2026-02-20T13:04:29.610 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T13:04:29.627 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T13:04:29.717 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221 branch: wip-vshankar-testing-20260219.125903 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} email: vshankar@redhat.com first_in_suite: false flavor: default job_id: '60221' kernel: client: branch: testing flavor: default kdb: 1 sha1: 8dec4b357aab872d3b63ec979924962a64be83dd sha1: 8dec4b357aab872d3b63ec979924962a64be83dd ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20260219.125903 ceph: cephfs: ec_profile: - disabled max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - slow metadata IO - SLOW_OPS - slow request sha1: 0917c15888a16c5bbbd9de28990cc81230360c9e subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 0917c15888a16c5bbbd9de28990cc81230360c9e kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20260219.125903 sha1: 0917c15888a16c5bbbd9de28990cc81230360c9e owner: scheduled_vshankar@soko04.front.sepia.ceph.com priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7416 sha1: 0917c15888a16c5bbbd9de28990cc81230360c9e sleep_before_teardown: 0 subset: 186/1024 suite: fs suite_branch: wip-vshankar-testing-20260219.125903 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0917c15888a16c5bbbd9de28990cc81230360c9e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0917c15888a16c5bbbd9de28990cc81230360c9e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVg369XTAGsxGp5kXdEnPXGGA4Uuk6fL4Xsa6VTxrzGPFFeYzI8CXxFzzK6F9IxaWyGrwDKs7UHQzVw5fXq4hI= trial034.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXddkYVFxKh0b89cgy/rUml4H/MfhVcBsoIgP892BEAMiqgduJbnxAqwgP/FsOH7Hg3jHbZgZjMoq5H1GWDB3A= trial127.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOWqui28rxjbu480CyaXKpoHW/FiMd6YXC8Q4qeWVMsLNFS7Wo5wIt2SdKbfhXKkC++zvDA6GNXXRc1y3XQh9gM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-20_09:38:02 tube: trial user: vshankar verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T13:04:29.717 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0917c15888a16c5bbbd9de28990cc81230360c9e/qa; will attempt to use it 2026-02-20T13:04:29.718 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0917c15888a16c5bbbd9de28990cc81230360c9e/qa/tasks 2026-02-20T13:04:29.718 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T13:04:29.719 INFO:teuthology.task.internal:Checking packages... 2026-02-20T13:04:29.719 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0917c15888a16c5bbbd9de28990cc81230360c9e' 2026-02-20T13:04:29.719 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T13:04:29.719 INFO:teuthology.packaging:ref: None 2026-02-20T13:04:29.719 INFO:teuthology.packaging:tag: None 2026-02-20T13:04:29.719 INFO:teuthology.packaging:branch: wip-vshankar-testing-20260219.125903 2026-02-20T13:04:29.719 INFO:teuthology.packaging:sha1: 0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:04:29.720 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20260219.125903 2026-02-20T13:04:29.951 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5390.g0917c158 2026-02-20T13:04:29.952 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T13:04:29.967 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T13:04:29.967 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T13:04:29.981 INFO:teuthology.task.internal:Saving configuration 2026-02-20T13:04:30.002 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T13:04:30.014 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T13:04:30.099 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial028.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 13:01:03.030306', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVg369XTAGsxGp5kXdEnPXGGA4Uuk6fL4Xsa6VTxrzGPFFeYzI8CXxFzzK6F9IxaWyGrwDKs7UHQzVw5fXq4hI='} 2026-02-20T13:04:30.155 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial034.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 13:01:03.029776', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXddkYVFxKh0b89cgy/rUml4H/MfhVcBsoIgP892BEAMiqgduJbnxAqwgP/FsOH7Hg3jHbZgZjMoq5H1GWDB3A='} 2026-02-20T13:04:30.211 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial127.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 13:01:03.030648', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOWqui28rxjbu480CyaXKpoHW/FiMd6YXC8Q4qeWVMsLNFS7Wo5wIt2SdKbfhXKkC++zvDA6GNXXRc1y3XQh9gM='} 2026-02-20T13:04:30.211 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T13:04:30.223 INFO:teuthology.task.internal:roles: ubuntu@trial028.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-20T13:04:30.223 INFO:teuthology.task.internal:roles: ubuntu@trial034.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-20T13:04:30.223 INFO:teuthology.task.internal:roles: ubuntu@trial127.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-20T13:04:30.223 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T13:04:30.415 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x773e4541a020>, signals=[15]) 2026-02-20T13:04:30.415 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T13:04:30.426 INFO:teuthology.task.internal:Opening connections... 2026-02-20T13:04:30.426 DEBUG:teuthology.task.internal:connecting to ubuntu@trial028.front.sepia.ceph.com 2026-02-20T13:04:30.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T13:04:30.489 DEBUG:teuthology.task.internal:connecting to ubuntu@trial034.front.sepia.ceph.com 2026-02-20T13:04:30.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T13:04:30.550 DEBUG:teuthology.task.internal:connecting to ubuntu@trial127.front.sepia.ceph.com 2026-02-20T13:04:30.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T13:04:30.613 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T13:04:30.624 DEBUG:teuthology.orchestra.run.trial028:> uname -m 2026-02-20T13:04:30.639 INFO:teuthology.orchestra.run.trial028.stdout:x86_64 2026-02-20T13:04:30.640 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:NAME="CentOS Stream" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="9" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:ID="centos" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel fedora" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="9" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el9" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;31" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://centos.org/" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T13:04:30.695 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T13:04:30.696 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-20T13:04:30.770 DEBUG:teuthology.orchestra.run.trial034:> uname -m 2026-02-20T13:04:30.786 INFO:teuthology.orchestra.run.trial034.stdout:x86_64 2026-02-20T13:04:30.786 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release 2026-02-20T13:04:30.841 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream" 2026-02-20T13:04:30.841 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9" 2026-02-20T13:04:30.841 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos" 2026-02-20T13:04:30.841 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora" 2026-02-20T13:04:30.841 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9" 2026-02-20T13:04:30.841 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9" 2026-02-20T13:04:30.841 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T13:04:30.842 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31" 2026-02-20T13:04:30.842 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon" 2026-02-20T13:04:30.842 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T13:04:30.842 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/" 2026-02-20T13:04:30.842 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T13:04:30.842 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T13:04:30.842 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T13:04:30.842 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server 2026-02-20T13:04:30.918 DEBUG:teuthology.orchestra.run.trial127:> uname -m 2026-02-20T13:04:30.933 INFO:teuthology.orchestra.run.trial127.stdout:x86_64 2026-02-20T13:04:30.933 DEBUG:teuthology.orchestra.run.trial127:> cat /etc/os-release 2026-02-20T13:04:30.988 INFO:teuthology.orchestra.run.trial127.stdout:NAME="CentOS Stream" 2026-02-20T13:04:30.988 INFO:teuthology.orchestra.run.trial127.stdout:VERSION="9" 2026-02-20T13:04:30.988 INFO:teuthology.orchestra.run.trial127.stdout:ID="centos" 2026-02-20T13:04:30.988 INFO:teuthology.orchestra.run.trial127.stdout:ID_LIKE="rhel fedora" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_ID="9" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:PLATFORM_ID="platform:el9" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:ANSI_COLOR="0;31" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:LOGO="fedora-logo-icon" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:HOME_URL="https://centos.org/" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T13:04:30.989 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T13:04:30.989 INFO:teuthology.lock.ops:Updating trial127.front.sepia.ceph.com on lock server 2026-02-20T13:04:31.054 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T13:04:31.066 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T13:04:31.077 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T13:04:31.077 DEBUG:teuthology.orchestra.run.trial028:> test '!' -e /home/ubuntu/cephtest 2026-02-20T13:04:31.078 DEBUG:teuthology.orchestra.run.trial034:> test '!' -e /home/ubuntu/cephtest 2026-02-20T13:04:31.080 DEBUG:teuthology.orchestra.run.trial127:> test '!' -e /home/ubuntu/cephtest 2026-02-20T13:04:31.094 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T13:04:31.105 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T13:04:31.105 DEBUG:teuthology.orchestra.run.trial028:> test -z $(ls -A /var/lib/ceph) 2026-02-20T13:04:31.133 DEBUG:teuthology.orchestra.run.trial034:> test -z $(ls -A /var/lib/ceph) 2026-02-20T13:04:31.135 DEBUG:teuthology.orchestra.run.trial127:> test -z $(ls -A /var/lib/ceph) 2026-02-20T13:04:31.150 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T13:04:31.340 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T13:04:31.359 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing', 'flavor': 'default', 'kdb': 1, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'} 2026-02-20T13:04:31.359 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing', 'flavor': 'default', 'kdb': 1, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}} 2026-02-20T13:04:31.359 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing', 'flavor': 'default', 'kdb': 1, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}}, timeout 300 2026-02-20T13:04:31.359 DEBUG:teuthology.orchestra.run.trial028:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T13:04:31.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:04:31.374 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-20T13:04:31.374 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-20T13:04:31.374 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-20T13:04:31.430 INFO:teuthology.orchestra.run.trial028.stdout:5.14.0-681.el9.x86_64 2026-02-20T13:04:31.430 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-20T13:04:31.430 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-20T13:04:31.430 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T13:04:31.430 INFO:teuthology.packaging:ref: None 2026-02-20T13:04:31.430 INFO:teuthology.packaging:tag: None 2026-02-20T13:04:31.430 INFO:teuthology.packaging:branch: testing 2026-02-20T13:04:31.430 INFO:teuthology.packaging:sha1: 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-20T13:04:31.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2026-02-20T13:04:31.563 DEBUG:teuthology.orchestra.run.trial028:> sudo yum upgrade -y linux-firmware 2026-02-20T13:04:41.875 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 913 kB/s | 8.9 MB 00:09 2026-02-20T13:05:09.823 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:27 2026-02-20T13:05:13.757 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 7.8 MB 00:01 2026-02-20T13:05:15.759 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-20T13:05:17.142 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-20T13:05:20.499 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 367 kB/s | 50 kB 00:00 2026-02-20T13:05:21.545 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T13:05:21.545 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T13:05:21.545 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T13:05:21.568 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-20T13:05:21.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-20T13:05:21.818 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-20T13:05:21.818 DEBUG:teuthology.orchestra.run.trial028:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-20T13:05:21.820 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial028.front.sepia.ceph.com to complete... 2026-02-20T13:05:28.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20 13:05:28 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-20T13:05:28.342 INFO:teuthology.orchestra.run.trial028.stderr:FINISHED --2026-02-20 13:05:28-- 2026-02-20T13:05:28.342 INFO:teuthology.orchestra.run.trial028.stderr:Total wall clock time: 6.5s 2026-02-20T13:05:28.342 INFO:teuthology.orchestra.run.trial028.stderr:Downloaded: 1 files, 370M in 6.4s (57.9 MB/s) 2026-02-20T13:05:28.346 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-20T13:05:28.347 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-20T13:05:29.477 INFO:teuthology.orchestra.run.trial028.stdout:Verifying... ######################################## 2026-02-20T13:05:29.528 INFO:teuthology.orchestra.run.trial028.stdout:Preparing... ######################################## 2026-02-20T13:05:29.546 INFO:teuthology.orchestra.run.trial028.stdout:Updating / installing... 2026-02-20T13:05:32.746 INFO:teuthology.orchestra.run.trial028.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-20T13:05:49.816 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial028.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-20T13:05:49.817 DEBUG:teuthology.orchestra.run.trial028:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-20T13:05:49.865 INFO:teuthology.orchestra.run.trial028.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-20T13:05:49.865 INFO:teuthology.orchestra.run.trial028.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-20T13:05:49.865 INFO:teuthology.orchestra.run.trial028.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-20T13:05:49.865 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-20T13:05:49.865 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-20T13:05:49.865 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-20T13:05:49.865 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-20T13:05:49.866 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-20T13:05:49.867 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-20T13:05:49.868 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-20T13:05:49.869 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-20T13:05:49.870 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-20T13:05:49.871 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-20T13:05:49.872 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-20T13:05:49.873 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-20T13:05:49.874 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-20T13:05:49.875 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-20T13:05:49.876 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-20T13:05:49.877 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-20T13:05:49.878 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-20T13:05:49.879 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-20T13:05:49.880 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-20T13:05:49.881 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-20T13:05:49.882 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-20T13:05:49.883 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-20T13:05:49.884 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-20T13:05:49.885 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-20T13:05:49.886 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-20T13:05:49.887 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-20T13:05:49.888 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-20T13:05:49.889 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-20T13:05:49.890 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-20T13:05:49.891 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-20T13:05:49.892 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-20T13:05:49.893 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-20T13:05:49.894 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-20T13:05:49.895 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-20T13:05:49.896 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-20T13:05:49.897 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-20T13:05:49.898 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-20T13:05:49.899 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-20T13:05:49.900 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-20T13:05:49.901 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-20T13:05:49.902 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-20T13:05:49.903 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-20T13:05:49.904 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-20T13:05:49.905 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-20T13:05:49.906 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-20T13:05:49.907 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-20T13:05:49.908 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-20T13:05:49.909 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-20T13:05:49.910 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-20T13:05:49.911 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-20T13:05:49.912 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-20T13:05:49.913 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-20T13:05:49.914 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-20T13:05:49.915 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-20T13:05:49.916 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-20T13:05:49.917 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-20T13:05:49.918 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-20T13:05:49.919 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-20T13:05:49.920 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-20T13:05:49.921 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-20T13:05:49.922 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-20T13:05:49.923 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-20T13:05:49.924 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-20T13:05:49.925 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-20T13:05:49.926 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-20T13:05:49.927 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-20T13:05:49.928 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-20T13:05:49.929 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-20T13:05:49.930 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-20T13:05:49.931 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-20T13:05:49.932 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-20T13:05:49.933 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-20T13:05:49.934 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-20T13:05:49.935 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-20T13:05:49.937 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-20T13:05:49.937 DEBUG:teuthology.orchestra.run.trial028:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout:postinstall scriptlet (using /bin/sh): 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout:for file in vmlinuz System.map config; do 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout: fi 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout:done 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-20T13:05:49.958 INFO:teuthology.orchestra.run.trial028.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-20T13:05:49.959 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-20T13:05:49.959 INFO:teuthology.orchestra.run.trial028.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-20T13:05:49.959 INFO:teuthology.orchestra.run.trial028.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-20T13:05:49.959 INFO:teuthology.orchestra.run.trial028.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-20T13:05:49.959 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-20T13:05:49.959 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -qi grub2-tools 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Name : grub2-tools 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Epoch : 1 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Version : 2.06 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Release : 120.el9 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Architecture: x86_64 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Group : Unspecified 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Size : 9108611 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:License : GPLv3+ 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Packager : builder@centos.org 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:Vendor : CentOS 2026-02-20T13:05:50.028 INFO:teuthology.orchestra.run.trial028.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout:Summary : Support tools for GRUB. 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout:Description : 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout:hardware devices. 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:05:50.029 INFO:teuthology.orchestra.run.trial028.stdout:This subpackage provides tools for support of all platforms. 2026-02-20T13:05:50.029 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-20T13:05:50.030 INFO:teuthology.task.kernel:Updating grub on trial028 to boot 6.19.0-g8dec4b357aab 2026-02-20T13:05:50.030 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-20T13:05:50.093 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-20T13:05:50.094 DEBUG:teuthology.orchestra.run.trial028:> sudo command -v grubby && echo yes || echo no 2026-02-20T13:05:50.157 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/grubby 2026-02-20T13:05:50.158 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-20T13:05:50.159 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-20T13:05:50.222 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-20T13:05:50.223 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-20T13:05:50.297 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-20T13:05:50.508 INFO:teuthology.orchestra.run.trial028.stderr:Generating grub configuration file ... 2026-02-20T13:05:50.576 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-20T13:05:50.583 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-20T13:05:50.837 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-20T13:05:50.845 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-20T13:05:50.879 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-20T13:05:50.886 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-20T13:05:50.918 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-20T13:05:50.925 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-20T13:05:50.948 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-20T13:05:50.954 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-20T13:05:51.042 INFO:teuthology.orchestra.run.trial028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-20T13:05:51.050 INFO:teuthology.orchestra.run.trial028.stderr:done 2026-02-20T13:05:51.052 DEBUG:teuthology.orchestra.run.trial028:> test -d /sys/firmware/efi 2026-02-20T13:05:51.068 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-20T13:05:51.133 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/BOOT 2026-02-20T13:05:51.134 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/centos 2026-02-20T13:05:51.135 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-20T13:05:51.200 INFO:teuthology.orchestra.run.trial028.stdout:no 2026-02-20T13:05:51.200 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-20T13:05:51.266 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-20T13:05:51.267 DEBUG:teuthology.orchestra.run.trial028:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-20T13:05:51.331 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial028 2026-02-20T13:05:51.331 DEBUG:teuthology.orchestra.run.trial028:> sudo bash -c ' 2026-02-20T13:05:51.331 DEBUG:teuthology.orchestra.run.trial028:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-20T13:05:51.331 DEBUG:teuthology.orchestra.run.trial028:> ' 2026-02-20T13:06:21.374 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-20T13:06:21.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T13:06:21.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T13:07:21.378 DEBUG:teuthology.orchestra.remote:timed out 2026-02-20T13:07:30.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T13:07:30.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T13:07:30.530 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-20T13:07:30.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T13:07:30.784 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.19.0-g8dec4b357aab"... 2026-02-20T13:07:30.785 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-20T13:07:30.863 INFO:teuthology.orchestra.run.trial028.stdout:6.19.0-g8dec4b357aab 2026-02-20T13:07:30.863 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-20T13:07:30.863 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-20T13:07:30.863 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-20T13:07:31.864 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2026-02-20T13:07:31.864 DEBUG:teuthology.orchestra.run.trial028:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T13:07:31.925 INFO:teuthology.orchestra.run.trial028.stdout:ttyS1 2026-02-20T13:07:31.959 DEBUG:teuthology.parallel:result is None 2026-02-20T13:07:31.960 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T13:07:31.972 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T13:07:31.972 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T13:07:31.976 DEBUG:teuthology.orchestra.run.trial034:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T13:07:31.978 DEBUG:teuthology.orchestra.run.trial127:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T13:07:32.009 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T13:07:32.021 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T13:07:32.037 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T13:07:32.038 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T13:07:32.053 DEBUG:teuthology.orchestra.run.trial034:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T13:07:32.056 DEBUG:teuthology.orchestra.run.trial127:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T13:07:32.106 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T13:07:32.119 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T13:07:32.119 DEBUG:teuthology.orchestra.run.trial034:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T13:07:32.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:07:32.136 DEBUG:teuthology.orchestra.run.trial127:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T13:07:32.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:07:32.152 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T13:07:32.155 DEBUG:teuthology.orchestra.run.trial034:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T13:07:32.179 DEBUG:teuthology.orchestra.run.trial127:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T13:07:32.202 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T13:07:32.208 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T13:07:32.210 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T13:07:32.219 INFO:teuthology.orchestra.run.trial127.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T13:07:32.227 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T13:07:32.228 INFO:teuthology.orchestra.run.trial127.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T13:07:32.231 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T13:07:32.244 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T13:07:32.244 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T13:07:32.248 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T13:07:32.254 DEBUG:teuthology.orchestra.run.trial127:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T13:07:32.300 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T13:07:32.319 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T13:07:32.319 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T13:07:32.323 DEBUG:teuthology.orchestra.run.trial034:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T13:07:32.325 DEBUG:teuthology.orchestra.run.trial127:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T13:07:32.358 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:07:32.541 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:07:32.597 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:07:32.735 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:07:32.789 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:07:32.789 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T13:07:32.843 DEBUG:teuthology.orchestra.run.trial034:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:07:32.933 DEBUG:teuthology.orchestra.run.trial034:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:07:32.959 DEBUG:teuthology.orchestra.run.trial034:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:07:33.091 DEBUG:teuthology.orchestra.run.trial034:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:07:33.116 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:07:33.116 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T13:07:33.182 DEBUG:teuthology.orchestra.run.trial127:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:07:33.298 DEBUG:teuthology.orchestra.run.trial127:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:07:33.325 DEBUG:teuthology.orchestra.run.trial127:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:07:33.465 DEBUG:teuthology.orchestra.run.trial127:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:07:33.490 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:07:33.490 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T13:07:33.554 DEBUG:teuthology.orchestra.run.trial028:> sudo service rsyslog restart 2026-02-20T13:07:33.556 DEBUG:teuthology.orchestra.run.trial034:> sudo service rsyslog restart 2026-02-20T13:07:33.558 DEBUG:teuthology.orchestra.run.trial127:> sudo service rsyslog restart 2026-02-20T13:07:33.585 INFO:teuthology.orchestra.run.trial034.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:07:33.616 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:07:33.621 INFO:teuthology.orchestra.run.trial127.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:07:34.140 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T13:07:34.153 INFO:teuthology.task.internal:Starting timer... 2026-02-20T13:07:34.153 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T13:07:34.174 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T13:07:34.189 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2026-02-20T13:07:34.189 DEBUG:teuthology.orchestra.run.trial028:> sudo service auditd rotate 2026-02-20T13:07:34.254 INFO:teuthology.orchestra.run.trial028.stdout:Rotating logs: 2026-02-20T13:07:34.257 DEBUG:teuthology.orchestra.run.trial034:> sudo service auditd rotate 2026-02-20T13:07:34.287 INFO:teuthology.orchestra.run.trial034.stdout:Rotating logs: 2026-02-20T13:07:34.289 DEBUG:teuthology.orchestra.run.trial127:> sudo service auditd rotate 2026-02-20T13:07:34.318 INFO:teuthology.orchestra.run.trial127.stdout:Rotating logs: 2026-02-20T13:07:34.320 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T13:07:34.320 DEBUG:teuthology.orchestra.run.trial028:> /usr/sbin/getenforce 2026-02-20T13:07:34.357 INFO:teuthology.orchestra.run.trial028.stdout:Permissive 2026-02-20T13:07:34.357 DEBUG:teuthology.orchestra.run.trial034:> /usr/sbin/getenforce 2026-02-20T13:07:34.373 INFO:teuthology.orchestra.run.trial034.stdout:Permissive 2026-02-20T13:07:34.373 DEBUG:teuthology.orchestra.run.trial127:> /usr/sbin/getenforce 2026-02-20T13:07:34.391 INFO:teuthology.orchestra.run.trial127.stdout:Permissive 2026-02-20T13:07:34.391 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial028.front.sepia.ceph.com': 'permissive', 'ubuntu@trial034.front.sepia.ceph.com': 'permissive', 'ubuntu@trial127.front.sepia.ceph.com': 'permissive'} 2026-02-20T13:07:34.392 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-20T13:07:34.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:07:34.455 DEBUG:teuthology.orchestra.run.trial034:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-20T13:07:34.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:07:34.483 DEBUG:teuthology.orchestra.run.trial127:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-20T13:07:34.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:07:34.510 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T13:07:34.510 DEBUG:teuthology.orchestra.run.trial028:> sudo /usr/sbin/setenforce permissive 2026-02-20T13:07:34.566 DEBUG:teuthology.orchestra.run.trial034:> sudo /usr/sbin/setenforce permissive 2026-02-20T13:07:34.591 DEBUG:teuthology.orchestra.run.trial127:> sudo /usr/sbin/setenforce permissive 2026-02-20T13:07:34.616 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T13:07:34.641 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-20T13:07:34.645 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-20T13:07:34.917 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T13:07:34.928 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T13:07:34.929 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial028.front.sepia.ceph.com,trial034.front.sepia.ceph.com,trial127.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T13:11:24.530 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial028.front.sepia.ceph.com'), Remote(name='ubuntu@trial034.front.sepia.ceph.com'), Remote(name='ubuntu@trial127.front.sepia.ceph.com')] 2026-02-20T13:11:24.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T13:11:24.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T13:11:24.617 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-20T13:11:24.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T13:11:24.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-20T13:11:24.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T13:11:24.784 DEBUG:teuthology.orchestra.run.trial034:> true 2026-02-20T13:11:24.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-20T13:11:24.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-20T13:11:24.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T13:11:24.946 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-20T13:11:25.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-20T13:11:25.024 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T13:11:25.039 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T13:11:25.039 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T13:11:25.040 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:11:25.044 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T13:11:25.044 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:11:25.046 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T13:11:25.046 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:11:25.073 INFO:teuthology.orchestra.run.trial034.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T13:11:25.084 INFO:teuthology.orchestra.run.trial034.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T13:11:25.093 INFO:teuthology.orchestra.run.trial127.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T13:11:25.101 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T13:11:25.105 INFO:teuthology.orchestra.run.trial034.stderr:sudo: ntpd: command not found 2026-02-20T13:11:25.105 INFO:teuthology.orchestra.run.trial127.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T13:11:25.114 INFO:teuthology.orchestra.run.trial034.stdout:506 Cannot talk to daemon 2026-02-20T13:11:25.125 INFO:teuthology.orchestra.run.trial034.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T13:11:25.125 INFO:teuthology.orchestra.run.trial127.stderr:sudo: ntpd: command not found 2026-02-20T13:11:25.126 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T13:11:25.135 INFO:teuthology.orchestra.run.trial127.stdout:506 Cannot talk to daemon 2026-02-20T13:11:25.136 INFO:teuthology.orchestra.run.trial034.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T13:11:25.146 INFO:teuthology.orchestra.run.trial127.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T13:11:25.158 INFO:teuthology.orchestra.run.trial127.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T13:11:25.169 INFO:teuthology.orchestra.run.trial028.stderr:sudo: ntpd: command not found 2026-02-20T13:11:25.180 INFO:teuthology.orchestra.run.trial034.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:11:25.190 INFO:teuthology.orchestra.run.trial028.stdout:506 Cannot talk to daemon 2026-02-20T13:11:25.205 INFO:teuthology.orchestra.run.trial127.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:11:25.215 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T13:11:25.240 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T13:11:25.313 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:11:25.698 INFO:teuthology.orchestra.run.trial034.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:11:25.699 INFO:teuthology.orchestra.run.trial034.stdout:=============================================================================== 2026-02-20T13:11:25.699 INFO:teuthology.orchestra.run.trial034.stdout:^? 144.202.41.38.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:25.699 INFO:teuthology.orchestra.run.trial034.stdout:^? usmoi.meezy.link 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:25.699 INFO:teuthology.orchestra.run.trial034.stdout:^? ntp.netlinkify.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:25.699 INFO:teuthology.orchestra.run.trial034.stdout:^? t2.time.gq1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:25.834 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:11:25.834 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-20T13:11:25.835 INFO:teuthology.orchestra.run.trial028.stdout:^? 69.9.131.124 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:25.835 INFO:teuthology.orchestra.run.trial028.stdout:^? sensei.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:25.835 INFO:teuthology.orchestra.run.trial028.stdout:^? 72-14-182-49.ip.linodeus> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:25.835 INFO:teuthology.orchestra.run.trial028.stdout:^? 23.157.160.168 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:30.714 INFO:teuthology.orchestra.run.trial127.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:11:30.714 INFO:teuthology.orchestra.run.trial127.stdout:=============================================================================== 2026-02-20T13:11:30.714 INFO:teuthology.orchestra.run.trial127.stdout:^? 172-232-15-202.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:30.714 INFO:teuthology.orchestra.run.trial127.stdout:^? 99-28-14-242.lightspeed.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:30.714 INFO:teuthology.orchestra.run.trial127.stdout:^? time.trtnw.net 2 6 1 0 -462us[ -462us] +/- 40ms 2026-02-20T13:11:30.714 INFO:teuthology.orchestra.run.trial127.stdout:^? jane.qotw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T13:11:30.716 INFO:teuthology.run_tasks:Running task install... 2026-02-20T13:11:30.730 DEBUG:teuthology.task.install:project ceph 2026-02-20T13:11:30.730 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0917c15888a16c5bbbd9de28990cc81230360c9e'}} 2026-02-20T13:11:30.730 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0917c15888a16c5bbbd9de28990cc81230360c9e'} 2026-02-20T13:11:30.731 INFO:teuthology.task.install:Using flavor: default 2026-02-20T13:11:30.739 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T13:11:30.739 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-20T13:11:30.740 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0917c15888a16c5bbbd9de28990cc81230360c9e', 'tag': None, 'wait_for_package': False} 2026-02-20T13:11:30.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:11:30.743 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0917c15888a16c5bbbd9de28990cc81230360c9e', 'tag': None, 'wait_for_package': False} 2026-02-20T13:11:30.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:11:30.745 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0917c15888a16c5bbbd9de28990cc81230360c9e', 'tag': None, 'wait_for_package': False} 2026-02-20T13:11:30.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:11:30.978 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/ 2026-02-20T13:11:30.978 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5390.g0917c158 2026-02-20T13:11:31.092 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/ 2026-02-20T13:11:31.092 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5390.g0917c158 2026-02-20T13:11:31.093 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/ 2026-02-20T13:11:31.093 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5390.g0917c158 2026-02-20T13:11:31.275 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T13:11:31.275 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:11:31.276 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T13:11:31.277 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T13:11:31.277 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:11:31.277 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T13:11:31.287 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T13:11:31.287 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:11:31.287 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T13:11:31.301 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-20T13:11:31.302 DEBUG:teuthology.orchestra.run.trial127:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0917c15888a16c5bbbd9de28990cc81230360c9e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T13:11:31.312 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-20T13:11:31.312 DEBUG:teuthology.orchestra.run.trial034:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0917c15888a16c5bbbd9de28990cc81230360c9e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T13:11:31.333 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-20T13:11:31.333 DEBUG:teuthology.orchestra.run.trial028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0917c15888a16c5bbbd9de28990cc81230360c9e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T13:11:31.368 DEBUG:teuthology.orchestra.run.trial127:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T13:11:31.376 DEBUG:teuthology.orchestra.run.trial034:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T13:11:31.430 DEBUG:teuthology.orchestra.run.trial028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T13:11:31.441 DEBUG:teuthology.orchestra.run.trial127:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T13:11:31.452 DEBUG:teuthology.orchestra.run.trial034:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T13:11:31.505 INFO:teuthology.orchestra.run.trial127.stdout:check_obsoletes = 1 2026-02-20T13:11:31.507 DEBUG:teuthology.orchestra.run.trial127:> sudo yum clean all 2026-02-20T13:11:31.508 DEBUG:teuthology.orchestra.run.trial028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T13:11:31.516 INFO:teuthology.orchestra.run.trial034.stdout:check_obsoletes = 1 2026-02-20T13:11:31.518 DEBUG:teuthology.orchestra.run.trial034:> sudo yum clean all 2026-02-20T13:11:31.564 INFO:teuthology.orchestra.run.trial028.stdout:check_obsoletes = 1 2026-02-20T13:11:31.567 DEBUG:teuthology.orchestra.run.trial028:> sudo yum clean all 2026-02-20T13:11:31.669 INFO:teuthology.orchestra.run.trial127.stdout:41 files removed 2026-02-20T13:11:31.675 INFO:teuthology.orchestra.run.trial034.stdout:41 files removed 2026-02-20T13:11:31.685 DEBUG:teuthology.orchestra.run.trial127:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-20T13:11:31.690 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-20T13:11:31.736 INFO:teuthology.orchestra.run.trial028.stdout:41 files removed 2026-02-20T13:11:31.755 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-20T13:11:32.079 INFO:teuthology.orchestra.run.trial127.stdout:ceph packages for x86_64 369 kB/s | 91 kB 00:00 2026-02-20T13:11:32.083 INFO:teuthology.orchestra.run.trial034.stdout:ceph packages for x86_64 368 kB/s | 91 kB 00:00 2026-02-20T13:11:32.122 INFO:teuthology.orchestra.run.trial028.stdout:ceph packages for x86_64 731 kB/s | 91 kB 00:00 2026-02-20T13:11:32.221 INFO:teuthology.orchestra.run.trial034.stdout:ceph noarch packages 211 kB/s | 24 kB 00:00 2026-02-20T13:11:32.223 INFO:teuthology.orchestra.run.trial127.stdout:ceph noarch packages 202 kB/s | 24 kB 00:00 2026-02-20T13:11:32.268 INFO:teuthology.orchestra.run.trial028.stdout:ceph noarch packages 200 kB/s | 24 kB 00:00 2026-02-20T13:11:32.348 INFO:teuthology.orchestra.run.trial034.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-20T13:11:32.348 INFO:teuthology.orchestra.run.trial127.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-20T13:11:32.396 INFO:teuthology.orchestra.run.trial028.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-20T13:11:33.300 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.9 MB 00:00 2026-02-20T13:11:37.522 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.9 MB 00:05 2026-02-20T13:11:38.189 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 27 MB 00:04 2026-02-20T13:11:40.970 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-20T13:11:45.154 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 27 MB 00:03 2026-02-20T13:11:45.363 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 27 MB 00:07 2026-02-20T13:11:47.357 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 7.8 MB 00:06 2026-02-20T13:11:48.555 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 20 kB 00:00 2026-02-20T13:11:49.853 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 7.8 MB 00:02 2026-02-20T13:11:49.902 INFO:teuthology.orchestra.run.trial034.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-20T13:11:51.182 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 20 kB 00:00 2026-02-20T13:11:51.675 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 47 MB/s | 20 MB 00:00 2026-02-20T13:11:53.235 INFO:teuthology.orchestra.run.trial034.stdout:lab-extras 368 kB/s | 50 kB 00:00 2026-02-20T13:11:54.426 INFO:teuthology.orchestra.run.trial034.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T13:11:54.426 INFO:teuthology.orchestra.run.trial034.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T13:11:54.432 INFO:teuthology.orchestra.run.trial034.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-20T13:11:54.433 INFO:teuthology.orchestra.run.trial034.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-20T13:11:54.433 INFO:teuthology.orchestra.run.trial034.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-20T13:11:54.434 INFO:teuthology.orchestra.run.trial034.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-20T13:11:54.434 INFO:teuthology.orchestra.run.trial034.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-20T13:11:54.436 INFO:teuthology.orchestra.run.trial034.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-20T13:11:54.436 INFO:teuthology.orchestra.run.trial034.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-20T13:11:54.462 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T13:11:54.466 INFO:teuthology.orchestra.run.trial034.stdout:======================================================================================= 2026-02-20T13:11:54.466 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repository Size 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout:======================================================================================= 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph x86_64 2:20.3.0-5390.g0917c158.el9 ceph 6.5 k 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph-base x86_64 2:20.3.0-5390.g0917c158.el9 ceph 5.2 M 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph-fuse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 987 k 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5390.g0917c158.el9 ceph 147 k 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr x86_64 2:20.3.0-5390.g0917c158.el9 ceph 936 k 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 184 k 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 51 M 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 7.4 M 2026-02-20T13:11:54.467 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-rook noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 50 k 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 167 k 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-classic x86_64 2:20.3.0-5390.g0917c158.el9 ceph 16 M 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: ceph-radosgw x86_64 2:20.3.0-5390.g0917c158.el9 ceph 13 M 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: ceph-test x86_64 2:20.3.0-5390.g0917c158.el9 ceph 78 M 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: ceph-volume noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 301 k 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: cephadm noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 1.0 M 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: cephfs-mirror x86_64 2:20.3.0-5390.g0917c158.el9 ceph 244 k 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: cephfs-shell x86_64 2:20.3.0-5390.g0917c158.el9 ceph 27 k 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: cephfs-top noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 18 k 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-20T13:11:54.468 INFO:teuthology.orchestra.run.trial034.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-devel x86_64 2:20.3.0-5390.g0917c158.el9 ceph 37 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 909 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: librados-devel x86_64 2:20.3.0-5390.g0917c158.el9 ceph 123 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: python3-cephfs x86_64 2:20.3.0-5390.g0917c158.el9 ceph 204 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: python3-rados x86_64 2:20.3.0-5390.g0917c158.el9 ceph 324 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: python3-rbd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 305 k 2026-02-20T13:11:54.469 INFO:teuthology.orchestra.run.trial034.stdout: python3-rgw x86_64 2:20.3.0-5390.g0917c158.el9 ceph 100 k 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: rbd-fuse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 84 k 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: rbd-mirror x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.9 M 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: rbd-nbd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 172 k 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout:Upgrading: 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: librados2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 3.5 M 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: librbd1 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.8 M 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout:Installing dependencies: 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T13:11:54.470 INFO:teuthology.orchestra.run.trial034.stdout: ceph-common x86_64 2:20.3.0-5390.g0917c158.el9 ceph 24 M 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 57 k 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mds x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.4 M 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 297 k 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mon x86_64 2:20.3.0-5390.g0917c158.el9 ceph 5.0 M 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-crimson x86_64 2:20.3.0-5390.g0917c158.el9 ceph 19 M 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 17 k 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-selinux x86_64 2:20.3.0-5390.g0917c158.el9 ceph 25 k 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T13:11:54.471 INFO:teuthology.orchestra.run.trial034.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 26 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libcephsqlite x86_64 2:20.3.0-5390.g0917c158.el9 ceph 159 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T13:11:54.472 INFO:teuthology.orchestra.run.trial034.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: libradosstriper1 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 248 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: librgw2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 6.5 M 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T13:11:54.473 INFO:teuthology.orchestra.run.trial034.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T13:11:54.474 INFO:teuthology.orchestra.run.trial034.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-argparse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 45 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-common x86_64 2:20.3.0-5390.g0917c158.el9 ceph 185 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-20T13:11:54.475 INFO:teuthology.orchestra.run.trial034.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T13:11:54.476 INFO:teuthology.orchestra.run.trial034.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T13:11:54.477 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T13:11:54.478 INFO:teuthology.orchestra.run.trial034.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T13:11:54.479 INFO:teuthology.orchestra.run.trial034.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout:Installing weak dependencies: 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout:======================================================================================= 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout:Install 163 Packages 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout:Upgrade 2 Packages 2026-02-20T13:11:54.480 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:11:54.481 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 327 M 2026-02-20T13:11:54.481 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T13:11:55.430 INFO:teuthology.orchestra.run.trial034.stdout:(1/165): ceph-20.3.0-5390.g0917c158.el9.x86_64. 35 kB/s | 6.5 kB 00:00 2026-02-20T13:11:55.569 INFO:teuthology.orchestra.run.trial034.stdout:(2/165): ceph-fuse-20.3.0-5390.g0917c158.el9.x8 7.0 MB/s | 987 kB 00:00 2026-02-20T13:11:55.621 INFO:teuthology.orchestra.run.trial034.stdout:(3/165): ceph-immutable-object-cache-20.3.0-539 2.8 MB/s | 147 kB 00:00 2026-02-20T13:11:55.639 INFO:teuthology.orchestra.run.trial034.stdout:(4/165): ceph-base-20.3.0-5390.g0917c158.el9.x8 13 MB/s | 5.2 MB 00:00 2026-02-20T13:11:55.694 INFO:teuthology.orchestra.run.trial034.stdout:(5/165): ceph-mgr-20.3.0-5390.g0917c158.el9.x86 17 MB/s | 936 kB 00:00 2026-02-20T13:11:55.810 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-20T13:11:55.846 INFO:teuthology.orchestra.run.trial034.stdout:(6/165): ceph-mds-20.3.0-5390.g0917c158.el9.x86 11 MB/s | 2.4 MB 00:00 2026-02-20T13:11:55.906 INFO:teuthology.orchestra.run.trial034.stdout:(7/165): ceph-osd-20.3.0-5390.g0917c158.el9.x86 2.7 MB/s | 167 kB 00:00 2026-02-20T13:11:55.929 INFO:teuthology.orchestra.run.trial034.stdout:(8/165): ceph-mon-20.3.0-5390.g0917c158.el9.x86 21 MB/s | 5.0 MB 00:00 2026-02-20T13:11:56.388 INFO:teuthology.orchestra.run.trial034.stdout:(9/165): ceph-common-20.3.0-5390.g0917c158.el9. 21 MB/s | 24 MB 00:01 2026-02-20T13:11:56.774 INFO:teuthology.orchestra.run.trial034.stdout:(10/165): ceph-osd-crimson-20.3.0-5390.g0917c15 23 MB/s | 19 MB 00:00 2026-02-20T13:11:56.786 INFO:teuthology.orchestra.run.trial034.stdout:(11/165): ceph-selinux-20.3.0-5390.g0917c158.el 2.0 MB/s | 25 kB 00:00 2026-02-20T13:11:56.933 INFO:teuthology.orchestra.run.trial034.stdout:(12/165): ceph-radosgw-20.3.0-5390.g0917c158.el 24 MB/s | 13 MB 00:00 2026-02-20T13:11:56.973 INFO:teuthology.orchestra.run.trial034.stdout:(13/165): cephfs-mirror-20.3.0-5390.g0917c158.e 5.9 MB/s | 244 kB 00:00 2026-02-20T13:11:57.008 INFO:teuthology.orchestra.run.trial034.stdout:(14/165): cephfs-shell-20.3.0-5390.g0917c158.el 781 kB/s | 27 kB 00:00 2026-02-20T13:11:57.044 INFO:teuthology.orchestra.run.trial034.stdout:(15/165): libcephfs-devel-20.3.0-5390.g0917c158 1.0 MB/s | 37 kB 00:00 2026-02-20T13:11:57.076 INFO:teuthology.orchestra.run.trial028.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T13:11:57.077 INFO:teuthology.orchestra.run.trial028.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T13:11:57.079 INFO:teuthology.orchestra.run.trial034.stdout:(16/165): libcephfs-proxy2-20.3.0-5390.g0917c15 724 kB/s | 26 kB 00:00 2026-02-20T13:11:57.082 INFO:teuthology.orchestra.run.trial028.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-20T13:11:57.082 INFO:teuthology.orchestra.run.trial028.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-20T13:11:57.083 INFO:teuthology.orchestra.run.trial028.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-20T13:11:57.083 INFO:teuthology.orchestra.run.trial028.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-20T13:11:57.084 INFO:teuthology.orchestra.run.trial028.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-20T13:11:57.086 INFO:teuthology.orchestra.run.trial028.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-20T13:11:57.086 INFO:teuthology.orchestra.run.trial028.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-20T13:11:57.114 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T13:11:57.119 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-20T13:11:57.119 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph x86_64 2:20.3.0-5390.g0917c158.el9 ceph 6.5 k 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base x86_64 2:20.3.0-5390.g0917c158.el9 ceph 5.2 M 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 987 k 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5390.g0917c158.el9 ceph 147 k 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr x86_64 2:20.3.0-5390.g0917c158.el9 ceph 936 k 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 184 k 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 51 M 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 7.4 M 2026-02-20T13:11:57.120 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 50 k 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 167 k 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-classic x86_64 2:20.3.0-5390.g0917c158.el9 ceph 16 M 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw x86_64 2:20.3.0-5390.g0917c158.el9 ceph 13 M 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test x86_64 2:20.3.0-5390.g0917c158.el9 ceph 78 M 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 301 k 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: cephadm noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 1.0 M 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-mirror x86_64 2:20.3.0-5390.g0917c158.el9 ceph 244 k 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-shell x86_64 2:20.3.0-5390.g0917c158.el9 ceph 27 k 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-top noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 18 k 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-20T13:11:57.121 INFO:teuthology.orchestra.run.trial028.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel x86_64 2:20.3.0-5390.g0917c158.el9 ceph 37 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 909 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel x86_64 2:20.3.0-5390.g0917c158.el9 ceph 123 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs x86_64 2:20.3.0-5390.g0917c158.el9 ceph 204 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados x86_64 2:20.3.0-5390.g0917c158.el9 ceph 324 k 2026-02-20T13:11:57.122 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 305 k 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw x86_64 2:20.3.0-5390.g0917c158.el9 ceph 100 k 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 84 k 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.9 M 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 172 k 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: librados2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 3.5 M 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: librbd1 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.8 M 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-20T13:11:57.123 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common x86_64 2:20.3.0-5390.g0917c158.el9 ceph 24 M 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 57 k 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.4 M 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 297 k 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon x86_64 2:20.3.0-5390.g0917c158.el9 ceph 5.0 M 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson x86_64 2:20.3.0-5390.g0917c158.el9 ceph 19 M 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 17 k 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux x86_64 2:20.3.0-5390.g0917c158.el9 ceph 25 k 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T13:11:57.124 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T13:11:57.125 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T13:11:57.125 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T13:11:57.125 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T13:11:57.125 INFO:teuthology.orchestra.run.trial028.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T13:11:57.125 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T13:11:57.125 INFO:teuthology.orchestra.run.trial028.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T13:11:57.125 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T13:11:57.125 INFO:teuthology.orchestra.run.trial028.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 26 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite x86_64 2:20.3.0-5390.g0917c158.el9 ceph 159 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 248 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T13:11:57.126 INFO:teuthology.orchestra.run.trial028.stdout: librgw2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 6.5 M 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T13:11:57.127 INFO:teuthology.orchestra.run.trial028.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T13:11:57.128 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 45 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common x86_64 2:20.3.0-5390.g0917c158.el9 ceph 185 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T13:11:57.129 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T13:11:57.130 INFO:teuthology.orchestra.run.trial028.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T13:11:57.131 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T13:11:57.132 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T13:11:57.133 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-20T13:11:57.134 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T13:11:57.135 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:11:57.135 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T13:11:57.135 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-20T13:11:57.135 INFO:teuthology.orchestra.run.trial028.stdout:Install 163 Packages 2026-02-20T13:11:57.135 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 2 Packages 2026-02-20T13:11:57.135 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:11:57.136 INFO:teuthology.orchestra.run.trial034.stdout:(17/165): libcephfs2-20.3.0-5390.g0917c158.el9. 17 MB/s | 909 kB 00:00 2026-02-20T13:11:57.136 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 327 M 2026-02-20T13:11:57.136 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T13:11:57.177 INFO:teuthology.orchestra.run.trial034.stdout:(18/165): ceph-osd-classic-20.3.0-5390.g0917c15 12 MB/s | 16 MB 00:01 2026-02-20T13:11:57.178 INFO:teuthology.orchestra.run.trial034.stdout:(19/165): libcephsqlite-20.3.0-5390.g0917c158.e 3.4 MB/s | 159 kB 00:00 2026-02-20T13:11:57.207 INFO:teuthology.orchestra.run.trial034.stdout:(20/165): libradosstriper1-20.3.0-5390.g0917c15 8.3 MB/s | 248 kB 00:00 2026-02-20T13:11:57.211 INFO:teuthology.orchestra.run.trial034.stdout:(21/165): librados-devel-20.3.0-5390.g0917c158. 3.5 MB/s | 123 kB 00:00 2026-02-20T13:11:57.261 INFO:teuthology.orchestra.run.trial034.stdout:(22/165): python3-ceph-argparse-20.3.0-5390.g09 908 kB/s | 45 kB 00:00 2026-02-20T13:11:57.313 INFO:teuthology.orchestra.run.trial034.stdout:(23/165): python3-ceph-common-20.3.0-5390.g0917 3.5 MB/s | 185 kB 00:00 2026-02-20T13:11:57.366 INFO:teuthology.orchestra.run.trial034.stdout:(24/165): python3-cephfs-20.3.0-5390.g0917c158. 3.8 MB/s | 204 kB 00:00 2026-02-20T13:11:57.422 INFO:teuthology.orchestra.run.trial034.stdout:(25/165): python3-rados-20.3.0-5390.g0917c158.e 5.6 MB/s | 324 kB 00:00 2026-02-20T13:11:57.461 INFO:teuthology.orchestra.run.trial034.stdout:(26/165): librgw2-20.3.0-5390.g0917c158.el9.x86 25 MB/s | 6.5 MB 00:00 2026-02-20T13:11:57.466 INFO:teuthology.orchestra.run.trial034.stdout:(27/165): python3-rbd-20.3.0-5390.g0917c158.el9 6.8 MB/s | 305 kB 00:00 2026-02-20T13:11:57.491 INFO:teuthology.orchestra.run.trial034.stdout:(28/165): python3-rgw-20.3.0-5390.g0917c158.el9 3.3 MB/s | 100 kB 00:00 2026-02-20T13:11:57.494 INFO:teuthology.orchestra.run.trial034.stdout:(29/165): rbd-fuse-20.3.0-5390.g0917c158.el9.x8 2.9 MB/s | 84 kB 00:00 2026-02-20T13:11:57.547 INFO:teuthology.orchestra.run.trial034.stdout:(30/165): rbd-nbd-20.3.0-5390.g0917c158.el9.x86 3.2 MB/s | 172 kB 00:00 2026-02-20T13:11:57.598 INFO:teuthology.orchestra.run.trial034.stdout:(31/165): ceph-grafana-dashboards-20.3.0-5390.g 1.1 MB/s | 57 kB 00:00 2026-02-20T13:11:57.622 INFO:teuthology.orchestra.run.trial034.stdout:(32/165): rbd-mirror-20.3.0-5390.g0917c158.el9. 22 MB/s | 2.9 MB 00:00 2026-02-20T13:11:57.627 INFO:teuthology.orchestra.run.trial034.stdout:(33/165): ceph-mgr-cephadm-20.3.0-5390.g0917c15 6.2 MB/s | 184 kB 00:00 2026-02-20T13:11:57.920 INFO:teuthology.orchestra.run.trial028.stdout:(1/165): ceph-20.3.0-5390.g0917c158.el9.x86_64. 25 kB/s | 6.5 kB 00:00 2026-02-20T13:11:57.976 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - CRB 776 kB/s | 7.8 MB 00:10 2026-02-20T13:11:58.389 INFO:teuthology.orchestra.run.trial034.stdout:(34/165): ceph-mgr-diskprediction-local-20.3.0- 9.7 MB/s | 7.4 MB 00:00 2026-02-20T13:11:58.443 INFO:teuthology.orchestra.run.trial034.stdout:(35/165): ceph-mgr-modules-core-20.3.0-5390.g09 5.4 MB/s | 297 kB 00:00 2026-02-20T13:11:58.491 INFO:teuthology.orchestra.run.trial034.stdout:(36/165): ceph-mgr-rook-20.3.0-5390.g0917c158.e 1.0 MB/s | 50 kB 00:00 2026-02-20T13:11:58.542 INFO:teuthology.orchestra.run.trial034.stdout:(37/165): ceph-prometheus-alerts-20.3.0-5390.g0 342 kB/s | 17 kB 00:00 2026-02-20T13:11:58.571 INFO:teuthology.orchestra.run.trial028.stdout:(2/165): ceph-fuse-20.3.0-5390.g0917c158.el9.x8 1.5 MB/s | 987 kB 00:00 2026-02-20T13:11:58.596 INFO:teuthology.orchestra.run.trial034.stdout:(38/165): ceph-volume-20.3.0-5390.g0917c158.el9 5.5 MB/s | 301 kB 00:00 2026-02-20T13:11:58.679 INFO:teuthology.orchestra.run.trial028.stdout:(3/165): ceph-immutable-object-cache-20.3.0-539 1.3 MB/s | 147 kB 00:00 2026-02-20T13:11:58.760 INFO:teuthology.orchestra.run.trial034.stdout:(39/165): cephadm-20.3.0-5390.g0917c158.el9.noa 6.2 MB/s | 1.0 MB 00:00 2026-02-20T13:11:58.809 INFO:teuthology.orchestra.run.trial034.stdout:(40/165): cephfs-top-20.3.0-5390.g0917c158.el9. 370 kB/s | 18 kB 00:00 2026-02-20T13:11:59.123 INFO:teuthology.orchestra.run.trial028.stdout:(4/165): ceph-base-20.3.0-5390.g0917c158.el9.x8 3.6 MB/s | 5.2 MB 00:01 2026-02-20T13:11:59.325 INFO:teuthology.orchestra.run.trial028.stdout:(5/165): ceph-mgr-20.3.0-5390.g0917c158.el9.x86 4.6 MB/s | 936 kB 00:00 2026-02-20T13:11:59.486 INFO:teuthology.orchestra.run.trial028.stdout:(6/165): ceph-mds-20.3.0-5390.g0917c158.el9.x86 2.9 MB/s | 2.4 MB 00:00 2026-02-20T13:11:59.578 INFO:teuthology.orchestra.run.trial034.stdout:(41/165): cryptsetup-2.8.1-3.el9.x86_64.rpm 457 kB/s | 351 kB 00:00 2026-02-20T13:11:59.587 INFO:teuthology.orchestra.run.trial028.stdout:(7/165): ceph-osd-20.3.0-5390.g0917c158.el9.x86 1.6 MB/s | 167 kB 00:00 2026-02-20T13:11:59.944 INFO:teuthology.orchestra.run.trial034.stdout:(42/165): ceph-mgr-dashboard-20.3.0-5390.g0917c 22 MB/s | 51 MB 00:02 2026-02-20T13:11:59.979 INFO:teuthology.orchestra.run.trial028.stdout:(8/165): ceph-mon-20.3.0-5390.g0917c158.el9.x86 7.6 MB/s | 5.0 MB 00:00 2026-02-20T13:12:00.048 INFO:teuthology.orchestra.run.trial034.stdout:(43/165): ceph-test-20.3.0-5390.g0917c158.el9.x 24 MB/s | 78 MB 00:03 2026-02-20T13:12:00.527 INFO:teuthology.orchestra.run.trial034.stdout:(44/165): ledmon-libs-1.1.0-3.el9.x86_64.rpm 69 kB/s | 40 kB 00:00 2026-02-20T13:12:00.551 INFO:teuthology.orchestra.run.trial034.stdout:(45/165): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.2 MB/s | 2.1 MB 00:00 2026-02-20T13:12:00.567 INFO:teuthology.orchestra.run.trial034.stdout:(46/165): libatomic-11.5.0-14.el9.x86_64.rpm 44 kB/s | 23 kB 00:00 2026-02-20T13:12:00.773 INFO:teuthology.orchestra.run.trial028.stdout:(9/165): ceph-common-20.3.0-5390.g0917c158.el9. 7.8 MB/s | 24 MB 00:03 2026-02-20T13:12:00.815 INFO:teuthology.orchestra.run.trial028.stdout:(10/165): ceph-osd-crimson-20.3.0-5390.g0917c15 23 MB/s | 19 MB 00:00 2026-02-20T13:12:00.827 INFO:teuthology.orchestra.run.trial028.stdout:(11/165): ceph-selinux-20.3.0-5390.g0917c158.el 2.0 MB/s | 25 kB 00:00 2026-02-20T13:12:01.077 INFO:teuthology.orchestra.run.trial028.stdout:(12/165): ceph-osd-classic-20.3.0-5390.g0917c15 11 MB/s | 16 MB 00:01 2026-02-20T13:12:01.105 INFO:teuthology.orchestra.run.trial028.stdout:(13/165): cephfs-mirror-20.3.0-5390.g0917c158.e 8.5 MB/s | 244 kB 00:00 2026-02-20T13:12:01.117 INFO:teuthology.orchestra.run.trial028.stdout:(14/165): cephfs-shell-20.3.0-5390.g0917c158.el 2.3 MB/s | 27 kB 00:00 2026-02-20T13:12:01.129 INFO:teuthology.orchestra.run.trial028.stdout:(15/165): libcephfs-devel-20.3.0-5390.g0917c158 3.1 MB/s | 37 kB 00:00 2026-02-20T13:12:01.130 INFO:teuthology.orchestra.run.trial034.stdout:(47/165): libconfig-1.7.2-9.el9.x86_64.rpm 119 kB/s | 72 kB 00:00 2026-02-20T13:12:01.140 INFO:teuthology.orchestra.run.trial028.stdout:(16/165): libcephfs-proxy2-20.3.0-5390.g0917c15 2.1 MB/s | 26 kB 00:00 2026-02-20T13:12:01.210 INFO:teuthology.orchestra.run.trial028.stdout:(17/165): libcephfs2-20.3.0-5390.g0917c158.el9. 13 MB/s | 909 kB 00:00 2026-02-20T13:12:01.226 INFO:teuthology.orchestra.run.trial028.stdout:(18/165): libcephsqlite-20.3.0-5390.g0917c158.e 9.8 MB/s | 159 kB 00:00 2026-02-20T13:12:01.240 INFO:teuthology.orchestra.run.trial028.stdout:(19/165): librados-devel-20.3.0-5390.g0917c158. 8.8 MB/s | 123 kB 00:00 2026-02-20T13:12:01.263 INFO:teuthology.orchestra.run.trial034.stdout:(48/165): libquadmath-11.5.0-14.el9.x86_64.rpm 266 kB/s | 184 kB 00:00 2026-02-20T13:12:01.266 INFO:teuthology.orchestra.run.trial028.stdout:(20/165): libradosstriper1-20.3.0-5390.g0917c15 9.4 MB/s | 248 kB 00:00 2026-02-20T13:12:01.403 INFO:teuthology.orchestra.run.trial034.stdout:(49/165): libgfortran-11.5.0-14.el9.x86_64.rpm 932 kB/s | 794 kB 00:00 2026-02-20T13:12:01.504 INFO:teuthology.orchestra.run.trial028.stdout:(21/165): ceph-radosgw-20.3.0-5390.g0917c158.el 18 MB/s | 13 MB 00:00 2026-02-20T13:12:01.517 INFO:teuthology.orchestra.run.trial028.stdout:(22/165): python3-ceph-argparse-20.3.0-5390.g09 3.6 MB/s | 45 kB 00:00 2026-02-20T13:12:01.532 INFO:teuthology.orchestra.run.trial028.stdout:(23/165): python3-ceph-common-20.3.0-5390.g0917 12 MB/s | 185 kB 00:00 2026-02-20T13:12:01.544 INFO:teuthology.orchestra.run.trial028.stdout:(24/165): python3-cephfs-20.3.0-5390.g0917c158. 16 MB/s | 204 kB 00:00 2026-02-20T13:12:01.570 INFO:teuthology.orchestra.run.trial028.stdout:(25/165): python3-rados-20.3.0-5390.g0917c158.e 13 MB/s | 324 kB 00:00 2026-02-20T13:12:01.596 INFO:teuthology.orchestra.run.trial028.stdout:(26/165): python3-rbd-20.3.0-5390.g0917c158.el9 12 MB/s | 305 kB 00:00 2026-02-20T13:12:01.608 INFO:teuthology.orchestra.run.trial028.stdout:(27/165): python3-rgw-20.3.0-5390.g0917c158.el9 8.1 MB/s | 100 kB 00:00 2026-02-20T13:12:01.621 INFO:teuthology.orchestra.run.trial028.stdout:(28/165): rbd-fuse-20.3.0-5390.g0917c158.el9.x8 6.7 MB/s | 84 kB 00:00 2026-02-20T13:12:01.709 INFO:teuthology.orchestra.run.trial028.stdout:(29/165): librgw2-20.3.0-5390.g0917c158.el9.x86 15 MB/s | 6.5 MB 00:00 2026-02-20T13:12:01.725 INFO:teuthology.orchestra.run.trial028.stdout:(30/165): rbd-nbd-20.3.0-5390.g0917c158.el9.x86 10 MB/s | 172 kB 00:00 2026-02-20T13:12:01.737 INFO:teuthology.orchestra.run.trial028.stdout:(31/165): ceph-grafana-dashboards-20.3.0-5390.g 4.6 MB/s | 57 kB 00:00 2026-02-20T13:12:01.753 INFO:teuthology.orchestra.run.trial028.stdout:(32/165): ceph-mgr-cephadm-20.3.0-5390.g0917c15 12 MB/s | 184 kB 00:00 2026-02-20T13:12:01.756 INFO:teuthology.orchestra.run.trial034.stdout:(50/165): lksctp-tools-1.0.19-2.el9.x86_64.rpm 150 kB/s | 94 kB 00:00 2026-02-20T13:12:01.767 INFO:teuthology.orchestra.run.trial028.stdout:(33/165): rbd-mirror-20.3.0-5390.g0917c158.el9. 20 MB/s | 2.9 MB 00:00 2026-02-20T13:12:01.796 INFO:teuthology.orchestra.run.trial034.stdout:(51/165): mailcap-2.1.49-5.el9.noarch.rpm 62 kB/s | 33 kB 00:00 2026-02-20T13:12:01.955 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - Extras packages 6.2 kB/s | 20 kB 00:03 2026-02-20T13:12:02.028 INFO:teuthology.orchestra.run.trial034.stdout:(52/165): pciutils-3.7.0-7.el9.x86_64.rpm 149 kB/s | 93 kB 00:00 2026-02-20T13:12:02.168 INFO:teuthology.orchestra.run.trial028.stdout:(34/165): ceph-mgr-diskprediction-local-20.3.0- 19 MB/s | 7.4 MB 00:00 2026-02-20T13:12:02.192 INFO:teuthology.orchestra.run.trial028.stdout:(35/165): ceph-mgr-modules-core-20.3.0-5390.g09 12 MB/s | 297 kB 00:00 2026-02-20T13:12:02.209 INFO:teuthology.orchestra.run.trial028.stdout:(36/165): ceph-mgr-rook-20.3.0-5390.g0917c158.e 3.0 MB/s | 50 kB 00:00 2026-02-20T13:12:02.220 INFO:teuthology.orchestra.run.trial028.stdout:(37/165): ceph-prometheus-alerts-20.3.0-5390.g0 1.5 MB/s | 17 kB 00:00 2026-02-20T13:12:02.239 INFO:teuthology.orchestra.run.trial028.stdout:(38/165): ceph-volume-20.3.0-5390.g0917c158.el9 16 MB/s | 301 kB 00:00 2026-02-20T13:12:02.303 INFO:teuthology.orchestra.run.trial028.stdout:(39/165): cephadm-20.3.0-5390.g0917c158.el9.noa 16 MB/s | 1.0 MB 00:00 2026-02-20T13:12:02.315 INFO:teuthology.orchestra.run.trial028.stdout:(40/165): cephfs-top-20.3.0-5390.g0917c158.el9. 1.5 MB/s | 18 kB 00:00 2026-02-20T13:12:02.489 INFO:teuthology.orchestra.run.trial034.stdout:(53/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 346 kB/s | 253 kB 00:00 2026-02-20T13:12:02.497 INFO:teuthology.orchestra.run.trial028.stdout:(41/165): cryptsetup-2.8.1-3.el9.x86_64.rpm 1.9 MB/s | 351 kB 00:00 2026-02-20T13:12:02.533 INFO:teuthology.orchestra.run.trial028.stdout:(42/165): hwloc-libs-2.4.1-6.el9.x86_64.rpm 58 MB/s | 2.1 MB 00:00 2026-02-20T13:12:02.542 INFO:teuthology.orchestra.run.trial028.stdout:(43/165): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.5 MB/s | 40 kB 00:00 2026-02-20T13:12:02.551 INFO:teuthology.orchestra.run.trial028.stdout:(44/165): libatomic-11.5.0-14.el9.x86_64.rpm 2.7 MB/s | 23 kB 00:00 2026-02-20T13:12:02.560 INFO:teuthology.orchestra.run.trial028.stdout:(45/165): libconfig-1.7.2-9.el9.x86_64.rpm 7.7 MB/s | 72 kB 00:00 2026-02-20T13:12:02.574 INFO:teuthology.orchestra.run.trial028.stdout:(46/165): libgfortran-11.5.0-14.el9.x86_64.rpm 55 MB/s | 794 kB 00:00 2026-02-20T13:12:02.585 INFO:teuthology.orchestra.run.trial028.stdout:(47/165): libquadmath-11.5.0-14.el9.x86_64.rpm 17 MB/s | 184 kB 00:00 2026-02-20T13:12:02.597 INFO:teuthology.orchestra.run.trial028.stdout:(48/165): lksctp-tools-1.0.19-2.el9.x86_64.rpm 7.8 MB/s | 94 kB 00:00 2026-02-20T13:12:02.606 INFO:teuthology.orchestra.run.trial028.stdout:(49/165): mailcap-2.1.49-5.el9.noarch.rpm 3.7 MB/s | 33 kB 00:00 2026-02-20T13:12:02.615 INFO:teuthology.orchestra.run.trial028.stdout:(50/165): pciutils-3.7.0-7.el9.x86_64.rpm 10 MB/s | 93 kB 00:00 2026-02-20T13:12:02.627 INFO:teuthology.orchestra.run.trial028.stdout:(51/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 21 MB/s | 253 kB 00:00 2026-02-20T13:12:02.646 INFO:teuthology.orchestra.run.trial028.stdout:(52/165): python3-cryptography-36.0.1-5.el9.x86 70 MB/s | 1.2 MB 00:00 2026-02-20T13:12:02.656 INFO:teuthology.orchestra.run.trial028.stdout:(53/165): python3-ply-3.11-14.el9.noarch.rpm 9.9 MB/s | 106 kB 00:00 2026-02-20T13:12:02.667 INFO:teuthology.orchestra.run.trial028.stdout:(54/165): python3-pycparser-2.20-6.el9.noarch.r 12 MB/s | 135 kB 00:00 2026-02-20T13:12:02.670 INFO:teuthology.orchestra.run.trial034.stdout:(54/165): python3-ply-3.11-14.el9.noarch.rpm 166 kB/s | 106 kB 00:00 2026-02-20T13:12:02.678 INFO:teuthology.orchestra.run.trial028.stdout:(55/165): python3-pyparsing-2.4.7-9.el9.noarch. 14 MB/s | 150 kB 00:00 2026-02-20T13:12:02.690 INFO:teuthology.orchestra.run.trial028.stdout:(56/165): python3-requests-2.25.1-10.el9.noarch 11 MB/s | 126 kB 00:00 2026-02-20T13:12:02.702 INFO:teuthology.orchestra.run.trial028.stdout:(57/165): python3-urllib3-1.26.5-7.el9.noarch.r 18 MB/s | 218 kB 00:00 2026-02-20T13:12:02.711 INFO:teuthology.orchestra.run.trial034.stdout:(55/165): python3-cryptography-36.0.1-5.el9.x86 1.4 MB/s | 1.2 MB 00:00 2026-02-20T13:12:02.714 INFO:teuthology.orchestra.run.trial028.stdout:(58/165): unzip-6.0-59.el9.x86_64.rpm 15 MB/s | 182 kB 00:00 2026-02-20T13:12:02.725 INFO:teuthology.orchestra.run.trial028.stdout:(59/165): zip-3.0-35.el9.x86_64.rpm 23 MB/s | 266 kB 00:00 2026-02-20T13:12:02.954 INFO:teuthology.orchestra.run.trial127.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-20T13:12:03.156 INFO:teuthology.orchestra.run.trial034.stdout:(56/165): python3-pycparser-2.20-6.el9.noarch.r 202 kB/s | 135 kB 00:00 2026-02-20T13:12:03.350 INFO:teuthology.orchestra.run.trial034.stdout:(57/165): python3-pyparsing-2.4.7-9.el9.noarch. 221 kB/s | 150 kB 00:00 2026-02-20T13:12:03.373 INFO:teuthology.orchestra.run.trial034.stdout:(58/165): python3-requests-2.25.1-10.el9.noarch 191 kB/s | 126 kB 00:00 2026-02-20T13:12:03.711 INFO:teuthology.orchestra.run.trial028.stdout:(60/165): ceph-test-20.3.0-5390.g0917c158.el9.x 27 MB/s | 78 MB 00:02 2026-02-20T13:12:03.869 INFO:teuthology.orchestra.run.trial034.stdout:(59/165): python3-urllib3-1.26.5-7.el9.noarch.r 306 kB/s | 218 kB 00:00 2026-02-20T13:12:04.047 INFO:teuthology.orchestra.run.trial034.stdout:(60/165): unzip-6.0-59.el9.x86_64.rpm 261 kB/s | 182 kB 00:00 2026-02-20T13:12:04.107 INFO:teuthology.orchestra.run.trial034.stdout:(61/165): zip-3.0-35.el9.x86_64.rpm 362 kB/s | 266 kB 00:00 2026-02-20T13:12:04.226 INFO:teuthology.orchestra.run.trial028.stdout:(61/165): ceph-mgr-dashboard-20.3.0-5390.g0917c 20 MB/s | 51 MB 00:02 2026-02-20T13:12:04.592 INFO:teuthology.orchestra.run.trial028.stdout:(62/165): boost-program-options-1.75.0-13.el9.x 285 kB/s | 104 kB 00:00 2026-02-20T13:12:04.785 INFO:teuthology.orchestra.run.trial028.stdout:(63/165): elfutils-libelf-devel-0.194-1.el9.x86 412 kB/s | 79 kB 00:00 2026-02-20T13:12:04.791 INFO:teuthology.orchestra.run.trial028.stdout:(64/165): automake-1.16.2-8.el9.noarch.rpm 334 kB/s | 689 kB 00:02 2026-02-20T13:12:04.853 INFO:teuthology.orchestra.run.trial034.stdout:(62/165): boost-program-options-1.75.0-13.el9.x 140 kB/s | 104 kB 00:00 2026-02-20T13:12:04.866 INFO:teuthology.orchestra.run.trial028.stdout:(65/165): bison-3.7.4-5.el9.x86_64.rpm 816 kB/s | 943 kB 00:01 2026-02-20T13:12:04.949 INFO:teuthology.orchestra.run.trial028.stdout:(66/165): flexiblas-3.0.4-9.el9.x86_64.rpm 187 kB/s | 30 kB 00:00 2026-02-20T13:12:05.089 INFO:teuthology.orchestra.run.trial034.stdout:(63/165): elfutils-libelf-devel-0.194-1.el9.x86 336 kB/s | 79 kB 00:00 2026-02-20T13:12:05.092 INFO:teuthology.orchestra.run.trial028.stdout:(67/165): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2026-02-20T13:12:05.095 INFO:teuthology.orchestra.run.trial034.stdout:(64/165): automake-1.16.2-8.el9.noarch.rpm 562 kB/s | 689 kB 00:01 2026-02-20T13:12:05.106 INFO:teuthology.orchestra.run.trial028.stdout:(68/165): flexiblas-openblas-openmp-3.0.4-9.el9 95 kB/s | 15 kB 00:00 2026-02-20T13:12:05.226 INFO:teuthology.orchestra.run.trial028.stdout:(69/165): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 11 kB 00:00 2026-02-20T13:12:05.253 INFO:teuthology.orchestra.run.trial034.stdout:(65/165): flexiblas-3.0.4-9.el9.x86_64.rpm 188 kB/s | 30 kB 00:00 2026-02-20T13:12:05.327 INFO:teuthology.orchestra.run.trial034.stdout:(66/165): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 313 kB 00:00 2026-02-20T13:12:05.378 INFO:teuthology.orchestra.run.trial028.stdout:(70/165): libnbd-1.20.3-4.el9.x86_64.rpm 603 kB/s | 164 kB 00:00 2026-02-20T13:12:05.458 INFO:teuthology.orchestra.run.trial028.stdout:(71/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 692 kB/s | 160 kB 00:00 2026-02-20T13:12:05.484 INFO:teuthology.orchestra.run.trial034.stdout:(67/165): flexiblas-openblas-openmp-3.0.4-9.el9 94 kB/s | 15 kB 00:00 2026-02-20T13:12:05.571 INFO:teuthology.orchestra.run.trial028.stdout:(72/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 234 kB/s | 45 kB 00:00 2026-02-20T13:12:05.642 INFO:teuthology.orchestra.run.trial034.stdout:(68/165): libaio-devel-0.3.111-13.el9.x86_64.rp 70 kB/s | 11 kB 00:00 2026-02-20T13:12:05.809 INFO:teuthology.orchestra.run.trial034.stdout:(69/165): bison-3.7.4-5.el9.x86_64.rpm 535 kB/s | 943 kB 00:01 2026-02-20T13:12:05.810 INFO:teuthology.orchestra.run.trial028.stdout:(73/165): flexiblas-netlib-3.0.4-9.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2026-02-20T13:12:05.876 INFO:teuthology.orchestra.run.trial028.stdout:(74/165): libstoragemgmt-1.10.1-1.el9.x86_64.rp 810 kB/s | 246 kB 00:00 2026-02-20T13:12:05.890 INFO:teuthology.orchestra.run.trial028.stdout:(75/165): librdkafka-1.6.1-102.el9.x86_64.rpm 1.5 MB/s | 662 kB 00:00 2026-02-20T13:12:05.956 INFO:teuthology.orchestra.run.trial034.stdout:(70/165): libnbd-1.20.3-4.el9.x86_64.rpm 523 kB/s | 164 kB 00:00 2026-02-20T13:12:06.047 INFO:teuthology.orchestra.run.trial034.stdout:(71/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 673 kB/s | 160 kB 00:00 2026-02-20T13:12:06.047 INFO:teuthology.orchestra.run.trial028.stdout:(76/165): libuuid-devel-2.37.4-21.el9.x86_64.rp 144 kB/s | 25 kB 00:00 2026-02-20T13:12:06.091 INFO:teuthology.orchestra.run.trial127.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-20T13:12:06.114 INFO:teuthology.orchestra.run.trial034.stdout:(72/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 287 kB/s | 45 kB 00:00 2026-02-20T13:12:06.122 INFO:teuthology.orchestra.run.trial034.stdout:(73/165): flexiblas-netlib-3.0.4-9.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2026-02-20T13:12:06.162 INFO:teuthology.orchestra.run.trial028.stdout:(77/165): libxslt-1.1.34-12.el9.x86_64.rpm 862 kB/s | 233 kB 00:00 2026-02-20T13:12:06.208 INFO:teuthology.orchestra.run.trial034.stdout:(74/165): librdkafka-1.6.1-102.el9.x86_64.rpm 4.0 MB/s | 662 kB 00:00 2026-02-20T13:12:06.228 INFO:teuthology.orchestra.run.trial028.stdout:(78/165): libtool-2.4.6-46.el9.x86_64.rpm 1.4 MB/s | 581 kB 00:00 2026-02-20T13:12:06.240 INFO:teuthology.orchestra.run.trial028.stdout:(79/165): libzstd-devel-1.5.5-1.el9.x86_64.rpm 263 kB/s | 51 kB 00:00 2026-02-20T13:12:06.350 INFO:teuthology.orchestra.run.trial034.stdout:(75/165): libstoragemgmt-1.10.1-1.el9.x86_64.rp 1.0 MB/s | 246 kB 00:00 2026-02-20T13:12:06.366 INFO:teuthology.orchestra.run.trial034.stdout:(76/165): libuuid-devel-2.37.4-21.el9.x86_64.rp 155 kB/s | 25 kB 00:00 2026-02-20T13:12:06.435 INFO:teuthology.orchestra.run.trial028.stdout:(80/165): openblas-0.3.29-1.el9.x86_64.rpm 216 kB/s | 42 kB 00:00 2026-02-20T13:12:06.473 INFO:teuthology.orchestra.run.trial028.stdout:(81/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 940 kB/s | 292 kB 00:00 2026-02-20T13:12:06.500 INFO:teuthology.orchestra.run.trial028.stdout:(82/165): lua-5.4.4-4.el9.x86_64.rpm 693 kB/s | 188 kB 00:00 2026-02-20T13:12:06.510 INFO:teuthology.orchestra.run.trial034.stdout:(77/165): libxslt-1.1.34-12.el9.x86_64.rpm 1.4 MB/s | 233 kB 00:00 2026-02-20T13:12:06.525 INFO:teuthology.orchestra.run.trial034.stdout:(78/165): libzstd-devel-1.5.5-1.el9.x86_64.rpm 322 kB/s | 51 kB 00:00 2026-02-20T13:12:06.656 INFO:teuthology.orchestra.run.trial028.stdout:(83/165): perl-Thread-Queue-3.14-460.el9.noarch 143 kB/s | 22 kB 00:00 2026-02-20T13:12:06.670 INFO:teuthology.orchestra.run.trial034.stdout:(79/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2026-02-20T13:12:06.683 INFO:teuthology.orchestra.run.trial034.stdout:(80/165): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2026-02-20T13:12:06.832 INFO:teuthology.orchestra.run.trial034.stdout:(81/165): openblas-0.3.29-1.el9.x86_64.rpm 262 kB/s | 42 kB 00:00 2026-02-20T13:12:06.858 INFO:teuthology.orchestra.run.trial028.stdout:(84/165): perl-threads-2.25-460.el9.x86_64.rpm 289 kB/s | 58 kB 00:00 2026-02-20T13:12:06.905 INFO:teuthology.orchestra.run.trial034.stdout:(82/165): libtool-2.4.6-46.el9.x86_64.rpm 743 kB/s | 581 kB 00:00 2026-02-20T13:12:07.052 INFO:teuthology.orchestra.run.trial028.stdout:(85/165): perl-threads-shared-1.61-460.el9.x86_ 230 kB/s | 45 kB 00:00 2026-02-20T13:12:07.062 INFO:teuthology.orchestra.run.trial034.stdout:(83/165): perl-Thread-Queue-3.14-460.el9.noarch 141 kB/s | 22 kB 00:00 2026-02-20T13:12:07.156 INFO:teuthology.orchestra.run.trial034.stdout:(84/165): openssl-devel-3.5.5-1.el9.x86_64.rpm 15 MB/s | 4.8 MB 00:00 2026-02-20T13:12:07.221 INFO:teuthology.orchestra.run.trial034.stdout:(85/165): perl-threads-2.25-460.el9.x86_64.rpm 369 kB/s | 58 kB 00:00 2026-02-20T13:12:07.249 INFO:teuthology.orchestra.run.trial034.stdout:(86/165): openblas-openmp-0.3.29-1.el9.x86_64.r 9.3 MB/s | 5.3 MB 00:00 2026-02-20T13:12:07.302 INFO:teuthology.orchestra.run.trial127.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T13:12:07.303 INFO:teuthology.orchestra.run.trial127.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T13:12:07.308 INFO:teuthology.orchestra.run.trial127.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-20T13:12:07.309 INFO:teuthology.orchestra.run.trial127.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-20T13:12:07.309 INFO:teuthology.orchestra.run.trial127.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-20T13:12:07.309 INFO:teuthology.orchestra.run.trial127.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-20T13:12:07.310 INFO:teuthology.orchestra.run.trial127.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-20T13:12:07.311 INFO:teuthology.orchestra.run.trial127.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-20T13:12:07.312 INFO:teuthology.orchestra.run.trial127.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-20T13:12:07.317 INFO:teuthology.orchestra.run.trial034.stdout:(87/165): perl-threads-shared-1.61-460.el9.x86_ 278 kB/s | 45 kB 00:00 2026-02-20T13:12:07.338 INFO:teuthology.orchestra.run.trial127.stdout:Dependencies resolved. 2026-02-20T13:12:07.342 INFO:teuthology.orchestra.run.trial127.stdout:======================================================================================= 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: Package Arch Version Repository Size 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout:======================================================================================= 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout:Installing: 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: ceph x86_64 2:20.3.0-5390.g0917c158.el9 ceph 6.5 k 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: ceph-base x86_64 2:20.3.0-5390.g0917c158.el9 ceph 5.2 M 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: ceph-fuse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 987 k 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5390.g0917c158.el9 ceph 147 k 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr x86_64 2:20.3.0-5390.g0917c158.el9 ceph 936 k 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 184 k 2026-02-20T13:12:07.343 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 51 M 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 7.4 M 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-rook noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 50 k 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 167 k 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-classic x86_64 2:20.3.0-5390.g0917c158.el9 ceph 16 M 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: ceph-radosgw x86_64 2:20.3.0-5390.g0917c158.el9 ceph 13 M 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: ceph-test x86_64 2:20.3.0-5390.g0917c158.el9 ceph 78 M 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: ceph-volume noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 301 k 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: cephadm noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 1.0 M 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-mirror x86_64 2:20.3.0-5390.g0917c158.el9 ceph 244 k 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-shell x86_64 2:20.3.0-5390.g0917c158.el9 ceph 27 k 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-top noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 18 k 2026-02-20T13:12:07.344 INFO:teuthology.orchestra.run.trial127.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs-devel x86_64 2:20.3.0-5390.g0917c158.el9 ceph 37 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 909 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: librados-devel x86_64 2:20.3.0-5390.g0917c158.el9 ceph 123 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-20T13:12:07.345 INFO:teuthology.orchestra.run.trial127.stdout: python3-cephfs x86_64 2:20.3.0-5390.g0917c158.el9 ceph 204 k 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: python3-rados x86_64 2:20.3.0-5390.g0917c158.el9 ceph 324 k 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: python3-rbd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 305 k 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: python3-rgw x86_64 2:20.3.0-5390.g0917c158.el9 ceph 100 k 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: rbd-fuse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 84 k 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: rbd-mirror x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.9 M 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: rbd-nbd x86_64 2:20.3.0-5390.g0917c158.el9 ceph 172 k 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout:Upgrading: 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: librados2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 3.5 M 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: librbd1 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.8 M 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout:Installing dependencies: 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T13:12:07.346 INFO:teuthology.orchestra.run.trial127.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: ceph-common x86_64 2:20.3.0-5390.g0917c158.el9 ceph 24 M 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 57 k 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mds x86_64 2:20.3.0-5390.g0917c158.el9 ceph 2.4 M 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 297 k 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mon x86_64 2:20.3.0-5390.g0917c158.el9 ceph 5.0 M 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-crimson x86_64 2:20.3.0-5390.g0917c158.el9 ceph 19 M 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5390.g0917c158.el9 ceph-noarch 17 k 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: ceph-selinux x86_64 2:20.3.0-5390.g0917c158.el9 ceph 25 k 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T13:12:07.347 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 26 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libcephsqlite x86_64 2:20.3.0-5390.g0917c158.el9 ceph 159 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T13:12:07.348 INFO:teuthology.orchestra.run.trial127.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: libradosstriper1 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 248 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: librgw2 x86_64 2:20.3.0-5390.g0917c158.el9 ceph 6.5 M 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T13:12:07.349 INFO:teuthology.orchestra.run.trial127.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T13:12:07.350 INFO:teuthology.orchestra.run.trial127.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-ceph-argparse x86_64 2:20.3.0-5390.g0917c158.el9 ceph 45 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-ceph-common x86_64 2:20.3.0-5390.g0917c158.el9 ceph 185 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T13:12:07.351 INFO:teuthology.orchestra.run.trial127.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T13:12:07.352 INFO:teuthology.orchestra.run.trial127.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T13:12:07.353 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T13:12:07.354 INFO:teuthology.orchestra.run.trial127.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-20T13:12:07.355 INFO:teuthology.orchestra.run.trial127.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout:Installing weak dependencies: 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout:Transaction Summary 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout:======================================================================================= 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout:Install 163 Packages 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout:Upgrade 2 Packages 2026-02-20T13:12:07.356 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:07.357 INFO:teuthology.orchestra.run.trial127.stdout:Total download size: 327 M 2026-02-20T13:12:07.357 INFO:teuthology.orchestra.run.trial127.stdout:Downloading Packages: 2026-02-20T13:12:07.412 INFO:teuthology.orchestra.run.trial034.stdout:(88/165): postgresql-contrib-13.23-1.el9.x86_64 5.4 MB/s | 903 kB 00:00 2026-02-20T13:12:07.544 INFO:teuthology.orchestra.run.trial034.stdout:(89/165): postgresql-13.23-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2026-02-20T13:12:07.553 INFO:teuthology.orchestra.run.trial034.stdout:(90/165): postgresql-private-libs-13.23-1.el9.x 586 kB/s | 138 kB 00:00 2026-02-20T13:12:07.665 INFO:teuthology.orchestra.run.trial034.stdout:(91/165): postgresql-server-13.23-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2026-02-20T13:12:07.708 INFO:teuthology.orchestra.run.trial034.stdout:(92/165): protobuf-3.14.0-17.el9.x86_64.rpm 6.2 MB/s | 1.0 MB 00:00 2026-02-20T13:12:07.723 INFO:teuthology.orchestra.run.trial127.stdout:(1/165): ceph-20.3.0-5390.g0917c158.el9.x86_64. 130 kB/s | 6.5 kB 00:00 2026-02-20T13:12:07.740 INFO:teuthology.orchestra.run.trial028.stdout:(86/165): postgresql-13.23-1.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2026-02-20T13:12:07.826 INFO:teuthology.orchestra.run.trial034.stdout:(93/165): python3-colorama-0.4.6-3.el9.noarch.r 381 kB/s | 61 kB 00:00 2026-02-20T13:12:07.827 INFO:teuthology.orchestra.run.trial127.stdout:(2/165): ceph-fuse-20.3.0-5390.g0917c158.el9.x8 9.4 MB/s | 987 kB 00:00 2026-02-20T13:12:07.845 INFO:teuthology.orchestra.run.trial127.stdout:(3/165): ceph-immutable-object-cache-20.3.0-539 7.8 MB/s | 147 kB 00:00 2026-02-20T13:12:07.867 INFO:teuthology.orchestra.run.trial034.stdout:(94/165): python3-devel-3.9.25-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2026-02-20T13:12:07.986 INFO:teuthology.orchestra.run.trial034.stdout:(95/165): python3-jinja2-2.11.3-8.el9.noarch.rp 1.5 MB/s | 249 kB 00:00 2026-02-20T13:12:07.987 INFO:teuthology.orchestra.run.trial127.stdout:(4/165): ceph-base-20.3.0-5390.g0917c158.el9.x8 17 MB/s | 5.2 MB 00:00 2026-02-20T13:12:07.995 INFO:teuthology.orchestra.run.trial127.stdout:(5/165): ceph-mds-20.3.0-5390.g0917c158.el9.x86 16 MB/s | 2.4 MB 00:00 2026-02-20T13:12:08.026 INFO:teuthology.orchestra.run.trial034.stdout:(96/165): python3-jmespath-1.0.1-1.el9.noarch.r 300 kB/s | 48 kB 00:00 2026-02-20T13:12:08.037 INFO:teuthology.orchestra.run.trial127.stdout:(6/165): ceph-mgr-20.3.0-5390.g0917c158.el9.x86 18 MB/s | 936 kB 00:00 2026-02-20T13:12:08.062 INFO:teuthology.orchestra.run.trial127.stdout:(7/165): ceph-osd-20.3.0-5390.g0917c158.el9.x86 6.6 MB/s | 167 kB 00:00 2026-02-20T13:12:08.146 INFO:teuthology.orchestra.run.trial034.stdout:(97/165): python3-libstoragemgmt-1.10.1-1.el9.x 1.1 MB/s | 177 kB 00:00 2026-02-20T13:12:08.185 INFO:teuthology.orchestra.run.trial034.stdout:(98/165): python3-markupsafe-1.1.1-12.el9.x86_6 218 kB/s | 35 kB 00:00 2026-02-20T13:12:08.236 INFO:teuthology.orchestra.run.trial028.stdout:(87/165): postgresql-contrib-13.23-1.el9.x86_64 1.8 MB/s | 903 kB 00:00 2026-02-20T13:12:08.268 INFO:teuthology.orchestra.run.trial127.stdout:(8/165): ceph-mon-20.3.0-5390.g0917c158.el9.x86 18 MB/s | 5.0 MB 00:00 2026-02-20T13:12:08.347 INFO:teuthology.orchestra.run.trial034.stdout:(99/165): python3-numpy-f2py-1.23.5-2.el9.x86_6 2.7 MB/s | 442 kB 00:00 2026-02-20T13:12:08.399 INFO:teuthology.orchestra.run.trial034.stdout:(100/165): python3-numpy-1.23.5-2.el9.x86_64.rp 24 MB/s | 6.1 MB 00:00 2026-02-20T13:12:08.447 INFO:teuthology.orchestra.run.trial028.stdout:(88/165): openblas-openmp-0.3.29-1.el9.x86_64.r 2.6 MB/s | 5.3 MB 00:02 2026-02-20T13:12:08.485 INFO:teuthology.orchestra.run.trial028.stdout:(89/165): postgresql-private-libs-13.23-1.el9.x 555 kB/s | 138 kB 00:00 2026-02-20T13:12:08.508 INFO:teuthology.orchestra.run.trial034.stdout:(101/165): python3-packaging-20.9-5.el9.noarch. 479 kB/s | 77 kB 00:00 2026-02-20T13:12:08.560 INFO:teuthology.orchestra.run.trial034.stdout:(102/165): python3-protobuf-3.14.0-17.el9.noarc 1.6 MB/s | 267 kB 00:00 2026-02-20T13:12:08.668 INFO:teuthology.orchestra.run.trial034.stdout:(103/165): python3-pyasn1-0.4.8-6.el9.noarch.rp 992 kB/s | 159 kB 00:00 2026-02-20T13:12:08.720 INFO:teuthology.orchestra.run.trial034.stdout:(104/165): python3-pyasn1-modules-0.4.8-6.el9.n 1.7 MB/s | 279 kB 00:00 2026-02-20T13:12:08.828 INFO:teuthology.orchestra.run.trial034.stdout:(105/165): python3-requests-oauthlib-1.3.0-12.e 336 kB/s | 54 kB 00:00 2026-02-20T13:12:08.873 INFO:teuthology.orchestra.run.trial127.stdout:(9/165): ceph-common-20.3.0-5390.g0917c158.el9. 20 MB/s | 24 MB 00:01 2026-02-20T13:12:08.896 INFO:teuthology.orchestra.run.trial127.stdout:(10/165): ceph-osd-classic-20.3.0-5390.g0917c15 19 MB/s | 16 MB 00:00 2026-02-20T13:12:08.946 INFO:teuthology.orchestra.run.trial127.stdout:(11/165): ceph-selinux-20.3.0-5390.g0917c158.el 500 kB/s | 25 kB 00:00 2026-02-20T13:12:08.987 INFO:teuthology.orchestra.run.trial034.stdout:(106/165): python3-toml-0.10.2-6.el9.noarch.rpm 261 kB/s | 42 kB 00:00 2026-02-20T13:12:09.022 INFO:teuthology.orchestra.run.trial028.stdout:(90/165): protobuf-3.14.0-17.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2026-02-20T13:12:09.059 INFO:teuthology.orchestra.run.trial028.stdout:(91/165): openssl-devel-3.5.5-1.el9.x86_64.rpm 1.9 MB/s | 4.8 MB 00:02 2026-02-20T13:12:09.147 INFO:teuthology.orchestra.run.trial034.stdout:(107/165): python3-wcwidth-0.2.5-8.el9.noarch.r 277 kB/s | 44 kB 00:00 2026-02-20T13:12:09.259 INFO:teuthology.orchestra.run.trial127.stdout:(12/165): ceph-osd-crimson-20.3.0-5390.g0917c15 19 MB/s | 19 MB 00:00 2026-02-20T13:12:09.274 INFO:teuthology.orchestra.run.trial028.stdout:(92/165): python3-colorama-0.4.6-3.el9.noarch.r 286 kB/s | 61 kB 00:00 2026-02-20T13:12:09.294 INFO:teuthology.orchestra.run.trial127.stdout:(13/165): cephfs-mirror-20.3.0-5390.g0917c158.e 6.8 MB/s | 244 kB 00:00 2026-02-20T13:12:09.307 INFO:teuthology.orchestra.run.trial034.stdout:(108/165): qatlib-25.08.0-2.el9.x86_64.rpm 1.5 MB/s | 240 kB 00:00 2026-02-20T13:12:09.334 INFO:teuthology.orchestra.run.trial127.stdout:(14/165): cephfs-shell-20.3.0-5390.g0917c158.el 691 kB/s | 27 kB 00:00 2026-02-20T13:12:09.373 INFO:teuthology.orchestra.run.trial127.stdout:(15/165): libcephfs-devel-20.3.0-5390.g0917c158 945 kB/s | 37 kB 00:00 2026-02-20T13:12:09.410 INFO:teuthology.orchestra.run.trial127.stdout:(16/165): ceph-radosgw-20.3.0-5390.g0917c158.el 25 MB/s | 13 MB 00:00 2026-02-20T13:12:09.411 INFO:teuthology.orchestra.run.trial127.stdout:(17/165): libcephfs-proxy2-20.3.0-5390.g0917c15 688 kB/s | 26 kB 00:00 2026-02-20T13:12:09.448 INFO:teuthology.orchestra.run.trial127.stdout:(18/165): libcephfs2-20.3.0-5390.g0917c158.el9. 24 MB/s | 909 kB 00:00 2026-02-20T13:12:09.448 INFO:teuthology.orchestra.run.trial127.stdout:(19/165): libcephsqlite-20.3.0-5390.g0917c158.e 4.1 MB/s | 159 kB 00:00 2026-02-20T13:12:09.466 INFO:teuthology.orchestra.run.trial034.stdout:(109/165): qatlib-service-25.08.0-2.el9.x86_64. 233 kB/s | 37 kB 00:00 2026-02-20T13:12:09.471 INFO:teuthology.orchestra.run.trial127.stdout:(20/165): libradosstriper1-20.3.0-5390.g0917c15 11 MB/s | 248 kB 00:00 2026-02-20T13:12:09.475 INFO:teuthology.orchestra.run.trial127.stdout:(21/165): librados-devel-20.3.0-5390.g0917c158. 4.5 MB/s | 123 kB 00:00 2026-02-20T13:12:09.517 INFO:teuthology.orchestra.run.trial127.stdout:(22/165): python3-ceph-argparse-20.3.0-5390.g09 1.0 MB/s | 45 kB 00:00 2026-02-20T13:12:09.560 INFO:teuthology.orchestra.run.trial127.stdout:(23/165): python3-ceph-common-20.3.0-5390.g0917 4.2 MB/s | 185 kB 00:00 2026-02-20T13:12:09.579 INFO:teuthology.orchestra.run.trial028.stdout:(93/165): python3-devel-3.9.25-3.el9.x86_64.rpm 800 kB/s | 244 kB 00:00 2026-02-20T13:12:09.605 INFO:teuthology.orchestra.run.trial127.stdout:(24/165): python3-cephfs-20.3.0-5390.g0917c158. 4.4 MB/s | 204 kB 00:00 2026-02-20T13:12:09.625 INFO:teuthology.orchestra.run.trial034.stdout:(110/165): qatzip-libs-1.3.1-1.el9.x86_64.rpm 417 kB/s | 66 kB 00:00 2026-02-20T13:12:09.649 INFO:teuthology.orchestra.run.trial127.stdout:(25/165): python3-rados-20.3.0-5390.g0917c158.e 7.2 MB/s | 324 kB 00:00 2026-02-20T13:12:09.694 INFO:teuthology.orchestra.run.trial127.stdout:(26/165): python3-rbd-20.3.0-5390.g0917c158.el9 6.7 MB/s | 305 kB 00:00 2026-02-20T13:12:09.721 INFO:teuthology.orchestra.run.trial127.stdout:(27/165): librgw2-20.3.0-5390.g0917c158.el9.x86 26 MB/s | 6.5 MB 00:00 2026-02-20T13:12:09.733 INFO:teuthology.orchestra.run.trial127.stdout:(28/165): python3-rgw-20.3.0-5390.g0917c158.el9 2.5 MB/s | 100 kB 00:00 2026-02-20T13:12:09.746 INFO:teuthology.orchestra.run.trial127.stdout:(29/165): rbd-fuse-20.3.0-5390.g0917c158.el9.x8 3.3 MB/s | 84 kB 00:00 2026-02-20T13:12:09.785 INFO:teuthology.orchestra.run.trial034.stdout:(111/165): socat-1.7.4.1-8.el9.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2026-02-20T13:12:09.794 INFO:teuthology.orchestra.run.trial127.stdout:(30/165): rbd-nbd-20.3.0-5390.g0917c158.el9.x86 3.5 MB/s | 172 kB 00:00 2026-02-20T13:12:09.844 INFO:teuthology.orchestra.run.trial127.stdout:(31/165): ceph-grafana-dashboards-20.3.0-5390.g 1.1 MB/s | 57 kB 00:00 2026-02-20T13:12:09.865 INFO:teuthology.orchestra.run.trial127.stdout:(32/165): rbd-mirror-20.3.0-5390.g0917c158.el9. 22 MB/s | 2.9 MB 00:00 2026-02-20T13:12:09.883 INFO:teuthology.orchestra.run.trial028.stdout:(94/165): python3-jinja2-2.11.3-8.el9.noarch.rp 819 kB/s | 249 kB 00:00 2026-02-20T13:12:09.886 INFO:teuthology.orchestra.run.trial127.stdout:(33/165): ceph-mgr-cephadm-20.3.0-5390.g0917c15 4.3 MB/s | 184 kB 00:00 2026-02-20T13:12:09.945 INFO:teuthology.orchestra.run.trial034.stdout:(112/165): uuid-1.6.2-55.el9.x86_64.rpm 362 kB/s | 58 kB 00:00 2026-02-20T13:12:10.078 INFO:teuthology.orchestra.run.trial028.stdout:(95/165): python3-jmespath-1.0.1-1.el9.noarch.r 245 kB/s | 48 kB 00:00 2026-02-20T13:12:10.104 INFO:teuthology.orchestra.run.trial034.stdout:(113/165): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 601 kB/s | 96 kB 00:00 2026-02-20T13:12:10.263 INFO:teuthology.orchestra.run.trial034.stdout:(114/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 401 kB/s | 64 kB 00:00 2026-02-20T13:12:10.347 INFO:teuthology.orchestra.run.trial028.stdout:(96/165): python3-libstoragemgmt-1.10.1-1.el9.x 656 kB/s | 177 kB 00:00 2026-02-20T13:12:10.422 INFO:teuthology.orchestra.run.trial034.stdout:(115/165): zlib-devel-1.2.11-41.el9.x86_64.rpm 282 kB/s | 45 kB 00:00 2026-02-20T13:12:10.453 INFO:teuthology.orchestra.run.trial127.stdout:(34/165): ceph-mgr-diskprediction-local-20.3.0- 13 MB/s | 7.4 MB 00:00 2026-02-20T13:12:10.510 INFO:teuthology.orchestra.run.trial127.stdout:(35/165): ceph-mgr-modules-core-20.3.0-5390.g09 5.0 MB/s | 297 kB 00:00 2026-02-20T13:12:10.511 INFO:teuthology.orchestra.run.trial028.stdout:(97/165): python3-markupsafe-1.1.1-12.el9.x86_6 213 kB/s | 35 kB 00:00 2026-02-20T13:12:10.551 INFO:teuthology.orchestra.run.trial028.stdout:(98/165): postgresql-server-13.23-1.el9.x86_64. 2.7 MB/s | 5.8 MB 00:02 2026-02-20T13:12:10.559 INFO:teuthology.orchestra.run.trial127.stdout:(36/165): ceph-mgr-rook-20.3.0-5390.g0917c158.e 1.0 MB/s | 50 kB 00:00 2026-02-20T13:12:10.609 INFO:teuthology.orchestra.run.trial127.stdout:(37/165): ceph-prometheus-alerts-20.3.0-5390.g0 346 kB/s | 17 kB 00:00 2026-02-20T13:12:10.665 INFO:teuthology.orchestra.run.trial127.stdout:(38/165): ceph-volume-20.3.0-5390.g0917c158.el9 5.3 MB/s | 301 kB 00:00 2026-02-20T13:12:10.682 INFO:teuthology.orchestra.run.trial028.stdout:(99/165): python3-babel-2.9.1-2.el9.noarch.rpm 3.6 MB/s | 6.0 MB 00:01 2026-02-20T13:12:10.782 INFO:teuthology.orchestra.run.trial127.stdout:(39/165): cephadm-20.3.0-5390.g0917c158.el9.noa 8.7 MB/s | 1.0 MB 00:00 2026-02-20T13:12:10.817 INFO:teuthology.orchestra.run.trial034.stdout:(116/165): python3-scipy-1.9.3-2.el9.x86_64.rpm 9.2 MB/s | 19 MB 00:02 2026-02-20T13:12:10.834 INFO:teuthology.orchestra.run.trial127.stdout:(40/165): cephfs-top-20.3.0-5390.g0917c158.el9. 351 kB/s | 18 kB 00:00 2026-02-20T13:12:10.875 INFO:teuthology.orchestra.run.trial028.stdout:(100/165): python3-packaging-20.9-5.el9.noarch. 400 kB/s | 77 kB 00:00 2026-02-20T13:12:10.897 INFO:teuthology.orchestra.run.trial028.stdout:(101/165): python3-numpy-f2py-1.23.5-2.el9.x86_ 1.3 MB/s | 442 kB 00:00 2026-02-20T13:12:11.165 INFO:teuthology.orchestra.run.trial028.stdout:(102/165): python3-pyasn1-0.4.8-6.el9.noarch.rp 593 kB/s | 159 kB 00:00 2026-02-20T13:12:11.192 INFO:teuthology.orchestra.run.trial028.stdout:(103/165): python3-protobuf-3.14.0-17.el9.noarc 845 kB/s | 267 kB 00:00 2026-02-20T13:12:11.240 INFO:teuthology.orchestra.run.trial127.stdout:(41/165): cryptsetup-2.8.1-3.el9.x86_64.rpm 865 kB/s | 351 kB 00:00 2026-02-20T13:12:11.342 INFO:teuthology.orchestra.run.trial127.stdout:(42/165): hwloc-libs-2.4.1-6.el9.x86_64.rpm 21 MB/s | 2.1 MB 00:00 2026-02-20T13:12:11.368 INFO:teuthology.orchestra.run.trial127.stdout:(43/165): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.5 MB/s | 40 kB 00:00 2026-02-20T13:12:11.387 INFO:teuthology.orchestra.run.trial028.stdout:(104/165): python3-requests-oauthlib-1.3.0-12.e 275 kB/s | 54 kB 00:00 2026-02-20T13:12:11.393 INFO:teuthology.orchestra.run.trial127.stdout:(44/165): libatomic-11.5.0-14.el9.x86_64.rpm 908 kB/s | 23 kB 00:00 2026-02-20T13:12:11.419 INFO:teuthology.orchestra.run.trial127.stdout:(45/165): libconfig-1.7.2-9.el9.x86_64.rpm 2.7 MB/s | 72 kB 00:00 2026-02-20T13:12:11.472 INFO:teuthology.orchestra.run.trial028.stdout:(105/165): python3-pyasn1-modules-0.4.8-6.el9.n 907 kB/s | 279 kB 00:00 2026-02-20T13:12:11.475 INFO:teuthology.orchestra.run.trial127.stdout:(46/165): libgfortran-11.5.0-14.el9.x86_64.rpm 14 MB/s | 794 kB 00:00 2026-02-20T13:12:11.502 INFO:teuthology.orchestra.run.trial127.stdout:(47/165): libquadmath-11.5.0-14.el9.x86_64.rpm 6.6 MB/s | 184 kB 00:00 2026-02-20T13:12:11.529 INFO:teuthology.orchestra.run.trial127.stdout:(48/165): lksctp-tools-1.0.19-2.el9.x86_64.rpm 3.5 MB/s | 94 kB 00:00 2026-02-20T13:12:11.554 INFO:teuthology.orchestra.run.trial127.stdout:(49/165): mailcap-2.1.49-5.el9.noarch.rpm 1.3 MB/s | 33 kB 00:00 2026-02-20T13:12:11.580 INFO:teuthology.orchestra.run.trial127.stdout:(50/165): pciutils-3.7.0-7.el9.x86_64.rpm 3.6 MB/s | 93 kB 00:00 2026-02-20T13:12:11.608 INFO:teuthology.orchestra.run.trial127.stdout:(51/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.8 MB/s | 253 kB 00:00 2026-02-20T13:12:11.644 INFO:teuthology.orchestra.run.trial127.stdout:(52/165): python3-cryptography-36.0.1-5.el9.x86 35 MB/s | 1.2 MB 00:00 2026-02-20T13:12:11.667 INFO:teuthology.orchestra.run.trial028.stdout:(106/165): python3-toml-0.10.2-6.el9.noarch.rpm 214 kB/s | 42 kB 00:00 2026-02-20T13:12:11.672 INFO:teuthology.orchestra.run.trial127.stdout:(53/165): python3-ply-3.11-14.el9.noarch.rpm 3.8 MB/s | 106 kB 00:00 2026-02-20T13:12:11.701 INFO:teuthology.orchestra.run.trial127.stdout:(54/165): python3-pycparser-2.20-6.el9.noarch.r 4.6 MB/s | 135 kB 00:00 2026-02-20T13:12:11.730 INFO:teuthology.orchestra.run.trial127.stdout:(55/165): python3-pyparsing-2.4.7-9.el9.noarch. 5.0 MB/s | 150 kB 00:00 2026-02-20T13:12:11.760 INFO:teuthology.orchestra.run.trial127.stdout:(56/165): python3-requests-2.25.1-10.el9.noarch 4.2 MB/s | 126 kB 00:00 2026-02-20T13:12:11.790 INFO:teuthology.orchestra.run.trial127.stdout:(57/165): python3-urllib3-1.26.5-7.el9.noarch.r 7.1 MB/s | 218 kB 00:00 2026-02-20T13:12:11.820 INFO:teuthology.orchestra.run.trial127.stdout:(58/165): unzip-6.0-59.el9.x86_64.rpm 6.0 MB/s | 182 kB 00:00 2026-02-20T13:12:11.821 INFO:teuthology.orchestra.run.trial028.stdout:(107/165): python3-numpy-1.23.5-2.el9.x86_64.rp 4.7 MB/s | 6.1 MB 00:01 2026-02-20T13:12:11.863 INFO:teuthology.orchestra.run.trial028.stdout:(108/165): python3-wcwidth-0.2.5-8.el9.noarch.r 226 kB/s | 44 kB 00:00 2026-02-20T13:12:11.952 INFO:teuthology.orchestra.run.trial127.stdout:(59/165): zip-3.0-35.el9.x86_64.rpm 2.0 MB/s | 266 kB 00:00 2026-02-20T13:12:12.057 INFO:teuthology.orchestra.run.trial028.stdout:(109/165): qatlib-service-25.08.0-2.el9.x86_64. 191 kB/s | 37 kB 00:00 2026-02-20T13:12:12.077 INFO:teuthology.orchestra.run.trial127.stdout:(60/165): ceph-mgr-dashboard-20.3.0-5390.g0917c 23 MB/s | 51 MB 00:02 2026-02-20T13:12:12.089 INFO:teuthology.orchestra.run.trial028.stdout:(110/165): qatlib-25.08.0-2.el9.x86_64.rpm 896 kB/s | 240 kB 00:00 2026-02-20T13:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout:(111/165): qatzip-libs-1.3.1-1.el9.x86_64.rpm 342 kB/s | 66 kB 00:00 2026-02-20T13:12:12.285 INFO:teuthology.orchestra.run.trial127.stdout:(61/165): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2026-02-20T13:12:12.296 INFO:teuthology.orchestra.run.trial127.stdout:(62/165): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2026-02-20T13:12:12.324 INFO:teuthology.orchestra.run.trial127.stdout:(63/165): boost-program-options-1.75.0-13.el9.x 2.7 MB/s | 104 kB 00:00 2026-02-20T13:12:12.353 INFO:teuthology.orchestra.run.trial127.stdout:(64/165): elfutils-libelf-devel-0.194-1.el9.x86 1.4 MB/s | 79 kB 00:00 2026-02-20T13:12:12.363 INFO:teuthology.orchestra.run.trial127.stdout:(65/165): flex-2.6.4-9.el9.x86_64.rpm 7.8 MB/s | 313 kB 00:00 2026-02-20T13:12:12.382 INFO:teuthology.orchestra.run.trial127.stdout:(66/165): flexiblas-3.0.4-9.el9.x86_64.rpm 1.0 MB/s | 30 kB 00:00 2026-02-20T13:12:12.395 INFO:teuthology.orchestra.run.trial028.stdout:(112/165): socat-1.7.4.1-8.el9.x86_64.rpm 993 kB/s | 303 kB 00:00 2026-02-20T13:12:12.410 INFO:teuthology.orchestra.run.trial127.stdout:(67/165): flexiblas-openblas-openmp-3.0.4-9.el9 528 kB/s | 15 kB 00:00 2026-02-20T13:12:12.438 INFO:teuthology.orchestra.run.trial127.stdout:(68/165): libaio-devel-0.3.111-13.el9.x86_64.rp 403 kB/s | 11 kB 00:00 2026-02-20T13:12:12.464 INFO:teuthology.orchestra.run.trial028.stdout:(113/165): uuid-1.6.2-55.el9.x86_64.rpm 271 kB/s | 58 kB 00:00 2026-02-20T13:12:12.467 INFO:teuthology.orchestra.run.trial127.stdout:(69/165): libnbd-1.20.3-4.el9.x86_64.rpm 5.5 MB/s | 164 kB 00:00 2026-02-20T13:12:12.474 INFO:teuthology.orchestra.run.trial127.stdout:(70/165): flexiblas-netlib-3.0.4-9.el9.x86_64.r 27 MB/s | 3.0 MB 00:00 2026-02-20T13:12:12.512 INFO:teuthology.orchestra.run.trial127.stdout:(71/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.5 MB/s | 160 kB 00:00 2026-02-20T13:12:12.517 INFO:teuthology.orchestra.run.trial127.stdout:(72/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2026-02-20T13:12:12.557 INFO:teuthology.orchestra.run.trial127.stdout:(73/165): libstoragemgmt-1.10.1-1.el9.x86_64.rp 6.1 MB/s | 246 kB 00:00 2026-02-20T13:12:12.563 INFO:teuthology.orchestra.run.trial127.stdout:(74/165): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2026-02-20T13:12:12.598 INFO:teuthology.orchestra.run.trial127.stdout:(75/165): libuuid-devel-2.37.4-21.el9.x86_64.rp 706 kB/s | 25 kB 00:00 2026-02-20T13:12:12.627 INFO:teuthology.orchestra.run.trial028.stdout:(114/165): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 413 kB/s | 96 kB 00:00 2026-02-20T13:12:12.640 INFO:teuthology.orchestra.run.trial127.stdout:(76/165): libxslt-1.1.34-12.el9.x86_64.rpm 5.4 MB/s | 233 kB 00:00 2026-02-20T13:12:12.661 INFO:teuthology.orchestra.run.trial028.stdout:(115/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 325 kB/s | 64 kB 00:00 2026-02-20T13:12:12.673 INFO:teuthology.orchestra.run.trial127.stdout:(77/165): libzstd-devel-1.5.5-1.el9.x86_64.rpm 1.5 MB/s | 51 kB 00:00 2026-02-20T13:12:12.683 INFO:teuthology.orchestra.run.trial127.stdout:(78/165): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2026-02-20T13:12:12.714 INFO:teuthology.orchestra.run.trial127.stdout:(79/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 7.0 MB/s | 292 kB 00:00 2026-02-20T13:12:12.730 INFO:teuthology.orchestra.run.trial127.stdout:(80/165): lua-5.4.4-4.el9.x86_64.rpm 3.9 MB/s | 188 kB 00:00 2026-02-20T13:12:12.745 INFO:teuthology.orchestra.run.trial127.stdout:(81/165): openblas-0.3.29-1.el9.x86_64.rpm 1.3 MB/s | 42 kB 00:00 2026-02-20T13:12:12.822 INFO:teuthology.orchestra.run.trial028.stdout:(116/165): zlib-devel-1.2.11-41.el9.x86_64.rpm 230 kB/s | 45 kB 00:00 2026-02-20T13:12:12.874 INFO:teuthology.orchestra.run.trial127.stdout:(82/165): openblas-openmp-0.3.29-1.el9.x86_64.r 37 MB/s | 5.3 MB 00:00 2026-02-20T13:12:12.912 INFO:teuthology.orchestra.run.trial127.stdout:(83/165): perl-Thread-Queue-3.14-460.el9.noarch 581 kB/s | 22 kB 00:00 2026-02-20T13:12:12.936 INFO:teuthology.orchestra.run.trial127.stdout:(84/165): perl-threads-2.25-460.el9.x86_64.rpm 2.4 MB/s | 58 kB 00:00 2026-02-20T13:12:12.960 INFO:teuthology.orchestra.run.trial127.stdout:(85/165): perl-threads-shared-1.61-460.el9.x86_ 1.8 MB/s | 45 kB 00:00 2026-02-20T13:12:13.014 INFO:teuthology.orchestra.run.trial127.stdout:(86/165): postgresql-13.23-1.el9.x86_64.rpm 31 MB/s | 1.6 MB 00:00 2026-02-20T13:12:13.072 INFO:teuthology.orchestra.run.trial127.stdout:(87/165): postgresql-contrib-13.23-1.el9.x86_64 15 MB/s | 903 kB 00:00 2026-02-20T13:12:13.128 INFO:teuthology.orchestra.run.trial127.stdout:(88/165): postgresql-private-libs-13.23-1.el9.x 2.4 MB/s | 138 kB 00:00 2026-02-20T13:12:13.221 INFO:teuthology.orchestra.run.trial028.stdout:(117/165): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2026-02-20T13:12:13.246 INFO:teuthology.orchestra.run.trial127.stdout:(89/165): postgresql-server-13.23-1.el9.x86_64. 49 MB/s | 5.8 MB 00:00 2026-02-20T13:12:13.284 INFO:teuthology.orchestra.run.trial127.stdout:(90/165): protobuf-3.14.0-17.el9.x86_64.rpm 26 MB/s | 1.0 MB 00:00 2026-02-20T13:12:13.352 INFO:teuthology.orchestra.run.trial127.stdout:(91/165): python3-babel-2.9.1-2.el9.noarch.rpm 88 MB/s | 6.0 MB 00:00 2026-02-20T13:12:13.449 INFO:teuthology.orchestra.run.trial028.stdout:(118/165): python3-scipy-1.9.3-2.el9.x86_64.rpm 9.3 MB/s | 19 MB 00:02 2026-02-20T13:12:13.467 INFO:teuthology.orchestra.run.trial127.stdout:(92/165): ceph-test-20.3.0-5390.g0917c158.el9.x 17 MB/s | 78 MB 00:04 2026-02-20T13:12:13.468 INFO:teuthology.orchestra.run.trial127.stdout:(93/165): python3-colorama-0.4.6-3.el9.noarch.r 529 kB/s | 61 kB 00:00 2026-02-20T13:12:13.494 INFO:teuthology.orchestra.run.trial127.stdout:(94/165): python3-jinja2-2.11.3-8.el9.noarch.rp 9.5 MB/s | 249 kB 00:00 2026-02-20T13:12:13.518 INFO:teuthology.orchestra.run.trial127.stdout:(95/165): python3-jmespath-1.0.1-1.el9.noarch.r 1.9 MB/s | 48 kB 00:00 2026-02-20T13:12:13.543 INFO:teuthology.orchestra.run.trial127.stdout:(96/165): python3-libstoragemgmt-1.10.1-1.el9.x 7.0 MB/s | 177 kB 00:00 2026-02-20T13:12:13.564 INFO:teuthology.orchestra.run.trial127.stdout:(97/165): openssl-devel-3.5.5-1.el9.x86_64.rpm 5.9 MB/s | 4.8 MB 00:00 2026-02-20T13:12:13.567 INFO:teuthology.orchestra.run.trial127.stdout:(98/165): python3-markupsafe-1.1.1-12.el9.x86_6 1.4 MB/s | 35 kB 00:00 2026-02-20T13:12:13.585 INFO:teuthology.orchestra.run.trial028.stdout:(119/165): abseil-cpp-20211102.0-4.el9.x86_64.r 1.5 MB/s | 551 kB 00:00 2026-02-20T13:12:13.594 INFO:teuthology.orchestra.run.trial127.stdout:(99/165): python3-numpy-f2py-1.23.5-2.el9.x86_6 16 MB/s | 442 kB 00:00 2026-02-20T13:12:13.618 INFO:teuthology.orchestra.run.trial127.stdout:(100/165): python3-packaging-20.9-5.el9.noarch. 3.1 MB/s | 77 kB 00:00 2026-02-20T13:12:13.619 INFO:teuthology.orchestra.run.trial028.stdout:(120/165): grpc-data-1.46.7-10.el9.noarch.rpm 580 kB/s | 19 kB 00:00 2026-02-20T13:12:13.625 INFO:teuthology.orchestra.run.trial127.stdout:(101/165): python3-devel-3.9.25-3.el9.x86_64.rp 1.5 MB/s | 244 kB 00:00 2026-02-20T13:12:13.666 INFO:teuthology.orchestra.run.trial028.stdout:(121/165): gperftools-libs-2.9.1-3.el9.x86_64.r 1.4 MB/s | 308 kB 00:00 2026-02-20T13:12:13.669 INFO:teuthology.orchestra.run.trial127.stdout:(102/165): python3-protobuf-3.14.0-17.el9.noarc 5.1 MB/s | 267 kB 00:00 2026-02-20T13:12:13.677 INFO:teuthology.orchestra.run.trial127.stdout:(103/165): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.0 MB/s | 159 kB 00:00 2026-02-20T13:12:13.695 INFO:teuthology.orchestra.run.trial127.stdout:(104/165): python3-pyasn1-modules-0.4.8-6.el9.n 11 MB/s | 279 kB 00:00 2026-02-20T13:12:13.700 INFO:teuthology.orchestra.run.trial028.stdout:(122/165): libarrow-doc-9.0.0-15.el9.noarch.rpm 742 kB/s | 25 kB 00:00 2026-02-20T13:12:13.713 INFO:teuthology.orchestra.run.trial127.stdout:(105/165): python3-requests-oauthlib-1.3.0-12.e 1.5 MB/s | 54 kB 00:00 2026-02-20T13:12:13.735 INFO:teuthology.orchestra.run.trial028.stdout:(123/165): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-20T13:12:13.747 INFO:teuthology.orchestra.run.trial127.stdout:(106/165): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2026-02-20T13:12:13.770 INFO:teuthology.orchestra.run.trial028.stdout:(124/165): libarrow-9.0.0-15.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2026-02-20T13:12:13.772 INFO:teuthology.orchestra.run.trial028.stdout:(125/165): libunwind-1.6.2-1.el9.x86_64.rpm 1.8 MB/s | 67 kB 00:00 2026-02-20T13:12:13.804 INFO:teuthology.orchestra.run.trial127.stdout:(107/165): python3-wcwidth-0.2.5-8.el9.noarch.r 782 kB/s | 44 kB 00:00 2026-02-20T13:12:13.806 INFO:teuthology.orchestra.run.trial028.stdout:(126/165): luarocks-3.9.2-5.el9.noarch.rpm 4.2 MB/s | 151 kB 00:00 2026-02-20T13:12:13.851 INFO:teuthology.orchestra.run.trial028.stdout:(127/165): python3-asyncssh-2.13.2-5.el9.noarch 12 MB/s | 548 kB 00:00 2026-02-20T13:12:13.865 INFO:teuthology.orchestra.run.trial127.stdout:(108/165): python3-scipy-1.9.3-2.el9.x86_64.rpm 113 MB/s | 19 MB 00:00 2026-02-20T13:12:13.866 INFO:teuthology.orchestra.run.trial028.stdout:(128/165): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.8 MB/s | 838 kB 00:00 2026-02-20T13:12:13.866 INFO:teuthology.orchestra.run.trial127.stdout:(109/165): qatlib-25.08.0-2.el9.x86_64.rpm 3.8 MB/s | 240 kB 00:00 2026-02-20T13:12:13.885 INFO:teuthology.orchestra.run.trial028.stdout:(129/165): python3-autocommand-2.2.2-8.el9.noar 858 kB/s | 29 kB 00:00 2026-02-20T13:12:13.889 INFO:teuthology.orchestra.run.trial127.stdout:(110/165): qatlib-service-25.08.0-2.el9.x86_64. 1.5 MB/s | 37 kB 00:00 2026-02-20T13:12:13.900 INFO:teuthology.orchestra.run.trial028.stdout:(130/165): python3-backports-tarfile-1.2.0-1.el 1.7 MB/s | 60 kB 00:00 2026-02-20T13:12:13.901 INFO:teuthology.orchestra.run.trial127.stdout:(111/165): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.8 MB/s | 66 kB 00:00 2026-02-20T13:12:13.915 INFO:teuthology.orchestra.run.trial127.stdout:(112/165): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-20T13:12:13.920 INFO:teuthology.orchestra.run.trial028.stdout:(131/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.2 MB/s | 43 kB 00:00 2026-02-20T13:12:13.935 INFO:teuthology.orchestra.run.trial028.stdout:(132/165): python3-cachetools-4.2.4-1.el9.noarc 938 kB/s | 32 kB 00:00 2026-02-20T13:12:13.954 INFO:teuthology.orchestra.run.trial028.stdout:(133/165): python3-certifi-2023.05.07-4.el9.noa 418 kB/s | 14 kB 00:00 2026-02-20T13:12:13.972 INFO:teuthology.orchestra.run.trial028.stdout:(134/165): python3-cheroot-10.0.1-4.el9.noarch. 4.5 MB/s | 173 kB 00:00 2026-02-20T13:12:13.983 INFO:teuthology.orchestra.run.trial127.stdout:(113/165): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2026-02-20T13:12:13.991 INFO:teuthology.orchestra.run.trial028.stdout:(135/165): python3-cherrypy-18.6.1-2.el9.noarch 9.4 MB/s | 358 kB 00:00 2026-02-20T13:12:13.993 INFO:teuthology.orchestra.run.trial127.stdout:(114/165): uuid-1.6.2-55.el9.x86_64.rpm 628 kB/s | 58 kB 00:00 2026-02-20T13:12:14.014 INFO:teuthology.orchestra.run.trial028.stdout:(136/165): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.2 MB/s | 303 kB 00:00 2026-02-20T13:12:14.028 INFO:teuthology.orchestra.run.trial028.stdout:(137/165): python3-google-auth-2.45.0-1.el9.noa 6.7 MB/s | 254 kB 00:00 2026-02-20T13:12:14.039 INFO:teuthology.orchestra.run.trial127.stdout:(115/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2026-02-20T13:12:14.046 INFO:teuthology.orchestra.run.trial127.stdout:(116/165): zlib-devel-1.2.11-41.el9.x86_64.rpm 863 kB/s | 45 kB 00:00 2026-02-20T13:12:14.064 INFO:teuthology.orchestra.run.trial028.stdout:(138/165): python3-grpcio-tools-1.46.7-10.el9.x 3.9 MB/s | 144 kB 00:00 2026-02-20T13:12:14.096 INFO:teuthology.orchestra.run.trial127.stdout:(117/165): python3-numpy-1.23.5-2.el9.x86_64.rp 12 MB/s | 6.1 MB 00:00 2026-02-20T13:12:14.101 INFO:teuthology.orchestra.run.trial028.stdout:(139/165): python3-grpcio-1.46.7-10.el9.x86_64. 23 MB/s | 2.0 MB 00:00 2026-02-20T13:12:14.102 INFO:teuthology.orchestra.run.trial028.stdout:(140/165): python3-jaraco-8.2.1-3.el9.noarch.rp 285 kB/s | 11 kB 00:00 2026-02-20T13:12:14.135 INFO:teuthology.orchestra.run.trial028.stdout:(141/165): python3-jaraco-classes-3.2.1-5.el9.n 525 kB/s | 18 kB 00:00 2026-02-20T13:12:14.136 INFO:teuthology.orchestra.run.trial028.stdout:(142/165): python3-jaraco-collections-3.0.0-8.e 685 kB/s | 23 kB 00:00 2026-02-20T13:12:14.169 INFO:teuthology.orchestra.run.trial028.stdout:(143/165): python3-jaraco-context-6.0.1-3.el9.n 581 kB/s | 20 kB 00:00 2026-02-20T13:12:14.170 INFO:teuthology.orchestra.run.trial028.stdout:(144/165): python3-jaraco-functools-3.5.0-2.el9 575 kB/s | 19 kB 00:00 2026-02-20T13:12:14.190 INFO:teuthology.orchestra.run.trial034.stdout:(117/165): lua-devel-5.4.4-4.el9.x86_64.rpm 5.9 kB/s | 22 kB 00:03 2026-02-20T13:12:14.191 INFO:teuthology.orchestra.run.trial127.stdout:(118/165): lua-devel-5.4.4-4.el9.x86_64.rpm 147 kB/s | 22 kB 00:00 2026-02-20T13:12:14.203 INFO:teuthology.orchestra.run.trial028.stdout:(145/165): python3-jaraco-text-4.0.0-2.el9.noar 778 kB/s | 26 kB 00:00 2026-02-20T13:12:14.214 INFO:teuthology.orchestra.run.trial028.stdout:(146/165): python3-kubernetes-26.1.0-3.el9.noar 23 MB/s | 1.0 MB 00:00 2026-02-20T13:12:14.237 INFO:teuthology.orchestra.run.trial034.stdout:(118/165): protobuf-compiler-3.14.0-17.el9.x86_ 252 kB/s | 862 kB 00:03 2026-02-20T13:12:14.238 INFO:teuthology.orchestra.run.trial127.stdout:(119/165): protobuf-compiler-3.14.0-17.el9.x86_ 4.4 MB/s | 862 kB 00:00 2026-02-20T13:12:14.239 INFO:teuthology.orchestra.run.trial028.stdout:(147/165): python3-more-itertools-8.12.0-2.el9. 2.2 MB/s | 79 kB 00:00 2026-02-20T13:12:14.249 INFO:teuthology.orchestra.run.trial028.stdout:(148/165): python3-natsort-7.1.1-5.el9.noarch.r 1.6 MB/s | 58 kB 00:00 2026-02-20T13:12:14.273 INFO:teuthology.orchestra.run.trial028.stdout:(149/165): python3-portend-3.1.0-2.el9.noarch.r 481 kB/s | 16 kB 00:00 2026-02-20T13:12:14.283 INFO:teuthology.orchestra.run.trial028.stdout:(150/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.5 MB/s | 90 kB 00:00 2026-02-20T13:12:14.307 INFO:teuthology.orchestra.run.trial028.stdout:(151/165): python3-pyperclip-1.8.2-2.el9.noarch 830 kB/s | 28 kB 00:00 2026-02-20T13:12:14.317 INFO:teuthology.orchestra.run.trial028.stdout:(152/165): python3-repoze-lru-0.7-16.el9.noarch 905 kB/s | 31 kB 00:00 2026-02-20T13:12:14.325 INFO:teuthology.orchestra.run.trial028.stdout:(153/165): protobuf-compiler-3.14.0-17.el9.x86_ 574 kB/s | 862 kB 00:01 2026-02-20T13:12:14.344 INFO:teuthology.orchestra.run.trial028.stdout:(154/165): python3-routes-2.5.1-5.el9.noarch.rp 5.1 MB/s | 188 kB 00:00 2026-02-20T13:12:14.352 INFO:teuthology.orchestra.run.trial028.stdout:(155/165): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-20T13:12:14.379 INFO:teuthology.orchestra.run.trial028.stdout:(156/165): python3-typing-extensions-4.15.0-1.e 2.4 MB/s | 86 kB 00:00 2026-02-20T13:12:14.386 INFO:teuthology.orchestra.run.trial028.stdout:(157/165): python3-websocket-client-1.2.3-2.el9 2.5 MB/s | 90 kB 00:00 2026-02-20T13:12:14.413 INFO:teuthology.orchestra.run.trial034.stdout:(119/165): python3-babel-2.9.1-2.el9.noarch.rpm 890 kB/s | 6.0 MB 00:06 2026-02-20T13:12:14.413 INFO:teuthology.orchestra.run.trial028.stdout:(158/165): python3-xmltodict-0.12.0-15.el9.noar 651 kB/s | 22 kB 00:00 2026-02-20T13:12:14.420 INFO:teuthology.orchestra.run.trial028.stdout:(159/165): python3-zc-lockfile-2.0-10.el9.noarc 595 kB/s | 20 kB 00:00 2026-02-20T13:12:14.438 INFO:teuthology.orchestra.run.trial028.stdout:(160/165): python3-tempora-5.0.0-2.el9.noarch.r 318 kB/s | 36 kB 00:00 2026-02-20T13:12:14.449 INFO:teuthology.orchestra.run.trial028.stdout:(161/165): re2-20211101-20.el9.x86_64.rpm 5.2 MB/s | 191 kB 00:00 2026-02-20T13:12:14.469 INFO:teuthology.orchestra.run.trial028.stdout:(162/165): thrift-0.15.0-4.el9.x86_64.rpm 32 MB/s | 1.6 MB 00:00 2026-02-20T13:12:14.541 INFO:teuthology.orchestra.run.trial028.stdout:(163/165): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.1 MB/s | 122 kB 00:00 2026-02-20T13:12:14.620 INFO:teuthology.orchestra.run.trial028.stdout:(164/165): librbd1-20.3.0-5390.g0917c158.el9.x8 19 MB/s | 2.8 MB 00:00 2026-02-20T13:12:14.635 INFO:teuthology.orchestra.run.trial127.stdout:(120/165): grpc-data-1.46.7-10.el9.noarch.rpm 49 kB/s | 19 kB 00:00 2026-02-20T13:12:14.695 INFO:teuthology.orchestra.run.trial028.stdout:(165/165): librados2-20.3.0-5390.g0917c158.el9. 14 MB/s | 3.5 MB 00:00 2026-02-20T13:12:14.698 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:12:14.698 INFO:teuthology.orchestra.run.trial028.stdout:Total 19 MB/s | 327 MB 00:17 2026-02-20T13:12:14.986 INFO:teuthology.orchestra.run.trial127.stdout:(121/165): gperftools-libs-2.9.1-3.el9.x86_64.r 387 kB/s | 308 kB 00:00 2026-02-20T13:12:15.066 INFO:teuthology.orchestra.run.trial127.stdout:(122/165): libarrow-doc-9.0.0-15.el9.noarch.rpm 311 kB/s | 25 kB 00:00 2026-02-20T13:12:15.146 INFO:teuthology.orchestra.run.trial127.stdout:(123/165): liboath-2.6.12-1.el9.x86_64.rpm 617 kB/s | 49 kB 00:00 2026-02-20T13:12:15.220 INFO:teuthology.orchestra.run.trial127.stdout:(124/165): abseil-cpp-20211102.0-4.el9.x86_64.r 491 kB/s | 551 kB 00:01 2026-02-20T13:12:15.225 INFO:teuthology.orchestra.run.trial127.stdout:(125/165): libunwind-1.6.2-1.el9.x86_64.rpm 843 kB/s | 67 kB 00:00 2026-02-20T13:12:15.495 INFO:teuthology.orchestra.run.trial127.stdout:(126/165): luarocks-3.9.2-5.el9.noarch.rpm 550 kB/s | 151 kB 00:00 2026-02-20T13:12:16.073 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T13:12:16.141 INFO:teuthology.orchestra.run.trial127.stdout:(127/165): python3-asyncssh-2.13.2-5.el9.noarch 849 kB/s | 548 kB 00:00 2026-02-20T13:12:16.151 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T13:12:16.151 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T13:12:16.174 INFO:teuthology.orchestra.run.trial127.stdout:(128/165): parquet-libs-9.0.0-15.el9.x86_64.rpm 883 kB/s | 838 kB 00:00 2026-02-20T13:12:16.228 INFO:teuthology.orchestra.run.trial127.stdout:(129/165): python3-autocommand-2.2.2-8.el9.noar 338 kB/s | 29 kB 00:00 2026-02-20T13:12:16.254 INFO:teuthology.orchestra.run.trial127.stdout:(130/165): python3-backports-tarfile-1.2.0-1.el 755 kB/s | 60 kB 00:00 2026-02-20T13:12:16.314 INFO:teuthology.orchestra.run.trial127.stdout:(131/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 506 kB/s | 43 kB 00:00 2026-02-20T13:12:16.341 INFO:teuthology.orchestra.run.trial127.stdout:(132/165): python3-cachetools-4.2.4-1.el9.noarc 370 kB/s | 32 kB 00:00 2026-02-20T13:12:16.399 INFO:teuthology.orchestra.run.trial127.stdout:(133/165): python3-certifi-2023.05.07-4.el9.noa 165 kB/s | 14 kB 00:00 2026-02-20T13:12:16.583 INFO:teuthology.orchestra.run.trial127.stdout:(134/165): python3-cheroot-10.0.1-4.el9.noarch. 718 kB/s | 173 kB 00:00 2026-02-20T13:12:16.882 INFO:teuthology.orchestra.run.trial127.stdout:(135/165): python3-cherrypy-18.6.1-2.el9.noarch 743 kB/s | 358 kB 00:00 2026-02-20T13:12:16.986 INFO:teuthology.orchestra.run.trial127.stdout:(136/165): python3-cmd2-2.4.2-2.el9.noarch.rpm 752 kB/s | 303 kB 00:00 2026-02-20T13:12:17.208 INFO:teuthology.orchestra.run.trial127.stdout:(137/165): python3-google-auth-2.45.0-1.el9.noa 781 kB/s | 254 kB 00:00 2026-02-20T13:12:17.450 INFO:teuthology.orchestra.run.trial127.stdout:(138/165): python3-grpcio-tools-1.46.7-10.el9.x 596 kB/s | 144 kB 00:00 2026-02-20T13:12:17.516 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T13:12:17.516 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T13:12:17.539 INFO:teuthology.orchestra.run.trial127.stdout:(139/165): python3-jaraco-8.2.1-3.el9.noarch.rp 121 kB/s | 11 kB 00:00 2026-02-20T13:12:17.619 INFO:teuthology.orchestra.run.trial127.stdout:[MIRROR] python3-jaraco-classes-3.2.1-5.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-jaraco-classes-3.2.1-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-20T13:12:17.777 INFO:teuthology.orchestra.run.trial127.stdout:[MIRROR] python3-jaraco-classes-3.2.1-5.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-jaraco-classes-3.2.1-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-20T13:12:17.887 INFO:teuthology.orchestra.run.trial127.stdout:(140/165): python3-jaraco-classes-3.2.1-5.el9.n 51 kB/s | 18 kB 00:00 2026-02-20T13:12:18.206 INFO:teuthology.orchestra.run.trial127.stdout:[MIRROR] python3-jaraco-collections-3.0.0-8.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-jaraco-collections-3.0.0-8.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-20T13:12:18.365 INFO:teuthology.orchestra.run.trial127.stdout:[MIRROR] python3-jaraco-collections-3.0.0-8.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-jaraco-collections-3.0.0-8.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-20T13:12:18.409 INFO:teuthology.orchestra.run.trial127.stdout:(141/165): python3-jaraco-collections-3.0.0-8.e 44 kB/s | 23 kB 00:00 2026-02-20T13:12:18.567 INFO:teuthology.orchestra.run.trial127.stdout:[MIRROR] python3-jaraco-context-6.0.1-3.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-jaraco-context-6.0.1-3.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-20T13:12:18.885 INFO:teuthology.orchestra.run.trial127.stdout:[MIRROR] python3-jaraco-context-6.0.1-3.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-jaraco-context-6.0.1-3.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-20T13:12:18.929 INFO:teuthology.orchestra.run.trial127.stdout:(142/165): python3-jaraco-context-6.0.1-3.el9.n 38 kB/s | 20 kB 00:00 2026-02-20T13:12:18.953 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T13:12:18.959 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/167 2026-02-20T13:12:18.972 INFO:teuthology.orchestra.run.trial028.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/167 2026-02-20T13:12:18.992 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/167 2026-02-20T13:12:19.168 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/167 2026-02-20T13:12:19.172 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librados2-2:20.3.0-5390.g0917c158.el9.x86_64 5/167 2026-02-20T13:12:19.216 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:20.3.0-5390.g0917c158.el9.x86_64 5/167 2026-02-20T13:12:19.229 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 6/167 2026-02-20T13:12:19.234 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/167 2026-02-20T13:12:19.239 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/167 2026-02-20T13:12:19.243 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/167 2026-02-20T13:12:19.246 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/167 2026-02-20T13:12:19.249 INFO:teuthology.orchestra.run.trial127.stdout:[MIRROR] python3-jaraco-functools-3.5.0-2.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-jaraco-functools-3.5.0-2.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-20T13:12:19.255 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 11/167 2026-02-20T13:12:19.294 INFO:teuthology.orchestra.run.trial127.stdout:(143/165): python3-jaraco-functools-3.5.0-2.el9 53 kB/s | 19 kB 00:00 2026-02-20T13:12:19.317 INFO:teuthology.orchestra.run.trial127.stdout:(144/165): python3-jaraco-text-4.0.0-2.el9.noar 1.1 MB/s | 26 kB 00:00 2026-02-20T13:12:19.345 INFO:teuthology.orchestra.run.trial127.stdout:(145/165): python3-grpcio-1.46.7-10.el9.x86_64. 884 kB/s | 2.0 MB 00:02 2026-02-20T13:12:19.388 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 12/167 2026-02-20T13:12:19.391 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:19.428 INFO:teuthology.orchestra.run.trial127.stdout:(146/165): python3-kubernetes-26.1.0-3.el9.noar 9.2 MB/s | 1.0 MB 00:00 2026-02-20T13:12:19.428 INFO:teuthology.orchestra.run.trial127.stdout:(147/165): python3-more-itertools-8.12.0-2.el9. 952 kB/s | 79 kB 00:00 2026-02-20T13:12:19.451 INFO:teuthology.orchestra.run.trial127.stdout:(148/165): python3-natsort-7.1.1-5.el9.noarch.r 2.5 MB/s | 58 kB 00:00 2026-02-20T13:12:19.452 INFO:teuthology.orchestra.run.trial127.stdout:(149/165): python3-portend-3.1.0-2.el9.noarch.r 702 kB/s | 16 kB 00:00 2026-02-20T13:12:19.476 INFO:teuthology.orchestra.run.trial127.stdout:(150/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2026-02-20T13:12:19.477 INFO:teuthology.orchestra.run.trial127.stdout:(151/165): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2026-02-20T13:12:19.499 INFO:teuthology.orchestra.run.trial127.stdout:(152/165): python3-repoze-lru-0.7-16.el9.noarch 1.3 MB/s | 31 kB 00:00 2026-02-20T13:12:19.500 INFO:teuthology.orchestra.run.trial127.stdout:(153/165): python3-routes-2.5.1-5.el9.noarch.rp 7.9 MB/s | 188 kB 00:00 2026-02-20T13:12:19.506 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:19.522 INFO:teuthology.orchestra.run.trial127.stdout:(154/165): python3-rsa-4.9-2.el9.noarch.rpm 2.6 MB/s | 59 kB 00:00 2026-02-20T13:12:19.522 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-13.23-1.el9.x86_64 14/167 2026-02-20T13:12:19.522 INFO:teuthology.orchestra.run.trial127.stdout:(155/165): python3-tempora-5.0.0-2.el9.noarch.r 1.6 MB/s | 36 kB 00:00 2026-02-20T13:12:19.524 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:19.545 INFO:teuthology.orchestra.run.trial127.stdout:(156/165): python3-typing-extensions-4.15.0-1.e 3.7 MB/s | 86 kB 00:00 2026-02-20T13:12:19.545 INFO:teuthology.orchestra.run.trial127.stdout:(157/165): python3-websocket-client-1.2.3-2.el9 3.8 MB/s | 90 kB 00:00 2026-02-20T13:12:19.558 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:19.560 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 16/167 2026-02-20T13:12:19.567 INFO:teuthology.orchestra.run.trial127.stdout:(158/165): python3-xmltodict-0.12.0-15.el9.noar 989 kB/s | 22 kB 00:00 2026-02-20T13:12:19.568 INFO:teuthology.orchestra.run.trial127.stdout:(159/165): python3-zc-lockfile-2.0-10.el9.noarc 891 kB/s | 20 kB 00:00 2026-02-20T13:12:19.575 INFO:teuthology.orchestra.run.trial034.stdout:(120/165): grpc-data-1.46.7-10.el9.noarch.rpm 3.8 kB/s | 19 kB 00:05 2026-02-20T13:12:19.586 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 16/167 2026-02-20T13:12:19.591 INFO:teuthology.orchestra.run.trial127.stdout:(160/165): re2-20211101-20.el9.x86_64.rpm 8.0 MB/s | 191 kB 00:00 2026-02-20T13:12:19.592 INFO:teuthology.orchestra.run.trial028.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 17/167 2026-02-20T13:12:19.616 INFO:teuthology.orchestra.run.trial127.stdout:(161/165): thrift-0.15.0-4.el9.x86_64.rpm 33 MB/s | 1.6 MB 00:00 2026-02-20T13:12:19.616 INFO:teuthology.orchestra.run.trial127.stdout:(162/165): yaml-cpp-0.6.3-5.el9.x86_64.rpm 4.7 MB/s | 122 kB 00:00 2026-02-20T13:12:19.633 INFO:teuthology.orchestra.run.trial028.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/167 2026-02-20T13:12:19.666 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 19/167 2026-02-20T13:12:19.676 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/167 2026-02-20T13:12:19.684 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 21/167 2026-02-20T13:12:19.693 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-5.4.4-4.el9.x86_64 22/167 2026-02-20T13:12:19.699 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 23/167 2026-02-20T13:12:19.707 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 24/167 2026-02-20T13:12:19.743 INFO:teuthology.orchestra.run.trial028.stdout: Installing : unzip-6.0-59.el9.x86_64 25/167 2026-02-20T13:12:19.764 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 26/167 2026-02-20T13:12:19.764 INFO:teuthology.orchestra.run.trial127.stdout:(163/165): librbd1-20.3.0-5390.g0917c158.el9.x8 19 MB/s | 2.8 MB 00:00 2026-02-20T13:12:19.768 INFO:teuthology.orchestra.run.trial127.stdout:(164/165): librados2-20.3.0-5390.g0917c158.el9. 23 MB/s | 3.5 MB 00:00 2026-02-20T13:12:19.774 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 27/167 2026-02-20T13:12:19.777 INFO:teuthology.orchestra.run.trial034.stdout:(121/165): gperftools-libs-2.9.1-3.el9.x86_64.r 56 kB/s | 308 kB 00:05 2026-02-20T13:12:19.780 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 28/167 2026-02-20T13:12:19.788 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 29/167 2026-02-20T13:12:19.791 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 30/167 2026-02-20T13:12:19.794 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 31/167 2026-02-20T13:12:19.796 INFO:teuthology.orchestra.run.trial127.stdout:(165/165): libarrow-9.0.0-15.el9.x86_64.rpm 875 kB/s | 4.4 MB 00:05 2026-02-20T13:12:19.800 INFO:teuthology.orchestra.run.trial127.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:12:19.800 INFO:teuthology.orchestra.run.trial127.stdout:Total 26 MB/s | 327 MB 00:12 2026-02-20T13:12:19.809 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 32/167 2026-02-20T13:12:19.823 INFO:teuthology.orchestra.run.trial034.stdout:(122/165): abseil-cpp-20211102.0-4.el9.x86_64.r 98 kB/s | 551 kB 00:05 2026-02-20T13:12:19.841 INFO:teuthology.orchestra.run.trial034.stdout:(123/165): libarrow-doc-9.0.0-15.el9.noarch.rpm 389 kB/s | 25 kB 00:00 2026-02-20T13:12:19.859 INFO:teuthology.orchestra.run.trial028.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 33/167 2026-02-20T13:12:19.867 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-common-2:20.3.0-5390.g0917c158.el9. 34/167 2026-02-20T13:12:19.870 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-argparse-2:20.3.0-5390.g0917c158.el 35/167 2026-02-20T13:12:19.871 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 36/167 2026-02-20T13:12:19.886 INFO:teuthology.orchestra.run.trial034.stdout:(124/165): liboath-2.6.12-1.el9.x86_64.rpm 772 kB/s | 49 kB 00:00 2026-02-20T13:12:19.910 INFO:teuthology.orchestra.run.trial034.stdout:(125/165): libunwind-1.6.2-1.el9.x86_64.rpm 971 kB/s | 67 kB 00:00 2026-02-20T13:12:19.935 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 36/167 2026-02-20T13:12:19.937 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 37/167 2026-02-20T13:12:19.958 INFO:teuthology.orchestra.run.trial034.stdout:(126/165): luarocks-3.9.2-5.el9.noarch.rpm 2.1 MB/s | 151 kB 00:00 2026-02-20T13:12:19.972 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 37/167 2026-02-20T13:12:19.990 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_6 38/167 2026-02-20T13:12:20.001 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 39/167 2026-02-20T13:12:20.040 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zip-3.0-35.el9.x86_64 40/167 2026-02-20T13:12:20.050 INFO:teuthology.orchestra.run.trial028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 41/167 2026-02-20T13:12:20.054 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 42/167 2026-02-20T13:12:20.060 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/167 2026-02-20T13:12:20.065 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 44/167 2026-02-20T13:12:20.085 INFO:teuthology.orchestra.run.trial034.stdout:(127/165): libarrow-9.0.0-15.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2026-02-20T13:12:20.086 INFO:teuthology.orchestra.run.trial034.stdout:(128/165): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2026-02-20T13:12:20.088 INFO:teuthology.orchestra.run.trial034.stdout:(129/165): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.6 MB/s | 838 kB 00:00 2026-02-20T13:12:20.106 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 45/167 2026-02-20T13:12:20.147 INFO:teuthology.orchestra.run.trial034.stdout:(130/165): python3-autocommand-2.2.2-8.el9.noar 482 kB/s | 29 kB 00:00 2026-02-20T13:12:20.151 INFO:teuthology.orchestra.run.trial034.stdout:(131/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 699 kB/s | 43 kB 00:00 2026-02-20T13:12:20.151 INFO:teuthology.orchestra.run.trial034.stdout:(132/165): python3-backports-tarfile-1.2.0-1.el 937 kB/s | 60 kB 00:00 2026-02-20T13:12:20.181 INFO:teuthology.orchestra.run.trial028.stdout: Installing : automake-1.16.2-8.el9.noarch 46/167 2026-02-20T13:12:20.202 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/167 2026-02-20T13:12:20.208 INFO:teuthology.orchestra.run.trial034.stdout:(133/165): python3-cachetools-4.2.4-1.el9.noarc 527 kB/s | 32 kB 00:00 2026-02-20T13:12:20.212 INFO:teuthology.orchestra.run.trial034.stdout:(134/165): python3-certifi-2023.05.07-4.el9.noa 230 kB/s | 14 kB 00:00 2026-02-20T13:12:20.219 INFO:teuthology.orchestra.run.trial034.stdout:(135/165): python3-cheroot-10.0.1-4.el9.noarch. 2.5 MB/s | 173 kB 00:00 2026-02-20T13:12:20.223 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/167 2026-02-20T13:12:20.232 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 49/167 2026-02-20T13:12:20.242 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/167 2026-02-20T13:12:20.253 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librados-devel-2:20.3.0-5390.g0917c158.el9.x86_6 51/167 2026-02-20T13:12:20.270 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 52/167 2026-02-20T13:12:20.272 INFO:teuthology.orchestra.run.trial034.stdout:(136/165): python3-cherrypy-18.6.1-2.el9.noarch 5.4 MB/s | 358 kB 00:00 2026-02-20T13:12:20.280 INFO:teuthology.orchestra.run.trial028.stdout: Installing : thrift-0.15.0-4.el9.x86_64 53/167 2026-02-20T13:12:20.286 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 54/167 2026-02-20T13:12:20.291 INFO:teuthology.orchestra.run.trial034.stdout:(137/165): python3-google-auth-2.45.0-1.el9.noa 3.4 MB/s | 254 kB 00:00 2026-02-20T13:12:20.292 INFO:teuthology.orchestra.run.trial034.stdout:(138/165): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.7 MB/s | 303 kB 00:00 2026-02-20T13:12:20.308 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 55/167 2026-02-20T13:12:20.316 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 56/167 2026-02-20T13:12:20.325 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 57/167 2026-02-20T13:12:20.343 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 58/167 2026-02-20T13:12:20.352 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 59/167 2026-02-20T13:12:20.366 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 60/167 2026-02-20T13:12:20.374 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 61/167 2026-02-20T13:12:20.374 INFO:teuthology.orchestra.run.trial034.stdout:(139/165): python3-jaraco-8.2.1-3.el9.noarch.rp 131 kB/s | 11 kB 00:00 2026-02-20T13:12:20.378 INFO:teuthology.orchestra.run.trial034.stdout:(140/165): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2026-02-20T13:12:20.382 INFO:teuthology.orchestra.run.trial034.stdout:(141/165): python3-grpcio-tools-1.46.7-10.el9.x 1.6 MB/s | 144 kB 00:00 2026-02-20T13:12:20.386 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 62/167 2026-02-20T13:12:20.435 INFO:teuthology.orchestra.run.trial034.stdout:(142/165): python3-jaraco-classes-3.2.1-5.el9.n 288 kB/s | 18 kB 00:00 2026-02-20T13:12:20.439 INFO:teuthology.orchestra.run.trial034.stdout:(143/165): python3-jaraco-collections-3.0.0-8.e 379 kB/s | 23 kB 00:00 2026-02-20T13:12:20.446 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/167 2026-02-20T13:12:20.469 INFO:teuthology.orchestra.run.trial034.stdout:(144/165): python3-jaraco-context-6.0.1-3.el9.n 227 kB/s | 20 kB 00:00 2026-02-20T13:12:20.532 INFO:teuthology.orchestra.run.trial034.stdout:(145/165): python3-jaraco-text-4.0.0-2.el9.noar 285 kB/s | 26 kB 00:00 2026-02-20T13:12:20.533 INFO:teuthology.orchestra.run.trial034.stdout:(146/165): python3-jaraco-functools-3.5.0-2.el9 200 kB/s | 19 kB 00:00 2026-02-20T13:12:20.536 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction check 2026-02-20T13:12:20.594 INFO:teuthology.orchestra.run.trial127.stdout:Transaction check succeeded. 2026-02-20T13:12:20.594 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction test 2026-02-20T13:12:20.595 INFO:teuthology.orchestra.run.trial034.stdout:(147/165): python3-natsort-7.1.1-5.el9.noarch.r 942 kB/s | 58 kB 00:00 2026-02-20T13:12:20.596 INFO:teuthology.orchestra.run.trial034.stdout:(148/165): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2026-02-20T13:12:20.600 INFO:teuthology.orchestra.run.trial034.stdout:(149/165): python3-kubernetes-26.1.0-3.el9.noar 7.8 MB/s | 1.0 MB 00:00 2026-02-20T13:12:20.673 INFO:teuthology.orchestra.run.trial034.stdout:(150/165): python3-portend-3.1.0-2.el9.noarch.r 209 kB/s | 16 kB 00:00 2026-02-20T13:12:20.673 INFO:teuthology.orchestra.run.trial034.stdout:(151/165): python3-pyperclip-1.8.2-2.el9.noarch 386 kB/s | 28 kB 00:00 2026-02-20T13:12:20.676 INFO:teuthology.orchestra.run.trial034.stdout:(152/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2026-02-20T13:12:20.744 INFO:teuthology.orchestra.run.trial034.stdout:(153/165): python3-repoze-lru-0.7-16.el9.noarch 430 kB/s | 31 kB 00:00 2026-02-20T13:12:20.748 INFO:teuthology.orchestra.run.trial034.stdout:(154/165): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2026-02-20T13:12:20.793 INFO:teuthology.orchestra.run.trial034.stdout:(155/165): python3-rsa-4.9-2.el9.noarch.rpm 505 kB/s | 59 kB 00:00 2026-02-20T13:12:20.822 INFO:teuthology.orchestra.run.trial034.stdout:(156/165): python3-tempora-5.0.0-2.el9.noarch.r 457 kB/s | 36 kB 00:00 2026-02-20T13:12:20.824 INFO:teuthology.orchestra.run.trial034.stdout:(157/165): python3-typing-extensions-4.15.0-1.e 1.1 MB/s | 86 kB 00:00 2026-02-20T13:12:20.911 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 64/167 2026-02-20T13:12:20.929 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 65/167 2026-02-20T13:12:20.937 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 66/167 2026-02-20T13:12:20.947 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 67/167 2026-02-20T13:12:20.953 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 68/167 2026-02-20T13:12:20.962 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 69/167 2026-02-20T13:12:20.967 INFO:teuthology.orchestra.run.trial028.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 70/167 2026-02-20T13:12:20.970 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 71/167 2026-02-20T13:12:21.017 INFO:teuthology.orchestra.run.trial028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 72/167 2026-02-20T13:12:21.084 INFO:teuthology.orchestra.run.trial028.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 73/167 2026-02-20T13:12:21.092 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 74/167 2026-02-20T13:12:21.094 INFO:teuthology.orchestra.run.trial034.stdout:(158/165): python3-xmltodict-0.12.0-15.el9.noar 81 kB/s | 22 kB 00:00 2026-02-20T13:12:21.094 INFO:teuthology.orchestra.run.trial034.stdout:(159/165): python3-zc-lockfile-2.0-10.el9.noarc 74 kB/s | 20 kB 00:00 2026-02-20T13:12:21.097 INFO:teuthology.orchestra.run.trial034.stdout:(160/165): python3-websocket-client-1.2.3-2.el9 295 kB/s | 90 kB 00:00 2026-02-20T13:12:21.098 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 75/167 2026-02-20T13:12:21.111 INFO:teuthology.orchestra.run.trial028.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/167 2026-02-20T13:12:21.123 INFO:teuthology.orchestra.run.trial028.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 77/167 2026-02-20T13:12:21.164 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 78/167 2026-02-20T13:12:21.176 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 79/167 2026-02-20T13:12:21.183 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/167 2026-02-20T13:12:21.192 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/167 2026-02-20T13:12:21.199 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 82/167 2026-02-20T13:12:21.204 INFO:teuthology.orchestra.run.trial034.stdout:(161/165): re2-20211101-20.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2026-02-20T13:12:21.206 INFO:teuthology.orchestra.run.trial034.stdout:(162/165): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.1 MB/s | 122 kB 00:00 2026-02-20T13:12:21.210 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 83/167 2026-02-20T13:12:21.216 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 84/167 2026-02-20T13:12:21.217 INFO:teuthology.orchestra.run.trial034.stdout:(163/165): thrift-0.15.0-4.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2026-02-20T13:12:21.258 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 85/167 2026-02-20T13:12:21.274 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 86/167 2026-02-20T13:12:21.285 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 87/167 2026-02-20T13:12:21.298 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 88/167 2026-02-20T13:12:21.331 INFO:teuthology.orchestra.run.trial034.stdout:(164/165): librbd1-20.3.0-5390.g0917c158.el9.x8 23 MB/s | 2.8 MB 00:00 2026-02-20T13:12:21.349 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 89/167 2026-02-20T13:12:21.368 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 90/167 2026-02-20T13:12:21.368 INFO:teuthology.orchestra.run.trial034.stdout:(165/165): librados2-20.3.0-5390.g0917c158.el9. 21 MB/s | 3.5 MB 00:00 2026-02-20T13:12:21.372 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:12:21.372 INFO:teuthology.orchestra.run.trial034.stdout:Total 12 MB/s | 327 MB 00:26 2026-02-20T13:12:21.671 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/167 2026-02-20T13:12:21.710 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 92/167 2026-02-20T13:12:21.717 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 93/167 2026-02-20T13:12:21.770 INFO:teuthology.orchestra.run.trial127.stdout:Transaction test succeeded. 2026-02-20T13:12:21.770 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction 2026-02-20T13:12:21.790 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-0.3.29-1.el9.x86_64 94/167 2026-02-20T13:12:21.794 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 95/167 2026-02-20T13:12:21.822 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 96/167 2026-02-20T13:12:22.062 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T13:12:22.121 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T13:12:22.121 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T13:12:22.289 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 97/167 2026-02-20T13:12:22.404 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 98/167 2026-02-20T13:12:23.022 INFO:teuthology.orchestra.run.trial127.stdout: Preparing : 1/1 2026-02-20T13:12:23.025 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/167 2026-02-20T13:12:23.034 INFO:teuthology.orchestra.run.trial127.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/167 2026-02-20T13:12:23.047 INFO:teuthology.orchestra.run.trial127.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/167 2026-02-20T13:12:23.199 INFO:teuthology.orchestra.run.trial127.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/167 2026-02-20T13:12:23.204 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : librados2-2:20.3.0-5390.g0917c158.el9.x86_64 5/167 2026-02-20T13:12:23.232 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librados2-2:20.3.0-5390.g0917c158.el9.x86_64 5/167 2026-02-20T13:12:23.242 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 6/167 2026-02-20T13:12:23.244 INFO:teuthology.orchestra.run.trial127.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/167 2026-02-20T13:12:23.247 INFO:teuthology.orchestra.run.trial127.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/167 2026-02-20T13:12:23.249 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/167 2026-02-20T13:12:23.251 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/167 2026-02-20T13:12:23.257 INFO:teuthology.orchestra.run.trial127.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 11/167 2026-02-20T13:12:23.295 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T13:12:23.295 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T13:12:23.375 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 99/167 2026-02-20T13:12:23.379 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 12/167 2026-02-20T13:12:23.380 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:23.407 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 100/167 2026-02-20T13:12:23.414 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 101/167 2026-02-20T13:12:23.417 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 102/167 2026-02-20T13:12:23.426 INFO:teuthology.orchestra.run.trial028.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 103/167 2026-02-20T13:12:23.461 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:23.471 INFO:teuthology.orchestra.run.trial127.stdout: Installing : postgresql-13.23-1.el9.x86_64 14/167 2026-02-20T13:12:23.471 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:23.494 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:23.496 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 16/167 2026-02-20T13:12:23.509 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 16/167 2026-02-20T13:12:23.512 INFO:teuthology.orchestra.run.trial127.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 17/167 2026-02-20T13:12:23.547 INFO:teuthology.orchestra.run.trial127.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/167 2026-02-20T13:12:23.568 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 19/167 2026-02-20T13:12:23.574 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/167 2026-02-20T13:12:23.579 INFO:teuthology.orchestra.run.trial127.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 21/167 2026-02-20T13:12:23.585 INFO:teuthology.orchestra.run.trial127.stdout: Installing : lua-5.4.4-4.el9.x86_64 22/167 2026-02-20T13:12:23.587 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 23/167 2026-02-20T13:12:23.592 INFO:teuthology.orchestra.run.trial127.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 24/167 2026-02-20T13:12:23.616 INFO:teuthology.orchestra.run.trial127.stdout: Installing : unzip-6.0-59.el9.x86_64 25/167 2026-02-20T13:12:23.628 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 26/167 2026-02-20T13:12:23.634 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 27/167 2026-02-20T13:12:23.637 INFO:teuthology.orchestra.run.trial127.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 28/167 2026-02-20T13:12:23.643 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 29/167 2026-02-20T13:12:23.645 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 30/167 2026-02-20T13:12:23.648 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 31/167 2026-02-20T13:12:23.659 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 32/167 2026-02-20T13:12:23.693 INFO:teuthology.orchestra.run.trial127.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 33/167 2026-02-20T13:12:23.698 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-ceph-common-2:20.3.0-5390.g0917c158.el9. 34/167 2026-02-20T13:12:23.699 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-ceph-argparse-2:20.3.0-5390.g0917c158.el 35/167 2026-02-20T13:12:23.700 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 36/167 2026-02-20T13:12:23.724 INFO:teuthology.orchestra.run.trial028.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 104/167 2026-02-20T13:12:23.727 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 105/167 2026-02-20T13:12:23.752 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 36/167 2026-02-20T13:12:23.753 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 37/167 2026-02-20T13:12:23.762 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 105/167 2026-02-20T13:12:23.765 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 106/167 2026-02-20T13:12:23.776 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 37/167 2026-02-20T13:12:23.789 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_6 38/167 2026-02-20T13:12:23.795 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 39/167 2026-02-20T13:12:23.819 INFO:teuthology.orchestra.run.trial127.stdout: Installing : zip-3.0-35.el9.x86_64 40/167 2026-02-20T13:12:23.824 INFO:teuthology.orchestra.run.trial127.stdout: Installing : luarocks-3.9.2-5.el9.noarch 41/167 2026-02-20T13:12:23.826 INFO:teuthology.orchestra.run.trial127.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 42/167 2026-02-20T13:12:23.829 INFO:teuthology.orchestra.run.trial127.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/167 2026-02-20T13:12:23.833 INFO:teuthology.orchestra.run.trial127.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 44/167 2026-02-20T13:12:23.862 INFO:teuthology.orchestra.run.trial127.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 45/167 2026-02-20T13:12:23.914 INFO:teuthology.orchestra.run.trial127.stdout: Installing : automake-1.16.2-8.el9.noarch 46/167 2026-02-20T13:12:23.927 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/167 2026-02-20T13:12:23.943 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/167 2026-02-20T13:12:23.949 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 49/167 2026-02-20T13:12:23.956 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/167 2026-02-20T13:12:23.964 INFO:teuthology.orchestra.run.trial127.stdout: Installing : librados-devel-2:20.3.0-5390.g0917c158.el9.x86_6 51/167 2026-02-20T13:12:23.976 INFO:teuthology.orchestra.run.trial127.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 52/167 2026-02-20T13:12:23.981 INFO:teuthology.orchestra.run.trial127.stdout: Installing : thrift-0.15.0-4.el9.x86_64 53/167 2026-02-20T13:12:23.984 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 54/167 2026-02-20T13:12:23.998 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 55/167 2026-02-20T13:12:24.003 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 56/167 2026-02-20T13:12:24.008 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 57/167 2026-02-20T13:12:24.019 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 58/167 2026-02-20T13:12:24.024 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 59/167 2026-02-20T13:12:24.033 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 60/167 2026-02-20T13:12:24.037 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 61/167 2026-02-20T13:12:24.045 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 62/167 2026-02-20T13:12:24.085 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/167 2026-02-20T13:12:24.412 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 64/167 2026-02-20T13:12:24.422 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 65/167 2026-02-20T13:12:24.426 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 66/167 2026-02-20T13:12:24.432 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 67/167 2026-02-20T13:12:24.435 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 68/167 2026-02-20T13:12:24.441 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 69/167 2026-02-20T13:12:24.443 INFO:teuthology.orchestra.run.trial127.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 70/167 2026-02-20T13:12:24.445 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 71/167 2026-02-20T13:12:24.474 INFO:teuthology.orchestra.run.trial127.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 72/167 2026-02-20T13:12:24.517 INFO:teuthology.orchestra.run.trial127.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 73/167 2026-02-20T13:12:24.521 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 74/167 2026-02-20T13:12:24.525 INFO:teuthology.orchestra.run.trial127.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 75/167 2026-02-20T13:12:24.534 INFO:teuthology.orchestra.run.trial127.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/167 2026-02-20T13:12:24.536 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T13:12:24.540 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/167 2026-02-20T13:12:24.540 INFO:teuthology.orchestra.run.trial127.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 77/167 2026-02-20T13:12:24.548 INFO:teuthology.orchestra.run.trial034.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/167 2026-02-20T13:12:24.561 INFO:teuthology.orchestra.run.trial034.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/167 2026-02-20T13:12:24.568 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 78/167 2026-02-20T13:12:24.574 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 79/167 2026-02-20T13:12:24.578 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/167 2026-02-20T13:12:24.583 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/167 2026-02-20T13:12:24.587 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 82/167 2026-02-20T13:12:24.594 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 83/167 2026-02-20T13:12:24.598 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 84/167 2026-02-20T13:12:24.626 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 85/167 2026-02-20T13:12:24.638 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 86/167 2026-02-20T13:12:24.646 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 87/167 2026-02-20T13:12:24.652 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 88/167 2026-02-20T13:12:24.687 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 89/167 2026-02-20T13:12:24.698 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 90/167 2026-02-20T13:12:24.720 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/167 2026-02-20T13:12:24.723 INFO:teuthology.orchestra.run.trial034.stdout: Upgrading : librados2-2:20.3.0-5390.g0917c158.el9.x86_64 5/167 2026-02-20T13:12:24.751 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados2-2:20.3.0-5390.g0917c158.el9.x86_64 5/167 2026-02-20T13:12:24.760 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 6/167 2026-02-20T13:12:24.762 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/167 2026-02-20T13:12:24.766 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/167 2026-02-20T13:12:24.767 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/167 2026-02-20T13:12:24.769 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/167 2026-02-20T13:12:24.774 INFO:teuthology.orchestra.run.trial034.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 11/167 2026-02-20T13:12:24.902 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 12/167 2026-02-20T13:12:24.904 INFO:teuthology.orchestra.run.trial034.stdout: Upgrading : librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:24.923 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/167 2026-02-20T13:12:24.947 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 92/167 2026-02-20T13:12:24.951 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 93/167 2026-02-20T13:12:24.958 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:24.965 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:24.976 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:24.987 INFO:teuthology.orchestra.run.trial034.stdout: Installing : postgresql-13.23-1.el9.x86_64 14/167 2026-02-20T13:12:24.987 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:25.001 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:25.009 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:25.010 INFO:teuthology.orchestra.run.trial127.stdout: Installing : openblas-0.3.29-1.el9.x86_64 94/167 2026-02-20T13:12:25.010 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 16/167 2026-02-20T13:12:25.011 INFO:teuthology.orchestra.run.trial127.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 95/167 2026-02-20T13:12:25.017 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 108/167 2026-02-20T13:12:25.022 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 16/167 2026-02-20T13:12:25.025 INFO:teuthology.orchestra.run.trial034.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 17/167 2026-02-20T13:12:25.028 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/167 2026-02-20T13:12:25.032 INFO:teuthology.orchestra.run.trial127.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 96/167 2026-02-20T13:12:25.049 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ply-3.11-14.el9.noarch 110/167 2026-02-20T13:12:25.056 INFO:teuthology.orchestra.run.trial034.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/167 2026-02-20T13:12:25.073 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 111/167 2026-02-20T13:12:25.078 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 19/167 2026-02-20T13:12:25.083 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/167 2026-02-20T13:12:25.088 INFO:teuthology.orchestra.run.trial034.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 21/167 2026-02-20T13:12:25.095 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lua-5.4.4-4.el9.x86_64 22/167 2026-02-20T13:12:25.097 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 23/167 2026-02-20T13:12:25.102 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 24/167 2026-02-20T13:12:25.125 INFO:teuthology.orchestra.run.trial034.stdout: Installing : unzip-6.0-59.el9.x86_64 25/167 2026-02-20T13:12:25.138 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 26/167 2026-02-20T13:12:25.144 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 27/167 2026-02-20T13:12:25.147 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 28/167 2026-02-20T13:12:25.153 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 29/167 2026-02-20T13:12:25.155 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 30/167 2026-02-20T13:12:25.156 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 31/167 2026-02-20T13:12:25.166 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 32/167 2026-02-20T13:12:25.189 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 112/167 2026-02-20T13:12:25.201 INFO:teuthology.orchestra.run.trial034.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 33/167 2026-02-20T13:12:25.205 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ceph-common-2:20.3.0-5390.g0917c158.el9. 34/167 2026-02-20T13:12:25.206 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 113/167 2026-02-20T13:12:25.207 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ceph-argparse-2:20.3.0-5390.g0917c158.el 35/167 2026-02-20T13:12:25.208 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 36/167 2026-02-20T13:12:25.242 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/167 2026-02-20T13:12:25.259 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 36/167 2026-02-20T13:12:25.260 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 37/167 2026-02-20T13:12:25.281 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 37/167 2026-02-20T13:12:25.288 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 115/167 2026-02-20T13:12:25.293 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_6 38/167 2026-02-20T13:12:25.299 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 39/167 2026-02-20T13:12:25.324 INFO:teuthology.orchestra.run.trial034.stdout: Installing : zip-3.0-35.el9.x86_64 40/167 2026-02-20T13:12:25.329 INFO:teuthology.orchestra.run.trial034.stdout: Installing : luarocks-3.9.2-5.el9.noarch 41/167 2026-02-20T13:12:25.331 INFO:teuthology.orchestra.run.trial034.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 42/167 2026-02-20T13:12:25.334 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/167 2026-02-20T13:12:25.337 INFO:teuthology.orchestra.run.trial034.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 44/167 2026-02-20T13:12:25.361 INFO:teuthology.orchestra.run.trial127.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 97/167 2026-02-20T13:12:25.362 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 116/167 2026-02-20T13:12:25.365 INFO:teuthology.orchestra.run.trial034.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 45/167 2026-02-20T13:12:25.374 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 117/167 2026-02-20T13:12:25.381 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 118/167 2026-02-20T13:12:25.388 INFO:teuthology.orchestra.run.trial028.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 119/167 2026-02-20T13:12:25.393 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 120/167 2026-02-20T13:12:25.395 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 121/167 2026-02-20T13:12:25.417 INFO:teuthology.orchestra.run.trial034.stdout: Installing : automake-1.16.2-8.el9.noarch 46/167 2026-02-20T13:12:25.430 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/167 2026-02-20T13:12:25.432 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 121/167 2026-02-20T13:12:25.435 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 98/167 2026-02-20T13:12:25.446 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/167 2026-02-20T13:12:25.451 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 49/167 2026-02-20T13:12:25.459 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/167 2026-02-20T13:12:25.466 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librados-devel-2:20.3.0-5390.g0917c158.el9.x86_6 51/167 2026-02-20T13:12:25.478 INFO:teuthology.orchestra.run.trial034.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 52/167 2026-02-20T13:12:25.483 INFO:teuthology.orchestra.run.trial034.stdout: Installing : thrift-0.15.0-4.el9.x86_64 53/167 2026-02-20T13:12:25.486 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 54/167 2026-02-20T13:12:25.500 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 55/167 2026-02-20T13:12:25.505 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 56/167 2026-02-20T13:12:25.510 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 57/167 2026-02-20T13:12:25.521 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 58/167 2026-02-20T13:12:25.526 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 59/167 2026-02-20T13:12:25.535 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 60/167 2026-02-20T13:12:25.539 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 61/167 2026-02-20T13:12:25.547 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 62/167 2026-02-20T13:12:25.587 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/167 2026-02-20T13:12:25.716 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 122/167 2026-02-20T13:12:25.723 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 123/167 2026-02-20T13:12:25.789 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 123/167 2026-02-20T13:12:25.789 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T13:12:25.789 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T13:12:25.789 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:25.795 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 124/167 2026-02-20T13:12:25.913 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 64/167 2026-02-20T13:12:25.923 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 65/167 2026-02-20T13:12:25.927 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 66/167 2026-02-20T13:12:25.933 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 67/167 2026-02-20T13:12:25.936 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 68/167 2026-02-20T13:12:25.942 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 69/167 2026-02-20T13:12:25.944 INFO:teuthology.orchestra.run.trial034.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 70/167 2026-02-20T13:12:25.945 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 71/167 2026-02-20T13:12:25.974 INFO:teuthology.orchestra.run.trial034.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 72/167 2026-02-20T13:12:26.018 INFO:teuthology.orchestra.run.trial034.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 73/167 2026-02-20T13:12:26.022 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 74/167 2026-02-20T13:12:26.026 INFO:teuthology.orchestra.run.trial034.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 75/167 2026-02-20T13:12:26.034 INFO:teuthology.orchestra.run.trial034.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/167 2026-02-20T13:12:26.041 INFO:teuthology.orchestra.run.trial034.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 77/167 2026-02-20T13:12:26.069 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 78/167 2026-02-20T13:12:26.075 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 79/167 2026-02-20T13:12:26.079 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/167 2026-02-20T13:12:26.084 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/167 2026-02-20T13:12:26.088 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 82/167 2026-02-20T13:12:26.095 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 83/167 2026-02-20T13:12:26.099 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 84/167 2026-02-20T13:12:26.112 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 99/167 2026-02-20T13:12:26.127 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 85/167 2026-02-20T13:12:26.127 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 100/167 2026-02-20T13:12:26.131 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 101/167 2026-02-20T13:12:26.133 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 102/167 2026-02-20T13:12:26.138 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 86/167 2026-02-20T13:12:26.139 INFO:teuthology.orchestra.run.trial127.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 103/167 2026-02-20T13:12:26.145 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 87/167 2026-02-20T13:12:26.152 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 88/167 2026-02-20T13:12:26.187 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 89/167 2026-02-20T13:12:26.198 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 90/167 2026-02-20T13:12:26.422 INFO:teuthology.orchestra.run.trial127.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 104/167 2026-02-20T13:12:26.423 INFO:teuthology.orchestra.run.trial127.stdout: Installing : librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 105/167 2026-02-20T13:12:26.424 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/167 2026-02-20T13:12:26.443 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 105/167 2026-02-20T13:12:26.444 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 106/167 2026-02-20T13:12:26.447 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 92/167 2026-02-20T13:12:26.451 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 93/167 2026-02-20T13:12:26.510 INFO:teuthology.orchestra.run.trial034.stdout: Installing : openblas-0.3.29-1.el9.x86_64 94/167 2026-02-20T13:12:26.511 INFO:teuthology.orchestra.run.trial034.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 95/167 2026-02-20T13:12:26.533 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 96/167 2026-02-20T13:12:26.862 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 97/167 2026-02-20T13:12:26.935 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 98/167 2026-02-20T13:12:27.541 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:27.543 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:27.561 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:27.571 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 108/167 2026-02-20T13:12:27.578 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/167 2026-02-20T13:12:27.592 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-ply-3.11-14.el9.noarch 110/167 2026-02-20T13:12:27.607 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 111/167 2026-02-20T13:12:27.610 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 99/167 2026-02-20T13:12:27.624 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 100/167 2026-02-20T13:12:27.628 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 101/167 2026-02-20T13:12:27.630 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 102/167 2026-02-20T13:12:27.636 INFO:teuthology.orchestra.run.trial034.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 103/167 2026-02-20T13:12:27.684 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 112/167 2026-02-20T13:12:27.692 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 113/167 2026-02-20T13:12:27.716 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/167 2026-02-20T13:12:27.746 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 115/167 2026-02-20T13:12:27.797 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 116/167 2026-02-20T13:12:27.803 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 117/167 2026-02-20T13:12:27.806 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 118/167 2026-02-20T13:12:27.812 INFO:teuthology.orchestra.run.trial127.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 119/167 2026-02-20T13:12:27.814 INFO:teuthology.orchestra.run.trial127.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 120/167 2026-02-20T13:12:27.815 INFO:teuthology.orchestra.run.trial127.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 121/167 2026-02-20T13:12:27.833 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 121/167 2026-02-20T13:12:27.930 INFO:teuthology.orchestra.run.trial034.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 104/167 2026-02-20T13:12:27.931 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 105/167 2026-02-20T13:12:27.949 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 105/167 2026-02-20T13:12:27.951 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 106/167 2026-02-20T13:12:28.084 INFO:teuthology.orchestra.run.trial127.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 122/167 2026-02-20T13:12:28.087 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 123/167 2026-02-20T13:12:28.128 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 123/167 2026-02-20T13:12:28.128 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T13:12:28.128 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T13:12:28.128 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:28.131 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 124/167 2026-02-20T13:12:29.115 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:29.117 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:29.135 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 107/167 2026-02-20T13:12:29.145 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 108/167 2026-02-20T13:12:29.153 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/167 2026-02-20T13:12:29.168 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ply-3.11-14.el9.noarch 110/167 2026-02-20T13:12:29.184 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 111/167 2026-02-20T13:12:29.262 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 112/167 2026-02-20T13:12:29.271 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 113/167 2026-02-20T13:12:29.294 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/167 2026-02-20T13:12:29.324 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 115/167 2026-02-20T13:12:29.376 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 116/167 2026-02-20T13:12:29.382 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 117/167 2026-02-20T13:12:29.386 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 118/167 2026-02-20T13:12:29.392 INFO:teuthology.orchestra.run.trial034.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 119/167 2026-02-20T13:12:29.394 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 120/167 2026-02-20T13:12:29.395 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 121/167 2026-02-20T13:12:29.412 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 121/167 2026-02-20T13:12:29.674 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 122/167 2026-02-20T13:12:29.677 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 123/167 2026-02-20T13:12:29.716 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 123/167 2026-02-20T13:12:29.716 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T13:12:29.716 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T13:12:29.716 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:29.720 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 124/167 2026-02-20T13:12:31.900 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 124/167 2026-02-20T13:12:31.900 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /sys 2026-02-20T13:12:31.900 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /proc 2026-02-20T13:12:31.900 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /mnt 2026-02-20T13:12:31.901 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /var/tmp 2026-02-20T13:12:31.901 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /home 2026-02-20T13:12:31.901 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /root 2026-02-20T13:12:31.901 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /tmp 2026-02-20T13:12:31.901 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:32.013 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 125/167 2026-02-20T13:12:32.061 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 125/167 2026-02-20T13:12:32.061 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:32.061 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T13:12:32.062 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:12:32.062 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:12:32.062 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:32.290 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 126/167 2026-02-20T13:12:32.339 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 126/167 2026-02-20T13:12:32.339 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:32.339 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T13:12:32.339 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:12:32.339 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:12:32.339 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:32.350 INFO:teuthology.orchestra.run.trial028.stdout: Installing : mailcap-2.1.49-5.el9.noarch 127/167 2026-02-20T13:12:32.353 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 128/167 2026-02-20T13:12:32.390 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:32.390 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'qat' with GID 992. 2026-02-20T13:12:32.391 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T13:12:32.391 INFO:teuthology.orchestra.run.trial028.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T13:12:32.391 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:32.406 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:32.458 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:32.458 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T13:12:32.458 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:32.509 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 130/167 2026-02-20T13:12:32.887 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 124/167 2026-02-20T13:12:32.887 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /sys 2026-02-20T13:12:32.887 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /proc 2026-02-20T13:12:32.888 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /mnt 2026-02-20T13:12:32.888 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /var/tmp 2026-02-20T13:12:32.888 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /home 2026-02-20T13:12:32.888 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /root 2026-02-20T13:12:32.888 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /tmp 2026-02-20T13:12:32.888 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:32.990 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 125/167 2026-02-20T13:12:33.013 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 125/167 2026-02-20T13:12:33.013 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:33.013 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T13:12:33.013 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:12:33.013 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:12:33.013 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:33.159 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 131/167 2026-02-20T13:12:33.227 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 126/167 2026-02-20T13:12:33.249 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 126/167 2026-02-20T13:12:33.249 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:33.249 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T13:12:33.249 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:12:33.249 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:12:33.249 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:33.256 INFO:teuthology.orchestra.run.trial127.stdout: Installing : mailcap-2.1.49-5.el9.noarch 127/167 2026-02-20T13:12:33.257 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 128/167 2026-02-20T13:12:33.276 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:33.276 INFO:teuthology.orchestra.run.trial127.stdout:Creating group 'qat' with GID 992. 2026-02-20T13:12:33.276 INFO:teuthology.orchestra.run.trial127.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T13:12:33.276 INFO:teuthology.orchestra.run.trial127.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T13:12:33.276 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:33.284 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:33.309 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:33.309 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T13:12:33.309 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:33.345 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 130/167 2026-02-20T13:12:33.947 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 132/167 2026-02-20T13:12:33.965 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 131/167 2026-02-20T13:12:34.036 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 133/167 2026-02-20T13:12:34.041 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 134/167 2026-02-20T13:12:34.074 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 134/167 2026-02-20T13:12:34.074 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:34.074 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T13:12:34.074 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:34.088 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 135/167 2026-02-20T13:12:34.140 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 135/167 2026-02-20T13:12:34.140 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:34.140 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T13:12:34.140 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:12:34.140 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:12:34.141 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:34.254 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephadm-2:20.3.0-5390.g0917c158.el9.noarch 136/167 2026-02-20T13:12:34.258 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephadm-2:20.3.0-5390.g0917c158.el9.noarch 136/167 2026-02-20T13:12:34.270 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.e 137/167 2026-02-20T13:12:34.304 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5390.g0917c158. 138/167 2026-02-20T13:12:34.307 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 139/167 2026-02-20T13:12:34.372 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 124/167 2026-02-20T13:12:34.373 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /sys 2026-02-20T13:12:34.373 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /proc 2026-02-20T13:12:34.373 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /mnt 2026-02-20T13:12:34.373 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /var/tmp 2026-02-20T13:12:34.373 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /home 2026-02-20T13:12:34.373 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /root 2026-02-20T13:12:34.373 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /tmp 2026-02-20T13:12:34.373 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:34.479 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 125/167 2026-02-20T13:12:34.501 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 125/167 2026-02-20T13:12:34.502 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:34.502 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T13:12:34.502 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:12:34.502 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:12:34.502 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:34.723 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 132/167 2026-02-20T13:12:34.726 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 126/167 2026-02-20T13:12:34.747 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 126/167 2026-02-20T13:12:34.747 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:34.747 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T13:12:34.747 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:12:34.747 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:12:34.747 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:34.755 INFO:teuthology.orchestra.run.trial034.stdout: Installing : mailcap-2.1.49-5.el9.noarch 127/167 2026-02-20T13:12:34.756 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 128/167 2026-02-20T13:12:34.774 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:34.774 INFO:teuthology.orchestra.run.trial034.stdout:Creating group 'qat' with GID 992. 2026-02-20T13:12:34.774 INFO:teuthology.orchestra.run.trial034.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T13:12:34.774 INFO:teuthology.orchestra.run.trial034.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T13:12:34.774 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:34.783 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:34.786 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 133/167 2026-02-20T13:12:34.788 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 134/167 2026-02-20T13:12:34.803 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 134/167 2026-02-20T13:12:34.804 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:34.804 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T13:12:34.804 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:34.807 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 129/167 2026-02-20T13:12:34.807 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T13:12:34.808 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:34.813 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 135/167 2026-02-20T13:12:34.837 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 135/167 2026-02-20T13:12:34.837 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:34.838 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T13:12:34.838 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:12:34.838 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:12:34.838 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:34.842 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 130/167 2026-02-20T13:12:34.896 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: cephadm-2:20.3.0-5390.g0917c158.el9.noarch 136/167 2026-02-20T13:12:34.898 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cephadm-2:20.3.0-5390.g0917c158.el9.noarch 136/167 2026-02-20T13:12:34.907 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.e 137/167 2026-02-20T13:12:34.931 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5390.g0917c158. 138/167 2026-02-20T13:12:34.932 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 139/167 2026-02-20T13:12:35.492 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 131/167 2026-02-20T13:12:36.276 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 132/167 2026-02-20T13:12:36.340 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 133/167 2026-02-20T13:12:36.342 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 134/167 2026-02-20T13:12:36.356 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 134/167 2026-02-20T13:12:36.356 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:36.356 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T13:12:36.356 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:36.365 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 135/167 2026-02-20T13:12:36.389 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 135/167 2026-02-20T13:12:36.389 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:36.389 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T13:12:36.389 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:12:36.389 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:12:36.389 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:36.447 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: cephadm-2:20.3.0-5390.g0917c158.el9.noarch 136/167 2026-02-20T13:12:36.449 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cephadm-2:20.3.0-5390.g0917c158.el9.noarch 136/167 2026-02-20T13:12:36.458 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.e 137/167 2026-02-20T13:12:36.482 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5390.g0917c158. 138/167 2026-02-20T13:12:36.483 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 139/167 2026-02-20T13:12:37.536 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 139/167 2026-02-20T13:12:37.551 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 140/167 2026-02-20T13:12:37.829 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 139/167 2026-02-20T13:12:37.836 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 140/167 2026-02-20T13:12:38.053 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 140/167 2026-02-20T13:12:38.055 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 141/167 2026-02-20T13:12:38.150 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 141/167 2026-02-20T13:12:38.198 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el 142/167 2026-02-20T13:12:38.201 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 143/167 2026-02-20T13:12:38.248 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 143/167 2026-02-20T13:12:38.248 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:38.248 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T13:12:38.248 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:12:38.248 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:12:38.248 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:38.266 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 144/167 2026-02-20T13:12:38.288 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 140/167 2026-02-20T13:12:38.289 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 144/167 2026-02-20T13:12:38.290 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 141/167 2026-02-20T13:12:38.351 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 141/167 2026-02-20T13:12:38.393 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el 142/167 2026-02-20T13:12:38.394 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 143/167 2026-02-20T13:12:38.415 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 143/167 2026-02-20T13:12:38.415 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:38.415 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T13:12:38.416 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:12:38.416 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:12:38.416 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:38.427 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 144/167 2026-02-20T13:12:38.438 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 144/167 2026-02-20T13:12:38.890 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-2:20.3.0-5390.g0917c158.el9.x86_64 145/167 2026-02-20T13:12:38.894 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 146/167 2026-02-20T13:12:38.941 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 146/167 2026-02-20T13:12:38.941 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:38.941 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T13:12:38.941 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T13:12:38.941 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T13:12:38.941 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:38.953 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5390.g0917c 147/167 2026-02-20T13:12:38.997 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5390.g0917c 147/167 2026-02-20T13:12:38.997 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:38.997 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T13:12:38.997 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:39.009 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-2:20.3.0-5390.g0917c158.el9.x86_64 145/167 2026-02-20T13:12:39.011 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 146/167 2026-02-20T13:12:39.014 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 148/167 2026-02-20T13:12:39.033 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 146/167 2026-02-20T13:12:39.033 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:39.033 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T13:12:39.033 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T13:12:39.033 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T13:12:39.033 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:39.042 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5390.g0917c 147/167 2026-02-20T13:12:39.058 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 148/167 2026-02-20T13:12:39.059 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:39.059 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-20T13:12:39.059 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T13:12:39.059 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T13:12:39.059 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:39.062 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5390.g0917c 147/167 2026-02-20T13:12:39.062 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:39.062 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T13:12:39.062 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:39.076 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 148/167 2026-02-20T13:12:39.097 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 148/167 2026-02-20T13:12:39.097 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:39.097 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-20T13:12:39.097 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T13:12:39.097 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T13:12:39.098 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:39.193 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 149/167 2026-02-20T13:12:39.221 INFO:teuthology.orchestra.run.trial127.stdout: Installing : rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 149/167 2026-02-20T13:12:39.240 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 149/167 2026-02-20T13:12:39.241 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:39.241 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T13:12:39.241 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:12:39.241 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:12:39.241 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:39.242 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 149/167 2026-02-20T13:12:39.242 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:39.242 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T13:12:39.242 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:12:39.242 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:12:39.242 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:39.485 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 139/167 2026-02-20T13:12:39.492 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 140/167 2026-02-20T13:12:39.964 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 140/167 2026-02-20T13:12:39.965 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 141/167 2026-02-20T13:12:40.026 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 141/167 2026-02-20T13:12:40.070 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el 142/167 2026-02-20T13:12:40.071 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 143/167 2026-02-20T13:12:40.092 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 143/167 2026-02-20T13:12:40.092 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:40.092 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T13:12:40.092 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:12:40.092 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:12:40.092 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:40.104 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 144/167 2026-02-20T13:12:40.114 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 144/167 2026-02-20T13:12:40.716 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-2:20.3.0-5390.g0917c158.el9.x86_64 145/167 2026-02-20T13:12:40.718 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 146/167 2026-02-20T13:12:40.739 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 146/167 2026-02-20T13:12:40.740 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:40.740 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T13:12:40.740 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T13:12:40.740 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T13:12:40.740 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:40.748 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5390.g0917c 147/167 2026-02-20T13:12:40.767 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5390.g0917c 147/167 2026-02-20T13:12:40.767 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:40.767 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T13:12:40.767 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:40.780 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 148/167 2026-02-20T13:12:40.801 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 148/167 2026-02-20T13:12:40.801 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:40.801 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-20T13:12:40.801 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T13:12:40.801 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T13:12:40.801 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:40.931 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 149/167 2026-02-20T13:12:40.952 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 149/167 2026-02-20T13:12:40.952 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:12:40.952 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T13:12:40.952 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:12:40.952 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:12:40.952 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:42.674 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 150/167 2026-02-20T13:12:42.688 INFO:teuthology.orchestra.run.trial127.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 151/167 2026-02-20T13:12:42.692 INFO:teuthology.orchestra.run.trial127.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 152/167 2026-02-20T13:12:42.766 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 153/167 2026-02-20T13:12:42.773 INFO:teuthology.orchestra.run.trial127.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 154/167 2026-02-20T13:12:42.784 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_ 155/167 2026-02-20T13:12:42.785 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libtool-2.4.6-46.el9.x86_64 156/167 2026-02-20T13:12:42.851 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 150/167 2026-02-20T13:12:42.872 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 151/167 2026-02-20T13:12:42.878 INFO:teuthology.orchestra.run.trial028.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 152/167 2026-02-20T13:12:42.905 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:42.909 INFO:teuthology.orchestra.run.trial127.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:42.928 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:42.938 INFO:teuthology.orchestra.run.trial127.stdout: Installing : rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 158/167 2026-02-20T13:12:42.942 INFO:teuthology.orchestra.run.trial127.stdout: Installing : rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 159/167 2026-02-20T13:12:42.983 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 160/167 2026-02-20T13:12:42.989 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 153/167 2026-02-20T13:12:43.003 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 154/167 2026-02-20T13:12:43.017 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_ 155/167 2026-02-20T13:12:43.020 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libtool-2.4.6-46.el9.x86_64 156/167 2026-02-20T13:12:43.225 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:43.235 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:43.272 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:43.284 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 158/167 2026-02-20T13:12:43.290 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 159/167 2026-02-20T13:12:43.336 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 160/167 2026-02-20T13:12:43.439 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 161/167 2026-02-20T13:12:43.455 INFO:teuthology.orchestra.run.trial127.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 162/167 2026-02-20T13:12:43.465 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/167 2026-02-20T13:12:43.494 INFO:teuthology.orchestra.run.trial127.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/167 2026-02-20T13:12:43.497 INFO:teuthology.orchestra.run.trial127.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/167 2026-02-20T13:12:43.497 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 166/167 2026-02-20T13:12:43.512 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 166/167 2026-02-20T13:12:43.512 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:43.525 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:43.533 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 167/167 2026-02-20T13:12:43.558 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 167/167 2026-02-20T13:12:44.207 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 161/167 2026-02-20T13:12:44.243 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 162/167 2026-02-20T13:12:44.258 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/167 2026-02-20T13:12:44.302 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/167 2026-02-20T13:12:44.309 INFO:teuthology.orchestra.run.trial028.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/167 2026-02-20T13:12:44.309 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 166/167 2026-02-20T13:12:44.340 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 166/167 2026-02-20T13:12:44.341 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:44.367 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:44.383 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 167/167 2026-02-20T13:12:44.417 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 167/167 2026-02-20T13:12:44.555 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 150/167 2026-02-20T13:12:44.569 INFO:teuthology.orchestra.run.trial034.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 151/167 2026-02-20T13:12:44.573 INFO:teuthology.orchestra.run.trial034.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 152/167 2026-02-20T13:12:44.579 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:44.579 INFO:teuthology.orchestra.run.trial028.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-20T13:12:44.579 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:44.643 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-2:20.3.0-5390.g0917c158.el9.x86_64 1/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 2/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 3/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 4/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5390.g0917c 5/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 6/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 7/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 8/167 2026-02-20T13:12:44.644 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 9/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 10/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 11/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 12/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 14/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 16/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_ 17/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 18/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 19/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 20/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librados-devel-2:20.3.0-5390.g0917c158.el9.x86_6 21/167 2026-02-20T13:12:44.645 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 22/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 23/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5390.g0917c158.el 24/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-ceph-common-2:20.3.0-5390.g0917c158.el9. 25/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_6 26/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 27/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 28/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 29/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 30/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 31/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 32/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5390.g0917c158. 33/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 34/167 2026-02-20T13:12:44.646 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 35/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 36/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el 37/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 38/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.e 39/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 40/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cephadm-2:20.3.0-5390.g0917c158.el9.noarch 41/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 42/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 43/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/167 2026-02-20T13:12:44.647 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 57/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 58/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 59/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : unzip-6.0-59.el9.x86_64 60/167 2026-02-20T13:12:44.648 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : zip-3.0-35.el9.x86_64 61/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 64/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 65/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 67/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 68/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 69/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 71/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/167 2026-02-20T13:12:44.649 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 75/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 76/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 77/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 78/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 79/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 80/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : lua-5.4.4-4.el9.x86_64 81/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 82/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 83/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 84/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 85/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 86/167 2026-02-20T13:12:44.650 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 87/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : postgresql-13.23-1.el9.x86_64 88/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 89/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 90/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 91/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 92/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 93/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 94/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 95/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 96/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 97/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 98/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 99/167 2026-02-20T13:12:44.651 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 100/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 101/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 102/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 103/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 104/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 105/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 106/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 107/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 108/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 109/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 110/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 111/167 2026-02-20T13:12:44.652 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 112/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 113/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 114/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 115/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 116/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 117/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 118/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 119/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 120/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 121/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 122/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 123/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 124/167 2026-02-20T13:12:44.653 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 125/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 126/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 127/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 128/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 129/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 130/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 131/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 132/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 133/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 134/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 135/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 136/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 137/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 138/167 2026-02-20T13:12:44.654 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 139/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 140/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 141/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 142/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 143/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 144/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 145/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 146/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 147/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 148/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 149/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 150/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 151/167 2026-02-20T13:12:44.655 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 152/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 153/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 154/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 155/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 156/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 157/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 159/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : re2-1:20211101-20.el9.x86_64 161/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 162/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 163/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librados2-2:20.3.0-5390.g0917c158.el9.x86_64 164/167 2026-02-20T13:12:44.656 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 165/167 2026-02-20T13:12:44.657 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 166/167 2026-02-20T13:12:44.657 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 153/167 2026-02-20T13:12:44.657 INFO:teuthology.orchestra.run.trial034.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 154/167 2026-02-20T13:12:44.664 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_ 155/167 2026-02-20T13:12:44.665 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libtool-2.4.6-46.el9.x86_64 156/167 2026-02-20T13:12:44.714 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout:Upgraded: 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout: librados2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout: librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout:Installed: 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout: automake-1.16.2-8.el9.noarch 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout: bison-3.7.4-5.el9.x86_64 2026-02-20T13:12:44.715 INFO:teuthology.orchestra.run.trial127.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-grafana-dashboards-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-immutable-object-cache-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.716 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: cephadm-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.717 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: flex-2.6.4-9.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T13:12:44.718 INFO:teuthology.orchestra.run.trial127.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T13:12:44.719 INFO:teuthology.orchestra.run.trial127.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: librados-devel-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-20T13:12:44.720 INFO:teuthology.orchestra.run.trial127.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T13:12:44.721 INFO:teuthology.orchestra.run.trial127.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-13.23-1.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T13:12:44.722 INFO:teuthology.orchestra.run.trial127.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-ceph-argparse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-20T13:12:44.723 INFO:teuthology.orchestra.run.trial127.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T13:12:44.724 INFO:teuthology.orchestra.run.trial127.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T13:12:44.725 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T13:12:44.726 INFO:teuthology.orchestra.run.trial127.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T13:12:44.727 INFO:teuthology.orchestra.run.trial127.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: zip-3.0-35.el9.x86_64 2026-02-20T13:12:44.728 INFO:teuthology.orchestra.run.trial127.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-20T13:12:44.729 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:12:44.729 INFO:teuthology.orchestra.run.trial127.stdout:Complete! 2026-02-20T13:12:44.784 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:44.788 INFO:teuthology.orchestra.run.trial034.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:44.807 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 157/167 2026-02-20T13:12:44.818 DEBUG:teuthology.parallel:result is None 2026-02-20T13:12:44.819 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 158/167 2026-02-20T13:12:44.820 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 159/167 2026-02-20T13:12:44.862 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 160/167 2026-02-20T13:12:45.315 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 161/167 2026-02-20T13:12:45.331 INFO:teuthology.orchestra.run.trial034.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 162/167 2026-02-20T13:12:45.341 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/167 2026-02-20T13:12:45.369 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/167 2026-02-20T13:12:45.373 INFO:teuthology.orchestra.run.trial034.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/167 2026-02-20T13:12:45.373 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 166/167 2026-02-20T13:12:45.385 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 166/167 2026-02-20T13:12:45.385 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:45.397 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:45.404 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 167/167 2026-02-20T13:12:45.428 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 167/167 2026-02-20T13:12:45.711 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-2:20.3.0-5390.g0917c158.el9.x86_64 1/167 2026-02-20T13:12:45.711 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 2/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 3/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 4/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5390.g0917c 5/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 6/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 7/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 8/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 9/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 10/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 11/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 12/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:45.712 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 14/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 16/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_ 17/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 18/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 19/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 20/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados-devel-2:20.3.0-5390.g0917c158.el9.x86_6 21/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 22/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 23/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5390.g0917c158.el 24/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-common-2:20.3.0-5390.g0917c158.el9. 25/167 2026-02-20T13:12:45.713 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_6 26/167 2026-02-20T13:12:45.714 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 27/167 2026-02-20T13:12:45.714 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 28/167 2026-02-20T13:12:45.714 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 29/167 2026-02-20T13:12:45.714 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 30/167 2026-02-20T13:12:45.714 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 31/167 2026-02-20T13:12:45.714 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 32/167 2026-02-20T13:12:45.714 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5390.g0917c158. 33/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 34/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 35/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 36/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el 37/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 38/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.e 39/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 40/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephadm-2:20.3.0-5390.g0917c158.el9.noarch 41/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 42/167 2026-02-20T13:12:45.725 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 43/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/167 2026-02-20T13:12:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 57/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 58/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 59/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : unzip-6.0-59.el9.x86_64 60/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zip-3.0-35.el9.x86_64 61/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 64/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 65/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 67/167 2026-02-20T13:12:45.727 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 68/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 69/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 71/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 75/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 76/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 77/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 78/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 79/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 80/167 2026-02-20T13:12:45.728 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 81/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 82/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 83/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 84/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 85/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 86/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 87/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-13.23-1.el9.x86_64 88/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 89/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 90/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 91/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 92/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 93/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 94/167 2026-02-20T13:12:45.729 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 95/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 96/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 97/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 98/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 99/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 100/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 101/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 102/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 103/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 104/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 105/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 106/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 107/167 2026-02-20T13:12:45.730 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 108/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 109/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 110/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 111/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 112/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 113/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 114/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 115/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 116/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 117/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 118/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 119/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 120/167 2026-02-20T13:12:45.731 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 121/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 122/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 123/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 124/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 125/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 126/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 127/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 128/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 129/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 130/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 131/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 132/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 133/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 134/167 2026-02-20T13:12:45.732 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 135/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 136/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 137/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 138/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 139/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 140/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 141/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 142/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 143/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 144/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 145/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 146/167 2026-02-20T13:12:45.733 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 147/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 148/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 149/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 150/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 151/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 152/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 153/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 154/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 155/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 156/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 157/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 159/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/167 2026-02-20T13:12:45.734 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : re2-1:20211101-20.el9.x86_64 161/167 2026-02-20T13:12:45.735 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 162/167 2026-02-20T13:12:45.735 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 163/167 2026-02-20T13:12:45.735 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:20.3.0-5390.g0917c158.el9.x86_64 164/167 2026-02-20T13:12:45.735 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 165/167 2026-02-20T13:12:45.735 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 166/167 2026-02-20T13:12:45.821 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:45.821 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: librados2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: automake-1.16.2-8.el9.noarch 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: bison-3.7.4-5.el9.x86_64 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: ceph-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.822 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.823 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: cephadm-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T13:12:45.824 INFO:teuthology.orchestra.run.trial028.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: flex-2.6.4-9.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T13:12:45.825 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.826 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T13:12:45.827 INFO:teuthology.orchestra.run.trial028.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-13.23-1.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-20T13:12:45.828 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T13:12:45.829 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T13:12:45.830 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T13:12:45.831 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T13:12:45.832 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T13:12:45.833 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T13:12:45.834 INFO:teuthology.orchestra.run.trial028.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T13:12:45.835 INFO:teuthology.orchestra.run.trial028.stdout: zip-3.0-35.el9.x86_64 2026-02-20T13:12:45.835 INFO:teuthology.orchestra.run.trial028.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-20T13:12:45.835 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:12:45.835 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T13:12:46.072 DEBUG:teuthology.parallel:result is None 2026-02-20T13:12:46.512 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:46.512 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-2:20.3.0-5390.g0917c158.el9.x86_64 1/167 2026-02-20T13:12:46.512 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 2/167 2026-02-20T13:12:46.512 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 3/167 2026-02-20T13:12:46.512 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 4/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5390.g0917c 5/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 6/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 7/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 8/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 9/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86 10/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86 11/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 12/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 13/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 14/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 15/167 2026-02-20T13:12:46.513 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 16/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_ 17/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86 18/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 19/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 20/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados-devel-2:20.3.0-5390.g0917c158.el9.x86_6 21/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86 22/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 23/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5390.g0917c158.el 24/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ceph-common-2:20.3.0-5390.g0917c158.el9. 25/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_6 26/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 27/167 2026-02-20T13:12:46.514 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 28/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 29/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 30/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 31/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 32/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5390.g0917c158. 33/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noa 34/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.n 35/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5390.g091 36/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el 37/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 38/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.e 39/167 2026-02-20T13:12:46.515 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 40/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cephadm-2:20.3.0-5390.g0917c158.el9.noarch 41/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 42/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 43/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/167 2026-02-20T13:12:46.516 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 57/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 58/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 59/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : unzip-6.0-59.el9.x86_64 60/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : zip-3.0-35.el9.x86_64 61/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 64/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 65/167 2026-02-20T13:12:46.517 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 67/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 68/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 69/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 71/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 75/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 76/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 77/167 2026-02-20T13:12:46.518 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 78/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 79/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 80/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lua-5.4.4-4.el9.x86_64 81/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 82/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 83/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 84/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 85/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 86/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 87/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : postgresql-13.23-1.el9.x86_64 88/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 89/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 90/167 2026-02-20T13:12:46.519 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 91/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 92/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 93/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 94/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 95/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 96/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 97/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 98/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 99/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 100/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 101/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 102/167 2026-02-20T13:12:46.520 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 103/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 104/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 105/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 106/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 107/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 108/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 109/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 110/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 111/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 112/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 113/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 114/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 115/167 2026-02-20T13:12:46.521 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 116/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 117/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 118/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 119/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 120/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 121/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 122/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 123/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 124/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 125/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 126/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 127/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 128/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 129/167 2026-02-20T13:12:46.522 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 130/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 131/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 132/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 133/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 134/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 135/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 136/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 137/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 138/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 139/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 140/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 141/167 2026-02-20T13:12:46.523 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 142/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 143/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 144/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 145/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 146/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 147/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 148/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 149/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 150/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 151/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 152/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 153/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 154/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 155/167 2026-02-20T13:12:46.524 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 156/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 157/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 159/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : re2-1:20211101-20.el9.x86_64 161/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 162/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 163/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados2-2:20.3.0-5390.g0917c158.el9.x86_64 164/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 165/167 2026-02-20T13:12:46.525 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 166/167 2026-02-20T13:12:46.582 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 167/167 2026-02-20T13:12:46.582 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:46.582 INFO:teuthology.orchestra.run.trial034.stdout:Upgraded: 2026-02-20T13:12:46.582 INFO:teuthology.orchestra.run.trial034.stdout: librados2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.582 INFO:teuthology.orchestra.run.trial034.stdout: librbd1-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.582 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T13:12:46.582 INFO:teuthology.orchestra.run.trial034.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T13:12:46.582 INFO:teuthology.orchestra.run.trial034.stdout: automake-1.16.2-8.el9.noarch 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: bison-3.7.4-5.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-base-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-grafana-dashboards-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-immutable-object-cache-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mds-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-cephadm-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.583 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-dashboard-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-modules-core-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-rook-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mon-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-classic-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-crimson-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-prometheus-alerts-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-radosgw-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-selinux-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-test-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.584 INFO:teuthology.orchestra.run.trial034.stdout: ceph-volume-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: cephadm-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: cephfs-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: cephfs-shell-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: cephfs-top-2:20.3.0-5390.g0917c158.el9.noarch 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: flex-2.6.4-9.el9.x86_64 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T13:12:46.585 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-devel-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-proxy2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.586 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: libcephsqlite-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: librados-devel-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: libradosstriper1-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.587 INFO:teuthology.orchestra.run.trial034.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: librgw2-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T13:12:46.588 INFO:teuthology.orchestra.run.trial034.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: postgresql-13.23-1.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-20T13:12:46.589 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-argparse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-common-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-cephfs-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T13:12:46.590 INFO:teuthology.orchestra.run.trial034.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T13:12:46.591 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T13:12:46.592 INFO:teuthology.orchestra.run.trial034.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-rados-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-rbd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T13:12:46.593 INFO:teuthology.orchestra.run.trial034.stdout: python3-rgw-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T13:12:46.594 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: rbd-fuse-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: rbd-mirror-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: rbd-nbd-2:20.3.0-5390.g0917c158.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-20T13:12:46.595 INFO:teuthology.orchestra.run.trial034.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-20T13:12:46.596 INFO:teuthology.orchestra.run.trial034.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T13:12:46.596 INFO:teuthology.orchestra.run.trial034.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T13:12:46.596 INFO:teuthology.orchestra.run.trial034.stdout: zip-3.0-35.el9.x86_64 2026-02-20T13:12:46.596 INFO:teuthology.orchestra.run.trial034.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-20T13:12:46.596 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:12:46.596 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T13:12:46.682 DEBUG:teuthology.parallel:result is None 2026-02-20T13:12:46.683 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:12:51.983 DEBUG:teuthology.orchestra.run.trial028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T13:12:52.030 INFO:teuthology.orchestra.run.trial028.stdout:20.3.0-5390.g0917c158.el9 2026-02-20T13:12:52.031 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5390.g0917c158.el9 2026-02-20T13:12:52.031 INFO:teuthology.task.install:The correct ceph version 20.3.0-5390.g0917c158 is installed. 2026-02-20T13:12:52.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:12:52.192 DEBUG:teuthology.orchestra.run.trial034:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T13:12:52.215 INFO:teuthology.orchestra.run.trial034.stdout:20.3.0-5390.g0917c158.el9 2026-02-20T13:12:52.215 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5390.g0917c158.el9 2026-02-20T13:12:52.216 INFO:teuthology.task.install:The correct ceph version 20.3.0-5390.g0917c158 is installed. 2026-02-20T13:12:52.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:12:52.371 DEBUG:teuthology.orchestra.run.trial127:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T13:12:52.394 INFO:teuthology.orchestra.run.trial127.stdout:20.3.0-5390.g0917c158.el9 2026-02-20T13:12:52.395 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5390.g0917c158.el9 2026-02-20T13:12:52.395 INFO:teuthology.task.install:The correct ceph version 20.3.0-5390.g0917c158 is installed. 2026-02-20T13:12:52.397 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T13:12:52.398 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:12:52.398 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T13:12:52.456 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:12:52.457 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T13:12:52.485 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:12:52.485 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T13:12:52.514 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T13:12:52.514 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:12:52.514 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T13:12:52.570 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T13:12:52.665 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:12:52.665 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T13:12:52.690 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T13:12:52.753 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:12:52.753 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T13:12:52.778 DEBUG:teuthology.orchestra.run.trial127:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T13:12:52.843 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T13:12:52.843 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:12:52.843 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T13:12:52.898 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T13:12:52.994 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:12:52.994 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T13:12:53.019 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T13:12:53.085 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:12:53.085 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T13:12:53.112 DEBUG:teuthology.orchestra.run.trial127:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T13:12:53.176 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T13:12:53.176 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:12:53.176 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T13:12:53.232 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T13:12:53.327 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:12:53.327 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T13:12:53.354 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T13:12:53.418 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:12:53.418 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T13:12:53.444 DEBUG:teuthology.orchestra.run.trial127:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T13:12:53.508 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-20T13:12:53.637 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '0917c15888a16c5bbbd9de28990cc81230360c9e', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2026-02-20T13:12:53.638 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:12:53.640 INFO:tasks.cephadm:Cluster fsid is dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:12:53.640 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-20T13:12:53.640 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.28', 'mon.b': '10.20.193.34', 'mon.c': '10.20.193.127'} 2026-02-20T13:12:53.640 INFO:tasks.cephadm:First mon is mon.a on trial028 2026-02-20T13:12:53.640 INFO:tasks.cephadm:First mgr is x 2026-02-20T13:12:53.640 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-20T13:12:53.640 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname $(hostname -s) 2026-02-20T13:12:53.696 DEBUG:teuthology.orchestra.run.trial034:> sudo hostname $(hostname -s) 2026-02-20T13:12:53.721 DEBUG:teuthology.orchestra.run.trial127:> sudo hostname $(hostname -s) 2026-02-20T13:12:53.748 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-20T13:12:53.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:12:54.029 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/flavors/default/', 'ref': 'wip-vshankar-testing-20260219.125903', 'sha1': '0917c15888a16c5bbbd9de28990cc81230360c9e', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-20 04:10:20.425701', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5390-g0917c158', 'package_manager_version': '20.3.0-5390.g0917c158', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3096/', 'root_build_cause': '', 'node_name': '10.20.192.98+toko08', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-20T13:12:54.176 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-vshankar-testing-20260219.125903, sha1 0917c15888a16c5bbbd9de28990cc81230360c9e from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:12:54.177 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/x86_64/flavors/default/cephadm 2026-02-20T13:12:54.177 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/x86_64/flavors/default/cephadm 2026-02-20T13:12:54.178 DEBUG:teuthology.orchestra.run.trial028:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:54.702 INFO:teuthology.orchestra.run.trial028.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073793 Feb 20 13:12 /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:54.702 DEBUG:teuthology.orchestra.run.trial034:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:55.044 INFO:teuthology.orchestra.run.trial034.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073793 Feb 20 13:12 /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:55.045 DEBUG:teuthology.orchestra.run.trial127:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260219.125903/0917c15888a16c5bbbd9de28990cc81230360c9e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:55.373 INFO:teuthology.orchestra.run.trial127.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073793 Feb 20 13:12 /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:55.374 DEBUG:teuthology.orchestra.run.trial028:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:55.414 DEBUG:teuthology.orchestra.run.trial034:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:55.431 DEBUG:teuthology.orchestra.run.trial127:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-20T13:12:55.460 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e on all hosts... 2026-02-20T13:12:55.460 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e pull 2026-02-20T13:12:55.463 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e pull 2026-02-20T13:12:55.474 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e pull 2026-02-20T13:12:55.725 INFO:teuthology.orchestra.run.trial034.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e... 2026-02-20T13:12:55.748 INFO:teuthology.orchestra.run.trial127.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e... 2026-02-20T13:12:55.946 INFO:teuthology.orchestra.run.trial028.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e... 2026-02-20T13:13:05.785 INFO:teuthology.orchestra.run.trial127.stdout:{ 2026-02-20T13:13:05.785 INFO:teuthology.orchestra.run.trial127.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev)", 2026-02-20T13:13:05.785 INFO:teuthology.orchestra.run.trial127.stdout: "image_id": "8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb", 2026-02-20T13:13:05.785 INFO:teuthology.orchestra.run.trial127.stdout: "repo_digests": [ 2026-02-20T13:13:05.785 INFO:teuthology.orchestra.run.trial127.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6" 2026-02-20T13:13:05.786 INFO:teuthology.orchestra.run.trial127.stdout: ] 2026-02-20T13:13:05.786 INFO:teuthology.orchestra.run.trial127.stdout:} 2026-02-20T13:13:05.834 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-20T13:13:05.834 INFO:teuthology.orchestra.run.trial034.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev)", 2026-02-20T13:13:05.834 INFO:teuthology.orchestra.run.trial034.stdout: "image_id": "8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb", 2026-02-20T13:13:05.835 INFO:teuthology.orchestra.run.trial034.stdout: "repo_digests": [ 2026-02-20T13:13:05.835 INFO:teuthology.orchestra.run.trial034.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6" 2026-02-20T13:13:05.835 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-20T13:13:05.835 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-20T13:13:08.111 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:13:08.111 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev)", 2026-02-20T13:13:08.111 INFO:teuthology.orchestra.run.trial028.stdout: "image_id": "8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb", 2026-02-20T13:13:08.111 INFO:teuthology.orchestra.run.trial028.stdout: "repo_digests": [ 2026-02-20T13:13:08.111 INFO:teuthology.orchestra.run.trial028.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6" 2026-02-20T13:13:08.111 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:13:08.111 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:13:08.132 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /etc/ceph 2026-02-20T13:13:08.192 DEBUG:teuthology.orchestra.run.trial034:> sudo mkdir -p /etc/ceph 2026-02-20T13:13:08.222 DEBUG:teuthology.orchestra.run.trial127:> sudo mkdir -p /etc/ceph 2026-02-20T13:13:08.250 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 777 /etc/ceph 2026-02-20T13:13:08.307 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod 777 /etc/ceph 2026-02-20T13:13:08.333 DEBUG:teuthology.orchestra.run.trial127:> sudo chmod 777 /etc/ceph 2026-02-20T13:13:08.360 INFO:tasks.cephadm:Writing seed config... 2026-02-20T13:13:08.362 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-20T13:13:08.363 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-20T13:13:08.364 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-20T13:13:08.365 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-20T13:13:08.365 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2026-02-20T13:13:08.366 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:13:08.366 DEBUG:teuthology.orchestra.run.trial028:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-20T13:13:08.405 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = dd845518-0e5d-11f1-9909-d404e6e7d460 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True [mds] mds_bal_replicate_threshold = 1 2026-02-20T13:13:08.405 DEBUG:teuthology.orchestra.run.trial028:mon.a> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.a.service 2026-02-20T13:13:08.449 DEBUG:teuthology.orchestra.run.trial028:mgr.x> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.x.service 2026-02-20T13:13:08.494 INFO:tasks.cephadm:Bootstrapping... 2026-02-20T13:13:08.494 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e -v bootstrap --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.28 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:13:08.684 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:13:08.684 INFO:teuthology.orchestra.run.trial028.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', '-v', 'bootstrap', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.28', '--skip-admin-label'] 2026-02-20T13:13:08.684 INFO:teuthology.orchestra.run.trial028.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-20T13:13:08.685 INFO:teuthology.orchestra.run.trial028.stdout:Verifying podman|docker is present... 2026-02-20T13:13:08.717 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.6.0 2026-02-20T13:13:08.718 INFO:teuthology.orchestra.run.trial028.stdout:Verifying lvm2 is present... 2026-02-20T13:13:08.718 INFO:teuthology.orchestra.run.trial028.stdout:Verifying time synchronization is in place... 2026-02-20T13:13:08.729 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-20T13:13:08.729 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-20T13:13:08.740 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-20T13:13:08.741 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T13:13:08.752 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-20T13:13:08.762 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-20T13:13:08.762 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-20T13:13:08.762 INFO:teuthology.orchestra.run.trial028.stdout:Repeating the final host check... 2026-02-20T13:13:08.796 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.6.0 2026-02-20T13:13:08.796 INFO:teuthology.orchestra.run.trial028.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-20T13:13:08.796 INFO:teuthology.orchestra.run.trial028.stdout:systemctl is present 2026-02-20T13:13:08.796 INFO:teuthology.orchestra.run.trial028.stdout:lvcreate is present 2026-02-20T13:13:08.806 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-20T13:13:08.806 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-20T13:13:08.816 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-20T13:13:08.816 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T13:13:08.828 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-20T13:13:08.838 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-20T13:13:08.838 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-20T13:13:08.838 INFO:teuthology.orchestra.run.trial028.stdout:Host looks OK 2026-02-20T13:13:08.838 INFO:teuthology.orchestra.run.trial028.stdout:Cluster fsid: dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:08.838 INFO:teuthology.orchestra.run.trial028.stdout:Acquiring lock 139832357328256 on /run/cephadm/dd845518-0e5d-11f1-9909-d404e6e7d460.lock 2026-02-20T13:13:08.839 INFO:teuthology.orchestra.run.trial028.stdout:Lock 139832357328256 acquired on /run/cephadm/dd845518-0e5d-11f1-9909-d404e6e7d460.lock 2026-02-20T13:13:08.839 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 3300 ... 2026-02-20T13:13:08.839 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 6789 ... 2026-02-20T13:13:08.839 INFO:teuthology.orchestra.run.trial028.stdout:Base mon IP(s) is [10.20.193.28:3300, 10.20.193.28:6789], mon addrv is [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-20T13:13:08.844 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.28 metric 100 2026-02-20T13:13:08.844 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.28 metric 100 2026-02-20T13:13:08.850 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-20T13:13:08.850 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-20T13:13:08.855 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-20T13:13:08.855 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-20T13:13:08.855 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-20T13:13:08.855 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 2: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-20T13:13:08.855 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:630c/64 scope link proto kernel_ll 2026-02-20T13:13:08.856 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-20T13:13:08.856 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-20T13:13:08.856 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-20T13:13:08.856 INFO:teuthology.orchestra.run.trial028.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-20T13:13:08.857 INFO:teuthology.orchestra.run.trial028.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-20T13:13:08.857 INFO:teuthology.orchestra.run.trial028.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e... 2026-02-20T13:13:09.403 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb 2026-02-20T13:13:09.403 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e... 2026-02-20T13:13:09.404 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Getting image source signatures 2026-02-20T13:13:09.404 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:5dd85e1a50663785d86adae5ef92579a03e6f64059ca9c005010518acdd62048 2026-02-20T13:13:09.404 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:6e3006c17985c791e515d543e4a035e1ba771d51b977edf026d4702d36e4300c 2026-02-20T13:13:09.404 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying config sha256:8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb 2026-02-20T13:13:09.404 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-20T13:13:09.633 INFO:teuthology.orchestra.run.trial028.stdout:ceph: stdout ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev) 2026-02-20T13:13:09.633 INFO:teuthology.orchestra.run.trial028.stdout:Ceph version: ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev) 2026-02-20T13:13:09.633 INFO:teuthology.orchestra.run.trial028.stdout:Extracting ceph user uid/gid from container image... 2026-02-20T13:13:09.858 INFO:teuthology.orchestra.run.trial028.stdout:stat: stdout 167 167 2026-02-20T13:13:09.858 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial keys... 2026-02-20T13:13:10.090 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDlXZhpf13tOhAAwQIWnkaHEg7bC8FZyAyepg== 2026-02-20T13:13:10.341 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDmXZhpU41TDhAAUcuE7zFoS9F3OeqaFF2JpQ== 2026-02-20T13:13:10.582 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDmXZhp6Qu1HBAALsZmLxb74jkjlAx/DgHP0A== 2026-02-20T13:13:10.584 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial monmap... 2026-02-20T13:13:10.819 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout:monmaptool for a [v2:10.20.193.28:3300,v1:10.20.193.28:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout:setting min_mon_release = tentacle 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: set fsid to dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:10.820 INFO:teuthology.orchestra.run.trial028.stdout:Creating mon... 2026-02-20T13:13:11.094 INFO:teuthology.orchestra.run.trial028.stdout:create mon.a on 2026-02-20T13:13:11.350 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-20T13:13:11.533 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-20T13:13:11.724 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460.target → /etc/systemd/system/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460.target. 2026-02-20T13:13:11.725 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460.target → /etc/systemd/system/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460.target. 2026-02-20T13:13:11.943 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.a 2026-02-20T13:13:11.944 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.a.service: Unit ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.a.service not loaded. 2026-02-20T13:13:12.175 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460.target.wants/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@.service. 2026-02-20T13:13:12.459 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T13:13:12.459 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-20T13:13:12.470 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T13:13:12.470 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T13:13:12.471 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-20T13:13:12.471 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-20T13:13:12.471 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon to start... 2026-02-20T13:13:12.471 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon... 2026-02-20T13:13:12.517 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:12 trial028 ceph-mon[37089]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T13:13:12.787 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout cluster: 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout id: dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout services: 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.201424s) [leader: a] 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:12.788 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout data: 2026-02-20T13:13:12.789 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-20T13:13:12.789 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-20T13:13:12.789 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-20T13:13:12.789 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pgs: 2026-02-20T13:13:12.789 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:12.789 INFO:teuthology.orchestra.run.trial028.stdout:mon is available 2026-02-20T13:13:12.789 INFO:teuthology.orchestra.run.trial028.stdout:Assimilating anything we can from ceph.conf... 2026-02-20T13:13:13.068 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:13.068 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-20T13:13:13.069 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:13.070 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-20T13:13:13.070 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-20T13:13:13.070 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-20T13:13:13.070 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-20T13:13:13.070 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-20T13:13:13.070 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-20T13:13:13.070 INFO:teuthology.orchestra.run.trial028.stdout:Generating new minimal ceph.conf... 2026-02-20T13:13:13.369 INFO:teuthology.orchestra.run.trial028.stdout:Restarting the monitor... 2026-02-20T13:13:13.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 systemd[1]: Stopping Ceph mon.a for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:13:13.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T13:13:13.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: monmap epoch 1 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: last_changed 2026-02-20T13:13:10.714298+0000 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: created 2026-02-20T13:13:10.714298+0000 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: min_mon_release 20 (tentacle) 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: election_strategy: 1 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: fsmap 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: osdmap e1: 0 total, 0 up, 0 in 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: mgrmap e1: no daemons active 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: from='client.? 10.20.193.28:0/2311109417' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-20T13:13:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: from='client.? 10.20.193.28:0/144940432' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-20T13:13:13.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: from='client.? 10.20.193.28:0/144940432' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-20T13:13:13.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-mon[37089]: from='client.? 10.20.193.28:0/1725647514' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:13:13.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a[37085]: 2026-02-20T13:13:13.508+0000 7f4f98298640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:13:13.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a[37085]: 2026-02-20T13:13:13.508+0000 7f4f98298640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-20T13:13:13.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 podman[37326]: 2026-02-20 13:13:13.611030593 +0000 UTC m=+0.127293154 container died 514891d4929e235cec935c6b1dd9794c3b3ad3e4bb7e7b6f684785e119214fc1 (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T13:13:13.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 podman[37326]: 2026-02-20 13:13:13.667111211 +0000 UTC m=+0.183373772 container remove 514891d4929e235cec935c6b1dd9794c3b3ad3e4bb7e7b6f684785e119214fc1 (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e) 2026-02-20T13:13:13.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 bash[37326]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a 2026-02-20T13:13:13.920 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 systemd[1]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-20T13:13:13.920 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 systemd[1]: Stopped Ceph mon.a for dd845518-0e5d-11f1-9909-d404e6e7d460. 2026-02-20T13:13:13.920 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 systemd[1]: Starting Ceph mon.a for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:13:14.002 INFO:teuthology.orchestra.run.trial028.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-20T13:13:14.218 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 podman[37422]: 2026-02-20 13:13:13.935997848 +0000 UTC m=+0.029558744 container create bb6f0128981f424297dd69614dea4630b24f2cad55caed1383afb7d781315c0e (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, ceph=True, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903) 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 podman[37422]: 2026-02-20 13:13:13.984849855 +0000 UTC m=+0.078410751 container init bb6f0128981f424297dd69614dea4630b24f2cad55caed1383afb7d781315c0e (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, ceph=True) 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 podman[37422]: 2026-02-20 13:13:13.990005277 +0000 UTC m=+0.083566183 container start bb6f0128981f424297dd69614dea4630b24f2cad55caed1383afb7d781315c0e (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, ceph=True, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 bash[37422]: bb6f0128981f424297dd69614dea4630b24f2cad55caed1383afb7d781315c0e 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 podman[37422]: 2026-02-20 13:13:13.926490779 +0000 UTC m=+0.020051676 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:13 trial028 systemd[1]: Started Ceph mon.a for dd845518-0e5d-11f1-9909-d404e6e7d460. 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: set uid:gid to 167:167 (ceph:ceph) 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: pidfile_write: ignore empty --pid-file 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: load: jerasure load: lrc 2026-02-20T13:13:14.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: RocksDB version: 7.9.2 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Git sha 0 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Compile date 2026-02-20 03:41:47 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: DB SUMMARY 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: DB Session ID: HFOFZVXIU8MJXYQU0DNS 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: CURRENT file: CURRENT 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: IDENTITY file: IDENTITY 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95547 ; 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.error_if_exists: 0 2026-02-20T13:13:14.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.create_if_missing: 0 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.paranoid_checks: 1 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.env: 0xed5d60 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.fs: PosixFileSystem 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.info_log: 0x1fdd62c0 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_file_opening_threads: 16 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.statistics: (nil) 2026-02-20T13:13:14.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.use_fsync: 0 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_log_file_size: 0 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.keep_log_file_num: 1000 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.recycle_log_file_num: 0 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.allow_fallocate: 1 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.allow_mmap_reads: 0 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.allow_mmap_writes: 0 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.use_direct_reads: 0 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-20T13:13:14.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.create_missing_column_families: 0 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.db_log_dir: 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.wal_dir: 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.advise_random_on_open: 1 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.db_write_buffer_size: 0 2026-02-20T13:13:14.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.write_buffer_manager: 0x1fdd2140 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.rate_limiter: (nil) 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.wal_recovery_mode: 2 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.enable_thread_tracking: 0 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.enable_pipelined_write: 0 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.unordered_write: 0 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-20T13:13:14.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.row_cache: None 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.wal_filter: None 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.allow_ingest_behind: 0 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.two_write_queues: 0 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.manual_wal_flush: 0 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.wal_compression: 0 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.atomic_flush: 0 2026-02-20T13:13:14.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.log_readahead_size: 0 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.best_efforts_recovery: 0 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.allow_data_in_errors: 0 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.db_host_id: __hostname__ 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-20T13:13:14.226 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_background_jobs: 2 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_background_compactions: -1 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_subcompactions: 1 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_total_wal_size: 0 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_open_files: -1 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bytes_per_sync: 0 2026-02-20T13:13:14.227 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_readahead_size: 0 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_background_flushes: -1 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Compression algorithms supported: 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: kZSTD supported: 0 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: kXpressCompression supported: 0 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: kBZip2Compression supported: 0 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: kLZ4Compression supported: 1 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: kZlibCompression supported: 1 2026-02-20T13:13:14.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: kLZ4HCCompression supported: 1 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: kSnappyCompression supported: 1 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.merge_operator: 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_filter: None 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_filter_factory: None 2026-02-20T13:13:14.229 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.sst_partitioner_factory: None 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x1fd84b80) 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks: 1 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_top_level_index_and_filter: 1 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout: index_type: 0 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_index_type: 0 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout: index_shortening: 1 2026-02-20T13:13:14.230 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: checksum: 4 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: no_block_cache: 0 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache: 0x1fdb1870 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_name: BinnedLRUCache 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_options: 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: capacity : 536870912 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: num_shard_bits : 4 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: strict_capacity_limit : 0 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: high_pri_pool_ratio: 0.000 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_compressed: (nil) 2026-02-20T13:13:14.231 INFO:journalctl@ceph.mon.a.trial028.stdout: persistent_cache: (nil) 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size: 4096 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size_deviation: 10 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: block_restart_interval: 16 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: index_block_restart_interval: 1 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: metadata_block_size: 4096 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: partition_filters: 0 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: use_delta_encoding: 1 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: filter_policy: bloomfilter 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: whole_key_filtering: 1 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: verify_compression: 0 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: read_amp_bytes_per_bit: 0 2026-02-20T13:13:14.232 INFO:journalctl@ceph.mon.a.trial028.stdout: format_version: 5 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_index_compression: 1 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout: block_align: 0 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout: max_auto_readahead_size: 262144 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout: prepopulate_block_cache: 0 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout: initial_auto_readahead_size: 8192 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout: num_file_reads_for_auto_readahead: 2 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.write_buffer_size: 33554432 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_write_buffer_number: 2 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression: NoCompression 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression: Disabled 2026-02-20T13:13:14.233 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.prefix_extractor: nullptr 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.num_levels: 7 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-20T13:13:14.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.level: 32767 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.strategy: 0 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.enabled: false 2026-02-20T13:13:14.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.target_file_size_base: 67108864 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-20T13:13:14.236 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.arena_block_size: 1048576 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.disable_auto_compactions: 0 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-20T13:13:14.237 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.inplace_update_support: 0 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-20T13:13:14.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.bloom_locality: 0 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.max_successive_merges: 0 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.paranoid_file_checks: 0 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.force_consistency_checks: 1 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.report_bg_io_stats: 0 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.ttl: 2592000 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-20T13:13:14.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.enable_blob_files: false 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.min_blob_size: 0 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.blob_file_size: 268435456 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.blob_file_starting_level: 0 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-20T13:13:14.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c820cdb8-540b-4c6e-8048-553d1b556745 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771593194022486, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771593194023812, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91958, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 276, "table_properties": {"data_size": 90000, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11838, "raw_average_key_size": 48, "raw_value_size": 83319, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771593194, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c820cdb8-540b-4c6e-8048-553d1b556745", "db_session_id": "HFOFZVXIU8MJXYQU0DNS", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771593194023964, "job": 1, "event": "recovery_finished"} 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x1fdf4e00 2026-02-20T13:13:14.241 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: DB pointer 0x1fe06000 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: ** DB Stats ** 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T13:13:14.242 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: L0 2/0 91.67 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: Sum 2/0 91.67 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 101.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T13:13:14.243 INFO:journalctl@ceph.mon.a.trial028.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative compaction: 0.00 GB write, 18.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval compaction: 0.00 GB write, 18.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-20T13:13:14.244 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache BinnedLRUCache@0x1fdb1870#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.6e-05 secs_since: 0 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: starting mon.a rank 0 at public addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] at bind addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a@-1(???) e1 preinit fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a@-1(???).mds e1 new map 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a@-1(???).mds e1 print_map 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout: e1 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout: btime 2026-02-20T13:13:12:477808+0000 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T13:13:14.245 INFO:journalctl@ceph.mon.a.trial028.stdout: legacy client fscid: -1 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout: No filesystems configured 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: monmap epoch 1 2026-02-20T13:13:14.246 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:14.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: last_changed 2026-02-20T13:13:10.714298+0000 2026-02-20T13:13:14.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: created 2026-02-20T13:13:10.714298+0000 2026-02-20T13:13:14.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: min_mon_release 20 (tentacle) 2026-02-20T13:13:14.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: election_strategy: 1 2026-02-20T13:13:14.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T13:13:14.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: fsmap 2026-02-20T13:13:14.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: osdmap e1: 0 total, 0 up, 0 in 2026-02-20T13:13:14.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:14 trial028 ceph-mon[37442]: mgrmap e1: no daemons active 2026-02-20T13:13:14.279 INFO:teuthology.orchestra.run.trial028.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-20T13:13:14.280 INFO:teuthology.orchestra.run.trial028.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:13:14.280 INFO:teuthology.orchestra.run.trial028.stdout:Creating mgr... 2026-02-20T13:13:14.281 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-20T13:13:14.281 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-20T13:13:14.507 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.x 2026-02-20T13:13:14.508 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.x.service: Unit ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.x.service not loaded. 2026-02-20T13:13:14.702 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460.target.wants/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@.service. 2026-02-20T13:13:14.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:14 trial028 systemd[1]: Starting Ceph mgr.x for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:13:14.983 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T13:13:14.983 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-20T13:13:14.994 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T13:13:14.994 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T13:13:14.994 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-20T13:13:14.994 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-20T13:13:15.008 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T13:13:15.008 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-20T13:13:15.019 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T13:13:15.019 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T13:13:15.020 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-20T13:13:15.020 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-20T13:13:15.020 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr to start... 2026-02-20T13:13:15.020 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr... 2026-02-20T13:13:15.209 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:14 trial028 podman[37664]: 2026-02-20 13:13:14.910427201 +0000 UTC m=+0.030227349 container create 99dbc4c627044bfb78112880a56b37d6e72953657ce30705709976310f6c0790 (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, ceph=True, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2026-02-20T13:13:15.209 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:14 trial028 podman[37664]: 2026-02-20 13:13:14.952402587 +0000 UTC m=+0.072202735 container init 99dbc4c627044bfb78112880a56b37d6e72953657ce30705709976310f6c0790 (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, OSD_FLAVOR=default, ceph=True) 2026-02-20T13:13:15.210 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:14 trial028 podman[37664]: 2026-02-20 13:13:14.957624271 +0000 UTC m=+0.077424429 container start 99dbc4c627044bfb78112880a56b37d6e72953657ce30705709976310f6c0790 (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0) 2026-02-20T13:13:15.210 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:14 trial028 bash[37664]: 99dbc4c627044bfb78112880a56b37d6e72953657ce30705709976310f6c0790 2026-02-20T13:13:15.210 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:14 trial028 podman[37664]: 2026-02-20 13:13:14.89930023 +0000 UTC m=+0.019100388 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:13:15.210 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:14 trial028 systemd[1]: Started Ceph mgr.x for dd845518-0e5d-11f1-9909-d404e6e7d460. 2026-02-20T13:13:15.315 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:15.315 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T13:13:15.315 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T13:13:15.316 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T13:13:15.317 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T13:13:15.318 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T13:13:12:477808+0000", 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-20T13:13:15.319 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T13:13:12.478250+0000", 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T13:13:15.320 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (1/15)... 2026-02-20T13:13:15.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:15 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/990121874' entity='client.admin' 2026-02-20T13:13:16.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:16 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4121478940' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-20T13:13:16.600 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:16 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T13:13:16.600 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:16 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T13:13:16.600 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:16 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: from numpy import show_config as show_numpy_config 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:17.596 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T13:13:17.597 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T13:13:17.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T13:13:12:477808+0000", 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:17.599 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T13:13:12.478250+0000", 2026-02-20T13:13:17.600 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T13:13:17.601 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:17.601 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T13:13:17.601 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T13:13:17.601 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (2/15)... 2026-02-20T13:13:17.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:17 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3452659657' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-20T13:13:19.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: Activating manager daemon x 2026-02-20T13:13:19.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: mgrmap e2: x(active, starting, since 0.00449342s) 2026-02-20T13:13:19.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-20T13:13:19.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-20T13:13:19.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-20T13:13:19.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:13:19.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-20T13:13:19.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: Manager daemon x is now available 2026-02-20T13:13:19.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-20T13:13:19.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' 2026-02-20T13:13:19.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-20T13:13:19.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' 2026-02-20T13:13:19.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:18 trial028 ceph-mon[37442]: from='mgr.14100 10.20.193.28:0/3634138647' entity='mgr.x' 2026-02-20T13:13:19.873 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-20T13:13:19.874 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:19.875 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T13:13:19.876 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T13:13:12:477808+0000", 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T13:13:19.877 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T13:13:19.878 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T13:13:12.478250+0000", 2026-02-20T13:13:19.879 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T13:13:19.879 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T13:13:19.879 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T13:13:19.879 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T13:13:19.879 INFO:teuthology.orchestra.run.trial028.stdout:mgr is available 2026-02-20T13:13:20.238 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:20.238 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-20T13:13:20.238 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:20.238 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-20T13:13:20.238 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-20T13:13:20.239 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-20T13:13:20.240 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-20T13:13:20.240 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-20T13:13:20.240 INFO:teuthology.orchestra.run.trial028.stdout:Enabling cephadm module... 2026-02-20T13:13:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:20 trial028 ceph-mon[37442]: mgrmap e3: x(active, since 1.00774s) 2026-02-20T13:13:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:20 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2553846276' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-20T13:13:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:20 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2006275584' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-20T13:13:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:20 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3522171678' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-20T13:13:21.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: ignoring --setuser ceph since I am not root 2026-02-20T13:13:21.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: ignoring --setgroup ceph since I am not root 2026-02-20T13:13:21.269 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T13:13:21.270 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 4, 2026-02-20T13:13:21.270 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T13:13:21.270 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-20T13:13:21.270 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-20T13:13:21.270 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T13:13:21.270 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-20T13:13:21.270 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 4... 2026-02-20T13:13:22.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:21 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3522171678' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-20T13:13:22.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:21 trial028 ceph-mon[37442]: mgrmap e4: x(active, since 2s) 2026-02-20T13:13:22.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:21 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1637775340' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-20T13:13:22.600 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T13:13:22.600 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T13:13:22.600 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: from numpy import show_config as show_numpy_config 2026-02-20T13:13:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: Active manager daemon x restarted 2026-02-20T13:13:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: Activating manager daemon x 2026-02-20T13:13:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: osdmap e2: 0 total, 0 up, 0 in 2026-02-20T13:13:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: mgrmap e5: x(active, starting, since 0.00304891s) 2026-02-20T13:13:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:13:25.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-20T13:13:25.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-20T13:13:25.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-20T13:13:25.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-20T13:13:25.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:24 trial028 ceph-mon[37442]: Manager daemon x is now available 2026-02-20T13:13:25.699 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T13:13:25.699 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 6, 2026-02-20T13:13:25.699 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-20T13:13:25.699 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T13:13:25.699 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 4 is available 2026-02-20T13:13:25.699 INFO:teuthology.orchestra.run.trial028.stdout:Verifying orchestrator module is enabled... 2026-02-20T13:13:26.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:26.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:26.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: Found migration_current of "None". Setting to last migration. 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: mgrmap e6: x(active, since 1.00539s) 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:25] ENGINE Bus STARTING 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:25] ENGINE Serving on http://10.20.193.28:8765 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:25] ENGINE Serving on https://10.20.193.28:7150 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:25] ENGINE Bus STARTED 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:13:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:25 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:25] ENGINE Client ('10.20.193.28', 36068) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T13:13:27.001 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-20T13:13:27.001 INFO:teuthology.orchestra.run.trial028.stdout:Setting orchestrator backend to cephadm... 2026-02-20T13:13:27.327 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:26 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1530010022' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-20T13:13:27.828 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-20T13:13:27.828 INFO:teuthology.orchestra.run.trial028.stdout:Generating ssh key... 2026-02-20T13:13:28.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:27 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1530010022' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-20T13:13:28.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:27 trial028 ceph-mon[37442]: mgrmap e7: x(active, since 2s) 2026-02-20T13:13:28.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:27 trial028 ceph-mon[37442]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:28.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:27 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:28.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:27 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:13:28.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:27 trial028 ceph-mon[37442]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:28.506 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: Generating public/private ed25519 key pair. 2026-02-20T13:13:28.506 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: Your identification has been saved in /tmp/tmps2_53chl/key 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: Your public key has been saved in /tmp/tmps2_53chl/key.pub 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: The key fingerprint is: 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: SHA256:JTzyKsbBVHv26HjbbEyBvhTtbMJn02li8KY2q+MUUkM ceph-dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: The key's randomart image is: 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: +--[ED25519 256]--+ 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | E | 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | o o | 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | . = *o. | 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | o . *+*o | 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | + .oS*.o . | 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | . o == & + | 2026-02-20T13:13:28.507 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | + +.o% + | 2026-02-20T13:13:28.508 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | . o..=+o | 2026-02-20T13:13:28.508 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: | .o+o+o | 2026-02-20T13:13:28.508 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: +----[SHA256]-----+ 2026-02-20T13:13:28.598 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAkKNuWxct3wOD5NqpMbREY2cwvfe6X2pQXEUitrC/zp ceph-dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:28.599 INFO:teuthology.orchestra.run.trial028.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-20T13:13:28.599 INFO:teuthology.orchestra.run.trial028.stdout:Adding key to root@localhost authorized_keys... 2026-02-20T13:13:28.599 INFO:teuthology.orchestra.run.trial028.stdout:Adding host trial028... 2026-02-20T13:13:29.208 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:29 trial028 ceph-mon[37442]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:29.208 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:29 trial028 ceph-mon[37442]: Generating ssh key... 2026-02-20T13:13:29.208 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:29 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:29.208 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:29 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:29.208 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:29 trial028 ceph-mon[37442]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:30.445 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:30 trial028 ceph-mon[37442]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial028", "addr": "10.20.193.28", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:30.445 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:30 trial028 ceph-mon[37442]: Deploying cephadm binary to trial028 2026-02-20T13:13:30.996 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Added host 'trial028' with addr '10.20.193.28' 2026-02-20T13:13:30.996 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mon service... 2026-02-20T13:13:31.391 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-20T13:13:31.391 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mgr service... 2026-02-20T13:13:31.760 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-20T13:13:32.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:32.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: Added host trial028 2026-02-20T13:13:32.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:13:32.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:32.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: Saving service mon spec with placement count:5 2026-02-20T13:13:32.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:32.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:32.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: Saving service mgr spec with placement count:2 2026-02-20T13:13:32.075 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:31 trial028 ceph-mon[37442]: from='mgr.14118 10.20.193.28:0/1756204562' entity='mgr.x' 2026-02-20T13:13:32.587 INFO:teuthology.orchestra.run.trial028.stdout:Enabling the dashboard module... 2026-02-20T13:13:33.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:33 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1817685349' entity='client.admin' 2026-02-20T13:13:33.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:33 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4212855297' entity='client.admin' 2026-02-20T13:13:33.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:33 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3426686039' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-20T13:13:33.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:33 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: ignoring --setuser ceph since I am not root 2026-02-20T13:13:33.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:33 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: ignoring --setgroup ceph since I am not root 2026-02-20T13:13:33.971 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T13:13:33.971 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 8, 2026-02-20T13:13:33.971 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T13:13:33.971 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-20T13:13:33.971 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-20T13:13:33.971 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T13:13:33.971 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-20T13:13:33.971 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 8... 2026-02-20T13:13:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:34 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3426686039' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-20T13:13:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:34 trial028 ceph-mon[37442]: mgrmap e8: x(active, since 8s) 2026-02-20T13:13:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:34 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/260784753' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-20T13:13:35.350 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:34 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T13:13:35.350 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:34 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T13:13:35.350 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:13:34 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: from numpy import show_config as show_numpy_config 2026-02-20T13:13:37.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: Active manager daemon x restarted 2026-02-20T13:13:37.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: Activating manager daemon x 2026-02-20T13:13:37.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: osdmap e3: 0 total, 0 up, 0 in 2026-02-20T13:13:37.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: mgrmap e9: x(active, starting, since 0.00288625s) 2026-02-20T13:13:37.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:13:37.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-20T13:13:37.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-20T13:13:37.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-20T13:13:37.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-20T13:13:37.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:37 trial028 ceph-mon[37442]: Manager daemon x is now available 2026-02-20T13:13:38.392 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T13:13:38.392 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 10, 2026-02-20T13:13:38.392 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-20T13:13:38.392 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T13:13:38.392 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 8 is available 2026-02-20T13:13:38.393 INFO:teuthology.orchestra.run.trial028.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-20T13:13:38.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:13:38.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-20T13:13:38.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-20T13:13:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:38 trial028 ceph-mon[37442]: mgrmap e10: x(active, since 1.00797s) 2026-02-20T13:13:39.418 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFHzCCAwegAwIBAgIUFdUqvBo7HsUV1Uyg4Cih9rd/dS8wDQYJKoZIhvcNAQEL\nBQAwPDE6MDgGA1UEAwwxY2VwaGFkbS1yb290LWRkODQ1NTE4LTBlNWQtMTFmMS05\nOTA5LWQ0MDRlNmU3ZDQ2MDAeFw0yNjAyMjAxMzEzMzlaFw0yOTAyMTkxMzEzMzla\nMBcxFTATBgNVBAMMDDEwLjIwLjE5My4yODCCAiIwDQYJKoZIhvcNAQEBBQADggIP\nADCCAgoCggIBANGAWI2dLdLlBpxMQBd7hd8TcTdWbdyBzmjUBqVz/HcGxnfy/Laa\nZg6MZ2UObNplUJAtXSm03+PrY8i2PXtcVpOZASzNwSRWqDZ0XEa4YWA9o41fIlUa\nytKNKuh+kwRx8U88ykZMS9/a3NFwTWOo06Xn9C1XAfNmXNuPpvg2jd0IAGlz2UG1\n7YWm1d8RngbVl7RjxSw0fq7seBuZOjVG9ShS9kzInL+ZzEB8poYe2FzA6SzmLwZp\n8UZGLyjbPk8+ZSEya5ZWQq35u0cgNVRUpABy5MfMi9GsH9QCqRKzzDth39pV3YUI\ncCPVi06jfTbS9pueZjebrdt69lN7AdLgvmgQd30JKLw0j7DRJZq8Fg6lN5H/QSLA\n/ZfMef00ipufFPLKNOqSPbY6UilNLvJMx+SPH9KWeorzsXbRRrgeZH68LdmhLf72\nKWIZCfpho+IcwgwQKZRfV0hHk/hR7IuDQkiFTpwkREBgDzFDr3wau4CWW+q51zXD\nbiSnyLv8xaSlvceaQkY7x/qkaiw99hq2Gw4vfaqb6mWRsPt9TbzxeOwEDmSkDiBu\nWZVSYsU6ispELkpjWI/oG0SZ1r6yP5mMfpEk3y44dGruSAfXuPUrWohSxWE7yLg1\nfdTEwIaNmmekv3EL6xk6QhYvrrKvOe/lASdo3imHrZvvwQ6lWXL6bI45AgMBAAGj\nPjA8MCwGA1UdEQQlMCOCCHRyaWFsMDI4ghFkYXNoYm9hcmRfc2VydmVyc4cEChTB\nHDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAsz/5xefJkL6MKhxwq\nbNOiwuwFaa3L/RMgdufrjEZKNOj+f400ZMhBerc/NQl9NI3FXLeDEXzcfJ8Nnc6I\n2dPBN2dlVx3Gsa86p9LdV+lT35FbJsAwT22lj4+VjQ4eQEnjEQdvotfDviE7Xooa\nLK5P9FNsxSjf9fRcsKCR3DlvwIKfa1sqRDTkpRxjQ4hhs+CV/7icbQFbT02+Ox9F\nIIi8QaQpf49TuV78+tvM6KkIJGaYdI9o1XhoWhdHNppMadGMWnAkPnUof4xUMEV4\nk9qOhzwKmKoBp0yuGsOyp1TSpQEMXy4ZrL2f8LrxTM+HIyoQC8DWyjZ7lDYFeOws\nuNiK1oUQJuB+63jsLJR/4fRHjJEjK9J64b7EJMSVjQxXbwBxVJokjAXnUNlcJreU\nuCdfw1jdcksIGCiiy7cGQo68ZLuDWnv38IGn/gkOqsMbCPsMFwMWUSYhhpMlHON+\nOVr5VgPkqj6YABJREZGq8IPxjd3fb5oevtkkiZLl9QRru3FwZsDbNAfRj6Ds+Lh2\nGay/efzNoEn0wZSqenF3piQYN+vCAUgCxR1gTihkapLjwctumxdOXUyRA14x2ye4\nvhD1aWDUsBKcC8hIyTTjQ6AHSIL1LlVcAL8TOozpEnZqdtPocMakU6l6D+lVBxfy\nP5/MSgo7JFypWt1bKrtOSIabCA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA0YBYjZ0t0uUGnExAF3uF3xNxN1Zt3IHOaNQGpXP8dwbGd/L8\ntppmDoxnZQ5s2mVQkC1dKbTf4+tjyLY9e1xWk5kBLM3BJFaoNnRcRrhhYD2jjV8i\nVRrK0o0q6H6TBHHxTzzKRkxL39rc0XBNY6jTpef0LVcB82Zc24+m+DaN3QgAaXPZ\nQbXthabV3xGeBtWXtGPFLDR+rux4G5k6NUb1KFL2TMicv5nMQHymhh7YXMDpLOYv\nBmnxRkYvKNs+Tz5lITJrllZCrfm7RyA1VFSkAHLkx8yL0awf1AKpErPMO2Hf2lXd\nhQhwI9WLTqN9NtL2m55mN5ut23r2U3sB0uC+aBB3fQkovDSPsNElmrwWDqU3kf9B\nIsD9l8x5/TSKm58U8so06pI9tjpSKU0u8kzH5I8f0pZ6ivOxdtFGuB5kfrwt2aEt\n/vYpYhkJ+mGj4hzCDBAplF9XSEeT+FHsi4NCSIVOnCREQGAPMUOvfBq7gJZb6rnX\nNcNuJKfIu/zFpKW9x5pCRjvH+qRqLD32GrYbDi99qpvqZZGw+31NvPF47AQOZKQO\nIG5ZlVJixTqKykQuSmNYj+gbRJnWvrI/mYx+kSTfLjh0au5IB9e49StaiFLFYTvI\nuDV91MTAho2aZ6S/cQvrGTpCFi+usq857+UBJ2jeKYetm+/BDqVZcvpsjjkCAwEA\nAQKCAgALcOHlIe9NtBovUO6zGZjO/OXS6tJnF2OpT+LpCDOCYIlYJZntcvMd2kcP\nOsFxD9Vdeky7KViMvt8dJ+6lnP5RYyqwQrBIhr768lHTvt/6fINBBi/+y87FvtXY\nComG1Z4jAKPfQO1n1TD38xUW2zJrvgYUr8q4ex+ZEfhBV+FZb8Vt/NihgQjuopTN\ncM3be7CkNkqfRmKgtOM+RpjqLezXfehbex0sTX7dCrGhY2/XaOWTASMSS5jUiKKs\nrYRymWq2bGV5uU486AV1NeoTp+eo6p1Z1+7OzYKTdm27SrxdhdPOvZ+yUyqkmlXY\nPo9o/g5foz/by5GsCcQH/RC1bnaXaN38eYout7sDRrBHNs3rdXG4nFGQdm447da8\nv2cSjZyNep34MEk/cE7cchH0VXpuxv/D8HAtpS/jX7q0Vma+p9m2IAo8AzO926KF\n7uY77tFpywdDRzZn851a3LY09bHI3WEjI3pq6aJ+zW0A1umRyynvlMwdtKfMR0hw\nV7+I7RCKL50+Dj0A8b11vDECsczTSrxLn/zjkwEPDPMC2fxWnIzxPq9sFGn/HLs+\ngViy5EWRRt7zzXl7tnticTDCNujA0BMCNhxckRsOv79g/0Nc19FPICnEaGcD46Z7\nBPZg/c3QsO5m482lkrqlJ9ihe/xZqvRlI+34UI6v+hx31wl3jQKCAQEA/r9cyno8\natGUxFx/z9BEC2Q7MmukQaIRtF+aDFHyIwreKnsQ1e/q1/DS3fPHVnfO4jGTEbQ+\nug0PLYvYSzAXeeRvF3tnZvTH6Jjw6L6LzUk0hNwWIf+nUPnUmFQJO5vhT2QpWCTA\nOlIwhwD8wQ+II7p/SvlzBya/ArYlP/3cENfEvfjn/yxvkhDEqfv6IexusWU2CoMS\nFS+RbvHmHeXAJeh7oirnP006JKQyRNKb/KXtUp5tzXXW3ewqhfqrfVyt+J1B5v17\nS41NwgMlg55s5MJ3ModQZLJKBGMEkwgqFOBCEkM5rca7R9OHoAT+J8tRK2BfylXq\n6SsACQjaOWvVCwKCAQEA0ogI0USMGN9MWlqsHp53vrinsiQw47v9ZioU5SP+Vvro\n+r/fcIYtsi82wJoOmyGAXWyABc2owbj3An/bz9ZEmL0B+y/6PMA4q0zNkqJTu0/i\nUDdecnBdp1OmZwwM+v1pxh3pazvej6SCR9F0stafV68HPa0oLdR0qPSS3Iw5RHef\n/04Kg6GJ37/xOTnLsC8d/HGya3TypQROqP+nQqUVDuQMFTlcPpCAwCMykaL9yQml\nx0BFsdYylSQX0MUmu7uM2bn/saEW3w3/DVUNMfkvTT2STwDYmovcY6NX0SC6b/vn\nCSu2eg+I8WzhNP0zNwjxHPEDcJWwanCJua5fta3sSwKCAQBjSqMYKFy0JcweXQ9U\nKJDc/8wy8tGq40iTTU/1zVrbXbkKRb1iJYkbcbo+2G2xvjDc6QWxuNdaHQz1a7R6\nWdxMnkTOmkLLVk0006fSj7Jd6VKXFlFqHwNQBJBgbyDKIw/GqfuTZ3+lO7O+axwZ\nA7zEcER9LI0xFGEO5X/PWVsVFYSRpxqF0wQJoo+E0bnEzyq16gUOQ9ggedHttEtF\nC+/A1sSZiK9pdOhcr8MIIC68YtAFi8qwcmW1Sf+pCPMegaktZd3x8orD/+d231MX\n4f//iex7vVIQbY17+DwoMt50FJSsGZe5q+QDMueB73BAgna4uW+cpbBSAXiaDOFB\n0E3RAoIBAGNBw3Z2LN7lGChZK2DcMXR3tohkS7ByxwtNt8A4cgcsEH93yq5QdGbX\nn6a6ezxkVRK2vrz9sxxySfKhuU6JpJmmMrLscbwGnDEW6qzBX1ymUvqiwCKQG3dy\nFrfqlIwYwa+oFo56EXoDg3C8rZpLWaCLYoyPgKvqyH2HoV3dtnozM/m4H3jjxg75\nfY8PUprj++0y5X2IC4YFO9itf3wKPJ1iote2zWip1CnB7mt/PstzgvcntDQd2oc6\nFwhUiuhjigp0iLqESjYrcR4mBSyUYNq3tq0MpxJl8if/sL1mAsAdMVW/iC6P+G5q\neNr0rRq7WoHcl1STHjNwj149ed47+3UCggEBANEXTfleyK2YKwbPPXx738alpPc3\nhTQlRdPbk6jTY0NkacHvzfqiqUvxEXbwnn/R4uczp1sbBEJvdUPT0NSOLEnhUrYM\n3+GlguZkCf9zoJIuDeODvQtp1Sy3Mr93WMPMoTe1q+Yu7GnDPesN7grawSPbpb18\n0lFSS5QHY3YwvDjMixFMZfNsmwvhkFPJ6MdWscmsd/pb0N8ZTwOOG3XrZxoeoVrD\nPKzjCp0Ux1vpudvpnkScqjya+WR9CNfdIpT9wc80DSIfTavaL5JdjQEgIXpgtXDt\n939mXCpbhFckVnjNsgBdy5xiH4cG74iRG8H7MjlXfZDyg+dPgp1bJS0Qh1c=\n-----END RSA PRIVATE KEY-----\n"} 2026-02-20T13:13:39.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:39 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:37] ENGINE Bus STARTING 2026-02-20T13:13:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:39 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:37] ENGINE Serving on https://10.20.193.28:7150 2026-02-20T13:13:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:39 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:37] ENGINE Client ('10.20.193.28', 34182) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T13:13:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:39 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:37] ENGINE Serving on http://10.20.193.28:8765 2026-02-20T13:13:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:39 trial028 ceph-mon[37442]: [20/Feb/2026:13:13:37] ENGINE Bus STARTED 2026-02-20T13:13:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:39 trial028 ceph-mon[37442]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-20T13:13:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:39 trial028 ceph-mon[37442]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-20T13:13:39.929 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-20T13:13:40.386 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-20T13:13:40.386 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial admin user... 2026-02-20T13:13:40.517 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:40 trial028 ceph-mon[37442]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:40.517 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:40 trial028 ceph-mon[37442]: mgrmap e11: x(active, since 2s) 2026-02-20T13:13:40.518 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:40.518 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:40.978 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$PKBAYuGuGny71.MQk8kug.S5nv2SVRADeY7rY8lK4Aiycbfs/PhmO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771593220, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-20T13:13:40.979 INFO:teuthology.orchestra.run.trial028.stdout:Fetching dashboard port number... 2026-02-20T13:13:41.339 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 8443 2026-02-20T13:13:41.355 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T13:13:41.355 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-20T13:13:41.367 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T13:13:41.367 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T13:13:41.367 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-20T13:13:41.367 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-20T13:13:41.368 INFO:teuthology.orchestra.run.trial028.stdout:Ceph Dashboard is now available at: 2026-02-20T13:13:41.368 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.368 INFO:teuthology.orchestra.run.trial028.stdout: URL: https://trial028:8443/ 2026-02-20T13:13:41.368 INFO:teuthology.orchestra.run.trial028.stdout: User: admin 2026-02-20T13:13:41.368 INFO:teuthology.orchestra.run.trial028.stdout: Password: 024nw0sjiq 2026-02-20T13:13:41.369 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.369 INFO:teuthology.orchestra.run.trial028.stdout:Saving cluster configuration to /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config directory 2026-02-20T13:13:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:41 trial028 ceph-mon[37442]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:41 trial028 ceph-mon[37442]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:41 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1105730263' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-20T13:13:41.776 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-20T13:13:41.776 INFO:teuthology.orchestra.run.trial028.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-20T13:13:41.776 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.776 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:13:41.776 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.776 INFO:teuthology.orchestra.run.trial028.stdout:Or, if you are only running a single cluster on this host: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: ceph telemetry on 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout:For more information see: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:41.777 INFO:teuthology.orchestra.run.trial028.stdout:Bootstrap complete. 2026-02-20T13:13:41.790 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout static 2026-02-20T13:13:41.801 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-20T13:13:41.801 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T13:13:41.801 INFO:teuthology.orchestra.run.trial028.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-20T13:13:42.051 INFO:tasks.cephadm:Fetching config... 2026-02-20T13:13:42.051 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:13:42.051 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-20T13:13:42.089 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-20T13:13:42.090 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:13:42.090 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-20T13:13:42.169 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-20T13:13:42.169 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:13:42.169 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-20T13:13:42.266 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-20T13:13:42.266 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:13:42.266 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-20T13:13:42.345 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-20T13:13:42.345 DEBUG:teuthology.orchestra.run.trial028:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAkKNuWxct3wOD5NqpMbREY2cwvfe6X2pQXEUitrC/zp ceph-dd845518-0e5d-11f1-9909-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-20T13:13:42.462 INFO:teuthology.orchestra.run.trial028.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAkKNuWxct3wOD5NqpMbREY2cwvfe6X2pQXEUitrC/zp ceph-dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:42.484 DEBUG:teuthology.orchestra.run.trial034:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAkKNuWxct3wOD5NqpMbREY2cwvfe6X2pQXEUitrC/zp ceph-dd845518-0e5d-11f1-9909-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-20T13:13:42.519 INFO:teuthology.orchestra.run.trial034.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAkKNuWxct3wOD5NqpMbREY2cwvfe6X2pQXEUitrC/zp ceph-dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:42.529 DEBUG:teuthology.orchestra.run.trial127:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAkKNuWxct3wOD5NqpMbREY2cwvfe6X2pQXEUitrC/zp ceph-dd845518-0e5d-11f1-9909-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-20T13:13:42.565 INFO:teuthology.orchestra.run.trial127.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAkKNuWxct3wOD5NqpMbREY2cwvfe6X2pQXEUitrC/zp ceph-dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:42.575 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-20T13:13:42.623 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:42 trial028 ceph-mon[37442]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:42.623 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:42 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3451286224' entity='client.admin' 2026-02-20T13:13:42.623 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:42 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:42.760 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:13:43.212 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-20T13:13:43.213 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-20T13:13:43.396 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:13:43.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:43.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:43 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/502172818' entity='client.admin' 2026-02-20T13:13:43.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:43.841 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial034 2026-02-20T13:13:43.841 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:13:43.842 DEBUG:teuthology.orchestra.run.trial034:> dd of=/etc/ceph/ceph.conf 2026-02-20T13:13:43.860 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:13:43.860 DEBUG:teuthology.orchestra.run.trial034:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T13:13:43.916 INFO:tasks.cephadm:Adding host trial034 to orchestrator... 2026-02-20T13:13:43.917 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch host add trial034 2026-02-20T13:13:44.109 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:13:44.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:44 trial028 ceph-mon[37442]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:44.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:44.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:44.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:44 trial028 ceph-mon[37442]: mgrmap e12: x(active, since 6s) 2026-02-20T13:13:44.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:44 trial028 ceph-mon[37442]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial034", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:46.017 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial034' with addr '10.20.193.34' 2026-02-20T13:13:46.017 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:45 trial028 ceph-mon[37442]: Deploying cephadm binary to trial034 2026-02-20T13:13:46.123 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-20T13:13:46.309 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:13:46.622 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:46.622 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.34", "hostname": "trial034", "labels": [], "status": ""}] 2026-02-20T13:13:46.723 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial127 2026-02-20T13:13:46.723 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:13:46.723 DEBUG:teuthology.orchestra.run.trial127:> dd of=/etc/ceph/ceph.conf 2026-02-20T13:13:46.742 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:13:46.742 DEBUG:teuthology.orchestra.run.trial127:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T13:13:46.800 INFO:tasks.cephadm:Adding host trial127 to orchestrator... 2026-02-20T13:13:46.800 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch host add trial127 2026-02-20T13:13:46.985 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:13:47.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:47.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"} : dispatch 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: Added host trial034 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: Updating trial028:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:13:47.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:46 trial028 ceph-mon[37442]: Updating trial028:/etc/ceph/ceph.client.admin.keyring 2026-02-20T13:13:48.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:13:48.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: Updating trial028:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T13:13:48.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:48.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:48.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: Certificate for "cephadm-signed_agent_cert (trial028)" is still valid for 1824 days. 2026-02-20T13:13:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:13:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial127", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:48 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:48.854 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial127' with addr '10.20.193.127' 2026-02-20T13:13:48.956 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-20T13:13:49.143 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:13:49.186 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:49 trial028 ceph-mon[37442]: Deploying cephadm binary to trial127 2026-02-20T13:13:49.187 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:49 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:49.187 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:49 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:49.438 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:13:49.439 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.34", "hostname": "trial034", "labels": [], "status": ""}, {"addr": "10.20.193.127", "hostname": "trial127", "labels": [], "status": ""}] 2026-02-20T13:13:49.537 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-20T13:13:49.537 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd crush tunables default 2026-02-20T13:13:49.723 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:13:50.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: Added host trial127 2026-02-20T13:13:50.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:13:50.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:50.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial034", "name": "osd_memory_target"} : dispatch 2026-02-20T13:13:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:13:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:13:51.024 INFO:teuthology.orchestra.run.trial028.stderr:adjusted tunables profile to default 2026-02-20T13:13:51.126 INFO:tasks.cephadm:Adding mon.a on trial028 2026-02-20T13:13:51.126 INFO:tasks.cephadm:Adding mon.b on trial034 2026-02-20T13:13:51.126 INFO:tasks.cephadm:Adding mon.c on trial127 2026-02-20T13:13:51.127 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch apply mon '3;trial028:10.20.193.28=a;trial034:10.20.193.34=b;trial127:10.20.193.127=c' 2026-02-20T13:13:51.246 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T13:13:51.246 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T13:13:51.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: Updating trial034:/etc/ceph/ceph.conf 2026-02-20T13:13:51.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: Updating trial034:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:13:51.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: Updating trial034:/etc/ceph/ceph.client.admin.keyring 2026-02-20T13:13:51.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/353420028' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-20T13:13:51.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: Updating trial034:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T13:13:51.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:51.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:51.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:51.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:13:51.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:51.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:51.488 INFO:teuthology.orchestra.run.trial127.stdout:Scheduled mon update... 2026-02-20T13:13:51.543 DEBUG:teuthology.orchestra.run.trial034:mon.b> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.b.service 2026-02-20T13:13:51.547 DEBUG:teuthology.orchestra.run.trial127:mon.c> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.c.service 2026-02-20T13:13:51.549 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-20T13:13:51.550 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T13:13:51.730 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T13:13:51.730 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T13:13:52.010 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:13:52.011 INFO:teuthology.orchestra.run.trial127.stdout:{"epoch":1,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","modified":"2026-02-20T13:13:10.714298Z","created":"2026-02-20T13:13:10.714298Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-20T13:13:10:714324+0000","crush_location":[]}],"quorum":[0]} 2026-02-20T13:13:52.011 INFO:teuthology.orchestra.run.trial127.stderr:dumped monmap epoch 1 2026-02-20T13:13:52.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:52 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/353420028' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-20T13:13:52.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:52 trial028 ceph-mon[37442]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T13:13:52.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:52 trial028 ceph-mon[37442]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial028:10.20.193.28=a;trial034:10.20.193.34=b;trial127:10.20.193.127=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:13:52.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:52 trial028 ceph-mon[37442]: Saving service mon spec with placement trial028:10.20.193.28=a;trial034:10.20.193.34=b;trial127:10.20.193.127=c;count:3 2026-02-20T13:13:52.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:52 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:52.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:52 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:52.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:52 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/3004945634' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-20T13:13:53.050 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-20T13:13:53.050 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T13:13:53.170 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:13:53.469 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:13:53.469 INFO:teuthology.orchestra.run.trial127.stdout:{"epoch":1,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","modified":"2026-02-20T13:13:10.714298Z","created":"2026-02-20T13:13:10.714298Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-20T13:13:10:714324+0000","crush_location":[]}],"quorum":[0]} 2026-02-20T13:13:53.470 INFO:teuthology.orchestra.run.trial127.stderr:dumped monmap epoch 1 2026-02-20T13:13:54.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:54.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:54.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial127", "name": "osd_memory_target"} : dispatch 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: Updating trial127:/etc/ceph/ceph.conf 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: Updating trial127:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: Updating trial127:/etc/ceph/ceph.client.admin.keyring 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: Updating trial127:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:54.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:54.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:13:54.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:13:54.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: Deploying daemon mon.c on trial127 2026-02-20T13:13:54.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:53 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/141545197' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-20T13:13:54.515 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-20T13:13:54.515 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T13:13:54.634 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:13:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: mon.a calling monitor election 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: mon.c calling monitor election 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-20T13:13:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: monmap epoch 2 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: last_changed 2026-02-20T13:13:54.483636+0000 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: created 2026-02-20T13:13:10.714298+0000 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: min_mon_release 20 (tentacle) 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: election_strategy: 1 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: 1: [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] mon.c 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: fsmap 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: mgrmap e12: x(active, since 22s) 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: overall HEALTH_OK 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:13:59.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:13:59.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:13:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:13:59.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:13:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:00 trial028 ceph-mon[37442]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:00 trial028 ceph-mon[37442]: Deploying daemon mon.b on trial034 2026-02-20T13:14:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:00 trial127 ceph-mon[43817]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:00 trial127 ceph-mon[43817]: Deploying daemon mon.b on trial034 2026-02-20T13:14:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:00.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:00 trial034 ceph-mon[43332]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-20T13:14:01.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:14:01 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: 2026-02-20T13:14:01.483+0000 7f2861cba640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-20T13:14:05.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:05.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:05.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:05.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: mon.a calling monitor election 2026-02-20T13:14:05.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: mon.c calling monitor election 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: mon.b calling monitor election 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: monmap epoch 3 2026-02-20T13:14:05.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: last_changed 2026-02-20T13:14:00.678403+0000 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: created 2026-02-20T13:13:10.714298+0000 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: min_mon_release 20 (tentacle) 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: election_strategy: 1 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: 1: [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] mon.c 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: 2: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.b 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: fsmap 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: mgrmap e12: x(active, since 28s) 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: overall HEALTH_OK 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:05.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:05.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:05.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.022 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:06.022 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.022 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:06.022 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: mon.a calling monitor election 2026-02-20T13:14:06.022 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: mon.c calling monitor election 2026-02-20T13:14:06.022 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: mon.b calling monitor election 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: monmap epoch 3 2026-02-20T13:14:06.023 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: last_changed 2026-02-20T13:14:00.678403+0000 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: created 2026-02-20T13:13:10.714298+0000 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: min_mon_release 20 (tentacle) 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: election_strategy: 1 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: 1: [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] mon.c 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: 2: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.b 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: fsmap 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: mgrmap e12: x(active, since 28s) 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: overall HEALTH_OK 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.024 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.025 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:06.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: mon.a calling monitor election 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: mon.c calling monitor election 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: mon.b calling monitor election 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: monmap epoch 3 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: last_changed 2026-02-20T13:14:00.678403+0000 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: created 2026-02-20T13:13:10.714298+0000 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: min_mon_release 20 (tentacle) 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: election_strategy: 1 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: 1: [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] mon.c 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: 2: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.b 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: fsmap 2026-02-20T13:14:06.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T13:14:06.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: mgrmap e12: x(active, since 28s) 2026-02-20T13:14:06.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: overall HEALTH_OK 2026-02-20T13:14:06.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.900 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:14:06.900 INFO:teuthology.orchestra.run.trial127.stdout:{"epoch":3,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","modified":"2026-02-20T13:14:00.678403Z","created":"2026-02-20T13:13:10.714298Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-20T13:13:10:714324+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:3300","nonce":0},{"type":"v1","addr":"10.20.193.127:6789","nonce":0}]},"addr":"10.20.193.127:6789/0","public_addr":"10.20.193.127:6789/0","priority":0,"weight":0,"time_added":"2026-02-20T13:13:54:483635+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"time_added":"2026-02-20T13:14:00:678401+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-20T13:14:06.900 INFO:teuthology.orchestra.run.trial127.stderr:dumped monmap epoch 3 2026-02-20T13:14:06.935 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-20T13:14:06.935 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-20T13:14:06.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:06.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: Updating trial034:/etc/ceph/ceph.conf 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: Updating trial127:/etc/ceph/ceph.conf 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: Updating trial034:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: Updating trial127:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:06.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: Updating trial028:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:07.000 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.000 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.000 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.000 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:07.000 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:07.000 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:07.000 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.126 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:07.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:07.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: Updating trial034:/etc/ceph/ceph.conf 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: Updating trial127:/etc/ceph/ceph.conf 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: Updating trial034:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: Updating trial127:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:07.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: Updating trial028:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:07.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: Updating trial034:/etc/ceph/ceph.conf 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: Updating trial127:/etc/ceph/ceph.conf 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: Updating trial034:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:07.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: Updating trial127:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: Updating trial028:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/config/ceph.conf 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:07.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.584 INFO:teuthology.orchestra.run.trial028.stdout:# minimal ceph.conf for dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:14:07.584 INFO:teuthology.orchestra.run.trial028.stdout:[global] 2026-02-20T13:14:07.584 INFO:teuthology.orchestra.run.trial028.stdout: fsid = dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:14:07.585 INFO:teuthology.orchestra.run.trial028.stdout: mon_host = [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] 2026-02-20T13:14:07.682 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-20T13:14:07.682 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:14:07.682 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.conf 2026-02-20T13:14:07.740 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:14:07.740 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T13:14:07.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: Reconfiguring mon.a (unknown last config time)... 2026-02-20T13:14:07.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: Reconfiguring daemon mon.a on trial028 2026-02-20T13:14:07.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/2789781795' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-20T13:14:07.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: Reconfiguring mon.b (monmap changed)... 2026-02-20T13:14:07.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: Reconfiguring daemon mon.b on trial034 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: Reconfiguring mon.c (monmap changed)... 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: Reconfiguring daemon mon.c on trial127 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3604883504' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:07.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.836 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:07.836 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.837 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:14:07.837 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/ceph/ceph.conf 2026-02-20T13:14:07.865 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:14:07.865 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T13:14:07.930 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:14:07.930 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/etc/ceph/ceph.conf 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: Reconfiguring mon.a (unknown last config time)... 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: Reconfiguring daemon mon.a on trial028 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/2789781795' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: Reconfiguring mon.b (monmap changed)... 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: Reconfiguring daemon mon.b on trial034 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: Reconfiguring mon.c (monmap changed)... 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: Reconfiguring daemon mon.c on trial127 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3604883504' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.957 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:07.957 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:07.957 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:07.957 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:07.959 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:14:07.959 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T13:14:08.023 INFO:tasks.cephadm:Adding mgr.x on trial028 2026-02-20T13:14:08.024 INFO:tasks.cephadm:Adding mgr.y on trial034 2026-02-20T13:14:08.024 INFO:tasks.cephadm:Adding mgr.z on trial127 2026-02-20T13:14:08.024 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch apply mgr '3;trial028=x;trial034=y;trial127=z' 2026-02-20T13:14:08.179 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: Reconfiguring mon.a (unknown last config time)... 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: Reconfiguring daemon mon.a on trial028 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/2789781795' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: Reconfiguring mon.b (monmap changed)... 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: Reconfiguring daemon mon.b on trial034 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: Reconfiguring mon.c (monmap changed)... 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: Reconfiguring daemon mon.c on trial127 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3604883504' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:08.409 INFO:teuthology.orchestra.run.trial127.stdout:Scheduled mgr update... 2026-02-20T13:14:08.448 DEBUG:teuthology.orchestra.run.trial034:mgr.y> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.y.service 2026-02-20T13:14:08.451 DEBUG:teuthology.orchestra.run.trial127:mgr.z> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.z.service 2026-02-20T13:14:08.453 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-20T13:14:08.454 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-20T13:14:08.458 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-20T13:14:08.458 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-20T13:14:08.503 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-20T13:14:08.503 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-20T13:14:08.548 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-20T13:14:08.548 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-20T13:14:08.594 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-20T13:14:08.594 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-20T13:14:08.639 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-20T13:14:08.639 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-20T13:14:08.647 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:08.650 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-20T13:14:08.650 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-20T13:14:08.687 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:08.690 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-20T13:14:08.690 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-20T13:14:08.736 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-20T13:14:08.736 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-20T13:14:08.737 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:08.785 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-20T13:14:08.785 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-20T13:14:08.820 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:08.826 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-20T13:14:08.826 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-20T13:14:08.881 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-20T13:14:08.881 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-20T13:14:08.884 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:08.889 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-20T13:14:08.889 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-20T13:14:08.931 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:08.942 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-20T13:14:08.942 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-20T13:14:08.943 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.000 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-20T13:14:09.000 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-20T13:14:09.031 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.043 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-20T13:14:09.043 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-20T13:14:09.097 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-20T13:14:09.097 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-20T13:14:09.166 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-20T13:14:09.166 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-20T13:14:09.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 -- 10.20.193.28:0/1133714362 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f561803fa30 msgr2=0x7f561805fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 --2- 10.20.193.28:0/1133714362 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f561803fa30 0x7f561805fee0 secure :-1 s=READY pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5634005e70 tx=0x7f5634005ab0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 -- 10.20.193.28:0/1133714362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f564410cd90 msgr2=0x7f5644107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 --2- 10.20.193.28:0/1133714362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f564410cd90 0x7f5644107180 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56300097e0 tx=0x7f5630002dd0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.227 INFO:journalctl@ceph.mgr.z.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mgr[45146]: -- 10.20.193.127:0/3749597699 <== mon.0 v2:10.20.193.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1b8ba00 con 0x1b5f400 2026-02-20T13:14:09.300 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-20T13:14:09.300 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-20T13:14:09.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 -- 10.20.193.28:0/1133714362 shutdown_connections 2026-02-20T13:14:09.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 --2- 10.20.193.28:0/1133714362 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f561803fa30 0x7f561805fee0 unknown :-1 s=CLOSED pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 --2- 10.20.193.28:0/1133714362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f564410e500 0x7f56441079c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 --2- 10.20.193.28:0/1133714362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f564410d740 0x7f564416f4b0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 --2- 10.20.193.28:0/1133714362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f564410cd90 0x7f5644107180 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 -- 10.20.193.28:0/1133714362 >> 10.20.193.28:0/1133714362 conn(0x7f56440ea770 msgr2=0x7f564405d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 -- 10.20.193.28:0/1133714362 shutdown_connections 2026-02-20T13:14:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.198+0000 7f564a197640 1 -- 10.20.193.28:0/1133714362 wait complete. 2026-02-20T13:14:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.235+0000 7f1a3707e640 1 -- 10.20.193.28:0/2911406032 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f1a3017a650 con 0x7f1a301145d0 2026-02-20T13:14:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.238+0000 7f1a25ffb640 1 -- 10.20.193.28:0/2911406032 <== mon.0 v2:10.20.193.28:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f1a2c0103c0 con 0x7f1a301145d0 2026-02-20T13:14:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.239+0000 7f1a25ffb640 1 -- 10.20.193.28:0/2911406032 <== mon.0 v2:10.20.193.28:3300/0 9 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f1a2c0059f0 con 0x7f1a301145d0 2026-02-20T13:14:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 -- 10.20.193.28:0/2911406032 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a1003f9d0 msgr2=0x7f1a1005fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 --2- 10.20.193.28:0/2911406032 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a1003f9d0 0x7f1a1005fe80 secure :-1 s=READY pgs=45 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a1c009830 tx=0x7f1a1c002390 comp rx=0 tx=0).stop 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 -- 10.20.193.28:0/2911406032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a301145d0 msgr2=0x7f1a30175ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 --2- 10.20.193.28:0/2911406032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a301145d0 0x7f1a30175ea0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a2c0038e0 tx=0x7f1a2c00eaf0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 -- 10.20.193.28:0/2911406032 shutdown_connections 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 --2- 10.20.193.28:0/2911406032 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a1003f9d0 0x7f1a1005fe80 unknown :-1 s=CLOSED pgs=45 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 --2- 10.20.193.28:0/2911406032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1a301559f0 0x7f1a30104530 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 --2- 10.20.193.28:0/2911406032 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1a30134ef0 0x7f1a301552d0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 --2- 10.20.193.28:0/2911406032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a301145d0 0x7f1a30175ea0 unknown :-1 s=CLOSED pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 -- 10.20.193.28:0/2911406032 >> 10.20.193.28:0/2911406032 conn(0x7f1a3005b500 msgr2=0x7f1a3017aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 -- 10.20.193.28:0/2911406032 shutdown_connections 2026-02-20T13:14:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.242+0000 7f1a3707e640 1 -- 10.20.193.28:0/2911406032 wait complete. 2026-02-20T13:14:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 -- 10.20.193.28:0/299219142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81559f0 msgr2=0x7f25a8175ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25a6ffd640 1 -- 10.20.193.28:0/299219142 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f259c0396f0 con 0x7f25a81559f0 2026-02-20T13:14:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 --2- 10.20.193.28:0/299219142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81559f0 0x7f25a8175ea0 secure :-1 s=READY pgs=122 gs=3 cs=0 l=1 c_cookie=14100440839774251059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f259c00a970 tx=0x7f259c0301f0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 -- 10.20.193.28:0/299219142 shutdown_connections 2026-02-20T13:14:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 --2- 10.20.193.28:0/299219142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81559f0 0x7f25a8175ea0 unknown :-1 s=CLOSED pgs=122 gs=3 cs=0 l=1 c_cookie=14100440839774251059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 --2- 10.20.193.28:0/299219142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a8134ef0 0x7f25a81552d0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 --2- 10.20.193.28:0/299219142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a81145d0 0x7f25a81349b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 -- 10.20.193.28:0/299219142 >> 10.20.193.28:0/299219142 conn(0x7f25a805b500 msgr2=0x7f25a805b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 -- 10.20.193.28:0/299219142 shutdown_connections 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.264+0000 7f25ae75f640 1 -- 10.20.193.28:0/299219142 wait complete. 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.265+0000 7f25ae75f640 1 Processor -- start 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.265+0000 7f25ae75f640 1 -- start start 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.266+0000 7f25ae75f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81145d0 0x7f25a8175e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.266+0000 7f25ae75f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 0x7f25a81552d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.266+0000 7f25ae75f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 0x7f25a8108f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.266+0000 7f25a77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 0x7f25a81552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.266+0000 7f25a77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 0x7f25a81552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42064/0 (socket says 10.20.193.28:42064) 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25a77fe640 1 -- 10.20.193.28:0/805225225 learned_addr learned my addr 10.20.193.28:0/805225225 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8109690 con 0x7f25a81145d0 2026-02-20T13:14:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8109800 con 0x7f25a81559f0 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25accd5640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 0x7f25a8108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f25a81099c0 con 0x7f25a8134ef0 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25a77fe640 1 -- 10.20.193.28:0/805225225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 msgr2=0x7f25a81552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25a77fe640 1 -- 10.20.193.28:0/805225225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 msgr2=0x7f25a81552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25a77fe640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 0x7f25a81552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25a77fe640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 0x7f25a81552d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25accd5640 1 -- 10.20.193.28:0/805225225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 msgr2=0x7f25a8108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25accd5640 1 -- 10.20.193.28:0/805225225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 msgr2=0x7f25a8108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25accd5640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 0x7f25a8108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.267+0000 7f25accd5640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 0x7f25a8108f00 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.268+0000 7f25a7fff640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81145d0 0x7f25a8175e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.268+0000 7f25a7fff640 1 -- 10.20.193.28:0/805225225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 msgr2=0x7f25a81552d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:14:09.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.268+0000 7f25a7fff640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 0x7f25a81552d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.268+0000 7f25a7fff640 1 -- 10.20.193.28:0/805225225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 msgr2=0x7f25a8108f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:14:09.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.268+0000 7f25a7fff640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 0x7f25a8108f00 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.268+0000 7f25a7fff640 1 -- 10.20.193.28:0/805225225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259c00a590 con 0x7f25a81145d0 2026-02-20T13:14:09.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.269+0000 7f25a7fff640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81145d0 0x7f25a8175e20 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2594004740 tx=0x7f259400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.287+0000 7fe55308c640 1 -- 10.20.193.28:0/2482612237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c060710 msgr2=0x7fe54c10b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.287+0000 7fe55308c640 1 --2- 10.20.193.28:0/2482612237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c060710 0x7fe54c10b610 secure :-1 s=READY pgs=124 gs=3 cs=0 l=1 c_cookie=12341014456935448801 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe53c009890 tx=0x7fe53c02f0e0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.288+0000 7fe55308c640 1 -- 10.20.193.28:0/2482612237 shutdown_connections 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.288+0000 7fe55308c640 1 --2- 10.20.193.28:0/2482612237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10c500 0x7fe54c10c950 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.288+0000 7fe55308c640 1 --2- 10.20.193.28:0/2482612237 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c10bb50 0x7fe54c10bfc0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.288+0000 7fe55308c640 1 --2- 10.20.193.28:0/2482612237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c060710 0x7fe54c10b610 unknown :-1 s=CLOSED pgs=124 gs=3 cs=0 l=1 c_cookie=12341014456935448801 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.288+0000 7fe55308c640 1 -- 10.20.193.28:0/2482612237 >> 10.20.193.28:0/2482612237 conn(0x7fe54c0e91d0 msgr2=0x7fe54c109600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.289+0000 7fe55308c640 1 -- 10.20.193.28:0/2482612237 shutdown_connections 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.289+0000 7fe55308c640 1 -- 10.20.193.28:0/2482612237 wait complete. 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.289+0000 7fe55308c640 1 Processor -- start 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.290+0000 7fe55308c640 1 -- start start 2026-02-20T13:14:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.290+0000 7fe55308c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 0x7fe54c058e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe55308c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 0x7fe54c0594d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe55308c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c10c500 0x7fe54c05a0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe550e01640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 0x7fe54c058e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe551602640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c10c500 0x7fe54c05a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe551602640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c10c500 0x7fe54c05a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48970/0 (socket says 10.20.193.28:48970) 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe551602640 1 -- 10.20.193.28:0/2435315254 learned_addr learned my addr 10.20.193.28:0/2435315254 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe55308c640 1 -- 10.20.193.28:0/2435315254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c05a810 con 0x7fe54c10c500 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe55308c640 1 -- 10.20.193.28:0/2435315254 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c05a980 con 0x7fe54c10bb50 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe55308c640 1 -- 10.20.193.28:0/2435315254 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c05ab40 con 0x7fe54c060710 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.291+0000 7fe543fff640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 0x7fe54c0594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe550e01640 1 -- 10.20.193.28:0/2435315254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 msgr2=0x7fe54c058e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-20T13:14:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe550e01640 1 -- 10.20.193.28:0/2435315254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 msgr2=0x7fe54c058e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe550e01640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 0x7fe54c058e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe551602640 1 -- 10.20.193.28:0/2435315254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 msgr2=0x7fe54c058e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe543fff640 1 -- 10.20.193.28:0/2435315254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 msgr2=0x7fe54c0594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe543fff640 1 -- 10.20.193.28:0/2435315254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 msgr2=0x7fe54c0594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe543fff640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 0x7fe54c0594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe543fff640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 0x7fe54c0594d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe550e01640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 0x7fe54c058e80 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe551602640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 0x7fe54c058e80 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe551602640 1 -- 10.20.193.28:0/2435315254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 msgr2=0x7fe54c0594d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe551602640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 0x7fe54c0594d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe551602640 1 -- 10.20.193.28:0/2435315254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53c0094b0 con 0x7fe54c10c500 2026-02-20T13:14:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.292+0000 7fe551602640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c10c500 0x7fe54c05a0d0 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe548006a50 tx=0x7fe54800ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.293+0000 7fe541ffb640 1 -- 10.20.193.28:0/2435315254 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe548005b50 con 0x7fe54c10c500 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.293+0000 7fe541ffb640 1 -- 10.20.193.28:0/2435315254 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7fe548005cb0 con 0x7fe54c10c500 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.293+0000 7fe541ffb640 1 -- 10.20.193.28:0/2435315254 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe548005b50 con 0x7fe54c10c500 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.293+0000 7fe55308c640 1 -- 10.20.193.28:0/2435315254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c05ae20 con 0x7fe54c10c500 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.294+0000 7fe55308c640 1 -- 10.20.193.28:0/2435315254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c170790 con 0x7fe54c10c500 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.295+0000 7fe51b7fe640 1 -- 10.20.193.28:0/2435315254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50c005300 con 0x7fe54c10c500 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.295+0000 7fe541ffb640 1 -- 10.20.193.28:0/2435315254 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fe548020060 con 0x7fe54c10c500 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.295+0000 7fe541ffb640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe52803fa30 0x7fe52805fee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.312 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.296+0000 7fe550e01640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe52803fa30 0x7fe52805fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.296+0000 7fe550e01640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe52803fa30 0x7fe52805fee0 secure :-1 s=READY pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe53c0097e0 tx=0x7fe53c002390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.297+0000 7fe541ffb640 1 -- 10.20.193.28:0/2435315254 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe548005e20 con 0x7fe54c10c500 2026-02-20T13:14:09.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.298+0000 7fe541ffb640 1 -- 10.20.193.28:0/2435315254 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe548019400 con 0x7fe54c10c500 2026-02-20T13:14:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.315+0000 7f25a57fa640 1 -- 10.20.193.28:0/805225225 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25940043a0 con 0x7f25a81145d0 2026-02-20T13:14:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.315+0000 7f25a57fa640 1 -- 10.20.193.28:0/805225225 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f2594004500 con 0x7f25a81145d0 2026-02-20T13:14:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.315+0000 7f25a57fa640 1 -- 10.20.193.28:0/805225225 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2594016440 con 0x7f25a81145d0 2026-02-20T13:14:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.316+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a8109c40 con 0x7f25a81145d0 2026-02-20T13:14:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.316+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a810a0c0 con 0x7f25a81145d0 2026-02-20T13:14:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.317+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2574005300 con 0x7f25a81145d0 2026-02-20T13:14:09.340 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-20T13:14:09.341 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-20T13:14:09.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.317+0000 7f25a57fa640 1 -- 10.20.193.28:0/805225225 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f259400a070 con 0x7f25a81145d0 2026-02-20T13:14:09.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.318+0000 7f25a57fa640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f257003fa20 0x7f257005fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.318+0000 7f25a57fa640 1 -- 10.20.193.28:0/805225225 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2594053d30 con 0x7f25a81145d0 2026-02-20T13:14:09.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.321+0000 7f25a57fa640 1 -- 10.20.193.28:0/805225225 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f25940026a0 con 0x7f25a81145d0 2026-02-20T13:14:09.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.321+0000 7f25a77fe640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f257003fa20 0x7f257005fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.322+0000 7f25a77fe640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f257003fa20 0x7f257005fed0 secure :-1 s=READY pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25a8180bc0 tx=0x7f2598004400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.342 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.343 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.383 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-20T13:14:09.383 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-20T13:14:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.421+0000 7fe51b7fe640 1 -- 10.20.193.28:0/2435315254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fe50c005b30 con 0x7fe54c10c500 2026-02-20T13:14:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.425+0000 7fe541ffb640 1 -- 10.20.193.28:0/2435315254 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7fe54800f350 con 0x7fe54c10c500 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 -- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe52803fa30 msgr2=0x7fe52805fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe52803fa30 0x7fe52805fee0 secure :-1 s=READY pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe53c0097e0 tx=0x7fe53c002390 comp rx=0 tx=0).stop 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 -- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c10c500 msgr2=0x7fe54c05a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c10c500 0x7fe54c05a0d0 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe548006a50 tx=0x7fe54800ea30 comp rx=0 tx=0).stop 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 -- 10.20.193.28:0/2435315254 shutdown_connections 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe52803fa30 0x7fe52805fee0 unknown :-1 s=CLOSED pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe54c10c500 0x7fe54c05a0d0 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe54c10bb50 0x7fe54c0594d0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 --2- 10.20.193.28:0/2435315254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe54c060710 0x7fe54c058e80 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.428+0000 7fe51b7fe640 1 -- 10.20.193.28:0/2435315254 >> 10.20.193.28:0/2435315254 conn(0x7fe54c0e91d0 msgr2=0x7fe54c174b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.429+0000 7fe51b7fe640 1 -- 10.20.193.28:0/2435315254 shutdown_connections 2026-02-20T13:14:09.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.429+0000 7fe51b7fe640 1 -- 10.20.193.28:0/2435315254 wait complete. 2026-02-20T13:14:09.438 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.441 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-20T13:14:09.441 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-20T13:14:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.452+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f25740055b0 con 0x7f25a81145d0 2026-02-20T13:14:09.474 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-20T13:14:09.475 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-20T13:14:09.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.455+0000 7f25a57fa640 1 -- 10.20.193.28:0/805225225 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f2594014340 con 0x7f25a81145d0 2026-02-20T13:14:09.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.456+0000 7f25a57fa640 1 -- 10.20.193.28:0/805225225 <== mon.0 v2:10.20.193.28:3300/0 8 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2594053630 con 0x7f25a81145d0 2026-02-20T13:14:09.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f257003fa20 msgr2=0x7f257005fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f257003fa20 0x7f257005fed0 secure :-1 s=READY pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25a8180bc0 tx=0x7f2598004400 comp rx=0 tx=0).stop 2026-02-20T13:14:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.473+0000 7f35048f5640 1 -- 10.20.193.28:0/2155083025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 msgr2=0x7f35001345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.473+0000 7f35048f5640 1 --2- 10.20.193.28:0/2155083025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 0x7f35001345e0 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=5103027239365002810 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34ec009950 tx=0x7f34ec02f260 comp rx=0 tx=0).stop 2026-02-20T13:14:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.474+0000 7f35048f5640 1 -- 10.20.193.28:0/2155083025 shutdown_connections 2026-02-20T13:14:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.474+0000 7f35048f5640 1 --2- 10.20.193.28:0/2155083025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3500134b70 0x7f3500154ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.474+0000 7f35048f5640 1 --2- 10.20.193.28:0/2155083025 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3500155730 0x7f3500175be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.474+0000 7f35048f5640 1 --2- 10.20.193.28:0/2155083025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 0x7f35001345e0 unknown :-1 s=CLOSED pgs=5 gs=1 cs=0 l=1 c_cookie=5103027239365002810 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.474+0000 7f35048f5640 1 -- 10.20.193.28:0/2155083025 >> 10.20.193.28:0/2155083025 conn(0x7f350005b340 msgr2=0x7f350005b760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.474+0000 7f35048f5640 1 -- 10.20.193.28:0/2155083025 shutdown_connections 2026-02-20T13:14:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.474+0000 7f35048f5640 1 -- 10.20.193.28:0/2155083025 wait complete. 2026-02-20T13:14:09.481 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-20T13:14:09.481 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-20T13:14:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81145d0 msgr2=0x7f25a8175e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81145d0 0x7f25a8175e20 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2594004740 tx=0x7f259400dda0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 shutdown_connections 2026-02-20T13:14:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f257003fa20 0x7f257005fed0 unknown :-1 s=CLOSED pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f25a81559f0 0x7f25a8108f00 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f25a8134ef0 0x7f25a81552d0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 --2- 10.20.193.28:0/805225225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25a81145d0 0x7f25a8175e20 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.466+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 >> 10.20.193.28:0/805225225 conn(0x7f25a805b500 msgr2=0x7f25a80f6900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.467+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 shutdown_connections 2026-02-20T13:14:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.467+0000 7f25ae75f640 1 -- 10.20.193.28:0/805225225 wait complete. 2026-02-20T13:14:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.475+0000 7f35048f5640 1 Processor -- start 2026-02-20T13:14:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.475+0000 7f35048f5640 1 -- start start 2026-02-20T13:14:09.484 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.490 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-20T13:14:09.490 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-20T13:14:09.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f35048f5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 0x7f3500175be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f35048f5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3500134b70 0x7f3500154fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f35048f5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3500155730 0x7f35001040d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34feffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3500134b70 0x7f3500154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34feffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3500134b70 0x7f3500154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42100/0 (socket says 10.20.193.28:42100) 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f35048f5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3500104860 con 0x7f3500155730 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f35048f5640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f35001049d0 con 0x7f350005e750 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f35048f5640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3500105050 con 0x7f3500134b70 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34ff7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 0x7f3500175be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34ff7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 0x7f3500175be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55768/0 (socket says 10.20.193.28:55768) 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34ff7fe640 1 -- 10.20.193.28:0/915917662 learned_addr learned my addr 10.20.193.28:0/915917662 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34fffff640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3500155730 0x7f35001040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34fffff640 1 -- 10.20.193.28:0/915917662 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3500134b70 msgr2=0x7f3500154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34fffff640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3500134b70 0x7f3500154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34fffff640 1 -- 10.20.193.28:0/915917662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 msgr2=0x7f3500175be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34fffff640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 0x7f3500175be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.476+0000 7f34fffff640 1 -- 10.20.193.28:0/915917662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec009570 con 0x7f3500155730 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.477+0000 7f34feffd640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3500134b70 0x7f3500154fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.477+0000 7f34ff7fe640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 0x7f3500175be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.477+0000 7f34fffff640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3500155730 0x7f35001040d0 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34f400f940 tx=0x7f34f400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.478+0000 7f34fcff9640 1 -- 10.20.193.28:0/915917662 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34f400dda0 con 0x7f3500155730 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.478+0000 7f34fcff9640 1 -- 10.20.193.28:0/915917662 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f34f4005e10 con 0x7f3500155730 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.478+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35001052d0 con 0x7f3500155730 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.478+0000 7f34fcff9640 1 -- 10.20.193.28:0/915917662 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34f40116b0 con 0x7f3500155730 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.479+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35001057a0 con 0x7f3500155730 2026-02-20T13:14:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.480+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3500179b10 con 0x7f3500155730 2026-02-20T13:14:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.481+0000 7f34fcff9640 1 -- 10.20.193.28:0/915917662 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f34f4020060 con 0x7f3500155730 2026-02-20T13:14:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.481+0000 7f34fcff9640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f34d403fa20 0x7f34d405fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.482+0000 7f34fcff9640 1 -- 10.20.193.28:0/915917662 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f34f4015070 con 0x7f3500155730 2026-02-20T13:14:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.482+0000 7f34ff7fe640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f34d403fa20 0x7f34d405fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.483+0000 7f34ff7fe640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f34d403fa20 0x7f34d405fed0 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34ec005b30 tx=0x7f34ec03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.485+0000 7f34fcff9640 1 -- 10.20.193.28:0/915917662 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f34f4005460 con 0x7f3500155730 2026-02-20T13:14:09.555 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-20T13:14:09.555 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-20T13:14:09.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial034=y;trial127=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:09.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: Saving service mgr spec with placement trial028=x;trial034=y;trial127=z;count:3 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: Deploying daemon mgr.z on trial127 2026-02-20T13:14:09.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/310722574' entity='client.admin' 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3477072087' entity='client.admin' 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1133714362' entity='client.admin' 2026-02-20T13:14:09.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:09 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2911406032' entity='client.admin' 2026-02-20T13:14:09.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.538+0000 7fed9a6e6640 1 -- 10.20.193.28:0/209932870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed9410cb80 msgr2=0x7fed9410d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.538+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/209932870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed9410cb80 0x7fed9410d020 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=3602525450020373264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed84009950 tx=0x7fed8402f1d0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.538+0000 7fed9a6e6640 1 -- 10.20.193.28:0/209932870 shutdown_connections 2026-02-20T13:14:09.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.539+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/209932870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed9410cb80 0x7fed9410d020 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=3602525450020373264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.539+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/209932870 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed94061590 0x7fed94061a00 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.539+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/209932870 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed94062ac0 0x7fed94061050 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.539+0000 7fed9a6e6640 1 -- 10.20.193.28:0/209932870 >> 10.20.193.28:0/209932870 conn(0x7fed940ea770 msgr2=0x7fed9410ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.539+0000 7fed9a6e6640 1 -- 10.20.193.28:0/209932870 shutdown_connections 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.539+0000 7fed9a6e6640 1 -- 10.20.193.28:0/209932870 wait complete. 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.539+0000 7fed9a6e6640 1 Processor -- start 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.539+0000 7fed9a6e6640 1 -- start start 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.540+0000 7fed9a6e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed94061590 0x7fed940fed60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.540+0000 7fed9a6e6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed94062ac0 0x7fed940ff3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.540+0000 7fed9a6e6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed9410cb80 0x7fed940fffb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.540+0000 7fed9a6e6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed94100680 con 0x7fed94061590 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed9a6e6640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fed941007f0 con 0x7fed94062ac0 2026-02-20T13:14:09.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed9a6e6640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fed941009b0 con 0x7fed9410cb80 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed93fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed94061590 0x7fed940fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed93fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed94061590 0x7fed940fed60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48996/0 (socket says 10.20.193.28:48996) 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed93fff640 1 -- 10.20.193.28:0/852557285 learned_addr learned my addr 10.20.193.28:0/852557285 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed93fff640 1 -- 10.20.193.28:0/852557285 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed9410cb80 msgr2=0x7fed940fffb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed93fff640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed9410cb80 0x7fed940fffb0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed93fff640 1 -- 10.20.193.28:0/852557285 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed94062ac0 msgr2=0x7fed940ff3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed93fff640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed94062ac0 0x7fed940ff3b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.541+0000 7fed93fff640 1 -- 10.20.193.28:0/852557285 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed84009570 con 0x7fed94061590 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.543+0000 7fed93fff640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed94061590 0x7fed940fed60 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed8800c750 tx=0x7fed8800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.543+0000 7fed917fa640 1 -- 10.20.193.28:0/852557285 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed88005500 con 0x7fed94061590 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.543+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed94100c90 con 0x7fed94061590 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.544+0000 7fed917fa640 1 -- 10.20.193.28:0/852557285 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fed88005660 con 0x7fed94061590 2026-02-20T13:14:09.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.544+0000 7fed917fa640 1 -- 10.20.193.28:0/852557285 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed88005500 con 0x7fed94061590 2026-02-20T13:14:09.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.544+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed941011c0 con 0x7fed94061590 2026-02-20T13:14:09.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.545+0000 7fed917fa640 1 -- 10.20.193.28:0/852557285 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fed8800dbd0 con 0x7fed94061590 2026-02-20T13:14:09.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.546+0000 7fed917fa640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed6803fa30 0x7fed6805fee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.546+0000 7fed917fa640 1 -- 10.20.193.28:0/852557285 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fed880038a0 con 0x7fed94061590 2026-02-20T13:14:09.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.546+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed58005300 con 0x7fed94061590 2026-02-20T13:14:09.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.546+0000 7fed937fe640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed6803fa30 0x7fed6805fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.547+0000 7fed937fe640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed6803fa30 0x7fed6805fee0 secure :-1 s=READY pgs=49 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed80004760 tx=0x7fed80006c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.548+0000 7fed917fa640 1 -- 10.20.193.28:0/852557285 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fed88014370 con 0x7fed94061590 2026-02-20T13:14:09.603 DEBUG:tasks.cephadm:set 26 configs 2026-02-20T13:14:09.603 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial028') 2026-02-20T13:14:09.603 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial028') 2026-02-20T13:14:09.603 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial028') 2026-02-20T13:14:09.604 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-20T13:14:09.619 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial034=y;trial127=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:09.619 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: Saving service mgr spec with placement trial028=x;trial034=y;trial127=z;count:3 2026-02-20T13:14:09.619 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.620 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: Deploying daemon mgr.z on trial127 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/310722574' entity='client.admin' 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3477072087' entity='client.admin' 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.621 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1133714362' entity='client.admin' 2026-02-20T13:14:09.622 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2911406032' entity='client.admin' 2026-02-20T13:14:09.623 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-20T13:14:09.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.632+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f3500179400 con 0x7f3500155730 2026-02-20T13:14:09.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 -- 10.20.193.28:0/1790926359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79881145d0 msgr2=0x7f79881349b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 --2- 10.20.193.28:0/1790926359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79881145d0 0x7f79881349b0 secure :-1 s=READY pgs=6 gs=2 cs=0 l=1 c_cookie=8304742423122737615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f797c009950 tx=0x7f797c02f190 comp rx=0 tx=0).stop 2026-02-20T13:14:09.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 -- 10.20.193.28:0/1790926359 shutdown_connections 2026-02-20T13:14:09.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 --2- 10.20.193.28:0/1790926359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f79881559f0 0x7f7988175ea0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 --2- 10.20.193.28:0/1790926359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7988134ef0 0x7f79881552d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 --2- 10.20.193.28:0/1790926359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79881145d0 0x7f79881349b0 unknown :-1 s=CLOSED pgs=6 gs=2 cs=0 l=1 c_cookie=8304742423122737615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 -- 10.20.193.28:0/1790926359 >> 10.20.193.28:0/1790926359 conn(0x7f798805b500 msgr2=0x7f798805b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 -- 10.20.193.28:0/1790926359 shutdown_connections 2026-02-20T13:14:09.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.655+0000 7f798d9d4640 1 -- 10.20.193.28:0/1790926359 wait complete. 2026-02-20T13:14:09.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.657+0000 7f798d9d4640 1 Processor -- start 2026-02-20T13:14:09.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.657+0000 7f798d9d4640 1 -- start start 2026-02-20T13:14:09.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f798d9d4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f79881145d0 0x7f7988175ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f798d9d4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7988134ef0 0x7f79881552d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f798d9d4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79881559f0 0x7f798811e1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f798d9d4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f798811e960 con 0x7f7988134ef0 2026-02-20T13:14:09.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f798d9d4640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f798811ead0 con 0x7f79881145d0 2026-02-20T13:14:09.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f798d9d4640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f798811f1c0 con 0x7f79881559f0 2026-02-20T13:14:09.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f7986ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f79881145d0 0x7f7988175ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f7986ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f79881145d0 0x7f7988175ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55802/0 (socket says 10.20.193.28:55802) 2026-02-20T13:14:09.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f7986ffd640 1 -- 10.20.193.28:0/2069571923 learned_addr learned my addr 10.20.193.28:0/2069571923 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.658+0000 7f79877fe640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79881559f0 0x7f798811e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f7986ffd640 1 -- 10.20.193.28:0/2069571923 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79881559f0 msgr2=0x7f798811e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f7986ffd640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79881559f0 0x7f798811e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f7986ffd640 1 -- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7988134ef0 msgr2=0x7f79881552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f79867fc640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7988134ef0 0x7f79881552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f7986ffd640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7988134ef0 0x7f79881552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f7986ffd640 1 -- 10.20.193.28:0/2069571923 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c009570 con 0x7f79881145d0 2026-02-20T13:14:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f79867fc640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7988134ef0 0x7f79881552d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:14:09.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f7986ffd640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f79881145d0 0x7f7988175ea0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f797c0023d0 tx=0x7f797c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.659+0000 7f34fcff9640 1 -- 10.20.193.28:0/915917662 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v16)=0 v16) ==== 117+0+0 (secure 0 0 0) 0x7f34f4026070 con 0x7f3500155730 2026-02-20T13:14:09.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.663+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f34d403fa20 msgr2=0x7f34d405fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.663+0000 7f35048f5640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f34d403fa20 0x7f34d405fed0 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34ec005b30 tx=0x7f34ec03a040 comp rx=0 tx=0).stop 2026-02-20T13:14:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.663+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3500155730 msgr2=0x7f35001040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.663+0000 7f35048f5640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3500155730 0x7f35001040d0 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34f400f940 tx=0x7f34f400fe10 comp rx=0 tx=0).stop 2026-02-20T13:14:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.664+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 shutdown_connections 2026-02-20T13:14:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.664+0000 7f35048f5640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f34d403fa20 0x7f34d405fed0 unknown :-1 s=CLOSED pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.664+0000 7f35048f5640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3500155730 0x7f35001040d0 unknown :-1 s=CLOSED pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.664+0000 7f35048f5640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3500134b70 0x7f3500154fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.664+0000 7f35048f5640 1 --2- 10.20.193.28:0/915917662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f350005e750 0x7f3500175be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.664+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 >> 10.20.193.28:0/915917662 conn(0x7f350005b340 msgr2=0x7f3500179d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.664+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 shutdown_connections 2026-02-20T13:14:09.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.664+0000 7f35048f5640 1 -- 10.20.193.28:0/915917662 wait complete. 2026-02-20T13:14:09.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.660+0000 7f798c9d2640 1 -- 10.20.193.28:0/2069571923 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f797c03d070 con 0x7f79881145d0 2026-02-20T13:14:09.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.660+0000 7f798c9d2640 1 -- 10.20.193.28:0/2069571923 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f797c038e00 con 0x7f79881145d0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.660+0000 7f798c9d2640 1 -- 10.20.193.28:0/2069571923 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f797c041be0 con 0x7f79881145d0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.660+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798811f440 con 0x7f79881145d0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.660+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798811f860 con 0x7f79881145d0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.662+0000 7f798c9d2640 1 -- 10.20.193.28:0/2069571923 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f797c048020 con 0x7f79881145d0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.662+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7988055d30 con 0x7f79881145d0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.662+0000 7f798c9d2640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f796403fa20 0x7f796405fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.662+0000 7f798c9d2640 1 -- 10.20.193.28:0/2069571923 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f797c078940 con 0x7f79881145d0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.666+0000 7f798c9d2640 1 -- 10.20.193.28:0/2069571923 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f797c04a430 con 0x7f79881145d0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.666+0000 7f79867fc640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f796403fa20 0x7f796405fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.666+0000 7f79867fc640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f796403fa20 0x7f796405fed0 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f798805ebd0 tx=0x7f797000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.678+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fed58005b30 con 0x7fed94061590 2026-02-20T13:14:09.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.684+0000 7fed917fa640 1 -- 10.20.193.28:0/852557285 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7fed88013320 con 0x7fed94061590 2026-02-20T13:14:09.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed6803fa30 msgr2=0x7fed6805fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed6803fa30 0x7fed6805fee0 secure :-1 s=READY pgs=49 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed80004760 tx=0x7fed80006c80 comp rx=0 tx=0).stop 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed94061590 msgr2=0x7fed940fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed94061590 0x7fed940fed60 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed8800c750 tx=0x7fed8800cc20 comp rx=0 tx=0).stop 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 shutdown_connections 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed6803fa30 0x7fed6805fee0 unknown :-1 s=CLOSED pgs=49 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed9410cb80 0x7fed940fffb0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed94062ac0 0x7fed940ff3b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 --2- 10.20.193.28:0/852557285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed94061590 0x7fed940fed60 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.688+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 >> 10.20.193.28:0/852557285 conn(0x7fed940ea770 msgr2=0x7fed940561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.689+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 shutdown_connections 2026-02-20T13:14:09.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.689+0000 7fed9a6e6640 1 -- 10.20.193.28:0/852557285 wait complete. 2026-02-20T13:14:09.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial034=y;trial127=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:09.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: Saving service mgr spec with placement trial028=x;trial034=y;trial127=z;count:3 2026-02-20T13:14:09.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:09.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: Deploying daemon mgr.z on trial127 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/310722574' entity='client.admin' 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3477072087' entity='client.admin' 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:09.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:09.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T13:14:09.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:09.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:09.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1133714362' entity='client.admin' 2026-02-20T13:14:09.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:09 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2911406032' entity='client.admin' 2026-02-20T13:14:09.768 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial028') 2026-02-20T13:14:09.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.790+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f7988179500 con 0x7f79881145d0 2026-02-20T13:14:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.793+0000 7f798c9d2640 1 -- 10.20.193.28:0/2069571923 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f797c036370 con 0x7f79881145d0 2026-02-20T13:14:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.795+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f796403fa20 msgr2=0x7f796405fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.795+0000 7f798d9d4640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f796403fa20 0x7f796405fed0 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f798805ebd0 tx=0x7f797000d040 comp rx=0 tx=0).stop 2026-02-20T13:14:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.795+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f79881145d0 msgr2=0x7f7988175ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.795+0000 7f798d9d4640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f79881145d0 0x7f7988175ea0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f797c0023d0 tx=0x7f797c0028d0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.796+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 shutdown_connections 2026-02-20T13:14:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.796+0000 7f798d9d4640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f796403fa20 0x7f796405fed0 unknown :-1 s=CLOSED pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.796+0000 7f798d9d4640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7988134ef0 0x7f79881552d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.796+0000 7f798d9d4640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79881559f0 0x7f798811e1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.796+0000 7f798d9d4640 1 --2- 10.20.193.28:0/2069571923 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f79881145d0 0x7f7988175ea0 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.796+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 >> 10.20.193.28:0/2069571923 conn(0x7f798805b500 msgr2=0x7f798817b940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.796+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 shutdown_connections 2026-02-20T13:14:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.796+0000 7f798d9d4640 1 -- 10.20.193.28:0/2069571923 wait complete. 2026-02-20T13:14:09.808 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.881 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial028') 2026-02-20T13:14:09.897 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.906 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.916 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:09.952 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial028') 2026-02-20T13:14:09.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.953+0000 7fc428fb2640 1 -- 10.20.193.28:0/2844879117 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5cc0 msgr2=0x7fc41c126650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.953+0000 7fc428fb2640 1 --2- 10.20.193.28:0/2844879117 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5cc0 0x7fc41c126650 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=16722503506535384661 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc41800aa30 tx=0x7fc418030280 comp rx=0 tx=0).stop 2026-02-20T13:14:09.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.953+0000 7fc428fb2640 1 -- 10.20.193.28:0/2844879117 shutdown_connections 2026-02-20T13:14:09.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.953+0000 7fc428fb2640 1 --2- 10.20.193.28:0/2844879117 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5cc0 0x7fc41c126650 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=16722503506535384661 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.953+0000 7fc428fb2640 1 --2- 10.20.193.28:0/2844879117 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc41c0c5310 0x7fc41c0c5780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.954+0000 7fc428fb2640 1 --2- 10.20.193.28:0/2844879117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc41c0c4180 0x7fc41c0c4570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.954+0000 7fc428fb2640 1 -- 10.20.193.28:0/2844879117 >> 10.20.193.28:0/2844879117 conn(0x7fc41c0a1470 msgr2=0x7fc41c0c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:09.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.954+0000 7fc428fb2640 1 -- 10.20.193.28:0/2844879117 shutdown_connections 2026-02-20T13:14:09.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.954+0000 7fc428fb2640 1 -- 10.20.193.28:0/2844879117 wait complete. 2026-02-20T13:14:09.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.955+0000 7fc428fb2640 1 Processor -- start 2026-02-20T13:14:09.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.955+0000 7fc428fb2640 1 -- start start 2026-02-20T13:14:09.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc428fb2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc41c0c4180 0x7fc41c0cd580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc428fb2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5310 0x7fc41c0cdbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc428fb2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc41c0c5cc0 0x7fc41c0ce7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc428fb2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0cef10 con 0x7fc41c0c4180 2026-02-20T13:14:09.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc428fb2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0cf080 con 0x7fc41c0c5310 2026-02-20T13:14:09.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc428fb2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0cf240 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc423fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc41c0c5cc0 0x7fc41c0ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc422ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5310 0x7fc41c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc422ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5310 0x7fc41c0cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55818/0 (socket says 10.20.193.28:55818) 2026-02-20T13:14:09.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc422ffd640 1 -- 10.20.193.28:0/3210591324 learned_addr learned my addr 10.20.193.28:0/3210591324 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:09.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.956+0000 7fc423fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc41c0c5cc0 0x7fc41c0ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42126/0 (socket says 10.20.193.28:42126) 2026-02-20T13:14:09.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.957+0000 7fc423fff640 1 -- 10.20.193.28:0/3210591324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5310 msgr2=0x7fc41c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.957+0000 7fc423fff640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5310 0x7fc41c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.957+0000 7fc423fff640 1 -- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc41c0c4180 msgr2=0x7fc41c0cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:09.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.957+0000 7fc423fff640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc41c0c4180 0x7fc41c0cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:09.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.957+0000 7fc423fff640 1 -- 10.20.193.28:0/3210591324 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41800a650 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.957+0000 7fc422ffd640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5310 0x7fc41c0cdbd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:14:09.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.957+0000 7fc423fff640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc41c0c5cc0 0x7fc41c0ce7d0 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc418039820 tx=0x7fc4180039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.958+0000 7fc420ff9640 1 -- 10.20.193.28:0/3210591324 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc41803e070 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.958+0000 7fc420ff9640 1 -- 10.20.193.28:0/3210591324 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc418003ae0 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.958+0000 7fc420ff9640 1 -- 10.20.193.28:0/3210591324 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc418042ba0 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.958+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41c0cf4c0 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.958+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41c10fa80 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.959+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41c12a2d0 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.960+0000 7fc420ff9640 1 -- 10.20.193.28:0/3210591324 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fc4180050c0 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.960+0000 7fc420ff9640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3f803fa20 0x7fc3f805fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:09.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.960+0000 7fc420ff9640 1 -- 10.20.193.28:0/3210591324 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc418079bf0 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.960+0000 7fc4237fe640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3f803fa20 0x7fc3f805fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:09.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.961+0000 7fc4237fe640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3f803fa20 0x7fc3f805fed0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc410004740 tx=0x7fc410006d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:09.963+0000 7fc420ff9640 1 -- 10.20.193.28:0/3210591324 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fc41804b780 con 0x7fc41c0c5cc0 2026-02-20T13:14:09.990 INFO:journalctl@ceph.mgr.y.trial034.stdout:Feb 20 13:14:09 trial034 ceph-mgr[44436]: -- 10.20.193.34:0/850110341 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x2dbfa00 con 0x2d93800 2026-02-20T13:14:09.995 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.029 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial028') 2026-02-20T13:14:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.078+0000 7f85cebdb640 1 -- 10.20.193.28:0/3977614389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c805e750 msgr2=0x7f85c81345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.078+0000 7f85cebdb640 1 --2- 10.20.193.28:0/3977614389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c805e750 0x7f85c81345e0 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=4523157762545118663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85c0008520 tx=0x7f85c0030f50 comp rx=0 tx=0).stop 2026-02-20T13:14:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.079+0000 7f85cebdb640 1 -- 10.20.193.28:0/3977614389 shutdown_connections 2026-02-20T13:14:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.079+0000 7f85cebdb640 1 --2- 10.20.193.28:0/3977614389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85c8155730 0x7f85c8175be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.079+0000 7f85cebdb640 1 --2- 10.20.193.28:0/3977614389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85c8134b70 0x7f85c8154ff0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.079+0000 7f85cebdb640 1 --2- 10.20.193.28:0/3977614389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c805e750 0x7f85c81345e0 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=4523157762545118663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.079+0000 7f85cebdb640 1 -- 10.20.193.28:0/3977614389 >> 10.20.193.28:0/3977614389 conn(0x7f85c805b340 msgr2=0x7f85c805b760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.079+0000 7f85cebdb640 1 -- 10.20.193.28:0/3977614389 shutdown_connections 2026-02-20T13:14:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.079+0000 7f85cebdb640 1 -- 10.20.193.28:0/3977614389 wait complete. 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.080+0000 7f85cebdb640 1 Processor -- start 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.080+0000 7f85cebdb640 1 -- start start 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cebdb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85c805e750 0x7f85c8185fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cebdb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c8134b70 0x7f85c81345e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cebdb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85c8155730 0x7f85c8186840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cebdb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8146840 con 0x7f85c8134b70 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cebdb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f85c81469b0 con 0x7f85c8155730 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cebdb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8146b70 con 0x7f85c805e750 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cd3d8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c8134b70 0x7f85c81345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cd3d8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c8134b70 0x7f85c81345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35764/0 (socket says 10.20.193.28:35764) 2026-02-20T13:14:10.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cd3d8640 1 -- 10.20.193.28:0/4081682155 learned_addr learned my addr 10.20.193.28:0/4081682155 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85cdbd9640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85c805e750 0x7f85c8185fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.081+0000 7f85ce3da640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85c8155730 0x7f85c8186840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85cd3d8640 1 -- 10.20.193.28:0/4081682155 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85c805e750 msgr2=0x7f85c8185fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85cd3d8640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85c805e750 0x7f85c8185fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85cd3d8640 1 -- 10.20.193.28:0/4081682155 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85c8155730 msgr2=0x7f85c8186840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85cd3d8640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85c8155730 0x7f85c8186840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85cd3d8640 1 -- 10.20.193.28:0/4081682155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c00081c0 con 0x7f85c8134b70 2026-02-20T13:14:10.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85cd3d8640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c8134b70 0x7f85c81345e0 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85b800b520 tx=0x7f85b800b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85b6ffd640 1 -- 10.20.193.28:0/4081682155 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85b80044a0 con 0x7f85c8134b70 2026-02-20T13:14:10.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85b6ffd640 1 -- 10.20.193.28:0/4081682155 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f85b8002c20 con 0x7f85c8134b70 2026-02-20T13:14:10.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85b6ffd640 1 -- 10.20.193.28:0/4081682155 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85b800fdb0 con 0x7f85c8134b70 2026-02-20T13:14:10.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.082+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c8146e50 con 0x7f85c8134b70 2026-02-20T13:14:10.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.083+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c8147350 con 0x7f85c8134b70 2026-02-20T13:14:10.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.083+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c8179650 con 0x7f85c8134b70 2026-02-20T13:14:10.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.084+0000 7f85b6ffd640 1 -- 10.20.193.28:0/4081682155 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f85b8002740 con 0x7f85c8134b70 2026-02-20T13:14:10.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.084+0000 7f85b6ffd640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f859803f9d0 0x7f859805fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.084+0000 7f85b6ffd640 1 -- 10.20.193.28:0/4081682155 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f85b801fcb0 con 0x7f85c8134b70 2026-02-20T13:14:10.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.086+0000 7f85cdbd9640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f859803f9d0 0x7f859805fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.087+0000 7f85b6ffd640 1 -- 10.20.193.28:0/4081682155 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f85b80188e0 con 0x7f85c8134b70 2026-02-20T13:14:10.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.087+0000 7f85cdbd9640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f859803f9d0 0x7f859805fe80 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85c0031460 tx=0x7f85c00037b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.088+0000 7ffa2015d640 1 -- 10.20.193.28:0/3156143317 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa18135fe0 msgr2=0x7ffa181563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.088+0000 7ffa2015d640 1 --2- 10.20.193.28:0/3156143317 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa18135fe0 0x7ffa181563c0 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=16594899145575334333 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa0c009890 tx=0x7ffa0c02f0e0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.089+0000 7ffa2015d640 1 -- 10.20.193.28:0/3156143317 shutdown_connections 2026-02-20T13:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.089+0000 7ffa2015d640 1 --2- 10.20.193.28:0/3156143317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa18114c70 0x7ffa181150f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.089+0000 7ffa2015d640 1 --2- 10.20.193.28:0/3156143317 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa18135fe0 0x7ffa181563c0 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=16594899145575334333 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.089+0000 7ffa2015d640 1 --2- 10.20.193.28:0/3156143317 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa1805d470 0x7ffa181145d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.089+0000 7ffa2015d640 1 -- 10.20.193.28:0/3156143317 >> 10.20.193.28:0/3156143317 conn(0x7ffa1805b500 msgr2=0x7ffa1805b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.089+0000 7ffa2015d640 1 -- 10.20.193.28:0/3156143317 shutdown_connections 2026-02-20T13:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.089+0000 7ffa2015d640 1 -- 10.20.193.28:0/3156143317 wait complete. 2026-02-20T13:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.090+0000 7ffa2015d640 1 Processor -- start 2026-02-20T13:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.090+0000 7ffa2015d640 1 -- start start 2026-02-20T13:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.090+0000 7ffa2015d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1805d470 0x7ffa181145d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa2015d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa18114c70 0x7ffa18129d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa2015d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa18135fe0 0x7ffa1812a460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa2015d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1812b050 con 0x7ffa1805d470 2026-02-20T13:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa2015d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1812b1c0 con 0x7ffa18135fe0 2026-02-20T13:14:10.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa2015d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1812b380 con 0x7ffa18114c70 2026-02-20T13:14:10.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa1d6d1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa18114c70 0x7ffa18129d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa1e6d3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa18135fe0 0x7ffa1812a460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa1d6d1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa18114c70 0x7ffa18129d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37366/0 (socket says 10.20.193.28:37366) 2026-02-20T13:14:10.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa1d6d1640 1 -- 10.20.193.28:0/2900594271 learned_addr learned my addr 10.20.193.28:0/2900594271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.091+0000 7ffa1ded2640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1805d470 0x7ffa181145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.092+0000 7ffa1d6d1640 1 -- 10.20.193.28:0/2900594271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa18135fe0 msgr2=0x7ffa1812a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.092+0000 7ffa1d6d1640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa18135fe0 0x7ffa1812a460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.092+0000 7ffa1d6d1640 1 -- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1805d470 msgr2=0x7ffa181145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.092+0000 7ffa1d6d1640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1805d470 0x7ffa181145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.092+0000 7ffa1d6d1640 1 -- 10.20.193.28:0/2900594271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa08009570 con 0x7ffa18114c70 2026-02-20T13:14:10.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.092+0000 7ffa1ded2640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1805d470 0x7ffa181145d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:14:10.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.092+0000 7ffa1d6d1640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa18114c70 0x7ffa18129d30 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa0c0097e0 tx=0x7ffa0c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.094+0000 7ffa06ffd640 1 -- 10.20.193.28:0/2900594271 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa0c03d070 con 0x7ffa18114c70 2026-02-20T13:14:10.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.094+0000 7ffa06ffd640 1 -- 10.20.193.28:0/2900594271 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa0c005d40 con 0x7ffa18114c70 2026-02-20T13:14:10.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.094+0000 7ffa06ffd640 1 -- 10.20.193.28:0/2900594271 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa0c03d070 con 0x7ffa18114c70 2026-02-20T13:14:10.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.094+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1000a590 con 0x7ffa18114c70 2026-02-20T13:14:10.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.094+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0c0094b0 con 0x7ffa18114c70 2026-02-20T13:14:10.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.095+0000 7ffa06ffd640 1 -- 10.20.193.28:0/2900594271 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7ffa0c038ae0 con 0x7ffa18114c70 2026-02-20T13:14:10.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.095+0000 7ffa06ffd640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff9ec03fa30 0x7ff9ec05fee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.095+0000 7ffa06ffd640 1 -- 10.20.193.28:0/2900594271 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ffa0c078a30 con 0x7ffa18114c70 2026-02-20T13:14:10.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.096+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fc41c1299e0 con 0x7fc41c0c5cc0 2026-02-20T13:14:10.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.096+0000 7ffa1ded2640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff9ec03fa30 0x7ff9ec05fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.096+0000 7ffa1ded2640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff9ec03fa30 0x7ff9ec05fee0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa08005b30 tx=0x7ffa08009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.096+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e0005300 con 0x7ffa18114c70 2026-02-20T13:14:10.107 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.101+0000 7ffa06ffd640 1 -- 10.20.193.28:0/2900594271 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7ffa0c041410 con 0x7ffa18114c70 2026-02-20T13:14:10.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.104+0000 7fc420ff9640 1 -- 10.20.193.28:0/3210591324 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v19)=0 v19) ==== 127+0+0 (secure 0 0 0) 0x7fc41804b780 con 0x7fc41c0c5cc0 2026-02-20T13:14:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3f803fa20 msgr2=0x7fc3f805fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3f803fa20 0x7fc3f805fed0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc410004740 tx=0x7fc410006d40 comp rx=0 tx=0).stop 2026-02-20T13:14:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc41c0c5cc0 msgr2=0x7fc41c0ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc41c0c5cc0 0x7fc41c0ce7d0 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc418039820 tx=0x7fc4180039b0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 shutdown_connections 2026-02-20T13:14:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3f803fa20 0x7fc3f805fed0 unknown :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc41c0c5cc0 0x7fc41c0ce7d0 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc41c0c5310 0x7fc41c0cdbd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 --2- 10.20.193.28:0/3210591324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc41c0c4180 0x7fc41c0cd580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 >> 10.20.193.28:0/3210591324 conn(0x7fc41c0a1470 msgr2=0x7fc41c0c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 shutdown_connections 2026-02-20T13:14:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.107+0000 7fc428fb2640 1 -- 10.20.193.28:0/3210591324 wait complete. 2026-02-20T13:14:10.183 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.201 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.211 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.237+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f85c8058480 con 0x7f85c8134b70 2026-02-20T13:14:10.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.247+0000 7f85b6ffd640 1 -- 10.20.193.28:0/4081682155 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7f85b8018a80 con 0x7f85c8134b70 2026-02-20T13:14:10.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.250+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f859803f9d0 msgr2=0x7f859805fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.251+0000 7f85cebdb640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f859803f9d0 0x7f859805fe80 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85c0031460 tx=0x7f85c00037b0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.251+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c8134b70 msgr2=0x7f85c81345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.251+0000 7f85cebdb640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c8134b70 0x7f85c81345e0 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85b800b520 tx=0x7f85b800b9f0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.253+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 shutdown_connections 2026-02-20T13:14:10.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.253+0000 7f85cebdb640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f859803f9d0 0x7f859805fe80 unknown :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.253+0000 7f85cebdb640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85c8134b70 0x7f85c81345e0 unknown :-1 s=CLOSED pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.253+0000 7f85cebdb640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85c8155730 0x7f85c8186840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.253+0000 7f85cebdb640 1 --2- 10.20.193.28:0/4081682155 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85c805e750 0x7f85c8185fe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.253+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 >> 10.20.193.28:0/4081682155 conn(0x7f85c805b340 msgr2=0x7f85c817cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.253+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 shutdown_connections 2026-02-20T13:14:10.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.254+0000 7f85cebdb640 1 -- 10.20.193.28:0/4081682155 wait complete. 2026-02-20T13:14:10.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.256+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7ff9e00055b0 con 0x7ffa18114c70 2026-02-20T13:14:10.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.234+0000 7f1556709640 1 -- 10.20.193.28:0/3083161196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1550134ef0 msgr2=0x7f15501552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.234+0000 7f1556709640 1 --2- 10.20.193.28:0/3083161196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1550134ef0 0x7f15501552d0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=14656353978369236521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1538009890 tx=0x7f153802f100 comp rx=0 tx=0).stop 2026-02-20T13:14:10.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.234+0000 7f1556709640 1 -- 10.20.193.28:0/3083161196 shutdown_connections 2026-02-20T13:14:10.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.234+0000 7f1556709640 1 --2- 10.20.193.28:0/3083161196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15501559f0 0x7f1550175ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.234+0000 7f1556709640 1 --2- 10.20.193.28:0/3083161196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1550134ef0 0x7f15501552d0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=14656353978369236521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.234+0000 7f1556709640 1 --2- 10.20.193.28:0/3083161196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15501145d0 0x7f15501349b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.234+0000 7f1556709640 1 -- 10.20.193.28:0/3083161196 >> 10.20.193.28:0/3083161196 conn(0x7f155005b500 msgr2=0x7f155005b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.235+0000 7f1556709640 1 -- 10.20.193.28:0/3083161196 shutdown_connections 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.235+0000 7f1556709640 1 -- 10.20.193.28:0/3083161196 wait complete. 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.236+0000 7f1556709640 1 Processor -- start 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.236+0000 7f1556709640 1 -- start start 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.237+0000 7f1556709640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15501145d0 0x7f1550175e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.237+0000 7f1556709640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1550134ef0 0x7f15501552d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.237+0000 7f1556709640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f15501559f0 0x7f1550103390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f15477fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1550134ef0 0x7f15501552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f15477fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1550134ef0 0x7f15501552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37386/0 (socket says 10.20.193.28:37386) 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f15477fe640 1 -- 10.20.193.28:0/2897324935 learned_addr learned my addr 10.20.193.28:0/2897324935 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1550103b20 con 0x7f15501145d0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1550103c90 con 0x7f15501559f0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f15501043a0 con 0x7f1550134ef0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1554c7f640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f15501559f0 0x7f1550103390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1554c7f640 1 -- 10.20.193.28:0/2897324935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1550134ef0 msgr2=0x7f15501552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1554c7f640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1550134ef0 0x7f15501552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1554c7f640 1 -- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15501145d0 msgr2=0x7f1550175e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1554c7f640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15501145d0 0x7f1550175e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.238+0000 7f1554c7f640 1 -- 10.20.193.28:0/2897324935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15380094b0 con 0x7f15501559f0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.239+0000 7f1554c7f640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f15501559f0 0x7f1550103390 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f154c006c10 tx=0x7f154c00fde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.240+0000 7f15457fa640 1 -- 10.20.193.28:0/2897324935 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f154c00dda0 con 0x7f15501559f0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.240+0000 7f15457fa640 1 -- 10.20.193.28:0/2897324935 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f154c005e10 con 0x7f15501559f0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.240+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1550104680 con 0x7f15501559f0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.240+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1550104b00 con 0x7f15501559f0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.241+0000 7f15457fa640 1 -- 10.20.193.28:0/2897324935 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f154c005b50 con 0x7f15501559f0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.242+0000 7f15457fa640 1 -- 10.20.193.28:0/2897324935 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f154c004820 con 0x7f15501559f0 2026-02-20T13:14:10.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.242+0000 7f15457fa640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f152003fa20 0x7f152005fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.242+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f155017a1f0 con 0x7f15501559f0 2026-02-20T13:14:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.242+0000 7f15457fa640 1 -- 10.20.193.28:0/2897324935 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f154c015070 con 0x7f15501559f0 2026-02-20T13:14:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.245+0000 7f1547fff640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f152003fa20 0x7f152005fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.245+0000 7f1547fff640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f152003fa20 0x7f152005fed0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15501763b0 tx=0x7f1540009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.245+0000 7f15457fa640 1 -- 10.20.193.28:0/2897324935 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f154c017b80 con 0x7f15501559f0 2026-02-20T13:14:10.269 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.260+0000 7ffa06ffd640 1 -- 10.20.193.28:0/2900594271 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7ffa0c046020 con 0x7ffa18114c70 2026-02-20T13:14:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.264+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff9ec03fa30 msgr2=0x7ff9ec05fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.264+0000 7ffa2015d640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff9ec03fa30 0x7ff9ec05fee0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa08005b30 tx=0x7ffa08009310 comp rx=0 tx=0).stop 2026-02-20T13:14:10.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.264+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa18114c70 msgr2=0x7ffa18129d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.264+0000 7ffa2015d640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa18114c70 0x7ffa18129d30 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa0c0097e0 tx=0x7ffa0c0042f0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.264+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 shutdown_connections 2026-02-20T13:14:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.264+0000 7ffa2015d640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff9ec03fa30 0x7ff9ec05fee0 unknown :-1 s=CLOSED pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.265+0000 7ffa2015d640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa18135fe0 0x7ffa1812a460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.265+0000 7ffa2015d640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa18114c70 0x7ffa18129d30 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.265+0000 7ffa2015d640 1 --2- 10.20.193.28:0/2900594271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1805d470 0x7ffa181145d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.265+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 >> 10.20.193.28:0/2900594271 conn(0x7ffa1805b500 msgr2=0x7ffa181202c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.265+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 shutdown_connections 2026-02-20T13:14:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.265+0000 7ffa2015d640 1 -- 10.20.193.28:0/2900594271 wait complete. 2026-02-20T13:14:10.320 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.349+0000 7fa1b700a640 1 -- 10.20.193.28:0/1652888773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1a80c5d00 msgr2=0x7fa1a8126690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.349+0000 7fa1b700a640 1 --2- 10.20.193.28:0/1652888773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1a80c5d00 0x7fa1a8126690 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=5717503930802151154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b00520d0 tx=0x7fa1b0080090 comp rx=0 tx=0).stop 2026-02-20T13:14:10.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.349+0000 7fa1b700a640 1 -- 10.20.193.28:0/1652888773 shutdown_connections 2026-02-20T13:14:10.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.349+0000 7fa1b700a640 1 --2- 10.20.193.28:0/1652888773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1a80c5350 0x7fa1a80c57c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.349+0000 7fa1b700a640 1 --2- 10.20.193.28:0/1652888773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1a80c5d00 0x7fa1a8126690 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=5717503930802151154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.349+0000 7fa1b700a640 1 --2- 10.20.193.28:0/1652888773 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1a80c41c0 0x7fa1a80c45b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.350+0000 7fa1b700a640 1 -- 10.20.193.28:0/1652888773 >> 10.20.193.28:0/1652888773 conn(0x7fa1a80a1490 msgr2=0x7fa1a80c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.350+0000 7fa1b700a640 1 -- 10.20.193.28:0/1652888773 shutdown_connections 2026-02-20T13:14:10.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.350+0000 7fa1b700a640 1 -- 10.20.193.28:0/1652888773 wait complete. 2026-02-20T13:14:10.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.351+0000 7fa1b700a640 1 Processor -- start 2026-02-20T13:14:10.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.351+0000 7fa1b700a640 1 -- start start 2026-02-20T13:14:10.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b700a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1a80c41c0 0x7fa1a80abc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b700a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1a80c5350 0x7fa1a8126690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b700a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1a80c5d00 0x7fa1a80ac4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b700a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a80ad040 con 0x7fa1a80c5d00 2026-02-20T13:14:10.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b700a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a80ad1b0 con 0x7fa1a80c41c0 2026-02-20T13:14:10.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b700a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a80ad370 con 0x7fa1a80c5350 2026-02-20T13:14:10.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b5d81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1a80c5d00 0x7fa1a80ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b5d81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1a80c5d00 0x7fa1a80ac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35816/0 (socket says 10.20.193.28:35816) 2026-02-20T13:14:10.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.352+0000 7fa1b5d81640 1 -- 10.20.193.28:0/309659957 learned_addr learned my addr 10.20.193.28:0/309659957 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.353+0000 7fa1b4d7f640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1a80c41c0 0x7fa1a80abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.353+0000 7fa1affff640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1a80c5350 0x7fa1a8126690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.353+0000 7fa1b5d81640 1 -- 10.20.193.28:0/309659957 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1a80c5350 msgr2=0x7fa1a8126690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.353+0000 7fa1b5d81640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1a80c5350 0x7fa1a8126690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.353+0000 7fa1b5d81640 1 -- 10.20.193.28:0/309659957 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1a80c41c0 msgr2=0x7fa1a80abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.353+0000 7fa1b5d81640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1a80c41c0 0x7fa1a80abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.354+0000 7fa1b5d81640 1 -- 10.20.193.28:0/309659957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b00391a0 con 0x7fa1a80c5d00 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.354+0000 7fa1b5d81640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1a80c5d00 0x7fa1a80ac4a0 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b0053410 tx=0x7fa1b0080ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.355+0000 7fa1adffb640 1 -- 10.20.193.28:0/309659957 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1b008e070 con 0x7fa1a80c5d00 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.355+0000 7fa1adffb640 1 -- 10.20.193.28:0/309659957 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa1b0089470 con 0x7fa1a80c5d00 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.355+0000 7fa1adffb640 1 -- 10.20.193.28:0/309659957 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1b004d340 con 0x7fa1a80c5d00 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.355+0000 7fa1b700a640 1 -- 10.20.193.28:0/309659957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a80ad5f0 con 0x7fa1a80c5d00 2026-02-20T13:14:10.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.355+0000 7fa1b700a640 1 -- 10.20.193.28:0/309659957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a80ada10 con 0x7fa1a80c5d00 2026-02-20T13:14:10.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.356+0000 7fa1837fe640 1 -- 10.20.193.28:0/309659957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a812c3e0 con 0x7fa1a80c5d00 2026-02-20T13:14:10.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fa1adffb640 1 -- 10.20.193.28:0/309659957 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fa1b0056810 con 0x7fa1a80c5d00 2026-02-20T13:14:10.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fa1adffb640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa18403fa20 0x7fa18405fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fa1adffb640 1 -- 10.20.193.28:0/309659957 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fa1b00c9ba0 con 0x7fa1a80c5d00 2026-02-20T13:14:10.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fa1adffb640 1 -- 10.20.193.28:0/309659957 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fa1b0102730 con 0x7fa1a80c5d00 2026-02-20T13:14:10.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 -- 10.20.193.28:0/3880608257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab600c5880 msgr2=0x7fab600c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 --2- 10.20.193.28:0/3880608257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab600c5880 0x7fab600c61c0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=2024919535968952608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab5c01ace0 tx=0x7fab5c040120 comp rx=0 tx=0).stop 2026-02-20T13:14:10.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 -- 10.20.193.28:0/3880608257 shutdown_connections 2026-02-20T13:14:10.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 --2- 10.20.193.28:0/3880608257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab600c5880 0x7fab600c61c0 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=2024919535968952608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 --2- 10.20.193.28:0/3880608257 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab600c4ed0 0x7fab600c5340 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 --2- 10.20.193.28:0/3880608257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab600c3e00 0x7fab600c41f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 -- 10.20.193.28:0/3880608257 >> 10.20.193.28:0/3880608257 conn(0x7fab600a1470 msgr2=0x7fab600c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 -- 10.20.193.28:0/3880608257 shutdown_connections 2026-02-20T13:14:10.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.361+0000 7fab6e953640 1 -- 10.20.193.28:0/3880608257 wait complete. 2026-02-20T13:14:10.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.368+0000 7fa1b4d7f640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa18403fa20 0x7fa18405fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.370+0000 7fa1b4d7f640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa18403fa20 0x7fa18405fed0 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa19c004740 tx=0x7fa19c00c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6e953640 1 Processor -- start 2026-02-20T13:14:10.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6e953640 1 -- start start 2026-02-20T13:14:10.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6e953640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab600c3e00 0x7fab600acd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6e953640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab600c4ed0 0x7fab600ad360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6e953640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab600c5880 0x7fab600adf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6e953640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab600ae650 con 0x7fab600c5880 2026-02-20T13:14:10.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6e953640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fab600ae7c0 con 0x7fab600c4ed0 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6e953640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fab600ae980 con 0x7fab600c3e00 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6d951640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab600c3e00 0x7fab600acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6d951640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab600c3e00 0x7fab600acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37446/0 (socket says 10.20.193.28:37446) 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.362+0000 7fab6d951640 1 -- 10.20.193.28:0/500515770 learned_addr learned my addr 10.20.193.28:0/500515770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fab6d951640 1 -- 10.20.193.28:0/500515770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab600c4ed0 msgr2=0x7fab600ad360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fab6d951640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab600c4ed0 0x7fab600ad360 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fab6d951640 1 -- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab600c5880 msgr2=0x7fab600adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fab6e152640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab600c5880 0x7fab600adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fab6d951640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab600c5880 0x7fab600adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fab6d951640 1 -- 10.20.193.28:0/500515770 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab580094b0 con 0x7fab600c3e00 2026-02-20T13:14:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fab6e152640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab600c5880 0x7fab600adf10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.363+0000 7fab6d951640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab600c3e00 0x7fab600acd10 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab58009fd0 tx=0x7fab58002bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.364+0000 7fab56ffd640 1 -- 10.20.193.28:0/500515770 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab5800ed60 con 0x7fab600c3e00 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.364+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c01a980 con 0x7fab600c3e00 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.364+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab60005bf0 con 0x7fab600c3e00 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.364+0000 7fab56ffd640 1 -- 10.20.193.28:0/500515770 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fab58002e20 con 0x7fab600c3e00 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.364+0000 7fab56ffd640 1 -- 10.20.193.28:0/500515770 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab5800ed60 con 0x7fab600c3e00 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.365+0000 7fab56ffd640 1 -- 10.20.193.28:0/500515770 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fab58016020 con 0x7fab600c3e00 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.367+0000 7fab56ffd640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab44084a40 0x7fab440a4ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.367+0000 7fab56ffd640 1 -- 10.20.193.28:0/500515770 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fab58055280 con 0x7fab600c3e00 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.370+0000 7fab6d150640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab44084a40 0x7fab440a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.366+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab30005300 con 0x7fab600c3e00 2026-02-20T13:14:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.373+0000 7fab56ffd640 1 -- 10.20.193.28:0/500515770 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fab58020590 con 0x7fab600c3e00 2026-02-20T13:14:10.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.377+0000 7fab6d150640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab44084a40 0x7fab440a4ef0 secure :-1 s=READY pgs=57 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab64005860 tx=0x7fab64007d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.426+0000 7ff5227fc640 1 -- 10.20.193.28:0/1372567583 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5180396f0 con 0x7ff52410f9e0 2026-02-20T13:14:10.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 -- 10.20.193.28:0/1372567583 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 msgr2=0x7ff524171770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 --2- 10.20.193.28:0/1372567583 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 0x7ff524171770 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=5792291971975229605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff51800a970 tx=0x7ff5180301d0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 -- 10.20.193.28:0/1372567583 shutdown_connections 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 --2- 10.20.193.28:0/1372567583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff52410f030 0x7ff52410f4a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 --2- 10.20.193.28:0/1372567583 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 0x7ff524171770 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=5792291971975229605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 --2- 10.20.193.28:0/1372567583 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5241107a0 0x7ff524110b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 -- 10.20.193.28:0/1372567583 >> 10.20.193.28:0/1372567583 conn(0x7ff5240ec9d0 msgr2=0x7ff52410ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 -- 10.20.193.28:0/1372567583 shutdown_connections 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.427+0000 7ff529b58640 1 -- 10.20.193.28:0/1372567583 wait complete. 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.428+0000 7ff529b58640 1 Processor -- start 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.428+0000 7ff529b58640 1 -- start start 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.428+0000 7ff529b58640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff52410f030 0x7ff524063460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff529b58640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 0x7ff524171770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff529b58640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5241107a0 0x7ff524063cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff529b58640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5240648b0 con 0x7ff52410f030 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff529b58640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff524064a20 con 0x7ff52410f9e0 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff529b58640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff524064be0 con 0x7ff5241107a0 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff5237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff52410f030 0x7ff524063460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff522ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 0x7ff524171770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff5237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff52410f030 0x7ff524063460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35844/0 (socket says 10.20.193.28:35844) 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff522ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 0x7ff524171770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43484/0 (socket says 10.20.193.28:43484) 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff523fff640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5241107a0 0x7ff524063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff5237fe640 1 -- 10.20.193.28:0/2691958968 learned_addr learned my addr 10.20.193.28:0/2691958968 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff523fff640 1 -- 10.20.193.28:0/2691958968 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 msgr2=0x7ff524171770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff523fff640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 0x7ff524171770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.429+0000 7ff523fff640 1 -- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff52410f030 msgr2=0x7ff524063460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.430+0000 7ff523fff640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff52410f030 0x7ff524063460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.430+0000 7ff523fff640 1 -- 10.20.193.28:0/2691958968 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51800a590 con 0x7ff5241107a0 2026-02-20T13:14:10.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.430+0000 7ff522ffd640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 0x7ff524171770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:14:10.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.430+0000 7ff5237fe640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff52410f030 0x7ff524063460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:14:10.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.430+0000 7ff523fff640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5241107a0 0x7ff524063cc0 secure :-1 s=READY pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5180306e0 tx=0x7ff518003780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.437 INFO:journalctl@ceph.mgr.z.trial127.stdout:Feb 20 13:14:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-z[45140]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T13:14:10.437 INFO:journalctl@ceph.mgr.z.trial127.stdout:Feb 20 13:14:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-z[45140]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T13:14:10.437 INFO:journalctl@ceph.mgr.z.trial127.stdout:Feb 20 13:14:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-z[45140]: from numpy import show_config as show_numpy_config 2026-02-20T13:14:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.431+0000 7ff520ff9640 1 -- 10.20.193.28:0/2691958968 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff51803e070 con 0x7ff5241107a0 2026-02-20T13:14:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.431+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff524064e60 con 0x7ff5241107a0 2026-02-20T13:14:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.432+0000 7ff520ff9640 1 -- 10.20.193.28:0/2691958968 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff518005050 con 0x7ff5241107a0 2026-02-20T13:14:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.433+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff524065320 con 0x7ff5241107a0 2026-02-20T13:14:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.433+0000 7ff520ff9640 1 -- 10.20.193.28:0/2691958968 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff51803e070 con 0x7ff5241107a0 2026-02-20T13:14:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.435+0000 7ff520ff9640 1 -- 10.20.193.28:0/2691958968 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7ff518039aa0 con 0x7ff5241107a0 2026-02-20T13:14:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.436+0000 7ff520ff9640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4fc03fa30 0x7ff4fc05fee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.436+0000 7ff520ff9640 1 -- 10.20.193.28:0/2691958968 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ff51807e9f0 con 0x7ff5241107a0 2026-02-20T13:14:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.437+0000 7ff5237fe640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4fc03fa30 0x7ff4fc05fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.438+0000 7ff5237fe640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4fc03fa30 0x7ff4fc05fee0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5100097c0 tx=0x7ff510009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.438+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff524175880 con 0x7ff5241107a0 2026-02-20T13:14:10.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.442+0000 7ff520ff9640 1 -- 10.20.193.28:0/2691958968 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7ff518039d80 con 0x7ff5241107a0 2026-02-20T13:14:10.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.444+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f1550055e00 con 0x7f15501559f0 2026-02-20T13:14:10.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.447+0000 7f15457fa640 1 -- 10.20.193.28:0/2897324935 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v22)=0 v22) ==== 116+0+0 (secure 0 0 0) 0x7f154c021390 con 0x7f15501559f0 2026-02-20T13:14:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.454+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f152003fa20 msgr2=0x7f152005fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.454+0000 7f1556709640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f152003fa20 0x7f152005fed0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15501763b0 tx=0x7f1540009690 comp rx=0 tx=0).stop 2026-02-20T13:14:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.454+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f15501559f0 msgr2=0x7f1550103390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.454+0000 7f1556709640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f15501559f0 0x7f1550103390 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f154c006c10 tx=0x7f154c00fde0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.458+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 shutdown_connections 2026-02-20T13:14:10.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.458+0000 7f1556709640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f152003fa20 0x7f152005fed0 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.458+0000 7f1556709640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f15501559f0 0x7f1550103390 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.458+0000 7f1556709640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1550134ef0 0x7f15501552d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.458+0000 7f1556709640 1 --2- 10.20.193.28:0/2897324935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15501145d0 0x7f1550175e70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.458+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 >> 10.20.193.28:0/2897324935 conn(0x7f155005b500 msgr2=0x7f15500f5720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.460+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 shutdown_connections 2026-02-20T13:14:10.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.460+0000 7f1556709640 1 -- 10.20.193.28:0/2897324935 wait complete. 2026-02-20T13:14:10.472 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial028') 2026-02-20T13:14:10.512 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:10.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.511+0000 7fa1837fe640 1 -- 10.20.193.28:0/309659957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fa1a80c45b0 con 0x7fa1a80c5d00 2026-02-20T13:14:10.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.527+0000 7fa1adffb640 1 -- 10.20.193.28:0/309659957 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7fa1b004d4d0 con 0x7fa1a80c5d00 2026-02-20T13:14:10.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.533+0000 7fa1837fe640 1 -- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa18403fa20 msgr2=0x7fa18405fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.533+0000 7fa1837fe640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa18403fa20 0x7fa18405fed0 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa19c004740 tx=0x7fa19c00c040 comp rx=0 tx=0).stop 2026-02-20T13:14:10.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.533+0000 7fa1837fe640 1 -- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1a80c5d00 msgr2=0x7fa1a80ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.533+0000 7fa1837fe640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1a80c5d00 0x7fa1a80ac4a0 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b0053410 tx=0x7fa1b0080ae0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.534+0000 7fa1837fe640 1 -- 10.20.193.28:0/309659957 shutdown_connections 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.534+0000 7fa1837fe640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa18403fa20 0x7fa18405fed0 unknown :-1 s=CLOSED pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.534+0000 7fa1837fe640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1a80c5d00 0x7fa1a80ac4a0 unknown :-1 s=CLOSED pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.534+0000 7fa1837fe640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1a80c5350 0x7fa1a8126690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.534+0000 7fa1837fe640 1 --2- 10.20.193.28:0/309659957 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1a80c41c0 0x7fa1a80abc40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.534+0000 7fa1837fe640 1 -- 10.20.193.28:0/309659957 >> 10.20.193.28:0/309659957 conn(0x7fa1a80a1490 msgr2=0x7fa1a80a2050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.534+0000 7fa1837fe640 1 -- 10.20.193.28:0/309659957 shutdown_connections 2026-02-20T13:14:10.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.534+0000 7fa1837fe640 1 -- 10.20.193.28:0/309659957 wait complete. 2026-02-20T13:14:10.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: Deploying daemon mgr.y on trial034 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2435315254' entity='client.admin' 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/805225225' entity='client.admin' 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/915917662' entity='client.admin' 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/852557285' entity='client.admin' 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4081682155' entity='client.admin' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:10.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:10.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.552+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fab30005b30 con 0x7fab600c3e00 2026-02-20T13:14:10.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.558+0000 7fab56ffd640 1 -- 10.20.193.28:0/500515770 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v25)=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7fab5800b2d0 con 0x7fab600c3e00 2026-02-20T13:14:10.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.563+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab44084a40 msgr2=0x7fab440a4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.563+0000 7fab6e953640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab44084a40 0x7fab440a4ef0 secure :-1 s=READY pgs=57 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab64005860 tx=0x7fab64007d60 comp rx=0 tx=0).stop 2026-02-20T13:14:10.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.563+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab600c3e00 msgr2=0x7fab600acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.563+0000 7fab6e953640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab600c3e00 0x7fab600acd10 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab58009fd0 tx=0x7fab58002bc0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.564+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 shutdown_connections 2026-02-20T13:14:10.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.564+0000 7fab6e953640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab44084a40 0x7fab440a4ef0 unknown :-1 s=CLOSED pgs=57 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.564+0000 7fab6e953640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab600c5880 0x7fab600adf10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.564+0000 7fab6e953640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab600c4ed0 0x7fab600ad360 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.564+0000 7fab6e953640 1 --2- 10.20.193.28:0/500515770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab600c3e00 0x7fab600acd10 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.564+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 >> 10.20.193.28:0/500515770 conn(0x7fab600a1470 msgr2=0x7fab600a3120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.570+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 shutdown_connections 2026-02-20T13:14:10.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.570+0000 7fab6e953640 1 -- 10.20.193.28:0/500515770 wait complete. 2026-02-20T13:14:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.589+0000 7fce54214640 1 -- 10.20.193.28:0/2852795790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c114b10 msgr2=0x7fce4c114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.589+0000 7fce54214640 1 --2- 10.20.193.28:0/2852795790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c114b10 0x7fce4c114f80 secure :-1 s=READY pgs=132 gs=2 cs=0 l=1 c_cookie=11462303185073704323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce400098e0 tx=0x7fce4002f170 comp rx=0 tx=0).stop 2026-02-20T13:14:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.590+0000 7fce54214640 1 -- 10.20.193.28:0/2852795790 shutdown_connections 2026-02-20T13:14:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.590+0000 7fce54214640 1 --2- 10.20.193.28:0/2852795790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c114b10 0x7fce4c114f80 unknown :-1 s=CLOSED pgs=132 gs=2 cs=0 l=1 c_cookie=11462303185073704323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.590+0000 7fce54214640 1 --2- 10.20.193.28:0/2852795790 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce4c1155d0 0x7fce4c115a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.590+0000 7fce54214640 1 --2- 10.20.193.28:0/2852795790 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce4c05e5b0 0x7fce4c1145d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.590+0000 7fce54214640 1 -- 10.20.193.28:0/2852795790 >> 10.20.193.28:0/2852795790 conn(0x7fce4c05b500 msgr2=0x7fce4c05b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.590+0000 7fce54214640 1 -- 10.20.193.28:0/2852795790 shutdown_connections 2026-02-20T13:14:10.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.590+0000 7fce54214640 1 -- 10.20.193.28:0/2852795790 wait complete. 2026-02-20T13:14:10.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.591+0000 7fce54214640 1 Processor -- start 2026-02-20T13:14:10.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.591+0000 7fce54214640 1 -- start start 2026-02-20T13:14:10.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.591+0000 7fce54214640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce4c05e5b0 0x7fce4c117d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.591+0000 7fce54214640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce4c114b10 0x7fce4c1183e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.591+0000 7fce54214640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c1155d0 0x7fce4c118fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c1155d0 0x7fce4c118fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c1155d0 0x7fce4c118fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35874/0 (socket says 10.20.193.28:35874) 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 -- 10.20.193.28:0/1558009099 learned_addr learned my addr 10.20.193.28:0/1558009099 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1196d0 con 0x7fce4c1155d0 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c119840 con 0x7fce4c05e5b0 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c119a00 con 0x7fce4c114b10 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 -- 10.20.193.28:0/1558009099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce4c114b10 msgr2=0x7fce4c1183e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce4c114b10 0x7fce4c1183e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 -- 10.20.193.28:0/1558009099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce4c05e5b0 msgr2=0x7fce4c117d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:14:10.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce4c05e5b0 0x7fce4c117d90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 -- 10.20.193.28:0/1558009099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce400094b0 con 0x7fce4c1155d0 2026-02-20T13:14:10.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.592+0000 7fce5278a640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c1155d0 0x7fce4c118fe0 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce48006e90 tx=0x7fce4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.593+0000 7fce3affd640 1 -- 10.20.193.28:0/1558009099 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce4800cb80 con 0x7fce4c1155d0 2026-02-20T13:14:10.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.593+0000 7fce3affd640 1 -- 10.20.193.28:0/1558009099 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce48005e10 con 0x7fce4c1155d0 2026-02-20T13:14:10.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.593+0000 7fce3affd640 1 -- 10.20.193.28:0/1558009099 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce48003b20 con 0x7fce4c1155d0 2026-02-20T13:14:10.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.593+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c119ce0 con 0x7fce4c1155d0 2026-02-20T13:14:10.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.593+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c11a1f0 con 0x7fce4c1155d0 2026-02-20T13:14:10.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.593+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce14005300 con 0x7fce4c1155d0 2026-02-20T13:14:10.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.596+0000 7fce3affd640 1 -- 10.20.193.28:0/1558009099 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fce48003cb0 con 0x7fce4c1155d0 2026-02-20T13:14:10.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.596+0000 7fce3affd640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce2803f9d0 0x7fce2805fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.596+0000 7fce3affd640 1 -- 10.20.193.28:0/1558009099 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fce48055190 con 0x7fce4c1155d0 2026-02-20T13:14:10.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.597+0000 7fce51f89640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce2803f9d0 0x7fce2805fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.598+0000 7fce51f89640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce2803f9d0 0x7fce2805fe80 secure :-1 s=READY pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce3c004740 tx=0x7fce3c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.598+0000 7fce3affd640 1 -- 10.20.193.28:0/1558009099 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fce480061f0 con 0x7fce4c1155d0 2026-02-20T13:14:10.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.623+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7ff52405f4c0 con 0x7ff5241107a0 2026-02-20T13:14:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.626+0000 7ff520ff9640 1 -- 10.20.193.28:0/2691958968 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7ff518045120 con 0x7ff5241107a0 2026-02-20T13:14:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.629+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4fc03fa30 msgr2=0x7ff4fc05fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.630+0000 7ff529b58640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4fc03fa30 0x7ff4fc05fee0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5100097c0 tx=0x7ff510009310 comp rx=0 tx=0).stop 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.630+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5241107a0 msgr2=0x7ff524063cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.630+0000 7ff529b58640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5241107a0 0x7ff524063cc0 secure :-1 s=READY pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5180306e0 tx=0x7ff518003780 comp rx=0 tx=0).stop 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.631+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 shutdown_connections 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.631+0000 7ff529b58640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4fc03fa30 0x7ff4fc05fee0 unknown :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.631+0000 7ff529b58640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5241107a0 0x7ff524063cc0 unknown :-1 s=CLOSED pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.631+0000 7ff529b58640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff52410f9e0 0x7ff524171770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.631+0000 7ff529b58640 1 --2- 10.20.193.28:0/2691958968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff52410f030 0x7ff524063460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.631+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 >> 10.20.193.28:0/2691958968 conn(0x7ff5240ec9d0 msgr2=0x7ff5240ee960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.631+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 shutdown_connections 2026-02-20T13:14:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.631+0000 7ff529b58640 1 -- 10.20.193.28:0/2691958968 wait complete. 2026-02-20T13:14:10.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.323+0000 7fab8640a640 1 -- 10.20.193.28:0/2498532152 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab8005d470 msgr2=0x7fab801145d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.323+0000 7fab8640a640 1 --2- 10.20.193.28:0/2498532152 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab8005d470 0x7fab801145d0 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=16469492714821556252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab70009890 tx=0x7fab7002f0e0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.324+0000 7fab8640a640 1 -- 10.20.193.28:0/2498532152 shutdown_connections 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.324+0000 7fab8640a640 1 --2- 10.20.193.28:0/2498532152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab80135fe0 0x7fab801563c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.325+0000 7fab8640a640 1 --2- 10.20.193.28:0/2498532152 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab80156900 0x7fab80176ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.325+0000 7fab8640a640 1 --2- 10.20.193.28:0/2498532152 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab8005d470 0x7fab801145d0 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=16469492714821556252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.325+0000 7fab8640a640 1 -- 10.20.193.28:0/2498532152 >> 10.20.193.28:0/2498532152 conn(0x7fab8005b500 msgr2=0x7fab8005b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.325+0000 7fab8640a640 1 -- 10.20.193.28:0/2498532152 shutdown_connections 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.325+0000 7fab8640a640 1 -- 10.20.193.28:0/2498532152 wait complete. 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.325+0000 7fab8640a640 1 Processor -- start 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab8640a640 1 -- start start 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab8640a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab8005d470 0x7fab801363b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab8640a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab80135fe0 0x7fab80156cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab8640a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab80156900 0x7fab8021ec80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab8640a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab8021f3c0 con 0x7fab8005d470 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab8640a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fab8021f530 con 0x7fab80135fe0 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab8640a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fab8021f6f0 con 0x7fab80156900 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab84980640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab80156900 0x7fab8021ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab84980640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab80156900 0x7fab8021ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37414/0 (socket says 10.20.193.28:37414) 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab7f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab80135fe0 0x7fab80156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab84980640 1 -- 10.20.193.28:0/2354296819 learned_addr learned my addr 10.20.193.28:0/2354296819 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab84980640 1 -- 10.20.193.28:0/2354296819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab80135fe0 msgr2=0x7fab80156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab84980640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab80135fe0 0x7fab80156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab84980640 1 -- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab8005d470 msgr2=0x7fab801363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.326+0000 7fab84980640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab8005d470 0x7fab801363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.327+0000 7fab84980640 1 -- 10.20.193.28:0/2354296819 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab700094b0 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.327+0000 7fab84980640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab80156900 0x7fab8021ec80 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab74006a20 tx=0x7fab7400fdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.327+0000 7fab7d7fa640 1 -- 10.20.193.28:0/2354296819 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab7400dd70 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.327+0000 7fab7d7fa640 1 -- 10.20.193.28:0/2354296819 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fab74005e10 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.327+0000 7fab7d7fa640 1 -- 10.20.193.28:0/2354296819 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab74004bc0 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.327+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8021f9d0 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.327+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8021fe50 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.328+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab80179e80 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.332+0000 7fab7d7fa640 1 -- 10.20.193.28:0/2354296819 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fab74005820 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.332+0000 7fab7d7fa640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab5403fa20 0x7fab5405fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.332+0000 7fab7d7fa640 1 -- 10.20.193.28:0/2354296819 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fab74015070 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.332+0000 7fab7d7fa640 1 -- 10.20.193.28:0/2354296819 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fab740575f0 con 0x7fab80156900 2026-02-20T13:14:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.333+0000 7fab7ffff640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab5403fa20 0x7fab5405fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.340+0000 7fab7ffff640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab5403fa20 0x7fab5405fed0 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab7002f5f0 tx=0x7fab70031fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.501+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fab801145d0 con 0x7fab80156900 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.504+0000 7fab7d7fa640 1 -- 10.20.193.28:0/2354296819 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7fab74006390 con 0x7fab80156900 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.507+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab5403fa20 msgr2=0x7fab5405fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.507+0000 7fab8640a640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab5403fa20 0x7fab5405fed0 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab7002f5f0 tx=0x7fab70031fb0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.507+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab80156900 msgr2=0x7fab8021ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.507+0000 7fab8640a640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab80156900 0x7fab8021ec80 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab74006a20 tx=0x7fab7400fdc0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.509+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 shutdown_connections 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.509+0000 7fab8640a640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fab5403fa20 0x7fab5405fed0 unknown :-1 s=CLOSED pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.509+0000 7fab8640a640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab80156900 0x7fab8021ec80 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.509+0000 7fab8640a640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab80135fe0 0x7fab80156cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.509+0000 7fab8640a640 1 --2- 10.20.193.28:0/2354296819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab8005d470 0x7fab801363b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.509+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 >> 10.20.193.28:0/2354296819 conn(0x7fab8005b500 msgr2=0x7fab8017c530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.509+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 shutdown_connections 2026-02-20T13:14:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.509+0000 7fab8640a640 1 -- 10.20.193.28:0/2354296819 wait complete. 2026-02-20T13:14:10.722 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial028') 2026-02-20T13:14:10.722 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial028') 2026-02-20T13:14:10.722 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial028') 2026-02-20T13:14:10.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.718+0000 7f9364630640 1 -- 10.20.193.28:0/1066418454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1559f0 msgr2=0x7f935c175ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.718+0000 7f9364630640 1 --2- 10.20.193.28:0/1066418454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1559f0 0x7f935c175ea0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=9954262189510778899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9350009950 tx=0x7f935002f1b0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.720+0000 7f9364630640 1 -- 10.20.193.28:0/1066418454 shutdown_connections 2026-02-20T13:14:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.720+0000 7f9364630640 1 --2- 10.20.193.28:0/1066418454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1559f0 0x7f935c175ea0 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=9954262189510778899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.720+0000 7f9364630640 1 --2- 10.20.193.28:0/1066418454 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f935c134ef0 0x7f935c1552d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.720+0000 7f9364630640 1 --2- 10.20.193.28:0/1066418454 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f935c1145d0 0x7f935c1349b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.720+0000 7f9364630640 1 -- 10.20.193.28:0/1066418454 >> 10.20.193.28:0/1066418454 conn(0x7f935c05b500 msgr2=0x7f935c05b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.720+0000 7f9364630640 1 -- 10.20.193.28:0/1066418454 shutdown_connections 2026-02-20T13:14:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.721+0000 7f9364630640 1 -- 10.20.193.28:0/1066418454 wait complete. 2026-02-20T13:14:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: Deploying daemon mgr.y on trial034 2026-02-20T13:14:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2435315254' entity='client.admin' 2026-02-20T13:14:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/805225225' entity='client.admin' 2026-02-20T13:14:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/915917662' entity='client.admin' 2026-02-20T13:14:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/852557285' entity='client.admin' 2026-02-20T13:14:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4081682155' entity='client.admin' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:10.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:10.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.725+0000 7f9364630640 1 Processor -- start 2026-02-20T13:14:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.726+0000 7f9364630640 1 -- start start 2026-02-20T13:14:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.726+0000 7f9364630640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1145d0 0x7f935c175dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.726+0000 7f9364630640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f935c134ef0 0x7f935c1552d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.726+0000 7f9364630640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f935c1559f0 0x7f935c100190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f9364630640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f935c100920 con 0x7f935c1145d0 2026-02-20T13:14:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.727+0000 7f93623a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1145d0 0x7f935c175dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f9364630640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f935c100a90 con 0x7f935c1559f0 2026-02-20T13:14:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f9364630640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f935c100c50 con 0x7f935c134ef0 2026-02-20T13:14:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.727+0000 7f9362ba6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f935c1559f0 0x7f935c100190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.727+0000 7f9361ba4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f935c134ef0 0x7f935c1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f9362ba6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f935c1559f0 0x7f935c100190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43530/0 (socket says 10.20.193.28:43530) 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f9362ba6640 1 -- 10.20.193.28:0/4189578918 learned_addr learned my addr 10.20.193.28:0/4189578918 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f93623a5640 1 -- 10.20.193.28:0/4189578918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f935c134ef0 msgr2=0x7f935c1552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f93623a5640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f935c134ef0 0x7f935c1552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f93623a5640 1 -- 10.20.193.28:0/4189578918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f935c1559f0 msgr2=0x7f935c100190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f93623a5640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f935c1559f0 0x7f935c100190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f93623a5640 1 -- 10.20.193.28:0/4189578918 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9350009570 con 0x7f935c1145d0 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f9362ba6640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f935c1559f0 0x7f935c100190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:14:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.728+0000 7f93623a5640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1145d0 0x7f935c175dd0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f935800c520 tx=0x7f935800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.729+0000 7f934b7fe640 1 -- 10.20.193.28:0/4189578918 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9358003c70 con 0x7f935c1145d0 2026-02-20T13:14:10.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.729+0000 7f9364630640 1 -- 10.20.193.28:0/4189578918 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c1013a0 con 0x7f935c1145d0 2026-02-20T13:14:10.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.729+0000 7f9364630640 1 -- 10.20.193.28:0/4189578918 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c1018f0 con 0x7f935c1145d0 2026-02-20T13:14:10.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.729+0000 7f934b7fe640 1 -- 10.20.193.28:0/4189578918 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9358003dd0 con 0x7f935c1145d0 2026-02-20T13:14:10.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.729+0000 7f934b7fe640 1 -- 10.20.193.28:0/4189578918 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9358003c70 con 0x7f935c1145d0 2026-02-20T13:14:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.737+0000 7f93497fa640 1 -- 10.20.193.28:0/4189578918 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c055d30 con 0x7f935c1145d0 2026-02-20T13:14:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.738+0000 7f934b7fe640 1 -- 10.20.193.28:0/4189578918 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f9358019b30 con 0x7f935c1145d0 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: Deploying daemon mgr.y on trial034 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2435315254' entity='client.admin' 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/805225225' entity='client.admin' 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/915917662' entity='client.admin' 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/852557285' entity='client.admin' 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4081682155' entity='client.admin' 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:10.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:10.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.741+0000 7f934b7fe640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f933003fa30 0x7f933005fee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.741+0000 7f934b7fe640 1 -- 10.20.193.28:0/4189578918 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f9358054540 con 0x7f935c1145d0 2026-02-20T13:14:10.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.741+0000 7f9361ba4640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f933003fa30 0x7f933005fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.741+0000 7f9361ba4640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f933003fa30 0x7f933005fee0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f935c05ebd0 tx=0x7f934c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.741+0000 7f934b7fe640 1 -- 10.20.193.28:0/4189578918 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f9358010790 con 0x7f935c1145d0 2026-02-20T13:14:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.752+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fce14005b30 con 0x7fce4c1155d0 2026-02-20T13:14:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.752+0000 7fce3affd640 1 -- 10.20.193.28:0/1558009099 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7fce48020810 con 0x7fce4c1155d0 2026-02-20T13:14:10.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce2803f9d0 msgr2=0x7fce2805fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce2803f9d0 0x7fce2805fe80 secure :-1 s=READY pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce3c004740 tx=0x7fce3c009310 comp rx=0 tx=0).stop 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c1155d0 msgr2=0x7fce4c118fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c1155d0 0x7fce4c118fe0 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce48006e90 tx=0x7fce4800eeb0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 shutdown_connections 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce2803f9d0 0x7fce2805fe80 unknown :-1 s=CLOSED pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce4c1155d0 0x7fce4c118fe0 unknown :-1 s=CLOSED pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce4c114b10 0x7fce4c1183e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 --2- 10.20.193.28:0/1558009099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce4c05e5b0 0x7fce4c117d90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 >> 10.20.193.28:0/1558009099 conn(0x7fce4c05b500 msgr2=0x7fce4c0f56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 shutdown_connections 2026-02-20T13:14:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7fce54214640 1 -- 10.20.193.28:0/1558009099 wait complete. 2026-02-20T13:14:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7f1deb0c3640 1 -- 10.20.193.28:0/1978370734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 msgr2=0x7f1de410d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.764+0000 7f1deb0c3640 1 --2- 10.20.193.28:0/1978370734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 0x7f1de410d020 secure :-1 s=READY pgs=136 gs=3 cs=0 l=1 c_cookie=543164426992462032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de000a970 tx=0x7f1de00301d0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.770+0000 7f1deb0c3640 1 -- 10.20.193.28:0/1978370734 shutdown_connections 2026-02-20T13:14:10.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.770+0000 7f1deb0c3640 1 --2- 10.20.193.28:0/1978370734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 0x7f1de410d020 unknown :-1 s=CLOSED pgs=136 gs=3 cs=0 l=1 c_cookie=543164426992462032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.770+0000 7f1deb0c3640 1 --2- 10.20.193.28:0/1978370734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1de410bd10 0x7f1de410c180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 --2- 10.20.193.28:0/1978370734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1de410adc0 0x7f1de410b1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- 10.20.193.28:0/1978370734 >> 10.20.193.28:0/1978370734 conn(0x7f1de40e8760 msgr2=0x7f1de4108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- 10.20.193.28:0/1978370734 shutdown_connections 2026-02-20T13:14:10.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- 10.20.193.28:0/1978370734 wait complete. 2026-02-20T13:14:10.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 Processor -- start 2026-02-20T13:14:10.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- start start 2026-02-20T13:14:10.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1de410adc0 0x7f1de40f4b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1de410bd10 0x7f1de40f5170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 0x7f1de40f5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1de40f64b0 con 0x7f1de410c6c0 2026-02-20T13:14:10.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1de40f6620 con 0x7f1de410bd10 2026-02-20T13:14:10.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1de40f67e0 con 0x7f1de410adc0 2026-02-20T13:14:10.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea0c1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1de410adc0 0x7f1de40f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 0x7f1de40f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 0x7f1de40f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35910/0 (socket says 10.20.193.28:35910) 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 -- 10.20.193.28:0/182206431 learned_addr learned my addr 10.20.193.28:0/182206431 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1de98c0640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1de410bd10 0x7f1de40f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 -- 10.20.193.28:0/182206431 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1de410adc0 msgr2=0x7f1de40f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1de410adc0 0x7f1de40f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 -- 10.20.193.28:0/182206431 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1de410bd10 msgr2=0x7f1de40f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1de410bd10 0x7f1de40f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 -- 10.20.193.28:0/182206431 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de000a590 con 0x7f1de410c6c0 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dea8c2640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 0x7f1de40f5d70 secure :-1 s=READY pgs=137 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de0007010 tx=0x7f1de0005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dcb7fe640 1 -- 10.20.193.28:0/182206431 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1de003e070 con 0x7f1de410c6c0 2026-02-20T13:14:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dcb7fe640 1 -- 10.20.193.28:0/182206431 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1de0039950 con 0x7f1de410c6c0 2026-02-20T13:14:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1dcb7fe640 1 -- 10.20.193.28:0/182206431 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1de0042ae0 con 0x7f1de410c6c0 2026-02-20T13:14:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- 10.20.193.28:0/182206431 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de40f6a60 con 0x7f1de410c6c0 2026-02-20T13:14:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.772+0000 7f1deb0c3640 1 -- 10.20.193.28:0/182206431 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de4171510 con 0x7f1de410c6c0 2026-02-20T13:14:10.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.780+0000 7f1dc97fa640 1 -- 10.20.193.28:0/182206431 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de4111130 con 0x7f1de410c6c0 2026-02-20T13:14:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.790+0000 7f1dcb7fe640 1 -- 10.20.193.28:0/182206431 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f1de0053020 con 0x7f1de410c6c0 2026-02-20T13:14:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.790+0000 7f1dcb7fe640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1dc003f9d0 0x7f1dc005fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.791+0000 7f1dcb7fe640 1 -- 10.20.193.28:0/182206431 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f1de007a9e0 con 0x7f1de410c6c0 2026-02-20T13:14:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.791+0000 7f1dea0c1640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1dc003f9d0 0x7f1dc005fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.791+0000 7f1dcb7fe640 1 -- 10.20.193.28:0/182206431 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f1de00b3730 con 0x7f1de410c6c0 2026-02-20T13:14:10.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.794+0000 7f1dea0c1640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1dc003f9d0 0x7f1dc005fe80 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dd4004740 tx=0x7f1dd4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.820+0000 7f7be4bf3640 1 -- 10.20.193.28:0/1809474797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be010f9e0 msgr2=0x7f7be0171770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.820+0000 7f7be4bf3640 1 --2- 10.20.193.28:0/1809474797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be010f9e0 0x7f7be0171770 secure :-1 s=READY pgs=138 gs=3 cs=0 l=1 c_cookie=7840131644987917571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd000a9a0 tx=0x7f7bd00301d0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.820+0000 7f7be4bf3640 1 -- 10.20.193.28:0/1809474797 shutdown_connections 2026-02-20T13:14:10.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.820+0000 7f7be4bf3640 1 --2- 10.20.193.28:0/1809474797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be010f9e0 0x7f7be0171770 unknown :-1 s=CLOSED pgs=138 gs=3 cs=0 l=1 c_cookie=7840131644987917571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.820+0000 7f7be4bf3640 1 --2- 10.20.193.28:0/1809474797 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be010f030 0x7f7be010f4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.820+0000 7f7be4bf3640 1 --2- 10.20.193.28:0/1809474797 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be01107a0 0x7f7be0110b90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.820+0000 7f7be4bf3640 1 -- 10.20.193.28:0/1809474797 >> 10.20.193.28:0/1809474797 conn(0x7f7be00ec9d0 msgr2=0x7f7be010ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.821+0000 7f7be4bf3640 1 -- 10.20.193.28:0/1809474797 shutdown_connections 2026-02-20T13:14:10.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.821+0000 7f7be4bf3640 1 -- 10.20.193.28:0/1809474797 wait complete. 2026-02-20T13:14:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.823+0000 7f7be4bf3640 1 Processor -- start 2026-02-20T13:14:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.824+0000 7f7be4bf3640 1 -- start start 2026-02-20T13:14:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.824+0000 7f7be4bf3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be010f030 0x7f7be0063460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.824+0000 7f7be4bf3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be010f9e0 0x7f7be0171750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.824+0000 7f7be4bf3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be01107a0 0x7f7be0063ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.824+0000 7f7be4bf3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7be00648d0 con 0x7f7be01107a0 2026-02-20T13:14:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.824+0000 7f7be4bf3640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0064a40 con 0x7f7be010f030 2026-02-20T13:14:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.824+0000 7f7be4bf3640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0064c00 con 0x7f7be010f9e0 2026-02-20T13:14:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.824+0000 7f7bded76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be01107a0 0x7f7be0063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bded76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be01107a0 0x7f7be0063ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35928/0 (socket says 10.20.193.28:35928) 2026-02-20T13:14:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bded76640 1 -- 10.20.193.28:0/2604791874 learned_addr learned my addr 10.20.193.28:0/2604791874 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bded76640 1 -- 10.20.193.28:0/2604791874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be010f9e0 msgr2=0x7f7be0171750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:14:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bded76640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be010f9e0 0x7f7be0171750 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bded76640 1 -- 10.20.193.28:0/2604791874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be010f030 msgr2=0x7f7be0063460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:14:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bded76640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be010f030 0x7f7be0063460 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bded76640 1 -- 10.20.193.28:0/2604791874 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd4009570 con 0x7f7be01107a0 2026-02-20T13:14:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bded76640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be01107a0 0x7f7be0063ca0 secure :-1 s=READY pgs=139 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0039820 tx=0x7f7bd003aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bc77fe640 1 -- 10.20.193.28:0/2604791874 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd003f070 con 0x7f7be01107a0 2026-02-20T13:14:10.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bc77fe640 1 -- 10.20.193.28:0/2604791874 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bd003add0 con 0x7f7be01107a0 2026-02-20T13:14:10.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7bc77fe640 1 -- 10.20.193.28:0/2604791874 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd0043a80 con 0x7f7be01107a0 2026-02-20T13:14:10.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7be4bf3640 1 -- 10.20.193.28:0/2604791874 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd000a590 con 0x7f7be01107a0 2026-02-20T13:14:10.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.825+0000 7f7be4bf3640 1 -- 10.20.193.28:0/2604791874 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be0065110 con 0x7f7be01107a0 2026-02-20T13:14:10.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.827+0000 7f7bc57fa640 1 -- 10.20.193.28:0/2604791874 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be01758d0 con 0x7f7be01107a0 2026-02-20T13:14:10.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.827+0000 7f7bc77fe640 1 -- 10.20.193.28:0/2604791874 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f7bd004b060 con 0x7f7be01107a0 2026-02-20T13:14:10.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.828+0000 7f7bc77fe640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bac03fa20 0x7f7bac05fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.828+0000 7f7bde575640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bac03fa20 0x7f7bac05fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.829+0000 7f7bc77fe640 1 -- 10.20.193.28:0/2604791874 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f7bd0079d40 con 0x7f7be01107a0 2026-02-20T13:14:10.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.829+0000 7f7bde575640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bac03fa20 0x7f7bac05fed0 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd4005b30 tx=0x7f7bd4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.830+0000 7f7bc77fe640 1 -- 10.20.193.28:0/2604791874 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f7bd004bbd0 con 0x7f7be01107a0 2026-02-20T13:14:10.892 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial028') 2026-02-20T13:14:10.892 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-20T13:14:10.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.913+0000 7f93497fa640 1 -- 10.20.193.28:0/4189578918 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f935c179e70 con 0x7f935c1145d0 2026-02-20T13:14:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.916+0000 7f934b7fe640 1 -- 10.20.193.28:0/4189578918 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v28)=0 v28) ==== 120+0+0 (secure 0 0 0) 0x7f935800f360 con 0x7f935c1145d0 2026-02-20T13:14:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.920+0000 7f93497fa640 1 -- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f933003fa30 msgr2=0x7f933005fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.920+0000 7f93497fa640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f933003fa30 0x7f933005fee0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f935c05ebd0 tx=0x7f934c005f90 comp rx=0 tx=0).stop 2026-02-20T13:14:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.920+0000 7f93497fa640 1 -- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1145d0 msgr2=0x7f935c175dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.920+0000 7f93497fa640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1145d0 0x7f935c175dd0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f935800c520 tx=0x7f935800c9f0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.923+0000 7f1dc97fa640 1 -- 10.20.193.28:0/182206431 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1de405f3f0 con 0x7f1de410c6c0 2026-02-20T13:14:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f1dcb7fe640 1 -- 10.20.193.28:0/182206431 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f1de0047030 con 0x7f1de410c6c0 2026-02-20T13:14:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f93497fa640 1 -- 10.20.193.28:0/4189578918 shutdown_connections 2026-02-20T13:14:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f93497fa640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f933003fa30 0x7f933005fee0 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f93497fa640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f935c1559f0 0x7f935c100190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f93497fa640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f935c134ef0 0x7f935c1552d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f93497fa640 1 --2- 10.20.193.28:0/4189578918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935c1145d0 0x7f935c175dd0 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f93497fa640 1 -- 10.20.193.28:0/4189578918 >> 10.20.193.28:0/4189578918 conn(0x7f935c05b500 msgr2=0x7f935c0f6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f93497fa640 1 -- 10.20.193.28:0/4189578918 shutdown_connections 2026-02-20T13:14:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.928+0000 7f93497fa640 1 -- 10.20.193.28:0/4189578918 wait complete. 2026-02-20T13:14:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.934+0000 7f1dc97fa640 1 -- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1dc003f9d0 msgr2=0x7f1dc005fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.934+0000 7f1dc97fa640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1dc003f9d0 0x7f1dc005fe80 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dd4004740 tx=0x7f1dd4009310 comp rx=0 tx=0).stop 2026-02-20T13:14:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.934+0000 7f1dc97fa640 1 -- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 msgr2=0x7f1de40f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.934+0000 7f1dc97fa640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 0x7f1de40f5d70 secure :-1 s=READY pgs=137 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de0007010 tx=0x7f1de0005320 comp rx=0 tx=0).stop 2026-02-20T13:14:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.932+0000 7fe5e0a17640 1 -- 10.20.193.28:0/1298889158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5d40bc530 msgr2=0x7fe5d40bc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.932+0000 7fe5d9573640 1 -- 10.20.193.28:0/1298889158 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5d002fc30 con 0x7fe5d40bc530 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.932+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/1298889158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5d40bc530 0x7fe5d40bc9a0 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=17301994086965309687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5d0009950 tx=0x7fe5d002f1b0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.932+0000 7fe5e0a17640 1 -- 10.20.193.28:0/1298889158 shutdown_connections 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.932+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/1298889158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5d40bcee0 0x7fe5d411d870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.932+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/1298889158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5d40bc530 0x7fe5d40bc9a0 unknown :-1 s=CLOSED pgs=14 gs=1 cs=0 l=1 c_cookie=17301994086965309687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.932+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/1298889158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5d40bb3f0 0x7fe5d40bb7e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.933+0000 7fe5e0a17640 1 -- 10.20.193.28:0/1298889158 >> 10.20.193.28:0/1298889158 conn(0x7fe5d400c300 msgr2=0x7fe5d400c720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.933+0000 7fe5e0a17640 1 -- 10.20.193.28:0/1298889158 shutdown_connections 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.933+0000 7fe5e0a17640 1 -- 10.20.193.28:0/1298889158 wait complete. 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.933+0000 7fe5e0a17640 1 Processor -- start 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.934+0000 7fe5e0a17640 1 -- start start 2026-02-20T13:14:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.934+0000 7fe5e0a17640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5d40bb3f0 0x7fe5d40ae8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.934+0000 7fe5e0a17640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5d40bc530 0x7fe5d411d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.934+0000 7fe5e0a17640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5d40bcee0 0x7fe5d40af120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5d9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5d40bc530 0x7fe5d411d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5e0a17640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d40afd10 con 0x7fe5d40bb3f0 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5e0a17640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d40afe80 con 0x7fe5d40bc530 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5e0a17640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d40b0040 con 0x7fe5d40bcee0 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5d9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5d40bc530 0x7fe5d411d870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43596/0 (socket says 10.20.193.28:43596) 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5d9d74640 1 -- 10.20.193.28:0/3473283019 learned_addr learned my addr 10.20.193.28:0/3473283019 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5dad76640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5d40bcee0 0x7fe5d40af120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5da575640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5d40bb3f0 0x7fe5d40ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5d9d74640 1 -- 10.20.193.28:0/3473283019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5d40bcee0 msgr2=0x7fe5d40af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5d9d74640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5d40bcee0 0x7fe5d40af120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7fe5d9d74640 1 -- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5d40bb3f0 msgr2=0x7fe5d40ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7f1dc97fa640 1 -- 10.20.193.28:0/182206431 shutdown_connections 2026-02-20T13:14:10.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7f1dc97fa640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1dc003f9d0 0x7f1dc005fe80 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7f1dc97fa640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1de410c6c0 0x7f1de40f5d70 unknown :-1 s=CLOSED pgs=137 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7f1dc97fa640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1de410bd10 0x7f1de40f5170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7f1dc97fa640 1 --2- 10.20.193.28:0/182206431 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1de410adc0 0x7f1de40f4b20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7f1dc97fa640 1 -- 10.20.193.28:0/182206431 >> 10.20.193.28:0/182206431 conn(0x7f1de40e8760 msgr2=0x7f1de40eb140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7f1dc97fa640 1 -- 10.20.193.28:0/182206431 shutdown_connections 2026-02-20T13:14:10.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.935+0000 7f1dc97fa640 1 -- 10.20.193.28:0/182206431 wait complete. 2026-02-20T13:14:10.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.949+0000 7fe5d9d74640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5d40bb3f0 0x7fe5d40ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.949+0000 7fe5d9d74640 1 -- 10.20.193.28:0/3473283019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d0009570 con 0x7fe5d40bc530 2026-02-20T13:14:10.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.949+0000 7fe5da575640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5d40bb3f0 0x7fe5d40ae8c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:14:10.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.949+0000 7fe5d9d74640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5d40bc530 0x7fe5d411d870 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5d00098a0 tx=0x7fe5d002fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.949+0000 7fe5cb7fe640 1 -- 10.20.193.28:0/3473283019 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5d0005e40 con 0x7fe5d40bc530 2026-02-20T13:14:10.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.949+0000 7fe5cb7fe640 1 -- 10.20.193.28:0/3473283019 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe5d0005030 con 0x7fe5d40bc530 2026-02-20T13:14:10.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.949+0000 7fe5cb7fe640 1 -- 10.20.193.28:0/3473283019 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5d0038a90 con 0x7fe5d40bc530 2026-02-20T13:14:10.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.949+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d40b02c0 con 0x7fe5d40bc530 2026-02-20T13:14:10.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.950+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d40b06e0 con 0x7fe5d40bc530 2026-02-20T13:14:10.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.950+0000 7fe5cb7fe640 1 -- 10.20.193.28:0/3473283019 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fe5d0038c60 con 0x7fe5d40bc530 2026-02-20T13:14:10.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.951+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d4009c10 con 0x7fe5d40bc530 2026-02-20T13:14:10.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.951+0000 7fe5cb7fe640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5b803fa50 0x7fe5b805ff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.951+0000 7fe5cb7fe640 1 -- 10.20.193.28:0/3473283019 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe5d00790a0 con 0x7fe5d40bc530 2026-02-20T13:14:10.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.952+0000 7fe5da575640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5b803fa50 0x7fe5b805ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.959+0000 7fe02be19640 1 -- 10.20.193.28:0/3205798008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe02410cd90 msgr2=0x7fe02410d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.959+0000 7fe02be19640 1 --2- 10.20.193.28:0/3205798008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe02410cd90 0x7fe02410d200 secure :-1 s=READY pgs=140 gs=2 cs=0 l=1 c_cookie=18286620012455469979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe00c009910 tx=0x7fe00c02f110 comp rx=0 tx=0).stop 2026-02-20T13:14:10.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.961+0000 7fe02be19640 1 -- 10.20.193.28:0/3205798008 shutdown_connections 2026-02-20T13:14:10.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.961+0000 7fe02be19640 1 --2- 10.20.193.28:0/3205798008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe02410cd90 0x7fe02410d200 unknown :-1 s=CLOSED pgs=140 gs=2 cs=0 l=1 c_cookie=18286620012455469979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.961+0000 7fe02be19640 1 --2- 10.20.193.28:0/3205798008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe02410d740 0x7fe02416f4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.961+0000 7fe02be19640 1 --2- 10.20.193.28:0/3205798008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe02410e500 0x7fe02410e8f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.961+0000 7fe02be19640 1 -- 10.20.193.28:0/3205798008 >> 10.20.193.28:0/3205798008 conn(0x7fe0240ea770 msgr2=0x7fe02410ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.962+0000 7fe02be19640 1 -- 10.20.193.28:0/3205798008 shutdown_connections 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.963+0000 7fe02be19640 1 -- 10.20.193.28:0/3205798008 wait complete. 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.964+0000 7fe02be19640 1 Processor -- start 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.964+0000 7fe02be19640 1 -- start start 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe02be19640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe02410cd90 0x7fe0241171a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe02be19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe02410d740 0x7fe0241177f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe02be19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe02410e500 0x7fe0241183f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe02be19640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe024118b30 con 0x7fe02410d740 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe02be19640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe024118ca0 con 0x7fe02410e500 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe02be19640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe024118e60 con 0x7fe02410cd90 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe029b8e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe02410cd90 0x7fe0241171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe029b8e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe02410cd90 0x7fe0241171a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37536/0 (socket says 10.20.193.28:37536) 2026-02-20T13:14:10.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.965+0000 7fe029b8e640 1 -- 10.20.193.28:0/927898915 learned_addr learned my addr 10.20.193.28:0/927898915 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:10.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.968+0000 7fe02a38f640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe02410e500 0x7fe0241183f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.954+0000 7fe5cb7fe640 1 -- 10.20.193.28:0/3473283019 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe5d004a3b0 con 0x7fe5d40bc530 2026-02-20T13:14:10.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.956+0000 7fe5da575640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5b803fa50 0x7fe5b805ff00 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5c4004760 tx=0x7fe5c4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.971+0000 7fe029b8e640 1 -- 10.20.193.28:0/927898915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe02410e500 msgr2=0x7fe0241183f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.971+0000 7fe029b8e640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe02410e500 0x7fe0241183f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.972+0000 7fe029b8e640 1 -- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe02410d740 msgr2=0x7fe0241177f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.972+0000 7fe029b8e640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe02410d740 0x7fe0241177f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.972+0000 7fe029b8e640 1 -- 10.20.193.28:0/927898915 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe014009570 con 0x7fe02410cd90 2026-02-20T13:14:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.973+0000 7fe029b8e640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe02410cd90 0x7fe0241171a0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe014005b30 tx=0x7fe014002c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.972+0000 7f7bc57fa640 1 -- 10.20.193.28:0/2604791874 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f7be005f420 con 0x7f7be01107a0 2026-02-20T13:14:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.972+0000 7f7bc77fe640 1 -- 10.20.193.28:0/2604791874 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v29)=0 v29) ==== 108+0+0 (secure 0 0 0) 0x7f7bd004bbd0 con 0x7f7be01107a0 2026-02-20T13:14:10.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7fe01affd640 1 -- 10.20.193.28:0/927898915 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe01400ed60 con 0x7fe02410cd90 2026-02-20T13:14:10.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c0094b0 con 0x7fe02410cd90 2026-02-20T13:14:10.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7fe01affd640 1 -- 10.20.193.28:0/927898915 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe014002e70 con 0x7fe02410cd90 2026-02-20T13:14:10.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7fe01affd640 1 -- 10.20.193.28:0/927898915 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe01400ed60 con 0x7fe02410cd90 2026-02-20T13:14:10.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7f7bc57fa640 1 -- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bac03fa20 msgr2=0x7f7bac05fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7f7bc57fa640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bac03fa20 0x7f7bac05fed0 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd4005b30 tx=0x7f7bd4009310 comp rx=0 tx=0).stop 2026-02-20T13:14:10.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7f7bc57fa640 1 -- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be01107a0 msgr2=0x7f7be0063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:10.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7f7bc57fa640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be01107a0 0x7f7be0063ca0 secure :-1 s=READY pgs=139 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0039820 tx=0x7f7bd003aac0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.975+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe024159620 con 0x7fe02410cd90 2026-02-20T13:14:10.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.976+0000 7fe01affd640 1 -- 10.20.193.28:0/927898915 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7fe014016070 con 0x7fe02410cd90 2026-02-20T13:14:10.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.979+0000 7fe01affd640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe00803fa30 0x7fe00805fee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:10.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.979+0000 7fe01affd640 1 -- 10.20.193.28:0/927898915 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe014059650 con 0x7fe02410cd90 2026-02-20T13:14:10.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.979+0000 7fe02938d640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe00803fa30 0x7fe00805fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:10.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.980+0000 7fe02938d640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe00803fa30 0x7fe00805fee0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe00c0059f0 tx=0x7fe00c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.986+0000 7f7bc57fa640 1 -- 10.20.193.28:0/2604791874 shutdown_connections 2026-02-20T13:14:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.986+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe024171420 con 0x7fe02410cd90 2026-02-20T13:14:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.986+0000 7f7bc57fa640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bac03fa20 0x7f7bac05fed0 unknown :-1 s=CLOSED pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.986+0000 7f7bc57fa640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be01107a0 0x7f7be0063ca0 unknown :-1 s=CLOSED pgs=139 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.986+0000 7f7bc57fa640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be010f9e0 0x7f7be0171750 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.986+0000 7f7bc57fa640 1 --2- 10.20.193.28:0/2604791874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be010f030 0x7f7be0063460 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:10.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.986+0000 7f7bc57fa640 1 -- 10.20.193.28:0/2604791874 >> 10.20.193.28:0/2604791874 conn(0x7f7be00ec9d0 msgr2=0x7f7be00eef10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:10.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.987+0000 7f7bc57fa640 1 -- 10.20.193.28:0/2604791874 shutdown_connections 2026-02-20T13:14:10.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.987+0000 7f7bc57fa640 1 -- 10.20.193.28:0/2604791874 wait complete. 2026-02-20T13:14:10.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:10.991+0000 7fe01affd640 1 -- 10.20.193.28:0/927898915 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe01405a060 con 0x7fe02410cd90 2026-02-20T13:14:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.000+0000 7f85ad5e6640 1 -- 10.20.193.28:0/3604934705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85a805e750 msgr2=0x7f85a81345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.000+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/3604934705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85a805e750 0x7f85a81345e0 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=5294032219695346623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f859c00aa30 tx=0x7f859c031450 comp rx=0 tx=0).stop 2026-02-20T13:14:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.000+0000 7f85ad5e6640 1 -- 10.20.193.28:0/3604934705 shutdown_connections 2026-02-20T13:14:11.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.000+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/3604934705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85a8155730 0x7f85a8175be0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.000+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/3604934705 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85a8134b70 0x7f85a8154ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.000+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/3604934705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85a805e750 0x7f85a81345e0 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=5294032219695346623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.001+0000 7f85ad5e6640 1 -- 10.20.193.28:0/3604934705 >> 10.20.193.28:0/3604934705 conn(0x7f85a805b340 msgr2=0x7f85a805b760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.002+0000 7f85ad5e6640 1 -- 10.20.193.28:0/3604934705 shutdown_connections 2026-02-20T13:14:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.002+0000 7f85ad5e6640 1 -- 10.20.193.28:0/3604934705 wait complete. 2026-02-20T13:14:11.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.003+0000 7f85ad5e6640 1 Processor -- start 2026-02-20T13:14:11.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.003+0000 7f85ad5e6640 1 -- start start 2026-02-20T13:14:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.004+0000 7f85ad5e6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85a805e750 0x7f85a8142c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.004+0000 7f85ad5e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85a8134b70 0x7f85a81345e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.004+0000 7f85ad5e6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85a8155730 0x7f85a8143480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.004+0000 7f85ad5e6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f85a8144070 con 0x7f85a8134b70 2026-02-20T13:14:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.004+0000 7f85ad5e6640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81441e0 con 0x7f85a805e750 2026-02-20T13:14:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.004+0000 7f85ad5e6640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81443a0 con 0x7f85a8155730 2026-02-20T13:14:11.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.005+0000 7f85a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85a8134b70 0x7f85a81345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.005+0000 7f85a7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85a805e750 0x7f85a8142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.005+0000 7f85acde5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85a8155730 0x7f85a8143480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.006+0000 7f85acde5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85a8155730 0x7f85a8143480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37550/0 (socket says 10.20.193.28:37550) 2026-02-20T13:14:11.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.006+0000 7f85acde5640 1 -- 10.20.193.28:0/2569073763 learned_addr learned my addr 10.20.193.28:0/2569073763 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:11.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.006+0000 7f85acde5640 1 -- 10.20.193.28:0/2569073763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85a805e750 msgr2=0x7f85a8142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.006+0000 7f85acde5640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85a805e750 0x7f85a8142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.006+0000 7f85acde5640 1 -- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85a8134b70 msgr2=0x7f85a81345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.005+0000 7f85a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85a8134b70 0x7f85a81345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35956/0 (socket says 10.20.193.28:35956) 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.006+0000 7f85acde5640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85a8134b70 0x7f85a81345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.006+0000 7f85acde5640 1 -- 10.20.193.28:0/2569073763 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c00a650 con 0x7f85a8155730 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.006+0000 7f85a77fe640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85a8134b70 0x7f85a81345e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.009+0000 7f85acde5640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85a8155730 0x7f85a8143480 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f859800b520 tx=0x7f859800b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.010+0000 7f85a57fa640 1 -- 10.20.193.28:0/2569073763 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85980044a0 con 0x7f85a8155730 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.010+0000 7f85a57fa640 1 -- 10.20.193.28:0/2569073763 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8598002b80 con 0x7f85a8155730 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.012+0000 7f85a57fa640 1 -- 10.20.193.28:0/2569073763 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8598010d10 con 0x7f85a8155730 2026-02-20T13:14:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.012+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a8144680 con 0x7f85a8155730 2026-02-20T13:14:11.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.012+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a8144b50 con 0x7f85a8155730 2026-02-20T13:14:11.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.013+0000 7f85a57fa640 1 -- 10.20.193.28:0/2569073763 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f8598002cf0 con 0x7f85a8155730 2026-02-20T13:14:11.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.014+0000 7f85a57fa640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f857c03f950 0x7f857c05fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.014+0000 7f85a7fff640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f857c03f950 0x7f857c05fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.015+0000 7f85a57fa640 1 -- 10.20.193.28:0/2569073763 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f8598005a70 con 0x7f85a8155730 2026-02-20T13:14:11.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.016+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a8055d30 con 0x7f85a8155730 2026-02-20T13:14:11.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.016+0000 7f85a7fff640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f857c03f950 0x7f857c05fe00 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f859c00a980 tx=0x7f859c03c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:11.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.019+0000 7f85a57fa640 1 -- 10.20.193.28:0/2569073763 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8598059060 con 0x7f85a8155730 2026-02-20T13:14:11.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.094+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fe5d4008980 con 0x7fe5d40bc530 2026-02-20T13:14:11.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.095+0000 7fe5cb7fe640 1 -- 10.20.193.28:0/3473283019 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v29)=0 v29) ==== 106+0+0 (secure 0 0 0) 0x7fe5d0046030 con 0x7fe5d40bc530 2026-02-20T13:14:11.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.097+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5b803fa50 msgr2=0x7fe5b805ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.097+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5b803fa50 0x7fe5b805ff00 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5c4004760 tx=0x7fe5c4008040 comp rx=0 tx=0).stop 2026-02-20T13:14:11.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.097+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5d40bc530 msgr2=0x7fe5d411d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.097+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5d40bc530 0x7fe5d411d870 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5d00098a0 tx=0x7fe5d002fcc0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.098+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 shutdown_connections 2026-02-20T13:14:11.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.098+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5b803fa50 0x7fe5b805ff00 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.098+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5d40bcee0 0x7fe5d40af120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.098+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5d40bc530 0x7fe5d411d870 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.098+0000 7fe5e0a17640 1 --2- 10.20.193.28:0/3473283019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5d40bb3f0 0x7fe5d40ae8c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.098+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 >> 10.20.193.28:0/3473283019 conn(0x7fe5d400c300 msgr2=0x7fe5d400d350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.098+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 shutdown_connections 2026-02-20T13:14:11.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.098+0000 7fe5e0a17640 1 -- 10.20.193.28:0/3473283019 wait complete. 2026-02-20T13:14:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.113+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fe02405f4f0 con 0x7fe02410cd90 2026-02-20T13:14:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.128+0000 7fe01affd640 1 -- 10.20.193.28:0/927898915 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7fe01400c2d0 con 0x7fe02410cd90 2026-02-20T13:14:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.134+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe00803fa30 msgr2=0x7fe00805fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe00803fa30 0x7fe00805fee0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe00c0059f0 tx=0x7fe00c005900 comp rx=0 tx=0).stop 2026-02-20T13:14:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.134+0000 7f403bfff640 1 -- 10.20.193.28:0/3040535752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 msgr2=0x7f403c154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.134+0000 7f403bfff640 1 --2- 10.20.193.28:0/3040535752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 0x7f403c154ff0 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=17465437853205113324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402400d990 tx=0x7f40240311b0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.134+0000 7f403bfff640 1 -- 10.20.193.28:0/3040535752 shutdown_connections 2026-02-20T13:14:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.134+0000 7f403bfff640 1 --2- 10.20.193.28:0/3040535752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 0x7f403c154ff0 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=17465437853205113324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.134+0000 7f403bfff640 1 --2- 10.20.193.28:0/3040535752 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f403c155730 0x7f403c175be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.134+0000 7f403bfff640 1 --2- 10.20.193.28:0/3040535752 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f403c05e750 0x7f403c1345e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.134+0000 7f403bfff640 1 -- 10.20.193.28:0/3040535752 >> 10.20.193.28:0/3040535752 conn(0x7f403c05b340 msgr2=0x7f403c05b760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe02410cd90 msgr2=0x7fe0241171a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe02410cd90 0x7fe0241171a0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe014005b30 tx=0x7fe014002c10 comp rx=0 tx=0).stop 2026-02-20T13:14:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 shutdown_connections 2026-02-20T13:14:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe00803fa30 0x7fe00805fee0 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe02410d740 0x7fe0241177f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7f403bfff640 1 -- 10.20.193.28:0/3040535752 shutdown_connections 2026-02-20T13:14:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7f403bfff640 1 -- 10.20.193.28:0/3040535752 wait complete. 2026-02-20T13:14:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe02410e500 0x7fe0241183f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 --2- 10.20.193.28:0/927898915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe02410cd90 0x7fe0241171a0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.135+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 >> 10.20.193.28:0/927898915 conn(0x7fe0240ea770 msgr2=0x7fe02410ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.136+0000 7f403bfff640 1 Processor -- start 2026-02-20T13:14:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.137+0000 7f403bfff640 1 -- start start 2026-02-20T13:14:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.137+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 shutdown_connections 2026-02-20T13:14:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.137+0000 7fe02be19640 1 -- 10.20.193.28:0/927898915 wait complete. 2026-02-20T13:14:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f403c05e750 0x7f403c1345e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 0x7f403c14a930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f403c05e750 0x7f403c1345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f403c05e750 0x7f403c1345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37568/0 (socket says 10.20.193.28:37568) 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f403c155730 0x7f403c14b060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403affd640 1 -- 10.20.193.28:0/2579982160 learned_addr learned my addr 10.20.193.28:0/2579982160 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f403c14bc50 con 0x7f403c134b70 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403b7fe640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f403c155730 0x7f403c14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f403c14bdc0 con 0x7f403c155730 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f403c14bf80 con 0x7f403c05e750 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.138+0000 7f403a7fc640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 0x7f403c14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.139+0000 7f403affd640 1 -- 10.20.193.28:0/2579982160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f403c155730 msgr2=0x7f403c14b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.139+0000 7f403affd640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f403c155730 0x7f403c14b060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.139+0000 7f403affd640 1 -- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 msgr2=0x7f403c14a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.139+0000 7f403affd640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 0x7f403c14a930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.139+0000 7f403affd640 1 -- 10.20.193.28:0/2579982160 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403000c050 con 0x7f403c05e750 2026-02-20T13:14:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.139+0000 7f403a7fc640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 0x7f403c14a930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:14:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.139+0000 7f403affd640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f403c05e750 0x7f403c1345e0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f403000c9b0 tx=0x7f403000ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.141+0000 7f401bfff640 1 -- 10.20.193.28:0/2579982160 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4030004500 con 0x7f403c05e750 2026-02-20T13:14:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.141+0000 7f401bfff640 1 -- 10.20.193.28:0/2579982160 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4030010040 con 0x7f403c05e750 2026-02-20T13:14:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.142+0000 7f401bfff640 1 -- 10.20.193.28:0/2579982160 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4030002ea0 con 0x7f403c05e750 2026-02-20T13:14:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.142+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402400d5b0 con 0x7f403c05e750 2026-02-20T13:14:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.142+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c14c550 con 0x7f403c05e750 2026-02-20T13:14:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.144+0000 7f401bfff640 1 -- 10.20.193.28:0/2579982160 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f403001b030 con 0x7f403c05e750 2026-02-20T13:14:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.144+0000 7f401bfff640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f401403fa20 0x7f401405fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.144+0000 7f401bfff640 1 -- 10.20.193.28:0/2579982160 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4030053fc0 con 0x7f403c05e750 2026-02-20T13:14:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.144+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403c055d30 con 0x7f403c05e750 2026-02-20T13:14:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.146+0000 7f403a7fc640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f401403fa20 0x7f401405fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.148+0000 7f401bfff640 1 -- 10.20.193.28:0/2579982160 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f403001d7e0 con 0x7f403c05e750 2026-02-20T13:14:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.149+0000 7f403a7fc640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f401403fa20 0x7f401405fed0 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402400d8e0 tx=0x7f402403d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:11.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.151+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f85a8179ca0 con 0x7f85a8155730 2026-02-20T13:14:11.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.155+0000 7f85a57fa640 1 -- 10.20.193.28:0/2569073763 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v31)=0 v31) ==== 111+0+0 (secure 0 0 0) 0x7f8598019cc0 con 0x7f85a8155730 2026-02-20T13:14:11.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f857c03f950 msgr2=0x7f857c05fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f857c03f950 0x7f857c05fe00 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f859c00a980 tx=0x7f859c03c040 comp rx=0 tx=0).stop 2026-02-20T13:14:11.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85a8155730 msgr2=0x7f85a8143480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85a8155730 0x7f85a8143480 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f859800b520 tx=0x7f859800b9f0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 shutdown_connections 2026-02-20T13:14:11.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f857c03f950 0x7f857c05fe00 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85a8134b70 0x7f85a81345e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85a8155730 0x7f85a8143480 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 --2- 10.20.193.28:0/2569073763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85a805e750 0x7f85a8142c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 >> 10.20.193.28:0/2569073763 conn(0x7f85a805b340 msgr2=0x7f85a81374c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 shutdown_connections 2026-02-20T13:14:11.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.158+0000 7f85ad5e6640 1 -- 10.20.193.28:0/2569073763 wait complete. 2026-02-20T13:14:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.182+0000 7f41a1804640 1 -- 10.20.193.28:0/218419610 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f419c1145d0 msgr2=0x7f419c114a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.182+0000 7f41a1804640 1 --2- 10.20.193.28:0/218419610 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f419c1145d0 0x7f419c114a40 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=10427001669180778293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4184009950 tx=0x7f418402f190 comp rx=0 tx=0).stop 2026-02-20T13:14:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.183+0000 7f41a1804640 1 -- 10.20.193.28:0/218419610 shutdown_connections 2026-02-20T13:14:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.183+0000 7f41a1804640 1 --2- 10.20.193.28:0/218419610 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f419c114f80 0x7f419c177bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.183+0000 7f41a1804640 1 --2- 10.20.193.28:0/218419610 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f419c1145d0 0x7f419c114a40 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=10427001669180778293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.183+0000 7f41a1804640 1 --2- 10.20.193.28:0/218419610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f419c05dcc0 0x7f419c05e090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.183+0000 7f41a1804640 1 -- 10.20.193.28:0/218419610 >> 10.20.193.28:0/218419610 conn(0x7f419c05b530 msgr2=0x7f419c05b950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.184+0000 7f41a1804640 1 -- 10.20.193.28:0/218419610 shutdown_connections 2026-02-20T13:14:11.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.184+0000 7f41a1804640 1 -- 10.20.193.28:0/218419610 wait complete. 2026-02-20T13:14:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.185+0000 7f41a1804640 1 Processor -- start 2026-02-20T13:14:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.185+0000 7f41a1804640 1 -- start start 2026-02-20T13:14:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.185+0000 7f41a1804640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f419c05dcc0 0x7f419c0ff970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.185+0000 7f41a1804640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f419c1145d0 0x7f419c177bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.185+0000 7f41a1804640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f419c114f80 0x7f419c1001d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.185+0000 7f41a1804640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f419c100dc0 con 0x7f419c1145d0 2026-02-20T13:14:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.185+0000 7f41a1804640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f419c100f30 con 0x7f419c05dcc0 2026-02-20T13:14:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.185+0000 7f41a1804640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f419c1010f0 con 0x7f419c114f80 2026-02-20T13:14:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.186+0000 7f419b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f419c114f80 0x7f419c1001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.186+0000 7f419affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f419c05dcc0 0x7f419c0ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.186+0000 7f419b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f419c114f80 0x7f419c1001d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37590/0 (socket says 10.20.193.28:37590) 2026-02-20T13:14:11.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.186+0000 7f419b7fe640 1 -- 10.20.193.28:0/69059178 learned_addr learned my addr 10.20.193.28:0/69059178 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:11.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.186+0000 7f419a7fc640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f419c1145d0 0x7f419c177bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.187+0000 7f419a7fc640 1 -- 10.20.193.28:0/69059178 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f419c114f80 msgr2=0x7f419c1001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.187+0000 7f419a7fc640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f419c114f80 0x7f419c1001d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.187+0000 7f419a7fc640 1 -- 10.20.193.28:0/69059178 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f419c05dcc0 msgr2=0x7f419c0ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.187+0000 7f419a7fc640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f419c05dcc0 0x7f419c0ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.187+0000 7f419a7fc640 1 -- 10.20.193.28:0/69059178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4184009570 con 0x7f419c1145d0 2026-02-20T13:14:11.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.188+0000 7f419a7fc640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f419c1145d0 0x7f419c177bf0 secure :-1 s=READY pgs=142 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4184002d80 tx=0x7f418402fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:11.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.188+0000 7f41a0802640 1 -- 10.20.193.28:0/69059178 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f418403d070 con 0x7f419c1145d0 2026-02-20T13:14:11.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.189+0000 7f41a0802640 1 -- 10.20.193.28:0/69059178 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41840043d0 con 0x7f419c1145d0 2026-02-20T13:14:11.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.189+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c101370 con 0x7f419c1145d0 2026-02-20T13:14:11.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.189+0000 7f41a0802640 1 -- 10.20.193.28:0/69059178 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4184041ce0 con 0x7f419c1145d0 2026-02-20T13:14:11.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.189+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c1017e0 con 0x7f419c1145d0 2026-02-20T13:14:11.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.190+0000 7f41a0802640 1 -- 10.20.193.28:0/69059178 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f4184041410 con 0x7f419c1145d0 2026-02-20T13:14:11.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.190+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c17deb0 con 0x7f419c1145d0 2026-02-20T13:14:11.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.191+0000 7f41a0802640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f417003fa20 0x7f417005fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.191+0000 7f41a0802640 1 -- 10.20.193.28:0/69059178 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4184041e40 con 0x7f419c1145d0 2026-02-20T13:14:11.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.191+0000 7f419affd640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f417003fa20 0x7f417005fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.192+0000 7f419affd640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f417003fa20 0x7f417005fed0 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4190004740 tx=0x7f41900073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:11.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.193+0000 7f41a0802640 1 -- 10.20.193.28:0/69059178 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f418404ab00 con 0x7f419c1145d0 2026-02-20T13:14:11.241 INFO:journalctl@ceph.mgr.y.trial034.stdout:Feb 20 13:14:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-y[44432]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T13:14:11.241 INFO:journalctl@ceph.mgr.y.trial034.stdout:Feb 20 13:14:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-y[44432]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T13:14:11.241 INFO:journalctl@ceph.mgr.y.trial034.stdout:Feb 20 13:14:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-y[44432]: from numpy import show_config as show_numpy_config 2026-02-20T13:14:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.265+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f403c14c770 con 0x7f403c05e750 2026-02-20T13:14:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.269+0000 7f401bfff640 1 -- 10.20.193.28:0/2579982160 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f40300129a0 con 0x7f403c05e750 2026-02-20T13:14:11.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f401403fa20 msgr2=0x7f401405fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f401403fa20 0x7f401405fed0 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402400d8e0 tx=0x7f402403d040 comp rx=0 tx=0).stop 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f403c05e750 msgr2=0x7f403c1345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f403c05e750 0x7f403c1345e0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f403000c9b0 tx=0x7f403000ce80 comp rx=0 tx=0).stop 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 shutdown_connections 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f401403fa20 0x7f401405fed0 unknown :-1 s=CLOSED pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f403c134b70 0x7f403c14a930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f403c155730 0x7f403c14b060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 --2- 10.20.193.28:0/2579982160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f403c05e750 0x7f403c1345e0 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 >> 10.20.193.28:0/2579982160 conn(0x7f403c05b340 msgr2=0x7f403c15c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 shutdown_connections 2026-02-20T13:14:11.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.272+0000 7f403bfff640 1 -- 10.20.193.28:0/2579982160 wait complete. 2026-02-20T13:14:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.314+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f419c17d7a0 con 0x7f419c1145d0 2026-02-20T13:14:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.317+0000 7f41a0802640 1 -- 10.20.193.28:0/69059178 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v33)=0 v33) ==== 125+0+0 (secure 0 0 0) 0x7f4184045170 con 0x7f419c1145d0 2026-02-20T13:14:11.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.320+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f417003fa20 msgr2=0x7f417005fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.320+0000 7f41a1804640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f417003fa20 0x7f417005fed0 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4190004740 tx=0x7f41900073d0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.320+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f419c1145d0 msgr2=0x7f419c177bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.320+0000 7f41a1804640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f419c1145d0 0x7f419c177bf0 secure :-1 s=READY pgs=142 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4184002d80 tx=0x7f418402fc20 comp rx=0 tx=0).stop 2026-02-20T13:14:11.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.326+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 shutdown_connections 2026-02-20T13:14:11.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.326+0000 7f41a1804640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f417003fa20 0x7f417005fed0 unknown :-1 s=CLOSED pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.326+0000 7f41a1804640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f419c1145d0 0x7f419c177bf0 unknown :-1 s=CLOSED pgs=142 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.326+0000 7f41a1804640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f419c114f80 0x7f419c1001d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.326+0000 7f41a1804640 1 --2- 10.20.193.28:0/69059178 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f419c05dcc0 0x7f419c0ff970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.326+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 >> 10.20.193.28:0/69059178 conn(0x7f419c05b530 msgr2=0x7f419c0f5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.326+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 shutdown_connections 2026-02-20T13:14:11.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.326+0000 7f41a1804640 1 -- 10.20.193.28:0/69059178 wait complete. 2026-02-20T13:14:11.343 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.344 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.344 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.344 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.344 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.344 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.344 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.345 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.345 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.496 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.496 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dd845518-0e5d-11f1-9909-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-20T13:14:11.496 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config dump 2026-02-20T13:14:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: Reconfiguring mgr.x (unknown last config time)... 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: Reconfiguring daemon mgr.x on trial028 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/309659957' entity='client.admin' 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1558009099' entity='client.admin' 2026-02-20T13:14:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4189578918' entity='client.admin' 2026-02-20T13:14:11.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/182206431' entity='client.admin' 2026-02-20T13:14:11.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:11 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/69059178' entity='client.admin' 2026-02-20T13:14:11.680 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:11.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: Reconfiguring mgr.x (unknown last config time)... 2026-02-20T13:14:11.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:11.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: Reconfiguring daemon mgr.x on trial028 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/309659957' entity='client.admin' 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1558009099' entity='client.admin' 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4189578918' entity='client.admin' 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/182206431' entity='client.admin' 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:11 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/69059178' entity='client.admin' 2026-02-20T13:14:11.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: Reconfiguring mgr.x (unknown last config time)... 2026-02-20T13:14:11.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-20T13:14:11.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-20T13:14:11.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:11.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: Reconfiguring daemon mgr.x on trial028 2026-02-20T13:14:11.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/309659957' entity='client.admin' 2026-02-20T13:14:11.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1558009099' entity='client.admin' 2026-02-20T13:14:11.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4189578918' entity='client.admin' 2026-02-20T13:14:11.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/182206431' entity='client.admin' 2026-02-20T13:14:11.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' 2026-02-20T13:14:11.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:11 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/69059178' entity='client.admin' 2026-02-20T13:14:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 -- 10.20.193.28:0/2992614292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6868114920 msgr2=0x7f6868154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 --2- 10.20.193.28:0/2992614292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6868114920 0x7f6868154ec0 secure :-1 s=READY pgs=143 gs=2 cs=0 l=1 c_cookie=8973215608253357575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6850009950 tx=0x7f685002f190 comp rx=0 tx=0).stop 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 -- 10.20.193.28:0/2992614292 shutdown_connections 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 --2- 10.20.193.28:0/2992614292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6868114920 0x7f6868154ec0 unknown :-1 s=CLOSED pgs=143 gs=2 cs=0 l=1 c_cookie=8973215608253357575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 --2- 10.20.193.28:0/2992614292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6868155600 0x7f6868175ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 --2- 10.20.193.28:0/2992614292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6868113fa0 0x7f6868114390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 -- 10.20.193.28:0/2992614292 >> 10.20.193.28:0/2992614292 conn(0x7f6868064760 msgr2=0x7f6868064b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 -- 10.20.193.28:0/2992614292 shutdown_connections 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 -- 10.20.193.28:0/2992614292 wait complete. 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 Processor -- start 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.849+0000 7f686cac0640 1 -- start start 2026-02-20T13:14:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f686cac0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6868113fa0 0x7f68680ffb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f686cac0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6868114920 0x7f6868154ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f686cac0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6868155600 0x7f68681003c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f686cac0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6868101020 con 0x7f6868113fa0 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f686cac0640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6868101190 con 0x7f6868155600 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f686cac0640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6868101350 con 0x7f6868114920 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6868113fa0 0x7f68680ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6868155600 0x7f68681003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6868155600 0x7f68681003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43678/0 (socket says 10.20.193.28:43678) 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866d76640 1 -- 10.20.193.28:0/2142128141 learned_addr learned my addr 10.20.193.28:0/2142128141 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6865d74640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6868114920 0x7f6868154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866d76640 1 -- 10.20.193.28:0/2142128141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6868114920 msgr2=0x7f6868154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866d76640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6868114920 0x7f6868154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866d76640 1 -- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6868113fa0 msgr2=0x7f68680ffb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866d76640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6868113fa0 0x7f68680ffb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.850+0000 7f6866d76640 1 -- 10.20.193.28:0/2142128141 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6850009570 con 0x7f6868155600 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.851+0000 7f6866d76640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6868155600 0x7f68681003c0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6858006e90 tx=0x7f685800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.851+0000 7f684f7fe640 1 -- 10.20.193.28:0/2142128141 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6858005500 con 0x7f6868155600 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.851+0000 7f684f7fe640 1 -- 10.20.193.28:0/2142128141 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6858005e10 con 0x7f6868155600 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.851+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6868101630 con 0x7f6868155600 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.851+0000 7f684f7fe640 1 -- 10.20.193.28:0/2142128141 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6858003a70 con 0x7f6868155600 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.851+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6868101b50 con 0x7f6868155600 2026-02-20T13:14:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.851+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6868179e50 con 0x7f6868155600 2026-02-20T13:14:11.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.852+0000 7f684f7fe640 1 -- 10.20.193.28:0/2142128141 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 12) ==== 52870+0+0 (secure 0 0 0) 0x7f685800c8d0 con 0x7f6868155600 2026-02-20T13:14:11.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.852+0000 7f684f7fe640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f684003f9d0 0x7f684005fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:11.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.852+0000 7f684f7fe640 1 -- 10.20.193.28:0/2142128141 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f6858055100 con 0x7f6868155600 2026-02-20T13:14:11.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.853+0000 7f6866575640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f684003f9d0 0x7f684005fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:11.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.853+0000 7f6866575640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f684003f9d0 0x7f684005fe80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f685c004740 tx=0x7f685c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:11.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.855+0000 7f684f7fe640 1 -- 10.20.193.28:0/2142128141 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f68580204e0 con 0x7f6868155600 2026-02-20T13:14:11.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.969+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6868114370 con 0x7f6868155600 2026-02-20T13:14:11.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.969+0000 7f684f7fe640 1 -- 10.20.193.28:0/2142128141 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+19046 (secure 0 0 0) 0x7f6858020300 con 0x7f6868155600 2026-02-20T13:14:11.972 INFO:teuthology.orchestra.run.trial028.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global dev auth_debug true 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 * 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global dev debug_asserts_on_shutdown true 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_file true 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_journald false 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_stderr false 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_allow_pool_delete true 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_cluster_log_to_file true 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global dev ms_die_on_bug true 2026-02-20T13:14:11.973 INFO:teuthology.orchestra.run.trial028.stdout:global dev ms_die_on_old_message true 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:global dev ms_die_on_skipped_message false 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_mon 20/20 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_ms 1/1 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_paxos 20/20 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_data_avail_warn 5 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_op_complaint_time 120 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-20T13:14:11.974 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced client_mount_timeout 30 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_client 20/20 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_mgr 20/20 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_ms 1/1 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bdev_debug_aio true 2026-02-20T13:14:11.975 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bluestore_fsck_on_mount true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_bluefs 20/20 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_bluestore 20/20 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_ms 1/1 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_osd 20/20 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_rocksdb 10/10 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_misdirected_ops true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_op_order true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_shutdown true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_max_omap_entries_per_request 10000 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_memory_target_autotune true 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_objectstore bluestore * 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_queue debug_random * 2026-02-20T13:14:11.976 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_recover_clone_overlap true 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_mds 20/20 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_mds_balancer 20/20 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_ms 2/2 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_merge_size 5 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_split_bits 3 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_split_size 100 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_debug_frag true 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_debug_scatterstat true 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_verify_scatter true 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced rados_mon_op_timeout 900 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced rados_osd_op_timeout 900 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:client advanced client_mount_timeout 600 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:client advanced debug_client 20/20 2026-02-20T13:14:11.977 INFO:teuthology.orchestra.run.trial028.stdout:client advanced debug_ms 1/1 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stdout:client advanced rados_mon_op_timeout 900 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stdout:client advanced rados_osd_op_timeout 900 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.970+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f684003f9d0 msgr2=0x7f684005fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.970+0000 7f686cac0640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f684003f9d0 0x7f684005fe80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f685c004740 tx=0x7f685c00b410 comp rx=0 tx=0).stop 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.970+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6868155600 msgr2=0x7f68681003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.970+0000 7f686cac0640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6868155600 0x7f68681003c0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6858006e90 tx=0x7f685800edf0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.971+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 shutdown_connections 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.971+0000 7f686cac0640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f684003f9d0 0x7f684005fe80 unknown :-1 s=CLOSED pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.971+0000 7f686cac0640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6868155600 0x7f68681003c0 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.971+0000 7f686cac0640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6868114920 0x7f6868154ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.971+0000 7f686cac0640 1 --2- 10.20.193.28:0/2142128141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6868113fa0 0x7f68680ffb80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.971+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 >> 10.20.193.28:0/2142128141 conn(0x7f6868064760 msgr2=0x7f68680f66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.971+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 shutdown_connections 2026-02-20T13:14:11.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:11.971+0000 7f686cac0640 1 -- 10.20.193.28:0/2142128141 wait complete. 2026-02-20T13:14:12.073 INFO:tasks.cephadm:Deploying OSDs... 2026-02-20T13:14:12.073 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:14:12.073 DEBUG:teuthology.orchestra.run.trial028:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T13:14:12.114 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T13:14:12.114 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_1 2026-02-20T13:14:12.192 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T13:14:12.192 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:12.192 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 749 Links: 1 2026-02-20T13:14:12.192 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:12.192 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:12.192 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 13:13:45.527372027 +0000 2026-02-20T13:14:12.192 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 13:11:06.369566542 +0000 2026-02-20T13:14:12.193 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 13:11:06.369566542 +0000 2026-02-20T13:14:12.193 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 13:11:06.369566542 +0000 2026-02-20T13:14:12.193 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T13:14:12.286 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T13:14:12.286 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T13:14:12.286 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000208045 s, 2.5 MB/s 2026-02-20T13:14:12.289 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T13:14:12.329 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_2 2026-02-20T13:14:12.407 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T13:14:12.408 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:12.408 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 777 Links: 1 2026-02-20T13:14:12.408 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:12.408 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:12.408 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 13:13:45.564371001 +0000 2026-02-20T13:14:12.408 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 13:11:06.756556819 +0000 2026-02-20T13:14:12.408 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 13:11:06.756556819 +0000 2026-02-20T13:14:12.408 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 13:11:06.756556819 +0000 2026-02-20T13:14:12.409 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T13:14:12.501 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T13:14:12.501 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T13:14:12.501 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000203707 s, 2.5 MB/s 2026-02-20T13:14:12.503 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T13:14:12.544 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_3 2026-02-20T13:14:12.622 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T13:14:12.622 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:12.622 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 802 Links: 1 2026-02-20T13:14:12.622 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:12.623 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:12.623 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 13:13:45.600370003 +0000 2026-02-20T13:14:12.623 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 13:11:07.119547699 +0000 2026-02-20T13:14:12.623 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 13:11:07.119547699 +0000 2026-02-20T13:14:12.623 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 13:11:07.119547699 +0000 2026-02-20T13:14:12.623 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T13:14:12.715 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T13:14:12.716 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T13:14:12.716 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000325844 s, 1.6 MB/s 2026-02-20T13:14:12.718 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T13:14:12.758 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_4 2026-02-20T13:14:12.836 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T13:14:12.837 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:12.837 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 832 Links: 1 2026-02-20T13:14:12.837 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:12.837 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:12.837 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 13:13:45.635369032 +0000 2026-02-20T13:14:12.837 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 13:11:08.505512875 +0000 2026-02-20T13:14:12.837 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 13:11:08.505512875 +0000 2026-02-20T13:14:12.837 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 13:11:08.505512875 +0000 2026-02-20T13:14:12.838 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T13:14:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: Standby manager daemon z started 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2142128141' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: Standby manager daemon y started 2026-02-20T13:14:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-20T13:14:12.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-20T13:14:12.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-20T13:14:12.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-20T13:14:12.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.904 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T13:14:12.904 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T13:14:12.904 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000218866 s, 2.3 MB/s 2026-02-20T13:14:12.906 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T13:14:12.946 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T13:14:12.946 DEBUG:teuthology.orchestra.run.trial034:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T13:14:12.965 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T13:14:12.966 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_1 2026-02-20T13:14:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: Standby manager daemon z started 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2142128141' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: Standby manager daemon y started 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-20T13:14:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-20T13:14:12.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-20T13:14:12.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-20T13:14:12.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:12.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:12.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:12.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:12.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:12.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: Standby manager daemon z started 2026-02-20T13:14:12.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-20T13:14:12.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-20T13:14:12.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-20T13:14:12.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.? 10.20.193.127:0/355221633' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-20T13:14:12.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2142128141' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-20T13:14:12.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: Standby manager daemon y started 2026-02-20T13:14:12.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-20T13:14:12.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-20T13:14:12.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-20T13:14:12.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.? 10.20.193.34:0/622266410' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-20T13:14:12.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:13.011 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T13:14:13.012 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:13.012 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 902 Links: 1 2026-02-20T13:14:13.012 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:13.012 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:13.012 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-20 13:14:09.573619354 +0000 2026-02-20T13:14:13.013 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-20 13:10:38.138237122 +0000 2026-02-20T13:14:13.013 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-20 13:10:38.138237122 +0000 2026-02-20T13:14:13.013 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-20 13:10:38.138237122 +0000 2026-02-20T13:14:13.013 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T13:14:13.078 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-20T13:14:13.078 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-20T13:14:13.079 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000156039 s, 3.3 MB/s 2026-02-20T13:14:13.080 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T13:14:13.138 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_2 2026-02-20T13:14:13.194 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T13:14:13.195 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:13.195 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 932 Links: 1 2026-02-20T13:14:13.195 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:13.195 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:13.195 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-20 13:14:09.574619327 +0000 2026-02-20T13:14:13.195 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-20 13:10:38.388230764 +0000 2026-02-20T13:14:13.195 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-20 13:10:38.388230764 +0000 2026-02-20T13:14:13.195 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-20 13:10:38.388230764 +0000 2026-02-20T13:14:13.196 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T13:14:13.259 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-20T13:14:13.259 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-20T13:14:13.259 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000153314 s, 3.3 MB/s 2026-02-20T13:14:13.260 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T13:14:13.318 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_3 2026-02-20T13:14:13.374 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T13:14:13.374 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:13.375 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 960 Links: 1 2026-02-20T13:14:13.375 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:13.375 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:13.375 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-20 13:14:09.574619327 +0000 2026-02-20T13:14:13.375 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-20 13:10:38.629224634 +0000 2026-02-20T13:14:13.375 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-20 13:10:38.629224634 +0000 2026-02-20T13:14:13.375 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-20 13:10:38.629224634 +0000 2026-02-20T13:14:13.375 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T13:14:13.437 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-20T13:14:13.438 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-20T13:14:13.438 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000150449 s, 3.4 MB/s 2026-02-20T13:14:13.439 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T13:14:13.496 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_4 2026-02-20T13:14:13.553 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T13:14:13.554 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:13.554 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 985 Links: 1 2026-02-20T13:14:13.554 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:13.554 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:13.554 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-20 13:14:09.574619327 +0000 2026-02-20T13:14:13.554 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-20 13:10:38.897217817 +0000 2026-02-20T13:14:13.554 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-20 13:10:38.897217817 +0000 2026-02-20T13:14:13.554 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-20 13:10:38.897217817 +0000 2026-02-20T13:14:13.555 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T13:14:13.616 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-20T13:14:13.616 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-20T13:14:13.617 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000153946 s, 3.3 MB/s 2026-02-20T13:14:13.618 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T13:14:13.675 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-20T13:14:13.675 DEBUG:teuthology.orchestra.run.trial127:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T13:14:13.694 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T13:14:13.694 DEBUG:teuthology.orchestra.run.trial127:> stat /dev/vg_nvme/lv_1 2026-02-20T13:14:13.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:13 trial034 ceph-mon[43332]: mgrmap e13: x(active, since 35s), standbys: z, y 2026-02-20T13:14:13.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:13 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-20T13:14:13.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:13 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-20T13:14:13.751 INFO:teuthology.orchestra.run.trial127.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T13:14:13.752 INFO:teuthology.orchestra.run.trial127.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:13.752 INFO:teuthology.orchestra.run.trial127.stdout:Device: 6h/6d Inode: 910 Links: 1 2026-02-20T13:14:13.752 INFO:teuthology.orchestra.run.trial127.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:13.752 INFO:teuthology.orchestra.run.trial127.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:13.752 INFO:teuthology.orchestra.run.trial127.stdout:Access: 2026-02-20 13:14:08.868796986 +0000 2026-02-20T13:14:13.752 INFO:teuthology.orchestra.run.trial127.stdout:Modify: 2026-02-20 13:10:36.162314847 +0000 2026-02-20T13:14:13.752 INFO:teuthology.orchestra.run.trial127.stdout:Change: 2026-02-20 13:10:36.162314847 +0000 2026-02-20T13:14:13.752 INFO:teuthology.orchestra.run.trial127.stdout: Birth: 2026-02-20 13:10:36.162314847 +0000 2026-02-20T13:14:13.753 DEBUG:teuthology.orchestra.run.trial127:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T13:14:13.815 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:13 trial127 ceph-mon[43817]: mgrmap e13: x(active, since 35s), standbys: z, y 2026-02-20T13:14:13.815 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:13 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-20T13:14:13.815 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:13 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-20T13:14:13.818 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records in 2026-02-20T13:14:13.818 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records out 2026-02-20T13:14:13.818 INFO:teuthology.orchestra.run.trial127.stderr:512 bytes copied, 0.000154737 s, 3.3 MB/s 2026-02-20T13:14:13.819 DEBUG:teuthology.orchestra.run.trial127:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T13:14:13.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:13 trial028 ceph-mon[37442]: mgrmap e13: x(active, since 35s), standbys: z, y 2026-02-20T13:14:13.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:13 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-20T13:14:13.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:13 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-20T13:14:13.877 DEBUG:teuthology.orchestra.run.trial127:> stat /dev/vg_nvme/lv_2 2026-02-20T13:14:13.933 INFO:teuthology.orchestra.run.trial127.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T13:14:13.933 INFO:teuthology.orchestra.run.trial127.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:13.933 INFO:teuthology.orchestra.run.trial127.stdout:Device: 6h/6d Inode: 938 Links: 1 2026-02-20T13:14:13.933 INFO:teuthology.orchestra.run.trial127.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:13.933 INFO:teuthology.orchestra.run.trial127.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:13.934 INFO:teuthology.orchestra.run.trial127.stdout:Access: 2026-02-20 13:14:08.868796986 +0000 2026-02-20T13:14:13.934 INFO:teuthology.orchestra.run.trial127.stdout:Modify: 2026-02-20 13:10:36.393311147 +0000 2026-02-20T13:14:13.934 INFO:teuthology.orchestra.run.trial127.stdout:Change: 2026-02-20 13:10:36.393311147 +0000 2026-02-20T13:14:13.934 INFO:teuthology.orchestra.run.trial127.stdout: Birth: 2026-02-20 13:10:36.393311147 +0000 2026-02-20T13:14:13.934 DEBUG:teuthology.orchestra.run.trial127:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T13:14:13.997 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records in 2026-02-20T13:14:13.998 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records out 2026-02-20T13:14:13.998 INFO:teuthology.orchestra.run.trial127.stderr:512 bytes copied, 0.000158695 s, 3.2 MB/s 2026-02-20T13:14:13.999 DEBUG:teuthology.orchestra.run.trial127:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T13:14:14.056 DEBUG:teuthology.orchestra.run.trial127:> stat /dev/vg_nvme/lv_3 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout:Device: 6h/6d Inode: 964 Links: 1 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout:Access: 2026-02-20 13:14:08.868796986 +0000 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout:Modify: 2026-02-20 13:10:36.621307496 +0000 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout:Change: 2026-02-20 13:10:36.621307496 +0000 2026-02-20T13:14:14.112 INFO:teuthology.orchestra.run.trial127.stdout: Birth: 2026-02-20 13:10:36.621307496 +0000 2026-02-20T13:14:14.112 DEBUG:teuthology.orchestra.run.trial127:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T13:14:14.175 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records in 2026-02-20T13:14:14.175 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records out 2026-02-20T13:14:14.175 INFO:teuthology.orchestra.run.trial127.stderr:512 bytes copied, 0.000166279 s, 3.1 MB/s 2026-02-20T13:14:14.176 DEBUG:teuthology.orchestra.run.trial127:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T13:14:14.234 DEBUG:teuthology.orchestra.run.trial127:> stat /dev/vg_nvme/lv_4 2026-02-20T13:14:14.291 INFO:teuthology.orchestra.run.trial127.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T13:14:14.291 INFO:teuthology.orchestra.run.trial127.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:14:14.292 INFO:teuthology.orchestra.run.trial127.stdout:Device: 6h/6d Inode: 995 Links: 1 2026-02-20T13:14:14.292 INFO:teuthology.orchestra.run.trial127.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:14:14.292 INFO:teuthology.orchestra.run.trial127.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:14:14.292 INFO:teuthology.orchestra.run.trial127.stdout:Access: 2026-02-20 13:14:08.868796986 +0000 2026-02-20T13:14:14.292 INFO:teuthology.orchestra.run.trial127.stdout:Modify: 2026-02-20 13:10:36.868303541 +0000 2026-02-20T13:14:14.292 INFO:teuthology.orchestra.run.trial127.stdout:Change: 2026-02-20 13:10:36.868303541 +0000 2026-02-20T13:14:14.292 INFO:teuthology.orchestra.run.trial127.stdout: Birth: 2026-02-20 13:10:36.868303541 +0000 2026-02-20T13:14:14.293 DEBUG:teuthology.orchestra.run.trial127:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T13:14:14.355 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records in 2026-02-20T13:14:14.355 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records out 2026-02-20T13:14:14.355 INFO:teuthology.orchestra.run.trial127.stderr:512 bytes copied, 0.000151542 s, 3.4 MB/s 2026-02-20T13:14:14.356 DEBUG:teuthology.orchestra.run.trial127:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T13:14:14.427 INFO:tasks.cephadm:Deploying osd.0 on trial028 with /dev/vg_nvme/lv_4... 2026-02-20T13:14:14.427 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-20T13:14:14.616 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:14.733 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:14 trial028 ceph-mon[37442]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:14 trial127 ceph-mon[43817]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:14 trial034 ceph-mon[43332]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:15.532 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:14:15.554 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_4 --skip-validation 2026-02-20T13:14:15.741 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:15.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 -- 10.20.193.28:0/1558700532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 msgr2=0x7f5a8010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:15.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 --2- 10.20.193.28:0/1558700532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 0x7f5a8010d080 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=12741353248063599309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a7c00a970 tx=0x7f5a7c0301b0 comp rx=0 tx=0).stop 2026-02-20T13:14:15.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 -- 10.20.193.28:0/1558700532 shutdown_connections 2026-02-20T13:14:15.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 --2- 10.20.193.28:0/1558700532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 0x7f5a8010d080 unknown :-1 s=CLOSED pgs=144 gs=1 cs=0 l=1 c_cookie=12741353248063599309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:15.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 --2- 10.20.193.28:0/1558700532 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a8010bd70 0x7f5a8010c1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:15.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 --2- 10.20.193.28:0/1558700532 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a8010ad40 0x7f5a8010b130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:15.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 -- 10.20.193.28:0/1558700532 >> 10.20.193.28:0/1558700532 conn(0x7f5a800e8760 msgr2=0x7f5a80108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:15.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 -- 10.20.193.28:0/1558700532 shutdown_connections 2026-02-20T13:14:15.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.910+0000 7f5a871d8640 1 -- 10.20.193.28:0/1558700532 wait complete. 2026-02-20T13:14:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a871d8640 1 Processor -- start 2026-02-20T13:14:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a871d8640 1 -- start start 2026-02-20T13:14:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a871d8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a8010ad40 0x7f5a800f32c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a871d8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a8010bd70 0x7f5a800f3910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a871d8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 0x7f5a800f4510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a871d8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a800f4c50 con 0x7f5a8010c720 2026-02-20T13:14:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a871d8640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5a800f4dc0 con 0x7f5a8010ad40 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a871d8640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5a800f4f80 con 0x7f5a8010bd70 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a859d5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a8010bd70 0x7f5a800f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a869d7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 0x7f5a800f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a859d5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a8010bd70 0x7f5a800f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37616/0 (socket says 10.20.193.28:37616) 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a859d5640 1 -- 10.20.193.28:0/2525911197 learned_addr learned my addr 10.20.193.28:0/2525911197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.911+0000 7f5a861d6640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a8010ad40 0x7f5a800f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a869d7640 1 -- 10.20.193.28:0/2525911197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a8010bd70 msgr2=0x7f5a800f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a869d7640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a8010bd70 0x7f5a800f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a869d7640 1 -- 10.20.193.28:0/2525911197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a8010ad40 msgr2=0x7f5a800f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a869d7640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a8010ad40 0x7f5a800f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a869d7640 1 -- 10.20.193.28:0/2525911197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a74009570 con 0x7f5a8010c720 2026-02-20T13:14:15.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a869d7640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 0x7f5a800f4510 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a7c00a970 tx=0x7f5a7c003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:15.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a677fe640 1 -- 10.20.193.28:0/2525911197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a7c03e070 con 0x7f5a8010c720 2026-02-20T13:14:15.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a677fe640 1 -- 10.20.193.28:0/2525911197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5a7c005510 con 0x7f5a8010c720 2026-02-20T13:14:15.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a677fe640 1 -- 10.20.193.28:0/2525911197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a7c042980 con 0x7f5a8010c720 2026-02-20T13:14:15.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a871d8640 1 -- 10.20.193.28:0/2525911197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c00a590 con 0x7f5a8010c720 2026-02-20T13:14:15.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.912+0000 7f5a871d8640 1 -- 10.20.193.28:0/2525911197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a800f5580 con 0x7f5a8010c720 2026-02-20T13:14:15.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.913+0000 7f5a657fa640 1 -- 10.20.193.28:0/2525911197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a801110e0 con 0x7f5a8010c720 2026-02-20T13:14:15.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.915+0000 7f5a677fe640 1 -- 10.20.193.28:0/2525911197 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f5a7c04a060 con 0x7f5a8010c720 2026-02-20T13:14:15.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.916+0000 7f5a677fe640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a5c0b56d0 0x7f5a5c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:15.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.916+0000 7f5a677fe640 1 -- 10.20.193.28:0/2525911197 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f5a7c10a670 con 0x7f5a8010c720 2026-02-20T13:14:15.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.916+0000 7f5a677fe640 1 -- 10.20.193.28:0/2525911197 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f5a7c10aaa0 con 0x7f5a8010c720 2026-02-20T13:14:15.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.917+0000 7f5a861d6640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a5c0b56d0 0x7f5a5c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:15.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:15.918+0000 7f5a861d6640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a5c0b56d0 0x7f5a5c0d5b80 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a70004740 tx=0x7f5a70005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:16.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:16.034+0000 7f5a657fa640 1 -- 10.20.193.28:0/2525911197 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f5a8010b130 con 0x7f5a5c0b56d0 2026-02-20T13:14:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:16.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:16.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:16.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:16.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:16.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:16.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:16.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:16.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:17.615 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:17.615 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:14:17.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_4'] 2026-02-20T13:14:17.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:14:17.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial028 2026-02-20T13:14:17.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/990708733' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d65e9bc-8b4a-480c-b540-72a21130e6a0"} : dispatch 2026-02-20T13:14:17.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/990708733' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d65e9bc-8b4a-480c-b540-72a21130e6a0"}]': finished 2026-02-20T13:14:17.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: osdmap e5: 1 total, 0 up, 1 in 2026-02-20T13:14:17.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:17 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:17.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:17.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:14:17.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_4'] 2026-02-20T13:14:17.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:14:17.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial028 2026-02-20T13:14:17.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/990708733' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d65e9bc-8b4a-480c-b540-72a21130e6a0"} : dispatch 2026-02-20T13:14:17.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/990708733' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d65e9bc-8b4a-480c-b540-72a21130e6a0"}]': finished 2026-02-20T13:14:17.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: osdmap e5: 1 total, 0 up, 1 in 2026-02-20T13:14:17.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:17 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:17.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:17.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:14:17.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_4'] 2026-02-20T13:14:17.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:14:17.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial028 2026-02-20T13:14:17.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/990708733' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d65e9bc-8b4a-480c-b540-72a21130e6a0"} : dispatch 2026-02-20T13:14:17.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/990708733' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d65e9bc-8b4a-480c-b540-72a21130e6a0"}]': finished 2026-02-20T13:14:17.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: osdmap e5: 1 total, 0 up, 1 in 2026-02-20T13:14:17.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:17 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:18 trial028 ceph-mon[37442]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:18 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4185203471' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:18 trial127 ceph-mon[43817]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:18 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4185203471' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:18 trial034 ceph-mon[43332]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:18 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4185203471' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:20.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:20 trial028 ceph-mon[37442]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:20 trial127 ceph-mon[43817]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:20 trial034 ceph-mon[43332]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:21.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-20T13:14:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:21 trial028 ceph-mon[37442]: Deploying daemon osd.0 on trial028 2026-02-20T13:14:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-20T13:14:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:21.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-20T13:14:21.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:21.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:21 trial127 ceph-mon[43817]: Deploying daemon osd.0 on trial028 2026-02-20T13:14:21.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-20T13:14:21.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:21.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-20T13:14:21.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:21.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:21 trial034 ceph-mon[43332]: Deploying daemon osd.0 on trial028 2026-02-20T13:14:21.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-20T13:14:21.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:22.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:22 trial028 ceph-mon[37442]: Deploying daemon osd.0 on trial028 2026-02-20T13:14:22.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:22 trial028 ceph-mon[37442]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:22 trial127 ceph-mon[43817]: Deploying daemon osd.0 on trial028 2026-02-20T13:14:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:22 trial127 ceph-mon[43817]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:22 trial034 ceph-mon[43332]: Deploying daemon osd.0 on trial028 2026-02-20T13:14:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:22 trial034 ceph-mon[43332]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:24 trial028 ceph-mon[37442]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:24 trial127 ceph-mon[43817]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:24 trial034 ceph-mon[43332]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:25.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:25 trial028 ceph-mon[37442]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:25.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:25 trial028 ceph-mon[37442]: from='osd.0 [v2:10.20.193.28:6802/3694499111,v1:10.20.193.28:6803/3694499111]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:25.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:25.914+0000 7f5a87c60640 1 -- 10.20.193.28:0/2525911197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=5}) -- 0x7f5a58003560 con 0x7f5a8010c720 2026-02-20T13:14:25.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:25.914+0000 7f5a677fe640 1 -- 10.20.193.28:0/2525911197 <== mon.0 v2:10.20.193.28:3300/0 7 ==== osd_map(5..6 src has 1..6) ==== 1027+0+0 (secure 0 0 0) 0x7f5a7c0d3060 con 0x7f5a8010c720 2026-02-20T13:14:25.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:25 trial127 ceph-mon[43817]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:25.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:25 trial127 ceph-mon[43817]: from='osd.0 [v2:10.20.193.28:6802/3694499111,v1:10.20.193.28:6803/3694499111]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:25.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:25 trial034 ceph-mon[43332]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:25.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:25 trial034 ceph-mon[43332]: from='osd.0 [v2:10.20.193.28:6802/3694499111,v1:10.20.193.28:6803/3694499111]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:26.766 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:26 trial028 ceph-mon[37442]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:26.766 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:26 trial028 ceph-mon[37442]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T13:14:26.766 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:26 trial028 ceph-mon[37442]: osdmap e6: 1 total, 0 up, 1 in 2026-02-20T13:14:26.767 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:26 trial127 ceph-mon[43817]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:26 trial127 ceph-mon[43817]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T13:14:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:26 trial127 ceph-mon[43817]: osdmap e6: 1 total, 0 up, 1 in 2026-02-20T13:14:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:26 trial034 ceph-mon[43332]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:26 trial034 ceph-mon[43332]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T13:14:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:26 trial034 ceph-mon[43332]: osdmap e6: 1 total, 0 up, 1 in 2026-02-20T13:14:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:27.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.811+0000 7f5a677fe640 1 -- 10.20.193.28:0/2525911197 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f5a8010b130 con 0x7f5a5c0b56d0 2026-02-20T13:14:27.815 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 0 on host 'trial028' 2026-02-20T13:14:27.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 -- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a5c0b56d0 msgr2=0x7f5a5c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:27.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a5c0b56d0 0x7f5a5c0d5b80 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a70004740 tx=0x7f5a70005f90 comp rx=0 tx=0).stop 2026-02-20T13:14:27.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 -- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 msgr2=0x7f5a800f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 0x7f5a800f4510 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a7c00a970 tx=0x7f5a7c003780 comp rx=0 tx=0).stop 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 -- 10.20.193.28:0/2525911197 shutdown_connections 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a5c0b56d0 0x7f5a5c0d5b80 unknown :-1 s=CLOSED pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a8010c720 0x7f5a800f4510 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a8010bd70 0x7f5a800f3910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 --2- 10.20.193.28:0/2525911197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a8010ad40 0x7f5a800f32c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 -- 10.20.193.28:0/2525911197 >> 10.20.193.28:0/2525911197 conn(0x7f5a800e8760 msgr2=0x7f5a80109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 -- 10.20.193.28:0/2525911197 shutdown_connections 2026-02-20T13:14:27.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:27.814+0000 7f5a657fa640 1 -- 10.20.193.28:0/2525911197 wait complete. 2026-02-20T13:14:27.918 DEBUG:teuthology.orchestra.run.trial028:osd.0> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.0.service 2026-02-20T13:14:27.923 INFO:tasks.cephadm:Deploying osd.1 on trial034 with /dev/vg_nvme/lv_4... 2026-02-20T13:14:27.923 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-20T13:14:28.039 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.b/config 2026-02-20T13:14:28.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:28 trial034 ceph-mon[43332]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:28.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:28 trial028 ceph-mon[37442]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:28.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.351 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0[52709]: 2026-02-20T13:14:28.045+0000 7f53cd88b780 -1 osd.0 0 log_to_monitors true 2026-02-20T13:14:28.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:28 trial127 ceph-mon[43817]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:28.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:28.503 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:14:28.521 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial034:vg_nvme/lv_4 --skip-validation 2026-02-20T13:14:28.638 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.b/config 2026-02-20T13:14:28.749 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 -- 10.20.193.34:0/938322679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f573810f0b0 msgr2=0x7f573810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:28.749 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 --2- 10.20.193.34:0/938322679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f573810f0b0 0x7f573810f520 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=14638207511492758752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f572c009950 tx=0x7f572c02f1d0 comp rx=0 tx=0).stop 2026-02-20T13:14:28.749 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 -- 10.20.193.34:0/938322679 shutdown_connections 2026-02-20T13:14:28.749 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 --2- 10.20.193.34:0/938322679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f573810fa60 0x7f57381717f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:28.749 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 --2- 10.20.193.34:0/938322679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f573810f0b0 0x7f573810f520 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=14638207511492758752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:28.749 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 --2- 10.20.193.34:0/938322679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5738110820 0x7f5738110c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 -- 10.20.193.34:0/938322679 >> 10.20.193.34:0/938322679 conn(0x7f57380eca70 msgr2=0x7f573810ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 -- 10.20.193.34:0/938322679 shutdown_connections 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.745+0000 7f5740255640 1 -- 10.20.193.34:0/938322679 wait complete. 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 Processor -- start 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 -- start start 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f573810f0b0 0x7f57380f9330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f573810fa60 0x7f57381717d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5738110820 0x7f57380f9b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57380fa7d0 con 0x7f573810fa60 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f57380fa940 con 0x7f5738110820 2026-02-20T13:14:28.750 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f57380fab00 con 0x7f573810f0b0 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5738110820 0x7f57380f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5738110820 0x7f57380f9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.34:44796/0 (socket says 10.20.193.34:44796) 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 -- 10.20.193.34:0/3969531831 learned_addr learned my addr 10.20.193.34:0/3969531831 (peer_addr_for_me v2:10.20.193.34:0/0) 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573dfca640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f573810f0b0 0x7f57380f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573d7c9640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f573810fa60 0x7f57381717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 -- 10.20.193.34:0/3969531831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f573810f0b0 msgr2=0x7f57380f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f573810f0b0 0x7f57380f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 -- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f573810fa60 msgr2=0x7f57381717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f573810fa60 0x7f57381717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 -- 10.20.193.34:0/3969531831 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572c009570 con 0x7f5738110820 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573d7c9640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f573810fa60 0x7f57381717d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f573e7cb640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5738110820 0x7f57380f9b70 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5734006e90 tx=0x7f573400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:28.751 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5726ffd640 1 -- 10.20.193.34:0/3969531831 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5734005500 con 0x7f5738110820 2026-02-20T13:14:28.752 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5726ffd640 1 -- 10.20.193.34:0/3969531831 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5734005e10 con 0x7f5738110820 2026-02-20T13:14:28.752 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57380fade0 con 0x7f5738110820 2026-02-20T13:14:28.752 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5726ffd640 1 -- 10.20.193.34:0/3969531831 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5734003a90 con 0x7f5738110820 2026-02-20T13:14:28.752 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.746+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57380fb260 con 0x7f5738110820 2026-02-20T13:14:28.752 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.747+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5738175920 con 0x7f5738110820 2026-02-20T13:14:28.752 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.748+0000 7f5726ffd640 1 -- 10.20.193.34:0/3969531831 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f573400c840 con 0x7f5738110820 2026-02-20T13:14:28.753 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.748+0000 7f5726ffd640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57140b5650 0x7f57140d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:28.753 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.749+0000 7f5726ffd640 1 -- 10.20.193.34:0/3969531831 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1356+0+0 (secure 0 0 0) 0x7f57340e6160 con 0x7f5738110820 2026-02-20T13:14:28.753 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.749+0000 7f573dfca640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57140b5650 0x7f57140d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:28.753 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.749+0000 7f573dfca640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57140b5650 0x7f57140d5b00 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5728004740 tx=0x7f5728004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:28.753 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.750+0000 7f5726ffd640 1 -- 10.20.193.34:0/3969531831 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f57340aa6d0 con 0x7f5738110820 2026-02-20T13:14:28.861 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:28.859+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f5738174fe0 con 0x7f57140b5650 2026-02-20T13:14:29.112 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:29.112 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:29.112 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.112 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.112 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:29.112 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.112 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.113 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:29.113 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:29.113 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:29.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:29.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:29.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:29.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:29.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-20T13:14:29.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:29.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:29.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:29.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:29.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:29.850 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:29 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0[52709]: 2026-02-20T13:14:29.534+0000 7f53c980d640 -1 osd.0 0 waiting for initial osdmap 2026-02-20T13:14:29.850 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:29 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0[52709]: 2026-02-20T13:14:29.537+0000 7f53c16cc640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:14:30.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_4'] 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial034 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: osdmap e7: 1 total, 0 up, 1 in 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:14:30.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"} : dispatch 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='client.? 10.20.193.34:0/4107116136' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"} : dispatch 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"}]': finished 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: osdmap e8: 2 total, 0 up, 2 in 2026-02-20T13:14:30.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:30.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:30 trial028 ceph-mon[37442]: from='client.? 10.20.193.34:0/3396565711' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:30.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:30.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:14:30.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_4'] 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial034 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: osdmap e7: 1 total, 0 up, 1 in 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:30.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"} : dispatch 2026-02-20T13:14:30.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='client.? 10.20.193.34:0/4107116136' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"} : dispatch 2026-02-20T13:14:30.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:14:30.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"}]': finished 2026-02-20T13:14:30.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: osdmap e8: 2 total, 0 up, 2 in 2026-02-20T13:14:30.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:30.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:30 trial127 ceph-mon[43817]: from='client.? 10.20.193.34:0/3396565711' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:30.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:30.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:14:30.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_4'] 2026-02-20T13:14:30.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:14:30.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial034 2026-02-20T13:14:30.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: osdmap e7: 1 total, 0 up, 1 in 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"} : dispatch 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='client.? 10.20.193.34:0/4107116136' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"} : dispatch 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21efdc9a-53aa-4a76-b2a0-90918eaf0262"}]': finished 2026-02-20T13:14:30.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: osdmap e8: 2 total, 0 up, 2 in 2026-02-20T13:14:30.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:30.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:30.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:30 trial034 ceph-mon[43332]: from='client.? 10.20.193.34:0/3396565711' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:14:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:14:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] boot 2026-02-20T13:14:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: osdmap e9: 2 total, 1 up, 2 in 2026-02-20T13:14:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:31.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:31.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:14:31.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] boot 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: osdmap e9: 2 total, 1 up, 2 in 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:31.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:31.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:14:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:14:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: osd.0 [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] boot 2026-02-20T13:14:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: osdmap e9: 2 total, 1 up, 2 in 2026-02-20T13:14:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-20T13:14:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:31.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: Detected new or changed devices on trial028 2026-02-20T13:14:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-20T13:14:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: pgmap v26: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-20T13:14:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: osdmap e10: 2 total, 1 up, 2 in 2026-02-20T13:14:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-20T13:14:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:32.863 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: Detected new or changed devices on trial028 2026-02-20T13:14:32.863 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-20T13:14:32.863 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: pgmap v26: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:32.863 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-20T13:14:32.863 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:32.863 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: osdmap e10: 2 total, 1 up, 2 in 2026-02-20T13:14:32.863 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:32.863 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-20T13:14:32.864 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: Detected new or changed devices on trial028 2026-02-20T13:14:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-20T13:14:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: pgmap v26: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-20T13:14:32.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:32.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: osdmap e10: 2 total, 1 up, 2 in 2026-02-20T13:14:32.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:32.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-20T13:14:32.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:33.771 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:33 trial034 ceph-mon[43332]: Deploying daemon osd.1 on trial034 2026-02-20T13:14:33.771 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:33 trial034 ceph-mon[43332]: Deploying daemon osd.1 on trial034 2026-02-20T13:14:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:33 trial028 ceph-mon[37442]: Deploying daemon osd.1 on trial034 2026-02-20T13:14:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:33 trial028 ceph-mon[37442]: Deploying daemon osd.1 on trial034 2026-02-20T13:14:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:33 trial127 ceph-mon[43817]: Deploying daemon osd.1 on trial034 2026-02-20T13:14:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:33 trial127 ceph-mon[43817]: Deploying daemon osd.1 on trial034 2026-02-20T13:14:34.628 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:34 trial034 ceph-mon[43332]: pgmap v28: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:34.628 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:34.628 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:34 trial028 ceph-mon[37442]: pgmap v28: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:34 trial127 ceph-mon[43817]: pgmap v28: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.002 INFO:teuthology.orchestra.run.trial034.stdout:Created osd(s) 1 on host 'trial034' 2026-02-20T13:14:36.002 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.000+0000 7f5726ffd640 1 -- 10.20.193.34:0/3969531831 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f5738174fe0 con 0x7f57140b5650 2026-02-20T13:14:36.004 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.002+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57140b5650 msgr2=0x7f57140d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:36.004 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.002+0000 7f5740255640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57140b5650 0x7f57140d5b00 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5728004740 tx=0x7f5728004420 comp rx=0 tx=0).stop 2026-02-20T13:14:36.004 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.002+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5738110820 msgr2=0x7f57380f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:36.004 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.002+0000 7f5740255640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5738110820 0x7f57380f9b70 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5734006e90 tx=0x7f573400edf0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.004 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.003+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 shutdown_connections 2026-02-20T13:14:36.004 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.003+0000 7f5740255640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57140b5650 0x7f57140d5b00 unknown :-1 s=CLOSED pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.004 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.003+0000 7f5740255640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f573810fa60 0x7f57381717d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.005 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.003+0000 7f5740255640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5738110820 0x7f57380f9b70 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.005 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.003+0000 7f5740255640 1 --2- 10.20.193.34:0/3969531831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f573810f0b0 0x7f57380f9330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.005 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.003+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 >> 10.20.193.34:0/3969531831 conn(0x7f57380eca70 msgr2=0x7f57380ef900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:36.005 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.003+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 shutdown_connections 2026-02-20T13:14:36.005 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:36.003+0000 7f5740255640 1 -- 10.20.193.34:0/3969531831 wait complete. 2026-02-20T13:14:36.046 DEBUG:teuthology.orchestra.run.trial034:osd.1> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.1.service 2026-02-20T13:14:36.047 INFO:tasks.cephadm:Deploying osd.2 on trial127 with /dev/vg_nvme/lv_4... 2026-02-20T13:14:36.047 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-20T13:14:36.164 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:14:36.503 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:36 trial034 ceph-mon[43332]: pgmap v29: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:36.504 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.504 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.504 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.504 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.504 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:36 trial034 ceph-mon[43332]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-20T13:14:36.504 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:36 trial034 ceph-mon[43332]: from='osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-20T13:14:36.505 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:36 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1[49081]: 2026-02-20T13:14:36.292+0000 7f1958c58780 -1 osd.1 0 log_to_monitors true 2026-02-20T13:14:36.579 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:36 trial127 ceph-mon[43817]: pgmap v29: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:36.579 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.579 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.579 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.579 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.579 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:36 trial127 ceph-mon[43817]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-20T13:14:36.579 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:36 trial127 ceph-mon[43817]: from='osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-20T13:14:36.609 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:14:36.627 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial127:vg_nvme/lv_4 --skip-validation 2026-02-20T13:14:36.744 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:14:36.850 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 -- 10.20.193.127:0/1274528778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a010fa50 msgr2=0x7f09a01717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:36.850 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 --2- 10.20.193.127:0/1274528778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a010fa50 0x7f09a01717e0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=2673619898442425738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099000aa60 tx=0x7f0990030270 comp rx=0 tx=0).stop 2026-02-20T13:14:36.850 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 -- 10.20.193.127:0/1274528778 shutdown_connections 2026-02-20T13:14:36.850 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 --2- 10.20.193.127:0/1274528778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09a010f0a0 0x7f09a010f510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.850 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 --2- 10.20.193.127:0/1274528778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a010fa50 0x7f09a01717e0 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=2673619898442425738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.850 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 --2- 10.20.193.127:0/1274528778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f09a0110810 0x7f09a0110c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.850 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 -- 10.20.193.127:0/1274528778 >> 10.20.193.127:0/1274528778 conn(0x7f09a00eca40 msgr2=0x7f09a010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 -- 10.20.193.127:0/1274528778 shutdown_connections 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 -- 10.20.193.127:0/1274528778 wait complete. 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 Processor -- start 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.846+0000 7f09a5600640 1 -- start start 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09a010f0a0 0x7f09a00f9330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f09a010fa50 0x7f09a01717e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a0110810 0x7f09a00f9b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f09a00fa6f0 con 0x7f09a010f0a0 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f09a00fa860 con 0x7f09a010fa50 2026-02-20T13:14:36.851 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f09a00faa20 con 0x7f09a0110810 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a0110810 0x7f09a00f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a0110810 0x7f09a00f9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:53704/0 (socket says 10.20.193.127:53704) 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 -- 10.20.193.127:0/3036327228 learned_addr learned my addr 10.20.193.127:0/3036327228 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099e7fc640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f09a010fa50 0x7f09a01717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099effd640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09a010f0a0 0x7f09a00f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 -- 10.20.193.127:0/3036327228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f09a010fa50 msgr2=0x7f09a01717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f09a010fa50 0x7f09a01717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 -- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09a010f0a0 msgr2=0x7f09a00f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09a010f0a0 0x7f09a00f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 -- 10.20.193.127:0/3036327228 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099000a650 con 0x7f09a0110810 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f099f7fe640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a0110810 0x7f09a00f9b90 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099000a360 tx=0x7f0990003a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:36.852 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f097ffff640 1 -- 10.20.193.127:0/3036327228 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099003e070 con 0x7f09a0110810 2026-02-20T13:14:36.853 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f097ffff640 1 -- 10.20.193.127:0/3036327228 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f09900055a0 con 0x7f09a0110810 2026-02-20T13:14:36.853 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a00faca0 con 0x7f09a0110810 2026-02-20T13:14:36.853 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f097ffff640 1 -- 10.20.193.127:0/3036327228 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0990042cb0 con 0x7f09a0110810 2026-02-20T13:14:36.853 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a00fb190 con 0x7f09a0110810 2026-02-20T13:14:36.853 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.847+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a0175970 con 0x7f09a0110810 2026-02-20T13:14:36.853 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.849+0000 7f097ffff640 1 -- 10.20.193.127:0/3036327228 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f0990042410 con 0x7f09a0110810 2026-02-20T13:14:36.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:36 trial028 ceph-mon[37442]: pgmap v29: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:36.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:36.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:36 trial028 ceph-mon[37442]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-20T13:14:36.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:36 trial028 ceph-mon[37442]: from='osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-20T13:14:36.855 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.849+0000 7f097ffff640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b56d0 0x7f09740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:36.855 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.849+0000 7f097ffff640 1 -- 10.20.193.127:0/3036327228 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1875+0+0 (secure 0 0 0) 0x7f0990042e40 con 0x7f09a0110810 2026-02-20T13:14:36.855 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.850+0000 7f099effd640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b56d0 0x7f09740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:36.855 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.850+0000 7f099effd640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b56d0 0x7f09740d5b80 secure :-1 s=READY pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0994006fd0 tx=0x7f0994008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:36.855 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.850+0000 7f097ffff640 1 -- 10.20.193.127:0/3036327228 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f09900cfb20 con 0x7f09a0110810 2026-02-20T13:14:36.958 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:36.958+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f09a005f5a0 con 0x7f09740b56d0 2026-02-20T13:14:37.714 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-20T13:14:37.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: osdmap e11: 2 total, 1 up, 2 in 2026-02-20T13:14:37.716 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:37.716 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:14:37.716 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:14:37.716 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.716 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:37.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: osdmap e11: 2 total, 1 up, 2 in 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.791 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.968 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:37 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1[49081]: 2026-02-20T13:14:37.632+0000 7f1954bda640 -1 osd.1 0 waiting for initial osdmap 2026-02-20T13:14:37.968 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:37 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1[49081]: 2026-02-20T13:14:37.635+0000 7f1950aa1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:14:37.969 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.969 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.969 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:37.969 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.969 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: osdmap e11: 2 total, 1 up, 2 in 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:14:37.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:37.971 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_4'] 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial127 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: pgmap v31: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"} : dispatch 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/1940782959' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"} : dispatch 2026-02-20T13:14:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"}]': finished 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: osdmap e12: 3 total, 1 up, 3 in 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/2625030727' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_4'] 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial127 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: pgmap v31: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"} : dispatch 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/1940782959' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"} : dispatch 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"}]': finished 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: osdmap e12: 3 total, 1 up, 3 in 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/2625030727' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_4'] 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial127 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: pgmap v31: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"} : dispatch 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/1940782959' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"} : dispatch 2026-02-20T13:14:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04252b73-4bf2-46c0-b9fb-9b4187606781"}]': finished 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: osdmap e12: 3 total, 1 up, 3 in 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/2625030727' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.643 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: Detected new or changed devices on trial034 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial034 to 84047M 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] boot 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: osdmap e13: 3 total, 2 up, 3 in 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:39.644 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.645 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:39.645 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:39.645 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:39.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:14:39.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:14:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: Detected new or changed devices on trial034 2026-02-20T13:14:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial034 to 84047M 2026-02-20T13:14:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] boot 2026-02-20T13:14:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: osdmap e13: 3 total, 2 up, 3 in 2026-02-20T13:14:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: Detected new or changed devices on trial034 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial034 to 84047M 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: osd.1 [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] boot 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: osdmap e13: 3 total, 2 up, 3 in 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:40.739 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:40 trial127 ceph-mon[43817]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:40.739 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-20T13:14:40.739 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:40.739 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:40 trial127 ceph-mon[43817]: osdmap e14: 3 total, 2 up, 3 in 2026-02-20T13:14:40.739 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:40.739 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-20T13:14:40.739 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:40 trial028 ceph-mon[37442]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-20T13:14:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:40 trial028 ceph-mon[37442]: osdmap e14: 3 total, 2 up, 3 in 2026-02-20T13:14:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-20T13:14:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:40 trial034 ceph-mon[43332]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-20T13:14:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:40 trial034 ceph-mon[43332]: osdmap e14: 3 total, 2 up, 3 in 2026-02-20T13:14:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-20T13:14:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:41.575 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:41 trial127 ceph-mon[43817]: Deploying daemon osd.2 on trial127 2026-02-20T13:14:41.575 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:41 trial127 ceph-mon[43817]: Deploying daemon osd.2 on trial127 2026-02-20T13:14:41.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:41 trial028 ceph-mon[37442]: Deploying daemon osd.2 on trial127 2026-02-20T13:14:41.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:41 trial028 ceph-mon[37442]: Deploying daemon osd.2 on trial127 2026-02-20T13:14:41.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:41 trial034 ceph-mon[43332]: Deploying daemon osd.2 on trial127 2026-02-20T13:14:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:41 trial034 ceph-mon[43332]: Deploying daemon osd.2 on trial127 2026-02-20T13:14:42.698 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:42 trial127 ceph-mon[43817]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:42.698 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:42 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:42.698 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:42 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:42 trial028 ceph-mon[37442]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:42 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:42 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:42.891 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:42 trial034 ceph-mon[43332]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:42.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:42 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:42.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:42 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.102 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.101+0000 7f097ffff640 1 -- 10.20.193.127:0/3036327228 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f09a005f5a0 con 0x7f09740b56d0 2026-02-20T13:14:44.102 INFO:teuthology.orchestra.run.trial127.stdout:Created osd(s) 2 on host 'trial127' 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b56d0 msgr2=0x7f09740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b56d0 0x7f09740d5b80 secure :-1 s=READY pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0994006fd0 tx=0x7f0994008040 comp rx=0 tx=0).stop 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a0110810 msgr2=0x7f09a00f9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a0110810 0x7f09a00f9b90 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099000a360 tx=0x7f0990003a20 comp rx=0 tx=0).stop 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 shutdown_connections 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b56d0 0x7f09740d5b80 unknown :-1 s=CLOSED pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09a0110810 0x7f09a00f9b90 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f09a010fa50 0x7f09a01717e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 --2- 10.20.193.127:0/3036327228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09a010f0a0 0x7f09a00f9330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 >> 10.20.193.127:0/3036327228 conn(0x7f09a00eca40 msgr2=0x7f09a00ef900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 shutdown_connections 2026-02-20T13:14:44.105 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:14:44.104+0000 7f09a5600640 1 -- 10.20.193.127:0/3036327228 wait complete. 2026-02-20T13:14:44.149 DEBUG:teuthology.orchestra.run.trial127:osd.2> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.2.service 2026-02-20T13:14:44.151 INFO:tasks.cephadm:Deploying osd.3 on trial028 with /dev/vg_nvme/lv_3... 2026-02-20T13:14:44.151 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-20T13:14:44.340 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:44.581 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:44 trial127 ceph-mon[43817]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:44.581 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.581 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.582 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.582 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.582 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:44 trial127 ceph-mon[43817]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-20T13:14:44.582 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:44 trial127 ceph-mon[43817]: from='osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-20T13:14:44.582 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:44 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2[49802]: 2026-02-20T13:14:44.352+0000 7f7b6bd8a780 -1 osd.2 0 log_to_monitors true 2026-02-20T13:14:44.722 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:44 trial028 ceph-mon[37442]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:44.722 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:44 trial028 ceph-mon[37442]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-20T13:14:44.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:44 trial028 ceph-mon[37442]: from='osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-20T13:14:44.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:44 trial034 ceph-mon[43332]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:44.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:44.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:44 trial034 ceph-mon[43332]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-20T13:14:44.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:44 trial034 ceph-mon[43332]: from='osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-20T13:14:45.284 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:14:45.316 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_3 --skip-validation 2026-02-20T13:14:45.501 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:14:45.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:45.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-20T13:14:45.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: osdmap e15: 3 total, 2 up, 3 in 2026-02-20T13:14:45.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:45.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:14:45.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: from='osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:14:45.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:45 trial028 ceph-mon[37442]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49f5ffb640 1 -- 10.20.193.28:0/1302962265 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49e80396f0 con 0x7f49f810fa50 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1302962265 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f49f810fa50 msgr2=0x7f49f81717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1302962265 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f49f810fa50 0x7f49f81717e0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=10885533468390394280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e800aa30 tx=0x7f49e8030270 comp rx=0 tx=0).stop 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1302962265 shutdown_connections 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1302962265 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f49f810fa50 0x7f49f81717e0 unknown :-1 s=CLOSED pgs=35 gs=1 cs=0 l=1 c_cookie=10885533468390394280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1302962265 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49f810f0a0 0x7f49f810f510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1302962265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49f8110810 0x7f49f8110c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1302962265 >> 10.20.193.28:0/1302962265 conn(0x7f49f80eca40 msgr2=0x7f49f810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1302962265 shutdown_connections 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.678+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1302962265 wait complete. 2026-02-20T13:14:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49fd9bd640 1 Processor -- start 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49fd9bd640 1 -- start start 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49fd9bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49f810f0a0 0x7f49f80f92e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49fd9bd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f49f810fa50 0x7f49f81717e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49fd9bd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49f8110810 0x7f49f80f9b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49fd9bd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80fa730 con 0x7f49f810f0a0 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49fd9bd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80fa8a0 con 0x7f49f810fa50 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49fd9bd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80faa60 con 0x7f49f8110810 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.679+0000 7f49f6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49f810f0a0 0x7f49f80f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49f810f0a0 0x7f49f80f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45570/0 (socket says 10.20.193.28:45570) 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f6ffd640 1 -- 10.20.193.28:0/1019669809 learned_addr learned my addr 10.20.193.28:0/1019669809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f67fc640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f49f810fa50 0x7f49f81717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:45.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f77fe640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49f8110810 0x7f49f80f9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:45.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f6ffd640 1 -- 10.20.193.28:0/1019669809 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49f8110810 msgr2=0x7f49f80f9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:45.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f6ffd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49f8110810 0x7f49f80f9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:45.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f6ffd640 1 -- 10.20.193.28:0/1019669809 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f49f810fa50 msgr2=0x7f49f81717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:45.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f6ffd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f49f810fa50 0x7f49f81717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:45.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f6ffd640 1 -- 10.20.193.28:0/1019669809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e800a650 con 0x7f49f810f0a0 2026-02-20T13:14:45.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49f6ffd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49f810f0a0 0x7f49f80f92e0 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49ec009480 tx=0x7f49ec00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:45.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49ec00ccc0 con 0x7f49f810f0a0 2026-02-20T13:14:45.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f80fad40 con 0x7f49f810f0a0 2026-02-20T13:14:45.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f49ec00ce20 con 0x7f49f810f0a0 2026-02-20T13:14:45.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49ec0106b0 con 0x7f49f810f0a0 2026-02-20T13:14:45.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.680+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f80fb260 con 0x7f49f810f0a0 2026-02-20T13:14:45.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.681+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f8175910 con 0x7f49f810f0a0 2026-02-20T13:14:45.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.683+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f49ec01f060 con 0x7f49f810f0a0 2026-02-20T13:14:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.685+0000 7f49fc9bb640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49cc0b56d0 0x7f49cc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.685+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2436+0+0 (secure 0 0 0) 0x7f49ec014070 con 0x7f49f810f0a0 2026-02-20T13:14:45.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.685+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f49ec0e5650 con 0x7f49f810f0a0 2026-02-20T13:14:45.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.685+0000 7f49f67fc640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49cc0b56d0 0x7f49cc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:45.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.686+0000 7f49f67fc640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49cc0b56d0 0x7f49cc0d5b80 secure :-1 s=READY pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e0004740 tx=0x7f49e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:45.805+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f49f8174fd0 con 0x7f49cc0b56d0 2026-02-20T13:14:45.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: osdmap e15: 3 total, 2 up, 3 in 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: from='osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:14:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:45 trial127 ceph-mon[43817]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-20T13:14:45.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: osdmap e15: 3 total, 2 up, 3 in 2026-02-20T13:14:45.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:45.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:14:45.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: from='osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:14:45.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:45 trial034 ceph-mon[43332]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T13:14:46.361 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:46 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2[49802]: 2026-02-20T13:14:46.107+0000 7f7b67d0c640 -1 osd.2 0 waiting for initial osdmap 2026-02-20T13:14:46.362 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:46 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2[49802]: 2026-02-20T13:14:46.110+0000 7f7b5fbcb640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:14:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_3'] 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial028 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: Detected new or changed devices on trial127 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial127 to 84047M 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:47.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:47.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:14:47.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: osdmap e16: 3 total, 2 up, 3 in 2026-02-20T13:14:47.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:47.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:47.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:47.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:14:47.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_3'] 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial028 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: Detected new or changed devices on trial127 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial127 to 84047M 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:47.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.230 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:14:47.230 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: osdmap e16: 3 total, 2 up, 3 in 2026-02-20T13:14:47.230 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:47.230 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_3'] 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial028 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:47.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: Detected new or changed devices on trial127 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial127 to 84047M 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:14:47.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:47.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:47.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:47.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:47.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:14:47.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: osdmap e16: 3 total, 2 up, 3 in 2026-02-20T13:14:47.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:47.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:48.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:14:48.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/194922934' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75c4c4b5-3018-42f7-a5ac-645bf321af19"} : dispatch 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/194922934' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75c4c4b5-3018-42f7-a5ac-645bf321af19"}]': finished 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] boot 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: osdmap e17: 4 total, 3 up, 4 in 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: pgmap v42: 0 pgs: ; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2838089199' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:48.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:47 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:14:48.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:14:48.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:14:48.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/194922934' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75c4c4b5-3018-42f7-a5ac-645bf321af19"} : dispatch 2026-02-20T13:14:48.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/194922934' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75c4c4b5-3018-42f7-a5ac-645bf321af19"}]': finished 2026-02-20T13:14:48.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] boot 2026-02-20T13:14:48.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: osdmap e17: 4 total, 3 up, 4 in 2026-02-20T13:14:48.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:48.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:48.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: pgmap v42: 0 pgs: ; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:48.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2838089199' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:48.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:47 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:14:48.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/194922934' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75c4c4b5-3018-42f7-a5ac-645bf321af19"} : dispatch 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/194922934' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75c4c4b5-3018-42f7-a5ac-645bf321af19"}]': finished 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: osd.2 [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] boot 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: osdmap e17: 4 total, 3 up, 4 in 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: pgmap v42: 0 pgs: ; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2838089199' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:14:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:47 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:14:49.257 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-20T13:14:49.257 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 ceph-mon[37442]: osdmap e18: 4 total, 3 up, 4 in 2026-02-20T13:14:49.257 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:49.257 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:14:49.257 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-20T13:14:49.257 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.257 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.258 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62409]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-20T13:14:49.258 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62409]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.258 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.258 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62409]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.258 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62422]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-20T13:14:49.258 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62422]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.258 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.258 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62422]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.317 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-20T13:14:49.317 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 ceph-mon[43817]: osdmap e18: 4 total, 3 up, 4 in 2026-02-20T13:14:49.317 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:49.317 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:14:49.318 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54220]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-20T13:14:49.318 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54220]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.318 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.318 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54220]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.318 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54224]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-20T13:14:49.318 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54224]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.318 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.318 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54224]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.361 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-20T13:14:49.361 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 ceph-mon[43332]: osdmap e18: 4 total, 3 up, 4 in 2026-02-20T13:14:49.362 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:49.362 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:14:49.362 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57665]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-20T13:14:49.362 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57665]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.362 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.362 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57665]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.362 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57669]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-20T13:14:49.362 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57669]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.362 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.362 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57669]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.524 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62519]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.524 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62525]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-20T13:14:49.524 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62525]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.524 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.524 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:49 trial028 sudo[62525]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54228]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-20T13:14:49.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54228]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54228]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54232]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-20T13:14:49.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54232]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:49 trial127 sudo[54232]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57673]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-20T13:14:49.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57673]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57673]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:49.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57677]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-20T13:14:49.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57677]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T13:14:49.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T13:14:49.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:49 trial034 sudo[57677]: pam_unix(sudo:session): session closed for user root 2026-02-20T13:14:50.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:14:50.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: osdmap e19: 4 total, 3 up, 4 in 2026-02-20T13:14:50.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:50.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.059 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: pgmap v45: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:50.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:50.314+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f49ec0a91c0 con 0x7f49f810f0a0 2026-02-20T13:14:50.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:14:50.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: osdmap e19: 4 total, 3 up, 4 in 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: pgmap v45: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: osdmap e19: 4 total, 3 up, 4 in 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: pgmap v45: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T13:14:50.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:51.158 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:51 trial028 ceph-mon[37442]: osdmap e20: 4 total, 3 up, 4 in 2026-02-20T13:14:51.158 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:51.159 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:51 trial028 ceph-mon[37442]: mgrmap e14: x(active, since 73s), standbys: z, y 2026-02-20T13:14:51.159 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-20T13:14:51.159 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:51.159 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:51 trial028 ceph-mon[37442]: Deploying daemon osd.3 on trial028 2026-02-20T13:14:51.159 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-20T13:14:51.159 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:51.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:51 trial127 ceph-mon[43817]: osdmap e20: 4 total, 3 up, 4 in 2026-02-20T13:14:51.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:51 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:51.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:51 trial127 ceph-mon[43817]: mgrmap e14: x(active, since 73s), standbys: z, y 2026-02-20T13:14:51.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:51 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-20T13:14:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:51 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:51 trial127 ceph-mon[43817]: Deploying daemon osd.3 on trial028 2026-02-20T13:14:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:51 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-20T13:14:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:51 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:51.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:51 trial034 ceph-mon[43332]: osdmap e20: 4 total, 3 up, 4 in 2026-02-20T13:14:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:51 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:51 trial034 ceph-mon[43332]: mgrmap e14: x(active, since 73s), standbys: z, y 2026-02-20T13:14:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:51 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-20T13:14:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:51 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:51 trial034 ceph-mon[43332]: Deploying daemon osd.3 on trial028 2026-02-20T13:14:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:51 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-20T13:14:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:51 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:52.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:52 trial028 ceph-mon[37442]: Deploying daemon osd.3 on trial028 2026-02-20T13:14:52.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:52 trial028 ceph-mon[37442]: pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:52.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:52 trial127 ceph-mon[43817]: Deploying daemon osd.3 on trial028 2026-02-20T13:14:52.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:52 trial127 ceph-mon[43817]: pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:52.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:52 trial034 ceph-mon[43332]: Deploying daemon osd.3 on trial028 2026-02-20T13:14:52.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:52 trial034 ceph-mon[43332]: pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:54.521 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:54 trial028 ceph-mon[37442]: pgmap v48: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:54.522 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:54 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:54.522 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:54 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:54.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:54 trial127 ceph-mon[43817]: pgmap v48: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:54.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:54 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:54.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:54 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:54.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:54 trial034 ceph-mon[43332]: pgmap v48: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:54.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:54 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:54.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:54 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:55.466 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:55 trial028 ceph-mon[37442]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:55.466 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:55 trial028 ceph-mon[37442]: from='osd.3 [v2:10.20.193.28:6810/321557434,v1:10.20.193.28:6811/321557434]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:55.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:55.682+0000 7f49fd1bc640 1 -- 10.20.193.28:0/1019669809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f49d0003560 con 0x7f49f810f0a0 2026-02-20T13:14:55.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:55.682+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mon.0 v2:10.20.193.28:3300/0 8 ==== osd_map(16..21 src has 1..21) ==== 4891+0+0 (secure 0 0 0) 0x7f49ec0ad8c0 con 0x7f49f810f0a0 2026-02-20T13:14:55.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:55 trial127 ceph-mon[43817]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:55.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:55 trial127 ceph-mon[43817]: from='osd.3 [v2:10.20.193.28:6810/321557434,v1:10.20.193.28:6811/321557434]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:55.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:55 trial034 ceph-mon[43332]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:55.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:55 trial034 ceph-mon[43332]: from='osd.3 [v2:10.20.193.28:6810/321557434,v1:10.20.193.28:6811/321557434]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:56.628 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:56 trial028 ceph-mon[37442]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:56.628 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:56 trial028 ceph-mon[37442]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T13:14:56.629 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:56 trial028 ceph-mon[37442]: osdmap e21: 4 total, 3 up, 4 in 2026-02-20T13:14:56.629 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:56 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:56.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:56 trial127 ceph-mon[43817]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:56.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:56 trial127 ceph-mon[43817]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T13:14:56.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:56 trial127 ceph-mon[43817]: osdmap e21: 4 total, 3 up, 4 in 2026-02-20T13:14:56.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:56 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:56.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:56 trial034 ceph-mon[43332]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:56.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:56 trial034 ceph-mon[43332]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T13:14:56.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:56 trial034 ceph-mon[43332]: osdmap e21: 4 total, 3 up, 4 in 2026-02-20T13:14:56.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:56 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:14:57.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.709+0000 7f49fc9bb640 1 -- 10.20.193.28:0/1019669809 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f49f8174fd0 con 0x7f49cc0b56d0 2026-02-20T13:14:57.712 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 3 on host 'trial028' 2026-02-20T13:14:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49cc0b56d0 msgr2=0x7f49cc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49cc0b56d0 0x7f49cc0d5b80 secure :-1 s=READY pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e0004740 tx=0x7f49e0005f90 comp rx=0 tx=0).stop 2026-02-20T13:14:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49f810f0a0 msgr2=0x7f49f80f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49f810f0a0 0x7f49f80f92e0 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49ec009480 tx=0x7f49ec00ee60 comp rx=0 tx=0).stop 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 shutdown_connections 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49cc0b56d0 0x7f49cc0d5b80 unknown :-1 s=CLOSED pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49f8110810 0x7f49f80f9b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f49f810fa50 0x7f49f81717e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 --2- 10.20.193.28:0/1019669809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49f810f0a0 0x7f49f80f92e0 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 >> 10.20.193.28:0/1019669809 conn(0x7f49f80eca40 msgr2=0x7f49f80ef8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 shutdown_connections 2026-02-20T13:14:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:14:57.712+0000 7f49fd9bd640 1 -- 10.20.193.28:0/1019669809 wait complete. 2026-02-20T13:14:57.818 DEBUG:teuthology.orchestra.run.trial028:osd.3> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.3.service 2026-02-20T13:14:57.822 INFO:tasks.cephadm:Deploying osd.4 on trial034 with /dev/vg_nvme/lv_3... 2026-02-20T13:14:57.822 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-20T13:14:57.947 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.b/config 2026-02-20T13:14:58.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:57 trial028 ceph-mon[37442]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:58.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.100 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:14:57 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3[65019]: 2026-02-20T13:14:57.942+0000 7f2b24e36780 -1 osd.3 0 log_to_monitors true 2026-02-20T13:14:58.101 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.101 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.101 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:57 trial034 ceph-mon[43332]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:58.101 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.101 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:57 trial127 ceph-mon[43817]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:14:58.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:58.420 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:14:58.441 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial034:vg_nvme/lv_3 --skip-validation 2026-02-20T13:14:58.559 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.b/config 2026-02-20T13:14:58.677 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 -- 10.20.193.34:0/1445093229 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78062a40 msgr2=0x7feb78060fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:58.677 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 --2- 10.20.193.34:0/1445093229 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78062a40 0x7feb78060fd0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=6360858752327684188 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb6c009950 tx=0x7feb6c02f190 comp rx=0 tx=0).stop 2026-02-20T13:14:58.677 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 -- 10.20.193.34:0/1445093229 shutdown_connections 2026-02-20T13:14:58.677 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 --2- 10.20.193.34:0/1445093229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb78151190 0x7feb781715d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:58.677 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 --2- 10.20.193.34:0/1445093229 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb78061510 0x7feb78061980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:58.677 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 --2- 10.20.193.34:0/1445093229 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78062a40 0x7feb78060fd0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=6360858752327684188 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:58.677 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 -- 10.20.193.34:0/1445093229 >> 10.20.193.34:0/1445093229 conn(0x7feb780ea7e0 msgr2=0x7feb7810ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:14:58.677 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 -- 10.20.193.34:0/1445093229 shutdown_connections 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 -- 10.20.193.34:0/1445093229 wait complete. 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 Processor -- start 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 -- start start 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.672+0000 7feb7d192640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78061510 0x7feb7815d3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb7d192640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb78062a40 0x7feb7815da30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb7d192640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb78151190 0x7feb7815e630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb7d192640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feb7815ece0 con 0x7feb78062a40 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb7d192640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7feb7815ee50 con 0x7feb78061510 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb7d192640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7feb7815f010 con 0x7feb78151190 2026-02-20T13:14:58.678 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78061510 0x7feb7815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78061510 0x7feb7815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.34:48012/0 (socket says 10.20.193.34:48012) 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 -- 10.20.193.34:0/1216176042 learned_addr learned my addr 10.20.193.34:0/1216176042 (peer_addr_for_me v2:10.20.193.34:0/0) 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb77577640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb78151190 0x7feb7815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76575640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb78062a40 0x7feb7815da30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 -- 10.20.193.34:0/1216176042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb78151190 msgr2=0x7feb7815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb78151190 0x7feb7815e630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 -- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb78062a40 msgr2=0x7feb7815da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb78062a40 0x7feb7815da30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 -- 10.20.193.34:0/1216176042 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c009570 con 0x7feb78061510 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76575640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb78062a40 0x7feb7815da30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:14:58.679 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb76d76640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78061510 0x7feb7815d3e0 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb6c002d80 tx=0x7feb6c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:58.680 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb57fff640 1 -- 10.20.193.34:0/1216176042 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb6c03d070 con 0x7feb78061510 2026-02-20T13:14:58.680 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7815f290 con 0x7feb78061510 2026-02-20T13:14:58.680 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb57fff640 1 -- 10.20.193.34:0/1216176042 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb6c0043d0 con 0x7feb78061510 2026-02-20T13:14:58.680 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb57fff640 1 -- 10.20.193.34:0/1216176042 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb6c041c30 con 0x7feb78061510 2026-02-20T13:14:58.680 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.673+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7815f840 con 0x7feb78061510 2026-02-20T13:14:58.680 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.674+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb78175920 con 0x7feb78061510 2026-02-20T13:14:58.681 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.675+0000 7feb57fff640 1 -- 10.20.193.34:0/1216176042 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7feb6c038920 con 0x7feb78061510 2026-02-20T13:14:58.681 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.676+0000 7feb57fff640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb4c0b5760 0x7feb4c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:14:58.681 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.676+0000 7feb57fff640 1 -- 10.20.193.34:0/1216176042 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3365+0+0 (secure 0 0 0) 0x7feb6c10a980 con 0x7feb78061510 2026-02-20T13:14:58.681 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.676+0000 7feb76575640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb4c0b5760 0x7feb4c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:14:58.681 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.677+0000 7feb57fff640 1 -- 10.20.193.34:0/1216176042 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7feb6c0ce630 con 0x7feb78061510 2026-02-20T13:14:58.682 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.677+0000 7feb76575640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb4c0b5760 0x7feb4c0d5c10 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb60004740 tx=0x7feb60005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:14:58.791 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:14:58.789+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7feb78174fc0 con 0x7feb4c0b5760 2026-02-20T13:14:59.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:59.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:59.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:59.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:59.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:14:59.781 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:14:59 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3[65019]: 2026-02-20T13:14:59.472+0000 7f2b20db8640 -1 osd.3 0 waiting for initial osdmap 2026-02-20T13:14:59.782 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:14:59 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3[65019]: 2026-02-20T13:14:59.479+0000 7f2b1cc7f640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:15:00.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:00.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_3'] 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: osdmap e22: 4 total, 3 up, 4 in 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"} : dispatch 2026-02-20T13:15:00.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='client.? 10.20.193.34:0/64145532' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"} : dispatch 2026-02-20T13:15:00.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:00.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"}]': finished 2026-02-20T13:15:00.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: osdmap e23: 5 total, 3 up, 5 in 2026-02-20T13:15:00.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:00.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:14:59 trial028 ceph-mon[37442]: from='client.? 10.20.193.34:0/746284320' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:00.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:00.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:15:00.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_3'] 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: osdmap e22: 4 total, 3 up, 4 in 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"} : dispatch 2026-02-20T13:15:00.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='client.? 10.20.193.34:0/64145532' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"} : dispatch 2026-02-20T13:15:00.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:00.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"}]': finished 2026-02-20T13:15:00.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: osdmap e23: 5 total, 3 up, 5 in 2026-02-20T13:15:00.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:00.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:14:59 trial127 ceph-mon[43817]: from='client.? 10.20.193.34:0/746284320' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_3'] 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: osdmap e22: 4 total, 3 up, 4 in 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:00.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"} : dispatch 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='client.? 10.20.193.34:0/64145532' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"} : dispatch 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccc69aa4-4352-4e39-aec0-41289a3d0d74"}]': finished 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: osdmap e23: 5 total, 3 up, 5 in 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:00.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:14:59 trial034 ceph-mon[43332]: from='client.? 10.20.193.34:0/746284320' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] boot 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: osdmap e24: 5 total, 4 up, 5 in 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:01.202 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:01.203 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:01.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:15:01.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:15:01.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] boot 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: osdmap e24: 5 total, 4 up, 5 in 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:01.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:01.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:01.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:01.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:01.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:01.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:01.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:15:01.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: osd.3 [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] boot 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: osdmap e24: 5 total, 4 up, 5 in 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:02.663 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: Detected new or changed devices on trial028 2026-02-20T13:15:02.663 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-20T13:15:02.663 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T13:15:02.664 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: osdmap e25: 5 total, 4 up, 5 in 2026-02-20T13:15:02.664 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:02.664 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-20T13:15:02.664 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:02.664 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-20T13:15:02.664 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:02 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:02.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: Detected new or changed devices on trial028 2026-02-20T13:15:02.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-20T13:15:02.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T13:15:02.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: osdmap e25: 5 total, 4 up, 5 in 2026-02-20T13:15:02.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:02.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-20T13:15:02.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:02.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-20T13:15:02.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:02 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: Detected new or changed devices on trial028 2026-02-20T13:15:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-20T13:15:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T13:15:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: osdmap e25: 5 total, 4 up, 5 in 2026-02-20T13:15:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-20T13:15:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-20T13:15:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:02 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:03.737 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:03 trial034 ceph-mon[43332]: Deploying daemon osd.4 on trial034 2026-02-20T13:15:03.738 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:03 trial034 ceph-mon[43332]: Deploying daemon osd.4 on trial034 2026-02-20T13:15:03.738 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:03 trial034 ceph-mon[43332]: osdmap e26: 5 total, 4 up, 5 in 2026-02-20T13:15:03.738 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:03 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:03.738 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:03 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:03.738 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:03 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:03.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:03 trial028 ceph-mon[37442]: Deploying daemon osd.4 on trial034 2026-02-20T13:15:03.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:03 trial028 ceph-mon[37442]: Deploying daemon osd.4 on trial034 2026-02-20T13:15:03.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:03 trial028 ceph-mon[37442]: osdmap e26: 5 total, 4 up, 5 in 2026-02-20T13:15:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:03 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:03 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:03 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:03.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:03 trial127 ceph-mon[43817]: Deploying daemon osd.4 on trial034 2026-02-20T13:15:03.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:03 trial127 ceph-mon[43817]: Deploying daemon osd.4 on trial034 2026-02-20T13:15:03.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:03 trial127 ceph-mon[43817]: osdmap e26: 5 total, 4 up, 5 in 2026-02-20T13:15:03.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:03 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:03.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:03 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:03.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:03 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:04.605 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:04 trial034 ceph-mon[43332]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T13:15:04.605 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:04 trial034 ceph-mon[43332]: osdmap e27: 5 total, 4 up, 5 in 2026-02-20T13:15:04.606 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:04 trial028 ceph-mon[37442]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T13:15:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:04 trial028 ceph-mon[37442]: osdmap e27: 5 total, 4 up, 5 in 2026-02-20T13:15:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:04 trial127 ceph-mon[43817]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T13:15:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:04 trial127 ceph-mon[43817]: osdmap e27: 5 total, 4 up, 5 in 2026-02-20T13:15:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:05.502 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:05 trial034 ceph-mon[43332]: osdmap e28: 5 total, 4 up, 5 in 2026-02-20T13:15:05.503 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:05.503 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:05.503 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:05.813 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.812+0000 7feb57fff640 1 -- 10.20.193.34:0/1216176042 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7feb78174fc0 con 0x7feb4c0b5760 2026-02-20T13:15:05.813 INFO:teuthology.orchestra.run.trial034.stdout:Created osd(s) 4 on host 'trial034' 2026-02-20T13:15:05.815 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb4c0b5760 msgr2=0x7feb4c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:05.815 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb4c0b5760 0x7feb4c0d5c10 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb60004740 tx=0x7feb60005f00 comp rx=0 tx=0).stop 2026-02-20T13:15:05.815 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78061510 msgr2=0x7feb7815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:05.815 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78061510 0x7feb7815d3e0 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb6c002d80 tx=0x7feb6c0028d0 comp rx=0 tx=0).stop 2026-02-20T13:15:05.816 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 shutdown_connections 2026-02-20T13:15:05.816 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb4c0b5760 0x7feb4c0d5c10 unknown :-1 s=CLOSED pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:05.816 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb78062a40 0x7feb7815da30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:05.816 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb78151190 0x7feb7815e630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:05.816 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 --2- 10.20.193.34:0/1216176042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb78061510 0x7feb7815d3e0 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:05.816 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.814+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 >> 10.20.193.34:0/1216176042 conn(0x7feb780ea7e0 msgr2=0x7feb7810abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:05.816 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.815+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 shutdown_connections 2026-02-20T13:15:05.816 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:05.815+0000 7feb7d192640 1 -- 10.20.193.34:0/1216176042 wait complete. 2026-02-20T13:15:05.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:05 trial028 ceph-mon[37442]: osdmap e28: 5 total, 4 up, 5 in 2026-02-20T13:15:05.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:05.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:05.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:05.855 DEBUG:teuthology.orchestra.run.trial034:osd.4> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.4.service 2026-02-20T13:15:05.857 INFO:tasks.cephadm:Deploying osd.5 on trial127 with /dev/vg_nvme/lv_3... 2026-02-20T13:15:05.857 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-20T13:15:05.883 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:05 trial127 ceph-mon[43817]: osdmap e28: 5 total, 4 up, 5 in 2026-02-20T13:15:05.883 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:05.883 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:05.884 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:05.978 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:15:06.440 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:15:06.456 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial127:vg_nvme/lv_3 --skip-validation 2026-02-20T13:15:06.487 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:15:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4[61750]: 2026-02-20T13:15:06.129+0000 7f888ad58780 -1 osd.4 0 log_to_monitors true 2026-02-20T13:15:06.615 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:15:06.716 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 -- 10.20.193.127:0/2625618162 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd70060710 msgr2=0x7fdd7010b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:06.717 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2625618162 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd70060710 0x7fdd7010b6a0 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=10878472772518053573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd60009950 tx=0x7fdd6002f1d0 comp rx=0 tx=0).stop 2026-02-20T13:15:06.717 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 -- 10.20.193.127:0/2625618162 shutdown_connections 2026-02-20T13:15:06.717 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2625618162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd7010bbe0 0x7fdd7010c050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:06.717 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2625618162 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd7010c590 0x7fdd7010c9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:06.717 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2625618162 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd70060710 0x7fdd7010b6a0 unknown :-1 s=CLOSED pgs=32 gs=1 cs=0 l=1 c_cookie=10878472772518053573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:06.717 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 -- 10.20.193.127:0/2625618162 >> 10.20.193.127:0/2625618162 conn(0x7fdd700e9280 msgr2=0x7fdd70109690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:06.718 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 -- 10.20.193.127:0/2625618162 shutdown_connections 2026-02-20T13:15:06.718 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.713+0000 7fdd77c98640 1 -- 10.20.193.127:0/2625618162 wait complete. 2026-02-20T13:15:06.718 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:06 trial127 ceph-mon[43817]: pgmap v62: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T13:15:06.719 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.719 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.719 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:06 trial127 ceph-mon[43817]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-20T13:15:06.719 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:06 trial127 ceph-mon[43817]: from='osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-20T13:15:06.719 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.719 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.719 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:06.724 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 Processor -- start 2026-02-20T13:15:06.724 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 -- start start 2026-02-20T13:15:06.724 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd70060710 0x7fdd700f5620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:06.724 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd7010bbe0 0x7fdd700f5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:06.724 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd7010c590 0x7fdd700f6870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:06.724 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd700f6fb0 con 0x7fdd7010c590 2026-02-20T13:15:06.725 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdd700f7120 con 0x7fdd70060710 2026-02-20T13:15:06.725 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdd700f72e0 con 0x7fdd7010bbe0 2026-02-20T13:15:06.725 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd7010bbe0 0x7fdd700f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:06.725 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd7010bbe0 0x7fdd700f5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:49732/0 (socket says 10.20.193.127:49732) 2026-02-20T13:15:06.725 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 -- 10.20.193.127:0/2015599650 learned_addr learned my addr 10.20.193.127:0/2015599650 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-20T13:15:06.725 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd75a0d640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd70060710 0x7fdd700f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:06.725 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7620e640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd7010c590 0x7fdd700f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:06.725 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 -- 10.20.193.127:0/2015599650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd70060710 msgr2=0x7fdd700f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:06.726 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd70060710 0x7fdd700f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:06.726 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 -- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd7010c590 msgr2=0x7fdd700f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:06.726 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd7010c590 0x7fdd700f6870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:06.726 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 -- 10.20.193.127:0/2015599650 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd60009570 con 0x7fdd7010bbe0 2026-02-20T13:15:06.726 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd7520c640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd7010bbe0 0x7fdd700f5c70 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd6400d950 tx=0x7fdd6400de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:06.726 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd5effd640 1 -- 10.20.193.127:0/2015599650 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd64004540 con 0x7fdd7010bbe0 2026-02-20T13:15:06.726 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd700f75c0 con 0x7fdd7010bbe0 2026-02-20T13:15:06.727 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd5effd640 1 -- 10.20.193.127:0/2015599650 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdd64009d00 con 0x7fdd7010bbe0 2026-02-20T13:15:06.727 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd5effd640 1 -- 10.20.193.127:0/2015599650 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd640106e0 con 0x7fdd7010bbe0 2026-02-20T13:15:06.727 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.714+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd700f7b40 con 0x7fdd7010bbe0 2026-02-20T13:15:06.727 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.715+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd701754c0 con 0x7fdd7010bbe0 2026-02-20T13:15:06.727 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.716+0000 7fdd5effd640 1 -- 10.20.193.127:0/2015599650 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7fdd640097c0 con 0x7fdd7010bbe0 2026-02-20T13:15:06.727 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.717+0000 7fdd5effd640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd4c0b56e0 0x7fdd4c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:06.727 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.717+0000 7fdd5effd640 1 -- 10.20.193.127:0/2015599650 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3776+0+0 (secure 0 0 0) 0x7fdd640e6090 con 0x7fdd7010bbe0 2026-02-20T13:15:06.727 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.717+0000 7fdd75a0d640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd4c0b56e0 0x7fdd4c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:06.728 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.718+0000 7fdd75a0d640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd4c0b56e0 0x7fdd4c0d5b90 secure :-1 s=READY pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd600023d0 tx=0x7fdd60031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:06.728 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.718+0000 7fdd5effd640 1 -- 10.20.193.127:0/2015599650 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fdd640a9c10 con 0x7fdd7010bbe0 2026-02-20T13:15:06.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:06 trial034 ceph-mon[43332]: pgmap v62: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T13:15:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:06 trial034 ceph-mon[43332]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-20T13:15:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:06 trial034 ceph-mon[43332]: from='osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-20T13:15:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:06.753 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:06 trial028 ceph-mon[37442]: pgmap v62: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T13:15:06.753 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.753 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.753 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:06 trial028 ceph-mon[37442]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-20T13:15:06.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:06 trial028 ceph-mon[37442]: from='osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-20T13:15:06.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:06.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:06.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:06.827+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fdd7004ca40 con 0x7fdd4c0b56e0 2026-02-20T13:15:07.753 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:15:07 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4[61750]: 2026-02-20T13:15:07.499+0000 7f8886cda640 -1 osd.4 0 waiting for initial osdmap 2026-02-20T13:15:07.753 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:15:07 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4[61750]: 2026-02-20T13:15:07.503+0000 7f887eb99640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:15:07.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: osdmap e29: 5 total, 4 up, 5 in 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_3'] 2026-02-20T13:15:07.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial127 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: pgmap v64: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 119 KiB/s, 0 objects/s recovering 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"} : dispatch 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/3115030536' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"} : dispatch 2026-02-20T13:15:07.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"}]': finished 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: osdmap e30: 6 total, 4 up, 6 in 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:07.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: osdmap e29: 5 total, 4 up, 5 in 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:15:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_3'] 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial127 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: pgmap v64: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 119 KiB/s, 0 objects/s recovering 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"} : dispatch 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/3115030536' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"} : dispatch 2026-02-20T13:15:08.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"}]': finished 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: osdmap e30: 6 total, 4 up, 6 in 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-20T13:15:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: osdmap e29: 5 total, 4 up, 5 in 2026-02-20T13:15:08.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_3'] 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial127 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:08.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: pgmap v64: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 119 KiB/s, 0 objects/s recovering 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"} : dispatch 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/3115030536' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"} : dispatch 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "772d85ad-8132-408c-bded-4c43600e0648"}]': finished 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: osdmap e30: 6 total, 4 up, 6 in 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:08.243 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.244 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.244 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:08.244 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:09.010 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: Detected new or changed devices on trial034 2026-02-20T13:15:09.010 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:09.010 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:09.010 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial034 to 42023M 2026-02-20T13:15:09.010 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:09.011 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/571753744' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:09.011 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] boot 2026-02-20T13:15:09.011 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: osdmap e31: 6 total, 5 up, 6 in 2026-02-20T13:15:09.011 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:09.011 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:08 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:09.064 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: Detected new or changed devices on trial034 2026-02-20T13:15:09.064 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:09.064 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:09.064 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial034 to 42023M 2026-02-20T13:15:09.064 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:09.065 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/571753744' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:09.065 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] boot 2026-02-20T13:15:09.065 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: osdmap e31: 6 total, 5 up, 6 in 2026-02-20T13:15:09.065 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:09.065 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:08 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:09.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: Detected new or changed devices on trial034 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial034 to 42023M 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/571753744' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: osd.4 [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] boot 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: osdmap e31: 6 total, 5 up, 6 in 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-20T13:15:09.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:08 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:09.879 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:15:09.879 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:15:09.879 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:09.879 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:09.879 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:09.879 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:09.879 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:09.880 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:09.880 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:09.880 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:09.880 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:09.880 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-20T13:15:09.880 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:10.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:15:10.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-20T13:15:10.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:10.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:10.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:10.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:10.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-20T13:15:10.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:11.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:10 trial028 ceph-mon[37442]: Deploying daemon osd.5 on trial127 2026-02-20T13:15:11.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:10 trial028 ceph-mon[37442]: osdmap e32: 6 total, 5 up, 6 in 2026-02-20T13:15:11.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:11.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-20T13:15:11.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:11.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:10 trial028 ceph-mon[37442]: Deploying daemon osd.5 on trial127 2026-02-20T13:15:11.222 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:10 trial127 ceph-mon[43817]: Deploying daemon osd.5 on trial127 2026-02-20T13:15:11.223 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:10 trial127 ceph-mon[43817]: osdmap e32: 6 total, 5 up, 6 in 2026-02-20T13:15:11.223 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:11.223 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-20T13:15:11.223 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:11.223 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:10 trial127 ceph-mon[43817]: Deploying daemon osd.5 on trial127 2026-02-20T13:15:11.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:10 trial034 ceph-mon[43332]: Deploying daemon osd.5 on trial127 2026-02-20T13:15:11.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:10 trial034 ceph-mon[43332]: osdmap e32: 6 total, 5 up, 6 in 2026-02-20T13:15:11.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:11.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-20T13:15:11.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:11.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:10 trial034 ceph-mon[43332]: Deploying daemon osd.5 on trial127 2026-02-20T13:15:12.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:12 trial127 ceph-mon[43817]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:12.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:12.715 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:12 trial028 ceph-mon[37442]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:12 trial034 ceph-mon[43332]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:12.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:12.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:13.896 INFO:teuthology.orchestra.run.trial127.stdout:Created osd(s) 5 on host 'trial127' 2026-02-20T13:15:13.896 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.894+0000 7fdd5effd640 1 -- 10.20.193.127:0/2015599650 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fdd7004ca40 con 0x7fdd4c0b56e0 2026-02-20T13:15:13.898 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd4c0b56e0 msgr2=0x7fdd4c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd4c0b56e0 0x7fdd4c0d5b90 secure :-1 s=READY pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd600023d0 tx=0x7fdd60031040 comp rx=0 tx=0).stop 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd7010bbe0 msgr2=0x7fdd700f5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd7010bbe0 0x7fdd700f5c70 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd6400d950 tx=0x7fdd6400de20 comp rx=0 tx=0).stop 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 shutdown_connections 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd4c0b56e0 0x7fdd4c0d5b90 unknown :-1 s=CLOSED pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd7010c590 0x7fdd700f6870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd7010bbe0 0x7fdd700f5c70 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 --2- 10.20.193.127:0/2015599650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd70060710 0x7fdd700f5620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 >> 10.20.193.127:0/2015599650 conn(0x7fdd700e9280 msgr2=0x7fdd700ebc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:13.899 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 shutdown_connections 2026-02-20T13:15:13.900 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:13.896+0000 7fdd77c98640 1 -- 10.20.193.127:0/2015599650 wait complete. 2026-02-20T13:15:13.936 DEBUG:teuthology.orchestra.run.trial127:osd.5> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.5.service 2026-02-20T13:15:13.938 INFO:tasks.cephadm:Deploying osd.6 on trial028 with /dev/vg_nvme/lv_2... 2026-02-20T13:15:13.938 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-20T13:15:14.127 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:15:14.510 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:14 trial028 ceph-mon[37442]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:14.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:14 trial028 ceph-mon[37442]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-20T13:15:14.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:14 trial028 ceph-mon[37442]: from='osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-20T13:15:14.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.681 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:14 trial127 ceph-mon[43817]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:14.682 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.682 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.682 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.682 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.682 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:14 trial127 ceph-mon[43817]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-20T13:15:14.682 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:14 trial127 ceph-mon[43817]: from='osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-20T13:15:14.682 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.683 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:15:14 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:15:14.238+0000 7f5b091f2780 -1 osd.5 0 log_to_monitors true 2026-02-20T13:15:14.684 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:14 trial034 ceph-mon[43332]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:14.684 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:14.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:14 trial034 ceph-mon[43332]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-20T13:15:14.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:14 trial034 ceph-mon[43332]: from='osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-20T13:15:14.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.082 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:15:15.105 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_2 --skip-validation 2026-02-20T13:15:15.293 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:15:15.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:15.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-20T13:15:15.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: osdmap e33: 6 total, 5 up, 6 in 2026-02-20T13:15:15.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:15.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:15.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:15 trial028 ceph-mon[37442]: from='osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.475+0000 7fc71aede640 1 -- 10.20.193.28:0/893037106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410ce10 msgr2=0x7fc71410d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.475+0000 7fc71aede640 1 --2- 10.20.193.28:0/893037106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410ce10 0x7fc71410d280 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=10208999878681501729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6fc009980 tx=0x7fc6fc02f190 comp rx=0 tx=0).stop 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.475+0000 7fc71aede640 1 -- 10.20.193.28:0/893037106 shutdown_connections 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.475+0000 7fc71aede640 1 --2- 10.20.193.28:0/893037106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410ce10 0x7fc71410d280 unknown :-1 s=CLOSED pgs=157 gs=1 cs=0 l=1 c_cookie=10208999878681501729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.475+0000 7fc71aede640 1 --2- 10.20.193.28:0/893037106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc71410d7c0 0x7fc71416f550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.475+0000 7fc71aede640 1 --2- 10.20.193.28:0/893037106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc71410e580 0x7fc71410e970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.475+0000 7fc71aede640 1 -- 10.20.193.28:0/893037106 >> 10.20.193.28:0/893037106 conn(0x7fc7140ea7d0 msgr2=0x7fc71410abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.476+0000 7fc71aede640 1 -- 10.20.193.28:0/893037106 shutdown_connections 2026-02-20T13:15:15.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.476+0000 7fc71aede640 1 -- 10.20.193.28:0/893037106 wait complete. 2026-02-20T13:15:15.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc71aede640 1 Processor -- start 2026-02-20T13:15:15.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc71aede640 1 -- start start 2026-02-20T13:15:15.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc71aede640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc71410ce10 0x7fc7140f93a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:15.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc71aede640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc71410d7c0 0x7fc71416f550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:15.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc71aede640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410e580 0x7fc7140f9c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:15.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc71aede640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140fa7a0 con 0x7fc71410e580 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc71aede640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140fa910 con 0x7fc71410d7c0 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc71aede640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140faad0 con 0x7fc71410ce10 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc719454640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410e580 0x7fc7140f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc719454640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410e580 0x7fc7140f9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48686/0 (socket says 10.20.193.28:48686) 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc70bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc71410d7c0 0x7fc71416f550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc719454640 1 -- 10.20.193.28:0/3106591084 learned_addr learned my addr 10.20.193.28:0/3106591084 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc718c53640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc71410ce10 0x7fc7140f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc719454640 1 -- 10.20.193.28:0/3106591084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc71410ce10 msgr2=0x7fc7140f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc719454640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc71410ce10 0x7fc7140f93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc719454640 1 -- 10.20.193.28:0/3106591084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc71410d7c0 msgr2=0x7fc71416f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc719454640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc71410d7c0 0x7fc71416f550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:15.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.477+0000 7fc719454640 1 -- 10.20.193.28:0/3106591084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6fc009570 con 0x7fc71410e580 2026-02-20T13:15:15.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.478+0000 7fc719454640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410e580 0x7fc7140f9c00 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc71000f8d0 tx=0x7fc71000fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:15.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.478+0000 7fc709ffb640 1 -- 10.20.193.28:0/3106591084 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc71000dce0 con 0x7fc71410e580 2026-02-20T13:15:15.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.478+0000 7fc709ffb640 1 -- 10.20.193.28:0/3106591084 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc71000de40 con 0x7fc71410e580 2026-02-20T13:15:15.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.478+0000 7fc709ffb640 1 -- 10.20.193.28:0/3106591084 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7100116b0 con 0x7fc71410e580 2026-02-20T13:15:15.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.478+0000 7fc71aede640 1 -- 10.20.193.28:0/3106591084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7140fadb0 con 0x7fc71410e580 2026-02-20T13:15:15.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.478+0000 7fc71aede640 1 -- 10.20.193.28:0/3106591084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7140fb230 con 0x7fc71410e580 2026-02-20T13:15:15.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.479+0000 7fc6e37fe640 1 -- 10.20.193.28:0/3106591084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7141736d0 con 0x7fc71410e580 2026-02-20T13:15:15.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.481+0000 7fc709ffb640 1 -- 10.20.193.28:0/3106591084 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7fc710020060 con 0x7fc71410e580 2026-02-20T13:15:15.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.482+0000 7fc709ffb640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc6f00b58b0 0x7fc6f00d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:15.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.482+0000 7fc709ffb640 1 -- 10.20.193.28:0/3106591084 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4229+0+0 (secure 0 0 0) 0x7fc710015070 con 0x7fc71410e580 2026-02-20T13:15:15.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.482+0000 7fc709ffb640 1 -- 10.20.193.28:0/3106591084 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fc71011f730 con 0x7fc71410e580 2026-02-20T13:15:15.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.483+0000 7fc718c53640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc6f00b58b0 0x7fc6f00d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:15.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.483+0000 7fc718c53640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc6f00b58b0 0x7fc6f00d5d60 secure :-1 s=READY pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc704004740 tx=0x7fc704005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:15.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:15.603+0000 7fc6e37fe640 1 -- 10.20.193.28:0/3106591084 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fc714172d90 con 0x7fc6f00b58b0 2026-02-20T13:15:15.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: osdmap e33: 6 total, 5 up, 6 in 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:15 trial127 ceph-mon[43817]: from='osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:15.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: osdmap e33: 6 total, 5 up, 6 in 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:15.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:15 trial034 ceph-mon[43332]: from='osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:16.227 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:15:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:15:15.898+0000 7f5b05174640 -1 osd.5 0 waiting for initial osdmap 2026-02-20T13:15:16.227 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:15:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:15:15.902+0000 7f5b0103b640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:15:16.401 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:16.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:16.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:16.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:16.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:16.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:16.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:16.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:16.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:16.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:16.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:16.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:15:16.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: osdmap e34: 6 total, 5 up, 6 in 2026-02-20T13:15:16.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:16.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:16 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: osdmap e34: 6 total, 5 up, 6 in 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:16.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:16 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:15:16.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: osdmap e34: 6 total, 5 up, 6 in 2026-02-20T13:15:16.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:16.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:16 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:17.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_2'] 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial028 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: Detected new or changed devices on trial127 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial127 to 42023M 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/353287277' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "48076158-4886-4ca9-8eb0-d9f1adeb4b9a"} : dispatch 2026-02-20T13:15:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/353287277' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48076158-4886-4ca9-8eb0-d9f1adeb4b9a"}]': finished 2026-02-20T13:15:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] boot 2026-02-20T13:15:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: osdmap e35: 7 total, 6 up, 7 in 2026-02-20T13:15:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:17 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/265567741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:17.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:15:17.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:15:17.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:17.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:15:17.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_2'] 2026-02-20T13:15:17.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:15:17.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial028 2026-02-20T13:15:17.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: Detected new or changed devices on trial127 2026-02-20T13:15:17.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial127 to 42023M 2026-02-20T13:15:17.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/353287277' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "48076158-4886-4ca9-8eb0-d9f1adeb4b9a"} : dispatch 2026-02-20T13:15:17.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/353287277' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48076158-4886-4ca9-8eb0-d9f1adeb4b9a"}]': finished 2026-02-20T13:15:17.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] boot 2026-02-20T13:15:17.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: osdmap e35: 7 total, 6 up, 7 in 2026-02-20T13:15:17.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:17.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:17.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:17 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/265567741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:17.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:15:17.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:15:17.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:17.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:15:17.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_2'] 2026-02-20T13:15:17.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:15:17.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial028 2026-02-20T13:15:17.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: Detected new or changed devices on trial127 2026-02-20T13:15:17.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial127 to 42023M 2026-02-20T13:15:17.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/353287277' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "48076158-4886-4ca9-8eb0-d9f1adeb4b9a"} : dispatch 2026-02-20T13:15:17.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/353287277' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48076158-4886-4ca9-8eb0-d9f1adeb4b9a"}]': finished 2026-02-20T13:15:17.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: osd.5 [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] boot 2026-02-20T13:15:17.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: osdmap e35: 7 total, 6 up, 7 in 2026-02-20T13:15:17.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-20T13:15:17.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:17.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:17 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/265567741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:18.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:18 trial127 ceph-mon[43817]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:18.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:18 trial127 ceph-mon[43817]: osdmap e36: 7 total, 6 up, 7 in 2026-02-20T13:15:18.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:18.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:18 trial034 ceph-mon[43332]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:18.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:18 trial034 ceph-mon[43332]: osdmap e36: 7 total, 6 up, 7 in 2026-02-20T13:15:18.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:18.775 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:18 trial028 ceph-mon[37442]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:18.775 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:18 trial028 ceph-mon[37442]: osdmap e36: 7 total, 6 up, 7 in 2026-02-20T13:15:18.775 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:19.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:19 trial028 ceph-mon[37442]: osdmap e37: 7 total, 6 up, 7 in 2026-02-20T13:15:19.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:19 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:19.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:19 trial028 ceph-mon[37442]: osdmap e38: 7 total, 6 up, 7 in 2026-02-20T13:15:19.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:19 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:19.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:19 trial028 ceph-mon[37442]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:20.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:19 trial127 ceph-mon[43817]: osdmap e37: 7 total, 6 up, 7 in 2026-02-20T13:15:20.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:19 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:20.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:19 trial127 ceph-mon[43817]: osdmap e38: 7 total, 6 up, 7 in 2026-02-20T13:15:20.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:19 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:20.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:19 trial127 ceph-mon[43817]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:20.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:19 trial034 ceph-mon[43332]: osdmap e37: 7 total, 6 up, 7 in 2026-02-20T13:15:20.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:19 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:20.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:19 trial034 ceph-mon[43332]: osdmap e38: 7 total, 6 up, 7 in 2026-02-20T13:15:20.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:19 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:20.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:19 trial034 ceph-mon[43332]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:21.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:21 trial028 ceph-mon[37442]: osdmap e39: 7 total, 6 up, 7 in 2026-02-20T13:15:21.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:21.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-20T13:15:21.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:21.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:21 trial028 ceph-mon[37442]: Deploying daemon osd.6 on trial028 2026-02-20T13:15:21.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-20T13:15:21.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:21.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:21 trial127 ceph-mon[43817]: osdmap e39: 7 total, 6 up, 7 in 2026-02-20T13:15:21.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:21.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-20T13:15:21.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:21.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:21 trial127 ceph-mon[43817]: Deploying daemon osd.6 on trial028 2026-02-20T13:15:21.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-20T13:15:21.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:21.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:21 trial034 ceph-mon[43332]: osdmap e39: 7 total, 6 up, 7 in 2026-02-20T13:15:21.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:21.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-20T13:15:21.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:21.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:21 trial034 ceph-mon[43332]: Deploying daemon osd.6 on trial028 2026-02-20T13:15:21.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-20T13:15:21.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:22.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:22 trial028 ceph-mon[37442]: Deploying daemon osd.6 on trial028 2026-02-20T13:15:22.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:22 trial028 ceph-mon[37442]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:22.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:22 trial127 ceph-mon[43817]: Deploying daemon osd.6 on trial028 2026-02-20T13:15:22.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:22 trial127 ceph-mon[43817]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:22.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:22 trial034 ceph-mon[43332]: Deploying daemon osd.6 on trial028 2026-02-20T13:15:22.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:22 trial034 ceph-mon[43332]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:24.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:24.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:24.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:24 trial028 ceph-mon[37442]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:24.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:24.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:24.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:24 trial127 ceph-mon[43817]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:24.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:24.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:24.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:24 trial034 ceph-mon[43332]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T13:15:25.255 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:25 trial028 ceph-mon[37442]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:25.255 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:25 trial028 ceph-mon[37442]: from='osd.6 [v2:10.20.193.28:6818/3597939661,v1:10.20.193.28:6819/3597939661]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:25.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:25 trial127 ceph-mon[43817]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:25.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:25 trial127 ceph-mon[43817]: from='osd.6 [v2:10.20.193.28:6818/3597939661,v1:10.20.193.28:6819/3597939661]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:25.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:25.479+0000 7fc71a6dd640 1 -- 10.20.193.28:0/3106591084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=34}) -- 0x7fc6ec003560 con 0x7fc71410e580 2026-02-20T13:15:25.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:25.479+0000 7fc709ffb640 1 -- 10.20.193.28:0/3106591084 <== mon.0 v2:10.20.193.28:3300/0 7 ==== osd_map(34..40 src has 1..40) ==== 4377+0+0 (secure 0 0 0) 0x7fc7100aeae0 con 0x7fc71410e580 2026-02-20T13:15:25.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:25 trial034 ceph-mon[43332]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:25.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:25 trial034 ceph-mon[43332]: from='osd.6 [v2:10.20.193.28:6818/3597939661,v1:10.20.193.28:6819/3597939661]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:26.184 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:26 trial028 ceph-mon[37442]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T13:15:26.184 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:26 trial028 ceph-mon[37442]: osdmap e40: 7 total, 6 up, 7 in 2026-02-20T13:15:26.184 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:26.184 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:26 trial028 ceph-mon[37442]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 92 KiB/s, 0 objects/s recovering 2026-02-20T13:15:26.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:26 trial127 ceph-mon[43817]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T13:15:26.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:26 trial127 ceph-mon[43817]: osdmap e40: 7 total, 6 up, 7 in 2026-02-20T13:15:26.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:26.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:26 trial127 ceph-mon[43817]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 92 KiB/s, 0 objects/s recovering 2026-02-20T13:15:26.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:26 trial034 ceph-mon[43332]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T13:15:26.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:26 trial034 ceph-mon[43332]: osdmap e40: 7 total, 6 up, 7 in 2026-02-20T13:15:26.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:26.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:26 trial034 ceph-mon[43332]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 92 KiB/s, 0 objects/s recovering 2026-02-20T13:15:27.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.221+0000 7fc709ffb640 1 -- 10.20.193.28:0/3106591084 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc714172d90 con 0x7fc6f00b58b0 2026-02-20T13:15:27.224 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 6 on host 'trial028' 2026-02-20T13:15:27.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.223+0000 7fc6e37fe640 1 -- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc6f00b58b0 msgr2=0x7fc6f00d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:27.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.223+0000 7fc6e37fe640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc6f00b58b0 0x7fc6f00d5d60 secure :-1 s=READY pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc704004740 tx=0x7fc704005f90 comp rx=0 tx=0).stop 2026-02-20T13:15:27.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.223+0000 7fc6e37fe640 1 -- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410e580 msgr2=0x7fc7140f9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:27.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.223+0000 7fc6e37fe640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410e580 0x7fc7140f9c00 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc71000f8d0 tx=0x7fc71000fda0 comp rx=0 tx=0).stop 2026-02-20T13:15:27.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.224+0000 7fc6e37fe640 1 -- 10.20.193.28:0/3106591084 shutdown_connections 2026-02-20T13:15:27.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.224+0000 7fc6e37fe640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc6f00b58b0 0x7fc6f00d5d60 unknown :-1 s=CLOSED pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:27.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.224+0000 7fc6e37fe640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc71410e580 0x7fc7140f9c00 unknown :-1 s=CLOSED pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:27.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.224+0000 7fc6e37fe640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc71410d7c0 0x7fc71416f550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:27.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.224+0000 7fc6e37fe640 1 --2- 10.20.193.28:0/3106591084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc71410ce10 0x7fc7140f93a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:27.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.224+0000 7fc6e37fe640 1 -- 10.20.193.28:0/3106591084 >> 10.20.193.28:0/3106591084 conn(0x7fc7140ea7d0 msgr2=0x7fc7140ed6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:27.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.224+0000 7fc6e37fe640 1 -- 10.20.193.28:0/3106591084 shutdown_connections 2026-02-20T13:15:27.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:27.224+0000 7fc6e37fe640 1 -- 10.20.193.28:0/3106591084 wait complete. 2026-02-20T13:15:27.334 DEBUG:teuthology.orchestra.run.trial028:osd.6> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.6.service 2026-02-20T13:15:27.338 INFO:tasks.cephadm:Deploying osd.7 on trial034 with /dev/vg_nvme/lv_2... 2026-02-20T13:15:27.338 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-20T13:15:27.462 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.b/config 2026-02-20T13:15:27.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:27 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:27 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:27 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:27 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:27 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:27 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:27 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:27 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.851 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:15:27 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:15:27.562+0000 7fc378441780 -1 osd.6 0 log_to_monitors true 2026-02-20T13:15:27.919 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:15:27.939 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial034:vg_nvme/lv_2 --skip-validation 2026-02-20T13:15:27.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:27 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:27 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:27 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:27.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:27 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.057 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.b/config 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.160+0000 7f169c99a640 1 -- 10.20.193.34:0/592197554 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 msgr2=0x7f169410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.160+0000 7f169c99a640 1 --2- 10.20.193.34:0/592197554 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 0x7f169410f520 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=2441199040423158359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1680009950 tx=0x7f168002f1d0 comp rx=0 tx=0).stop 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 -- 10.20.193.34:0/592197554 shutdown_connections 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 --2- 10.20.193.34:0/592197554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f169410fa60 0x7f16941717f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 --2- 10.20.193.34:0/592197554 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 0x7f169410f520 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=2441199040423158359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 --2- 10.20.193.34:0/592197554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1694110820 0x7f1694110c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 -- 10.20.193.34:0/592197554 >> 10.20.193.34:0/592197554 conn(0x7f16940eca70 msgr2=0x7f169410ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 -- 10.20.193.34:0/592197554 shutdown_connections 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 -- 10.20.193.34:0/592197554 wait complete. 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 Processor -- start 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 -- start start 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 0x7f16940f9330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:28.163 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f169410fa60 0x7f16941717f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1694110820 0x7f16940f9b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f16940fa780 con 0x7f169410fa60 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f16940fa8f0 con 0x7f169410f0b0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169c99a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f16940faab0 con 0x7f1694110820 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 0x7f16940f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 0x7f16940f9330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.34:40586/0 (socket says 10.20.193.34:40586) 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 -- 10.20.193.34:0/79945174 learned_addr learned my addr 10.20.193.34:0/79945174 (peer_addr_for_me v2:10.20.193.34:0/0) 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f1699f0e640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f169410fa60 0x7f16941717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 -- 10.20.193.34:0/79945174 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1694110820 msgr2=0x7f16940f9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1694110820 0x7f16940f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 -- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f169410fa60 msgr2=0x7f16941717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f169410fa60 0x7f16941717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 -- 10.20.193.34:0/79945174 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1680009570 con 0x7f169410f0b0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f169a70f640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 0x7f16940f9330 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f168c00d950 tx=0x7f168c00de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.161+0000 7f167f7fe640 1 -- 10.20.193.34:0/79945174 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f168c004540 con 0x7f169410f0b0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.162+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16940fad90 con 0x7f169410f0b0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.162+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16940fb2b0 con 0x7f169410f0b0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.162+0000 7f167f7fe640 1 -- 10.20.193.34:0/79945174 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f168c009d00 con 0x7f169410f0b0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.162+0000 7f167f7fe640 1 -- 10.20.193.34:0/79945174 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f168c0106e0 con 0x7f169410f0b0 2026-02-20T13:15:28.164 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.162+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1694175900 con 0x7f169410f0b0 2026-02-20T13:15:28.165 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.163+0000 7f167f7fe640 1 -- 10.20.193.34:0/79945174 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f168c0027c0 con 0x7f169410f0b0 2026-02-20T13:15:28.167 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.164+0000 7f167f7fe640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16700b56e0 0x7f16700d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:28.167 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.164+0000 7f167f7fe640 1 -- 10.20.193.34:0/79945174 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4661+0+0 (secure 0 0 0) 0x7f168c0e64e0 con 0x7f169410f0b0 2026-02-20T13:15:28.167 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.164+0000 7f1699f0e640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16700b56e0 0x7f16700d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:28.167 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.164+0000 7f167f7fe640 1 -- 10.20.193.34:0/79945174 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f168c0a9c80 con 0x7f169410f0b0 2026-02-20T13:15:28.167 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.165+0000 7f1699f0e640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16700b56e0 0x7f16700d5b90 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16800098a0 tx=0x7f1680031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:28.276 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:28.274+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f1694174fa0 con 0x7f16700b56e0 2026-02-20T13:15:28.649 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-20T13:15:28.650 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:28.650 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.650 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.650 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:28.650 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.650 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.650 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:28.651 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:28.651 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:28.651 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.651 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:28.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.214 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:15:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:15:28.952+0000 7fc3743c3640 -1 osd.6 0 waiting for initial osdmap 2026-02-20T13:15:29.214 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:15:28 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:15:28.959+0000 7fc37028a640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:15:29.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_2'] 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: osdmap e41: 7 total, 6 up, 7 in 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"} : dispatch 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='client.? 10.20.193.34:0/3867202053' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"} : dispatch 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"}]': finished 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: osdmap e42: 8 total, 6 up, 8 in 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='client.? 10.20.193.34:0/1191301890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_2'] 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: osdmap e41: 7 total, 6 up, 7 in 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"} : dispatch 2026-02-20T13:15:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='client.? 10.20.193.34:0/3867202053' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"} : dispatch 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"}]': finished 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: osdmap e42: 8 total, 6 up, 8 in 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='client.? 10.20.193.34:0/1191301890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:29.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:15:29.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_2'] 2026-02-20T13:15:29.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:29.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:29.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T13:15:29.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: osdmap e41: 7 total, 6 up, 7 in 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"} : dispatch 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='client.? 10.20.193.34:0/3867202053' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"} : dispatch 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f995ac5e-8e5e-43ac-b394-5bae7a4bf16d"}]': finished 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: osdmap e42: 8 total, 6 up, 8 in 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:29.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:29.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='client.? 10.20.193.34:0/1191301890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:29.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:29.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T13:15:30.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] boot 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: osdmap e43: 8 total, 7 up, 8 in 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:30.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:30.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:30.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:30.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:30.684 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T13:15:30.684 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] boot 2026-02-20T13:15:30.684 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: osdmap e43: 8 total, 7 up, 8 in 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.685 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.686 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:30.686 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:30.686 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.686 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:30.686 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:30.686 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T13:15:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: osd.6 [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] boot 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: osdmap e43: 8 total, 7 up, 8 in 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:30.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:30.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:30.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:30.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:30.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:30.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:31.778 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:31 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:15:31.779 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:31 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:15:31.779 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:31 trial034 ceph-mon[43332]: Detected new or changed devices on trial028 2026-02-20T13:15:31.779 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:31 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-20T13:15:31.779 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-20T13:15:31.779 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:31.779 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-20T13:15:31.779 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:31.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:31 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:15:31.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:31 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:15:31.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:31 trial028 ceph-mon[37442]: Detected new or changed devices on trial028 2026-02-20T13:15:31.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:31 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-20T13:15:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-20T13:15:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-20T13:15:31.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:31 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:15:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:31 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:15:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:31 trial127 ceph-mon[43817]: Detected new or changed devices on trial028 2026-02-20T13:15:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:31 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-20T13:15:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-20T13:15:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-20T13:15:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:32.796 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:32 trial034 ceph-mon[43332]: Deploying daemon osd.7 on trial034 2026-02-20T13:15:32.796 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:32 trial034 ceph-mon[43332]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:32.796 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:32 trial034 ceph-mon[43332]: Deploying daemon osd.7 on trial034 2026-02-20T13:15:32.796 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:32 trial034 ceph-mon[43332]: osdmap e44: 8 total, 7 up, 8 in 2026-02-20T13:15:32.797 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:32 trial028 ceph-mon[37442]: Deploying daemon osd.7 on trial034 2026-02-20T13:15:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:32 trial028 ceph-mon[37442]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:32 trial028 ceph-mon[37442]: Deploying daemon osd.7 on trial034 2026-02-20T13:15:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:32 trial028 ceph-mon[37442]: osdmap e44: 8 total, 7 up, 8 in 2026-02-20T13:15:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:32 trial127 ceph-mon[43817]: Deploying daemon osd.7 on trial034 2026-02-20T13:15:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:32 trial127 ceph-mon[43817]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:32 trial127 ceph-mon[43817]: Deploying daemon osd.7 on trial034 2026-02-20T13:15:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:32 trial127 ceph-mon[43817]: osdmap e44: 8 total, 7 up, 8 in 2026-02-20T13:15:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:34.116 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:34.116 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:34.116 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:33 trial034 ceph-mon[43332]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:34.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:34.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:34.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:33 trial127 ceph-mon[43817]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:34.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:34.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:34.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:33 trial028 ceph-mon[37442]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:35.185 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.182+0000 7f167f7fe640 1 -- 10.20.193.34:0/79945174 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f1694174fa0 con 0x7f16700b56e0 2026-02-20T13:15:35.185 INFO:teuthology.orchestra.run.trial034.stdout:Created osd(s) 7 on host 'trial034' 2026-02-20T13:15:35.187 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16700b56e0 msgr2=0x7f16700d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:35.187 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16700b56e0 0x7f16700d5b90 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16800098a0 tx=0x7f1680031040 comp rx=0 tx=0).stop 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 msgr2=0x7f16940f9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 0x7f16940f9330 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f168c00d950 tx=0x7f168c00de20 comp rx=0 tx=0).stop 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 shutdown_connections 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16700b56e0 0x7f16700d5b90 unknown :-1 s=CLOSED pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f169410fa60 0x7f16941717f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1694110820 0x7f16940f9b90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 --2- 10.20.193.34:0/79945174 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f169410f0b0 0x7f16940f9330 unknown :-1 s=CLOSED pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 >> 10.20.193.34:0/79945174 conn(0x7f16940eca70 msgr2=0x7f16940ef950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 shutdown_connections 2026-02-20T13:15:35.188 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:35.185+0000 7f169c99a640 1 -- 10.20.193.34:0/79945174 wait complete. 2026-02-20T13:15:35.229 DEBUG:teuthology.orchestra.run.trial034:osd.7> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.7.service 2026-02-20T13:15:35.231 INFO:tasks.cephadm:Deploying osd.8 on trial127 with /dev/vg_nvme/lv_2... 2026-02-20T13:15:35.231 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-20T13:15:35.354 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:15:35.765 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:35.765 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:35.765 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:35.765 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:35.765 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:35 trial127 ceph-mon[43817]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:35.765 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:35 trial127 ceph-mon[43817]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-20T13:15:35.765 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:35 trial127 ceph-mon[43817]: from='osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-20T13:15:35.830 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:15:35.848 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial127:vg_nvme/lv_2 --skip-validation 2026-02-20T13:15:35.967 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:15:35.969 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:35.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:35.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:35.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:35.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:35 trial034 ceph-mon[43332]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:35.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:35 trial034 ceph-mon[43332]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-20T13:15:35.970 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:35 trial034 ceph-mon[43332]: from='osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-20T13:15:35.971 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:15:35 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:15:35.508+0000 7f2cb30d7780 -1 osd.7 0 log_to_monitors true 2026-02-20T13:15:36.074 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- 10.20.193.127:0/3079790713 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d10110810 msgr2=0x7f8d10110c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:36.075 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3079790713 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d10110810 0x7f8d10110c00 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=16188252099783615676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cfc009980 tx=0x7f8cfc02f180 comp rx=0 tx=0).stop 2026-02-20T13:15:36.075 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- 10.20.193.127:0/3079790713 shutdown_connections 2026-02-20T13:15:36.075 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3079790713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1010f0a0 0x7f8d1010f510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:36.075 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3079790713 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8d1010fa50 0x7f8d101717e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:36.076 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3079790713 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d10110810 0x7f8d10110c00 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=16188252099783615676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:36.076 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- 10.20.193.127:0/3079790713 >> 10.20.193.127:0/3079790713 conn(0x7f8d100eca40 msgr2=0x7f8d1010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:36.076 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- 10.20.193.127:0/3079790713 shutdown_connections 2026-02-20T13:15:36.076 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- 10.20.193.127:0/3079790713 wait complete. 2026-02-20T13:15:36.076 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 Processor -- start 2026-02-20T13:15:36.076 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- start start 2026-02-20T13:15:36.076 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8d1010f0a0 0x7f8d100f9370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:36.077 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d1010fa50 0x7f8d101717e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:36.077 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d10110810 0x7f8d100f9bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:36.077 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100fa7c0 con 0x7f8d10110810 2026-02-20T13:15:36.077 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100fa930 con 0x7f8d1010f0a0 2026-02-20T13:15:36.077 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d160cd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100faaf0 con 0x7f8d1010fa50 2026-02-20T13:15:36.077 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d0effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d1010fa50 0x7f8d101717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:36.078 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d0effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d1010fa50 0x7f8d101717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:44706/0 (socket says 10.20.193.127:44706) 2026-02-20T13:15:36.078 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d0effd640 1 -- 10.20.193.127:0/3078595816 learned_addr learned my addr 10.20.193.127:0/3078595816 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-20T13:15:36.078 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d0f7fe640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8d1010f0a0 0x7f8d100f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:36.078 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.069+0000 7f8d0ffff640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d10110810 0x7f8d100f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:36.078 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0effd640 1 -- 10.20.193.127:0/3078595816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8d1010f0a0 msgr2=0x7f8d100f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:36.078 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0effd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8d1010f0a0 0x7f8d100f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:36.079 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0effd640 1 -- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d10110810 msgr2=0x7f8d100f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:36.079 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0effd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d10110810 0x7f8d100f9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:36.079 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0effd640 1 -- 10.20.193.127:0/3078595816 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc009570 con 0x7f8d1010fa50 2026-02-20T13:15:36.079 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0effd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d1010fa50 0x7f8d101717e0 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d0000d950 tx=0x7f8d0000de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:36.079 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0cff9640 1 -- 10.20.193.127:0/3078595816 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d00004540 con 0x7f8d1010fa50 2026-02-20T13:15:36.079 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0cff9640 1 -- 10.20.193.127:0/3078595816 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8d00009d00 con 0x7f8d1010fa50 2026-02-20T13:15:36.080 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d100fadd0 con 0x7f8d1010fa50 2026-02-20T13:15:36.080 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d0cff9640 1 -- 10.20.193.127:0/3078595816 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d000106e0 con 0x7f8d1010fa50 2026-02-20T13:15:36.080 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d100fb2f0 con 0x7f8d1010fa50 2026-02-20T13:15:36.080 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.070+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d10175910 con 0x7f8d1010fa50 2026-02-20T13:15:36.080 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.072+0000 7f8d0cff9640 1 -- 10.20.193.127:0/3078595816 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f8d000097c0 con 0x7f8d1010fa50 2026-02-20T13:15:36.080 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.072+0000 7f8d0cff9640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ce40b5760 0x7f8ce40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:36.081 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.073+0000 7f8d0cff9640 1 -- 10.20.193.127:0/3078595816 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5072+0+0 (secure 0 0 0) 0x7f8d000e6460 con 0x7f8d1010fa50 2026-02-20T13:15:36.081 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.073+0000 7f8d0f7fe640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ce40b5760 0x7f8ce40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:36.081 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.073+0000 7f8d0f7fe640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ce40b5760 0x7f8ce40d5c10 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cfc002d20 tx=0x7f8cfc03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:36.081 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.073+0000 7f8d0cff9640 1 -- 10.20.193.127:0/3078595816 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8d000a9a90 con 0x7f8d1010fa50 2026-02-20T13:15:36.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:35 trial028 ceph-mon[37442]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:36.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:35 trial028 ceph-mon[37442]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-20T13:15:36.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:35 trial028 ceph-mon[37442]: from='osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-20T13:15:36.185 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:36.184+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f8d10174fd0 con 0x7f8ce40b5760 2026-02-20T13:15:36.934 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.934 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.934 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:36.934 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_2'] 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: osdmap e45: 8 total, 7 up, 8 in 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial127 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:36.935 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:36.936 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.936 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:36.936 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.936 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.936 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_2'] 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: osdmap e45: 8 total, 7 up, 8 in 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial127 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:36.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:36.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:36.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.991 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:15:36 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:15:36.889+0000 7f2caf059640 -1 osd.7 0 waiting for initial osdmap 2026-02-20T13:15:36.991 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:15:36 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:15:36.894+0000 7f2ca6f18640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:15:36.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:36.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:36.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:15:36.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_2'] 2026-02-20T13:15:36.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-20T13:15:36.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: osdmap e45: 8 total, 7 up, 8 in 2026-02-20T13:15:36.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:36.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:36.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:15:36.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial127 2026-02-20T13:15:36.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:15:36.993 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:36.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:36.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:36.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:36.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"} : dispatch 2026-02-20T13:15:37.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/1603016029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"} : dispatch 2026-02-20T13:15:37.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"}]': finished 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: osdmap e46: 9 total, 7 up, 9 in 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: Detected new or changed devices on trial034 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:37.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial034 to 28015M 2026-02-20T13:15:37.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/1570617832' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:37.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:37 trial127 ceph-mon[43817]: pgmap v96: 1 pgs: 1 unknown; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:37.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"} : dispatch 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/1603016029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"} : dispatch 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"}]': finished 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: osdmap e46: 9 total, 7 up, 9 in 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: Detected new or changed devices on trial034 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:37.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:37.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:37.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial034 to 28015M 2026-02-20T13:15:37.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:37.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/1570617832' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:37.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:37 trial034 ceph-mon[43332]: pgmap v96: 1 pgs: 1 unknown; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"} : dispatch 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/1603016029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"} : dispatch 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d2e30d1-5c22-405d-9d9c-b3a986a18c64"}]': finished 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: osdmap e46: 9 total, 7 up, 9 in 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: Detected new or changed devices on trial034 2026-02-20T13:15:38.015 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial034 to 28015M 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/1570617832' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:38.016 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:37 trial028 ceph-mon[37442]: pgmap v96: 1 pgs: 1 unknown; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T13:15:39.120 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:15:39.120 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:15:39.120 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] boot 2026-02-20T13:15:39.120 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: osdmap e47: 9 total, 8 up, 9 in 2026-02-20T13:15:39.120 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:39.120 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:39.121 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.121 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.121 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:39.121 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:39.121 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.121 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:39.121 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:39.121 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:39.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:15:39.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:15:39.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] boot 2026-02-20T13:15:39.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: osdmap e47: 9 total, 8 up, 9 in 2026-02-20T13:15:39.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:39.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:39.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:39.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:39.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:39.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:39.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:39.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:15:39.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: osd.7 [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] boot 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: osdmap e47: 9 total, 8 up, 9 in 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:39.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:39.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: osdmap e48: 9 total, 8 up, 9 in 2026-02-20T13:15:39.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:39.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-20T13:15:39.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:39.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: Deploying daemon osd.8 on trial127 2026-02-20T13:15:39.955 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: pgmap v99: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:39.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-20T13:15:39.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:39.956 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:39 trial127 ceph-mon[43817]: Deploying daemon osd.8 on trial127 2026-02-20T13:15:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: osdmap e48: 9 total, 8 up, 9 in 2026-02-20T13:15:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-20T13:15:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: Deploying daemon osd.8 on trial127 2026-02-20T13:15:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: pgmap v99: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-20T13:15:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:40.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:39 trial034 ceph-mon[43332]: Deploying daemon osd.8 on trial127 2026-02-20T13:15:40.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: osdmap e48: 9 total, 8 up, 9 in 2026-02-20T13:15:40.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:40.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-20T13:15:40.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:40.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: Deploying daemon osd.8 on trial127 2026-02-20T13:15:40.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: pgmap v99: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:40.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-20T13:15:40.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:40.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:39 trial028 ceph-mon[37442]: Deploying daemon osd.8 on trial127 2026-02-20T13:15:41.112 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:40 trial127 ceph-mon[43817]: osdmap e49: 9 total, 8 up, 9 in 2026-02-20T13:15:41.112 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:41.112 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:41.112 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:41.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:40 trial034 ceph-mon[43332]: osdmap e49: 9 total, 8 up, 9 in 2026-02-20T13:15:41.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:41.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:41.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:41.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:40 trial028 ceph-mon[37442]: osdmap e49: 9 total, 8 up, 9 in 2026-02-20T13:15:41.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:41.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:41.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:41.951 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:41 trial127 ceph-mon[43817]: osdmap e50: 9 total, 8 up, 9 in 2026-02-20T13:15:41.951 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:41.951 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:41 trial127 ceph-mon[43817]: pgmap v102: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:42.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:41 trial034 ceph-mon[43332]: osdmap e50: 9 total, 8 up, 9 in 2026-02-20T13:15:42.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:42.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:41 trial034 ceph-mon[43332]: pgmap v102: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:42.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:41 trial028 ceph-mon[37442]: osdmap e50: 9 total, 8 up, 9 in 2026-02-20T13:15:42.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:42.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:41 trial028 ceph-mon[37442]: pgmap v102: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:43.158 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:42 trial127 ceph-mon[43817]: osdmap e51: 9 total, 8 up, 9 in 2026-02-20T13:15:43.158 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:42 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:43.158 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:42 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:43.159 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:42 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:43.210 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.209+0000 7f8d0cff9640 1 -- 10.20.193.127:0/3078595816 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f8d10174fd0 con 0x7f8ce40b5760 2026-02-20T13:15:43.211 INFO:teuthology.orchestra.run.trial127.stdout:Created osd(s) 8 on host 'trial127' 2026-02-20T13:15:43.213 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ce40b5760 msgr2=0x7f8ce40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:43.213 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ce40b5760 0x7f8ce40d5c10 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cfc002d20 tx=0x7f8cfc03a040 comp rx=0 tx=0).stop 2026-02-20T13:15:43.213 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d1010fa50 msgr2=0x7f8d101717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:43.213 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d1010fa50 0x7f8d101717e0 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d0000d950 tx=0x7f8d0000de20 comp rx=0 tx=0).stop 2026-02-20T13:15:43.214 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 shutdown_connections 2026-02-20T13:15:43.214 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ce40b5760 0x7f8ce40d5c10 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:43.214 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d10110810 0x7f8d100f9bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:43.214 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8d1010fa50 0x7f8d101717e0 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:43.214 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 --2- 10.20.193.127:0/3078595816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8d1010f0a0 0x7f8d100f9370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:43.214 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 >> 10.20.193.127:0/3078595816 conn(0x7f8d100eca40 msgr2=0x7f8d100ef990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:43.214 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 shutdown_connections 2026-02-20T13:15:43.214 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:15:43.212+0000 7f8d160cd640 1 -- 10.20.193.127:0/3078595816 wait complete. 2026-02-20T13:15:43.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:42 trial034 ceph-mon[43332]: osdmap e51: 9 total, 8 up, 9 in 2026-02-20T13:15:43.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:42 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:43.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:42 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:43.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:42 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:43.253 DEBUG:teuthology.orchestra.run.trial127:osd.8> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.8.service 2026-02-20T13:15:43.255 INFO:tasks.cephadm:Deploying osd.9 on trial028 with /dev/vg_nvme/lv_1... 2026-02-20T13:15:43.256 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-20T13:15:43.310 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:42 trial028 ceph-mon[37442]: osdmap e51: 9 total, 8 up, 9 in 2026-02-20T13:15:43.310 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:42 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:43.310 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:42 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:43.310 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:42 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:43.448 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:15:43.977 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:15:43 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:15:43.579+0000 7f36f6150780 -1 osd.8 0 log_to_monitors true 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:44.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.242 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.361 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.361 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.361 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:44.362 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-20T13:15:44.362 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-20T13:15:44.362 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.362 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.362 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:44.362 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.362 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.364 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:15:44.389 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_1 --skip-validation 2026-02-20T13:15:44.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.440 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:44.576 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:15:44.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.758+0000 7f2d90d34640 1 -- 10.20.193.28:0/4102691314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d8c110360 msgr2=0x7f2d8c1107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:44.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.758+0000 7f2d90d34640 1 --2- 10.20.193.28:0/4102691314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d8c110360 0x7f2d8c1107d0 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=16272153344747114474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d7c009950 tx=0x7f2d7c02f190 comp rx=0 tx=0).stop 2026-02-20T13:15:44.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.758+0000 7f2d90d34640 1 -- 10.20.193.28:0/4102691314 shutdown_connections 2026-02-20T13:15:44.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.758+0000 7f2d90d34640 1 --2- 10.20.193.28:0/4102691314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d8c110360 0x7f2d8c1107d0 unknown :-1 s=CLOSED pgs=167 gs=1 cs=0 l=1 c_cookie=16272153344747114474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.758+0000 7f2d90d34640 1 --2- 10.20.193.28:0/4102691314 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d8c110d10 0x7f2d8c1716a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.758+0000 7f2d90d34640 1 --2- 10.20.193.28:0/4102691314 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2d8c10f1d0 0x7f2d8c10f5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.758+0000 7f2d90d34640 1 -- 10.20.193.28:0/4102691314 >> 10.20.193.28:0/4102691314 conn(0x7f2d8c0ec940 msgr2=0x7f2d8c10cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.758+0000 7f2d90d34640 1 -- 10.20.193.28:0/4102691314 shutdown_connections 2026-02-20T13:15:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.759+0000 7f2d90d34640 1 -- 10.20.193.28:0/4102691314 wait complete. 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.759+0000 7f2d90d34640 1 Processor -- start 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.759+0000 7f2d90d34640 1 -- start start 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d90d34640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2d8c10f1d0 0x7f2d8c0f9270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d90d34640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d8c110360 0x7f2d8c1716a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d90d34640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d8c110d10 0x7f2d8c0f9ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d90d34640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8c0fa6c0 con 0x7f2d8c110360 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d90d34640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8c0fa830 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d90d34640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8c0fa9f0 con 0x7f2d8c110d10 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2d8c10f1d0 0x7f2d8c0f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2d8c10f1d0 0x7f2d8c0f9270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41222/0 (socket says 10.20.193.28:41222) 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8b7fe640 1 -- 10.20.193.28:0/245823259 learned_addr learned my addr 10.20.193.28:0/245823259 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8affd640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d8c110360 0x7f2d8c1716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8bfff640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d8c110d10 0x7f2d8c0f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8b7fe640 1 -- 10.20.193.28:0/245823259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d8c110d10 msgr2=0x7f2d8c0f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8b7fe640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d8c110d10 0x7f2d8c0f9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8b7fe640 1 -- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d8c110360 msgr2=0x7f2d8c1716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8b7fe640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d8c110360 0x7f2d8c1716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.760+0000 7f2d8b7fe640 1 -- 10.20.193.28:0/245823259 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c009570 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.761+0000 7f2d8b7fe640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2d8c10f1d0 0x7f2d8c0f9270 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d78009480 tx=0x7f2d7800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:44.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.761+0000 7f2d88ff9640 1 -- 10.20.193.28:0/245823259 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d7800cd40 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.761+0000 7f2d88ff9640 1 -- 10.20.193.28:0/245823259 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2d78004d30 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.761+0000 7f2d88ff9640 1 -- 10.20.193.28:0/245823259 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d780106b0 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.761+0000 7f2d90d34640 1 -- 10.20.193.28:0/245823259 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8c0facd0 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.761+0000 7f2d90d34640 1 -- 10.20.193.28:0/245823259 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d8c0fb150 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.761+0000 7f2d667fc640 1 -- 10.20.193.28:0/245823259 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8c175710 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.764+0000 7f2d88ff9640 1 -- 10.20.193.28:0/245823259 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f2d7801f060 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.766+0000 7f2d88ff9640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2d600b5760 0x7f2d600d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.766+0000 7f2d88ff9640 1 -- 10.20.193.28:0/245823259 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5525+0+0 (secure 0 0 0) 0x7f2d78014070 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.766+0000 7f2d88ff9640 1 -- 10.20.193.28:0/245823259 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f2d780e6670 con 0x7f2d8c10f1d0 2026-02-20T13:15:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.767+0000 7f2d8affd640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2d600b5760 0x7f2d600d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.767+0000 7f2d8affd640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2d600b5760 0x7f2d600d5c10 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d7c002d80 tx=0x7f2d7c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:44.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:44.886+0000 7f2d667fc640 1 -- 10.20.193.28:0/245823259 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f2d8c10f5c0 con 0x7f2d600b5760 2026-02-20T13:15:45.412 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-20T13:15:45.412 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.412 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: osdmap e52: 9 total, 8 up, 9 in 2026-02-20T13:15:45.412 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:45.412 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:45.412 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:45.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:45.477 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:15:45 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:15:45.216+0000 7f36f20d2640 -1 osd.8 0 waiting for initial osdmap 2026-02-20T13:15:45.477 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:15:45 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:15:45.222+0000 7f36e9f91640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:15:45.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-20T13:15:45.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: osdmap e52: 9 total, 8 up, 9 in 2026-02-20T13:15:45.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:45.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:45.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:45.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.480 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.480 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.480 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:45.480 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:45.480 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.480 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:45.480 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:45.480 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:45.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-20T13:15:45.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: osdmap e52: 9 total, 8 up, 9 in 2026-02-20T13:15:45.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:45.493 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:15:45.494 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:45.494 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:45.494 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:45.494 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:46.469 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:46.469 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:15:46.469 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_1'] 2026-02-20T13:15:46.469 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:15:46.469 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial028 2026-02-20T13:15:46.469 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: Detected new or changed devices on trial127 2026-02-20T13:15:46.469 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial127 to 28015M 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: osdmap e53: 9 total, 8 up, 9 in 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/379399424' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b57f8393-ae99-42fe-9e7a-74462092b493"} : dispatch 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/379399424' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b57f8393-ae99-42fe-9e7a-74462092b493"}]': finished 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] boot 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: osdmap e54: 10 total, 9 up, 10 in 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:46.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:46.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:15:46.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_1'] 2026-02-20T13:15:46.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:15:46.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial028 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: Detected new or changed devices on trial127 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial127 to 28015M 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: osdmap e53: 9 total, 8 up, 9 in 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/379399424' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b57f8393-ae99-42fe-9e7a-74462092b493"} : dispatch 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/379399424' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b57f8393-ae99-42fe-9e7a-74462092b493"}]': finished 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] boot 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: osdmap e54: 10 total, 9 up, 10 in 2026-02-20T13:15:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.479 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:46.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_1'] 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial028 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: Detected new or changed devices on trial127 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial127 to 28015M 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: osdmap e53: 9 total, 8 up, 9 in 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T13:15:46.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/379399424' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b57f8393-ae99-42fe-9e7a-74462092b493"} : dispatch 2026-02-20T13:15:46.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/379399424' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b57f8393-ae99-42fe-9e7a-74462092b493"}]': finished 2026-02-20T13:15:46.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: osd.8 [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] boot 2026-02-20T13:15:46.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: osdmap e54: 10 total, 9 up, 10 in 2026-02-20T13:15:46.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-20T13:15:46.492 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:47.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:47 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:15:47.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:47 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:15:47.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:47 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2185522741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:47.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:47 trial127 ceph-mon[43817]: osdmap e55: 10 total, 9 up, 10 in 2026-02-20T13:15:47.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:47 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:47.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:47 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:15:47.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:47 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:15:47.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:47 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2185522741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:47.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:47 trial034 ceph-mon[43332]: osdmap e55: 10 total, 9 up, 10 in 2026-02-20T13:15:47.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:47 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:47.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:47 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:15:47.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:47 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:15:47.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:47 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2185522741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:47.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:47 trial028 ceph-mon[37442]: osdmap e55: 10 total, 9 up, 10 in 2026-02-20T13:15:47.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:47 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:48.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:48 trial028 ceph-mon[37442]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:48.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:48 trial028 ceph-mon[37442]: osdmap e56: 10 total, 9 up, 10 in 2026-02-20T13:15:48.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:48 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:48.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:48 trial127 ceph-mon[43817]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:48.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:48 trial127 ceph-mon[43817]: osdmap e56: 10 total, 9 up, 10 in 2026-02-20T13:15:48.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:48 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:48.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:48 trial034 ceph-mon[43332]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:48.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:48 trial034 ceph-mon[43332]: osdmap e56: 10 total, 9 up, 10 in 2026-02-20T13:15:48.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:48 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:50.130 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:50 trial028 ceph-mon[37442]: osdmap e57: 10 total, 9 up, 10 in 2026-02-20T13:15:50.131 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:50.131 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:50 trial028 ceph-mon[37442]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:50.131 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-20T13:15:50.131 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:50.131 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:50 trial028 ceph-mon[37442]: Deploying daemon osd.9 on trial028 2026-02-20T13:15:50.131 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-20T13:15:50.131 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:50 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:50.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:50 trial127 ceph-mon[43817]: osdmap e57: 10 total, 9 up, 10 in 2026-02-20T13:15:50.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:50.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:50 trial127 ceph-mon[43817]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-20T13:15:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:50 trial127 ceph-mon[43817]: Deploying daemon osd.9 on trial028 2026-02-20T13:15:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-20T13:15:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:50 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:50 trial034 ceph-mon[43332]: osdmap e57: 10 total, 9 up, 10 in 2026-02-20T13:15:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:50 trial034 ceph-mon[43332]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-20T13:15:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:50 trial034 ceph-mon[43332]: Deploying daemon osd.9 on trial028 2026-02-20T13:15:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-20T13:15:50.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:50 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:51.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:51 trial028 ceph-mon[37442]: Deploying daemon osd.9 on trial028 2026-02-20T13:15:51.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:51 trial028 ceph-mon[37442]: osdmap e58: 10 total, 9 up, 10 in 2026-02-20T13:15:51.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:51 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:51.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:51 trial127 ceph-mon[43817]: Deploying daemon osd.9 on trial028 2026-02-20T13:15:51.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:51 trial127 ceph-mon[43817]: osdmap e58: 10 total, 9 up, 10 in 2026-02-20T13:15:51.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:51 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:51.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:51 trial034 ceph-mon[43332]: Deploying daemon osd.9 on trial028 2026-02-20T13:15:51.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:51 trial034 ceph-mon[43332]: osdmap e58: 10 total, 9 up, 10 in 2026-02-20T13:15:51.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:51 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:52.206 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:52 trial028 ceph-mon[37442]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:52.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:52 trial127 ceph-mon[43817]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:52.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:52 trial034 ceph-mon[43332]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:15:53.748 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:53.748 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:53 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:53.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:53 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:53.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:53 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:53.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:53 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:53.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:53 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:54.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:54 trial028 ceph-mon[37442]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T13:15:54.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:54 trial028 ceph-mon[37442]: from='osd.9 [v2:10.20.193.28:6826/3942858672,v1:10.20.193.28:6827/3942858672]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:54.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:54.763+0000 7f2d917bc640 1 -- 10.20.193.28:0/245823259 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=53}) -- 0x7f2d6c003560 con 0x7f2d8c10f1d0 2026-02-20T13:15:54.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:54.763+0000 7f2d88ff9640 1 -- 10.20.193.28:0/245823259 <== mon.2 v2:10.20.193.34:3300/0 7 ==== osd_map(53..59 src has 1..59) ==== 4599+0+0 (secure 0 0 0) 0x7f2d780adba0 con 0x7f2d8c10f1d0 2026-02-20T13:15:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:54 trial127 ceph-mon[43817]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T13:15:54.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:54 trial127 ceph-mon[43817]: from='osd.9 [v2:10.20.193.28:6826/3942858672,v1:10.20.193.28:6827/3942858672]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:54 trial034 ceph-mon[43332]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T13:15:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:54 trial034 ceph-mon[43332]: from='osd.9 [v2:10.20.193.28:6826/3942858672,v1:10.20.193.28:6827/3942858672]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:55.587 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:55 trial028 ceph-mon[37442]: from='osd.9 [v2:10.20.193.28:6826/3942858672,v1:10.20.193.28:6827/3942858672]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T13:15:55.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:55 trial028 ceph-mon[37442]: osdmap e59: 10 total, 9 up, 10 in 2026-02-20T13:15:55.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:55 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:55.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:55 trial127 ceph-mon[43817]: from='osd.9 [v2:10.20.193.28:6826/3942858672,v1:10.20.193.28:6827/3942858672]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T13:15:55.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:55 trial127 ceph-mon[43817]: osdmap e59: 10 total, 9 up, 10 in 2026-02-20T13:15:55.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:55 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:55.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:55 trial034 ceph-mon[43332]: from='osd.9 [v2:10.20.193.28:6826/3942858672,v1:10.20.193.28:6827/3942858672]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T13:15:55.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:55 trial034 ceph-mon[43332]: osdmap e59: 10 total, 9 up, 10 in 2026-02-20T13:15:55.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:55 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.603+0000 7f2d88ff9640 1 -- 10.20.193.28:0/245823259 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f2d8c10f5c0 con 0x7f2d600b5760 2026-02-20T13:15:56.607 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 9 on host 'trial028' 2026-02-20T13:15:56.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 -- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2d600b5760 msgr2=0x7f2d600d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:56.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2d600b5760 0x7f2d600d5c10 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d7c002d80 tx=0x7f2d7c03a040 comp rx=0 tx=0).stop 2026-02-20T13:15:56.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 -- 10.20.193.28:0/245823259 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2d8c10f1d0 msgr2=0x7f2d8c0f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:56.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2d8c10f1d0 0x7f2d8c0f9270 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d78009480 tx=0x7f2d7800ee60 comp rx=0 tx=0).stop 2026-02-20T13:15:56.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 -- 10.20.193.28:0/245823259 shutdown_connections 2026-02-20T13:15:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2d600b5760 0x7f2d600d5c10 unknown :-1 s=CLOSED pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d8c110360 0x7f2d8c1716a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d8c110d10 0x7f2d8c0f9ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 --2- 10.20.193.28:0/245823259 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2d8c10f1d0 0x7f2d8c0f9270 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.606+0000 7f2d667fc640 1 -- 10.20.193.28:0/245823259 >> 10.20.193.28:0/245823259 conn(0x7f2d8c0ec940 msgr2=0x7f2d8c0ef890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.607+0000 7f2d667fc640 1 -- 10.20.193.28:0/245823259 shutdown_connections 2026-02-20T13:15:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:15:56.607+0000 7f2d667fc640 1 -- 10.20.193.28:0/245823259 wait complete. 2026-02-20T13:15:56.712 DEBUG:teuthology.orchestra.run.trial028:osd.9> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.9.service 2026-02-20T13:15:56.716 INFO:tasks.cephadm:Deploying osd.10 on trial034 with /dev/vg_nvme/lv_1... 2026-02-20T13:15:56.716 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-20T13:15:56.837 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.b/config 2026-02-20T13:15:56.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:56 trial028 ceph-mon[37442]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 92 KiB/s, 0 objects/s recovering 2026-02-20T13:15:56.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:56 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:56.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:56 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:56.860 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:56 trial034 ceph-mon[43332]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 92 KiB/s, 0 objects/s recovering 2026-02-20T13:15:56.860 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:56 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:56.861 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:56 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:56 trial127 ceph-mon[43817]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 92 KiB/s, 0 objects/s recovering 2026-02-20T13:15:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:56 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:56 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:15:56 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:15:56.894+0000 7faaf42e0780 -1 osd.9 0 log_to_monitors true 2026-02-20T13:15:57.326 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T13:15:57.343 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial034:vg_nvme/lv_1 --skip-validation 2026-02-20T13:15:57.462 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.b/config 2026-02-20T13:15:57.571 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 -- 10.20.193.34:0/370026873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff08010fa50 msgr2=0x7ff0801717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 --2- 10.20.193.34:0/370026873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff08010fa50 0x7ff0801717e0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=461926443370910592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff07c00a970 tx=0x7ff07c0301b0 comp rx=0 tx=0).stop 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 -- 10.20.193.34:0/370026873 shutdown_connections 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 --2- 10.20.193.34:0/370026873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff08010fa50 0x7ff0801717e0 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=461926443370910592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 --2- 10.20.193.34:0/370026873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff08010f0a0 0x7ff08010f510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 --2- 10.20.193.34:0/370026873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff080110810 0x7ff080110c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 -- 10.20.193.34:0/370026873 >> 10.20.193.34:0/370026873 conn(0x7ff0800eca40 msgr2=0x7ff08010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 -- 10.20.193.34:0/370026873 shutdown_connections 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.566+0000 7ff0883d5640 1 -- 10.20.193.34:0/370026873 wait complete. 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff0883d5640 1 Processor -- start 2026-02-20T13:15:57.572 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff0883d5640 1 -- start start 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff0883d5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff08010f0a0 0x7ff0800f9300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff0883d5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff08010fa50 0x7ff0801717e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff0883d5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff080110810 0x7ff0800f9b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff0883d5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff0800fa750 con 0x7ff08010fa50 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff0883d5640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff0800fa8c0 con 0x7ff080110810 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff0883d5640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff0800faa80 con 0x7ff08010f0a0 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff080110810 0x7ff0800f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff080110810 0x7ff0800f9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.34:44538/0 (socket says 10.20.193.34:44538) 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 -- 10.20.193.34:0/558143475 learned_addr learned my addr 10.20.193.34:0/558143475 (peer_addr_for_me v2:10.20.193.34:0/0) 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08614a640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff08010f0a0 0x7ff0800f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:57.573 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff085949640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff08010fa50 0x7ff0801717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 -- 10.20.193.34:0/558143475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff08010f0a0 msgr2=0x7ff0800f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff08010f0a0 0x7ff0800f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 -- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff08010fa50 msgr2=0x7ff0801717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff08010fa50 0x7ff0801717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 -- 10.20.193.34:0/558143475 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07c00a590 con 0x7ff080110810 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.567+0000 7ff08694b640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff080110810 0x7ff0800f9b60 secure :-1 s=READY pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff07c006ad0 tx=0x7ff07c0039b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.568+0000 7ff0677fe640 1 -- 10.20.193.34:0/558143475 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff07c03e070 con 0x7ff080110810 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.568+0000 7ff0677fe640 1 -- 10.20.193.34:0/558143475 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff07c039d50 con 0x7ff080110810 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.568+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0800fad00 con 0x7ff080110810 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.568+0000 7ff0677fe640 1 -- 10.20.193.34:0/558143475 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff07c042c50 con 0x7ff080110810 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.568+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0800fb120 con 0x7ff080110810 2026-02-20T13:15:57.574 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.568+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff080175910 con 0x7ff080110810 2026-02-20T13:15:57.575 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.569+0000 7ff0677fe640 1 -- 10.20.193.34:0/558143475 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7ff07c005050 con 0x7ff080110810 2026-02-20T13:15:57.576 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.570+0000 7ff0677fe640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff05c0b56e0 0x7ff05c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:15:57.576 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.570+0000 7ff0677fe640 1 -- 10.20.193.34:0/558143475 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5957+0+0 (secure 0 0 0) 0x7ff07c10c6f0 con 0x7ff080110810 2026-02-20T13:15:57.576 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.570+0000 7ff08614a640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff05c0b56e0 0x7ff05c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:15:57.576 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.571+0000 7ff08614a640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff05c0b56e0 0x7ff05c0d5b90 secure :-1 s=READY pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff070004740 tx=0x7ff07000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:15:57.576 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.571+0000 7ff0677fe640 1 -- 10.20.193.34:0/558143475 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7ff07c0cfa70 con 0x7ff080110810 2026-02-20T13:15:57.682 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:15:57.680+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7ff08005f560 con 0x7ff05c0b56e0 2026-02-20T13:15:57.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:57 trial034 ceph-mon[43332]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:57.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:57 trial034 ceph-mon[43332]: from='osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:57.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:57 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:57.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:57 trial127 ceph-mon[43817]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:57.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:57 trial127 ceph-mon[43817]: from='osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:57.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:57.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:57 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:58.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:57 trial028 ceph-mon[37442]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:58.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:57 trial028 ceph-mon[37442]: from='osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-20T13:15:58.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:57 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:15:58.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: osdmap e60: 10 total, 9 up, 10 in 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='client.? 10.20.193.34:0/4034619940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"}]': finished 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: osdmap e61: 11 total, 9 up, 11 in 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:15:58.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:58 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:58.850 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:15:58 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:15:58.376+0000 7faaf0262640 -1 osd.9 0 waiting for initial osdmap 2026-02-20T13:15:58.850 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:15:58 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:15:58.385+0000 7faae8121640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:15:58.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-20T13:15:58.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T13:15:58.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: osdmap e60: 10 total, 9 up, 10 in 2026-02-20T13:15:58.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:58.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:58.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:58.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"} : dispatch 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='client.? 10.20.193.34:0/4034619940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"} : dispatch 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"}]': finished 2026-02-20T13:15:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: osdmap e61: 11 total, 9 up, 11 in 2026-02-20T13:15:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:15:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:58 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:58.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-20T13:15:58.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T13:15:58.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: osdmap e60: 10 total, 9 up, 10 in 2026-02-20T13:15:58.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:58.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:58.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"} : dispatch 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='client.? 10.20.193.34:0/4034619940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"} : dispatch 2026-02-20T13:15:58.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T13:15:58.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cc473cd-99f0-483e-b827-c925c4627fb1"}]': finished 2026-02-20T13:15:58.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: osdmap e61: 11 total, 9 up, 11 in 2026-02-20T13:15:58.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:58.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:15:58.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:58 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:15:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_1'] 2026-02-20T13:15:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: from='client.? 10.20.193.34:0/110773272' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] boot 2026-02-20T13:15:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: osdmap e62: 11 total, 10 up, 11 in 2026-02-20T13:15:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:15:59 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:15:59.912 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:59.912 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:15:59.912 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_1'] 2026-02-20T13:15:59.912 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:59.912 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:59.912 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: from='client.? 10.20.193.34:0/110773272' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:59.912 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:59.912 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:59.913 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] boot 2026-02-20T13:15:59.913 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: osdmap e62: 11 total, 10 up, 11 in 2026-02-20T13:15:59.913 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:59.913 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:15:59 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:15:59.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_1'] 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial034 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: from='client.? 10.20.193.34:0/110773272' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: osd.9 [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] boot 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: osdmap e62: 11 total, 10 up, 11 in 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-20T13:15:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:15:59 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:00.781 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:16:00.781 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:16:00.781 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:16:00.781 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: Detected new or changed devices on trial028 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.782 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:00.783 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:00.783 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:00.783 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-20T13:16:00.783 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:00.783 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:00 trial034 ceph-mon[43332]: Deploying daemon osd.10 on trial034 2026-02-20T13:16:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: Detected new or changed devices on trial028 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-20T13:16:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:00 trial127 ceph-mon[43817]: Deploying daemon osd.10 on trial034 2026-02-20T13:16:01.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:16:01.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: Detected new or changed devices on trial028 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:01.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:00 trial028 ceph-mon[37442]: Deploying daemon osd.10 on trial034 2026-02-20T13:16:01.905 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:01 trial034 ceph-mon[43332]: osdmap e63: 11 total, 10 up, 11 in 2026-02-20T13:16:01.905 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:01 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:01.905 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:01 trial034 ceph-mon[43332]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:02.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:01 trial028 ceph-mon[37442]: osdmap e63: 11 total, 10 up, 11 in 2026-02-20T13:16:02.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:01 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:02.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:01 trial028 ceph-mon[37442]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:02.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:01 trial127 ceph-mon[43817]: osdmap e63: 11 total, 10 up, 11 in 2026-02-20T13:16:02.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:01 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:02.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:01 trial127 ceph-mon[43817]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:02.949 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.946+0000 7ff0677fe640 1 -- 10.20.193.34:0/558143475 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff08005f560 con 0x7ff05c0b56e0 2026-02-20T13:16:02.949 INFO:teuthology.orchestra.run.trial034.stdout:Created osd(s) 10 on host 'trial034' 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff05c0b56e0 msgr2=0x7ff05c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff05c0b56e0 0x7ff05c0d5b90 secure :-1 s=READY pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff070004740 tx=0x7ff07000b410 comp rx=0 tx=0).stop 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff080110810 msgr2=0x7ff0800f9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff080110810 0x7ff0800f9b60 secure :-1 s=READY pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff07c006ad0 tx=0x7ff07c0039b0 comp rx=0 tx=0).stop 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 shutdown_connections 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff05c0b56e0 0x7ff05c0d5b90 unknown :-1 s=CLOSED pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff08010fa50 0x7ff0801717e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff080110810 0x7ff0800f9b60 unknown :-1 s=CLOSED pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:02.952 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 --2- 10.20.193.34:0/558143475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff08010f0a0 0x7ff0800f9300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:02.953 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 >> 10.20.193.34:0/558143475 conn(0x7ff0800eca40 msgr2=0x7ff0800ef910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:02.953 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 shutdown_connections 2026-02-20T13:16:02.953 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T13:16:02.949+0000 7ff0883d5640 1 -- 10.20.193.34:0/558143475 wait complete. 2026-02-20T13:16:02.994 DEBUG:teuthology.orchestra.run.trial034:osd.10> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.10.service 2026-02-20T13:16:02.996 INFO:tasks.cephadm:Deploying osd.11 on trial127 with /dev/vg_nvme/lv_1... 2026-02-20T13:16:02.996 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-20T13:16:03.118 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:16:03.178 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:16:03 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:16:03.107+0000 7f92c9c34780 -1 osd.10 0 log_to_monitors true 2026-02-20T13:16:03.274 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:03 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.274 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:03 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.274 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:03 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.274 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:03 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.275 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:03 trial127 ceph-mon[43817]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-20T13:16:03.275 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:03 trial127 ceph-mon[43817]: from='osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-20T13:16:03.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:03 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:03 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:03 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:03 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:03 trial034 ceph-mon[43332]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-20T13:16:03.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:03 trial034 ceph-mon[43332]: from='osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-20T13:16:03.582 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-20T13:16:03.600 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch daemon add osd trial127:vg_nvme/lv_1 --skip-validation 2026-02-20T13:16:03.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:03 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:03 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:03 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:03 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:03.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:03 trial028 ceph-mon[37442]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-20T13:16:03.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:03 trial028 ceph-mon[37442]: from='osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-20T13:16:03.718 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:16:03.828 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- 10.20.193.127:0/1532218663 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f479010f0a0 msgr2=0x7f479010f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:03.828 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 --2- 10.20.193.127:0/1532218663 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f479010f0a0 0x7f479010f510 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=6261057351731685505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4778009980 tx=0x7f477802f180 comp rx=0 tx=0).stop 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- 10.20.193.127:0/1532218663 shutdown_connections 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 --2- 10.20.193.127:0/1532218663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f479010fa50 0x7f47901717e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 --2- 10.20.193.127:0/1532218663 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f479010f0a0 0x7f479010f510 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=6261057351731685505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 --2- 10.20.193.127:0/1532218663 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4790110810 0x7f4790110c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- 10.20.193.127:0/1532218663 >> 10.20.193.127:0/1532218663 conn(0x7f47900eca40 msgr2=0x7f479010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- 10.20.193.127:0/1532218663 shutdown_connections 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- 10.20.193.127:0/1532218663 wait complete. 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 Processor -- start 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- start start 2026-02-20T13:16:03.829 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f479010f0a0 0x7f47900f9380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f479010fa50 0x7f47901717e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4790110810 0x7f47900f9be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47900fa7d0 con 0x7f479010fa50 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f47900fa940 con 0x7f479010f0a0 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4797051640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f47900fab00 con 0x7f4790110810 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f47955c7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4790110810 0x7f47900f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f47955c7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4790110810 0x7f47900f9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:57326/0 (socket says 10.20.193.127:57326) 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f47955c7640 1 -- 10.20.193.127:0/4237639836 learned_addr learned my addr 10.20.193.127:0/4237639836 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.824+0000 7f4794dc6640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f479010f0a0 0x7f47900f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f4787fff640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f479010fa50 0x7f47901717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f47955c7640 1 -- 10.20.193.127:0/4237639836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f479010f0a0 msgr2=0x7f47900f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:03.830 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f47955c7640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f479010f0a0 0x7f47900f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f47955c7640 1 -- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f479010fa50 msgr2=0x7f47901717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f47955c7640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f479010fa50 0x7f47901717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f47955c7640 1 -- 10.20.193.127:0/4237639836 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4778009570 con 0x7f4790110810 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f47955c7640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4790110810 0x7f47900f9be0 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478c00c750 tx=0x7f478c00cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f4785ffb640 1 -- 10.20.193.127:0/4237639836 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f478c005500 con 0x7f4790110810 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f4785ffb640 1 -- 10.20.193.127:0/4237639836 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f478c003c60 con 0x7f4790110810 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47900fade0 con 0x7f4790110810 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f4785ffb640 1 -- 10.20.193.127:0/4237639836 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f478c00ddb0 con 0x7f4790110810 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47900fb330 con 0x7f4790110810 2026-02-20T13:16:03.831 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.825+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4790175970 con 0x7f4790110810 2026-02-20T13:16:03.832 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.827+0000 7f4785ffb640 1 -- 10.20.193.127:0/4237639836 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f478c003780 con 0x7f4790110810 2026-02-20T13:16:03.832 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.827+0000 7f4785ffb640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f476c0b56e0 0x7f476c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:03.833 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.827+0000 7f4785ffb640 1 -- 10.20.193.127:0/4237639836 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6368+0+0 (secure 0 0 0) 0x7f478c0e67f0 con 0x7f4790110810 2026-02-20T13:16:03.833 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.828+0000 7f4794dc6640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f476c0b56e0 0x7f476c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:03.833 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.828+0000 7f4794dc6640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f476c0b56e0 0x7f476c0d5b90 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4780004740 tx=0x7f478000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:03.833 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.828+0000 7f4785ffb640 1 -- 10.20.193.127:0/4237639836 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f478c0a99a0 con 0x7f4790110810 2026-02-20T13:16:03.941 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:03.938+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f4790175010 con 0x7f476c0b56e0 2026-02-20T13:16:04.616 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:04.616 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.616 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.616 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:04.616 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.616 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.616 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: osdmap e64: 11 total, 10 up, 11 in 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.617 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:04 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:04.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:04.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: osdmap e64: 11 total, 10 up, 11 in 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.653 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:04 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.710 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: osdmap e64: 11 total, 10 up, 11 in 2026-02-20T13:16:04.711 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:04.712 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:04.712 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:04.712 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:16:04.712 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-20T13:16:04.712 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.712 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:04 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:04.969 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:16:04 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:16:04.612+0000 7f92c5bb6640 -1 osd.10 0 waiting for initial osdmap 2026-02-20T13:16:04.970 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:16:04 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:16:04.620+0000 7f92bda75640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:16:05.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:05.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: osd.default does not exist. Creating it now. 2026-02-20T13:16:05.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_1'] 2026-02-20T13:16:05.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:16:05.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: Saving service osd.default spec with placement trial127 2026-02-20T13:16:05.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"} : dispatch 2026-02-20T13:16:05.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/4206174165' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"} : dispatch 2026-02-20T13:16:05.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:16:05.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"}]': finished 2026-02-20T13:16:05.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: osdmap e65: 12 total, 10 up, 12 in 2026-02-20T13:16:05.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:05.637 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:05.637 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:05.637 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='client.? 10.20.193.127:0/335965703' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:16:05.637 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.637 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.637 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.638 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.638 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.638 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.638 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.638 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.638 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:05 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:05.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: osd.default does not exist. Creating it now. 2026-02-20T13:16:05.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_1'] 2026-02-20T13:16:05.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:16:05.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: Saving service osd.default spec with placement trial127 2026-02-20T13:16:05.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"} : dispatch 2026-02-20T13:16:05.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/4206174165' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"} : dispatch 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"}]': finished 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: osdmap e65: 12 total, 10 up, 12 in 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='client.? 10.20.193.127:0/335965703' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.730 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:05 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: osd.default does not exist. Creating it now. 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: Creating OSDs with service ID: default on trial127:['vg_nvme/lv_1'] 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: Marking host: trial127 for OSDSpec preview refresh. 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: Saving service osd.default spec with placement trial127 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"} : dispatch 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/4206174165' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"} : dispatch 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea"}]': finished 2026-02-20T13:16:05.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: osdmap e65: 12 total, 10 up, 12 in 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='client.? 10.20.193.127:0/335965703' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:05.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:05 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.431 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: Detected new or changed devices on trial034 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial034 to 21011M 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] boot 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: osdmap e66: 12 total, 11 up, 12 in 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:06.432 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:06 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:06.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:16:06.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:16:06.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: Detected new or changed devices on trial034 2026-02-20T13:16:06.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial034 to 21011M 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] boot 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: osdmap e66: 12 total, 11 up, 12 in 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:06.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:06 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: Detected new or changed devices on trial034 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial034 to 21011M 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: osd.10 [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] boot 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: osdmap e66: 12 total, 11 up, 12 in 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:06.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:06.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:06.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:06.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:06.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:06 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:07.885 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: osdmap e67: 12 total, 11 up, 12 in 2026-02-20T13:16:07.886 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:07.886 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-20T13:16:07.886 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:07.886 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: Deploying daemon osd.11 on trial127 2026-02-20T13:16:07.886 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-20T13:16:07.886 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:07.886 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: Deploying daemon osd.11 on trial127 2026-02-20T13:16:07.886 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:07 trial127 ceph-mon[43817]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: osdmap e67: 12 total, 11 up, 12 in 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: Deploying daemon osd.11 on trial127 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: Deploying daemon osd.11 on trial127 2026-02-20T13:16:07.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:07 trial034 ceph-mon[43332]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T13:16:08.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: osdmap e67: 12 total, 11 up, 12 in 2026-02-20T13:16:08.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:08.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-20T13:16:08.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: Deploying daemon osd.11 on trial127 2026-02-20T13:16:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-20T13:16:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: Deploying daemon osd.11 on trial127 2026-02-20T13:16:08.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:07 trial028 ceph-mon[37442]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T13:16:08.716 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:08 trial127 ceph-mon[43817]: osdmap e68: 12 total, 11 up, 12 in 2026-02-20T13:16:08.716 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:08 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:08.716 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:08 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:08.717 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:08 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:08 trial034 ceph-mon[43332]: osdmap e68: 12 total, 11 up, 12 in 2026-02-20T13:16:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:08 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:08 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:08.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:08 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:08 trial028 ceph-mon[37442]: osdmap e68: 12 total, 11 up, 12 in 2026-02-20T13:16:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:08 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:08 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:08 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:09.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:09 trial127 ceph-mon[43817]: osdmap e69: 12 total, 11 up, 12 in 2026-02-20T13:16:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:09 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:09 trial127 ceph-mon[43817]: pgmap v135: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-20T13:16:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:09 trial034 ceph-mon[43332]: osdmap e69: 12 total, 11 up, 12 in 2026-02-20T13:16:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:09 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:09.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:09 trial034 ceph-mon[43332]: pgmap v135: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-20T13:16:10.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:09 trial028 ceph-mon[37442]: osdmap e69: 12 total, 11 up, 12 in 2026-02-20T13:16:10.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:09 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:10.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:09 trial028 ceph-mon[37442]: pgmap v135: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-20T13:16:10.798 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:10 trial127 ceph-mon[43817]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-20T13:16:10.799 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:10 trial127 ceph-mon[43817]: osdmap e70: 12 total, 11 up, 12 in 2026-02-20T13:16:10.799 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:10.799 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:10.799 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:10 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:10.823 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.822+0000 7f4785ffb640 1 -- 10.20.193.127:0/4237639836 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4790175010 con 0x7f476c0b56e0 2026-02-20T13:16:10.824 INFO:teuthology.orchestra.run.trial127.stdout:Created osd(s) 11 on host 'trial127' 2026-02-20T13:16:10.826 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.824+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f476c0b56e0 msgr2=0x7f476c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:10.826 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.824+0000 7f4797051640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f476c0b56e0 0x7f476c0d5b90 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4780004740 tx=0x7f478000b410 comp rx=0 tx=0).stop 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4790110810 msgr2=0x7f47900f9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4790110810 0x7f47900f9be0 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478c00c750 tx=0x7f478c00cc20 comp rx=0 tx=0).stop 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 shutdown_connections 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f476c0b56e0 0x7f476c0d5b90 unknown :-1 s=CLOSED pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f479010fa50 0x7f47901717e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4790110810 0x7f47900f9be0 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 --2- 10.20.193.127:0/4237639836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f479010f0a0 0x7f47900f9380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 >> 10.20.193.127:0/4237639836 conn(0x7f47900eca40 msgr2=0x7f47900ef950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 shutdown_connections 2026-02-20T13:16:10.827 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:10.825+0000 7f4797051640 1 -- 10.20.193.127:0/4237639836 wait complete. 2026-02-20T13:16:10.869 DEBUG:teuthology.orchestra.run.trial127:osd.11> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.11.service 2026-02-20T13:16:10.872 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-20T13:16:10.872 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T13:16:10.924 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:10 trial028 ceph-mon[37442]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-20T13:16:10.925 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:10 trial028 ceph-mon[37442]: osdmap e70: 12 total, 11 up, 12 in 2026-02-20T13:16:10.925 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:10.925 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:10.925 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:10 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:10 trial034 ceph-mon[43332]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-20T13:16:10.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:10 trial034 ceph-mon[43332]: osdmap e70: 12 total, 11 up, 12 in 2026-02-20T13:16:10.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:10.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:10.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:10 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:11.060 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.234+0000 7f265c60a640 1 -- 10.20.193.28:0/594363083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 msgr2=0x7f26541717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.234+0000 7f265c60a640 1 --2- 10.20.193.28:0/594363083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 0x7f26541717e0 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=15679429488564917032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f265000a9a0 tx=0x7f26500301b0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.234+0000 7f265c60a640 1 -- 10.20.193.28:0/594363083 shutdown_connections 2026-02-20T13:16:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.234+0000 7f265c60a640 1 --2- 10.20.193.28:0/594363083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 0x7f26541717e0 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=15679429488564917032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.234+0000 7f265c60a640 1 --2- 10.20.193.28:0/594363083 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f265410f0a0 0x7f265410f510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.234+0000 7f265c60a640 1 --2- 10.20.193.28:0/594363083 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2654110810 0x7f2654110c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.234+0000 7f265c60a640 1 -- 10.20.193.28:0/594363083 >> 10.20.193.28:0/594363083 conn(0x7f26540eca40 msgr2=0x7f265410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.235+0000 7f265c60a640 1 -- 10.20.193.28:0/594363083 shutdown_connections 2026-02-20T13:16:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.235+0000 7f265c60a640 1 -- 10.20.193.28:0/594363083 wait complete. 2026-02-20T13:16:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.235+0000 7f265c60a640 1 Processor -- start 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.235+0000 7f265c60a640 1 -- start start 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265c60a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f265410f0a0 0x7f2654101f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265c60a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 0x7f26541717e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265c60a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2654110810 0x7f26541027d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265c60a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f26541031a0 con 0x7f265410fa50 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265c60a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2654103310 con 0x7f265410f0a0 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265c60a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f26541034d0 con 0x7f2654110810 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f2659b7e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 0x7f26541717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265a37f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f265410f0a0 0x7f2654101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265ab80640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2654110810 0x7f26541027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265a37f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f265410f0a0 0x7f2654101f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38690/0 (socket says 10.20.193.28:38690) 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f265a37f640 1 -- 10.20.193.28:0/3616696108 learned_addr learned my addr 10.20.193.28:0/3616696108 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f2659b7e640 1 -- 10.20.193.28:0/3616696108 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2654110810 msgr2=0x7f26541027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f2659b7e640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2654110810 0x7f26541027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f2659b7e640 1 -- 10.20.193.28:0/3616696108 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f265410f0a0 msgr2=0x7f2654101f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f2659b7e640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f265410f0a0 0x7f2654101f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f2659b7e640 1 -- 10.20.193.28:0/3616696108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265000a590 con 0x7f265410fa50 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.236+0000 7f2659b7e640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 0x7f26541717e0 secure :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f264800e7b0 tx=0x7f264800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.237+0000 7f263b7fe640 1 -- 10.20.193.28:0/3616696108 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f264800cc60 con 0x7f265410fa50 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.237+0000 7f263b7fe640 1 -- 10.20.193.28:0/3616696108 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2648004500 con 0x7f265410fa50 2026-02-20T13:16:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.237+0000 7f263b7fe640 1 -- 10.20.193.28:0/3616696108 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26480052a0 con 0x7f265410fa50 2026-02-20T13:16:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.237+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26541037b0 con 0x7f265410fa50 2026-02-20T13:16:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.237+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2654103c50 con 0x7f265410fa50 2026-02-20T13:16:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.237+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2654175960 con 0x7f265410fa50 2026-02-20T13:16:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.240+0000 7f263b7fe640 1 -- 10.20.193.28:0/3616696108 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f2648004770 con 0x7f265410fa50 2026-02-20T13:16:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.242+0000 7f263b7fe640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26300b5760 0x7f26300d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.242+0000 7f263b7fe640 1 -- 10.20.193.28:0/3616696108 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6801+0+0 (secure 0 0 0) 0x7f2648014070 con 0x7f265410fa50 2026-02-20T13:16:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.242+0000 7f263b7fe640 1 -- 10.20.193.28:0/3616696108 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f264811f730 con 0x7f265410fa50 2026-02-20T13:16:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.242+0000 7f265a37f640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26300b5760 0x7f26300d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.242+0000 7f265a37f640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26300b5760 0x7f26300d5c10 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26440097c0 tx=0x7f2644009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.358+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2654175020 con 0x7f265410fa50 2026-02-20T13:16:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.358+0000 7f263b7fe640 1 -- 10.20.193.28:0/3616696108 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f26480a99f0 con 0x7f265410fa50 2026-02-20T13:16:11.361 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:11.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26300b5760 msgr2=0x7f26300d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:11.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26300b5760 0x7f26300d5c10 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26440097c0 tx=0x7f2644009310 comp rx=0 tx=0).stop 2026-02-20T13:16:11.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 msgr2=0x7f26541717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:11.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 0x7f26541717e0 secure :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f264800e7b0 tx=0x7f264800ec80 comp rx=0 tx=0).stop 2026-02-20T13:16:11.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 shutdown_connections 2026-02-20T13:16:11.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26300b5760 0x7f26300d5c10 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f265410fa50 0x7f26541717e0 unknown :-1 s=CLOSED pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2654110810 0x7f26541027d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 --2- 10.20.193.28:0/3616696108 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f265410f0a0 0x7f2654101f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:11.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.360+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 >> 10.20.193.28:0/3616696108 conn(0x7f26540eca40 msgr2=0x7f26540ef910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:11.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.361+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 shutdown_connections 2026-02-20T13:16:11.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:11.361+0000 7f265c60a640 1 -- 10.20.193.28:0/3616696108 wait complete. 2026-02-20T13:16:11.460 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1771593365,"num_in_osds":12,"osd_in_since":1771593364,"num_remapped_pgs":0} 2026-02-20T13:16:11.478 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:16:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:16:11.263+0000 7f9cbe2e1780 -1 osd.11 0 log_to_monitors true 2026-02-20T13:16:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-20T13:16:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: from='osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-20T13:16:11.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:11.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:11.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: pgmap v137: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-20T13:16:11.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3616696108' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:11.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:11 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:12.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-20T13:16:12.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: from='osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-20T13:16:12.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: pgmap v137: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-20T13:16:12.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3616696108' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:12.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:11 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:12.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-20T13:16:12.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: from='osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-20T13:16:12.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: pgmap v137: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-20T13:16:12.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3616696108' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:12.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:11 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:12.461 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T13:16:12.653 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:12.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.834+0000 7f4392cc2640 1 -- 10.20.193.28:0/263058155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 msgr2=0x7f438c061050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:12.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.834+0000 7f4392cc2640 1 --2- 10.20.193.28:0/263058155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 0x7f438c061050 secure :-1 s=READY pgs=174 gs=2 cs=0 l=1 c_cookie=17785882502070270232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f437c009950 tx=0x7f437c02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.834+0000 7f4392cc2640 1 -- 10.20.193.28:0/263058155 shutdown_connections 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.834+0000 7f4392cc2640 1 --2- 10.20.193.28:0/263058155 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438c10c9a0 0x7f438c10ce40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.834+0000 7f4392cc2640 1 --2- 10.20.193.28:0/263058155 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438c061590 0x7f438c061a00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.834+0000 7f4392cc2640 1 --2- 10.20.193.28:0/263058155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 0x7f438c061050 unknown :-1 s=CLOSED pgs=174 gs=2 cs=0 l=1 c_cookie=17785882502070270232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.834+0000 7f4392cc2640 1 -- 10.20.193.28:0/263058155 >> 10.20.193.28:0/263058155 conn(0x7f438c0ea5a0 msgr2=0x7f438c10a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.835+0000 7f4392cc2640 1 -- 10.20.193.28:0/263058155 shutdown_connections 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.835+0000 7f4392cc2640 1 -- 10.20.193.28:0/263058155 wait complete. 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.835+0000 7f4392cc2640 1 Processor -- start 2026-02-20T13:16:12.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.835+0000 7f4392cc2640 1 -- start start 2026-02-20T13:16:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f4392cc2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438c061590 0x7f438c0f6070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f4392cc2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 0x7f438c0f66c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f4392cc2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438c10c9a0 0x7f438c0f72c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f4392cc2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f438c0f7960 con 0x7f438c0629c0 2026-02-20T13:16:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f4392cc2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f438c0f7ad0 con 0x7f438c10c9a0 2026-02-20T13:16:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f4392cc2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f438c0f7c90 con 0x7f438c061590 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 0x7f438c0f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 0x7f438c0f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47058/0 (socket says 10.20.193.28:47058) 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 -- 10.20.193.28:0/2274938718 learned_addr learned my addr 10.20.193.28:0/2274938718 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43924c1640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438c10c9a0 0x7f438c0f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f4391cc0640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438c061590 0x7f438c0f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 -- 10.20.193.28:0/2274938718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438c061590 msgr2=0x7f438c0f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438c061590 0x7f438c0f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 -- 10.20.193.28:0/2274938718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438c10c9a0 msgr2=0x7f438c0f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438c10c9a0 0x7f438c0f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 -- 10.20.193.28:0/2274938718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c009570 con 0x7f438c0629c0 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43924c1640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438c10c9a0 0x7f438c0f72c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f43914bf640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 0x7f438c0f66c0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43800072a0 tx=0x7f438000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f437affd640 1 -- 10.20.193.28:0/2274938718 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4380004500 con 0x7f438c0629c0 2026-02-20T13:16:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f437affd640 1 -- 10.20.193.28:0/2274938718 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f438000bd20 con 0x7f438c0629c0 2026-02-20T13:16:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.836+0000 7f437affd640 1 -- 10.20.193.28:0/2274938718 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4380002ea0 con 0x7f438c0629c0 2026-02-20T13:16:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.837+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438c0f7f70 con 0x7f438c0629c0 2026-02-20T13:16:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.837+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f438c0f84d0 con 0x7f438c0629c0 2026-02-20T13:16:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.837+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438c179b30 con 0x7f438c0629c0 2026-02-20T13:16:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.839+0000 7f437affd640 1 -- 10.20.193.28:0/2274938718 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f438000b840 con 0x7f438c0629c0 2026-02-20T13:16:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.841+0000 7f437affd640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43680b5760 0x7f43680d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.841+0000 7f437affd640 1 -- 10.20.193.28:0/2274938718 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6839+0+0 (secure 0 0 0) 0x7f43800e65a0 con 0x7f438c0629c0 2026-02-20T13:16:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.841+0000 7f437affd640 1 -- 10.20.193.28:0/2274938718 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f43800e6a20 con 0x7f438c0629c0 2026-02-20T13:16:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.841+0000 7f4391cc0640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43680b5760 0x7f43680d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:12.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.841+0000 7f4391cc0640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43680b5760 0x7f43680d5c10 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f437c002d80 tx=0x7f437c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:12.868 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:16:12 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:16:12.830+0000 7f9cba263640 -1 osd.11 0 waiting for initial osdmap 2026-02-20T13:16:12.868 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:16:12 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:16:12.837+0000 7f9cb2122640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: osdmap e71: 12 total, 11 up, 12 in 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.869 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:12.870 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:12 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:12.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.962+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f438c05f3f0 con 0x7f438c0629c0 2026-02-20T13:16:12.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.962+0000 7f437affd640 1 -- 10.20.193.28:0/2274938718 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f43800a94c0 con 0x7f438c0629c0 2026-02-20T13:16:12.966 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.963+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43680b5760 msgr2=0x7f43680d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.963+0000 7f4392cc2640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43680b5760 0x7f43680d5c10 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f437c002d80 tx=0x7f437c03a040 comp rx=0 tx=0).stop 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.963+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 msgr2=0x7f438c0f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.963+0000 7f4392cc2640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 0x7f438c0f66c0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43800072a0 tx=0x7f438000ddf0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.964+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 shutdown_connections 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.964+0000 7f4392cc2640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43680b5760 0x7f43680d5c10 unknown :-1 s=CLOSED pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.964+0000 7f4392cc2640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438c0629c0 0x7f438c0f66c0 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.964+0000 7f4392cc2640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438c10c9a0 0x7f438c0f72c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.964+0000 7f4392cc2640 1 --2- 10.20.193.28:0/2274938718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438c061590 0x7f438c0f6070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.964+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 >> 10.20.193.28:0/2274938718 conn(0x7f438c0ea5a0 msgr2=0x7f438c0ec250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:12.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.964+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 shutdown_connections 2026-02-20T13:16:12.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:12.964+0000 7f4392cc2640 1 -- 10.20.193.28:0/2274938718 wait complete. 2026-02-20T13:16:13.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-20T13:16:13.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: osdmap e71: 12 total, 11 up, 12 in 2026-02-20T13:16:13.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:13.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:13.032 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:13.032 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.032 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:13.032 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:13.032 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.032 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:13.032 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:13.032 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:12 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:13.109 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1771593365,"num_in_osds":12,"osd_in_since":1771593364,"num_remapped_pgs":0} 2026-02-20T13:16:13.141 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-20T13:16:13.141 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: osdmap e71: 12 total, 11 up, 12 in 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-20T13:16:13.142 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:12 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:14.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:13 trial028 ceph-mon[37442]: Detected new or changed devices on trial127 2026-02-20T13:16:14.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:13 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial127 to 21011M 2026-02-20T13:16:14.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:13 trial028 ceph-mon[37442]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:16:14.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:13 trial028 ceph-mon[37442]: osdmap e72: 12 total, 11 up, 12 in 2026-02-20T13:16:14.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:13 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:14.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:13 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:14.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:13 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2274938718' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:14.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:13 trial028 ceph-mon[37442]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-20T13:16:14.109 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T13:16:14.170 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:13 trial127 ceph-mon[43817]: Detected new or changed devices on trial127 2026-02-20T13:16:14.171 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:13 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial127 to 21011M 2026-02-20T13:16:14.171 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:13 trial127 ceph-mon[43817]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:16:14.171 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:13 trial127 ceph-mon[43817]: osdmap e72: 12 total, 11 up, 12 in 2026-02-20T13:16:14.171 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:13 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:14.171 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:13 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:14.171 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:13 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2274938718' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:14.171 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:13 trial127 ceph-mon[43817]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-20T13:16:14.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:13 trial034 ceph-mon[43332]: Detected new or changed devices on trial127 2026-02-20T13:16:14.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:13 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial127 to 21011M 2026-02-20T13:16:14.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:13 trial034 ceph-mon[43332]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-20T13:16:14.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:13 trial034 ceph-mon[43332]: osdmap e72: 12 total, 11 up, 12 in 2026-02-20T13:16:14.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:13 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:14.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:13 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:14.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:13 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2274938718' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:14.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:13 trial034 ceph-mon[43332]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-20T13:16:14.298 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:14.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 -- 10.20.193.28:0/3569417699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810c720 msgr2=0x7f641810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:14.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 --2- 10.20.193.28:0/3569417699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810c720 0x7f641810d080 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=8422703429003002327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f640c00aa30 tx=0x7f640c030270 comp rx=0 tx=0).stop 2026-02-20T13:16:14.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 -- 10.20.193.28:0/3569417699 shutdown_connections 2026-02-20T13:16:14.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 --2- 10.20.193.28:0/3569417699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810c720 0x7f641810d080 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=8422703429003002327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 --2- 10.20.193.28:0/3569417699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f641810bd70 0x7f641810c1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 --2- 10.20.193.28:0/3569417699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f641810ad40 0x7f641810b130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 -- 10.20.193.28:0/3569417699 >> 10.20.193.28:0/3569417699 conn(0x7f64180e8760 msgr2=0x7f6418108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:14.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 -- 10.20.193.28:0/3569417699 shutdown_connections 2026-02-20T13:16:14.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.468+0000 7f641d152640 1 -- 10.20.193.28:0/3569417699 wait complete. 2026-02-20T13:16:14.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641d152640 1 Processor -- start 2026-02-20T13:16:14.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641d152640 1 -- start start 2026-02-20T13:16:14.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641d152640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810ad40 0x7f64180f32b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641d152640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f641810bd70 0x7f64180f3900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641d152640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f641810c720 0x7f64180f4500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641d152640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f64180f4c40 con 0x7f641810ad40 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641d152640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f64180f4db0 con 0x7f641810bd70 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641d152640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f64180f4f70 con 0x7f641810c720 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f6417fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810ad40 0x7f64180f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f6417fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810ad40 0x7f64180f32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47070/0 (socket says 10.20.193.28:47070) 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f6417fff640 1 -- 10.20.193.28:0/3031954812 learned_addr learned my addr 10.20.193.28:0/3031954812 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f64177fe640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f641810bd70 0x7f64180f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.469+0000 7f641c951640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f641810c720 0x7f64180f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:14.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f6417fff640 1 -- 10.20.193.28:0/3031954812 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f641810c720 msgr2=0x7f64180f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f6417fff640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f641810c720 0x7f64180f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f6417fff640 1 -- 10.20.193.28:0/3031954812 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f641810bd70 msgr2=0x7f64180f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f6417fff640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f641810bd70 0x7f64180f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f6417fff640 1 -- 10.20.193.28:0/3031954812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c00a650 con 0x7f641810ad40 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f6417fff640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810ad40 0x7f64180f32b0 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6404009480 tx=0x7f640400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f64157fa640 1 -- 10.20.193.28:0/3031954812 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f640400cd40 con 0x7f641810ad40 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f64157fa640 1 -- 10.20.193.28:0/3031954812 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6404004d30 con 0x7f641810ad40 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f64157fa640 1 -- 10.20.193.28:0/3031954812 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64040106b0 con 0x7f641810ad40 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64180f5250 con 0x7f641810ad40 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.470+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64180f5770 con 0x7f641810ad40 2026-02-20T13:16:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.471+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63dc005300 con 0x7f641810ad40 2026-02-20T13:16:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.473+0000 7f64157fa640 1 -- 10.20.193.28:0/3031954812 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f640401f060 con 0x7f641810ad40 2026-02-20T13:16:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.475+0000 7f64157fa640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f63ec0b5760 0x7f63ec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.475+0000 7f64157fa640 1 -- 10.20.193.28:0/3031954812 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7119+0+0 (secure 0 0 0) 0x7f6404014070 con 0x7f641810ad40 2026-02-20T13:16:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.475+0000 7f64177fe640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f63ec0b5760 0x7f63ec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.475+0000 7f64157fa640 1 -- 10.20.193.28:0/3031954812 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f64040e6be0 con 0x7f641810ad40 2026-02-20T13:16:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.475+0000 7f64177fe640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f63ec0b5760 0x7f63ec0d5c10 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6408004740 tx=0x7f6408005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:14.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.591+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f63dc005880 con 0x7f641810ad40 2026-02-20T13:16:14.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.591+0000 7f64157fa640 1 -- 10.20.193.28:0/3031954812 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f64040a97c0 con 0x7f641810ad40 2026-02-20T13:16:14.594 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f63ec0b5760 msgr2=0x7f63ec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f63ec0b5760 0x7f63ec0d5c10 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6408004740 tx=0x7f6408005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810ad40 msgr2=0x7f64180f32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810ad40 0x7f64180f32b0 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6404009480 tx=0x7f640400ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 shutdown_connections 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f63ec0b5760 0x7f63ec0d5c10 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f641810c720 0x7f64180f4500 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f641810bd70 0x7f64180f3900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 --2- 10.20.193.28:0/3031954812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641810ad40 0x7f64180f32b0 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.592+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 >> 10.20.193.28:0/3031954812 conn(0x7f64180e8760 msgr2=0x7f6418109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.593+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 shutdown_connections 2026-02-20T13:16:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:14.593+0000 7f641d152640 1 -- 10.20.193.28:0/3031954812 wait complete. 2026-02-20T13:16:14.696 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1771593373,"num_in_osds":12,"osd_in_since":1771593364,"num_remapped_pgs":0} 2026-02-20T13:16:14.697 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:16:14.882 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:14.951 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: purged_snaps scrub starts 2026-02-20T13:16:14.951 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: purged_snaps scrub ok 2026-02-20T13:16:14.951 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-20T13:16:14.952 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: Cluster is now healthy 2026-02-20T13:16:14.952 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:14.952 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] boot 2026-02-20T13:16:14.952 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: osdmap e73: 12 total, 12 up, 12 in 2026-02-20T13:16:14.952 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:14.952 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:14.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:14.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:14 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3031954812' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:15.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 -- 10.20.193.28:0/1121076728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a3010f230 msgr2=0x7f0a3010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/1121076728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a3010f230 0x7f0a3010f600 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=10462659144664654801 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a20009950 tx=0x7f0a2002f190 comp rx=0 tx=0).stop 2026-02-20T13:16:15.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 -- 10.20.193.28:0/1121076728 shutdown_connections 2026-02-20T13:16:15.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/1121076728 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a30115420 0x7f0a30175df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/1121076728 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a3010fc20 0x7f0a30114c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/1121076728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a3010f230 0x7f0a3010f600 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=10462659144664654801 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 -- 10.20.193.28:0/1121076728 >> 10.20.193.28:0/1121076728 conn(0x7f0a3005f830 msgr2=0x7f0a3010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:15.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 -- 10.20.193.28:0/1121076728 shutdown_connections 2026-02-20T13:16:15.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 -- 10.20.193.28:0/1121076728 wait complete. 2026-02-20T13:16:15.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 Processor -- start 2026-02-20T13:16:15.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.060+0000 7f0a36b9e640 1 -- start start 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a36b9e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a3010f230 0x7f0a3011db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a36b9e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a3010fc20 0x7f0a3011e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a36b9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a30115420 0x7f0a30123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a36b9e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a30123a60 con 0x7f0a30115420 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a36b9e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0a30123bd0 con 0x7f0a3010f230 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a36b9e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0a30123d90 con 0x7f0a3010fc20 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a34913640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a3010f230 0x7f0a3011db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a34913640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a3010f230 0x7f0a3011db30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38754/0 (socket says 10.20.193.28:38754) 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a34913640 1 -- 10.20.193.28:0/3961876560 learned_addr learned my addr 10.20.193.28:0/3961876560 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a35114640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a30115420 0x7f0a30123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a27fff640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a3010fc20 0x7f0a3011e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:15.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a35114640 1 -- 10.20.193.28:0/3961876560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a3010fc20 msgr2=0x7f0a3011e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a35114640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a3010fc20 0x7f0a3011e070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a35114640 1 -- 10.20.193.28:0/3961876560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a3010f230 msgr2=0x7f0a3011db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a35114640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a3010f230 0x7f0a3011db30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a35114640 1 -- 10.20.193.28:0/3961876560 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a20009570 con 0x7f0a30115420 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a34913640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a3010f230 0x7f0a3011db30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.061+0000 7f0a35114640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a30115420 0x7f0a30123440 secure :-1 s=READY pgs=179 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a2c00f940 tx=0x7f0a2c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.062+0000 7f0a25ffb640 1 -- 10.20.193.28:0/3961876560 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a2c00dce0 con 0x7f0a30115420 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.062+0000 7f0a25ffb640 1 -- 10.20.193.28:0/3961876560 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0a2c00de40 con 0x7f0a30115420 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.062+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a30124070 con 0x7f0a30115420 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.062+0000 7f0a25ffb640 1 -- 10.20.193.28:0/3961876560 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a2c0116b0 con 0x7f0a30115420 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.062+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a30164770 con 0x7f0a30115420 2026-02-20T13:16:15.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.062+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a30110510 con 0x7f0a30115420 2026-02-20T13:16:15.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.064+0000 7f0a25ffb640 1 -- 10.20.193.28:0/3961876560 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f0a2c020060 con 0x7f0a30115420 2026-02-20T13:16:15.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.066+0000 7f0a25ffb640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a0c0b5760 0x7f0a0c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:15.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.066+0000 7f0a25ffb640 1 -- 10.20.193.28:0/3961876560 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7119+0+0 (secure 0 0 0) 0x7f0a2c015070 con 0x7f0a30115420 2026-02-20T13:16:15.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.066+0000 7f0a25ffb640 1 -- 10.20.193.28:0/3961876560 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f0a2c0e7ba0 con 0x7f0a30115420 2026-02-20T13:16:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.067+0000 7f0a34913640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a0c0b5760 0x7f0a0c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.067+0000 7f0a34913640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a0c0b5760 0x7f0a0c0d5c10 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a20038820 tx=0x7f0a2003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:15.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.181+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a3010f600 con 0x7f0a30115420 2026-02-20T13:16:15.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.182+0000 7f0a25ffb640 1 -- 10.20.193.28:0/3961876560 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18442 (secure 0 0 0) 0x7f0a2c0aa780 con 0x7f0a30115420 2026-02-20T13:16:15.186 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:15.186 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":73,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:13.827689+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:16:15.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a0c0b5760 msgr2=0x7f0a0c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a0c0b5760 0x7f0a0c0d5c10 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a20038820 tx=0x7f0a2003a040 comp rx=0 tx=0).stop 2026-02-20T13:16:15.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a30115420 msgr2=0x7f0a30123440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a30115420 0x7f0a30123440 secure :-1 s=READY pgs=179 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a2c00f940 tx=0x7f0a2c00fe10 comp rx=0 tx=0).stop 2026-02-20T13:16:15.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 shutdown_connections 2026-02-20T13:16:15.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a0c0b5760 0x7f0a0c0d5c10 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a30115420 0x7f0a30123440 unknown :-1 s=CLOSED pgs=179 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a3010fc20 0x7f0a3011e070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 --2- 10.20.193.28:0/3961876560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a3010f230 0x7f0a3011db30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 >> 10.20.193.28:0/3961876560 conn(0x7f0a3005f830 msgr2=0x7f0a3010cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:15.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 shutdown_connections 2026-02-20T13:16:15.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.183+0000 7f0a36b9e640 1 -- 10.20.193.28:0/3961876560 wait complete. 2026-02-20T13:16:15.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: purged_snaps scrub starts 2026-02-20T13:16:15.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: purged_snaps scrub ok 2026-02-20T13:16:15.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-20T13:16:15.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: Cluster is now healthy 2026-02-20T13:16:15.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:15.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] boot 2026-02-20T13:16:15.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: osdmap e73: 12 total, 12 up, 12 in 2026-02-20T13:16:15.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:15.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:15.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:15.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:14 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3031954812' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:15.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: purged_snaps scrub starts 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: purged_snaps scrub ok 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: Cluster is now healthy 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: osd.11 [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] boot 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: osdmap e73: 12 total, 12 up, 12 in 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:15.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:14 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3031954812' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-20T13:16:15.288 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-20T13:14:47.526378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-20T13:16:15.289 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-20T13:16:15.474 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:15.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.650+0000 7f24db0ca640 1 -- 10.20.193.28:0/1402769340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d41157e0 msgr2=0x7f24d41761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.650+0000 7f24db0ca640 1 --2- 10.20.193.28:0/1402769340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d41157e0 0x7f24d41761b0 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=8541525400027431952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24d000aa30 tx=0x7f24d0030270 comp rx=0 tx=0).stop 2026-02-20T13:16:15.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.650+0000 7f24db0ca640 1 -- 10.20.193.28:0/1402769340 shutdown_connections 2026-02-20T13:16:15.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.650+0000 7f24db0ca640 1 --2- 10.20.193.28:0/1402769340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d41157e0 0x7f24d41761b0 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=8541525400027431952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.650+0000 7f24db0ca640 1 --2- 10.20.193.28:0/1402769340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24d410ffe0 0x7f24d4115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.650+0000 7f24db0ca640 1 --2- 10.20.193.28:0/1402769340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f24d410f5f0 0x7f24d410f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.650+0000 7f24db0ca640 1 -- 10.20.193.28:0/1402769340 >> 10.20.193.28:0/1402769340 conn(0x7f24d40ecea0 msgr2=0x7f24d410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:15.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.650+0000 7f24db0ca640 1 -- 10.20.193.28:0/1402769340 shutdown_connections 2026-02-20T13:16:15.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.651+0000 7f24db0ca640 1 -- 10.20.193.28:0/1402769340 wait complete. 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.651+0000 7f24db0ca640 1 Processor -- start 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.651+0000 7f24db0ca640 1 -- start start 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.651+0000 7f24db0ca640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24d410f5f0 0x7f24d411d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.651+0000 7f24db0ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d410ffe0 0x7f24d411da10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.651+0000 7f24db0ca640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f24d41157e0 0x7f24d4122de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24db0ca640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4123400 con 0x7f24d410ffe0 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24db0ca640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4123570 con 0x7f24d41157e0 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24db0ca640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4123730 con 0x7f24d410f5f0 2026-02-20T13:16:15.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24d9640640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f24d41157e0 0x7f24d4122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d410ffe0 0x7f24d411da10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24d8e3f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24d410f5f0 0x7f24d411d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24d9640640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f24d41157e0 0x7f24d4122de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38766/0 (socket says 10.20.193.28:38766) 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24d9640640 1 -- 10.20.193.28:0/3826674739 learned_addr learned my addr 10.20.193.28:0/3826674739 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d410ffe0 0x7f24d411da10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47104/0 (socket says 10.20.193.28:47104) 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24cbfff640 1 -- 10.20.193.28:0/3826674739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24d410f5f0 msgr2=0x7f24d411d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24cbfff640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24d410f5f0 0x7f24d411d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24cbfff640 1 -- 10.20.193.28:0/3826674739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f24d41157e0 msgr2=0x7f24d4122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24cbfff640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f24d41157e0 0x7f24d4122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24cbfff640 1 -- 10.20.193.28:0/3826674739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c40094b0 con 0x7f24d410ffe0 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24cbfff640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d410ffe0 0x7f24d411da10 secure :-1 s=READY pgs=181 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24bc00e7b0 tx=0x7f24bc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:15.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24c9ffb640 1 -- 10.20.193.28:0/3826674739 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24bc00cc60 con 0x7f24d410ffe0 2026-02-20T13:16:15.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24c9ffb640 1 -- 10.20.193.28:0/3826674739 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f24bc004500 con 0x7f24d410ffe0 2026-02-20T13:16:15.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24c9ffb640 1 -- 10.20.193.28:0/3826674739 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24bc0052a0 con 0x7f24d410ffe0 2026-02-20T13:16:15.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d000a650 con 0x7f24d410ffe0 2026-02-20T13:16:15.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.652+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d4163f70 con 0x7f24d410ffe0 2026-02-20T13:16:15.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.653+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c005300 con 0x7f24d410ffe0 2026-02-20T13:16:15.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.655+0000 7f24c9ffb640 1 -- 10.20.193.28:0/3826674739 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f24bc004770 con 0x7f24d410ffe0 2026-02-20T13:16:15.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.657+0000 7f24c9ffb640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f24b00b5760 0x7f24b00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:15.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.657+0000 7f24c9ffb640 1 -- 10.20.193.28:0/3826674739 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7f24bc014070 con 0x7f24d410ffe0 2026-02-20T13:16:15.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.657+0000 7f24d8e3f640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f24b00b5760 0x7f24b00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:15.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.658+0000 7f24d8e3f640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f24b00b5760 0x7f24b00d5c10 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24c4004740 tx=0x7f24c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:15.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.658+0000 7f24c9ffb640 1 -- 10.20.193.28:0/3826674739 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f24bc0a98a0 con 0x7f24d410ffe0 2026-02-20T13:16:15.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.771+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f249c005b30 con 0x7f24d410ffe0 2026-02-20T13:16:15.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.772+0000 7f24c9ffb640 1 -- 10.20.193.28:0/3826674739 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f24bc0aca50 con 0x7f24d410ffe0 2026-02-20T13:16:15.775 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-20T13:16:15.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.773+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f24b00b5760 msgr2=0x7f24b00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.773+0000 7f24db0ca640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f24b00b5760 0x7f24b00d5c10 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24c4004740 tx=0x7f24c4005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:15.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.773+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d410ffe0 msgr2=0x7f24d411da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:15.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.773+0000 7f24db0ca640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d410ffe0 0x7f24d411da10 secure :-1 s=READY pgs=181 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24bc00e7b0 tx=0x7f24bc00ec80 comp rx=0 tx=0).stop 2026-02-20T13:16:15.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.774+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 shutdown_connections 2026-02-20T13:16:15.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.774+0000 7f24db0ca640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f24b00b5760 0x7f24b00d5c10 unknown :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.774+0000 7f24db0ca640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24d410ffe0 0x7f24d411da10 unknown :-1 s=CLOSED pgs=181 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.774+0000 7f24db0ca640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f24d41157e0 0x7f24d4122de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.774+0000 7f24db0ca640 1 --2- 10.20.193.28:0/3826674739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24d410f5f0 0x7f24d411d4d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:15.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.774+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 >> 10.20.193.28:0/3826674739 conn(0x7f24d40ecea0 msgr2=0x7f24d410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:15.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.774+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 shutdown_connections 2026-02-20T13:16:15.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:15.774+0000 7f24db0ca640 1 -- 10.20.193.28:0/3826674739 wait complete. 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.a on trial028 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.d on trial028 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.g on trial028 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.j on trial028 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.b on trial034 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.e on trial034 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.h on trial034 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.k on trial034 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.c on trial127 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.f on trial127 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.i on trial127 2026-02-20T13:16:15.875 INFO:tasks.cephadm:Adding mds.l on trial127 2026-02-20T13:16:15.876 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph orch apply mds all '12;trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l' 2026-02-20T13:16:15.998 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.c/config 2026-02-20T13:16:16.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:15 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3961876560' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:16.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:15 trial028 ceph-mon[37442]: osdmap e74: 12 total, 12 up, 12 in 2026-02-20T13:16:16.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:15 trial028 ceph-mon[37442]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T13:16:16.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:15 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3826674739' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.105+0000 7f6a9817d640 1 -- 10.20.193.127:0/1332064937 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 msgr2=0x7f6a9010f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.105+0000 7f6a9817d640 1 --2- 10.20.193.127:0/1332064937 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 0x7f6a9010f4a0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=18353756530989060198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a84009980 tx=0x7f6a8402f190 comp rx=0 tx=0).stop 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.105+0000 7f6a9817d640 1 -- 10.20.193.127:0/1332064937 shutdown_connections 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.105+0000 7f6a9817d640 1 --2- 10.20.193.127:0/1332064937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a9010f9e0 0x7f6a90171770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.105+0000 7f6a9817d640 1 --2- 10.20.193.127:0/1332064937 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 0x7f6a9010f4a0 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=18353756530989060198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.105+0000 7f6a9817d640 1 --2- 10.20.193.127:0/1332064937 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6a901107a0 0x7f6a90110b90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.105+0000 7f6a9817d640 1 -- 10.20.193.127:0/1332064937 >> 10.20.193.127:0/1332064937 conn(0x7f6a900eca10 msgr2=0x7f6a9010ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.105+0000 7f6a9817d640 1 -- 10.20.193.127:0/1332064937 shutdown_connections 2026-02-20T13:16:16.107 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 -- 10.20.193.127:0/1332064937 wait complete. 2026-02-20T13:16:16.107 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:15 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3961876560' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:16.107 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:15 trial127 ceph-mon[43817]: osdmap e74: 12 total, 12 up, 12 in 2026-02-20T13:16:16.107 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:15 trial127 ceph-mon[43817]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T13:16:16.107 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:15 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3826674739' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 Processor -- start 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 -- start start 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 0x7f6a900f8940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6a9010f9e0 0x7f6a90171770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a901107a0 0x7f6a900f91a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6a900f9d90 con 0x7f6a901107a0 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6a900f9f00 con 0x7f6a9010f9e0 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a9817d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6a900fa0c0 con 0x7f6a9010f030 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a95ef2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 0x7f6a900f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a95ef2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 0x7f6a900f8940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:56636/0 (socket says 10.20.193.127:56636) 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a95ef2640 1 -- 10.20.193.127:0/2471724293 learned_addr learned my addr 10.20.193.127:0/2471724293 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a956f1640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6a9010f9e0 0x7f6a90171770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a966f3640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a901107a0 0x7f6a900f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a95ef2640 1 -- 10.20.193.127:0/2471724293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6a9010f9e0 msgr2=0x7f6a90171770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a95ef2640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6a9010f9e0 0x7f6a90171770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a95ef2640 1 -- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a901107a0 msgr2=0x7f6a900f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a95ef2640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a901107a0 0x7f6a900f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.106+0000 7f6a95ef2640 1 -- 10.20.193.127:0/2471724293 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a84009570 con 0x7f6a9010f030 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.107+0000 7f6a95ef2640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 0x7f6a900f8940 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a80005db0 tx=0x7f6a8000ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.107+0000 7f6a7effd640 1 -- 10.20.193.127:0/2471724293 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a80004500 con 0x7f6a9010f030 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.107+0000 7f6a7effd640 1 -- 10.20.193.127:0/2471724293 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6a80004d30 con 0x7f6a9010f030 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.107+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a900fa3a0 con 0x7f6a9010f030 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.107+0000 7f6a7effd640 1 -- 10.20.193.127:0/2471724293 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a80005310 con 0x7f6a9010f030 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.107+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a900fa870 con 0x7f6a9010f030 2026-02-20T13:16:16.108 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.107+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a901758a0 con 0x7f6a9010f030 2026-02-20T13:16:16.109 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.108+0000 7f6a7effd640 1 -- 10.20.193.127:0/2471724293 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f6a800054a0 con 0x7f6a9010f030 2026-02-20T13:16:16.110 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.109+0000 7f6a7effd640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a6c0b5760 0x7f6a6c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:16.110 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.109+0000 7f6a7effd640 1 -- 10.20.193.127:0/2471724293 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7f6a800e6bd0 con 0x7f6a9010f030 2026-02-20T13:16:16.110 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.109+0000 7f6a956f1640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a6c0b5760 0x7f6a6c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:16.111 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.110+0000 7f6a956f1640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a6c0b5760 0x7f6a6c0d5c10 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a84005b30 tx=0x7f6a84031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:16.111 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.110+0000 7f6a7effd640 1 -- 10.20.193.127:0/2471724293 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f6a800a99e0 con 0x7f6a9010f030 2026-02-20T13:16:16.224 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.223+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l", "target": ["mon-mgr", ""]}) -- 0x7f6a9005f690 con 0x7f6a6c0b5760 2026-02-20T13:16:16.230 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.229+0000 7f6a7effd640 1 -- 10.20.193.127:0/2471724293 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6a9005f690 con 0x7f6a6c0b5760 2026-02-20T13:16:16.230 INFO:teuthology.orchestra.run.trial127.stdout:Scheduled mds.all update... 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a6c0b5760 msgr2=0x7f6a6c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a6c0b5760 0x7f6a6c0d5c10 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a84005b30 tx=0x7f6a84031040 comp rx=0 tx=0).stop 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 msgr2=0x7f6a900f8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 0x7f6a900f8940 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a80005db0 tx=0x7f6a8000ddf0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 shutdown_connections 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a6c0b5760 0x7f6a6c0d5c10 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a901107a0 0x7f6a900f91a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6a9010f9e0 0x7f6a90171770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 --2- 10.20.193.127:0/2471724293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6a9010f030 0x7f6a900f8940 unknown :-1 s=CLOSED pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 >> 10.20.193.127:0/2471724293 conn(0x7f6a900eca10 msgr2=0x7f6a900eefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 shutdown_connections 2026-02-20T13:16:16.232 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-20T13:16:16.231+0000 7f6a9817d640 1 -- 10.20.193.127:0/2471724293 wait complete. 2026-02-20T13:16:16.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:15 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3961876560' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:16.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:15 trial034 ceph-mon[43332]: osdmap e74: 12 total, 12 up, 12 in 2026-02-20T13:16:16.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:15 trial034 ceph-mon[43332]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T13:16:16.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:15 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3826674739' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:16:16.273 DEBUG:teuthology.orchestra.run.trial028:mds.a> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.a.service 2026-02-20T13:16:16.276 DEBUG:teuthology.orchestra.run.trial028:mds.d> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.d.service 2026-02-20T13:16:16.320 DEBUG:teuthology.orchestra.run.trial028:mds.g> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.g.service 2026-02-20T13:16:16.364 DEBUG:teuthology.orchestra.run.trial028:mds.j> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.j.service 2026-02-20T13:16:16.407 DEBUG:teuthology.orchestra.run.trial034:mds.b> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.b.service 2026-02-20T13:16:16.409 DEBUG:teuthology.orchestra.run.trial034:mds.e> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.e.service 2026-02-20T13:16:16.451 DEBUG:teuthology.orchestra.run.trial034:mds.h> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.h.service 2026-02-20T13:16:16.494 DEBUG:teuthology.orchestra.run.trial034:mds.k> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.k.service 2026-02-20T13:16:16.537 DEBUG:teuthology.orchestra.run.trial127:mds.c> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.c.service 2026-02-20T13:16:16.540 DEBUG:teuthology.orchestra.run.trial127:mds.f> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.f.service 2026-02-20T13:16:16.583 DEBUG:teuthology.orchestra.run.trial127:mds.i> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.i.service 2026-02-20T13:16:16.627 DEBUG:teuthology.orchestra.run.trial127:mds.l> sudo journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.l.service 2026-02-20T13:16:16.671 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-20T13:16:16.671 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:16.857 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:17.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 -- 10.20.193.28:0/4288224643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1500614f0 msgr2=0x7fd150061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:17.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 --2- 10.20.193.28:0/4288224643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1500614f0 0x7fd150061920 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=2409976421812569178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd138009950 tx=0x7fd13802f190 comp rx=0 tx=0).stop 2026-02-20T13:16:17.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 -- 10.20.193.28:0/4288224643 shutdown_connections 2026-02-20T13:16:17.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 --2- 10.20.193.28:0/4288224643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1500614f0 0x7fd150061920 unknown :-1 s=CLOSED pgs=182 gs=1 cs=0 l=1 c_cookie=2409976421812569178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 --2- 10.20.193.28:0/4288224643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd150159af0 0x7fd150179ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 --2- 10.20.193.28:0/4288224643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd150062ae0 0x7fd150060fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 -- 10.20.193.28:0/4288224643 >> 10.20.193.28:0/4288224643 conn(0x7fd15005f830 msgr2=0x7fd15010ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:17.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 -- 10.20.193.28:0/4288224643 shutdown_connections 2026-02-20T13:16:17.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.031+0000 7fd1558fd640 1 -- 10.20.193.28:0/4288224643 wait complete. 2026-02-20T13:16:17.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd1558fd640 1 Processor -- start 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd1558fd640 1 -- start start 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd1558fd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd1500614f0 0x7fd1500f2c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd1558fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd150062ae0 0x7fd1500f3190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd1558fd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd150159af0 0x7fd1500f8560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd1558fd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1500f8b80 con 0x7fd150062ae0 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd1558fd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd1500f8cf0 con 0x7fd1500614f0 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd1558fd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd1500f8eb0 con 0x7fd150159af0 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd150062ae0 0x7fd1500f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd150062ae0 0x7fd1500f3190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47134/0 (socket says 10.20.193.28:47134) 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14e7fc640 1 -- 10.20.193.28:0/1995036331 learned_addr learned my addr 10.20.193.28:0/1995036331 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14effd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd1500614f0 0x7fd1500f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:17.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14f7fe640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd150159af0 0x7fd1500f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14e7fc640 1 -- 10.20.193.28:0/1995036331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd150159af0 msgr2=0x7fd1500f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14e7fc640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd150159af0 0x7fd1500f8560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14e7fc640 1 -- 10.20.193.28:0/1995036331 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd1500614f0 msgr2=0x7fd1500f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14e7fc640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd1500614f0 0x7fd1500f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.032+0000 7fd14e7fc640 1 -- 10.20.193.28:0/1995036331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd138009570 con 0x7fd150062ae0 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.033+0000 7fd14e7fc640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd150062ae0 0x7fd1500f3190 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd138038820 tx=0x7fd138004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.033+0000 7fd1548fb640 1 -- 10.20.193.28:0/1995036331 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd13803d070 con 0x7fd150062ae0 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.033+0000 7fd1548fb640 1 -- 10.20.193.28:0/1995036331 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd138002ad0 con 0x7fd150062ae0 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.033+0000 7fd1548fb640 1 -- 10.20.193.28:0/1995036331 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd138041930 con 0x7fd150062ae0 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.033+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1500f9130 con 0x7fd150062ae0 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.033+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1500f96d0 con 0x7fd150062ae0 2026-02-20T13:16:17.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.033+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1500624c0 con 0x7fd150062ae0 2026-02-20T13:16:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.036+0000 7fd1548fb640 1 -- 10.20.193.28:0/1995036331 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7fd13802f9f0 con 0x7fd150062ae0 2026-02-20T13:16:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.037+0000 7fd1548fb640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1240b5760 0x7fd1240d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.037+0000 7fd1548fb640 1 -- 10.20.193.28:0/1995036331 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7fd13810b000 con 0x7fd150062ae0 2026-02-20T13:16:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.037+0000 7fd1548fb640 1 -- 10.20.193.28:0/1995036331 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fd13810b4f0 con 0x7fd150062ae0 2026-02-20T13:16:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.037+0000 7fd14effd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1240b5760 0x7fd1240d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.038+0000 7fd14effd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1240b5760 0x7fd1240d5c10 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd144004740 tx=0x7fd144005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:17.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.182+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd150060f60 con 0x7fd150062ae0 2026-02-20T13:16:17.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.182+0000 7fd1548fb640 1 -- 10.20.193.28:0/1995036331 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fd1380cde50 con 0x7fd150062ae0 2026-02-20T13:16:17.186 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:17.186 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":1,"btime":"2026-02-20T13:13:12:477808+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-20T13:16:17.187 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 1 2026-02-20T13:16:17.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1240b5760 msgr2=0x7fd1240d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:17.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1240b5760 0x7fd1240d5c10 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd144004740 tx=0x7fd144005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:17.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd150062ae0 msgr2=0x7fd1500f3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd150062ae0 0x7fd1500f3190 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd138038820 tx=0x7fd138004300 comp rx=0 tx=0).stop 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 shutdown_connections 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1240b5760 0x7fd1240d5c10 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd150062ae0 0x7fd1500f3190 unknown :-1 s=CLOSED pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd150159af0 0x7fd1500f8560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 --2- 10.20.193.28:0/1995036331 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd1500614f0 0x7fd1500f2c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 >> 10.20.193.28:0/1995036331 conn(0x7fd15005f830 msgr2=0x7fd15010f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 shutdown_connections 2026-02-20T13:16:17.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:17.184+0000 7fd1558fd640 1 -- 10.20.193.28:0/1995036331 wait complete. 2026-02-20T13:16:17.243 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:17 trial028 ceph-mon[37442]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:17.244 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:17 trial028 ceph-mon[37442]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l;count:12 2026-02-20T13:16:17.244 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:17 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.244 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:17 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:17.244 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:17 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.244 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:17 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.244 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:17 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1995036331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:17.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:17 trial034 ceph-mon[43332]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:17.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:17 trial034 ceph-mon[43332]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l;count:12 2026-02-20T13:16:17.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:17 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:17 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:17.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:17 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:17 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:17 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1995036331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:17.512 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:17 trial127 ceph-mon[43817]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:17.513 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:17 trial127 ceph-mon[43817]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l;count:12 2026-02-20T13:16:17.513 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:17 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.513 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:17 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:17.513 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:17 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.513 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:17 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:17.513 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:17 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1995036331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:18.478 INFO:journalctl@ceph.mds.l.trial127.stdout:Feb 20 13:16:18 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-l[96287]: starting mds.l at 2026-02-20T13:16:18.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 105 KiB/s, 0 objects/s recovering 2026-02-20T13:16:18.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:18.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:18.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:18.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:18.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: Deploying daemon mds.l on trial127 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.127:6832/3591480373,v1:10.20.193.127:6833/3591480373] up:boot 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: fsmap 1 up:standby 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:18.743 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 105 KiB/s, 0 objects/s recovering 2026-02-20T13:16:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: Deploying daemon mds.l on trial127 2026-02-20T13:16:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.127:6832/3591480373,v1:10.20.193.127:6833/3591480373] up:boot 2026-02-20T13:16:18.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: fsmap 1 up:standby 2026-02-20T13:16:18.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-20T13:16:18.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:18.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:18.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:18 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:18.920 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:16:18 trial034 bash[91678]: 1537aa942f1f98af2dce0db6eb0c11cce044de151cf4f461003bc26bbe2a261c 2026-02-20T13:16:18.920 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:16:18 trial034 podman[91678]: 2026-02-20 13:16:18.882011424 +0000 UTC m=+0.009099905 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:16:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 105 KiB/s, 0 objects/s recovering 2026-02-20T13:16:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: Deploying daemon mds.l on trial127 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.127:6832/3591480373,v1:10.20.193.127:6833/3591480373] up:boot 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: fsmap 1 up:standby 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:18.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:18.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:18 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:19.241 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:16:18 trial034 systemd[1]: Started Ceph mds.k for dd845518-0e5d-11f1-9909-d404e6e7d460. 2026-02-20T13:16:19.241 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:16:18 trial034 ceph-mds[91706]: -- 10.20.193.34:0/596681254 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x3023860 con 0x2ff7c00 2026-02-20T13:16:19.241 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:16:18 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-k[91699]: starting mds.k at 2026-02-20T13:16:19.285 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:19.475 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:19.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.792+0000 7f7e1996d640 1 -- 10.20.193.28:0/556540771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e1410f4b0 msgr2=0x7f7e1410f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:19.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.792+0000 7f7e1996d640 1 --2- 10.20.193.28:0/556540771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e1410f4b0 0x7f7e1410f880 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=17986909205585247343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e04009950 tx=0x7f7e0402f190 comp rx=0 tx=0).stop 2026-02-20T13:16:19.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.792+0000 7f7e1996d640 1 -- 10.20.193.28:0/556540771 shutdown_connections 2026-02-20T13:16:19.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.792+0000 7f7e1996d640 1 --2- 10.20.193.28:0/556540771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e141156a0 0x7f7e14176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.792+0000 7f7e1996d640 1 --2- 10.20.193.28:0/556540771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e1410fea0 0x7f7e14114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.792+0000 7f7e1996d640 1 --2- 10.20.193.28:0/556540771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e1410f4b0 0x7f7e1410f880 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=17986909205585247343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.792+0000 7f7e1996d640 1 -- 10.20.193.28:0/556540771 >> 10.20.193.28:0/556540771 conn(0x7f7e140ecd60 msgr2=0x7f7e1410d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:19.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.792+0000 7f7e1996d640 1 -- 10.20.193.28:0/556540771 shutdown_connections 2026-02-20T13:16:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.794+0000 7f7e1996d640 1 -- 10.20.193.28:0/556540771 wait complete. 2026-02-20T13:16:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.794+0000 7f7e1996d640 1 Processor -- start 2026-02-20T13:16:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.794+0000 7f7e1996d640 1 -- start start 2026-02-20T13:16:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.794+0000 7f7e1996d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e1410f4b0 0x7f7e140f5750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.794+0000 7f7e1996d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e1410fea0 0x7f7e14175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.794+0000 7f7e1996d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e141156a0 0x7f7e140f5e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1996d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140fb060 con 0x7f7e1410f4b0 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1996d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140fb1d0 con 0x7f7e141156a0 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1996d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140fb390 con 0x7f7e1410fea0 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e1410f4b0 0x7f7e140f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e1410f4b0 0x7f7e140f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47152/0 (socket says 10.20.193.28:47152) 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 -- 10.20.193.28:0/2163917693 learned_addr learned my addr 10.20.193.28:0/2163917693 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1916c640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e141156a0 0x7f7e140f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e0bfff640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e1410fea0 0x7f7e14175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 -- 10.20.193.28:0/2163917693 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e1410fea0 msgr2=0x7f7e14175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e1410fea0 0x7f7e14175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 -- 10.20.193.28:0/2163917693 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e141156a0 msgr2=0x7f7e140f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e141156a0 0x7f7e140f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 -- 10.20.193.28:0/2163917693 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e04009570 con 0x7f7e1410f4b0 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1896b640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e1410f4b0 0x7f7e140f5750 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e040023d0 tx=0x7f7e040028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e09ffb640 1 -- 10.20.193.28:0/2163917693 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e0403d070 con 0x7f7e1410f4b0 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e09ffb640 1 -- 10.20.193.28:0/2163917693 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7e040043d0 con 0x7f7e1410f4b0 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e09ffb640 1 -- 10.20.193.28:0/2163917693 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e040418a0 con 0x7f7e1410f4b0 2026-02-20T13:16:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.795+0000 7f7e1996d640 1 -- 10.20.193.28:0/2163917693 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e140fb610 con 0x7f7e1410f4b0 2026-02-20T13:16:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.796+0000 7f7e1996d640 1 -- 10.20.193.28:0/2163917693 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e140fba30 con 0x7f7e1410f4b0 2026-02-20T13:16:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.796+0000 7f7de37fe640 1 -- 10.20.193.28:0/2163917693 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e14110790 con 0x7f7e1410f4b0 2026-02-20T13:16:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.798+0000 7f7e09ffb640 1 -- 10.20.193.28:0/2163917693 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f7e04041a30 con 0x7f7e1410f4b0 2026-02-20T13:16:19.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.800+0000 7f7e09ffb640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7df00b5750 0x7f7df00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:19.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.800+0000 7f7e09ffb640 1 -- 10.20.193.28:0/2163917693 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7f7e0410b820 con 0x7f7e1410f4b0 2026-02-20T13:16:19.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.801+0000 7f7e09ffb640 1 -- 10.20.193.28:0/2163917693 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f7e04144730 con 0x7f7e1410f4b0 2026-02-20T13:16:19.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.801+0000 7f7e0bfff640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7df00b5750 0x7f7df00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:19.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.801+0000 7f7e0bfff640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7df00b5750 0x7f7df00d5c00 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e140fc0f0 tx=0x7f7dfc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:19.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:19 trial028 ceph-mon[37442]: Deploying daemon mds.k on trial034 2026-02-20T13:16:19.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:19 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:19 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:19 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:19 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:19.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:19 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:19.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:19 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.942+0000 7f7de37fe640 1 -- 10.20.193.28:0/2163917693 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e140f68b0 con 0x7f7e1410f4b0 2026-02-20T13:16:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.943+0000 7f7e09ffb640 1 -- 10.20.193.28:0/2163917693 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f7e040ce6e0 con 0x7f7e1410f4b0 2026-02-20T13:16:19.947 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:19.947 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":3,"btime":"2026-02-20T13:16:19:560509+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-20T13:16:19.947 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 3 2026-02-20T13:16:19.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 -- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7df00b5750 msgr2=0x7f7df00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:19.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7df00b5750 0x7f7df00d5c00 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e140fc0f0 tx=0x7f7dfc005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:19.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 -- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e1410f4b0 msgr2=0x7f7e140f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:19.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e1410f4b0 0x7f7e140f5750 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e040023d0 tx=0x7f7e040028d0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 -- 10.20.193.28:0/2163917693 shutdown_connections 2026-02-20T13:16:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7df00b5750 0x7f7df00d5c00 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e141156a0 0x7f7e140f5e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e1410fea0 0x7f7e14175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 --2- 10.20.193.28:0/2163917693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e1410f4b0 0x7f7e140f5750 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.945+0000 7f7de37fe640 1 -- 10.20.193.28:0/2163917693 >> 10.20.193.28:0/2163917693 conn(0x7f7e140ecd60 msgr2=0x7f7e14111950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.946+0000 7f7de37fe640 1 -- 10.20.193.28:0/2163917693 shutdown_connections 2026-02-20T13:16:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:19.946+0000 7f7de37fe640 1 -- 10.20.193.28:0/2163917693 wait complete. 2026-02-20T13:16:19.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:19 trial127 ceph-mon[43817]: Deploying daemon mds.k on trial034 2026-02-20T13:16:19.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:19 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:19 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:19 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:19 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:19.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:19 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:19.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:19 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:19.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:19 trial034 ceph-mon[43332]: Deploying daemon mds.k on trial034 2026-02-20T13:16:19.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:19 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:19 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:19 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:19.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:19 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:19.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:19 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:19.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:19 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:20.202 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:16:20 trial028 podman[100064]: 2026-02-20 13:16:20.199196774 +0000 UTC m=+0.076680140 container start 687d4134d83c60da4523e5f1a08697a0c17979e87c963fb482ab1f24c1c0fbda (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-j, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.41.3) 2026-02-20T13:16:20.569 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:16:20 trial028 bash[100064]: 687d4134d83c60da4523e5f1a08697a0c17979e87c963fb482ab1f24c1c0fbda 2026-02-20T13:16:20.570 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:16:20 trial028 podman[100064]: 2026-02-20 13:16:20.142878094 +0000 UTC m=+0.020361480 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:16:20.570 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:16:20 trial028 systemd[1]: Started Ceph mds.j for dd845518-0e5d-11f1-9909-d404e6e7d460. 2026-02-20T13:16:20.570 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:16:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-j[100080]: starting mds.j at 2026-02-20T13:16:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: Deploying daemon mds.j on trial028 2026-02-20T13:16:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 89 KiB/s, 0 objects/s recovering 2026-02-20T13:16:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6832/4255317184,v1:10.20.193.34:6833/4255317184] up:boot 2026-02-20T13:16:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: fsmap 2 up:standby 2026-02-20T13:16:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-20T13:16:20.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2163917693' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:20.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:20.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:20.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: Deploying daemon mds.j on trial028 2026-02-20T13:16:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 89 KiB/s, 0 objects/s recovering 2026-02-20T13:16:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6832/4255317184,v1:10.20.193.34:6833/4255317184] up:boot 2026-02-20T13:16:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: fsmap 2 up:standby 2026-02-20T13:16:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-20T13:16:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2163917693' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:20.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:20.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: Deploying daemon mds.j on trial028 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 89 KiB/s, 0 objects/s recovering 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6832/4255317184,v1:10.20.193.34:6833/4255317184] up:boot 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: fsmap 2 up:standby 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2163917693' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:20.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:20.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:21.254 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 systemd[1]: Starting Ceph mds.d for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:16:21.511 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 podman[100362]: 2026-02-20 13:16:21.433206188 +0000 UTC m=+0.031057556 container create 4c1defeb2a515fee5c552c9258ea046ddb76b76a4dbc828bb995dac028302f1b (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2) 2026-02-20T13:16:21.511 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 podman[100362]: 2026-02-20 13:16:21.475463104 +0000 UTC m=+0.073314482 container init 4c1defeb2a515fee5c552c9258ea046ddb76b76a4dbc828bb995dac028302f1b (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS) 2026-02-20T13:16:21.511 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 podman[100362]: 2026-02-20 13:16:21.481155011 +0000 UTC m=+0.079006379 container start 4c1defeb2a515fee5c552c9258ea046ddb76b76a4dbc828bb995dac028302f1b (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-20T13:16:21.511 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 bash[100362]: 4c1defeb2a515fee5c552c9258ea046ddb76b76a4dbc828bb995dac028302f1b 2026-02-20T13:16:21.511 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 podman[100362]: 2026-02-20 13:16:21.422319138 +0000 UTC m=+0.020170526 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:16:21.511 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 systemd[1]: Started Ceph mds.d for dd845518-0e5d-11f1-9909-d404e6e7d460. 2026-02-20T13:16:21.511 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mds[100382]: -- 10.20.193.28:0/3180205531 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x2ffa1b80 con 0x30d04000 2026-02-20T13:16:21.512 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mds[100382]: -- 10.20.193.28:0/3180205531 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x2ff99860 con 0x30d04000 2026-02-20T13:16:21.848 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: Deploying daemon mds.d on trial028 2026-02-20T13:16:21.848 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] up:boot 2026-02-20T13:16:21.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: fsmap 3 up:standby 2026-02-20T13:16:21.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-20T13:16:21.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:21.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:21.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:21 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:21.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: Deploying daemon mds.d on trial028 2026-02-20T13:16:21.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] up:boot 2026-02-20T13:16:21.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: fsmap 3 up:standby 2026-02-20T13:16:21.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-20T13:16:21.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:21 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:21.851 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:16:21 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d[100378]: starting mds.d at 2026-02-20T13:16:21.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: Deploying daemon mds.d on trial028 2026-02-20T13:16:21.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] up:boot 2026-02-20T13:16:21.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: fsmap 3 up:standby 2026-02-20T13:16:21.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-20T13:16:21.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:21.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:21.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:21.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:21 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:22.052 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:22.202 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:16:22 trial034 podman[92012]: 2026-02-20 13:16:22.174486816 +0000 UTC m=+0.017397190 container create cd01bcf443d8ee253542d7a37e6aaebd6e1497a26b7cf1f175d3f093e0f3d33e (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260219.125903) 2026-02-20T13:16:22.244 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:22.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 -- 10.20.193.28:0/803068687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 msgr2=0x7f469c173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:22.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/803068687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 0x7f469c173b60 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=2001622134635602409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f468c00aa30 tx=0x7f468c030270 comp rx=0 tx=0).stop 2026-02-20T13:16:22.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 -- 10.20.193.28:0/803068687 shutdown_connections 2026-02-20T13:16:22.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/803068687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 0x7f469c173b60 unknown :-1 s=CLOSED pgs=186 gs=1 cs=0 l=1 c_cookie=2001622134635602409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/803068687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f469c10d990 0x7f469c1129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/803068687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f469c10cfa0 0x7f469c10d370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 -- 10.20.193.28:0/803068687 >> 10.20.193.28:0/803068687 conn(0x7f469c05f830 msgr2=0x7f469c10ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 -- 10.20.193.28:0/803068687 shutdown_connections 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.436+0000 7f46a0a0f640 1 -- 10.20.193.28:0/803068687 wait complete. 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f46a0a0f640 1 Processor -- start 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f46a0a0f640 1 -- start start 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f46a0a0f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f469c10cfa0 0x7f469c0f54f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f46a0a0f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f469c10d990 0x7f469c173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f46a0a0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 0x7f469c0f5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:22.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f46a0a0f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f469c0fadb0 con 0x7f469c113190 2026-02-20T13:16:22.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f46a0a0f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f469c0faf20 con 0x7f469c10d990 2026-02-20T13:16:22.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f46a0a0f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f469c0fb0e0 con 0x7f469c10cfa0 2026-02-20T13:16:22.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f4699d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f469c10d990 0x7f469c173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:22.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f469ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 0x7f469c0f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:22.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f4699d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f469c10d990 0x7f469c173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55110/0 (socket says 10.20.193.28:55110) 2026-02-20T13:16:22.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f4699d74640 1 -- 10.20.193.28:0/445282205 learned_addr learned my addr 10.20.193.28:0/445282205 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:22.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f4699d74640 1 -- 10.20.193.28:0/445282205 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f469c10cfa0 msgr2=0x7f469c0f54f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:16:22.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f4699d74640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f469c10cfa0 0x7f469c0f54f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f4699d74640 1 -- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 msgr2=0x7f469c0f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f4699d74640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 0x7f469c0f5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f4699d74640 1 -- 10.20.193.28:0/445282205 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c00a650 con 0x7f469c10d990 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.437+0000 7f469ad76640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 0x7f469c0f5bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.438+0000 7f4699d74640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f469c10d990 0x7f469c173a60 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4684009480 tx=0x7f468400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.438+0000 7f46837fe640 1 -- 10.20.193.28:0/445282205 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f468400cd40 con 0x7f469c10d990 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.438+0000 7f46837fe640 1 -- 10.20.193.28:0/445282205 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4684004d30 con 0x7f469c10d990 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.438+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c0fb3c0 con 0x7f469c10d990 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.438+0000 7f46837fe640 1 -- 10.20.193.28:0/445282205 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46840106b0 con 0x7f469c10d990 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.438+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c0fb890 con 0x7f469c10d990 2026-02-20T13:16:22.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.438+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469c10e280 con 0x7f469c10d990 2026-02-20T13:16:22.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.440+0000 7f46837fe640 1 -- 10.20.193.28:0/445282205 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f468401f060 con 0x7f469c10d990 2026-02-20T13:16:22.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.442+0000 7f46837fe640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46740b56d0 0x7f46740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:22.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.442+0000 7f46837fe640 1 -- 10.20.193.28:0/445282205 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7f4684014070 con 0x7f469c10d990 2026-02-20T13:16:22.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.442+0000 7f469a575640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46740b56d0 0x7f46740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:22.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.443+0000 7f469a575640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46740b56d0 0x7f46740d5b80 secure :-1 s=READY pgs=147 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4690004740 tx=0x7f4690005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:22.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.443+0000 7f46837fe640 1 -- 10.20.193.28:0/445282205 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f46840a97b0 con 0x7f469c10d990 2026-02-20T13:16:22.491 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:16:22 trial034 podman[92012]: 2026-02-20 13:16:22.202937533 +0000 UTC m=+0.045847897 container init cd01bcf443d8ee253542d7a37e6aaebd6e1497a26b7cf1f175d3f093e0f3d33e (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.build-date=20260216, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e) 2026-02-20T13:16:22.491 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:16:22 trial034 podman[92012]: 2026-02-20 13:16:22.205122156 +0000 UTC m=+0.048032510 container start cd01bcf443d8ee253542d7a37e6aaebd6e1497a26b7cf1f175d3f093e0f3d33e (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e, io.buildah.version=1.41.3, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True) 2026-02-20T13:16:22.491 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:16:22 trial034 bash[92012]: cd01bcf443d8ee253542d7a37e6aaebd6e1497a26b7cf1f175d3f093e0f3d33e 2026-02-20T13:16:22.491 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:16:22 trial034 podman[92012]: 2026-02-20 13:16:22.167336629 +0000 UTC m=+0.010246993 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:16:22.491 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:16:22 trial034 systemd[1]: Started Ceph mds.e for dd845518-0e5d-11f1-9909-d404e6e7d460. 2026-02-20T13:16:22.492 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mds[92041]: -- 10.20.193.34:0/3515372074 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1917860 con 0x18eb400 2026-02-20T13:16:22.492 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:16:22 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e[92037]: starting mds.e at 2026-02-20T13:16:22.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.585+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f469c0fbb10 con 0x7f469c10d990 2026-02-20T13:16:22.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.586+0000 7f46837fe640 1 -- 10.20.193.28:0/445282205 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f46840ac960 con 0x7f469c10d990 2026-02-20T13:16:22.589 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:22.590 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":5,"btime":"2026-02-20T13:16:21:961343+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[]} 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 5 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46740b56d0 msgr2=0x7f46740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46740b56d0 0x7f46740d5b80 secure :-1 s=READY pgs=147 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4690004740 tx=0x7f4690005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f469c10d990 msgr2=0x7f469c173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f469c10d990 0x7f469c173a60 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4684009480 tx=0x7f468400ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 shutdown_connections 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46740b56d0 0x7f46740d5b80 unknown :-1 s=CLOSED pgs=147 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f469c113190 0x7f469c0f5bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f469c10d990 0x7f469c173a60 unknown :-1 s=CLOSED pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 --2- 10.20.193.28:0/445282205 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f469c10cfa0 0x7f469c0f54f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 >> 10.20.193.28:0/445282205 conn(0x7f469c05f830 msgr2=0x7f469c1110e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 shutdown_connections 2026-02-20T13:16:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:22.587+0000 7f46a0a0f640 1 -- 10.20.193.28:0/445282205 wait complete. 2026-02-20T13:16:22.615 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: Deploying daemon mds.e on trial034 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6836/3921516269,v1:10.20.193.28:6837/3921516269] up:boot 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: fsmap 4 up:standby 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:22.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:22 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:22.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:22.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: Deploying daemon mds.e on trial034 2026-02-20T13:16:22.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6836/3921516269,v1:10.20.193.28:6837/3921516269] up:boot 2026-02-20T13:16:22.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: fsmap 4 up:standby 2026-02-20T13:16:22.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-20T13:16:22.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:22.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:22.729 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:22 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: Deploying daemon mds.e on trial034 2026-02-20T13:16:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6836/3921516269,v1:10.20.193.28:6837/3921516269] up:boot 2026-02-20T13:16:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: fsmap 4 up:standby 2026-02-20T13:16:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-20T13:16:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:22.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:22.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:22.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:22 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:23.148 INFO:journalctl@ceph.mds.f.trial127.stdout:Feb 20 13:16:22 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-f[96630]: starting mds.f at 2026-02-20T13:16:23.848 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: Deploying daemon mds.f on trial127 2026-02-20T13:16:23.848 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/445282205' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6834/1117780356,v1:10.20.193.34:6835/1117780356] up:boot 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.127:6834/519312474,v1:10.20.193.127:6835/519312474] up:boot 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: fsmap 6 up:standby 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-20T13:16:23.849 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:23 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-20T13:16:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: Deploying daemon mds.f on trial127 2026-02-20T13:16:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/445282205' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6834/1117780356,v1:10.20.193.34:6835/1117780356] up:boot 2026-02-20T13:16:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.127:6834/519312474,v1:10.20.193.127:6835/519312474] up:boot 2026-02-20T13:16:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: fsmap 6 up:standby 2026-02-20T13:16:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-20T13:16:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:23 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-20T13:16:23.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: Deploying daemon mds.f on trial127 2026-02-20T13:16:23.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/445282205' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:23.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:23.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:23.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:23.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:23.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6834/1117780356,v1:10.20.193.34:6835/1117780356] up:boot 2026-02-20T13:16:23.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.127:6834/519312474,v1:10.20.193.127:6835/519312474] up:boot 2026-02-20T13:16:23.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: fsmap 6 up:standby 2026-02-20T13:16:23.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-20T13:16:23.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-20T13:16:23.980 INFO:journalctl@ceph.mds.c.trial127.stdout:Feb 20 13:16:23 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-c[96963]: starting mds.c at 2026-02-20T13:16:24.491 INFO:journalctl@ceph.mds.h.trial034.stdout:Feb 20 13:16:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-h[92374]: starting mds.h at 2026-02-20T13:16:24.695 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: Deploying daemon mds.c on trial127 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:24.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:24.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:24 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:24.883 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:24.892 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: Deploying daemon mds.c on trial127 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:24.893 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:24.894 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:24 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: Deploying daemon mds.c on trial127 2026-02-20T13:16:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:24.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:24.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:24.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:24.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:24.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:24.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:24 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:25.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 -- 10.20.193.28:0/1076356288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ba20 msgr2=0x7f0a7011a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:25.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 --2- 10.20.193.28:0/1076356288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ba20 0x7f0a7011a6c0 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=10819846581382694393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a64009950 tx=0x7f0a6402f190 comp rx=0 tx=0).stop 2026-02-20T13:16:25.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 -- 10.20.193.28:0/1076356288 shutdown_connections 2026-02-20T13:16:25.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 --2- 10.20.193.28:0/1076356288 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a70118720 0x7f0a70118ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 --2- 10.20.193.28:0/1076356288 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a7011ac00 0x7f0a7011b030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 --2- 10.20.193.28:0/1076356288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ba20 0x7f0a7011a6c0 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=10819846581382694393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 -- 10.20.193.28:0/1076356288 >> 10.20.193.28:0/1076356288 conn(0x7f0a700590e0 msgr2=0x7f0a700594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:25.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 -- 10.20.193.28:0/1076356288 shutdown_connections 2026-02-20T13:16:25.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.066+0000 7f0a751cd640 1 -- 10.20.193.28:0/1076356288 wait complete. 2026-02-20T13:16:25.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.067+0000 7f0a751cd640 1 Processor -- start 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.067+0000 7f0a751cd640 1 -- start start 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.067+0000 7f0a751cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a70118720 0x7f0a700ffe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.067+0000 7f0a751cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ac00 0x7f0a701003c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.067+0000 7f0a751cd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a7011ba20 0x7f0a70105790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.067+0000 7f0a751cd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a70105db0 con 0x7f0a7011ac00 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.067+0000 7f0a751cd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0a70105f20 con 0x7f0a70118720 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.068+0000 7f0a751cd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701060e0 con 0x7f0a7011ba20 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a7011ba20 0x7f0a70105790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ac00 0x7f0a701003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:25.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a7011ba20 0x7f0a70105790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56702/0 (socket says 10.20.193.28:56702) 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6f577640 1 -- 10.20.193.28:0/2748090446 learned_addr learned my addr 10.20.193.28:0/2748090446 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6ed76640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a70118720 0x7f0a700ffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6e575640 1 -- 10.20.193.28:0/2748090446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a7011ba20 msgr2=0x7f0a70105790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6e575640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a7011ba20 0x7f0a70105790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6e575640 1 -- 10.20.193.28:0/2748090446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a70118720 msgr2=0x7f0a700ffe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6e575640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a70118720 0x7f0a700ffe80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6e575640 1 -- 10.20.193.28:0/2748090446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a64009570 con 0x7f0a7011ac00 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a6e575640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ac00 0x7f0a701003c0 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a5800d700 tx=0x7f0a5800dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a4ffff640 1 -- 10.20.193.28:0/2748090446 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a58004500 con 0x7f0a7011ac00 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.069+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a701063c0 con 0x7f0a7011ac00 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.070+0000 7f0a4ffff640 1 -- 10.20.193.28:0/2748090446 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0a5800de30 con 0x7f0a7011ac00 2026-02-20T13:16:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.070+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a70106aa0 con 0x7f0a7011ac00 2026-02-20T13:16:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.070+0000 7f0a4ffff640 1 -- 10.20.193.28:0/2748090446 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a58004770 con 0x7f0a7011ac00 2026-02-20T13:16:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.070+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7005b520 con 0x7f0a7011ac00 2026-02-20T13:16:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.072+0000 7f0a4ffff640 1 -- 10.20.193.28:0/2748090446 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f0a580048d0 con 0x7f0a7011ac00 2026-02-20T13:16:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.074+0000 7f0a4ffff640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a440b56e0 0x7f0a440d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.074+0000 7f0a6ed76640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a440b56e0 0x7f0a440d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.074+0000 7f0a4ffff640 1 -- 10.20.193.28:0/2748090446 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7f0a580e63a0 con 0x7f0a7011ac00 2026-02-20T13:16:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.074+0000 7f0a4ffff640 1 -- 10.20.193.28:0/2748090446 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f0a580e6820 con 0x7f0a7011ac00 2026-02-20T13:16:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.075+0000 7f0a6ed76640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a440b56e0 0x7f0a440d5b90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a640023d0 tx=0x7f0a64031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:25.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.216+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a70106550 con 0x7f0a7011ac00 2026-02-20T13:16:25.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.216+0000 7f0a4ffff640 1 -- 10.20.193.28:0/2748090446 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+7216 (secure 0 0 0) 0x7f0a70106550 con 0x7f0a7011ac00 2026-02-20T13:16:25.220 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:25.220 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":7,"btime":"2026-02-20T13:16:24:569000+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2026-02-20T13:16:25.220 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 7 2026-02-20T13:16:25.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.218+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a440b56e0 msgr2=0x7f0a440d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:25.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.218+0000 7f0a751cd640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a440b56e0 0x7f0a440d5b90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a640023d0 tx=0x7f0a64031040 comp rx=0 tx=0).stop 2026-02-20T13:16:25.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.218+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ac00 msgr2=0x7f0a701003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:25.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.218+0000 7f0a751cd640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ac00 0x7f0a701003c0 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a5800d700 tx=0x7f0a5800dbd0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.219+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 shutdown_connections 2026-02-20T13:16:25.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.219+0000 7f0a751cd640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a440b56e0 0x7f0a440d5b90 unknown :-1 s=CLOSED pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.219+0000 7f0a751cd640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a7011ac00 0x7f0a701003c0 unknown :-1 s=CLOSED pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.219+0000 7f0a751cd640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a7011ba20 0x7f0a70105790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.219+0000 7f0a751cd640 1 --2- 10.20.193.28:0/2748090446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a70118720 0x7f0a700ffe80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:25.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.219+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 >> 10.20.193.28:0/2748090446 conn(0x7f0a700590e0 msgr2=0x7f0a700f56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:25.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.219+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 shutdown_connections 2026-02-20T13:16:25.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:25.219+0000 7f0a751cd640 1 -- 10.20.193.28:0/2748090446 wait complete. 2026-02-20T13:16:25.228 INFO:journalctl@ceph.mds.i.trial127.stdout:Feb 20 13:16:25 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-i[97304]: starting mds.i at 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: Deploying daemon mds.h on trial034 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: Deploying daemon mds.i on trial127 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.127:6836/2801639412,v1:10.20.193.127:6837/2801639412] up:boot 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] up:boot 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: fsmap 8 up:standby 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.836 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.836 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:25.836 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:25.836 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:25.836 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:25 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2748090446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: Deploying daemon mds.h on trial034 2026-02-20T13:16:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: Deploying daemon mds.i on trial127 2026-02-20T13:16:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.127:6836/2801639412,v1:10.20.193.127:6837/2801639412] up:boot 2026-02-20T13:16:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] up:boot 2026-02-20T13:16:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: fsmap 8 up:standby 2026-02-20T13:16:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-20T13:16:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-20T13:16:25.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:25.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:25.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:25.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:25 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2748090446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: Deploying daemon mds.h on trial034 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: Deploying daemon mds.i on trial127 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.127:6836/2801639412,v1:10.20.193.127:6837/2801639412] up:boot 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] up:boot 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: fsmap 8 up:standby 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:25.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:25.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:25.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:25.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:25 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2748090446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:26.100 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 systemd[1]: Starting Ceph mds.g for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:16:26.581 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 podman[100839]: 2026-02-20 13:16:26.237614547 +0000 UTC m=+0.029072672 container create 57a2c6d8dbc42ae381b17e2816e68b5d0d1ea78e5ddcaa67c9de4438b8e60249 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260219.125903, ceph=True, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, io.buildah.version=1.41.3) 2026-02-20T13:16:26.581 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 podman[100839]: 2026-02-20 13:16:26.283224728 +0000 UTC m=+0.074682873 container init 57a2c6d8dbc42ae381b17e2816e68b5d0d1ea78e5ddcaa67c9de4438b8e60249 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T13:16:26.581 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 podman[100839]: 2026-02-20 13:16:26.288255797 +0000 UTC m=+0.079713932 container start 57a2c6d8dbc42ae381b17e2816e68b5d0d1ea78e5ddcaa67c9de4438b8e60249 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260219.125903, ceph=True, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:16:26.581 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 bash[100839]: 57a2c6d8dbc42ae381b17e2816e68b5d0d1ea78e5ddcaa67c9de4438b8e60249 2026-02-20T13:16:26.581 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 podman[100839]: 2026-02-20 13:16:26.227444056 +0000 UTC m=+0.018902191 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:16:26.581 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 systemd[1]: Started Ceph mds.g for dd845518-0e5d-11f1-9909-d404e6e7d460. 2026-02-20T13:16:26.581 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mds[100859]: -- 10.20.193.28:0/4139982635 <== mon.0 v2:10.20.193.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x19481860 con 0x195b2000 2026-02-20T13:16:26.582 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:16:26 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g[100855]: starting mds.g at 2026-02-20T13:16:26.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: Deploying daemon mds.g on trial028 2026-02-20T13:16:26.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:26.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] up:boot 2026-02-20T13:16:26.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: fsmap 9 up:standby 2026-02-20T13:16:26.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-20T13:16:26.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:26.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:26.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:26 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: Deploying daemon mds.g on trial028 2026-02-20T13:16:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] up:boot 2026-02-20T13:16:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: fsmap 9 up:standby 2026-02-20T13:16:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-20T13:16:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:26.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:26.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:26 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: Deploying daemon mds.g on trial028 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] up:boot 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: fsmap 9 up:standby 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:26.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:26 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:27.324 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:27.511 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:27.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 -- 10.20.193.28:0/1408787024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10060f30 msgr2=0x7fcb10061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:27.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 --2- 10.20.193.28:0/1408787024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10060f30 0x7fcb10061300 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=6676135254519837871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcafc009950 tx=0x7fcafc02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:27.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 -- 10.20.193.28:0/1408787024 shutdown_connections 2026-02-20T13:16:27.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 --2- 10.20.193.28:0/1408787024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb10155980 0x7fcb10175d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 --2- 10.20.193.28:0/1408787024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb10061840 0x7fcb10155440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 --2- 10.20.193.28:0/1408787024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10060f30 0x7fcb10061300 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=6676135254519837871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 -- 10.20.193.28:0/1408787024 >> 10.20.193.28:0/1408787024 conn(0x7fcb100eaad0 msgr2=0x7fcb1010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:27.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 -- 10.20.193.28:0/1408787024 shutdown_connections 2026-02-20T13:16:27.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.688+0000 7fcb15151640 1 -- 10.20.193.28:0/1408787024 wait complete. 2026-02-20T13:16:27.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb15151640 1 Processor -- start 2026-02-20T13:16:27.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb15151640 1 -- start start 2026-02-20T13:16:27.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb15151640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb10060f30 0x7fcb10162120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:27.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb15151640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb10061840 0x7fcb10162660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:27.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb15151640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10155980 0x7fcb10167a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:27.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb15151640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcb10168050 con 0x7fcb10155980 2026-02-20T13:16:27.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb15151640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101681c0 con 0x7fcb10060f30 2026-02-20T13:16:27.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb15151640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcb10168380 con 0x7fcb10061840 2026-02-20T13:16:27.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb14950640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10155980 0x7fcb10167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:27.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb0ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb10060f30 0x7fcb10162120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:27.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.689+0000 7fcb0f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb10061840 0x7fcb10162660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:27.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb0ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb10060f30 0x7fcb10162120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55166/0 (socket says 10.20.193.28:55166) 2026-02-20T13:16:27.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb0f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb10061840 0x7fcb10162660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56756/0 (socket says 10.20.193.28:56756) 2026-02-20T13:16:27.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb0f7fe640 1 -- 10.20.193.28:0/3425724973 learned_addr learned my addr 10.20.193.28:0/3425724973 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:27.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb14950640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10155980 0x7fcb10167a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60750/0 (socket says 10.20.193.28:60750) 2026-02-20T13:16:27.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb14950640 1 -- 10.20.193.28:0/3425724973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb10061840 msgr2=0x7fcb10162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:27.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb14950640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb10061840 0x7fcb10162660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb14950640 1 -- 10.20.193.28:0/3425724973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb10060f30 msgr2=0x7fcb10162120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:27.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb14950640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb10060f30 0x7fcb10162120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb14950640 1 -- 10.20.193.28:0/3425724973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc009570 con 0x7fcb10155980 2026-02-20T13:16:27.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb14950640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10155980 0x7fcb10167a30 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb0400f940 tx=0x7fcb0400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:27.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb0d7fa640 1 -- 10.20.193.28:0/3425724973 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb0400dce0 con 0x7fcb10155980 2026-02-20T13:16:27.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb0d7fa640 1 -- 10.20.193.28:0/3425724973 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcb0400de40 con 0x7fcb10155980 2026-02-20T13:16:27.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb10168660 con 0x7fcb10155980 2026-02-20T13:16:27.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb0d7fa640 1 -- 10.20.193.28:0/3425724973 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb040116b0 con 0x7fcb10155980 2026-02-20T13:16:27.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.690+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb101515a0 con 0x7fcb10155980 2026-02-20T13:16:27.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.691+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad4005300 con 0x7fcb10155980 2026-02-20T13:16:27.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.693+0000 7fcb0d7fa640 1 -- 10.20.193.28:0/3425724973 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7fcb04020060 con 0x7fcb10155980 2026-02-20T13:16:27.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.694+0000 7fcb0d7fa640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcae40b5760 0x7fcae40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:27.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.694+0000 7fcb0d7fa640 1 -- 10.20.193.28:0/3425724973 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7fcb04015070 con 0x7fcb10155980 2026-02-20T13:16:27.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.695+0000 7fcb0ffff640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcae40b5760 0x7fcae40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:27.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.695+0000 7fcb0d7fa640 1 -- 10.20.193.28:0/3425724973 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fcb040e7b60 con 0x7fcb10155980 2026-02-20T13:16:27.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.695+0000 7fcb0ffff640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcae40b5760 0x7fcae40d5c10 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcafc0098a0 tx=0x7fcafc03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:27.838 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:27 trial028 ceph-mon[37442]: Deploying daemon mds.a on trial028 2026-02-20T13:16:27.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:27 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] up:boot 2026-02-20T13:16:27.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:27 trial028 ceph-mon[37442]: fsmap 10 up:standby 2026-02-20T13:16:27.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:27 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-20T13:16:27.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.835+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcad4005950 con 0x7fcb10155980 2026-02-20T13:16:27.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.836+0000 7fcb0d7fa640 1 -- 10.20.193.28:0/3425724973 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+8869 (secure 0 0 0) 0x7fcb040aa710 con 0x7fcb10155980 2026-02-20T13:16:27.839 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:27.839 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":9,"btime":"2026-02-20T13:16:27:055876+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24677,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 9 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcae40b5760 msgr2=0x7fcae40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcae40b5760 0x7fcae40d5c10 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcafc0098a0 tx=0x7fcafc03a040 comp rx=0 tx=0).stop 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10155980 msgr2=0x7fcb10167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10155980 0x7fcb10167a30 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb0400f940 tx=0x7fcb0400fe10 comp rx=0 tx=0).stop 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 shutdown_connections 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcae40b5760 0x7fcae40d5c10 unknown :-1 s=CLOSED pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb10155980 0x7fcb10167a30 unknown :-1 s=CLOSED pgs=193 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb10061840 0x7fcb10162660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 --2- 10.20.193.28:0/3425724973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb10060f30 0x7fcb10162120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 >> 10.20.193.28:0/3425724973 conn(0x7fcb100eaad0 msgr2=0x7fcb1010aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 shutdown_connections 2026-02-20T13:16:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:27.837+0000 7fcb15151640 1 -- 10.20.193.28:0/3425724973 wait complete. 2026-02-20T13:16:27.864 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:27 trial034 ceph-mon[43332]: Deploying daemon mds.a on trial028 2026-02-20T13:16:27.864 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:27 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] up:boot 2026-02-20T13:16:27.864 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:27 trial034 ceph-mon[43332]: fsmap 10 up:standby 2026-02-20T13:16:27.864 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:27 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-20T13:16:27.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:27 trial127 ceph-mon[43817]: Deploying daemon mds.a on trial028 2026-02-20T13:16:27.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:27 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] up:boot 2026-02-20T13:16:27.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:27 trial127 ceph-mon[43817]: fsmap 10 up:standby 2026-02-20T13:16:27.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:27 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-20T13:16:28.491 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: starting mds.b at 2026-02-20T13:16:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3425724973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:28 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:28.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:28.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3425724973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:28.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:28 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3425724973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:28.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:28 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: Deploying daemon mds.b on trial034 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6840/12920569,v1:10.20.193.28:6841/12920569] up:boot 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] up:boot 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: fsmap 12 up:standby 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:29 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:29.864 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: Deploying daemon mds.b on trial034 2026-02-20T13:16:29.864 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6840/12920569,v1:10.20.193.28:6841/12920569] up:boot 2026-02-20T13:16:29.864 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] up:boot 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: fsmap 12 up:standby 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:29.865 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.866 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:29 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:29.867 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: Deploying daemon mds.b on trial034 2026-02-20T13:16:29.867 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6840/12920569,v1:10.20.193.28:6841/12920569] up:boot 2026-02-20T13:16:29.867 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] up:boot 2026-02-20T13:16:29.867 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: fsmap 12 up:standby 2026-02-20T13:16:29.867 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-20T13:16:29.867 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-20T13:16:29.867 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:29.868 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:29 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:29.940 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:30.127 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:30.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 -- 10.20.193.28:0/2941824486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 msgr2=0x7fdb6010bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:30.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 --2- 10.20.193.28:0/2941824486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 0x7fdb6010bdc0 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=13038855159590236680 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb50009950 tx=0x7fdb5002f190 comp rx=0 tx=0).stop 2026-02-20T13:16:30.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 -- 10.20.193.28:0/2941824486 shutdown_connections 2026-02-20T13:16:30.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 --2- 10.20.193.28:0/2941824486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb60155720 0x7fdb60175b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 --2- 10.20.193.28:0/2941824486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb6010c300 0x7fdb601551e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 --2- 10.20.193.28:0/2941824486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 0x7fdb6010bdc0 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=13038855159590236680 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 -- 10.20.193.28:0/2941824486 >> 10.20.193.28:0/2941824486 conn(0x7fdb600e96f0 msgr2=0x7fdb60109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:30.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 -- 10.20.193.28:0/2941824486 shutdown_connections 2026-02-20T13:16:30.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.310+0000 7fdb66029640 1 -- 10.20.193.28:0/2941824486 wait complete. 2026-02-20T13:16:30.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb66029640 1 Processor -- start 2026-02-20T13:16:30.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb66029640 1 -- start start 2026-02-20T13:16:30.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb66029640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 0x7fdb60160de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:30.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb66029640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6010c300 0x7fdb60161320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb66029640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb60155720 0x7fdb601666f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb66029640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60166d10 con 0x7fdb6010b9f0 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb66029640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60166e80 con 0x7fdb60155720 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb66029640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60167040 con 0x7fdb6010c300 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb64826640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6010c300 0x7fdb60161320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb64826640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6010c300 0x7fdb60161320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52906/0 (socket says 10.20.193.28:52906) 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb64826640 1 -- 10.20.193.28:0/2783204878 learned_addr learned my addr 10.20.193.28:0/2783204878 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.311+0000 7fdb65828640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb60155720 0x7fdb601666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb65027640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 0x7fdb60160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb65828640 1 -- 10.20.193.28:0/2783204878 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6010c300 msgr2=0x7fdb60161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb65828640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6010c300 0x7fdb60161320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb65828640 1 -- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 msgr2=0x7fdb60160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb65828640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 0x7fdb60160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb65828640 1 -- 10.20.193.28:0/2783204878 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb50009570 con 0x7fdb60155720 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb65027640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 0x7fdb60160de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb64826640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6010c300 0x7fdb60161320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb65828640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb60155720 0x7fdb601666f0 secure :-1 s=READY pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb5c005820 tx=0x7fdb5c00ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb4e7fc640 1 -- 10.20.193.28:0/2783204878 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb5c005500 con 0x7fdb60155720 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb4e7fc640 1 -- 10.20.193.28:0/2783204878 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb5c005660 con 0x7fdb60155720 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb60167320 con 0x7fdb60155720 2026-02-20T13:16:30.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb4e7fc640 1 -- 10.20.193.28:0/2783204878 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb5c011460 con 0x7fdb60155720 2026-02-20T13:16:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.312+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb60152350 con 0x7fdb60155720 2026-02-20T13:16:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.313+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb60167540 con 0x7fdb60155720 2026-02-20T13:16:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.315+0000 7fdb4e7fc640 1 -- 10.20.193.28:0/2783204878 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7fdb5c00c7e0 con 0x7fdb60155720 2026-02-20T13:16:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.316+0000 7fdb4e7fc640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb3c0b5760 0x7fdb3c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.316+0000 7fdb4e7fc640 1 -- 10.20.193.28:0/2783204878 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7fdb5c0e7660 con 0x7fdb60155720 2026-02-20T13:16:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.316+0000 7fdb65027640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb3c0b5760 0x7fdb3c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.317+0000 7fdb65027640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb3c0b5760 0x7fdb3c0d5c10 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb500098a0 tx=0x7fdb50031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.317+0000 7fdb4e7fc640 1 -- 10.20.193.28:0/2783204878 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fdb5c0aa470 con 0x7fdb60155720 2026-02-20T13:16:30.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.459+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb60161f40 con 0x7fdb60155720 2026-02-20T13:16:30.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.460+0000 7fdb4e7fc640 1 -- 10.20.193.28:0/2783204878 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+10516 (secure 0 0 0) 0x7fdb5c0ad620 con 0x7fdb60155720 2026-02-20T13:16:30.464 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:30.464 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":10,"btime":"2026-02-20T13:16:28:580306+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24677,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2026-02-20T13:16:30.464 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 10 2026-02-20T13:16:30.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb3c0b5760 msgr2=0x7fdb3c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:30.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb3c0b5760 0x7fdb3c0d5c10 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb500098a0 tx=0x7fdb50031040 comp rx=0 tx=0).stop 2026-02-20T13:16:30.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb60155720 msgr2=0x7fdb601666f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb60155720 0x7fdb601666f0 secure :-1 s=READY pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb5c005820 tx=0x7fdb5c00ebc0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 shutdown_connections 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb3c0b5760 0x7fdb3c0d5c10 unknown :-1 s=CLOSED pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb60155720 0x7fdb601666f0 unknown :-1 s=CLOSED pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6010c300 0x7fdb60161320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 --2- 10.20.193.28:0/2783204878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6010b9f0 0x7fdb60160de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 >> 10.20.193.28:0/2783204878 conn(0x7fdb600e96f0 msgr2=0x7fdb60109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 shutdown_connections 2026-02-20T13:16:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.462+0000 7fdb66029640 1 -- 10.20.193.28:0/2783204878 wait complete. 2026-02-20T13:16:30.568 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-20T13:16:30.751 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:30.796 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:30 trial028 ceph-mon[37442]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:30.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:30.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:30 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:30 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2783204878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 -- 10.20.193.28:0/2620935934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5928111160 msgr2=0x7f5928111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 --2- 10.20.193.28:0/2620935934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5928111160 0x7f5928111b40 secure :-1 s=READY pgs=195 gs=2 cs=0 l=1 c_cookie=3803082424318730714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f592400a970 tx=0x7f59240301b0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 -- 10.20.193.28:0/2620935934 shutdown_connections 2026-02-20T13:16:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 --2- 10.20.193.28:0/2620935934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5928111160 0x7f5928111b40 unknown :-1 s=CLOSED pgs=195 gs=2 cs=0 l=1 c_cookie=3803082424318730714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 --2- 10.20.193.28:0/2620935934 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f592810bb40 0x7f59281109d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 --2- 10.20.193.28:0/2620935934 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f592810b150 0x7f592810b520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 -- 10.20.193.28:0/2620935934 >> 10.20.193.28:0/2620935934 conn(0x7f59280e8ce0 msgr2=0x7f59281090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 -- 10.20.193.28:0/2620935934 shutdown_connections 2026-02-20T13:16:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.931+0000 7f592d8e0640 1 -- 10.20.193.28:0/2620935934 wait complete. 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.932+0000 7f592d8e0640 1 Processor -- start 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.932+0000 7f592d8e0640 1 -- start start 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592d8e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592810b150 0x7f5928123340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592d8e0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f592810bb40 0x7f5928123880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592d8e0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5928111160 0x7f5928128c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592d8e0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5928129270 con 0x7f592810b150 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592d8e0640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f59281293e0 con 0x7f5928111160 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592d8e0640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f59281295a0 con 0x7f592810bb40 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592c8de640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592810b150 0x7f5928123340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592c8de640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592810b150 0x7f5928123340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41464/0 (socket says 10.20.193.28:41464) 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592c8de640 1 -- 10.20.193.28:0/610177053 learned_addr learned my addr 10.20.193.28:0/610177053 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592d0df640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5928111160 0x7f5928128c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f591ffff640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f592810bb40 0x7f5928123880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592c8de640 1 -- 10.20.193.28:0/610177053 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f592810bb40 msgr2=0x7f5928123880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592c8de640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f592810bb40 0x7f5928123880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592c8de640 1 -- 10.20.193.28:0/610177053 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5928111160 msgr2=0x7f5928128c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:30.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592c8de640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5928111160 0x7f5928128c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f592c8de640 1 -- 10.20.193.28:0/610177053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592400a590 con 0x7f592810b150 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.933+0000 7f591ffff640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f592810bb40 0x7f5928123880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.934+0000 7f592c8de640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592810b150 0x7f5928123340 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5918009480 tx=0x7f591800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.934+0000 7f591dffb640 1 -- 10.20.193.28:0/610177053 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f591800ccc0 con 0x7f592810b150 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.934+0000 7f591dffb640 1 -- 10.20.193.28:0/610177053 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f591800ce20 con 0x7f592810b150 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.934+0000 7f591dffb640 1 -- 10.20.193.28:0/610177053 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59180106b0 con 0x7f592810b150 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.934+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5928129880 con 0x7f592810b150 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.934+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5928169f80 con 0x7f592810b150 2026-02-20T13:16:30.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.936+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5928129aa0 con 0x7f592810b150 2026-02-20T13:16:30.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.936+0000 7f591dffb640 1 -- 10.20.193.28:0/610177053 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f591801f060 con 0x7f592810b150 2026-02-20T13:16:30.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.938+0000 7f591dffb640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59040b5760 0x7f59040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:30.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.938+0000 7f591dffb640 1 -- 10.20.193.28:0/610177053 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7f5918014070 con 0x7f592810b150 2026-02-20T13:16:30.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.938+0000 7f591ffff640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59040b5760 0x7f59040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:30.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.938+0000 7f591ffff640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59040b5760 0x7f59040d5c10 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5928129ce0 tx=0x7f5910009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:30.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:30.939+0000 7f591dffb640 1 -- 10.20.193.28:0/610177053 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f59180a9590 con 0x7f592810b150 2026-02-20T13:16:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:30 trial127 ceph-mon[43817]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:30 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:30 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2783204878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:30 trial034 ceph-mon[43332]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:30.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:16:30.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:30 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:30.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:30 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2783204878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:31.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.056+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f59281109d0 con 0x7f592810b150 2026-02-20T13:16:31.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.057+0000 7f591dffb640 1 -- 10.20.193.28:0/610177053 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f59180ac740 con 0x7f592810b150 2026-02-20T13:16:31.060 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:31.060 INFO:teuthology.orchestra.run.trial028.stdout:[ 2026-02-20T13:16:31.060 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:16:31.060 INFO:teuthology.orchestra.run.trial028.stdout: "poolnum": 1, 2026-02-20T13:16:31.060 INFO:teuthology.orchestra.run.trial028.stdout: "poolname": ".mgr" 2026-02-20T13:16:31.061 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:16:31.061 INFO:teuthology.orchestra.run.trial028.stdout:] 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59040b5760 msgr2=0x7f59040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59040b5760 0x7f59040d5c10 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5928129ce0 tx=0x7f5910009310 comp rx=0 tx=0).stop 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592810b150 msgr2=0x7f5928123340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592810b150 0x7f5928123340 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5918009480 tx=0x7f591800ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 shutdown_connections 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59040b5760 0x7f59040d5c10 unknown :-1 s=CLOSED pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5928111160 0x7f5928128c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f592810bb40 0x7f5928123880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 --2- 10.20.193.28:0/610177053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592810b150 0x7f5928123340 unknown :-1 s=CLOSED pgs=196 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 >> 10.20.193.28:0/610177053 conn(0x7f59280e8ce0 msgr2=0x7f59281090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:31.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 shutdown_connections 2026-02-20T13:16:31.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.058+0000 7f592d8e0640 1 -- 10.20.193.28:0/610177053 wait complete. 2026-02-20T13:16:31.159 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-20T13:16:31.159 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-20T13:16:31.345 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.539+0000 7fb1cffff640 1 -- 10.20.193.28:0/3824802576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1d010d240 msgr2=0x7fb1d010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.539+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3824802576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1d010d240 0x7fb1d010d610 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=16894553007176044768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1c4009950 tx=0x7fb1c402f190 comp rx=0 tx=0).stop 2026-02-20T13:16:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.539+0000 7fb1cffff640 1 -- 10.20.193.28:0/3824802576 shutdown_connections 2026-02-20T13:16:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.539+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3824802576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1d0113430 0x7fb1d0173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.539+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3824802576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1d010dc30 0x7fb1d0112c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.539+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3824802576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1d010d240 0x7fb1d010d610 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=16894553007176044768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.539+0000 7fb1cffff640 1 -- 10.20.193.28:0/3824802576 >> 10.20.193.28:0/3824802576 conn(0x7fb1d00eaad0 msgr2=0x7fb1d010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:31.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.539+0000 7fb1cffff640 1 -- 10.20.193.28:0/3824802576 shutdown_connections 2026-02-20T13:16:31.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.540+0000 7fb1cffff640 1 -- 10.20.193.28:0/3824802576 wait complete. 2026-02-20T13:16:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cffff640 1 Processor -- start 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cffff640 1 -- start start 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1d010d240 0x7fb1d00f5810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1d010dc30 0x7fb1d0173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1d0113430 0x7fb1d00f5f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d00fb120 con 0x7fb1d0113430 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cffff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d00fb290 con 0x7fb1d010dc30 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cffff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d00fb450 con 0x7fb1d010d240 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1ceffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1d010d240 0x7fb1d00f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1ceffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1d010d240 0x7fb1d00f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52942/0 (socket says 10.20.193.28:52942) 2026-02-20T13:16:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1cf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1d0113430 0x7fb1d00f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.541+0000 7fb1ceffd640 1 -- 10.20.193.28:0/3658472904 learned_addr learned my addr 10.20.193.28:0/3658472904 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1ce7fc640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1d010dc30 0x7fb1d0173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1ceffd640 1 -- 10.20.193.28:0/3658472904 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1d010dc30 msgr2=0x7fb1d0173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1ceffd640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1d010dc30 0x7fb1d0173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1ceffd640 1 -- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1d0113430 msgr2=0x7fb1d00f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1ceffd640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1d0113430 0x7fb1d00f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1ceffd640 1 -- 10.20.193.28:0/3658472904 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c4009570 con 0x7fb1d010d240 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1ceffd640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1d010d240 0x7fb1d00f5810 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1c4005b30 tx=0x7fb1c4004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1d4816640 1 -- 10.20.193.28:0/3658472904 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1c403d070 con 0x7fb1d010d240 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1d4816640 1 -- 10.20.193.28:0/3658472904 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb1c4038920 con 0x7fb1d010d240 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d00fb6d0 con 0x7fb1d010d240 2026-02-20T13:16:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d00fbb40 con 0x7fb1d010d240 2026-02-20T13:16:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.542+0000 7fb1d4816640 1 -- 10.20.193.28:0/3658472904 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1c40418a0 con 0x7fb1d010d240 2026-02-20T13:16:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.543+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d010e520 con 0x7fb1d010d240 2026-02-20T13:16:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.545+0000 7fb1d4816640 1 -- 10.20.193.28:0/3658472904 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7fb1c4048020 con 0x7fb1d010d240 2026-02-20T13:16:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.547+0000 7fb1d4816640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.547+0000 7fb1d4816640 1 -- 10.20.193.28:0/3658472904 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7119+0+0 (secure 0 0 0) 0x7fb1c410ae80 con 0x7fb1d010d240 2026-02-20T13:16:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.547+0000 7fb1d4816640 1 -- 10.20.193.28:0/3658472904 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fb1c410b300 con 0x7fb1d010d240 2026-02-20T13:16:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.547+0000 7fb1ce7fc640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.548+0000 7fb1ce7fc640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1d00fc1b0 tx=0x7fb1b8004340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:31.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.661+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb1d010d640 con 0x7fb1d010d240 2026-02-20T13:16:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.758+0000 7fb1d4816640 1 -- 10.20.193.28:0/3658472904 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7fb1c40cdc90 con 0x7fb1d010d240 2026-02-20T13:16:31.761 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_metadata' created 2026-02-20T13:16:31.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.760+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1a40b56d0 msgr2=0x7fb1a40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.760+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1d00fc1b0 tx=0x7fb1b8004340 comp rx=0 tx=0).stop 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.760+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1d010d240 msgr2=0x7fb1d00f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.760+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1d010d240 0x7fb1d00f5810 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1c4005b30 tx=0x7fb1c4004340 comp rx=0 tx=0).stop 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.761+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 shutdown_connections 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.761+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 unknown :-1 s=CLOSED pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.761+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1d0113430 0x7fb1d00f5f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.761+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1d010dc30 0x7fb1d0173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.761+0000 7fb1cffff640 1 --2- 10.20.193.28:0/3658472904 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1d010d240 0x7fb1d00f5810 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.761+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 >> 10.20.193.28:0/3658472904 conn(0x7fb1d00eaad0 msgr2=0x7fb1d0110430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.761+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 shutdown_connections 2026-02-20T13:16:31.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:31.761+0000 7fb1cffff640 1 -- 10.20.193.28:0/3658472904 wait complete. 2026-02-20T13:16:31.866 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/610177053' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:31.917 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-20T13:16:31.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:31 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3658472904' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-20T13:16:32.051 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:32.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:32.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:32.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:32.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:32.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:32.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:32.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/610177053' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-20T13:16:32.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:32.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-20T13:16:32.229 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:31 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3658472904' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-20T13:16:32.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.224+0000 7f0207fff640 1 -- 10.20.193.28:0/2511646046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f020810f430 msgr2=0x7f020810f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:32.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.224+0000 7f0207fff640 1 --2- 10.20.193.28:0/2511646046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f020810f430 0x7f020810f800 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=13604719802400026440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01fc009950 tx=0x7f01fc02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:32.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.224+0000 7f0207fff640 1 -- 10.20.193.28:0/2511646046 shutdown_connections 2026-02-20T13:16:32.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.224+0000 7f0207fff640 1 --2- 10.20.193.28:0/2511646046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0208115620 0x7f0208175ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.224+0000 7f0207fff640 1 --2- 10.20.193.28:0/2511646046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f020810fe20 0x7f0208114e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.224+0000 7f0207fff640 1 --2- 10.20.193.28:0/2511646046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f020810f430 0x7f020810f800 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=13604719802400026440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.224+0000 7f0207fff640 1 -- 10.20.193.28:0/2511646046 >> 10.20.193.28:0/2511646046 conn(0x7f02080ecd20 msgr2=0x7f020810d130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.225+0000 7f0207fff640 1 -- 10.20.193.28:0/2511646046 shutdown_connections 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.225+0000 7f0207fff640 1 -- 10.20.193.28:0/2511646046 wait complete. 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.225+0000 7f0207fff640 1 Processor -- start 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.225+0000 7f0207fff640 1 -- start start 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0207fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f020810f430 0x7f020811d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0207fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f020810fe20 0x7f020811d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0207fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0208115620 0x7f0208122c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0207fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0208123270 con 0x7f0208115620 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0207fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f02081233e0 con 0x7f020810fe20 2026-02-20T13:16:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0207fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f02081235a0 con 0x7f020810f430 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0206ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f020810f430 0x7f020811d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0206ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f020810f430 0x7f020811d390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52972/0 (socket says 10.20.193.28:52972) 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0206ffd640 1 -- 10.20.193.28:0/631530516 learned_addr learned my addr 10.20.193.28:0/631530516 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f02077fe640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0208115620 0x7f0208122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f02067fc640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f020810fe20 0x7f020811d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0206ffd640 1 -- 10.20.193.28:0/631530516 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f020810fe20 msgr2=0x7f020811d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0206ffd640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f020810fe20 0x7f020811d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0206ffd640 1 -- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0208115620 msgr2=0x7f0208122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0206ffd640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0208115620 0x7f0208122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.226+0000 7f0206ffd640 1 -- 10.20.193.28:0/631530516 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc009570 con 0x7f020810f430 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.227+0000 7f0206ffd640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f020810f430 0x7f020811d390 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01fc0023d0 tx=0x7f01fc004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.227+0000 7f01e7fff640 1 -- 10.20.193.28:0/631530516 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01fc03d070 con 0x7f020810f430 2026-02-20T13:16:32.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.227+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0208123820 con 0x7f020810f430 2026-02-20T13:16:32.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.227+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0208163f80 con 0x7f020810f430 2026-02-20T13:16:32.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.227+0000 7f01e7fff640 1 -- 10.20.193.28:0/631530516 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f01fc002ad0 con 0x7f020810f430 2026-02-20T13:16:32.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.227+0000 7f01e7fff640 1 -- 10.20.193.28:0/631530516 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01fc041820 con 0x7f020810f430 2026-02-20T13:16:32.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.227+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f020805f650 con 0x7f020810f430 2026-02-20T13:16:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.230+0000 7f01e7fff640 1 -- 10.20.193.28:0/631530516 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f01fc02f9f0 con 0x7f020810f430 2026-02-20T13:16:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.232+0000 7f01e7fff640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01dc0b5760 0x7f01dc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.232+0000 7f01e7fff640 1 -- 10.20.193.28:0/631530516 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7492+0+0 (secure 0 0 0) 0x7f01fc10b330 con 0x7f020810f430 2026-02-20T13:16:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.232+0000 7f02067fc640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01dc0b5760 0x7f01dc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.232+0000 7f01e7fff640 1 -- 10.20.193.28:0/631530516 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f01fc10b7b0 con 0x7f020810f430 2026-02-20T13:16:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.232+0000 7f02067fc640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01dc0b5760 0x7f01dc0d5c10 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0208123ce0 tx=0x7f01f0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:32.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/610177053' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-20T13:16:32.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:31 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3658472904' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-20T13:16:32.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.346+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f020811e4a0 con 0x7f020810f430 2026-02-20T13:16:32.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.762+0000 7f01e7fff640 1 -- 10.20.193.28:0/631530516 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7f01fc0cdfc0 con 0x7f020810f430 2026-02-20T13:16:32.766 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data' created 2026-02-20T13:16:32.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01dc0b5760 msgr2=0x7f01dc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:32.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01dc0b5760 0x7f01dc0d5c10 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0208123ce0 tx=0x7f01f0005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:32.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f020810f430 msgr2=0x7f020811d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:32.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f020810f430 0x7f020811d390 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01fc0023d0 tx=0x7f01fc004290 comp rx=0 tx=0).stop 2026-02-20T13:16:32.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 shutdown_connections 2026-02-20T13:16:32.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01dc0b5760 0x7f01dc0d5c10 unknown :-1 s=CLOSED pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0208115620 0x7f0208122c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f020810fe20 0x7f020811d8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 --2- 10.20.193.28:0/631530516 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f020810f430 0x7f020811d390 unknown :-1 s=CLOSED pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:32.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.767+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 >> 10.20.193.28:0/631530516 conn(0x7f02080ecd20 msgr2=0x7f020810d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:32.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.768+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 shutdown_connections 2026-02-20T13:16:32.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:32.768+0000 7f0207fff640 1 -- 10.20.193.28:0/631530516 wait complete. 2026-02-20T13:16:32.872 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-20T13:16:33.056 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:33.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:32 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-20T13:16:33.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:32 trial028 ceph-mon[37442]: osdmap e75: 12 total, 12 up, 12 in 2026-02-20T13:16:33.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:32 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-20T13:16:33.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:32 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/631530516' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-20T13:16:33.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:33.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:32 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-20T13:16:33.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:32 trial127 ceph-mon[43817]: osdmap e75: 12 total, 12 up, 12 in 2026-02-20T13:16:33.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:32 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-20T13:16:33.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:32 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/631530516' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-20T13:16:33.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:33.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 -- 10.20.193.28:0/660884836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10f5f0 msgr2=0x7f1b6c10f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:33.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 --2- 10.20.193.28:0/660884836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10f5f0 0x7f1b6c10f9c0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=9051058335676002112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b5c009950 tx=0x7f1b5c02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:33.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 -- 10.20.193.28:0/660884836 shutdown_connections 2026-02-20T13:16:33.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 --2- 10.20.193.28:0/660884836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b6c1157e0 0x7f1b6c1761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 --2- 10.20.193.28:0/660884836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6c10ffe0 0x7f1b6c115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 --2- 10.20.193.28:0/660884836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10f5f0 0x7f1b6c10f9c0 unknown :-1 s=CLOSED pgs=199 gs=1 cs=0 l=1 c_cookie=9051058335676002112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 -- 10.20.193.28:0/660884836 >> 10.20.193.28:0/660884836 conn(0x7f1b6c0ecea0 msgr2=0x7f1b6c10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:33.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 -- 10.20.193.28:0/660884836 shutdown_connections 2026-02-20T13:16:33.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.232+0000 7f1b739fe640 1 -- 10.20.193.28:0/660884836 wait complete. 2026-02-20T13:16:33.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.233+0000 7f1b739fe640 1 Processor -- start 2026-02-20T13:16:33.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.233+0000 7f1b739fe640 1 -- start start 2026-02-20T13:16:33.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.233+0000 7f1b739fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b6c10f5f0 0x7f1b6c11d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:33.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.233+0000 7f1b739fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10ffe0 0x7f1b6c11da10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:33.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.233+0000 7f1b739fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6c1157e0 0x7f1b6c122de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:33.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.233+0000 7f1b739fe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c123400 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.233+0000 7f1b739fe640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c123570 con 0x7f1b6c10f5f0 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.233+0000 7f1b739fe640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c123730 con 0x7f1b6c1157e0 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10ffe0 0x7f1b6c11da10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b71773640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b6c10f5f0 0x7f1b6c11d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10ffe0 0x7f1b6c11da10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41506/0 (socket says 10.20.193.28:41506) 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 -- 10.20.193.28:0/226585012 learned_addr learned my addr 10.20.193.28:0/226585012 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b71f74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6c1157e0 0x7f1b6c122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 -- 10.20.193.28:0/226585012 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6c1157e0 msgr2=0x7f1b6c122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6c1157e0 0x7f1b6c122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 -- 10.20.193.28:0/226585012 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b6c10f5f0 msgr2=0x7f1b6c11d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b6c10f5f0 0x7f1b6c11d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 -- 10.20.193.28:0/226585012 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c009570 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b70f72640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10ffe0 0x7f1b6c11da10 secure :-1 s=READY pgs=200 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60005db0 tx=0x7f1b6000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:33.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b5a7fc640 1 -- 10.20.193.28:0/226585012 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b60004500 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6c123a10 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b5a7fc640 1 -- 10.20.193.28:0/226585012 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b60004d30 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b5a7fc640 1 -- 10.20.193.28:0/226585012 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b600053c0 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.234+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6c164110 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.235+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6c1108d0 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:32 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-20T13:16:33.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:32 trial034 ceph-mon[43332]: osdmap e75: 12 total, 12 up, 12 in 2026-02-20T13:16:33.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:32 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-20T13:16:33.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:32 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/631530516' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-20T13:16:33.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:16:33.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.237+0000 7f1b5a7fc640 1 -- 10.20.193.28:0/226585012 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f1b60020020 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.239+0000 7f1b5a7fc640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b480b57e0 0x7f1b480d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:33.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.239+0000 7f1b5a7fc640 1 -- 10.20.193.28:0/226585012 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7877+0+0 (secure 0 0 0) 0x7f1b600e6870 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.239+0000 7f1b71773640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b480b57e0 0x7f1b480d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:33.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.239+0000 7f1b5a7fc640 1 -- 10.20.193.28:0/226585012 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f1b600a9380 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.240+0000 7f1b71773640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b480b57e0 0x7f1b480d5c90 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b5c005b30 tx=0x7f1b5c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:33.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.379+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1b6c10f9c0 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.763+0000 7f1b5a7fc640 1 -- 10.20.193.28:0/226585012 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v11) ==== 172+0+0 (secure 0 0 0) 0x7f1b600ac530 con 0x7f1b6c10ffe0 2026-02-20T13:16:33.767 INFO:teuthology.orchestra.run.trial028.stderr:new fs with metadata pool 2 and data pool 3 2026-02-20T13:16:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.768+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b480b57e0 msgr2=0x7f1b480d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.768+0000 7f1b739fe640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b480b57e0 0x7f1b480d5c90 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b5c005b30 tx=0x7f1b5c03a040 comp rx=0 tx=0).stop 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.768+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10ffe0 msgr2=0x7f1b6c11da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.768+0000 7f1b739fe640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10ffe0 0x7f1b6c11da10 secure :-1 s=READY pgs=200 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60005db0 tx=0x7f1b6000ddf0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.769+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 shutdown_connections 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.769+0000 7f1b739fe640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b480b57e0 0x7f1b480d5c90 unknown :-1 s=CLOSED pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.769+0000 7f1b739fe640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6c10ffe0 0x7f1b6c11da10 unknown :-1 s=CLOSED pgs=200 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.769+0000 7f1b739fe640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6c1157e0 0x7f1b6c122de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.769+0000 7f1b739fe640 1 --2- 10.20.193.28:0/226585012 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b6c10f5f0 0x7f1b6c11d4d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.769+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 >> 10.20.193.28:0/226585012 conn(0x7f1b6c0ecea0 msgr2=0x7f1b6c10d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.769+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 shutdown_connections 2026-02-20T13:16:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:33.769+0000 7f1b739fe640 1 -- 10.20.193.28:0/226585012 wait complete. 2026-02-20T13:16:33.875 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:16:34.058 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:34.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:33 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-20T13:16:34.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:33 trial028 ceph-mon[37442]: osdmap e76: 12 total, 12 up, 12 in 2026-02-20T13:16:34.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:33 trial028 ceph-mon[37442]: pgmap v154: 97 pgs: 4 active+clean, 16 creating+peering, 77 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:34.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:33 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/226585012' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-20T13:16:34.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:33 trial028 ceph-mon[37442]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-20T13:16:34.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:33 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-20T13:16:34.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:33 trial127 ceph-mon[43817]: osdmap e76: 12 total, 12 up, 12 in 2026-02-20T13:16:34.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:33 trial127 ceph-mon[43817]: pgmap v154: 97 pgs: 4 active+clean, 16 creating+peering, 77 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:34.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:33 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/226585012' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-20T13:16:34.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:33 trial127 ceph-mon[43817]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-20T13:16:34.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 -- 10.20.193.28:0/1662795131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60110140 msgr2=0x7f1b60173d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/1662795131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60110140 0x7f1b60173d50 secure :-1 s=READY pgs=201 gs=2 cs=0 l=1 c_cookie=17240593679582064386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b5000aa30 tx=0x7f1b50030270 comp rx=0 tx=0).stop 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 -- 10.20.193.28:0/1662795131 shutdown_connections 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/1662795131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60110140 0x7f1b60173d50 unknown :-1 s=CLOSED pgs=201 gs=2 cs=0 l=1 c_cookie=17240593679582064386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/1662795131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6010c040 0x7f1b6010f990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/1662795131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b6010b650 0x7f1b6010ba20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 -- 10.20.193.28:0/1662795131 >> 10.20.193.28:0/1662795131 conn(0x7f1b600e9080 msgr2=0x7f1b60109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 -- 10.20.193.28:0/1662795131 shutdown_connections 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.225+0000 7f1b5ffff640 1 -- 10.20.193.28:0/1662795131 wait complete. 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5ffff640 1 Processor -- start 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5ffff640 1 -- start start 2026-02-20T13:16:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6010b650 0x7f1b600f3c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6010c040 0x7f1b60173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b60110140 0x7f1b600f4330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b600f9540 con 0x7f1b6010b650 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5ffff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1b600f96b0 con 0x7f1b60110140 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5ffff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1b600f9870 con 0x7f1b6010c040 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6010b650 0x7f1b600f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6010b650 0x7f1b600f3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41512/0 (socket says 10.20.193.28:41512) 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5effd640 1 -- 10.20.193.28:0/3037293988 learned_addr learned my addr 10.20.193.28:0/3037293988 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5e7fc640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6010c040 0x7f1b60173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.226+0000 7f1b5f7fe640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b60110140 0x7f1b600f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5effd640 1 -- 10.20.193.28:0/3037293988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6010c040 msgr2=0x7f1b60173c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5effd640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6010c040 0x7f1b60173c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5effd640 1 -- 10.20.193.28:0/3037293988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b60110140 msgr2=0x7f1b600f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5effd640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b60110140 0x7f1b600f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5effd640 1 -- 10.20.193.28:0/3037293988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5000a650 con 0x7f1b6010b650 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5e7fc640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6010c040 0x7f1b60173c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5effd640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6010b650 0x7f1b600f3c30 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b540072a0 tx=0x7f1b5400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b3ffff640 1 -- 10.20.193.28:0/3037293988 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b54004500 con 0x7f1b6010b650 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b3ffff640 1 -- 10.20.193.28:0/3037293988 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b5400bca0 con 0x7f1b6010b650 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b3ffff640 1 -- 10.20.193.28:0/3037293988 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b540106e0 con 0x7f1b6010b650 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b600f9b50 con 0x7f1b6010b650 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.227+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b600fa020 con 0x7f1b6010b650 2026-02-20T13:16:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.228+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6005f910 con 0x7f1b6010b650 2026-02-20T13:16:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.230+0000 7f1b3ffff640 1 -- 10.20.193.28:0/3037293988 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f1b5400b7c0 con 0x7f1b6010b650 2026-02-20T13:16:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.231+0000 7f1b3ffff640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b340b56d0 0x7f1b340d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.231+0000 7f1b3ffff640 1 -- 10.20.193.28:0/3037293988 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7977+0+0 (secure 0 0 0) 0x7f1b540e6ad0 con 0x7f1b6010b650 2026-02-20T13:16:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.231+0000 7f1b3ffff640 1 -- 10.20.193.28:0/3037293988 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f1b540a9580 con 0x7f1b6010b650 2026-02-20T13:16:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.231+0000 7f1b5e7fc640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b340b56d0 0x7f1b340d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.232+0000 7f1b5e7fc640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b340b56d0 0x7f1b340d5b80 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b600fa5d0 tx=0x7f1b48005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:34.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:33 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-20T13:16:34.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:33 trial034 ceph-mon[43332]: osdmap e76: 12 total, 12 up, 12 in 2026-02-20T13:16:34.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:33 trial034 ceph-mon[43332]: pgmap v154: 97 pgs: 4 active+clean, 16 creating+peering, 77 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T13:16:34.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:33 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/226585012' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-20T13:16:34.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:33 trial034 ceph-mon[43332]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-20T13:16:34.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.347+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b600fa240 con 0x7f1b6010b650 2026-02-20T13:16:34.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.348+0000 7f1b3ffff640 1 -- 10.20.193.28:0/3037293988 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22339 (secure 0 0 0) 0x7f1b540ac730 con 0x7f1b6010b650 2026-02-20T13:16:34.352 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:34.352 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":77,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:33.380760+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:16:34.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.349+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b340b56d0 msgr2=0x7f1b340d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.349+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b340b56d0 0x7f1b340d5b80 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b600fa5d0 tx=0x7f1b48005d80 comp rx=0 tx=0).stop 2026-02-20T13:16:34.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.349+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6010b650 msgr2=0x7f1b600f3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.349+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6010b650 0x7f1b600f3c30 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b540072a0 tx=0x7f1b5400ddf0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.350+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 shutdown_connections 2026-02-20T13:16:34.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.350+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1b340b56d0 0x7f1b340d5b80 unknown :-1 s=CLOSED pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.350+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b60110140 0x7f1b600f4330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.350+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b6010c040 0x7f1b60173c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.350+0000 7f1b5ffff640 1 --2- 10.20.193.28:0/3037293988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b6010b650 0x7f1b600f3c30 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.350+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 >> 10.20.193.28:0/3037293988 conn(0x7f1b600e9080 msgr2=0x7f1b60111290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:34.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.350+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 shutdown_connections 2026-02-20T13:16:34.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.350+0000 7f1b5ffff640 1 -- 10.20.193.28:0/3037293988 wait complete. 2026-02-20T13:16:34.452 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:16:34.636 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:34.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.820+0000 7f6fe229d640 1 -- 10.20.193.28:0/3669595107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc111160 msgr2=0x7f6fdc111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.820+0000 7f6fe229d640 1 --2- 10.20.193.28:0/3669595107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc111160 0x7f6fdc111b40 secure :-1 s=READY pgs=203 gs=2 cs=0 l=1 c_cookie=11968302434496649941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fd800aa30 tx=0x7f6fd8030270 comp rx=0 tx=0).stop 2026-02-20T13:16:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.820+0000 7f6fe229d640 1 -- 10.20.193.28:0/3669595107 shutdown_connections 2026-02-20T13:16:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.820+0000 7f6fe229d640 1 --2- 10.20.193.28:0/3669595107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc111160 0x7f6fdc111b40 unknown :-1 s=CLOSED pgs=203 gs=2 cs=0 l=1 c_cookie=11968302434496649941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.820+0000 7f6fe229d640 1 --2- 10.20.193.28:0/3669595107 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6fdc10bb40 0x7f6fdc1109d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.820+0000 7f6fe229d640 1 --2- 10.20.193.28:0/3669595107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6fdc10b150 0x7f6fdc10b520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.820+0000 7f6fe229d640 1 -- 10.20.193.28:0/3669595107 >> 10.20.193.28:0/3669595107 conn(0x7f6fdc0e8ce0 msgr2=0x7f6fdc1090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.821+0000 7f6fe229d640 1 -- 10.20.193.28:0/3669595107 shutdown_connections 2026-02-20T13:16:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.821+0000 7f6fe229d640 1 -- 10.20.193.28:0/3669595107 wait complete. 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.821+0000 7f6fe229d640 1 Processor -- start 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.821+0000 7f6fe229d640 1 -- start start 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe229d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6fdc10b150 0x7f6fdc1233d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe229d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc10bb40 0x7f6fdc123910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe229d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6fdc111160 0x7f6fdc128ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe229d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc129300 con 0x7f6fdc10bb40 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe229d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc129470 con 0x7f6fdc10b150 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe229d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc129630 con 0x7f6fdc111160 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc10bb40 0x7f6fdc123910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc10bb40 0x7f6fdc123910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41526/0 (socket says 10.20.193.28:41526) 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 -- 10.20.193.28:0/1896735869 learned_addr learned my addr 10.20.193.28:0/1896735869 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe129b640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6fdc10b150 0x7f6fdc1233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe1a9c640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6fdc111160 0x7f6fdc128ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 -- 10.20.193.28:0/1896735869 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6fdc111160 msgr2=0x7f6fdc128ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6fdc111160 0x7f6fdc128ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 -- 10.20.193.28:0/1896735869 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6fdc10b150 msgr2=0x7f6fdc1233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6fdc10b150 0x7f6fdc1233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 -- 10.20.193.28:0/1896735869 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd800a650 con 0x7f6fdc10bb40 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe0a9a640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc10bb40 0x7f6fdc123910 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fd000d950 tx=0x7f6fd000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fca7fc640 1 -- 10.20.193.28:0/1896735869 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fd0004500 con 0x7f6fdc10bb40 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fca7fc640 1 -- 10.20.193.28:0/1896735869 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6fd000bd20 con 0x7f6fdc10bb40 2026-02-20T13:16:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fca7fc640 1 -- 10.20.193.28:0/1896735869 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fd00106e0 con 0x7f6fdc10bb40 2026-02-20T13:16:34.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.822+0000 7f6fe229d640 1 -- 10.20.193.28:0/1896735869 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fdc129910 con 0x7f6fdc10bb40 2026-02-20T13:16:34.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.823+0000 7f6fe229d640 1 -- 10.20.193.28:0/1896735869 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fdc16a010 con 0x7f6fdc10bb40 2026-02-20T13:16:34.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.823+0000 7f6fabfff640 1 -- 10.20.193.28:0/1896735869 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fdc129b30 con 0x7f6fdc10bb40 2026-02-20T13:16:34.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.825+0000 7f6fca7fc640 1 -- 10.20.193.28:0/1896735869 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f6fd000b840 con 0x7f6fdc10bb40 2026-02-20T13:16:34.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.827+0000 7f6fca7fc640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6fb80b5760 0x7f6fb80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:34.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.827+0000 7f6fca7fc640 1 -- 10.20.193.28:0/1896735869 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6fd00e6a50 con 0x7f6fdc10bb40 2026-02-20T13:16:34.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.827+0000 7f6fe129b640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6fb80b5760 0x7f6fb80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:34.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.827+0000 7f6fca7fc640 1 -- 10.20.193.28:0/1896735869 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f6fd011f750 con 0x7f6fdc10bb40 2026-02-20T13:16:34.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.827+0000 7f6fe129b640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6fb80b5760 0x7f6fb80d5c10 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fcc004740 tx=0x7f6fcc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.943+0000 7f6fabfff640 1 -- 10.20.193.28:0/1896735869 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6fdc1109d0 con 0x7f6fdc10bb40 2026-02-20T13:16:34.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:34 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/226585012' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-20T13:16:34.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:34 trial028 ceph-mon[37442]: osdmap e77: 12 total, 12 up, 12 in 2026-02-20T13:16:34.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:34 trial028 ceph-mon[37442]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-20T13:16:34.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:34 trial028 ceph-mon[37442]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-20T13:16:34.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:34 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] up:active 2026-02-20T13:16:34.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:34 trial028 ceph-mon[37442]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:34.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:34 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3037293988' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.943+0000 7f6fca7fc640 1 -- 10.20.193.28:0/1896735869 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7f6fd00a9540 con 0x7f6fdc10bb40 2026-02-20T13:16:34.946 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:34.946 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 -- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6fb80b5760 msgr2=0x7f6fb80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6fb80b5760 0x7f6fb80d5c10 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fcc004740 tx=0x7f6fcc005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 -- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc10bb40 msgr2=0x7f6fdc123910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc10bb40 0x7f6fdc123910 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fd000d950 tx=0x7f6fd000de20 comp rx=0 tx=0).stop 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 -- 10.20.193.28:0/1896735869 shutdown_connections 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6fb80b5760 0x7f6fb80d5c10 unknown :-1 s=CLOSED pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6fdc10bb40 0x7f6fdc123910 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6fdc111160 0x7f6fdc128ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 --2- 10.20.193.28:0/1896735869 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6fdc10b150 0x7f6fdc1233d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 -- 10.20.193.28:0/1896735869 >> 10.20.193.28:0/1896735869 conn(0x7f6fdc0e8ce0 msgr2=0x7f6fdc1090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 -- 10.20.193.28:0/1896735869 shutdown_connections 2026-02-20T13:16:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:34.945+0000 7f6fabfff640 1 -- 10.20.193.28:0/1896735869 wait complete. 2026-02-20T13:16:35.047 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-20T13:16:35.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:34 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/226585012' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-20T13:16:35.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:34 trial127 ceph-mon[43817]: osdmap e77: 12 total, 12 up, 12 in 2026-02-20T13:16:35.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:34 trial127 ceph-mon[43817]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-20T13:16:35.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:34 trial127 ceph-mon[43817]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-20T13:16:35.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:34 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] up:active 2026-02-20T13:16:35.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:34 trial127 ceph-mon[43817]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:35.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:34 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3037293988' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:35.231 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:35.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:34 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/226585012' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-20T13:16:35.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:34 trial034 ceph-mon[43332]: osdmap e77: 12 total, 12 up, 12 in 2026-02-20T13:16:35.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:34 trial034 ceph-mon[43332]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-20T13:16:35.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:34 trial034 ceph-mon[43332]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-20T13:16:35.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:34 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] up:active 2026-02-20T13:16:35.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:34 trial034 ceph-mon[43332]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:35.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:34 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3037293988' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.407+0000 7ff3a4aea640 1 -- 10.20.193.28:0/4155293050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0113000 msgr2=0x7ff3a01739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.407+0000 7ff3a4aea640 1 --2- 10.20.193.28:0/4155293050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0113000 0x7ff3a01739d0 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=8469746226034220767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff39400aa30 tx=0x7ff394030270 comp rx=0 tx=0).stop 2026-02-20T13:16:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.407+0000 7ff3a4aea640 1 -- 10.20.193.28:0/4155293050 shutdown_connections 2026-02-20T13:16:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.407+0000 7ff3a4aea640 1 --2- 10.20.193.28:0/4155293050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0113000 0x7ff3a01739d0 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=8469746226034220767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.407+0000 7ff3a4aea640 1 --2- 10.20.193.28:0/4155293050 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3a0060a00 0x7ff3a0112850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.407+0000 7ff3a4aea640 1 --2- 10.20.193.28:0/4155293050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3a0060010 0x7ff3a00603e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.407+0000 7ff3a4aea640 1 -- 10.20.193.28:0/4155293050 >> 10.20.193.28:0/4155293050 conn(0x7ff3a00e95a0 msgr2=0x7ff3a01099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.408+0000 7ff3a4aea640 1 -- 10.20.193.28:0/4155293050 shutdown_connections 2026-02-20T13:16:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.408+0000 7ff3a4aea640 1 -- 10.20.193.28:0/4155293050 wait complete. 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff3a4aea640 1 Processor -- start 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff3a4aea640 1 -- start start 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff3a4aea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3a0060010 0x7ff3a00f4260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff3a4aea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0060a00 0x7ff3a01738d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff3a4aea640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3a0113000 0x7ff3a00f4960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff3a4aea640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00f9b20 con 0x7ff3a0060a00 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff3a4aea640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00f9c90 con 0x7ff3a0113000 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff3a4aea640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00f9e50 con 0x7ff3a0060010 2026-02-20T13:16:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff39f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3a0060010 0x7ff3a00f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff39effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0060a00 0x7ff3a01738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff39f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3a0060010 0x7ff3a00f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53046/0 (socket says 10.20.193.28:53046) 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff39f7fe640 1 -- 10.20.193.28:0/1129474357 learned_addr learned my addr 10.20.193.28:0/1129474357 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.409+0000 7ff39ffff640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3a0113000 0x7ff3a00f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39effd640 1 -- 10.20.193.28:0/1129474357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3a0060010 msgr2=0x7ff3a00f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39effd640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3a0060010 0x7ff3a00f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39effd640 1 -- 10.20.193.28:0/1129474357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3a0113000 msgr2=0x7ff3a00f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39effd640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3a0113000 0x7ff3a00f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39effd640 1 -- 10.20.193.28:0/1129474357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39400a650 con 0x7ff3a0060a00 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39effd640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0060a00 0x7ff3a01738d0 secure :-1 s=READY pgs=206 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff39000d700 tx=0x7ff39000dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39cff9640 1 -- 10.20.193.28:0/1129474357 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff390004500 con 0x7ff3a0060a00 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39cff9640 1 -- 10.20.193.28:0/1129474357 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff39000de30 con 0x7ff3a0060a00 2026-02-20T13:16:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff3a4aea640 1 -- 10.20.193.28:0/1129474357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a00fa130 con 0x7ff3a0060a00 2026-02-20T13:16:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff39cff9640 1 -- 10.20.193.28:0/1129474357 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3900052a0 con 0x7ff3a0060a00 2026-02-20T13:16:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff3a4aea640 1 -- 10.20.193.28:0/1129474357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a00fa600 con 0x7ff3a0060a00 2026-02-20T13:16:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.410+0000 7ff37a7fc640 1 -- 10.20.193.28:0/1129474357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a010e0f0 con 0x7ff3a0060a00 2026-02-20T13:16:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.413+0000 7ff39cff9640 1 -- 10.20.193.28:0/1129474357 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7ff390005430 con 0x7ff3a0060a00 2026-02-20T13:16:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.414+0000 7ff39cff9640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3740b5750 0x7ff3740d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.415+0000 7ff39cff9640 1 -- 10.20.193.28:0/1129474357 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7ff3900e6730 con 0x7ff3a0060a00 2026-02-20T13:16:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.415+0000 7ff39cff9640 1 -- 10.20.193.28:0/1129474357 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7ff3900e6bb0 con 0x7ff3a0060a00 2026-02-20T13:16:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.415+0000 7ff39f7fe640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3740b5750 0x7ff3740d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.415+0000 7ff39f7fe640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3740b5750 0x7ff3740d5c00 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff38c00b2c0 tx=0x7ff38c00b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:35.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.556+0000 7ff37a7fc640 1 -- 10.20.193.28:0/1129474357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff3a00603e0 con 0x7ff3a0060a00 2026-02-20T13:16:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.778+0000 7ff39cff9640 1 -- 10.20.193.28:0/1129474357 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7ff3900a9290 con 0x7ff3a0060a00 2026-02-20T13:16:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.779+0000 7ff37a7fc640 1 -- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3740b5750 msgr2=0x7ff3740d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.779+0000 7ff37a7fc640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3740b5750 0x7ff3740d5c00 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff38c00b2c0 tx=0x7ff38c00b4a0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.779+0000 7ff37a7fc640 1 -- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0060a00 msgr2=0x7ff3a01738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.779+0000 7ff37a7fc640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0060a00 0x7ff3a01738d0 secure :-1 s=READY pgs=206 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff39000d700 tx=0x7ff39000dbd0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.780+0000 7ff37a7fc640 1 -- 10.20.193.28:0/1129474357 shutdown_connections 2026-02-20T13:16:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.780+0000 7ff37a7fc640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3740b5750 0x7ff3740d5c00 unknown :-1 s=CLOSED pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.780+0000 7ff37a7fc640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3a0060a00 0x7ff3a01738d0 unknown :-1 s=CLOSED pgs=206 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.780+0000 7ff37a7fc640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3a0113000 0x7ff3a00f4960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.780+0000 7ff37a7fc640 1 --2- 10.20.193.28:0/1129474357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3a0060010 0x7ff3a00f4260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:35.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.780+0000 7ff37a7fc640 1 -- 10.20.193.28:0/1129474357 >> 10.20.193.28:0/1129474357 conn(0x7ff3a00e95a0 msgr2=0x7ff3a010a160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:35.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.780+0000 7ff37a7fc640 1 -- 10.20.193.28:0/1129474357 shutdown_connections 2026-02-20T13:16:35.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:35.780+0000 7ff37a7fc640 1 -- 10.20.193.28:0/1129474357 wait complete. 2026-02-20T13:16:35.823 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:35 trial028 ceph-mon[37442]: osdmap e78: 12 total, 12 up, 12 in 2026-02-20T13:16:35.823 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:35 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1896735869' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:35.823 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:35 trial028 ceph-mon[37442]: pgmap v157: 97 pgs: 29 active+clean, 24 creating+peering, 44 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 255 B/s wr, 1 op/s 2026-02-20T13:16:35.823 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:35 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1129474357' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-20T13:16:35.882 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2026-02-20T13:16:35.882 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs set cephfs max_mds 5 --yes-i-really-mean-it 2026-02-20T13:16:36.067 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:36.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:35 trial127 ceph-mon[43817]: osdmap e78: 12 total, 12 up, 12 in 2026-02-20T13:16:36.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:35 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1896735869' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:36.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:35 trial127 ceph-mon[43817]: pgmap v157: 97 pgs: 29 active+clean, 24 creating+peering, 44 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 255 B/s wr, 1 op/s 2026-02-20T13:16:36.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:35 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1129474357' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-20T13:16:36.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:35 trial034 ceph-mon[43332]: osdmap e78: 12 total, 12 up, 12 in 2026-02-20T13:16:36.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:35 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1896735869' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:36.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:35 trial034 ceph-mon[43332]: pgmap v157: 97 pgs: 29 active+clean, 24 creating+peering, 44 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 255 B/s wr, 1 op/s 2026-02-20T13:16:36.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:35 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1129474357' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-20T13:16:36.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 -- 10.20.193.28:0/1701832969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10fc20 msgr2=0x7f814c114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:36.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 --2- 10.20.193.28:0/1701832969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10fc20 0x7f814c114c70 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=13381930286343010595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8134009890 tx=0x7f813402f120 comp rx=0 tx=0).stop 2026-02-20T13:16:36.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 -- 10.20.193.28:0/1701832969 shutdown_connections 2026-02-20T13:16:36.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 --2- 10.20.193.28:0/1701832969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10fc20 0x7f814c114c70 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=13381930286343010595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 --2- 10.20.193.28:0/1701832969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f814c115420 0x7f814c175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 --2- 10.20.193.28:0/1701832969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f814c10f230 0x7f814c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 -- 10.20.193.28:0/1701832969 >> 10.20.193.28:0/1701832969 conn(0x7f814c05f830 msgr2=0x7f814c10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:36.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 -- 10.20.193.28:0/1701832969 shutdown_connections 2026-02-20T13:16:36.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.249+0000 7f8151731640 1 -- 10.20.193.28:0/1701832969 wait complete. 2026-02-20T13:16:36.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f8151731640 1 Processor -- start 2026-02-20T13:16:36.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f8151731640 1 -- start start 2026-02-20T13:16:36.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f8151731640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10f230 0x7f814c0f54f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:36.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f8151731640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f814c10fc20 0x7f814c175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:36.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f8151731640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f814c115420 0x7f814c0f5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:36.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f8151731640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f814c0fae00 con 0x7f814c10f230 2026-02-20T13:16:36.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f8151731640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f814c0faf70 con 0x7f814c115420 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f8151731640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f814c0fb130 con 0x7f814c10fc20 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f814affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10f230 0x7f814c0f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f814a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f814c10fc20 0x7f814c175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f814a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f814c10fc20 0x7f814c175cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53058/0 (socket says 10.20.193.28:53058) 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f814affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10f230 0x7f814c0f54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41554/0 (socket says 10.20.193.28:41554) 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.250+0000 7f814a7fc640 1 -- 10.20.193.28:0/1929111594 learned_addr learned my addr 10.20.193.28:0/1929111594 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f814b7fe640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f814c115420 0x7f814c0f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f814affd640 1 -- 10.20.193.28:0/1929111594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f814c10fc20 msgr2=0x7f814c175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f814affd640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f814c10fc20 0x7f814c175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f814affd640 1 -- 10.20.193.28:0/1929111594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f814c115420 msgr2=0x7f814c0f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f814affd640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f814c115420 0x7f814c0f5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f814affd640 1 -- 10.20.193.28:0/1929111594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81340094b0 con 0x7f814c10f230 2026-02-20T13:16:36.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f814b7fe640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f814c115420 0x7f814c0f5bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:36.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f814affd640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10f230 0x7f814c0f54f0 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8140004740 tx=0x7f814000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:36.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f812bfff640 1 -- 10.20.193.28:0/1929111594 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f814000cd40 con 0x7f814c10f230 2026-02-20T13:16:36.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f812bfff640 1 -- 10.20.193.28:0/1929111594 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8140004d30 con 0x7f814c10f230 2026-02-20T13:16:36.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f812bfff640 1 -- 10.20.193.28:0/1929111594 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81400106b0 con 0x7f814c10f230 2026-02-20T13:16:36.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f814c0fb410 con 0x7f814c10f230 2026-02-20T13:16:36.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.251+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f814c0fb890 con 0x7f814c10f230 2026-02-20T13:16:36.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.252+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f814c110510 con 0x7f814c10f230 2026-02-20T13:16:36.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.254+0000 7f812bfff640 1 -- 10.20.193.28:0/1929111594 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f814001f060 con 0x7f814c10f230 2026-02-20T13:16:36.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.256+0000 7f812bfff640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81200b5750 0x7f81200d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:36.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.256+0000 7f812bfff640 1 -- 10.20.193.28:0/1929111594 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f8140014070 con 0x7f814c10f230 2026-02-20T13:16:36.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.256+0000 7f812bfff640 1 -- 10.20.193.28:0/1929111594 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f814011f750 con 0x7f814c10f230 2026-02-20T13:16:36.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.256+0000 7f814a7fc640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81200b5750 0x7f81200d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:36.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.256+0000 7f814a7fc640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81200b5750 0x7f81200d5c00 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f814c0fbe90 tx=0x7f813403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:36.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.398+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} v 0) -- 0x7f814c10f600 con 0x7f814c10f230 2026-02-20T13:16:36.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.784+0000 7f812bfff640 1 -- 10.20.193.28:0/1929111594 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]=0 v14) ==== 135+0+0 (secure 0 0 0) 0x7f81400a96b0 con 0x7f814c10f230 2026-02-20T13:16:36.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81200b5750 msgr2=0x7f81200d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:36.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81200b5750 0x7f81200d5c00 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f814c0fbe90 tx=0x7f813403a040 comp rx=0 tx=0).stop 2026-02-20T13:16:36.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10f230 msgr2=0x7f814c0f54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:36.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10f230 0x7f814c0f54f0 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8140004740 tx=0x7f814000ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:36.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 shutdown_connections 2026-02-20T13:16:36.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81200b5750 0x7f81200d5c00 unknown :-1 s=CLOSED pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f814c115420 0x7f814c0f5bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f814c10fc20 0x7f814c175cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 --2- 10.20.193.28:0/1929111594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f814c10f230 0x7f814c0f54f0 unknown :-1 s=CLOSED pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:36.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.786+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 >> 10.20.193.28:0/1929111594 conn(0x7f814c05f830 msgr2=0x7f814c111a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:36.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.787+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 shutdown_connections 2026-02-20T13:16:36.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:36.787+0000 7f8151731640 1 -- 10.20.193.28:0/1929111594 wait complete. 2026-02-20T13:16:36.887 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-20T13:16:37.073 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:36 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1129474357' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-20T13:16:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:36 trial028 ceph-mon[37442]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:36 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1929111594' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:16:37.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:36 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1129474357' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-20T13:16:37.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:36 trial127 ceph-mon[43817]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:37.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:36 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1929111594' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:16:37.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:36 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1129474357' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-20T13:16:37.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:36 trial034 ceph-mon[43332]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:37.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:36 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1929111594' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 -- 10.20.193.28:0/4258164945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff801157e0 msgr2=0x7eff801761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 --2- 10.20.193.28:0/4258164945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff801157e0 0x7eff801761b0 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=5082918622799505829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff7400aa30 tx=0x7eff74030270 comp rx=0 tx=0).stop 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 -- 10.20.193.28:0/4258164945 shutdown_connections 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 --2- 10.20.193.28:0/4258164945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff801157e0 0x7eff801761b0 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=5082918622799505829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 --2- 10.20.193.28:0/4258164945 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff8010ffe0 0x7eff80115030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 --2- 10.20.193.28:0/4258164945 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7eff8010f5f0 0x7eff8010f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 -- 10.20.193.28:0/4258164945 >> 10.20.193.28:0/4258164945 conn(0x7eff800ecea0 msgr2=0x7eff8010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 -- 10.20.193.28:0/4258164945 shutdown_connections 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.242+0000 7eff85ace640 1 -- 10.20.193.28:0/4258164945 wait complete. 2026-02-20T13:16:37.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.243+0000 7eff85ace640 1 Processor -- start 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.243+0000 7eff85ace640 1 -- start start 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.243+0000 7eff85ace640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff8010f5f0 0x7eff8011d530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.243+0000 7eff85ace640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff8010ffe0 0x7eff8011da70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.243+0000 7eff85ace640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7eff801157e0 0x7eff80122e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.243+0000 7eff85ace640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7eff80123460 con 0x7eff8010f5f0 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.243+0000 7eff85ace640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7eff801235d0 con 0x7eff801157e0 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.243+0000 7eff85ace640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7eff80123790 con 0x7eff8010ffe0 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff8010f5f0 0x7eff8011d530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff8010f5f0 0x7eff8011d530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41578/0 (socket says 10.20.193.28:41578) 2026-02-20T13:16:37.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 -- 10.20.193.28:0/2060521257 learned_addr learned my addr 10.20.193.28:0/2060521257 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:37.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff8010ffe0 0x7eff8011da70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:37.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7ffff640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7eff801157e0 0x7eff80122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:37.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 -- 10.20.193.28:0/2060521257 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff8010ffe0 msgr2=0x7eff8011da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:37.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff8010ffe0 0x7eff8011da70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 -- 10.20.193.28:0/2060521257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7eff801157e0 msgr2=0x7eff80122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:37.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7eff801157e0 0x7eff80122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 -- 10.20.193.28:0/2060521257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7400a650 con 0x7eff8010f5f0 2026-02-20T13:16:37.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7f7fe640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff8010f5f0 0x7eff8011d530 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff6c00d950 tx=0x7eff6c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:37.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7cff9640 1 -- 10.20.193.28:0/2060521257 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff6c004540 con 0x7eff8010f5f0 2026-02-20T13:16:37.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7cff9640 1 -- 10.20.193.28:0/2060521257 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7eff6c009d00 con 0x7eff8010f5f0 2026-02-20T13:16:37.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff7cff9640 1 -- 10.20.193.28:0/2060521257 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff6c0106e0 con 0x7eff8010f5f0 2026-02-20T13:16:37.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff80123a70 con 0x7eff8010f5f0 2026-02-20T13:16:37.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.244+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff80164170 con 0x7eff8010f5f0 2026-02-20T13:16:37.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.245+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff801108d0 con 0x7eff8010f5f0 2026-02-20T13:16:37.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.247+0000 7eff7cff9640 1 -- 10.20.193.28:0/2060521257 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7eff6c009820 con 0x7eff8010f5f0 2026-02-20T13:16:37.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.249+0000 7eff7cff9640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7eff540b5760 0x7eff540d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:37.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.249+0000 7eff7cff9640 1 -- 10.20.193.28:0/2060521257 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7eff6c0e65c0 con 0x7eff8010f5f0 2026-02-20T13:16:37.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.249+0000 7eff7cff9640 1 -- 10.20.193.28:0/2060521257 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7eff6c0e6a40 con 0x7eff8010f5f0 2026-02-20T13:16:37.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.249+0000 7eff7effd640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7eff540b5760 0x7eff540d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:37.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.250+0000 7eff7effd640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7eff540b5760 0x7eff540d5c10 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff80123ed0 tx=0x7eff7000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:37.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.389+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7eff8010f9c0 con 0x7eff8010f5f0 2026-02-20T13:16:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.788+0000 7eff7cff9640 1 -- 10.20.193.28:0/2060521257 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7eff6c0a9070 con 0x7eff8010f5f0 2026-02-20T13:16:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7eff540b5760 msgr2=0x7eff540d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7eff540b5760 0x7eff540d5c10 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff80123ed0 tx=0x7eff7000b410 comp rx=0 tx=0).stop 2026-02-20T13:16:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff8010f5f0 msgr2=0x7eff8011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff8010f5f0 0x7eff8011d530 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff6c00d950 tx=0x7eff6c00de20 comp rx=0 tx=0).stop 2026-02-20T13:16:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 shutdown_connections 2026-02-20T13:16:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7eff540b5760 0x7eff540d5c10 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7eff801157e0 0x7eff80122e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff8010ffe0 0x7eff8011da70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 --2- 10.20.193.28:0/2060521257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff8010f5f0 0x7eff8011d530 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 >> 10.20.193.28:0/2060521257 conn(0x7eff800ecea0 msgr2=0x7eff8010d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 shutdown_connections 2026-02-20T13:16:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:37.791+0000 7eff85ace640 1 -- 10.20.193.28:0/2060521257 wait complete. 2026-02-20T13:16:37.894 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-20T13:16:38.078 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:38.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:37 trial028 ceph-mon[37442]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-20T13:16:38.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:37 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1929111594' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:16:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:37 trial028 ceph-mon[37442]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-20T13:16:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:37 trial028 ceph-mon[37442]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:37 trial028 ceph-mon[37442]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2026-02-20T13:16:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:37 trial028 ceph-mon[37442]: daemon mds.g is now active in filesystem cephfs as rank 1 2026-02-20T13:16:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:37 trial028 ceph-mon[37442]: pgmap v158: 97 pgs: 81 active+clean, 16 creating+peering; 580 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s wr, 8 op/s 2026-02-20T13:16:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:37 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2060521257' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-20T13:16:38.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:37 trial127 ceph-mon[43817]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-20T13:16:38.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:37 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1929111594' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:16:38.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:37 trial127 ceph-mon[43817]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-20T13:16:38.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:37 trial127 ceph-mon[43817]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:38.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:37 trial127 ceph-mon[43817]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2026-02-20T13:16:38.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:37 trial127 ceph-mon[43817]: daemon mds.g is now active in filesystem cephfs as rank 1 2026-02-20T13:16:38.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:37 trial127 ceph-mon[43817]: pgmap v158: 97 pgs: 81 active+clean, 16 creating+peering; 580 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s wr, 8 op/s 2026-02-20T13:16:38.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:37 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2060521257' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-20T13:16:38.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:37 trial034 ceph-mon[43332]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-20T13:16:38.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:37 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1929111594' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:16:38.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:37 trial034 ceph-mon[43332]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-20T13:16:38.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:37 trial034 ceph-mon[43332]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T13:16:38.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:37 trial034 ceph-mon[43332]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2026-02-20T13:16:38.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:37 trial034 ceph-mon[43332]: daemon mds.g is now active in filesystem cephfs as rank 1 2026-02-20T13:16:38.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:37 trial034 ceph-mon[43332]: pgmap v158: 97 pgs: 81 active+clean, 16 creating+peering; 580 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s wr, 8 op/s 2026-02-20T13:16:38.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:37 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2060521257' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 -- 10.20.193.28:0/4133093311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010f4b0 msgr2=0x7f405010f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 --2- 10.20.193.28:0/4133093311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010f4b0 0x7f405010f880 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=13014329894807793359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4044009950 tx=0x7f404402f190 comp rx=0 tx=0).stop 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 -- 10.20.193.28:0/4133093311 shutdown_connections 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 --2- 10.20.193.28:0/4133093311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40501156a0 0x7f4050176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 --2- 10.20.193.28:0/4133093311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f405010fea0 0x7f4050114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 --2- 10.20.193.28:0/4133093311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010f4b0 0x7f405010f880 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=13014329894807793359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 -- 10.20.193.28:0/4133093311 >> 10.20.193.28:0/4133093311 conn(0x7f40500ecda0 msgr2=0x7f405010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 -- 10.20.193.28:0/4133093311 shutdown_connections 2026-02-20T13:16:38.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.258+0000 7f4054891640 1 -- 10.20.193.28:0/4133093311 wait complete. 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f4054891640 1 Processor -- start 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f4054891640 1 -- start start 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f4054891640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f405010f4b0 0x7f405011ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f4054891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010fea0 0x7f405011e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f4054891640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40501156a0 0x7f40501236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f4054891640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4050123d00 con 0x7f405010fea0 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f4054891640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4050123e70 con 0x7f405010f4b0 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f4054891640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4050124030 con 0x7f40501156a0 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f404ed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f405010f4b0 0x7f405011ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f404f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40501156a0 0x7f40501236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f404ed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f405010f4b0 0x7f405011ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58328/0 (socket says 10.20.193.28:58328) 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f404ed76640 1 -- 10.20.193.28:0/3502662683 learned_addr learned my addr 10.20.193.28:0/3502662683 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.259+0000 7f404e575640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010fea0 0x7f405011e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f404e575640 1 -- 10.20.193.28:0/3502662683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40501156a0 msgr2=0x7f40501236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f404e575640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40501156a0 0x7f40501236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f404e575640 1 -- 10.20.193.28:0/3502662683 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f405010f4b0 msgr2=0x7f405011ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f404e575640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f405010f4b0 0x7f405011ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f404e575640 1 -- 10.20.193.28:0/3502662683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4044009570 con 0x7f405010fea0 2026-02-20T13:16:38.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f404e575640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010fea0 0x7f405011e310 secure :-1 s=READY pgs=212 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f403800e9c0 tx=0x7f403800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:38.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f402ffff640 1 -- 10.20.193.28:0/3502662683 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f403800ccb0 con 0x7f405010fea0 2026-02-20T13:16:38.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f402ffff640 1 -- 10.20.193.28:0/3502662683 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f403800ce10 con 0x7f405010fea0 2026-02-20T13:16:38.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f402ffff640 1 -- 10.20.193.28:0/3502662683 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40380106b0 con 0x7f405010fea0 2026-02-20T13:16:38.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f4054891640 1 -- 10.20.193.28:0/3502662683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4050124310 con 0x7f405010fea0 2026-02-20T13:16:38.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.260+0000 7f4054891640 1 -- 10.20.193.28:0/3502662683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4050164a10 con 0x7f405010fea0 2026-02-20T13:16:38.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.261+0000 7f402dffb640 1 -- 10.20.193.28:0/3502662683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4050124530 con 0x7f405010fea0 2026-02-20T13:16:38.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.263+0000 7f402ffff640 1 -- 10.20.193.28:0/3502662683 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f403801f060 con 0x7f405010fea0 2026-02-20T13:16:38.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.265+0000 7f402ffff640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40240b5760 0x7f40240d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:38.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.265+0000 7f402ffff640 1 -- 10.20.193.28:0/3502662683 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4038014070 con 0x7f405010fea0 2026-02-20T13:16:38.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.265+0000 7f402ffff640 1 -- 10.20.193.28:0/3502662683 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f403811f730 con 0x7f405010fea0 2026-02-20T13:16:38.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.265+0000 7f404ed76640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40240b5760 0x7f40240d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:38.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.266+0000 7f404ed76640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40240b5760 0x7f40240d5c10 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4044005b30 tx=0x7f404403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.407+0000 7f402dffb640 1 -- 10.20.193.28:0/3502662683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f405011ef30 con 0x7f405010fea0 2026-02-20T13:16:38.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.795+0000 7f402ffff640 1 -- 10.20.193.28:0/3502662683 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7f40380a96e0 con 0x7f405010fea0 2026-02-20T13:16:38.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 -- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40240b5760 msgr2=0x7f40240d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40240b5760 0x7f40240d5c10 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4044005b30 tx=0x7f404403a040 comp rx=0 tx=0).stop 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 -- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010fea0 msgr2=0x7f405011e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010fea0 0x7f405011e310 secure :-1 s=READY pgs=212 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f403800e9c0 tx=0x7f403800ee90 comp rx=0 tx=0).stop 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 -- 10.20.193.28:0/3502662683 shutdown_connections 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40240b5760 0x7f40240d5c10 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f405010fea0 0x7f405011e310 unknown :-1 s=CLOSED pgs=212 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40501156a0 0x7f40501236e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 --2- 10.20.193.28:0/3502662683 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f405010f4b0 0x7f405011ddd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 -- 10.20.193.28:0/3502662683 >> 10.20.193.28:0/3502662683 conn(0x7f40500ecda0 msgr2=0x7f405010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:38.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.797+0000 7f402dffb640 1 -- 10.20.193.28:0/3502662683 shutdown_connections 2026-02-20T13:16:38.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:38.798+0000 7f402dffb640 1 -- 10.20.193.28:0/3502662683 wait complete. 2026-02-20T13:16:38.901 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2026-02-20T13:16:38.901 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-20T13:16:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2060521257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-20T13:16:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] up:active 2026-02-20T13:16:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-mon[43332]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-20T13:16:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-mon[43332]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2026-02-20T13:16:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-mon[43332]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:creating} 9 up:standby 2026-02-20T13:16:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-mon[43332]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-20T13:16:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3502662683' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-20T13:16:38.992 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: 2026-02-20T13:16:38.587+0000 7f2e3c7fd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-20T13:16:38.992 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:16:38 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: 2026-02-20T13:16:38.587+0000 7f2e3c7fd640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2026-02-20T13:16:39.087 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:38 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2060521257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-20T13:16:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:38 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] up:active 2026-02-20T13:16:39.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:38 trial028 ceph-mon[37442]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-20T13:16:39.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:38 trial028 ceph-mon[37442]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2026-02-20T13:16:39.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:38 trial028 ceph-mon[37442]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:creating} 9 up:standby 2026-02-20T13:16:39.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:38 trial028 ceph-mon[37442]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-20T13:16:39.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:38 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3502662683' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-20T13:16:39.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:38 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2060521257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-20T13:16:39.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:38 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] up:active 2026-02-20T13:16:39.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:38 trial127 ceph-mon[43817]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-20T13:16:39.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:38 trial127 ceph-mon[43817]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2026-02-20T13:16:39.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:38 trial127 ceph-mon[43817]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:creating} 9 up:standby 2026-02-20T13:16:39.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:38 trial127 ceph-mon[43817]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-20T13:16:39.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:38 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3502662683' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-20T13:16:39.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 -- 10.20.193.28:0/1133037292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f782c10fea0 msgr2=0x7f782c114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 --2- 10.20.193.28:0/1133037292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f782c10fea0 0x7f782c114ef0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=16194365546091073577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7820009950 tx=0x7f782002f190 comp rx=0 tx=0).stop 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 -- 10.20.193.28:0/1133037292 shutdown_connections 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 --2- 10.20.193.28:0/1133037292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f782c1156a0 0x7f782c176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 --2- 10.20.193.28:0/1133037292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f782c10fea0 0x7f782c114ef0 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=16194365546091073577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 --2- 10.20.193.28:0/1133037292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f782c10f4b0 0x7f782c10f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 -- 10.20.193.28:0/1133037292 >> 10.20.193.28:0/1133037292 conn(0x7f782c0ecda0 msgr2=0x7f782c10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 -- 10.20.193.28:0/1133037292 shutdown_connections 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.266+0000 7f783303b640 1 -- 10.20.193.28:0/1133037292 wait complete. 2026-02-20T13:16:39.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783303b640 1 Processor -- start 2026-02-20T13:16:39.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783303b640 1 -- start start 2026-02-20T13:16:39.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783303b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f782c10f4b0 0x7f782c0f5760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:39.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783303b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f782c10fea0 0x7f782c175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783303b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f782c1156a0 0x7f782c0f5e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783303b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0fb070 con 0x7f782c1156a0 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783303b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0fb1e0 con 0x7f782c10fea0 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783303b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0fb3a0 con 0x7f782c10f4b0 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783283a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f782c1156a0 0x7f782c0f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f7831838640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f782c10fea0 0x7f782c175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783283a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f782c1156a0 0x7f782c0f5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41614/0 (socket says 10.20.193.28:41614) 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f783283a640 1 -- 10.20.193.28:0/3225892898 learned_addr learned my addr 10.20.193.28:0/3225892898 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.267+0000 7f7832039640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f782c10f4b0 0x7f782c0f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f783283a640 1 -- 10.20.193.28:0/3225892898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f782c10f4b0 msgr2=0x7f782c0f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:39.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f783283a640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f782c10f4b0 0x7f782c0f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f783283a640 1 -- 10.20.193.28:0/3225892898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f782c10fea0 msgr2=0x7f782c175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f783283a640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f782c10fea0 0x7f782c175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f783283a640 1 -- 10.20.193.28:0/3225892898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781c0094b0 con 0x7f782c1156a0 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f783283a640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f782c1156a0 0x7f782c0f5e60 secure :-1 s=READY pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f782800f8d0 tx=0x7f782800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f78137fe640 1 -- 10.20.193.28:0/3225892898 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f782800dce0 con 0x7f782c1156a0 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f78137fe640 1 -- 10.20.193.28:0/3225892898 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f782800de40 con 0x7f782c1156a0 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f78137fe640 1 -- 10.20.193.28:0/3225892898 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78280116b0 con 0x7f782c1156a0 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7820009570 con 0x7f782c1156a0 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.268+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782c0fb970 con 0x7f782c1156a0 2026-02-20T13:16:39.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.269+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782c110790 con 0x7f782c1156a0 2026-02-20T13:16:39.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.271+0000 7f78137fe640 1 -- 10.20.193.28:0/3225892898 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f7828020060 con 0x7f782c1156a0 2026-02-20T13:16:39.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.272+0000 7f78137fe640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78080b5750 0x7f78080d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:39.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.272+0000 7f78137fe640 1 -- 10.20.193.28:0/3225892898 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f7828015070 con 0x7f782c1156a0 2026-02-20T13:16:39.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.273+0000 7f7832039640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78080b5750 0x7f78080d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:39.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.273+0000 7f78137fe640 1 -- 10.20.193.28:0/3225892898 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f7828120730 con 0x7f782c1156a0 2026-02-20T13:16:39.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.273+0000 7f7832039640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78080b5750 0x7f78080d5c00 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f781c004740 tx=0x7f781c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:39.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:39.405+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f782c0532d0 con 0x7f78080b5750 2026-02-20T13:16:39.799 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:16:39 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: 2026-02-20T13:16:39.412+0000 7f282fb02640 -1 client.14772 error registering admin socket command: (17) File exists 2026-02-20T13:16:40.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.080+0000 7f78137fe640 1 -- 10.20.193.28:0/3225892898 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f782c0532d0 con 0x7f78080b5750 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3502662683' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] up:active 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 9 up:standby 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] up:active 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: daemon mds.j assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-20T13:16:40.084 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-20T13:16:40.085 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: Cluster is now healthy 2026-02-20T13:16:40.085 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2026-02-20T13:16:40.085 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2026-02-20T13:16:40.085 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: daemon mds.j is now active in filesystem cephfs as rank 4 2026-02-20T13:16:40.085 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: pgmap v159: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s wr, 10 op/s 2026-02-20T13:16:40.085 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:39 trial028 ceph-mon[37442]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:40.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78080b5750 msgr2=0x7f78080d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:40.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78080b5750 0x7f78080d5c00 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f781c004740 tx=0x7f781c005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:40.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f782c1156a0 msgr2=0x7f782c0f5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:40.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f782c1156a0 0x7f782c0f5e60 secure :-1 s=READY pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f782800f8d0 tx=0x7f782800fda0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 shutdown_connections 2026-02-20T13:16:40.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78080b5750 0x7f78080d5c00 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f782c1156a0 0x7f782c0f5e60 unknown :-1 s=CLOSED pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f782c10fea0 0x7f782c175f70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 --2- 10.20.193.28:0/3225892898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f782c10f4b0 0x7f782c0f5760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 >> 10.20.193.28:0/3225892898 conn(0x7f782c0ecda0 msgr2=0x7f782c111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:40.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 shutdown_connections 2026-02-20T13:16:40.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.083+0000 7f783303b640 1 -- 10.20.193.28:0/3225892898 wait complete. 2026-02-20T13:16:40.188 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-20T13:16:40.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3502662683' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-20T13:16:40.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] up:active 2026-02-20T13:16:40.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-20T13:16:40.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 9 up:standby 2026-02-20T13:16:40.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2026-02-20T13:16:40.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-20T13:16:40.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] up:active 2026-02-20T13:16:40.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: daemon mds.j assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-20T13:16:40.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-20T13:16:40.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: Cluster is now healthy 2026-02-20T13:16:40.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2026-02-20T13:16:40.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2026-02-20T13:16:40.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: daemon mds.j is now active in filesystem cephfs as rank 4 2026-02-20T13:16:40.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: pgmap v159: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s wr, 10 op/s 2026-02-20T13:16:40.228 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:39 trial127 ceph-mon[43817]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3502662683' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] up:active 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 9 up:standby 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] up:active 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: daemon mds.j assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-20T13:16:40.240 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: Cluster is now healthy 2026-02-20T13:16:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2026-02-20T13:16:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2026-02-20T13:16:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: daemon mds.j is now active in filesystem cephfs as rank 4 2026-02-20T13:16:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: pgmap v159: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s wr, 10 op/s 2026-02-20T13:16:40.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:39 trial034 ceph-mon[43332]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:40.374 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:40.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 -- 10.20.193.28:0/695856616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 msgr2=0x7f4ccc10bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:40.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 --2- 10.20.193.28:0/695856616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 0x7f4ccc10bb80 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=12098602331582972570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cbc009950 tx=0x7f4cbc02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:40.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 -- 10.20.193.28:0/695856616 shutdown_connections 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 --2- 10.20.193.28:0/695856616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ccc1119a0 0x7f4ccc172370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 --2- 10.20.193.28:0/695856616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ccc10c1a0 0x7f4ccc1111f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 --2- 10.20.193.28:0/695856616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 0x7f4ccc10bb80 unknown :-1 s=CLOSED pgs=87 gs=1 cs=0 l=1 c_cookie=12098602331582972570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 -- 10.20.193.28:0/695856616 >> 10.20.193.28:0/695856616 conn(0x7f4ccc0e9080 msgr2=0x7f4ccc109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 -- 10.20.193.28:0/695856616 shutdown_connections 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.557+0000 7f4cd34c9640 1 -- 10.20.193.28:0/695856616 wait complete. 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd34c9640 1 Processor -- start 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd34c9640 1 -- start start 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd34c9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 0x7f4ccc0f5fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd34c9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ccc10c1a0 0x7f4ccc172270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:40.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd34c9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ccc1119a0 0x7f4ccc0f66d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd34c9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0fb8e0 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd34c9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0fba50 con 0x7f4ccc10b7b0 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd34c9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0fbc10 con 0x7f4ccc1119a0 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd1cc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ccc10c1a0 0x7f4ccc172270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd1cc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ccc10c1a0 0x7f4ccc172270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47776/0 (socket says 10.20.193.28:47776) 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd1cc6640 1 -- 10.20.193.28:0/1880693588 learned_addr learned my addr 10.20.193.28:0/1880693588 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.558+0000 7f4cd24c7640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 0x7f4ccc0f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd2cc8640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ccc1119a0 0x7f4ccc0f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd1cc6640 1 -- 10.20.193.28:0/1880693588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ccc1119a0 msgr2=0x7f4ccc0f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd1cc6640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ccc1119a0 0x7f4ccc0f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd1cc6640 1 -- 10.20.193.28:0/1880693588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 msgr2=0x7f4ccc0f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd1cc6640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 0x7f4ccc0f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd1cc6640 1 -- 10.20.193.28:0/1880693588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc009570 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd24c7640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 0x7f4ccc0f5fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd1cc6640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ccc10c1a0 0x7f4ccc172270 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cc000a2b0 tx=0x7f4cc000eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cb37fe640 1 -- 10.20.193.28:0/1880693588 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4cc000cbe0 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cb37fe640 1 -- 10.20.193.28:0/1880693588 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4cc000cd40 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cb37fe640 1 -- 10.20.193.28:0/1880693588 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4cc0016690 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd34c9640 1 -- 10.20.193.28:0/1880693588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc0fbef0 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.559+0000 7f4cd34c9640 1 -- 10.20.193.28:0/1880693588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc0fc370 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.560+0000 7f4cb17fa640 1 -- 10.20.193.28:0/1880693588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ccc10ca90 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.562+0000 7f4cb37fe640 1 -- 10.20.193.28:0/1880693588 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f4cc0004770 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.564+0000 7f4cb37fe640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4ca80b57d0 0x7f4ca80d5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:40.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.564+0000 7f4cb37fe640 1 -- 10.20.193.28:0/1880693588 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4cc00e6fb0 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.564+0000 7f4cb37fe640 1 -- 10.20.193.28:0/1880693588 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f4cc00e73b0 con 0x7f4ccc10c1a0 2026-02-20T13:16:40.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.564+0000 7f4cd24c7640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4ca80b57d0 0x7f4ca80d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:40.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.564+0000 7f4cd24c7640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4ca80b57d0 0x7f4ca80d5c80 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cbc0023d0 tx=0x7f4cbc031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:40.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.699+0000 7f4cb17fa640 1 -- 10.20.193.28:0/1880693588 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4ccc0f7130 con 0x7f4ca80b57d0 2026-02-20T13:16:40.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.714+0000 7f4cb37fe640 1 -- 10.20.193.28:0/1880693588 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ccc0f7130 con 0x7f4ca80b57d0 2026-02-20T13:16:40.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 -- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4ca80b57d0 msgr2=0x7f4ca80d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:40.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4ca80b57d0 0x7f4ca80d5c80 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cbc0023d0 tx=0x7f4cbc031040 comp rx=0 tx=0).stop 2026-02-20T13:16:40.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 -- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ccc10c1a0 msgr2=0x7f4ccc172270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:40.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ccc10c1a0 0x7f4ccc172270 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cc000a2b0 tx=0x7f4cc000eb70 comp rx=0 tx=0).stop 2026-02-20T13:16:40.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 -- 10.20.193.28:0/1880693588 shutdown_connections 2026-02-20T13:16:40.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4ca80b57d0 0x7f4ca80d5c80 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ccc10c1a0 0x7f4ccc172270 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ccc1119a0 0x7f4ccc0f66d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 --2- 10.20.193.28:0/1880693588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ccc10b7b0 0x7f4ccc0f5fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:40.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 -- 10.20.193.28:0/1880693588 >> 10.20.193.28:0/1880693588 conn(0x7f4ccc0e9080 msgr2=0x7f4ccc10d950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:40.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 -- 10.20.193.28:0/1880693588 shutdown_connections 2026-02-20T13:16:40.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:40.716+0000 7f4cb17fa640 1 -- 10.20.193.28:0/1880693588 wait complete. 2026-02-20T13:16:40.820 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-20T13:16:41.004 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:41.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 -- 10.20.193.28:0/3207520242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74060f30 msgr2=0x7f2f74061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 --2- 10.20.193.28:0/3207520242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74060f30 0x7f2f74061300 secure :-1 s=READY pgs=217 gs=2 cs=0 l=1 c_cookie=17761872613774092346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f68009950 tx=0x7f2f6802f190 comp rx=0 tx=0).stop 2026-02-20T13:16:41.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 -- 10.20.193.28:0/3207520242 shutdown_connections 2026-02-20T13:16:41.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 --2- 10.20.193.28:0/3207520242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f74155980 0x7f2f74175d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 --2- 10.20.193.28:0/3207520242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f74061840 0x7f2f74155440 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 --2- 10.20.193.28:0/3207520242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74060f30 0x7f2f74061300 unknown :-1 s=CLOSED pgs=217 gs=2 cs=0 l=1 c_cookie=17761872613774092346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 -- 10.20.193.28:0/3207520242 >> 10.20.193.28:0/3207520242 conn(0x7f2f740eaad0 msgr2=0x7f2f7410aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 -- 10.20.193.28:0/3207520242 shutdown_connections 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.182+0000 7f2f73577640 1 -- 10.20.193.28:0/3207520242 wait complete. 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.183+0000 7f2f73577640 1 Processor -- start 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.183+0000 7f2f73577640 1 -- start start 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f73577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f74060f30 0x7f2f741620b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f73577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74061840 0x7f2f741625f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f73577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f74155980 0x7f2f741679c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f73577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74167fe0 con 0x7f2f74061840 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f73577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74168150 con 0x7f2f74155980 2026-02-20T13:16:41.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f73577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74168310 con 0x7f2f74060f30 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74061840 0x7f2f741625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74061840 0x7f2f741625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47788/0 (socket says 10.20.193.28:47788) 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f72575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f74060f30 0x7f2f741620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 -- 10.20.193.28:0/1892104163 learned_addr learned my addr 10.20.193.28:0/1892104163 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f72d76640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f74155980 0x7f2f741679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 -- 10.20.193.28:0/1892104163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f74060f30 msgr2=0x7f2f741620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f74060f30 0x7f2f741620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 -- 10.20.193.28:0/1892104163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f74155980 msgr2=0x7f2f741679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f74155980 0x7f2f741679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 -- 10.20.193.28:0/1892104163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f68009570 con 0x7f2f74061840 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f71d74640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74061840 0x7f2f741625f0 secure :-1 s=READY pgs=218 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f5c009480 tx=0x7f2f5c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f5b7fe640 1 -- 10.20.193.28:0/1892104163 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f5c00cc80 con 0x7f2f74061840 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f5b7fe640 1 -- 10.20.193.28:0/1892104163 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f5c00cde0 con 0x7f2f74061840 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f73577640 1 -- 10.20.193.28:0/1892104163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f741685f0 con 0x7f2f74061840 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f5b7fe640 1 -- 10.20.193.28:0/1892104163 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f5c0106b0 con 0x7f2f74061840 2026-02-20T13:16:41.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.184+0000 7f2f73577640 1 -- 10.20.193.28:0/1892104163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f741515a0 con 0x7f2f74061840 2026-02-20T13:16:41.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.185+0000 7f2f597fa640 1 -- 10.20.193.28:0/1892104163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f38005300 con 0x7f2f74061840 2026-02-20T13:16:41.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.187+0000 7f2f5b7fe640 1 -- 10.20.193.28:0/1892104163 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f2f5c01f060 con 0x7f2f74061840 2026-02-20T13:16:41.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.189+0000 7f2f5b7fe640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2f4c0b56e0 0x7f2f4c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:41.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.189+0000 7f2f5b7fe640 1 -- 10.20.193.28:0/1892104163 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f2f5c014070 con 0x7f2f74061840 2026-02-20T13:16:41.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.189+0000 7f2f72575640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2f4c0b56e0 0x7f2f4c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:41.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.189+0000 7f2f5b7fe640 1 -- 10.20.193.28:0/1892104163 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f2f5c11f730 con 0x7f2f74061840 2026-02-20T13:16:41.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.190+0000 7f2f72575640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2f4c0b56e0 0x7f2f4c0d5b90 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f680098a0 tx=0x7f2f6803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:41.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.323+0000 7f2f597fa640 1 -- 10.20.193.28:0/1892104163 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f2f38002bb0 con 0x7f2f4c0b56e0 2026-02-20T13:16:41.327 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:41 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] up:active 2026-02-20T13:16:41.327 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:41 trial028 ceph-mon[37442]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2026-02-20T13:16:41.327 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:41 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:16:41.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.327+0000 7f2f5b7fe640 1 -- 10.20.193.28:0/1892104163 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2f38002bb0 con 0x7f2f4c0b56e0 2026-02-20T13:16:41.330 INFO:teuthology.orchestra.run.trial028.stdout:/volumes/qa/sv_0/65af61d1-8e1a-4995-85dc-945bca6e7a5c 2026-02-20T13:16:41.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 -- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2f4c0b56e0 msgr2=0x7f2f4c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2f4c0b56e0 0x7f2f4c0d5b90 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f680098a0 tx=0x7f2f6803a040 comp rx=0 tx=0).stop 2026-02-20T13:16:41.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 -- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74061840 msgr2=0x7f2f741625f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74061840 0x7f2f741625f0 secure :-1 s=READY pgs=218 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f5c009480 tx=0x7f2f5c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 -- 10.20.193.28:0/1892104163 shutdown_connections 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2f4c0b56e0 0x7f2f4c0d5b90 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f74061840 0x7f2f741625f0 unknown :-1 s=CLOSED pgs=218 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f74155980 0x7f2f741679c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 --2- 10.20.193.28:0/1892104163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f74060f30 0x7f2f741620b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 -- 10.20.193.28:0/1892104163 >> 10.20.193.28:0/1892104163 conn(0x7f2f740eaad0 msgr2=0x7f2f7410aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 -- 10.20.193.28:0/1892104163 shutdown_connections 2026-02-20T13:16:41.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.328+0000 7f2f597fa640 1 -- 10.20.193.28:0/1892104163 wait complete. 2026-02-20T13:16:41.430 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-20T13:16:41.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:41 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] up:active 2026-02-20T13:16:41.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:41 trial127 ceph-mon[43817]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2026-02-20T13:16:41.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:41 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:16:41.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:41 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] up:active 2026-02-20T13:16:41.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:41 trial034 ceph-mon[43332]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2026-02-20T13:16:41.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:41 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:16:41.614 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 -- 10.20.193.28:0/2946713723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 msgr2=0x7f4ed81108f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2946713723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 0x7f4ed81108f0 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=5572995842150337304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ec8009980 tx=0x7f4ec802f190 comp rx=0 tx=0).stop 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 -- 10.20.193.28:0/2946713723 shutdown_connections 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2946713723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 0x7f4ed81108f0 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=5572995842150337304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2946713723 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ed8110f10 0x7f4ed81113b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2946713723 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ed810b930 0x7f4ed810bd00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 -- 10.20.193.28:0/2946713723 >> 10.20.193.28:0/2946713723 conn(0x7f4ed80e95c0 msgr2=0x7f4ed81099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 -- 10.20.193.28:0/2946713723 shutdown_connections 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.794+0000 7f4edd39d640 1 -- 10.20.193.28:0/2946713723 wait complete. 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edd39d640 1 Processor -- start 2026-02-20T13:16:41.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edd39d640 1 -- start start 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edd39d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ed810b930 0x7f4ed8122290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edd39d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 0x7f4ed81227d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edd39d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ed8110f10 0x7f4ed8127ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edd39d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed81281c0 con 0x7f4ed810c320 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edd39d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed8128330 con 0x7f4ed8110f10 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edd39d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed81284f0 con 0x7f4ed810b930 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4ed77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 0x7f4ed81227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4ed77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 0x7f4ed81227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47802/0 (socket says 10.20.193.28:47802) 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4ed77fe640 1 -- 10.20.193.28:0/2231446650 learned_addr learned my addr 10.20.193.28:0/2231446650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4ed7fff640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ed810b930 0x7f4ed8122290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.795+0000 7f4edcb9c640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ed8110f10 0x7f4ed8127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed77fe640 1 -- 10.20.193.28:0/2231446650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ed810b930 msgr2=0x7f4ed8122290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed77fe640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ed810b930 0x7f4ed8122290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed77fe640 1 -- 10.20.193.28:0/2231446650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ed8110f10 msgr2=0x7f4ed8127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed77fe640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ed8110f10 0x7f4ed8127ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed77fe640 1 -- 10.20.193.28:0/2231446650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec8009570 con 0x7f4ed810c320 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed77fe640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 0x7f4ed81227d0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ec8038820 tx=0x7f4ec8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed57fa640 1 -- 10.20.193.28:0/2231446650 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ec803d070 con 0x7f4ed810c320 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed57fa640 1 -- 10.20.193.28:0/2231446650 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ec8002ad0 con 0x7f4ed810c320 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4ed57fa640 1 -- 10.20.193.28:0/2231446650 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ec8041960 con 0x7f4ed810c320 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.796+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed81287d0 con 0x7f4ed810c320 2026-02-20T13:16:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.797+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed8168ed0 con 0x7f4ed810c320 2026-02-20T13:16:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.797+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed81289f0 con 0x7f4ed810c320 2026-02-20T13:16:41.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.799+0000 7f4ed57fa640 1 -- 10.20.193.28:0/2231446650 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 157122+0+0 (secure 0 0 0) 0x7f4ec802f9f0 con 0x7f4ed810c320 2026-02-20T13:16:41.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.800+0000 7f4ed57fa640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4eac0b5760 0x7f4eac0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:41.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.800+0000 7f4ed57fa640 1 -- 10.20.193.28:0/2231446650 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4ec810ace0 con 0x7f4ed810c320 2026-02-20T13:16:41.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.801+0000 7f4ed7fff640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4eac0b5760 0x7f4eac0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:41.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.801+0000 7f4ed7fff640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4eac0b5760 0x7f4eac0d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ec4004740 tx=0x7f4ec4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:41.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.802+0000 7f4ed57fa640 1 -- 10.20.193.28:0/2231446650 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f4ec80cd840 con 0x7f4ed810c320 2026-02-20T13:16:41.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.938+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4ed81233f0 con 0x7f4eac0b5760 2026-02-20T13:16:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.954+0000 7f4ed57fa640 1 -- 10.20.193.28:0/2231446650 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ed81233f0 con 0x7f4eac0b5760 2026-02-20T13:16:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4eac0b5760 msgr2=0x7f4eac0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4eac0b5760 0x7f4eac0d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ec4004740 tx=0x7f4ec4005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 msgr2=0x7f4ed81227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 0x7f4ed81227d0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ec8038820 tx=0x7f4ec8004290 comp rx=0 tx=0).stop 2026-02-20T13:16:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 shutdown_connections 2026-02-20T13:16:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4eac0b5760 0x7f4eac0d5c10 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ed810c320 0x7f4ed81227d0 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ed8110f10 0x7f4ed8127ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 --2- 10.20.193.28:0/2231446650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ed810b930 0x7f4ed8122290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 >> 10.20.193.28:0/2231446650 conn(0x7f4ed80e95c0 msgr2=0x7f4ed81099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 shutdown_connections 2026-02-20T13:16:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:41.956+0000 7f4edd39d640 1 -- 10.20.193.28:0/2231446650 wait complete. 2026-02-20T13:16:42.056 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-20T13:16:42.239 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:42.283 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:42 trial028 ceph-mon[37442]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:42.283 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:42 trial028 ceph-mon[37442]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:42.283 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:42 trial028 ceph-mon[37442]: pgmap v160: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.2 KiB/s rd, 7.1 KiB/s wr, 23 op/s 2026-02-20T13:16:42.378 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:42 trial127 ceph-mon[43817]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:42.378 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:42 trial127 ceph-mon[43817]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:42.379 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:42 trial127 ceph-mon[43817]: pgmap v160: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.2 KiB/s rd, 7.1 KiB/s wr, 23 op/s 2026-02-20T13:16:42.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 -- 10.20.193.28:0/3311171729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 msgr2=0x7f0ff0111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:42.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 --2- 10.20.193.28:0/3311171729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 0x7f0ff0111b40 secure :-1 s=READY pgs=221 gs=2 cs=0 l=1 c_cookie=11171120536297957179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fe000a970 tx=0x7f0fe00301b0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 -- 10.20.193.28:0/3311171729 shutdown_connections 2026-02-20T13:16:42.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 --2- 10.20.193.28:0/3311171729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 0x7f0ff0111b40 unknown :-1 s=CLOSED pgs=221 gs=2 cs=0 l=1 c_cookie=11171120536297957179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 --2- 10.20.193.28:0/3311171729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ff010bb40 0x7f0ff01109d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 --2- 10.20.193.28:0/3311171729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ff010b150 0x7f0ff010b520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 -- 10.20.193.28:0/3311171729 >> 10.20.193.28:0/3311171729 conn(0x7f0ff00e8ce0 msgr2=0x7f0ff01090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:42.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 -- 10.20.193.28:0/3311171729 shutdown_connections 2026-02-20T13:16:42.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.425+0000 7f0feffff640 1 -- 10.20.193.28:0/3311171729 wait complete. 2026-02-20T13:16:42.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feffff640 1 Processor -- start 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feffff640 1 -- start start 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ff010b150 0x7f0ff00f1010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ff010bb40 0x7f0ff00f1550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 0x7f0ff00f6920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff00f6f40 con 0x7f0ff0111160 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feffff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff00f70b0 con 0x7f0ff010b150 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feffff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff00f7270 con 0x7f0ff010bb40 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0fef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 0x7f0ff00f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0fef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 0x7f0ff00f6920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47818/0 (socket says 10.20.193.28:47818) 2026-02-20T13:16:42.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0fef7fe640 1 -- 10.20.193.28:0/2242928755 learned_addr learned my addr 10.20.193.28:0/2242928755 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0feeffd640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ff010b150 0x7f0ff00f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.426+0000 7f0fee7fc640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ff010bb40 0x7f0ff00f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0fef7fe640 1 -- 10.20.193.28:0/2242928755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ff010bb40 msgr2=0x7f0ff00f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0fef7fe640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ff010bb40 0x7f0ff00f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0fef7fe640 1 -- 10.20.193.28:0/2242928755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ff010b150 msgr2=0x7f0ff00f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0fef7fe640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ff010b150 0x7f0ff00f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0fef7fe640 1 -- 10.20.193.28:0/2242928755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe000a590 con 0x7f0ff0111160 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0fef7fe640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 0x7f0ff00f6920 secure :-1 s=READY pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fe000a8c0 tx=0x7f0fe0003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0ff48aa640 1 -- 10.20.193.28:0/2242928755 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fe003e070 con 0x7f0ff0111160 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0ff48aa640 1 -- 10.20.193.28:0/2242928755 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0fe0003a90 con 0x7f0ff0111160 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0ff48aa640 1 -- 10.20.193.28:0/2242928755 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fe0042910 con 0x7f0ff0111160 2026-02-20T13:16:42.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0feffff640 1 -- 10.20.193.28:0/2242928755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff00f74f0 con 0x7f0ff0111160 2026-02-20T13:16:42.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.427+0000 7f0feffff640 1 -- 10.20.193.28:0/2242928755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff00f7c30 con 0x7f0ff0111160 2026-02-20T13:16:42.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.428+0000 7f0fce7fc640 1 -- 10.20.193.28:0/2242928755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff00f77c0 con 0x7f0ff0111160 2026-02-20T13:16:42.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.430+0000 7f0ff48aa640 1 -- 10.20.193.28:0/2242928755 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f0fe004a060 con 0x7f0ff0111160 2026-02-20T13:16:42.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.431+0000 7f0ff48aa640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0fc40b57f0 0x7f0fc40d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:42.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.431+0000 7f0ff48aa640 1 -- 10.20.193.28:0/2242928755 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f0fe010c560 con 0x7f0ff0111160 2026-02-20T13:16:42.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.432+0000 7f0feeffd640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0fc40b57f0 0x7f0fc40d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:42.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.433+0000 7f0ff48aa640 1 -- 10.20.193.28:0/2242928755 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f0fe00cefc0 con 0x7f0ff0111160 2026-02-20T13:16:42.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.433+0000 7f0feeffd640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0fc40b57f0 0x7f0fc40d5ca0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fe4004740 tx=0x7f0fe4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:42.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:42 trial034 ceph-mon[43332]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:42.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:42 trial034 ceph-mon[43332]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:42.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:42 trial034 ceph-mon[43332]: pgmap v160: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.2 KiB/s rd, 7.1 KiB/s wr, 23 op/s 2026-02-20T13:16:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.568+0000 7f0fce7fc640 1 -- 10.20.193.28:0/2242928755 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0ff010c270 con 0x7f0fc40b57f0 2026-02-20T13:16:42.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.572+0000 7f0ff48aa640 1 -- 10.20.193.28:0/2242928755 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0ff010c270 con 0x7f0fc40b57f0 2026-02-20T13:16:42.575 INFO:teuthology.orchestra.run.trial028.stdout:/volumes/qa/sv_1/bb7c75c8-c7fe-4589-9211-d37b51867f1c 2026-02-20T13:16:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 -- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0fc40b57f0 msgr2=0x7f0fc40d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0fc40b57f0 0x7f0fc40d5ca0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fe4004740 tx=0x7f0fe4005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 -- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 msgr2=0x7f0ff00f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 0x7f0ff00f6920 secure :-1 s=READY pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fe000a8c0 tx=0x7f0fe0003f70 comp rx=0 tx=0).stop 2026-02-20T13:16:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 -- 10.20.193.28:0/2242928755 shutdown_connections 2026-02-20T13:16:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0fc40b57f0 0x7f0fc40d5ca0 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ff0111160 0x7f0ff00f6920 unknown :-1 s=CLOSED pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ff010bb40 0x7f0ff00f1550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 --2- 10.20.193.28:0/2242928755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ff010b150 0x7f0ff00f1010 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 -- 10.20.193.28:0/2242928755 >> 10.20.193.28:0/2242928755 conn(0x7f0ff00e8ce0 msgr2=0x7f0ff010fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 -- 10.20.193.28:0/2242928755 shutdown_connections 2026-02-20T13:16:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:42.573+0000 7f0fce7fc640 1 -- 10.20.193.28:0/2242928755 wait complete. 2026-02-20T13:16:42.709 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:42.895 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.074+0000 7f02454ed640 1 -- 10.20.193.28:0/1974949273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f024010dc30 msgr2=0x7f0240112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.074+0000 7f02454ed640 1 --2- 10.20.193.28:0/1974949273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f024010dc30 0x7f0240112c80 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=7157074217339964301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0230009890 tx=0x7f023002f120 comp rx=0 tx=0).stop 2026-02-20T13:16:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.074+0000 7f02454ed640 1 -- 10.20.193.28:0/1974949273 shutdown_connections 2026-02-20T13:16:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.074+0000 7f02454ed640 1 --2- 10.20.193.28:0/1974949273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f024010dc30 0x7f0240112c80 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=7157074217339964301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.074+0000 7f02454ed640 1 --2- 10.20.193.28:0/1974949273 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0240113430 0x7f0240173e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.074+0000 7f02454ed640 1 --2- 10.20.193.28:0/1974949273 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f024010d240 0x7f024010d610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.074+0000 7f02454ed640 1 -- 10.20.193.28:0/1974949273 >> 10.20.193.28:0/1974949273 conn(0x7f02400eaad0 msgr2=0x7f024010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.074+0000 7f02454ed640 1 -- 10.20.193.28:0/1974949273 shutdown_connections 2026-02-20T13:16:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.075+0000 7f02454ed640 1 -- 10.20.193.28:0/1974949273 wait complete. 2026-02-20T13:16:43.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.075+0000 7f02454ed640 1 Processor -- start 2026-02-20T13:16:43.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f02454ed640 1 -- start start 2026-02-20T13:16:43.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f02454ed640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f024010d240 0x7f02400f57f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f02454ed640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f024010dc30 0x7f0240173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f02454ed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0240113430 0x7f02400f5ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f02454ed640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02400fb100 con 0x7f0240113430 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f02454ed640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f02400fb270 con 0x7f024010d240 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f02454ed640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f02400fb430 con 0x7f024010dc30 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f024010d240 0x7f02400f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f024010dc30 0x7f0240173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f024010d240 0x7f02400f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47220/0 (socket says 10.20.193.28:47220) 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023ffff640 1 -- 10.20.193.28:0/3124104201 learned_addr learned my addr 10.20.193.28:0/3124104201 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f0244cec640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0240113430 0x7f02400f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:43.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023f7fe640 1 -- 10.20.193.28:0/3124104201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f024010d240 msgr2=0x7f02400f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023f7fe640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f024010d240 0x7f02400f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023f7fe640 1 -- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0240113430 msgr2=0x7f02400f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023f7fe640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0240113430 0x7f02400f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.076+0000 7f023f7fe640 1 -- 10.20.193.28:0/3124104201 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02300094b0 con 0x7f024010dc30 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.077+0000 7f023ffff640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f024010d240 0x7f02400f57f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.077+0000 7f023f7fe640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f024010dc30 0x7f0240173d00 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0230009230 tx=0x7f02300028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.077+0000 7f023d7fa640 1 -- 10.20.193.28:0/3124104201 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f023003d070 con 0x7f024010dc30 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.077+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02400fb6b0 con 0x7f024010dc30 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.077+0000 7f023d7fa640 1 -- 10.20.193.28:0/3124104201 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f023002fcb0 con 0x7f024010dc30 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.077+0000 7f023d7fa640 1 -- 10.20.193.28:0/3124104201 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0230041820 con 0x7f024010dc30 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.077+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02400fbb70 con 0x7f024010dc30 2026-02-20T13:16:43.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.078+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024010e520 con 0x7f024010dc30 2026-02-20T13:16:43.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.080+0000 7f023d7fa640 1 -- 10.20.193.28:0/3124104201 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f02300386b0 con 0x7f024010dc30 2026-02-20T13:16:43.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.081+0000 7f023d7fa640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02140b57e0 0x7f02140d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:43.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.082+0000 7f023d7fa640 1 -- 10.20.193.28:0/3124104201 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f023010b420 con 0x7f024010dc30 2026-02-20T13:16:43.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.082+0000 7f023d7fa640 1 -- 10.20.193.28:0/3124104201 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f023010b8a0 con 0x7f024010dc30 2026-02-20T13:16:43.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.082+0000 7f023ffff640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02140b57e0 0x7f02140d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:43.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.082+0000 7f023ffff640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02140b57e0 0x7f02140d5c90 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f022c0097c0 tx=0x7f022c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.224+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02400f6950 con 0x7f024010dc30 2026-02-20T13:16:43.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:43 trial028 ceph-mon[37442]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:43.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:43 trial028 ceph-mon[37442]: mgrmap e15: x(active, since 3m), standbys: z, y 2026-02-20T13:16:43.228 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:43 trial028 ceph-mon[37442]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:43.228 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:43.229 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-20T13:16:40:073425+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:16:40.073414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.225+0000 7f023d7fa640 1 -- 10.20.193.28:0/3124104201 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11996 (secure 0 0 0) 0x7f02300cdf30 con 0x7f024010dc30 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02140b57e0 msgr2=0x7f02140d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02140b57e0 0x7f02140d5c90 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f022c0097c0 tx=0x7f022c009310 comp rx=0 tx=0).stop 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f024010dc30 msgr2=0x7f0240173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f024010dc30 0x7f0240173d00 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0230009230 tx=0x7f02300028d0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 shutdown_connections 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02140b57e0 0x7f02140d5c90 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0240113430 0x7f02400f5ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f024010dc30 0x7f0240173d00 unknown :-1 s=CLOSED pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 --2- 10.20.193.28:0/3124104201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f024010d240 0x7f02400f57f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.226+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 >> 10.20.193.28:0/3124104201 conn(0x7f02400eaad0 msgr2=0x7f024010bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.227+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 shutdown_connections 2026-02-20T13:16:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.227+0000 7f02454ed640 1 -- 10.20.193.28:0/3124104201 wait complete. 2026-02-20T13:16:43.330 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:16:43.392 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:43 trial034 ceph-mon[43332]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:43.392 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:43 trial034 ceph-mon[43332]: mgrmap e15: x(active, since 3m), standbys: z, y 2026-02-20T13:16:43.392 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:43 trial034 ceph-mon[43332]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:43.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:43 trial127 ceph-mon[43817]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:43.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:43 trial127 ceph-mon[43817]: mgrmap e15: x(active, since 3m), standbys: z, y 2026-02-20T13:16:43.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:43 trial127 ceph-mon[43817]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:16:43.517 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.688+0000 7f6c50a3c640 1 -- 10.20.193.28:0/41022020 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c4c10b930 msgr2=0x7f6c4c10bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.688+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/41022020 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c4c10b930 0x7f6c4c10bd00 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=2958243088689115058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c38009950 tx=0x7f6c3802f190 comp rx=0 tx=0).stop 2026-02-20T13:16:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 -- 10.20.193.28:0/41022020 shutdown_connections 2026-02-20T13:16:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/41022020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c4c10c320 0x7f6c4c1108f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/41022020 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c4c110f10 0x7f6c4c1113b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/41022020 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c4c10b930 0x7f6c4c10bd00 unknown :-1 s=CLOSED pgs=79 gs=1 cs=0 l=1 c_cookie=2958243088689115058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 -- 10.20.193.28:0/41022020 >> 10.20.193.28:0/41022020 conn(0x7f6c4c0e95a0 msgr2=0x7f6c4c1099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 -- 10.20.193.28:0/41022020 shutdown_connections 2026-02-20T13:16:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 -- 10.20.193.28:0/41022020 wait complete. 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 Processor -- start 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.689+0000 7f6c50a3c640 1 -- start start 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c50a3c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c4c10b930 0x7f6c4c122330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c50a3c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c4c10c320 0x7f6c4c122870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c50a3c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c4c110f10 0x7f6c4c127bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c50a3c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c128210 con 0x7f6c4c110f10 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c50a3c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c128380 con 0x7f6c4c10c320 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c50a3c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c128540 con 0x7f6c4c10b930 2026-02-20T13:16:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c4c110f10 0x7f6c4c127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c4c10b930 0x7f6c4c122330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c4c110f10 0x7f6c4c127bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47846/0 (socket says 10.20.193.28:47846) 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 -- 10.20.193.28:0/178537229 learned_addr learned my addr 10.20.193.28:0/178537229 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 -- 10.20.193.28:0/178537229 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c4c10b930 msgr2=0x7f6c4c122330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c4c10b930 0x7f6c4c122330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 -- 10.20.193.28:0/178537229 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c4c10c320 msgr2=0x7f6c4c122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c4c10c320 0x7f6c4c122870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 -- 10.20.193.28:0/178537229 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c0094b0 con 0x7f6c4c110f10 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.690+0000 7f6c4bfff640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c4c110f10 0x7f6c4c127bf0 secure :-1 s=READY pgs=224 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c4000f8d0 tx=0x7f6c4000fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.691+0000 7f6c48ff9640 1 -- 10.20.193.28:0/178537229 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c4000dce0 con 0x7f6c4c110f10 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.691+0000 7f6c48ff9640 1 -- 10.20.193.28:0/178537229 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c4000de40 con 0x7f6c4c110f10 2026-02-20T13:16:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.691+0000 7f6c48ff9640 1 -- 10.20.193.28:0/178537229 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c40011740 con 0x7f6c4c110f10 2026-02-20T13:16:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.691+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c38009570 con 0x7f6c4c110f10 2026-02-20T13:16:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.691+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c168d80 con 0x7f6c4c110f10 2026-02-20T13:16:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.691+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4c0603a0 con 0x7f6c4c110f10 2026-02-20T13:16:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.693+0000 7f6c48ff9640 1 -- 10.20.193.28:0/178537229 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f6c40020060 con 0x7f6c4c110f10 2026-02-20T13:16:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.695+0000 7f6c48ff9640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c200b57f0 0x7f6c200d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.695+0000 7f6c48ff9640 1 -- 10.20.193.28:0/178537229 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6c40015070 con 0x7f6c4c110f10 2026-02-20T13:16:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.695+0000 7f6c48ff9640 1 -- 10.20.193.28:0/178537229 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f6c400a9f60 con 0x7f6c4c110f10 2026-02-20T13:16:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.695+0000 7f6c4b7fe640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c200b57f0 0x7f6c200d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.695+0000 7f6c4b7fe640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c200b57f0 0x7f6c200d5ca0 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c380098a0 tx=0x7f6c3803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:43.740 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:16:43 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: 2026-02-20T13:16:43.587+0000 7f2e3c7fd640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2026-02-20T13:16:43.741 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:16:43 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: 2026-02-20T13:16:43.587+0000 7f2e3c7fd640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2026-02-20T13:16:43.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.809+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c4c123440 con 0x7f6c4c110f10 2026-02-20T13:16:43.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.810+0000 7f6c48ff9640 1 -- 10.20.193.28:0/178537229 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7f6c400a9a10 con 0x7f6c4c110f10 2026-02-20T13:16:43.814 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:43.814 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:16:43.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.812+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c200b57f0 msgr2=0x7f6c200d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.812+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c200b57f0 0x7f6c200d5ca0 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c380098a0 tx=0x7f6c3803a040 comp rx=0 tx=0).stop 2026-02-20T13:16:43.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.812+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c4c110f10 msgr2=0x7f6c4c127bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:43.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.812+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c4c110f10 0x7f6c4c127bf0 secure :-1 s=READY pgs=224 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c4000f8d0 tx=0x7f6c4000fda0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.814+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 shutdown_connections 2026-02-20T13:16:43.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.814+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c200b57f0 0x7f6c200d5ca0 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.814+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c4c110f10 0x7f6c4c127bf0 unknown :-1 s=CLOSED pgs=224 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.814+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c4c10c320 0x7f6c4c122870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.814+0000 7f6c50a3c640 1 --2- 10.20.193.28:0/178537229 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c4c10b930 0x7f6c4c122330 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:43.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.814+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 >> 10.20.193.28:0/178537229 conn(0x7f6c4c0e95a0 msgr2=0x7f6c4c109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:43.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.814+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 shutdown_connections 2026-02-20T13:16:43.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:43.814+0000 7f6c50a3c640 1 -- 10.20.193.28:0/178537229 wait complete. 2026-02-20T13:16:43.916 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-20T13:16:43.916 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T13:16:44.089 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:44 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3124104201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:44.089 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:44 trial028 ceph-mon[37442]: pgmap v161: 97 pgs: 97 active+clean; 591 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 7.3 KiB/s wr, 25 op/s 2026-02-20T13:16:44.089 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:44 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/178537229' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:44.100 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 -- 10.20.193.28:0/2371658399 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c5010d240 msgr2=0x7f6c5010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 --2- 10.20.193.28:0/2371658399 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c5010d240 0x7f6c5010d610 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=4123835514378967912 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c3c009950 tx=0x7f6c3c02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 -- 10.20.193.28:0/2371658399 shutdown_connections 2026-02-20T13:16:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 --2- 10.20.193.28:0/2371658399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c50113430 0x7f6c50173e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 --2- 10.20.193.28:0/2371658399 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c5010dc30 0x7f6c50112c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 --2- 10.20.193.28:0/2371658399 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c5010d240 0x7f6c5010d610 unknown :-1 s=CLOSED pgs=88 gs=1 cs=0 l=1 c_cookie=4123835514378967912 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 -- 10.20.193.28:0/2371658399 >> 10.20.193.28:0/2371658399 conn(0x7f6c500eaad0 msgr2=0x7f6c5010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 -- 10.20.193.28:0/2371658399 shutdown_connections 2026-02-20T13:16:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 -- 10.20.193.28:0/2371658399 wait complete. 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.267+0000 7f6c5517e640 1 Processor -- start 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c5517e640 1 -- start start 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c5517e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c5010d240 0x7f6c500f5750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c5517e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c5010dc30 0x7f6c50173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c5517e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c50113430 0x7f6c500f5e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c5517e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500fb060 con 0x7f6c5010dc30 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c5517e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500fb1d0 con 0x7f6c50113430 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c5517e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500fb390 con 0x7f6c5010d240 2026-02-20T13:16:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c5010dc30 0x7f6c50173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c5497d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c50113430 0x7f6c500f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c5010d240 0x7f6c500f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c5010dc30 0x7f6c50173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47870/0 (socket says 10.20.193.28:47870) 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 -- 10.20.193.28:0/3105552779 learned_addr learned my addr 10.20.193.28:0/3105552779 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 -- 10.20.193.28:0/3105552779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c5010d240 msgr2=0x7f6c500f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c5010d240 0x7f6c500f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 -- 10.20.193.28:0/3105552779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c50113430 msgr2=0x7f6c500f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c50113430 0x7f6c500f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 -- 10.20.193.28:0/3105552779 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c009570 con 0x7f6c5010dc30 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.268+0000 7f6c4f7fe640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c5010dc30 0x7f6c50173d00 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c40009480 tx=0x7f6c4000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.269+0000 7f6c4d7fa640 1 -- 10.20.193.28:0/3105552779 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c4000cd40 con 0x7f6c5010dc30 2026-02-20T13:16:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.269+0000 7f6c4d7fa640 1 -- 10.20.193.28:0/3105552779 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c40004d30 con 0x7f6c5010dc30 2026-02-20T13:16:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.269+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c500fb670 con 0x7f6c5010dc30 2026-02-20T13:16:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.269+0000 7f6c4d7fa640 1 -- 10.20.193.28:0/3105552779 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c400106b0 con 0x7f6c5010dc30 2026-02-20T13:16:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.269+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c500fbb90 con 0x7f6c5010dc30 2026-02-20T13:16:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.269+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5010e520 con 0x7f6c5010dc30 2026-02-20T13:16:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.271+0000 7f6c4d7fa640 1 -- 10.20.193.28:0/3105552779 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f6c4001f060 con 0x7f6c5010dc30 2026-02-20T13:16:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.273+0000 7f6c4d7fa640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c240b57e0 0x7f6c240d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.273+0000 7f6c4d7fa640 1 -- 10.20.193.28:0/3105552779 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6c40014070 con 0x7f6c5010dc30 2026-02-20T13:16:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.273+0000 7f6c4ffff640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c240b57e0 0x7f6c240d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.273+0000 7f6c4d7fa640 1 -- 10.20.193.28:0/3105552779 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f6c400e71f0 con 0x7f6c5010dc30 2026-02-20T13:16:44.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.274+0000 7f6c4ffff640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c240b57e0 0x7f6c240d5c90 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c3c005b30 tx=0x7f6c3c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:44.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.387+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c500f68b0 con 0x7f6c240b57e0 2026-02-20T13:16:44.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.391+0000 7f6c4d7fa640 1 -- 10.20.193.28:0/3105552779 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258953 (secure 0 0 0) 0x7f6c500f68b0 con 0x7f6c240b57e0 2026-02-20T13:16:44.398 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:44.399 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:16:44.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c240b57e0 msgr2=0x7f6c240d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:44.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c240b57e0 0x7f6c240d5c90 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c3c005b30 tx=0x7f6c3c03a040 comp rx=0 tx=0).stop 2026-02-20T13:16:44.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c5010dc30 msgr2=0x7f6c50173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:44.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c5010dc30 0x7f6c50173d00 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c40009480 tx=0x7f6c4000ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:44.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 shutdown_connections 2026-02-20T13:16:44.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c240b57e0 0x7f6c240d5c90 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c5010dc30 0x7f6c50173d00 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c50113430 0x7f6c500f5e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 --2- 10.20.193.28:0/3105552779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c5010d240 0x7f6c500f5750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 >> 10.20.193.28:0/3105552779 conn(0x7f6c500eaad0 msgr2=0x7f6c501103f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:44.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 shutdown_connections 2026-02-20T13:16:44.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.394+0000 7f6c5517e640 1 -- 10.20.193.28:0/3105552779 wait complete. 2026-02-20T13:16:44.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:44 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3124104201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:44.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:44 trial127 ceph-mon[43817]: pgmap v161: 97 pgs: 97 active+clean; 591 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 7.3 KiB/s wr, 25 op/s 2026-02-20T13:16:44.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:44 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/178537229' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:44.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:44 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3124104201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:44.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:44 trial034 ceph-mon[43332]: pgmap v161: 97 pgs: 97 active+clean; 591 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 7.3 KiB/s wr, 25 op/s 2026-02-20T13:16:44.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:44 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/178537229' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:44.493 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2026-02-20T13:16:43.332138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605346,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":148,"num_read_kb":121,"num_write":387,"num_write_kb":3786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327,"ondisk_log_size":327,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335004,"kb_used_data":10412,"kb_used_omap":449,"kb_used_meta":323902,"kb_avail":8807703396,"statfs":{"total":9019431321600,"available":9019088277504,"internally_reserved":0,"allocated":10661888,"data_stored":6745391,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":460557,"internal_metadata":331675891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14978,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":198,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.567313"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:40.071551+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:16:40.071551+0000","last_peered":"2026-02-20T13:16:40.071551+0000","last_clean":"2026-02-20T13:16:40.071551+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:16:40.071551+0000","last_undegraded":"2026-02-20T13:16:40.071551+0000","last_fullsized":"2026-02-20T13:16:40.071551+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:40.071307+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:16:40.071307+0000","last_peered":"2026-02-20T13:16:40.071307+0000","last_clean":"2026-02-20T13:16:40.071307+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:16:40.071307+0000","last_undegraded":"2026-02-20T13:16:40.071307+0000","last_fullsized":"2026-02-20T13:16:40.071307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'13","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:40.080274+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:16:40.080274+0000","last_peered":"2026-02-20T13:16:40.080274+0000","last_clean":"2026-02-20T13:16:40.080274+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:16:40.080274+0000","last_undegraded":"2026-02-20T13:16:40.080274+0000","last_fullsized":"2026-02-20T13:16:40.080274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.796348+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:16:37.796348+0000","last_peered":"2026-02-20T13:16:37.796348+0000","last_clean":"2026-02-20T13:16:37.796348+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:16:37.796348+0000","last_undegraded":"2026-02-20T13:16:37.796348+0000","last_fullsized":"2026-02-20T13:16:37.796348+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:41.075520+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:16:41.075520+0000","last_peered":"2026-02-20T13:16:41.075520+0000","last_clean":"2026-02-20T13:16:41.075520+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:16:41.075520+0000","last_undegraded":"2026-02-20T13:16:41.075520+0000","last_fullsized":"2026-02-20T13:16:41.075520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794861+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:36.794861+0000","last_peered":"2026-02-20T13:16:36.794861+0000","last_clean":"2026-02-20T13:16:36.794861+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:36.794861+0000","last_undegraded":"2026-02-20T13:16:36.794861+0000","last_fullsized":"2026-02-20T13:16:36.794861+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.071150+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:16:39.071150+0000","last_peered":"2026-02-20T13:16:39.071150+0000","last_clean":"2026-02-20T13:16:39.071150+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:16:39.071150+0000","last_undegraded":"2026-02-20T13:16:39.071150+0000","last_fullsized":"2026-02-20T13:16:39.071150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:41.081979+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:16:41.081979+0000","last_peered":"2026-02-20T13:16:41.081979+0000","last_clean":"2026-02-20T13:16:41.081979+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:16:41.081979+0000","last_undegraded":"2026-02-20T13:16:41.081979+0000","last_fullsized":"2026-02-20T13:16:41.081979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775960+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:34.775960+0000","last_peered":"2026-02-20T13:16:34.775960+0000","last_clean":"2026-02-20T13:16:34.775960+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:34.775960+0000","last_undegraded":"2026-02-20T13:16:34.775960+0000","last_fullsized":"2026-02-20T13:16:34.775960+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.806583+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:38.806583+0000","last_peered":"2026-02-20T13:16:38.806583+0000","last_clean":"2026-02-20T13:16:38.806583+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:38.806583+0000","last_undegraded":"2026-02-20T13:16:38.806583+0000","last_fullsized":"2026-02-20T13:16:38.806583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.796015+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:36.796015+0000","last_peered":"2026-02-20T13:16:36.796015+0000","last_clean":"2026-02-20T13:16:36.796015+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:36.796015+0000","last_undegraded":"2026-02-20T13:16:36.796015+0000","last_fullsized":"2026-02-20T13:16:36.796015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.076095+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:16:39.076095+0000","last_peered":"2026-02-20T13:16:39.076095+0000","last_clean":"2026-02-20T13:16:39.076095+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:16:39.076095+0000","last_undegraded":"2026-02-20T13:16:39.076095+0000","last_fullsized":"2026-02-20T13:16:39.076095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":14861,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":197,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":77590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170154,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612615,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841544,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27892,"kb_used_data":928,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975308,"statfs":{"total":751619276800,"available":751590715392,"internally_reserved":0,"allocated":950272,"data_stored":1004374,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972361,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28068,"kb_used_data":848,"kb_used_omap":24,"kb_used_meta":27175,"kb_avail":733975132,"statfs":{"total":751619276800,"available":751590535168,"internally_reserved":0,"allocated":868352,"data_stored":411544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24873,"internal_metadata":27827927},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928233996,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34876,"internal_metadata":27555780},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1004695,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593743,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28060,"kb_used_data":840,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975140,"statfs":{"total":751619276800,"available":751590543360,"internally_reserved":0,"allocated":860160,"data_stored":411336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855378,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27880,"kb_used_data":916,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975320,"statfs":{"total":751619276800,"available":751590727680,"internally_reserved":0,"allocated":937984,"data_stored":1003868,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986195,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37423,"internal_metadata":27553233},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215125,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28072,"kb_used_data":852,"kb_used_omap":44,"kb_used_meta":27155,"kb_avail":733975128,"statfs":{"total":751619276800,"available":751590531072,"internally_reserved":0,"allocated":872448,"data_stored":411044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45352,"internal_metadata":27807448},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":438202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":412248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4840,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7911,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26316,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28040,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":10553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:16:44.500 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T13:16:44.685 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:44.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 -- 10.20.193.28:0/2945962498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 msgr2=0x7f77dc061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:44.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 --2- 10.20.193.28:0/2945962498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 0x7f77dc061300 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=4029877739543476786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77cc009950 tx=0x7f77cc02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:44.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 -- 10.20.193.28:0/2945962498 shutdown_connections 2026-02-20T13:16:44.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 --2- 10.20.193.28:0/2945962498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f77dc155980 0x7f77dc175d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 --2- 10.20.193.28:0/2945962498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f77dc061840 0x7f77dc155440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 --2- 10.20.193.28:0/2945962498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 0x7f77dc061300 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=4029877739543476786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 -- 10.20.193.28:0/2945962498 >> 10.20.193.28:0/2945962498 conn(0x7f77dc0eaad0 msgr2=0x7f77dc10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:44.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 -- 10.20.193.28:0/2945962498 shutdown_connections 2026-02-20T13:16:44.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.877+0000 7f77e233c640 1 -- 10.20.193.28:0/2945962498 wait complete. 2026-02-20T13:16:44.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e233c640 1 Processor -- start 2026-02-20T13:16:44.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e233c640 1 -- start start 2026-02-20T13:16:44.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e233c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 0x7f77dc1620f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:44.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e233c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f77dc061840 0x7f77dc162630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:44.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e233c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f77dc155980 0x7f77dc167a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:44.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e233c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc168020 con 0x7f77dc060f30 2026-02-20T13:16:44.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e233c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc168190 con 0x7f77dc061840 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e233c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc168350 con 0x7f77dc155980 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e133a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 0x7f77dc1620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e0b39640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f77dc061840 0x7f77dc162630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e133a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 0x7f77dc1620f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47894/0 (socket says 10.20.193.28:47894) 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e133a640 1 -- 10.20.193.28:0/2596219605 learned_addr learned my addr 10.20.193.28:0/2596219605 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e1b3b640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f77dc155980 0x7f77dc167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e133a640 1 -- 10.20.193.28:0/2596219605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f77dc155980 msgr2=0x7f77dc167a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e133a640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f77dc155980 0x7f77dc167a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e133a640 1 -- 10.20.193.28:0/2596219605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f77dc061840 msgr2=0x7f77dc162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e133a640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f77dc061840 0x7f77dc162630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e133a640 1 -- 10.20.193.28:0/2596219605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77cc009570 con 0x7f77dc060f30 2026-02-20T13:16:44.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.878+0000 7f77e1b3b640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f77dc155980 0x7f77dc167a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.879+0000 7f77e133a640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 0x7f77dc1620f0 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77cc038820 tx=0x7f77cc0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.879+0000 7f77ca7fc640 1 -- 10.20.193.28:0/2596219605 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77cc03d070 con 0x7f77dc060f30 2026-02-20T13:16:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.879+0000 7f77ca7fc640 1 -- 10.20.193.28:0/2596219605 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f77cc038920 con 0x7f77dc060f30 2026-02-20T13:16:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.879+0000 7f77ca7fc640 1 -- 10.20.193.28:0/2596219605 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77cc041960 con 0x7f77dc060f30 2026-02-20T13:16:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.879+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77dc1685d0 con 0x7f77dc060f30 2026-02-20T13:16:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.879+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77dc151400 con 0x7f77dc060f30 2026-02-20T13:16:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.879+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77dc062440 con 0x7f77dc060f30 2026-02-20T13:16:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.881+0000 7f77ca7fc640 1 -- 10.20.193.28:0/2596219605 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f77cc038a90 con 0x7f77dc060f30 2026-02-20T13:16:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.883+0000 7f77ca7fc640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f77b80b57f0 0x7f77b80d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.883+0000 7f77ca7fc640 1 -- 10.20.193.28:0/2596219605 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f77cc10b4b0 con 0x7f77dc060f30 2026-02-20T13:16:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.883+0000 7f77ca7fc640 1 -- 10.20.193.28:0/2596219605 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f77cc10b930 con 0x7f77dc060f30 2026-02-20T13:16:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.883+0000 7f77e0b39640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f77b80b57f0 0x7f77b80d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:44.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.884+0000 7f77e0b39640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f77b80b57f0 0x7f77b80d5ca0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77dc168a90 tx=0x7f77d000b360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.995+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77dc163250 con 0x7f77b80b57f0 2026-02-20T13:16:45.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:44.999+0000 7f77ca7fc640 1 -- 10.20.193.28:0/2596219605 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258953 (secure 0 0 0) 0x7f77dc163250 con 0x7f77b80b57f0 2026-02-20T13:16:45.002 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:45.004 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:16:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f77b80b57f0 msgr2=0x7f77b80d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f77b80b57f0 0x7f77b80d5ca0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77dc168a90 tx=0x7f77d000b360 comp rx=0 tx=0).stop 2026-02-20T13:16:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 msgr2=0x7f77dc1620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 0x7f77dc1620f0 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77cc038820 tx=0x7f77cc0043d0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 shutdown_connections 2026-02-20T13:16:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f77b80b57f0 0x7f77b80d5ca0 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f77dc155980 0x7f77dc167a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f77dc061840 0x7f77dc162630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 --2- 10.20.193.28:0/2596219605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77dc060f30 0x7f77dc1620f0 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 >> 10.20.193.28:0/2596219605 conn(0x7f77dc0eaad0 msgr2=0x7f77dc10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.001+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 shutdown_connections 2026-02-20T13:16:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.002+0000 7f77e233c640 1 -- 10.20.193.28:0/2596219605 wait complete. 2026-02-20T13:16:45.140 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2026-02-20T13:16:43.332138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605346,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":148,"num_read_kb":121,"num_write":387,"num_write_kb":3786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327,"ondisk_log_size":327,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335004,"kb_used_data":10412,"kb_used_omap":449,"kb_used_meta":323902,"kb_avail":8807703396,"statfs":{"total":9019431321600,"available":9019088277504,"internally_reserved":0,"allocated":10661888,"data_stored":6745391,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":460557,"internal_metadata":331675891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14978,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":198,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.567313"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:40.071551+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:16:40.071551+0000","last_peered":"2026-02-20T13:16:40.071551+0000","last_clean":"2026-02-20T13:16:40.071551+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:16:40.071551+0000","last_undegraded":"2026-02-20T13:16:40.071551+0000","last_fullsized":"2026-02-20T13:16:40.071551+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:40.071307+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:16:40.071307+0000","last_peered":"2026-02-20T13:16:40.071307+0000","last_clean":"2026-02-20T13:16:40.071307+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:16:40.071307+0000","last_undegraded":"2026-02-20T13:16:40.071307+0000","last_fullsized":"2026-02-20T13:16:40.071307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'13","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:40.080274+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:16:40.080274+0000","last_peered":"2026-02-20T13:16:40.080274+0000","last_clean":"2026-02-20T13:16:40.080274+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:16:40.080274+0000","last_undegraded":"2026-02-20T13:16:40.080274+0000","last_fullsized":"2026-02-20T13:16:40.080274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.796348+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:16:37.796348+0000","last_peered":"2026-02-20T13:16:37.796348+0000","last_clean":"2026-02-20T13:16:37.796348+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:16:37.796348+0000","last_undegraded":"2026-02-20T13:16:37.796348+0000","last_fullsized":"2026-02-20T13:16:37.796348+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:41.075520+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:16:41.075520+0000","last_peered":"2026-02-20T13:16:41.075520+0000","last_clean":"2026-02-20T13:16:41.075520+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:16:41.075520+0000","last_undegraded":"2026-02-20T13:16:41.075520+0000","last_fullsized":"2026-02-20T13:16:41.075520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794861+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:36.794861+0000","last_peered":"2026-02-20T13:16:36.794861+0000","last_clean":"2026-02-20T13:16:36.794861+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:36.794861+0000","last_undegraded":"2026-02-20T13:16:36.794861+0000","last_fullsized":"2026-02-20T13:16:36.794861+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.071150+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:16:39.071150+0000","last_peered":"2026-02-20T13:16:39.071150+0000","last_clean":"2026-02-20T13:16:39.071150+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:16:39.071150+0000","last_undegraded":"2026-02-20T13:16:39.071150+0000","last_fullsized":"2026-02-20T13:16:39.071150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:41.081979+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:16:41.081979+0000","last_peered":"2026-02-20T13:16:41.081979+0000","last_clean":"2026-02-20T13:16:41.081979+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:16:41.081979+0000","last_undegraded":"2026-02-20T13:16:41.081979+0000","last_fullsized":"2026-02-20T13:16:41.081979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775960+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:34.775960+0000","last_peered":"2026-02-20T13:16:34.775960+0000","last_clean":"2026-02-20T13:16:34.775960+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:34.775960+0000","last_undegraded":"2026-02-20T13:16:34.775960+0000","last_fullsized":"2026-02-20T13:16:34.775960+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.806583+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:38.806583+0000","last_peered":"2026-02-20T13:16:38.806583+0000","last_clean":"2026-02-20T13:16:38.806583+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:38.806583+0000","last_undegraded":"2026-02-20T13:16:38.806583+0000","last_fullsized":"2026-02-20T13:16:38.806583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.796015+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:36.796015+0000","last_peered":"2026-02-20T13:16:36.796015+0000","last_clean":"2026-02-20T13:16:36.796015+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:36.796015+0000","last_undegraded":"2026-02-20T13:16:36.796015+0000","last_fullsized":"2026-02-20T13:16:36.796015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.076095+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:16:39.076095+0000","last_peered":"2026-02-20T13:16:39.076095+0000","last_clean":"2026-02-20T13:16:39.076095+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:16:39.076095+0000","last_undegraded":"2026-02-20T13:16:39.076095+0000","last_fullsized":"2026-02-20T13:16:39.076095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":14861,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":197,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":77590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170154,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612615,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841544,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27892,"kb_used_data":928,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975308,"statfs":{"total":751619276800,"available":751590715392,"internally_reserved":0,"allocated":950272,"data_stored":1004374,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972361,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28068,"kb_used_data":848,"kb_used_omap":24,"kb_used_meta":27175,"kb_avail":733975132,"statfs":{"total":751619276800,"available":751590535168,"internally_reserved":0,"allocated":868352,"data_stored":411544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24873,"internal_metadata":27827927},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928233996,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34876,"internal_metadata":27555780},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1004695,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593743,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28060,"kb_used_data":840,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975140,"statfs":{"total":751619276800,"available":751590543360,"internally_reserved":0,"allocated":860160,"data_stored":411336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855378,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27880,"kb_used_data":916,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975320,"statfs":{"total":751619276800,"available":751590727680,"internally_reserved":0,"allocated":937984,"data_stored":1003868,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986195,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37423,"internal_metadata":27553233},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215125,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28072,"kb_used_data":852,"kb_used_omap":44,"kb_used_meta":27155,"kb_avail":733975128,"statfs":{"total":751619276800,"available":751590531072,"internally_reserved":0,"allocated":872448,"data_stored":411044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45352,"internal_metadata":27807448},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":438202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":412248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4840,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7911,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26316,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28040,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":10553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:16:45.148 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-20T13:16:45.149 INFO:tasks.cephadm:Setting up client nodes... 2026-02-20T13:16:45.149 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-20T13:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:45.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:45 trial028 ceph-mon[37442]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:45.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:45 trial127 ceph-mon[43817]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:45.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:45 trial034 ceph-mon[43332]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:45.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 -- 10.20.193.28:0/1085732987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2814e730 msgr2=0x7faf2816ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:45.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/1085732987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2814e730 0x7faf2816ebe0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=17655240190331700853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2400aa30 tx=0x7faf24030270 comp rx=0 tx=0).stop 2026-02-20T13:16:45.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 -- 10.20.193.28:0/1085732987 shutdown_connections 2026-02-20T13:16:45.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/1085732987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2814e730 0x7faf2816ebe0 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=17655240190331700853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/1085732987 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf2812dc90 0x7faf2814e070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/1085732987 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf280607e0 0x7faf2812d750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 -- 10.20.193.28:0/1085732987 >> 10.20.193.28:0/1085732987 conn(0x7faf280e9050 msgr2=0x7faf28109460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:45.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 -- 10.20.193.28:0/1085732987 shutdown_connections 2026-02-20T13:16:45.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.520+0000 7faf2e6e8640 1 -- 10.20.193.28:0/1085732987 wait complete. 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2e6e8640 1 Processor -- start 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2e6e8640 1 -- start start 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2e6e8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf280607e0 0x7faf2816eb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2e6e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2812dc90 0x7faf28109430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2e6e8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf2814e730 0x7faf2811bb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2e6e8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf2811c310 con 0x7faf2812dc90 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2e6e8640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7faf2811c480 con 0x7faf2814e730 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2e6e8640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7faf2811c640 con 0x7faf280607e0 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2cee5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2812dc90 0x7faf28109430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:45.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2d6e6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf280607e0 0x7faf2816eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2cee5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2812dc90 0x7faf28109430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47906/0 (socket says 10.20.193.28:47906) 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2cee5640 1 -- 10.20.193.28:0/4088503066 learned_addr learned my addr 10.20.193.28:0/4088503066 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.521+0000 7faf2dee7640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf2814e730 0x7faf2811bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf2cee5640 1 -- 10.20.193.28:0/4088503066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf280607e0 msgr2=0x7faf2816eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf2cee5640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf280607e0 0x7faf2816eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf2cee5640 1 -- 10.20.193.28:0/4088503066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf2814e730 msgr2=0x7faf2811bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf2cee5640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf2814e730 0x7faf2811bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf2cee5640 1 -- 10.20.193.28:0/4088503066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2400a650 con 0x7faf2812dc90 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf2cee5640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2812dc90 0x7faf28109430 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf14005db0 tx=0x7faf1400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf1a7fc640 1 -- 10.20.193.28:0/4088503066 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf14004500 con 0x7faf2812dc90 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf1a7fc640 1 -- 10.20.193.28:0/4088503066 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faf14004d30 con 0x7faf2812dc90 2026-02-20T13:16:45.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf1a7fc640 1 -- 10.20.193.28:0/4088503066 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf14005330 con 0x7faf2812dc90 2026-02-20T13:16:45.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2811cdd0 con 0x7faf2812dc90 2026-02-20T13:16:45.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.522+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2811d250 con 0x7faf2812dc90 2026-02-20T13:16:45.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.523+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf28172f80 con 0x7faf2812dc90 2026-02-20T13:16:45.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.525+0000 7faf1a7fc640 1 -- 10.20.193.28:0/4088503066 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7faf140098c0 con 0x7faf2812dc90 2026-02-20T13:16:45.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.526+0000 7faf1a7fc640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf040b57f0 0x7faf040d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:45.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.526+0000 7faf1a7fc640 1 -- 10.20.193.28:0/4088503066 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7faf140e6ef0 con 0x7faf2812dc90 2026-02-20T13:16:45.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.526+0000 7faf2d6e6640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf040b57f0 0x7faf040d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:45.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.526+0000 7faf1a7fc640 1 -- 10.20.193.28:0/4088503066 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7faf140e7370 con 0x7faf2812dc90 2026-02-20T13:16:45.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.527+0000 7faf2d6e6640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf040b57f0 0x7faf040d5ca0 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf1c004740 tx=0x7faf1c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:45.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.684+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7faf28172620 con 0x7faf2812dc90 2026-02-20T13:16:45.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.685+0000 7faf1a7fc640 1 -- 10.20.193.28:0/4088503066 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7faf140a9840 con 0x7faf2812dc90 2026-02-20T13:16:45.688 INFO:teuthology.orchestra.run.trial028.stdout:[client.0] 2026-02-20T13:16:45.689 INFO:teuthology.orchestra.run.trial028.stdout: key = AQC9XphpcHbZKBAAwaPfws/JoAiAwx1VJv5h1Q== 2026-02-20T13:16:45.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf040b57f0 msgr2=0x7faf040d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:45.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf040b57f0 0x7faf040d5ca0 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf1c004740 tx=0x7faf1c00b410 comp rx=0 tx=0).stop 2026-02-20T13:16:45.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2812dc90 msgr2=0x7faf28109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:45.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2812dc90 0x7faf28109430 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf14005db0 tx=0x7faf1400ddf0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 shutdown_connections 2026-02-20T13:16:45.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf040b57f0 0x7faf040d5ca0 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf2812dc90 0x7faf28109430 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf2814e730 0x7faf2811bb80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 --2- 10.20.193.28:0/4088503066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf280607e0 0x7faf2816eb10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:45.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 >> 10.20.193.28:0/4088503066 conn(0x7faf280e9050 msgr2=0x7faf2810b520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:45.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 shutdown_connections 2026-02-20T13:16:45.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:45.687+0000 7faf2e6e8640 1 -- 10.20.193.28:0/4088503066 wait complete. 2026-02-20T13:16:45.787 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:16:45.787 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-20T13:16:45.788 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T13:16:45.865 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-20T13:16:46.087 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:46.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:46 trial028 ceph-mon[37442]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:46.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:46 trial028 ceph-mon[37442]: pgmap v162: 97 pgs: 97 active+clean; 592 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 7.1 KiB/s wr, 26 op/s 2026-02-20T13:16:46.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:46 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4088503066' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-20T13:16:46.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:46 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4088503066' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T13:16:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 -- 10.20.193.28:0/1699835162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 msgr2=0x7fd4e010f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 --2- 10.20.193.28:0/1699835162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 0x7fd4e010f880 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=3680343199865232152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4d4009950 tx=0x7fd4d402f190 comp rx=0 tx=0).stop 2026-02-20T13:16:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 -- 10.20.193.28:0/1699835162 shutdown_connections 2026-02-20T13:16:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 --2- 10.20.193.28:0/1699835162 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4e01156a0 0x7fd4e0176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 --2- 10.20.193.28:0/1699835162 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4e010fea0 0x7fd4e0114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 --2- 10.20.193.28:0/1699835162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 0x7fd4e010f880 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=3680343199865232152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 -- 10.20.193.28:0/1699835162 >> 10.20.193.28:0/1699835162 conn(0x7fd4e00ecda0 msgr2=0x7fd4e010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 -- 10.20.193.28:0/1699835162 shutdown_connections 2026-02-20T13:16:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 -- 10.20.193.28:0/1699835162 wait complete. 2026-02-20T13:16:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.263+0000 7fd4dffff640 1 Processor -- start 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4dffff640 1 -- start start 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4dffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 0x7fd4e0066f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4dffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4e010fea0 0x7fd4e00631a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4dffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4e01156a0 0x7fd4e0063850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4dffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0063fe0 con 0x7fd4e010f4b0 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4dffff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01685e0 con 0x7fd4e01156a0 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4dffff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01687a0 con 0x7fd4e010fea0 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 0x7fd4e0066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 0x7fd4e0066f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47918/0 (socket says 10.20.193.28:47918) 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4deffd640 1 -- 10.20.193.28:0/2039675595 learned_addr learned my addr 10.20.193.28:0/2039675595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4de7fc640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4e010fea0 0x7fd4e00631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4df7fe640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4e01156a0 0x7fd4e0063850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4deffd640 1 -- 10.20.193.28:0/2039675595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4e010fea0 msgr2=0x7fd4e00631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4deffd640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4e010fea0 0x7fd4e00631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4deffd640 1 -- 10.20.193.28:0/2039675595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4e01156a0 msgr2=0x7fd4e0063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4deffd640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4e01156a0 0x7fd4e0063850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.264+0000 7fd4deffd640 1 -- 10.20.193.28:0/2039675595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d4009570 con 0x7fd4e010f4b0 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.265+0000 7fd4deffd640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 0x7fd4e0066f30 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4d4038820 tx=0x7fd4d40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.265+0000 7fd4e484c640 1 -- 10.20.193.28:0/2039675595 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4d403d070 con 0x7fd4e010f4b0 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.265+0000 7fd4e484c640 1 -- 10.20.193.28:0/2039675595 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4d4038920 con 0x7fd4e010f4b0 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.265+0000 7fd4e484c640 1 -- 10.20.193.28:0/2039675595 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4d4041960 con 0x7fd4e010f4b0 2026-02-20T13:16:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.265+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e01689c0 con 0x7fd4e010f4b0 2026-02-20T13:16:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.265+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e0168de0 con 0x7fd4e010f4b0 2026-02-20T13:16:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.265+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e0110790 con 0x7fd4e010f4b0 2026-02-20T13:16:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.268+0000 7fd4e484c640 1 -- 10.20.193.28:0/2039675595 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fd4d4038a90 con 0x7fd4e010f4b0 2026-02-20T13:16:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.269+0000 7fd4e484c640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4b40b57f0 0x7fd4b40d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.269+0000 7fd4e484c640 1 -- 10.20.193.28:0/2039675595 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fd4d410b440 con 0x7fd4e010f4b0 2026-02-20T13:16:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.269+0000 7fd4de7fc640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4b40b57f0 0x7fd4b40d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.269+0000 7fd4e484c640 1 -- 10.20.193.28:0/2039675595 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fd4d410b8c0 con 0x7fd4e010f4b0 2026-02-20T13:16:46.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.270+0000 7fd4de7fc640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4b40b57f0 0x7fd4b40d5ca0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4e010dac0 tx=0x7fd4c800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:46.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.384+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fd4e00644a0 con 0x7fd4e010f4b0 2026-02-20T13:16:46.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.384+0000 7fd4e484c640 1 -- 10.20.193.28:0/2039675595 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) ==== 86+0+133 (secure 0 0 0) 0x7fd4d40cdf30 con 0x7fd4e010f4b0 2026-02-20T13:16:46.387 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:46.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4b40b57f0 msgr2=0x7fd4b40d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4b40b57f0 0x7fd4b40d5ca0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4e010dac0 tx=0x7fd4c800b410 comp rx=0 tx=0).stop 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 msgr2=0x7fd4e0066f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 0x7fd4e0066f30 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4d4038820 tx=0x7fd4d40043d0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 shutdown_connections 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4b40b57f0 0x7fd4b40d5ca0 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4e01156a0 0x7fd4e0063850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4e010fea0 0x7fd4e00631a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 --2- 10.20.193.28:0/2039675595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e010f4b0 0x7fd4e0066f30 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 >> 10.20.193.28:0/2039675595 conn(0x7fd4e00ecda0 msgr2=0x7fd4e010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 shutdown_connections 2026-02-20T13:16:46.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.385+0000 7fd4dffff640 1 -- 10.20.193.28:0/2039675595 wait complete. 2026-02-20T13:16:46.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:46 trial127 ceph-mon[43817]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:46 trial127 ceph-mon[43817]: pgmap v162: 97 pgs: 97 active+clean; 592 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 7.1 KiB/s wr, 26 op/s 2026-02-20T13:16:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:46 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4088503066' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-20T13:16:46.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:46 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4088503066' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T13:16:46.486 INFO:teuthology.orchestra.run.trial028.stdout:[{"version":46,"timestamp":"2026-02-20T13:16:28.365911+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-20T13:16:46.487 INFO:tasks.ceph_manager:config epoch is 46 2026-02-20T13:16:46.487 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T13:16:46.487 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-20T13:16:46.487 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-20T13:16:46.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:46 trial034 ceph-mon[43332]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:46.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:46 trial034 ceph-mon[43332]: pgmap v162: 97 pgs: 97 active+clean; 592 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 7.1 KiB/s wr, 26 op/s 2026-02-20T13:16:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:46 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4088503066' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-20T13:16:46.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:46 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4088503066' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T13:16:46.672 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:46.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 -- 10.20.193.28:0/3956510646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe79410ee70 msgr2=0x7fe79410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 --2- 10.20.193.28:0/3956510646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe79410ee70 0x7fe79410f2b0 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=5679339987279384918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe78800aa30 tx=0x7fe788030280 comp rx=0 tx=0).stop 2026-02-20T13:16:46.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 -- 10.20.193.28:0/3956510646 shutdown_connections 2026-02-20T13:16:46.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 --2- 10.20.193.28:0/3956510646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe79410ee70 0x7fe79410f2b0 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=5679339987279384918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 --2- 10.20.193.28:0/3956510646 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe79410be40 0x7fe79410e820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 --2- 10.20.193.28:0/3956510646 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe79410b530 0x7fe79410b900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 -- 10.20.193.28:0/3956510646 >> 10.20.193.28:0/3956510646 conn(0x7fe7940e9080 msgr2=0x7fe794109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:46.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 -- 10.20.193.28:0/3956510646 shutdown_connections 2026-02-20T13:16:46.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.836+0000 7fe79935d640 1 -- 10.20.193.28:0/3956510646 wait complete. 2026-02-20T13:16:46.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.837+0000 7fe79935d640 1 Processor -- start 2026-02-20T13:16:46.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.837+0000 7fe79935d640 1 -- start start 2026-02-20T13:16:46.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe79935d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe79410b530 0x7fe794122e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:46.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe79935d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe79410be40 0x7fe794123350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:46.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe79935d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe79410ee70 0x7fe794128720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:46.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe79935d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe794128d40 con 0x7fe79410be40 2026-02-20T13:16:46.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe79935d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe794128eb0 con 0x7fe79410b530 2026-02-20T13:16:46.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe79935d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe794129070 con 0x7fe79410ee70 2026-02-20T13:16:46.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe793fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe79410b530 0x7fe794122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:46.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe793fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe79410b530 0x7fe794122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47302/0 (socket says 10.20.193.28:47302) 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe793fff640 1 -- 10.20.193.28:0/2993734958 learned_addr learned my addr 10.20.193.28:0/2993734958 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe7937fe640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe79410be40 0x7fe794123350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe798b5c640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe79410ee70 0x7fe794128720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe793fff640 1 -- 10.20.193.28:0/2993734958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe79410ee70 msgr2=0x7fe794128720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe793fff640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe79410ee70 0x7fe794128720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe793fff640 1 -- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe79410be40 msgr2=0x7fe794123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe793fff640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe79410be40 0x7fe794123350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe793fff640 1 -- 10.20.193.28:0/2993734958 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78800a650 con 0x7fe79410b530 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.838+0000 7fe798b5c640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe79410ee70 0x7fe794128720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.839+0000 7fe793fff640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe79410b530 0x7fe794122e10 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe780009480 tx=0x7fe78000ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.839+0000 7fe7917fa640 1 -- 10.20.193.28:0/2993734958 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe78000cd40 con 0x7fe79410b530 2026-02-20T13:16:46.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.839+0000 7fe7917fa640 1 -- 10.20.193.28:0/2993734958 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe780004d30 con 0x7fe79410b530 2026-02-20T13:16:46.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.839+0000 7fe7917fa640 1 -- 10.20.193.28:0/2993734958 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe780010740 con 0x7fe79410b530 2026-02-20T13:16:46.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.839+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe794129350 con 0x7fe79410b530 2026-02-20T13:16:46.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.839+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe794169a50 con 0x7fe79410b530 2026-02-20T13:16:46.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.839+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe794129570 con 0x7fe79410b530 2026-02-20T13:16:46.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.842+0000 7fe7917fa640 1 -- 10.20.193.28:0/2993734958 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fe78001f060 con 0x7fe79410b530 2026-02-20T13:16:46.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.843+0000 7fe7917fa640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7680b57f0 0x7fe7680d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:46.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.843+0000 7fe7917fa640 1 -- 10.20.193.28:0/2993734958 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fe780014070 con 0x7fe79410b530 2026-02-20T13:16:46.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.844+0000 7fe7917fa640 1 -- 10.20.193.28:0/2993734958 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe7800e70e0 con 0x7fe79410b530 2026-02-20T13:16:46.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.844+0000 7fe7937fe640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7680b57f0 0x7fe7680d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:46.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.844+0000 7fe7937fe640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7680b57f0 0x7fe7680d5ca0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7941297b0 tx=0x7fe784005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.986+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe794123f70 con 0x7fe79410b530 2026-02-20T13:16:46.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.989+0000 7fe7917fa640 1 -- 10.20.193.28:0/2993734958 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v15) ==== 74+0+297630 (secure 0 0 0) 0x7fe7800a9770 con 0x7fe79410b530 2026-02-20T13:16:46.996 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7680b57f0 msgr2=0x7fe7680d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7680b57f0 0x7fe7680d5ca0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7941297b0 tx=0x7fe784005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe79410b530 msgr2=0x7fe794122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe79410b530 0x7fe794122e10 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe780009480 tx=0x7fe78000ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 shutdown_connections 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7680b57f0 0x7fe7680d5ca0 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe79410be40 0x7fe794123350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe79410ee70 0x7fe794128720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 --2- 10.20.193.28:0/2993734958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe79410b530 0x7fe794122e10 unknown :-1 s=CLOSED pgs=89 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 >> 10.20.193.28:0/2993734958 conn(0x7fe7940e9080 msgr2=0x7fe794109460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 shutdown_connections 2026-02-20T13:16:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:46.992+0000 7fe79935d640 1 -- 10.20.193.28:0/2993734958 wait complete. 2026-02-20T13:16:47.131 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":15,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":1124954776},{"type":"v1","addr":"10.20.193.28:6801","nonce":1124954776}]},"active_addr":"10.20.193.28:6801/1124954776","active_change":"2026-02-20T13:13:37.304927+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":14235,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.28:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":4267729573}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":2351717990}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":803030585}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":2788676170}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":3953639375}]}]} 2026-02-20T13:16:47.139 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-20T13:16:47.139 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-20T13:16:47.140 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:16:47.324 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:47.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:47 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2039675595' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-20T13:16:47.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:47 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2993734958' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-20T13:16:47.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:47 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2039675595' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-20T13:16:47.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:47 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2993734958' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-20T13:16:47.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:47 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2039675595' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-20T13:16:47.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:47 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2993734958' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-20T13:16:47.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 -- 10.20.193.28:0/3455274961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97d010f230 msgr2=0x7f97d010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:47.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 --2- 10.20.193.28:0/3455274961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97d010f230 0x7f97d010f600 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=13176732462632913152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c0009950 tx=0x7f97c002f190 comp rx=0 tx=0).stop 2026-02-20T13:16:47.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 -- 10.20.193.28:0/3455274961 shutdown_connections 2026-02-20T13:16:47.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 --2- 10.20.193.28:0/3455274961 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97d0115420 0x7f97d0175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 --2- 10.20.193.28:0/3455274961 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97d010fc20 0x7f97d0114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 --2- 10.20.193.28:0/3455274961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97d010f230 0x7f97d010f600 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=13176732462632913152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 -- 10.20.193.28:0/3455274961 >> 10.20.193.28:0/3455274961 conn(0x7f97d005f830 msgr2=0x7f97d010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:47.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 -- 10.20.193.28:0/3455274961 shutdown_connections 2026-02-20T13:16:47.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.510+0000 7f97d73d0640 1 -- 10.20.193.28:0/3455274961 wait complete. 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.511+0000 7f97d73d0640 1 Processor -- start 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.511+0000 7f97d73d0640 1 -- start start 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d73d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97d010f230 0x7f97d011db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d73d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97d010fc20 0x7f97d011e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d73d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97d0115420 0x7f97d0123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d73d0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0123a60 con 0x7f97d0115420 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d73d0640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0123bd0 con 0x7f97d010f230 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d73d0640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0123d90 con 0x7f97d010fc20 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97d010f230 0x7f97d011db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:47.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97d010f230 0x7f97d011db30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47308/0 (socket says 10.20.193.28:47308) 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 -- 10.20.193.28:0/2878362097 learned_addr learned my addr 10.20.193.28:0/2878362097 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d4944640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97d010fc20 0x7f97d011e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5946640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97d0115420 0x7f97d0123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 -- 10.20.193.28:0/2878362097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97d010fc20 msgr2=0x7f97d011e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97d010fc20 0x7f97d011e070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 -- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97d0115420 msgr2=0x7f97d0123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97d0115420 0x7f97d0123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 -- 10.20.193.28:0/2878362097 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c0009570 con 0x7f97d010f230 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.512+0000 7f97d5145640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97d010f230 0x7f97d011db30 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c0005b30 tx=0x7f97c0004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.513+0000 7f97be7fc640 1 -- 10.20.193.28:0/2878362097 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97c003d070 con 0x7f97d010f230 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.513+0000 7f97be7fc640 1 -- 10.20.193.28:0/2878362097 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97c0038920 con 0x7f97d010f230 2026-02-20T13:16:47.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.513+0000 7f97be7fc640 1 -- 10.20.193.28:0/2878362097 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97c00418a0 con 0x7f97d010f230 2026-02-20T13:16:47.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.513+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d0124010 con 0x7f97d010f230 2026-02-20T13:16:47.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.513+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d0164770 con 0x7f97d010f230 2026-02-20T13:16:47.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.513+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d0110510 con 0x7f97d010f230 2026-02-20T13:16:47.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.515+0000 7f97be7fc640 1 -- 10.20.193.28:0/2878362097 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f97c0048020 con 0x7f97d010f230 2026-02-20T13:16:47.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.517+0000 7f97be7fc640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97ac0b5770 0x7f97ac0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:47.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.517+0000 7f97be7fc640 1 -- 10.20.193.28:0/2878362097 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f97c010ae00 con 0x7f97d010f230 2026-02-20T13:16:47.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.517+0000 7f97d4944640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97ac0b5770 0x7f97ac0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:47.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.517+0000 7f97be7fc640 1 -- 10.20.193.28:0/2878362097 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f97c010b280 con 0x7f97d010f230 2026-02-20T13:16:47.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.517+0000 7f97d4944640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97ac0b5770 0x7f97ac0d5c20 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d01244d0 tx=0x7f97c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:47.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.632+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97d011ec90 con 0x7f97d010f230 2026-02-20T13:16:47.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.633+0000 7f97be7fc640 1 -- 10.20.193.28:0/2878362097 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7f97c00cd910 con 0x7f97d010f230 2026-02-20T13:16:47.636 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:47.637 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:16:47.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.634+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97ac0b5770 msgr2=0x7f97ac0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:47.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.634+0000 7f97d73d0640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97ac0b5770 0x7f97ac0d5c20 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d01244d0 tx=0x7f97c4005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:47.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.634+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97d010f230 msgr2=0x7f97d011db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:47.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.634+0000 7f97d73d0640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97d010f230 0x7f97d011db30 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c0005b30 tx=0x7f97c0004340 comp rx=0 tx=0).stop 2026-02-20T13:16:47.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.635+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 shutdown_connections 2026-02-20T13:16:47.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.635+0000 7f97d73d0640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97ac0b5770 0x7f97ac0d5c20 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.635+0000 7f97d73d0640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97d0115420 0x7f97d0123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.635+0000 7f97d73d0640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97d010fc20 0x7f97d011e070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.635+0000 7f97d73d0640 1 --2- 10.20.193.28:0/2878362097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97d010f230 0x7f97d011db30 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:47.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.635+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 >> 10.20.193.28:0/2878362097 conn(0x7f97d005f830 msgr2=0x7f97d010cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:47.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.635+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 shutdown_connections 2026-02-20T13:16:47.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:47.635+0000 7f97d73d0640 1 -- 10.20.193.28:0/2878362097 wait complete. 2026-02-20T13:16:47.735 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-20T13:16:47.735 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:16:47.922 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.092+0000 7efc10c11640 1 -- 10.20.193.28:0/3832207934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10dc30 msgr2=0x7efc0c112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.092+0000 7efc10c11640 1 --2- 10.20.193.28:0/3832207934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10dc30 0x7efc0c112c80 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=13084360702782098288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efbfc009950 tx=0x7efbfc02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.092+0000 7efc10c11640 1 -- 10.20.193.28:0/3832207934 shutdown_connections 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.092+0000 7efc10c11640 1 --2- 10.20.193.28:0/3832207934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10dc30 0x7efc0c112c80 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=13084360702782098288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.092+0000 7efc10c11640 1 --2- 10.20.193.28:0/3832207934 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efc0c113430 0x7efc0c173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.092+0000 7efc10c11640 1 --2- 10.20.193.28:0/3832207934 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efc0c10d240 0x7efc0c10d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.092+0000 7efc10c11640 1 -- 10.20.193.28:0/3832207934 >> 10.20.193.28:0/3832207934 conn(0x7efc0c0eaad0 msgr2=0x7efc0c10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.093+0000 7efc10c11640 1 -- 10.20.193.28:0/3832207934 shutdown_connections 2026-02-20T13:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.093+0000 7efc10c11640 1 -- 10.20.193.28:0/3832207934 wait complete. 2026-02-20T13:16:48.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.093+0000 7efc10c11640 1 Processor -- start 2026-02-20T13:16:48.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.093+0000 7efc10c11640 1 -- start start 2026-02-20T13:16:48.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc10c11640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10d240 0x7efc0c0f5690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc10c11640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efc0c10dc30 0x7efc0c173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc10c11640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efc0c113430 0x7efc0c0f5d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc10c11640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c0fafa0 con 0x7efc0c10d240 2026-02-20T13:16:48.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc10c11640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c0fb110 con 0x7efc0c10dc30 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc10c11640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c0fb2d0 con 0x7efc0c113430 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efc0c10dc30 0x7efc0c173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10d240 0x7efc0c0f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efc0c10dc30 0x7efc0c173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47324/0 (socket says 10.20.193.28:47324) 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0affd640 1 -- 10.20.193.28:0/1262451540 learned_addr learned my addr 10.20.193.28:0/1262451540 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0b7fe640 1 -- 10.20.193.28:0/1262451540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efc0c113430 msgr2=0x7efc0c0f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0bfff640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efc0c113430 0x7efc0c0f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0b7fe640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efc0c113430 0x7efc0c0f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0b7fe640 1 -- 10.20.193.28:0/1262451540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efc0c10dc30 msgr2=0x7efc0c173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0b7fe640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efc0c10dc30 0x7efc0c173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0b7fe640 1 -- 10.20.193.28:0/1262451540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc009570 con 0x7efc0c10d240 2026-02-20T13:16:48.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.094+0000 7efc0affd640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efc0c10dc30 0x7efc0c173d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:48.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.095+0000 7efc0b7fe640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10d240 0x7efc0c0f5690 secure :-1 s=READY pgs=235 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efbf800e7b0 tx=0x7efbf800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.096+0000 7efc08ff9640 1 -- 10.20.193.28:0/1262451540 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efbf800cce0 con 0x7efc0c10d240 2026-02-20T13:16:48.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.096+0000 7efc08ff9640 1 -- 10.20.193.28:0/1262451540 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efbf800ce40 con 0x7efc0c10d240 2026-02-20T13:16:48.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.096+0000 7efc08ff9640 1 -- 10.20.193.28:0/1262451540 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efbf80052a0 con 0x7efc0c10d240 2026-02-20T13:16:48.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.097+0000 7efc10c11640 1 -- 10.20.193.28:0/1262451540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c0fb5b0 con 0x7efc0c10d240 2026-02-20T13:16:48.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.097+0000 7efc10c11640 1 -- 10.20.193.28:0/1262451540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c0fba30 con 0x7efc0c10d240 2026-02-20T13:16:48.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.097+0000 7efbe67fc640 1 -- 10.20.193.28:0/1262451540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbd4005300 con 0x7efc0c10d240 2026-02-20T13:16:48.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.099+0000 7efc08ff9640 1 -- 10.20.193.28:0/1262451540 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7efbf8004770 con 0x7efc0c10d240 2026-02-20T13:16:48.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.101+0000 7efc08ff9640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efbe00b57e0 0x7efbe00d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.101+0000 7efc08ff9640 1 -- 10.20.193.28:0/1262451540 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7efbf8014070 con 0x7efc0c10d240 2026-02-20T13:16:48.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.101+0000 7efc0affd640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efbe00b57e0 0x7efbe00d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.101+0000 7efc08ff9640 1 -- 10.20.193.28:0/1262451540 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7efbf80a94f0 con 0x7efc0c10d240 2026-02-20T13:16:48.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.101+0000 7efc0affd640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efbe00b57e0 0x7efbe00d5c90 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0fc030 tx=0x7efbfc03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.217+0000 7efbe67fc640 1 -- 10.20.193.28:0/1262451540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efbd40055b0 con 0x7efc0c10d240 2026-02-20T13:16:48.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:48 trial028 ceph-mon[37442]: pgmap v163: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 11 KiB/s wr, 26 op/s 2026-02-20T13:16:48.221 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:48 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2878362097' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:48.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.218+0000 7efc08ff9640 1 -- 10.20.193.28:0/1262451540 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7efbf80ac6a0 con 0x7efc0c10d240 2026-02-20T13:16:48.222 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:48.223 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:16:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 -- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efbe00b57e0 msgr2=0x7efbe00d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efbe00b57e0 0x7efbe00d5c90 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0fc030 tx=0x7efbfc03a040 comp rx=0 tx=0).stop 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 -- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10d240 msgr2=0x7efc0c0f5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10d240 0x7efc0c0f5690 secure :-1 s=READY pgs=235 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efbf800e7b0 tx=0x7efbf800ec80 comp rx=0 tx=0).stop 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 -- 10.20.193.28:0/1262451540 shutdown_connections 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efbe00b57e0 0x7efbe00d5c90 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efc0c113430 0x7efc0c0f5d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efc0c10dc30 0x7efc0c173d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 --2- 10.20.193.28:0/1262451540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc0c10d240 0x7efc0c0f5690 unknown :-1 s=CLOSED pgs=235 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 -- 10.20.193.28:0/1262451540 >> 10.20.193.28:0/1262451540 conn(0x7efc0c0eaad0 msgr2=0x7efc0c10bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.219+0000 7efbe67fc640 1 -- 10.20.193.28:0/1262451540 shutdown_connections 2026-02-20T13:16:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.220+0000 7efbe67fc640 1 -- 10.20.193.28:0/1262451540 wait complete. 2026-02-20T13:16:48.329 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-20T13:16:48.330 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-20T13:16:48.330 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-20T13:16:48.331 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-20T13:16:48.331 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-20T13:16:48.332 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-20T13:16:48.332 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-20T13:16:48.333 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-20T13:16:48.333 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-20T13:16:48.334 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-20T13:16:48.334 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-20T13:16:48.334 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-20T13:16:48.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:48 trial127 ceph-mon[43817]: pgmap v163: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 11 KiB/s wr, 26 op/s 2026-02-20T13:16:48.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:48 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2878362097' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:48.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:48 trial034 ceph-mon[43332]: pgmap v163: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 11 KiB/s wr, 26 op/s 2026-02-20T13:16:48.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:48 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2878362097' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.631 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.635 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.647 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.658 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.698 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.704 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.705 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.716 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.721 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.728 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:48.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.903+0000 7f9710c6c640 1 -- 10.20.193.28:0/2577781449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c15bfe0 msgr2=0x7f970c17c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.903+0000 7f9710c6c640 1 --2- 10.20.193.28:0/2577781449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c15bfe0 0x7f970c17c420 secure :-1 s=READY pgs=236 gs=2 cs=0 l=1 c_cookie=7431518049278751505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96fc009890 tx=0x7f96fc02f0e0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.905+0000 7f9710c6c640 1 -- 10.20.193.28:0/2577781449 shutdown_connections 2026-02-20T13:16:48.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.905+0000 7f9710c6c640 1 --2- 10.20.193.28:0/2577781449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c15bfe0 0x7f970c17c420 unknown :-1 s=CLOSED pgs=236 gs=2 cs=0 l=1 c_cookie=7431518049278751505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.905+0000 7f9710c6c640 1 --2- 10.20.193.28:0/2577781449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f970c115050 0x7f970c15ba10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.905+0000 7f9710c6c640 1 --2- 10.20.193.28:0/2577781449 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f970c114660 0x7f970c114a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.905+0000 7f9710c6c640 1 -- 10.20.193.28:0/2577781449 >> 10.20.193.28:0/2577781449 conn(0x7f970c05b8b0 msgr2=0x7f970c05bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:48.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.905+0000 7f9710c6c640 1 -- 10.20.193.28:0/2577781449 shutdown_connections 2026-02-20T13:16:48.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.905+0000 7f9710c6c640 1 -- 10.20.193.28:0/2577781449 wait complete. 2026-02-20T13:16:48.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.906+0000 7f9710c6c640 1 Processor -- start 2026-02-20T13:16:48.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.906+0000 7f9710c6c640 1 -- start start 2026-02-20T13:16:48.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.908+0000 7f9710c6c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f970c114660 0x7f970c100340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.908+0000 7f9710c6c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c115050 0x7f970c100880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.908+0000 7f9710c6c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f970c15bfe0 0x7f970c105c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c115050 0x7f970c100880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f9710c6c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f970c106270 con 0x7f970c115050 2026-02-20T13:16:48.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f9710c6c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f970c1063e0 con 0x7f970c114660 2026-02-20T13:16:48.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f9710c6c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f970c1065a0 con 0x7f970c15bfe0 2026-02-20T13:16:48.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.908+0000 7f540f574640 1 -- 10.20.193.28:0/446596256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5408116f60 msgr2=0x7f540817aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.908+0000 7f540f574640 1 --2- 10.20.193.28:0/446596256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5408116f60 0x7f540817aba0 secure :-1 s=READY pgs=237 gs=3 cs=0 l=1 c_cookie=16268287678573944309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f540400a970 tx=0x7f5404032480 comp rx=0 tx=0).stop 2026-02-20T13:16:48.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c115050 0x7f970c100880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47986/0 (socket says 10.20.193.28:47986) 2026-02-20T13:16:48.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970affd640 1 -- 10.20.193.28:0/1688765425 learned_addr learned my addr 10.20.193.28:0/1688765425 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:48.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970b7fe640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f970c114660 0x7f970c100340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970bfff640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f970c15bfe0 0x7f970c105c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970affd640 1 -- 10.20.193.28:0/1688765425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f970c15bfe0 msgr2=0x7f970c105c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970affd640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f970c15bfe0 0x7f970c105c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970affd640 1 -- 10.20.193.28:0/1688765425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f970c114660 msgr2=0x7f970c100340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970affd640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f970c114660 0x7f970c100340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.909+0000 7f970affd640 1 -- 10.20.193.28:0/1688765425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970000a590 con 0x7f970c115050 2026-02-20T13:16:48.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.910+0000 7f970affd640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c115050 0x7f970c100880 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96f8005b30 tx=0x7f96f8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.911+0000 7f540f574640 1 -- 10.20.193.28:0/446596256 shutdown_connections 2026-02-20T13:16:48.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.911+0000 7f540f574640 1 --2- 10.20.193.28:0/446596256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5408116f60 0x7f540817aba0 unknown :-1 s=CLOSED pgs=237 gs=3 cs=0 l=1 c_cookie=16268287678573944309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.911+0000 7f540f574640 1 --2- 10.20.193.28:0/446596256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f54081151f0 0x7f54081167e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.911+0000 7f540f574640 1 --2- 10.20.193.28:0/446596256 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5408114800 0x7f5408114bd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.911+0000 7f540f574640 1 -- 10.20.193.28:0/446596256 >> 10.20.193.28:0/446596256 conn(0x7f5408058c80 msgr2=0x7f5408059080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:48.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.911+0000 7f540f574640 1 -- 10.20.193.28:0/446596256 shutdown_connections 2026-02-20T13:16:48.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.911+0000 7f540f574640 1 -- 10.20.193.28:0/446596256 wait complete. 2026-02-20T13:16:48.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.912+0000 7f540f574640 1 Processor -- start 2026-02-20T13:16:48.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.913+0000 7f540f574640 1 -- start start 2026-02-20T13:16:48.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.913+0000 7f540f574640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5408114800 0x7f540811ba90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.913+0000 7f540f574640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54081151f0 0x7f540811bfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.913+0000 7f540f574640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5408116f60 0x7f54081213a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.913+0000 7f540f574640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f54081219c0 con 0x7f54081151f0 2026-02-20T13:16:48.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.913+0000 7f540f574640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5408121b30 con 0x7f5408116f60 2026-02-20T13:16:48.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.913+0000 7f540f574640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5408121cf0 con 0x7f5408114800 2026-02-20T13:16:48.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.913+0000 7f540cae8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54081151f0 0x7f540811bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.914+0000 7f540daea640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5408116f60 0x7f54081213a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.914+0000 7f540cae8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54081151f0 0x7f540811bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48004/0 (socket says 10.20.193.28:48004) 2026-02-20T13:16:48.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.914+0000 7f540daea640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5408116f60 0x7f54081213a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47368/0 (socket says 10.20.193.28:47368) 2026-02-20T13:16:48.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.914+0000 7f540daea640 1 -- 10.20.193.28:0/3047927378 learned_addr learned my addr 10.20.193.28:0/3047927378 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:48.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.914+0000 7f540d2e9640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5408114800 0x7f540811ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.914+0000 7f540d2e9640 1 -- 10.20.193.28:0/3047927378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5408116f60 msgr2=0x7f54081213a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.914+0000 7f540d2e9640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5408116f60 0x7f54081213a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.914+0000 7f540d2e9640 1 -- 10.20.193.28:0/3047927378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54081151f0 msgr2=0x7f540811bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.915+0000 7f540d2e9640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54081151f0 0x7f540811bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.915+0000 7f540d2e9640 1 -- 10.20.193.28:0/3047927378 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540400a590 con 0x7f5408114800 2026-02-20T13:16:48.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.915+0000 7f540cae8640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54081151f0 0x7f540811bfd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:48.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.915+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96f8014040 con 0x7f970c115050 2026-02-20T13:16:48.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.916+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f96f800f530 con 0x7f970c115050 2026-02-20T13:16:48.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.916+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96f8019790 con 0x7f970c115050 2026-02-20T13:16:48.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.915+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2389943045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f410d230 msgr2=0x7f11f410d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.915+0000 7f11fb3ec640 1 --2- 10.20.193.28:0/2389943045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f410d230 0x7f11f410d600 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=5201588806344400155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e8009950 tx=0x7f11e802f1b0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.916+0000 7f540d2e9640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5408114800 0x7f540811ba90 secure :-1 s=READY pgs=81 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53fc004740 tx=0x7f53fc00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.916+0000 7f9710c6c640 1 -- 10.20.193.28:0/1688765425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f800f830 con 0x7f970c115050 2026-02-20T13:16:48.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.916+0000 7f9710c6c640 1 -- 10.20.193.28:0/1688765425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96fc0094b0 con 0x7f970c115050 2026-02-20T13:16:48.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53fc00cd40 con 0x7f5408114800 2026-02-20T13:16:48.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2389943045 shutdown_connections 2026-02-20T13:16:48.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f11fb3ec640 1 --2- 10.20.193.28:0/2389943045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11f4113420 0x7f11f4173df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f11fb3ec640 1 --2- 10.20.193.28:0/2389943045 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f11f410dc20 0x7f11f4112c70 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f11fb3ec640 1 --2- 10.20.193.28:0/2389943045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f410d230 0x7f11f410d600 unknown :-1 s=CLOSED pgs=80 gs=1 cs=0 l=1 c_cookie=5201588806344400155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2389943045 >> 10.20.193.28:0/2389943045 conn(0x7f11f40eab00 msgr2=0x7f11f410af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:48.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53fc004d30 con 0x7f5408114800 2026-02-20T13:16:48.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.918+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2389943045 shutdown_connections 2026-02-20T13:16:48.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.918+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2389943045 wait complete. 2026-02-20T13:16:48.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53fc0106b0 con 0x7f5408114800 2026-02-20T13:16:48.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5408121fd0 con 0x7f5408114800 2026-02-20T13:16:48.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.917+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54081626d0 con 0x7f5408114800 2026-02-20T13:16:48.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.918+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53d0000fd0 con 0x7f5408114800 2026-02-20T13:16:48.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f11fb3ec640 1 Processor -- start 2026-02-20T13:16:48.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f96f800e910 con 0x7f970c115050 2026-02-20T13:16:48.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f11fb3ec640 1 -- start start 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f11fb3ec640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f11f410d230 0x7f11f4062870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f11fb3ec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11f410dc20 0x7f11f4173cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f11fb3ec640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f4113420 0x7f11f4060df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f11fb3ec640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11f4061330 con 0x7f11f410dc20 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f11fb3ec640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f11f40614a0 con 0x7f11f410d230 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f11fb3ec640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f11f4061660 con 0x7f11f4113420 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.921+0000 7f11fabeb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f4113420 0x7f11f4060df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.921+0000 7f11f9be9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11f410dc20 0x7f11f4173cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.921+0000 7f11fabeb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f4113420 0x7f11f4060df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53418/0 (socket says 10.20.193.28:53418) 2026-02-20T13:16:48.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.921+0000 7f11fabeb640 1 -- 10.20.193.28:0/2171904536 learned_addr learned my addr 10.20.193.28:0/2171904536 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.922+0000 7f11f9be9640 1 -- 10.20.193.28:0/2171904536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f4113420 msgr2=0x7f11f4060df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.923+0000 7f11f9be9640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f4113420 0x7f11f4060df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.920+0000 7f9710c6c640 1 -- 10.20.193.28:0/1688765425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96d8000fd0 con 0x7f970c115050 2026-02-20T13:16:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.922+0000 7f9708ff9640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96e40b5940 0x7f96e40d5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.922+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f96f80ea7e0 con 0x7f970c115050 2026-02-20T13:16:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.922+0000 7f970b7fe640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96e40b5940 0x7f96e40d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.923+0000 7f9708ff9640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] conn(0x7f96e40dd0b0 0x7f96e40fd4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.923+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 --> [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96e40fdb70 con 0x7f96e40dd0b0 2026-02-20T13:16:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.923+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f96f80ecd80 con 0x7f970c115050 2026-02-20T13:16:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.923+0000 7f970bfff640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] conn(0x7f96e40dd0b0 0x7f96e40fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.923+0000 7f11f9be9640 1 -- 10.20.193.28:0/2171904536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f11f410d230 msgr2=0x7f11f4062870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:16:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.924+0000 7f970bfff640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] conn(0x7f96e40dd0b0 0x7f96e40fd4c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.924+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 <== osd.1 v2:10.20.193.34:6800/1497190611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f96e40fdb70 con 0x7f96e40dd0b0 2026-02-20T13:16:48.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.923+0000 7f11f9be9640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f11f410d230 0x7f11f4062870 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.924+0000 7f11f9be9640 1 -- 10.20.193.28:0/2171904536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e8009570 con 0x7f11f410dc20 2026-02-20T13:16:48.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.924+0000 7f11fabeb640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f11f4113420 0x7f11f4060df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:48.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.925+0000 7f11f9be9640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11f410dc20 0x7f11f4173cf0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e400b400 tx=0x7f11e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.925+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11e40044a0 con 0x7f11f410dc20 2026-02-20T13:16:48.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.925+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f40618e0 con 0x7f11f410dc20 2026-02-20T13:16:48.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.926+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f40f77e0 con 0x7f11f410dc20 2026-02-20T13:16:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.928+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11c4000fd0 con 0x7f11f410dc20 2026-02-20T13:16:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.921+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f53fc005000 con 0x7f5408114800 2026-02-20T13:16:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.928+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f11e4002c20 con 0x7f11f410dc20 2026-02-20T13:16:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.929+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11e4011df0 con 0x7f11f410dc20 2026-02-20T13:16:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.929+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f11e401a3b0 con 0x7f11f410dc20 2026-02-20T13:16:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.930+0000 7f11e37fe640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11d40b58b0 0x7f11d40d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.930+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f11e40e69f0 con 0x7f11f410dc20 2026-02-20T13:16:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.930+0000 7f11e37fe640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] conn(0x7f11d40dd020 0x7f11d40fd430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.930+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 --> [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11d40fdae0 con 0x7f11d40dd020 2026-02-20T13:16:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.930+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f11e40a9500 con 0x7f11f410dc20 2026-02-20T13:16:48.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.931+0000 7f53f67fc640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53e00b56f0 0x7f53e00d5ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.931+0000 7f540cae8640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53e00b56f0 0x7f53e00d5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.931+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f53fc014070 con 0x7f5408114800 2026-02-20T13:16:48.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.931+0000 7f53f67fc640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] conn(0x7f53e00dccf0 0x7f53e00fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.931+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 --> [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53e00fd7b0 con 0x7f53e00dccf0 2026-02-20T13:16:48.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.931+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f53fc0e7470 con 0x7f5408114800 2026-02-20T13:16:48.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.932+0000 7f540cae8640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53e00b56f0 0x7f53e00d5ba0 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5408122430 tx=0x7f53f8005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.925+0000 7f970b7fe640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96e40b5940 0x7f96e40d5df0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9700005820 tx=0x7f970000a310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.937+0000 7f9710c6c640 1 -- 10.20.193.28:0/1688765425 --> [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96d8002d10 con 0x7f96e40dd0b0 2026-02-20T13:16:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.936+0000 7f11fa3ea640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11d40b58b0 0x7f11d40d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.937+0000 7f11fa3ea640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11d40b58b0 0x7f11d40d5d60 secure :-1 s=READY pgs=185 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e80098a0 tx=0x7f11e8002390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.944+0000 7f540daea640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] conn(0x7f53e00dccf0 0x7f53e00fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.944+0000 7f540daea640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] conn(0x7f53e00dccf0 0x7f53e00fd100 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.945+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 <== osd.4 v2:10.20.193.34:6808/3346390712 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f53e00fd7b0 con 0x7f53e00dccf0 2026-02-20T13:16:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.940+0000 7f9708ff9640 1 -- 10.20.193.28:0/1688765425 <== osd.1 v2:10.20.193.34:6800/1497190611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96d8002d10 con 0x7f96e40dd0b0 2026-02-20T13:16:48.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.941+0000 7f96ee7fc640 1 -- 10.20.193.28:0/1688765425 >> [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] conn(0x7f96e40dd0b0 msgr2=0x7f96e40fd4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.941+0000 7f96ee7fc640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] conn(0x7f96e40dd0b0 0x7f96e40fd4c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.941+0000 7f96ee7fc640 1 -- 10.20.193.28:0/1688765425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96e40b5940 msgr2=0x7f96e40d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.941+0000 7f96ee7fc640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96e40b5940 0x7f96e40d5df0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9700005820 tx=0x7f970000a310 comp rx=0 tx=0).stop 2026-02-20T13:16:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.942+0000 7f96ee7fc640 1 -- 10.20.193.28:0/1688765425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c115050 msgr2=0x7f970c100880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.942+0000 7f96ee7fc640 1 --2- 10.20.193.28:0/1688765425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f970c115050 0x7f970c100880 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96f8005b30 tx=0x7f96f8009880 comp rx=0 tx=0).stop 2026-02-20T13:16:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.942+0000 7f970bfff640 1 -- 10.20.193.28:0/1688765425 reap_dead start 2026-02-20T13:16:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.947+0000 7f96ee7fc640 1 -- 10.20.193.28:0/1688765425 shutdown_connections 2026-02-20T13:16:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.947+0000 7f96ee7fc640 1 -- 10.20.193.28:0/1688765425 >> 10.20.193.28:0/1688765425 conn(0x7f970c05b8b0 msgr2=0x7f970c0f70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.947+0000 7f96ee7fc640 1 -- 10.20.193.28:0/1688765425 shutdown_connections 2026-02-20T13:16:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.947+0000 7f96ee7fc640 1 -- 10.20.193.28:0/1688765425 wait complete. 2026-02-20T13:16:48.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.944+0000 7f11fabeb640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] conn(0x7f11d40dd020 0x7f11d40fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.945+0000 7f11fabeb640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] conn(0x7f11d40dd020 0x7f11d40fd430 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.958+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 <== osd.11 v2:10.20.193.127:6824/2910856149 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f11d40fdae0 con 0x7f11d40dd020 2026-02-20T13:16:48.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.963+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 --> [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53d0002d10 con 0x7f53e00dccf0 2026-02-20T13:16:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.963+0000 7f53f67fc640 1 -- 10.20.193.28:0/3047927378 <== osd.4 v2:10.20.193.34:6808/3346390712 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f53d0002d10 con 0x7f53e00dccf0 2026-02-20T13:16:48.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.965+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 >> [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] conn(0x7f53e00dccf0 msgr2=0x7f53e00fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.965+0000 7f540f574640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] conn(0x7f53e00dccf0 0x7f53e00fd100 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53e00b56f0 msgr2=0x7f53e00d5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540f574640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53e00b56f0 0x7f53e00d5ba0 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5408122430 tx=0x7f53f8005f00 comp rx=0 tx=0).stop 2026-02-20T13:16:48.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5408114800 msgr2=0x7f540811ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540f574640 1 --2- 10.20.193.28:0/3047927378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5408114800 0x7f540811ba90 secure :-1 s=READY pgs=81 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53fc004740 tx=0x7f53fc00ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:48.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540daea640 1 -- 10.20.193.28:0/3047927378 reap_dead start 2026-02-20T13:16:48.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 shutdown_connections 2026-02-20T13:16:48.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 >> 10.20.193.28:0/3047927378 conn(0x7f5408058c80 msgr2=0x7f54081181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:48.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 shutdown_connections 2026-02-20T13:16:48.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.966+0000 7f540f574640 1 -- 10.20.193.28:0/3047927378 wait complete. 2026-02-20T13:16:48.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.989+0000 7fea1bfff640 1 -- 10.20.193.28:0/4080077741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4f20 msgr2=0x7fea140c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:48.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.989+0000 7fea1bfff640 1 --2- 10.20.193.28:0/4080077741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4f20 0x7fea140c9f70 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=657777133918725139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea10009890 tx=0x7fea1002f160 comp rx=0 tx=0).stop 2026-02-20T13:16:48.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.989+0000 7fea1bfff640 1 -- 10.20.193.28:0/4080077741 shutdown_connections 2026-02-20T13:16:48.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.989+0000 7fea1bfff640 1 --2- 10.20.193.28:0/4080077741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4f20 0x7fea140c9f70 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=657777133918725139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.989+0000 7fea1bfff640 1 --2- 10.20.193.28:0/4080077741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea140ca720 0x7fea1412b0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.989+0000 7fea1bfff640 1 --2- 10.20.193.28:0/4080077741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea140c4530 0x7fea140c4900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.989+0000 7fea1bfff640 1 -- 10.20.193.28:0/4080077741 >> 10.20.193.28:0/4080077741 conn(0x7fea1401c630 msgr2=0x7fea1401cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.989+0000 7fea1bfff640 1 -- 10.20.193.28:0/4080077741 shutdown_connections 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.990+0000 7fea1bfff640 1 -- 10.20.193.28:0/4080077741 wait complete. 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.990+0000 7fea1bfff640 1 Processor -- start 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.991+0000 7fea1bfff640 1 -- start start 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.991+0000 7fea1bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4530 0x7fea140a9a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4530 0x7fea140a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea140c4f20 0x7fea1412aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea140ca720 0x7fea140aa160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:48.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4530 0x7fea140a9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48020/0 (socket says 10.20.193.28:48020) 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea140af370 con 0x7fea140c4530 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1bfff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fea140af4e0 con 0x7fea140ca720 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1bfff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fea140af6a0 con 0x7fea140c4f20 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1affd640 1 -- 10.20.193.28:0/3870350440 learned_addr learned my addr 10.20.193.28:0/3870350440 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1b7fe640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea140ca720 0x7fea140aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1a7fc640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea140c4f20 0x7fea1412aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1b7fe640 1 -- 10.20.193.28:0/3870350440 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea140c4f20 msgr2=0x7fea1412aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1b7fe640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea140c4f20 0x7fea1412aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.992+0000 7fea1b7fe640 1 -- 10.20.193.28:0/3870350440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4530 msgr2=0x7fea140a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.993+0000 7fea1b7fe640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4530 0x7fea140a9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.993+0000 7fea1b7fe640 1 -- 10.20.193.28:0/3870350440 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea100094b0 con 0x7fea140ca720 2026-02-20T13:16:49.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.993+0000 7fea1affd640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea140c4530 0x7fea140a9a60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:49.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.993+0000 7fea1b7fe640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea140ca720 0x7fea140aa160 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea0c00e5e0 tx=0x7fea0c00eab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.993+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea0c00a960 con 0x7fea140ca720 2026-02-20T13:16:49.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.993+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fea0c011460 con 0x7fea140ca720 2026-02-20T13:16:49.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.993+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea0c0197a0 con 0x7fea140ca720 2026-02-20T13:16:49.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.993+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea140af980 con 0x7fea140ca720 2026-02-20T13:16:49.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.994+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea140afe00 con 0x7fea140ca720 2026-02-20T13:16:49.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.994+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea14000e20 con 0x7fea140ca720 2026-02-20T13:16:49.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.996+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fea0c017020 con 0x7fea140ca720 2026-02-20T13:16:49.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.996+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 --> [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11c4002d10 con 0x7f11d40dd020 2026-02-20T13:16:49.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.997+0000 7f11e37fe640 1 -- 10.20.193.28:0/2171904536 <== osd.11 v2:10.20.193.127:6824/2910856149 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f11c4002d10 con 0x7f11d40dd020 2026-02-20T13:16:49.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 >> [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] conn(0x7f11d40dd020 msgr2=0x7f11d40fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7f11fb3ec640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] conn(0x7f11d40dd020 0x7f11d40fd430 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11d40b58b0 msgr2=0x7f11d40d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7f11fb3ec640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11d40b58b0 0x7f11d40d5d60 secure :-1 s=READY pgs=185 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e80098a0 tx=0x7f11e8002390 comp rx=0 tx=0).stop 2026-02-20T13:16:49.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11f410dc20 msgr2=0x7f11f4173cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7f11fb3ec640 1 --2- 10.20.193.28:0/2171904536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11f410dc20 0x7f11f4173cf0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e400b400 tx=0x7f11e400b8d0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7f11fabeb640 1 -- 10.20.193.28:0/2171904536 reap_dead start 2026-02-20T13:16:49.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7fea208af640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9fc0b5930 0x7fe9fc0d5de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 shutdown_connections 2026-02-20T13:16:49.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.998+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fea0c0e7ae0 con 0x7fea140ca720 2026-02-20T13:16:49.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.999+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 >> 10.20.193.28:0/2171904536 conn(0x7f11f40eab00 msgr2=0x7f11f410b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.999+0000 7fea208af640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] conn(0x7fe9fc0dd0a0 0x7fe9fc0fd4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.999+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 --> [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9fc0fdb60 con 0x7fe9fc0dd0a0 2026-02-20T13:16:49.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.999+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fea0c0e7e10 con 0x7fea140ca720 2026-02-20T13:16:49.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.999+0000 7fea1affd640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9fc0b5930 0x7fe9fc0d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:48.999+0000 7fea1a7fc640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] conn(0x7fe9fc0dd0a0 0x7fe9fc0fd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.000+0000 7fea1affd640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9fc0b5930 0x7fe9fc0d5de0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea040097c0 tx=0x7fea04009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.000+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 shutdown_connections 2026-02-20T13:16:49.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.000+0000 7f11fb3ec640 1 -- 10.20.193.28:0/2171904536 wait complete. 2026-02-20T13:16:49.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.001+0000 7fea1a7fc640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] conn(0x7fe9fc0dd0a0 0x7fe9fc0fd4b0 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.001+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 <== osd.2 v2:10.20.193.127:6800/3179400175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fe9fc0fdb60 con 0x7fe9fc0dd0a0 2026-02-20T13:16:49.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.015+0000 7f4052bc5640 1 -- 10.20.193.28:0/3342424504 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f404c10bad0 msgr2=0x7f404c110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.015+0000 7f4052bc5640 1 --2- 10.20.193.28:0/3342424504 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f404c10bad0 0x7f404c110e30 secure :-1 s=READY pgs=82 gs=3 cs=0 l=1 c_cookie=14158381615337493070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4040009890 tx=0x7f404002f100 comp rx=0 tx=0).stop 2026-02-20T13:16:49.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.016+0000 7f4052bc5640 1 -- 10.20.193.28:0/3342424504 shutdown_connections 2026-02-20T13:16:49.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.016+0000 7f4052bc5640 1 --2- 10.20.193.28:0/3342424504 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f404c111370 0x7f404c1117f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.016+0000 7f4052bc5640 1 --2- 10.20.193.28:0/3342424504 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f404c10bad0 0x7f404c110e30 unknown :-1 s=CLOSED pgs=82 gs=3 cs=0 l=1 c_cookie=14158381615337493070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.016+0000 7f4052bc5640 1 --2- 10.20.193.28:0/3342424504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f404c10b1c0 0x7f404c10b590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.016+0000 7f4052bc5640 1 -- 10.20.193.28:0/3342424504 >> 10.20.193.28:0/3342424504 conn(0x7f404c0e8ce0 msgr2=0x7f404c1090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.016+0000 7f4052bc5640 1 -- 10.20.193.28:0/3342424504 shutdown_connections 2026-02-20T13:16:49.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.016+0000 7f4052bc5640 1 -- 10.20.193.28:0/3342424504 wait complete. 2026-02-20T13:16:49.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.018+0000 7f4052bc5640 1 Processor -- start 2026-02-20T13:16:49.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.018+0000 7f4052bc5640 1 -- start start 2026-02-20T13:16:49.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.018+0000 7f4052bc5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f404c10b1c0 0x7f404c17d070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.018+0000 7f4052bc5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f404c10bad0 0x7f404c17d5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f4052bc5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f404c111370 0x7f404c17daf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f4052bc5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f404c156390 con 0x7f404c10b1c0 2026-02-20T13:16:49.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f4052bc5640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f404c156500 con 0x7f404c10bad0 2026-02-20T13:16:49.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f4052bc5640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1566c0 con 0x7f404c111370 2026-02-20T13:16:49.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f404c10bad0 0x7f404c17d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f404c10bad0 0x7f404c17d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47424/0 (socket says 10.20.193.28:47424) 2026-02-20T13:16:49.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 -- 10.20.193.28:0/4226799449 learned_addr learned my addr 10.20.193.28:0/4226799449 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 -- 10.20.193.28:0/4226799449 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f404c111370 msgr2=0x7f404c17daf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:16:49.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f404c111370 0x7f404c17daf0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 -- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f404c10b1c0 msgr2=0x7f404c17d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f404c10b1c0 0x7f404c17d070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 -- 10.20.193.28:0/4226799449 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404800a650 con 0x7f404c10bad0 2026-02-20T13:16:49.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f40513c2640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f404c10bad0 0x7f404c17d5b0 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4040002390 tx=0x7f4040004370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40400388a0 con 0x7f404c10bad0 2026-02-20T13:16:49.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.020+0000 7f0b35a71640 1 -- 10.20.193.28:0/1002520232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b30114ba0 msgr2=0x7f0b30114fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.020+0000 7f0b35a71640 1 --2- 10.20.193.28:0/1002520232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b30114ba0 0x7f0b30114fd0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=6841210386658884224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b180099a0 tx=0x7f0b1802f220 comp rx=0 tx=0).stop 2026-02-20T13:16:49.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.019+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40400094b0 con 0x7f404c10bad0 2026-02-20T13:16:49.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.020+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f404c1151d0 con 0x7f404c10bad0 2026-02-20T13:16:49.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.020+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4040002a10 con 0x7f404c10bad0 2026-02-20T13:16:49.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.020+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40400388a0 con 0x7f404c10bad0 2026-02-20T13:16:49.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.028+0000 7f37ca933640 1 -- 10.20.193.28:0/3198732733 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37bc0c4380 msgr2=0x7f37bc0c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.029+0000 7f37ca933640 1 --2- 10.20.193.28:0/3198732733 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37bc0c4380 0x7f37bc0c4750 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=14557787040491189417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37b4009950 tx=0x7f37b402f190 comp rx=0 tx=0).stop 2026-02-20T13:16:49.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.030+0000 7f37ca933640 1 -- 10.20.193.28:0/3198732733 shutdown_connections 2026-02-20T13:16:49.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.030+0000 7f37ca933640 1 --2- 10.20.193.28:0/3198732733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37bc0ca280 0x7f37bc0cac40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.024+0000 7f0b35a71640 1 -- 10.20.193.28:0/1002520232 shutdown_connections 2026-02-20T13:16:49.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.024+0000 7f0b35a71640 1 --2- 10.20.193.28:0/1002520232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b30114ba0 0x7f0b30114fd0 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=6841210386658884224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.024+0000 7f0b35a71640 1 --2- 10.20.193.28:0/1002520232 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0b30117e50 0x7f0b30118290 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.024+0000 7f0b35a71640 1 --2- 10.20.193.28:0/1002520232 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0b30117970 0x7f0b301145d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.024+0000 7f0b35a71640 1 -- 10.20.193.28:0/1002520232 >> 10.20.193.28:0/1002520232 conn(0x7f0b300590e0 msgr2=0x7f0b300594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.024+0000 7f0b35a71640 1 -- 10.20.193.28:0/1002520232 shutdown_connections 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.024+0000 7f0b35a71640 1 -- 10.20.193.28:0/1002520232 wait complete. 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.025+0000 7f0b35a71640 1 Processor -- start 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.025+0000 7f0b35a71640 1 -- start start 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.026+0000 7f0b35a71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b30114ba0 0x7f0b3012e2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.026+0000 7f0b35a71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0b30117970 0x7f0b3012e810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.026+0000 7f0b35a71640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0b30117e50 0x7f0b30133be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.026+0000 7f0b35a71640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30134200 con 0x7f0b30114ba0 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.026+0000 7f0b35a71640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30134370 con 0x7f0b30117970 2026-02-20T13:16:49.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.026+0000 7f0b35a71640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30134530 con 0x7f0b30117e50 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.026+0000 7f0b2f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0b30117e50 0x7f0b30133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0b30117e50 0x7f0b30133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53468/0 (socket says 10.20.193.28:53468) 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2f7fe640 1 -- 10.20.193.28:0/229676740 learned_addr learned my addr 10.20.193.28:0/229676740 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2e7fc640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0b30117970 0x7f0b3012e810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2effd640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b30114ba0 0x7f0b3012e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2f7fe640 1 -- 10.20.193.28:0/229676740 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0b30117970 msgr2=0x7f0b3012e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2f7fe640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0b30117970 0x7f0b3012e810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2f7fe640 1 -- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b30114ba0 msgr2=0x7f0b3012e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2f7fe640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b30114ba0 0x7f0b3012e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2f7fe640 1 -- 10.20.193.28:0/229676740 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b18009570 con 0x7f0b30117e50 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.027+0000 7f0b2effd640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b30114ba0 0x7f0b3012e2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:49.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.028+0000 7f0b2f7fe640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0b30117e50 0x7f0b30133be0 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b24006f30 tx=0x7f0b2400b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.028+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b240044a0 con 0x7f0b30117e50 2026-02-20T13:16:49.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.028+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0b24002c20 con 0x7f0b30117e50 2026-02-20T13:16:49.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.028+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b24010ce0 con 0x7f0b30117e50 2026-02-20T13:16:49.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.028+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b30134810 con 0x7f0b30117e50 2026-02-20T13:16:49.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.028+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b30174f10 con 0x7f0b30117e50 2026-02-20T13:16:49.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.030+0000 7f37ca933640 1 --2- 10.20.193.28:0/3198732733 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f37bc0c4d70 0x7f37bc0c9ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.031+0000 7f37ca933640 1 --2- 10.20.193.28:0/3198732733 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37bc0c4380 0x7f37bc0c4750 unknown :-1 s=CLOSED pgs=83 gs=1 cs=0 l=1 c_cookie=14557787040491189417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.031+0000 7f37ca933640 1 -- 10.20.193.28:0/3198732733 >> 10.20.193.28:0/3198732733 conn(0x7f37bc01cde0 msgr2=0x7f37bc01d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.031+0000 7fbc3f7fe640 1 -- 10.20.193.28:0/3680051047 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc3002fc10 con 0x7fbc40110060 2026-02-20T13:16:49.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.032+0000 7fbc46ac0640 1 -- 10.20.193.28:0/3680051047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40110060 msgr2=0x7fbc401150b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.032+0000 7fbc46ac0640 1 --2- 10.20.193.28:0/3680051047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40110060 0x7fbc401150b0 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=17509856823445202845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc30009950 tx=0x7fbc3002f190 comp rx=0 tx=0).stop 2026-02-20T13:16:49.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.032+0000 7f37ca933640 1 -- 10.20.193.28:0/3198732733 shutdown_connections 2026-02-20T13:16:49.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.031+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f4040048020 con 0x7f404c10bad0 2026-02-20T13:16:49.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.032+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f404c0532d0 con 0x7f404c10bad0 2026-02-20T13:16:49.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.033+0000 7f37ca933640 1 -- 10.20.193.28:0/3198732733 wait complete. 2026-02-20T13:16:49.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.033+0000 7fbc46ac0640 1 -- 10.20.193.28:0/3680051047 shutdown_connections 2026-02-20T13:16:49.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.033+0000 7fbc46ac0640 1 --2- 10.20.193.28:0/3680051047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc40115860 0x7fbc40176230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.033+0000 7fbc46ac0640 1 --2- 10.20.193.28:0/3680051047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40110060 0x7fbc401150b0 unknown :-1 s=CLOSED pgs=85 gs=1 cs=0 l=1 c_cookie=17509856823445202845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.033+0000 7fbc46ac0640 1 --2- 10.20.193.28:0/3680051047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc4010f670 0x7fbc4010fa40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.033+0000 7fbc46ac0640 1 -- 10.20.193.28:0/3680051047 >> 10.20.193.28:0/3680051047 conn(0x7fbc400ecf20 msgr2=0x7fbc4010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.033+0000 7fbc46ac0640 1 -- 10.20.193.28:0/3680051047 shutdown_connections 2026-02-20T13:16:49.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.033+0000 7fbc46ac0640 1 -- 10.20.193.28:0/3680051047 wait complete. 2026-02-20T13:16:49.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.034+0000 7f403affd640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40280b58d0 0x7f40280d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.035+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f404010b180 con 0x7f404c10bad0 2026-02-20T13:16:49.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.035+0000 7f4051bc3640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40280b58d0 0x7f40280d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.035+0000 7f403affd640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] conn(0x7f40280dd040 0x7f40280fd450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.035+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 --> [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40280fdb00 con 0x7f40280dd040 2026-02-20T13:16:49.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.035+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f404010d720 con 0x7f404c10bad0 2026-02-20T13:16:49.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.035+0000 7f40523c4640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] conn(0x7f40280dd040 0x7f40280fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.035+0000 7f37ca933640 1 Processor -- start 2026-02-20T13:16:49.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f37ca933640 1 -- start start 2026-02-20T13:16:49.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.035+0000 7fbc46ac0640 1 Processor -- start 2026-02-20T13:16:49.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f4051bc3640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40280b58d0 0x7f40280d5d80 secure :-1 s=READY pgs=187 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f403c005970 tx=0x7f403c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7fbc46ac0640 1 -- start start 2026-02-20T13:16:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f37ca933640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f37bc0c4380 0x7f37bc0dbb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f37ca933640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37bc0c4d70 0x7f37bc0dc0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f37ca933640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37bc0ca280 0x7f37bc0e14a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f37ca933640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc0e1ac0 con 0x7f37bc0ca280 2026-02-20T13:16:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f37ca933640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc0e1c30 con 0x7f37bc0c4380 2026-02-20T13:16:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f37ca933640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc0e1df0 con 0x7f37bc0c4d70 2026-02-20T13:16:49.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.036+0000 7f40523c4640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] conn(0x7f40280dd040 0x7f40280fd450 crc :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7f37c8ea9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37bc0ca280 0x7f37bc0e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7fbc46ac0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc4010f670 0x7fbc400f5710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7fbc46ac0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc40110060 0x7fbc40176130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7fbc46ac0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40115860 0x7fbc400f5e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7fbc46ac0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc400fb020 con 0x7fbc4010f670 2026-02-20T13:16:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7fbc46ac0640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbc400fb190 con 0x7fbc40110060 2026-02-20T13:16:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7fbc46ac0640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbc400fb350 con 0x7fbc40115860 2026-02-20T13:16:49.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.038+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 <== osd.6 v2:10.20.193.28:6818/3124866379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f40280fdb00 con 0x7f40280dd040 2026-02-20T13:16:49.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7f37c8ea9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37bc0ca280 0x7f37bc0e14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48082/0 (socket says 10.20.193.28:48082) 2026-02-20T13:16:49.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.037+0000 7f37c8ea9640 1 -- 10.20.193.28:0/2817161196 learned_addr learned my addr 10.20.193.28:0/2817161196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.038+0000 7fbc45036640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40115860 0x7fbc400f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.038+0000 7fbc45036640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40115860 0x7fbc400f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53500/0 (socket says 10.20.193.28:53500) 2026-02-20T13:16:49.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.038+0000 7fbc45036640 1 -- 10.20.193.28:0/2233776158 learned_addr learned my addr 10.20.193.28:0/2233776158 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.038+0000 7f37c37fe640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37bc0c4d70 0x7f37bc0dc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.038+0000 7f37c3fff640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f37bc0c4380 0x7f37bc0dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7fbc44835640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc4010f670 0x7fbc400f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7fbc3ffff640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc40110060 0x7fbc40176130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7f37c3fff640 1 -- 10.20.193.28:0/2817161196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37bc0c4d70 msgr2=0x7f37bc0dc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7f37c3fff640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37bc0c4d70 0x7f37bc0dc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7fbc45036640 1 -- 10.20.193.28:0/2233776158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc40110060 msgr2=0x7fbc40176130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7f37c3fff640 1 -- 10.20.193.28:0/2817161196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37bc0ca280 msgr2=0x7f37bc0e14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7f37c3fff640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37bc0ca280 0x7f37bc0e14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7f37c3fff640 1 -- 10.20.193.28:0/2817161196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b4009570 con 0x7f37bc0c4380 2026-02-20T13:16:49.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7fbc45036640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc40110060 0x7fbc40176130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7fbc45036640 1 -- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc4010f670 msgr2=0x7fbc400f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7f37c8ea9640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37bc0ca280 0x7f37bc0e14a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:49.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0af4000fd0 con 0x7f0b30117e50 2026-02-20T13:16:49.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f0b24002740 con 0x7f0b30117e50 2026-02-20T13:16:49.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7f0b34a6f640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0b000b5940 0x7f0b000d5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7fbc45036640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc4010f670 0x7fbc400f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7fbc45036640 1 -- 10.20.193.28:0/2233776158 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c0094b0 con 0x7fbc40115860 2026-02-20T13:16:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f0b240e5e00 con 0x7f0b30117e50 2026-02-20T13:16:49.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7f37c3fff640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f37bc0c4380 0x7f37bc0dbb90 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37b402f6a0 tx=0x7f37b4004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7f0b34a6f640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] conn(0x7f0b000dd0b0 0x7f0b000fd4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 --> [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b000fdb70 con 0x7f0b000dd0b0 2026-02-20T13:16:49.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f0b240e83a0 con 0x7f0b30117e50 2026-02-20T13:16:49.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7f0b2e7fc640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] conn(0x7f0b000dd0b0 0x7f0b000fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7fbc44835640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc4010f670 0x7fbc400f5710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:49.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7fbc45036640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40115860 0x7fbc400f5e10 secure :-1 s=READY pgs=86 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc3400e650 tx=0x7fbc3400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37b403d070 con 0x7f37bc0c4380 2026-02-20T13:16:49.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f37b4002ad0 con 0x7f37bc0c4380 2026-02-20T13:16:49.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.043+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc3400aa20 con 0x7fbc40115860 2026-02-20T13:16:49.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.042+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37b403d070 con 0x7f37bc0c4380 2026-02-20T13:16:49.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.043+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbc3400ab80 con 0x7fbc40115860 2026-02-20T13:16:49.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.043+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc340106d0 con 0x7fbc40115860 2026-02-20T13:16:49.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.044+0000 7f0b2effd640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0b000b5940 0x7f0b000d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.044+0000 7f0b2e7fc640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] conn(0x7f0b000dd0b0 0x7f0b000fd4c0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.044+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc30009570 con 0x7fbc40115860 2026-02-20T13:16:49.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.044+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc400fb920 con 0x7fbc40115860 2026-02-20T13:16:49.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.046+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc0e2070 con 0x7f37bc0c4380 2026-02-20T13:16:49.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.046+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc08000fd0 con 0x7fbc40115860 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.038+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 --> [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fea140c5810 con 0x7fe9fc0dd0a0 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.038+0000 7fea208af640 1 -- 10.20.193.28:0/3870350440 <== osd.2 v2:10.20.193.127:6800/3179400175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fea140c5810 con 0x7fe9fc0dd0a0 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 >> [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] conn(0x7fe9fc0dd0a0 msgr2=0x7fe9fc0fd4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7fea1bfff640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] conn(0x7fe9fc0dd0a0 0x7fe9fc0fd4b0 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9fc0b5930 msgr2=0x7fe9fc0d5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7fea1bfff640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9fc0b5930 0x7fe9fc0d5de0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea040097c0 tx=0x7fea04009310 comp rx=0 tx=0).stop 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea140ca720 msgr2=0x7fea140aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.039+0000 7fea1bfff640 1 --2- 10.20.193.28:0/3870350440 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea140ca720 0x7fea140aa160 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea0c00e5e0 tx=0x7fea0c00eab0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.040+0000 7fea1b7fe640 1 -- 10.20.193.28:0/3870350440 reap_dead start 2026-02-20T13:16:49.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 shutdown_connections 2026-02-20T13:16:49.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 >> 10.20.193.28:0/3870350440 conn(0x7fea1401c630 msgr2=0x7fea1412c940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 shutdown_connections 2026-02-20T13:16:49.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.041+0000 7fea1bfff640 1 -- 10.20.193.28:0/3870350440 wait complete. 2026-02-20T13:16:49.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.046+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 <== osd.9 v2:10.20.193.28:6826/1755797163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f0b000fdb70 con 0x7f0b000dd0b0 2026-02-20T13:16:49.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.050+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37bc122630 con 0x7f37bc0c4380 2026-02-20T13:16:49.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.051+0000 7f0b2effd640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0b000b5940 0x7f0b000d5df0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b20005840 tx=0x7f0b20003820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.052+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 --> [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f404c10c6d0 con 0x7f40280dd040 2026-02-20T13:16:49.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37bc000c50 con 0x7f37bc0c4380 2026-02-20T13:16:49.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f403affd640 1 -- 10.20.193.28:0/4226799449 <== osd.6 v2:10.20.193.28:6818/3124866379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f404c10c6d0 con 0x7f40280dd040 2026-02-20T13:16:49.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] conn(0x7f40280dd040 msgr2=0x7f40280fd450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f4052bc5640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] conn(0x7f40280dd040 0x7f40280fd450 crc :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40280b58d0 msgr2=0x7f40280d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f4052bc5640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40280b58d0 0x7f40280d5d80 secure :-1 s=READY pgs=187 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f403c005970 tx=0x7f403c005900 comp rx=0 tx=0).stop 2026-02-20T13:16:49.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f404c10bad0 msgr2=0x7f404c17d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f4052bc5640 1 --2- 10.20.193.28:0/4226799449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f404c10bad0 0x7f404c17d5b0 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4040002390 tx=0x7f4040004370 comp rx=0 tx=0).stop 2026-02-20T13:16:49.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.053+0000 7f40523c4640 1 -- 10.20.193.28:0/4226799449 reap_dead start 2026-02-20T13:16:49.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.054+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 shutdown_connections 2026-02-20T13:16:49.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.054+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 >> 10.20.193.28:0/4226799449 conn(0x7f404c0e8ce0 msgr2=0x7f404c1090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.054+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 shutdown_connections 2026-02-20T13:16:49.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.054+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fbc34021020 con 0x7fbc40115860 2026-02-20T13:16:49.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.054+0000 7f4052bc5640 1 -- 10.20.193.28:0/4226799449 wait complete. 2026-02-20T13:16:49.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.056+0000 7fbc3dffb640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc140b57e0 0x7fbc140d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.056+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fbc340ae8f0 con 0x7fbc40115860 2026-02-20T13:16:49.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.056+0000 7fbc3dffb640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] conn(0x7fbc140ddc00 0x7fbc140fe090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.056+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 --> [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc140fe7e0 con 0x7fbc140ddc00 2026-02-20T13:16:49.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.056+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fbc340aa540 con 0x7fbc40115860 2026-02-20T13:16:49.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.058+0000 7fbc44835640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc140b57e0 0x7fbc140d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.058+0000 7fbc3ffff640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] conn(0x7fbc140ddc00 0x7fbc140fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.059+0000 7fbc44835640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc140b57e0 0x7fbc140d5c90 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc2c004740 tx=0x7fbc2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.059+0000 7fbc3ffff640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] conn(0x7fbc140ddc00 0x7fbc140fe090 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.061+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 <== osd.10 v2:10.20.193.34:6824/3326939746 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fbc140fe7e0 con 0x7fbc140ddc00 2026-02-20T13:16:49.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.064+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f37b4048020 con 0x7f37bc0c4380 2026-02-20T13:16:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.065+0000 7f37c17fa640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37980b5830 0x7f37980d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.065+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f37b410a940 con 0x7f37bc0c4380 2026-02-20T13:16:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.065+0000 7f37c17fa640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] conn(0x7f37980dcfa0 0x7f37980fd3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.065+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 --> [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37980fda60 con 0x7f37980dcfa0 2026-02-20T13:16:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.065+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f37b403d070 con 0x7f37bc0c4380 2026-02-20T13:16:49.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.066+0000 7f37c37fe640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37980b5830 0x7f37980d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.066+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 --> [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0af4002d10 con 0x7f0b000dd0b0 2026-02-20T13:16:49.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.066+0000 7f37c8ea9640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] conn(0x7f37980dcfa0 0x7f37980fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.067+0000 7f0b34a6f640 1 -- 10.20.193.28:0/229676740 <== osd.9 v2:10.20.193.28:6826/1755797163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0af4002d10 con 0x7f0b000dd0b0 2026-02-20T13:16:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.067+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] conn(0x7f0b000dd0b0 msgr2=0x7f0b000fd4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.067+0000 7f0b35a71640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] conn(0x7f0b000dd0b0 0x7f0b000fd4c0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.068+0000 7f37c37fe640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37980b5830 0x7f37980d5ce0 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37bc0e2530 tx=0x7f37b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.069+0000 7f85fed4a640 1 -- 10.20.193.28:0/3576682307 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 msgr2=0x7f85f810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.069+0000 7f85fed4a640 1 --2- 10.20.193.28:0/3576682307 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 0x7f85f810f880 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=798715926492385995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85e8009950 tx=0x7f85e802f1d0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0b000b5940 msgr2=0x7f0b000d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f0b35a71640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0b000b5940 0x7f0b000d5df0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b20005840 tx=0x7f0b20003820 comp rx=0 tx=0).stop 2026-02-20T13:16:49.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0b30117e50 msgr2=0x7f0b30133be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f0b35a71640 1 --2- 10.20.193.28:0/229676740 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0b30117e50 0x7f0b30133be0 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b24006f30 tx=0x7f0b2400b8f0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f0b2f7fe640 1 -- 10.20.193.28:0/229676740 reap_dead start 2026-02-20T13:16:49.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.069+0000 7f812ce87640 1 -- 10.20.193.28:0/3163836480 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81240396f0 con 0x7f8128117e50 2026-02-20T13:16:49.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f37c8ea9640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] conn(0x7f37980dcfa0 0x7f37980fd3b0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.071+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 <== osd.7 v2:10.20.193.34:6816/646042575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f37980fda60 con 0x7f37980dcfa0 2026-02-20T13:16:49.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.071+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 shutdown_connections 2026-02-20T13:16:49.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.071+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 >> 10.20.193.28:0/229676740 conn(0x7f0b300590e0 msgr2=0x7f0b3011bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.071+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 shutdown_connections 2026-02-20T13:16:49.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.071+0000 7f0b35a71640 1 -- 10.20.193.28:0/229676740 wait complete. 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f85fed4a640 1 -- 10.20.193.28:0/3576682307 shutdown_connections 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f85fed4a640 1 --2- 10.20.193.28:0/3576682307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85f81156a0 0x7f85f8176070 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f85fed4a640 1 --2- 10.20.193.28:0/3576682307 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85f810fea0 0x7f85f8114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f85fed4a640 1 --2- 10.20.193.28:0/3576682307 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 0x7f85f810f880 unknown :-1 s=CLOSED pgs=94 gs=2 cs=0 l=1 c_cookie=798715926492385995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.070+0000 7f85fed4a640 1 -- 10.20.193.28:0/3576682307 >> 10.20.193.28:0/3576682307 conn(0x7f85f80ecda0 msgr2=0x7f85f810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.071+0000 7f85fed4a640 1 -- 10.20.193.28:0/3576682307 shutdown_connections 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.071+0000 7f85fed4a640 1 -- 10.20.193.28:0/3576682307 wait complete. 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.072+0000 7f85fed4a640 1 Processor -- start 2026-02-20T13:16:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.072+0000 7f85fed4a640 1 -- start start 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.072+0000 7f85fed4a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 0x7f85f81019f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.072+0000 7f85fed4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85f810fea0 0x7f85f8175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.072+0000 7f85fed4a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85f81156a0 0x7f85f81020f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fdd48640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 0x7f85f81019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fed4a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f85f8100800 con 0x7f85f810fea0 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fed4a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f85f8100970 con 0x7f85f810f4b0 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fdd48640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 0x7f85f81019f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47528/0 (socket says 10.20.193.28:47528) 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f85f8100b30 con 0x7f85f81156a0 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fe549640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85f81156a0 0x7f85f81020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fdd48640 1 -- 10.20.193.28:0/1986781377 learned_addr learned my addr 10.20.193.28:0/1986781377 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fd547640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85f810fea0 0x7f85f8175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fdd48640 1 -- 10.20.193.28:0/1986781377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85f81156a0 msgr2=0x7f85f81020f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fdd48640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85f81156a0 0x7f85f81020f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fdd48640 1 -- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85f810fea0 msgr2=0x7f85f8175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fdd48640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85f810fea0 0x7f85f8175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f85fdd48640 1 -- 10.20.193.28:0/1986781377 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e8009570 con 0x7f85f810f4b0 2026-02-20T13:16:49.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.074+0000 7f85fe549640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f85f81156a0 0x7f85f81020f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:49.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.074+0000 7f85fd547640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85f810fea0 0x7f85f8175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:49.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f8130114640 1 -- 10.20.193.28:0/3163836480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8128117e50 msgr2=0x7f8128118290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.073+0000 7f8130114640 1 --2- 10.20.193.28:0/3163836480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8128117e50 0x7f8128118290 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=11600702122418966272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f812400aa80 tx=0x7f8124030310 comp rx=0 tx=0).stop 2026-02-20T13:16:49.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.074+0000 7f85fdd48640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 0x7f85f81019f0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85e80098a0 tx=0x7f85e80028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.074+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85e803d070 con 0x7f85f810f4b0 2026-02-20T13:16:49.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.074+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f85e80043d0 con 0x7f85f810f4b0 2026-02-20T13:16:49.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.074+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f8100db0 con 0x7f85f810f4b0 2026-02-20T13:16:49.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.074+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85e8041a00 con 0x7f85f810f4b0 2026-02-20T13:16:49.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.074+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f8101220 con 0x7f85f810f4b0 2026-02-20T13:16:49.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.075+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85f80532d0 con 0x7f85f810f4b0 2026-02-20T13:16:49.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.075+0000 7f8130114640 1 -- 10.20.193.28:0/3163836480 shutdown_connections 2026-02-20T13:16:49.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.075+0000 7f8130114640 1 --2- 10.20.193.28:0/3163836480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8128117e50 0x7f8128118290 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=11600702122418966272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.075+0000 7f8130114640 1 --2- 10.20.193.28:0/3163836480 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8128114ba0 0x7f8128114fd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.075+0000 7f8130114640 1 --2- 10.20.193.28:0/3163836480 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8128117970 0x7f81281145d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.075+0000 7f8130114640 1 -- 10.20.193.28:0/3163836480 >> 10.20.193.28:0/3163836480 conn(0x7f81280590e0 msgr2=0x7f81280594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.075+0000 7f8130114640 1 -- 10.20.193.28:0/3163836480 shutdown_connections 2026-02-20T13:16:49.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.078+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f85e8038880 con 0x7f85f810f4b0 2026-02-20T13:16:49.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.079+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 --> [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc08002da0 con 0x7fbc140ddc00 2026-02-20T13:16:49.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.079+0000 7f85e6ffd640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85d00b5930 0x7f85d00d5de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.079+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f85e810bde0 con 0x7f85f810f4b0 2026-02-20T13:16:49.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.079+0000 7f85e6ffd640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] conn(0x7f85d00dd0a0 0x7f85d00fd4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.079+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 --> [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85d00fdb60 con 0x7f85d00dd0a0 2026-02-20T13:16:49.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.079+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f85e810c110 con 0x7f85f810f4b0 2026-02-20T13:16:49.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.080+0000 7f85fe549640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] conn(0x7f85d00dd0a0 0x7f85d00fd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.081+0000 7fbc3dffb640 1 -- 10.20.193.28:0/2233776158 <== osd.10 v2:10.20.193.34:6824/3326939746 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbc08002da0 con 0x7fbc140ddc00 2026-02-20T13:16:49.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f85fd547640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85d00b5930 0x7f85d00d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.086+0000 7f85fe549640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] conn(0x7f85d00dd0a0 0x7f85d00fd4b0 crc :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.080+0000 7f8130114640 1 -- 10.20.193.28:0/3163836480 wait complete. 2026-02-20T13:16:49.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.080+0000 7f8130114640 1 Processor -- start 2026-02-20T13:16:49.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.086+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 >> [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] conn(0x7fbc140ddc00 msgr2=0x7fbc140fe090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.086+0000 7fbc46ac0640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] conn(0x7fbc140ddc00 0x7fbc140fe090 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.081+0000 7f8130114640 1 -- start start 2026-02-20T13:16:49.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f8130114640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8128114ba0 0x7f81281aca90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f8130114640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8128117970 0x7f81281acfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f8130114640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8128117e50 0x7f81281b23a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f8130114640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f81281b29f0 con 0x7f8128117e50 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f8130114640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f81281b2b60 con 0x7f8128117970 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f8130114640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f81281b2d20 con 0x7f8128114ba0 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f812de89640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8128114ba0 0x7f81281aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f812d688640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8128117970 0x7f81281acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f812d688640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8128117970 0x7f81281acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47532/0 (socket says 10.20.193.28:47532) 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f812d688640 1 -- 10.20.193.28:0/3889745471 learned_addr learned my addr 10.20.193.28:0/3889745471 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.082+0000 7f812e68a640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8128117e50 0x7f81281b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.087+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc140b57e0 msgr2=0x7fbc140d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.087+0000 7fbc46ac0640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc140b57e0 0x7fbc140d5c90 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc2c004740 tx=0x7fbc2c005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:49.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.087+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40115860 msgr2=0x7fbc400f5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.087+0000 7fbc46ac0640 1 --2- 10.20.193.28:0/2233776158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc40115860 0x7fbc400f5e10 secure :-1 s=READY pgs=86 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc3400e650 tx=0x7fbc3400eb20 comp rx=0 tx=0).stop 2026-02-20T13:16:49.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.087+0000 7fbc45036640 1 -- 10.20.193.28:0/2233776158 reap_dead start 2026-02-20T13:16:49.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.088+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 shutdown_connections 2026-02-20T13:16:49.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.088+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 >> 10.20.193.28:0/2233776158 conn(0x7fbc400ecf20 msgr2=0x7fbc40113750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f812de89640 1 -- 10.20.193.28:0/3889745471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8128117970 msgr2=0x7f81281acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f812de89640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8128117970 0x7f81281acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f812de89640 1 -- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8128117e50 msgr2=0x7f81281b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f812de89640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8128117e50 0x7f81281b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f812de89640 1 -- 10.20.193.28:0/3889745471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812400a650 con 0x7f8128114ba0 2026-02-20T13:16:49.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f812d688640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8128117970 0x7f81281acfd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:49.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f812e68a640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8128117e50 0x7f81281b23a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:49.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.083+0000 7f812de89640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8128114ba0 0x7f81281aca90 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f811c00b400 tx=0x7f811c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.084+0000 7f8116ffd640 1 -- 10.20.193.28:0/3889745471 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f811c0044a0 con 0x7f8128114ba0 2026-02-20T13:16:49.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.084+0000 7f8116ffd640 1 -- 10.20.193.28:0/3889745471 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f811c002c20 con 0x7f8128114ba0 2026-02-20T13:16:49.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.084+0000 7f8116ffd640 1 -- 10.20.193.28:0/3889745471 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f811c011d80 con 0x7f8128114ba0 2026-02-20T13:16:49.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.086+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81281b2fa0 con 0x7f8128114ba0 2026-02-20T13:16:49.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.088+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 shutdown_connections 2026-02-20T13:16:49.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.088+0000 7fbc46ac0640 1 -- 10.20.193.28:0/2233776158 wait complete. 2026-02-20T13:16:49.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.086+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81281b3690 con 0x7f8128114ba0 2026-02-20T13:16:49.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.089+0000 7f85fd547640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85d00b5930 0x7f85d00d5de0 secure :-1 s=READY pgs=191 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85ec005e40 tx=0x7f85ec005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.091+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 <== osd.3 v2:10.20.193.28:6810/3411989985 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f85d00fdb60 con 0x7f85d00dd0a0 2026-02-20T13:16:49.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.093+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 --> [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37bc136ce0 con 0x7f37980dcfa0 2026-02-20T13:16:49.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.090+0000 7f8116ffd640 1 -- 10.20.193.28:0/3889745471 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f811c002740 con 0x7f8128114ba0 2026-02-20T13:16:49.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.091+0000 7f8116ffd640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81040b5940 0x7f81040d5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.091+0000 7f8116ffd640 1 -- 10.20.193.28:0/3889745471 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f811c0e5a30 con 0x7f8128114ba0 2026-02-20T13:16:49.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.092+0000 7f812d688640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81040b5940 0x7f81040d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.092+0000 7f8130114640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] conn(0x7f80f00015f0 0x7f80f0021aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.092+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 --> [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80f0024c00 con 0x7f80f00015f0 2026-02-20T13:16:49.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.094+0000 7f812e68a640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] conn(0x7f80f00015f0 0x7f80f0021aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.094+0000 7f812d688640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81040b5940 0x7f81040d5df0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f812805a6d0 tx=0x7f8118004050 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.096+0000 7f812e68a640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] conn(0x7f80f00015f0 0x7f80f0021aa0 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.100+0000 7f37c17fa640 1 -- 10.20.193.28:0/2817161196 <== osd.7 v2:10.20.193.34:6816/646042575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f37bc136ce0 con 0x7f37980dcfa0 2026-02-20T13:16:49.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.101+0000 7f8116ffd640 1 -- 10.20.193.28:0/3889745471 <== osd.5 v2:10.20.193.127:6808/460724236 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f80f0024c00 con 0x7f80f00015f0 2026-02-20T13:16:49.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.102+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] conn(0x7f37980dcfa0 msgr2=0x7f37980fd3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.102+0000 7f37ca933640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] conn(0x7f37980dcfa0 0x7f37980fd3b0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.102+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37980b5830 msgr2=0x7f37980d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.102+0000 7f37ca933640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37980b5830 0x7f37980d5ce0 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37bc0e2530 tx=0x7f37b0005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:49.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.102+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f37bc0c4380 msgr2=0x7f37bc0dbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.102+0000 7f37ca933640 1 --2- 10.20.193.28:0/2817161196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f37bc0c4380 0x7f37bc0dbb90 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37b402f6a0 tx=0x7f37b4004270 comp rx=0 tx=0).stop 2026-02-20T13:16:49.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.102+0000 7f37c8ea9640 1 -- 10.20.193.28:0/2817161196 reap_dead start 2026-02-20T13:16:49.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.103+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 shutdown_connections 2026-02-20T13:16:49.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.103+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 >> 10.20.193.28:0/2817161196 conn(0x7f37bc01cde0 msgr2=0x7f37bc0c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.103+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 shutdown_connections 2026-02-20T13:16:49.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.103+0000 7f37ca933640 1 -- 10.20.193.28:0/2817161196 wait complete. 2026-02-20T13:16:49.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.113+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 --> [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f85f8110790 con 0x7f85d00dd0a0 2026-02-20T13:16:49.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f85e6ffd640 1 -- 10.20.193.28:0/1986781377 <== osd.3 v2:10.20.193.28:6810/3411989985 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f85f8110790 con 0x7f85d00dd0a0 2026-02-20T13:16:49.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] conn(0x7f85d00dd0a0 msgr2=0x7f85d00fd4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f85fed4a640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] conn(0x7f85d00dd0a0 0x7f85d00fd4b0 crc :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 --> [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80f0023c90 con 0x7f80f00015f0 2026-02-20T13:16:49.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85d00b5930 msgr2=0x7f85d00d5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f85fed4a640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85d00b5930 0x7f85d00d5de0 secure :-1 s=READY pgs=191 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85ec005e40 tx=0x7f85ec005dd0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 msgr2=0x7f85f81019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f85fed4a640 1 --2- 10.20.193.28:0/1986781377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f85f810f4b0 0x7f85f81019f0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85e80098a0 tx=0x7f85e80028d0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f85fe549640 1 -- 10.20.193.28:0/1986781377 reap_dead start 2026-02-20T13:16:49.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f8116ffd640 1 -- 10.20.193.28:0/3889745471 <== osd.5 v2:10.20.193.127:6808/460724236 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f80f0023c90 con 0x7f80f00015f0 2026-02-20T13:16:49.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 >> [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] conn(0x7f80f00015f0 msgr2=0x7f80f0021aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f8130114640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] conn(0x7f80f00015f0 0x7f80f0021aa0 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81040b5940 msgr2=0x7f81040d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f8130114640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f81040b5940 0x7f81040d5df0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f812805a6d0 tx=0x7f8118004050 comp rx=0 tx=0).stop 2026-02-20T13:16:49.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8128114ba0 msgr2=0x7f81281aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f8130114640 1 --2- 10.20.193.28:0/3889745471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8128114ba0 0x7f81281aca90 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f811c00b400 tx=0x7f811c00b8d0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.116+0000 7f812e68a640 1 -- 10.20.193.28:0/3889745471 reap_dead start 2026-02-20T13:16:49.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 shutdown_connections 2026-02-20T13:16:49.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 >> 10.20.193.28:0/3889745471 conn(0x7f81280590e0 msgr2=0x7f8128115dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 shutdown_connections 2026-02-20T13:16:49.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f8130114640 1 -- 10.20.193.28:0/3889745471 wait complete. 2026-02-20T13:16:49.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.118+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 shutdown_connections 2026-02-20T13:16:49.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.118+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 >> 10.20.193.28:0/1986781377 conn(0x7f85f80ecda0 msgr2=0x7f85f81129e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e8effd640 1 -- 10.20.193.28:0/195692476 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e84030d10 con 0x7f7e9010f4d0 2026-02-20T13:16:49.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e9536b640 1 -- 10.20.193.28:0/195692476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e9010f4d0 msgr2=0x7f7e9010f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e9536b640 1 --2- 10.20.193.28:0/195692476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e9010f4d0 0x7f7e9010f8a0 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=14589757019324496164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e8400aa30 tx=0x7f7e84030290 comp rx=0 tx=0).stop 2026-02-20T13:16:49.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e9536b640 1 -- 10.20.193.28:0/195692476 shutdown_connections 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e9536b640 1 --2- 10.20.193.28:0/195692476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e9010fec0 0x7f7e90114f10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e9536b640 1 --2- 10.20.193.28:0/195692476 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e901156c0 0x7f7e90176090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e9536b640 1 --2- 10.20.193.28:0/195692476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e9010f4d0 0x7f7e9010f8a0 unknown :-1 s=CLOSED pgs=88 gs=2 cs=0 l=1 c_cookie=14589757019324496164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e9536b640 1 -- 10.20.193.28:0/195692476 >> 10.20.193.28:0/195692476 conn(0x7f7e900ece20 msgr2=0x7f7e9010d230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.108+0000 7f7e9536b640 1 -- 10.20.193.28:0/195692476 shutdown_connections 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.109+0000 7f7e9536b640 1 -- 10.20.193.28:0/195692476 wait complete. 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.110+0000 7f7e9536b640 1 Processor -- start 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.110+0000 7f7e9536b640 1 -- start start 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.110+0000 7f7e9536b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e9010f4d0 0x7f7e9011b2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.110+0000 7f7e9536b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e9010fec0 0x7f7e9011b810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e9536b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e901156c0 0x7f7e90120be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e9536b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90121200 con 0x7f7e9010f4d0 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e9536b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90121370 con 0x7f7e9010fec0 2026-02-20T13:16:49.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e9536b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90121530 con 0x7f7e901156c0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e9010fec0 0x7f7e9011b810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e9010fec0 0x7f7e9011b810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47554/0 (socket says 10.20.193.28:47554) 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8f7fe640 1 -- 10.20.193.28:0/618690024 learned_addr learned my addr 10.20.193.28:0/618690024 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8ffff640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e9010f4d0 0x7f7e9011b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8f7fe640 1 -- 10.20.193.28:0/618690024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e901156c0 msgr2=0x7f7e90120be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8f7fe640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7e901156c0 0x7f7e90120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8f7fe640 1 -- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e9010f4d0 msgr2=0x7f7e9011b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8f7fe640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e9010f4d0 0x7f7e9011b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8f7fe640 1 -- 10.20.193.28:0/618690024 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e800094b0 con 0x7f7e9010fec0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.111+0000 7f7e8ffff640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e9010f4d0 0x7f7e9011b2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.112+0000 7f7e8f7fe640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e9010fec0 0x7f7e9011b810 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e80009fd0 tx=0x7f7e80002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.112+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e8000ed60 con 0x7f7e9010fec0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.112+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7e80002e20 con 0x7f7e9010fec0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.112+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e80018950 con 0x7f7e9010fec0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.112+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c0094b0 con 0x7f7e9010fec0 2026-02-20T13:16:49.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.112+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8400a650 con 0x7f7e9010fec0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.114+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e900532d0 con 0x7f7e9010fec0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.115+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f7e80016020 con 0x7f7e9010fec0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f7e8d7fa640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7e700b5940 0x7f7e700d5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f7e800e7220 con 0x7f7e9010fec0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f7e8ffff640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7e700b5940 0x7f7e700d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f7e8d7fa640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] conn(0x7f7e700dd0b0 0x7f7e700fd4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 --> [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e700fdb70 con 0x7f7e700dd0b0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.117+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f7e800e97c0 con 0x7f7e9010fec0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.118+0000 7f7e94b6a640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] conn(0x7f7e700dd0b0 0x7f7e700fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.118+0000 7f7e8ffff640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7e700b5940 0x7f7e700d5df0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e8400a980 tx=0x7f7e84006f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.118+0000 7f7e94b6a640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] conn(0x7f7e700dd0b0 0x7f7e700fd4c0 crc :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.119+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 <== osd.8 v2:10.20.193.127:6816/2418786729 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f7e700fdb70 con 0x7f7e700dd0b0 2026-02-20T13:16:49.132 INFO:teuthology.orchestra.run.trial028.stdout:55834574876 2026-02-20T13:16:49.133 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-20T13:16:49.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.130+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 shutdown_connections 2026-02-20T13:16:49.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.130+0000 7f85fed4a640 1 -- 10.20.193.28:0/1986781377 wait complete. 2026-02-20T13:16:49.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.130+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 --> [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e90063b80 con 0x7f7e700dd0b0 2026-02-20T13:16:49.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.131+0000 7f7e8d7fa640 1 -- 10.20.193.28:0/618690024 <== osd.8 v2:10.20.193.127:6816/2418786729 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7e90063b80 con 0x7f7e700dd0b0 2026-02-20T13:16:49.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.131+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 >> [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] conn(0x7f7e700dd0b0 msgr2=0x7f7e700fd4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.131+0000 7f7e9536b640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] conn(0x7f7e700dd0b0 0x7f7e700fd4c0 crc :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.131+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7e700b5940 msgr2=0x7f7e700d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.131+0000 7f7e9536b640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7e700b5940 0x7f7e700d5df0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e8400a980 tx=0x7f7e84006f00 comp rx=0 tx=0).stop 2026-02-20T13:16:49.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.132+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e9010fec0 msgr2=0x7f7e9011b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.132+0000 7f7e9536b640 1 --2- 10.20.193.28:0/618690024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7e9010fec0 0x7f7e9011b810 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e80009fd0 tx=0x7f7e80002bc0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.132+0000 7f7e94b6a640 1 -- 10.20.193.28:0/618690024 reap_dead start 2026-02-20T13:16:49.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.141+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 shutdown_connections 2026-02-20T13:16:49.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.141+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 >> 10.20.193.28:0/618690024 conn(0x7f7e900ece20 msgr2=0x7f7e9010d200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.141+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 shutdown_connections 2026-02-20T13:16:49.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.141+0000 7f7e9536b640 1 -- 10.20.193.28:0/618690024 wait complete. 2026-02-20T13:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 -- 10.20.193.28:0/4097693147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b1810bbb0 msgr2=0x7f3b18155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 --2- 10.20.193.28:0/4097693147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b1810bbb0 0x7f3b18155250 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=9423404473430103386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b04009950 tx=0x7f3b0402f240 comp rx=0 tx=0).stop 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 -- 10.20.193.28:0/4097693147 shutdown_connections 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 --2- 10.20.193.28:0/4097693147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b1810bbb0 0x7f3b18155250 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=9423404473430103386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 --2- 10.20.193.28:0/4097693147 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b181558f0 0x7f3b18175d80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 --2- 10.20.193.28:0/4097693147 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b1810b2a0 0x7f3b1810b670 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 -- 10.20.193.28:0/4097693147 >> 10.20.193.28:0/4097693147 conn(0x7f3b180e8e10 msgr2=0x7f3b18109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 -- 10.20.193.28:0/4097693147 shutdown_connections 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.187+0000 7f3b1db8f640 1 -- 10.20.193.28:0/4097693147 wait complete. 2026-02-20T13:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.188+0000 7f3b1db8f640 1 Processor -- start 2026-02-20T13:16:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.188+0000 7f3b1db8f640 1 -- start start 2026-02-20T13:16:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.189+0000 7f3b1db8f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b1810b2a0 0x7f3b18160150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.189+0000 7f3b1db8f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b1810bbb0 0x7f3b18160690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b1db8f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b181558f0 0x7f3b18165a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b1db8f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3b18166080 con 0x7f3b181558f0 2026-02-20T13:16:49.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b1db8f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181661f0 con 0x7f3b1810bbb0 2026-02-20T13:16:49.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b1db8f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181663b0 con 0x7f3b1810b2a0 2026-02-20T13:16:49.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b181558f0 0x7f3b18165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b181558f0 0x7f3b18165a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48156/0 (socket says 10.20.193.28:48156) 2026-02-20T13:16:49.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b17fff640 1 -- 10.20.193.28:0/560997517 learned_addr learned my addr 10.20.193.28:0/560997517 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b16ffd640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b1810bbb0 0x7f3b18160690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.190+0000 7f3b17fff640 1 -- 10.20.193.28:0/560997517 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b1810b2a0 msgr2=0x7f3b18160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.191+0000 7f3b17fff640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b1810b2a0 0x7f3b18160150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:49 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1262451540' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.191+0000 7f3b17fff640 1 -- 10.20.193.28:0/560997517 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b1810bbb0 msgr2=0x7f3b18160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.191+0000 7f3b17fff640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b1810bbb0 0x7f3b18160690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.191+0000 7f3b17fff640 1 -- 10.20.193.28:0/560997517 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b04009570 con 0x7f3b181558f0 2026-02-20T13:16:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.191+0000 7f3b16ffd640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b1810bbb0 0x7f3b18160690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.191+0000 7f3b17fff640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b181558f0 0x7f3b18165a60 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b0800c9c0 tx=0x7f3b0800ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.192+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b080044a0 con 0x7f3b181558f0 2026-02-20T13:16:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.192+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b18166690 con 0x7f3b181558f0 2026-02-20T13:16:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.192+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b18153450 con 0x7f3b181558f0 2026-02-20T13:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.192+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b08007c50 con 0x7f3b181558f0 2026-02-20T13:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.192+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b0800f450 con 0x7f3b181558f0 2026-02-20T13:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.192+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b180532d0 con 0x7f3b181558f0 2026-02-20T13:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.195+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f3b08007770 con 0x7f3b181558f0 2026-02-20T13:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.197+0000 7f3b14ff9640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3aec0b5870 0x7f3aec0d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.197+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f3b080e6f20 con 0x7f3b181558f0 2026-02-20T13:16:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.197+0000 7f3b14ff9640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] conn(0x7f3aec0dcfe0 0x7f3aec0fd3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.197+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 --> [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3aec0fdaa0 con 0x7f3aec0dcfe0 2026-02-20T13:16:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.197+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f3b080e7250 con 0x7f3b181558f0 2026-02-20T13:16:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.197+0000 7f3b16ffd640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] conn(0x7f3aec0dcfe0 0x7f3aec0fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.200+0000 7f3b177fe640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3aec0b5870 0x7f3aec0d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.201+0000 7f3b16ffd640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] conn(0x7f3aec0dcfe0 0x7f3aec0fd3f0 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.202+0000 7f3b177fe640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3aec0b5870 0x7f3aec0d5d20 secure :-1 s=READY pgs=194 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b0c005840 tx=0x7f3b0c007dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.204+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 <== osd.0 v2:10.20.193.28:6802/3440519886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f3aec0fdaa0 con 0x7f3aec0dcfe0 2026-02-20T13:16:49.229 INFO:teuthology.orchestra.run.trial028.stdout:313532612617 2026-02-20T13:16:49.230 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-20T13:16:49.240 INFO:teuthology.orchestra.run.trial028.stdout:133143986198 2026-02-20T13:16:49.241 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-20T13:16:49.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.238+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 --> [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b1805fe90 con 0x7f3aec0dcfe0 2026-02-20T13:16:49.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.238+0000 7f3b14ff9640 1 -- 10.20.193.28:0/560997517 <== osd.0 v2:10.20.193.28:6802/3440519886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b1805fe90 con 0x7f3aec0dcfe0 2026-02-20T13:16:49.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.239+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] conn(0x7f3aec0dcfe0 msgr2=0x7f3aec0fd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.239+0000 7f3b1db8f640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] conn(0x7f3aec0dcfe0 0x7f3aec0fd3f0 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.240+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3aec0b5870 msgr2=0x7f3aec0d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.240+0000 7f3b1db8f640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3aec0b5870 0x7f3aec0d5d20 secure :-1 s=READY pgs=194 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b0c005840 tx=0x7f3b0c007dd0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.240+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b181558f0 msgr2=0x7f3b18165a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.240+0000 7f3b1db8f640 1 --2- 10.20.193.28:0/560997517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b181558f0 0x7f3b18165a60 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b0800c9c0 tx=0x7f3b0800ce90 comp rx=0 tx=0).stop 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.240+0000 7f3b17fff640 1 -- 10.20.193.28:0/560997517 reap_dead start 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.242+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 shutdown_connections 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.242+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 >> 10.20.193.28:0/560997517 conn(0x7f3b180e8e10 msgr2=0x7f3b181091f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.243+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 shutdown_connections 2026-02-20T13:16:49.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.243+0000 7f3b1db8f640 1 -- 10.20.193.28:0/560997517 wait complete. 2026-02-20T13:16:49.288 INFO:teuthology.orchestra.run.trial028.stdout:73014444058 2026-02-20T13:16:49.289 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-20T13:16:49.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:49 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1262451540' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:49.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:49 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1262451540' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:49.509 INFO:teuthology.orchestra.run.trial028.stdout:150323855380 2026-02-20T13:16:49.510 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-20T13:16:49.604 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:49.614 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:49.615 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:49.625 INFO:teuthology.orchestra.run.trial028.stdout:231928233998 2026-02-20T13:16:49.625 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:49.626 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-20T13:16:49.632 INFO:teuthology.orchestra.run.trial028.stdout:103079215127 2026-02-20T13:16:49.632 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-20T13:16:49.634 INFO:teuthology.orchestra.run.trial028.stdout:201863462928 2026-02-20T13:16:49.635 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-20T13:16:49.636 INFO:teuthology.orchestra.run.trial028.stdout:38654705693 2026-02-20T13:16:49.637 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-20T13:16:49.643 INFO:teuthology.orchestra.run.trial028.stdout:266287972363 2026-02-20T13:16:49.644 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-20T13:16:49.654 INFO:teuthology.orchestra.run.trial028.stdout:184683593745 2026-02-20T13:16:49.655 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-20T13:16:49.659 INFO:teuthology.orchestra.run.trial028.stdout:283467841546 2026-02-20T13:16:49.659 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-20T13:16:49.724 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.844+0000 7fb85011e640 1 -- 10.20.193.28:0/1066450145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb848114800 msgr2=0x7fb848114bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.844+0000 7fb85011e640 1 --2- 10.20.193.28:0/1066450145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb848114800 0x7fb848114bd0 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=8138587993763453939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84000a970 tx=0x7fb8400301b0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.846+0000 7fb85011e640 1 -- 10.20.193.28:0/1066450145 shutdown_connections 2026-02-20T13:16:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.846+0000 7fb85011e640 1 --2- 10.20.193.28:0/1066450145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8481151f0 0x7fb84815ba10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.846+0000 7fb85011e640 1 --2- 10.20.193.28:0/1066450145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb84815c100 0x7fb84817c570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.846+0000 7fb85011e640 1 --2- 10.20.193.28:0/1066450145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb848114800 0x7fb848114bd0 unknown :-1 s=CLOSED pgs=89 gs=2 cs=0 l=1 c_cookie=8138587993763453939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.846+0000 7fb85011e640 1 -- 10.20.193.28:0/1066450145 >> 10.20.193.28:0/1066450145 conn(0x7fb848058c80 msgr2=0x7fb848059080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.846+0000 7fb85011e640 1 -- 10.20.193.28:0/1066450145 shutdown_connections 2026-02-20T13:16:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.846+0000 7fb85011e640 1 -- 10.20.193.28:0/1066450145 wait complete. 2026-02-20T13:16:49.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.851+0000 7fb85011e640 1 Processor -- start 2026-02-20T13:16:49.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb85011e640 1 -- start start 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb85011e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb848114800 0x7fb8481048c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb85011e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb8481151f0 0x7fb848104e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb85011e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb84815c100 0x7fb84810a1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb85011e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb84810a7f0 con 0x7fb84815c100 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb85011e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb84810a960 con 0x7fb848114800 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb85011e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb84810ab20 con 0x7fb8481151f0 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb84de93640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb848114800 0x7fb8481048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb84de93640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb848114800 0x7fb8481048c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:47592/0 (socket says 10.20.193.28:47592) 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb84de93640 1 -- 10.20.193.28:0/4094079357 learned_addr learned my addr 10.20.193.28:0/4094079357 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.853+0000 7fb84d692640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb8481151f0 0x7fb848104e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.854+0000 7fb84de93640 1 -- 10.20.193.28:0/4094079357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb8481151f0 msgr2=0x7fb848104e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.854+0000 7fb84de93640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb8481151f0 0x7fb848104e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.854+0000 7fb84de93640 1 -- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb84815c100 msgr2=0x7fb84810a1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.854+0000 7fb84de93640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb84815c100 0x7fb84810a1d0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.854+0000 7fb84de93640 1 -- 10.20.193.28:0/4094079357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84000a590 con 0x7fb848114800 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.854+0000 7fb84de93640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb848114800 0x7fb8481048c0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84000a8c0 tx=0x7fb840003f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.854+0000 7fb83effd640 1 -- 10.20.193.28:0/4094079357 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb84003e070 con 0x7fb848114800 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.855+0000 7fb83effd640 1 -- 10.20.193.28:0/4094079357 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb840003b10 con 0x7fb848114800 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.855+0000 7fb83effd640 1 -- 10.20.193.28:0/4094079357 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb84003e070 con 0x7fb848114800 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.856+0000 7fb85011e640 1 -- 10.20.193.28:0/4094079357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84810ada0 con 0x7fb848114800 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.856+0000 7fb85011e640 1 -- 10.20.193.28:0/4094079357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb848155740 con 0x7fb848114800 2026-02-20T13:16:49.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.859+0000 7fb85011e640 1 -- 10.20.193.28:0/4094079357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb810005300 con 0x7fb848114800 2026-02-20T13:16:49.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.861+0000 7fb83effd640 1 -- 10.20.193.28:0/4094079357 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fb840039b40 con 0x7fb848114800 2026-02-20T13:16:49.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.863+0000 7fb83effd640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8180b56f0 0x7fb8180d5ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.863+0000 7fb83effd640 1 -- 10.20.193.28:0/4094079357 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fb84010c260 con 0x7fb848114800 2026-02-20T13:16:49.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.864+0000 7fb84d692640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8180b56f0 0x7fb8180d5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.864+0000 7fb83effd640 1 -- 10.20.193.28:0/4094079357 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fb8400ce510 con 0x7fb848114800 2026-02-20T13:16:49.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.865+0000 7fb84d692640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8180b56f0 0x7fb8180d5ba0 secure :-1 s=READY pgs=195 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84810b260 tx=0x7fb838005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.890+0000 7f89727fc640 1 -- 10.20.193.28:0/213972470 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89680375f0 con 0x7f8974114f70 2026-02-20T13:16:49.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.890+0000 7f8979d10640 1 -- 10.20.193.28:0/213972470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8974114f70 msgr2=0x7f897415df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.890+0000 7f8979d10640 1 --2- 10.20.193.28:0/213972470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8974114f70 0x7f897415df00 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=5113931808575916638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f896800a970 tx=0x7f89680301f0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.891+0000 7f8979d10640 1 -- 10.20.193.28:0/213972470 shutdown_connections 2026-02-20T13:16:49.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.891+0000 7f8979d10640 1 --2- 10.20.193.28:0/213972470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f897415e440 0x7f897417e820 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.891+0000 7f8979d10640 1 --2- 10.20.193.28:0/213972470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8974114f70 0x7f897415df00 unknown :-1 s=CLOSED pgs=98 gs=2 cs=0 l=1 c_cookie=5113931808575916638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.891+0000 7f8979d10640 1 --2- 10.20.193.28:0/213972470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f89741145d0 0x7f89741149a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.891+0000 7f8979d10640 1 -- 10.20.193.28:0/213972470 >> 10.20.193.28:0/213972470 conn(0x7f89740590e0 msgr2=0x7f89740594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.903+0000 7f8979d10640 1 -- 10.20.193.28:0/213972470 shutdown_connections 2026-02-20T13:16:49.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.903+0000 7f8979d10640 1 -- 10.20.193.28:0/213972470 wait complete. 2026-02-20T13:16:49.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.904+0000 7f8979d10640 1 Processor -- start 2026-02-20T13:16:49.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.904+0000 7fc9bfb39640 1 -- 10.20.193.28:0/3037279853 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8116f60 msgr2=0x7fc9b817aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.905+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/3037279853 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8116f60 0x7fc9b817aba0 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=14701282586974347449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9b000aa30 tx=0x7fc9b0030290 comp rx=0 tx=0).stop 2026-02-20T13:16:49.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.904+0000 7f8979d10640 1 -- start start 2026-02-20T13:16:49.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.904+0000 7f8979d10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89741145d0 0x7f8974106dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.907+0000 7f89737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89741145d0 0x7f8974106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.907+0000 7f89737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89741145d0 0x7f8974106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48174/0 (socket says 10.20.193.28:48174) 2026-02-20T13:16:49.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.908+0000 7f8979d10640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8974114f70 0x7f8974107300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.909+0000 7f89737fe640 1 -- 10.20.193.28:0/3867912801 learned_addr learned my addr 10.20.193.28:0/3867912801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.910+0000 7f8979d10640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f897415e440 0x7f897410c6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f8979d10640 1 -- 10.20.193.28:0/3867912801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f897410ccf0 con 0x7f89741145d0 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f8979d10640 1 -- 10.20.193.28:0/3867912801 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f897410ce60 con 0x7f897415e440 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f8979d10640 1 -- 10.20.193.28:0/3867912801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f897410d020 con 0x7f8974114f70 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.910+0000 7f8972ffd640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8974114f70 0x7f8974107300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f89737fe640 1 -- 10.20.193.28:0/3867912801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8974114f70 msgr2=0x7f8974107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f89737fe640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8974114f70 0x7f8974107300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f89737fe640 1 -- 10.20.193.28:0/3867912801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f897415e440 msgr2=0x7f897410c6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f8973fff640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f897415e440 0x7f897410c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f89737fe640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f897415e440 0x7f897410c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f89737fe640 1 -- 10.20.193.28:0/3867912801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896800a590 con 0x7f89741145d0 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.911+0000 7f8972ffd640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8974114f70 0x7f8974107300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:49.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.913+0000 7f89737fe640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89741145d0 0x7f8974106dc0 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8964009480 tx=0x7f896400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7fc9bfb39640 1 -- 10.20.193.28:0/3037279853 shutdown_connections 2026-02-20T13:16:49.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/3037279853 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8116f60 0x7fc9b817aba0 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=14701282586974347449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/3037279853 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc9b81151f0 0x7fc9b81167e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/3037279853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9b8114800 0x7fc9b8114bd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7fc9bfb39640 1 -- 10.20.193.28:0/3037279853 >> 10.20.193.28:0/3037279853 conn(0x7fc9b8058c80 msgr2=0x7fc9b8059080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7f8970ff9640 1 -- 10.20.193.28:0/3867912801 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f896400cd40 con 0x7f89741145d0 2026-02-20T13:16:49.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7f8970ff9640 1 -- 10.20.193.28:0/3867912801 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8964004d30 con 0x7f89741145d0 2026-02-20T13:16:49.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7f8970ff9640 1 -- 10.20.193.28:0/3867912801 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89640106b0 con 0x7f89741145d0 2026-02-20T13:16:49.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7f8979d10640 1 -- 10.20.193.28:0/3867912801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897410d300 con 0x7f89741145d0 2026-02-20T13:16:49.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7f8979d10640 1 -- 10.20.193.28:0/3867912801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8974157b70 con 0x7f89741145d0 2026-02-20T13:16:49.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7f5bb8803640 1 -- 10.20.193.28:0/549430960 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117f80 msgr2=0x7f5bb417a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.914+0000 7f5bb8803640 1 --2- 10.20.193.28:0/549430960 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117f80 0x7f5bb417a960 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=4711501077126351698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ba0009890 tx=0x7f5ba002f160 comp rx=0 tx=0).stop 2026-02-20T13:16:49.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.915+0000 7f5bb8803640 1 -- 10.20.193.28:0/549430960 shutdown_connections 2026-02-20T13:16:49.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.915+0000 7f5bb8803640 1 --2- 10.20.193.28:0/549430960 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117f80 0x7f5bb417a960 unknown :-1 s=CLOSED pgs=100 gs=2 cs=0 l=1 c_cookie=4711501077126351698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.915+0000 7f5bb8803640 1 --2- 10.20.193.28:0/549430960 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bb4117380 0x7f5bb41177d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.915+0000 7f5bb8803640 1 --2- 10.20.193.28:0/549430960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bb4116990 0x7f5bb4116d60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.915+0000 7f5bb8803640 1 -- 10.20.193.28:0/549430960 >> 10.20.193.28:0/549430960 conn(0x7f5bb405b8b0 msgr2=0x7f5bb405bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:49.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.915+0000 7fc9bfb39640 1 -- 10.20.193.28:0/3037279853 shutdown_connections 2026-02-20T13:16:49.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.915+0000 7fc9bfb39640 1 -- 10.20.193.28:0/3037279853 wait complete. 2026-02-20T13:16:49.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.915+0000 7fc9bfb39640 1 Processor -- start 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.916+0000 7fc9bfb39640 1 -- start start 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.916+0000 7fc9bfb39640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8114800 0x7fc9b8122940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.916+0000 7fc9bfb39640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9b81151f0 0x7fc9b8122e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.916+0000 7fc9bfb39640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc9b8116f60 0x7fc9b8128200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.916+0000 7fc9bd8ae640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8114800 0x7fc9b8122940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.917+0000 7fc9bd0ad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9b81151f0 0x7fc9b8122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.917+0000 7fc9be0af640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc9b8116f60 0x7fc9b8128200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.917+0000 7fc9be0af640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc9b8116f60 0x7fc9b8128200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53612/0 (socket says 10.20.193.28:53612) 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.917+0000 7fc9be0af640 1 -- 10.20.193.28:0/1311875460 learned_addr learned my addr 10.20.193.28:0/1311875460 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.917+0000 7fc9bfb39640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8128820 con 0x7fc9b81151f0 2026-02-20T13:16:49.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7f5bb8803640 1 -- 10.20.193.28:0/549430960 shutdown_connections 2026-02-20T13:16:49.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7f5bb8803640 1 -- 10.20.193.28:0/549430960 wait complete. 2026-02-20T13:16:49.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.919+0000 7f89527fc640 1 -- 10.20.193.28:0/3867912801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897410d520 con 0x7f89741145d0 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.919+0000 7f5bb8803640 1 Processor -- start 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.919+0000 7f5bb8803640 1 -- start start 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb8803640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bb4116990 0x7f5bb40fe160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb8803640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117380 0x7f5bb40fe6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb8803640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bb4117f80 0x7f5bb4103a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb8803640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4104090 con 0x7f5bb4116990 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb8803640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4104200 con 0x7f5bb4117380 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb8803640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41043c0 con 0x7f5bb4117f80 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bb4116990 0x7f5bb40fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bb4116990 0x7f5bb40fe160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48194/0 (socket says 10.20.193.28:48194) 2026-02-20T13:16:49.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb2d76640 1 -- 10.20.193.28:0/4108159665 learned_addr learned my addr 10.20.193.28:0/4108159665 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:49.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.920+0000 7f5bb2575640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117380 0x7f5bb40fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.921+0000 7f5bb3577640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bb4117f80 0x7f5bb4103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.921+0000 7f5bb2d76640 1 -- 10.20.193.28:0/4108159665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bb4117f80 msgr2=0x7f5bb4103a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.921+0000 7f5bb2d76640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bb4117f80 0x7f5bb4103a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5bb2d76640 1 -- 10.20.193.28:0/4108159665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117380 msgr2=0x7f5bb40fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5bb2d76640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117380 0x7f5bb40fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5bb2d76640 1 -- 10.20.193.28:0/4108159665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba00094b0 con 0x7f5bb4116990 2026-02-20T13:16:49.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5bb3577640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bb4117f80 0x7f5bb4103a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:49.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5bb2575640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117380 0x7f5bb40fe6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:49.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5bb2d76640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bb4116990 0x7f5bb40fe160 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ba400f9c0 tx=0x7f5ba400fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5babfff640 1 -- 10.20.193.28:0/4108159665 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ba400ddd0 con 0x7f5bb4116990 2026-02-20T13:16:49.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5babfff640 1 -- 10.20.193.28:0/4108159665 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ba4005e10 con 0x7f5bb4116990 2026-02-20T13:16:49.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5babfff640 1 -- 10.20.193.28:0/4108159665 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ba40117d0 con 0x7f5bb4116990 2026-02-20T13:16:49.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41046a0 con 0x7f5bb4116990 2026-02-20T13:16:49.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.923+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb411aad0 con 0x7f5bb4116990 2026-02-20T13:16:49.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.923+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb4057810 con 0x7f5bb4116990 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.917+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8128990 con 0x7fc9b8114800 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.917+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8128b50 con 0x7fc9b8116f60 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.917+0000 7fc9bd0ad640 1 -- 10.20.193.28:0/1311875460 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc9b8116f60 msgr2=0x7fc9b8128200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9bd0ad640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc9b8116f60 0x7fc9b8128200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9bd0ad640 1 -- 10.20.193.28:0/1311875460 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8114800 msgr2=0x7fc9b8122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9bd0ad640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8114800 0x7fc9b8122940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9bd0ad640 1 -- 10.20.193.28:0/1311875460 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b000a650 con 0x7fc9b81151f0 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9bd8ae640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8114800 0x7fc9b8122940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9bd0ad640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9b81151f0 0x7fc9b8122e80 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9a8004740 tx=0x7fc9a800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9a6ffd640 1 -- 10.20.193.28:0/1311875460 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9a800cce0 con 0x7fc9b81151f0 2026-02-20T13:16:49.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9a6ffd640 1 -- 10.20.193.28:0/1311875460 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc9a800ce40 con 0x7fc9b81151f0 2026-02-20T13:16:49.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9a6ffd640 1 -- 10.20.193.28:0/1311875460 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9a80052a0 con 0x7fc9b81151f0 2026-02-20T13:16:49.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.918+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b8128e30 con 0x7fc9b81151f0 2026-02-20T13:16:49.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.922+0000 7fc9a6ffd640 1 -- 10.20.193.28:0/1311875460 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fc9a8005430 con 0x7fc9b81151f0 2026-02-20T13:16:49.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.924+0000 7fc9a6ffd640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc9940b9dd0 0x7fc9940da280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.925+0000 7fc9bd8ae640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc9940b9dd0 0x7fc9940da280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.925+0000 7fc9bd8ae640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc9940b9dd0 0x7fc9940da280 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9ac004780 tx=0x7fc9ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.924+0000 7f8970ff9640 1 -- 10.20.193.28:0/3867912801 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f896401f060 con 0x7f89741145d0 2026-02-20T13:16:49.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.926+0000 7f8970ff9640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89480b5940 0x7f89480d5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.926+0000 7f8970ff9640 1 -- 10.20.193.28:0/3867912801 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f8964014070 con 0x7f89741145d0 2026-02-20T13:16:49.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.926+0000 7f8972ffd640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89480b5940 0x7f89480d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.926+0000 7f5babfff640 1 -- 10.20.193.28:0/4108159665 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f5ba4020060 con 0x7f5bb4116990 2026-02-20T13:16:49.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.927+0000 7f8970ff9640 1 -- 10.20.193.28:0/3867912801 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8964004b30 con 0x7f89741145d0 2026-02-20T13:16:49.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.929+0000 7f5babfff640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5b840b5870 0x7f5b840d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:49.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.929+0000 7f5babfff640 1 -- 10.20.193.28:0/4108159665 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f5ba4015070 con 0x7f5bb4116990 2026-02-20T13:16:49.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.929+0000 7f5babfff640 1 -- 10.20.193.28:0/4108159665 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f5ba40e8110 con 0x7f5bb4116990 2026-02-20T13:16:49.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.929+0000 7f8972ffd640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89480b5940 0x7f89480d5df0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8968037720 tx=0x7f8968003d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.929+0000 7f5bb2575640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5b840b5870 0x7f5b840d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:49.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.930+0000 7f5bb2575640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5b840b5870 0x7f5b840d5d20 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bb4104b00 tx=0x7f5b9c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:49.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.937+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b805acd0 con 0x7fc9b81151f0 2026-02-20T13:16:49.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.938+0000 7fc9a6ffd640 1 -- 10.20.193.28:0/1311875460 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fc9a8014070 con 0x7fc9b81151f0 2026-02-20T13:16:49.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.940+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b805bab0 con 0x7fc9b81151f0 2026-02-20T13:16:49.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:49.942+0000 7fc9a6ffd640 1 -- 10.20.193.28:0/1311875460 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fc9a80a9af0 con 0x7fc9b81151f0 2026-02-20T13:16:49.961 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:49.974 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:50.010 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:50.024 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:50.040 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:50.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b5db1a640 1 -- 10.20.193.28:0/2808106661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b58113fa0 msgr2=0x7f8b58114370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b567fc640 1 -- 10.20.193.28:0/2808106661 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b48004290 con 0x7f8b58113fa0 2026-02-20T13:16:50.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/2808106661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b58113fa0 0x7f8b58114370 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=11782054055999963274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b480098c0 tx=0x7f8b4802f0c0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b5db1a640 1 -- 10.20.193.28:0/2808106661 shutdown_connections 2026-02-20T13:16:50.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/2808106661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8b581169d0 0x7f8b5817a590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/2808106661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8b58114990 0x7f8b581161f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/2808106661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b58113fa0 0x7f8b58114370 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=11782054055999963274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b5db1a640 1 -- 10.20.193.28:0/2808106661 >> 10.20.193.28:0/2808106661 conn(0x7f8b58064b10 msgr2=0x7f8b58064f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.042+0000 7f8b5db1a640 1 -- 10.20.193.28:0/2808106661 shutdown_connections 2026-02-20T13:16:50.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.043+0000 7f8b5db1a640 1 -- 10.20.193.28:0/2808106661 wait complete. 2026-02-20T13:16:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.043+0000 7f8b5db1a640 1 Processor -- start 2026-02-20T13:16:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.044+0000 7f8b5db1a640 1 -- start start 2026-02-20T13:16:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.044+0000 7f8b5db1a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8b58113fa0 0x7f8b5811a460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.044+0000 7f8b5db1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b58114990 0x7f8b5811a9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.044+0000 7f8b5db1a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8b581169d0 0x7f8b5815f4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.044+0000 7f8b5db1a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5811b190 con 0x7f8b58114990 2026-02-20T13:16:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.044+0000 7f8b5db1a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5811b300 con 0x7f8b58113fa0 2026-02-20T13:16:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.044+0000 7f8b5db1a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5815fa60 con 0x7f8b581169d0 2026-02-20T13:16:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8b58113fa0 0x7f8b5811a460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8b58113fa0 0x7f8b5811a460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50906/0 (socket says 10.20.193.28:50906) 2026-02-20T13:16:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 -- 10.20.193.28:0/3837275664 learned_addr learned my addr 10.20.193.28:0/3837275664 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b56ffd640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b58114990 0x7f8b5811a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b57fff640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8b581169d0 0x7f8b5815f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 -- 10.20.193.28:0/3837275664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8b581169d0 msgr2=0x7f8b5815f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8b581169d0 0x7f8b5815f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 -- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b58114990 msgr2=0x7f8b5811a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b58114990 0x7f8b5811a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 -- 10.20.193.28:0/3837275664 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b480094b0 con 0x7f8b58113fa0 2026-02-20T13:16:50.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.045+0000 7f8b577fe640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8b58113fa0 0x7f8b5811a460 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b48005f90 tx=0x7f8b480042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.046+0000 7f8b54ff9640 1 -- 10.20.193.28:0/3837275664 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b48038690 con 0x7f8b58113fa0 2026-02-20T13:16:50.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.046+0000 7f8b54ff9640 1 -- 10.20.193.28:0/3837275664 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8b48002e30 con 0x7f8b58113fa0 2026-02-20T13:16:50.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.046+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5815fce0 con 0x7f8b58113fa0 2026-02-20T13:16:50.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.046+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b58160100 con 0x7f8b58113fa0 2026-02-20T13:16:50.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.046+0000 7f8b54ff9640 1 -- 10.20.193.28:0/3837275664 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b48042d00 con 0x7f8b58113fa0 2026-02-20T13:16:50.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.047+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b58114d80 con 0x7f8b58113fa0 2026-02-20T13:16:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.054+0000 7f8b54ff9640 1 -- 10.20.193.28:0/3837275664 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f8b48038a00 con 0x7f8b58113fa0 2026-02-20T13:16:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.055+0000 7f8b54ff9640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b2c0b57f0 0x7f8b2c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.056+0000 7f8b54ff9640 1 -- 10.20.193.28:0/3837275664 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f8b4810bd20 con 0x7f8b58113fa0 2026-02-20T13:16:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.058+0000 7f8b54ff9640 1 -- 10.20.193.28:0/3837275664 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8b480ce810 con 0x7f8b58113fa0 2026-02-20T13:16:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.058+0000 7f8b56ffd640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b2c0b57f0 0x7f8b2c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.058+0000 7f8b56ffd640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b2c0b57f0 0x7f8b2c0d5ca0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b581165d0 tx=0x7f8b44009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.059+0000 7fb85011e640 1 -- 10.20.193.28:0/4094079357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb8100055b0 con 0x7fb848114800 2026-02-20T13:16:50.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.059+0000 7fb83effd640 1 -- 10.20.193.28:0/4094079357 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8400cce60 con 0x7fb848114800 2026-02-20T13:16:50.063 INFO:teuthology.orchestra.run.trial028.stdout:55834574874 2026-02-20T13:16:50.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.062+0000 7fb83cff9640 1 -- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8180b56f0 msgr2=0x7fb8180d5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.062+0000 7fb83cff9640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8180b56f0 0x7fb8180d5ba0 secure :-1 s=READY pgs=195 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84810b260 tx=0x7fb838005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.062+0000 7fb83cff9640 1 -- 10.20.193.28:0/4094079357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb848114800 msgr2=0x7fb8481048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.062+0000 7fb83cff9640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb848114800 0x7fb8481048c0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84000a8c0 tx=0x7fb840003f70 comp rx=0 tx=0).stop 2026-02-20T13:16:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.063+0000 7fb83cff9640 1 -- 10.20.193.28:0/4094079357 shutdown_connections 2026-02-20T13:16:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.063+0000 7fb83cff9640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8180b56f0 0x7fb8180d5ba0 unknown :-1 s=CLOSED pgs=195 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.063+0000 7fb83cff9640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb84815c100 0x7fb84810a1d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.063+0000 7fb83cff9640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb8481151f0 0x7fb848104e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.063+0000 7fb83cff9640 1 --2- 10.20.193.28:0/4094079357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb848114800 0x7fb8481048c0 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.063+0000 7fb83cff9640 1 -- 10.20.193.28:0/4094079357 >> 10.20.193.28:0/4094079357 conn(0x7fb848058c80 msgr2=0x7fb8480fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.063+0000 7fb83cff9640 1 -- 10.20.193.28:0/4094079357 shutdown_connections 2026-02-20T13:16:50.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.063+0000 7fb83cff9640 1 -- 10.20.193.28:0/4094079357 wait complete. 2026-02-20T13:16:50.073 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:50.076 INFO:teuthology.orchestra.run.trial028.stdout:133143986196 2026-02-20T13:16:50.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.057+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5b800051a0 con 0x7f5bb4116990 2026-02-20T13:16:50.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.060+0000 7f5babfff640 1 -- 10.20.193.28:0/4108159665 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5ba40aa8b0 con 0x7f5bb4116990 2026-02-20T13:16:50.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.065+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5b840b5870 msgr2=0x7f5b840d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.065+0000 7f5bb8803640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5b840b5870 0x7f5b840d5d20 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bb4104b00 tx=0x7f5b9c005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:50.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.065+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bb4116990 msgr2=0x7f5bb40fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.065+0000 7f5bb8803640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bb4116990 0x7f5bb40fe160 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ba400f9c0 tx=0x7f5ba400fe90 comp rx=0 tx=0).stop 2026-02-20T13:16:50.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.075+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 shutdown_connections 2026-02-20T13:16:50.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.075+0000 7f5bb8803640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5b840b5870 0x7f5b840d5d20 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.075+0000 7f5bb8803640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bb4117f80 0x7f5bb4103a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.075+0000 7f5bb8803640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bb4117380 0x7f5bb40fe6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.075+0000 7f5bb8803640 1 --2- 10.20.193.28:0/4108159665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bb4116990 0x7f5bb40fe160 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.075+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 >> 10.20.193.28:0/4108159665 conn(0x7f5bb405b8b0 msgr2=0x7f5bb40f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.075+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 shutdown_connections 2026-02-20T13:16:50.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.075+0000 7f5bb8803640 1 -- 10.20.193.28:0/4108159665 wait complete. 2026-02-20T13:16:50.099 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:50.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.135+0000 7f89527fc640 1 -- 10.20.193.28:0/3867912801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f89741149a0 con 0x7f89741145d0 2026-02-20T13:16:50.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.136+0000 7f8970ff9640 1 -- 10.20.193.28:0/3867912801 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89640a9b90 con 0x7f89741145d0 2026-02-20T13:16:50.139 INFO:teuthology.orchestra.run.trial028.stdout:73014444058 2026-02-20T13:16:50.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.099+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fc9b8114bd0 con 0x7fc9b81151f0 2026-02-20T13:16:50.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.105+0000 7fc9a6ffd640 1 -- 10.20.193.28:0/1311875460 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc9a801c030 con 0x7fc9b81151f0 2026-02-20T13:16:50.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc9940b9dd0 msgr2=0x7fc9940da280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stdout:313532612616 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc9940b9dd0 0x7fc9940da280 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9ac004780 tx=0x7fc9ac008040 comp rx=0 tx=0).stop 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9b81151f0 msgr2=0x7fc9b8122e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9b81151f0 0x7fc9b8122e80 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9a8004740 tx=0x7fc9a800ec50 comp rx=0 tx=0).stop 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 shutdown_connections 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc9940b9dd0 0x7fc9940da280 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9b81151f0 0x7fc9b8122e80 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc9b8116f60 0x7fc9b8128200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 --2- 10.20.193.28:0/1311875460 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc9b8114800 0x7fc9b8122940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 >> 10.20.193.28:0/1311875460 conn(0x7fc9b8058c80 msgr2=0x7fc9b805a020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 shutdown_connections 2026-02-20T13:16:50.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.111+0000 7fc9bfb39640 1 -- 10.20.193.28:0/1311875460 wait complete. 2026-02-20T13:16:50.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.145+0000 7f89527fc640 1 -- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89480b5940 msgr2=0x7f89480d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.145+0000 7f89527fc640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89480b5940 0x7f89480d5df0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8968037720 tx=0x7f8968003d80 comp rx=0 tx=0).stop 2026-02-20T13:16:50.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.145+0000 7f89527fc640 1 -- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89741145d0 msgr2=0x7f8974106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.145+0000 7f89527fc640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89741145d0 0x7f8974106dc0 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8964009480 tx=0x7f896400ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:50.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.155+0000 7f89527fc640 1 -- 10.20.193.28:0/3867912801 shutdown_connections 2026-02-20T13:16:50.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.155+0000 7f89527fc640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89480b5940 0x7f89480d5df0 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.155+0000 7f89527fc640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f897415e440 0x7f897410c6d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.155+0000 7f89527fc640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8974114f70 0x7f8974107300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.155+0000 7f89527fc640 1 --2- 10.20.193.28:0/3867912801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89741145d0 0x7f8974106dc0 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.155+0000 7f89527fc640 1 -- 10.20.193.28:0/3867912801 >> 10.20.193.28:0/3867912801 conn(0x7f89740590e0 msgr2=0x7f89740fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.157+0000 7f89527fc640 1 -- 10.20.193.28:0/3867912801 shutdown_connections 2026-02-20T13:16:50.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.157+0000 7f89527fc640 1 -- 10.20.193.28:0/3867912801 wait complete. 2026-02-20T13:16:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.214+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8b5806f310 con 0x7f8b58113fa0 2026-02-20T13:16:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.215+0000 7f8b54ff9640 1 -- 10.20.193.28:0/3837275664 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8b480d1930 con 0x7f8b58113fa0 2026-02-20T13:16:50.218 INFO:teuthology.orchestra.run.trial028.stdout:150323855380 2026-02-20T13:16:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b2c0b57f0 msgr2=0x7f8b2c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b2c0b57f0 0x7f8b2c0d5ca0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b581165d0 tx=0x7f8b44009310 comp rx=0 tx=0).stop 2026-02-20T13:16:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8b58113fa0 msgr2=0x7f8b5811a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8b58113fa0 0x7f8b5811a460 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b48005f90 tx=0x7f8b480042f0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 shutdown_connections 2026-02-20T13:16:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b2c0b57f0 0x7f8b2c0d5ca0 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b58114990 0x7f8b5811a9a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8b581169d0 0x7f8b5815f4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 --2- 10.20.193.28:0/3837275664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8b58113fa0 0x7f8b5811a460 unknown :-1 s=CLOSED pgs=101 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.217+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 >> 10.20.193.28:0/3837275664 conn(0x7f8b58064b10 msgr2=0x7f8b581159d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.218+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 shutdown_connections 2026-02-20T13:16:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.218+0000 7f8b5db1a640 1 -- 10.20.193.28:0/3837275664 wait complete. 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 -- 10.20.193.28:0/153622330 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e4010ddc0 msgr2=0x7f0e40112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/153622330 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e4010ddc0 0x7f0e40112e10 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=2853908129951491909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e30009950 tx=0x7f0e3002f1d0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 -- 10.20.193.28:0/153622330 shutdown_connections 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/153622330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e401135c0 0x7f0e40173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/153622330 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e4010ddc0 0x7f0e40112e10 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=2853908129951491909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/153622330 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4010d3d0 0x7f0e4010d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 -- 10.20.193.28:0/153622330 >> 10.20.193.28:0/153622330 conn(0x7f0e400eacc0 msgr2=0x7f0e4010b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 -- 10.20.193.28:0/153622330 shutdown_connections 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.255+0000 7f0e45c2d640 1 -- 10.20.193.28:0/153622330 wait complete. 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e45c2d640 1 Processor -- start 2026-02-20T13:16:50.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e45c2d640 1 -- start start 2026-02-20T13:16:50.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e45c2d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4010d3d0 0x7f0e400f5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e45c2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4010ddc0 0x7f0e40173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e45c2d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e401135c0 0x7f0e400f6170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e45c2d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0e400fb380 con 0x7f0e4010d3d0 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e45c2d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0e400fb4f0 con 0x7f0e4010ddc0 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e45c2d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0e400fb6b0 con 0x7f0e401135c0 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e3effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4010ddc0 0x7f0e40173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e3effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4010ddc0 0x7f0e40173e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50922/0 (socket says 10.20.193.28:50922) 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.256+0000 7f0e3effd640 1 -- 10.20.193.28:0/2862880319 learned_addr learned my addr 10.20.193.28:0/2862880319 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3effd640 1 -- 10.20.193.28:0/2862880319 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e401135c0 msgr2=0x7f0e400f6170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3effd640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e401135c0 0x7f0e400f6170 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3effd640 1 -- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4010d3d0 msgr2=0x7f0e400f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3effd640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4010d3d0 0x7f0e400f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3effd640 1 -- 10.20.193.28:0/2862880319 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e30009570 con 0x7f0e4010ddc0 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3effd640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4010ddc0 0x7f0e40173e90 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e30005f10 tx=0x7f0e300047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3cff9640 1 -- 10.20.193.28:0/2862880319 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e30046070 con 0x7f0e4010ddc0 2026-02-20T13:16:50.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e400fb930 con 0x7f0e4010ddc0 2026-02-20T13:16:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e400fbdf0 con 0x7f0e4010ddc0 2026-02-20T13:16:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3cff9640 1 -- 10.20.193.28:0/2862880319 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e30041e60 con 0x7f0e4010ddc0 2026-02-20T13:16:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.257+0000 7f0e3cff9640 1 -- 10.20.193.28:0/2862880319 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3004a410 con 0x7f0e4010ddc0 2026-02-20T13:16:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.258+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4010e6b0 con 0x7f0e4010ddc0 2026-02-20T13:16:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.260+0000 7f0e3cff9640 1 -- 10.20.193.28:0/2862880319 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f0e300385e0 con 0x7f0e4010ddc0 2026-02-20T13:16:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.262+0000 7f0e3cff9640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e140b57f0 0x7f0e140d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.262+0000 7f0e3cff9640 1 -- 10.20.193.28:0/2862880319 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f0e30113bf0 con 0x7f0e4010ddc0 2026-02-20T13:16:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.262+0000 7f0e3f7fe640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e140b57f0 0x7f0e140d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.262+0000 7f0e3cff9640 1 -- 10.20.193.28:0/2862880319 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f0e301140e0 con 0x7f0e4010ddc0 2026-02-20T13:16:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.263+0000 7f0e3f7fe640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e140b57f0 0x7f0e140d5ca0 secure :-1 s=READY pgs=200 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e2c005970 tx=0x7f0e2c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.267 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574876 got 55834574874 for osd.1 2026-02-20T13:16:50.291 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:50 trial028 ceph-mon[37442]: pgmap v164: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 27 op/s 2026-02-20T13:16:50.291 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:50 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4108159665' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-20T13:16:50.291 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:50 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4094079357' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-20T13:16:50.328 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986198 got 133143986196 for osd.4 2026-02-20T13:16:50.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.384+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0e400f6bd0 con 0x7f0e4010ddc0 2026-02-20T13:16:50.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.384+0000 7f0e3cff9640 1 -- 10.20.193.28:0/2862880319 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0e300d6690 con 0x7f0e4010ddc0 2026-02-20T13:16:50.388 INFO:teuthology.orchestra.run.trial028.stdout:201863462928 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e140b57f0 msgr2=0x7f0e140d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e140b57f0 0x7f0e140d5ca0 secure :-1 s=READY pgs=200 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e2c005970 tx=0x7f0e2c005900 comp rx=0 tx=0).stop 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4010ddc0 msgr2=0x7f0e40173e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4010ddc0 0x7f0e40173e90 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e30005f10 tx=0x7f0e300047b0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 shutdown_connections 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e140b57f0 0x7f0e140d5ca0 unknown :-1 s=CLOSED pgs=200 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e401135c0 0x7f0e400f6170 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4010ddc0 0x7f0e40173e90 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 --2- 10.20.193.28:0/2862880319 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4010d3d0 0x7f0e400f5a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 >> 10.20.193.28:0/2862880319 conn(0x7f0e400eacc0 msgr2=0x7f0e40110c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 shutdown_connections 2026-02-20T13:16:50.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.387+0000 7f0e45c2d640 1 -- 10.20.193.28:0/2862880319 wait complete. 2026-02-20T13:16:50.435 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612617 got 313532612616 for osd.11 2026-02-20T13:16:50.436 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444058 got 73014444058 for osd.2 2026-02-20T13:16:50.436 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:50.446 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855380 got 150323855380 for osd.5 2026-02-20T13:16:50.447 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:50.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:50 trial127 ceph-mon[43817]: pgmap v164: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 27 op/s 2026-02-20T13:16:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:50 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4108159665' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-20T13:16:50.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:50 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4094079357' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-20T13:16:50.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f59cbdfe640 1 -- 10.20.193.28:0/470541944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 msgr2=0x7f59c4114bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/470541944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 0x7f59c4114bd0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=18375827720301165632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b8009950 tx=0x7f59b80302e0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f51fbfff640 1 -- 10.20.193.28:0/450890972 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51fc02fc30 con 0x7f520c10d3d0 2026-02-20T13:16:50.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 -- 10.20.193.28:0/450890972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f520c10d3d0 msgr2=0x7f520c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 --2- 10.20.193.28:0/450890972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f520c10d3d0 0x7f520c10d7a0 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=13760356773127571327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51fc009950 tx=0x7f51fc02f1b0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 -- 10.20.193.28:0/450890972 shutdown_connections 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 --2- 10.20.193.28:0/450890972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f520c10ddc0 0x7f520c112e10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 --2- 10.20.193.28:0/450890972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f520c1135c0 0x7f520c173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 --2- 10.20.193.28:0/450890972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f520c10d3d0 0x7f520c10d7a0 unknown :-1 s=CLOSED pgs=103 gs=2 cs=0 l=1 c_cookie=13760356773127571327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 -- 10.20.193.28:0/450890972 >> 10.20.193.28:0/450890972 conn(0x7f520c0eacc0 msgr2=0x7f520c10b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 -- 10.20.193.28:0/450890972 shutdown_connections 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.475+0000 7f5213a12640 1 -- 10.20.193.28:0/450890972 wait complete. 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.476+0000 7f5213a12640 1 Processor -- start 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.476+0000 7f5213a12640 1 -- start start 2026-02-20T13:16:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.477+0000 7f59cbdfe640 1 -- 10.20.193.28:0/470541944 shutdown_connections 2026-02-20T13:16:50.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.477+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/470541944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c405ab30 0x7f59c417aba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.477+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/470541944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c41151f0 0x7f59c41167e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.477+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/470541944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 0x7f59c4114bd0 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=18375827720301165632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.477+0000 7f59cbdfe640 1 -- 10.20.193.28:0/470541944 >> 10.20.193.28:0/470541944 conn(0x7f59c4058c80 msgr2=0x7f59c4059080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.477+0000 7f59cbdfe640 1 -- 10.20.193.28:0/470541944 shutdown_connections 2026-02-20T13:16:50.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.477+0000 7f59cbdfe640 1 -- 10.20.193.28:0/470541944 wait complete. 2026-02-20T13:16:50.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.478+0000 7f5213a12640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f520c10d3d0 0x7f520c05e3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.478+0000 7f5213a12640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f520c10ddc0 0x7f520c173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.478+0000 7f5213a12640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f520c1135c0 0x7f520c05a670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.478+0000 7f5213a12640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f520c05acc0 con 0x7f520c10ddc0 2026-02-20T13:16:50.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.478+0000 7f5211f88640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f520c1135c0 0x7f520c05a670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5211f88640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f520c1135c0 0x7f520c05a670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52460/0 (socket says 10.20.193.28:52460) 2026-02-20T13:16:50.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5211f88640 1 -- 10.20.193.28:0/1276501215 learned_addr learned my addr 10.20.193.28:0/1276501215 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:50.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f520c05ae30 con 0x7f520c10d3d0 2026-02-20T13:16:50.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5211787640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f520c10d3d0 0x7f520c05e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f520c05aff0 con 0x7f520c1135c0 2026-02-20T13:16:50.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5210f86640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f520c10ddc0 0x7f520c173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f59cbdfe640 1 Processor -- start 2026-02-20T13:16:50.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5210f86640 1 -- 10.20.193.28:0/1276501215 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f520c1135c0 msgr2=0x7f520c05a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5210f86640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f520c1135c0 0x7f520c05a670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5210f86640 1 -- 10.20.193.28:0/1276501215 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f520c10d3d0 msgr2=0x7f520c05e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5210f86640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f520c10d3d0 0x7f520c05e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f59cbdfe640 1 -- start start 2026-02-20T13:16:50.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.479+0000 7f5210f86640 1 -- 10.20.193.28:0/1276501215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520800a590 con 0x7f520c10ddc0 2026-02-20T13:16:50.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f5210f86640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f520c10ddc0 0x7f520c173e90 secure :-1 s=READY pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5200012c40 tx=0x7f5200010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59cbdfe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c405ab30 0x7f59c40f8470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59cbdfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 0x7f59c417ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59cbdfe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c41151f0 0x7f59c40f4800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59cbdfe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40f4f00 con 0x7f59c4114800 2026-02-20T13:16:50.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59cbdfe640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40f5070 con 0x7f59c405ab30 2026-02-20T13:16:50.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59cbdfe640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40f5230 con 0x7f59c41151f0 2026-02-20T13:16:50.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59c9b73640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c405ab30 0x7f59c40f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f51fa7fc640 1 -- 10.20.193.28:0/1276501215 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f520001c070 con 0x7f520c10ddc0 2026-02-20T13:16:50.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59c9372640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 0x7f59c417ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51fc009570 con 0x7f520c10ddc0 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59c9372640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 0x7f59c417ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49486/0 (socket says 10.20.193.28:49486) 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f59c9372640 1 -- 10.20.193.28:0/3487347609 learned_addr learned my addr 10.20.193.28:0/3487347609 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59ca374640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c41151f0 0x7f59c40f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59c9b73640 1 -- 10.20.193.28:0/3487347609 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c41151f0 msgr2=0x7f59c40f4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59c9b73640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c41151f0 0x7f59c40f4800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59c9b73640 1 -- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 msgr2=0x7f59c417ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59c9b73640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 0x7f59c417ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59c9b73640 1 -- 10.20.193.28:0/3487347609 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b8009570 con 0x7f59c405ab30 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59c9b73640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c405ab30 0x7f59c40f8470 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b80098a0 tx=0x7f59b80028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59b2ffd640 1 -- 10.20.193.28:0/3487347609 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b8005e40 con 0x7f59c405ab30 2026-02-20T13:16:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f59b2ffd640 1 -- 10.20.193.28:0/3487347609 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59b8032ed0 con 0x7f59c405ab30 2026-02-20T13:16:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.482+0000 7f59b2ffd640 1 -- 10.20.193.28:0/3487347609 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b8039790 con 0x7f59c405ab30 2026-02-20T13:16:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.482+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c40f54b0 con 0x7f59c405ab30 2026-02-20T13:16:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.482+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c4100a60 con 0x7f59c405ab30 2026-02-20T13:16:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f51fa7fc640 1 -- 10.20.193.28:0/1276501215 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5200013040 con 0x7f520c10ddc0 2026-02-20T13:16:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.480+0000 7f51fa7fc640 1 -- 10.20.193.28:0/1276501215 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f520000b9e0 con 0x7f520c10ddc0 2026-02-20T13:16:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.481+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520c102520 con 0x7f520c10ddc0 2026-02-20T13:16:50.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.482+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f520c10e6b0 con 0x7f520c10ddc0 2026-02-20T13:16:50.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.482+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598c005300 con 0x7f59c405ab30 2026-02-20T13:16:50.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.483+0000 7f51fa7fc640 1 -- 10.20.193.28:0/1276501215 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f52000048e0 con 0x7f520c10ddc0 2026-02-20T13:16:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.484+0000 7f59b2ffd640 1 -- 10.20.193.28:0/3487347609 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f59b8039920 con 0x7f59c405ab30 2026-02-20T13:16:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.486+0000 7f59b2ffd640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b57f0 0x7f59a00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.486+0000 7f59b2ffd640 1 -- 10.20.193.28:0/3487347609 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f59b810b7d0 con 0x7f59c405ab30 2026-02-20T13:16:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.487+0000 7f59b2ffd640 1 -- 10.20.193.28:0/3487347609 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f59b80ce230 con 0x7f59c405ab30 2026-02-20T13:16:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.487+0000 7f59c9372640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b57f0 0x7f59a00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.488+0000 7f59c9372640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b57f0 0x7f59a00d5ca0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b4005ea0 tx=0x7f59b4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7f51fa7fc640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f51e40b57f0 0x7f51e40d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7f51fa7fc640 1 -- 10.20.193.28:0/1276501215 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f52000ea140 con 0x7f520c10ddc0 2026-02-20T13:16:50.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7f5211787640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f51e40b57f0 0x7f51e40d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7efe72267640 1 -- 10.20.193.28:0/3904923664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe6c10f230 msgr2=0x7efe6c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7efe72267640 1 --2- 10.20.193.28:0/3904923664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe6c10f230 0x7efe6c10f600 secure :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=10031869490753745146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe58009950 tx=0x7efe5802f190 comp rx=0 tx=0).stop 2026-02-20T13:16:50.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7efe72267640 1 -- 10.20.193.28:0/3904923664 shutdown_connections 2026-02-20T13:16:50.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7efe72267640 1 --2- 10.20.193.28:0/3904923664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe6c10fc20 0x7efe6c114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7efe72267640 1 --2- 10.20.193.28:0/3904923664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe6c115420 0x7efe6c175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7efe72267640 1 --2- 10.20.193.28:0/3904923664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe6c10f230 0x7efe6c10f600 unknown :-1 s=CLOSED pgs=91 gs=1 cs=0 l=1 c_cookie=10031869490753745146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.489+0000 7efe72267640 1 -- 10.20.193.28:0/3904923664 >> 10.20.193.28:0/3904923664 conn(0x7efe6c05f830 msgr2=0x7efe6c10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.490+0000 7efe72267640 1 -- 10.20.193.28:0/3904923664 shutdown_connections 2026-02-20T13:16:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.490+0000 7efe72267640 1 -- 10.20.193.28:0/3904923664 wait complete. 2026-02-20T13:16:50.495 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:50 trial034 ceph-mon[43332]: pgmap v164: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 27 op/s 2026-02-20T13:16:50.495 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:50 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4108159665' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-20T13:16:50.495 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:50 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4094079357' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-20T13:16:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.490+0000 7f5211787640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f51e40b57f0 0x7f51e40d5ca0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51fc005b30 tx=0x7f51fc03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.490+0000 7efe72267640 1 Processor -- start 2026-02-20T13:16:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe72267640 1 -- start start 2026-02-20T13:16:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe72267640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe6c10f230 0x7efe6c11dc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe72267640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe6c10fc20 0x7efe6c11e160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7f51fa7fc640 1 -- 10.20.193.28:0/1276501215 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f52000acad0 con 0x7f520c10ddc0 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe72267640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe6c115420 0x7efe6c123530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe72267640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c123b50 con 0x7efe6c10fc20 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe72267640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c123cc0 con 0x7efe6c115420 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe72267640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c123e80 con 0x7efe6c10f230 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe6c10fc20 0x7efe6c11e160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe6c10fc20 0x7efe6c11e160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49504/0 (socket says 10.20.193.28:49504) 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6affd640 1 -- 10.20.193.28:0/464856787 learned_addr learned my addr 10.20.193.28:0/464856787 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6b7fe640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe6c10f230 0x7efe6c11dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6bfff640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe6c115420 0x7efe6c123530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6affd640 1 -- 10.20.193.28:0/464856787 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe6c10f230 msgr2=0x7efe6c11dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6affd640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe6c10f230 0x7efe6c11dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6affd640 1 -- 10.20.193.28:0/464856787 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe6c115420 msgr2=0x7efe6c123530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6affd640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe6c115420 0x7efe6c123530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.491+0000 7efe6affd640 1 -- 10.20.193.28:0/464856787 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c0094b0 con 0x7efe6c10fc20 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.492+0000 7efe6affd640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe6c10fc20 0x7efe6c11e160 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5c002950 tx=0x7efe5c002e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.492+0000 7efe68ff9640 1 -- 10.20.193.28:0/464856787 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe5c00ec10 con 0x7efe6c10fc20 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.492+0000 7efe68ff9640 1 -- 10.20.193.28:0/464856787 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efe5c00ed70 con 0x7efe6c10fc20 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.492+0000 7efe68ff9640 1 -- 10.20.193.28:0/464856787 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe5c018a80 con 0x7efe6c10fc20 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.492+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6000a590 con 0x7efe6c10fc20 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.492+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe58009570 con 0x7efe6c10fc20 2026-02-20T13:16:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.494+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe30005300 con 0x7efe6c10fc20 2026-02-20T13:16:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.494+0000 7efe68ff9640 1 -- 10.20.193.28:0/464856787 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7efe5c016020 con 0x7efe6c10fc20 2026-02-20T13:16:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.495+0000 7f8c5de8f640 1 -- 10.20.193.28:0/3586564079 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 msgr2=0x7f8c58067ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.495+0000 7f8c5de8f640 1 --2- 10.20.193.28:0/3586564079 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 0x7f8c58067ad0 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=4994379199914813764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c48009890 tx=0x7f8c4802f0e0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.495+0000 7f8c5de8f640 1 -- 10.20.193.28:0/3586564079 shutdown_connections 2026-02-20T13:16:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.495+0000 7f8c5de8f640 1 --2- 10.20.193.28:0/3586564079 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8c58159e80 0x7f8c5817a280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.495+0000 7f8c5de8f640 1 --2- 10.20.193.28:0/3586564079 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 0x7f8c58067ad0 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=4994379199914813764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.495+0000 7f8c5de8f640 1 --2- 10.20.193.28:0/3586564079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c58069090 0x7f8c58067160 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.495+0000 7f8c5de8f640 1 -- 10.20.193.28:0/3586564079 >> 10.20.193.28:0/3586564079 conn(0x7f8c58064c90 msgr2=0x7f8c58065090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.496+0000 7efe68ff9640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe400b57f0 0x7efe400d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.496+0000 7efe68ff9640 1 -- 10.20.193.28:0/464856787 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7efe5c0e7200 con 0x7efe6c10fc20 2026-02-20T13:16:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.496+0000 7efe6b7fe640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe400b57f0 0x7efe400d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.497+0000 7efe6b7fe640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe400b57f0 0x7efe400d5ca0 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe580023d0 tx=0x7efe58031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.497+0000 7efe68ff9640 1 -- 10.20.193.28:0/464856787 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7efe5c0a9b50 con 0x7efe6c10fc20 2026-02-20T13:16:50.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.498+0000 7f8c5de8f640 1 -- 10.20.193.28:0/3586564079 shutdown_connections 2026-02-20T13:16:50.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.498+0000 7f8c5de8f640 1 -- 10.20.193.28:0/3586564079 wait complete. 2026-02-20T13:16:50.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.498+0000 7f8c5de8f640 1 Processor -- start 2026-02-20T13:16:50.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.499+0000 7f8c5de8f640 1 -- start start 2026-02-20T13:16:50.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.499+0000 7f8c5de8f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 0x7f8c58166070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.499+0000 7f8c5de8f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c58069090 0x7f8c581665b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.499+0000 7f8c5de8f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8c58159e80 0x7f8c5816b980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.499+0000 7f8c5de8f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5816bfa0 con 0x7f8c58069090 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.499+0000 7f8c5de8f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5816c110 con 0x7f8c580676a0 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.499+0000 7f8c5de8f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5816c2d0 con 0x7f8c58159e80 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.499+0000 7f8c577fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 0x7f8c58166070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c577fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 0x7f8c58166070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50992/0 (socket says 10.20.193.28:50992) 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c577fe640 1 -- 10.20.193.28:0/4144373694 learned_addr learned my addr 10.20.193.28:0/4144373694 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c56ffd640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c58069090 0x7f8c581665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c57fff640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8c58159e80 0x7f8c5816b980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c577fe640 1 -- 10.20.193.28:0/4144373694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8c58159e80 msgr2=0x7f8c5816b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c577fe640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8c58159e80 0x7f8c5816b980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c577fe640 1 -- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c58069090 msgr2=0x7f8c581665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c577fe640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c58069090 0x7f8c581665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c577fe640 1 -- 10.20.193.28:0/4144373694 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c440094b0 con 0x7f8c580676a0 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.500+0000 7f8c577fe640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 0x7f8c58166070 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c44009fd0 tx=0x7f8c44002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.501+0000 7f8c54ff9640 1 -- 10.20.193.28:0/4144373694 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c4400ed60 con 0x7f8c580676a0 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.501+0000 7f8c54ff9640 1 -- 10.20.193.28:0/4144373694 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c44002e20 con 0x7f8c580676a0 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.501+0000 7f8c54ff9640 1 -- 10.20.193.28:0/4144373694 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c44018950 con 0x7f8c580676a0 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.501+0000 7f8c5de8f640 1 -- 10.20.193.28:0/4144373694 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c480094b0 con 0x7f8c580676a0 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.501+0000 7f8c5de8f640 1 -- 10.20.193.28:0/4144373694 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c58155db0 con 0x7f8c580676a0 2026-02-20T13:16:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.501+0000 7f8c327fc640 1 -- 10.20.193.28:0/4144373694 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c58068670 con 0x7f8c580676a0 2026-02-20T13:16:50.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.504+0000 7f8c54ff9640 1 -- 10.20.193.28:0/4144373694 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f8c44016020 con 0x7f8c580676a0 2026-02-20T13:16:50.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.506+0000 7f8c54ff9640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c2c0b5870 0x7f8c2c0d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.506+0000 7f8c54ff9640 1 -- 10.20.193.28:0/4144373694 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f8c440e6e80 con 0x7f8c580676a0 2026-02-20T13:16:50.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.506+0000 7f8c54ff9640 1 -- 10.20.193.28:0/4144373694 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8c440e7280 con 0x7f8c580676a0 2026-02-20T13:16:50.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.506+0000 7f8c56ffd640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c2c0b5870 0x7f8c2c0d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.507+0000 7f8c56ffd640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c2c0b5870 0x7f8c2c0d5d20 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c5816ca10 tx=0x7f8c48002390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.563 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462928 got 201863462928 for osd.7 2026-02-20T13:16:50.563 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:50.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.607+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1562523663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10c900 msgr2=0x7fcd8c111950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.607+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1562523663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10c900 0x7fcd8c111950 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=14430764443846408566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd74009890 tx=0x7fcd7402f120 comp rx=0 tx=0).stop 2026-02-20T13:16:50.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.607+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1562523663 shutdown_connections 2026-02-20T13:16:50.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.607+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1562523663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10c900 0x7fcd8c111950 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=14430764443846408566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.607+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1562523663 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd8c112100 0x7fcd8c172ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.607+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1562523663 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd8c10bf10 0x7fcd8c10c2e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.607+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1562523663 >> 10.20.193.28:0/1562523663 conn(0x7fcd8c0e97e0 msgr2=0x7fcd8c109bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.608+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1562523663 shutdown_connections 2026-02-20T13:16:50.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.608+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1562523663 wait complete. 2026-02-20T13:16:50.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.609+0000 7fcd92f0b640 1 Processor -- start 2026-02-20T13:16:50.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.609+0000 7fcd92f0b640 1 -- start start 2026-02-20T13:16:50.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd92f0b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10bf10 0x7fcd8c0eec40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd92f0b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd8c10c900 0x7fcd8c1729d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd92f0b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd8c112100 0x7fcd8c0ef340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd92f0b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c0f4550 con 0x7fcd8c10bf10 2026-02-20T13:16:50.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd92f0b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c0f46c0 con 0x7fcd8c112100 2026-02-20T13:16:50.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd92f0b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c0f4880 con 0x7fcd8c10c900 2026-02-20T13:16:50.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd83fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd8c10c900 0x7fcd8c1729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd83fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd8c10c900 0x7fcd8c1729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52508/0 (socket says 10.20.193.28:52508) 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd83fff640 1 -- 10.20.193.28:0/1865974244 learned_addr learned my addr 10.20.193.28:0/1865974244 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd91481640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd8c112100 0x7fcd8c0ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.610+0000 7fcd90c80640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10bf10 0x7fcd8c0eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.611+0000 7fcd83fff640 1 -- 10.20.193.28:0/1865974244 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd8c112100 msgr2=0x7fcd8c0ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.611+0000 7fcd83fff640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd8c112100 0x7fcd8c0ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.611+0000 7fcd83fff640 1 -- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10bf10 msgr2=0x7fcd8c0eec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.611+0000 7fcd83fff640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10bf10 0x7fcd8c0eec40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.611+0000 7fcd83fff640 1 -- 10.20.193.28:0/1865974244 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c009570 con 0x7fcd8c10c900 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.611+0000 7fcd91481640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd8c112100 0x7fcd8c0ef340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.611+0000 7fcd90c80640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10bf10 0x7fcd8c0eec40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.611+0000 7fcd83fff640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd8c10c900 0x7fcd8c1729d0 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd740023b0 tx=0x7fcd740028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.612+0000 7fcd81ffb640 1 -- 10.20.193.28:0/1865974244 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd7403d070 con 0x7fcd8c10c900 2026-02-20T13:16:50.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.612+0000 7fcd81ffb640 1 -- 10.20.193.28:0/1865974244 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcd740044f0 con 0x7fcd8c10c900 2026-02-20T13:16:50.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.612+0000 7fcd81ffb640 1 -- 10.20.193.28:0/1865974244 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd740419e0 con 0x7fcd8c10c900 2026-02-20T13:16:50.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.612+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8800a590 con 0x7fcd8c10c900 2026-02-20T13:16:50.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.612+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd740094b0 con 0x7fcd8c10c900 2026-02-20T13:16:50.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 -- 10.20.193.28:0/3743966807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810d3d0 msgr2=0x7f438810d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3743966807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810d3d0 0x7f438810d7a0 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=796745030034021714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f437c00aa30 tx=0x7f437c030280 comp rx=0 tx=0).stop 2026-02-20T13:16:50.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 -- 10.20.193.28:0/3743966807 shutdown_connections 2026-02-20T13:16:50.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3743966807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43881135c0 0x7f4388173f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3743966807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438810ddc0 0x7f4388112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3743966807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810d3d0 0x7f438810d7a0 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=796745030034021714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 -- 10.20.193.28:0/3743966807 >> 10.20.193.28:0/3743966807 conn(0x7f43880eacc0 msgr2=0x7f438810b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 -- 10.20.193.28:0/3743966807 shutdown_connections 2026-02-20T13:16:50.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.614+0000 7f438d8d6640 1 -- 10.20.193.28:0/3743966807 wait complete. 2026-02-20T13:16:50.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.615+0000 7f438d8d6640 1 Processor -- start 2026-02-20T13:16:50.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.615+0000 7f438d8d6640 1 -- start start 2026-02-20T13:16:50.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f438d8d6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438810d3d0 0x7f4388108f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f438d8d6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810ddc0 0x7f4388173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f438d8d6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43881135c0 0x7f4388109630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f438d8d6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f43880ee1a0 con 0x7f438810ddc0 2026-02-20T13:16:50.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f43877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43881135c0 0x7f4388109630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.615+0000 7fcd81ffb640 1 -- 10.20.193.28:0/1865974244 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fcd74048020 con 0x7fcd8c10c900 2026-02-20T13:16:50.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f43877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43881135c0 0x7f4388109630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52520/0 (socket says 10.20.193.28:52520) 2026-02-20T13:16:50.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f43877fe640 1 -- 10.20.193.28:0/3056901992 learned_addr learned my addr 10.20.193.28:0/3056901992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:50.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f4386ffd640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438810d3d0 0x7f4388108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f43880ee310 con 0x7f438810d3d0 2026-02-20T13:16:50.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f43880ee4d0 con 0x7f43881135c0 2026-02-20T13:16:50.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7f43867fc640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810ddc0 0x7f4388173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7f4386ffd640 1 -- 10.20.193.28:0/3056901992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43881135c0 msgr2=0x7f4388109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd8c10d1f0 con 0x7fcd8c10c900 2026-02-20T13:16:50.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7fcd81ffb640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd680b57e0 0x7fcd680d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.616+0000 7fcd81ffb640 1 -- 10.20.193.28:0/1865974244 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fcd7410ada0 con 0x7fcd8c10c900 2026-02-20T13:16:50.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7fcd90c80640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd680b57e0 0x7fcd680d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7f4386ffd640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43881135c0 0x7f4388109630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7f4386ffd640 1 -- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810ddc0 msgr2=0x7f4388173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7f4386ffd640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810ddc0 0x7f4388173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7f4386ffd640 1 -- 10.20.193.28:0/3056901992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c00a650 con 0x7f438810d3d0 2026-02-20T13:16:50.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7f43867fc640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810ddc0 0x7f4388173e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:50.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7fcd90c80640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd680b57e0 0x7fcd680d5c90 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd7c005b30 tx=0x7fcd7c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.617+0000 7f43877fe640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43881135c0 0x7f4388109630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:50.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.618+0000 7f4386ffd640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438810d3d0 0x7f4388108f30 secure :-1 s=READY pgs=107 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f437c030790 tx=0x7f437c030cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.618+0000 7f438c8d4640 1 -- 10.20.193.28:0/3056901992 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f437c03e070 con 0x7f438810d3d0 2026-02-20T13:16:50.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.618+0000 7f438c8d4640 1 -- 10.20.193.28:0/3056901992 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f437c039e40 con 0x7f438810d3d0 2026-02-20T13:16:50.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.618+0000 7f438c8d4640 1 -- 10.20.193.28:0/3056901992 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f437c03e070 con 0x7f438810d3d0 2026-02-20T13:16:50.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.618+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43880ee750 con 0x7f438810d3d0 2026-02-20T13:16:50.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.618+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43880eeb70 con 0x7f438810d3d0 2026-02-20T13:16:50.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.618+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f520c10d7a0 con 0x7f520c10ddc0 2026-02-20T13:16:50.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.619+0000 7fcd81ffb640 1 -- 10.20.193.28:0/1865974244 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fcd740cd800 con 0x7fcd8c10c900 2026-02-20T13:16:50.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.619+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438810e6b0 con 0x7f438810d3d0 2026-02-20T13:16:50.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.620+0000 7f51fa7fc640 1 -- 10.20.193.28:0/1276501215 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52000afc80 con 0x7f520c10ddc0 2026-02-20T13:16:50.626 INFO:teuthology.orchestra.run.trial028.stdout:38654705693 2026-02-20T13:16:50.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.621+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f598c005880 con 0x7f59c405ab30 2026-02-20T13:16:50.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.621+0000 7f438c8d4640 1 -- 10.20.193.28:0/3056901992 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f437c039960 con 0x7f438810d3d0 2026-02-20T13:16:50.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.623+0000 7f59b2ffd640 1 -- 10.20.193.28:0/3487347609 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f59b80d13e0 con 0x7f59c405ab30 2026-02-20T13:16:50.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.622+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f51e40b57f0 msgr2=0x7f51e40d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.622+0000 7f5213a12640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f51e40b57f0 0x7f51e40d5ca0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51fc005b30 tx=0x7f51fc03a040 comp rx=0 tx=0).stop 2026-02-20T13:16:50.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.622+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f520c10ddc0 msgr2=0x7f520c173e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.622+0000 7f5213a12640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f520c10ddc0 0x7f520c173e90 secure :-1 s=READY pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5200012c40 tx=0x7f5200010490 comp rx=0 tx=0).stop 2026-02-20T13:16:50.628 INFO:teuthology.orchestra.run.trial028.stdout:283467841546 2026-02-20T13:16:50.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.623+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 shutdown_connections 2026-02-20T13:16:50.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.623+0000 7f5213a12640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f51e40b57f0 0x7f51e40d5ca0 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.623+0000 7f5213a12640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f520c10ddc0 0x7f520c173e90 unknown :-1 s=CLOSED pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.623+0000 7f5213a12640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f520c1135c0 0x7f520c05a670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.623+0000 7f5213a12640 1 --2- 10.20.193.28:0/1276501215 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f520c10d3d0 0x7f520c05e3b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.623+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 >> 10.20.193.28:0/1276501215 conn(0x7f520c0eacc0 msgr2=0x7f520c110350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.623+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 shutdown_connections 2026-02-20T13:16:50.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.624+0000 7f5213a12640 1 -- 10.20.193.28:0/1276501215 wait complete. 2026-02-20T13:16:50.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.624+0000 7f438c8d4640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5820 0x7f435c0d5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:50.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.624+0000 7f438c8d4640 1 -- 10.20.193.28:0/3056901992 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f437c10c2f0 con 0x7f438810d3d0 2026-02-20T13:16:50.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.624+0000 7f438c8d4640 1 -- 10.20.193.28:0/3056901992 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f437c10c770 con 0x7f438810d3d0 2026-02-20T13:16:50.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.624+0000 7f43867fc640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5820 0x7f435c0d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:50.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.626+0000 7f43867fc640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5820 0x7f435c0d5cd0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f438810fdb0 tx=0x7f4370005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:50.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.625+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b57f0 msgr2=0x7f59a00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.625+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b57f0 0x7f59a00d5ca0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b4005ea0 tx=0x7f59b4005e30 comp rx=0 tx=0).stop 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.625+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c405ab30 msgr2=0x7f59c40f8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.625+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c405ab30 0x7f59c40f8470 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b80098a0 tx=0x7f59b80028d0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.626+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 shutdown_connections 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.626+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b57f0 0x7f59a00d5ca0 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.626+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c4114800 0x7f59c417ab10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.626+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c41151f0 0x7f59c40f4800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.626+0000 7f59cbdfe640 1 --2- 10.20.193.28:0/3487347609 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c405ab30 0x7f59c40f8470 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.626+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 >> 10.20.193.28:0/3487347609 conn(0x7f59c4058c80 msgr2=0x7f59c4118820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.626+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 shutdown_connections 2026-02-20T13:16:50.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.629+0000 7f59cbdfe640 1 -- 10.20.193.28:0/3487347609 wait complete. 2026-02-20T13:16:50.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.631+0000 7f8c327fc640 1 -- 10.20.193.28:0/4144373694 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8c58067130 con 0x7f8c580676a0 2026-02-20T13:16:50.635 INFO:teuthology.orchestra.run.trial028.stdout:103079215127 2026-02-20T13:16:50.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.632+0000 7f8c54ff9640 1 -- 10.20.193.28:0/4144373694 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8c440a9860 con 0x7f8c580676a0 2026-02-20T13:16:50.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.633+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7efe300055b0 con 0x7efe6c10fc20 2026-02-20T13:16:50.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.633+0000 7efe68ff9640 1 -- 10.20.193.28:0/464856787 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efe5c0acd00 con 0x7efe6c10fc20 2026-02-20T13:16:50.636 INFO:teuthology.orchestra.run.trial028.stdout:266287972363 2026-02-20T13:16:50.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 -- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c2c0b5870 msgr2=0x7f8c2c0d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c2c0b5870 0x7f8c2c0d5d20 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c5816ca10 tx=0x7f8c48002390 comp rx=0 tx=0).stop 2026-02-20T13:16:50.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 -- 10.20.193.28:0/4144373694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 msgr2=0x7f8c58166070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 0x7f8c58166070 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c44009fd0 tx=0x7f8c44002bc0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 -- 10.20.193.28:0/4144373694 shutdown_connections 2026-02-20T13:16:50.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c2c0b5870 0x7f8c2c0d5d20 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c58069090 0x7f8c581665b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8c58159e80 0x7f8c5816b980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 --2- 10.20.193.28:0/4144373694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8c580676a0 0x7f8c58166070 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.634+0000 7f8c327fc640 1 -- 10.20.193.28:0/4144373694 >> 10.20.193.28:0/4144373694 conn(0x7f8c58064c90 msgr2=0x7f8c58160970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.635+0000 7f8c327fc640 1 -- 10.20.193.28:0/4144373694 shutdown_connections 2026-02-20T13:16:50.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.635+0000 7f8c327fc640 1 -- 10.20.193.28:0/4144373694 wait complete. 2026-02-20T13:16:50.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.636+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe400b57f0 msgr2=0x7efe400d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.636+0000 7efe72267640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe400b57f0 0x7efe400d5ca0 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe580023d0 tx=0x7efe58031040 comp rx=0 tx=0).stop 2026-02-20T13:16:50.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.636+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe6c10fc20 msgr2=0x7efe6c11e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.636+0000 7efe72267640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe6c10fc20 0x7efe6c11e160 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5c002950 tx=0x7efe5c002e20 comp rx=0 tx=0).stop 2026-02-20T13:16:50.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.637+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 shutdown_connections 2026-02-20T13:16:50.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.637+0000 7efe72267640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe400b57f0 0x7efe400d5ca0 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.637+0000 7efe72267640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe6c10fc20 0x7efe6c11e160 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.637+0000 7efe72267640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe6c115420 0x7efe6c123530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.637+0000 7efe72267640 1 --2- 10.20.193.28:0/464856787 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe6c10f230 0x7efe6c11dc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.637+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 >> 10.20.193.28:0/464856787 conn(0x7efe6c05f830 msgr2=0x7efe6c10cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.638+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 shutdown_connections 2026-02-20T13:16:50.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.638+0000 7efe72267640 1 -- 10.20.193.28:0/464856787 wait complete. 2026-02-20T13:16:50.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.750+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcd8c0efda0 con 0x7fcd8c10c900 2026-02-20T13:16:50.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.751+0000 7fcd81ffb640 1 -- 10.20.193.28:0/1865974244 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcd740029f0 con 0x7fcd8c10c900 2026-02-20T13:16:50.754 INFO:teuthology.orchestra.run.trial028.stdout:184683593745 2026-02-20T13:16:50.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.753+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd680b57e0 msgr2=0x7fcd680d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.753+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd680b57e0 0x7fcd680d5c90 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd7c005b30 tx=0x7fcd7c009310 comp rx=0 tx=0).stop 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.753+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd8c10c900 msgr2=0x7fcd8c1729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.753+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd8c10c900 0x7fcd8c1729d0 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd740023b0 tx=0x7fcd740028d0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 shutdown_connections 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd680b57e0 0x7fcd680d5c90 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd8c112100 0x7fcd8c0ef340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd8c10c900 0x7fcd8c1729d0 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7fcd92f0b640 1 --2- 10.20.193.28:0/1865974244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd8c10bf10 0x7fcd8c0eec40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 >> 10.20.193.28:0/1865974244 conn(0x7fcd8c0e97e0 msgr2=0x7fcd8c10ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 shutdown_connections 2026-02-20T13:16:50.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7fcd92f0b640 1 -- 10.20.193.28:0/1865974244 wait complete. 2026-02-20T13:16:50.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.754+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f438810a0c0 con 0x7f438810d3d0 2026-02-20T13:16:50.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.755+0000 7f438c8d4640 1 -- 10.20.193.28:0/3056901992 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f437c0ced50 con 0x7f438810d3d0 2026-02-20T13:16:50.758 INFO:teuthology.orchestra.run.trial028.stdout:231928233998 2026-02-20T13:16:50.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5820 msgr2=0x7f435c0d5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5820 0x7f435c0d5cd0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f438810fdb0 tx=0x7f4370005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:50.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438810d3d0 msgr2=0x7f4388108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438810d3d0 0x7f4388108f30 secure :-1 s=READY pgs=107 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f437c030790 tx=0x7f437c030cf0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 shutdown_connections 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5820 0x7f435c0d5cd0 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438810ddc0 0x7f4388173e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43881135c0 0x7f4388109630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 --2- 10.20.193.28:0/3056901992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f438810d3d0 0x7f4388108f30 unknown :-1 s=CLOSED pgs=107 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.757+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 >> 10.20.193.28:0/3056901992 conn(0x7f43880eacc0 msgr2=0x7f4388110c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.758+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 shutdown_connections 2026-02-20T13:16:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:50.758+0000 7f438d8d6640 1 -- 10.20.193.28:0/3056901992 wait complete. 2026-02-20T13:16:50.859 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705693 got 38654705693 for osd.0 2026-02-20T13:16:50.859 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:50.861 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841546 got 283467841546 for osd.10 2026-02-20T13:16:50.861 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:50.907 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972363 got 266287972363 for osd.9 2026-02-20T13:16:50.907 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:50.953 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215127 got 103079215127 for osd.3 2026-02-20T13:16:50.954 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:50.964 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928233998 got 231928233998 for osd.8 2026-02-20T13:16:50.965 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:50.966 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593745 got 184683593745 for osd.6 2026-02-20T13:16:50.966 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:51.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-20T13:16:51.329 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-20T13:16:51.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1311875460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-20T13:16:51.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3867912801' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-20T13:16:51.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3837275664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-20T13:16:51.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2862880319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-20T13:16:51.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1276501215' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-20T13:16:51.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3487347609' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-20T13:16:51.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4144373694' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-20T13:16:51.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/464856787' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-20T13:16:51.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1865974244' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-20T13:16:51.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3056901992' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-20T13:16:51.436 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-20T13:16:51.455 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:51.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1311875460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3867912801' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3837275664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2862880319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1276501215' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3487347609' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4144373694' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/464856787' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1865974244' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-20T13:16:51.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3056901992' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-20T13:16:51.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1311875460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3867912801' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3837275664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2862880319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1276501215' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3487347609' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4144373694' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/464856787' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1865974244' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-20T13:16:51.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3056901992' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-20T13:16:51.512 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:51.622 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:51.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.634+0000 7f179886e640 1 -- 10.20.193.28:0/428993608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 msgr2=0x7f179410f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.634+0000 7f179886e640 1 --2- 10.20.193.28:0/428993608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 0x7f179410f880 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=411384214893793413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1780009950 tx=0x7f178002f190 comp rx=0 tx=0).stop 2026-02-20T13:16:51.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.634+0000 7f179886e640 1 -- 10.20.193.28:0/428993608 shutdown_connections 2026-02-20T13:16:51.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.634+0000 7f179886e640 1 --2- 10.20.193.28:0/428993608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f17941156a0 0x7f1794176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.634+0000 7f179886e640 1 --2- 10.20.193.28:0/428993608 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f179410fea0 0x7f1794114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.634+0000 7f179886e640 1 --2- 10.20.193.28:0/428993608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 0x7f179410f880 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=411384214893793413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.634+0000 7f179886e640 1 -- 10.20.193.28:0/428993608 >> 10.20.193.28:0/428993608 conn(0x7f17940ecd60 msgr2=0x7f179410d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:51.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.635+0000 7f179886e640 1 -- 10.20.193.28:0/428993608 shutdown_connections 2026-02-20T13:16:51.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.635+0000 7f179886e640 1 -- 10.20.193.28:0/428993608 wait complete. 2026-02-20T13:16:51.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.636+0000 7f179886e640 1 Processor -- start 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.636+0000 7f179886e640 1 -- start start 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.636+0000 7f179886e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 0x7f1794066f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.636+0000 7f179886e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f179410fea0 0x7f17940631a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.636+0000 7f179886e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17941156a0 0x7f1794063850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.636+0000 7f179886e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1794063f50 con 0x7f179410f4b0 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.636+0000 7f179886e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f17941684f0 con 0x7f17941156a0 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.636+0000 7f179886e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f17941686b0 con 0x7f179410fea0 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f179410fea0 0x7f17940631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f179410fea0 0x7f17940631a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52536/0 (socket says 10.20.193.28:52536) 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 -- 10.20.193.28:0/4013371682 learned_addr learned my addr 10.20.193.28:0/4013371682 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1793fff640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17941156a0 0x7f1794063850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f17937fe640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 0x7f1794066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 -- 10.20.193.28:0/4013371682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17941156a0 msgr2=0x7f1794063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17941156a0 0x7f1794063850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 -- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 msgr2=0x7f1794066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 0x7f1794066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 -- 10.20.193.28:0/4013371682 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1780009570 con 0x7f179410fea0 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1793fff640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17941156a0 0x7f1794063850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f17937fe640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 0x7f1794066f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.637+0000 7f1792ffd640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f179410fea0 0x7f17940631a0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f178400c9b0 tx=0x7f178400ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.638+0000 7f1790ff9640 1 -- 10.20.193.28:0/4013371682 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1784004560 con 0x7f179410fea0 2026-02-20T13:16:51.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.638+0000 7f1790ff9640 1 -- 10.20.193.28:0/4013371682 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1784007da0 con 0x7f179410fea0 2026-02-20T13:16:51.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.638+0000 7f1790ff9640 1 -- 10.20.193.28:0/4013371682 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f178400f6d0 con 0x7f179410fea0 2026-02-20T13:16:51.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.638+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1794168990 con 0x7f179410fea0 2026-02-20T13:16:51.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.638+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1794168e10 con 0x7f179410fea0 2026-02-20T13:16:51.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.638+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1794110790 con 0x7f179410fea0 2026-02-20T13:16:51.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.641+0000 7f1790ff9640 1 -- 10.20.193.28:0/4013371682 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f17840078c0 con 0x7f179410fea0 2026-02-20T13:16:51.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.643+0000 7f1790ff9640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17680b57f0 0x7f17680d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.643+0000 7f1790ff9640 1 -- 10.20.193.28:0/4013371682 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f17840e6bd0 con 0x7f179410fea0 2026-02-20T13:16:51.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.643+0000 7f1790ff9640 1 -- 10.20.193.28:0/4013371682 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f178411f730 con 0x7f179410fea0 2026-02-20T13:16:51.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.643+0000 7f17937fe640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17680b57f0 0x7f17680d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.644+0000 7f17937fe640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17680b57f0 0x7f17680d5ca0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17800098a0 tx=0x7f1780002390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.684+0000 7f260dadd640 1 -- 10.20.193.28:0/3671972341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810d3d0 msgr2=0x7f260810d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.684+0000 7f260dadd640 1 --2- 10.20.193.28:0/3671972341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810d3d0 0x7f260810d7a0 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=5481175150243283123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25f4009890 tx=0x7f25f402f0e0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.685+0000 7f260dadd640 1 -- 10.20.193.28:0/3671972341 shutdown_connections 2026-02-20T13:16:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.685+0000 7f260dadd640 1 --2- 10.20.193.28:0/3671972341 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f26081135c0 0x7f2608173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.685+0000 7f260dadd640 1 --2- 10.20.193.28:0/3671972341 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f260810ddc0 0x7f2608112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.685+0000 7f260dadd640 1 --2- 10.20.193.28:0/3671972341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810d3d0 0x7f260810d7a0 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=5481175150243283123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.685+0000 7f260dadd640 1 -- 10.20.193.28:0/3671972341 >> 10.20.193.28:0/3671972341 conn(0x7f26080eacc0 msgr2=0x7f260810b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.685+0000 7f260dadd640 1 -- 10.20.193.28:0/3671972341 shutdown_connections 2026-02-20T13:16:51.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.685+0000 7f260dadd640 1 -- 10.20.193.28:0/3671972341 wait complete. 2026-02-20T13:16:51.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f260dadd640 1 Processor -- start 2026-02-20T13:16:51.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f260dadd640 1 -- start start 2026-02-20T13:16:51.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f260dadd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f260810d3d0 0x7f26080f5930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f260dadd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810ddc0 0x7f2608173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f260dadd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f26081135c0 0x7f26080f6030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f260dadd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f26080fb1f0 con 0x7f260810ddc0 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f260dadd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f26080fb360 con 0x7f260810d3d0 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f260dadd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f26080fb520 con 0x7f26081135c0 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f2606ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810ddc0 0x7f2608173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f2606ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810ddc0 0x7f2608173e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49592/0 (socket says 10.20.193.28:49592) 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f2606ffd640 1 -- 10.20.193.28:0/3699835726 learned_addr learned my addr 10.20.193.28:0/3699835726 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f2607fff640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f26081135c0 0x7f26080f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.686+0000 7f26077fe640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f260810d3d0 0x7f26080f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2606ffd640 1 -- 10.20.193.28:0/3699835726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f26081135c0 msgr2=0x7f26080f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2606ffd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f26081135c0 0x7f26080f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2606ffd640 1 -- 10.20.193.28:0/3699835726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f260810d3d0 msgr2=0x7f26080f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2606ffd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f260810d3d0 0x7f26080f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2606ffd640 1 -- 10.20.193.28:0/3699835726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f8009570 con 0x7f260810ddc0 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2606ffd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810ddc0 0x7f2608173e90 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25f8005b30 tx=0x7f25f8002c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2604ff9640 1 -- 10.20.193.28:0/3699835726 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25f800ed60 con 0x7f260810ddc0 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2604ff9640 1 -- 10.20.193.28:0/3699835726 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f25f8002e70 con 0x7f260810ddc0 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f40094b0 con 0x7f260810ddc0 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f2604ff9640 1 -- 10.20.193.28:0/3699835726 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25f800f870 con 0x7f260810ddc0 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.687+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26080fbb90 con 0x7f260810ddc0 2026-02-20T13:16:51.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.688+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260810e6b0 con 0x7f260810ddc0 2026-02-20T13:16:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.691+0000 7f2604ff9640 1 -- 10.20.193.28:0/3699835726 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f25f801f060 con 0x7f260810ddc0 2026-02-20T13:16:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.693+0000 7f2604ff9640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f25dc0b57e0 0x7f25dc0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.693+0000 7f2604ff9640 1 -- 10.20.193.28:0/3699835726 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f25f80e7110 con 0x7f260810ddc0 2026-02-20T13:16:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.693+0000 7f26077fe640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f25dc0b57e0 0x7f25dc0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.693+0000 7f2604ff9640 1 -- 10.20.193.28:0/3699835726 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f25f80e7590 con 0x7f260810ddc0 2026-02-20T13:16:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.694+0000 7f26077fe640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f25dc0b57e0 0x7f25dc0d5c90 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25f40097e0 tx=0x7f25f403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:51.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.759+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f179410f8b0 con 0x7f179410fea0 2026-02-20T13:16:51.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.760+0000 7f1790ff9640 1 -- 10.20.193.28:0/4013371682 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f17840a9520 con 0x7f179410fea0 2026-02-20T13:16:51.763 INFO:teuthology.orchestra.run.trial028.stdout:55834574876 2026-02-20T13:16:51.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17680b57f0 msgr2=0x7f17680d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17680b57f0 0x7f17680d5ca0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17800098a0 tx=0x7f1780002390 comp rx=0 tx=0).stop 2026-02-20T13:16:51.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f179410fea0 msgr2=0x7f17940631a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f179410fea0 0x7f17940631a0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f178400c9b0 tx=0x7f178400ce80 comp rx=0 tx=0).stop 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 shutdown_connections 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17680b57f0 0x7f17680d5ca0 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17941156a0 0x7f1794063850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f179410fea0 0x7f17940631a0 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 --2- 10.20.193.28:0/4013371682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179410f4b0 0x7f1794066f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 >> 10.20.193.28:0/4013371682 conn(0x7f17940ecd60 msgr2=0x7f179410d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.762+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 shutdown_connections 2026-02-20T13:16:51.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.763+0000 7f179886e640 1 -- 10.20.193.28:0/4013371682 wait complete. 2026-02-20T13:16:51.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f26080f6a70 con 0x7f260810ddc0 2026-02-20T13:16:51.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2604ff9640 1 -- 10.20.193.28:0/3699835726 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f25f80a9a60 con 0x7f260810ddc0 2026-02-20T13:16:51.816 INFO:teuthology.orchestra.run.trial028.stdout:133143986198 2026-02-20T13:16:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/2024355931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0119ba0 msgr2=0x7f2ad017a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/2024355931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0119ba0 0x7f2ad017a570 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=157798337591121163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2acc00aa80 tx=0x7f2acc0302c0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/2024355931 shutdown_connections 2026-02-20T13:16:51.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/2024355931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0119ba0 0x7f2ad017a570 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=157798337591121163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/2024355931 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ad0114990 0x7f2ad01193f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/2024355931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ad0113fa0 0x7f2ad0114370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/2024355931 >> 10.20.193.28:0/2024355931 conn(0x7f2ad0064a90 msgr2=0x7f2ad0064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/2024355931 shutdown_connections 2026-02-20T13:16:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/2024355931 wait complete. 2026-02-20T13:16:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f25dc0b57e0 msgr2=0x7f25dc0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f25dc0b57e0 0x7f25dc0d5c90 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25f40097e0 tx=0x7f25f403a040 comp rx=0 tx=0).stop 2026-02-20T13:16:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810ddc0 msgr2=0x7f2608173e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810ddc0 0x7f2608173e90 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25f8005b30 tx=0x7f25f8002c10 comp rx=0 tx=0).stop 2026-02-20T13:16:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 Processor -- start 2026-02-20T13:16:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 shutdown_connections 2026-02-20T13:16:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f25dc0b57e0 0x7f25dc0d5c90 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f260810ddc0 0x7f2608173e90 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f26081135c0 0x7f26080f6030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 --2- 10.20.193.28:0/3699835726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f260810d3d0 0x7f26080f5930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 >> 10.20.193.28:0/3699835726 conn(0x7f26080eacc0 msgr2=0x7f2608110520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 shutdown_connections 2026-02-20T13:16:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f260dadd640 1 -- 10.20.193.28:0/3699835726 wait complete. 2026-02-20T13:16:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- start start 2026-02-20T13:16:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0113fa0 0x7f2ad00fbd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ad0114990 0x7f2ad017a470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ad0119ba0 0x7f2ad00fc490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01016a0 con 0x7f2ad0113fa0 2026-02-20T13:16:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0101810 con 0x7f2ad0114990 2026-02-20T13:16:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad5b8d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01019d0 con 0x7f2ad0119ba0 2026-02-20T13:16:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad4b8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0113fa0 0x7f2ad00fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad4b8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0113fa0 0x7f2ad00fbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49616/0 (socket says 10.20.193.28:49616) 2026-02-20T13:16:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad4b8b640 1 -- 10.20.193.28:0/4133107654 learned_addr learned my addr 10.20.193.28:0/4133107654 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad4b8b640 1 -- 10.20.193.28:0/4133107654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ad0119ba0 msgr2=0x7f2ad00fc490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:16:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad4b8b640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ad0119ba0 0x7f2ad00fc490 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad4b8b640 1 -- 10.20.193.28:0/4133107654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ad0114990 msgr2=0x7f2ad017a470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:16:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad4b8b640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ad0114990 0x7f2ad017a470 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.811+0000 7f2ad4b8b640 1 -- 10.20.193.28:0/4133107654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc00a650 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.816+0000 7f2ad4b8b640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0113fa0 0x7f2ad00fbd90 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ac000b500 tx=0x7f2ac000b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.816+0000 7f2ac5ffb640 1 -- 10.20.193.28:0/4133107654 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ac00044a0 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.816+0000 7f2ac5ffb640 1 -- 10.20.193.28:0/4133107654 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2ac0002b80 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.816+0000 7f2ac5ffb640 1 -- 10.20.193.28:0/4133107654 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ac000fd90 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.816+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad0101cb0 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.816+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad0102130 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.816+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a98005300 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.816+0000 7f2ac5ffb640 1 -- 10.20.193.28:0/4133107654 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f2ac00026a0 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.819+0000 7f2ac5ffb640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2aac0b57e0 0x7f2aac0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.819+0000 7f2ac5ffb640 1 -- 10.20.193.28:0/4133107654 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f2ac00e69b0 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.819+0000 7f2ac5ffb640 1 -- 10.20.193.28:0/4133107654 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f2ac011f750 con 0x7f2ad0113fa0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.819+0000 7f2ac7fff640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2aac0b57e0 0x7f2aac0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.819+0000 7f2ac7fff640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2aac0b57e0 0x7f2aac0d5c90 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ad0102730 tx=0x7f2ab8006cd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:51.869 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574876 got 55834574876 for osd.1 2026-02-20T13:16:51.870 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:51.926 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986198 got 133143986198 for osd.4 2026-02-20T13:16:51.926 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:51.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.939+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f2a98005880 con 0x7f2ad0113fa0 2026-02-20T13:16:51.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.939+0000 7f2ac5ffb640 1 -- 10.20.193.28:0/4133107654 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2ac00a9450 con 0x7f2ad0113fa0 2026-02-20T13:16:51.942 INFO:teuthology.orchestra.run.trial028.stdout:313532612617 2026-02-20T13:16:51.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2aac0b57e0 msgr2=0x7f2aac0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2aac0b57e0 0x7f2aac0d5c90 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ad0102730 tx=0x7f2ab8006cd0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0113fa0 msgr2=0x7f2ad00fbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0113fa0 0x7f2ad00fbd90 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ac000b500 tx=0x7f2ac000b9d0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 shutdown_connections 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2aac0b57e0 0x7f2aac0d5c90 unknown :-1 s=CLOSED pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ad0119ba0 0x7f2ad00fc490 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ad0114990 0x7f2ad017a470 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 --2- 10.20.193.28:0/4133107654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ad0113fa0 0x7f2ad00fbd90 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 >> 10.20.193.28:0/4133107654 conn(0x7f2ad0064a90 msgr2=0x7f2ad0065e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.941+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 shutdown_connections 2026-02-20T13:16:51.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:51.942+0000 7f2ad5b8d640 1 -- 10.20.193.28:0/4133107654 wait complete. 2026-02-20T13:16:52.041 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612617 got 313532612617 for osd.11 2026-02-20T13:16:52.041 DEBUG:teuthology.parallel:result is None 2026-02-20T13:16:52.041 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-20T13:16:52.041 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T13:16:52.267 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:52.311 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:52 trial028 ceph-mon[37442]: pgmap v165: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 26 op/s 2026-02-20T13:16:52.311 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:52 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4013371682' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-20T13:16:52.312 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:52 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3699835726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-20T13:16:52.312 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:52 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4133107654' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-20T13:16:52.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 -- 10.20.193.28:0/3077945570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28b0115420 msgr2=0x7f28b0175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:52.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 --2- 10.20.193.28:0/3077945570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28b0115420 0x7f28b0175df0 secure :-1 s=READY pgs=259 gs=2 cs=0 l=1 c_cookie=8419272779849112725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28a400aa30 tx=0x7f28a4030270 comp rx=0 tx=0).stop 2026-02-20T13:16:52.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 -- 10.20.193.28:0/3077945570 shutdown_connections 2026-02-20T13:16:52.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 --2- 10.20.193.28:0/3077945570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28b0115420 0x7f28b0175df0 unknown :-1 s=CLOSED pgs=259 gs=2 cs=0 l=1 c_cookie=8419272779849112725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 --2- 10.20.193.28:0/3077945570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28b010fc20 0x7f28b0114c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 --2- 10.20.193.28:0/3077945570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28b010f230 0x7f28b010f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 -- 10.20.193.28:0/3077945570 >> 10.20.193.28:0/3077945570 conn(0x7f28b005f830 msgr2=0x7f28b010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:52.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 -- 10.20.193.28:0/3077945570 shutdown_connections 2026-02-20T13:16:52.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.433+0000 7f28b61b1640 1 -- 10.20.193.28:0/3077945570 wait complete. 2026-02-20T13:16:52.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28b61b1640 1 Processor -- start 2026-02-20T13:16:52.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28b61b1640 1 -- start start 2026-02-20T13:16:52.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28b61b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28b010f230 0x7f28b011db50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:52.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28b61b1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28b010fc20 0x7f28b011e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:52.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28b61b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28b0115420 0x7f28b0123460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:52.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28b61b1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0123a80 con 0x7f28b0115420 2026-02-20T13:16:52.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28b61b1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0123bf0 con 0x7f28b010fc20 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28b61b1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0123db0 con 0x7f28b010f230 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28af7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28b010f230 0x7f28b011db50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28af7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28b010f230 0x7f28b011db50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52600/0 (socket says 10.20.193.28:52600) 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28af7fe640 1 -- 10.20.193.28:0/2354079974 learned_addr learned my addr 10.20.193.28:0/2354079974 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28aeffd640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28b010fc20 0x7f28b011e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.434+0000 7f28affff640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28b0115420 0x7f28b0123460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28af7fe640 1 -- 10.20.193.28:0/2354079974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28b010fc20 msgr2=0x7f28b011e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28af7fe640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28b010fc20 0x7f28b011e090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28af7fe640 1 -- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28b0115420 msgr2=0x7f28b0123460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28af7fe640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28b0115420 0x7f28b0123460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28af7fe640 1 -- 10.20.193.28:0/2354079974 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a400a650 con 0x7f28b010f230 2026-02-20T13:16:52.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28af7fe640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28b010f230 0x7f28b011db50 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f289c009480 tx=0x7f289c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:52.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28acff9640 1 -- 10.20.193.28:0/2354079974 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f289c00cd40 con 0x7f28b010f230 2026-02-20T13:16:52.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28acff9640 1 -- 10.20.193.28:0/2354079974 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f289c004d30 con 0x7f28b010f230 2026-02-20T13:16:52.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b0124090 con 0x7f28b010f230 2026-02-20T13:16:52.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28acff9640 1 -- 10.20.193.28:0/2354079974 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f289c010740 con 0x7f28b010f230 2026-02-20T13:16:52.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.435+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b0164790 con 0x7f28b010f230 2026-02-20T13:16:52.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.436+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b01242b0 con 0x7f28b010f230 2026-02-20T13:16:52.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.437+0000 7f28acff9640 1 -- 10.20.193.28:0/2354079974 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f289c01f060 con 0x7f28b010f230 2026-02-20T13:16:52.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.439+0000 7f28acff9640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28840b5770 0x7f28840d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:52.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.439+0000 7f28acff9640 1 -- 10.20.193.28:0/2354079974 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f289c014070 con 0x7f28b010f230 2026-02-20T13:16:52.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.439+0000 7f28aeffd640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28840b5770 0x7f28840d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:52.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.439+0000 7f28acff9640 1 -- 10.20.193.28:0/2354079974 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f289c0e7200 con 0x7f28b010f230 2026-02-20T13:16:52.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.440+0000 7f28aeffd640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28840b5770 0x7f28840d5c20 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28b01244f0 tx=0x7f28a00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:52.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:52 trial127 ceph-mon[43817]: pgmap v165: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 26 op/s 2026-02-20T13:16:52.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:52 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4013371682' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-20T13:16:52.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:52 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3699835726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-20T13:16:52.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:52 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4133107654' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-20T13:16:52.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:52 trial034 ceph-mon[43332]: pgmap v165: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 26 op/s 2026-02-20T13:16:52.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:52 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4013371682' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-20T13:16:52.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:52 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3699835726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-20T13:16:52.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:52 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4133107654' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-20T13:16:52.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.551+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28b011ecb0 con 0x7f28840b5770 2026-02-20T13:16:52.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.555+0000 7f28acff9640 1 -- 10.20.193.28:0/2354079974 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259013 (secure 0 0 0) 0x7f28b011ecb0 con 0x7f28840b5770 2026-02-20T13:16:52.561 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:52.562 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:16:52.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28840b5770 msgr2=0x7f28840d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:52.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28840b5770 0x7f28840d5c20 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28b01244f0 tx=0x7f28a00073d0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28b010f230 msgr2=0x7f28b011db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28b010f230 0x7f28b011db50 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f289c009480 tx=0x7f289c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 shutdown_connections 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28840b5770 0x7f28840d5c20 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28b0115420 0x7f28b0123460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28b010fc20 0x7f28b011e090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 --2- 10.20.193.28:0/2354079974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28b010f230 0x7f28b011db50 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 >> 10.20.193.28:0/2354079974 conn(0x7f28b005f830 msgr2=0x7f28b010cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 shutdown_connections 2026-02-20T13:16:52.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:52.558+0000 7f28b61b1640 1 -- 10.20.193.28:0/2354079974 wait complete. 2026-02-20T13:16:52.658 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2026-02-20T13:16:51.334483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659632,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":253,"num_read_kb":242,"num_write":427,"num_write_kb":3857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":358,"ondisk_log_size":358,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335192,"kb_used_data":10600,"kb_used_omap":470,"kb_used_meta":323881,"kb_avail":8807703208,"statfs":{"total":9019431321600,"available":9019088084992,"internally_reserved":0,"allocated":10854400,"data_stored":6897892,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":482113,"internal_metadata":331654335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64962,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":147,"num_read_kb":151,"num_write":167,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003024"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:48.077020+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:16:48.077020+0000","last_peered":"2026-02-20T13:16:48.077020+0000","last_clean":"2026-02-20T13:16:48.077020+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:16:48.077020+0000","last_undegraded":"2026-02-20T13:16:48.077020+0000","last_fullsized":"2026-02-20T13:16:48.077020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:50.077917+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:16:50.077917+0000","last_peered":"2026-02-20T13:16:50.077917+0000","last_clean":"2026-02-20T13:16:50.077917+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:16:50.077917+0000","last_undegraded":"2026-02-20T13:16:50.077917+0000","last_fullsized":"2026-02-20T13:16:50.077917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'28","reported_seq":74,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:50.083048+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:16:50.083048+0000","last_peered":"2026-02-20T13:16:50.083048+0000","last_clean":"2026-02-20T13:16:50.083048+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:16:50.083048+0000","last_undegraded":"2026-02-20T13:16:50.083048+0000","last_fullsized":"2026-02-20T13:16:50.083048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62088,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":75,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.079355+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:16:47.079355+0000","last_peered":"2026-02-20T13:16:47.079355+0000","last_clean":"2026-02-20T13:16:47.079355+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:16:47.079355+0000","last_undegraded":"2026-02-20T13:16:47.079355+0000","last_fullsized":"2026-02-20T13:16:47.079355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.079978+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:16:47.079978+0000","last_peered":"2026-02-20T13:16:47.079978+0000","last_clean":"2026-02-20T13:16:47.079978+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:16:47.079978+0000","last_undegraded":"2026-02-20T13:16:47.079978+0000","last_fullsized":"2026-02-20T13:16:47.079978+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079144+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:39.079144+0000","last_peered":"2026-02-20T13:16:39.079144+0000","last_clean":"2026-02-20T13:16:39.079144+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:39.079144+0000","last_undegraded":"2026-02-20T13:16:39.079144+0000","last_fullsized":"2026-02-20T13:16:39.079144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:48.078873+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:16:48.078873+0000","last_peered":"2026-02-20T13:16:48.078873+0000","last_clean":"2026-02-20T13:16:48.078873+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:16:48.078873+0000","last_undegraded":"2026-02-20T13:16:48.078873+0000","last_fullsized":"2026-02-20T13:16:48.078873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:48.086453+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:16:48.086453+0000","last_peered":"2026-02-20T13:16:48.086453+0000","last_clean":"2026-02-20T13:16:48.086453+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:16:48.086453+0000","last_undegraded":"2026-02-20T13:16:48.086453+0000","last_fullsized":"2026-02-20T13:16:48.086453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.625539+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:35.625539+0000","last_peered":"2026-02-20T13:16:35.625539+0000","last_clean":"2026-02-20T13:16:35.625539+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:35.625539+0000","last_undegraded":"2026-02-20T13:16:35.625539+0000","last_fullsized":"2026-02-20T13:16:35.625539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.768390+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:47.768390+0000","last_peered":"2026-02-20T13:16:47.768390+0000","last_clean":"2026-02-20T13:16:47.768390+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:47.768390+0000","last_undegraded":"2026-02-20T13:16:47.768390+0000","last_fullsized":"2026-02-20T13:16:47.768390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079979+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:39.079979+0000","last_peered":"2026-02-20T13:16:39.079979+0000","last_clean":"2026-02-20T13:16:39.079979+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:39.079979+0000","last_undegraded":"2026-02-20T13:16:39.079979+0000","last_fullsized":"2026-02-20T13:16:39.079979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":40,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:48.085221+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:16:48.085221+0000","last_peered":"2026-02-20T13:16:48.085221+0000","last_clean":"2026-02-20T13:16:48.085221+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:16:48.085221+0000","last_undegraded":"2026-02-20T13:16:48.085221+0000","last_fullsized":"2026-02-20T13:16:48.085221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69030,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":147,"num_read_kb":151,"num_write":236,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185581,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612618,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841547,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27952,"kb_used_data":988,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975248,"statfs":{"total":751619276800,"available":751590653952,"internally_reserved":0,"allocated":1011712,"data_stored":1065355,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972364,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":34,"kb_used_meta":27165,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35051,"internal_metadata":27817749},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928233999,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36782,"internal_metadata":27553874},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1004695,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593746,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":844,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":864256,"data_stored":411453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855380,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":1003985,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986198,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":411724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44499,"internal_metadata":27546157},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215128,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":45,"kb_used_meta":27154,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46410,"internal_metadata":27806390},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27880,"kb_used_data":916,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975320,"statfs":{"total":751619276800,"available":751590727680,"internally_reserved":0,"allocated":937984,"data_stored":466324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27868,"kb_used_data":904,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975332,"statfs":{"total":751619276800,"available":751590739968,"internally_reserved":0,"allocated":925696,"data_stored":474498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45658,"internal_metadata":27544998},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3840,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6750,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15030,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29976,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:16:52.665 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T13:16:52.850 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:53.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.016+0000 7f8ff48ce640 1 -- 10.20.193.28:0/401021928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec115420 msgr2=0x7f8fec175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.016+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/401021928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec115420 0x7f8fec175df0 secure :-1 s=READY pgs=260 gs=3 cs=0 l=1 c_cookie=5141324104575807934 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe000a970 tx=0x7f8fe00301b0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 -- 10.20.193.28:0/401021928 shutdown_connections 2026-02-20T13:16:53.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/401021928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec115420 0x7f8fec175df0 unknown :-1 s=CLOSED pgs=260 gs=3 cs=0 l=1 c_cookie=5141324104575807934 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/401021928 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fec10fc20 0x7f8fec114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/401021928 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fec10f230 0x7f8fec10f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 -- 10.20.193.28:0/401021928 >> 10.20.193.28:0/401021928 conn(0x7f8fec05f830 msgr2=0x7f8fec10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:53.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 -- 10.20.193.28:0/401021928 shutdown_connections 2026-02-20T13:16:53.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 -- 10.20.193.28:0/401021928 wait complete. 2026-02-20T13:16:53.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 Processor -- start 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.017+0000 7f8ff48ce640 1 -- start start 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff48ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec10f230 0x7f8fec0f52b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff48ce640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fec10fc20 0x7f8fec175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff48ce640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fec115420 0x7f8fec0f59b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff48ce640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec0fabc0 con 0x7f8fec10f230 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff48ce640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec0fad30 con 0x7f8fec10fc20 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff48ce640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec0faef0 con 0x7f8fec115420 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec10f230 0x7f8fec0f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:53.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff1e42640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fec10fc20 0x7f8fec175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec10f230 0x7f8fec0f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49656/0 (socket says 10.20.193.28:49656) 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 -- 10.20.193.28:0/847374410 learned_addr learned my addr 10.20.193.28:0/847374410 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2e44640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fec115420 0x7f8fec0f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 -- 10.20.193.28:0/847374410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fec115420 msgr2=0x7f8fec0f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fec115420 0x7f8fec0f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 -- 10.20.193.28:0/847374410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fec10fc20 msgr2=0x7f8fec175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fec10fc20 0x7f8fec175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 -- 10.20.193.28:0/847374410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe000a590 con 0x7f8fec10f230 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2e44640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fec115420 0x7f8fec0f59b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.018+0000 7f8ff2643640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec10f230 0x7f8fec0f52b0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe4009480 tx=0x7f8fe400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.019+0000 7f8fd77fe640 1 -- 10.20.193.28:0/847374410 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fe400cd40 con 0x7f8fec10f230 2026-02-20T13:16:53.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.019+0000 7f8fd77fe640 1 -- 10.20.193.28:0/847374410 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8fe4004d30 con 0x7f8fec10f230 2026-02-20T13:16:53.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.019+0000 7f8fd77fe640 1 -- 10.20.193.28:0/847374410 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fe40106b0 con 0x7f8fec10f230 2026-02-20T13:16:53.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.019+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fec0fb1d0 con 0x7f8fec10f230 2026-02-20T13:16:53.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.019+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fec0fb650 con 0x7f8fec10f230 2026-02-20T13:16:53.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.019+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fec110510 con 0x7f8fec10f230 2026-02-20T13:16:53.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.021+0000 7f8fd77fe640 1 -- 10.20.193.28:0/847374410 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f8fe401f060 con 0x7f8fec10f230 2026-02-20T13:16:53.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.023+0000 7f8fd77fe640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fc80b57e0 0x7f8fc80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:53.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.023+0000 7f8fd77fe640 1 -- 10.20.193.28:0/847374410 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f8fe4014070 con 0x7f8fec10f230 2026-02-20T13:16:53.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.023+0000 7f8ff1e42640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fc80b57e0 0x7f8fc80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:53.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.023+0000 7f8fd77fe640 1 -- 10.20.193.28:0/847374410 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8fe40a98a0 con 0x7f8fec10f230 2026-02-20T13:16:53.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.024+0000 7f8ff1e42640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fc80b57e0 0x7f8fc80d5c90 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fec0fbc50 tx=0x7f8fd8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:53.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.136+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fec179160 con 0x7f8fc80b57e0 2026-02-20T13:16:53.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.138+0000 7f8fd77fe640 1 -- 10.20.193.28:0/847374410 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259013 (secure 0 0 0) 0x7f8fec179160 con 0x7f8fc80b57e0 2026-02-20T13:16:53.144 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:53.146 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:16:53.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fc80b57e0 msgr2=0x7f8fc80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fc80b57e0 0x7f8fc80d5c90 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fec0fbc50 tx=0x7f8fd8009310 comp rx=0 tx=0).stop 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec10f230 msgr2=0x7f8fec0f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec10f230 0x7f8fec0f52b0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe4009480 tx=0x7f8fe400ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 shutdown_connections 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fc80b57e0 0x7f8fc80d5c90 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fec115420 0x7f8fec0f59b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fec10fc20 0x7f8fec175cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 --2- 10.20.193.28:0/847374410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fec10f230 0x7f8fec0f52b0 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 >> 10.20.193.28:0/847374410 conn(0x7f8fec05f830 msgr2=0x7f8fec113270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 shutdown_connections 2026-02-20T13:16:53.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.141+0000 7f8ff48ce640 1 -- 10.20.193.28:0/847374410 wait complete. 2026-02-20T13:16:53.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:53 trial028 ceph-mon[37442]: from='client.24952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:53.244 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2026-02-20T13:16:51.334483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659632,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":253,"num_read_kb":242,"num_write":427,"num_write_kb":3857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":358,"ondisk_log_size":358,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335192,"kb_used_data":10600,"kb_used_omap":470,"kb_used_meta":323881,"kb_avail":8807703208,"statfs":{"total":9019431321600,"available":9019088084992,"internally_reserved":0,"allocated":10854400,"data_stored":6897892,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":482113,"internal_metadata":331654335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64962,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":147,"num_read_kb":151,"num_write":167,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003024"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:48.077020+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:16:48.077020+0000","last_peered":"2026-02-20T13:16:48.077020+0000","last_clean":"2026-02-20T13:16:48.077020+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:16:48.077020+0000","last_undegraded":"2026-02-20T13:16:48.077020+0000","last_fullsized":"2026-02-20T13:16:48.077020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:50.077917+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:16:50.077917+0000","last_peered":"2026-02-20T13:16:50.077917+0000","last_clean":"2026-02-20T13:16:50.077917+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:16:50.077917+0000","last_undegraded":"2026-02-20T13:16:50.077917+0000","last_fullsized":"2026-02-20T13:16:50.077917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'28","reported_seq":74,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:50.083048+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:16:50.083048+0000","last_peered":"2026-02-20T13:16:50.083048+0000","last_clean":"2026-02-20T13:16:50.083048+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:16:50.083048+0000","last_undegraded":"2026-02-20T13:16:50.083048+0000","last_fullsized":"2026-02-20T13:16:50.083048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62088,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":75,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.079355+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:16:47.079355+0000","last_peered":"2026-02-20T13:16:47.079355+0000","last_clean":"2026-02-20T13:16:47.079355+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:16:47.079355+0000","last_undegraded":"2026-02-20T13:16:47.079355+0000","last_fullsized":"2026-02-20T13:16:47.079355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.079978+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:16:47.079978+0000","last_peered":"2026-02-20T13:16:47.079978+0000","last_clean":"2026-02-20T13:16:47.079978+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:16:47.079978+0000","last_undegraded":"2026-02-20T13:16:47.079978+0000","last_fullsized":"2026-02-20T13:16:47.079978+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079144+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:39.079144+0000","last_peered":"2026-02-20T13:16:39.079144+0000","last_clean":"2026-02-20T13:16:39.079144+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:39.079144+0000","last_undegraded":"2026-02-20T13:16:39.079144+0000","last_fullsized":"2026-02-20T13:16:39.079144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:48.078873+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:16:48.078873+0000","last_peered":"2026-02-20T13:16:48.078873+0000","last_clean":"2026-02-20T13:16:48.078873+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:16:48.078873+0000","last_undegraded":"2026-02-20T13:16:48.078873+0000","last_fullsized":"2026-02-20T13:16:48.078873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:48.086453+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:16:48.086453+0000","last_peered":"2026-02-20T13:16:48.086453+0000","last_clean":"2026-02-20T13:16:48.086453+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:16:48.086453+0000","last_undegraded":"2026-02-20T13:16:48.086453+0000","last_fullsized":"2026-02-20T13:16:48.086453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.625539+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:35.625539+0000","last_peered":"2026-02-20T13:16:35.625539+0000","last_clean":"2026-02-20T13:16:35.625539+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:35.625539+0000","last_undegraded":"2026-02-20T13:16:35.625539+0000","last_fullsized":"2026-02-20T13:16:35.625539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.768390+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:47.768390+0000","last_peered":"2026-02-20T13:16:47.768390+0000","last_clean":"2026-02-20T13:16:47.768390+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:47.768390+0000","last_undegraded":"2026-02-20T13:16:47.768390+0000","last_fullsized":"2026-02-20T13:16:47.768390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079979+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:39.079979+0000","last_peered":"2026-02-20T13:16:39.079979+0000","last_clean":"2026-02-20T13:16:39.079979+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:39.079979+0000","last_undegraded":"2026-02-20T13:16:39.079979+0000","last_fullsized":"2026-02-20T13:16:39.079979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":40,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:48.085221+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:16:48.085221+0000","last_peered":"2026-02-20T13:16:48.085221+0000","last_clean":"2026-02-20T13:16:48.085221+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:16:48.085221+0000","last_undegraded":"2026-02-20T13:16:48.085221+0000","last_fullsized":"2026-02-20T13:16:48.085221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69030,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":147,"num_read_kb":151,"num_write":236,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185581,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612618,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841547,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27952,"kb_used_data":988,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975248,"statfs":{"total":751619276800,"available":751590653952,"internally_reserved":0,"allocated":1011712,"data_stored":1065355,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972364,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":34,"kb_used_meta":27165,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35051,"internal_metadata":27817749},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928233999,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36782,"internal_metadata":27553874},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1004695,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593746,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":844,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":864256,"data_stored":411453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855380,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":1003985,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986198,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":411724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44499,"internal_metadata":27546157},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215128,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":45,"kb_used_meta":27154,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46410,"internal_metadata":27806390},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27880,"kb_used_data":916,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975320,"statfs":{"total":751619276800,"available":751590727680,"internally_reserved":0,"allocated":937984,"data_stored":466324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27868,"kb_used_data":904,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975332,"statfs":{"total":751619276800,"available":751590739968,"internally_reserved":0,"allocated":925696,"data_stored":474498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45658,"internal_metadata":27544998},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3840,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6750,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15030,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29976,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:16:53.251 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-20T13:16:53.251 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T13:16:53.251 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-20T13:16:53.252 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph health --format=json 2026-02-20T13:16:53.470 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:53.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:53 trial127 ceph-mon[43817]: from='client.24952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:53.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:53 trial034 ceph-mon[43332]: from='client.24952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:53.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 -- 10.20.193.28:0/1148795871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 msgr2=0x7f3ea4176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1148795871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 0x7f3ea4176070 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=16705389594384267411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e9400aa30 tx=0x7f3e94030270 comp rx=0 tx=0).stop 2026-02-20T13:16:53.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 -- 10.20.193.28:0/1148795871 shutdown_connections 2026-02-20T13:16:53.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1148795871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 0x7f3ea4176070 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=16705389594384267411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1148795871 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ea410fea0 0x7f3ea4114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1148795871 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3ea410f4b0 0x7f3ea410f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 -- 10.20.193.28:0/1148795871 >> 10.20.193.28:0/1148795871 conn(0x7f3ea40ecda0 msgr2=0x7f3ea410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:53.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 -- 10.20.193.28:0/1148795871 shutdown_connections 2026-02-20T13:16:53.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.649+0000 7f3ea3577640 1 -- 10.20.193.28:0/1148795871 wait complete. 2026-02-20T13:16:53.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.650+0000 7f3ea3577640 1 Processor -- start 2026-02-20T13:16:53.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.650+0000 7f3ea3577640 1 -- start start 2026-02-20T13:16:53.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.650+0000 7f3ea3577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ea410f4b0 0x7f3ea411ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:53.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.650+0000 7f3ea3577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3ea410fea0 0x7f3ea411e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:53.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.650+0000 7f3ea3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 0x7f3ea41236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:53.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.650+0000 7f3ea3577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4123d00 con 0x7f3ea41156a0 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.650+0000 7f3ea3577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4123e70 con 0x7f3ea410fea0 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.650+0000 7f3ea3577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4124030 con 0x7f3ea410f4b0 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 0x7f3ea41236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 0x7f3ea41236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49674/0 (socket says 10.20.193.28:49674) 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 -- 10.20.193.28:0/1025728937 learned_addr learned my addr 10.20.193.28:0/1025728937 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2575640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ea410f4b0 0x7f3ea411ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea1d74640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3ea410fea0 0x7f3ea411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 -- 10.20.193.28:0/1025728937 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ea410f4b0 msgr2=0x7f3ea411ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ea410f4b0 0x7f3ea411ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 -- 10.20.193.28:0/1025728937 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3ea410fea0 msgr2=0x7f3ea411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3ea410fea0 0x7f3ea411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 -- 10.20.193.28:0/1025728937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9400a650 con 0x7f3ea41156a0 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea2d76640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 0x7f3ea41236e0 secure :-1 s=READY pgs=263 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e94006a50 tx=0x7f3e94006fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3e8b7fe640 1 -- 10.20.193.28:0/1025728937 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e9403e070 con 0x7f3ea41156a0 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3e8b7fe640 1 -- 10.20.193.28:0/1025728937 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e94039e00 con 0x7f3ea41156a0 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3e8b7fe640 1 -- 10.20.193.28:0/1025728937 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e940428c0 con 0x7f3ea41156a0 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea41242b0 con 0x7f3ea41156a0 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.651+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea4164a10 con 0x7f3ea41156a0 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.652+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea4124580 con 0x7f3ea41156a0 2026-02-20T13:16:53.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.654+0000 7f3e8b7fe640 1 -- 10.20.193.28:0/1025728937 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f3e94039920 con 0x7f3ea41156a0 2026-02-20T13:16:53.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.655+0000 7f3e8b7fe640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e7c0b57f0 0x7f3e7c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:53.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.655+0000 7f3e8b7fe640 1 -- 10.20.193.28:0/1025728937 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f3e9410c650 con 0x7f3ea41156a0 2026-02-20T13:16:53.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.656+0000 7f3ea2575640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e7c0b57f0 0x7f3e7c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:53.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.656+0000 7f3e8b7fe640 1 -- 10.20.193.28:0/1025728937 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f3e9410cad0 con 0x7f3ea41156a0 2026-02-20T13:16:53.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.656+0000 7f3ea2575640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e7c0b57f0 0x7f3e7c0d5ca0 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e98004740 tx=0x7f3e98005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:53.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.798+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ea411ef30 con 0x7f3ea41156a0 2026-02-20T13:16:53.801 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:53.802 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T13:16:53.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.798+0000 7f3e8b7fe640 1 -- 10.20.193.28:0/1025728937 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3e940cf0b0 con 0x7f3ea41156a0 2026-02-20T13:16:53.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e7c0b57f0 msgr2=0x7f3e7c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e7c0b57f0 0x7f3e7c0d5ca0 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e98004740 tx=0x7f3e98005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:53.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 msgr2=0x7f3ea41236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:53.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 0x7f3ea41236e0 secure :-1 s=READY pgs=263 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e94006a50 tx=0x7f3e94006fb0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 shutdown_connections 2026-02-20T13:16:53.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e7c0b57f0 0x7f3e7c0d5ca0 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ea41156a0 0x7f3ea41236e0 unknown :-1 s=CLOSED pgs=263 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3ea410fea0 0x7f3ea411e310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 --2- 10.20.193.28:0/1025728937 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ea410f4b0 0x7f3ea411ddd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:53.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 >> 10.20.193.28:0/1025728937 conn(0x7f3ea40ecda0 msgr2=0x7f3ea410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:53.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 shutdown_connections 2026-02-20T13:16:53.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:53.800+0000 7f3ea3577640 1 -- 10.20.193.28:0/1025728937 wait complete. 2026-02-20T13:16:53.938 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-20T13:16:53.939 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:54.123 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:54.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.295+0000 7f4c3f577640 1 -- 10.20.193.28:0/38177727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 msgr2=0x7f4c40114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:54.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.295+0000 7f4c3f577640 1 --2- 10.20.193.28:0/38177727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 0x7f4c40114ef0 secure :-1 s=READY pgs=264 gs=2 cs=0 l=1 c_cookie=10720868203892840213 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c28009890 tx=0x7f4c2802f120 comp rx=0 tx=0).stop 2026-02-20T13:16:54.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.296+0000 7f4c3f577640 1 -- 10.20.193.28:0/38177727 shutdown_connections 2026-02-20T13:16:54.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.296+0000 7f4c3f577640 1 --2- 10.20.193.28:0/38177727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 0x7f4c40114ef0 unknown :-1 s=CLOSED pgs=264 gs=2 cs=0 l=1 c_cookie=10720868203892840213 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.296+0000 7f4c3f577640 1 --2- 10.20.193.28:0/38177727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4c401156a0 0x7f4c40176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.296+0000 7f4c3f577640 1 --2- 10.20.193.28:0/38177727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4c4010f4b0 0x7f4c4010f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.296+0000 7f4c3f577640 1 -- 10.20.193.28:0/38177727 >> 10.20.193.28:0/38177727 conn(0x7f4c400ecda0 msgr2=0x7f4c4010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:54.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.296+0000 7f4c3f577640 1 -- 10.20.193.28:0/38177727 shutdown_connections 2026-02-20T13:16:54.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.296+0000 7f4c3f577640 1 -- 10.20.193.28:0/38177727 wait complete. 2026-02-20T13:16:54.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3f577640 1 Processor -- start 2026-02-20T13:16:54.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3f577640 1 -- start start 2026-02-20T13:16:54.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3f577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4c4010f4b0 0x7f4c400f5880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:54.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 0x7f4c40175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:54.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4c401156a0 0x7f4c400f5f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:54.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400fb190 con 0x7f4c4010fea0 2026-02-20T13:16:54.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3f577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400fb300 con 0x7f4c4010f4b0 2026-02-20T13:16:54.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3f577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400fb4c0 con 0x7f4c401156a0 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 0x7f4c40175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3ed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4c401156a0 0x7f4c400f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 0x7f4c40175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49698/0 (socket says 10.20.193.28:49698) 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3dd74640 1 -- 10.20.193.28:0/2479174949 learned_addr learned my addr 10.20.193.28:0/2479174949 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3e575640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4c4010f4b0 0x7f4c400f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3dd74640 1 -- 10.20.193.28:0/2479174949 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4c401156a0 msgr2=0x7f4c400f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3dd74640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4c401156a0 0x7f4c400f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.297+0000 7f4c3dd74640 1 -- 10.20.193.28:0/2479174949 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4c4010f4b0 msgr2=0x7f4c400f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c3dd74640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4c4010f4b0 0x7f4c400f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c3dd74640 1 -- 10.20.193.28:0/2479174949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c280094b0 con 0x7f4c4010fea0 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c3ed76640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4c401156a0 0x7f4c400f5f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:54.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c3dd74640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 0x7f4c40175f70 secure :-1 s=READY pgs=265 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c280023b0 tx=0x7f4c280028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c277fe640 1 -- 10.20.193.28:0/2479174949 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c2803d070 con 0x7f4c4010fea0 2026-02-20T13:16:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c277fe640 1 -- 10.20.193.28:0/2479174949 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4c280044f0 con 0x7f4c4010fea0 2026-02-20T13:16:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c277fe640 1 -- 10.20.193.28:0/2479174949 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c28041a00 con 0x7f4c4010fea0 2026-02-20T13:16:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c400fb740 con 0x7f4c4010fea0 2026-02-20T13:16:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.298+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c400fbb60 con 0x7f4c4010fea0 2026-02-20T13:16:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.299+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c40110790 con 0x7f4c4010fea0 2026-02-20T13:16:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.301+0000 7f4c277fe640 1 -- 10.20.193.28:0/2479174949 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f4c28038c20 con 0x7f4c4010fea0 2026-02-20T13:16:54.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.303+0000 7f4c277fe640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4c180b57e0 0x7f4c180d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:54.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.303+0000 7f4c277fe640 1 -- 10.20.193.28:0/2479174949 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4c2810b2b0 con 0x7f4c4010fea0 2026-02-20T13:16:54.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.303+0000 7f4c3e575640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4c180b57e0 0x7f4c180d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:54.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.303+0000 7f4c3e575640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4c180b57e0 0x7f4c180d5c90 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c34004740 tx=0x7f4c34009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:54.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.304+0000 7f4c277fe640 1 -- 10.20.193.28:0/2479174949 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f4c280cddc0 con 0x7f4c4010fea0 2026-02-20T13:16:54.315 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:54 trial028 ceph-mon[37442]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:54.315 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:54 trial028 ceph-mon[37442]: pgmap v166: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:16:54.315 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:54 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1025728937' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-20T13:16:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.443+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c400f69e0 con 0x7f4c4010fea0 2026-02-20T13:16:54.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.444+0000 7f4c277fe640 1 -- 10.20.193.28:0/2479174949 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11996 (secure 0 0 0) 0x7f4c28005d40 con 0x7f4c4010fea0 2026-02-20T13:16:54.448 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:54.448 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-20T13:16:40:073425+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:16:40.073414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4c180b57e0 msgr2=0x7f4c180d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4c180b57e0 0x7f4c180d5c90 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c34004740 tx=0x7f4c34009310 comp rx=0 tx=0).stop 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 msgr2=0x7f4c40175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 0x7f4c40175f70 secure :-1 s=READY pgs=265 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c280023b0 tx=0x7f4c280028d0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 shutdown_connections 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4c180b57e0 0x7f4c180d5c90 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c4010fea0 0x7f4c40175f70 unknown :-1 s=CLOSED pgs=265 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4c401156a0 0x7f4c400f5f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 --2- 10.20.193.28:0/2479174949 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4c4010f4b0 0x7f4c400f5880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 >> 10.20.193.28:0/2479174949 conn(0x7f4c400ecda0 msgr2=0x7f4c40111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:54.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 shutdown_connections 2026-02-20T13:16:54.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.445+0000 7f4c3f577640 1 -- 10.20.193.28:0/2479174949 wait complete. 2026-02-20T13:16:54.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:54 trial127 ceph-mon[43817]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:54.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:54 trial127 ceph-mon[43817]: pgmap v166: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:16:54.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:54 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1025728937' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-20T13:16:54.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:54 trial034 ceph-mon[43332]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:16:54.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:54 trial034 ceph-mon[43332]: pgmap v166: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:16:54.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:54 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1025728937' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-20T13:16:54.549 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:54.731 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:54.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 -- 10.20.193.28:0/2013741364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc474113420 msgr2=0x7fc474173df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:54.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 --2- 10.20.193.28:0/2013741364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc474113420 0x7fc474173df0 secure :-1 s=READY pgs=266 gs=3 cs=0 l=1 c_cookie=508010080799750694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc47000aa30 tx=0x7fc470030270 comp rx=0 tx=0).stop 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 -- 10.20.193.28:0/2013741364 shutdown_connections 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 --2- 10.20.193.28:0/2013741364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc474113420 0x7fc474173df0 unknown :-1 s=CLOSED pgs=266 gs=3 cs=0 l=1 c_cookie=508010080799750694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 --2- 10.20.193.28:0/2013741364 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc47410dc20 0x7fc474112c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 --2- 10.20.193.28:0/2013741364 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc47410d230 0x7fc47410d600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 -- 10.20.193.28:0/2013741364 >> 10.20.193.28:0/2013741364 conn(0x7fc4740eab00 msgr2=0x7fc47410af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 -- 10.20.193.28:0/2013741364 shutdown_connections 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 -- 10.20.193.28:0/2013741364 wait complete. 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.909+0000 7fc47b40c640 1 Processor -- start 2026-02-20T13:16:54.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47b40c640 1 -- start start 2026-02-20T13:16:54.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47b40c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc47410d230 0x7fc4740f5820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:54.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47b40c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc47410dc20 0x7fc474173cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:54.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47b40c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc474113420 0x7fc4740f5f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:54.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47b40c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4740fb0e0 con 0x7fc47410dc20 2026-02-20T13:16:54.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47b40c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc4740fb250 con 0x7fc474113420 2026-02-20T13:16:54.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47b40c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc4740fb410 con 0x7fc47410d230 2026-02-20T13:16:54.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc47410dc20 0x7fc474173cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:54.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc47410dc20 0x7fc474173cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49704/0 (socket says 10.20.193.28:49704) 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 -- 10.20.193.28:0/1074716501 learned_addr learned my addr 10.20.193.28:0/1074716501 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47a40a640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc47410d230 0x7fc4740f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc47ac0b640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc474113420 0x7fc4740f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 -- 10.20.193.28:0/1074716501 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc47410d230 msgr2=0x7fc4740f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc47410d230 0x7fc4740f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 -- 10.20.193.28:0/1074716501 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc474113420 msgr2=0x7fc4740f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc474113420 0x7fc4740f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 -- 10.20.193.28:0/1074716501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47000a650 con 0x7fc47410dc20 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.910+0000 7fc479c09640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc47410dc20 0x7fc474173cf0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc468009480 tx=0x7fc46800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.911+0000 7fc45b7fe640 1 -- 10.20.193.28:0/1074716501 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc46800cd40 con 0x7fc47410dc20 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.911+0000 7fc45b7fe640 1 -- 10.20.193.28:0/1074716501 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc468004d30 con 0x7fc47410dc20 2026-02-20T13:16:54.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.911+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4740fb6f0 con 0x7fc47410dc20 2026-02-20T13:16:54.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.911+0000 7fc45b7fe640 1 -- 10.20.193.28:0/1074716501 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4680106b0 con 0x7fc47410dc20 2026-02-20T13:16:54.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.911+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4740fbc10 con 0x7fc47410dc20 2026-02-20T13:16:54.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.911+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47410e510 con 0x7fc47410dc20 2026-02-20T13:16:54.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.913+0000 7fc45b7fe640 1 -- 10.20.193.28:0/1074716501 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fc46801f060 con 0x7fc47410dc20 2026-02-20T13:16:54.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.915+0000 7fc45b7fe640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4500b57e0 0x7fc4500d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:54.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.915+0000 7fc45b7fe640 1 -- 10.20.193.28:0/1074716501 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fc468014070 con 0x7fc47410dc20 2026-02-20T13:16:54.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.915+0000 7fc47a40a640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4500b57e0 0x7fc4500d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:54.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.915+0000 7fc45b7fe640 1 -- 10.20.193.28:0/1074716501 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fc46811f730 con 0x7fc47410dc20 2026-02-20T13:16:54.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:54.916+0000 7fc47a40a640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4500b57e0 0x7fc4500d5c90 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc464004740 tx=0x7fc464005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.059+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4740f6930 con 0x7fc47410dc20 2026-02-20T13:16:55.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.059+0000 7fc45b7fe640 1 -- 10.20.193.28:0/1074716501 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11996 (secure 0 0 0) 0x7fc4680a96b0 con 0x7fc47410dc20 2026-02-20T13:16:55.063 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:55.064 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-20T13:16:40:073425+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:16:40.073414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:16:55.064 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-20T13:16:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4500b57e0 msgr2=0x7fc4500d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4500b57e0 0x7fc4500d5c90 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc464004740 tx=0x7fc464005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc47410dc20 msgr2=0x7fc474173cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc47410dc20 0x7fc474173cf0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc468009480 tx=0x7fc46800ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 shutdown_connections 2026-02-20T13:16:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4500b57e0 0x7fc4500d5c90 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc47410dc20 0x7fc474173cf0 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc474113420 0x7fc4740f5f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 --2- 10.20.193.28:0/1074716501 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc47410d230 0x7fc4740f5820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 >> 10.20.193.28:0/1074716501 conn(0x7fc4740eab00 msgr2=0x7fc47410b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 shutdown_connections 2026-02-20T13:16:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.062+0000 7fc47b40c640 1 -- 10.20.193.28:0/1074716501 wait complete. 2026-02-20T13:16:55.164 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:16:55.348 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:55.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:55 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2479174949' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:55.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:55 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1074716501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:55.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:55 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2479174949' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:55.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:55 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1074716501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:55.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:55 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2479174949' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:55.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:55 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1074716501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:55.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 -- 10.20.193.28:0/845922275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 msgr2=0x7f6b30176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:55.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 --2- 10.20.193.28:0/845922275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 0x7f6b30176070 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=3137520242624834357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b2c00aa30 tx=0x7f6b2c030270 comp rx=0 tx=0).stop 2026-02-20T13:16:55.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 -- 10.20.193.28:0/845922275 shutdown_connections 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 --2- 10.20.193.28:0/845922275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3010fea0 0x7f6b30114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 --2- 10.20.193.28:0/845922275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 0x7f6b30176070 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=3137520242624834357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 --2- 10.20.193.28:0/845922275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3010f4b0 0x7f6b3010f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 -- 10.20.193.28:0/845922275 >> 10.20.193.28:0/845922275 conn(0x7f6b300ecda0 msgr2=0x7f6b3010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 -- 10.20.193.28:0/845922275 shutdown_connections 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 -- 10.20.193.28:0/845922275 wait complete. 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 Processor -- start 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.537+0000 7f6b3736e640 1 -- start start 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3736e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3010f4b0 0x7f6b3011ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3736e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3010fea0 0x7f6b3011e300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:55.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3736e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 0x7f6b301236d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:55.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3736e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30123cf0 con 0x7f6b3010f4b0 2026-02-20T13:16:55.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3736e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30123e60 con 0x7f6b301156a0 2026-02-20T13:16:55.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3736e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30124020 con 0x7f6b3010fea0 2026-02-20T13:16:55.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3010f4b0 0x7f6b3011ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:55.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3010f4b0 0x7f6b3011ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49720/0 (socket says 10.20.193.28:49720) 2026-02-20T13:16:55.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 -- 10.20.193.28:0/757809622 learned_addr learned my addr 10.20.193.28:0/757809622 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b35b6b640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3010fea0 0x7f6b3011e300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b36b6d640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 0x7f6b301236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 -- 10.20.193.28:0/757809622 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3010fea0 msgr2=0x7f6b3011e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3010fea0 0x7f6b3011e300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 -- 10.20.193.28:0/757809622 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 msgr2=0x7f6b301236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 0x7f6b301236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 -- 10.20.193.28:0/757809622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c00a650 con 0x7f6b3010f4b0 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b36b6d640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 0x7f6b301236d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.538+0000 7f6b3636c640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3010f4b0 0x7f6b3011ddc0 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b20009480 tx=0x7f6b2000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.539+0000 7f6b177fe640 1 -- 10.20.193.28:0/757809622 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b2000cd40 con 0x7f6b3010f4b0 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.539+0000 7f6b177fe640 1 -- 10.20.193.28:0/757809622 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6b20004d30 con 0x7f6b3010f4b0 2026-02-20T13:16:55.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.539+0000 7f6b177fe640 1 -- 10.20.193.28:0/757809622 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b200106b0 con 0x7f6b3010f4b0 2026-02-20T13:16:55.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.539+0000 7f6b3736e640 1 -- 10.20.193.28:0/757809622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b30124300 con 0x7f6b3010f4b0 2026-02-20T13:16:55.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.539+0000 7f6b3736e640 1 -- 10.20.193.28:0/757809622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b30164a00 con 0x7f6b3010f4b0 2026-02-20T13:16:55.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.539+0000 7f6b157fa640 1 -- 10.20.193.28:0/757809622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b30110790 con 0x7f6b3010f4b0 2026-02-20T13:16:55.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.542+0000 7f6b177fe640 1 -- 10.20.193.28:0/757809622 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f6b2001f060 con 0x7f6b3010f4b0 2026-02-20T13:16:55.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.544+0000 7f6b177fe640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b0c0b58c0 0x7f6b0c0d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:55.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.544+0000 7f6b177fe640 1 -- 10.20.193.28:0/757809622 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6b20014070 con 0x7f6b3010f4b0 2026-02-20T13:16:55.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.544+0000 7f6b35b6b640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b0c0b58c0 0x7f6b0c0d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:55.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.544+0000 7f6b177fe640 1 -- 10.20.193.28:0/757809622 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f6b200e7110 con 0x7f6b3010f4b0 2026-02-20T13:16:55.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.545+0000 7f6b35b6b640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b0c0b58c0 0x7f6b0c0d5d70 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b30124760 tx=0x7f6b24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:55.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.659+0000 7f6b157fa640 1 -- 10.20.193.28:0/757809622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b3011ef20 con 0x7f6b3010f4b0 2026-02-20T13:16:55.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.660+0000 7f6b177fe640 1 -- 10.20.193.28:0/757809622 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7f6b200a97a0 con 0x7f6b3010f4b0 2026-02-20T13:16:55.663 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:55.663 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:16:55.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 -- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b0c0b58c0 msgr2=0x7f6b0c0d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:55.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b0c0b58c0 0x7f6b0c0d5d70 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b30124760 tx=0x7f6b24005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:55.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 -- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3010f4b0 msgr2=0x7f6b3011ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:55.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3010f4b0 0x7f6b3011ddc0 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b20009480 tx=0x7f6b2000ee60 comp rx=0 tx=0).stop 2026-02-20T13:16:55.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 -- 10.20.193.28:0/757809622 shutdown_connections 2026-02-20T13:16:55.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b0c0b58c0 0x7f6b0c0d5d70 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b301156a0 0x7f6b301236d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3010fea0 0x7f6b3011e300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 --2- 10.20.193.28:0/757809622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3010f4b0 0x7f6b3011ddc0 unknown :-1 s=CLOSED pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:55.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 -- 10.20.193.28:0/757809622 >> 10.20.193.28:0/757809622 conn(0x7f6b300ecda0 msgr2=0x7f6b3010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:55.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 -- 10.20.193.28:0/757809622 shutdown_connections 2026-02-20T13:16:55.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:55.661+0000 7f6b157fa640 1 -- 10.20.193.28:0/757809622 wait complete. 2026-02-20T13:16:55.801 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:16:55.985 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:56.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 -- 10.20.193.28:0/297682447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b80614f0 msgr2=0x7f04b8061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 --2- 10.20.193.28:0/297682447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b80614f0 0x7f04b8061920 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=8597977809599112870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04ac009950 tx=0x7f04ac02f190 comp rx=0 tx=0).stop 2026-02-20T13:16:56.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 -- 10.20.193.28:0/297682447 shutdown_connections 2026-02-20T13:16:56.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 --2- 10.20.193.28:0/297682447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b80614f0 0x7f04b8061920 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=8597977809599112870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 --2- 10.20.193.28:0/297682447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04b8159d80 0x7f04b817a160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 --2- 10.20.193.28:0/297682447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04b8062ae0 0x7f04b8060fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 -- 10.20.193.28:0/297682447 >> 10.20.193.28:0/297682447 conn(0x7f04b80eab00 msgr2=0x7f04b810af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:56.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 -- 10.20.193.28:0/297682447 shutdown_connections 2026-02-20T13:16:56.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.172+0000 7f04be00f640 1 -- 10.20.193.28:0/297682447 wait complete. 2026-02-20T13:16:56.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.173+0000 7f04be00f640 1 Processor -- start 2026-02-20T13:16:56.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.173+0000 7f04be00f640 1 -- start start 2026-02-20T13:16:56.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.173+0000 7f04be00f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04b80614f0 0x7f04b80f2f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.173+0000 7f04be00f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b8062ae0 0x7f04b80f3470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.173+0000 7f04be00f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04b8159d80 0x7f04b80f8840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.173+0000 7f04be00f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80f8e60 con 0x7f04b8062ae0 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.173+0000 7f04be00f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80f8fd0 con 0x7f04b8159d80 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.173+0000 7f04be00f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80f9190 con 0x7f04b80614f0 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b8062ae0 0x7f04b80f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b8062ae0 0x7f04b80f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49728/0 (socket says 10.20.193.28:49728) 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bd80e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04b8159d80 0x7f04b80f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 -- 10.20.193.28:0/3970160413 learned_addr learned my addr 10.20.193.28:0/3970160413 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bd00d640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04b80614f0 0x7f04b80f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 -- 10.20.193.28:0/3970160413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04b80614f0 msgr2=0x7f04b80f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04b80614f0 0x7f04b80f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 -- 10.20.193.28:0/3970160413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04b8159d80 msgr2=0x7f04b80f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04b8159d80 0x7f04b80f8840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 -- 10.20.193.28:0/3970160413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac009570 con 0x7f04b8062ae0 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04bc80c640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b8062ae0 0x7f04b80f3470 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04ac005b30 tx=0x7f04ac004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04a67fc640 1 -- 10.20.193.28:0/3970160413 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04ac03d070 con 0x7f04b8062ae0 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04a67fc640 1 -- 10.20.193.28:0/3970160413 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04ac038920 con 0x7f04b8062ae0 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04a67fc640 1 -- 10.20.193.28:0/3970160413 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04ac0418a0 con 0x7f04b8062ae0 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04be00f640 1 -- 10.20.193.28:0/3970160413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b80f9410 con 0x7f04b8062ae0 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.174+0000 7f04be00f640 1 -- 10.20.193.28:0/3970160413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b80f9b50 con 0x7f04b8062ae0 2026-02-20T13:16:56.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.175+0000 7f0487fff640 1 -- 10.20.193.28:0/3970160413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b80624c0 con 0x7f04b8062ae0 2026-02-20T13:16:56.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.177+0000 7f04a67fc640 1 -- 10.20.193.28:0/3970160413 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f04ac048020 con 0x7f04b8062ae0 2026-02-20T13:16:56.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.179+0000 7f04a67fc640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04940b57f0 0x7f04940d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.179+0000 7f04a67fc640 1 -- 10.20.193.28:0/3970160413 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f04ac10af90 con 0x7f04b8062ae0 2026-02-20T13:16:56.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.179+0000 7f04bd00d640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04940b57f0 0x7f04940d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.179+0000 7f04a67fc640 1 -- 10.20.193.28:0/3970160413 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f04ac10b410 con 0x7f04b8062ae0 2026-02-20T13:16:56.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.179+0000 7f04bd00d640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04940b57f0 0x7f04940d5ca0 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04a8004740 tx=0x7f04a800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:56.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.320+0000 7f0487fff640 1 -- 10.20.193.28:0/3970160413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04b8060f80 con 0x7f04b8062ae0 2026-02-20T13:16:56.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:56 trial028 ceph-mon[37442]: pgmap v167: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 14 op/s 2026-02-20T13:16:56.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:56 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/757809622' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:56.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.321+0000 7f04a67fc640 1 -- 10.20.193.28:0/3970160413 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11996 (secure 0 0 0) 0x7f04ac0cdaa0 con 0x7f04b8062ae0 2026-02-20T13:16:56.325 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:16:56.325 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-20T13:16:40:073425+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:16:40.073414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:16:56.326 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-20T13:16:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 -- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04940b57f0 msgr2=0x7f04940d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04940b57f0 0x7f04940d5ca0 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04a8004740 tx=0x7f04a800b410 comp rx=0 tx=0).stop 2026-02-20T13:16:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 -- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b8062ae0 msgr2=0x7f04b80f3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b8062ae0 0x7f04b80f3470 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04ac005b30 tx=0x7f04ac004340 comp rx=0 tx=0).stop 2026-02-20T13:16:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 -- 10.20.193.28:0/3970160413 shutdown_connections 2026-02-20T13:16:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04940b57f0 0x7f04940d5ca0 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04b8062ae0 0x7f04b80f3470 unknown :-1 s=CLOSED pgs=270 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04b8159d80 0x7f04b80f8840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 --2- 10.20.193.28:0/3970160413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04b80614f0 0x7f04b80f2f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 -- 10.20.193.28:0/3970160413 >> 10.20.193.28:0/3970160413 conn(0x7f04b80eab00 msgr2=0x7f04b810fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 -- 10.20.193.28:0/3970160413 shutdown_connections 2026-02-20T13:16:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.322+0000 7f0487fff640 1 -- 10.20.193.28:0/3970160413 wait complete. 2026-02-20T13:16:56.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False, 'allow_referent_inodes': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-20T13:16:33.380729+0000', 'modified': '2026-02-20T13:16:40.073414+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24692, 'mds_1': 24677, 'mds_2': 24659, 'mds_3': 24655, 'mds_4': 24622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24617': {'gid': 24617, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.34:6833/4255317184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6832', 'nonce': 4255317184}, {'type': 'v1', 'addr': '10.20.193.34:6833', 'nonce': 4255317184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24622': {'gid': 24622, 'name': 'j', 'rank': 4, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '10.20.193.28:6835/2839011553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6834', 'nonce': 2839011553}, {'type': 'v1', 'addr': '10.20.193.28:6835', 'nonce': 2839011553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'd', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.28:6837/3921516269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6836', 'nonce': 3921516269}, {'type': 'v1', 'addr': '10.20.193.28:6837', 'nonce': 3921516269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.127:6835/519312474', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6834', 'nonce': 519312474}, {'type': 'v1', 'addr': '10.20.193.127:6835', 'nonce': 519312474}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24641': {'gid': 24641, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.34:6835/1117780356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6834', 'nonce': 1117780356}, {'type': 'v1', 'addr': '10.20.193.34:6835', 'nonce': 1117780356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.127:6837/2801639412', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6836', 'nonce': 2801639412}, {'type': 'v1', 'addr': '10.20.193.127:6837', 'nonce': 2801639412}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24655': {'gid': 24655, 'name': 'i', 'rank': 3, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.127:6839/3644236506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6838', 'nonce': 3644236506}, {'type': 'v1', 'addr': '10.20.193.127:6839', 'nonce': 3644236506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 2, 'incarnation': 17, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.34:6837/3360165301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6836', 'nonce': 3360165301}, {'type': 'v1', 'addr': '10.20.193.34:6837', 'nonce': 3360165301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24677': {'gid': 24677, 'name': 'g', 'rank': 1, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.28:6839/1527574900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6838', 'nonce': 1527574900}, {'type': 'v1', 'addr': '10.20.193.28:6839', 'nonce': 1527574900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24692': {'gid': 24692, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.34:6839/1838974969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6838', 'nonce': 1838974969}, {'type': 'v1', 'addr': '10.20.193.34:6839', 'nonce': 1838974969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24692, 'qdb_cluster': [24692, 24677, 24659, 24655, 24622]} 2026-02-20T13:16:56.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2026-02-20T13:16:56.424 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.j status 2026-02-20T13:16:56.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:56 trial127 ceph-mon[43817]: pgmap v167: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 14 op/s 2026-02-20T13:16:56.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:56 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/757809622' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:56.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:56 trial034 ceph-mon[43332]: pgmap v167: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 14 op/s 2026-02-20T13:16:56.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:56 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/757809622' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:16:56.609 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:56.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 -- 10.20.193.28:0/2643582403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010fc20 msgr2=0x7f55f0114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 --2- 10.20.193.28:0/2643582403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010fc20 0x7f55f0114c70 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=891398474756293084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e0009950 tx=0x7f55e002f190 comp rx=0 tx=0).stop 2026-02-20T13:16:56.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 -- 10.20.193.28:0/2643582403 shutdown_connections 2026-02-20T13:16:56.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 --2- 10.20.193.28:0/2643582403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010fc20 0x7f55f0114c70 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=891398474756293084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 --2- 10.20.193.28:0/2643582403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f55f0115420 0x7f55f0175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 --2- 10.20.193.28:0/2643582403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55f010f230 0x7f55f010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 -- 10.20.193.28:0/2643582403 >> 10.20.193.28:0/2643582403 conn(0x7f55f005f830 msgr2=0x7f55f010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:56.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 -- 10.20.193.28:0/2643582403 shutdown_connections 2026-02-20T13:16:56.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.790+0000 7f55f6601640 1 -- 10.20.193.28:0/2643582403 wait complete. 2026-02-20T13:16:56.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f6601640 1 Processor -- start 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f6601640 1 -- start start 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f6601640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010f230 0x7f55f00f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f6601640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f55f010fc20 0x7f55f0175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f6601640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55f0115420 0x7f55f00f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f6601640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f55f00fae90 con 0x7f55f010f230 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f6601640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f55f00fb000 con 0x7f55f010fc20 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f6601640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f55f00fb1c0 con 0x7f55f0115420 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010f230 0x7f55f00f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55ef7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f55f010fc20 0x7f55f0175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010f230 0x7f55f00f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49752/0 (socket says 10.20.193.28:49752) 2026-02-20T13:16:56.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55effff640 1 -- 10.20.193.28:0/72703796 learned_addr learned my addr 10.20.193.28:0/72703796 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.791+0000 7f55f4b77640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55f0115420 0x7f55f00f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55effff640 1 -- 10.20.193.28:0/72703796 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55f0115420 msgr2=0x7f55f00f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55effff640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55f0115420 0x7f55f00f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55effff640 1 -- 10.20.193.28:0/72703796 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f55f010fc20 msgr2=0x7f55f0175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55effff640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f55f010fc20 0x7f55f0175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55effff640 1 -- 10.20.193.28:0/72703796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e0009570 con 0x7f55f010f230 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55effff640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010f230 0x7f55f00f5580 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc00d950 tx=0x7f55dc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55ed7fa640 1 -- 10.20.193.28:0/72703796 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55dc004540 con 0x7f55f010f230 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55ed7fa640 1 -- 10.20.193.28:0/72703796 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f55dc009d00 con 0x7f55f010f230 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55ed7fa640 1 -- 10.20.193.28:0/72703796 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55dc0106e0 con 0x7f55f010f230 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55f6601640 1 -- 10.20.193.28:0/72703796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f00fb4a0 con 0x7f55f010f230 2026-02-20T13:16:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.792+0000 7f55f6601640 1 -- 10.20.193.28:0/72703796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f00fb920 con 0x7f55f010f230 2026-02-20T13:16:56.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.795+0000 7f55ed7fa640 1 -- 10.20.193.28:0/72703796 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f55dc0097c0 con 0x7f55f010f230 2026-02-20T13:16:56.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.797+0000 7f55ed7fa640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f55c40b57e0 0x7f55c40d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.797+0000 7f55ed7fa640 1 -- 10.20.193.28:0/72703796 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f55dc0e6d90 con 0x7f55f010f230 2026-02-20T13:16:56.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.797+0000 7f55ef7fe640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f55c40b57e0 0x7f55c40d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.797+0000 7f55ef7fe640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f55c40b57e0 0x7f55c40d5c90 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55f00fbf20 tx=0x7f55e003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:56.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f85fbe00 1 Processor -- start 2026-02-20T13:16:56.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f85fbe00 1 -- start start 2026-02-20T13:16:56.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca0d75e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7b20 0x5626ca11c280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca11c7c0 0x5626ca13cba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626c9f69370 con 0x5626ca0d7210 2026-02-20T13:16:56.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5626c9fed710 con 0x5626ca11c7c0 2026-02-20T13:16:56.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5626c9fe9440 con 0x5626ca0d7b20 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca0d75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca0d75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49762/0 (socket says 10.20.193.28:49762) 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55effff640 1 -- 10.20.193.28:0/1372849230 learned_addr learned my addr 10.20.193.28:0/1372849230 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55f4b77640 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca11c7c0 0x5626ca13cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.798+0000 7f55ef7fe640 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7b20 0x5626ca11c280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55effff640 1 -- 10.20.193.28:0/1372849230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7b20 msgr2=0x5626ca11c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55effff640 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7b20 0x5626ca11c280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55effff640 1 -- 10.20.193.28:0/1372849230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca11c7c0 msgr2=0x5626ca13cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55effff640 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca11c7c0 0x5626ca13cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55effff640 1 -- 10.20.193.28:0/1372849230 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626c9f8ecf0 con 0x5626ca0d7210 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55effff640 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca0d75e0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=7000697819256392036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc0e4840 tx=0x7f55dc002c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6127799348a10964 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:56.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55c0ce3640 1 -- 10.20.193.28:0/1372849230 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55dc0ad140 con 0x5626ca0d7210 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55c0ce3640 1 -- 10.20.193.28:0/1372849230 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f55dc0aca70 con 0x5626ca0d7210 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55c0ce3640 1 -- 10.20.193.28:0/1372849230 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55dc0b7d40 con 0x5626ca0d7210 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1372849230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 msgr2=0x5626ca0d75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca0d75e0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=7000697819256392036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc0e4840 tx=0x7f55dc002c20 comp rx=0 tx=0).stop 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1372849230 shutdown_connections 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca11c7c0 0x5626ca13cba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7b20 0x5626ca11c280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/1372849230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca0d75e0 unknown :-1 s=CLOSED pgs=273 gs=1 cs=0 l=1 c_cookie=7000697819256392036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1372849230 >> 10.20.193.28:0/1372849230 conn(0x5626c9ff6450 msgr2=0x5626ca0d5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1372849230 shutdown_connections 2026-02-20T13:16:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.799+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1372849230 wait complete. 2026-02-20T13:16:56.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.801+0000 7f55f85fbe00 1 -- start start 2026-02-20T13:16:56.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.801+0000 7f55f85fbe00 1 Processor -- start 2026-02-20T13:16:56.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.801+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 0x5626ca0ef980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.801+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0efec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.801+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f4eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.801+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626c9ca1610 con 0x5626ca11c7c0 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.801+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5626ca0f5420 con 0x5626ca0d7b20 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.801+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5626ca0f55e0 con 0x5626ca0d7210 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49776/0 (socket says 10.20.193.28:49776) 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 -- 10.20.193.28:0/2632216550 learned_addr learned my addr 10.20.193.28:0/2632216550 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55ef7fe640 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55effff640 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 0x5626ca0ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 -- 10.20.193.28:0/2632216550 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 msgr2=0x5626ca0ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 0x5626ca0ef980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 -- 10.20.193.28:0/2632216550 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 msgr2=0x5626ca0efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0efec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 -- 10.20.193.28:0/2632216550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626c9f672c0 con 0x5626ca11c7c0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f4b77640 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f4eb0 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=2934206423209771909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e4003a00 tx=0x7f55e4003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b8653221168385 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55b1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55b1ffb640 1 -- 10.20.193.28:0/2632216550 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55e4012440 con 0x5626ca11c7c0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55b1ffb640 1 -- 10.20.193.28:0/2632216550 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f55e4012a80 con 0x5626ca11c7c0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55b1ffb640 1 -- 10.20.193.28:0/2632216550 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55e4011d50 con 0x5626ca11c7c0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f00fb920 con 0x5626ca11c7c0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55b1ffb640 1 -- 10.20.193.28:0/2632216550 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f55e40103c0 con 0x5626ca11c7c0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55b1ffb640 10 client.15039 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f85fbe00 10 client.15039 _ll_register_callbacks cb 0x5626c9f6ca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.802+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5626c9c79600 con 0x5626ca11c7c0 2026-02-20T13:16:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55b1ffb640 1 -- 10.20.193.28:0/2632216550 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f55e4011ee0 con 0x5626ca11c7c0 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55f85fbe00 10 client.15039 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5626c9f790c0 con 0x5626ca11c7c0 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55b1ffb640 1 -- 10.20.193.28:0/2632216550 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f55e40125a0 con 0x5626ca11c7c0 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55f85fbe00 10 client.15039 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55f85fbe00 10 client.15039 resolve_mds: resolved name 'j' to daemon mds.j 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55f85fbe00 20 client.15039 populate_metadata read hostname 'trial028' 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5626ca11c300 0x5626ca11bc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55f85fbe00 4 client.15039 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626c9fb60a0 con 0x5626ca11c300 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.803+0000 7f55effff640 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5626ca11c300 0x5626ca11bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.804+0000 7f55b1ffb640 10 client.15039 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:16:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.804+0000 7f55effff640 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5626ca11c300 0x5626ca11bc30 crc :-1 s=READY pgs=15 gs=4 cs=0 l=0 c_cookie=16388043260387879737 s_cookie=8923509691615204869 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e36e06848b276b39 server_cookie=7bd6acc9267ad605 in_seq=0 out_seq=0 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55b1ffb640 1 -- 10.20.193.28:0/2632216550 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5626c9fb60a0 con 0x5626ca11c300 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55b1ffb640 10 client.15039 handle_command_reply: tid=0 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 client.15039 shutdown 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 msgr2=0x5626ca0f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f4eb0 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=2934206423209771909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e4003a00 tx=0x7f55e4003ed0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 shutdown_connections 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5626ca11c300 0x5626ca11bc30 crc :-1 s=READY pgs=15 gs=4 cs=0 l=0 c_cookie=16388043260387879737 s_cookie=8923509691615204869 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f4eb0 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=2934206423209771909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0efec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/2632216550 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 0x5626ca0ef980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55b1ffb640 0 client.15039 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:16:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 >> 10.20.193.28:0/2632216550 conn(0x5626c9ff6450 msgr2=0x5626ca0d6200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 shutdown_connections 2026-02-20T13:16:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 1 -- 10.20.193.28:0/2632216550 wait complete. 2026-02-20T13:16:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.805+0000 7f55f85fbe00 20 client.15039 trim_cache size 0 max 16384 2026-02-20T13:16:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.814+0000 7f55f85fbe00 1 Processor -- start 2026-02-20T13:16:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55f85fbe00 1 -- start start 2026-02-20T13:16:56.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca119c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0d6400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca11c7c0 0x5626ca0d6940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626c9fe35a0 con 0x5626ca0d7210 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5626c9fe11d0 con 0x5626ca0d7b20 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5626ca15d190 con 0x5626ca11c7c0 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca119c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca119c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49792/0 (socket says 10.20.193.28:49792) 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 -- 10.20.193.28:0/1618454033 learned_addr learned my addr 10.20.193.28:0/1618454033 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55ef7fe640 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55f4b77640 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca11c7c0 0x5626ca0d6940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 -- 10.20.193.28:0/1618454033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca11c7c0 msgr2=0x5626ca0d6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca11c7c0 0x5626ca0d6940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 -- 10.20.193.28:0/1618454033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 msgr2=0x5626ca0d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0d6400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 -- 10.20.193.28:0/1618454033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626c9f73b40 con 0x5626ca0d7210 2026-02-20T13:16:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.815+0000 7f55effff640 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca119c20 secure :-1 s=READY pgs=275 gs=3 cs=0 l=1 c_cookie=6141845461197471511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc0af320 tx=0x7f55dc002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553c37e7f4053f17 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55b3fff640 1 -- 10.20.193.28:0/1618454033 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55dc0b81d0 con 0x5626ca0d7210 2026-02-20T13:16:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55b3fff640 1 -- 10.20.193.28:0/1618454033 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f55dc0b2db0 con 0x5626ca0d7210 2026-02-20T13:16:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55b3fff640 1 -- 10.20.193.28:0/1618454033 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55dc0b8010 con 0x5626ca0d7210 2026-02-20T13:16:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1618454033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 msgr2=0x5626ca119c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca119c20 secure :-1 s=READY pgs=275 gs=3 cs=0 l=1 c_cookie=6141845461197471511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc0af320 tx=0x7f55dc002cc0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1618454033 shutdown_connections 2026-02-20T13:16:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca11c7c0 0x5626ca0d6940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0d6400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/1618454033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca0d7210 0x5626ca119c20 unknown :-1 s=CLOSED pgs=275 gs=3 cs=0 l=1 c_cookie=6141845461197471511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1618454033 >> 10.20.193.28:0/1618454033 conn(0x5626c9ff6450 msgr2=0x5626ca0e1650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1618454033 shutdown_connections 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.816+0000 7f55f85fbe00 1 -- 10.20.193.28:0/1618454033 wait complete. 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f85fbe00 1 -- start start 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f85fbe00 1 Processor -- start 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 0x5626ca0d6050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0d6590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f85fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f5f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626ca115bf0 con 0x5626ca11c7c0 2026-02-20T13:16:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5626ca115d60 con 0x5626ca0d7b20 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f85fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5626ca0f64b0 con 0x5626ca0d7210 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f4b77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f4b77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49800/0 (socket says 10.20.193.28:49800) 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55f4b77640 1 -- 10.20.193.28:0/3187598958 learned_addr learned my addr 10.20.193.28:0/3187598958 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.817+0000 7f55ef7fe640 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55effff640 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 0x5626ca0d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f4b77640 1 -- 10.20.193.28:0/3187598958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 msgr2=0x5626ca0d6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f4b77640 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 0x5626ca0d6050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f4b77640 1 -- 10.20.193.28:0/3187598958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 msgr2=0x5626ca0d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f4b77640 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f4b77640 1 -- 10.20.193.28:0/3187598958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626c9f675f0 con 0x5626ca11c7c0 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f4b77640 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f5f70 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=7405875639728103995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e400ed80 tx=0x7f55e4005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c6f4a804b6623b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55b1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55b1ffb640 1 -- 10.20.193.28:0/3187598958 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55e402b040 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55b1ffb640 1 -- 10.20.193.28:0/3187598958 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5626c9c79600 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55b1ffb640 1 -- 10.20.193.28:0/3187598958 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55e401c650 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626c9f8ecf0 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f85fbe00 10 client.15045 _ll_register_callbacks cb 0x5626c9f6ca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.818+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55dc0aca70 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55b1ffb640 1 -- 10.20.193.28:0/3187598958 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f55e401b3a0 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55b1ffb640 1 -- 10.20.193.28:0/3187598958 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f55e4025e80 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55f85fbe00 10 client.15045 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5626c9f79320 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55b1ffb640 1 -- 10.20.193.28:0/3187598958 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f55e401c7e0 con 0x5626ca11c7c0 2026-02-20T13:16:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55f85fbe00 10 client.15045 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55f85fbe00 10 client.15045 resolve_mds: resolved name 'j' to daemon mds.j 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55f85fbe00 20 client.15045 populate_metadata read hostname 'trial028' 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5626ca1ce330 0x5626ca1cd040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55f85fbe00 4 client.15045 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "status"}) -- 0x5626c9c76e50 con 0x5626ca1ce330 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.819+0000 7f55effff640 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5626ca1ce330 0x5626ca1cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55effff640 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5626ca1ce330 0x5626ca1cd040 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=3335503186372567052 s_cookie=4524539610366693697 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2e4a1679caeba00c server_cookie=3eca64cdb8175141 in_seq=0 out_seq=0 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55b1ffb640 10 client.15045 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55b1ffb640 1 -- 10.20.193.28:0/3187598958 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1223 (crc 0 0 0) 0x5626c9c76e50 con 0x5626ca1ce330 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55b1ffb640 10 client.15045 handle_command_reply: tid=0 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 client.15045 shutdown 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 msgr2=0x5626ca0f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f5f70 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=7405875639728103995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e400ed80 tx=0x7f55e4005550 comp rx=0 tx=0).stop 2026-02-20T13:16:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 shutdown_connections 2026-02-20T13:16:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5626ca1ce330 0x5626ca1cd040 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=3335503186372567052 s_cookie=4524539610366693697 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ca11c7c0 0x5626ca0f5f70 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=7405875639728103995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626ca0d7b20 0x5626ca0d6590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55b1ffb640 0 client.15045 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:16:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 --2- 10.20.193.28:0/3187598958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626ca0d7210 0x5626ca0d6050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 >> 10.20.193.28:0/3187598958 conn(0x5626c9ff6450 msgr2=0x5626ca119c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:56.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 shutdown_connections 2026-02-20T13:16:56.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.820+0000 7f55f85fbe00 1 -- 10.20.193.28:0/3187598958 wait complete. 2026-02-20T13:16:56.829 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:16:56.829 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:16:56.829 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 4, 2026-02-20T13:16:56.829 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24622, 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 17.751100400999999, 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 36.588573642999997, 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:16:56.830 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial028", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:16:56.831 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448336", 2026-02-20T13:16:56.832 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:16:56.832 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:16:56.832 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:16:56.832 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:16:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f85fbe00 20 client.15045 trim_cache size 0 max 16384 2026-02-20T13:16:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 -- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f55c40b57e0 msgr2=0x7f55c40d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f55c40b57e0 0x7f55c40d5c90 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55f00fbf20 tx=0x7f55e003a040 comp rx=0 tx=0).stop 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 -- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010f230 msgr2=0x7f55f00f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010f230 0x7f55f00f5580 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc00d950 tx=0x7f55dc00de20 comp rx=0 tx=0).stop 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 -- 10.20.193.28:0/72703796 shutdown_connections 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f55c40b57e0 0x7f55c40d5c90 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55f0115420 0x7f55f00f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f55f010fc20 0x7f55f0175cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 --2- 10.20.193.28:0/72703796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55f010f230 0x7f55f00f5580 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 -- 10.20.193.28:0/72703796 >> 10.20.193.28:0/72703796 conn(0x7f55f005f830 msgr2=0x7f55f010d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 -- 10.20.193.28:0/72703796 shutdown_connections 2026-02-20T13:16:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:56.821+0000 7f55f6601640 1 -- 10.20.193.28:0/72703796 wait complete. 2026-02-20T13:16:56.960 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.i status 2026-02-20T13:16:57.144 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:57.188 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:57 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3970160413' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 -- 10.20.193.28:0/1999750523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc115420 msgr2=0x7f9fbc175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/1999750523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc115420 0x7f9fbc175df0 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=1232096707205043544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb000aa30 tx=0x7f9fb0030270 comp rx=0 tx=0).stop 2026-02-20T13:16:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 -- 10.20.193.28:0/1999750523 shutdown_connections 2026-02-20T13:16:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/1999750523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc115420 0x7f9fbc175df0 unknown :-1 s=CLOSED pgs=277 gs=1 cs=0 l=1 c_cookie=1232096707205043544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/1999750523 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fbc10fc20 0x7f9fbc114c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/1999750523 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fbc10f230 0x7f9fbc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 -- 10.20.193.28:0/1999750523 >> 10.20.193.28:0/1999750523 conn(0x7f9fbc05f830 msgr2=0x7f9fbc10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 -- 10.20.193.28:0/1999750523 shutdown_connections 2026-02-20T13:16:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.323+0000 7f9fc26ad640 1 -- 10.20.193.28:0/1999750523 wait complete. 2026-02-20T13:16:57.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.324+0000 7f9fc26ad640 1 Processor -- start 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.324+0000 7f9fc26ad640 1 -- start start 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.324+0000 7f9fc26ad640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fbc10f230 0x7f9fbc11db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fc26ad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc10fc20 0x7f9fbc11e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fc26ad640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fbc115420 0x7f9fbc123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fc26ad640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc123a60 con 0x7f9fbc10fc20 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fc26ad640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc123bd0 con 0x7f9fbc10f230 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fc26ad640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc123d90 con 0x7f9fbc115420 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fbbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fbc10f230 0x7f9fbc11db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fc0c23640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fbc115420 0x7f9fbc123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fc0c23640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fbc115420 0x7f9fbc123440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52770/0 (socket says 10.20.193.28:52770) 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fc0c23640 1 -- 10.20.193.28:0/3847884730 learned_addr learned my addr 10.20.193.28:0/3847884730 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc10fc20 0x7f9fbc11e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/3847884730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fbc115420 msgr2=0x7f9fbc123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fbc115420 0x7f9fbc123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/3847884730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fbc10f230 msgr2=0x7f9fbc11db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fbc10f230 0x7f9fbc11db30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/3847884730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb000a650 con 0x7f9fbc10fc20 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.325+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc10fc20 0x7f9fbc11e070 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fac00d700 tx=0x7f9fac00dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.326+0000 7f9fb97fa640 1 -- 10.20.193.28:0/3847884730 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fac004500 con 0x7f9fbc10fc20 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.326+0000 7f9fb97fa640 1 -- 10.20.193.28:0/3847884730 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9fac00de30 con 0x7f9fbc10fc20 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.326+0000 7f9fc26ad640 1 -- 10.20.193.28:0/3847884730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fbc124070 con 0x7f9fbc10fc20 2026-02-20T13:16:57.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.326+0000 7f9fc26ad640 1 -- 10.20.193.28:0/3847884730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fbc164770 con 0x7f9fbc10fc20 2026-02-20T13:16:57.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.326+0000 7f9fb97fa640 1 -- 10.20.193.28:0/3847884730 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fac0106e0 con 0x7f9fbc10fc20 2026-02-20T13:16:57.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.328+0000 7f9fb97fa640 1 -- 10.20.193.28:0/3847884730 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f9fac021070 con 0x7f9fbc10fc20 2026-02-20T13:16:57.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.330+0000 7f9fb97fa640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f900b57f0 0x7f9f900d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.330+0000 7f9fb97fa640 1 -- 10.20.193.28:0/3847884730 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f9fac0e69f0 con 0x7f9fbc10fc20 2026-02-20T13:16:57.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.330+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f900b57f0 0x7f9f900d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.331+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f900b57f0 0x7f9f900d5ca0 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa8004740 tx=0x7f9fa80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.331+0000 7f9fc46a7e00 1 Processor -- start 2026-02-20T13:16:57.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.331+0000 7f9fc46a7e00 1 -- start start 2026-02-20T13:16:57.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6210 0x555c4aac65e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6b20 0x555c4ab0b280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4ab2bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c4a958370 con 0x555c4aac6210 2026-02-20T13:16:57.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555c4a9dc710 con 0x555c4ab0b7c0 2026-02-20T13:16:57.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555c4a9d8440 con 0x555c4aac6b20 2026-02-20T13:16:57.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6210 0x555c4aac65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6210 0x555c4aac65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49820/0 (socket says 10.20.193.28:49820) 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 -- 10.20.193.28:0/194987922 learned_addr learned my addr 10.20.193.28:0/194987922 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6b20 0x555c4ab0b280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fc0c23640 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4ab2bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 -- 10.20.193.28:0/194987922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6b20 msgr2=0x555c4ab0b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6b20 0x555c4ab0b280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 -- 10.20.193.28:0/194987922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 msgr2=0x555c4ab2bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4ab2bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 -- 10.20.193.28:0/194987922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c4a97dcf0 con 0x555c4aac6210 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6b20 0x555c4ab0b280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.332+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6210 0x555c4aac65e0 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=4493513745747608376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa8007a00 tx=0x7f9fa8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5c2af1b09f0338 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9f8cce3640 1 -- 10.20.193.28:0/194987922 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fa8011dd0 con 0x555c4aac6210 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9f8cce3640 1 -- 10.20.193.28:0/194987922 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9fa8015070 con 0x555c4aac6210 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9f8cce3640 1 -- 10.20.193.28:0/194987922 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fa801da00 con 0x555c4aac6210 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/194987922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6210 msgr2=0x555c4aac65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6210 0x555c4aac65e0 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=4493513745747608376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa8007a00 tx=0x7f9fa8013000 comp rx=0 tx=0).stop 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/194987922 shutdown_connections 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4ab2bba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6b20 0x555c4ab0b280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/194987922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6210 0x555c4aac65e0 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=4493513745747608376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/194987922 >> 10.20.193.28:0/194987922 conn(0x555c4a9e5450 msgr2=0x555c4aac4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/194987922 shutdown_connections 2026-02-20T13:16:57.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.333+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/194987922 wait complete. 2026-02-20T13:16:57.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.334+0000 7f9fc46a7e00 1 -- start start 2026-02-20T13:16:57.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.334+0000 7f9fc46a7e00 1 Processor -- start 2026-02-20T13:16:57.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aade8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadee10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aae3e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c4a690610 con 0x555c4aac6b20 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555c4aae4370 con 0x555c4ab0b7c0 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555c4aae4530 con 0x555c4aac6210 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aade8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadee10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aade8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52800/0 (socket says 10.20.193.28:52800) 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbbfff640 1 -- 10.20.193.28:0/2299733346 learned_addr learned my addr 10.20.193.28:0/2299733346 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fc0c23640 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aae3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/2299733346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 msgr2=0x555c4aade8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aade8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/2299733346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 msgr2=0x555c4aae3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aae3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/2299733346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c4a9562c0 con 0x555c4aac6b20 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadee10 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=17518702291911629517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fac0e4500 tx=0x7f9fac0a8d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31eeeea9b36dacd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9f7dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9f7dffb640 1 -- 10.20.193.28:0/2299733346 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fac0b2a10 con 0x555c4aac6b20 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9f7dffb640 1 -- 10.20.193.28:0/2299733346 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9fac0b4ff0 con 0x555c4aac6b20 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9f7dffb640 1 -- 10.20.193.28:0/2299733346 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fac0b79a0 con 0x555c4aac6b20 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.335+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa8007cf0 con 0x555c4aac6b20 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 10 client.15057 _ll_register_callbacks cb 0x555c4a95ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c4a668600 con 0x555c4aac6b20 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9f7dffb640 1 -- 10.20.193.28:0/2299733346 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f9fac0b7b20 con 0x555c4aac6b20 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9f7dffb640 1 -- 10.20.193.28:0/2299733346 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9fac002e10 con 0x555c4aac6b20 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 10 client.15057 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x555c4a9680c0 con 0x555c4aac6b20 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9f7dffb640 1 -- 10.20.193.28:0/2299733346 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f9fac0aad80 con 0x555c4aac6b20 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 10 client.15057 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 10 client.15057 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 20 client.15057 populate_metadata read hostname 'trial028' 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555c4ab09cd0 0x555c4ab0aa70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 4 client.15057 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c4a9a50a0 con 0x555c4ab09cd0 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.336+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555c4ab09cd0 0x555c4ab0aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.337+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555c4ab09cd0 0x555c4ab0aa70 crc :-1 s=READY pgs=14 gs=4 cs=0 l=0 c_cookie=8303991077139196087 s_cookie=17591063651130182161 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=733db3e362e528b7 server_cookie=f420033072e68a11 in_seq=0 out_seq=0 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.337+0000 7f9f7dffb640 10 client.15057 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9f7dffb640 1 -- 10.20.193.28:0/2299733346 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555c4a9a50a0 con 0x555c4ab09cd0 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9f7dffb640 10 client.15057 handle_command_reply: tid=0 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 client.15057 shutdown 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 msgr2=0x555c4aadee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadee10 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=17518702291911629517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fac0e4500 tx=0x7f9fac0a8d10 comp rx=0 tx=0).stop 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 shutdown_connections 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555c4ab09cd0 0x555c4ab0aa70 crc :-1 s=READY pgs=14 gs=4 cs=0 l=0 c_cookie=8303991077139196087 s_cookie=17591063651130182161 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadee10 unknown :-1 s=CLOSED pgs=280 gs=1 cs=0 l=1 c_cookie=17518702291911629517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aae3e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/2299733346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aade8d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9f7dffb640 0 client.15057 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:16:57.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 >> 10.20.193.28:0/2299733346 conn(0x555c4a9e5450 msgr2=0x555c4aac5200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 shutdown_connections 2026-02-20T13:16:57.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.338+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/2299733346 wait complete. 2026-02-20T13:16:57.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.339+0000 7f9fc46a7e00 20 client.15057 trim_cache size 0 max 16384 2026-02-20T13:16:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.348+0000 7f9fc46a7e00 1 Processor -- start 2026-02-20T13:16:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.348+0000 7f9fc46a7e00 1 -- start start 2026-02-20T13:16:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.348+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4ab08a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.348+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadbc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.348+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aadc1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.348+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c4a9d25a0 con 0x555c4aac6b20 2026-02-20T13:16:57.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.348+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555c4a9d01d0 con 0x555c4ab0b7c0 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.348+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555c4aa35b90 con 0x555c4aac6210 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49826/0 (socket says 10.20.193.28:49826) 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/1444450535 learned_addr learned my addr 10.20.193.28:0/1444450535 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4ab08a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fc0c23640 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aadc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/1444450535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 msgr2=0x555c4ab08a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4ab08a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/1444450535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 msgr2=0x555c4aadc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aadc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/1444450535 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c4a962b40 con 0x555c4aac6b20 2026-02-20T13:16:57.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadbc80 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=10435775986662196169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fac00b630 tx=0x7f9fac01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d352f8008d43c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9f7ffff640 1 -- 10.20.193.28:0/1444450535 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fac06f030 con 0x555c4aac6b20 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9f7ffff640 1 -- 10.20.193.28:0/1444450535 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555c4a668600 con 0x555c4aac6b20 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.349+0000 7f9f7ffff640 1 -- 10.20.193.28:0/1444450535 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fac0b2a80 con 0x555c4aac6b20 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/1444450535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 msgr2=0x555c4aadbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadbc80 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=10435775986662196169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fac00b630 tx=0x7f9fac01b000 comp rx=0 tx=0).stop 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/1444450535 shutdown_connections 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aadbc80 unknown :-1 s=CLOSED pgs=281 gs=1 cs=0 l=1 c_cookie=10435775986662196169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aadc1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/1444450535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4ab08a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/1444450535 >> 10.20.193.28:0/1444450535 conn(0x555c4a9e5450 msgr2=0x555c4aad0550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/1444450535 shutdown_connections 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/1444450535 wait complete. 2026-02-20T13:16:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 -- start start 2026-02-20T13:16:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.350+0000 7f9fc46a7e00 1 Processor -- start 2026-02-20T13:16:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aae4e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aae5350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fc46a7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aae5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c4aad6360 con 0x555c4aac6b20 2026-02-20T13:16:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555c4ab07610 con 0x555c4ab0b7c0 2026-02-20T13:16:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fc46a7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555c4aae3ad0 con 0x555c4aac6210 2026-02-20T13:16:57.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aae5350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aae5350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49834/0 (socket says 10.20.193.28:49834) 2026-02-20T13:16:57.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/724582246 learned_addr learned my addr 10.20.193.28:0/724582246 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fc0c23640 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aae5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aae4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/724582246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 msgr2=0x555c4aae4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aae4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/724582246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 msgr2=0x555c4aae5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aae5890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 -- 10.20.193.28:0/724582246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c4a9565f0 con 0x555c4aac6b20 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fbb7fe640 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aae5350 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=7880730978579546529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fac0a9370 tx=0x7f9fac002aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5dfb1234a681a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9f7dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9f7dffb640 1 -- 10.20.193.28:0/724582246 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fac06f070 con 0x555c4aac6b20 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9f7dffb640 1 -- 10.20.193.28:0/724582246 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9fac072490 con 0x555c4aac6b20 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9f7dffb640 1 -- 10.20.193.28:0/724582246 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fac0acb60 con 0x555c4aac6b20 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c4a9680c0 con 0x555c4aac6b20 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.351+0000 7f9f7dffb640 1 -- 10.20.193.28:0/724582246 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f9fac070070 con 0x555c4aac6b20 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9f7dffb640 10 client.15063 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 10 client.15063 _ll_register_callbacks cb 0x555c4a95ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:57.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fa8015070 con 0x555c4aac6b20 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9f7dffb640 1 -- 10.20.193.28:0/724582246 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9fac0d2040 con 0x555c4aac6b20 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 10 client.15063 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x555c4a968320 con 0x555c4aac6b20 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9f7dffb640 1 -- 10.20.193.28:0/724582246 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f9fac08f030 con 0x555c4aac6b20 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 10 client.15063 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 10 client.15063 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 20 client.15063 populate_metadata read hostname 'trial028' 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555c4abbd280 0x555c4abbbf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 4 client.15063 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "status"}) -- 0x555c4a665e50 con 0x555c4abbd280 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.352+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555c4abbd280 0x555c4abbbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fbbfff640 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555c4abbd280 0x555c4abbbf90 crc :-1 s=READY pgs=15 gs=4 cs=0 l=0 c_cookie=1488908858190977033 s_cookie=3844757537524838175 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=14a9aab7cb67d809 server_cookie=355b529c27ac6f1f in_seq=0 out_seq=0 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9f7dffb640 10 client.15063 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9f7dffb640 1 -- 10.20.193.28:0/724582246 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x555c4a665e50 con 0x555c4abbd280 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9f7dffb640 10 client.15063 handle_command_reply: tid=0 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 client.15063 shutdown 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 msgr2=0x555c4aae5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aae5350 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=7880730978579546529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fac0a9370 tx=0x7f9fac002aa0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 shutdown_connections 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555c4abbd280 0x555c4abbbf90 crc :-1 s=READY pgs=15 gs=4 cs=0 l=0 c_cookie=1488908858190977033 s_cookie=3844757537524838175 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c4aac6b20 0x555c4aae5350 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=7880730978579546529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c4ab0b7c0 0x555c4aae5890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 --2- 10.20.193.28:0/724582246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c4aac6210 0x555c4aae4e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9f7dffb640 0 client.15063 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:16:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.353+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 >> 10.20.193.28:0/724582246 conn(0x555c4a9e5450 msgr2=0x555c4ab08a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 shutdown_connections 2026-02-20T13:16:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc46a7e00 1 -- 10.20.193.28:0/724582246 wait complete. 2026-02-20T13:16:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc46a7e00 20 client.15063 trim_cache size 0 max 16384 2026-02-20T13:16:57.363 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:16:57.363 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:16:57.363 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 3, 2026-02-20T13:16:57.363 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24655, 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 18.554730445000001, 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 32.325400797999997, 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:16:57.364 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial127", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial127", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:16:57.365 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438940", 2026-02-20T13:16:57.366 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:16:57.366 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:16:57.366 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:16:57.366 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:16:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 -- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f900b57f0 msgr2=0x7f9f900d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f900b57f0 0x7f9f900d5ca0 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa8004740 tx=0x7f9fa80073d0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 -- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc10fc20 msgr2=0x7f9fbc11e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc10fc20 0x7f9fbc11e070 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fac00d700 tx=0x7f9fac00dbd0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 -- 10.20.193.28:0/3847884730 shutdown_connections 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f900b57f0 0x7f9f900d5ca0 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fbc10fc20 0x7f9fbc11e070 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fbc115420 0x7f9fbc123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 --2- 10.20.193.28:0/3847884730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fbc10f230 0x7f9fbc11db30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 -- 10.20.193.28:0/3847884730 >> 10.20.193.28:0/3847884730 conn(0x7f9fbc05f830 msgr2=0x7f9fbc10cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 -- 10.20.193.28:0/3847884730 shutdown_connections 2026-02-20T13:16:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.354+0000 7f9fc26ad640 1 -- 10.20.193.28:0/3847884730 wait complete. 2026-02-20T13:16:57.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:57 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3970160413' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:57.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:57 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3970160413' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:16:57.492 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.h status 2026-02-20T13:16:57.676 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:57.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 -- 10.20.193.28:0/1982953527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 msgr2=0x7f5d041739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 --2- 10.20.193.28:0/1982953527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 0x7f5d041739d0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=1111327833744811007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d0000aa30 tx=0x7f5d00030280 comp rx=0 tx=0).stop 2026-02-20T13:16:57.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 -- 10.20.193.28:0/1982953527 shutdown_connections 2026-02-20T13:16:57.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 --2- 10.20.193.28:0/1982953527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 0x7f5d041739d0 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=1111327833744811007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 --2- 10.20.193.28:0/1982953527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d04060a00 0x7f5d04112850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 --2- 10.20.193.28:0/1982953527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d04060010 0x7f5d040603e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 -- 10.20.193.28:0/1982953527 >> 10.20.193.28:0/1982953527 conn(0x7f5d040e95a0 msgr2=0x7f5d041099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 -- 10.20.193.28:0/1982953527 shutdown_connections 2026-02-20T13:16:57.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.861+0000 7f5d0996a640 1 -- 10.20.193.28:0/1982953527 wait complete. 2026-02-20T13:16:57.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d0996a640 1 Processor -- start 2026-02-20T13:16:57.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d0996a640 1 -- start start 2026-02-20T13:16:57.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d0996a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d04060010 0x7f5d040f4230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d0996a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d04060a00 0x7f5d041738d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d0996a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 0x7f5d040f4930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d0996a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040f9af0 con 0x7f5d04113000 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d0996a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040f9c60 con 0x7f5d04060010 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d0996a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040f9e20 con 0x7f5d04060a00 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5cfbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d04060a00 0x7f5d041738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5cfbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d04060a00 0x7f5d041738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52844/0 (socket says 10.20.193.28:52844) 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5cfbfff640 1 -- 10.20.193.28:0/189274942 learned_addr learned my addr 10.20.193.28:0/189274942 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d09169640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 0x7f5d040f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.862+0000 7f5d08968640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d04060010 0x7f5d040f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5d09169640 1 -- 10.20.193.28:0/189274942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d04060a00 msgr2=0x7f5d041738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5d09169640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d04060a00 0x7f5d041738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5d09169640 1 -- 10.20.193.28:0/189274942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d04060010 msgr2=0x7f5d040f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5d09169640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d04060010 0x7f5d040f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5d09169640 1 -- 10.20.193.28:0/189274942 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0000a650 con 0x7f5d04113000 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5d09169640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 0x7f5d040f4930 secure :-1 s=READY pgs=284 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d0000aa30 tx=0x7f5d00003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5cf9ffb640 1 -- 10.20.193.28:0/189274942 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d0003e070 con 0x7f5d04113000 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5cf9ffb640 1 -- 10.20.193.28:0/189274942 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d00003b40 con 0x7f5d04113000 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5cf9ffb640 1 -- 10.20.193.28:0/189274942 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d000429d0 con 0x7f5d04113000 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5d0996a640 1 -- 10.20.193.28:0/189274942 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d040fa0a0 con 0x7f5d04113000 2026-02-20T13:16:57.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.863+0000 7f5d0996a640 1 -- 10.20.193.28:0/189274942 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d040fa510 con 0x7f5d04113000 2026-02-20T13:16:57.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.866+0000 7f5cf9ffb640 1 -- 10.20.193.28:0/189274942 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f5d00039c10 con 0x7f5d04113000 2026-02-20T13:16:57.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.868+0000 7f5cf9ffb640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ce00b57e0 0x7f5ce00d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.868+0000 7f5cf9ffb640 1 -- 10.20.193.28:0/189274942 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f5d0010c6c0 con 0x7f5d04113000 2026-02-20T13:16:57.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.868+0000 7f5d08968640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ce00b57e0 0x7f5ce00d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.868+0000 7f5d08968640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ce00b57e0 0x7f5ce00d5c90 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cf4004740 tx=0x7f5cf4004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.869+0000 7f5d0cbede00 1 Processor -- start 2026-02-20T13:16:57.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.869+0000 7f5d0cbede00 1 -- start start 2026-02-20T13:16:57.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.869+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f98fe5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.869+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 0x55e9f9943280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.869+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f9963ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.869+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9790370 con 0x55e9f99437c0 2026-02-20T13:16:57.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.869+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9814710 con 0x55e9f98fe210 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.869+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9810440 con 0x55e9f98feb20 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f9963ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f9963ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49868/0 (socket says 10.20.193.28:49868) 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 -- 10.20.193.28:0/3669127055 learned_addr learned my addr 10.20.193.28:0/3669127055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d08968640 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f98fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5cfbfff640 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 0x55e9f9943280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 -- 10.20.193.28:0/3669127055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 msgr2=0x55e9f9943280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 0x55e9f9943280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 -- 10.20.193.28:0/3669127055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 msgr2=0x55e9f98fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f98fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 -- 10.20.193.28:0/3669127055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f97b5cf0 con 0x55e9f99437c0 2026-02-20T13:16:57.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d08968640 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f98fe5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:57.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d09169640 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f9963ba0 secure :-1 s=READY pgs=285 gs=2 cs=0 l=1 c_cookie=3294525995781198226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d0010a280 tx=0x7f5d000d2b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db881f021d41192 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5cd14e4640 1 -- 10.20.193.28:0/3669127055 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d000d34d0 con 0x55e9f99437c0 2026-02-20T13:16:57.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5cd14e4640 1 -- 10.20.193.28:0/3669127055 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d000d87f0 con 0x55e9f99437c0 2026-02-20T13:16:57.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5cd14e4640 1 -- 10.20.193.28:0/3669127055 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d000dd780 con 0x55e9f99437c0 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d0cbede00 1 -- 10.20.193.28:0/3669127055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 msgr2=0x55e9f9963ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.870+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f9963ba0 secure :-1 s=READY pgs=285 gs=2 cs=0 l=1 c_cookie=3294525995781198226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d0010a280 tx=0x7f5d000d2b80 comp rx=0 tx=0).stop 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.871+0000 7f5d0cbede00 1 -- 10.20.193.28:0/3669127055 shutdown_connections 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.871+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f9963ba0 unknown :-1 s=CLOSED pgs=285 gs=2 cs=0 l=1 c_cookie=3294525995781198226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.871+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 0x55e9f9943280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.871+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/3669127055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f98fe5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.871+0000 7f5d0cbede00 1 -- 10.20.193.28:0/3669127055 >> 10.20.193.28:0/3669127055 conn(0x55e9f981d450 msgr2=0x55e9f98fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.871+0000 7f5d0cbede00 1 -- 10.20.193.28:0/3669127055 shutdown_connections 2026-02-20T13:16:57.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.871+0000 7f5d0cbede00 1 -- 10.20.193.28:0/3669127055 wait complete. 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.872+0000 7f5d0cbede00 1 -- start start 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.872+0000 7f5d0cbede00 1 Processor -- start 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f9916850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 0x55e9f9916d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f991bd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9f94c8610 con 0x55e9f99437c0 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9f991c2f0 con 0x55e9f98fe210 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9f991c4b0 con 0x55e9f98feb20 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d08968640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f9916850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d08968640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f9916850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51364/0 (socket says 10.20.193.28:51364) 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d08968640 1 -- 10.20.193.28:0/1171166957 learned_addr learned my addr 10.20.193.28:0/1171166957 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d08968640 1 -- 10.20.193.28:0/1171166957 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 msgr2=0x55e9f9916d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d08968640 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 0x55e9f9916d90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d08968640 1 -- 10.20.193.28:0/1171166957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 msgr2=0x55e9f991bd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d09169640 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f991bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.873+0000 7f5d08968640 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f991bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5d08968640 1 -- 10.20.193.28:0/1171166957 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d040fa510 con 0x55e9f98fe210 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5d09169640 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f991bd80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5d08968640 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f9916850 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=9375681618840381206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cf400fbc0 tx=0x7f5cf4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821d1cc20223e716 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5cc27fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5cc27fc640 1 -- 10.20.193.28:0/1171166957 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cf401eb70 con 0x55e9f98fe210 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5cc27fc640 1 -- 10.20.193.28:0/1171166957 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5cf4011e60 con 0x55e9f98fe210 2026-02-20T13:16:57.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5cc27fc640 1 -- 10.20.193.28:0/1171166957 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cf4027650 con 0x55e9f98fe210 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf400f9b0 con 0x55e9f98fe210 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5cc27fc640 1 -- 10.20.193.28:0/1171166957 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f5cf40277e0 con 0x55e9f98fe210 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5d0cbede00 10 client.25061 _ll_register_callbacks cb 0x55e9f9793a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9f94a0600 con 0x55e9f98fe210 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5cc27fc640 1 -- 10.20.193.28:0/1171166957 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5cf401ecd0 con 0x55e9f98fe210 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5d0cbede00 10 client.25061 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.874+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55e9f978e2c0 con 0x55e9f98fe210 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.875+0000 7f5cc27fc640 1 -- 10.20.193.28:0/1171166957 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f5cf40279e0 con 0x55e9f98fe210 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.875+0000 7f5d0cbede00 10 client.25061 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.875+0000 7f5d0cbede00 10 client.25061 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.875+0000 7f5d0cbede00 20 client.25061 populate_metadata read hostname 'trial028' 2026-02-20T13:16:57.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.875+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e9f9941d40 0x55e9f9942ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.875+0000 7f5d0cbede00 4 client.25061 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:16:57.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.875+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9f97dd0a0 con 0x55e9f9941d40 2026-02-20T13:16:57.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.875+0000 7f5cfbfff640 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e9f9941d40 0x55e9f9942ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.876+0000 7f5cfbfff640 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e9f9941d40 0x55e9f9942ae0 crc :-1 s=READY pgs=15 gs=3 cs=0 l=0 c_cookie=11632316941184820908 s_cookie=3574058076638634790 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a16e4aa09a1466ac server_cookie=31999ae270a96326 in_seq=0 out_seq=0 2026-02-20T13:16:57.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.876+0000 7f5cc27fc640 10 client.25061 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:16:57.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.876+0000 7f5cc27fc640 1 -- 10.20.193.28:0/1171166957 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e9f97dd0a0 con 0x55e9f9941d40 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.876+0000 7f5cc27fc640 10 client.25061 handle_command_reply: tid=0 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 client.25061 shutdown 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 msgr2=0x55e9f9916850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f9916850 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=9375681618840381206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cf400fbc0 tx=0x7f5cf4004770 comp rx=0 tx=0).stop 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 shutdown_connections 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e9f9941d40 0x55e9f9942ae0 crc :-1 s=READY pgs=15 gs=3 cs=0 l=0 c_cookie=11632316941184820908 s_cookie=3574058076638634790 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f99437c0 0x55e9f991bd80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f98feb20 0x55e9f9916d90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1171166957 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f9916850 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=9375681618840381206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5cc27fc640 0 client.25061 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:16:57.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 >> 10.20.193.28:0/1171166957 conn(0x55e9f981d450 msgr2=0x55e9f98fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 shutdown_connections 2026-02-20T13:16:57.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1171166957 wait complete. 2026-02-20T13:16:57.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.877+0000 7f5d0cbede00 20 client.25061 trim_cache size 0 max 16384 2026-02-20T13:16:57.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d0cbede00 1 Processor -- start 2026-02-20T13:16:57.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d0cbede00 1 -- start start 2026-02-20T13:16:57.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98fe210 0x55e9f98fd400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98feb20 0x55e9f98fd940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 0x55e9f9913c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9f980a5a0 con 0x55e9f98fe210 2026-02-20T13:16:57.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9f98081d0 con 0x55e9f98feb20 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9887040 con 0x55e9f99437c0 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d08968640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98fe210 0x55e9f98fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d08968640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98fe210 0x55e9f98fd400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49878/0 (socket says 10.20.193.28:49878) 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5d08968640 1 -- 10.20.193.28:0/1334329646 learned_addr learned my addr 10.20.193.28:0/1334329646 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.886+0000 7f5cfbfff640 1 --2- 10.20.193.28:0/1334329646 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98feb20 0x55e9f98fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d08968640 1 -- 10.20.193.28:0/1334329646 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 msgr2=0x55e9f9913c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d08968640 1 --2- 10.20.193.28:0/1334329646 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 0x55e9f9913c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d08968640 1 -- 10.20.193.28:0/1334329646 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98feb20 msgr2=0x55e9f98fd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d08968640 1 --2- 10.20.193.28:0/1334329646 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98feb20 0x55e9f98fd940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d08968640 1 -- 10.20.193.28:0/1334329646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f9908c40 con 0x55e9f98fe210 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d08968640 1 --2- 10.20.193.28:0/1334329646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98fe210 0x55e9f98fd400 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=10690700355899797836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cf401f6f0 tx=0x7f5cf4021030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945cff54f98cb14c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5cd0ce3640 1 -- 10.20.193.28:0/1334329646 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cf401f440 con 0x55e9f98fe210 2026-02-20T13:16:57.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5cd0ce3640 1 -- 10.20.193.28:0/1334329646 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e9f94a0600 con 0x55e9f98fe210 2026-02-20T13:16:57.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5cd0ce3640 1 -- 10.20.193.28:0/1334329646 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cf4010c60 con 0x55e9f98fe210 2026-02-20T13:16:57.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1334329646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98fe210 msgr2=0x55e9f98fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1334329646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98fe210 0x55e9f98fd400 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=10690700355899797836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cf401f6f0 tx=0x7f5cf4021030 comp rx=0 tx=0).stop 2026-02-20T13:16:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1334329646 shutdown_connections 2026-02-20T13:16:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1334329646 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 0x55e9f9913c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1334329646 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98feb20 0x55e9f98fd940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/1334329646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98fe210 0x55e9f98fd400 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=10690700355899797836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1334329646 >> 10.20.193.28:0/1334329646 conn(0x55e9f981d450 msgr2=0x55e9f9901010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.887+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1334329646 shutdown_connections 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 -- 10.20.193.28:0/1334329646 wait complete. 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 -- start start 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 Processor -- start 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f991ca00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98feb20 0x55e9f991cf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 0x55e9f991d480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9f99433e0 con 0x55e9f98feb20 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9f991ba10 con 0x55e9f98fe210 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.888+0000 7f5d0cbede00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9921a50 con 0x55e9f99437c0 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f991ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f991ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51378/0 (socket says 10.20.193.28:51378) 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 -- 10.20.193.28:0/2796427488 learned_addr learned my addr 10.20.193.28:0/2796427488 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5cfbfff640 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98feb20 0x55e9f991cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d09169640 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 0x55e9f991d480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 -- 10.20.193.28:0/2796427488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 msgr2=0x55e9f991d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 0x55e9f991d480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 -- 10.20.193.28:0/2796427488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98feb20 msgr2=0x55e9f991cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98feb20 0x55e9f991cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 -- 10.20.193.28:0/2796427488 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f97a00c0 con 0x55e9f98fe210 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5d08968640 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f991ca00 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=2641400697886547435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cf4033da0 tx=0x7f5cf4033e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a823f0a2ff1deb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.889+0000 7f5cc27fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5cc27fc640 1 -- 10.20.193.28:0/2796427488 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cf4011e60 con 0x55e9f98fe210 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5cc27fc640 1 -- 10.20.193.28:0/2796427488 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5cf401f440 con 0x55e9f98fe210 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5cc27fc640 1 -- 10.20.193.28:0/2796427488 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cf4010550 con 0x55e9f98fe210 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f978e2c0 con 0x55e9f98fe210 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5cc27fc640 1 -- 10.20.193.28:0/2796427488 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f5cf4030070 con 0x55e9f98fe210 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5cc27fc640 10 client.25067 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 10 client.25067 _ll_register_callbacks cb 0x55e9f9793a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d000d87f0 con 0x55e9f98fe210 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5cc27fc640 1 -- 10.20.193.28:0/2796427488 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5cf401c350 con 0x55e9f98fe210 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 10 client.25067 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55e9f979ab40 con 0x55e9f98fe210 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5cc27fc640 1 -- 10.20.193.28:0/2796427488 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f5cf40106b0 con 0x55e9f98fe210 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 10 client.25067 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 10 client.25067 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 20 client.25067 populate_metadata read hostname 'trial028' 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e9f99f57b0 0x55e9f99f44c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 4 client.25067 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.890+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "status"}) -- 0x55e9f949de50 con 0x55e9f99f57b0 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.891+0000 7f5cfbfff640 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e9f99f57b0 0x55e9f99f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.891+0000 7f5cfbfff640 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e9f99f57b0 0x55e9f99f44c0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=5365927128930471337 s_cookie=12343165412716795320 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a779a4b3a884da9 server_cookie=ab4bbb8bc4df55b8 in_seq=0 out_seq=0 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.891+0000 7f5cc27fc640 10 client.25067 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:16:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.891+0000 7f5cc27fc640 1 -- 10.20.193.28:0/2796427488 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x55e9f949de50 con 0x55e9f99f57b0 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.891+0000 7f5cc27fc640 10 client.25067 handle_command_reply: tid=0 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.891+0000 7f5d0cbede00 1 client.25067 shutdown 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.891+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 msgr2=0x55e9f991ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.891+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f991ca00 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=2641400697886547435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cf4033da0 tx=0x7f5cf4033e20 comp rx=0 tx=0).stop 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 shutdown_connections 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e9f99f57b0 0x55e9f99f44c0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=5365927128930471337 s_cookie=12343165412716795320 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f98feb20 0x55e9f991cf40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9f99437c0 0x55e9f991d480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 1 --2- 10.20.193.28:0/2796427488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9f98fe210 0x55e9f991ca00 unknown :-1 s=CLOSED pgs=110 gs=2 cs=0 l=1 c_cookie=2641400697886547435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5cc27fc640 0 client.25067 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 >> 10.20.193.28:0/2796427488 conn(0x55e9f981d450 msgr2=0x55e9f9914a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 shutdown_connections 2026-02-20T13:16:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 1 -- 10.20.193.28:0/2796427488 wait complete. 2026-02-20T13:16:57.901 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:16:57.901 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:16:57.901 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 2, 2026-02-20T13:16:57.901 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24659, 2026-02-20T13:16:57.901 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:16:57.901 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:16:57.901 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 20.100032279000001, 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 33.575157648999998, 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:16:57.902 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial034", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial034", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438948", 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:16:57.903 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:16:57.904 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:16:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0cbede00 20 client.25067 trim_cache size 0 max 16384 2026-02-20T13:16:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 -- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ce00b57e0 msgr2=0x7f5ce00d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ce00b57e0 0x7f5ce00d5c90 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cf4004740 tx=0x7f5cf4004420 comp rx=0 tx=0).stop 2026-02-20T13:16:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 -- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 msgr2=0x7f5d040f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 0x7f5d040f4930 secure :-1 s=READY pgs=284 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d0000aa30 tx=0x7f5d00003780 comp rx=0 tx=0).stop 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 -- 10.20.193.28:0/189274942 shutdown_connections 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ce00b57e0 0x7f5ce00d5c90 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d04113000 0x7f5d040f4930 unknown :-1 s=CLOSED pgs=284 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d04060a00 0x7f5d041738d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 --2- 10.20.193.28:0/189274942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d04060010 0x7f5d040f4230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 -- 10.20.193.28:0/189274942 >> 10.20.193.28:0/189274942 conn(0x7f5d040e95a0 msgr2=0x7f5d0410a160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 -- 10.20.193.28:0/189274942 shutdown_connections 2026-02-20T13:16:57.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:57.892+0000 7f5d0996a640 1 -- 10.20.193.28:0/189274942 wait complete. 2026-02-20T13:16:58.032 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.g status 2026-02-20T13:16:58.216 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:58.262 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:16:58 trial028 ceph-mon[37442]: pgmap v168: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 13 op/s 2026-02-20T13:16:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 -- 10.20.193.28:0/569916489 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f04118720 msgr2=0x7f0f04118ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/569916489 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f04118720 0x7f0f04118ba0 secure :-1 s=READY pgs=111 gs=3 cs=0 l=1 c_cookie=3442952050832214603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef400aa30 tx=0x7f0ef4030270 comp rx=0 tx=0).stop 2026-02-20T13:16:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 -- 10.20.193.28:0/569916489 shutdown_connections 2026-02-20T13:16:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/569916489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f0411ac00 0x7f0f0411b030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/569916489 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f04118720 0x7f0f04118ba0 unknown :-1 s=CLOSED pgs=111 gs=3 cs=0 l=1 c_cookie=3442952050832214603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/569916489 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f0411ba20 0x7f0f0411a6c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 -- 10.20.193.28:0/569916489 >> 10.20.193.28:0/569916489 conn(0x7f0f040590e0 msgr2=0x7f0f040594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 -- 10.20.193.28:0/569916489 shutdown_connections 2026-02-20T13:16:58.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 -- 10.20.193.28:0/569916489 wait complete. 2026-02-20T13:16:58.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.402+0000 7f0f08c9c640 1 Processor -- start 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f08c9c640 1 -- start start 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f08c9c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f04118720 0x7f0f040ffdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f08c9c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f0411ac00 0x7f0f04100330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f08c9c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f0411ba20 0x7f0f04105700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f08c9c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0f04105d20 con 0x7f0f0411ac00 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f08c9c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0f04105e90 con 0x7f0f0411ba20 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f08c9c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0f04106050 con 0x7f0f04118720 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f04118720 0x7f0f040ffdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f04118720 0x7f0f040ffdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52902/0 (socket says 10.20.193.28:52902) 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02575640 1 -- 10.20.193.28:0/1538956791 learned_addr learned my addr 10.20.193.28:0/1538956791 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02d76640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f0411ba20 0x7f0f04105700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f01d74640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f0411ac00 0x7f0f04100330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02575640 1 -- 10.20.193.28:0/1538956791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f0411ba20 msgr2=0x7f0f04105700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02575640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f0411ba20 0x7f0f04105700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02575640 1 -- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f0411ac00 msgr2=0x7f0f04100330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02575640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f0411ac00 0x7f0f04100330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f02575640 1 -- 10.20.193.28:0/1538956791 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec0094b0 con 0x7f0f04118720 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.403+0000 7f0f01d74640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f0411ac00 0x7f0f04100330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.404+0000 7f0f02575640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f04118720 0x7f0f040ffdf0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef8005db0 tx=0x7f0ef800ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.404+0000 7f0eeb7fe640 1 -- 10.20.193.28:0/1538956791 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef8004500 con 0x7f0f04118720 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.404+0000 7f0f08c9c640 1 -- 10.20.193.28:0/1538956791 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef400a650 con 0x7f0f04118720 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.404+0000 7f0eeb7fe640 1 -- 10.20.193.28:0/1538956791 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ef8004d30 con 0x7f0f04118720 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.404+0000 7f0eeb7fe640 1 -- 10.20.193.28:0/1538956791 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef8005330 con 0x7f0f04118720 2026-02-20T13:16:58.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.404+0000 7f0f08c9c640 1 -- 10.20.193.28:0/1538956791 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f04106870 con 0x7f0f04118720 2026-02-20T13:16:58.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.407+0000 7f0eeb7fe640 1 -- 10.20.193.28:0/1538956791 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f0ef8005490 con 0x7f0f04118720 2026-02-20T13:16:58.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.408+0000 7f0eeb7fe640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0edc0b57f0 0x7f0edc0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.408+0000 7f0eeb7fe640 1 -- 10.20.193.28:0/1538956791 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f0ef80ae8f0 con 0x7f0f04118720 2026-02-20T13:16:58.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.408+0000 7f0f01d74640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0edc0b57f0 0x7f0edc0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.409+0000 7f0f01d74640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0edc0b57f0 0x7f0edc0d5ca0 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f04106790 tx=0x7f0eec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.410+0000 7f0f0ac96e00 1 Processor -- start 2026-02-20T13:16:58.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.410+0000 7f0f0ac96e00 1 -- start start 2026-02-20T13:16:58.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.410+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3b5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.410+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 0x561107b80280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.410+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107ba0ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.410+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5611079cd370 con 0x561107b3b210 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.410+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561107a51710 con 0x561107b3bb20 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.410+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561107a4d440 con 0x561107b807c0 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107ba0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107ba0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52918/0 (socket says 10.20.193.28:52918) 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 -- 10.20.193.28:0/1880208758 learned_addr learned my addr 10.20.193.28:0/1880208758 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f01d74640 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 0x561107b80280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02575640 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 -- 10.20.193.28:0/1880208758 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 msgr2=0x561107b80280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 0x561107b80280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 -- 10.20.193.28:0/1880208758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 msgr2=0x561107b3b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 -- 10.20.193.28:0/1880208758 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611079f2cf0 con 0x561107b807c0 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0f02d76640 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107ba0ba0 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=6913820619704935038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef4030780 tx=0x7f0ef4006eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff2d338fe48a27e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0ee8ff9640 1 -- 10.20.193.28:0/1880208758 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef403e050 con 0x561107b807c0 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0ee8ff9640 1 -- 10.20.193.28:0/1880208758 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ef403f040 con 0x561107b807c0 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.411+0000 7f0ee8ff9640 1 -- 10.20.193.28:0/1880208758 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef4039db0 con 0x561107b807c0 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/1880208758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 msgr2=0x561107ba0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107ba0ba0 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=6913820619704935038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef4030780 tx=0x7f0ef4006eb0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/1880208758 shutdown_connections 2026-02-20T13:16:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107ba0ba0 unknown :-1 s=CLOSED pgs=96 gs=3 cs=0 l=1 c_cookie=6913820619704935038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 0x561107b80280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/1880208758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3b5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/1880208758 >> 10.20.193.28:0/1880208758 conn(0x561107a5a450 msgr2=0x561107b39af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/1880208758 shutdown_connections 2026-02-20T13:16:58.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.412+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/1880208758 wait complete. 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.413+0000 7f0f0ac96e00 1 -- start start 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.413+0000 7f0f0ac96e00 1 Processor -- start 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b53880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 0x561107b53dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b58db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561107705610 con 0x561107b3b210 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561107b59320 con 0x561107b3bb20 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561107b594e0 con 0x561107b807c0 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b53880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b53880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49912/0 (socket says 10.20.193.28:49912) 2026-02-20T13:16:58.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 -- 10.20.193.28:0/3970442421 learned_addr learned my addr 10.20.193.28:0/3970442421 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f01d74640 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 0x561107b53dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 -- 10.20.193.28:0/3970442421 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 msgr2=0x561107b58db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b58db0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 -- 10.20.193.28:0/3970442421 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 msgr2=0x561107b53dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 0x561107b53dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 -- 10.20.193.28:0/3970442421 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611079cb2c0 con 0x561107b3b210 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f02575640 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b53880 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=554811835937606249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef80aad90 tx=0x7f0ef80b8b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3166cde3e4a69 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0eb3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0eb3fff640 1 -- 10.20.193.28:0/3970442421 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef80aa540 con 0x561107b3b210 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0eb3fff640 1 -- 10.20.193.28:0/3970442421 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ef80ad8d0 con 0x561107b3b210 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0eb3fff640 1 -- 10.20.193.28:0/3970442421 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef80e4370 con 0x561107b3b210 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.414+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f04119820 con 0x561107b3b210 2026-02-20T13:16:58.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0eb3fff640 1 -- 10.20.193.28:0/3970442421 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f0ef80b61f0 con 0x561107b3b210 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0eb3fff640 10 client.15090 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 10 client.15090 _ll_register_callbacks cb 0x5611079d0a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5611076dd600 con 0x561107b3b210 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0eb3fff640 1 -- 10.20.193.28:0/3970442421 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0ef80099e0 con 0x561107b3b210 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 10 client.15090 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5611079dd0c0 con 0x561107b3b210 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0eb3fff640 1 -- 10.20.193.28:0/3970442421 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f0ef8005490 con 0x561107b3b210 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 10 client.15090 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 10 client.15090 resolve_mds: resolved name 'g' to daemon mds.g 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 20 client.15090 populate_metadata read hostname 'trial028' 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561107b7ec90 0x561107b7fa30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 4 client.15090 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:16:58.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.415+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561107a1a0a0 con 0x561107b7ec90 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.416+0000 7f0f01d74640 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561107b7ec90 0x561107b7fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.416+0000 7f0f01d74640 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561107b7ec90 0x561107b7fa30 crc :-1 s=READY pgs=15 gs=3 cs=0 l=0 c_cookie=15601463084443683772 s_cookie=10328837434882712267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d8838803e4a2cbbc server_cookie=8f5766ec28f0e2cb in_seq=0 out_seq=0 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.416+0000 7f0eb3fff640 10 client.15090 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0eb3fff640 1 -- 10.20.193.28:0/3970442421 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561107a1a0a0 con 0x561107b7ec90 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0eb3fff640 10 client.15090 handle_command_reply: tid=0 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 client.15090 shutdown 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 msgr2=0x561107b53880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b53880 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=554811835937606249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef80aad90 tx=0x7f0ef80b8b30 comp rx=0 tx=0).stop 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 shutdown_connections 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561107b7ec90 0x561107b7fa30 crc :-1 s=READY pgs=15 gs=3 cs=0 l=0 c_cookie=15601463084443683772 s_cookie=10328837434882712267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b58db0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3bb20 0x561107b53dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/3970442421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b53880 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=554811835937606249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0eb3fff640 0 client.15090 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:16:58.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 >> 10.20.193.28:0/3970442421 conn(0x561107a5a450 msgr2=0x561107b3a200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 shutdown_connections 2026-02-20T13:16:58.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/3970442421 wait complete. 2026-02-20T13:16:58.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.417+0000 7f0f0ac96e00 20 client.15090 trim_cache size 0 max 16384 2026-02-20T13:16:58.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.426+0000 7f0f0ac96e00 1 Processor -- start 2026-02-20T13:16:58.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f0ac96e00 1 -- start start 2026-02-20T13:16:58.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3a400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b3bb20 0x561107b3a940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b807c0 0x561107b50c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561107a475a0 con 0x561107b3b210 2026-02-20T13:16:58.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561107a451d0 con 0x561107b807c0 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561107b4b340 con 0x561107b3bb20 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3a400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3a400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49926/0 (socket says 10.20.193.28:49926) 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 -- 10.20.193.28:0/998309783 learned_addr learned my addr 10.20.193.28:0/998309783 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02d76640 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b807c0 0x561107b50c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f01d74640 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b3bb20 0x561107b3a940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 -- 10.20.193.28:0/998309783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b3bb20 msgr2=0x561107b3a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b3bb20 0x561107b3a940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 -- 10.20.193.28:0/998309783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b807c0 msgr2=0x561107b50c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b807c0 0x561107b50c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 -- 10.20.193.28:0/998309783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611079d7b40 con 0x561107b3b210 2026-02-20T13:16:58.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0f02575640 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3a400 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=17960335068602991311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef8009fd0 tx=0x7f0ef80cd000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93fed96431282cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0ece4e6640 1 -- 10.20.193.28:0/998309783 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef8020740 con 0x561107b3b210 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0ece4e6640 1 -- 10.20.193.28:0/998309783 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ef80cb020 con 0x561107b3b210 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.427+0000 7f0ece4e6640 1 -- 10.20.193.28:0/998309783 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef8073260 con 0x561107b3b210 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/998309783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 msgr2=0x561107b3a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3a400 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=17960335068602991311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef8009fd0 tx=0x7f0ef80cd000 comp rx=0 tx=0).stop 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/998309783 shutdown_connections 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b807c0 0x561107b50c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b3bb20 0x561107b3a940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/998309783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3b210 0x561107b3a400 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=17960335068602991311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/998309783 >> 10.20.193.28:0/998309783 conn(0x561107a5a450 msgr2=0x561107b7da20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/998309783 shutdown_connections 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/998309783 wait complete. 2026-02-20T13:16:58.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.428+0000 7f0f0ac96e00 1 -- start start 2026-02-20T13:16:58.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f0ac96e00 1 Processor -- start 2026-02-20T13:16:58.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3b210 0x561107b57fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3bb20 0x561107b58540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f0ac96e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b59f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561107a451d0 con 0x561107b3bb20 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561107b5a660 con 0x561107b3b210 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f0ac96e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561107b5a820 con 0x561107b807c0 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f02d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b59f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f02d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b59f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52944/0 (socket says 10.20.193.28:52944) 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f02d76640 1 -- 10.20.193.28:0/979557696 learned_addr learned my addr 10.20.193.28:0/979557696 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f02575640 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3b210 0x561107b57fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f01d74640 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3bb20 0x561107b58540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f02d76640 1 -- 10.20.193.28:0/979557696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3b210 msgr2=0x561107b57fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f02d76640 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3b210 0x561107b57fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.429+0000 7f0f02d76640 1 -- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3bb20 msgr2=0x561107b58540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0f02d76640 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3bb20 0x561107b58540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0f02d76640 1 -- 10.20.193.28:0/979557696 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611079cb5f0 con 0x561107b807c0 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0f01d74640 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3bb20 0x561107b58540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0f02d76640 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b59f30 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=397317079748057044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef400aa30 tx=0x7f0ef4030270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5838dc7699417d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0eb3fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0eb3fff640 1 -- 10.20.193.28:0/979557696 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef4003bb0 con 0x561107b807c0 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0eb3fff640 1 -- 10.20.193.28:0/979557696 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ef4039e00 con 0x561107b807c0 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0eb3fff640 1 -- 10.20.193.28:0/979557696 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ef40566f0 con 0x561107b807c0 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611079dd0c0 con 0x561107b807c0 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0f0ac96e00 10 client.25048 _ll_register_callbacks cb 0x5611079d0a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:58.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.430+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ef403f040 con 0x561107b807c0 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0eb3fff640 1 -- 10.20.193.28:0/979557696 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f0ef4005150 con 0x561107b807c0 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0eb3fff640 1 -- 10.20.193.28:0/979557696 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0ef4039920 con 0x561107b807c0 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f0ac96e00 10 client.25048 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5611079dd320 con 0x561107b807c0 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0eb3fff640 1 -- 10.20.193.28:0/979557696 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f0ef4039a80 con 0x561107b807c0 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f0ac96e00 10 client.25048 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f0ac96e00 10 client.25048 resolve_mds: resolved name 'g' to daemon mds.g 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f0ac96e00 20 client.25048 populate_metadata read hostname 'trial028' 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561107c321e0 0x561107c30ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f0ac96e00 4 client.25048 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "status"}) -- 0x5611076dae50 con 0x561107c321e0 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.431+0000 7f0f02575640 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561107c321e0 0x561107c30ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.432+0000 7f0f02575640 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561107c321e0 0x561107c30ef0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=10497562424431888650 s_cookie=5459181588777552733 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=91aed56813c0490a server_cookie=4bc2e8bb23704b5d in_seq=0 out_seq=0 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.432+0000 7f0eb3fff640 10 client.25048 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.432+0000 7f0eb3fff640 1 -- 10.20.193.28:0/979557696 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1217 (crc 0 0 0) 0x5611076dae50 con 0x561107c321e0 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.432+0000 7f0eb3fff640 10 client.25048 handle_command_reply: tid=0 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.432+0000 7f0f0ac96e00 1 client.25048 shutdown 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 msgr2=0x561107b59f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b59f30 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=397317079748057044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef400aa30 tx=0x7f0ef4030270 comp rx=0 tx=0).stop 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 shutdown_connections 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561107c321e0 0x561107c30ef0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=10497562424431888650 s_cookie=5459181588777552733 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561107b3bb20 0x561107b58540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561107b807c0 0x561107b59f30 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=397317079748057044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0eb3fff640 0 client.25048 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 --2- 10.20.193.28:0/979557696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561107b3b210 0x561107b57fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 >> 10.20.193.28:0/979557696 conn(0x561107a5a450 msgr2=0x561107b3e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 shutdown_connections 2026-02-20T13:16:58.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 1 -- 10.20.193.28:0/979557696 wait complete. 2026-02-20T13:16:58.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f0ac96e00 20 client.25048 trim_cache size 0 max 16384 2026-02-20T13:16:58.442 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:16:58.442 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:16:58.442 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 1, 2026-02-20T13:16:58.442 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24677, 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 21.645104435, 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 32.110604451999997, 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:16:58.443 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial028", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:16:58.444 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448336", 2026-02-20T13:16:58.445 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:16:58.445 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:16:58.445 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:16:58.445 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:16:58.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f08c9c640 1 -- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0edc0b57f0 msgr2=0x7f0edc0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0edc0b57f0 0x7f0edc0d5ca0 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f04106790 tx=0x7f0eec005f90 comp rx=0 tx=0).stop 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f08c9c640 1 -- 10.20.193.28:0/1538956791 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f04118720 msgr2=0x7f0f040ffdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.433+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f04118720 0x7f0f040ffdf0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef8005db0 tx=0x7f0ef800ddf0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.434+0000 7f0f08c9c640 1 -- 10.20.193.28:0/1538956791 shutdown_connections 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.434+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0edc0b57f0 0x7f0edc0d5ca0 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.434+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f0411ac00 0x7f0f04100330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.434+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f0411ba20 0x7f0f04105700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.434+0000 7f0f08c9c640 1 --2- 10.20.193.28:0/1538956791 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f04118720 0x7f0f040ffdf0 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.434+0000 7f0f08c9c640 1 -- 10.20.193.28:0/1538956791 >> 10.20.193.28:0/1538956791 conn(0x7f0f040590e0 msgr2=0x7f0f040f6420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.434+0000 7f0f08c9c640 1 -- 10.20.193.28:0/1538956791 shutdown_connections 2026-02-20T13:16:58.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.434+0000 7f0f08c9c640 1 -- 10.20.193.28:0/1538956791 wait complete. 2026-02-20T13:16:58.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:16:58 trial127 ceph-mon[43817]: pgmap v168: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 13 op/s 2026-02-20T13:16:58.490 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:16:58 trial034 ceph-mon[43332]: pgmap v168: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 13 op/s 2026-02-20T13:16:58.569 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.b status 2026-02-20T13:16:58.753 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:58.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 -- 10.20.193.28:0/2915166009 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410f230 msgr2=0x7fe91410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 --2- 10.20.193.28:0/2915166009 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410f230 0x7fe91410f600 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=17451028389307165131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe900009950 tx=0x7fe90002f190 comp rx=0 tx=0).stop 2026-02-20T13:16:58.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 -- 10.20.193.28:0/2915166009 shutdown_connections 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 --2- 10.20.193.28:0/2915166009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe914115420 0x7fe914175df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 --2- 10.20.193.28:0/2915166009 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe91410fc20 0x7fe914114c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 --2- 10.20.193.28:0/2915166009 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410f230 0x7fe91410f600 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=17451028389307165131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 -- 10.20.193.28:0/2915166009 >> 10.20.193.28:0/2915166009 conn(0x7fe91405f830 msgr2=0x7fe91410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 -- 10.20.193.28:0/2915166009 shutdown_connections 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.938+0000 7fe91a661640 1 -- 10.20.193.28:0/2915166009 wait complete. 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe91a661640 1 Processor -- start 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe91a661640 1 -- start start 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe91a661640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe91410f230 0x7fe91411db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe91a661640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410fc20 0x7fe91411e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe91a661640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe914115420 0x7fe914123480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe91a661640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe914123aa0 con 0x7fe914115420 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe91a661640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe914123c10 con 0x7fe91410fc20 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe91a661640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe914123dd0 con 0x7fe91410f230 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe918bd7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe914115420 0x7fe914123480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe913fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe91410f230 0x7fe91411db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe913fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe91410f230 0x7fe91411db70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52968/0 (socket says 10.20.193.28:52968) 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe913fff640 1 -- 10.20.193.28:0/366780747 learned_addr learned my addr 10.20.193.28:0/366780747 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe9137fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410fc20 0x7fe91411e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.939+0000 7fe918bd7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe914115420 0x7fe914123480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49952/0 (socket says 10.20.193.28:49952) 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9137fe640 1 -- 10.20.193.28:0/366780747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe91410f230 msgr2=0x7fe91411db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9137fe640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe91410f230 0x7fe91411db70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9137fe640 1 -- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe914115420 msgr2=0x7fe914123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9137fe640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe914115420 0x7fe914123480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9137fe640 1 -- 10.20.193.28:0/366780747 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe900009570 con 0x7fe91410fc20 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe913fff640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe91410f230 0x7fe91411db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9137fe640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410fc20 0x7fe91411e0b0 secure :-1 s=READY pgs=113 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe90400d700 tx=0x7fe90400dbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9117fa640 1 -- 10.20.193.28:0/366780747 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe904004500 con 0x7fe91410fc20 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9117fa640 1 -- 10.20.193.28:0/366780747 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe90400de30 con 0x7fe91410fc20 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe9117fa640 1 -- 10.20.193.28:0/366780747 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9040052a0 con 0x7fe91410fc20 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe91a661640 1 -- 10.20.193.28:0/366780747 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9141240b0 con 0x7fe91410fc20 2026-02-20T13:16:58.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.940+0000 7fe91a661640 1 -- 10.20.193.28:0/366780747 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141647b0 con 0x7fe91410fc20 2026-02-20T13:16:58.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.943+0000 7fe9117fa640 1 -- 10.20.193.28:0/366780747 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fe904005430 con 0x7fe91410fc20 2026-02-20T13:16:58.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.945+0000 7fe9117fa640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe8e80b57f0 0x7fe8e80d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.945+0000 7fe913fff640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe8e80b57f0 0x7fe8e80d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.945+0000 7fe9117fa640 1 -- 10.20.193.28:0/366780747 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fe9040e61c0 con 0x7fe91410fc20 2026-02-20T13:16:58.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.945+0000 7fe91c65be00 1 Processor -- start 2026-02-20T13:16:58.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe91c65be00 1 -- start start 2026-02-20T13:16:58.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe8e80b57f0 0x7fe8e80d5ca0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9000023d0 tx=0x7fe900031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053210 0x55b0bf0535e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053b20 0x55b0bf098280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 0x55b0bf0b8ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe91c65be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b0beee5370 con 0x55b0bf053210 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe91c65be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b0bef69710 con 0x55b0bf053b20 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe91c65be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b0bef65440 con 0x55b0bf0987c0 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053210 0x55b0bf0535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053210 0x55b0bf0535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49956/0 (socket says 10.20.193.28:49956) 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 -- 10.20.193.28:0/102630484 learned_addr learned my addr 10.20.193.28:0/102630484 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe918bd7640 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 0x55b0bf0b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe9137fe640 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053b20 0x55b0bf098280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 -- 10.20.193.28:0/102630484 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 msgr2=0x55b0bf0b8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 0x55b0bf0b8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 -- 10.20.193.28:0/102630484 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053b20 msgr2=0x55b0bf098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053b20 0x55b0bf098280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.946+0000 7fe913fff640 1 -- 10.20.193.28:0/102630484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0bef0acf0 con 0x55b0bf053210 2026-02-20T13:16:58.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe913fff640 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053210 0x55b0bf0535e0 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=9746652800101844316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe900005ab0 tx=0x7fe900040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87431114eb23055c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe8e4ce3640 1 -- 10.20.193.28:0/102630484 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe90002fc10 con 0x55b0bf053210 2026-02-20T13:16:58.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe8e4ce3640 1 -- 10.20.193.28:0/102630484 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe900038650 con 0x55b0bf053210 2026-02-20T13:16:58.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe8e4ce3640 1 -- 10.20.193.28:0/102630484 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe90004fb60 con 0x55b0bf053210 2026-02-20T13:16:58.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 -- 10.20.193.28:0/102630484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053210 msgr2=0x55b0bf0535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053210 0x55b0bf0535e0 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=9746652800101844316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe900005ab0 tx=0x7fe900040000 comp rx=0 tx=0).stop 2026-02-20T13:16:58.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 -- 10.20.193.28:0/102630484 shutdown_connections 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 0x55b0bf0b8ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053b20 0x55b0bf098280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 --2- 10.20.193.28:0/102630484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053210 0x55b0bf0535e0 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=9746652800101844316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 -- 10.20.193.28:0/102630484 >> 10.20.193.28:0/102630484 conn(0x55b0bef72450 msgr2=0x55b0bf051af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 -- 10.20.193.28:0/102630484 shutdown_connections 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.947+0000 7fe91c65be00 1 -- 10.20.193.28:0/102630484 wait complete. 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe91c65be00 1 -- start start 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe91c65be00 1 Processor -- start 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 0x55b0bf06b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf06bde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 0x55b0bf070dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe91c65be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b0bec1d610 con 0x55b0bf053b20 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe91c65be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b0bf071340 con 0x55b0bf053210 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe91c65be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b0bf071500 con 0x55b0bf0987c0 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe9137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe9137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf06bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49966/0 (socket says 10.20.193.28:49966) 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe9137fe640 1 -- 10.20.193.28:0/3240509340 learned_addr learned my addr 10.20.193.28:0/3240509340 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe913fff640 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 0x55b0bf06b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.949+0000 7fe918bd7640 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 0x55b0bf070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe9137fe640 1 -- 10.20.193.28:0/3240509340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 msgr2=0x55b0bf070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe9137fe640 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 0x55b0bf070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe9137fe640 1 -- 10.20.193.28:0/3240509340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 msgr2=0x55b0bf06b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe9137fe640 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 0x55b0bf06b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe9137fe640 1 -- 10.20.193.28:0/3240509340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0beee32c0 con 0x55b0bf053b20 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe9137fe640 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf06bde0 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=12879995817187753655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9040e3c70 tx=0x7fe9040e4120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2beeff45ffe3eb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe8d5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/3240509340 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9040b7600 con 0x55b0bf053b20 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/3240509340 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe904009740 con 0x55b0bf053b20 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe914176660 con 0x55b0bf053b20 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/3240509340 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9040ad3b0 con 0x55b0bf053b20 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe91c65be00 10 client.15105 _ll_register_callbacks cb 0x55b0beee8a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b0bebf5600 con 0x55b0bf053b20 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/3240509340 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fe9040aa4a0 con 0x55b0bf053b20 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/3240509340 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe9040aa660 con 0x55b0bf053b20 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe91c65be00 10 client.15105 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:58.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.950+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55b0beef50c0 con 0x55b0bf053b20 2026-02-20T13:16:58.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.951+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/3240509340 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7fe9040b7170 con 0x55b0bf053b20 2026-02-20T13:16:58.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.951+0000 7fe91c65be00 10 client.15105 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:58.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.951+0000 7fe91c65be00 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T13:16:58.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.951+0000 7fe91c65be00 20 client.15105 populate_metadata read hostname 'trial028' 2026-02-20T13:16:58.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.951+0000 7fe91c65be00 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b0bf096d00 0x55b0bf097aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.951+0000 7fe91c65be00 4 client.15105 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:16:58.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.951+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0bef320a0 con 0x55b0bf096d00 2026-02-20T13:16:58.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.951+0000 7fe913fff640 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b0bf096d00 0x55b0bf097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.952+0000 7fe913fff640 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b0bf096d00 0x55b0bf097aa0 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=14271301505639050866 s_cookie=3939172897461887247 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c60dd91b561cee72 server_cookie=36aac0e12e0fe10f in_seq=0 out_seq=0 2026-02-20T13:16:58.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.952+0000 7fe8d5ffb640 10 client.15105 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:16:58.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.952+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/3240509340 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b0bef320a0 con 0x55b0bf096d00 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.952+0000 7fe8d5ffb640 10 client.15105 handle_command_reply: tid=0 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 client.15105 shutdown 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 msgr2=0x55b0bf06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf06bde0 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=12879995817187753655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9040e3c70 tx=0x7fe9040e4120 comp rx=0 tx=0).stop 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 shutdown_connections 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b0bf096d00 0x55b0bf097aa0 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=14271301505639050866 s_cookie=3939172897461887247 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf06bde0 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=12879995817187753655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe8d5ffb640 0 client.15105 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf0987c0 0x55b0bf070dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 --2- 10.20.193.28:0/3240509340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 0x55b0bf06b8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 >> 10.20.193.28:0/3240509340 conn(0x55b0bef72450 msgr2=0x55b0bf052200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 shutdown_connections 2026-02-20T13:16:58.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 1 -- 10.20.193.28:0/3240509340 wait complete. 2026-02-20T13:16:58.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.953+0000 7fe91c65be00 20 client.15105 trim_cache size 0 max 16384 2026-02-20T13:16:58.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.963+0000 7fe91c65be00 1 Processor -- start 2026-02-20T13:16:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.963+0000 7fe91c65be00 1 -- start start 2026-02-20T13:16:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 0x55b0bf0560a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf0565e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf096d00 0x55b0bf068c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe91c65be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b0bef5f5a0 con 0x55b0bf053b20 2026-02-20T13:16:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe91c65be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b0bef5d1d0 con 0x55b0bf053210 2026-02-20T13:16:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe91c65be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b0bf0d8d30 con 0x55b0bf096d00 2026-02-20T13:16:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf0565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf0565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49978/0 (socket says 10.20.193.28:49978) 2026-02-20T13:16:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe913fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 0x55b0bf0560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 -- 10.20.193.28:0/2471240712 learned_addr learned my addr 10.20.193.28:0/2471240712 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe918bd7640 1 --2- 10.20.193.28:0/2471240712 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf096d00 0x55b0bf068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 -- 10.20.193.28:0/2471240712 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf096d00 msgr2=0x55b0bf068c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 --2- 10.20.193.28:0/2471240712 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf096d00 0x55b0bf068c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 -- 10.20.193.28:0/2471240712 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 msgr2=0x55b0bf0560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 --2- 10.20.193.28:0/2471240712 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 0x55b0bf0560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 -- 10.20.193.28:0/2471240712 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0bf05dc70 con 0x55b0bf053b20 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe9137fe640 1 --2- 10.20.193.28:0/2471240712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf0565e0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=8249308186465883475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe904005aa0 tx=0x7fe9040cb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727b6e16c1055553 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe8d7fff640 1 -- 10.20.193.28:0/2471240712 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9040d1830 con 0x55b0bf053b20 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe8d7fff640 1 -- 10.20.193.28:0/2471240712 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe90408c020 con 0x55b0bf053b20 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.964+0000 7fe8d7fff640 1 -- 10.20.193.28:0/2471240712 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe904009740 con 0x55b0bf053b20 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 -- 10.20.193.28:0/2471240712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 msgr2=0x55b0bf0565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 --2- 10.20.193.28:0/2471240712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf0565e0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=8249308186465883475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe904005aa0 tx=0x7fe9040cb000 comp rx=0 tx=0).stop 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 -- 10.20.193.28:0/2471240712 shutdown_connections 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 --2- 10.20.193.28:0/2471240712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf0565e0 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=8249308186465883475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 --2- 10.20.193.28:0/2471240712 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf096d00 0x55b0bf068c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 --2- 10.20.193.28:0/2471240712 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf053210 0x55b0bf0560a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 -- 10.20.193.28:0/2471240712 >> 10.20.193.28:0/2471240712 conn(0x55b0bef72450 msgr2=0x55b0bf095a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 -- 10.20.193.28:0/2471240712 shutdown_connections 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 -- 10.20.193.28:0/2471240712 wait complete. 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.965+0000 7fe91c65be00 1 -- start start 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe91c65be00 1 Processor -- start 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf053210 0x55b0bf091520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf071d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe91c65be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf096d00 0x55b0bf0722b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe91c65be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b0bf0983a0 con 0x55b0bf053b20 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe91c65be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b0befc2b90 con 0x55b0bf096d00 2026-02-20T13:16:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe91c65be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b0bf091dc0 con 0x55b0bf053210 2026-02-20T13:16:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe9137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe9137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49994/0 (socket says 10.20.193.28:49994) 2026-02-20T13:16:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe9137fe640 1 -- 10.20.193.28:0/1838654227 learned_addr learned my addr 10.20.193.28:0/1838654227 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe918bd7640 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf096d00 0x55b0bf0722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe913fff640 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf053210 0x55b0bf091520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe9137fe640 1 -- 10.20.193.28:0/1838654227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf053210 msgr2=0x55b0bf091520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe9137fe640 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf053210 0x55b0bf091520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe9137fe640 1 -- 10.20.193.28:0/1838654227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf096d00 msgr2=0x55b0bf0722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe9137fe640 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf096d00 0x55b0bf0722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.966+0000 7fe9137fe640 1 -- 10.20.193.28:0/1838654227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0beeefb40 con 0x55b0bf053b20 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe9137fe640 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf071d70 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=5250469868058521949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9040ae750 tx=0x7fe904005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dd6a86dd85315d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe8d5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/1838654227 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9040d1830 con 0x55b0bf053b20 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/1838654227 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55b0bebf5600 con 0x55b0bf053b20 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/1838654227 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9040ad150 con 0x55b0bf053b20 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0beef50c0 con 0x55b0bf053b20 2026-02-20T13:16:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/1838654227 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fe90408d030 con 0x55b0bf053b20 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe8d5ffb640 10 client.15111 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe91c65be00 10 client.15111 _ll_register_callbacks cb 0x55b0beee8a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe900038650 con 0x55b0bf053b20 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/1838654227 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe9040b7600 con 0x55b0bf053b20 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe91c65be00 10 client.15111 fetch_fsmap learned FSMap version 23 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55b0beee35f0 con 0x55b0bf053b20 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/1838654227 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7fe9040b7170 con 0x55b0bf053b20 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.967+0000 7fe91c65be00 10 client.15111 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.968+0000 7fe91c65be00 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.968+0000 7fe91c65be00 20 client.15111 populate_metadata read hostname 'trial028' 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.968+0000 7fe91c65be00 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b0bf0987c0 0x55b0bf148ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.968+0000 7fe91c65be00 4 client.15111 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:16:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.968+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "status"}) -- 0x55b0bebf2e50 con 0x55b0bf0987c0 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.968+0000 7fe913fff640 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b0bf0987c0 0x55b0bf148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe913fff640 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b0bf0987c0 0x55b0bf148ad0 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=5623439092331575713 s_cookie=5444201690776741897 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e0a780f6a77f9a1 server_cookie=4b8db097d8542809 in_seq=0 out_seq=0 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe8d5ffb640 10 client.15111 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe8d5ffb640 1 -- 10.20.193.28:0/1838654227 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1218 (crc 0 0 0) 0x55b0bebf2e50 con 0x55b0bf0987c0 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe8d5ffb640 10 client.15111 handle_command_reply: tid=0 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 client.15111 shutdown 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 msgr2=0x55b0bf071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf071d70 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=5250469868058521949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9040ae750 tx=0x7fe904005df0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 shutdown_connections 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b0bf0987c0 0x55b0bf148ad0 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=5623439092331575713 s_cookie=5444201690776741897 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0bf053b20 0x55b0bf071d70 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=5250469868058521949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b0bf096d00 0x55b0bf0722b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 --2- 10.20.193.28:0/1838654227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b0bf053210 0x55b0bf091520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 >> 10.20.193.28:0/1838654227 conn(0x55b0bef72450 msgr2=0x55b0bf0560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe8d5ffb640 0 client.15111 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:16:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 shutdown_connections 2026-02-20T13:16:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 1 -- 10.20.193.28:0/1838654227 wait complete. 2026-02-20T13:16:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.969+0000 7fe91c65be00 20 client.15111 trim_cache size 0 max 16384 2026-02-20T13:16:58.978 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:16:58.978 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24692, 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 25.205233089, 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 30.632661759000001, 2026-02-20T13:16:58.979 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial034", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial034", 2026-02-20T13:16:58.980 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:16:58.981 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:16:58.981 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:16:58.981 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438948", 2026-02-20T13:16:58.981 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:16:58.981 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:16:58.981 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:16:58.981 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:16:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.970+0000 7fe91a661640 1 -- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe8e80b57f0 msgr2=0x7fe8e80d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.970+0000 7fe91a661640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe8e80b57f0 0x7fe8e80d5ca0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9000023d0 tx=0x7fe900031040 comp rx=0 tx=0).stop 2026-02-20T13:16:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.970+0000 7fe91a661640 1 -- 10.20.193.28:0/366780747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410fc20 msgr2=0x7fe91411e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.970+0000 7fe91a661640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410fc20 0x7fe91411e0b0 secure :-1 s=READY pgs=113 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe90400d700 tx=0x7fe90400dbd0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.971+0000 7fe91a661640 1 -- 10.20.193.28:0/366780747 shutdown_connections 2026-02-20T13:16:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.971+0000 7fe91a661640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe8e80b57f0 0x7fe8e80d5ca0 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.971+0000 7fe91a661640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe914115420 0x7fe914123480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.971+0000 7fe91a661640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe91410fc20 0x7fe91411e0b0 unknown :-1 s=CLOSED pgs=113 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.971+0000 7fe91a661640 1 --2- 10.20.193.28:0/366780747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe91410f230 0x7fe91411db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.971+0000 7fe91a661640 1 -- 10.20.193.28:0/366780747 >> 10.20.193.28:0/366780747 conn(0x7fe91405f830 msgr2=0x7fe91410cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.971+0000 7fe91a661640 1 -- 10.20.193.28:0/366780747 shutdown_connections 2026-02-20T13:16:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:58.971+0000 7fe91a661640 1 -- 10.20.193.28:0/366780747 wait complete. 2026-02-20T13:16:59.073 INFO:tasks.cephadm:Setup complete, yielding 2026-02-20T13:16:59.073 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-20T13:16:59.089 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T13:16:59.089 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-20T13:16:59.275 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:16:59.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 -- 10.20.193.28:0/2829228409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc110c20 msgr2=0x7f7efc1715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/2829228409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc110c20 0x7f7efc1715b0 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=764759303579909924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ef800aa30 tx=0x7f7ef8030270 comp rx=0 tx=0).stop 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 -- 10.20.193.28:0/2829228409 shutdown_connections 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/2829228409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc110c20 0x7f7efc1715b0 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=764759303579909924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/2829228409 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7efc110270 0x7f7efc1106e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/2829228409 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7efc10f0e0 0x7f7efc10f4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 -- 10.20.193.28:0/2829228409 >> 10.20.193.28:0/2829228409 conn(0x7f7efc0ec810 msgr2=0x7f7efc10cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 -- 10.20.193.28:0/2829228409 shutdown_connections 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 -- 10.20.193.28:0/2829228409 wait complete. 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 Processor -- start 2026-02-20T13:16:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.443+0000 7f7f01a0c640 1 -- start start 2026-02-20T13:16:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f01a0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc10f0e0 0x7f7efc0f8740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f01a0c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7efc110270 0x7f7efc171590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f01a0c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7efc110c20 0x7f7efc0f8f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f01a0c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0f9be0 con 0x7f7efc10f0e0 2026-02-20T13:16:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f01a0c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0f9d50 con 0x7f7efc110c20 2026-02-20T13:16:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f01a0c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0f9f10 con 0x7f7efc110270 2026-02-20T13:16:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc10f0e0 0x7f7efc0f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc10f0e0 0x7f7efc0f8740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50012/0 (socket says 10.20.193.28:50012) 2026-02-20T13:16:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 -- 10.20.193.28:0/4272919136 learned_addr learned my addr 10.20.193.28:0/4272919136 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7ef3fff640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7efc110270 0x7f7efc171590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 -- 10.20.193.28:0/4272919136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7efc110270 msgr2=0x7f7efc171590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7efc110270 0x7f7efc171590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 -- 10.20.193.28:0/4272919136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7efc110c20 msgr2=0x7f7efc0f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f0120b640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7efc110c20 0x7f7efc0f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7efc110c20 0x7f7efc0f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 -- 10.20.193.28:0/4272919136 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef800a650 con 0x7f7efc10f0e0 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f0120b640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7efc110c20 0x7f7efc0f8f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f00a0a640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc10f0e0 0x7f7efc0f8740 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7eec00d950 tx=0x7f7eec00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7ef1ffb640 1 -- 10.20.193.28:0/4272919136 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7eec004540 con 0x7f7efc10f0e0 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7ef1ffb640 1 -- 10.20.193.28:0/4272919136 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7eec009d00 con 0x7f7efc10f0e0 2026-02-20T13:16:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7ef1ffb640 1 -- 10.20.193.28:0/4272919136 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7eec0106e0 con 0x7f7efc10f0e0 2026-02-20T13:16:59.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.444+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc0fa1f0 con 0x7f7efc10f0e0 2026-02-20T13:16:59.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.445+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc0fa670 con 0x7f7efc10f0e0 2026-02-20T13:16:59.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.445+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc1755b0 con 0x7f7efc10f0e0 2026-02-20T13:16:59.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.447+0000 7f7ef1ffb640 1 -- 10.20.193.28:0/4272919136 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f7eec0097c0 con 0x7f7efc10f0e0 2026-02-20T13:16:59.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.449+0000 7f7ef1ffb640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ed80b58c0 0x7f7ed80d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:16:59.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.449+0000 7f7ef1ffb640 1 -- 10.20.193.28:0/4272919136 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f7eec0e7190 con 0x7f7efc10f0e0 2026-02-20T13:16:59.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.449+0000 7f7ef3fff640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ed80b58c0 0x7f7ed80d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:16:59.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.449+0000 7f7ef1ffb640 1 -- 10.20.193.28:0/4272919136 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f7eec0e7610 con 0x7f7efc10f0e0 2026-02-20T13:16:59.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.449+0000 7f7ef3fff640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ed80b58c0 0x7f7ed80d5d70 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee4004740 tx=0x7f7ee4004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:16:59.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.572+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f7efc174d00 con 0x7f7ed80b58c0 2026-02-20T13:16:59.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.573+0000 7f7ef1ffb640 1 -- 10.20.193.28:0/4272919136 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f7efc174d00 con 0x7f7ed80b58c0 2026-02-20T13:16:59.576 INFO:teuthology.orchestra.run.trial028.stdout:Backend: cephadm 2026-02-20T13:16:59.576 INFO:teuthology.orchestra.run.trial028.stdout:Available: Yes 2026-02-20T13:16:59.577 INFO:teuthology.orchestra.run.trial028.stdout:Paused: No 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.574+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ed80b58c0 msgr2=0x7f7ed80d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.574+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ed80b58c0 0x7f7ed80d5d70 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee4004740 tx=0x7f7ee4004420 comp rx=0 tx=0).stop 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.574+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc10f0e0 msgr2=0x7f7efc0f8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.574+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc10f0e0 0x7f7efc0f8740 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7eec00d950 tx=0x7f7eec00de20 comp rx=0 tx=0).stop 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.575+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 shutdown_connections 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.575+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ed80b58c0 0x7f7ed80d5d70 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.575+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7efc110c20 0x7f7efc0f8f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.575+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7efc110270 0x7f7efc171590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.575+0000 7f7f01a0c640 1 --2- 10.20.193.28:0/4272919136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc10f0e0 0x7f7efc0f8740 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:16:59.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.575+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 >> 10.20.193.28:0/4272919136 conn(0x7f7efc0ec810 msgr2=0x7f7efc0eedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:16:59.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.575+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 shutdown_connections 2026-02-20T13:16:59.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:16:59.575+0000 7f7f01a0c640 1 -- 10.20.193.28:0/4272919136 wait complete. 2026-02-20T13:16:59.677 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-20T13:16:59.866 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 -- 10.20.193.28:0/4066232239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 msgr2=0x7fc85410cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/4066232239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 0x7fc85410cc40 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=1138285091250400404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc85000aa30 tx=0x7fc850030270 comp rx=0 tx=0).stop 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 -- 10.20.193.28:0/4066232239 shutdown_connections 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/4066232239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 0x7fc85410cc40 unknown :-1 s=CLOSED pgs=295 gs=1 cs=0 l=1 c_cookie=1138285091250400404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/4066232239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc85410bc30 0x7fc85410c0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/4066232239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc8540609a0 0x7fc85410b610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 -- 10.20.193.28:0/4066232239 >> 10.20.193.28:0/4066232239 conn(0x7fc8540e9250 msgr2=0x7fc854109680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 -- 10.20.193.28:0/4066232239 shutdown_connections 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.047+0000 7fc85bf3b640 1 -- 10.20.193.28:0/4066232239 wait complete. 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85bf3b640 1 Processor -- start 2026-02-20T13:17:00.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85bf3b640 1 -- start start 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85bf3b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8540609a0 0x7fc8540f4a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85bf3b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc85410bc30 0x7fc8540f5060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85bf3b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 0x7fc8540f5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85bf3b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540f6350 con 0x7fc85410c7c0 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85bf3b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540f64c0 con 0x7fc8540609a0 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85bf3b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540f6680 con 0x7fc85410bc30 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85a4b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 0x7fc8540f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85a4b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 0x7fc8540f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54770/0 (socket says 10.20.193.28:54770) 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.048+0000 7fc85a4b1640 1 -- 10.20.193.28:0/3871076340 learned_addr learned my addr 10.20.193.28:0/3871076340 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc8594af640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc85410bc30 0x7fc8540f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc859cb0640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8540609a0 0x7fc8540f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:00.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc85a4b1640 1 -- 10.20.193.28:0/3871076340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc85410bc30 msgr2=0x7fc8540f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc85a4b1640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc85410bc30 0x7fc8540f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc85a4b1640 1 -- 10.20.193.28:0/3871076340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8540609a0 msgr2=0x7fc8540f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc85a4b1640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8540609a0 0x7fc8540f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc85a4b1640 1 -- 10.20.193.28:0/3871076340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85000a650 con 0x7fc85410c7c0 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc8594af640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc85410bc30 0x7fc8540f5060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc85a4b1640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 0x7fc8540f5c10 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc85000a980 tx=0x7fc8500039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc842ffd640 1 -- 10.20.193.28:0/3871076340 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc85003e070 con 0x7fc85410c7c0 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc842ffd640 1 -- 10.20.193.28:0/3871076340 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8500055a0 con 0x7fc85410c7c0 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc842ffd640 1 -- 10.20.193.28:0/3871076340 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc850042b00 con 0x7fc85410c7c0 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8540f6900 con 0x7fc85410c7c0 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.049+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8540f6e20 con 0x7fc85410c7c0 2026-02-20T13:17:00.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.050+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc854110fc0 con 0x7fc85410c7c0 2026-02-20T13:17:00.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.052+0000 7fc842ffd640 1 -- 10.20.193.28:0/3871076340 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fc8500050c0 con 0x7fc85410c7c0 2026-02-20T13:17:00.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.054+0000 7fc842ffd640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc8300b57f0 0x7fc8300d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:00.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.054+0000 7fc842ffd640 1 -- 10.20.193.28:0/3871076340 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fc85010cf50 con 0x7fc85410c7c0 2026-02-20T13:17:00.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.054+0000 7fc859cb0640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc8300b57f0 0x7fc8300d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:00.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.054+0000 7fc842ffd640 1 -- 10.20.193.28:0/3871076340 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fc85010d3d0 con 0x7fc85410c7c0 2026-02-20T13:17:00.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.054+0000 7fc859cb0640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc8300b57f0 0x7fc8300d5ca0 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc844004740 tx=0x7fc844004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:00.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.172+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc85404ca40 con 0x7fc8300b57f0 2026-02-20T13:17:00.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.179+0000 7fc842ffd640 1 -- 10.20.193.28:0/3871076340 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fc85404ca40 con 0x7fc8300b57f0 2026-02-20T13:17:00.183 INFO:teuthology.orchestra.run.trial028.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-20T13:17:00.183 INFO:teuthology.orchestra.run.trial028.stdout:mds.a trial028 running (32s) 29s ago 32s 13.2M - 20.3.0-5390-g0917c158 8ba129fe2622 afa13cbe3851 2026-02-20T13:17:00.183 INFO:teuthology.orchestra.run.trial028.stdout:mds.b trial034 running (31s) 29s ago 31s 16.5M - 20.3.0-5390-g0917c158 8ba129fe2622 b4a5246ec56a 2026-02-20T13:17:00.183 INFO:teuthology.orchestra.run.trial028.stdout:mds.c trial127 running (36s) 29s ago 36s 15.5M - 20.3.0-5390-g0917c158 8ba129fe2622 23c0f50020c2 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.d trial028 running (38s) 29s ago 38s 13.6M - 20.3.0-5390-g0917c158 8ba129fe2622 4c1defeb2a51 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.e trial034 running (38s) 29s ago 37s 15.7M - 20.3.0-5390-g0917c158 8ba129fe2622 cd01bcf443d8 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.f trial127 running (37s) 29s ago 37s 15.5M - 20.3.0-5390-g0917c158 8ba129fe2622 3debc9d16814 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.g trial028 running (33s) 29s ago 33s 13.5M - 20.3.0-5390-g0917c158 8ba129fe2622 57a2c6d8dbc4 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.h trial034 running (35s) 29s ago 35s 17.0M - 20.3.0-5390-g0917c158 8ba129fe2622 ebf9e57ecefc 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.i trial127 running (35s) 29s ago 35s 15.7M - 20.3.0-5390-g0917c158 8ba129fe2622 2721dad6752f 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.j trial028 running (40s) 29s ago 39s 13.2M - 20.3.0-5390-g0917c158 8ba129fe2622 687d4134d83c 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.k trial034 running (41s) 29s ago 41s 17.0M - 20.3.0-5390-g0917c158 8ba129fe2622 1537aa942f1f 2026-02-20T13:17:00.184 INFO:teuthology.orchestra.run.trial028.stdout:mds.l trial127 running (41s) 29s ago 41s 17.0M - 20.3.0-5390-g0917c158 8ba129fe2622 a6d672f3e723 2026-02-20T13:17:00.185 INFO:teuthology.orchestra.run.trial028.stdout:mgr.x trial028 *:9283,8765 running (3m) 29s ago 3m 567M - 20.3.0-5390-g0917c158 8ba129fe2622 99dbc4c62704 2026-02-20T13:17:00.185 INFO:teuthology.orchestra.run.trial028.stdout:mgr.y trial034 *:8443,8765 running (2m) 29s ago 2m 493M - 20.3.0-5390-g0917c158 8ba129fe2622 6df14a5c290c 2026-02-20T13:17:00.185 INFO:teuthology.orchestra.run.trial028.stdout:mgr.z trial127 *:8443,8765 running (2m) 29s ago 2m 494M - 20.3.0-5390-g0917c158 8ba129fe2622 e8ecc008daba 2026-02-20T13:17:00.185 INFO:teuthology.orchestra.run.trial028.stdout:mon.a trial028 running (3m) 29s ago 3m 53.2M 2048M 20.3.0-5390-g0917c158 8ba129fe2622 bb6f0128981f 2026-02-20T13:17:00.185 INFO:teuthology.orchestra.run.trial028.stdout:mon.b trial034 running (2m) 29s ago 2m 44.7M 2048M 20.3.0-5390-g0917c158 8ba129fe2622 efdac399e00c 2026-02-20T13:17:00.185 INFO:teuthology.orchestra.run.trial028.stdout:mon.c trial127 running (3m) 29s ago 3m 45.0M 2048M 20.3.0-5390-g0917c158 8ba129fe2622 f19f31382754 2026-02-20T13:17:00.185 INFO:teuthology.orchestra.run.trial028.stdout:osd.0 trial028 running (2m) 29s ago 2m 44.5M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 47134796bee0 2026-02-20T13:17:00.185 INFO:teuthology.orchestra.run.trial028.stdout:osd.1 trial034 running (2m) 29s ago 2m 45.9M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 47d363fb2554 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.2 trial127 running (2m) 29s ago 2m 44.1M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 e8b120713daf 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.3 trial028 running (2m) 29s ago 2m 43.5M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 6d6e7ac638b3 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.4 trial034 running (114s) 29s ago 116s 43.6M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 e40c39376327 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.5 trial127 running (106s) 29s ago 108s 43.2M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 f1e1ddc5bb4e 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.6 trial028 running (93s) 29s ago 97s 41.2M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 e73e63df1999 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.7 trial034 running (85s) 29s ago 87s 44.6M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 a39135f3ff4e 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.8 trial127 running (77s) 29s ago 79s 42.9M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 34da12ac25a8 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.9 trial028 running (64s) 29s ago 67s 42.4M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 8ca80ac33596 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.10 trial034 running (58s) 29s ago 58s 42.7M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 1b73ea671a2f 2026-02-20T13:17:00.186 INFO:teuthology.orchestra.run.trial028.stdout:osd.11 trial127 running (49s) 29s ago 51s 41.0M 20.5G 20.3.0-5390-g0917c158 8ba129fe2622 01f55771a6ba 2026-02-20T13:17:00.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc8300b57f0 msgr2=0x7fc8300d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc8300b57f0 0x7fc8300d5ca0 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc844004740 tx=0x7fc844004420 comp rx=0 tx=0).stop 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 msgr2=0x7fc8540f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 0x7fc8540f5c10 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc85000a980 tx=0x7fc8500039b0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 shutdown_connections 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc8300b57f0 0x7fc8300d5ca0 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc85410c7c0 0x7fc8540f5c10 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc85410bc30 0x7fc8540f5060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 --2- 10.20.193.28:0/3871076340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8540609a0 0x7fc8540f4a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 >> 10.20.193.28:0/3871076340 conn(0x7fc8540e9250 msgr2=0x7fc8540eaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:00.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 shutdown_connections 2026-02-20T13:17:00.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.180+0000 7fc85bf3b640 1 -- 10.20.193.28:0/3871076340 wait complete. 2026-02-20T13:17:00.283 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-20T13:17:00.469 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:00.513 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:00 trial028 ceph-mon[37442]: pgmap v169: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2026-02-20T13:17:00.513 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:00 trial028 ceph-mon[37442]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:00.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.640+0000 7f9c4b09f640 1 -- 10.20.193.28:0/693039634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c44110270 msgr2=0x7f9c441106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.640+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/693039634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c44110270 0x7f9c441106e0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=1566555164484671119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c38009950 tx=0x7f9c3802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:00.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.641+0000 7f9c4b09f640 1 -- 10.20.193.28:0/693039634 shutdown_connections 2026-02-20T13:17:00.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.641+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/693039634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c44110270 0x7f9c441106e0 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=1566555164484671119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.641+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/693039634 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9c44110c20 0x7f9c441715b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.641+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/693039634 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9c4410f0e0 0x7f9c4410f4d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.641+0000 7f9c4b09f640 1 -- 10.20.193.28:0/693039634 >> 10.20.193.28:0/693039634 conn(0x7f9c440ec810 msgr2=0x7f9c4410cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.641+0000 7f9c4b09f640 1 -- 10.20.193.28:0/693039634 shutdown_connections 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.641+0000 7f9c4b09f640 1 -- 10.20.193.28:0/693039634 wait complete. 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4b09f640 1 Processor -- start 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4b09f640 1 -- start start 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4b09f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c4410f0e0 0x7f9c440f87e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4b09f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9c44110270 0x7f9c44171590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4b09f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9c44110c20 0x7f9c440f9020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4b09f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440f9c80 con 0x7f9c4410f0e0 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4b09f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440f9df0 con 0x7f9c44110c20 2026-02-20T13:17:00.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4b09f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440f9fb0 con 0x7f9c44110270 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a09d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c4410f0e0 0x7f9c440f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a09d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c4410f0e0 0x7f9c440f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54796/0 (socket says 10.20.193.28:54796) 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a09d640 1 -- 10.20.193.28:0/1641922070 learned_addr learned my addr 10.20.193.28:0/1641922070 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a89e640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9c44110c20 0x7f9c440f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4989c640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9c44110270 0x7f9c44171590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a09d640 1 -- 10.20.193.28:0/1641922070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9c44110270 msgr2=0x7f9c44171590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a09d640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9c44110270 0x7f9c44171590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a09d640 1 -- 10.20.193.28:0/1641922070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9c44110c20 msgr2=0x7f9c440f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a09d640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9c44110c20 0x7f9c440f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a09d640 1 -- 10.20.193.28:0/1641922070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c38009570 con 0x7f9c4410f0e0 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4a89e640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9c44110c20 0x7f9c440f9020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:00.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.642+0000 7f9c4989c640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9c44110270 0x7f9c44171590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:00.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.643+0000 7f9c4a09d640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c4410f0e0 0x7f9c440f87e0 secure :-1 s=READY pgs=298 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c34009480 tx=0x7f9c3400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:00.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.643+0000 7f9c2b7fe640 1 -- 10.20.193.28:0/1641922070 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c3400cd40 con 0x7f9c4410f0e0 2026-02-20T13:17:00.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.643+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c440fa290 con 0x7f9c4410f0e0 2026-02-20T13:17:00.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.643+0000 7f9c2b7fe640 1 -- 10.20.193.28:0/1641922070 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c34004d30 con 0x7f9c4410f0e0 2026-02-20T13:17:00.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.643+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c440fa760 con 0x7f9c4410f0e0 2026-02-20T13:17:00.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.643+0000 7f9c2b7fe640 1 -- 10.20.193.28:0/1641922070 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c34010740 con 0x7f9c4410f0e0 2026-02-20T13:17:00.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.644+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44175620 con 0x7f9c4410f0e0 2026-02-20T13:17:00.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.645+0000 7f9c2b7fe640 1 -- 10.20.193.28:0/1641922070 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f9c3401f060 con 0x7f9c4410f0e0 2026-02-20T13:17:00.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.647+0000 7f9c2b7fe640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9c200b57f0 0x7f9c200d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:00.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.647+0000 7f9c2b7fe640 1 -- 10.20.193.28:0/1641922070 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f9c34014070 con 0x7f9c4410f0e0 2026-02-20T13:17:00.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.647+0000 7f9c4989c640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9c200b57f0 0x7f9c200d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:00.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.648+0000 7f9c4989c640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9c200b57f0 0x7f9c200d5ca0 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c380023d0 tx=0x7f9c38031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:00.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.648+0000 7f9c2b7fe640 1 -- 10.20.193.28:0/1641922070 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f9c340eb070 con 0x7f9c4410f0e0 2026-02-20T13:17:00.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:00 trial127 ceph-mon[43817]: pgmap v169: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2026-02-20T13:17:00.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:00 trial127 ceph-mon[43817]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:00.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:00 trial034 ceph-mon[43332]: pgmap v169: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2026-02-20T13:17:00.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:00 trial034 ceph-mon[43332]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:00.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.765+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9c44174d50 con 0x7f9c200b57f0 2026-02-20T13:17:00.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.769+0000 7f9c2b7fe640 1 -- 10.20.193.28:0/1641922070 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+940 (secure 0 0 0) 0x7f9c44174d50 con 0x7f9c200b57f0 2026-02-20T13:17:00.772 INFO:teuthology.orchestra.run.trial028.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-20T13:17:00.772 INFO:teuthology.orchestra.run.trial028.stdout:mds.all 12/12 30s ago 44s trial028=a;trial028=d;trial028=g;trial028=j;trial034=b;trial034=e;trial034=h;trial034=k;trial127=c;trial127=f;trial127=i;trial127=l;count:12 2026-02-20T13:17:00.772 INFO:teuthology.orchestra.run.trial028.stdout:mgr 3/3 30s ago 2m trial028=x;trial034=y;trial127=z;count:3 2026-02-20T13:17:00.772 INFO:teuthology.orchestra.run.trial028.stdout:mon 3/3 30s ago 3m trial028:10.20.193.28=a;trial034:10.20.193.34=b;trial127:10.20.193.127=c;count:3 2026-02-20T13:17:00.772 INFO:teuthology.orchestra.run.trial028.stdout:osd.default 12 30s ago 56s trial127 2026-02-20T13:17:00.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9c200b57f0 msgr2=0x7f9c200d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9c200b57f0 0x7f9c200d5ca0 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c380023d0 tx=0x7f9c38031040 comp rx=0 tx=0).stop 2026-02-20T13:17:00.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c4410f0e0 msgr2=0x7f9c440f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:00.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c4410f0e0 0x7f9c440f87e0 secure :-1 s=READY pgs=298 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c34009480 tx=0x7f9c3400ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:00.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 shutdown_connections 2026-02-20T13:17:00.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9c200b57f0 0x7f9c200d5ca0 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9c44110c20 0x7f9c440f9020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9c44110270 0x7f9c44171590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 --2- 10.20.193.28:0/1641922070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c4410f0e0 0x7f9c440f87e0 unknown :-1 s=CLOSED pgs=298 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:00.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 >> 10.20.193.28:0/1641922070 conn(0x7f9c440ec810 msgr2=0x7f9c440eee30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:00.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 shutdown_connections 2026-02-20T13:17:00.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:00.770+0000 7f9c4b09f640 1 -- 10.20.193.28:0/1641922070 wait complete. 2026-02-20T13:17:00.911 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-20T13:17:01.095 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.280+0000 7f624bfff640 1 -- 10.20.193.28:0/3255808036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c060730 msgr2=0x7f624c10b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.280+0000 7f624bfff640 1 --2- 10.20.193.28:0/3255808036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c060730 0x7f624c10b450 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=15210776743059737335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6240009950 tx=0x7f624002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.280+0000 7f624bfff640 1 -- 10.20.193.28:0/3255808036 shutdown_connections 2026-02-20T13:17:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.280+0000 7f624bfff640 1 --2- 10.20.193.28:0/3255808036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f624c10c340 0x7f624c10c7e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.280+0000 7f624bfff640 1 --2- 10.20.193.28:0/3255808036 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f624c10b990 0x7f624c10be00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.280+0000 7f624bfff640 1 --2- 10.20.193.28:0/3255808036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c060730 0x7f624c10b450 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=15210776743059737335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.280+0000 7f624bfff640 1 -- 10.20.193.28:0/3255808036 >> 10.20.193.28:0/3255808036 conn(0x7f624c0e9050 msgr2=0x7f624c109460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.280+0000 7f624bfff640 1 -- 10.20.193.28:0/3255808036 shutdown_connections 2026-02-20T13:17:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.281+0000 7f624bfff640 1 -- 10.20.193.28:0/3255808036 wait complete. 2026-02-20T13:17:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.281+0000 7f624bfff640 1 Processor -- start 2026-02-20T13:17:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.281+0000 7f624bfff640 1 -- start start 2026-02-20T13:17:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f624c060730 0x7f624c0f4a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f624c10b990 0x7f624c0f50d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c10c340 0x7f624c0f5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0f6410 con 0x7f624c10c340 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624bfff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0f6580 con 0x7f624c060730 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624bfff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0f6740 con 0x7f624c10b990 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c10c340 0x7f624c0f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c10c340 0x7f624c0f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54820/0 (socket says 10.20.193.28:54820) 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 -- 10.20.193.28:0/4543568 learned_addr learned my addr 10.20.193.28:0/4543568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624a7fc640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f624c10b990 0x7f624c0f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624affd640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f624c060730 0x7f624c0f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 -- 10.20.193.28:0/4543568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f624c10b990 msgr2=0x7f624c0f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f624c10b990 0x7f624c0f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 -- 10.20.193.28:0/4543568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f624c060730 msgr2=0x7f624c0f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f624c060730 0x7f624c0f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 -- 10.20.193.28:0/4543568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6240009570 con 0x7f624c10c340 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f624b7fe640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c10c340 0x7f624c0f5cd0 secure :-1 s=READY pgs=300 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f623c006e90 tx=0x7f623c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f622bfff640 1 -- 10.20.193.28:0/4543568 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f623c005500 con 0x7f624c10c340 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f622bfff640 1 -- 10.20.193.28:0/4543568 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f623c005e10 con 0x7f624c10c340 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.282+0000 7f622bfff640 1 -- 10.20.193.28:0/4543568 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f623c003a90 con 0x7f624c10c340 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.283+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c0f6a20 con 0x7f624c10c340 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.283+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c0f6f40 con 0x7f624c10c340 2026-02-20T13:17:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.283+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624c175210 con 0x7f624c10c340 2026-02-20T13:17:01.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.285+0000 7f622bfff640 1 -- 10.20.193.28:0/4543568 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f623c00c840 con 0x7f624c10c340 2026-02-20T13:17:01.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.287+0000 7f622bfff640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f62200b57f0 0x7f62200d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:01.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.287+0000 7f622bfff640 1 -- 10.20.193.28:0/4543568 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f623c0e7bb0 con 0x7f624c10c340 2026-02-20T13:17:01.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.287+0000 7f624affd640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f62200b57f0 0x7f62200d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:01.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.287+0000 7f622bfff640 1 -- 10.20.193.28:0/4543568 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f623c120730 con 0x7f624c10c340 2026-02-20T13:17:01.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.288+0000 7f624affd640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f62200b57f0 0x7f62200d5ca0 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6240002d80 tx=0x7f624003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:01.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.405+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f624c04ca40 con 0x7f62200b57f0 2026-02-20T13:17:01.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.406+0000 7f622bfff640 1 -- 10.20.193.28:0/4543568 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f624c04ca40 con 0x7f62200b57f0 2026-02-20T13:17:01.409 INFO:teuthology.orchestra.run.trial028.stdout:HOST ADDR LABELS STATUS 2026-02-20T13:17:01.409 INFO:teuthology.orchestra.run.trial028.stdout:trial028 10.20.193.28 2026-02-20T13:17:01.410 INFO:teuthology.orchestra.run.trial028.stdout:trial034 10.20.193.34 2026-02-20T13:17:01.410 INFO:teuthology.orchestra.run.trial028.stdout:trial127 10.20.193.127 2026-02-20T13:17:01.410 INFO:teuthology.orchestra.run.trial028.stdout:3 hosts in cluster 2026-02-20T13:17:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.407+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f62200b57f0 msgr2=0x7f62200d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.407+0000 7f624bfff640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f62200b57f0 0x7f62200d5ca0 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6240002d80 tx=0x7f624003a040 comp rx=0 tx=0).stop 2026-02-20T13:17:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.407+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c10c340 msgr2=0x7f624c0f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.407+0000 7f624bfff640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c10c340 0x7f624c0f5cd0 secure :-1 s=READY pgs=300 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f623c006e90 tx=0x7f623c00edf0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.408+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 shutdown_connections 2026-02-20T13:17:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.408+0000 7f624bfff640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f62200b57f0 0x7f62200d5ca0 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.408+0000 7f624bfff640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f624c10c340 0x7f624c0f5cd0 unknown :-1 s=CLOSED pgs=300 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.408+0000 7f624bfff640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f624c10b990 0x7f624c0f50d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.408+0000 7f624bfff640 1 --2- 10.20.193.28:0/4543568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f624c060730 0x7f624c0f4a80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.408+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 >> 10.20.193.28:0/4543568 conn(0x7f624c0e9050 msgr2=0x7f624c0ead00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:01.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.408+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 shutdown_connections 2026-02-20T13:17:01.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.408+0000 7f624bfff640 1 -- 10.20.193.28:0/4543568 wait complete. 2026-02-20T13:17:01.509 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-20T13:17:01.694 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:01.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:01 trial127 ceph-mon[43817]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:01.737 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:01 trial028 ceph-mon[37442]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:01.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:01 trial034 ceph-mon[43332]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:01.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.860+0000 7fe61cc1f640 1 -- 10.20.193.28:0/3207756679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110270 msgr2=0x7fe6181106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.860+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/3207756679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110270 0x7fe6181106e0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=16055583146769906236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe608009950 tx=0x7fe60802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:01.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.860+0000 7fe61cc1f640 1 -- 10.20.193.28:0/3207756679 shutdown_connections 2026-02-20T13:17:01.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.860+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/3207756679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110270 0x7fe6181106e0 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=16055583146769906236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.860+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/3207756679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe618110c20 0x7fe6181715b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.860+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/3207756679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe61810f0e0 0x7fe61810f4d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.860+0000 7fe61cc1f640 1 -- 10.20.193.28:0/3207756679 >> 10.20.193.28:0/3207756679 conn(0x7fe6180ec810 msgr2=0x7fe61810cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:01.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.860+0000 7fe61cc1f640 1 -- 10.20.193.28:0/3207756679 shutdown_connections 2026-02-20T13:17:01.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.861+0000 7fe61cc1f640 1 -- 10.20.193.28:0/3207756679 wait complete. 2026-02-20T13:17:01.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.861+0000 7fe61cc1f640 1 Processor -- start 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.861+0000 7fe61cc1f640 1 -- start start 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe61cc1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe61810f0e0 0x7fe6180f8790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe61cc1f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe618110270 0x7fe6181715b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe61cc1f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110c20 0x7fe6180f8ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe61cc1f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180f9be0 con 0x7fe618110c20 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe61cc1f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180f9d50 con 0x7fe618110270 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe61cc1f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180f9f10 con 0x7fe61810f0e0 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe6177fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe61810f0e0 0x7fe6180f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe616ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe618110270 0x7fe6181715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110c20 0x7fe6180f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:01.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110c20 0x7fe6180f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54846/0 (socket says 10.20.193.28:54846) 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 -- 10.20.193.28:0/364548089 learned_addr learned my addr 10.20.193.28:0/364548089 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 -- 10.20.193.28:0/364548089 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe61810f0e0 msgr2=0x7fe6180f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe61810f0e0 0x7fe6180f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 -- 10.20.193.28:0/364548089 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe618110270 msgr2=0x7fe6181715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe618110270 0x7fe6181715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 -- 10.20.193.28:0/364548089 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe608009570 con 0x7fe618110c20 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.862+0000 7fe617fff640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110c20 0x7fe6180f8ff0 secure :-1 s=READY pgs=302 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe60c006e90 tx=0x7fe60c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.863+0000 7fe614ff9640 1 -- 10.20.193.28:0/364548089 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe60c005500 con 0x7fe618110c20 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.863+0000 7fe614ff9640 1 -- 10.20.193.28:0/364548089 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe60c005e10 con 0x7fe618110c20 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.863+0000 7fe614ff9640 1 -- 10.20.193.28:0/364548089 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe60c003a90 con 0x7fe618110c20 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.863+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6180fa1f0 con 0x7fe618110c20 2026-02-20T13:17:01.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.863+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6180fa670 con 0x7fe618110c20 2026-02-20T13:17:01.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.864+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe618175620 con 0x7fe618110c20 2026-02-20T13:17:01.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.865+0000 7fe614ff9640 1 -- 10.20.193.28:0/364548089 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fe60c00c840 con 0x7fe618110c20 2026-02-20T13:17:01.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.867+0000 7fe614ff9640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5ec0b57f0 0x7fe5ec0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:01.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.867+0000 7fe614ff9640 1 -- 10.20.193.28:0/364548089 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fe60c0e7930 con 0x7fe618110c20 2026-02-20T13:17:01.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.867+0000 7fe6177fe640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5ec0b57f0 0x7fe5ec0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:01.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.867+0000 7fe6177fe640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5ec0b57f0 0x7fe5ec0d5ca0 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe604005e30 tx=0x7fe604005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:01.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.868+0000 7fe614ff9640 1 -- 10.20.193.28:0/364548089 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe60c0aa280 con 0x7fe618110c20 2026-02-20T13:17:01.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.984+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fe618174ce0 con 0x7fe5ec0b57f0 2026-02-20T13:17:01.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.986+0000 7fe614ff9640 1 -- 10.20.193.28:0/364548089 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+910 (secure 0 0 0) 0x7fe618174ce0 con 0x7fe5ec0b57f0 2026-02-20T13:17:01.989 INFO:teuthology.orchestra.run.trial028.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-20T13:17:01.989 INFO:teuthology.orchestra.run.trial028.stdout:trial028 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB50F4 1788G No 56s ago Has a FileSystem, LVM detected 2026-02-20T13:17:01.989 INFO:teuthology.orchestra.run.trial028.stdout:trial028 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB50DD 1788G No 56s ago Has a FileSystem, LVM detected 2026-02-20T13:17:01.989 INFO:teuthology.orchestra.run.trial028.stdout:trial034 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6B84 1788G No 56s ago Has a FileSystem, LVM detected 2026-02-20T13:17:01.989 INFO:teuthology.orchestra.run.trial028.stdout:trial034 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6C13 1788G No 56s ago Has a FileSystem, LVM detected 2026-02-20T13:17:01.990 INFO:teuthology.orchestra.run.trial028.stdout:trial127 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6BA9 1788G No 44s ago Has a FileSystem, LVM detected 2026-02-20T13:17:01.990 INFO:teuthology.orchestra.run.trial028.stdout:trial127 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6C17 1788G No 44s ago Has a FileSystem, LVM detected 2026-02-20T13:17:01.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5ec0b57f0 msgr2=0x7fe5ec0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5ec0b57f0 0x7fe5ec0d5ca0 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe604005e30 tx=0x7fe604005da0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110c20 msgr2=0x7fe6180f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:01.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110c20 0x7fe6180f8ff0 secure :-1 s=READY pgs=302 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe60c006e90 tx=0x7fe60c00edf0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 shutdown_connections 2026-02-20T13:17:01.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5ec0b57f0 0x7fe5ec0d5ca0 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe618110c20 0x7fe6180f8ff0 unknown :-1 s=CLOSED pgs=302 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe618110270 0x7fe6181715b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 --2- 10.20.193.28:0/364548089 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe61810f0e0 0x7fe6180f8790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:01.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 >> 10.20.193.28:0/364548089 conn(0x7fe6180ec810 msgr2=0x7fe6180eedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:01.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 shutdown_connections 2026-02-20T13:17:01.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:01.987+0000 7fe61cc1f640 1 -- 10.20.193.28:0/364548089 wait complete. 2026-02-20T13:17:02.086 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-20T13:17:02.101 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T13:17:02.101 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- bash -c 'ceph fs dump' 2026-02-20T13:17:02.285 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:02.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.463+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3959685751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 msgr2=0x7f7ccc10f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:02.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.463+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3959685751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 0x7f7ccc10f510 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=15175286091853568032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc0009980 tx=0x7f7cc002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:02.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.463+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3959685751 shutdown_connections 2026-02-20T13:17:02.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.463+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3959685751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 0x7f7ccc10f510 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=15175286091853568032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.463+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3959685751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7ccc10fa50 0x7f7ccc1717e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.463+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3959685751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7ccc110810 0x7f7ccc110c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.463+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3959685751 >> 10.20.193.28:0/3959685751 conn(0x7f7ccc0eca40 msgr2=0x7f7ccc10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:02.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.464+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3959685751 shutdown_connections 2026-02-20T13:17:02.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.464+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3959685751 wait complete. 2026-02-20T13:17:02.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.464+0000 7f7cd3f1d640 1 Processor -- start 2026-02-20T13:17:02.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.464+0000 7f7cd3f1d640 1 -- start start 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.464+0000 7f7cd3f1d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 0x7f7ccc0f9370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.464+0000 7f7cd3f1d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7ccc10fa50 0x7f7ccc1717c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.464+0000 7f7cd3f1d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7ccc110810 0x7f7ccc0f9bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd3f1d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0fa810 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd3f1d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0fa980 con 0x7f7ccc110810 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd3f1d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0fab40 con 0x7f7ccc10fa50 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 0x7f7ccc0f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 0x7f7ccc0f9370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54870/0 (socket says 10.20.193.28:54870) 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 -- 10.20.193.28:0/3024990886 learned_addr learned my addr 10.20.193.28:0/3024990886 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd2493640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7ccc110810 0x7f7ccc0f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1491640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7ccc10fa50 0x7f7ccc1717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 -- 10.20.193.28:0/3024990886 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7ccc10fa50 msgr2=0x7f7ccc1717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7ccc10fa50 0x7f7ccc1717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 -- 10.20.193.28:0/3024990886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7ccc110810 msgr2=0x7f7ccc0f9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7ccc110810 0x7f7ccc0f9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 -- 10.20.193.28:0/3024990886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc0009570 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1491640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7ccc10fa50 0x7f7ccc1717c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd2493640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7ccc110810 0x7f7ccc0f9bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd1c92640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 0x7f7ccc0f9370 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cbc00d950 tx=0x7f7cbc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cbaffd640 1 -- 10.20.193.28:0/3024990886 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cbc004540 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cbaffd640 1 -- 10.20.193.28:0/3024990886 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7cbc009d00 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cbaffd640 1 -- 10.20.193.28:0/3024990886 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cbc0106e0 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ccc0fae20 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.465+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ccc0fb340 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.466+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ccc175910 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.468+0000 7f7cbaffd640 1 -- 10.20.193.28:0/3024990886 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f7cbc0097c0 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.470+0000 7f7cbaffd640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ca80b57f0 0x7f7ca80d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:02.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.470+0000 7f7cbaffd640 1 -- 10.20.193.28:0/3024990886 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f7cbc0e7210 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.470+0000 7f7cbaffd640 1 -- 10.20.193.28:0/3024990886 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f7cbc0e7700 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.470+0000 7f7cd1491640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ca80b57f0 0x7f7ca80d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:02.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.471+0000 7f7cd1491640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ca80b57f0 0x7f7ca80d5ca0 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc00098a0 tx=0x7f7cc0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:02.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:02 trial028 ceph-mon[37442]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:02.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:02 trial028 ceph-mon[37442]: pgmap v170: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 8 op/s 2026-02-20T13:17:02.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:02 trial028 ceph-mon[37442]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:02.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.612+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7ccc110c00 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.612+0000 7f7cbaffd640 1 -- 10.20.193.28:0/3024990886 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3122 (secure 0 0 0) 0x7f7cbc0a9ba0 con 0x7f7ccc10f0a0 2026-02-20T13:17:02.616 INFO:teuthology.orchestra.run.trial028.stdout:e23 2026-02-20T13:17:02.616 INFO:teuthology.orchestra.run.trial028.stdout:btime 2026-02-20T13:16:40:073425+0000 2026-02-20T13:17:02.616 INFO:teuthology.orchestra.run.trial028.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-20T13:17:02.616 INFO:teuthology.orchestra.run.trial028.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T13:17:02.616 INFO:teuthology.orchestra.run.trial028.stdout:legacy client fscid: 1 2026-02-20T13:17:02.616 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:02.616 INFO:teuthology.orchestra.run.trial028.stdout:Filesystem 'cephfs' (1) 2026-02-20T13:17:02.616 INFO:teuthology.orchestra.run.trial028.stdout:fs_name cephfs 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:epoch 23 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:created 2026-02-20T13:16:33.380729+0000 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:modified 2026-02-20T13:16:40.073414+0000 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:tableserver 0 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:root 0 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:session_timeout 300 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:session_autoclose 300 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:max_file_size 1099511627776 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:max_xattr_size 65536 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:required_client_features {} 2026-02-20T13:17:02.617 INFO:teuthology.orchestra.run.trial028.stdout:last_failure 0 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:last_failure_osd_epoch 0 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:max_mds 5 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:in 0,1,2,3,4 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:up {0=24692,1=24677,2=24659,3=24655,4=24622} 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:failed 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:damaged 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:stopped 2026-02-20T13:17:02.618 INFO:teuthology.orchestra.run.trial028.stdout:data_pools [3] 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:metadata_pool 2 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:inline_data disabled 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:balancer 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:bal_rank_mask -1 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:standby_count_wanted 0 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:qdb_cluster leader: 24692 members: 24692,24677,24659,24655,24622 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:[mds.b{0:24692} state up:active seq 3 addr [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:[mds.c{0:24643} state up:standby-replay seq 1 addr [v2:10.20.193.127:6836/2801639412,v1:10.20.193.127:6837/2801639412] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:[mds.g{1:24677} state up:active seq 4 addr [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:[mds.e{1:24641} state up:standby-replay seq 1 addr [v2:10.20.193.34:6834/1117780356,v1:10.20.193.34:6835/1117780356] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:[mds.h{2:24659} state up:active seq 5 addr [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.619 INFO:teuthology.orchestra.run.trial028.stdout:[mds.f{2:24637} state up:standby-replay seq 1 addr [v2:10.20.193.127:6834/519312474,v1:10.20.193.127:6835/519312474] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout:[mds.i{3:24655} state up:active seq 5 addr [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout:[mds.d{3:24628} state up:standby-replay seq 1 addr [v2:10.20.193.28:6836/3921516269,v1:10.20.193.28:6837/3921516269] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout:[mds.j{4:24622} state up:active seq 6 addr [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout:[mds.k{4:24617} state up:standby-replay seq 1 addr [v2:10.20.193.34:6832/4255317184,v1:10.20.193.34:6833/4255317184] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout:Standby daemons: 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout:[mds.a{-1:14688} state up:standby seq 1 addr [v2:10.20.193.28:6840/12920569,v1:10.20.193.28:6841/12920569] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.620 INFO:teuthology.orchestra.run.trial028.stdout:[mds.l{-1:24604} state up:standby seq 1 addr [v2:10.20.193.127:6832/3591480373,v1:10.20.193.127:6833/3591480373] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T13:17:02.621 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-20T13:17:02.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ca80b57f0 msgr2=0x7f7ca80d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ca80b57f0 0x7f7ca80d5ca0 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc00098a0 tx=0x7f7cc0031040 comp rx=0 tx=0).stop 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 msgr2=0x7f7ccc0f9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 0x7f7ccc0f9370 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cbc00d950 tx=0x7f7cbc00de20 comp rx=0 tx=0).stop 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 shutdown_connections 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7ca80b57f0 0x7f7ca80d5ca0 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7ccc110810 0x7f7ccc0f9bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7ccc10fa50 0x7f7ccc1717c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 --2- 10.20.193.28:0/3024990886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ccc10f0a0 0x7f7ccc0f9370 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 >> 10.20.193.28:0/3024990886 conn(0x7f7ccc0eca40 msgr2=0x7f7ccc0ef990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.613+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 shutdown_connections 2026-02-20T13:17:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:02.614+0000 7f7cd3f1d640 1 -- 10.20.193.28:0/3024990886 wait complete. 2026-02-20T13:17:02.718 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- bash -c 'ceph osd dump' 2026-02-20T13:17:02.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:02 trial127 ceph-mon[43817]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:02.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:02 trial127 ceph-mon[43817]: pgmap v170: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 8 op/s 2026-02-20T13:17:02.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:02 trial127 ceph-mon[43817]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:02.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:02 trial034 ceph-mon[43332]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:02.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:02 trial034 ceph-mon[43332]: pgmap v170: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 8 op/s 2026-02-20T13:17:02.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:02 trial034 ceph-mon[43332]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:02.903 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:03.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 -- 10.20.193.28:0/60384534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 msgr2=0x7fa8901715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 --2- 10.20.193.28:0/60384534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 0x7fa8901715b0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=12073995798940886370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa88000aa30 tx=0x7fa880030270 comp rx=0 tx=0).stop 2026-02-20T13:17:03.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 -- 10.20.193.28:0/60384534 shutdown_connections 2026-02-20T13:17:03.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 --2- 10.20.193.28:0/60384534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 0x7fa8901715b0 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=12073995798940886370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 --2- 10.20.193.28:0/60384534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa890061590 0x7fa890061a00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 --2- 10.20.193.28:0/60384534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa890062ac0 0x7fa890061050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 -- 10.20.193.28:0/60384534 >> 10.20.193.28:0/60384534 conn(0x7fa8900ea7d0 msgr2=0x7fa89010abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:03.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 -- 10.20.193.28:0/60384534 shutdown_connections 2026-02-20T13:17:03.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.084+0000 7fa894e30640 1 -- 10.20.193.28:0/60384534 wait complete. 2026-02-20T13:17:03.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa894e30640 1 Processor -- start 2026-02-20T13:17:03.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa894e30640 1 -- start start 2026-02-20T13:17:03.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa894e30640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa890061590 0x7fa890165d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:03.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa894e30640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa890062ac0 0x7fa8901663d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:03.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa894e30640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 0x7fa890166fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:03.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa894e30640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa890167710 con 0x7fa890151130 2026-02-20T13:17:03.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa894e30640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa890167880 con 0x7fa890061590 2026-02-20T13:17:03.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa894e30640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa890167a40 con 0x7fa890062ac0 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa88ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 0x7fa890166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa88dd74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa890062ac0 0x7fa8901663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa88ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 0x7fa890166fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54892/0 (socket says 10.20.193.28:54892) 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa88ed76640 1 -- 10.20.193.28:0/3249275082 learned_addr learned my addr 10.20.193.28:0/3249275082 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.085+0000 7fa88e575640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa890061590 0x7fa890165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa88ed76640 1 -- 10.20.193.28:0/3249275082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa890062ac0 msgr2=0x7fa8901663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa88ed76640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa890062ac0 0x7fa8901663d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa88ed76640 1 -- 10.20.193.28:0/3249275082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa890061590 msgr2=0x7fa890165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa88ed76640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa890061590 0x7fa890165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa88ed76640 1 -- 10.20.193.28:0/3249275082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88000a650 con 0x7fa890151130 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa88e575640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa890061590 0x7fa890165d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa88dd74640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa890062ac0 0x7fa8901663d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa88ed76640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 0x7fa890166fd0 secure :-1 s=READY pgs=306 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa880003e00 tx=0x7fa8800039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa8777fe640 1 -- 10.20.193.28:0/3249275082 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa88003e070 con 0x7fa890151130 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa8777fe640 1 -- 10.20.193.28:0/3249275082 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa8800055a0 con 0x7fa890151130 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa8777fe640 1 -- 10.20.193.28:0/3249275082 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa880042a00 con 0x7fa890151130 2026-02-20T13:17:03.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa890167cc0 con 0x7fa890151130 2026-02-20T13:17:03.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.086+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89014cd70 con 0x7fa890151130 2026-02-20T13:17:03.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.087+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa890175950 con 0x7fa890151130 2026-02-20T13:17:03.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.089+0000 7fa8777fe640 1 -- 10.20.193.28:0/3249275082 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fa880049020 con 0x7fa890151130 2026-02-20T13:17:03.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.091+0000 7fa8777fe640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8680b57f0 0x7fa8680d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:03.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.091+0000 7fa8777fe640 1 -- 10.20.193.28:0/3249275082 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fa88010c640 con 0x7fa890151130 2026-02-20T13:17:03.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.091+0000 7fa8777fe640 1 -- 10.20.193.28:0/3249275082 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fa88010cac0 con 0x7fa890151130 2026-02-20T13:17:03.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.091+0000 7fa88e575640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8680b57f0 0x7fa8680d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:03.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.091+0000 7fa88e575640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8680b57f0 0x7fa8680d5ca0 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa884004740 tx=0x7fa884005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:03.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.209+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fa890061050 con 0x7fa890151130 2026-02-20T13:17:03.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.210+0000 7fa8777fe640 1 -- 10.20.193.28:0/3249275082 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v78) ==== 56+0+5062 (secure 0 0 0) 0x7fa8800cf0a0 con 0x7fa890151130 2026-02-20T13:17:03.213 INFO:teuthology.orchestra.run.trial028.stdout:epoch 78 2026-02-20T13:17:03.213 INFO:teuthology.orchestra.run.trial028.stdout:fsid dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:17:03.213 INFO:teuthology.orchestra.run.trial028.stdout:created 2026-02-20T13:13:12.477975+0000 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:modified 2026-02-20T13:16:34.769763+0000 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:crush_version 30 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:full_ratio 0.95 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:backfillfull_ratio 0.9 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:nearfull_ratio 0.85 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:require_min_compat_client luminous 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:min_compat_client jewel 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:require_osd_release tentacle 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:stretch_mode_enabled false 2026-02-20T13:17:03.214 INFO:teuthology.orchestra.run.trial028.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:max_osd 12 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.0 up in weight 1 up_from 9 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6802/3440519886,v1:10.20.193.28:6803/3440519886] [v2:10.20.193.28:6804/3440519886,v1:10.20.193.28:6805/3440519886] exists,up 9d65e9bc-8b4a-480c-b540-72a21130e6a0 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.1 up in weight 1 up_from 13 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.34:6800/1497190611,v1:10.20.193.34:6801/1497190611] [v2:10.20.193.34:6802/1497190611,v1:10.20.193.34:6803/1497190611] exists,up 21efdc9a-53aa-4a76-b2a0-90918eaf0262 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.2 up in weight 1 up_from 17 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.127:6800/3179400175,v1:10.20.193.127:6801/3179400175] [v2:10.20.193.127:6802/3179400175,v1:10.20.193.127:6803/3179400175] exists,up 04252b73-4bf2-46c0-b9fb-9b4187606781 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.3 up in weight 1 up_from 24 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6810/3411989985,v1:10.20.193.28:6811/3411989985] [v2:10.20.193.28:6812/3411989985,v1:10.20.193.28:6813/3411989985] exists,up 75c4c4b5-3018-42f7-a5ac-645bf321af19 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.4 up in weight 1 up_from 31 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.34:6808/3346390712,v1:10.20.193.34:6809/3346390712] [v2:10.20.193.34:6810/3346390712,v1:10.20.193.34:6811/3346390712] exists,up ccc69aa4-4352-4e39-aec0-41289a3d0d74 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.5 up in weight 1 up_from 35 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.127:6808/460724236,v1:10.20.193.127:6809/460724236] [v2:10.20.193.127:6810/460724236,v1:10.20.193.127:6811/460724236] exists,up 772d85ad-8132-408c-bded-4c43600e0648 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.6 up in weight 1 up_from 43 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6818/3124866379,v1:10.20.193.28:6819/3124866379] [v2:10.20.193.28:6820/3124866379,v1:10.20.193.28:6821/3124866379] exists,up 48076158-4886-4ca9-8eb0-d9f1adeb4b9a 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.7 up in weight 1 up_from 47 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.34:6816/646042575,v1:10.20.193.34:6817/646042575] [v2:10.20.193.34:6818/646042575,v1:10.20.193.34:6819/646042575] exists,up f995ac5e-8e5e-43ac-b394-5bae7a4bf16d 2026-02-20T13:17:03.215 INFO:teuthology.orchestra.run.trial028.stdout:osd.8 up in weight 1 up_from 54 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.127:6816/2418786729,v1:10.20.193.127:6817/2418786729] [v2:10.20.193.127:6818/2418786729,v1:10.20.193.127:6819/2418786729] exists,up 6d2e30d1-5c22-405d-9d9c-b3a986a18c64 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:osd.9 up in weight 1 up_from 62 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6826/1755797163,v1:10.20.193.28:6827/1755797163] [v2:10.20.193.28:6828/1755797163,v1:10.20.193.28:6829/1755797163] exists,up b57f8393-ae99-42fe-9e7a-74462092b493 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:osd.10 up in weight 1 up_from 66 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.34:6824/3326939746,v1:10.20.193.34:6825/3326939746] [v2:10.20.193.34:6826/3326939746,v1:10.20.193.34:6827/3326939746] exists,up 3cc473cd-99f0-483e-b827-c925c4627fb1 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:osd.11 up in weight 1 up_from 73 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:10.20.193.127:6824/2910856149,v1:10.20.193.127:6825/2910856149] [v2:10.20.193.127:6826/2910856149,v1:10.20.193.127:6827/2910856149] exists,up 872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6801/3613875849 expires 2026-02-21T13:13:37.304833+0000 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/701608793 expires 2026-02-21T13:13:37.304833+0000 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/1283600451 expires 2026-02-21T13:13:37.304833+0000 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/2163750178 expires 2026-02-21T13:13:37.304833+0000 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6801/2570534842 expires 2026-02-21T13:13:24.612016+0000 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6800/3613875849 expires 2026-02-21T13:13:37.304833+0000 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/2935390412 expires 2026-02-21T13:13:24.612016+0000 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6800/2570534842 expires 2026-02-21T13:13:24.612016+0000 2026-02-20T13:17:03.216 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/404382129 expires 2026-02-21T13:13:24.612016+0000 2026-02-20T13:17:03.217 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/91657074 expires 2026-02-21T13:13:24.612016+0000 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8680b57f0 msgr2=0x7fa8680d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8680b57f0 0x7fa8680d5ca0 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa884004740 tx=0x7fa884005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 msgr2=0x7fa890166fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 0x7fa890166fd0 secure :-1 s=READY pgs=306 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa880003e00 tx=0x7fa8800039b0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 shutdown_connections 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8680b57f0 0x7fa8680d5ca0 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa890151130 0x7fa890166fd0 unknown :-1 s=CLOSED pgs=306 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa890062ac0 0x7fa8901663d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 --2- 10.20.193.28:0/3249275082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa890061590 0x7fa890165d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 >> 10.20.193.28:0/3249275082 conn(0x7fa8900ea7d0 msgr2=0x7fa89010abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:03.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 shutdown_connections 2026-02-20T13:17:03.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.211+0000 7fa894e30640 1 -- 10.20.193.28:0/3249275082 wait complete. 2026-02-20T13:17:03.317 INFO:teuthology.run_tasks:Running task fs.ready... 2026-02-20T13:17:03.337 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:03.521 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:03.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:03 trial028 ceph-mon[37442]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:03.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:03 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3024990886' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-20T13:17:03.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:03 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3249275082' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-20T13:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 -- 10.20.193.28:0/4229565891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 msgr2=0x7f9fb410bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 --2- 10.20.193.28:0/4229565891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 0x7f9fb410bb80 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=3600619378010683241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa0009950 tx=0x7f9fa002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 -- 10.20.193.28:0/4229565891 shutdown_connections 2026-02-20T13:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 --2- 10.20.193.28:0/4229565891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fb41119a0 0x7f9fb4172370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 --2- 10.20.193.28:0/4229565891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fb410c1a0 0x7f9fb41111f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 --2- 10.20.193.28:0/4229565891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 0x7f9fb410bb80 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=3600619378010683241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 -- 10.20.193.28:0/4229565891 >> 10.20.193.28:0/4229565891 conn(0x7f9fb40e9080 msgr2=0x7f9fb4109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 -- 10.20.193.28:0/4229565891 shutdown_connections 2026-02-20T13:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.697+0000 7f9fb93b2640 1 -- 10.20.193.28:0/4229565891 wait complete. 2026-02-20T13:17:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb93b2640 1 Processor -- start 2026-02-20T13:17:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb93b2640 1 -- start start 2026-02-20T13:17:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb93b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 0x7f9fb40f4d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb93b2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fb410c1a0 0x7f9fb4172270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb93b2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fb41119a0 0x7f9fb40f5480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb93b2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40fa690 con 0x7f9fb410b7b0 2026-02-20T13:17:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb93b2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40fa800 con 0x7f9fb410c1a0 2026-02-20T13:17:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb93b2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40fa9c0 con 0x7f9fb41119a0 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 0x7f9fb40f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 0x7f9fb40f4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54914/0 (socket says 10.20.193.28:54914) 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb3fff640 1 -- 10.20.193.28:0/4163266738 learned_addr learned my addr 10.20.193.28:0/4163266738 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb37fe640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fb410c1a0 0x7f9fb4172270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb8bb1640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fb41119a0 0x7f9fb40f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb3fff640 1 -- 10.20.193.28:0/4163266738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fb41119a0 msgr2=0x7f9fb40f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb3fff640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fb41119a0 0x7f9fb40f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb3fff640 1 -- 10.20.193.28:0/4163266738 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fb410c1a0 msgr2=0x7f9fb4172270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.698+0000 7f9fb3fff640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fb410c1a0 0x7f9fb4172270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.699+0000 7f9fb3fff640 1 -- 10.20.193.28:0/4163266738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa0009570 con 0x7f9fb410b7b0 2026-02-20T13:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.699+0000 7f9fb8bb1640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fb41119a0 0x7f9fb40f5480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:03.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.699+0000 7f9fb3fff640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 0x7f9fb40f4d80 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa0004820 tx=0x7f9fa0005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:03.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.699+0000 7f9fb17fa640 1 -- 10.20.193.28:0/4163266738 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fa003d070 con 0x7f9fb410b7b0 2026-02-20T13:17:03.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.699+0000 7f9fb17fa640 1 -- 10.20.193.28:0/4163266738 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9fa0038e00 con 0x7f9fb410b7b0 2026-02-20T13:17:03.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.699+0000 7f9fb17fa640 1 -- 10.20.193.28:0/4163266738 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fa0041a90 con 0x7f9fb410b7b0 2026-02-20T13:17:03.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.699+0000 7f9fb93b2640 1 -- 10.20.193.28:0/4163266738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb40fac40 con 0x7f9fb410b7b0 2026-02-20T13:17:03.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.699+0000 7f9fb93b2640 1 -- 10.20.193.28:0/4163266738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb40fb100 con 0x7f9fb410b7b0 2026-02-20T13:17:03.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.700+0000 7f9f86ffd640 1 -- 10.20.193.28:0/4163266738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7c005300 con 0x7f9fb410b7b0 2026-02-20T13:17:03.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.702+0000 7f9fb17fa640 1 -- 10.20.193.28:0/4163266738 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f9fa002fc10 con 0x7f9fb410b7b0 2026-02-20T13:17:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.703+0000 7f9fb17fa640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f880b57f0 0x7f9f880d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.703+0000 7f9fb17fa640 1 -- 10.20.193.28:0/4163266738 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f9fa010b8b0 con 0x7f9fb410b7b0 2026-02-20T13:17:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.704+0000 7f9fb37fe640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f880b57f0 0x7f9f880d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.704+0000 7f9fb17fa640 1 -- 10.20.193.28:0/4163266738 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f9fa0144750 con 0x7f9fb410b7b0 2026-02-20T13:17:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.704+0000 7f9fb37fe640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f880b57f0 0x7f9f880d5ca0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb40fb720 tx=0x7f9fa4005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:03.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:03 trial127 ceph-mon[43817]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:03.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:03 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3024990886' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-20T13:17:03.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:03 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3249275082' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-20T13:17:03.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:03 trial034 ceph-mon[43332]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T13:17:03.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:03 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3024990886' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-20T13:17:03.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:03 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3249275082' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-20T13:17:03.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.845+0000 7f9f86ffd640 1 -- 10.20.193.28:0/4163266738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f7c005950 con 0x7f9fb410b7b0 2026-02-20T13:17:03.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.845+0000 7f9fb17fa640 1 -- 10.20.193.28:0/4163266738 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11996 (secure 0 0 0) 0x7f9fa00ce350 con 0x7f9fb410b7b0 2026-02-20T13:17:03.849 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:03.849 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-20T13:16:40:073425+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:16:40.073414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:17:03.850 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-20T13:17:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.846+0000 7f9f86ffd640 1 -- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f880b57f0 msgr2=0x7f9f880d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.846+0000 7f9f86ffd640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f880b57f0 0x7f9f880d5ca0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb40fb720 tx=0x7f9fa4005f70 comp rx=0 tx=0).stop 2026-02-20T13:17:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.846+0000 7f9f86ffd640 1 -- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 msgr2=0x7f9fb40f4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.846+0000 7f9f86ffd640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 0x7f9fb40f4d80 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa0004820 tx=0x7f9fa0005f10 comp rx=0 tx=0).stop 2026-02-20T13:17:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.847+0000 7f9f86ffd640 1 -- 10.20.193.28:0/4163266738 shutdown_connections 2026-02-20T13:17:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.847+0000 7f9f86ffd640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f880b57f0 0x7f9f880d5ca0 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.847+0000 7f9f86ffd640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9fb41119a0 0x7f9fb40f5480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.847+0000 7f9f86ffd640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9fb410c1a0 0x7f9fb4172270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.847+0000 7f9f86ffd640 1 --2- 10.20.193.28:0/4163266738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410b7b0 0x7f9fb40f4d80 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.847+0000 7f9f86ffd640 1 -- 10.20.193.28:0/4163266738 >> 10.20.193.28:0/4163266738 conn(0x7f9fb40e9080 msgr2=0x7f9fb4172e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.847+0000 7f9f86ffd640 1 -- 10.20.193.28:0/4163266738 shutdown_connections 2026-02-20T13:17:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:03.847+0000 7f9f86ffd640 1 -- 10.20.193.28:0/4163266738 wait complete. 2026-02-20T13:17:03.947 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:04.133 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:04.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 -- 10.20.193.28:0/577081390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe0115420 msgr2=0x7fdbe0175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:04.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 --2- 10.20.193.28:0/577081390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe0115420 0x7fdbe0175df0 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=13209633191785105500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbdc00aa30 tx=0x7fdbdc030270 comp rx=0 tx=0).stop 2026-02-20T13:17:04.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 -- 10.20.193.28:0/577081390 shutdown_connections 2026-02-20T13:17:04.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 --2- 10.20.193.28:0/577081390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe0115420 0x7fdbe0175df0 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=13209633191785105500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 --2- 10.20.193.28:0/577081390 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdbe010fc20 0x7fdbe0114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 --2- 10.20.193.28:0/577081390 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdbe010f230 0x7fdbe010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 -- 10.20.193.28:0/577081390 >> 10.20.193.28:0/577081390 conn(0x7fdbe005f830 msgr2=0x7fdbe010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:04.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 -- 10.20.193.28:0/577081390 shutdown_connections 2026-02-20T13:17:04.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.297+0000 7fdbe7f30640 1 -- 10.20.193.28:0/577081390 wait complete. 2026-02-20T13:17:04.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.298+0000 7fdbe7f30640 1 Processor -- start 2026-02-20T13:17:04.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.298+0000 7fdbe7f30640 1 -- start start 2026-02-20T13:17:04.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.298+0000 7fdbe7f30640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdbe010f230 0x7fdbe00f84d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:04.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.298+0000 7fdbe7f30640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe010fc20 0x7fdbe0175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:04.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.298+0000 7fdbe7f30640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdbe0115420 0x7fdbe00f4300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:04.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.298+0000 7fdbe7f30640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00f4a90 con 0x7fdbe010fc20 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.298+0000 7fdbe7f30640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00f4c00 con 0x7fdbe010f230 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.298+0000 7fdbe7f30640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00f4dc0 con 0x7fdbe0115420 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe010fc20 0x7fdbe0175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe010fc20 0x7fdbe0175cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54944/0 (socket says 10.20.193.28:54944) 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 -- 10.20.193.28:0/193436082 learned_addr learned my addr 10.20.193.28:0/193436082 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe5ca5640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdbe010f230 0x7fdbe00f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe64a6640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdbe0115420 0x7fdbe00f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 -- 10.20.193.28:0/193436082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdbe0115420 msgr2=0x7fdbe00f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdbe0115420 0x7fdbe00f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 -- 10.20.193.28:0/193436082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdbe010f230 msgr2=0x7fdbe00f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdbe010f230 0x7fdbe00f84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 -- 10.20.193.28:0/193436082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc00a650 con 0x7fdbe010fc20 2026-02-20T13:17:04.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe64a6640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdbe0115420 0x7fdbe00f4300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:04.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe54a4640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe010fc20 0x7fdbe0175cf0 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbd4009480 tx=0x7fdbd400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:04.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbceffd640 1 -- 10.20.193.28:0/193436082 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdbd400cd40 con 0x7fdbe010fc20 2026-02-20T13:17:04.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbceffd640 1 -- 10.20.193.28:0/193436082 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdbd4004d30 con 0x7fdbe010fc20 2026-02-20T13:17:04.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbceffd640 1 -- 10.20.193.28:0/193436082 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdbd4010740 con 0x7fdbe010fc20 2026-02-20T13:17:04.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe7f30640 1 -- 10.20.193.28:0/193436082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe00eeff0 con 0x7fdbe010fc20 2026-02-20T13:17:04.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.299+0000 7fdbe7f30640 1 -- 10.20.193.28:0/193436082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe00ef470 con 0x7fdbe010fc20 2026-02-20T13:17:04.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.300+0000 7fdbccff9640 1 -- 10.20.193.28:0/193436082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe00f4fe0 con 0x7fdbe010fc20 2026-02-20T13:17:04.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.302+0000 7fdbceffd640 1 -- 10.20.193.28:0/193436082 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fdbd401f060 con 0x7fdbe010fc20 2026-02-20T13:17:04.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.303+0000 7fdbceffd640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdbbc0b57f0 0x7fdbbc0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:04.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.303+0000 7fdbceffd640 1 -- 10.20.193.28:0/193436082 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fdbd4014070 con 0x7fdbe010fc20 2026-02-20T13:17:04.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.304+0000 7fdbe5ca5640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdbbc0b57f0 0x7fdbbc0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:04.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.304+0000 7fdbceffd640 1 -- 10.20.193.28:0/193436082 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fdbd40e7340 con 0x7fdbe010fc20 2026-02-20T13:17:04.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.304+0000 7fdbe5ca5640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdbbc0b57f0 0x7fdbbc0d5ca0 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbd0004740 tx=0x7fdbd0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:04.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.448+0000 7fdbccff9640 1 -- 10.20.193.28:0/193436082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbe0110510 con 0x7fdbe010fc20 2026-02-20T13:17:04.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.449+0000 7fdbceffd640 1 -- 10.20.193.28:0/193436082 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11996 (secure 0 0 0) 0x7fdbd40a99d0 con 0x7fdbe010fc20 2026-02-20T13:17:04.452 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:04.453 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-20T13:16:40:073425+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:16:40.073414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:17:04.453 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-20T13:17:04.453 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:04 trial028 ceph-mon[37442]: pgmap v171: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-20T13:17:04.453 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:04 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4163266738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:04.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 -- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdbbc0b57f0 msgr2=0x7fdbbc0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:04.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdbbc0b57f0 0x7fdbbc0d5ca0 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbd0004740 tx=0x7fdbd0005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:04.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 -- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe010fc20 msgr2=0x7fdbe0175cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe010fc20 0x7fdbe0175cf0 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbd4009480 tx=0x7fdbd400ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 -- 10.20.193.28:0/193436082 shutdown_connections 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdbbc0b57f0 0x7fdbbc0d5ca0 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdbe010fc20 0x7fdbe0175cf0 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdbe0115420 0x7fdbe00f4300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 --2- 10.20.193.28:0/193436082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdbe010f230 0x7fdbe00f84d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 -- 10.20.193.28:0/193436082 >> 10.20.193.28:0/193436082 conn(0x7fdbe005f830 msgr2=0x7fdbe010d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 -- 10.20.193.28:0/193436082 shutdown_connections 2026-02-20T13:17:04.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.450+0000 7fdbccff9640 1 -- 10.20.193.28:0/193436082 wait complete. 2026-02-20T13:17:04.553 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:17:04.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:04 trial127 ceph-mon[43817]: pgmap v171: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-20T13:17:04.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:04 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4163266738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:04.734 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:04.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:04 trial034 ceph-mon[43332]: pgmap v171: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-20T13:17:04.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:04 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4163266738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.913+0000 7f4f62f3d640 1 -- 10.20.193.28:0/1974805727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 msgr2=0x7f4f5c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.913+0000 7f4f62f3d640 1 --2- 10.20.193.28:0/1974805727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 0x7f4f5c10d610 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=681253791409888154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f4c009950 tx=0x7f4f4c02f190 comp rx=0 tx=0).stop 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.914+0000 7f4f62f3d640 1 -- 10.20.193.28:0/1974805727 shutdown_connections 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.914+0000 7f4f62f3d640 1 --2- 10.20.193.28:0/1974805727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4f5c113430 0x7f4f5c173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.914+0000 7f4f62f3d640 1 --2- 10.20.193.28:0/1974805727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f5c10dc30 0x7f4f5c112c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.914+0000 7f4f62f3d640 1 --2- 10.20.193.28:0/1974805727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 0x7f4f5c10d610 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=681253791409888154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.914+0000 7f4f62f3d640 1 -- 10.20.193.28:0/1974805727 >> 10.20.193.28:0/1974805727 conn(0x7f4f5c0eaad0 msgr2=0x7f4f5c10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.914+0000 7f4f62f3d640 1 -- 10.20.193.28:0/1974805727 shutdown_connections 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.914+0000 7f4f62f3d640 1 -- 10.20.193.28:0/1974805727 wait complete. 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.914+0000 7f4f62f3d640 1 Processor -- start 2026-02-20T13:17:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f62f3d640 1 -- start start 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f62f3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 0x7f4f5c0f57a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f62f3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4f5c10dc30 0x7f4f5c173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f62f3d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f5c113430 0x7f4f5c0f5ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f62f3d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c0fb0b0 con 0x7f4f5c10d240 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f62f3d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c0fb220 con 0x7f4f5c10dc30 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f62f3d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c0fb3e0 con 0x7f4f5c113430 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 0x7f4f5c0f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 0x7f4f5c0f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54956/0 (socket says 10.20.193.28:54956) 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 -- 10.20.193.28:0/1146726135 learned_addr learned my addr 10.20.193.28:0/1146726135 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f6273c640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f5c113430 0x7f4f5c0f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 -- 10.20.193.28:0/1146726135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f5c113430 msgr2=0x7f4f5c0f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f5c113430 0x7f4f5c0f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 -- 10.20.193.28:0/1146726135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4f5c10dc30 msgr2=0x7f4f5c173d00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4f5c10dc30 0x7f4f5c173d00 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 -- 10.20.193.28:0/1146726135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c009570 con 0x7f4f5c10d240 2026-02-20T13:17:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.915+0000 7f4f61f3b640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 0x7f4f5c0f57a0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f4c038820 tx=0x7f4f4c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.916+0000 7f4f4affd640 1 -- 10.20.193.28:0/1146726135 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f4c03d070 con 0x7f4f5c10d240 2026-02-20T13:17:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.916+0000 7f4f4affd640 1 -- 10.20.193.28:0/1146726135 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4f4c002ad0 con 0x7f4f5c10d240 2026-02-20T13:17:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.916+0000 7f4f4affd640 1 -- 10.20.193.28:0/1146726135 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f4c041960 con 0x7f4f5c10d240 2026-02-20T13:17:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.916+0000 7f4f62f3d640 1 -- 10.20.193.28:0/1146726135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c0fb660 con 0x7f4f5c10d240 2026-02-20T13:17:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.916+0000 7f4f62f3d640 1 -- 10.20.193.28:0/1146726135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5c0fba80 con 0x7f4f5c10d240 2026-02-20T13:17:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.916+0000 7f4f48ff9640 1 -- 10.20.193.28:0/1146726135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f5c10e520 con 0x7f4f5c10d240 2026-02-20T13:17:04.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.918+0000 7f4f4affd640 1 -- 10.20.193.28:0/1146726135 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f4f4c041af0 con 0x7f4f5c10d240 2026-02-20T13:17:04.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.920+0000 7f4f4affd640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4f380b57e0 0x7f4f380d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:04.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.920+0000 7f4f4affd640 1 -- 10.20.193.28:0/1146726135 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4f4c10b0b0 con 0x7f4f5c10d240 2026-02-20T13:17:04.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.920+0000 7f4f4affd640 1 -- 10.20.193.28:0/1146726135 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f4f4c10b5a0 con 0x7f4f5c10d240 2026-02-20T13:17:04.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.920+0000 7f4f6173a640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4f380b57e0 0x7f4f380d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:04.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:04.921+0000 7f4f6173a640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4f380b57e0 0x7f4f380d5c90 secure :-1 s=READY pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f5c0fc140 tx=0x7f4f50005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:05.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.034+0000 7f4f48ff9640 1 -- 10.20.193.28:0/1146726135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f5c0f6900 con 0x7f4f5c10d240 2026-02-20T13:17:05.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.035+0000 7f4f4affd640 1 -- 10.20.193.28:0/1146726135 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7f4f4c0cdb50 con 0x7f4f5c10d240 2026-02-20T13:17:05.038 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:05.038 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 -- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4f380b57e0 msgr2=0x7f4f380d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4f380b57e0 0x7f4f380d5c90 secure :-1 s=READY pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f5c0fc140 tx=0x7f4f50005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 -- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 msgr2=0x7f4f5c0f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 0x7f4f5c0f57a0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f4c038820 tx=0x7f4f4c004300 comp rx=0 tx=0).stop 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 -- 10.20.193.28:0/1146726135 shutdown_connections 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4f380b57e0 0x7f4f380d5c90 unknown :-1 s=CLOSED pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f5c113430 0x7f4f5c0f5ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4f5c10dc30 0x7f4f5c173d00 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 --2- 10.20.193.28:0/1146726135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f5c10d240 0x7f4f5c0f57a0 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 -- 10.20.193.28:0/1146726135 >> 10.20.193.28:0/1146726135 conn(0x7f4f5c0eaad0 msgr2=0x7f4f5c10f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 -- 10.20.193.28:0/1146726135 shutdown_connections 2026-02-20T13:17:05.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.036+0000 7f4f48ff9640 1 -- 10.20.193.28:0/1146726135 wait complete. 2026-02-20T13:17:05.172 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False, 'allow_referent_inodes': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-20T13:16:33.380729+0000', 'modified': '2026-02-20T13:16:40.073414+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24692, 'mds_1': 24677, 'mds_2': 24659, 'mds_3': 24655, 'mds_4': 24622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24617': {'gid': 24617, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.34:6833/4255317184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6832', 'nonce': 4255317184}, {'type': 'v1', 'addr': '10.20.193.34:6833', 'nonce': 4255317184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24622': {'gid': 24622, 'name': 'j', 'rank': 4, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '10.20.193.28:6835/2839011553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6834', 'nonce': 2839011553}, {'type': 'v1', 'addr': '10.20.193.28:6835', 'nonce': 2839011553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'd', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.28:6837/3921516269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6836', 'nonce': 3921516269}, {'type': 'v1', 'addr': '10.20.193.28:6837', 'nonce': 3921516269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.127:6835/519312474', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6834', 'nonce': 519312474}, {'type': 'v1', 'addr': '10.20.193.127:6835', 'nonce': 519312474}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24641': {'gid': 24641, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.34:6835/1117780356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6834', 'nonce': 1117780356}, {'type': 'v1', 'addr': '10.20.193.34:6835', 'nonce': 1117780356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.127:6837/2801639412', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6836', 'nonce': 2801639412}, {'type': 'v1', 'addr': '10.20.193.127:6837', 'nonce': 2801639412}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24655': {'gid': 24655, 'name': 'i', 'rank': 3, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.127:6839/3644236506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6838', 'nonce': 3644236506}, {'type': 'v1', 'addr': '10.20.193.127:6839', 'nonce': 3644236506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 2, 'incarnation': 17, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.34:6837/3360165301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6836', 'nonce': 3360165301}, {'type': 'v1', 'addr': '10.20.193.34:6837', 'nonce': 3360165301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24677': {'gid': 24677, 'name': 'g', 'rank': 1, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.28:6839/1527574900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6838', 'nonce': 1527574900}, {'type': 'v1', 'addr': '10.20.193.28:6839', 'nonce': 1527574900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24692': {'gid': 24692, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.34:6839/1838974969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6838', 'nonce': 1838974969}, {'type': 'v1', 'addr': '10.20.193.34:6839', 'nonce': 1838974969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24692, 'qdb_cluster': [24692, 24677, 24659, 24655, 24622]} 2026-02-20T13:17:05.172 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2026-02-20T13:17:05.173 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.j status 2026-02-20T13:17:05.357 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 -- 10.20.193.28:0/780844659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c840614f0 msgr2=0x7f1c84061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/780844659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c840614f0 0x7f1c84061920 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=3769375504168927671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c009950 tx=0x7f1c6c02f190 comp rx=0 tx=0).stop 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 -- 10.20.193.28:0/780844659 shutdown_connections 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/780844659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c84159af0 0x7f1c84179ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/780844659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c840614f0 0x7f1c84061920 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=3769375504168927671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/780844659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c84062ae0 0x7f1c84060fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 -- 10.20.193.28:0/780844659 >> 10.20.193.28:0/780844659 conn(0x7f1c8405f830 msgr2=0x7f1c8410ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 -- 10.20.193.28:0/780844659 shutdown_connections 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.529+0000 7f1c88b1f640 1 -- 10.20.193.28:0/780844659 wait complete. 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c88b1f640 1 Processor -- start 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c88b1f640 1 -- start start 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c88b1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c840614f0 0x7f1c840f2d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c88b1f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c84062ae0 0x7f1c840f3260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c88b1f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c84159af0 0x7f1c840f85e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c88b1f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c840f8c00 con 0x7f1c84062ae0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c88b1f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1c840f8d70 con 0x7f1c84159af0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c88b1f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1c840f8f30 con 0x7f1c840614f0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c81d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c84062ae0 0x7f1c840f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c82575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c840614f0 0x7f1c840f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c82575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c840614f0 0x7f1c840f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45234/0 (socket says 10.20.193.28:45234) 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c82575640 1 -- 10.20.193.28:0/3895290579 learned_addr learned my addr 10.20.193.28:0/3895290579 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c81d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c84062ae0 0x7f1c840f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54984/0 (socket says 10.20.193.28:54984) 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c82d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c84159af0 0x7f1c840f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c81d74640 1 -- 10.20.193.28:0/3895290579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c840614f0 msgr2=0x7f1c840f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c840614f0 0x7f1c840f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c81d74640 1 -- 10.20.193.28:0/3895290579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c84159af0 msgr2=0x7f1c840f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c84159af0 0x7f1c840f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.530+0000 7f1c81d74640 1 -- 10.20.193.28:0/3895290579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c009570 con 0x7f1c84062ae0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.531+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c84062ae0 0x7f1c840f3260 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c02f6a0 tx=0x7f1c6c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.531+0000 7f1c6b7fe640 1 -- 10.20.193.28:0/3895290579 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c03d070 con 0x7f1c84062ae0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.531+0000 7f1c88b1f640 1 -- 10.20.193.28:0/3895290579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c840f91b0 con 0x7f1c84062ae0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.531+0000 7f1c6b7fe640 1 -- 10.20.193.28:0/3895290579 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6c002ad0 con 0x7f1c84062ae0 2026-02-20T13:17:05.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.531+0000 7f1c6b7fe640 1 -- 10.20.193.28:0/3895290579 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c041820 con 0x7f1c84062ae0 2026-02-20T13:17:05.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.531+0000 7f1c88b1f640 1 -- 10.20.193.28:0/3895290579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c840f98f0 con 0x7f1c84062ae0 2026-02-20T13:17:05.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.533+0000 7f1c6b7fe640 1 -- 10.20.193.28:0/3895290579 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f1c6c02f9f0 con 0x7f1c84062ae0 2026-02-20T13:17:05.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.535+0000 7f1c6b7fe640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c5c0b57f0 0x7f1c5c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.535+0000 7f1c6b7fe640 1 -- 10.20.193.28:0/3895290579 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f1c6c10af90 con 0x7f1c84062ae0 2026-02-20T13:17:05.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.535+0000 7f1c82575640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c5c0b57f0 0x7f1c5c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.536+0000 7f1c82575640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c5c0b57f0 0x7f1c5c0d5ca0 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c780095d0 tx=0x7f1c78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.536+0000 7f1c8ab19e00 1 Processor -- start 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.536+0000 7f1c8ab19e00 1 -- start start 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b9a4280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b9a47c0 0x560a9b9c4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560a9b7f1370 con 0x560a9b95f210 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560a9b875710 con 0x560a9b95fb20 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560a9b871440 con 0x560a9b9a47c0 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c82575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b9a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b9a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44644/0 (socket says 10.20.193.28:44644) 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 -- 10.20.193.28:0/3667291830 learned_addr learned my addr 10.20.193.28:0/3667291830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:05.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b9a47c0 0x560a9b9c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 -- 10.20.193.28:0/3667291830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b9a47c0 msgr2=0x560a9b9c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b9a47c0 0x560a9b9c4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 -- 10.20.193.28:0/3667291830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 msgr2=0x560a9b95f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 -- 10.20.193.28:0/3667291830 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a9b816cf0 con 0x560a9b95fb20 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c82575640 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95f5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b9a4280 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=8439350669978128182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c0ce6c0 tx=0x7f1c6c038e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751e98b883004f36 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c68ff9640 1 -- 10.20.193.28:0/3667291830 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c0d0e30 con 0x560a9b95fb20 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c68ff9640 1 -- 10.20.193.28:0/3667291830 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6c0d0c50 con 0x560a9b95fb20 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.537+0000 7f1c68ff9640 1 -- 10.20.193.28:0/3667291830 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c0dc050 con 0x560a9b95fb20 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3667291830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 msgr2=0x560a9b9a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b9a4280 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=8439350669978128182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c0ce6c0 tx=0x7f1c6c038e90 comp rx=0 tx=0).stop 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3667291830 shutdown_connections 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b9a47c0 0x560a9b9c4ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b9a4280 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=8439350669978128182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3667291830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95f5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3667291830 >> 10.20.193.28:0/3667291830 conn(0x560a9b87e450 msgr2=0x560a9b95daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3667291830 shutdown_connections 2026-02-20T13:17:05.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.538+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3667291830 wait complete. 2026-02-20T13:17:05.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.539+0000 7f1c8ab19e00 1 -- start start 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.539+0000 7f1c8ab19e00 1 Processor -- start 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95fb20 0x560a9b977bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b97cc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560a9b529610 con 0x560a9b95fb20 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560a9b97d1c0 con 0x560a9b9a47c0 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560a9b97d380 con 0x560a9b95f210 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b97cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b97cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44648/0 (socket says 10.20.193.28:44648) 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 -- 10.20.193.28:0/3127344338 learned_addr learned my addr 10.20.193.28:0/3127344338 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95fb20 0x560a9b977bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82575640 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 -- 10.20.193.28:0/3127344338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 msgr2=0x560a9b977680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 -- 10.20.193.28:0/3127344338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95fb20 msgr2=0x560a9b977bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95fb20 0x560a9b977bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 -- 10.20.193.28:0/3127344338 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c840f98f0 con 0x560a9b9a47c0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b97cc50 secure :-1 s=READY pgs=116 gs=3 cs=0 l=1 c_cookie=15518836146921558321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c74003c60 tx=0x7f1c7400aab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d75dfb40d8c05131 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c33fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c33fff640 1 -- 10.20.193.28:0/3127344338 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c74018070 con 0x560a9b9a47c0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c33fff640 1 -- 10.20.193.28:0/3127344338 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c74011d40 con 0x560a9b9a47c0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c33fff640 1 -- 10.20.193.28:0/3127344338 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c740103c0 con 0x560a9b9a47c0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.540+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c78009de0 con 0x560a9b9a47c0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 10 client.25163 _ll_register_callbacks cb 0x560a9b7f4a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a9b501600 con 0x560a9b9a47c0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c33fff640 1 -- 10.20.193.28:0/3127344338 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f1c74011860 con 0x560a9b9a47c0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c33fff640 1 -- 10.20.193.28:0/3127344338 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1c74011a60 con 0x560a9b9a47c0 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 10 client.25163 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:05.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=23}) -- 0x560a9b7ef2c0 con 0x560a9b9a47c0 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c33fff640 1 -- 10.20.193.28:0/3127344338 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f1c74027020 con 0x560a9b9a47c0 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 10 client.25163 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 10 client.25163 resolve_mds: resolved name 'j' to daemon mds.j 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 20 client.25163 populate_metadata read hostname 'trial028' 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560a9b9a2c70 0x560a9b9a4000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 4 client.25163 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.541+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a9b83e0a0 con 0x560a9b9a2c70 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.542+0000 7f1c82575640 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560a9b9a2c70 0x560a9b9a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.542+0000 7f1c82575640 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560a9b9a2c70 0x560a9b9a4000 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=7994233170071487052 s_cookie=8784855087898495105 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6ef138b681c1824c server_cookie=79ea132885790881 in_seq=0 out_seq=0 2026-02-20T13:17:05.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.542+0000 7f1c33fff640 10 client.25163 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:05.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c33fff640 1 -- 10.20.193.28:0/3127344338 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560a9b83e0a0 con 0x560a9b9a2c70 2026-02-20T13:17:05.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c33fff640 10 client.25163 handle_command_reply: tid=0 2026-02-20T13:17:05.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 client.25163 shutdown 2026-02-20T13:17:05.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 msgr2=0x560a9b97cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b97cc50 secure :-1 s=READY pgs=116 gs=3 cs=0 l=1 c_cookie=15518836146921558321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c74003c60 tx=0x7f1c7400aab0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 shutdown_connections 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560a9b9a2c70 0x560a9b9a4000 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=7994233170071487052 s_cookie=8784855087898495105 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95fb20 0x560a9b977bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b97cc50 unknown :-1 s=CLOSED pgs=116 gs=3 cs=0 l=1 c_cookie=15518836146921558321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3127344338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c33fff640 0 client.25163 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 >> 10.20.193.28:0/3127344338 conn(0x560a9b87e450 msgr2=0x560a9b95e200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 shutdown_connections 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3127344338 wait complete. 2026-02-20T13:17:05.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.543+0000 7f1c8ab19e00 20 client.25163 trim_cache size 0 max 16384 2026-02-20T13:17:05.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c8ab19e00 1 Processor -- start 2026-02-20T13:17:05.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c8ab19e00 1 -- start start 2026-02-20T13:17:05.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95fb20 0x560a9b95e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b9a1920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560a9b86b5a0 con 0x560a9b95f210 2026-02-20T13:17:05.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560a9b8691d0 con 0x560a9b9a47c0 2026-02-20T13:17:05.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560a9b9a04b0 con 0x560a9b95fb20 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95e400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55004/0 (socket says 10.20.193.28:55004) 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82575640 1 -- 10.20.193.28:0/3572292939 learned_addr learned my addr 10.20.193.28:0/3572292939 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b9a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82575640 1 -- 10.20.193.28:0/3572292939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95fb20 msgr2=0x560a9b95e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95fb20 0x560a9b95e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82575640 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95fb20 0x560a9b95e940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82575640 1 -- 10.20.193.28:0/3572292939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 msgr2=0x560a9b9a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82575640 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b9a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.553+0000 7f1c82575640 1 -- 10.20.193.28:0/3572292939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a9b8010c0 con 0x560a9b95f210 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b9a1920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95fb20 0x560a9b95e940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c82575640 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95e400 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=4567371154714326141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560a9b9a30e0 tx=0x7f1c78014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f628fddc21cf47d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c4e4e6640 1 -- 10.20.193.28:0/3572292939 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c78021040 con 0x560a9b95f210 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c4e4e6640 1 -- 10.20.193.28:0/3572292939 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c7802a180 con 0x560a9b95f210 2026-02-20T13:17:05.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c4e4e6640 1 -- 10.20.193.28:0/3572292939 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c78026b10 con 0x560a9b95f210 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3572292939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 msgr2=0x560a9b95e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95e400 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=4567371154714326141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560a9b9a30e0 tx=0x7f1c78014000 comp rx=0 tx=0).stop 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3572292939 shutdown_connections 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b9a47c0 0x560a9b9a1920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95fb20 0x560a9b95e940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3572292939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b95f210 0x560a9b95e400 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=4567371154714326141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.554+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3572292939 >> 10.20.193.28:0/3572292939 conn(0x560a9b87e450 msgr2=0x560a9b961f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3572292939 shutdown_connections 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3572292939 wait complete. 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 -- start start 2026-02-20T13:17:05.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 Processor -- start 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b97dd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b9a47c0 0x560a9b97e250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560a9b96f140 con 0x560a9b9a47c0 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560a9b9a27d0 con 0x560a9b95fb20 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.555+0000 7f1c8ab19e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560a9b97ea00 con 0x560a9b95f210 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45266/0 (socket says 10.20.193.28:45266) 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82575640 1 -- 10.20.193.28:0/3895658499 learned_addr learned my addr 10.20.193.28:0/3895658499 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b9a47c0 0x560a9b97e250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c81d74640 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b97dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82d76640 1 -- 10.20.193.28:0/3895658499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 msgr2=0x560a9b977a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82d76640 1 -- 10.20.193.28:0/3895658499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 msgr2=0x560a9b97dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b97dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82d76640 1 -- 10.20.193.28:0/3895658499 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a9b7fbb40 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c82d76640 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b9a47c0 0x560a9b97e250 secure :-1 s=READY pgs=315 gs=2 cs=0 l=1 c_cookie=14137364541655296275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7401c7a0 tx=0x7f1c74006fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4320225cd912913 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c33fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c33fff640 1 -- 10.20.193.28:0/3895658499 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c74018070 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c33fff640 1 -- 10.20.193.28:0/3895658499 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560a9b501600 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c33fff640 1 -- 10.20.193.28:0/3895658499 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c7400db70 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.556+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c78003c80 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 10 client.15189 _ll_register_callbacks cb 0x560a9b7f62f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c6c0d0c50 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c33fff640 1 -- 10.20.193.28:0/3895658499 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f1c74025050 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c33fff640 1 -- 10.20.193.28:0/3895658499 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1c7400dd00 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 10 client.15189 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x560a9b7ef5f0 con 0x560a9b9a47c0 2026-02-20T13:17:05.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c33fff640 1 -- 10.20.193.28:0/3895658499 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f1c7401cc80 con 0x560a9b9a47c0 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 10 client.15189 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 10 client.15189 resolve_mds: resolved name 'j' to daemon mds.j 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 20 client.15189 populate_metadata read hostname 'trial028' 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560a9ba56870 0x560a9ba55580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 4 client.15189 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "status"}) -- 0x560a9b4fee50 con 0x560a9ba56870 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.557+0000 7f1c82575640 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560a9ba56870 0x560a9ba55580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c82575640 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560a9ba56870 0x560a9ba55580 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=7637995270006312711 s_cookie=5487252529280632889 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=69ff9c3af0d70f07 server_cookie=4c26a31a48a2c839 in_seq=0 out_seq=0 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c33fff640 10 client.15189 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c33fff640 1 -- 10.20.193.28:0/3895658499 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1223 (crc 0 0 0) 0x560a9b4fee50 con 0x560a9ba56870 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c33fff640 10 client.15189 handle_command_reply: tid=0 2026-02-20T13:17:05.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 client.15189 shutdown 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b9a47c0 msgr2=0x560a9b97e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b9a47c0 0x560a9b97e250 secure :-1 s=READY pgs=315 gs=2 cs=0 l=1 c_cookie=14137364541655296275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7401c7a0 tx=0x7f1c74006fb0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 shutdown_connections 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560a9ba56870 0x560a9ba55580 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=7637995270006312711 s_cookie=5487252529280632889 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560a9b9a47c0 0x560a9b97e250 unknown :-1 s=CLOSED pgs=315 gs=2 cs=0 l=1 c_cookie=14137364541655296275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560a9b95fb20 0x560a9b97dd10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 --2- 10.20.193.28:0/3895658499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560a9b95f210 0x560a9b977a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 >> 10.20.193.28:0/3895658499 conn(0x560a9b87e450 msgr2=0x560a9b9a1920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c33fff640 0 client.15189 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 shutdown_connections 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.558+0000 7f1c8ab19e00 1 -- 10.20.193.28:0/3895658499 wait complete. 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c8ab19e00 20 client.15189 trim_cache size 0 max 16384 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 4, 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24622, 2026-02-20T13:17:05.561 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 26.489213315000001, 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 45.326686508000002, 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial028", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448336", 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 -- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c5c0b57f0 msgr2=0x7f1c5c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c5c0b57f0 0x7f1c5c0d5ca0 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c780095d0 tx=0x7f1c78005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 -- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c84062ae0 msgr2=0x7f1c840f3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c84062ae0 0x7f1c840f3260 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c02f6a0 tx=0x7f1c6c004290 comp rx=0 tx=0).stop 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 -- 10.20.193.28:0/3895290579 shutdown_connections 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c5c0b57f0 0x7f1c5c0d5ca0 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c84062ae0 0x7f1c840f3260 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c84159af0 0x7f1c840f85e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 --2- 10.20.193.28:0/3895290579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c840614f0 0x7f1c840f2d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:05.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 -- 10.20.193.28:0/3895290579 >> 10.20.193.28:0/3895290579 conn(0x7f1c8405f830 msgr2=0x7f1c8410f920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:05.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 -- 10.20.193.28:0/3895290579 shutdown_connections 2026-02-20T13:17:05.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:05.559+0000 7f1c88b1f640 1 -- 10.20.193.28:0/3895290579 wait complete. 2026-02-20T13:17:05.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:05 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/193436082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:05.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:05 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1146726135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:05.661 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.i status 2026-02-20T13:17:05.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:05 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/193436082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:05.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:05 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1146726135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:05.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:05 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/193436082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:05.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:05 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1146726135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:05.845 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:06.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 -- 10.20.193.28:0/2725917487 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea7410fc20 msgr2=0x7fea74114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/2725917487 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea7410fc20 0x7fea74114c70 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=15369393074310942074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea68009950 tx=0x7fea6802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:06.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 -- 10.20.193.28:0/2725917487 shutdown_connections 2026-02-20T13:17:06.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/2725917487 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea74115420 0x7fea74175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/2725917487 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea7410fc20 0x7fea74114c70 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=15369393074310942074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/2725917487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea7410f230 0x7fea7410f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 -- 10.20.193.28:0/2725917487 >> 10.20.193.28:0/2725917487 conn(0x7fea7405f830 msgr2=0x7fea7410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 -- 10.20.193.28:0/2725917487 shutdown_connections 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.018+0000 7fea7bc3f640 1 -- 10.20.193.28:0/2725917487 wait complete. 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7bc3f640 1 Processor -- start 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7bc3f640 1 -- start start 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7bc3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea7410f230 0x7fea740f5510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7bc3f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea7410fc20 0x7fea74175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7bc3f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea74115420 0x7fea740f5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7bc3f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea740fae20 con 0x7fea7410f230 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7bc3f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fea740faf90 con 0x7fea74115420 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7bc3f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fea740fb150 con 0x7fea7410fc20 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea799b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea7410f230 0x7fea740f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea799b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea7410f230 0x7fea740f5510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55024/0 (socket says 10.20.193.28:55024) 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea799b4640 1 -- 10.20.193.28:0/3510792880 learned_addr learned my addr 10.20.193.28:0/3510792880 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea791b3640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea7410fc20 0x7fea74175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.019+0000 7fea7a1b5640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea74115420 0x7fea740f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea799b4640 1 -- 10.20.193.28:0/3510792880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea7410fc20 msgr2=0x7fea74175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea799b4640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea7410fc20 0x7fea74175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea799b4640 1 -- 10.20.193.28:0/3510792880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea74115420 msgr2=0x7fea740f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea799b4640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea74115420 0x7fea740f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea799b4640 1 -- 10.20.193.28:0/3510792880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea640094b0 con 0x7fea7410f230 2026-02-20T13:17:06.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea799b4640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea7410f230 0x7fea740f5510 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea64009fd0 tx=0x7fea64002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea62ffd640 1 -- 10.20.193.28:0/3510792880 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea6400ed60 con 0x7fea7410f230 2026-02-20T13:17:06.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea7bc3f640 1 -- 10.20.193.28:0/3510792880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7000a590 con 0x7fea7410f230 2026-02-20T13:17:06.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea7bc3f640 1 -- 10.20.193.28:0/3510792880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea68009570 con 0x7fea7410f230 2026-02-20T13:17:06.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea62ffd640 1 -- 10.20.193.28:0/3510792880 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fea64002e20 con 0x7fea7410f230 2026-02-20T13:17:06.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.020+0000 7fea62ffd640 1 -- 10.20.193.28:0/3510792880 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea64018920 con 0x7fea7410f230 2026-02-20T13:17:06.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.023+0000 7fea62ffd640 1 -- 10.20.193.28:0/3510792880 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fea64016020 con 0x7fea7410f230 2026-02-20T13:17:06.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.024+0000 7fea62ffd640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fea500b5760 0x7fea500d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.024+0000 7fea62ffd640 1 -- 10.20.193.28:0/3510792880 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fea640e6dc0 con 0x7fea7410f230 2026-02-20T13:17:06.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.025+0000 7fea791b3640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fea500b5760 0x7fea500d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.025+0000 7fea791b3640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fea500b5760 0x7fea500d5c10 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea740fbeb0 tx=0x7fea6803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7dc39e00 1 Processor -- start 2026-02-20T13:17:06.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7dc39e00 1 -- start start 2026-02-20T13:17:06.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c8045e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c849280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 0x55d79c869ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d79c696370 con 0x55d79c804b20 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d79c71a710 con 0x55d79c804210 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d79c716440 con 0x55d79c8497c0 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea799b4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c8045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea791b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c849280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea799b4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c8045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44712/0 (socket says 10.20.193.28:44712) 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea799b4640 1 -- 10.20.193.28:0/1891447551 learned_addr learned my addr 10.20.193.28:0/1891447551 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.026+0000 7fea7a1b5640 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 0x55d79c869ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea799b4640 1 -- 10.20.193.28:0/1891447551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 msgr2=0x55d79c869ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea799b4640 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 0x55d79c869ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea799b4640 1 -- 10.20.193.28:0/1891447551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 msgr2=0x55d79c849280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea799b4640 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c849280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea799b4640 1 -- 10.20.193.28:0/1891447551 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79c6bbcf0 con 0x55d79c804210 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea791b3640 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c849280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea799b4640 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c8045e0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=5400437141234731396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea640e4930 tx=0x7fea640a9880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4af234f79b1f4984 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea424e6640 1 -- 10.20.193.28:0/1891447551 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea640b2e20 con 0x55d79c804210 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea424e6640 1 -- 10.20.193.28:0/1891447551 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fea640b5400 con 0x55d79c804210 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.027+0000 7fea424e6640 1 -- 10.20.193.28:0/1891447551 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea640add90 con 0x55d79c804210 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 -- 10.20.193.28:0/1891447551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 msgr2=0x55d79c8045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c8045e0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=5400437141234731396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea640e4930 tx=0x7fea640a9880 comp rx=0 tx=0).stop 2026-02-20T13:17:06.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 -- 10.20.193.28:0/1891447551 shutdown_connections 2026-02-20T13:17:06.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c849280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 0x55d79c869ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/1891447551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c8045e0 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=5400437141234731396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 -- 10.20.193.28:0/1891447551 >> 10.20.193.28:0/1891447551 conn(0x55d79c723450 msgr2=0x55d79c802af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 -- 10.20.193.28:0/1891447551 shutdown_connections 2026-02-20T13:17:06.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.028+0000 7fea7dc39e00 1 -- 10.20.193.28:0/1891447551 wait complete. 2026-02-20T13:17:06.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.029+0000 7fea7dc39e00 1 -- start start 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea7dc39e00 1 Processor -- start 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c81c830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c81cd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 0x55d79c821d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d79c3ce610 con 0x55d79c804b20 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d79c8222d0 con 0x55d79c804210 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d79c822490 con 0x55d79c8497c0 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea799b4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c81c830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea799b4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c81c830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44728/0 (socket says 10.20.193.28:44728) 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea799b4640 1 -- 10.20.193.28:0/4078338357 learned_addr learned my addr 10.20.193.28:0/4078338357 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea791b3640 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c81cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea7a1b5640 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 0x55d79c821d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea799b4640 1 -- 10.20.193.28:0/4078338357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 msgr2=0x55d79c821d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea799b4640 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 0x55d79c821d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea799b4640 1 -- 10.20.193.28:0/4078338357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 msgr2=0x55d79c81cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea799b4640 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c81cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea799b4640 1 -- 10.20.193.28:0/4078338357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea68009570 con 0x55d79c804210 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.030+0000 7fea791b3640 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c81cd70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea799b4640 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c81c830 secure :-1 s=READY pgs=119 gs=2 cs=0 l=1 c_cookie=2780929845392769625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea640e48b0 tx=0x7fea640e4d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2697d8f5dbeb0259 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea2f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea2f7fe640 1 -- 10.20.193.28:0/4078338357 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea6400e7d0 con 0x55d79c804210 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea2f7fe640 1 -- 10.20.193.28:0/4078338357 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fea640b8240 con 0x55d79c804210 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea2f7fe640 1 -- 10.20.193.28:0/4078338357 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea640ab0e0 con 0x55d79c804210 2026-02-20T13:17:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea74176660 con 0x55d79c804210 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea2f7fe640 1 -- 10.20.193.28:0/4078338357 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fea640ab270 con 0x55d79c804210 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea2f7fe640 10 client.25181 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea7dc39e00 10 client.25181 _ll_register_callbacks cb 0x55d79c699a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d79c3a6600 con 0x55d79c804210 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea2f7fe640 1 -- 10.20.193.28:0/4078338357 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fea640b2e20 con 0x55d79c804210 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea7dc39e00 10 client.25181 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.031+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55d79c6942c0 con 0x55d79c804210 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea2f7fe640 1 -- 10.20.193.28:0/4078338357 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7fea640add90 con 0x55d79c804210 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea7dc39e00 10 client.25181 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea7dc39e00 10 client.25181 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea7dc39e00 20 client.25181 populate_metadata read hostname 'trial028' 2026-02-20T13:17:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d79c8471c0 0x55d79c848c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea7dc39e00 4 client.25181 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d79c6e30a0 con 0x55d79c8471c0 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea791b3640 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d79c8471c0 0x55d79c848c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea791b3640 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d79c8471c0 0x55d79c848c50 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=2279513340461807179 s_cookie=7815594341317951538 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1fa2754e46fd764b server_cookie=6c7691a506cf4032 in_seq=0 out_seq=0 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.032+0000 7fea2f7fe640 10 client.25181 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea2f7fe640 1 -- 10.20.193.28:0/4078338357 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d79c6e30a0 con 0x55d79c8471c0 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea2f7fe640 10 client.25181 handle_command_reply: tid=0 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 client.25181 shutdown 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 msgr2=0x55d79c81c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c81c830 secure :-1 s=READY pgs=119 gs=2 cs=0 l=1 c_cookie=2780929845392769625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea640e48b0 tx=0x7fea640e4d40 comp rx=0 tx=0).stop 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 shutdown_connections 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d79c8471c0 0x55d79c848c50 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=2279513340461807179 s_cookie=7815594341317951538 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c81cd70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c8497c0 0x55d79c821d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/4078338357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c804210 0x55d79c81c830 unknown :-1 s=CLOSED pgs=119 gs=2 cs=0 l=1 c_cookie=2780929845392769625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea2f7fe640 0 client.25181 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 >> 10.20.193.28:0/4078338357 conn(0x55d79c723450 msgr2=0x55d79c803200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 shutdown_connections 2026-02-20T13:17:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.033+0000 7fea7dc39e00 1 -- 10.20.193.28:0/4078338357 wait complete. 2026-02-20T13:17:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.034+0000 7fea7dc39e00 20 client.25181 trim_cache size 0 max 16384 2026-02-20T13:17:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7dc39e00 1 Processor -- start 2026-02-20T13:17:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7dc39e00 1 -- start start 2026-02-20T13:17:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804210 0x55d79c821c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804b20 0x55d79c8070a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8075e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d79c7105a0 con 0x55d79c804210 2026-02-20T13:17:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d79c70e1d0 con 0x55d79c8497c0 2026-02-20T13:17:06.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d79c773b90 con 0x55d79c804b20 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea791b3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804b20 0x55d79c8070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea799b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804210 0x55d79c821c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7a1b5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7a1b5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44730/0 (socket says 10.20.193.28:44730) 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea7a1b5640 1 -- 10.20.193.28:0/2612424317 learned_addr learned my addr 10.20.193.28:0/2612424317 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.043+0000 7fea799b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804210 0x55d79c821c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55048/0 (socket says 10.20.193.28:55048) 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7a1b5640 1 -- 10.20.193.28:0/2612424317 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804b20 msgr2=0x55d79c8070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7a1b5640 1 --2- 10.20.193.28:0/2612424317 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804b20 0x55d79c8070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7a1b5640 1 -- 10.20.193.28:0/2612424317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804210 msgr2=0x55d79c821c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7a1b5640 1 --2- 10.20.193.28:0/2612424317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804210 0x55d79c821c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7a1b5640 1 -- 10.20.193.28:0/2612424317 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79c6a60c0 con 0x55d79c8497c0 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea799b4640 1 --2- 10.20.193.28:0/2612424317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804210 0x55d79c821c40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7a1b5640 1 --2- 10.20.193.28:0/2612424317 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8075e0 secure :-1 s=READY pgs=120 gs=3 cs=0 l=1 c_cookie=803032488303203011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea7000a910 tx=0x7fea7000ade0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b24f1cb206912c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea41ce5640 1 -- 10.20.193.28:0/2612424317 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea70024440 con 0x55d79c8497c0 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea41ce5640 1 -- 10.20.193.28:0/2612424317 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fea7001e040 con 0x55d79c8497c0 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea41ce5640 1 -- 10.20.193.28:0/2612424317 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea70018850 con 0x55d79c8497c0 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7dc39e00 1 -- 10.20.193.28:0/2612424317 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 msgr2=0x55d79c8075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/2612424317 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8075e0 secure :-1 s=READY pgs=120 gs=3 cs=0 l=1 c_cookie=803032488303203011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea7000a910 tx=0x7fea7000ade0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7dc39e00 1 -- 10.20.193.28:0/2612424317 shutdown_connections 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/2612424317 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8075e0 unknown :-1 s=CLOSED pgs=120 gs=3 cs=0 l=1 c_cookie=803032488303203011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/2612424317 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804b20 0x55d79c8070a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/2612424317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804210 0x55d79c821c40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7dc39e00 1 -- 10.20.193.28:0/2612424317 >> 10.20.193.28:0/2612424317 conn(0x55d79c723450 msgr2=0x55d79c8465c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.044+0000 7fea7dc39e00 1 -- 10.20.193.28:0/2612424317 shutdown_connections 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 -- 10.20.193.28:0/2612424317 wait complete. 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 -- start start 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 Processor -- start 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804210 0x55d79c820440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c841180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8416c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d79c8142d0 con 0x55d79c804b20 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d79c845150 con 0x55d79c8497c0 2026-02-20T13:17:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.045+0000 7fea7dc39e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d79c841d80 con 0x55d79c804210 2026-02-20T13:17:06.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c841180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea7a1b5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c841180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55054/0 (socket says 10.20.193.28:55054) 2026-02-20T13:17:06.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 -- 10.20.193.28:0/3151834619 learned_addr learned my addr 10.20.193.28:0/3151834619 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 -- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804210 msgr2=0x55d79c820440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea799b4640 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804210 0x55d79c820440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804210 0x55d79c820440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 -- 10.20.193.28:0/3151834619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 msgr2=0x55d79c8416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 -- 10.20.193.28:0/3151834619 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea70005520 con 0x55d79c804b20 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea7a1b5640 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8416c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea799b4640 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804210 0x55d79c820440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea791b3640 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c841180 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=5395337671626215111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea680098a0 tx=0x7fea68009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae01706d0904ec7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea2f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea2f7fe640 1 -- 10.20.193.28:0/3151834619 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea68057040 con 0x55d79c804b20 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79c6942c0 con 0x55d79c804b20 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea7dc39e00 10 client.15207 _ll_register_callbacks cb 0x55d79c699a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.046+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d79c4683b0 con 0x55d79c804b20 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea2f7fe640 1 -- 10.20.193.28:0/3151834619 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fea6803e040 con 0x55d79c804b20 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea2f7fe640 1 -- 10.20.193.28:0/3151834619 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea68052890 con 0x55d79c804b20 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea2f7fe640 1 -- 10.20.193.28:0/3151834619 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fea68052a20 con 0x55d79c804b20 2026-02-20T13:17:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea2f7fe640 1 -- 10.20.193.28:0/3151834619 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fea68052c20 con 0x55d79c804b20 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea7dc39e00 10 client.15207 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55d79c6a0b40 con 0x55d79c804b20 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea2f7fe640 1 -- 10.20.193.28:0/3151834619 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7fea6804f040 con 0x55d79c804b20 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea7dc39e00 10 client.15207 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea7dc39e00 10 client.15207 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea7dc39e00 20 client.15207 populate_metadata read hostname 'trial028' 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d79c86e630 0x55d79c86d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea7dc39e00 4 client.15207 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "status"}) -- 0x7fea640b5400 con 0x55d79c86e630 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.047+0000 7fea799b4640 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d79c86e630 0x55d79c86d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.048+0000 7fea799b4640 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d79c86e630 0x55d79c86d340 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=6844771608135317132 s_cookie=1949797180515319317 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5efd83832f95b68c server_cookie=1b0f123488ac7e15 in_seq=0 out_seq=0 2026-02-20T13:17:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.048+0000 7fea2f7fe640 10 client.15207 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.048+0000 7fea2f7fe640 1 -- 10.20.193.28:0/3151834619 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x7fea640b5400 con 0x55d79c86e630 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.048+0000 7fea2f7fe640 10 client.15207 handle_command_reply: tid=0 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.048+0000 7fea7dc39e00 1 client.15207 shutdown 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.048+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 msgr2=0x55d79c841180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.048+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c841180 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=5395337671626215111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea680098a0 tx=0x7fea68009310 comp rx=0 tx=0).stop 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 shutdown_connections 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d79c86e630 0x55d79c86d340 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=6844771608135317132 s_cookie=1949797180515319317 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79c804b20 0x55d79c841180 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=5395337671626215111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d79c8497c0 0x55d79c8416c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 1 --2- 10.20.193.28:0/3151834619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d79c804210 0x55d79c820440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 >> 10.20.193.28:0/3151834619 conn(0x55d79c723450 msgr2=0x55d79c8070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea2f7fe640 0 client.15207 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:06.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 shutdown_connections 2026-02-20T13:17:06.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 1 -- 10.20.193.28:0/3151834619 wait complete. 2026-02-20T13:17:06.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7dc39e00 20 client.15207 trim_cache size 0 max 16384 2026-02-20T13:17:06.058 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:06.058 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:06.058 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 3, 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24655, 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 27.249861366000001, 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 41.020531327999997, 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:06.059 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial127", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial127", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:06.060 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438940", 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 -- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fea500b5760 msgr2=0x7fea500d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fea500b5760 0x7fea500d5c10 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea740fbeb0 tx=0x7fea6803a040 comp rx=0 tx=0).stop 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 -- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea7410f230 msgr2=0x7fea740f5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea7410f230 0x7fea740f5510 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea64009fd0 tx=0x7fea64002bc0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 -- 10.20.193.28:0/3510792880 shutdown_connections 2026-02-20T13:17:06.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fea500b5760 0x7fea500d5c10 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fea74115420 0x7fea740f5c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea7410fc20 0x7fea74175cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 --2- 10.20.193.28:0/3510792880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea7410f230 0x7fea740f5510 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 -- 10.20.193.28:0/3510792880 >> 10.20.193.28:0/3510792880 conn(0x7fea7405f830 msgr2=0x7fea7410d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 -- 10.20.193.28:0/3510792880 shutdown_connections 2026-02-20T13:17:06.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.049+0000 7fea7bc3f640 1 -- 10.20.193.28:0/3510792880 wait complete. 2026-02-20T13:17:06.149 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.h status 2026-02-20T13:17:06.333 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:06.465 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:06 trial028 ceph-mon[37442]: pgmap v172: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:17:06.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c83fff640 1 -- 10.20.193.28:0/3048422764 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c900396f0 con 0x7f6c94111160 2026-02-20T13:17:06.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 -- 10.20.193.28:0/3048422764 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c94111160 msgr2=0x7f6c94111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3048422764 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c94111160 0x7f6c94111b40 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=8002431025416270714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9000aa30 tx=0x7f6c90030270 comp rx=0 tx=0).stop 2026-02-20T13:17:06.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 -- 10.20.193.28:0/3048422764 shutdown_connections 2026-02-20T13:17:06.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3048422764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c9410bb40 0x7f6c941109d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3048422764 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c94111160 0x7f6c94111b40 unknown :-1 s=CLOSED pgs=121 gs=1 cs=0 l=1 c_cookie=8002431025416270714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3048422764 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c9410b150 0x7f6c9410b520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 -- 10.20.193.28:0/3048422764 >> 10.20.193.28:0/3048422764 conn(0x7f6c940e8ce0 msgr2=0x7f6c941090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 -- 10.20.193.28:0/3048422764 shutdown_connections 2026-02-20T13:17:06.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.509+0000 7f6c9a729640 1 -- 10.20.193.28:0/3048422764 wait complete. 2026-02-20T13:17:06.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.510+0000 7f6c9a729640 1 Processor -- start 2026-02-20T13:17:06.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.510+0000 7f6c9a729640 1 -- start start 2026-02-20T13:17:06.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c9a729640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c9410b150 0x7f6c940fa660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c9a729640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c9410bb40 0x7f6c940faba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c9a729640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c94111160 0x7f6c940ff510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c9a729640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940ffae0 con 0x7f6c9410bb40 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c9a729640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940ffc50 con 0x7f6c94111160 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c9a729640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940ffe10 con 0x7f6c9410b150 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c99727640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c9410b150 0x7f6c940fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c98f26640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c9410bb40 0x7f6c940faba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c98f26640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c9410bb40 0x7f6c940faba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55082/0 (socket says 10.20.193.28:55082) 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c98f26640 1 -- 10.20.193.28:0/3102714240 learned_addr learned my addr 10.20.193.28:0/3102714240 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c99f28640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c94111160 0x7f6c940ff510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c98f26640 1 -- 10.20.193.28:0/3102714240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c9410b150 msgr2=0x7f6c940fa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c98f26640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c9410b150 0x7f6c940fa660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c98f26640 1 -- 10.20.193.28:0/3102714240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c94111160 msgr2=0x7f6c940ff510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c98f26640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c94111160 0x7f6c940ff510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.511+0000 7f6c98f26640 1 -- 10.20.193.28:0/3102714240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c880094b0 con 0x7f6c9410bb40 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.512+0000 7f6c98f26640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c9410bb40 0x7f6c940faba0 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c88002770 tx=0x7f6c88002c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.512+0000 7f6c827fc640 1 -- 10.20.193.28:0/3102714240 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c88002ea0 con 0x7f6c9410bb40 2026-02-20T13:17:06.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.512+0000 7f6c9a729640 1 -- 10.20.193.28:0/3102714240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9000a650 con 0x7f6c9410bb40 2026-02-20T13:17:06.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.512+0000 7f6c9a729640 1 -- 10.20.193.28:0/3102714240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c94100480 con 0x7f6c9410bb40 2026-02-20T13:17:06.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.512+0000 7f6c827fc640 1 -- 10.20.193.28:0/3102714240 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c8800ed60 con 0x7f6c9410bb40 2026-02-20T13:17:06.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.512+0000 7f6c827fc640 1 -- 10.20.193.28:0/3102714240 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c88018950 con 0x7f6c9410bb40 2026-02-20T13:17:06.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.515+0000 7f6c827fc640 1 -- 10.20.193.28:0/3102714240 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f6c88016020 con 0x7f6c9410bb40 2026-02-20T13:17:06.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.517+0000 7f6c827fc640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c700b57f0 0x7f6c700d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.517+0000 7f6c827fc640 1 -- 10.20.193.28:0/3102714240 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6c880e6df0 con 0x7f6c9410bb40 2026-02-20T13:17:06.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.517+0000 7f6c99727640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c700b57f0 0x7f6c700d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.517+0000 7f6c99727640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c700b57f0 0x7f6c700d5ca0 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c84004740 tx=0x7f6c84005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.518+0000 7f6c9d9ace00 1 Processor -- start 2026-02-20T13:17:06.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.518+0000 7f6c9d9ace00 1 -- start start 2026-02-20T13:17:06.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5193ba5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193bab20 0x55e5193ff280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193ff7c0 0x55e51941fba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e51924c370 con 0x55e5193ff7c0 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e5192d0710 con 0x55e5193ba210 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e5192cc440 con 0x55e5193bab20 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99f28640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193ff7c0 0x55e51941fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c98f26640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193bab20 0x55e5193ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c98f26640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193bab20 0x55e5193ff280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45376/0 (socket says 10.20.193.28:45376) 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c98f26640 1 -- 10.20.193.28:0/4087531717 learned_addr learned my addr 10.20.193.28:0/4087531717 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99727640 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5193ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99f28640 1 -- 10.20.193.28:0/4087531717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193bab20 msgr2=0x55e5193ff280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99f28640 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193bab20 0x55e5193ff280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99f28640 1 -- 10.20.193.28:0/4087531717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 msgr2=0x55e5193ba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99f28640 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5193ba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99f28640 1 -- 10.20.193.28:0/4087531717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e519271cf0 con 0x55e5193ff7c0 2026-02-20T13:17:06.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99727640 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5193ba5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:06.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.519+0000 7f6c99f28640 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193ff7c0 0x55e51941fba0 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=9423058352192057952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9000aa30 tx=0x7f6c90006a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c56da5542f7260 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c61ce5640 1 -- 10.20.193.28:0/4087531717 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9003e040 con 0x55e5193ff7c0 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c61ce5640 1 -- 10.20.193.28:0/4087531717 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c90030ad0 con 0x55e5193ff7c0 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c61ce5640 1 -- 10.20.193.28:0/4087531717 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c90039d90 con 0x55e5193ff7c0 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/4087531717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193ff7c0 msgr2=0x55e51941fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193ff7c0 0x55e51941fba0 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=9423058352192057952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9000aa30 tx=0x7f6c90006a20 comp rx=0 tx=0).stop 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/4087531717 shutdown_connections 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193ff7c0 0x55e51941fba0 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=9423058352192057952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193bab20 0x55e5193ff280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/4087531717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5193ba5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/4087531717 >> 10.20.193.28:0/4087531717 conn(0x55e5192d9450 msgr2=0x55e5193b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/4087531717 shutdown_connections 2026-02-20T13:17:06.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.520+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/4087531717 wait complete. 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.521+0000 7f6c9d9ace00 1 -- start start 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.521+0000 7f6c9d9ace00 1 Processor -- start 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5194172a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194177e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ff7c0 0x55e51941c870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e518f84610 con 0x55e5193bab20 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e51941cde0 con 0x55e5193ba210 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e51941cfa0 con 0x55e5193ff7c0 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99f28640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ff7c0 0x55e51941c870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99f28640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ff7c0 0x55e51941c870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45388/0 (socket says 10.20.193.28:45388) 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99f28640 1 -- 10.20.193.28:0/3687154530 learned_addr learned my addr 10.20.193.28:0/3687154530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99727640 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5194172a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c98f26640 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194177e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99f28640 1 -- 10.20.193.28:0/3687154530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 msgr2=0x55e5194172a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99f28640 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5194172a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99f28640 1 -- 10.20.193.28:0/3687154530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 msgr2=0x55e5194177e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99f28640 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194177e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c99f28640 1 -- 10.20.193.28:0/3687154530 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51924a2c0 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.522+0000 7f6c98f26640 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194177e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c99f28640 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ff7c0 0x55e51941c870 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=7364609575965782615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9000a230 tx=0x7f6c90039660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66345963d4e17257 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c4effd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c4effd640 1 -- 10.20.193.28:0/3687154530 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9003e040 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c94112400 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c4effd640 1 -- 10.20.193.28:0/3687154530 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c900050c0 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c9d9ace00 10 client.25153 _ll_register_callbacks cb 0x55e51924fa90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e518f5c600 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c4effd640 1 -- 10.20.193.28:0/3687154530 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9003e040 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.523+0000 7f6c4effd640 1 -- 10.20.193.28:0/3687154530 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6c90005230 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c4effd640 1 -- 10.20.193.28:0/3687154530 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6c90005430 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c9d9ace00 10 client.25153 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55e51925c0c0 con 0x55e5193ff7c0 2026-02-20T13:17:06.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c4effd640 1 -- 10.20.193.28:0/3687154530 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f6c90003780 con 0x55e5193ff7c0 2026-02-20T13:17:06.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c9d9ace00 10 client.25153 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:06.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c9d9ace00 10 client.25153 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T13:17:06.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c9d9ace00 20 client.25153 populate_metadata read hostname 'trial028' 2026-02-20T13:17:06.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e5193fd5f0 0x55e5193fea60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c9d9ace00 4 client.25153 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:06.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5192990a0 con 0x55e5193fd5f0 2026-02-20T13:17:06.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.524+0000 7f6c99727640 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e5193fd5f0 0x55e5193fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.525+0000 7f6c99727640 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e5193fd5f0 0x55e5193fea60 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=3044797132372371004 s_cookie=4195526247861006392 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2a414adc202ee63c server_cookie=3a3980e4c1953038 in_seq=0 out_seq=0 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.525+0000 7f6c4effd640 10 client.25153 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.525+0000 7f6c4effd640 1 -- 10.20.193.28:0/3687154530 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e5192990a0 con 0x55e5193fd5f0 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.525+0000 7f6c4effd640 10 client.25153 handle_command_reply: tid=0 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 client.25153 shutdown 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ff7c0 msgr2=0x55e51941c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ff7c0 0x55e51941c870 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=7364609575965782615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9000a230 tx=0x7f6c90039660 comp rx=0 tx=0).stop 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 shutdown_connections 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e5193fd5f0 0x55e5193fea60 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=3044797132372371004 s_cookie=4195526247861006392 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194177e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ff7c0 0x55e51941c870 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=7364609575965782615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/3687154530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ba210 0x55e5194172a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c4effd640 0 client.25153 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:06.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 >> 10.20.193.28:0/3687154530 conn(0x55e5192d9450 msgr2=0x55e5193b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 shutdown_connections 2026-02-20T13:17:06.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/3687154530 wait complete. 2026-02-20T13:17:06.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.526+0000 7f6c9d9ace00 20 client.25153 trim_cache size 0 max 16384 2026-02-20T13:17:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.535+0000 7f6c9d9ace00 1 Processor -- start 2026-02-20T13:17:06.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.535+0000 7f6c9d9ace00 1 -- start start 2026-02-20T13:17:06.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 0x55e519401ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194020e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e519417040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e5192c65a0 con 0x55e5193bab20 2026-02-20T13:17:06.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e5192c41d0 con 0x55e5193ff7c0 2026-02-20T13:17:06.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e519329b90 con 0x55e5193ba210 2026-02-20T13:17:06.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c99727640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 0x55e519401ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c99f28640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e519417040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55108/0 (socket says 10.20.193.28:55108) 2026-02-20T13:17:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 -- 10.20.193.28:0/2817214575 learned_addr learned my addr 10.20.193.28:0/2817214575 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 -- 10.20.193.28:0/2817214575 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 msgr2=0x55e519401ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 --2- 10.20.193.28:0/2817214575 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 0x55e519401ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 -- 10.20.193.28:0/2817214575 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 msgr2=0x55e519417040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 --2- 10.20.193.28:0/2817214575 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e519417040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 -- 10.20.193.28:0/2817214575 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e519256b40 con 0x55e5193bab20 2026-02-20T13:17:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c98f26640 1 --2- 10.20.193.28:0/2817214575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194020e0 secure :-1 s=READY pgs=320 gs=2 cs=0 l=1 c_cookie=1098836555906591404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c880a96c0 tx=0x7f6c880ad2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fda069506aaac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c614e4640 1 -- 10.20.193.28:0/2817214575 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c880b2e10 con 0x55e5193bab20 2026-02-20T13:17:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c614e4640 1 -- 10.20.193.28:0/2817214575 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c880b53f0 con 0x55e5193bab20 2026-02-20T13:17:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.536+0000 7f6c614e4640 1 -- 10.20.193.28:0/2817214575 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c880b8020 con 0x55e5193bab20 2026-02-20T13:17:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/2817214575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 msgr2=0x55e5194020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/2817214575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194020e0 secure :-1 s=READY pgs=320 gs=2 cs=0 l=1 c_cookie=1098836555906591404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c880a96c0 tx=0x7f6c880ad2a0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/2817214575 shutdown_connections 2026-02-20T13:17:06.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/2817214575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5194020e0 unknown :-1 s=CLOSED pgs=320 gs=2 cs=0 l=1 c_cookie=1098836555906591404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/2817214575 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e519417040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/2817214575 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 0x55e519401ba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/2817214575 >> 10.20.193.28:0/2817214575 conn(0x55e5192d9450 msgr2=0x55e5193fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/2817214575 shutdown_connections 2026-02-20T13:17:06.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/2817214575 wait complete. 2026-02-20T13:17:06.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.537+0000 7f6c9d9ace00 1 -- start start 2026-02-20T13:17:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c9d9ace00 1 Processor -- start 2026-02-20T13:17:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 0x55e5193b9710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5193b9c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c9d9ace00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e51941ffb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e5194206b0 con 0x55e5193bab20 2026-02-20T13:17:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e519420820 con 0x55e5193ff7c0 2026-02-20T13:17:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c9d9ace00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e5194209e0 con 0x55e5193ba210 2026-02-20T13:17:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c99f28640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e51941ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c99f28640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e51941ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44800/0 (socket says 10.20.193.28:44800) 2026-02-20T13:17:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c99f28640 1 -- 10.20.193.28:0/743418788 learned_addr learned my addr 10.20.193.28:0/743418788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c99727640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 0x55e5193b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.538+0000 7f6c98f26640 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5193b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c99f28640 1 -- 10.20.193.28:0/743418788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 msgr2=0x55e5193b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c99f28640 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 0x55e5193b9710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c99f28640 1 -- 10.20.193.28:0/743418788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 msgr2=0x55e5193b9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c99f28640 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5193b9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c99f28640 1 -- 10.20.193.28:0/743418788 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51924a5f0 con 0x55e5193ff7c0 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c99f28640 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e51941ffb0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=2162885934510439950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9005df60 tx=0x7f6c90057000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e041d4c482efe0e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c4effd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c4effd640 1 -- 10.20.193.28:0/743418788 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9003e040 con 0x55e5193ff7c0 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c94100480 con 0x55e5193ff7c0 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c9d9ace00 10 client.25202 _ll_register_callbacks cb 0x55e5192512f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c90030ad0 con 0x55e5193ff7c0 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c4effd640 1 -- 10.20.193.28:0/743418788 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c90030ad0 con 0x55e5193ff7c0 2026-02-20T13:17:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c4effd640 1 -- 10.20.193.28:0/743418788 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9004bea0 con 0x55e5193ff7c0 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c4effd640 1 -- 10.20.193.28:0/743418788 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6c90054410 con 0x55e5193ff7c0 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c4effd640 1 -- 10.20.193.28:0/743418788 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6c900383d0 con 0x55e5193ff7c0 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c9d9ace00 10 client.25202 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.539+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55e51925c320 con 0x55e5193ff7c0 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.540+0000 7f6c4effd640 1 -- 10.20.193.28:0/743418788 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f6c90003780 con 0x55e5193ff7c0 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.540+0000 7f6c9d9ace00 10 client.25202 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.540+0000 7f6c9d9ace00 10 client.25202 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.540+0000 7f6c9d9ace00 20 client.25202 populate_metadata read hostname 'trial028' 2026-02-20T13:17:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.540+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e5194b1300 0x55e5194b0010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.540+0000 7f6c9d9ace00 4 client.25202 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.540+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "status"}) -- 0x55e518f59e50 con 0x55e5194b1300 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.540+0000 7f6c99727640 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e5194b1300 0x55e5194b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c99727640 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e5194b1300 0x55e5194b0010 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=777581970803033769 s_cookie=5720425575103619372 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aca86aec17686a9 server_cookie=4f6308c0a01c612c in_seq=0 out_seq=0 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c4effd640 10 client.25202 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c4effd640 1 -- 10.20.193.28:0/743418788 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x55e518f59e50 con 0x55e5194b1300 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c4effd640 10 client.25202 handle_command_reply: tid=0 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 client.25202 shutdown 2026-02-20T13:17:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 msgr2=0x55e51941ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e51941ffb0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=2162885934510439950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9005df60 tx=0x7f6c90057000 comp rx=0 tx=0).stop 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 shutdown_connections 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e5194b1300 0x55e5194b0010 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=777581970803033769 s_cookie=5720425575103619372 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5193bab20 0x55e5193b9c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e5193ff7c0 0x55e51941ffb0 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=2162885934510439950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 --2- 10.20.193.28:0/743418788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e5193ba210 0x55e5193b9710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c4effd640 0 client.25202 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 >> 10.20.193.28:0/743418788 conn(0x55e5192d9450 msgr2=0x55e519401ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 shutdown_connections 2026-02-20T13:17:06.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 1 -- 10.20.193.28:0/743418788 wait complete. 2026-02-20T13:17:06.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.541+0000 7f6c9d9ace00 20 client.25202 trim_cache size 0 max 16384 2026-02-20T13:17:06.556 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:06.556 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:06.557 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 2, 2026-02-20T13:17:06.557 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24659, 2026-02-20T13:17:06.557 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:06.557 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:06.557 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:06.557 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 28.749590091000002, 2026-02-20T13:17:06.557 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:17:06.557 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 42.224715611000001, 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial034", 2026-02-20T13:17:06.558 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial034", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:06.559 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438948", 2026-02-20T13:17:06.560 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:06.560 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:06.560 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:06.560 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 -- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c700b57f0 msgr2=0x7f6c700d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c700b57f0 0x7f6c700d5ca0 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c84004740 tx=0x7f6c84005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 -- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c9410bb40 msgr2=0x7f6c940faba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c9410bb40 0x7f6c940faba0 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c88002770 tx=0x7f6c88002c40 comp rx=0 tx=0).stop 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 -- 10.20.193.28:0/3102714240 shutdown_connections 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c700b57f0 0x7f6c700d5ca0 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c9410bb40 0x7f6c940faba0 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c94111160 0x7f6c940ff510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 --2- 10.20.193.28:0/3102714240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c9410b150 0x7f6c940fa660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:06.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.542+0000 7f6c9a729640 1 -- 10.20.193.28:0/3102714240 >> 10.20.193.28:0/3102714240 conn(0x7f6c940e8ce0 msgr2=0x7f6c9410efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:06.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.543+0000 7f6c9a729640 1 -- 10.20.193.28:0/3102714240 shutdown_connections 2026-02-20T13:17:06.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:06.543+0000 7f6c9a729640 1 -- 10.20.193.28:0/3102714240 wait complete. 2026-02-20T13:17:06.646 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.g status 2026-02-20T13:17:06.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:06 trial127 ceph-mon[43817]: pgmap v172: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:17:06.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:06 trial034 ceph-mon[43332]: pgmap v172: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:17:06.829 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 -- 10.20.193.28:0/3712707678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c10f670 msgr2=0x7f5a5c10fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3712707678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c10f670 0x7f5a5c10fa40 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=16738056220217060517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a48009950 tx=0x7f5a4802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 -- 10.20.193.28:0/3712707678 shutdown_connections 2026-02-20T13:17:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3712707678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a5c115860 0x7f5a5c176230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3712707678 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a5c110060 0x7f5a5c1150b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3712707678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c10f670 0x7f5a5c10fa40 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=16738056220217060517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 -- 10.20.193.28:0/3712707678 >> 10.20.193.28:0/3712707678 conn(0x7f5a5c0ecf20 msgr2=0x7f5a5c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 -- 10.20.193.28:0/3712707678 shutdown_connections 2026-02-20T13:17:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.014+0000 7f5a6285d640 1 -- 10.20.193.28:0/3712707678 wait complete. 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.015+0000 7f5a6285d640 1 Processor -- start 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.015+0000 7f5a6285d640 1 -- start start 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.015+0000 7f5a6285d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a5c10f670 0x7f5a5c11df80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.015+0000 7f5a6285d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c110060 0x7f5a5c11e4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.015+0000 7f5a6285d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a5c115860 0x7f5a5c123890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.015+0000 7f5a6285d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c123eb0 con 0x7f5a5c110060 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.015+0000 7f5a6285d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c124020 con 0x7f5a5c115860 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.015+0000 7f5a6285d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1241e0 con 0x7f5a5c10f670 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c110060 0x7f5a5c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a5c10f670 0x7f5a5c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c110060 0x7f5a5c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55132/0 (socket says 10.20.193.28:55132) 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/3716018796 learned_addr learned my addr 10.20.193.28:0/3716018796 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a5c115860 0x7f5a5c123890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/3716018796 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a5c10f670 msgr2=0x7f5a5c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a5c10f670 0x7f5a5c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/3716018796 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a5c115860 msgr2=0x7f5a5c123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a5c115860 0x7f5a5c123890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/3716018796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a48009570 con 0x7f5a5c110060 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c110060 0x7f5a5c11e4c0 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a4c009480 tx=0x7f5a4c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a597fa640 1 -- 10.20.193.28:0/3716018796 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a4c00cd40 con 0x7f5a5c110060 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.016+0000 7f5a597fa640 1 -- 10.20.193.28:0/3716018796 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5a4c004d30 con 0x7f5a5c110060 2026-02-20T13:17:07.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.017+0000 7f5a597fa640 1 -- 10.20.193.28:0/3716018796 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a4c0106b0 con 0x7f5a5c110060 2026-02-20T13:17:07.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.017+0000 7f5a6285d640 1 -- 10.20.193.28:0/3716018796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5c1244c0 con 0x7f5a5c110060 2026-02-20T13:17:07.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.017+0000 7f5a6285d640 1 -- 10.20.193.28:0/3716018796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a5c164bc0 con 0x7f5a5c110060 2026-02-20T13:17:07.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.019+0000 7f5a597fa640 1 -- 10.20.193.28:0/3716018796 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f5a4c01f060 con 0x7f5a5c110060 2026-02-20T13:17:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a597fa640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a300b57f0 0x7f5a300d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a597fa640 1 -- 10.20.193.28:0/3716018796 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f5a4c014070 con 0x7f5a5c110060 2026-02-20T13:17:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a64857e00 1 Processor -- start 2026-02-20T13:17:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a64857e00 1 -- start start 2026-02-20T13:17:07.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a300b57f0 0x7f5a300d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72230 0x55fe18c6f200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c6f740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 0x55fe18cfd5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a64857e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe18b21370 con 0x55fe18c72230 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a64857e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fe18ba5710 con 0x55fe18c72600 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a64857e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fe18ba1440 con 0x55fe18c6fc80 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c6f740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c6f740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44818/0 (socket says 10.20.193.28:44818) 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/1084011116 learned_addr learned my addr 10.20.193.28:0/1084011116 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 0x55fe18cfd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72230 0x55fe18c6f200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/1084011116 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 msgr2=0x55fe18cfd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 0x55fe18cfd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/1084011116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72230 msgr2=0x55fe18c6f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72230 0x55fe18c6f200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/1084011116 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe18b46cf0 con 0x55fe18c72600 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.022+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72230 0x55fe18c6f200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c6f740 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=2147397459009814683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a4c005490 tx=0x7f5a4c0a8820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dcd169c8fdb409b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a2cce3640 1 -- 10.20.193.28:0/1084011116 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a4c0ac780 con 0x55fe18c72600 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a2cce3640 1 -- 10.20.193.28:0/1084011116 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5a4c016ea0 con 0x55fe18c72600 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a2cce3640 1 -- 10.20.193.28:0/1084011116 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a4c0a9380 con 0x55fe18c72600 2026-02-20T13:17:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 -- 10.20.193.28:0/1084011116 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 msgr2=0x55fe18c6f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c6f740 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=2147397459009814683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a4c005490 tx=0x7f5a4c0a8820 comp rx=0 tx=0).stop 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 -- 10.20.193.28:0/1084011116 shutdown_connections 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 0x55fe18cfd5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c6f740 unknown :-1 s=CLOSED pgs=123 gs=2 cs=0 l=1 c_cookie=2147397459009814683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1084011116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72230 0x55fe18c6f200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 -- 10.20.193.28:0/1084011116 >> 10.20.193.28:0/1084011116 conn(0x55fe18bae450 msgr2=0x55fe18c6dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 -- 10.20.193.28:0/1084011116 shutdown_connections 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.023+0000 7f5a64857e00 1 -- 10.20.193.28:0/1084011116 wait complete. 2026-02-20T13:17:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.024+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a300b57f0 0x7f5a300d5ca0 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a480098a0 tx=0x7f5a48002390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.024+0000 7f5a64857e00 1 -- start start 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.024+0000 7f5a64857e00 1 Processor -- start 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c6fc80 0x55fe18ca7cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18ca8230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18cad220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a64857e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe18859610 con 0x55fe18c72600 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a64857e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fe18cad7c0 con 0x55fe18c6fc80 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a64857e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fe18cad980 con 0x55fe18c72230 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18ca8230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18ca8230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45426/0 (socket says 10.20.193.28:45426) 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/4272854718 learned_addr learned my addr 10.20.193.28:0/4272854718 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18cad220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c6fc80 0x55fe18ca7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/4272854718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c6fc80 msgr2=0x55fe18ca7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c6fc80 0x55fe18ca7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 msgr2=0x55fe18cad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18cad220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a5b7fe640 1 -- 10.20.193.28:0/4272854718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe18b1f2c0 con 0x55fe18c72230 2026-02-20T13:17:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.025+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18cad220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18ca8230 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=4568506218226326968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a4c0ad1f0 tx=0x7f5a4c0052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f669833538b1db8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a1dffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a1dffb640 1 -- 10.20.193.28:0/4272854718 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a4c0b7e50 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a1dffb640 1 -- 10.20.193.28:0/4272854718 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5a4c0d2320 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a1dffb640 1 -- 10.20.193.28:0/4272854718 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a4c0aaf60 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a5c164bc0 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a1dffb640 1 -- 10.20.193.28:0/4272854718 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f5a4c0ab0f0 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a1dffb640 10 client.25171 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a64857e00 10 client.25171 _ll_register_callbacks cb 0x55fe18b24a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe18831600 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a1dffb640 1 -- 10.20.193.28:0/4272854718 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5a4c0b2ca0 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a64857e00 10 client.25171 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.026+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55fe18b310c0 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a1dffb640 1 -- 10.20.193.28:0/4272854718 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f5a4c0ae970 con 0x55fe18c72230 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a64857e00 10 client.25171 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a64857e00 10 client.25171 resolve_mds: resolved name 'g' to daemon mds.g 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a64857e00 20 client.25171 populate_metadata read hostname 'trial028' 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55fe18d12c60 0x55fe18d140d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a64857e00 4 client.25171 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe18b6e0a0 con 0x55fe18d12c60 2026-02-20T13:17:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55fe18d12c60 0x55fe18d140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55fe18d12c60 0x55fe18d140d0 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=6253363319320696526 s_cookie=11885045274311549874 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56c868cea39156ce server_cookie=a4f029b512c663b2 in_seq=0 out_seq=0 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.027+0000 7f5a1dffb640 10 client.25171 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a1dffb640 1 -- 10.20.193.28:0/4272854718 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fe18b6e0a0 con 0x55fe18d12c60 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a1dffb640 10 client.25171 handle_command_reply: tid=0 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 client.25171 shutdown 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 msgr2=0x55fe18ca8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18ca8230 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=4568506218226326968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a4c0ad1f0 tx=0x7f5a4c0052e0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 shutdown_connections 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55fe18d12c60 0x55fe18d140d0 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=6253363319320696526 s_cookie=11885045274311549874 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18cad220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18ca8230 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=4568506218226326968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4272854718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c6fc80 0x55fe18ca7cf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.028+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 >> 10.20.193.28:0/4272854718 conn(0x55fe18bae450 msgr2=0x55fe18c710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.029+0000 7f5a1dffb640 0 client.25171 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.029+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 shutdown_connections 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.029+0000 7f5a64857e00 1 -- 10.20.193.28:0/4272854718 wait complete. 2026-02-20T13:17:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.029+0000 7f5a64857e00 20 client.25171 trim_cache size 0 max 16384 2026-02-20T13:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.038+0000 7f5a64857e00 1 Processor -- start 2026-02-20T13:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.038+0000 7f5a64857e00 1 -- start start 2026-02-20T13:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.038+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c6fc80 0x55fe18c998f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.038+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18c6f300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.038+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c711d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.038+0000 7f5a64857e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe18b9b5a0 con 0x55fe18c6fc80 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.038+0000 7f5a64857e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fe18b991d0 con 0x55fe18c72600 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.038+0000 7f5a64857e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fe18d14bb0 con 0x55fe18c72230 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44832/0 (socket says 10.20.193.28:44832) 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 -- 10.20.193.28:0/4004061770 learned_addr learned my addr 10.20.193.28:0/4004061770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18c6f300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c6fc80 0x55fe18c998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 -- 10.20.193.28:0/4004061770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 msgr2=0x55fe18c6f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18c6f300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 -- 10.20.193.28:0/4004061770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c6fc80 msgr2=0x55fe18c998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c6fc80 0x55fe18c998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 -- 10.20.193.28:0/4004061770 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe18b2bb40 con 0x55fe18c72600 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c6fc80 0x55fe18c998f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c711d0 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=10677622198400246516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a500055b0 tx=0x7f5a50008c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=942e88d12578e2f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a1ffff640 1 -- 10.20.193.28:0/4004061770 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a50012660 con 0x55fe18c72600 2026-02-20T13:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a1ffff640 1 -- 10.20.193.28:0/4004061770 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5a50018040 con 0x55fe18c72600 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.039+0000 7f5a1ffff640 1 -- 10.20.193.28:0/4004061770 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a50011da0 con 0x55fe18c72600 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 -- 10.20.193.28:0/4004061770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 msgr2=0x55fe18c711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c711d0 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=10677622198400246516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a500055b0 tx=0x7f5a50008c50 comp rx=0 tx=0).stop 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 -- 10.20.193.28:0/4004061770 shutdown_connections 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72600 0x55fe18c711d0 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=10677622198400246516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c72230 0x55fe18c6f300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 --2- 10.20.193.28:0/4004061770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c6fc80 0x55fe18c998f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 -- 10.20.193.28:0/4004061770 >> 10.20.193.28:0/4004061770 conn(0x55fe18bae450 msgr2=0x55fe18ca52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 -- 10.20.193.28:0/4004061770 shutdown_connections 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.040+0000 7f5a64857e00 1 -- 10.20.193.28:0/4004061770 wait complete. 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a64857e00 1 -- start start 2026-02-20T13:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a64857e00 1 Processor -- start 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 0x55fe18c761a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72230 0x55fe18c766e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a64857e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18c76c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a64857e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe18c9f790 con 0x55fe18c72600 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a64857e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fe18ca8d90 con 0x55fe18c72230 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a64857e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fe18bff660 con 0x55fe18c6fc80 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a60dd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18c76c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a60dd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18c76c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55172/0 (socket says 10.20.193.28:55172) 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.041+0000 7f5a60dd3640 1 -- 10.20.193.28:0/1021311437 learned_addr learned my addr 10.20.193.28:0/1021311437 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a5b7fe640 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72230 0x55fe18c766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a60dd3640 1 -- 10.20.193.28:0/1021311437 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 msgr2=0x55fe18c761a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 0x55fe18c761a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a60dd3640 1 -- 10.20.193.28:0/1021311437 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72230 msgr2=0x55fe18c766e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72230 0x55fe18c766e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a60dd3640 1 -- 10.20.193.28:0/1021311437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a50005250 con 0x55fe18c72600 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a60dd3640 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18c76c20 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=1633159699910992854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a50005220 tx=0x7f5a50011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16aa26181eada3d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a1dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a1dffb640 1 -- 10.20.193.28:0/1021311437 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a500116b0 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a1dffb640 1 -- 10.20.193.28:0/1021311437 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5a50011d60 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a1dffb640 1 -- 10.20.193.28:0/1021311437 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a500065a0 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4804f040 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a64857e00 10 client.15243 _ll_register_callbacks cb 0x55fe18b24a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.042+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe188f33b0 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a1dffb640 1 -- 10.20.193.28:0/1021311437 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f5a50006730 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a1dffb640 1 -- 10.20.193.28:0/1021311437 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5a50008e50 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a64857e00 10 client.15243 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55fe18b1f5f0 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a1dffb640 1 -- 10.20.193.28:0/1021311437 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f5a50031020 con 0x55fe18c72600 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a64857e00 10 client.15243 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a64857e00 10 client.15243 resolve_mds: resolved name 'g' to daemon mds.g 2026-02-20T13:17:07.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a64857e00 20 client.15243 populate_metadata read hostname 'trial028' 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55fe18d86710 0x55fe18d85420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a64857e00 4 client.15243 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "status"}) -- 0x7f5a4c016ea0 con 0x55fe18d86710 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.043+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55fe18d86710 0x55fe18d85420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.044+0000 7f5a5bfff640 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55fe18d86710 0x55fe18d85420 crc :-1 s=READY pgs=18 gs=3 cs=0 l=0 c_cookie=7994948279132384658 s_cookie=2887112487750249374 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ef3c319cf4e6d92 server_cookie=28111582d2f2ab9e in_seq=0 out_seq=0 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.044+0000 7f5a1dffb640 10 client.15243 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.044+0000 7f5a1dffb640 1 -- 10.20.193.28:0/1021311437 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1217 (crc 0 0 0) 0x7f5a4c016ea0 con 0x55fe18d86710 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.044+0000 7f5a1dffb640 10 client.15243 handle_command_reply: tid=0 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.044+0000 7f5a64857e00 1 client.15243 shutdown 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 msgr2=0x55fe18c76c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18c76c20 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=1633159699910992854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a50005220 tx=0x7f5a50011bc0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 shutdown_connections 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55fe18d86710 0x55fe18d85420 crc :-1 s=READY pgs=18 gs=3 cs=0 l=0 c_cookie=7994948279132384658 s_cookie=2887112487750249374 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe18c72600 0x55fe18c76c20 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=1633159699910992854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe18c72230 0x55fe18c766e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 --2- 10.20.193.28:0/1021311437 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe18c6fc80 0x55fe18c761a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a1dffb640 0 client.15243 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 >> 10.20.193.28:0/1021311437 conn(0x55fe18bae450 msgr2=0x55fe18c998f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 shutdown_connections 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 1 -- 10.20.193.28:0/1021311437 wait complete. 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.045+0000 7f5a64857e00 20 client.15243 trim_cache size 0 max 16384 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 1, 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24677, 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 30.257099346, 2026-02-20T13:17:07.049 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 40.722598812000001, 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial028", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448336", 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:07.050 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 -- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a300b57f0 msgr2=0x7f5a300d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a300b57f0 0x7f5a300d5ca0 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a480098a0 tx=0x7f5a48002390 comp rx=0 tx=0).stop 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 -- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c110060 msgr2=0x7f5a5c11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c110060 0x7f5a5c11e4c0 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a4c009480 tx=0x7f5a4c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 -- 10.20.193.28:0/3716018796 shutdown_connections 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a300b57f0 0x7f5a300d5ca0 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a5c110060 0x7f5a5c11e4c0 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5a5c115860 0x7f5a5c123890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 --2- 10.20.193.28:0/3716018796 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5a5c10f670 0x7f5a5c11df80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 -- 10.20.193.28:0/3716018796 >> 10.20.193.28:0/3716018796 conn(0x7f5a5c0ecf20 msgr2=0x7f5a5c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 -- 10.20.193.28:0/3716018796 shutdown_connections 2026-02-20T13:17:07.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.046+0000 7f5a6285d640 1 -- 10.20.193.28:0/3716018796 wait complete. 2026-02-20T13:17:07.145 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.b status 2026-02-20T13:17:07.330 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:07.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 -- 10.20.193.28:0/1338875099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010bb40 msgr2=0x7f53301109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 --2- 10.20.193.28:0/1338875099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010bb40 0x7f53301109d0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=16701707906722423015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5320009890 tx=0x7f532002f120 comp rx=0 tx=0).stop 2026-02-20T13:17:07.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 -- 10.20.193.28:0/1338875099 shutdown_connections 2026-02-20T13:17:07.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 --2- 10.20.193.28:0/1338875099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010bb40 0x7f53301109d0 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=16701707906722423015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 --2- 10.20.193.28:0/1338875099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5330111160 0x7f5330111b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 --2- 10.20.193.28:0/1338875099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f533010b150 0x7f533010b520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 -- 10.20.193.28:0/1338875099 >> 10.20.193.28:0/1338875099 conn(0x7f53300e8ce0 msgr2=0x7f53301090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 -- 10.20.193.28:0/1338875099 shutdown_connections 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.502+0000 7f533539f640 1 -- 10.20.193.28:0/1338875099 wait complete. 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f533539f640 1 Processor -- start 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f533539f640 1 -- start start 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f533539f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010b150 0x7f53300f10f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f533539f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f533010bb40 0x7f53300f1630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f533539f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5330111160 0x7f53300f6a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f533539f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53300f7020 con 0x7f533010b150 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f533539f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f53300f7190 con 0x7f5330111160 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f533539f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f53300f7350 con 0x7f533010bb40 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f532f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f533010bb40 0x7f53300f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f532f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f533010bb40 0x7f53300f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45470/0 (socket says 10.20.193.28:45470) 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f532f7fe640 1 -- 10.20.193.28:0/291784739 learned_addr learned my addr 10.20.193.28:0/291784739 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f5334b9e640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5330111160 0x7f53300f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.503+0000 7f532ffff640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010b150 0x7f53300f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532f7fe640 1 -- 10.20.193.28:0/291784739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5330111160 msgr2=0x7f53300f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532f7fe640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5330111160 0x7f53300f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532f7fe640 1 -- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010b150 msgr2=0x7f53300f10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532f7fe640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010b150 0x7f53300f10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532f7fe640 1 -- 10.20.193.28:0/291784739 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53200094b0 con 0x7f533010bb40 2026-02-20T13:17:07.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532ffff640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010b150 0x7f53300f10f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:07.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532f7fe640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f533010bb40 0x7f53300f1630 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5320002390 tx=0x7f53200028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532d7fa640 1 -- 10.20.193.28:0/291784739 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f532003d070 con 0x7f533010bb40 2026-02-20T13:17:07.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532d7fa640 1 -- 10.20.193.28:0/291784739 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53200044f0 con 0x7f533010bb40 2026-02-20T13:17:07.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f533539f640 1 -- 10.20.193.28:0/291784739 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53300f75d0 con 0x7f533010bb40 2026-02-20T13:17:07.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f532d7fa640 1 -- 10.20.193.28:0/291784739 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5320041a00 con 0x7f533010bb40 2026-02-20T13:17:07.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.504+0000 7f533539f640 1 -- 10.20.193.28:0/291784739 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53300f7d10 con 0x7f533010bb40 2026-02-20T13:17:07.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.507+0000 7f532d7fa640 1 -- 10.20.193.28:0/291784739 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f5320038c20 con 0x7f533010bb40 2026-02-20T13:17:07.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.509+0000 7f532d7fa640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53040b57f0 0x7f53040d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.509+0000 7f532d7fa640 1 -- 10.20.193.28:0/291784739 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f532010b1b0 con 0x7f533010bb40 2026-02-20T13:17:07.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.509+0000 7f532ffff640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53040b57f0 0x7f53040d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532ffff640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53040b57f0 0x7f53040d5ca0 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c005b30 tx=0x7f531c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5338622e00 1 Processor -- start 2026-02-20T13:17:07.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5338622e00 1 -- start start 2026-02-20T13:17:07.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5338622e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838412210 0x5558384125e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5338622e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x555838457280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5338622e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5558384577c0 0x555838477ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5338622e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5558382a4370 con 0x555838412210 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5338622e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555838328710 con 0x555838412b20 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5338622e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555838324440 con 0x5558384577c0 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x555838457280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838412210 0x5558384125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x555838457280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44870/0 (socket says 10.20.193.28:44870) 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532f7fe640 1 -- 10.20.193.28:0/1639068278 learned_addr learned my addr 10.20.193.28:0/1639068278 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f5334b9e640 1 --2- 10.20.193.28:0/1639068278 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5558384577c0 0x555838477ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532ffff640 1 -- 10.20.193.28:0/1639068278 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5558384577c0 msgr2=0x555838477ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532ffff640 1 --2- 10.20.193.28:0/1639068278 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5558384577c0 0x555838477ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532ffff640 1 -- 10.20.193.28:0/1639068278 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 msgr2=0x555838457280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532ffff640 1 --2- 10.20.193.28:0/1639068278 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x555838457280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.510+0000 7f532ffff640 1 -- 10.20.193.28:0/1639068278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558382c9cf0 con 0x555838412210 2026-02-20T13:17:07.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f532ffff640 1 --2- 10.20.193.28:0/1639068278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838412210 0x5558384125e0 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=16134047049436116900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c004740 tx=0x7f531c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe7a64f431437a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5300ce3640 1 -- 10.20.193.28:0/1639068278 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f531c004850 con 0x555838412210 2026-02-20T13:17:07.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5300ce3640 1 -- 10.20.193.28:0/1639068278 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f531c004e90 con 0x555838412210 2026-02-20T13:17:07.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5300ce3640 1 -- 10.20.193.28:0/1639068278 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f531c01a810 con 0x555838412210 2026-02-20T13:17:07.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 -- 10.20.193.28:0/1639068278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838412210 msgr2=0x5558384125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 --2- 10.20.193.28:0/1639068278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838412210 0x5558384125e0 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=16134047049436116900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c004740 tx=0x7f531c014000 comp rx=0 tx=0).stop 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 -- 10.20.193.28:0/1639068278 shutdown_connections 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 --2- 10.20.193.28:0/1639068278 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5558384577c0 0x555838477ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 --2- 10.20.193.28:0/1639068278 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x555838457280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 --2- 10.20.193.28:0/1639068278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838412210 0x5558384125e0 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=16134047049436116900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 -- 10.20.193.28:0/1639068278 >> 10.20.193.28:0/1639068278 conn(0x555838331450 msgr2=0x555838410af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 -- 10.20.193.28:0/1639068278 shutdown_connections 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.511+0000 7f5338622e00 1 -- 10.20.193.28:0/1639068278 wait complete. 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5338622e00 1 -- start start 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5338622e00 1 Processor -- start 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5338622e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x55583846f320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5338622e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x55583846f860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5338622e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558384577c0 0x555838474850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5338622e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555837fdc610 con 0x5558384577c0 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5338622e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555838474dc0 con 0x555838412210 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5338622e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555838474f80 con 0x555838412b20 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f5334b9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558384577c0 0x555838474850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f532f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x55583846f860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f532f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x55583846f860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45492/0 (socket says 10.20.193.28:45492) 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.513+0000 7f532f7fe640 1 -- 10.20.193.28:0/3776428042 learned_addr learned my addr 10.20.193.28:0/3776428042 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f532f7fe640 1 -- 10.20.193.28:0/3776428042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 msgr2=0x55583846f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f532f7fe640 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x55583846f320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f532f7fe640 1 -- 10.20.193.28:0/3776428042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558384577c0 msgr2=0x555838474850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f532f7fe640 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558384577c0 0x555838474850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f532f7fe640 1 -- 10.20.193.28:0/3776428042 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558382a22c0 con 0x555838412b20 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f5334b9e640 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558384577c0 0x555838474850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f532f7fe640 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x55583846f860 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=5172909880545536198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53200d18e0 tx=0x7f5320041410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47c9de210d0668c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f52f1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f52f1ffb640 1 -- 10.20.193.28:0/3776428042 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53200d7070 con 0x555838412b20 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c003d10 con 0x555838412b20 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f52f1ffb640 1 -- 10.20.193.28:0/3776428042 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53200d1050 con 0x555838412b20 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f52f1ffb640 1 -- 10.20.193.28:0/3776428042 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53200cf8d0 con 0x555838412b20 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f5338622e00 10 client.25186 _ll_register_callbacks cb 0x5558382a7a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555837fb4600 con 0x555838412b20 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.514+0000 7f52f1ffb640 1 -- 10.20.193.28:0/3776428042 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f5320005b60 con 0x555838412b20 2026-02-20T13:17:07.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f52f1ffb640 1 -- 10.20.193.28:0/3776428042 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f53200d72e0 con 0x555838412b20 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f5338622e00 10 client.25186 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5558382b40c0 con 0x555838412b20 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f52f1ffb640 1 -- 10.20.193.28:0/3776428042 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f53200d2fb0 con 0x555838412b20 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f5338622e00 10 client.25186 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f5338622e00 10 client.25186 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f5338622e00 20 client.25186 populate_metadata read hostname 'trial028' 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f5338622e00 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555838455650 0x555838456ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f5338622e00 4 client.25186 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558382f10a0 con 0x555838455650 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.515+0000 7f532ffff640 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555838455650 0x555838456ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f532ffff640 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555838455650 0x555838456ac0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=3379471041929963516 s_cookie=3814225170657386319 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee64b01e6f467fc server_cookie=34eed99586631f4f in_seq=0 out_seq=0 2026-02-20T13:17:07.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f52f1ffb640 10 client.25186 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f52f1ffb640 1 -- 10.20.193.28:0/3776428042 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5558382f10a0 con 0x555838455650 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f52f1ffb640 10 client.25186 handle_command_reply: tid=0 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 client.25186 shutdown 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 msgr2=0x55583846f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x55583846f860 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=5172909880545536198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53200d18e0 tx=0x7f5320041410 comp rx=0 tx=0).stop 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 shutdown_connections 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555838455650 0x555838456ac0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=3379471041929963516 s_cookie=3814225170657386319 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558384577c0 0x555838474850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x55583846f860 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=5172909880545536198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f52f1ffb640 0 client.25186 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 --2- 10.20.193.28:0/3776428042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x55583846f320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.516+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 >> 10.20.193.28:0/3776428042 conn(0x555838331450 msgr2=0x555838410300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.517+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 shutdown_connections 2026-02-20T13:17:07.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.517+0000 7f5338622e00 1 -- 10.20.193.28:0/3776428042 wait complete. 2026-02-20T13:17:07.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.517+0000 7f5338622e00 20 client.25186 trim_cache size 0 max 16384 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5338622e00 1 Processor -- start 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5338622e00 1 -- start start 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5338622e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412210 0x55583845a2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5338622e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x55583846c6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5338622e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x55583846cc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5338622e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55583831e5a0 con 0x555838455650 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5338622e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55583831c1d0 con 0x555838412b20 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5338622e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555838381b90 con 0x555838412210 2026-02-20T13:17:07.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f5334b9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x55583846cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.526+0000 7f532ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412210 0x55583845a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5334b9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x55583846cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55224/0 (socket says 10.20.193.28:55224) 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5334b9e640 1 -- 10.20.193.28:0/4006593001 learned_addr learned my addr 10.20.193.28:0/4006593001 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f532f7fe640 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x55583846c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5334b9e640 1 -- 10.20.193.28:0/4006593001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412210 msgr2=0x55583845a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5334b9e640 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412210 0x55583845a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5334b9e640 1 -- 10.20.193.28:0/4006593001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 msgr2=0x55583846c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5334b9e640 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x55583846c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5334b9e640 1 -- 10.20.193.28:0/4006593001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558384616f0 con 0x555838455650 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5334b9e640 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x55583846cc20 secure :-1 s=READY pgs=326 gs=3 cs=0 l=1 c_cookie=16518171011690372627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53240049c0 tx=0x7f5324004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53c5504a2f59e13 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f532f7fe640 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x55583846c6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f52f3fff640 1 -- 10.20.193.28:0/4006593001 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f532400ae80 con 0x555838455650 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f52f3fff640 1 -- 10.20.193.28:0/4006593001 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5324019040 con 0x555838455650 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f52f3fff640 1 -- 10.20.193.28:0/4006593001 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f532401da90 con 0x555838455650 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5338622e00 1 -- 10.20.193.28:0/4006593001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 msgr2=0x55583846cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5338622e00 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x55583846cc20 secure :-1 s=READY pgs=326 gs=3 cs=0 l=1 c_cookie=16518171011690372627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53240049c0 tx=0x7f5324004e90 comp rx=0 tx=0).stop 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5338622e00 1 -- 10.20.193.28:0/4006593001 shutdown_connections 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5338622e00 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x55583846cc20 unknown :-1 s=CLOSED pgs=326 gs=3 cs=0 l=1 c_cookie=16518171011690372627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5338622e00 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412b20 0x55583846c6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5338622e00 1 --2- 10.20.193.28:0/4006593001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412210 0x55583845a2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.527+0000 7f5338622e00 1 -- 10.20.193.28:0/4006593001 >> 10.20.193.28:0/4006593001 conn(0x555838331450 msgr2=0x555838459ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.528+0000 7f5338622e00 1 -- 10.20.193.28:0/4006593001 shutdown_connections 2026-02-20T13:17:07.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.528+0000 7f5338622e00 1 -- 10.20.193.28:0/4006593001 wait complete. 2026-02-20T13:17:07.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.528+0000 7f5338622e00 1 -- start start 2026-02-20T13:17:07.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.528+0000 7f5338622e00 1 Processor -- start 2026-02-20T13:17:07.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f5338622e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x555838472580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f5338622e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x555838472ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f5338622e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x555838473000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f5338622e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5558384760f0 con 0x555838455650 2026-02-20T13:17:07.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f5338622e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5558384750c0 con 0x555838412210 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f5338622e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55583846e810 con 0x555838412b20 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x555838472580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x555838472580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44898/0 (socket says 10.20.193.28:44898) 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532ffff640 1 -- 10.20.193.28:0/1540310444 learned_addr learned my addr 10.20.193.28:0/1540310444 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532f7fe640 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x555838472ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f5334b9e640 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x555838473000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532ffff640 1 -- 10.20.193.28:0/1540310444 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 msgr2=0x555838472ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532ffff640 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x555838472ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532ffff640 1 -- 10.20.193.28:0/1540310444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 msgr2=0x555838473000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532ffff640 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x555838473000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f532ffff640 1 -- 10.20.193.28:0/1540310444 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558382aeb40 con 0x555838412210 2026-02-20T13:17:07.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.529+0000 7f5334b9e640 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x555838473000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f532ffff640 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x555838472580 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=7819588133810649042 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c011460 tx=0x7f531c009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c84c1fa4da4b7d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f52f1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f52f1ffb640 1 -- 10.20.193.28:0/1540310444 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f531c005080 con 0x555838412210 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f52f1ffb640 1 -- 10.20.193.28:0/1540310444 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f531c004c50 con 0x555838412210 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f52f1ffb640 1 -- 10.20.193.28:0/1540310444 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f531c032cd0 con 0x555838412210 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5324005500 con 0x555838412210 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f52f1ffb640 1 -- 10.20.193.28:0/1540310444 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f531c01a520 con 0x555838412210 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f5338622e00 10 client.25232 _ll_register_callbacks cb 0x5558382a7a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f531c004e90 con 0x555838412210 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f52f1ffb640 1 -- 10.20.193.28:0/1540310444 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f531c032610 con 0x555838412210 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f5338622e00 10 client.25232 fetch_fsmap learned FSMap version 23 2026-02-20T13:17:07.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5558382a25f0 con 0x555838412210 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f52f1ffb640 1 -- 10.20.193.28:0/1540310444 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 23) ==== 8362+0+0 (secure 0 0 0) 0x7f531c0051e0 con 0x555838412210 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f5338622e00 10 client.25232 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f5338622e00 10 client.25232 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.530+0000 7f5338622e00 20 client.25232 populate_metadata read hostname 'trial028' 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.531+0000 7f5338622e00 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5558384577c0 0x5558384368c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.531+0000 7f5338622e00 4 client.25232 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.531+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "status"}) -- 0x555837fb1e50 con 0x5558384577c0 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.531+0000 7f532f7fe640 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5558384577c0 0x5558384368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.531+0000 7f532f7fe640 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5558384577c0 0x5558384368c0 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=15399502656321693655 s_cookie=4268329118140209471 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b606136bbd27d7 server_cookie=3b3c26b7e734193f in_seq=0 out_seq=0 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.531+0000 7f52f1ffb640 10 client.25232 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f52f1ffb640 1 -- 10.20.193.28:0/1540310444 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x555837fb1e50 con 0x5558384577c0 2026-02-20T13:17:07.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f52f1ffb640 10 client.25232 handle_command_reply: tid=0 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 client.25232 shutdown 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 msgr2=0x555838472580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x555838472580 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=7819588133810649042 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c011460 tx=0x7f531c009380 comp rx=0 tx=0).stop 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 shutdown_connections 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5558384577c0 0x5558384368c0 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=15399502656321693655 s_cookie=4268329118140209471 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555838455650 0x555838473000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555838412b20 0x555838472ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 --2- 10.20.193.28:0/1540310444 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555838412210 0x555838472580 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=7819588133810649042 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 >> 10.20.193.28:0/1540310444 conn(0x555838331450 msgr2=0x55583846d750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f52f1ffb640 0 client.25232 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 shutdown_connections 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 1 -- 10.20.193.28:0/1540310444 wait complete. 2026-02-20T13:17:07.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f5338622e00 20 client.25232 trim_cache size 0 max 16384 2026-02-20T13:17:07.542 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:07.542 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:07.542 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-20T13:17:07.542 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24692, 2026-02-20T13:17:07.542 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:07.542 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:07.542 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 33.767993081999997, 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 23, 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 39.195420951000003, 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial034", 2026-02-20T13:17:07.543 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial034", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438948", 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:07.544 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:07.545 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:07.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.532+0000 7f533539f640 1 -- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53040b57f0 msgr2=0x7f53040d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53040b57f0 0x7f53040d5ca0 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c005b30 tx=0x7f531c009310 comp rx=0 tx=0).stop 2026-02-20T13:17:07.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 -- 10.20.193.28:0/291784739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f533010bb40 msgr2=0x7f53300f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:07.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f533010bb40 0x7f53300f1630 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5320002390 tx=0x7f53200028d0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 -- 10.20.193.28:0/291784739 shutdown_connections 2026-02-20T13:17:07.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53040b57f0 0x7f53040d5ca0 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5330111160 0x7f53300f6a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f533010bb40 0x7f53300f1630 unknown :-1 s=CLOSED pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 --2- 10.20.193.28:0/291784739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f533010b150 0x7f53300f10f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 -- 10.20.193.28:0/291784739 >> 10.20.193.28:0/291784739 conn(0x7f53300e8ce0 msgr2=0x7f533010a090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 -- 10.20.193.28:0/291784739 shutdown_connections 2026-02-20T13:17:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:07.533+0000 7f533539f640 1 -- 10.20.193.28:0/291784739 wait complete. 2026-02-20T13:17:07.668 INFO:teuthology.run_tasks:Running task kclient... 2026-02-20T13:17:07.727 INFO:tasks.kclient:Mounting kernel clients... 2026-02-20T13:17:07.728 INFO:tasks.kclient:config is {'client.0': {}} 2026-02-20T13:17:07.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:07.728 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-20T13:17:07.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:07.769 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link delete ceph-brx 2026-02-20T13:17:07.870 INFO:teuthology.orchestra.run.trial028.stderr:Cannot find device "ceph-brx" 2026-02-20T13:17:07.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:17:07.873 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2026-02-20T13:17:07.873 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-20T13:17:07.873 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-20T13:17:07.874 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs ls 2026-02-20T13:17:08.057 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:08.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.235+0000 7fa87e99b640 1 -- 10.20.193.28:0/1069112855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa87810fea0 msgr2=0x7fa878114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:08.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.235+0000 7fa87e99b640 1 --2- 10.20.193.28:0/1069112855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa87810fea0 0x7fa878114ef0 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=1531015973325745851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa86c009950 tx=0x7fa86c02f190 comp rx=0 tx=0).stop 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 -- 10.20.193.28:0/1069112855 shutdown_connections 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 --2- 10.20.193.28:0/1069112855 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa8781156a0 0x7fa878176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 --2- 10.20.193.28:0/1069112855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa87810fea0 0x7fa878114ef0 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=1531015973325745851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 --2- 10.20.193.28:0/1069112855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa87810f4b0 0x7fa87810f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 -- 10.20.193.28:0/1069112855 >> 10.20.193.28:0/1069112855 conn(0x7fa8780ecda0 msgr2=0x7fa87810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 -- 10.20.193.28:0/1069112855 shutdown_connections 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 -- 10.20.193.28:0/1069112855 wait complete. 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 Processor -- start 2026-02-20T13:17:08.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.236+0000 7fa87e99b640 1 -- start start 2026-02-20T13:17:08.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87e99b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa87810f4b0 0x7fa8780f5770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:08.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87e99b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa87810fea0 0x7fa878175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:08.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87e99b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8781156a0 0x7fa8780f5e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:08.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87e99b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780fb080 con 0x7fa87810f4b0 2026-02-20T13:17:08.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87e99b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780fb1f0 con 0x7fa87810fea0 2026-02-20T13:17:08.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87e99b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780fb3b0 con 0x7fa8781156a0 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d198640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa87810fea0 0x7fa878175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d198640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa87810fea0 0x7fa878175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44918/0 (socket says 10.20.193.28:44918) 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d198640 1 -- 10.20.193.28:0/949741080 learned_addr learned my addr 10.20.193.28:0/949741080 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d999640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa87810f4b0 0x7fa8780f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87e19a640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8781156a0 0x7fa8780f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d198640 1 -- 10.20.193.28:0/949741080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8781156a0 msgr2=0x7fa8780f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d198640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8781156a0 0x7fa8780f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d198640 1 -- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa87810f4b0 msgr2=0x7fa8780f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d198640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa87810f4b0 0x7fa8780f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d198640 1 -- 10.20.193.28:0/949741080 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c009570 con 0x7fa87810fea0 2026-02-20T13:17:08.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.237+0000 7fa87d999640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa87810f4b0 0x7fa8780f5770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:08.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.238+0000 7fa87d198640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa87810fea0 0x7fa878175f70 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa86c0023d0 tx=0x7fa86c004290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:08.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.238+0000 7fa866ffd640 1 -- 10.20.193.28:0/949741080 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa86c03d070 con 0x7fa87810fea0 2026-02-20T13:17:08.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.238+0000 7fa866ffd640 1 -- 10.20.193.28:0/949741080 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa86c002ad0 con 0x7fa87810fea0 2026-02-20T13:17:08.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.238+0000 7fa866ffd640 1 -- 10.20.193.28:0/949741080 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa86c0418a0 con 0x7fa87810fea0 2026-02-20T13:17:08.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.238+0000 7fa87e99b640 1 -- 10.20.193.28:0/949741080 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8780fb630 con 0x7fa87810fea0 2026-02-20T13:17:08.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.238+0000 7fa87e99b640 1 -- 10.20.193.28:0/949741080 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8780fbaf0 con 0x7fa87810fea0 2026-02-20T13:17:08.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.239+0000 7fa864ff9640 1 -- 10.20.193.28:0/949741080 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa844005300 con 0x7fa87810fea0 2026-02-20T13:17:08.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.240+0000 7fa866ffd640 1 -- 10.20.193.28:0/949741080 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fa86c041a30 con 0x7fa87810fea0 2026-02-20T13:17:08.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.241+0000 7fa866ffd640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8540b57e0 0x7fa8540d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:08.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.242+0000 7fa866ffd640 1 -- 10.20.193.28:0/949741080 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fa86c10afe0 con 0x7fa87810fea0 2026-02-20T13:17:08.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.242+0000 7fa87d999640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8540b57e0 0x7fa8540d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:08.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.242+0000 7fa87d999640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8540b57e0 0x7fa8540d5c90 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa868004740 tx=0x7fa868005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:08.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.243+0000 7fa866ffd640 1 -- 10.20.193.28:0/949741080 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fa86c0cda80 con 0x7fa87810fea0 2026-02-20T13:17:08.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.382+0000 7fa864ff9640 1 -- 10.20.193.28:0/949741080 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa844005dc0 con 0x7fa87810fea0 2026-02-20T13:17:08.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.382+0000 7fa866ffd640 1 -- 10.20.193.28:0/949741080 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7fa86c041d10 con 0x7fa87810fea0 2026-02-20T13:17:08.386 INFO:teuthology.orchestra.run.trial028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2026-02-20T13:17:08.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 -- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8540b57e0 msgr2=0x7fa8540d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:08.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8540b57e0 0x7fa8540d5c90 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa868004740 tx=0x7fa868005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:08.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 -- 10.20.193.28:0/949741080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa87810fea0 msgr2=0x7fa878175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:08.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa87810fea0 0x7fa878175f70 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa86c0023d0 tx=0x7fa86c004290 comp rx=0 tx=0).stop 2026-02-20T13:17:08.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 -- 10.20.193.28:0/949741080 shutdown_connections 2026-02-20T13:17:08.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8540b57e0 0x7fa8540d5c90 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8781156a0 0x7fa8780f5e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa87810fea0 0x7fa878175f70 unknown :-1 s=CLOSED pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 --2- 10.20.193.28:0/949741080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa87810f4b0 0x7fa8780f5770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:08.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 -- 10.20.193.28:0/949741080 >> 10.20.193.28:0/949741080 conn(0x7fa8780ecda0 msgr2=0x7fa878111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:08.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 -- 10.20.193.28:0/949741080 shutdown_connections 2026-02-20T13:17:08.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08.384+0000 7fa864ff9640 1 -- 10.20.193.28:0/949741080 wait complete. 2026-02-20T13:17:08.426 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:08 trial028 ceph-mon[37442]: pgmap v173: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-20T13:17:08.426 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:08 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/949741080' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-20T13:17:08.488 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2026-02-20T13:17:08.488 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-20T13:17:08.488 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial028.front.sepia.ceph.com 2026-02-20T13:17:08.488 INFO:tasks.cephfs.mount:self.client.name = client.0 2026-02-20T13:17:08.488 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-20T13:17:08.488 INFO:tasks.cephfs.mount:self.cephfs_name = None 2026-02-20T13:17:08.489 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-20T13:17:08.489 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-20T13:17:08.489 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2026-02-20T13:17:08.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:08.489 DEBUG:teuthology.orchestra.run.trial028:> ip addr 2026-02-20T13:17:08.529 INFO:teuthology.orchestra.run.trial028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-20T13:17:08.529 INFO:teuthology.orchestra.run.trial028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-20T13:17:08.529 INFO:teuthology.orchestra.run.trial028.stdout: inet 127.0.0.1/8 scope host lo 2026-02-20T13:17:08.529 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T13:17:08.529 INFO:teuthology.orchestra.run.trial028.stdout: inet6 ::1/128 scope host 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout:2: enp1s0f0np0: mtu 1500 qdisc fq_codel state UP group default qlen 1000 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout: link/ether 90:5a:08:77:63:0c brd ff:ff:ff:ff:ff:ff 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout: inet 10.20.193.28/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0np0 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft 748sec preferred_lft 748sec 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout: inet6 fe80::925a:8ff:fe77:630c/64 scope link proto kernel_ll 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout:3: enp1s0f1np1: mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 2026-02-20T13:17:08.530 INFO:teuthology.orchestra.run.trial028.stdout: link/ether 90:5a:08:77:63:0d brd ff:ff:ff:ff:ff:ff 2026-02-20T13:17:08.531 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-20T13:17:08.531 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T13:17:08.531 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T13:17:08.531 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link add name ceph-brx type bridge 2026-02-20T13:17:08.532 DEBUG:teuthology.orchestra.run.trial028:> sudo ip addr flush dev ceph-brx 2026-02-20T13:17:08.532 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set ceph-brx up 2026-02-20T13:17:08.532 DEBUG:teuthology.orchestra.run.trial028:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-20T13:17:08.532 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T13:17:08.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T13:17:08.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:08 trial127 ceph-mon[43817]: pgmap v173: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-20T13:17:08.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:08 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/949741080' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-20T13:17:08.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:08 trial034 ceph-mon[43332]: pgmap v173: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-20T13:17:08.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:08 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/949741080' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-20T13:17:08.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:08.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:08.794 DEBUG:teuthology.orchestra.run.trial028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-20T13:17:08.851 INFO:teuthology.orchestra.run.trial028.stdout:1 2026-02-20T13:17:08.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:08.855 DEBUG:teuthology.orchestra.run.trial028:> ip r 2026-02-20T13:17:08.893 INFO:teuthology.orchestra.run.trial028.stdout:default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.28 metric 100 2026-02-20T13:17:08.893 INFO:teuthology.orchestra.run.trial028.stdout:10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.28 metric 100 2026-02-20T13:17:08.893 INFO:teuthology.orchestra.run.trial028.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-20T13:17:08.894 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T13:17:08.894 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T13:17:08.894 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -A FORWARD -o enp1s0f0np0 -i ceph-brx -j ACCEPT 2026-02-20T13:17:08.894 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -A FORWARD -i enp1s0f0np0 -o ceph-brx -j ACCEPT 2026-02-20T13:17:08.895 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0np0 -j MASQUERADE 2026-02-20T13:17:08.895 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T13:17:08.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T13:17:09.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:09.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:09.195 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-20T13:17:09.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:09.236 DEBUG:teuthology.orchestra.run.trial028:> ip netns list-id 2026-02-20T13:17:09.315 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T13:17:09.315 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T13:17:09.315 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T13:17:09.315 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2026-02-20T13:17:09.315 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T13:17:09.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T13:17:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:09.473 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.144.1/20 2026-02-20T13:17:09.473 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T13:17:09.474 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T13:17:09.474 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2026-02-20T13:17:09.474 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-20T13:17:09.474 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2026-02-20T13:17:09.474 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2026-02-20T13:17:09.474 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.159.254 2026-02-20T13:17:09.474 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T13:17:09.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T13:17:09.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:09.671 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T13:17:09.671 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T13:17:09.672 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set brx.0 up 2026-02-20T13:17:09.672 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set dev brx.0 master ceph-brx 2026-02-20T13:17:09.672 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T13:17:09.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T13:17:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:09.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T13:17:09.822 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2026-02-20T13:17:09.861 INFO:teuthology.orchestra.run.trial028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2026-02-20T13:17:09.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T13:17:09.862 DEBUG:teuthology.orchestra.run.trial028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2026-02-20T13:17:09.940 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2026-02-20T13:17:09.940 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2026-02-20T13:17:09.940 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/bb7c75c8-c7fe-4589-9211-d37b51867f1c 2026-02-20T13:17:09.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:09.940 DEBUG:teuthology.orchestra.run.trial028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/bb7c75c8-c7fe-4589-9211-d37b51867f1c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2026-02-20T13:17:10.059 INFO:teuthology.orchestra.run.trial028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2026-02-20T13:17:10.059 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2026-02-20T13:17:10.059 INFO:teuthology.orchestra.run.trial028.stdout:invalid new device string format 2026-02-20T13:17:10.217 INFO:teuthology.orchestra.run.trial028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2026-02-20T13:17:10.217 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2026-02-20T13:17:10.217 INFO:teuthology.orchestra.run.trial028.stdout:invalid new device string format 2026-02-20T13:17:10.217 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: resolved to: "10.20.193.28:6789,10.20.193.34:6789,10.20.193.127:6789" 2026-02-20T13:17:10.217 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: trying mount with old device syntax: 10.20.193.28:6789,10.20.193.34:6789,10.20.193.127:6789:/volumes/qa/sv_1/bb7c75c8-c7fe-4589-9211-d37b51867f1c 2026-02-20T13:17:10.217 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,key=0,fsid=dd845518-0e5d-11f1-9909-d404e6e7d460" will pass to kernel 2026-02-20T13:17:10.218 INFO:teuthology.orchestra.run.trial028.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2026-02-20T13:17:10.218 INFO:teuthology.orchestra.run.trial028.stdout: You just mounted a file system that supports labels which does not 2026-02-20T13:17:10.218 INFO:teuthology.orchestra.run.trial028.stdout: contain labels, onto an SELinux box. It is likely that confined 2026-02-20T13:17:10.218 INFO:teuthology.orchestra.run.trial028.stdout: applications will generate AVC messages and not be allowed access to 2026-02-20T13:17:10.218 INFO:teuthology.orchestra.run.trial028.stdout: this file system. For more details see restorecon(8) and mount(8). 2026-02-20T13:17:10.220 INFO:tasks.cephfs.kernel_mount:mount command passed 2026-02-20T13:17:10.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:17:10.220 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2026-02-20T13:17:10.280 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-20T13:17:10.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-20T13:17:10.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:10.360 INFO:teuthology.orchestra.run.trial028.stdout:client15270 2026-02-20T13:17:10.360 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:17:10.360 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T13:17:10.401 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-20T13:17:10.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-20T13:17:10.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:10.518 INFO:teuthology.orchestra.run.trial028.stdout:client15270 2026-02-20T13:17:10.518 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-20T13:17:10.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-20T13:17:10.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:10.597 INFO:teuthology.orchestra.run.trial028.stdout:client15270 2026-02-20T13:17:10.597 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460.client15270/status') 2026-02-20T13:17:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T13:17:10.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:10 trial028 ceph-mon[37442]: pgmap v174: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 9 op/s 2026-02-20T13:17:10.686 INFO:teuthology.orchestra.run.trial028.stdout:instance: client.15270 (3)192.168.144.1:0/3807164967 2026-02-20T13:17:10.686 INFO:teuthology.orchestra.run.trial028.stdout:blocklisted: false 2026-02-20T13:17:10.686 INFO:teuthology.orchestra.run.trial028.stderr:0+1 records in 2026-02-20T13:17:10.686 INFO:teuthology.orchestra.run.trial028.stderr:0+1 records out 2026-02-20T13:17:10.686 INFO:teuthology.orchestra.run.trial028.stderr:72 bytes copied, 4.9312e-05 s, 1.5 MB/s 2026-02-20T13:17:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T13:17:10.694 INFO:teuthology.run_tasks:Running task exec... 2026-02-20T13:17:10.711 INFO:teuthology.task.exec:Executing custom commands... 2026-02-20T13:17:10.711 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T13:17:10.711 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2026-02-20T13:17:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:10 trial127 ceph-mon[43817]: pgmap v174: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 9 op/s 2026-02-20T13:17:10.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:10 trial034 ceph-mon[43332]: pgmap v174: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 9 op/s 2026-02-20T13:17:10.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 -- 10.20.193.28:0/2613092506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f277414e720 msgr2=0x7f277416ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:10.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 --2- 10.20.193.28:0/2613092506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f277414e720 0x7f277416ebd0 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=1452882334754218863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f276800a970 tx=0x7f27680301b0 comp rx=0 tx=0).stop 2026-02-20T13:17:10.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 -- 10.20.193.28:0/2613092506 shutdown_connections 2026-02-20T13:17:10.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 --2- 10.20.193.28:0/2613092506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277412db60 0x7f277414dfe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:10.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 --2- 10.20.193.28:0/2613092506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f277414e720 0x7f277416ebd0 unknown :-1 s=CLOSED pgs=127 gs=2 cs=0 l=1 c_cookie=1452882334754218863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:10.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 --2- 10.20.193.28:0/2613092506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2774060900 0x7f277412d620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:10.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 -- 10.20.193.28:0/2613092506 >> 10.20.193.28:0/2613092506 conn(0x7f27740e8f00 msgr2=0x7f2774109350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:10.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 -- 10.20.193.28:0/2613092506 shutdown_connections 2026-02-20T13:17:10.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.824+0000 7f27793b5640 1 -- 10.20.193.28:0/2613092506 wait complete. 2026-02-20T13:17:10.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27793b5640 1 Processor -- start 2026-02-20T13:17:10.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27793b5640 1 -- start start 2026-02-20T13:17:10.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27793b5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2774060900 0x7f277416eb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27793b5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277412db60 0x7f27741092e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27793b5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f277414e720 0x7f277411ba00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27793b5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f277411c160 con 0x7f277412db60 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27793b5640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f277411c2d0 con 0x7f2774060900 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27793b5640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f277411c490 con 0x7f277414e720 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277412db60 0x7f27741092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f2773fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2774060900 0x7f277416eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277412db60 0x7f27741092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51746/0 (socket says 10.20.193.28:51746) 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f27737fe640 1 -- 10.20.193.28:0/1882729455 learned_addr learned my addr 10.20.193.28:0/1882729455 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.825+0000 7f2778bb4640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f277414e720 0x7f277411ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:10.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27737fe640 1 -- 10.20.193.28:0/1882729455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f277414e720 msgr2=0x7f277411ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27737fe640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f277414e720 0x7f277411ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27737fe640 1 -- 10.20.193.28:0/1882729455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2774060900 msgr2=0x7f277416eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27737fe640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2774060900 0x7f277416eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27737fe640 1 -- 10.20.193.28:0/1882729455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2764009570 con 0x7f277412db60 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f2773fff640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2774060900 0x7f277416eb00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27737fe640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277412db60 0x7f27741092e0 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2764005b30 tx=0x7f2764002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27717fa640 1 -- 10.20.193.28:0/1882729455 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f276400eb50 con 0x7f277412db60 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276800a590 con 0x7f277412db60 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27717fa640 1 -- 10.20.193.28:0/1882729455 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f276400ecb0 con 0x7f277412db60 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27717fa640 1 -- 10.20.193.28:0/1882729455 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f276400f870 con 0x7f277412db60 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.826+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277411cfa0 con 0x7f277412db60 2026-02-20T13:17:10.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.827+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2774172f70 con 0x7f277412db60 2026-02-20T13:17:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.829+0000 7f27717fa640 1 -- 10.20.193.28:0/1882729455 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f276401f060 con 0x7f277412db60 2026-02-20T13:17:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.830+0000 7f27717fa640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f27480b57f0 0x7f27480d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:10.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.830+0000 7f27717fa640 1 -- 10.20.193.28:0/1882729455 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f27640e6e50 con 0x7f277412db60 2026-02-20T13:17:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.831+0000 7f2773fff640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f27480b57f0 0x7f27480d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.831+0000 7f2773fff640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f27480b57f0 0x7f27480d5ca0 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2760004740 tx=0x7f2760005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:10.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.832+0000 7f27717fa640 1 -- 10.20.193.28:0/1882729455 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f27640a97a0 con 0x7f277412db60 2026-02-20T13:17:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:10.973+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f277411c650 con 0x7f277412db60 2026-02-20T13:17:11.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.411+0000 7f27717fa640 1 -- 10.20.193.28:0/1882729455 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7f27640ac950 con 0x7f277412db60 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f27480b57f0 msgr2=0x7f27480d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f27480b57f0 0x7f27480d5ca0 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2760004740 tx=0x7f2760005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277412db60 msgr2=0x7f27741092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277412db60 0x7f27741092e0 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2764005b30 tx=0x7f2764002b90 comp rx=0 tx=0).stop 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 shutdown_connections 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f27480b57f0 0x7f27480d5ca0 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277412db60 0x7f27741092e0 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f277414e720 0x7f277411ba00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 --2- 10.20.193.28:0/1882729455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2774060900 0x7f277416eb00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 >> 10.20.193.28:0/1882729455 conn(0x7f27740e8f00 msgr2=0x7f277410b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 shutdown_connections 2026-02-20T13:17:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.413+0000 7f27793b5640 1 -- 10.20.193.28:0/1882729455 wait complete. 2026-02-20T13:17:11.431 INFO:teuthology.run_tasks:Running task check-counter... 2026-02-20T13:17:11.452 INFO:teuthology.run_tasks:Running task fwd_scrub... 2026-02-20T13:17:11.473 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T13:17:11.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.590+0000 7f8ba99d2640 1 -- 10.20.193.28:0/1171905316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410c940 msgr2=0x7f8ba410cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.590+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/1171905316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410c940 0x7f8ba410cd30 secure :-1 s=READY pgs=329 gs=2 cs=0 l=1 c_cookie=4724329963510804237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b94009890 tx=0x7f8b9402f120 comp rx=0 tx=0).stop 2026-02-20T13:17:11.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 -- 10.20.193.28:0/1171905316 shutdown_connections 2026-02-20T13:17:11.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/1171905316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ba410e480 0x7f8ba416ee10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/1171905316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ba410dad0 0x7f8ba410df40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/1171905316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410c940 0x7f8ba410cd30 unknown :-1 s=CLOSED pgs=329 gs=2 cs=0 l=1 c_cookie=4724329963510804237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 -- 10.20.193.28:0/1171905316 >> 10.20.193.28:0/1171905316 conn(0x7f8ba40ea090 msgr2=0x7f8ba410a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:11.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 -- 10.20.193.28:0/1171905316 shutdown_connections 2026-02-20T13:17:11.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 -- 10.20.193.28:0/1171905316 wait complete. 2026-02-20T13:17:11.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 Processor -- start 2026-02-20T13:17:11.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 -- start start 2026-02-20T13:17:11.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ba410c940 0x7f8ba40f8200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:11.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410dad0 0x7f8ba416ee10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:11.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ba410e480 0x7f8ba40f9450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:11.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba40f8d40 con 0x7f8ba410dad0 2026-02-20T13:17:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba40f8eb0 con 0x7f8ba410e480 2026-02-20T13:17:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.591+0000 7f8ba99d2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba40f9a10 con 0x7f8ba410c940 2026-02-20T13:17:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410dad0 0x7f8ba416ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8ba89d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ba410c940 0x7f8ba40f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410dad0 0x7f8ba416ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51758/0 (socket says 10.20.193.28:51758) 2026-02-20T13:17:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 -- 10.20.193.28:0/3316084974 learned_addr learned my addr 10.20.193.28:0/3316084974 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8ba91d1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ba410e480 0x7f8ba40f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 -- 10.20.193.28:0/3316084974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ba410c940 msgr2=0x7f8ba40f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ba410c940 0x7f8ba40f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 -- 10.20.193.28:0/3316084974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ba410e480 msgr2=0x7f8ba40f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ba410e480 0x7f8ba40f9450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 -- 10.20.193.28:0/3316084974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b940094b0 con 0x7f8ba410dad0 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b9bfff640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410dad0 0x7f8ba416ee10 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b8c00e9c0 tx=0x7f8b8c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b99ffb640 1 -- 10.20.193.28:0/3316084974 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b8c00cd70 con 0x7f8ba410dad0 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b99ffb640 1 -- 10.20.193.28:0/3316084974 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8b8c004d30 con 0x7f8ba410dad0 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8b99ffb640 1 -- 10.20.193.28:0/3316084974 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b8c0106b0 con 0x7f8ba410dad0 2026-02-20T13:17:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba40f9cf0 con 0x7f8ba410dad0 2026-02-20T13:17:11.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.592+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba40fa170 con 0x7f8ba410dad0 2026-02-20T13:17:11.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.593+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba4172e80 con 0x7f8ba410dad0 2026-02-20T13:17:11.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.595+0000 7f8b99ffb640 1 -- 10.20.193.28:0/3316084974 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f8b8c01f060 con 0x7f8ba410dad0 2026-02-20T13:17:11.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.597+0000 7f8b99ffb640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b800b57f0 0x7f8b800d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:11.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.597+0000 7f8b99ffb640 1 -- 10.20.193.28:0/3316084974 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f8b8c014070 con 0x7f8ba410dad0 2026-02-20T13:17:11.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.597+0000 7f8b99ffb640 1 -- 10.20.193.28:0/3316084974 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8b8c11f730 con 0x7f8ba410dad0 2026-02-20T13:17:11.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.597+0000 7f8ba89d0640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b800b57f0 0x7f8b800d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:11.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.598+0000 7f8ba89d0640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b800b57f0 0x7f8b800d5ca0 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b940097e0 tx=0x7f8b9403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:11.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.712+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ba4172520 con 0x7f8ba410dad0 2026-02-20T13:17:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.712+0000 7f8b99ffb640 1 -- 10.20.193.28:0/3316084974 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7f8b8c096090 con 0x7f8ba410dad0 2026-02-20T13:17:11.715 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:11.716 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.713+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b800b57f0 msgr2=0x7f8b800d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.713+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b800b57f0 0x7f8b800d5ca0 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b940097e0 tx=0x7f8b9403a040 comp rx=0 tx=0).stop 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.713+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410dad0 msgr2=0x7f8ba416ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.713+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410dad0 0x7f8ba416ee10 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b8c00e9c0 tx=0x7f8b8c00ee90 comp rx=0 tx=0).stop 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.714+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 shutdown_connections 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.714+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8b800b57f0 0x7f8b800d5ca0 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.714+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba410dad0 0x7f8ba416ee10 unknown :-1 s=CLOSED pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.714+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ba410e480 0x7f8ba40f9450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.714+0000 7f8ba99d2640 1 --2- 10.20.193.28:0/3316084974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ba410c940 0x7f8ba40f8200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.714+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 >> 10.20.193.28:0/3316084974 conn(0x7f8ba40ea090 msgr2=0x7f8ba4061680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.714+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 shutdown_connections 2026-02-20T13:17:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.714+0000 7f8ba99d2640 1 -- 10.20.193.28:0/3316084974 wait complete. 2026-02-20T13:17:11.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:11 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1882729455' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2026-02-20T13:17:11.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:11 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1882729455' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2026-02-20T13:17:11.729 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-20T13:14:47.526378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2026-02-20T13:16:31.670509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2026-02-20T13:16:32.355776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-20T13:17:11.730 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-20T13:17:11.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:11 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1882729455' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2026-02-20T13:17:11.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 -- 10.20.193.28:0/2770785190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf3c10eba0 msgr2=0x7faf3c10ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 --2- 10.20.193.28:0/2770785190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf3c10eba0 0x7faf3c10ef90 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=1059688999193788519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2c009950 tx=0x7faf2c02f190 comp rx=0 tx=0).stop 2026-02-20T13:17:11.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 -- 10.20.193.28:0/2770785190 shutdown_connections 2026-02-20T13:17:11.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 --2- 10.20.193.28:0/2770785190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf3c10fd30 0x7faf3c1101a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 --2- 10.20.193.28:0/2770785190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf3c1106e0 0x7faf3c171070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 --2- 10.20.193.28:0/2770785190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf3c10eba0 0x7faf3c10ef90 unknown :-1 s=CLOSED pgs=128 gs=2 cs=0 l=1 c_cookie=1059688999193788519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 -- 10.20.193.28:0/2770785190 >> 10.20.193.28:0/2770785190 conn(0x7faf3c0ec2d0 msgr2=0x7faf3c10c700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 -- 10.20.193.28:0/2770785190 shutdown_connections 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.847+0000 7faf41e83640 1 -- 10.20.193.28:0/2770785190 wait complete. 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41e83640 1 Processor -- start 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41e83640 1 -- start start 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41e83640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf3c10eba0 0x7faf3c0f81e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41e83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf3c10fd30 0x7faf3c171070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41e83640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf3c1106e0 0x7faf3c0f8a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41e83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c0f9630 con 0x7faf3c10fd30 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41e83640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c0f97a0 con 0x7faf3c10eba0 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41e83640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c0f9960 con 0x7faf3c1106e0 2026-02-20T13:17:11.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf40e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf3c10eba0 0x7faf3c0f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf33fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf3c10fd30 0x7faf3c171070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf33fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf3c10fd30 0x7faf3c171070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51770/0 (socket says 10.20.193.28:51770) 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf33fff640 1 -- 10.20.193.28:0/4056803902 learned_addr learned my addr 10.20.193.28:0/4056803902 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.848+0000 7faf41682640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf3c1106e0 0x7faf3c0f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf33fff640 1 -- 10.20.193.28:0/4056803902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf3c1106e0 msgr2=0x7faf3c0f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf33fff640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf3c1106e0 0x7faf3c0f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf33fff640 1 -- 10.20.193.28:0/4056803902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf3c10eba0 msgr2=0x7faf3c0f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf33fff640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf3c10eba0 0x7faf3c0f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf33fff640 1 -- 10.20.193.28:0/4056803902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf240094b0 con 0x7faf3c10fd30 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf33fff640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf3c10fd30 0x7faf3c171070 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf24009fd0 tx=0x7faf24002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf31ffb640 1 -- 10.20.193.28:0/4056803902 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf2400ed60 con 0x7faf3c10fd30 2026-02-20T13:17:11.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c009570 con 0x7faf3c10fd30 2026-02-20T13:17:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf31ffb640 1 -- 10.20.193.28:0/4056803902 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faf24002e20 con 0x7faf3c10fd30 2026-02-20T13:17:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf31ffb640 1 -- 10.20.193.28:0/4056803902 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf240189f0 con 0x7faf3c10fd30 2026-02-20T13:17:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.849+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3c0f9fd0 con 0x7faf3c10fd30 2026-02-20T13:17:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.850+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf04005300 con 0x7faf3c10fd30 2026-02-20T13:17:11.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.852+0000 7faf31ffb640 1 -- 10.20.193.28:0/4056803902 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7faf24016020 con 0x7faf3c10fd30 2026-02-20T13:17:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.853+0000 7faf31ffb640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf180b57f0 0x7faf180d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.853+0000 7faf31ffb640 1 -- 10.20.193.28:0/4056803902 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7faf240e6f40 con 0x7faf3c10fd30 2026-02-20T13:17:11.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.854+0000 7faf40e81640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf180b57f0 0x7faf180d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.854+0000 7faf31ffb640 1 -- 10.20.193.28:0/4056803902 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7faf240e73c0 con 0x7faf3c10fd30 2026-02-20T13:17:11.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.855+0000 7faf40e81640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf180b57f0 0x7faf180d5ca0 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2c005b30 tx=0x7faf2c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:11.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.970+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf04005b30 con 0x7faf3c10fd30 2026-02-20T13:17:11.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.970+0000 7faf31ffb640 1 -- 10.20.193.28:0/4056803902 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7faf240a9890 con 0x7faf3c10fd30 2026-02-20T13:17:11.973 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-20T13:17:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf180b57f0 msgr2=0x7faf180d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf180b57f0 0x7faf180d5ca0 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2c005b30 tx=0x7faf2c03a040 comp rx=0 tx=0).stop 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf3c10fd30 msgr2=0x7faf3c171070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf3c10fd30 0x7faf3c171070 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf24009fd0 tx=0x7faf24002bc0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 shutdown_connections 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faf180b57f0 0x7faf180d5ca0 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf3c10fd30 0x7faf3c171070 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faf3c1106e0 0x7faf3c0f8a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 --2- 10.20.193.28:0/4056803902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faf3c10eba0 0x7faf3c0f81e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 >> 10.20.193.28:0/4056803902 conn(0x7faf3c0ec2d0 msgr2=0x7faf3c0ee870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 shutdown_connections 2026-02-20T13:17:11.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:11.971+0000 7faf41e83640 1 -- 10.20.193.28:0/4056803902 wait complete. 2026-02-20T13:17:11.986 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2026-02-20T13:17:12.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 -- 10.20.193.28:0/1153924867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 msgr2=0x7fd2d4154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/1153924867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 0x7fd2d4154650 secure :-1 s=READY pgs=332 gs=2 cs=0 l=1 c_cookie=5613381767884432581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2c4009950 tx=0x7fd2c402f190 comp rx=0 tx=0).stop 2026-02-20T13:17:12.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 -- 10.20.193.28:0/1153924867 shutdown_connections 2026-02-20T13:17:12.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/1153924867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 0x7fd2d4154650 unknown :-1 s=CLOSED pgs=332 gs=2 cs=0 l=1 c_cookie=5613381767884432581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/1153924867 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd2d4154d90 0x7fd2d4175240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/1153924867 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2d41137b0 0x7fd2d4133b90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 -- 10.20.193.28:0/1153924867 >> 10.20.193.28:0/1153924867 conn(0x7fd2d4064000 msgr2=0x7fd2d4064420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:12.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 -- 10.20.193.28:0/1153924867 shutdown_connections 2026-02-20T13:17:12.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.105+0000 7fd2d8c83640 1 -- 10.20.193.28:0/1153924867 wait complete. 2026-02-20T13:17:12.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d8c83640 1 Processor -- start 2026-02-20T13:17:12.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d8c83640 1 -- start start 2026-02-20T13:17:12.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d8c83640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2d41137b0 0x7fd2d4175240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d8c83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 0x7fd2d41545f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d8c83640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd2d4154d90 0x7fd2d40ff220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d8c83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40ff9b0 con 0x7fd2d41341d0 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d8c83640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40ffb20 con 0x7fd2d4154d90 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d8c83640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4100170 con 0x7fd2d41137b0 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 0x7fd2d41545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd2d4154d90 0x7fd2d40ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd2d4154d90 0x7fd2d40ff220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45036/0 (socket says 10.20.193.28:45036) 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 0x7fd2d41545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51788/0 (socket says 10.20.193.28:51788) 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d3fff640 1 -- 10.20.193.28:0/874423612 learned_addr learned my addr 10.20.193.28:0/874423612 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d37fe640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2d41137b0 0x7fd2d4175240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d2ffd640 1 -- 10.20.193.28:0/874423612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2d41137b0 msgr2=0x7fd2d4175240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d2ffd640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2d41137b0 0x7fd2d4175240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d2ffd640 1 -- 10.20.193.28:0/874423612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd2d4154d90 msgr2=0x7fd2d40ff220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d2ffd640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd2d4154d90 0x7fd2d40ff220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.106+0000 7fd2d2ffd640 1 -- 10.20.193.28:0/874423612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c4009570 con 0x7fd2d41341d0 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.107+0000 7fd2d2ffd640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 0x7fd2d41545f0 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2c402f6a0 tx=0x7fd2c4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.107+0000 7fd2d0ff9640 1 -- 10.20.193.28:0/874423612 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2c403d070 con 0x7fd2d41341d0 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.107+0000 7fd2d0ff9640 1 -- 10.20.193.28:0/874423612 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd2c4038920 con 0x7fd2d41341d0 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.107+0000 7fd2d0ff9640 1 -- 10.20.193.28:0/874423612 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2c4041910 con 0x7fd2d41341d0 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.107+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d41003c0 con 0x7fd2d41341d0 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.107+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d41007e0 con 0x7fd2d41341d0 2026-02-20T13:17:12.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.108+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d41795e0 con 0x7fd2d41341d0 2026-02-20T13:17:12.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.110+0000 7fd2d0ff9640 1 -- 10.20.193.28:0/874423612 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fd2c4038a90 con 0x7fd2d41341d0 2026-02-20T13:17:12.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.112+0000 7fd2d0ff9640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2a80b57f0 0x7fd2a80d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.112+0000 7fd2d0ff9640 1 -- 10.20.193.28:0/874423612 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fd2c410b420 con 0x7fd2d41341d0 2026-02-20T13:17:12.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.112+0000 7fd2d37fe640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2a80b57f0 0x7fd2a80d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.112+0000 7fd2d0ff9640 1 -- 10.20.193.28:0/874423612 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fd2c410b8a0 con 0x7fd2d41341d0 2026-02-20T13:17:12.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.112+0000 7fd2d37fe640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2a80b57f0 0x7fd2a80d5ca0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2c0004740 tx=0x7fd2c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.225+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd2d4178ca0 con 0x7fd2d41341d0 2026-02-20T13:17:12.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.226+0000 7fd2d0ff9640 1 -- 10.20.193.28:0/874423612 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) ==== 104+0+11 (secure 0 0 0) 0x7fd2c40cde80 con 0x7fd2d41341d0 2026-02-20T13:17:12.229 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 32 2026-02-20T13:17:12.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2a80b57f0 msgr2=0x7fd2a80d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2a80b57f0 0x7fd2a80d5ca0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2c0004740 tx=0x7fd2c0005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:12.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 msgr2=0x7fd2d41545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 0x7fd2d41545f0 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2c402f6a0 tx=0x7fd2c4004290 comp rx=0 tx=0).stop 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 shutdown_connections 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2a80b57f0 0x7fd2a80d5ca0 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2d41341d0 0x7fd2d41545f0 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd2d4154d90 0x7fd2d40ff220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 --2- 10.20.193.28:0/874423612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2d41137b0 0x7fd2d4175240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 >> 10.20.193.28:0/874423612 conn(0x7fd2d4064000 msgr2=0x7fd2d40f5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 shutdown_connections 2026-02-20T13:17:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.227+0000 7fd2d8c83640 1 -- 10.20.193.28:0/874423612 wait complete. 2026-02-20T13:17:12.243 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2026-02-20T13:17:12.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 -- 10.20.193.28:0/2481141275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2c0410f190 msgr2=0x7f2c0410f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2481141275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2c0410f190 0x7f2c0410f580 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=16007337171807301909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bf8009950 tx=0x7f2bf802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:12.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 -- 10.20.193.28:0/2481141275 shutdown_connections 2026-02-20T13:17:12.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2481141275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c04110cd0 0x7f2c04171660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2481141275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2c04110320 0x7f2c04110790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2481141275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2c0410f190 0x7f2c0410f580 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=16007337171807301909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 -- 10.20.193.28:0/2481141275 >> 10.20.193.28:0/2481141275 conn(0x7f2c040ec8e0 msgr2=0x7f2c0410ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:12.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 -- 10.20.193.28:0/2481141275 shutdown_connections 2026-02-20T13:17:12.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.360+0000 7f2c09a47640 1 -- 10.20.193.28:0/2481141275 wait complete. 2026-02-20T13:17:12.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c09a47640 1 Processor -- start 2026-02-20T13:17:12.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c09a47640 1 -- start start 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c09a47640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2c0410f190 0x7f2c040f8840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c09a47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c04110320 0x7f2c04171660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c09a47640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2c04110cd0 0x7f2c040f90a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c09a47640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2c040f9c90 con 0x7f2c04110320 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c09a47640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2c040f9e00 con 0x7f2c0410f190 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c09a47640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2c040f9fc0 con 0x7f2c04110cd0 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.361+0000 7f2c02ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2c0410f190 0x7f2c040f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c04110320 0x7f2c04171660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c037fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2c04110cd0 0x7f2c040f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c04110320 0x7f2c04171660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51796/0 (socket says 10.20.193.28:51796) 2026-02-20T13:17:12.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 -- 10.20.193.28:0/2389624316 learned_addr learned my addr 10.20.193.28:0/2389624316 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 -- 10.20.193.28:0/2389624316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2c04110cd0 msgr2=0x7f2c040f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2c04110cd0 0x7f2c040f90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 -- 10.20.193.28:0/2389624316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2c0410f190 msgr2=0x7f2c040f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2c0410f190 0x7f2c040f8840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 -- 10.20.193.28:0/2389624316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf400a590 con 0x7f2c04110320 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c027fc640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c04110320 0x7f2c04171660 secure :-1 s=READY pgs=334 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bec009480 tx=0x7f2bec00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c08a45640 1 -- 10.20.193.28:0/2389624316 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2bec00cd40 con 0x7f2c04110320 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf8009570 con 0x7f2c04110320 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c08a45640 1 -- 10.20.193.28:0/2389624316 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2bec004d30 con 0x7f2c04110320 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c08a45640 1 -- 10.20.193.28:0/2389624316 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2bec010740 con 0x7f2c04110320 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.362+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c040fa5e0 con 0x7f2c04110320 2026-02-20T13:17:12.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.363+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c041756d0 con 0x7f2c04110320 2026-02-20T13:17:12.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.365+0000 7f2c08a45640 1 -- 10.20.193.28:0/2389624316 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f2bec01f060 con 0x7f2c04110320 2026-02-20T13:17:12.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.367+0000 7f2c08a45640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2bd80b57f0 0x7f2bd80d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.367+0000 7f2c08a45640 1 -- 10.20.193.28:0/2389624316 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f2bec014070 con 0x7f2c04110320 2026-02-20T13:17:12.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.367+0000 7f2c02ffd640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2bd80b57f0 0x7f2bd80d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.368+0000 7f2c02ffd640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2bd80b57f0 0x7f2bd80d5ca0 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bf80098a0 tx=0x7f2bf803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:12.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.368+0000 7f2c08a45640 1 -- 10.20.193.28:0/2389624316 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f2bec0a9710 con 0x7f2c04110320 2026-02-20T13:17:12.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.482+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2c04174d90 con 0x7f2c04110320 2026-02-20T13:17:12.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.482+0000 7f2c08a45640 1 -- 10.20.193.28:0/2389624316 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) ==== 100+0+11 (secure 0 0 0) 0x7f2bec0ac8c0 con 0x7f2c04110320 2026-02-20T13:17:12.485 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 64 2026-02-20T13:17:12.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2bd80b57f0 msgr2=0x7f2bd80d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2bd80b57f0 0x7f2bd80d5ca0 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bf80098a0 tx=0x7f2bf803a040 comp rx=0 tx=0).stop 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c04110320 msgr2=0x7f2c04171660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c04110320 0x7f2c04171660 secure :-1 s=READY pgs=334 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bec009480 tx=0x7f2bec00ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 shutdown_connections 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2bd80b57f0 0x7f2bd80d5ca0 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c04110320 0x7f2c04171660 unknown :-1 s=CLOSED pgs=334 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2c04110cd0 0x7f2c040f90a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 --2- 10.20.193.28:0/2389624316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2c0410f190 0x7f2c040f8840 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 >> 10.20.193.28:0/2389624316 conn(0x7f2c040ec8e0 msgr2=0x7f2c040eeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.483+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 shutdown_connections 2026-02-20T13:17:12.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.484+0000 7f2c09a47640 1 -- 10.20.193.28:0/2389624316 wait complete. 2026-02-20T13:17:12.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:12 trial028 ceph-mon[37442]: pgmap v175: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-20T13:17:12.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:12 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1882729455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2026-02-20T13:17:12.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:12 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:12.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:12 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3316084974' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:12.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:12 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4056803902' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:17:12.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:12 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/874423612' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-20T13:17:12.498 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2026-02-20T13:17:12.498 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:12.686 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:12 trial127 ceph-mon[43817]: pgmap v175: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-20T13:17:12.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:12 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1882729455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2026-02-20T13:17:12.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:12 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:12.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:12 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3316084974' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:12.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:12 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4056803902' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:17:12.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:12 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/874423612' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-20T13:17:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:12 trial034 ceph-mon[43332]: pgmap v175: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-20T13:17:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:12 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1882729455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2026-02-20T13:17:12.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:12 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:12.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:12 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3316084974' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:12.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:12 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4056803902' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:17:12.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:12 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/874423612' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-20T13:17:12.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/277673919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea41156a0 msgr2=0x7f4ea4176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/277673919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea41156a0 0x7f4ea4176070 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=10327773653353247869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea000aa30 tx=0x7f4ea0030270 comp rx=0 tx=0).stop 2026-02-20T13:17:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/277673919 shutdown_connections 2026-02-20T13:17:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/277673919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea41156a0 0x7f4ea4176070 unknown :-1 s=CLOSED pgs=130 gs=2 cs=0 l=1 c_cookie=10327773653353247869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/277673919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea410fea0 0x7f4ea4114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/277673919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea410f4b0 0x7f4ea410f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/277673919 >> 10.20.193.28:0/277673919 conn(0x7f4ea40ecda0 msgr2=0x7f4ea410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/277673919 shutdown_connections 2026-02-20T13:17:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.861+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/277673919 wait complete. 2026-02-20T13:17:12.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.862+0000 7f4ea9ad6640 1 Processor -- start 2026-02-20T13:17:12.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.862+0000 7f4ea9ad6640 1 -- start start 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea9ad6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea410f4b0 0x7f4ea411ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea9ad6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea410fea0 0x7f4ea411e300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea9ad6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea41156a0 0x7f4ea41236d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea9ad6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4123cf0 con 0x7f4ea41156a0 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea9ad6640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4123e60 con 0x7f4ea410fea0 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea9ad6640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4124020 con 0x7f4ea410f4b0 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea410f4b0 0x7f4ea411ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4e9bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea410fea0 0x7f4ea411e300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea410f4b0 0x7f4ea411ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45052/0 (socket says 10.20.193.28:45052) 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 -- 10.20.193.28:0/591733185 learned_addr learned my addr 10.20.193.28:0/591733185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:12.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea92d5640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea41156a0 0x7f4ea41236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 -- 10.20.193.28:0/591733185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea410fea0 msgr2=0x7f4ea411e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea410fea0 0x7f4ea411e300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 -- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea41156a0 msgr2=0x7f4ea41236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea41156a0 0x7f4ea41236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 -- 10.20.193.28:0/591733185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c0094b0 con 0x7f4ea410f4b0 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.863+0000 7f4ea8ad4640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea410f4b0 0x7f4ea411ddc0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e94009480 tx=0x7f4e9400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.864+0000 7f4e99ffb640 1 -- 10.20.193.28:0/591733185 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e9400cd40 con 0x7f4ea410f4b0 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.864+0000 7f4e99ffb640 1 -- 10.20.193.28:0/591733185 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4e94004d30 con 0x7f4ea410f4b0 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.864+0000 7f4e99ffb640 1 -- 10.20.193.28:0/591733185 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e940106b0 con 0x7f4ea410f4b0 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.864+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea000a650 con 0x7f4ea410f4b0 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.864+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea4164860 con 0x7f4ea410f4b0 2026-02-20T13:17:12.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.864+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea4110790 con 0x7f4ea410f4b0 2026-02-20T13:17:12.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.866+0000 7f4e99ffb640 1 -- 10.20.193.28:0/591733185 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f4e9401f060 con 0x7f4ea410f4b0 2026-02-20T13:17:12.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.868+0000 7f4e99ffb640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e800b57f0 0x7f4e800d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:12.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.868+0000 7f4e99ffb640 1 -- 10.20.193.28:0/591733185 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4e94014070 con 0x7f4ea410f4b0 2026-02-20T13:17:12.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.868+0000 7f4e9bfff640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e800b57f0 0x7f4e800d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:12.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.868+0000 7f4e99ffb640 1 -- 10.20.193.28:0/591733185 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f4e9411f730 con 0x7f4ea410f4b0 2026-02-20T13:17:12.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:12.869+0000 7f4e9bfff640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e800b57f0 0x7f4e800d5ca0 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea4124760 tx=0x7f4e8c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:13.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.012+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ea411ef20 con 0x7f4ea410f4b0 2026-02-20T13:17:13.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.013+0000 7f4e99ffb640 1 -- 10.20.193.28:0/591733185 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11996 (secure 0 0 0) 0x7f4e940a95d0 con 0x7f4ea410f4b0 2026-02-20T13:17:13.018 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:13.018 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T13:17:11:407313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:10.974665+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:17:13.019 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T13:17:13.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.015+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e800b57f0 msgr2=0x7f4e800d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.015+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e800b57f0 0x7f4e800d5ca0 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea4124760 tx=0x7f4e8c005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:13.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.015+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea410f4b0 msgr2=0x7f4ea411ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.015+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea410f4b0 0x7f4ea411ddc0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e94009480 tx=0x7f4e9400ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:13.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.016+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 shutdown_connections 2026-02-20T13:17:13.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.016+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e800b57f0 0x7f4e800d5ca0 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.016+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea41156a0 0x7f4ea41236d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.016+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea410fea0 0x7f4ea411e300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.016+0000 7f4ea9ad6640 1 --2- 10.20.193.28:0/591733185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea410f4b0 0x7f4ea411ddc0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.016+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 >> 10.20.193.28:0/591733185 conn(0x7f4ea40ecda0 msgr2=0x7f4ea410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:13.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.016+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 shutdown_connections 2026-02-20T13:17:13.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.016+0000 7f4ea9ad6640 1 -- 10.20.193.28:0/591733185 wait complete. 2026-02-20T13:17:13.120 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2026-02-20T13:17:13.121 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2026-02-20T13:17:13.121 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:17:13.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.239+0000 7f6627577640 1 -- 10.20.193.28:0/1595571509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6628154dd0 msgr2=0x7f6628175280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.239+0000 7f6627577640 1 --2- 10.20.193.28:0/1595571509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6628154dd0 0x7f6628175280 secure :-1 s=READY pgs=335 gs=2 cs=0 l=1 c_cookie=18182953222713842762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f661800aa30 tx=0x7f6618030270 comp rx=0 tx=0).stop 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.239+0000 7f6627577640 1 -- 10.20.193.28:0/1595571509 shutdown_connections 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.239+0000 7f6627577640 1 --2- 10.20.193.28:0/1595571509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6628154dd0 0x7f6628175280 unknown :-1 s=CLOSED pgs=335 gs=2 cs=0 l=1 c_cookie=18182953222713842762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.239+0000 7f6627577640 1 --2- 10.20.193.28:0/1595571509 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f66281141c0 0x7f6628154690 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.239+0000 7f6627577640 1 --2- 10.20.193.28:0/1595571509 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66281137b0 0x7f6628113ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.239+0000 7f6627577640 1 -- 10.20.193.28:0/1595571509 >> 10.20.193.28:0/1595571509 conn(0x7f6628064030 msgr2=0x7f6628064450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.239+0000 7f6627577640 1 -- 10.20.193.28:0/1595571509 shutdown_connections 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 -- 10.20.193.28:0/1595571509 wait complete. 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 Processor -- start 2026-02-20T13:17:13.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 -- start start 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66281137b0 0x7f6628154690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66281141c0 0x7f66281751b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6628154dd0 0x7f66280ff110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f66280ff8a0 con 0x7f66281141c0 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f66280ffa10 con 0x7f6628154dd0 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.240+0000 7f6627577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6628100070 con 0x7f66281137b0 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6626575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66281137b0 0x7f6628154690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6625d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66281141c0 0x7f66281751b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6626575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66281137b0 0x7f6628154690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45078/0 (socket says 10.20.193.28:45078) 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6626575640 1 -- 10.20.193.28:0/1322471392 learned_addr learned my addr 10.20.193.28:0/1322471392 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6626d76640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6628154dd0 0x7f66280ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6625d74640 1 -- 10.20.193.28:0/1322471392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66281137b0 msgr2=0x7f6628154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6625d74640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66281137b0 0x7f6628154690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6625d74640 1 -- 10.20.193.28:0/1322471392 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6628154dd0 msgr2=0x7f66280ff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6625d74640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6628154dd0 0x7f66280ff110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6625d74640 1 -- 10.20.193.28:0/1322471392 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661800a650 con 0x7f66281141c0 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6625d74640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66281141c0 0x7f66281751b0 secure :-1 s=READY pgs=336 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f661000e9c0 tx=0x7f661000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f660f7fe640 1 -- 10.20.193.28:0/1322471392 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f661000ccb0 con 0x7f66281141c0 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f660f7fe640 1 -- 10.20.193.28:0/1322471392 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f661000ce10 con 0x7f66281141c0 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f660f7fe640 1 -- 10.20.193.28:0/1322471392 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66100106b0 con 0x7f66281141c0 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6628100350 con 0x7f66281141c0 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.241+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66281007d0 con 0x7f66281141c0 2026-02-20T13:17:13.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.242+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66281795d0 con 0x7f66281141c0 2026-02-20T13:17:13.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.244+0000 7f660f7fe640 1 -- 10.20.193.28:0/1322471392 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f661001f060 con 0x7f66281141c0 2026-02-20T13:17:13.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.245+0000 7f660f7fe640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66000b57f0 0x7f66000d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.245+0000 7f660f7fe640 1 -- 10.20.193.28:0/1322471392 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6610014070 con 0x7f66281141c0 2026-02-20T13:17:13.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.246+0000 7f660f7fe640 1 -- 10.20.193.28:0/1322471392 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f661011f730 con 0x7f66281141c0 2026-02-20T13:17:13.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.246+0000 7f6626575640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66000b57f0 0x7f66000d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.246+0000 7f6626575640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66000b57f0 0x7f66000d5ca0 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f661c009590 tx=0x7f661c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.357+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6628100b60 con 0x7f66000b57f0 2026-02-20T13:17:13.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.360+0000 7f660f7fe640 1 -- 10.20.193.28:0/1322471392 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259005 (secure 0 0 0) 0x7f6628100b60 con 0x7f66000b57f0 2026-02-20T13:17:13.366 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:13.367 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66000b57f0 msgr2=0x7f66000d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66000b57f0 0x7f66000d5ca0 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f661c009590 tx=0x7f661c005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66281141c0 msgr2=0x7f66281751b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66281141c0 0x7f66281751b0 secure :-1 s=READY pgs=336 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f661000e9c0 tx=0x7f661000ee90 comp rx=0 tx=0).stop 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 shutdown_connections 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66000b57f0 0x7f66000d5ca0 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66281141c0 0x7f66281751b0 unknown :-1 s=CLOSED pgs=336 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6628154dd0 0x7f66280ff110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 --2- 10.20.193.28:0/1322471392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66281137b0 0x7f6628154690 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 >> 10.20.193.28:0/1322471392 conn(0x7f6628064030 msgr2=0x7f66280f4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:13.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 shutdown_connections 2026-02-20T13:17:13.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.362+0000 7f6627577640 1 -- 10.20.193.28:0/1322471392 wait complete. 2026-02-20T13:17:13.378 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2026-02-20T13:17:13.338706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668892,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":466,"num_read_kb":353,"num_write":436,"num_write_kb":3873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335236,"kb_used_data":10644,"kb_used_omap":470,"kb_used_meta":323881,"kb_avail":8807703164,"statfs":{"total":9019431321600,"available":9019088039936,"internally_reserved":0,"allocated":10899456,"data_stored":6933432,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":482113,"internal_metadata":331654335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":53,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002420"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.090221+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:17:11.090221+0000","last_peered":"2026-02-20T13:17:11.090221+0000","last_clean":"2026-02-20T13:17:11.090221+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:17:11.090221+0000","last_undegraded":"2026-02-20T13:17:11.090221+0000","last_fullsized":"2026-02-20T13:17:11.090221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'5","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.098919+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:17:10.098919+0000","last_peered":"2026-02-20T13:17:10.098919+0000","last_clean":"2026-02-20T13:17:10.098919+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:17:10.098919+0000","last_undegraded":"2026-02-20T13:17:10.098919+0000","last_fullsized":"2026-02-20T13:17:10.098919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'35","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.096561+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:17:10.096561+0000","last_peered":"2026-02-20T13:17:10.096561+0000","last_clean":"2026-02-20T13:17:10.096561+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:17:10.096561+0000","last_undegraded":"2026-02-20T13:17:10.096561+0000","last_fullsized":"2026-02-20T13:17:10.096561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71042,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":105,"num_write":37,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:07.099597+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:17:07.099597+0000","last_peered":"2026-02-20T13:17:07.099597+0000","last_clean":"2026-02-20T13:17:07.099597+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:17:07.099597+0000","last_undegraded":"2026-02-20T13:17:07.099597+0000","last_fullsized":"2026-02-20T13:17:07.099597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.099707+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:17:11.099707+0000","last_peered":"2026-02-20T13:17:11.099707+0000","last_clean":"2026-02-20T13:17:11.099707+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:17:11.099707+0000","last_undegraded":"2026-02-20T13:17:11.099707+0000","last_fullsized":"2026-02-20T13:17:11.099707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079144+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:39.079144+0000","last_peered":"2026-02-20T13:16:39.079144+0000","last_clean":"2026-02-20T13:16:39.079144+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:39.079144+0000","last_undegraded":"2026-02-20T13:16:39.079144+0000","last_fullsized":"2026-02-20T13:16:39.079144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":53,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:08.099107+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:17:08.099107+0000","last_peered":"2026-02-20T13:17:08.099107+0000","last_clean":"2026-02-20T13:17:08.099107+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:17:08.099107+0000","last_undegraded":"2026-02-20T13:17:08.099107+0000","last_fullsized":"2026-02-20T13:17:08.099107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.102398+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:17:11.102398+0000","last_peered":"2026-02-20T13:17:11.102398+0000","last_clean":"2026-02-20T13:17:11.102398+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:17:11.102398+0000","last_undegraded":"2026-02-20T13:17:11.102398+0000","last_fullsized":"2026-02-20T13:17:11.102398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.625539+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:35.625539+0000","last_peered":"2026-02-20T13:16:35.625539+0000","last_clean":"2026-02-20T13:16:35.625539+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:35.625539+0000","last_undegraded":"2026-02-20T13:16:35.625539+0000","last_fullsized":"2026-02-20T13:16:35.625539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.768390+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:47.768390+0000","last_peered":"2026-02-20T13:16:47.768390+0000","last_clean":"2026-02-20T13:16:47.768390+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:47.768390+0000","last_undegraded":"2026-02-20T13:16:47.768390+0000","last_fullsized":"2026-02-20T13:16:47.768390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079979+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:39.079979+0000","last_peered":"2026-02-20T13:16:39.079979+0000","last_clean":"2026-02-20T13:16:39.079979+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:39.079979+0000","last_undegraded":"2026-02-20T13:16:39.079979+0000","last_fullsized":"2026-02-20T13:16:39.079979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:08.099052+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:17:08.099052+0000","last_peered":"2026-02-20T13:17:08.099052+0000","last_clean":"2026-02-20T13:17:08.099052+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:17:08.099052+0000","last_undegraded":"2026-02-20T13:17:08.099052+0000","last_fullsized":"2026-02-20T13:17:08.099052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78290,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":360,"num_read_kb":262,"num_write":245,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":234564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185581,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612622,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27964,"kb_used_data":1000,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975236,"statfs":{"total":751619276800,"available":751590641664,"internally_reserved":0,"allocated":1024000,"data_stored":1074003,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972368,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":34,"kb_used_meta":27165,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35051,"internal_metadata":27817749},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234003,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36782,"internal_metadata":27553874},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1005001,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593750,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":844,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":864256,"data_stored":411453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855385,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":1004291,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":411724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44499,"internal_metadata":27546157},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215132,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":45,"kb_used_meta":27154,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46410,"internal_metadata":27806390},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27900,"kb_used_data":936,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975300,"statfs":{"total":751619276800,"available":751590707200,"internally_reserved":0,"allocated":958464,"data_stored":483956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27880,"kb_used_data":916,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975320,"statfs":{"total":751619276800,"available":751590727680,"internally_reserved":0,"allocated":937984,"data_stored":483146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45658,"internal_metadata":27544998},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3840,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6750,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15030,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29976,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:17:13.385 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:17:13.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 -- 10.20.193.28:0/1451440630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf68110320 msgr2=0x7fdf68110790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 --2- 10.20.193.28:0/1451440630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf68110320 0x7fdf68110790 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=6660828272872497446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf50009950 tx=0x7fdf5002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 -- 10.20.193.28:0/1451440630 shutdown_connections 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 --2- 10.20.193.28:0/1451440630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf68110320 0x7fdf68110790 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=6660828272872497446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 --2- 10.20.193.28:0/1451440630 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf68110cd0 0x7fdf68171660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 --2- 10.20.193.28:0/1451440630 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdf6810f190 0x7fdf6810f580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 -- 10.20.193.28:0/1451440630 >> 10.20.193.28:0/1451440630 conn(0x7fdf680ec8e0 msgr2=0x7fdf6810ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 -- 10.20.193.28:0/1451440630 shutdown_connections 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.534+0000 7fdf6ceb8640 1 -- 10.20.193.28:0/1451440630 wait complete. 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf6ceb8640 1 Processor -- start 2026-02-20T13:17:13.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf6ceb8640 1 -- start start 2026-02-20T13:17:13.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf6ceb8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf6810f190 0x7fdf680f87f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf6ceb8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf68110320 0x7fdf68171640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf6ceb8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdf68110cd0 0x7fdf680f9030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf6ceb8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdf680f9c90 con 0x7fdf6810f190 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf6ceb8640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdf680f9e00 con 0x7fdf68110cd0 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf6ceb8640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdf680f9fc0 con 0x7fdf68110320 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf6810f190 0x7fdf680f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf6810f190 0x7fdf680f87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51870/0 (socket says 10.20.193.28:51870) 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 -- 10.20.193.28:0/1264598915 learned_addr learned my addr 10.20.193.28:0/1264598915 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66d76640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdf68110cd0 0x7fdf680f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf65d74640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf68110320 0x7fdf68171640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 -- 10.20.193.28:0/1264598915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf68110320 msgr2=0x7fdf68171640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf68110320 0x7fdf68171640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 -- 10.20.193.28:0/1264598915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdf68110cd0 msgr2=0x7fdf680f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdf68110cd0 0x7fdf680f9030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 -- 10.20.193.28:0/1264598915 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf50009570 con 0x7fdf6810f190 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf65d74640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf68110320 0x7fdf68171640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.535+0000 7fdf66575640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf6810f190 0x7fdf680f87f0 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf5c00d950 tx=0x7fdf5c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.536+0000 7fdf4f7fe640 1 -- 10.20.193.28:0/1264598915 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf5c004540 con 0x7fdf6810f190 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.536+0000 7fdf4f7fe640 1 -- 10.20.193.28:0/1264598915 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdf5c009d00 con 0x7fdf6810f190 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.536+0000 7fdf4f7fe640 1 -- 10.20.193.28:0/1264598915 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf5c0106e0 con 0x7fdf6810f190 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.536+0000 7fdf6ceb8640 1 -- 10.20.193.28:0/1264598915 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf680fa2a0 con 0x7fdf6810f190 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.536+0000 7fdf6ceb8640 1 -- 10.20.193.28:0/1264598915 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf680fa720 con 0x7fdf6810f190 2026-02-20T13:17:13.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.537+0000 7fdf4d7fa640 1 -- 10.20.193.28:0/1264598915 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf681756d0 con 0x7fdf6810f190 2026-02-20T13:17:13.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.539+0000 7fdf4f7fe640 1 -- 10.20.193.28:0/1264598915 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fdf5c0097c0 con 0x7fdf6810f190 2026-02-20T13:17:13.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.541+0000 7fdf4f7fe640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdf400b5770 0x7fdf400d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.541+0000 7fdf4f7fe640 1 -- 10.20.193.28:0/1264598915 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fdf5c0e6fb0 con 0x7fdf6810f190 2026-02-20T13:17:13.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.541+0000 7fdf4f7fe640 1 -- 10.20.193.28:0/1264598915 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fdf5c0e7430 con 0x7fdf6810f190 2026-02-20T13:17:13.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.541+0000 7fdf65d74640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdf400b5770 0x7fdf400d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.542+0000 7fdf65d74640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdf400b5770 0x7fdf400d5c20 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf500098a0 tx=0x7fdf50031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:13.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.653+0000 7fdf4d7fa640 1 -- 10.20.193.28:0/1264598915 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf6810f580 con 0x7fdf400b5770 2026-02-20T13:17:13.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.656+0000 7fdf4f7fe640 1 -- 10.20.193.28:0/1264598915 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259005 (secure 0 0 0) 0x7fdf6810f580 con 0x7fdf400b5770 2026-02-20T13:17:13.661 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:13.663 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:17:13.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 -- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdf400b5770 msgr2=0x7fdf400d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdf400b5770 0x7fdf400d5c20 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf500098a0 tx=0x7fdf50031040 comp rx=0 tx=0).stop 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 -- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf6810f190 msgr2=0x7fdf680f87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf6810f190 0x7fdf680f87f0 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf5c00d950 tx=0x7fdf5c00de20 comp rx=0 tx=0).stop 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 -- 10.20.193.28:0/1264598915 shutdown_connections 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdf400b5770 0x7fdf400d5c20 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdf68110cd0 0x7fdf680f9030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf68110320 0x7fdf68171640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 --2- 10.20.193.28:0/1264598915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf6810f190 0x7fdf680f87f0 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 -- 10.20.193.28:0/1264598915 >> 10.20.193.28:0/1264598915 conn(0x7fdf680ec8e0 msgr2=0x7fdf680eee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:13.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 -- 10.20.193.28:0/1264598915 shutdown_connections 2026-02-20T13:17:13.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.658+0000 7fdf4d7fa640 1 -- 10.20.193.28:0/1264598915 wait complete. 2026-02-20T13:17:13.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:13 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2389624316' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-20T13:17:13.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:13 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/591733185' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:13.673 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2026-02-20T13:17:13.338706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668892,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":466,"num_read_kb":353,"num_write":436,"num_write_kb":3873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335236,"kb_used_data":10644,"kb_used_omap":470,"kb_used_meta":323881,"kb_avail":8807703164,"statfs":{"total":9019431321600,"available":9019088039936,"internally_reserved":0,"allocated":10899456,"data_stored":6933432,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":482113,"internal_metadata":331654335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":53,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002420"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.090221+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:17:11.090221+0000","last_peered":"2026-02-20T13:17:11.090221+0000","last_clean":"2026-02-20T13:17:11.090221+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:17:11.090221+0000","last_undegraded":"2026-02-20T13:17:11.090221+0000","last_fullsized":"2026-02-20T13:17:11.090221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'5","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.098919+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:17:10.098919+0000","last_peered":"2026-02-20T13:17:10.098919+0000","last_clean":"2026-02-20T13:17:10.098919+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:17:10.098919+0000","last_undegraded":"2026-02-20T13:17:10.098919+0000","last_fullsized":"2026-02-20T13:17:10.098919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'35","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.096561+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:17:10.096561+0000","last_peered":"2026-02-20T13:17:10.096561+0000","last_clean":"2026-02-20T13:17:10.096561+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:17:10.096561+0000","last_undegraded":"2026-02-20T13:17:10.096561+0000","last_fullsized":"2026-02-20T13:17:10.096561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71042,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":105,"num_write":37,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:07.099597+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:17:07.099597+0000","last_peered":"2026-02-20T13:17:07.099597+0000","last_clean":"2026-02-20T13:17:07.099597+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:17:07.099597+0000","last_undegraded":"2026-02-20T13:17:07.099597+0000","last_fullsized":"2026-02-20T13:17:07.099597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.099707+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:17:11.099707+0000","last_peered":"2026-02-20T13:17:11.099707+0000","last_clean":"2026-02-20T13:17:11.099707+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:17:11.099707+0000","last_undegraded":"2026-02-20T13:17:11.099707+0000","last_fullsized":"2026-02-20T13:17:11.099707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079144+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:39.079144+0000","last_peered":"2026-02-20T13:16:39.079144+0000","last_clean":"2026-02-20T13:16:39.079144+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:39.079144+0000","last_undegraded":"2026-02-20T13:16:39.079144+0000","last_fullsized":"2026-02-20T13:16:39.079144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":53,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:08.099107+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:17:08.099107+0000","last_peered":"2026-02-20T13:17:08.099107+0000","last_clean":"2026-02-20T13:17:08.099107+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:17:08.099107+0000","last_undegraded":"2026-02-20T13:17:08.099107+0000","last_fullsized":"2026-02-20T13:17:08.099107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.102398+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:17:11.102398+0000","last_peered":"2026-02-20T13:17:11.102398+0000","last_clean":"2026-02-20T13:17:11.102398+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:17:11.102398+0000","last_undegraded":"2026-02-20T13:17:11.102398+0000","last_fullsized":"2026-02-20T13:17:11.102398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.625539+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:35.625539+0000","last_peered":"2026-02-20T13:16:35.625539+0000","last_clean":"2026-02-20T13:16:35.625539+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:35.625539+0000","last_undegraded":"2026-02-20T13:16:35.625539+0000","last_fullsized":"2026-02-20T13:16:35.625539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.768390+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:47.768390+0000","last_peered":"2026-02-20T13:16:47.768390+0000","last_clean":"2026-02-20T13:16:47.768390+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:47.768390+0000","last_undegraded":"2026-02-20T13:16:47.768390+0000","last_fullsized":"2026-02-20T13:16:47.768390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079979+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:39.079979+0000","last_peered":"2026-02-20T13:16:39.079979+0000","last_clean":"2026-02-20T13:16:39.079979+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:39.079979+0000","last_undegraded":"2026-02-20T13:16:39.079979+0000","last_fullsized":"2026-02-20T13:16:39.079979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:08.099052+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:17:08.099052+0000","last_peered":"2026-02-20T13:17:08.099052+0000","last_clean":"2026-02-20T13:17:08.099052+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:17:08.099052+0000","last_undegraded":"2026-02-20T13:17:08.099052+0000","last_fullsized":"2026-02-20T13:17:08.099052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78290,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":360,"num_read_kb":262,"num_write":245,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":234564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185581,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612622,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27964,"kb_used_data":1000,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975236,"statfs":{"total":751619276800,"available":751590641664,"internally_reserved":0,"allocated":1024000,"data_stored":1074003,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972368,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":34,"kb_used_meta":27165,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35051,"internal_metadata":27817749},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234003,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36782,"internal_metadata":27553874},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1005001,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593750,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":844,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":864256,"data_stored":411453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855385,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":1004291,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":411724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44499,"internal_metadata":27546157},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215132,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":45,"kb_used_meta":27154,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46410,"internal_metadata":27806390},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27900,"kb_used_data":936,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975300,"statfs":{"total":751619276800,"available":751590707200,"internally_reserved":0,"allocated":958464,"data_stored":483956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27880,"kb_used_data":916,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975320,"statfs":{"total":751619276800,"available":751590727680,"internally_reserved":0,"allocated":937984,"data_stored":483146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45658,"internal_metadata":27544998},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3840,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6750,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15030,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29976,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:17:13.680 INFO:tasks.fwd_scrub.ceph_manager:clean! 2026-02-20T13:17:13.680 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:17:13.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:13 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2389624316' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-20T13:17:13.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:13 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/591733185' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:13.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:13 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2389624316' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-20T13:17:13.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:13 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/591733185' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:13.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 -- 10.20.193.28:0/3833871567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 msgr2=0x7f1f40154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3833871567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 0x7f1f40154690 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=5255939450780110972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f28009950 tx=0x7f1f2802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:13.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 -- 10.20.193.28:0/3833871567 shutdown_connections 2026-02-20T13:17:13.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3833871567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 0x7f1f40154690 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=5255939450780110972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3833871567 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1f40154dd0 0x7f1f40175280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3833871567 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1f401137b0 0x7f1f40113ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 -- 10.20.193.28:0/3833871567 >> 10.20.193.28:0/3833871567 conn(0x7f1f40064030 msgr2=0x7f1f40064450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:13.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 -- 10.20.193.28:0/3833871567 shutdown_connections 2026-02-20T13:17:13.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.831+0000 7f1f4582f640 1 -- 10.20.193.28:0/3833871567 wait complete. 2026-02-20T13:17:13.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f4582f640 1 Processor -- start 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f4582f640 1 -- start start 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f4582f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1f401137b0 0x7f1f40175280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f4582f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 0x7f1f40154630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f4582f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1f40154dd0 0x7f1f400ff1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f4582f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f400ff980 con 0x7f1f401141c0 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f4582f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1f400ffaf0 con 0x7f1f401137b0 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f4582f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1f40100130 con 0x7f1f40154dd0 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f37fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 0x7f1f40154630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f37fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 0x7f1f40154630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51900/0 (socket says 10.20.193.28:51900) 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.832+0000 7f1f37fff640 1 -- 10.20.193.28:0/3420016628 learned_addr learned my addr 10.20.193.28:0/3420016628 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f4482d640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1f401137b0 0x7f1f40175280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f4502e640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1f40154dd0 0x7f1f400ff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f37fff640 1 -- 10.20.193.28:0/3420016628 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1f40154dd0 msgr2=0x7f1f400ff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f37fff640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1f40154dd0 0x7f1f400ff1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f37fff640 1 -- 10.20.193.28:0/3420016628 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1f401137b0 msgr2=0x7f1f40175280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f37fff640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1f401137b0 0x7f1f40175280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f37fff640 1 -- 10.20.193.28:0/3420016628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f28009570 con 0x7f1f401141c0 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f4482d640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1f401137b0 0x7f1f40175280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f37fff640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 0x7f1f40154630 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f28005b30 tx=0x7f1f280028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f35ffb640 1 -- 10.20.193.28:0/3420016628 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f2803d070 con 0x7f1f401141c0 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f35ffb640 1 -- 10.20.193.28:0/3420016628 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1f28002a40 con 0x7f1f401141c0 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f35ffb640 1 -- 10.20.193.28:0/3420016628 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f28041a70 con 0x7f1f401141c0 2026-02-20T13:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f401003b0 con 0x7f1f401141c0 2026-02-20T13:17:13.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.833+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f401007d0 con 0x7f1f401141c0 2026-02-20T13:17:13.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.834+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f40179620 con 0x7f1f401141c0 2026-02-20T13:17:13.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.836+0000 7f1f35ffb640 1 -- 10.20.193.28:0/3420016628 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f1f28038920 con 0x7f1f401141c0 2026-02-20T13:17:13.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.838+0000 7f1f35ffb640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1f1c0b5770 0x7f1f1c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:13.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.838+0000 7f1f35ffb640 1 -- 10.20.193.28:0/3420016628 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f1f2810b990 con 0x7f1f401141c0 2026-02-20T13:17:13.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.838+0000 7f1f4482d640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1f1c0b5770 0x7f1f1c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:13.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.838+0000 7f1f35ffb640 1 -- 10.20.193.28:0/3420016628 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f1f28144750 con 0x7f1f401141c0 2026-02-20T13:17:13.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.838+0000 7f1f4482d640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1f1c0b5770 0x7f1f1c0d5c20 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f40066d70 tx=0x7f1f30005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:13.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.950+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f40100a60 con 0x7f1f1c0b5770 2026-02-20T13:17:13.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.953+0000 7f1f35ffb640 1 -- 10.20.193.28:0/3420016628 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259005 (secure 0 0 0) 0x7f1f40100a60 con 0x7f1f1c0b5770 2026-02-20T13:17:13.958 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:13.960 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1f1c0b5770 msgr2=0x7f1f1c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1f1c0b5770 0x7f1f1c0d5c20 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f40066d70 tx=0x7f1f30005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 msgr2=0x7f1f40154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 0x7f1f40154630 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f28005b30 tx=0x7f1f280028d0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 shutdown_connections 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1f1c0b5770 0x7f1f1c0d5c20 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f401141c0 0x7f1f40154630 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1f40154dd0 0x7f1f400ff1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 --2- 10.20.193.28:0/3420016628 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1f401137b0 0x7f1f40175280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 >> 10.20.193.28:0/3420016628 conn(0x7f1f40064030 msgr2=0x7f1f400f4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 shutdown_connections 2026-02-20T13:17:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:13.955+0000 7f1f4582f640 1 -- 10.20.193.28:0/3420016628 wait complete. 2026-02-20T13:17:13.970 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2026-02-20T13:17:13.338706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668892,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":466,"num_read_kb":353,"num_write":436,"num_write_kb":3873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335236,"kb_used_data":10644,"kb_used_omap":470,"kb_used_meta":323881,"kb_avail":8807703164,"statfs":{"total":9019431321600,"available":9019088039936,"internally_reserved":0,"allocated":10899456,"data_stored":6933432,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":482113,"internal_metadata":331654335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":53,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002420"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.090221+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:17:11.090221+0000","last_peered":"2026-02-20T13:17:11.090221+0000","last_clean":"2026-02-20T13:17:11.090221+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:17:11.090221+0000","last_undegraded":"2026-02-20T13:17:11.090221+0000","last_fullsized":"2026-02-20T13:17:11.090221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'5","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.098919+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:17:10.098919+0000","last_peered":"2026-02-20T13:17:10.098919+0000","last_clean":"2026-02-20T13:17:10.098919+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:17:10.098919+0000","last_undegraded":"2026-02-20T13:17:10.098919+0000","last_fullsized":"2026-02-20T13:17:10.098919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'35","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.096561+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:17:10.096561+0000","last_peered":"2026-02-20T13:17:10.096561+0000","last_clean":"2026-02-20T13:17:10.096561+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:17:10.096561+0000","last_undegraded":"2026-02-20T13:17:10.096561+0000","last_fullsized":"2026-02-20T13:17:10.096561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71042,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":105,"num_write":37,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:07.099597+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:17:07.099597+0000","last_peered":"2026-02-20T13:17:07.099597+0000","last_clean":"2026-02-20T13:17:07.099597+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:17:07.099597+0000","last_undegraded":"2026-02-20T13:17:07.099597+0000","last_fullsized":"2026-02-20T13:17:07.099597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.099707+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:17:11.099707+0000","last_peered":"2026-02-20T13:17:11.099707+0000","last_clean":"2026-02-20T13:17:11.099707+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:17:11.099707+0000","last_undegraded":"2026-02-20T13:17:11.099707+0000","last_fullsized":"2026-02-20T13:17:11.099707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079144+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:39.079144+0000","last_peered":"2026-02-20T13:16:39.079144+0000","last_clean":"2026-02-20T13:16:39.079144+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:39.079144+0000","last_undegraded":"2026-02-20T13:16:39.079144+0000","last_fullsized":"2026-02-20T13:16:39.079144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":53,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:08.099107+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:17:08.099107+0000","last_peered":"2026-02-20T13:17:08.099107+0000","last_clean":"2026-02-20T13:17:08.099107+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:17:08.099107+0000","last_undegraded":"2026-02-20T13:17:08.099107+0000","last_fullsized":"2026-02-20T13:17:08.099107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.102398+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:17:11.102398+0000","last_peered":"2026-02-20T13:17:11.102398+0000","last_clean":"2026-02-20T13:17:11.102398+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:17:11.102398+0000","last_undegraded":"2026-02-20T13:17:11.102398+0000","last_fullsized":"2026-02-20T13:17:11.102398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.625539+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:35.625539+0000","last_peered":"2026-02-20T13:16:35.625539+0000","last_clean":"2026-02-20T13:16:35.625539+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:35.625539+0000","last_undegraded":"2026-02-20T13:16:35.625539+0000","last_fullsized":"2026-02-20T13:16:35.625539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.768390+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:47.768390+0000","last_peered":"2026-02-20T13:16:47.768390+0000","last_clean":"2026-02-20T13:16:47.768390+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:47.768390+0000","last_undegraded":"2026-02-20T13:16:47.768390+0000","last_fullsized":"2026-02-20T13:16:47.768390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079979+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:39.079979+0000","last_peered":"2026-02-20T13:16:39.079979+0000","last_clean":"2026-02-20T13:16:39.079979+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:39.079979+0000","last_undegraded":"2026-02-20T13:16:39.079979+0000","last_fullsized":"2026-02-20T13:16:39.079979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:08.099052+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:17:08.099052+0000","last_peered":"2026-02-20T13:17:08.099052+0000","last_clean":"2026-02-20T13:17:08.099052+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:17:08.099052+0000","last_undegraded":"2026-02-20T13:17:08.099052+0000","last_fullsized":"2026-02-20T13:17:08.099052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78290,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":360,"num_read_kb":262,"num_write":245,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":234564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185581,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612622,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27964,"kb_used_data":1000,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975236,"statfs":{"total":751619276800,"available":751590641664,"internally_reserved":0,"allocated":1024000,"data_stored":1074003,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972368,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":34,"kb_used_meta":27165,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35051,"internal_metadata":27817749},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234003,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36782,"internal_metadata":27553874},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1005001,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593750,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":844,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":864256,"data_stored":411453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855385,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":1004291,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":411724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44499,"internal_metadata":27546157},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215132,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":45,"kb_used_meta":27154,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46410,"internal_metadata":27806390},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27900,"kb_used_data":936,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975300,"statfs":{"total":751619276800,"available":751590707200,"internally_reserved":0,"allocated":958464,"data_stored":483956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27880,"kb_used_data":916,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975320,"statfs":{"total":751619276800,"available":751590727680,"internally_reserved":0,"allocated":937984,"data_stored":483146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45658,"internal_metadata":27544998},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3840,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6750,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15030,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29976,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:17:13.977 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:14.197 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:14.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 -- 10.20.193.28:0/2255316709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec10f230 msgr2=0x7f48ec10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:14.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 --2- 10.20.193.28:0/2255316709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec10f230 0x7f48ec10f600 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=55926692870767901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48e0009950 tx=0x7f48e002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:14.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 -- 10.20.193.28:0/2255316709 shutdown_connections 2026-02-20T13:17:14.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 --2- 10.20.193.28:0/2255316709 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48ec115420 0x7f48ec175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 --2- 10.20.193.28:0/2255316709 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f48ec10fc20 0x7f48ec114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 --2- 10.20.193.28:0/2255316709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec10f230 0x7f48ec10f600 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=55926692870767901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 -- 10.20.193.28:0/2255316709 >> 10.20.193.28:0/2255316709 conn(0x7f48ec05f830 msgr2=0x7f48ec10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:14.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 -- 10.20.193.28:0/2255316709 shutdown_connections 2026-02-20T13:17:14.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.364+0000 7f48f17ff640 1 -- 10.20.193.28:0/2255316709 wait complete. 2026-02-20T13:17:14.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48f17ff640 1 Processor -- start 2026-02-20T13:17:14.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48f17ff640 1 -- start start 2026-02-20T13:17:14.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48f17ff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f48ec10f230 0x7f48ec11db40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:14.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48f17ff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48ec10fc20 0x7f48ec11e080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:14.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48f17ff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec115420 0x7f48ec123450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:14.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48f17ff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec123a70 con 0x7f48ec115420 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48f17ff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec123be0 con 0x7f48ec10f230 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48f17ff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec123da0 con 0x7f48ec10fc20 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48eb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec115420 0x7f48ec123450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48eaffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f48ec10f230 0x7f48ec11db40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48ea7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48ec10fc20 0x7f48ec11e080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48eb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec115420 0x7f48ec123450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51910/0 (socket says 10.20.193.28:51910) 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.365+0000 7f48eb7fe640 1 -- 10.20.193.28:0/3895673858 learned_addr learned my addr 10.20.193.28:0/3895673858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48eb7fe640 1 -- 10.20.193.28:0/3895673858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48ec10fc20 msgr2=0x7f48ec11e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48eb7fe640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48ec10fc20 0x7f48ec11e080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48eb7fe640 1 -- 10.20.193.28:0/3895673858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f48ec10f230 msgr2=0x7f48ec11db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:14.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48eb7fe640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f48ec10f230 0x7f48ec11db40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48eb7fe640 1 -- 10.20.193.28:0/3895673858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e0009570 con 0x7f48ec115420 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48eb7fe640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec115420 0x7f48ec123450 secure :-1 s=READY pgs=342 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48dc00f8d0 tx=0x7f48dc00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48cbfff640 1 -- 10.20.193.28:0/3895673858 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f48dc00dce0 con 0x7f48ec115420 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48cbfff640 1 -- 10.20.193.28:0/3895673858 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f48dc00de40 con 0x7f48ec115420 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48cbfff640 1 -- 10.20.193.28:0/3895673858 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f48dc0116b0 con 0x7f48ec115420 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ec124080 con 0x7f48ec115420 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.366+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ec164780 con 0x7f48ec115420 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.367+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ec1242a0 con 0x7f48ec115420 2026-02-20T13:17:14.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.369+0000 7f48cbfff640 1 -- 10.20.193.28:0/3895673858 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f48dc020060 con 0x7f48ec115420 2026-02-20T13:17:14.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.371+0000 7f48cbfff640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48c00b57f0 0x7f48c00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:14.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.371+0000 7f48cbfff640 1 -- 10.20.193.28:0/3895673858 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f48dc015070 con 0x7f48ec115420 2026-02-20T13:17:14.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.371+0000 7f48eaffd640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48c00b57f0 0x7f48c00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:14.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.372+0000 7f48eaffd640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48c00b57f0 0x7f48c00d5ca0 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48e00098a0 tx=0x7f48e003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:14.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.372+0000 7f48cbfff640 1 -- 10.20.193.28:0/3895673858 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f48dc0aa570 con 0x7f48ec115420 2026-02-20T13:17:14.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.512+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48ec110510 con 0x7f48ec115420 2026-02-20T13:17:14.516 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:14 trial028 ceph-mon[37442]: pgmap v176: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:17:14.516 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:14 trial028 ceph-mon[37442]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:14.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.513+0000 7f48cbfff640 1 -- 10.20.193.28:0/3895673858 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11996 (secure 0 0 0) 0x7f48dc0ad720 con 0x7f48ec115420 2026-02-20T13:17:14.517 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:14.517 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T13:17:11:407313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:10.974665+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48c00b57f0 msgr2=0x7f48c00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48c00b57f0 0x7f48c00d5ca0 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48e00098a0 tx=0x7f48e003a040 comp rx=0 tx=0).stop 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec115420 msgr2=0x7f48ec123450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec115420 0x7f48ec123450 secure :-1 s=READY pgs=342 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48dc00f8d0 tx=0x7f48dc00fda0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 shutdown_connections 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48c00b57f0 0x7f48c00d5ca0 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48ec115420 0x7f48ec123450 unknown :-1 s=CLOSED pgs=342 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48ec10fc20 0x7f48ec11e080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 --2- 10.20.193.28:0/3895673858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f48ec10f230 0x7f48ec11db40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 >> 10.20.193.28:0/3895673858 conn(0x7f48ec05f830 msgr2=0x7f48ec10cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:14.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 shutdown_connections 2026-02-20T13:17:14.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.514+0000 7f48f17ff640 1 -- 10.20.193.28:0/3895673858 wait complete. 2026-02-20T13:17:14.617 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:17:14.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:14 trial127 ceph-mon[43817]: pgmap v176: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:17:14.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:14 trial127 ceph-mon[43817]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:14.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:14 trial034 ceph-mon[43332]: pgmap v176: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:17:14.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:14 trial034 ceph-mon[43332]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:14.804 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 -- 10.20.193.28:0/1082826159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410dc30 msgr2=0x7fa2c4112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/1082826159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410dc30 0x7fa2c4112c80 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=1144492159987624099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b8009950 tx=0x7fa2b802f1d0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 -- 10.20.193.28:0/1082826159 shutdown_connections 2026-02-20T13:17:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/1082826159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410dc30 0x7fa2c4112c80 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=1144492159987624099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/1082826159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa2c4113430 0x7fa2c4173e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/1082826159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa2c410d240 0x7fa2c410d610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 -- 10.20.193.28:0/1082826159 >> 10.20.193.28:0/1082826159 conn(0x7fa2c40eaad0 msgr2=0x7fa2c410aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 -- 10.20.193.28:0/1082826159 shutdown_connections 2026-02-20T13:17:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 -- 10.20.193.28:0/1082826159 wait complete. 2026-02-20T13:17:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.974+0000 7fa2ca8df640 1 Processor -- start 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca8df640 1 -- start start 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca8df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410d240 0x7fa2c40f56f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca8df640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa2c410dc30 0x7fa2c4173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca8df640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa2c4113430 0x7fa2c40f5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca8df640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c40fb000 con 0x7fa2c410d240 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca8df640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c40fb170 con 0x7fa2c410dc30 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca8df640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c40fb330 con 0x7fa2c4113430 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c90dc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa2c410dc30 0x7fa2c4173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c98dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410d240 0x7fa2c40f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:14.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca0de640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa2c4113430 0x7fa2c40f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c90dc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa2c410dc30 0x7fa2c4173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45134/0 (socket says 10.20.193.28:45134) 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c90dc640 1 -- 10.20.193.28:0/3093980062 learned_addr learned my addr 10.20.193.28:0/3093980062 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2ca0de640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa2c4113430 0x7fa2c40f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45164/0 (socket says 10.20.193.28:45164) 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c98dd640 1 -- 10.20.193.28:0/3093980062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa2c4113430 msgr2=0x7fa2c40f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c98dd640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa2c4113430 0x7fa2c40f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c98dd640 1 -- 10.20.193.28:0/3093980062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa2c410dc30 msgr2=0x7fa2c4173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c98dd640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa2c410dc30 0x7fa2c4173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.975+0000 7fa2c98dd640 1 -- 10.20.193.28:0/3093980062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b8009570 con 0x7fa2c410d240 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.976+0000 7fa2c98dd640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410d240 0x7fa2c40f56f0 secure :-1 s=READY pgs=344 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b400d720 tx=0x7fa2b400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.976+0000 7fa2b2ffd640 1 -- 10.20.193.28:0/3093980062 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2b4004500 con 0x7fa2c410d240 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.976+0000 7fa2b2ffd640 1 -- 10.20.193.28:0/3093980062 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa2b4004d30 con 0x7fa2c410d240 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.976+0000 7fa2b2ffd640 1 -- 10.20.193.28:0/3093980062 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2b40052a0 con 0x7fa2c410d240 2026-02-20T13:17:14.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.976+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c40fb610 con 0x7fa2c410d240 2026-02-20T13:17:14.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.976+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c40fba90 con 0x7fa2c410d240 2026-02-20T13:17:14.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.976+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c410e520 con 0x7fa2c410d240 2026-02-20T13:17:14.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.979+0000 7fa2b2ffd640 1 -- 10.20.193.28:0/3093980062 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fa2b4005430 con 0x7fa2c410d240 2026-02-20T13:17:14.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.980+0000 7fa2b2ffd640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa2a00b57e0 0x7fa2a00d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:14.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.980+0000 7fa2b2ffd640 1 -- 10.20.193.28:0/3093980062 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fa2b40e68e0 con 0x7fa2c410d240 2026-02-20T13:17:14.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.980+0000 7fa2b2ffd640 1 -- 10.20.193.28:0/3093980062 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fa2b411f730 con 0x7fa2c410d240 2026-02-20T13:17:14.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.980+0000 7fa2c90dc640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa2a00b57e0 0x7fa2a00d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:14.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:14.981+0000 7fa2c90dc640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa2a00b57e0 0x7fa2a00d5c90 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b8005b30 tx=0x7fa2b803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.094+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2c40f6850 con 0x7fa2c410d240 2026-02-20T13:17:15.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.095+0000 7fa2b2ffd640 1 -- 10.20.193.28:0/3093980062 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7fa2b40a92e0 con 0x7fa2c410d240 2026-02-20T13:17:15.099 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:15.099 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:17:15.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.096+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa2a00b57e0 msgr2=0x7fa2a00d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.096+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa2a00b57e0 0x7fa2a00d5c90 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b8005b30 tx=0x7fa2b803a040 comp rx=0 tx=0).stop 2026-02-20T13:17:15.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.096+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410d240 msgr2=0x7fa2c40f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.096+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410d240 0x7fa2c40f56f0 secure :-1 s=READY pgs=344 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b400d720 tx=0x7fa2b400dbf0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.097+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 shutdown_connections 2026-02-20T13:17:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.097+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa2a00b57e0 0x7fa2a00d5c90 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.097+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa2c4113430 0x7fa2c40f5df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.097+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa2c410dc30 0x7fa2c4173d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.097+0000 7fa2ca8df640 1 --2- 10.20.193.28:0/3093980062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c410d240 0x7fa2c40f56f0 unknown :-1 s=CLOSED pgs=344 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.097+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 >> 10.20.193.28:0/3093980062 conn(0x7fa2c40eaad0 msgr2=0x7fa2c410fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.097+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 shutdown_connections 2026-02-20T13:17:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.097+0000 7fa2ca8df640 1 -- 10.20.193.28:0/3093980062 wait complete. 2026-02-20T13:17:15.199 DEBUG:tasks.fwd_scrub:Yielding 2026-02-20T13:17:15.199 INFO:teuthology.run_tasks:Running task background_exec... 2026-02-20T13:17:15.217 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T13:17:15.217 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2026-02-20T13:17:15.218 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2026-02-20T13:17:15.218 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:17:15.218 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:17:15.222 INFO:teuthology.run_tasks:Running task quiescer... 2026-02-20T13:17:15.249 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-20T13:17:15.249 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T13:17:15.403 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:15.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:15 trial028 ceph-mon[37442]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:15.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:15 trial028 ceph-mon[37442]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:15.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:15 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3895673858' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:15.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:15 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3093980062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:15.434 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:15.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 -- 10.20.193.28:0/4291079279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 msgr2=0x7f14ec176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 --2- 10.20.193.28:0/4291079279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 0x7f14ec176070 secure :-1 s=READY pgs=104 gs=3 cs=0 l=1 c_cookie=7408936392666433000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e800a970 tx=0x7f14e80301b0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 -- 10.20.193.28:0/4291079279 shutdown_connections 2026-02-20T13:17:15.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 --2- 10.20.193.28:0/4291079279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10fea0 0x7f14ec114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 --2- 10.20.193.28:0/4291079279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 0x7f14ec176070 unknown :-1 s=CLOSED pgs=104 gs=3 cs=0 l=1 c_cookie=7408936392666433000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 --2- 10.20.193.28:0/4291079279 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f4b0 0x7f14ec10f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 -- 10.20.193.28:0/4291079279 >> 10.20.193.28:0/4291079279 conn(0x7f14ec0ecda0 msgr2=0x7f14ec10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 -- 10.20.193.28:0/4291079279 shutdown_connections 2026-02-20T13:17:15.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.580+0000 7f14f280b640 1 -- 10.20.193.28:0/4291079279 wait complete. 2026-02-20T13:17:15.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.581+0000 7f14f280b640 1 Processor -- start 2026-02-20T13:17:15.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.581+0000 7f14f280b640 1 -- start start 2026-02-20T13:17:15.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.581+0000 7f14f280b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f4b0 0x7f14ec11ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.581+0000 7f14f280b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10fea0 0x7f14ec11e300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.581+0000 7f14f280b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 0x7f14ec1236d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.581+0000 7f14f280b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec123cf0 con 0x7f14ec10fea0 2026-02-20T13:17:15.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.581+0000 7f14f280b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec123e60 con 0x7f14ec10f4b0 2026-02-20T13:17:15.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.581+0000 7f14f280b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec124020 con 0x7f14ec1156a0 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10fea0 0x7f14ec11e300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10fea0 0x7f14ec11e300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51936/0 (socket says 10.20.193.28:51936) 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 -- 10.20.193.28:0/3427869410 learned_addr learned my addr 10.20.193.28:0/3427869410 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f200a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 0x7f14ec1236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1809640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f4b0 0x7f14ec11ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 -- 10.20.193.28:0/3427869410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 msgr2=0x7f14ec1236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 0x7f14ec1236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 -- 10.20.193.28:0/3427869410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f4b0 msgr2=0x7f14ec11ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f4b0 0x7f14ec11ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 -- 10.20.193.28:0/3427869410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e00094b0 con 0x7f14ec10fea0 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f200a640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 0x7f14ec1236d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f1008640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10fea0 0x7f14ec11e300 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e0009fd0 tx=0x7f14e0002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14daffd640 1 -- 10.20.193.28:0/3427869410 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14e000ed60 con 0x7f14ec10fea0 2026-02-20T13:17:15.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14daffd640 1 -- 10.20.193.28:0/3427869410 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14e0002e20 con 0x7f14ec10fea0 2026-02-20T13:17:15.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14daffd640 1 -- 10.20.193.28:0/3427869410 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14e00189f0 con 0x7f14ec10fea0 2026-02-20T13:17:15.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f280b640 1 -- 10.20.193.28:0/3427869410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e800a590 con 0x7f14ec10fea0 2026-02-20T13:17:15.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.582+0000 7f14f280b640 1 -- 10.20.193.28:0/3427869410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec164860 con 0x7f14ec10fea0 2026-02-20T13:17:15.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.586+0000 7f14daffd640 1 -- 10.20.193.28:0/3427869410 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f14e0016020 con 0x7f14ec10fea0 2026-02-20T13:17:15.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.587+0000 7f14daffd640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c80b5870 0x7f14c80d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.587+0000 7f14daffd640 1 -- 10.20.193.28:0/3427869410 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f14e00e6d40 con 0x7f14ec10fea0 2026-02-20T13:17:15.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.587+0000 7f14f1809640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c80b5870 0x7f14c80d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.588+0000 7f14f1809640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c80b5870 0x7f14c80d5d20 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc005b30 tx=0x7f14dc009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.588+0000 7f14f5a8ee00 1 Processor -- start 2026-02-20T13:17:15.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f5a8ee00 1 -- start start 2026-02-20T13:17:15.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd2a37e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2e8480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd308da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd1b9a20 con 0x55b9cd2a3d20 2026-02-20T13:17:15.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd1b5750 con 0x55b9cd2a3410 2026-02-20T13:17:15.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd1af6f0 con 0x55b9cd2e89c0 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f200a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd308da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f200a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd308da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45192/0 (socket says 10.20.193.28:45192) 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f200a640 1 -- 10.20.193.28:0/771146374 learned_addr learned my addr 10.20.193.28:0/771146374 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f1008640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2e8480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f1809640 1 --2- 10.20.193.28:0/771146374 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd2a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f1008640 1 -- 10.20.193.28:0/771146374 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 msgr2=0x55b9cd308da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f1008640 1 --2- 10.20.193.28:0/771146374 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd308da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f1008640 1 -- 10.20.193.28:0/771146374 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 msgr2=0x55b9cd2a37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f1008640 1 --2- 10.20.193.28:0/771146374 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd2a37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.589+0000 7f14f1008640 1 -- 10.20.193.28:0/771146374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cd15b120 con 0x55b9cd2a3d20 2026-02-20T13:17:15.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f1008640 1 --2- 10.20.193.28:0/771146374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2e8480 secure :-1 s=READY pgs=346 gs=2 cs=0 l=1 c_cookie=8126212790472236245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e00a9610 tx=0x7f14e0002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c61b7a79555cd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14ba4e6640 1 -- 10.20.193.28:0/771146374 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14e00ada40 con 0x55b9cd2a3d20 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14ba4e6640 1 -- 10.20.193.28:0/771146374 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14e00b2d60 con 0x55b9cd2a3d20 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14ba4e6640 1 -- 10.20.193.28:0/771146374 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14e00ada40 con 0x55b9cd2a3d20 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/771146374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 msgr2=0x55b9cd2e8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/771146374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2e8480 secure :-1 s=READY pgs=346 gs=2 cs=0 l=1 c_cookie=8126212790472236245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e00a9610 tx=0x7f14e0002f90 comp rx=0 tx=0).stop 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/771146374 shutdown_connections 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/771146374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2e8480 unknown :-1 s=CLOSED pgs=346 gs=2 cs=0 l=1 c_cookie=8126212790472236245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/771146374 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd308da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/771146374 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd2a37e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/771146374 >> 10.20.193.28:0/771146374 conn(0x55b9cd281910 msgr2=0x55b9cd2a1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/771146374 shutdown_connections 2026-02-20T13:17:15.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.590+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/771146374 wait complete. 2026-02-20T13:17:15.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f5a8ee00 1 -- start start 2026-02-20T13:17:15.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f5a8ee00 1 Processor -- start 2026-02-20T13:17:15.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2c5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2c6120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2c9ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd2ca1e0 con 0x55b9cd2a3410 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd2ca350 con 0x55b9cd2a3d20 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd2ca510 con 0x55b9cd2e89c0 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f200a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f1809640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f200a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45208/0 (socket says 10.20.193.28:45208) 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f200a640 1 -- 10.20.193.28:0/255519703 learned_addr learned my addr 10.20.193.28:0/255519703 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.592+0000 7f14f1008640 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14f1809640 1 -- 10.20.193.28:0/255519703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 msgr2=0x55b9cd2c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14f1809640 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14f1809640 1 -- 10.20.193.28:0/255519703 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3d20 msgr2=0x55b9cd2c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14f1809640 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14f1809640 1 -- 10.20.193.28:0/255519703 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cd133810 con 0x55b9cd2a3410 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14f1809640 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2c5be0 secure :-1 s=READY pgs=347 gs=2 cs=0 l=1 c_cookie=1991200110924011746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc004460 tx=0x7f14dc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba229f3785818e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14a77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14a77fe640 1 -- 10.20.193.28:0/255519703 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14dc021070 con 0x55b9cd2a3410 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14a77fe640 1 -- 10.20.193.28:0/255519703 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14dc019900 con 0x55b9cd2a3410 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14a77fe640 1 -- 10.20.193.28:0/255519703 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14dc01ca00 con 0x55b9cd2a3410 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.593+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec164860 con 0x55b9cd2a3410 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14a77fe640 1 -- 10.20.193.28:0/255519703 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f14dc01c410 con 0x55b9cd2a3410 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 10 client.15348 _ll_register_callbacks cb 0x55b9cd166b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9cce459d0 con 0x55b9cd2a3410 2026-02-20T13:17:15.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14a77fe640 1 -- 10.20.193.28:0/255519703 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f14dc01cb90 con 0x55b9cd2a3410 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 10 client.15348 fetch_fsmap learned FSMap version 24 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55b9cd1454f0 con 0x55b9cd2a3410 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14a77fe640 1 -- 10.20.193.28:0/255519703 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f14dc02d060 con 0x55b9cd2a3410 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 10 client.15348 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 10 client.15348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 20 client.15348 populate_metadata read hostname 'trial028' 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b9cd2cef80 0x55b9cd2cf420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 4 client.15348 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.594+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9cd1bcdf0 con 0x55b9cd2cef80 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.595+0000 7f14f1008640 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b9cd2cef80 0x55b9cd2cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.595+0000 7f14f1008640 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b9cd2cef80 0x55b9cd2cf420 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=8632639291552841184 s_cookie=8941425033755411707 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77cd4bb2af163de0 server_cookie=7c1652b1cac6c4fb in_seq=0 out_seq=0 2026-02-20T13:17:15.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.595+0000 7f14a77fe640 10 client.15348 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14a77fe640 1 -- 10.20.193.28:0/255519703 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b9cd1bcdf0 con 0x55b9cd2cef80 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14a77fe640 10 client.15348 handle_command_reply: tid=0 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 client.15348 shutdown 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 msgr2=0x55b9cd2c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2c5be0 secure :-1 s=READY pgs=347 gs=2 cs=0 l=1 c_cookie=1991200110924011746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc004460 tx=0x7f14dc0047e0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 shutdown_connections 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b9cd2cef80 0x55b9cd2cf420 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=8632639291552841184 s_cookie=8941425033755411707 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2c9ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2c6120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14a77fe640 0 client.15348 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:15.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/255519703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2c5be0 unknown :-1 s=CLOSED pgs=347 gs=2 cs=0 l=1 c_cookie=1991200110924011746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 >> 10.20.193.28:0/255519703 conn(0x55b9cd281910 msgr2=0x55b9cd28aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 shutdown_connections 2026-02-20T13:17:15.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/255519703 wait complete. 2026-02-20T13:17:15.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.596+0000 7f14f5a8ee00 20 client.15348 trim_cache size 0 max 16384 2026-02-20T13:17:15.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 -- 10.20.193.28:0/1463798579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0062ae0 msgr2=0x7fb1e0060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 --2- 10.20.193.28:0/1463798579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0062ae0 0x7fb1e0060fb0 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=13253801943862396467 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1d0009950 tx=0x7fb1d002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 -- 10.20.193.28:0/1463798579 shutdown_connections 2026-02-20T13:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 --2- 10.20.193.28:0/1463798579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1e0159af0 0x7fb1e0179ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 --2- 10.20.193.28:0/1463798579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1e00614f0 0x7fb1e0061920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 --2- 10.20.193.28:0/1463798579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0062ae0 0x7fb1e0060fb0 unknown :-1 s=CLOSED pgs=131 gs=1 cs=0 l=1 c_cookie=13253801943862396467 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 -- 10.20.193.28:0/1463798579 >> 10.20.193.28:0/1463798579 conn(0x7fb1e005f830 msgr2=0x7fb1e010ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 -- 10.20.193.28:0/1463798579 shutdown_connections 2026-02-20T13:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.603+0000 7fb1e7fcf640 1 -- 10.20.193.28:0/1463798579 wait complete. 2026-02-20T13:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.604+0000 7fb1e7fcf640 1 Processor -- start 2026-02-20T13:17:15.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.604+0000 7fb1e7fcf640 1 -- start start 2026-02-20T13:17:15.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.604+0000 7fb1e7fcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1e00614f0 0x7fb1e00f2ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.604+0000 7fb1e7fcf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1e0062ae0 0x7fb1e00f3220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.604+0000 7fb1e7fcf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0159af0 0x7fb1e00f85f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.604+0000 7fb1e7fcf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00f8c10 con 0x7fb1e00614f0 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.604+0000 7fb1e7fcf640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00f8d80 con 0x7fb1e0159af0 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e7fcf640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00f8f40 con 0x7fb1e0062ae0 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0159af0 0x7fb1e00f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e5d44640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1e00614f0 0x7fb1e00f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0159af0 0x7fb1e00f85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45188/0 (socket says 10.20.193.28:45188) 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 -- 10.20.193.28:0/195544742 learned_addr learned my addr 10.20.193.28:0/195544742 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e5543640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1e0062ae0 0x7fb1e00f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 -- 10.20.193.28:0/195544742 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1e0062ae0 msgr2=0x7fb1e00f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1e0062ae0 0x7fb1e00f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 -- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1e00614f0 msgr2=0x7fb1e00f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1e00614f0 0x7fb1e00f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 -- 10.20.193.28:0/195544742 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d0009570 con 0x7fb1e0159af0 2026-02-20T13:17:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e5d44640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1e00614f0 0x7fb1e00f2ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.605+0000 7fb1e6545640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0159af0 0x7fb1e00f85f0 secure :-1 s=READY pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1dc006e90 tx=0x7fb1dc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f5a8ee00 1 Processor -- start 2026-02-20T13:17:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f5a8ee00 1 -- start start 2026-02-20T13:17:15.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7fb1ceffd640 1 -- 10.20.193.28:0/195544742 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1dc005500 con 0x7fb1e0159af0 2026-02-20T13:17:15.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7fb1ceffd640 1 -- 10.20.193.28:0/195544742 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb1dc005e10 con 0x7fb1e0159af0 2026-02-20T13:17:15.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7fb1ceffd640 1 -- 10.20.193.28:0/195544742 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1dc003a90 con 0x7fb1e0159af0 2026-02-20T13:17:15.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7fb1e7fcf640 1 -- 10.20.193.28:0/195544742 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e00f9220 con 0x7fb1e0159af0 2026-02-20T13:17:15.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7fb1e7fcf640 1 -- 10.20.193.28:0/195544742 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e010ad10 con 0x7fb1e0159af0 2026-02-20T13:17:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd28df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd28e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2a0b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd1ad320 con 0x55b9cd2a3d20 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b9cce6d790 con 0x55b9cd2a3410 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd2c9db0 con 0x55b9cd2e89c0 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1809640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd28df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1809640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd28df00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45194/0 (socket says 10.20.193.28:45194) 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1809640 1 -- 10.20.193.28:0/2005792008 learned_addr learned my addr 10.20.193.28:0/2005792008 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f200a640 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1008640 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd28e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1809640 1 -- 10.20.193.28:0/2005792008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 msgr2=0x55b9cd2a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1809640 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1809640 1 -- 10.20.193.28:0/2005792008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 msgr2=0x55b9cd28e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1809640 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd28e440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.606+0000 7f14f1809640 1 -- 10.20.193.28:0/2005792008 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cd282340 con 0x55b9cd2a3410 2026-02-20T13:17:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f1809640 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd28df00 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=11542587983439137671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc0316a0 tx=0x7f14dc02b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a02f829d9d950b87 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7fb1ccff9640 1 -- 10.20.193.28:0/195544742 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e00f9440 con 0x7fb1e0159af0 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14b9ce5640 1 -- 10.20.193.28:0/2005792008 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14dc021070 con 0x55b9cd2a3410 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14b9ce5640 1 -- 10.20.193.28:0/2005792008 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14dc036060 con 0x55b9cd2a3410 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14b9ce5640 1 -- 10.20.193.28:0/2005792008 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14dc01cea0 con 0x55b9cd2a3410 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/2005792008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 msgr2=0x55b9cd28df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd28df00 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=11542587983439137671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc0316a0 tx=0x7f14dc02b000 comp rx=0 tx=0).stop 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/2005792008 shutdown_connections 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3d20 0x55b9cd28e440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2a0b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/2005792008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2a3410 0x55b9cd28df00 unknown :-1 s=CLOSED pgs=133 gs=1 cs=0 l=1 c_cookie=11542587983439137671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/2005792008 >> 10.20.193.28:0/2005792008 conn(0x55b9cd281910 msgr2=0x55b9cd2952f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/2005792008 shutdown_connections 2026-02-20T13:17:15.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.607+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/2005792008 wait complete. 2026-02-20T13:17:15.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.608+0000 7f14f5a8ee00 1 -- start start 2026-02-20T13:17:15.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f5a8ee00 1 Processor -- start 2026-02-20T13:17:15.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.609+0000 7fb1ceffd640 1 -- 10.20.193.28:0/195544742 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fb1dc00c840 con 0x7fb1e0159af0 2026-02-20T13:17:15.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2dc910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2dce50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f5a8ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2dd390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f1809640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f1008640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f1008640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2dce50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45230/0 (socket says 10.20.193.28:45230) 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f200a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f200a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2dd390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45202/0 (socket says 10.20.193.28:45202) 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f1809640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2dc910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51974/0 (socket says 10.20.193.28:51974) 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd3ae4a0 con 0x55b9cd2a3410 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd3ae610 con 0x55b9cd2e89c0 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f5a8ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b9cd3ae7d0 con 0x55b9cd2a3d20 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.610+0000 7f14f1008640 1 -- 10.20.193.28:0/417141618 learned_addr learned my addr 10.20.193.28:0/417141618 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:15.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f1008640 1 -- 10.20.193.28:0/417141618 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2e89c0 msgr2=0x55b9cd2dd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f1008640 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2dd390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f1008640 1 -- 10.20.193.28:0/417141618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 msgr2=0x55b9cd2dc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f1008640 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2dc910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f1008640 1 -- 10.20.193.28:0/417141618 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cd13ff70 con 0x55b9cd2a3d20 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f1809640 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2dc910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f1008640 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2dce50 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=13078741366263886151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e00d2010 tx=0x7f14e00184a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58105fa7d5db147 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14a77fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14a77fe640 1 -- 10.20.193.28:0/417141618 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14e00c4ea0 con 0x55b9cd2a3d20 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14a77fe640 1 -- 10.20.193.28:0/417141618 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14e006f070 con 0x55b9cd2a3d20 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14a77fe640 1 -- 10.20.193.28:0/417141618 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14e00adf50 con 0x55b9cd2a3d20 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9cd1454f0 con 0x55b9cd2a3d20 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14a77fe640 1 -- 10.20.193.28:0/417141618 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f14e00b7cf0 con 0x55b9cd2a3d20 2026-02-20T13:17:15.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f5a8ee00 10 client.25285 _ll_register_callbacks cb 0x55b9cd166b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:15.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.611+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14e00b2d60 con 0x55b9cd2a3d20 2026-02-20T13:17:15.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14a77fe640 1 -- 10.20.193.28:0/417141618 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f14e0010de0 con 0x55b9cd2a3d20 2026-02-20T13:17:15.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14f5a8ee00 10 client.25285 fetch_fsmap learned FSMap version 24 2026-02-20T13:17:15.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55b9cd133b40 con 0x55b9cd2a3d20 2026-02-20T13:17:15.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14a77fe640 1 -- 10.20.193.28:0/417141618 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f14e00721d0 con 0x55b9cd2a3d20 2026-02-20T13:17:15.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7fb1ceffd640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1bc0b57f0 0x7fb1bc0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14f5a8ee00 10 client.25285 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T13:17:15.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14f5a8ee00 10 client.25285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:15.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14f5a8ee00 20 client.25285 populate_metadata read hostname 'trial028' 2026-02-20T13:17:15.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b9cd3b0070 0x55b9cd3d0520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:15.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14f5a8ee00 4 client.25285 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:17:15.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b9cce43220 con 0x55b9cd3b0070 2026-02-20T13:17:15.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7fb1ceffd640 1 -- 10.20.193.28:0/195544742 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fb1dc0e7530 con 0x7fb1e0159af0 2026-02-20T13:17:15.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.612+0000 7fb1e5d44640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1bc0b57f0 0x7fb1bc0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.613+0000 7f14f1809640 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b9cd3b0070 0x55b9cd3d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:15.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.613+0000 7fb1e5d44640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1bc0b57f0 0x7fb1bc0d5ca0 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1d0038820 tx=0x7fb1d003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:15.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.613+0000 7fb1ceffd640 1 -- 10.20.193.28:0/195544742 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fb1dc0a9e80 con 0x7fb1e0159af0 2026-02-20T13:17:15.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.613+0000 7f14f1809640 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b9cd3b0070 0x55b9cd3d0520 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=3978804666134348019 s_cookie=11189103657847461603 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37378dc3639ac0f3 server_cookie=9b47ae7e910596e3 in_seq=0 out_seq=0 2026-02-20T13:17:15.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.613+0000 7f14a77fe640 10 client.25285 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:15.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.614+0000 7f14a77fe640 1 -- 10.20.193.28:0/417141618 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b9cce43220 con 0x55b9cd3b0070 2026-02-20T13:17:15.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.614+0000 7f14a77fe640 10 client.25285 handle_command_reply: tid=0 2026-02-20T13:17:15.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.614+0000 7f14f5a8ee00 1 client.25285 shutdown 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2a3d20 msgr2=0x55b9cd2dce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2dce50 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=13078741366263886151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e00d2010 tx=0x7f14e00184a0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 shutdown_connections 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b9cd3b0070 0x55b9cd3d0520 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=3978804666134348019 s_cookie=11189103657847461603 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b9cd2e89c0 0x55b9cd2dd390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b9cd2a3d20 0x55b9cd2dce50 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=13078741366263886151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 --2- 10.20.193.28:0/417141618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9cd2a3410 0x55b9cd2dc910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 >> 10.20.193.28:0/417141618 conn(0x55b9cd281910 msgr2=0x55b9cd2c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14a77fe640 0 client.25285 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 shutdown_connections 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 1 -- 10.20.193.28:0/417141618 wait complete. 2026-02-20T13:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.615+0000 7f14f5a8ee00 20 client.25285 trim_cache size 0 max 16384 2026-02-20T13:17:15.628 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:15.628 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:17:15.628 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5", 2026-02-20T13:17:15.628 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:17:15.628 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:15.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 -- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c80b5870 msgr2=0x7f14c80d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c80b5870 0x7f14c80d5d20 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc005b30 tx=0x7f14dc009310 comp rx=0 tx=0).stop 2026-02-20T13:17:15.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 -- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10fea0 msgr2=0x7f14ec11e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10fea0 0x7f14ec11e300 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e0009fd0 tx=0x7f14e0002bc0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 -- 10.20.193.28:0/3427869410 shutdown_connections 2026-02-20T13:17:15.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c80b5870 0x7f14c80d5d20 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10fea0 0x7f14ec11e300 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec1156a0 0x7f14ec1236d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 --2- 10.20.193.28:0/3427869410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f4b0 0x7f14ec11ddc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 -- 10.20.193.28:0/3427869410 >> 10.20.193.28:0/3427869410 conn(0x7f14ec0ecda0 msgr2=0x7f14ec10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.616+0000 7f14f280b640 1 -- 10.20.193.28:0/3427869410 shutdown_connections 2026-02-20T13:17:15.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.617+0000 7f14f280b640 1 -- 10.20.193.28:0/3427869410 wait complete. 2026-02-20T13:17:15.720 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:17:15.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:15 trial127 ceph-mon[43817]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:15.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:15 trial127 ceph-mon[43817]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:15 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3895673858' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:15.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:15 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3093980062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:15.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.730+0000 7fb1ccff9640 1 -- 10.20.193.28:0/195544742 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1e00f3e40 con 0x7fb1bc0b57f0 2026-02-20T13:17:15.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.733+0000 7fb1ceffd640 1 -- 10.20.193.28:0/195544742 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259005 (secure 0 0 0) 0x7fb1e00f3e40 con 0x7fb1bc0b57f0 2026-02-20T13:17:15.739 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:15.741 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:17:15.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 -- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1bc0b57f0 msgr2=0x7fb1bc0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1bc0b57f0 0x7fb1bc0d5ca0 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1d0038820 tx=0x7fb1d003a040 comp rx=0 tx=0).stop 2026-02-20T13:17:15.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 -- 10.20.193.28:0/195544742 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0159af0 msgr2=0x7fb1e00f85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:15.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0159af0 0x7fb1e00f85f0 secure :-1 s=READY pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1dc006e90 tx=0x7fb1dc00edf0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 -- 10.20.193.28:0/195544742 shutdown_connections 2026-02-20T13:17:15.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb1bc0b57f0 0x7fb1bc0d5ca0 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1e0159af0 0x7fb1e00f85f0 unknown :-1 s=CLOSED pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1e0062ae0 0x7fb1e00f3220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 --2- 10.20.193.28:0/195544742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1e00614f0 0x7fb1e00f2ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:15.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 -- 10.20.193.28:0/195544742 >> 10.20.193.28:0/195544742 conn(0x7fb1e005f830 msgr2=0x7fb1e010e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:15.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 -- 10.20.193.28:0/195544742 shutdown_connections 2026-02-20T13:17:15.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:15.737+0000 7fb1ccff9640 1 -- 10.20.193.28:0/195544742 wait complete. 2026-02-20T13:17:15.744 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:15 trial034 ceph-mon[43332]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:15.744 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:15 trial034 ceph-mon[43332]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:15.744 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:15 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3895673858' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:15.744 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:15 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3093980062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:15.846 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2026-02-20T13:17:15.339084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668892,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":481,"num_read_kb":363,"num_write":436,"num_write_kb":3873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335240,"kb_used_data":10648,"kb_used_omap":470,"kb_used_meta":323881,"kb_avail":8807703160,"statfs":{"total":9019431321600,"available":9019088035840,"internally_reserved":0,"allocated":10903552,"data_stored":6938231,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":482113,"internal_metadata":331654335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002419"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.090221+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:17:11.090221+0000","last_peered":"2026-02-20T13:17:11.090221+0000","last_clean":"2026-02-20T13:17:11.090221+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:17:11.090221+0000","last_undegraded":"2026-02-20T13:17:11.090221+0000","last_fullsized":"2026-02-20T13:17:11.090221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'5","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.098919+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:17:10.098919+0000","last_peered":"2026-02-20T13:17:10.098919+0000","last_clean":"2026-02-20T13:17:10.098919+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:17:10.098919+0000","last_undegraded":"2026-02-20T13:17:10.098919+0000","last_fullsized":"2026-02-20T13:17:10.098919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'35","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.096561+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:17:10.096561+0000","last_peered":"2026-02-20T13:17:10.096561+0000","last_clean":"2026-02-20T13:17:10.096561+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:17:10.096561+0000","last_undegraded":"2026-02-20T13:17:10.096561+0000","last_fullsized":"2026-02-20T13:17:10.096561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71042,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":105,"num_write":37,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:12.103100+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:17:12.103100+0000","last_peered":"2026-02-20T13:17:12.103100+0000","last_clean":"2026-02-20T13:17:12.103100+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:17:12.103100+0000","last_undegraded":"2026-02-20T13:17:12.103100+0000","last_fullsized":"2026-02-20T13:17:12.103100+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.099707+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:17:11.099707+0000","last_peered":"2026-02-20T13:17:11.099707+0000","last_clean":"2026-02-20T13:17:11.099707+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:17:11.099707+0000","last_undegraded":"2026-02-20T13:17:11.099707+0000","last_fullsized":"2026-02-20T13:17:11.099707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079144+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:39.079144+0000","last_peered":"2026-02-20T13:16:39.079144+0000","last_clean":"2026-02-20T13:16:39.079144+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:39.079144+0000","last_undegraded":"2026-02-20T13:16:39.079144+0000","last_fullsized":"2026-02-20T13:16:39.079144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:13.102539+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:17:13.102539+0000","last_peered":"2026-02-20T13:17:13.102539+0000","last_clean":"2026-02-20T13:17:13.102539+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:17:13.102539+0000","last_undegraded":"2026-02-20T13:17:13.102539+0000","last_fullsized":"2026-02-20T13:17:13.102539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.102398+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:17:11.102398+0000","last_peered":"2026-02-20T13:17:11.102398+0000","last_clean":"2026-02-20T13:17:11.102398+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:17:11.102398+0000","last_undegraded":"2026-02-20T13:17:11.102398+0000","last_fullsized":"2026-02-20T13:17:11.102398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.625539+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:35.625539+0000","last_peered":"2026-02-20T13:16:35.625539+0000","last_clean":"2026-02-20T13:16:35.625539+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:35.625539+0000","last_undegraded":"2026-02-20T13:16:35.625539+0000","last_fullsized":"2026-02-20T13:16:35.625539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.768390+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:47.768390+0000","last_peered":"2026-02-20T13:16:47.768390+0000","last_clean":"2026-02-20T13:16:47.768390+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:47.768390+0000","last_undegraded":"2026-02-20T13:16:47.768390+0000","last_fullsized":"2026-02-20T13:16:47.768390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079979+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:39.079979+0000","last_peered":"2026-02-20T13:16:39.079979+0000","last_clean":"2026-02-20T13:16:39.079979+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:39.079979+0000","last_undegraded":"2026-02-20T13:16:39.079979+0000","last_fullsized":"2026-02-20T13:16:39.079979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":65,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:13.102607+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:17:13.102607+0000","last_peered":"2026-02-20T13:17:13.102607+0000","last_clean":"2026-02-20T13:17:13.102607+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:17:13.102607+0000","last_undegraded":"2026-02-20T13:17:13.102607+0000","last_fullsized":"2026-02-20T13:17:13.102607+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78290,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":375,"num_read_kb":272,"num_write":245,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":606208,"data_stored":239363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185581,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612623,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27964,"kb_used_data":1000,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975236,"statfs":{"total":751619276800,"available":751590641664,"internally_reserved":0,"allocated":1024000,"data_stored":1074003,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":34,"kb_used_meta":27165,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35051,"internal_metadata":27817749},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234003,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36782,"internal_metadata":27553874},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1005001,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593751,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":844,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":864256,"data_stored":411453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855385,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":1004291,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986203,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":411724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44499,"internal_metadata":27546157},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215132,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":45,"kb_used_meta":27154,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46410,"internal_metadata":27806390},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27900,"kb_used_data":936,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975300,"statfs":{"total":751619276800,"available":751590707200,"internally_reserved":0,"allocated":958464,"data_stored":483956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":487945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45658,"internal_metadata":27544998},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":77331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3840,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6750,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15030,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29976,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:17:15.853 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T13:17:15.908 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:16.039 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:16.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.090+0000 7f164e33e640 1 -- 10.20.193.28:0/989043541 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810dc30 msgr2=0x7f1648112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.090+0000 7f164e33e640 1 --2- 10.20.193.28:0/989043541 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810dc30 0x7f1648112c80 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=14583545773698891384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c009950 tx=0x7f163c02f1d0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.091+0000 7f164e33e640 1 -- 10.20.193.28:0/989043541 shutdown_connections 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.091+0000 7f164e33e640 1 --2- 10.20.193.28:0/989043541 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1648113430 0x7f1648173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.091+0000 7f164e33e640 1 --2- 10.20.193.28:0/989043541 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810dc30 0x7f1648112c80 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=14583545773698891384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.091+0000 7f164e33e640 1 --2- 10.20.193.28:0/989043541 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f164810d240 0x7f164810d610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.091+0000 7f164e33e640 1 -- 10.20.193.28:0/989043541 >> 10.20.193.28:0/989043541 conn(0x7f16480eaad0 msgr2=0x7f164810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.091+0000 7f164e33e640 1 -- 10.20.193.28:0/989043541 shutdown_connections 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.091+0000 7f164e33e640 1 -- 10.20.193.28:0/989043541 wait complete. 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.091+0000 7f164e33e640 1 Processor -- start 2026-02-20T13:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164e33e640 1 -- start start 2026-02-20T13:17:16.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164e33e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810d240 0x7f1648060f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164e33e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164810dc30 0x7f1648173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164e33e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1648113430 0x7f1648061450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164e33e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1648061990 con 0x7f1648113430 2026-02-20T13:17:16.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164e33e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1648061b00 con 0x7f164810d240 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164e33e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1648061cc0 con 0x7f164810dc30 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164d33c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810d240 0x7f1648060f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164db3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1648113430 0x7f1648061450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164cb3b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164810dc30 0x7f1648173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164cb3b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164810dc30 0x7f1648173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45256/0 (socket says 10.20.193.28:45256) 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164cb3b640 1 -- 10.20.193.28:0/621801450 learned_addr learned my addr 10.20.193.28:0/621801450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.092+0000 7f164d33c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810d240 0x7f1648060f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45234/0 (socket says 10.20.193.28:45234) 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164d33c640 1 -- 10.20.193.28:0/621801450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164810dc30 msgr2=0x7f1648173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164d33c640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164810dc30 0x7f1648173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164d33c640 1 -- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1648113430 msgr2=0x7f1648061450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164d33c640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1648113430 0x7f1648061450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164d33c640 1 -- 10.20.193.28:0/621801450 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163c009570 con 0x7f164810d240 2026-02-20T13:17:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164db3d640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1648113430 0x7f1648061450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164d33c640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810d240 0x7f1648060f10 secure :-1 s=READY pgs=135 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163800e9c0 tx=0x7f163800ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f16367fc640 1 -- 10.20.193.28:0/621801450 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f163800ccb0 con 0x7f164810d240 2026-02-20T13:17:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f16367fc640 1 -- 10.20.193.28:0/621801450 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f163800ce10 con 0x7f164810d240 2026-02-20T13:17:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f16367fc640 1 -- 10.20.193.28:0/621801450 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16380106b0 con 0x7f164810d240 2026-02-20T13:17:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164e33e640 1 -- 10.20.193.28:0/621801450 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16480fb890 con 0x7f164810d240 2026-02-20T13:17:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.093+0000 7f164e33e640 1 -- 10.20.193.28:0/621801450 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16480fbd10 con 0x7f164810d240 2026-02-20T13:17:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.096+0000 7f16367fc640 1 -- 10.20.193.28:0/621801450 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f163801f060 con 0x7f164810d240 2026-02-20T13:17:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.097+0000 7f16367fc640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16240b58b0 0x7f16240d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.097+0000 7f16367fc640 1 -- 10.20.193.28:0/621801450 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f1638014070 con 0x7f164810d240 2026-02-20T13:17:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.097+0000 7f164cb3b640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16240b58b0 0x7f16240d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.098+0000 7f164cb3b640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16240b58b0 0x7f16240d5d60 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c005b30 tx=0x7f163c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f16515c1e00 1 Processor -- start 2026-02-20T13:17:16.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f16515c1e00 1 -- start start 2026-02-20T13:17:16.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c686b90 0x55ad6c686f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6cbe10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6cc350 0x55ad6c6ec730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f16515c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c5947d0 con 0x55ad6c6cc350 2026-02-20T13:17:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f16515c1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c590500 con 0x55ad6c686b90 2026-02-20T13:17:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f16515c1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c58a4a0 con 0x55ad6c6874a0 2026-02-20T13:17:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f164db3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6cc350 0x55ad6c6ec730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f164cb3b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f164d33c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c686b90 0x55ad6c686f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f164cb3b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45258/0 (socket says 10.20.193.28:45258) 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.101+0000 7f164cb3b640 1 -- 10.20.193.28:0/2236678123 learned_addr learned my addr 10.20.193.28:0/2236678123 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f164db3d640 1 -- 10.20.193.28:0/2236678123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 msgr2=0x55ad6c6cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f164db3d640 1 --2- 10.20.193.28:0/2236678123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f164db3d640 1 -- 10.20.193.28:0/2236678123 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c686b90 msgr2=0x55ad6c686f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f164db3d640 1 --2- 10.20.193.28:0/2236678123 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c686b90 0x55ad6c686f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f164db3d640 1 -- 10.20.193.28:0/2236678123 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad6c535d80 con 0x55ad6c6cc350 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f164db3d640 1 --2- 10.20.193.28:0/2236678123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6cc350 0x55ad6c6ec730 secure :-1 s=READY pgs=348 gs=3 cs=0 l=1 c_cookie=5963509157275268272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1644005820 tx=0x7f1644005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c2a3fb862e74b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f1615ce5640 1 -- 10.20.193.28:0/2236678123 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1644003e20 con 0x55ad6c6cc350 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f1615ce5640 1 -- 10.20.193.28:0/2236678123 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f164401b920 con 0x55ad6c6cc350 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f1615ce5640 1 -- 10.20.193.28:0/2236678123 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1644011a80 con 0x55ad6c6cc350 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f16515c1e00 1 -- 10.20.193.28:0/2236678123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6cc350 msgr2=0x55ad6c6ec730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2236678123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6cc350 0x55ad6c6ec730 secure :-1 s=READY pgs=348 gs=3 cs=0 l=1 c_cookie=5963509157275268272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1644005820 tx=0x7f1644005540 comp rx=0 tx=0).stop 2026-02-20T13:17:16.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f16515c1e00 1 -- 10.20.193.28:0/2236678123 shutdown_connections 2026-02-20T13:17:16.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2236678123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6cc350 0x55ad6c6ec730 unknown :-1 s=CLOSED pgs=348 gs=3 cs=0 l=1 c_cookie=5963509157275268272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2236678123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6cbe10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2236678123 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c686b90 0x55ad6c686f60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.102+0000 7f16515c1e00 1 -- 10.20.193.28:0/2236678123 >> 10.20.193.28:0/2236678123 conn(0x55ad6c65c680 msgr2=0x55ad6c67ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.103+0000 7f16515c1e00 1 -- 10.20.193.28:0/2236678123 shutdown_connections 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.103+0000 7f16515c1e00 1 -- 10.20.193.28:0/2236678123 wait complete. 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.104+0000 7f16515c1e00 1 -- start start 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.104+0000 7f16515c1e00 1 Processor -- start 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.104+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 0x55ad6c6e3a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.104+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e3f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.104+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e8f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.104+0000 7f16515c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c6e9490 con 0x55ad6c686b90 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.104+0000 7f16515c1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c6e9600 con 0x55ad6c6cc350 2026-02-20T13:17:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.104+0000 7f16515c1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c6e97c0 con 0x55ad6c6874a0 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164cb3b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164db3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164db3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45244/0 (socket says 10.20.193.28:45244) 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164db3d640 1 -- 10.20.193.28:0/2619809665 learned_addr learned my addr 10.20.193.28:0/2619809665 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164d33c640 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 0x55ad6c6e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164cb3b640 1 -- 10.20.193.28:0/2619809665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 msgr2=0x55ad6c6e8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164cb3b640 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164cb3b640 1 -- 10.20.193.28:0/2619809665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 msgr2=0x55ad6c6e3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164cb3b640 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 0x55ad6c6e3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164cb3b640 1 -- 10.20.193.28:0/2619809665 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad6c50e350 con 0x55ad6c6874a0 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.105+0000 7f164d33c640 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 0x55ad6c6e3a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f164cb3b640 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e3f60 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=2269690681979181975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c0098a0 tx=0x7f163c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f7f8fa661621b97 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f15feffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f15feffd640 1 -- 10.20.193.28:0/2619809665 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f163c038d50 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f15feffd640 1 -- 10.20.193.28:0/2619809665 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f163c03e040 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f15feffd640 1 -- 10.20.193.28:0/2619809665 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f163c050670 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164400ace0 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f16515c1e00 10 client.25297 _ll_register_callbacks cb 0x55ad6c50b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad6c2206f0 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f15feffd640 1 -- 10.20.193.28:0/2619809665 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f163c044e00 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f15feffd640 1 -- 10.20.193.28:0/2619809665 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f163c050800 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f16515c1e00 10 client.25297 fetch_fsmap learned FSMap version 24 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55ad6c520150 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.106+0000 7f15feffd640 1 -- 10.20.193.28:0/2619809665 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f163c04f070 con 0x55ad6c6874a0 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f16515c1e00 10 client.25297 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T13:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f16515c1e00 10 client.25297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f16515c1e00 20 client.25297 populate_metadata read hostname 'trial028' 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ad6c6c9410 0x55ad6c6c98b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f16515c1e00 4 client.25297 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad6c597d60 con 0x55ad6c6c9410 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f164d33c640 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ad6c6c9410 0x55ad6c6c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f164d33c640 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ad6c6c9410 0x55ad6c6c98b0 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=8452499877530167007 s_cookie=4414892394790668305 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=754d4fdaf837e6df server_cookie=3d44d93df1124811 in_seq=0 out_seq=0 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.107+0000 7f15feffd640 10 client.25297 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f15feffd640 1 -- 10.20.193.28:0/2619809665 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ad6c597d60 con 0x55ad6c6c9410 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f15feffd640 10 client.25297 handle_command_reply: tid=0 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 client.25297 shutdown 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 msgr2=0x55ad6c6e3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e3f60 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=2269690681979181975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c0098a0 tx=0x7f163c009310 comp rx=0 tx=0).stop 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 shutdown_connections 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ad6c6c9410 0x55ad6c6c98b0 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=8452499877530167007 s_cookie=4414892394790668305 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e8f50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e3f60 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=2269690681979181975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2619809665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 0x55ad6c6e3a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 >> 10.20.193.28:0/2619809665 conn(0x55ad6c65c680 msgr2=0x55ad6c67ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f15feffd640 0 client.25297 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 shutdown_connections 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 1 -- 10.20.193.28:0/2619809665 wait complete. 2026-02-20T13:17:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.108+0000 7f16515c1e00 20 client.25297 trim_cache size 0 max 16384 2026-02-20T13:17:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f16515c1e00 1 Processor -- start 2026-02-20T13:17:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f16515c1e00 1 -- start start 2026-02-20T13:17:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c686b90 0x55ad6c6c9410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e0d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e1250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f16515c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c5880d0 con 0x55ad6c6874a0 2026-02-20T13:17:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f16515c1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c248700 con 0x55ad6c6cc350 2026-02-20T13:17:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f16515c1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c65c2f0 con 0x55ad6c686b90 2026-02-20T13:17:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164d33c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c686b90 0x55ad6c6c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164db3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164cb3b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164db3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e1250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45246/0 (socket says 10.20.193.28:45246) 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164db3d640 1 -- 10.20.193.28:0/1503944053 learned_addr learned my addr 10.20.193.28:0/1503944053 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164cb3b640 1 -- 10.20.193.28:0/1503944053 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c686b90 msgr2=0x55ad6c6c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164cb3b640 1 --2- 10.20.193.28:0/1503944053 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c686b90 0x55ad6c6c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164cb3b640 1 -- 10.20.193.28:0/1503944053 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 msgr2=0x55ad6c6e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164cb3b640 1 --2- 10.20.193.28:0/1503944053 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.118+0000 7f164cb3b640 1 -- 10.20.193.28:0/1503944053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad6c51abd0 con 0x55ad6c6874a0 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f164cb3b640 1 --2- 10.20.193.28:0/1503944053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e0d10 secure :-1 s=READY pgs=349 gs=3 cs=0 l=1 c_cookie=11874874772295532736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c0444b0 tx=0x7f163c065000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cc07b08aec40c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16154e4640 1 -- 10.20.193.28:0/1503944053 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f163c042e90 con 0x55ad6c6874a0 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16154e4640 1 -- 10.20.193.28:0/1503944053 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f163c03e070 con 0x55ad6c6874a0 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16154e4640 1 -- 10.20.193.28:0/1503944053 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f163c038cc0 con 0x55ad6c6874a0 2026-02-20T13:17:16.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 -- 10.20.193.28:0/1503944053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6874a0 msgr2=0x55ad6c6e0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 --2- 10.20.193.28:0/1503944053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e0d10 secure :-1 s=READY pgs=349 gs=3 cs=0 l=1 c_cookie=11874874772295532736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c0444b0 tx=0x7f163c065000 comp rx=0 tx=0).stop 2026-02-20T13:17:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 -- 10.20.193.28:0/1503944053 shutdown_connections 2026-02-20T13:17:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 --2- 10.20.193.28:0/1503944053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c6874a0 0x55ad6c6e0d10 unknown :-1 s=CLOSED pgs=349 gs=3 cs=0 l=1 c_cookie=11874874772295532736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 --2- 10.20.193.28:0/1503944053 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c6e1250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 --2- 10.20.193.28:0/1503944053 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c686b90 0x55ad6c6c9410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 -- 10.20.193.28:0/1503944053 >> 10.20.193.28:0/1503944053 conn(0x55ad6c65c680 msgr2=0x55ad6c6e0600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 -- 10.20.193.28:0/1503944053 shutdown_connections 2026-02-20T13:17:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.119+0000 7f16515c1e00 1 -- 10.20.193.28:0/1503944053 wait complete. 2026-02-20T13:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.120+0000 7f16515c1e00 1 -- start start 2026-02-20T13:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.120+0000 7f16515c1e00 1 Processor -- start 2026-02-20T13:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 0x55ad6c65e210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c65e750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f16515c1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c731e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f16515c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c6e4540 con 0x55ad6c686b90 2026-02-20T13:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f16515c1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c5880d0 con 0x55ad6c6cc350 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f16515c1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ad6c65ef80 con 0x55ad6c6874a0 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164db3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c731e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164cb3b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c65e750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164db3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c731e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45254/0 (socket says 10.20.193.28:45254) 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164db3d640 1 -- 10.20.193.28:0/2521824211 learned_addr learned my addr 10.20.193.28:0/2521824211 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164cb3b640 1 -- 10.20.193.28:0/2521824211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 msgr2=0x55ad6c731e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164cb3b640 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c731e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164cb3b640 1 -- 10.20.193.28:0/2521824211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 msgr2=0x55ad6c65e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164cb3b640 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 0x55ad6c65e210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164cb3b640 1 -- 10.20.193.28:0/2521824211 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad6c50e680 con 0x55ad6c6874a0 2026-02-20T13:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f164cb3b640 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c65e750 secure :-1 s=READY pgs=107 gs=3 cs=0 l=1 c_cookie=1028561175548195664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c038820 tx=0x7f163c002bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e462ef08a4ef350 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.121+0000 7f15feffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f15feffd640 1 -- 10.20.193.28:0/2521824211 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f163c0043a0 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f15feffd640 1 -- 10.20.193.28:0/2521824211 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f163c048070 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad6c520150 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f15feffd640 1 -- 10.20.193.28:0/2521824211 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f163c0585d0 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f15feffd640 1 -- 10.20.193.28:0/2521824211 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f163c058730 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 10 client.25303 _ll_register_callbacks cb 0x55ad6c50b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f164401b920 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f15feffd640 1 -- 10.20.193.28:0/2521824211 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f163c0040c0 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 10 client.25303 fetch_fsmap learned FSMap version 24 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55ad6c5203b0 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f15feffd640 1 -- 10.20.193.28:0/2521824211 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f163c04f040 con 0x55ad6c6874a0 2026-02-20T13:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 10 client.25303 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 10 client.25303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 20 client.25303 populate_metadata read hostname 'trial028' 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ad6c779c60 0x55ad6c79a060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 4 client.25303 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.122+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ad6c21df40 con 0x55ad6c779c60 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f164d33c640 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ad6c779c60 0x55ad6c79a060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f164d33c640 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ad6c779c60 0x55ad6c79a060 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=9532253866817766618 s_cookie=10063021224669398509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84495e63488444da server_cookie=8ba7087cd7a2c5ed in_seq=0 out_seq=0 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f15feffd640 10 client.25303 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f15feffd640 1 -- 10.20.193.28:0/2521824211 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55ad6c21df40 con 0x55ad6c779c60 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f15feffd640 10 client.25303 handle_command_reply: tid=0 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 client.25303 shutdown 2026-02-20T13:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 msgr2=0x55ad6c65e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c65e750 secure :-1 s=READY pgs=107 gs=3 cs=0 l=1 c_cookie=1028561175548195664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c038820 tx=0x7f163c002bc0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 shutdown_connections 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ad6c779c60 0x55ad6c79a060 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=9532253866817766618 s_cookie=10063021224669398509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ad6c6cc350 0x55ad6c731e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ad6c6874a0 0x55ad6c65e750 unknown :-1 s=CLOSED pgs=107 gs=3 cs=0 l=1 c_cookie=1028561175548195664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 --2- 10.20.193.28:0/2521824211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad6c686b90 0x55ad6c65e210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 >> 10.20.193.28:0/2521824211 conn(0x55ad6c65c680 msgr2=0x55ad6c6e0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.123+0000 7f15feffd640 0 client.25303 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 shutdown_connections 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f16515c1e00 1 -- 10.20.193.28:0/2521824211 wait complete. 2026-02-20T13:17:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f16515c1e00 20 client.25303 trim_cache size 0 max 16384 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5", 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:16.133 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:16.134 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:16.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 -- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16240b58b0 msgr2=0x7f16240d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16240b58b0 0x7f16240d5d60 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c005b30 tx=0x7f163c03a040 comp rx=0 tx=0).stop 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 -- 10.20.193.28:0/621801450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810d240 msgr2=0x7f1648060f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810d240 0x7f1648060f10 secure :-1 s=READY pgs=135 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163800e9c0 tx=0x7f163800ee90 comp rx=0 tx=0).stop 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 -- 10.20.193.28:0/621801450 shutdown_connections 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16240b58b0 0x7f16240d5d60 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1648113430 0x7f1648061450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164810dc30 0x7f1648173d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 --2- 10.20.193.28:0/621801450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f164810d240 0x7f1648060f10 unknown :-1 s=CLOSED pgs=135 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 -- 10.20.193.28:0/621801450 >> 10.20.193.28:0/621801450 conn(0x7f16480eaad0 msgr2=0x7f164810fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 -- 10.20.193.28:0/621801450 shutdown_connections 2026-02-20T13:17:16.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.124+0000 7f164e33e640 1 -- 10.20.193.28:0/621801450 wait complete. 2026-02-20T13:17:16.227 INFO:tasks.cephfs.filesystem:scrub status for tag:ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5 - {'path': '/', 'tag': 'ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5', 'options': 'recursive,force'} 2026-02-20T13:17:16.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.256+0000 7fa6097f6640 1 -- 10.20.193.28:0/915351112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604155990 msgr2=0x7fa604175d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.256+0000 7fa6097f6640 1 --2- 10.20.193.28:0/915351112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604155990 0x7fa604175d70 secure :-1 s=READY pgs=350 gs=3 cs=0 l=1 c_cookie=7312944924164330967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f400a970 tx=0x7fa5f40301b0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.256+0000 7fa6097f6640 1 -- 10.20.193.28:0/915351112 shutdown_connections 2026-02-20T13:17:16.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.256+0000 7fa6097f6640 1 --2- 10.20.193.28:0/915351112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604155990 0x7fa604175d70 unknown :-1 s=CLOSED pgs=350 gs=3 cs=0 l=1 c_cookie=7312944924164330967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.256+0000 7fa6097f6640 1 --2- 10.20.193.28:0/915351112 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa604061860 0x7fa604155450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.256+0000 7fa6097f6640 1 --2- 10.20.193.28:0/915351112 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa604060f50 0x7fa604061320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.256+0000 7fa6097f6640 1 -- 10.20.193.28:0/915351112 >> 10.20.193.28:0/915351112 conn(0x7fa6040eab40 msgr2=0x7fa60410af50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.257+0000 7fa6097f6640 1 -- 10.20.193.28:0/915351112 shutdown_connections 2026-02-20T13:17:16.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.257+0000 7fa6097f6640 1 -- 10.20.193.28:0/915351112 wait complete. 2026-02-20T13:17:16.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.257+0000 7fa6097f6640 1 Processor -- start 2026-02-20T13:17:16.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.257+0000 7fa6097f6640 1 -- start start 2026-02-20T13:17:16.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.257+0000 7fa6097f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604060f50 0x7fa6041620f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6097f6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa604061860 0x7fa604162630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6097f6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa604155990 0x7fa604167a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6097f6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa604168020 con 0x7fa604060f50 2026-02-20T13:17:16.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6097f6640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa604168190 con 0x7fa604061860 2026-02-20T13:17:16.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6097f6640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa604168350 con 0x7fa604155990 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa602ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604060f50 0x7fa6041620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6027fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa604061860 0x7fa604162630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa602ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604060f50 0x7fa6041620f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52046/0 (socket says 10.20.193.28:52046) 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa602ffd640 1 -- 10.20.193.28:0/1272777921 learned_addr learned my addr 10.20.193.28:0/1272777921 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6037fe640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa604155990 0x7fa604167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6027fc640 1 -- 10.20.193.28:0/1272777921 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa604155990 msgr2=0x7fa604167a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6027fc640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa604155990 0x7fa604167a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6027fc640 1 -- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604060f50 msgr2=0x7fa6041620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6027fc640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604060f50 0x7fa6041620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6027fc640 1 -- 10.20.193.28:0/1272777921 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f400a590 con 0x7fa604061860 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa602ffd640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604060f50 0x7fa6041620f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:16.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6027fc640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa604061860 0x7fa604162630 secure :-1 s=READY pgs=136 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5ec00e9c0 tx=0x7fa5ec00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa5e3fff640 1 -- 10.20.193.28:0/1272777921 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5ec00ccb0 con 0x7fa604061860 2026-02-20T13:17:16.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa5e3fff640 1 -- 10.20.193.28:0/1272777921 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa5ec00ce10 con 0x7fa604061860 2026-02-20T13:17:16.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa5e3fff640 1 -- 10.20.193.28:0/1272777921 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5ec0106b0 con 0x7fa604061860 2026-02-20T13:17:16.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa604168630 con 0x7fa604061860 2026-02-20T13:17:16.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.258+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6041515b0 con 0x7fa604061860 2026-02-20T13:17:16.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.259+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa604168850 con 0x7fa604061860 2026-02-20T13:17:16.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.261+0000 7fa5e3fff640 1 -- 10.20.193.28:0/1272777921 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fa5ec01f060 con 0x7fa604061860 2026-02-20T13:17:16.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.262+0000 7fa5e3fff640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa5d80b5770 0x7fa5d80d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.262+0000 7fa5e3fff640 1 -- 10.20.193.28:0/1272777921 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fa5ec014070 con 0x7fa604061860 2026-02-20T13:17:16.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.262+0000 7fa602ffd640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa5d80b5770 0x7fa5d80d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.263+0000 7fa602ffd640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa5d80b5770 0x7fa5d80d5c20 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f8005970 tx=0x7fa5f8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.264+0000 7fa5e3fff640 1 -- 10.20.193.28:0/1272777921 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fa5ec0a9570 con 0x7fa604061860 2026-02-20T13:17:16.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.376+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6040613b0 con 0x7fa5d80b5770 2026-02-20T13:17:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.378+0000 7fa5e3fff640 1 -- 10.20.193.28:0/1272777921 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259005 (secure 0 0 0) 0x7fa5f8011440 con 0x7fa5d80b5770 2026-02-20T13:17:16.384 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:16.386 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:17:16.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa5d80b5770 msgr2=0x7fa5d80d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa5d80b5770 0x7fa5d80d5c20 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f8005970 tx=0x7fa5f8009310 comp rx=0 tx=0).stop 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa604061860 msgr2=0x7fa604162630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa604061860 0x7fa604162630 secure :-1 s=READY pgs=136 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5ec00e9c0 tx=0x7fa5ec00ee90 comp rx=0 tx=0).stop 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 shutdown_connections 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa5d80b5770 0x7fa5d80d5c20 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa604155990 0x7fa604167a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa604061860 0x7fa604162630 unknown :-1 s=CLOSED pgs=136 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 --2- 10.20.193.28:0/1272777921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa604060f50 0x7fa6041620f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 >> 10.20.193.28:0/1272777921 conn(0x7fa6040eab40 msgr2=0x7fa60410af20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 shutdown_connections 2026-02-20T13:17:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.381+0000 7fa6097f6640 1 -- 10.20.193.28:0/1272777921 wait complete. 2026-02-20T13:17:16.485 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:16 trial028 ceph-mon[37442]: pgmap v177: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:17:16.485 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:16 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:17:16.486 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:16 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:16.486 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:16 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:17:16.486 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:16 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:16.519 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2026-02-20T13:17:15.339084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668892,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":481,"num_read_kb":363,"num_write":436,"num_write_kb":3873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335240,"kb_used_data":10648,"kb_used_omap":470,"kb_used_meta":323881,"kb_avail":8807703160,"statfs":{"total":9019431321600,"available":9019088035840,"internally_reserved":0,"allocated":10903552,"data_stored":6938231,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":482113,"internal_metadata":331654335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002419"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.090221+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:17:11.090221+0000","last_peered":"2026-02-20T13:17:11.090221+0000","last_clean":"2026-02-20T13:17:11.090221+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:17:11.090221+0000","last_undegraded":"2026-02-20T13:17:11.090221+0000","last_fullsized":"2026-02-20T13:17:11.090221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'5","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.098919+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:17:10.098919+0000","last_peered":"2026-02-20T13:17:10.098919+0000","last_clean":"2026-02-20T13:17:10.098919+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:17:10.098919+0000","last_undegraded":"2026-02-20T13:17:10.098919+0000","last_fullsized":"2026-02-20T13:17:10.098919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'35","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.096561+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:17:10.096561+0000","last_peered":"2026-02-20T13:17:10.096561+0000","last_clean":"2026-02-20T13:17:10.096561+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:17:10.096561+0000","last_undegraded":"2026-02-20T13:17:10.096561+0000","last_fullsized":"2026-02-20T13:17:10.096561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71042,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":105,"num_write":37,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:12.103100+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:17:12.103100+0000","last_peered":"2026-02-20T13:17:12.103100+0000","last_clean":"2026-02-20T13:17:12.103100+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:17:12.103100+0000","last_undegraded":"2026-02-20T13:17:12.103100+0000","last_fullsized":"2026-02-20T13:17:12.103100+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.099707+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:17:11.099707+0000","last_peered":"2026-02-20T13:17:11.099707+0000","last_clean":"2026-02-20T13:17:11.099707+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:17:11.099707+0000","last_undegraded":"2026-02-20T13:17:11.099707+0000","last_fullsized":"2026-02-20T13:17:11.099707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079144+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:39.079144+0000","last_peered":"2026-02-20T13:16:39.079144+0000","last_clean":"2026-02-20T13:16:39.079144+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:39.079144+0000","last_undegraded":"2026-02-20T13:16:39.079144+0000","last_fullsized":"2026-02-20T13:16:39.079144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:13.102539+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:17:13.102539+0000","last_peered":"2026-02-20T13:17:13.102539+0000","last_clean":"2026-02-20T13:17:13.102539+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:17:13.102539+0000","last_undegraded":"2026-02-20T13:17:13.102539+0000","last_fullsized":"2026-02-20T13:17:13.102539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.102398+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:17:11.102398+0000","last_peered":"2026-02-20T13:17:11.102398+0000","last_clean":"2026-02-20T13:17:11.102398+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:17:11.102398+0000","last_undegraded":"2026-02-20T13:17:11.102398+0000","last_fullsized":"2026-02-20T13:17:11.102398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.625539+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:35.625539+0000","last_peered":"2026-02-20T13:16:35.625539+0000","last_clean":"2026-02-20T13:16:35.625539+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:35.625539+0000","last_undegraded":"2026-02-20T13:16:35.625539+0000","last_fullsized":"2026-02-20T13:16:35.625539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.768390+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:47.768390+0000","last_peered":"2026-02-20T13:16:47.768390+0000","last_clean":"2026-02-20T13:16:47.768390+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:47.768390+0000","last_undegraded":"2026-02-20T13:16:47.768390+0000","last_fullsized":"2026-02-20T13:16:47.768390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079979+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:39.079979+0000","last_peered":"2026-02-20T13:16:39.079979+0000","last_clean":"2026-02-20T13:16:39.079979+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:39.079979+0000","last_undegraded":"2026-02-20T13:16:39.079979+0000","last_fullsized":"2026-02-20T13:16:39.079979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":65,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:13.102607+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:17:13.102607+0000","last_peered":"2026-02-20T13:17:13.102607+0000","last_clean":"2026-02-20T13:17:13.102607+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:17:13.102607+0000","last_undegraded":"2026-02-20T13:17:13.102607+0000","last_fullsized":"2026-02-20T13:17:13.102607+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78290,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":375,"num_read_kb":272,"num_write":245,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":606208,"data_stored":239363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185581,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612623,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27964,"kb_used_data":1000,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975236,"statfs":{"total":751619276800,"available":751590641664,"internally_reserved":0,"allocated":1024000,"data_stored":1074003,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":34,"kb_used_meta":27165,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35051,"internal_metadata":27817749},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234003,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36782,"internal_metadata":27553874},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1005001,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593751,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":844,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":864256,"data_stored":411453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855385,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":1004291,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986203,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":411724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44499,"internal_metadata":27546157},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215132,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":45,"kb_used_meta":27154,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46410,"internal_metadata":27806390},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27900,"kb_used_data":936,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975300,"statfs":{"total":751619276800,"available":751590707200,"internally_reserved":0,"allocated":958464,"data_stored":483956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":487945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45658,"internal_metadata":27544998},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":77331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3840,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6750,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15030,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29976,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:17:16.526 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-20T13:17:16.527 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T13:17:16.711 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:16.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:16 trial127 ceph-mon[43817]: pgmap v177: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:17:16.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:16 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:17:16.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:16 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:16.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:16 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:17:16.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:16 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:16.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:16 trial034 ceph-mon[43332]: pgmap v177: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:17:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:16 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:17:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:16 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:16 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:17:16.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:16 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:16.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 -- 10.20.193.28:0/2960224540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810fc20 msgr2=0x7f16f8114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 --2- 10.20.193.28:0/2960224540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810fc20 0x7f16f8114c70 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=5478895690182312731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e0009950 tx=0x7f16e002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 -- 10.20.193.28:0/2960224540 shutdown_connections 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 --2- 10.20.193.28:0/2960224540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16f8115420 0x7f16f8175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 --2- 10.20.193.28:0/2960224540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810fc20 0x7f16f8114c70 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=5478895690182312731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 --2- 10.20.193.28:0/2960224540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16f810f230 0x7f16f810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 -- 10.20.193.28:0/2960224540 >> 10.20.193.28:0/2960224540 conn(0x7f16f805f830 msgr2=0x7f16f810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 -- 10.20.193.28:0/2960224540 shutdown_connections 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.901+0000 7f16fce9e640 1 -- 10.20.193.28:0/2960224540 wait complete. 2026-02-20T13:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16fce9e640 1 Processor -- start 2026-02-20T13:17:16.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16fce9e640 1 -- start start 2026-02-20T13:17:16.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16fce9e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810f230 0x7f16f80f5520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16fce9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16f810fc20 0x7f16f8175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16fce9e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16f8115420 0x7f16f80f5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16fce9e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80fae30 con 0x7f16f810fc20 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16fce9e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80fafa0 con 0x7f16f810f230 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16fce9e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80fb160 con 0x7f16f8115420 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16f6575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810f230 0x7f16f80f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16f6d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16f8115420 0x7f16f80f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16f6575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810f230 0x7f16f80f5520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45300/0 (socket says 10.20.193.28:45300) 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16f6575640 1 -- 10.20.193.28:0/58211347 learned_addr learned my addr 10.20.193.28:0/58211347 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.902+0000 7f16f5d74640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16f810fc20 0x7f16f8175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16f6575640 1 -- 10.20.193.28:0/58211347 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16f8115420 msgr2=0x7f16f80f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16f6575640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16f8115420 0x7f16f80f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16f6575640 1 -- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16f810fc20 msgr2=0x7f16f8175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16f6575640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16f810fc20 0x7f16f8175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16f6575640 1 -- 10.20.193.28:0/58211347 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec0094b0 con 0x7f16f810f230 2026-02-20T13:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16f6575640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810f230 0x7f16f80f5520 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16ec009fd0 tx=0x7f16ec002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16df7fe640 1 -- 10.20.193.28:0/58211347 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16ec00ed60 con 0x7f16f810f230 2026-02-20T13:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16df7fe640 1 -- 10.20.193.28:0/58211347 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16ec002e20 con 0x7f16f810f230 2026-02-20T13:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e0009570 con 0x7f16f810f230 2026-02-20T13:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16df7fe640 1 -- 10.20.193.28:0/58211347 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16ec0189f0 con 0x7f16f810f230 2026-02-20T13:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.903+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f80fb780 con 0x7f16f810f230 2026-02-20T13:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.904+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f8110510 con 0x7f16f810f230 2026-02-20T13:17:16.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.905+0000 7f16df7fe640 1 -- 10.20.193.28:0/58211347 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f16ec016020 con 0x7f16f810f230 2026-02-20T13:17:16.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.907+0000 7f16df7fe640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16d00b5760 0x7f16d00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:16.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.907+0000 7f16df7fe640 1 -- 10.20.193.28:0/58211347 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f16ec0e6e20 con 0x7f16f810f230 2026-02-20T13:17:16.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.907+0000 7f16f5d74640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16d00b5760 0x7f16d00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:16.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.907+0000 7f16df7fe640 1 -- 10.20.193.28:0/58211347 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f16ec0e72a0 con 0x7f16f810f230 2026-02-20T13:17:16.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:16.908+0000 7f16f5d74640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16d00b5760 0x7f16d00d5c10 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16f80fbec0 tx=0x7f16e003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:17.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.021+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 --> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16f80fba00 con 0x7f16d00b5760 2026-02-20T13:17:17.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.023+0000 7f16df7fe640 1 -- 10.20.193.28:0/58211347 <== mgr.14152 v2:10.20.193.28:6800/1124954776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259005 (secure 0 0 0) 0x7f16f80fba00 con 0x7f16d00b5760 2026-02-20T13:17:17.028 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:17.030 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T13:17:17.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.025+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16d00b5760 msgr2=0x7f16d00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:17.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.025+0000 7f16fce9e640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16d00b5760 0x7f16d00d5c10 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16f80fbec0 tx=0x7f16e003a040 comp rx=0 tx=0).stop 2026-02-20T13:17:17.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.025+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810f230 msgr2=0x7f16f80f5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:17.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.025+0000 7f16fce9e640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810f230 0x7f16f80f5520 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16ec009fd0 tx=0x7f16ec002bc0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.026+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 shutdown_connections 2026-02-20T13:17:17.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.026+0000 7f16fce9e640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f16d00b5760 0x7f16d00d5c10 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.026+0000 7f16fce9e640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16f810fc20 0x7f16f8175cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.026+0000 7f16fce9e640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16f8115420 0x7f16f80f5c20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.026+0000 7f16fce9e640 1 --2- 10.20.193.28:0/58211347 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16f810f230 0x7f16f80f5520 unknown :-1 s=CLOSED pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.026+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 >> 10.20.193.28:0/58211347 conn(0x7f16f805f830 msgr2=0x7f16f8111a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:17.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.026+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 shutdown_connections 2026-02-20T13:17:17.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.026+0000 7f16fce9e640 1 -- 10.20.193.28:0/58211347 wait complete. 2026-02-20T13:17:17.129 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2026-02-20T13:17:15.339084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668892,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":481,"num_read_kb":363,"num_write":436,"num_write_kb":3873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":367,"ondisk_log_size":367,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335240,"kb_used_data":10648,"kb_used_omap":470,"kb_used_meta":323881,"kb_avail":8807703160,"statfs":{"total":9019431321600,"available":9019088035840,"internally_reserved":0,"allocated":10903552,"data_stored":6938231,"data_compressed":113619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":482113,"internal_metadata":331654335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002419"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363238+0000","last_change":"2026-02-20T13:16:33.782757+0000","last_active":"2026-02-20T13:16:35.363238+0000","last_peered":"2026-02-20T13:16:35.363238+0000","last_clean":"2026-02-20T13:16:35.363238+0000","last_became_active":"2026-02-20T13:16:33.782533+0000","last_became_peered":"2026-02-20T13:16:33.782533+0000","last_unstale":"2026-02-20T13:16:35.363238+0000","last_undegraded":"2026-02-20T13:16:35.363238+0000","last_fullsized":"2026-02-20T13:16:35.363238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:04:19.282961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776002+0000","last_change":"2026-02-20T13:16:33.779816+0000","last_active":"2026-02-20T13:16:34.776002+0000","last_peered":"2026-02-20T13:16:34.776002+0000","last_clean":"2026-02-20T13:16:34.776002+0000","last_became_active":"2026-02-20T13:16:33.779747+0000","last_became_peered":"2026-02-20T13:16:33.779747+0000","last_unstale":"2026-02-20T13:16:34.776002+0000","last_undegraded":"2026-02-20T13:16:34.776002+0000","last_fullsized":"2026-02-20T13:16:34.776002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:16.877244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775850+0000","last_change":"2026-02-20T13:16:33.777657+0000","last_active":"2026-02-20T13:16:34.775850+0000","last_peered":"2026-02-20T13:16:34.775850+0000","last_clean":"2026-02-20T13:16:34.775850+0000","last_became_active":"2026-02-20T13:16:33.777234+0000","last_became_peered":"2026-02-20T13:16:33.777234+0000","last_unstale":"2026-02-20T13:16:34.775850+0000","last_undegraded":"2026-02-20T13:16:34.775850+0000","last_fullsized":"2026-02-20T13:16:34.775850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:48:19.503599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362683+0000","last_change":"2026-02-20T13:16:33.773367+0000","last_active":"2026-02-20T13:16:35.362683+0000","last_peered":"2026-02-20T13:16:35.362683+0000","last_clean":"2026-02-20T13:16:35.362683+0000","last_became_active":"2026-02-20T13:16:33.773157+0000","last_became_peered":"2026-02-20T13:16:33.773157+0000","last_unstale":"2026-02-20T13:16:35.362683+0000","last_undegraded":"2026-02-20T13:16:35.362683+0000","last_fullsized":"2026-02-20T13:16:35.362683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:10.580827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775887+0000","last_change":"2026-02-20T13:16:33.780375+0000","last_active":"2026-02-20T13:16:34.775887+0000","last_peered":"2026-02-20T13:16:34.775887+0000","last_clean":"2026-02-20T13:16:34.775887+0000","last_became_active":"2026-02-20T13:16:33.780244+0000","last_became_peered":"2026-02-20T13:16:33.780244+0000","last_unstale":"2026-02-20T13:16:34.775887+0000","last_undegraded":"2026-02-20T13:16:34.775887+0000","last_fullsized":"2026-02-20T13:16:34.775887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:51:02.034641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775852+0000","last_change":"2026-02-20T13:16:33.776709+0000","last_active":"2026-02-20T13:16:34.775852+0000","last_peered":"2026-02-20T13:16:34.775852+0000","last_clean":"2026-02-20T13:16:34.775852+0000","last_became_active":"2026-02-20T13:16:33.776545+0000","last_became_peered":"2026-02-20T13:16:33.776545+0000","last_unstale":"2026-02-20T13:16:34.775852+0000","last_undegraded":"2026-02-20T13:16:34.775852+0000","last_fullsized":"2026-02-20T13:16:34.775852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:32:08.133311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815276+0000","last_change":"2026-02-20T13:16:33.776793+0000","last_active":"2026-02-20T13:16:34.815276+0000","last_peered":"2026-02-20T13:16:34.815276+0000","last_clean":"2026-02-20T13:16:34.815276+0000","last_became_active":"2026-02-20T13:16:33.776635+0000","last_became_peered":"2026-02-20T13:16:33.776635+0000","last_unstale":"2026-02-20T13:16:34.815276+0000","last_undegraded":"2026-02-20T13:16:34.815276+0000","last_fullsized":"2026-02-20T13:16:34.815276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:39:57.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774840+0000","last_change":"2026-02-20T13:16:33.774079+0000","last_active":"2026-02-20T13:16:34.774840+0000","last_peered":"2026-02-20T13:16:34.774840+0000","last_clean":"2026-02-20T13:16:34.774840+0000","last_became_active":"2026-02-20T13:16:33.773977+0000","last_became_peered":"2026-02-20T13:16:33.773977+0000","last_unstale":"2026-02-20T13:16:34.774840+0000","last_undegraded":"2026-02-20T13:16:34.774840+0000","last_fullsized":"2026-02-20T13:16:34.774840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:29:55.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205704+0000","last_change":"2026-02-20T13:16:33.774608+0000","last_active":"2026-02-20T13:16:35.205704+0000","last_peered":"2026-02-20T13:16:35.205704+0000","last_clean":"2026-02-20T13:16:35.205704+0000","last_became_active":"2026-02-20T13:16:33.774493+0000","last_became_peered":"2026-02-20T13:16:33.774493+0000","last_unstale":"2026-02-20T13:16:35.205704+0000","last_undegraded":"2026-02-20T13:16:35.205704+0000","last_fullsized":"2026-02-20T13:16:35.205704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:46:42.049090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776003+0000","last_change":"2026-02-20T13:16:33.771484+0000","last_active":"2026-02-20T13:16:34.776003+0000","last_peered":"2026-02-20T13:16:34.776003+0000","last_clean":"2026-02-20T13:16:34.776003+0000","last_became_active":"2026-02-20T13:16:33.771290+0000","last_became_peered":"2026-02-20T13:16:33.771290+0000","last_unstale":"2026-02-20T13:16:34.776003+0000","last_undegraded":"2026-02-20T13:16:34.776003+0000","last_fullsized":"2026-02-20T13:16:34.776003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:17.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815490+0000","last_change":"2026-02-20T13:16:33.772825+0000","last_active":"2026-02-20T13:16:34.815490+0000","last_peered":"2026-02-20T13:16:34.815490+0000","last_clean":"2026-02-20T13:16:34.815490+0000","last_became_active":"2026-02-20T13:16:33.772523+0000","last_became_peered":"2026-02-20T13:16:33.772523+0000","last_unstale":"2026-02-20T13:16:34.815490+0000","last_undegraded":"2026-02-20T13:16:34.815490+0000","last_fullsized":"2026-02-20T13:16:34.815490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:22:02.615451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362733+0000","last_change":"2026-02-20T13:16:33.773299+0000","last_active":"2026-02-20T13:16:35.362733+0000","last_peered":"2026-02-20T13:16:35.362733+0000","last_clean":"2026-02-20T13:16:35.362733+0000","last_became_active":"2026-02-20T13:16:33.772997+0000","last_became_peered":"2026-02-20T13:16:33.772997+0000","last_unstale":"2026-02-20T13:16:35.362733+0000","last_undegraded":"2026-02-20T13:16:35.362733+0000","last_fullsized":"2026-02-20T13:16:35.362733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:37:58.166137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775144+0000","last_change":"2026-02-20T13:16:33.771008+0000","last_active":"2026-02-20T13:16:34.775144+0000","last_peered":"2026-02-20T13:16:34.775144+0000","last_clean":"2026-02-20T13:16:34.775144+0000","last_became_active":"2026-02-20T13:16:33.770193+0000","last_became_peered":"2026-02-20T13:16:33.770193+0000","last_unstale":"2026-02-20T13:16:34.775144+0000","last_undegraded":"2026-02-20T13:16:34.775144+0000","last_fullsized":"2026-02-20T13:16:34.775144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:31:47.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775584+0000","last_change":"2026-02-20T13:16:33.779616+0000","last_active":"2026-02-20T13:16:34.775584+0000","last_peered":"2026-02-20T13:16:34.775584+0000","last_clean":"2026-02-20T13:16:34.775584+0000","last_became_active":"2026-02-20T13:16:33.777164+0000","last_became_peered":"2026-02-20T13:16:33.777164+0000","last_unstale":"2026-02-20T13:16:34.775584+0000","last_undegraded":"2026-02-20T13:16:34.775584+0000","last_fullsized":"2026-02-20T13:16:34.775584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:12:15.518885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775541+0000","last_change":"2026-02-20T13:16:33.775271+0000","last_active":"2026-02-20T13:16:34.775541+0000","last_peered":"2026-02-20T13:16:34.775541+0000","last_clean":"2026-02-20T13:16:34.775541+0000","last_became_active":"2026-02-20T13:16:33.775196+0000","last_became_peered":"2026-02-20T13:16:33.775196+0000","last_unstale":"2026-02-20T13:16:34.775541+0000","last_undegraded":"2026-02-20T13:16:34.775541+0000","last_fullsized":"2026-02-20T13:16:34.775541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:25:55.414505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.204982+0000","last_change":"2026-02-20T13:16:33.777616+0000","last_active":"2026-02-20T13:16:35.204982+0000","last_peered":"2026-02-20T13:16:35.204982+0000","last_clean":"2026-02-20T13:16:35.204982+0000","last_became_active":"2026-02-20T13:16:33.777492+0000","last_became_peered":"2026-02-20T13:16:33.777492+0000","last_unstale":"2026-02-20T13:16:35.204982+0000","last_undegraded":"2026-02-20T13:16:35.204982+0000","last_fullsized":"2026-02-20T13:16:35.204982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:23:47.111548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363292+0000","last_change":"2026-02-20T13:16:33.782661+0000","last_active":"2026-02-20T13:16:35.363292+0000","last_peered":"2026-02-20T13:16:35.363292+0000","last_clean":"2026-02-20T13:16:35.363292+0000","last_became_active":"2026-02-20T13:16:33.782460+0000","last_became_peered":"2026-02-20T13:16:33.782460+0000","last_unstale":"2026-02-20T13:16:35.363292+0000","last_undegraded":"2026-02-20T13:16:35.363292+0000","last_fullsized":"2026-02-20T13:16:35.363292+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:28.176844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362092+0000","last_change":"2026-02-20T13:16:33.772371+0000","last_active":"2026-02-20T13:16:35.362092+0000","last_peered":"2026-02-20T13:16:35.362092+0000","last_clean":"2026-02-20T13:16:35.362092+0000","last_became_active":"2026-02-20T13:16:33.771972+0000","last_became_peered":"2026-02-20T13:16:33.771972+0000","last_unstale":"2026-02-20T13:16:35.362092+0000","last_undegraded":"2026-02-20T13:16:35.362092+0000","last_fullsized":"2026-02-20T13:16:35.362092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:25:22.181288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363321+0000","last_change":"2026-02-20T13:16:33.781574+0000","last_active":"2026-02-20T13:16:35.363321+0000","last_peered":"2026-02-20T13:16:35.363321+0000","last_clean":"2026-02-20T13:16:35.363321+0000","last_became_active":"2026-02-20T13:16:33.781443+0000","last_became_peered":"2026-02-20T13:16:33.781443+0000","last_unstale":"2026-02-20T13:16:35.363321+0000","last_undegraded":"2026-02-20T13:16:35.363321+0000","last_fullsized":"2026-02-20T13:16:35.363321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:50:02.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362762+0000","last_change":"2026-02-20T13:16:33.774160+0000","last_active":"2026-02-20T13:16:35.362762+0000","last_peered":"2026-02-20T13:16:35.362762+0000","last_clean":"2026-02-20T13:16:35.362762+0000","last_became_active":"2026-02-20T13:16:33.773455+0000","last_became_peered":"2026-02-20T13:16:33.773455+0000","last_unstale":"2026-02-20T13:16:35.362762+0000","last_undegraded":"2026-02-20T13:16:35.362762+0000","last_fullsized":"2026-02-20T13:16:35.362762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:55.556028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775382+0000","last_change":"2026-02-20T13:16:33.781076+0000","last_active":"2026-02-20T13:16:34.775382+0000","last_peered":"2026-02-20T13:16:34.775382+0000","last_clean":"2026-02-20T13:16:34.775382+0000","last_became_active":"2026-02-20T13:16:33.780966+0000","last_became_peered":"2026-02-20T13:16:33.780966+0000","last_unstale":"2026-02-20T13:16:34.775382+0000","last_undegraded":"2026-02-20T13:16:34.775382+0000","last_fullsized":"2026-02-20T13:16:34.775382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:02.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205333+0000","last_change":"2026-02-20T13:16:33.775802+0000","last_active":"2026-02-20T13:16:35.205333+0000","last_peered":"2026-02-20T13:16:35.205333+0000","last_clean":"2026-02-20T13:16:35.205333+0000","last_became_active":"2026-02-20T13:16:33.775619+0000","last_became_peered":"2026-02-20T13:16:33.775619+0000","last_unstale":"2026-02-20T13:16:35.205333+0000","last_undegraded":"2026-02-20T13:16:35.205333+0000","last_fullsized":"2026-02-20T13:16:35.205333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:57:04.992610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775136+0000","last_change":"2026-02-20T13:16:33.778796+0000","last_active":"2026-02-20T13:16:34.775136+0000","last_peered":"2026-02-20T13:16:34.775136+0000","last_clean":"2026-02-20T13:16:34.775136+0000","last_became_active":"2026-02-20T13:16:33.777986+0000","last_became_peered":"2026-02-20T13:16:33.777986+0000","last_unstale":"2026-02-20T13:16:34.775136+0000","last_undegraded":"2026-02-20T13:16:34.775136+0000","last_fullsized":"2026-02-20T13:16:34.775136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:23:48.810359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363099+0000","last_change":"2026-02-20T13:16:33.775037+0000","last_active":"2026-02-20T13:16:35.363099+0000","last_peered":"2026-02-20T13:16:35.363099+0000","last_clean":"2026-02-20T13:16:35.363099+0000","last_became_active":"2026-02-20T13:16:33.774863+0000","last_became_peered":"2026-02-20T13:16:33.774863+0000","last_unstale":"2026-02-20T13:16:35.363099+0000","last_undegraded":"2026-02-20T13:16:35.363099+0000","last_fullsized":"2026-02-20T13:16:35.363099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:35:28.128032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775911+0000","last_change":"2026-02-20T13:16:33.778417+0000","last_active":"2026-02-20T13:16:34.775911+0000","last_peered":"2026-02-20T13:16:34.775911+0000","last_clean":"2026-02-20T13:16:34.775911+0000","last_became_active":"2026-02-20T13:16:33.778315+0000","last_became_peered":"2026-02-20T13:16:33.778315+0000","last_unstale":"2026-02-20T13:16:34.775911+0000","last_undegraded":"2026-02-20T13:16:34.775911+0000","last_fullsized":"2026-02-20T13:16:34.775911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:52:17.442074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363429+0000","last_change":"2026-02-20T13:16:33.773733+0000","last_active":"2026-02-20T13:16:35.363429+0000","last_peered":"2026-02-20T13:16:35.363429+0000","last_clean":"2026-02-20T13:16:35.363429+0000","last_became_active":"2026-02-20T13:16:33.773501+0000","last_became_peered":"2026-02-20T13:16:33.773501+0000","last_unstale":"2026-02-20T13:16:35.363429+0000","last_undegraded":"2026-02-20T13:16:35.363429+0000","last_fullsized":"2026-02-20T13:16:35.363429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:02.128160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362990+0000","last_change":"2026-02-20T13:16:33.773793+0000","last_active":"2026-02-20T13:16:35.362990+0000","last_peered":"2026-02-20T13:16:35.362990+0000","last_clean":"2026-02-20T13:16:35.362990+0000","last_became_active":"2026-02-20T13:16:33.773394+0000","last_became_peered":"2026-02-20T13:16:33.773394+0000","last_unstale":"2026-02-20T13:16:35.362990+0000","last_undegraded":"2026-02-20T13:16:35.362990+0000","last_fullsized":"2026-02-20T13:16:35.362990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:09:33.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775197+0000","last_change":"2026-02-20T13:16:33.782888+0000","last_active":"2026-02-20T13:16:34.775197+0000","last_peered":"2026-02-20T13:16:34.775197+0000","last_clean":"2026-02-20T13:16:34.775197+0000","last_became_active":"2026-02-20T13:16:33.782351+0000","last_became_peered":"2026-02-20T13:16:33.782351+0000","last_unstale":"2026-02-20T13:16:34.775197+0000","last_undegraded":"2026-02-20T13:16:34.775197+0000","last_fullsized":"2026-02-20T13:16:34.775197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:48:12.437710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775685+0000","last_change":"2026-02-20T13:16:33.783827+0000","last_active":"2026-02-20T13:16:34.775685+0000","last_peered":"2026-02-20T13:16:34.775685+0000","last_clean":"2026-02-20T13:16:34.775685+0000","last_became_active":"2026-02-20T13:16:33.783643+0000","last_became_peered":"2026-02-20T13:16:33.783643+0000","last_unstale":"2026-02-20T13:16:34.775685+0000","last_undegraded":"2026-02-20T13:16:34.775685+0000","last_fullsized":"2026-02-20T13:16:34.775685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:29:12.093074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363054+0000","last_change":"2026-02-20T13:16:33.777581+0000","last_active":"2026-02-20T13:16:35.363054+0000","last_peered":"2026-02-20T13:16:35.363054+0000","last_clean":"2026-02-20T13:16:35.363054+0000","last_became_active":"2026-02-20T13:16:33.777440+0000","last_became_peered":"2026-02-20T13:16:33.777440+0000","last_unstale":"2026-02-20T13:16:35.363054+0000","last_undegraded":"2026-02-20T13:16:35.363054+0000","last_fullsized":"2026-02-20T13:16:35.363054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:11:30.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363074+0000","last_change":"2026-02-20T13:16:33.772746+0000","last_active":"2026-02-20T13:16:35.363074+0000","last_peered":"2026-02-20T13:16:35.363074+0000","last_clean":"2026-02-20T13:16:35.363074+0000","last_became_active":"2026-02-20T13:16:33.772477+0000","last_became_peered":"2026-02-20T13:16:33.772477+0000","last_unstale":"2026-02-20T13:16:35.363074+0000","last_undegraded":"2026-02-20T13:16:35.363074+0000","last_fullsized":"2026-02-20T13:16:35.363074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:09:12.086380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362747+0000","last_change":"2026-02-20T13:16:33.774535+0000","last_active":"2026-02-20T13:16:35.362747+0000","last_peered":"2026-02-20T13:16:35.362747+0000","last_clean":"2026-02-20T13:16:35.362747+0000","last_became_active":"2026-02-20T13:16:33.773897+0000","last_became_peered":"2026-02-20T13:16:33.773897+0000","last_unstale":"2026-02-20T13:16:35.362747+0000","last_undegraded":"2026-02-20T13:16:35.362747+0000","last_fullsized":"2026-02-20T13:16:35.362747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:28:43.807089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776035+0000","last_change":"2026-02-20T13:16:33.775010+0000","last_active":"2026-02-20T13:16:34.776035+0000","last_peered":"2026-02-20T13:16:34.776035+0000","last_clean":"2026-02-20T13:16:34.776035+0000","last_became_active":"2026-02-20T13:16:33.774795+0000","last_became_peered":"2026-02-20T13:16:33.774795+0000","last_unstale":"2026-02-20T13:16:34.776035+0000","last_undegraded":"2026-02-20T13:16:34.776035+0000","last_fullsized":"2026-02-20T13:16:34.776035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:03:06.250352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.090221+0000","last_change":"2026-02-20T13:16:32.770339+0000","last_active":"2026-02-20T13:17:11.090221+0000","last_peered":"2026-02-20T13:17:11.090221+0000","last_clean":"2026-02-20T13:17:11.090221+0000","last_became_active":"2026-02-20T13:16:32.770227+0000","last_became_peered":"2026-02-20T13:16:32.770227+0000","last_unstale":"2026-02-20T13:17:11.090221+0000","last_undegraded":"2026-02-20T13:17:11.090221+0000","last_fullsized":"2026-02-20T13:17:11.090221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:07:04.745570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363324+0000","last_change":"2026-02-20T13:16:33.780292+0000","last_active":"2026-02-20T13:16:35.363324+0000","last_peered":"2026-02-20T13:16:35.363324+0000","last_clean":"2026-02-20T13:16:35.363324+0000","last_became_active":"2026-02-20T13:16:33.780165+0000","last_became_peered":"2026-02-20T13:16:33.780165+0000","last_unstale":"2026-02-20T13:16:35.363324+0000","last_undegraded":"2026-02-20T13:16:35.363324+0000","last_fullsized":"2026-02-20T13:16:35.363324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:05:06.831132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805239+0000","last_change":"2026-02-20T13:16:32.769737+0000","last_active":"2026-02-20T13:16:38.805239+0000","last_peered":"2026-02-20T13:16:38.805239+0000","last_clean":"2026-02-20T13:16:38.805239+0000","last_became_active":"2026-02-20T13:16:32.769570+0000","last_became_peered":"2026-02-20T13:16:32.769570+0000","last_unstale":"2026-02-20T13:16:38.805239+0000","last_undegraded":"2026-02-20T13:16:38.805239+0000","last_fullsized":"2026-02-20T13:16:38.805239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:41:52.447735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.798501+0000","last_change":"2026-02-20T13:16:32.771432+0000","last_active":"2026-02-20T13:16:37.798501+0000","last_peered":"2026-02-20T13:16:37.798501+0000","last_clean":"2026-02-20T13:16:37.798501+0000","last_became_active":"2026-02-20T13:16:32.771106+0000","last_became_peered":"2026-02-20T13:16:32.771106+0000","last_unstale":"2026-02-20T13:16:37.798501+0000","last_undegraded":"2026-02-20T13:16:37.798501+0000","last_fullsized":"2026-02-20T13:16:37.798501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:22:00.362256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774906+0000","last_change":"2026-02-20T13:16:33.781914+0000","last_active":"2026-02-20T13:16:34.774906+0000","last_peered":"2026-02-20T13:16:34.774906+0000","last_clean":"2026-02-20T13:16:34.774906+0000","last_became_active":"2026-02-20T13:16:33.781840+0000","last_became_peered":"2026-02-20T13:16:33.781840+0000","last_unstale":"2026-02-20T13:16:34.774906+0000","last_undegraded":"2026-02-20T13:16:34.774906+0000","last_fullsized":"2026-02-20T13:16:34.774906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:32.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.073267+0000","last_change":"2026-02-20T13:16:32.768503+0000","last_active":"2026-02-20T13:16:39.073267+0000","last_peered":"2026-02-20T13:16:39.073267+0000","last_clean":"2026-02-20T13:16:39.073267+0000","last_became_active":"2026-02-20T13:16:32.768221+0000","last_became_peered":"2026-02-20T13:16:32.768221+0000","last_unstale":"2026-02-20T13:16:39.073267+0000","last_undegraded":"2026-02-20T13:16:39.073267+0000","last_fullsized":"2026-02-20T13:16:39.073267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:05:23.457231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.361969+0000","last_change":"2026-02-20T13:16:33.775818+0000","last_active":"2026-02-20T13:16:35.361969+0000","last_peered":"2026-02-20T13:16:35.361969+0000","last_clean":"2026-02-20T13:16:35.361969+0000","last_became_active":"2026-02-20T13:16:33.775708+0000","last_became_peered":"2026-02-20T13:16:33.775708+0000","last_unstale":"2026-02-20T13:16:35.361969+0000","last_undegraded":"2026-02-20T13:16:35.361969+0000","last_fullsized":"2026-02-20T13:16:35.361969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:55.926386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'5","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.098919+0000","last_change":"2026-02-20T13:16:32.772001+0000","last_active":"2026-02-20T13:17:10.098919+0000","last_peered":"2026-02-20T13:17:10.098919+0000","last_clean":"2026-02-20T13:17:10.098919+0000","last_became_active":"2026-02-20T13:16:32.771830+0000","last_became_peered":"2026-02-20T13:16:32.771830+0000","last_unstale":"2026-02-20T13:17:10.098919+0000","last_undegraded":"2026-02-20T13:17:10.098919+0000","last_fullsized":"2026-02-20T13:17:10.098919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:36:58.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205690+0000","last_change":"2026-02-20T13:16:33.770214+0000","last_active":"2026-02-20T13:16:35.205690+0000","last_peered":"2026-02-20T13:16:35.205690+0000","last_clean":"2026-02-20T13:16:35.205690+0000","last_became_active":"2026-02-20T13:16:33.770109+0000","last_became_peered":"2026-02-20T13:16:33.770109+0000","last_unstale":"2026-02-20T13:16:35.205690+0000","last_undegraded":"2026-02-20T13:16:35.205690+0000","last_fullsized":"2026-02-20T13:16:35.205690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:07:12.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077594+0000","last_change":"2026-02-20T13:16:32.769497+0000","last_active":"2026-02-20T13:16:39.077594+0000","last_peered":"2026-02-20T13:16:39.077594+0000","last_clean":"2026-02-20T13:16:39.077594+0000","last_became_active":"2026-02-20T13:16:32.769290+0000","last_became_peered":"2026-02-20T13:16:32.769290+0000","last_unstale":"2026-02-20T13:16:39.077594+0000","last_undegraded":"2026-02-20T13:16:39.077594+0000","last_fullsized":"2026-02-20T13:16:39.077594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:32:01.315125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776224+0000","last_change":"2026-02-20T13:16:33.779612+0000","last_active":"2026-02-20T13:16:34.776224+0000","last_peered":"2026-02-20T13:16:34.776224+0000","last_clean":"2026-02-20T13:16:34.776224+0000","last_became_active":"2026-02-20T13:16:33.777908+0000","last_became_peered":"2026-02-20T13:16:33.777908+0000","last_unstale":"2026-02-20T13:16:34.776224+0000","last_undegraded":"2026-02-20T13:16:34.776224+0000","last_fullsized":"2026-02-20T13:16:34.776224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:21:19.436176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.803770+0000","last_change":"2026-02-20T13:16:32.774215+0000","last_active":"2026-02-20T13:16:38.803770+0000","last_peered":"2026-02-20T13:16:38.803770+0000","last_clean":"2026-02-20T13:16:38.803770+0000","last_became_active":"2026-02-20T13:16:32.774096+0000","last_became_peered":"2026-02-20T13:16:32.774096+0000","last_unstale":"2026-02-20T13:16:38.803770+0000","last_undegraded":"2026-02-20T13:16:38.803770+0000","last_fullsized":"2026-02-20T13:16:38.803770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:39:42.159225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205431+0000","last_change":"2026-02-20T13:16:33.771538+0000","last_active":"2026-02-20T13:16:35.205431+0000","last_peered":"2026-02-20T13:16:35.205431+0000","last_clean":"2026-02-20T13:16:35.205431+0000","last_became_active":"2026-02-20T13:16:33.771324+0000","last_became_peered":"2026-02-20T13:16:33.771324+0000","last_unstale":"2026-02-20T13:16:35.205431+0000","last_undegraded":"2026-02-20T13:16:35.205431+0000","last_fullsized":"2026-02-20T13:16:35.205431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:29:34.251262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'35","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:10.096561+0000","last_change":"2026-02-20T13:16:32.769965+0000","last_active":"2026-02-20T13:17:10.096561+0000","last_peered":"2026-02-20T13:17:10.096561+0000","last_clean":"2026-02-20T13:17:10.096561+0000","last_became_active":"2026-02-20T13:16:32.769771+0000","last_became_peered":"2026-02-20T13:16:32.769771+0000","last_unstale":"2026-02-20T13:17:10.096561+0000","last_undegraded":"2026-02-20T13:17:10.096561+0000","last_fullsized":"2026-02-20T13:17:10.096561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:01:41.824965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71042,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":105,"num_write":37,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775991+0000","last_change":"2026-02-20T13:16:33.773369+0000","last_active":"2026-02-20T13:16:34.775991+0000","last_peered":"2026-02-20T13:16:34.775991+0000","last_clean":"2026-02-20T13:16:34.775991+0000","last_became_active":"2026-02-20T13:16:33.773132+0000","last_became_peered":"2026-02-20T13:16:33.773132+0000","last_unstale":"2026-02-20T13:16:34.775991+0000","last_undegraded":"2026-02-20T13:16:34.775991+0000","last_fullsized":"2026-02-20T13:16:34.775991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:04:37.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078209+0000","last_change":"2026-02-20T13:16:32.778035+0000","last_active":"2026-02-20T13:16:39.078209+0000","last_peered":"2026-02-20T13:16:39.078209+0000","last_clean":"2026-02-20T13:16:39.078209+0000","last_became_active":"2026-02-20T13:16:32.777896+0000","last_became_peered":"2026-02-20T13:16:32.777896+0000","last_unstale":"2026-02-20T13:16:39.078209+0000","last_undegraded":"2026-02-20T13:16:39.078209+0000","last_fullsized":"2026-02-20T13:16:39.078209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:48.986903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774897+0000","last_change":"2026-02-20T13:16:33.781488+0000","last_active":"2026-02-20T13:16:34.774897+0000","last_peered":"2026-02-20T13:16:34.774897+0000","last_clean":"2026-02-20T13:16:34.774897+0000","last_became_active":"2026-02-20T13:16:33.781304+0000","last_became_peered":"2026-02-20T13:16:33.781304+0000","last_unstale":"2026-02-20T13:16:34.774897+0000","last_undegraded":"2026-02-20T13:16:34.774897+0000","last_fullsized":"2026-02-20T13:16:34.774897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:27:36.786774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078336+0000","last_change":"2026-02-20T13:16:32.777138+0000","last_active":"2026-02-20T13:16:39.078336+0000","last_peered":"2026-02-20T13:16:39.078336+0000","last_clean":"2026-02-20T13:16:39.078336+0000","last_became_active":"2026-02-20T13:16:32.776933+0000","last_became_peered":"2026-02-20T13:16:32.776933+0000","last_unstale":"2026-02-20T13:16:39.078336+0000","last_undegraded":"2026-02-20T13:16:39.078336+0000","last_fullsized":"2026-02-20T13:16:39.078336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:11:00.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815447+0000","last_change":"2026-02-20T13:16:33.777566+0000","last_active":"2026-02-20T13:16:34.815447+0000","last_peered":"2026-02-20T13:16:34.815447+0000","last_clean":"2026-02-20T13:16:34.815447+0000","last_became_active":"2026-02-20T13:16:33.777345+0000","last_became_peered":"2026-02-20T13:16:33.777345+0000","last_unstale":"2026-02-20T13:16:34.815447+0000","last_undegraded":"2026-02-20T13:16:34.815447+0000","last_fullsized":"2026-02-20T13:16:34.815447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:18.574431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:12.103100+0000","last_change":"2026-02-20T13:16:32.766794+0000","last_active":"2026-02-20T13:17:12.103100+0000","last_peered":"2026-02-20T13:17:12.103100+0000","last_clean":"2026-02-20T13:17:12.103100+0000","last_became_active":"2026-02-20T13:16:32.766574+0000","last_became_peered":"2026-02-20T13:16:32.766574+0000","last_unstale":"2026-02-20T13:17:12.103100+0000","last_undegraded":"2026-02-20T13:17:12.103100+0000","last_fullsized":"2026-02-20T13:17:12.103100+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:45:23.968187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815271+0000","last_change":"2026-02-20T13:16:33.773263+0000","last_active":"2026-02-20T13:16:34.815271+0000","last_peered":"2026-02-20T13:16:34.815271+0000","last_clean":"2026-02-20T13:16:34.815271+0000","last_became_active":"2026-02-20T13:16:33.773041+0000","last_became_peered":"2026-02-20T13:16:33.773041+0000","last_unstale":"2026-02-20T13:16:34.815271+0000","last_undegraded":"2026-02-20T13:16:34.815271+0000","last_fullsized":"2026-02-20T13:16:34.815271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:31:00.257125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069640+0000","last_change":"2026-02-20T13:16:32.774214+0000","last_active":"2026-02-20T13:16:39.069640+0000","last_peered":"2026-02-20T13:16:39.069640+0000","last_clean":"2026-02-20T13:16:39.069640+0000","last_became_active":"2026-02-20T13:16:32.774047+0000","last_became_peered":"2026-02-20T13:16:32.774047+0000","last_unstale":"2026-02-20T13:16:39.069640+0000","last_undegraded":"2026-02-20T13:16:39.069640+0000","last_fullsized":"2026-02-20T13:16:39.069640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:08:12.330810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363114+0000","last_change":"2026-02-20T13:16:33.771334+0000","last_active":"2026-02-20T13:16:35.363114+0000","last_peered":"2026-02-20T13:16:35.363114+0000","last_clean":"2026-02-20T13:16:35.363114+0000","last_became_active":"2026-02-20T13:16:33.770715+0000","last_became_peered":"2026-02-20T13:16:33.770715+0000","last_unstale":"2026-02-20T13:16:35.363114+0000","last_undegraded":"2026-02-20T13:16:35.363114+0000","last_fullsized":"2026-02-20T13:16:35.363114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:42:12.528072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069772+0000","last_change":"2026-02-20T13:16:32.768440+0000","last_active":"2026-02-20T13:16:39.069772+0000","last_peered":"2026-02-20T13:16:39.069772+0000","last_clean":"2026-02-20T13:16:39.069772+0000","last_became_active":"2026-02-20T13:16:32.768229+0000","last_became_peered":"2026-02-20T13:16:32.768229+0000","last_unstale":"2026-02-20T13:16:39.069772+0000","last_undegraded":"2026-02-20T13:16:39.069772+0000","last_fullsized":"2026-02-20T13:16:39.069772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:18:17.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363005+0000","last_change":"2026-02-20T13:16:33.773925+0000","last_active":"2026-02-20T13:16:35.363005+0000","last_peered":"2026-02-20T13:16:35.363005+0000","last_clean":"2026-02-20T13:16:35.363005+0000","last_became_active":"2026-02-20T13:16:33.773523+0000","last_became_peered":"2026-02-20T13:16:33.773523+0000","last_unstale":"2026-02-20T13:16:35.363005+0000","last_undegraded":"2026-02-20T13:16:35.363005+0000","last_fullsized":"2026-02-20T13:16:35.363005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:46:19.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079342+0000","last_change":"2026-02-20T13:16:32.775572+0000","last_active":"2026-02-20T13:16:39.079342+0000","last_peered":"2026-02-20T13:16:39.079342+0000","last_clean":"2026-02-20T13:16:39.079342+0000","last_became_active":"2026-02-20T13:16:32.775447+0000","last_became_peered":"2026-02-20T13:16:32.775447+0000","last_unstale":"2026-02-20T13:16:39.079342+0000","last_undegraded":"2026-02-20T13:16:39.079342+0000","last_fullsized":"2026-02-20T13:16:39.079342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:45:26.280112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815506+0000","last_change":"2026-02-20T13:16:33.774007+0000","last_active":"2026-02-20T13:16:34.815506+0000","last_peered":"2026-02-20T13:16:34.815506+0000","last_clean":"2026-02-20T13:16:34.815506+0000","last_became_active":"2026-02-20T13:16:33.773843+0000","last_became_peered":"2026-02-20T13:16:33.773843+0000","last_unstale":"2026-02-20T13:16:34.815506+0000","last_undegraded":"2026-02-20T13:16:34.815506+0000","last_fullsized":"2026-02-20T13:16:34.815506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:42:41.082049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069608+0000","last_change":"2026-02-20T13:16:32.777049+0000","last_active":"2026-02-20T13:16:39.069608+0000","last_peered":"2026-02-20T13:16:39.069608+0000","last_clean":"2026-02-20T13:16:39.069608+0000","last_became_active":"2026-02-20T13:16:32.776807+0000","last_became_peered":"2026-02-20T13:16:32.776807+0000","last_unstale":"2026-02-20T13:16:39.069608+0000","last_undegraded":"2026-02-20T13:16:39.069608+0000","last_fullsized":"2026-02-20T13:16:39.069608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:15:20.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815453+0000","last_change":"2026-02-20T13:16:33.775805+0000","last_active":"2026-02-20T13:16:34.815453+0000","last_peered":"2026-02-20T13:16:34.815453+0000","last_clean":"2026-02-20T13:16:34.815453+0000","last_became_active":"2026-02-20T13:16:33.775666+0000","last_became_peered":"2026-02-20T13:16:33.775666+0000","last_unstale":"2026-02-20T13:16:34.815453+0000","last_undegraded":"2026-02-20T13:16:34.815453+0000","last_fullsized":"2026-02-20T13:16:34.815453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:52:40.006822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'5","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.099707+0000","last_change":"2026-02-20T13:16:32.773956+0000","last_active":"2026-02-20T13:17:11.099707+0000","last_peered":"2026-02-20T13:17:11.099707+0000","last_clean":"2026-02-20T13:17:11.099707+0000","last_became_active":"2026-02-20T13:16:32.773840+0000","last_became_peered":"2026-02-20T13:16:32.773840+0000","last_unstale":"2026-02-20T13:17:11.099707+0000","last_undegraded":"2026-02-20T13:17:11.099707+0000","last_fullsized":"2026-02-20T13:17:11.099707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:46:05.374854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815501+0000","last_change":"2026-02-20T13:16:33.773652+0000","last_active":"2026-02-20T13:16:34.815501+0000","last_peered":"2026-02-20T13:16:34.815501+0000","last_clean":"2026-02-20T13:16:34.815501+0000","last_became_active":"2026-02-20T13:16:33.773427+0000","last_became_peered":"2026-02-20T13:16:33.773427+0000","last_unstale":"2026-02-20T13:16:34.815501+0000","last_undegraded":"2026-02-20T13:16:34.815501+0000","last_fullsized":"2026-02-20T13:16:34.815501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:07:14.564697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":340,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815354+0000","last_change":"2026-02-20T13:16:09.625812+0000","last_active":"2026-02-20T13:16:34.815354+0000","last_peered":"2026-02-20T13:16:34.815354+0000","last_clean":"2026-02-20T13:16:34.815354+0000","last_became_active":"2026-02-20T13:16:09.625415+0000","last_became_peered":"2026-02-20T13:16:09.625415+0000","last_unstale":"2026-02-20T13:16:34.815354+0000","last_undegraded":"2026-02-20T13:16:34.815354+0000","last_fullsized":"2026-02-20T13:16:34.815354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:14:47.995494+0000","last_clean_scrub_stamp":"2026-02-20T13:14:47.995494+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:09:22.967249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079144+0000","last_change":"2026-02-20T13:16:32.770288+0000","last_active":"2026-02-20T13:16:39.079144+0000","last_peered":"2026-02-20T13:16:39.079144+0000","last_clean":"2026-02-20T13:16:39.079144+0000","last_became_active":"2026-02-20T13:16:32.770146+0000","last_became_peered":"2026-02-20T13:16:32.770146+0000","last_unstale":"2026-02-20T13:16:39.079144+0000","last_undegraded":"2026-02-20T13:16:39.079144+0000","last_fullsized":"2026-02-20T13:16:39.079144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:27:34.278699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775528+0000","last_change":"2026-02-20T13:16:33.778524+0000","last_active":"2026-02-20T13:16:34.775528+0000","last_peered":"2026-02-20T13:16:34.775528+0000","last_clean":"2026-02-20T13:16:34.775528+0000","last_became_active":"2026-02-20T13:16:33.777012+0000","last_became_peered":"2026-02-20T13:16:33.777012+0000","last_unstale":"2026-02-20T13:16:34.775528+0000","last_undegraded":"2026-02-20T13:16:34.775528+0000","last_fullsized":"2026-02-20T13:16:34.775528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:57:15.339495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:37.797261+0000","last_change":"2026-02-20T13:16:32.768648+0000","last_active":"2026-02-20T13:16:37.797261+0000","last_peered":"2026-02-20T13:16:37.797261+0000","last_clean":"2026-02-20T13:16:37.797261+0000","last_became_active":"2026-02-20T13:16:32.768464+0000","last_became_peered":"2026-02-20T13:16:32.768464+0000","last_unstale":"2026-02-20T13:16:37.797261+0000","last_undegraded":"2026-02-20T13:16:37.797261+0000","last_fullsized":"2026-02-20T13:16:37.797261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:08:06.058603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.774847+0000","last_change":"2026-02-20T13:16:33.774353+0000","last_active":"2026-02-20T13:16:34.774847+0000","last_peered":"2026-02-20T13:16:34.774847+0000","last_clean":"2026-02-20T13:16:34.774847+0000","last_became_active":"2026-02-20T13:16:33.774238+0000","last_became_peered":"2026-02-20T13:16:33.774238+0000","last_unstale":"2026-02-20T13:16:34.774847+0000","last_undegraded":"2026-02-20T13:16:34.774847+0000","last_fullsized":"2026-02-20T13:16:34.774847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:21:37.654623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":58,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:13.102539+0000","last_change":"2026-02-20T13:16:32.773458+0000","last_active":"2026-02-20T13:17:13.102539+0000","last_peered":"2026-02-20T13:17:13.102539+0000","last_clean":"2026-02-20T13:17:13.102539+0000","last_became_active":"2026-02-20T13:16:32.773376+0000","last_became_peered":"2026-02-20T13:16:32.773376+0000","last_unstale":"2026-02-20T13:17:13.102539+0000","last_undegraded":"2026-02-20T13:17:13.102539+0000","last_fullsized":"2026-02-20T13:17:13.102539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:55:17.925143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363454+0000","last_change":"2026-02-20T13:16:33.771918+0000","last_active":"2026-02-20T13:16:35.363454+0000","last_peered":"2026-02-20T13:16:35.363454+0000","last_clean":"2026-02-20T13:16:35.363454+0000","last_became_active":"2026-02-20T13:16:33.771629+0000","last_became_peered":"2026-02-20T13:16:33.771629+0000","last_unstale":"2026-02-20T13:16:35.363454+0000","last_undegraded":"2026-02-20T13:16:35.363454+0000","last_fullsized":"2026-02-20T13:16:35.363454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:31:29.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:11.102398+0000","last_change":"2026-02-20T13:16:32.767308+0000","last_active":"2026-02-20T13:17:11.102398+0000","last_peered":"2026-02-20T13:17:11.102398+0000","last_clean":"2026-02-20T13:17:11.102398+0000","last_became_active":"2026-02-20T13:16:32.767086+0000","last_became_peered":"2026-02-20T13:16:32.767086+0000","last_unstale":"2026-02-20T13:17:11.102398+0000","last_undegraded":"2026-02-20T13:17:11.102398+0000","last_fullsized":"2026-02-20T13:17:11.102398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:15:10.443570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775928+0000","last_change":"2026-02-20T13:16:33.781151+0000","last_active":"2026-02-20T13:16:34.775928+0000","last_peered":"2026-02-20T13:16:34.775928+0000","last_clean":"2026-02-20T13:16:34.775928+0000","last_became_active":"2026-02-20T13:16:33.781008+0000","last_became_peered":"2026-02-20T13:16:33.781008+0000","last_unstale":"2026-02-20T13:16:34.775928+0000","last_undegraded":"2026-02-20T13:16:34.775928+0000","last_fullsized":"2026-02-20T13:16:34.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:53:21.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"78'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.362024+0000","last_change":"2026-02-20T13:16:32.774571+0000","last_active":"2026-02-20T13:16:35.362024+0000","last_peered":"2026-02-20T13:16:35.362024+0000","last_clean":"2026-02-20T13:16:35.362024+0000","last_became_active":"2026-02-20T13:16:32.774023+0000","last_became_peered":"2026-02-20T13:16:32.774023+0000","last_unstale":"2026-02-20T13:16:35.362024+0000","last_undegraded":"2026-02-20T13:16:35.362024+0000","last_fullsized":"2026-02-20T13:16:35.362024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:23:59.932851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.625539+0000","last_change":"2026-02-20T13:16:33.778974+0000","last_active":"2026-02-20T13:16:35.625539+0000","last_peered":"2026-02-20T13:16:35.625539+0000","last_clean":"2026-02-20T13:16:35.625539+0000","last_became_active":"2026-02-20T13:16:33.778842+0000","last_became_peered":"2026-02-20T13:16:33.778842+0000","last_unstale":"2026-02-20T13:16:35.625539+0000","last_undegraded":"2026-02-20T13:16:35.625539+0000","last_fullsized":"2026-02-20T13:16:35.625539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:28:17.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.069052+0000","last_change":"2026-02-20T13:16:32.773582+0000","last_active":"2026-02-20T13:16:39.069052+0000","last_peered":"2026-02-20T13:16:39.069052+0000","last_clean":"2026-02-20T13:16:39.069052+0000","last_became_active":"2026-02-20T13:16:32.773454+0000","last_became_peered":"2026-02-20T13:16:32.773454+0000","last_unstale":"2026-02-20T13:16:39.069052+0000","last_undegraded":"2026-02-20T13:16:39.069052+0000","last_fullsized":"2026-02-20T13:16:39.069052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:45:52.871956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775257+0000","last_change":"2026-02-20T13:16:33.777735+0000","last_active":"2026-02-20T13:16:34.775257+0000","last_peered":"2026-02-20T13:16:34.775257+0000","last_clean":"2026-02-20T13:16:34.775257+0000","last_became_active":"2026-02-20T13:16:33.777529+0000","last_became_peered":"2026-02-20T13:16:33.777529+0000","last_unstale":"2026-02-20T13:16:34.775257+0000","last_undegraded":"2026-02-20T13:16:34.775257+0000","last_fullsized":"2026-02-20T13:16:34.775257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:08:20.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:47.768390+0000","last_change":"2026-02-20T13:16:32.776287+0000","last_active":"2026-02-20T13:16:47.768390+0000","last_peered":"2026-02-20T13:16:47.768390+0000","last_clean":"2026-02-20T13:16:47.768390+0000","last_became_active":"2026-02-20T13:16:32.776174+0000","last_became_peered":"2026-02-20T13:16:32.776174+0000","last_unstale":"2026-02-20T13:16:47.768390+0000","last_undegraded":"2026-02-20T13:16:47.768390+0000","last_fullsized":"2026-02-20T13:16:47.768390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T23:31:56.704524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775783+0000","last_change":"2026-02-20T13:16:33.777871+0000","last_active":"2026-02-20T13:16:34.775783+0000","last_peered":"2026-02-20T13:16:34.775783+0000","last_clean":"2026-02-20T13:16:34.775783+0000","last_became_active":"2026-02-20T13:16:33.776824+0000","last_became_peered":"2026-02-20T13:16:33.776824+0000","last_unstale":"2026-02-20T13:16:34.775783+0000","last_undegraded":"2026-02-20T13:16:34.775783+0000","last_fullsized":"2026-02-20T13:16:34.775783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:24:52.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.079979+0000","last_change":"2026-02-20T13:16:32.771931+0000","last_active":"2026-02-20T13:16:39.079979+0000","last_peered":"2026-02-20T13:16:39.079979+0000","last_clean":"2026-02-20T13:16:39.079979+0000","last_became_active":"2026-02-20T13:16:32.771759+0000","last_became_peered":"2026-02-20T13:16:32.771759+0000","last_unstale":"2026-02-20T13:16:39.079979+0000","last_undegraded":"2026-02-20T13:16:39.079979+0000","last_fullsized":"2026-02-20T13:16:39.079979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:55.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776055+0000","last_change":"2026-02-20T13:16:33.783113+0000","last_active":"2026-02-20T13:16:34.776055+0000","last_peered":"2026-02-20T13:16:34.776055+0000","last_clean":"2026-02-20T13:16:34.776055+0000","last_became_active":"2026-02-20T13:16:33.783042+0000","last_became_peered":"2026-02-20T13:16:33.783042+0000","last_unstale":"2026-02-20T13:16:34.776055+0000","last_undegraded":"2026-02-20T13:16:34.776055+0000","last_fullsized":"2026-02-20T13:16:34.776055+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:22:07.569275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794426+0000","last_change":"2026-02-20T13:16:32.774348+0000","last_active":"2026-02-20T13:16:36.794426+0000","last_peered":"2026-02-20T13:16:36.794426+0000","last_clean":"2026-02-20T13:16:36.794426+0000","last_became_active":"2026-02-20T13:16:32.774224+0000","last_became_peered":"2026-02-20T13:16:32.774224+0000","last_unstale":"2026-02-20T13:16:36.794426+0000","last_undegraded":"2026-02-20T13:16:36.794426+0000","last_fullsized":"2026-02-20T13:16:36.794426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:26:20.454795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775665+0000","last_change":"2026-02-20T13:16:33.771896+0000","last_active":"2026-02-20T13:16:34.775665+0000","last_peered":"2026-02-20T13:16:34.775665+0000","last_clean":"2026-02-20T13:16:34.775665+0000","last_became_active":"2026-02-20T13:16:33.771680+0000","last_became_peered":"2026-02-20T13:16:33.771680+0000","last_unstale":"2026-02-20T13:16:34.775665+0000","last_undegraded":"2026-02-20T13:16:34.775665+0000","last_fullsized":"2026-02-20T13:16:34.775665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:17:17.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.078134+0000","last_change":"2026-02-20T13:16:32.774222+0000","last_active":"2026-02-20T13:16:39.078134+0000","last_peered":"2026-02-20T13:16:39.078134+0000","last_clean":"2026-02-20T13:16:39.078134+0000","last_became_active":"2026-02-20T13:16:32.773600+0000","last_became_peered":"2026-02-20T13:16:32.773600+0000","last_unstale":"2026-02-20T13:16:39.078134+0000","last_undegraded":"2026-02-20T13:16:39.078134+0000","last_fullsized":"2026-02-20T13:16:39.078134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:12:36.285254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363071+0000","last_change":"2026-02-20T13:16:33.780939+0000","last_active":"2026-02-20T13:16:35.363071+0000","last_peered":"2026-02-20T13:16:35.363071+0000","last_clean":"2026-02-20T13:16:35.363071+0000","last_became_active":"2026-02-20T13:16:33.780723+0000","last_became_peered":"2026-02-20T13:16:33.780723+0000","last_unstale":"2026-02-20T13:16:35.363071+0000","last_undegraded":"2026-02-20T13:16:35.363071+0000","last_fullsized":"2026-02-20T13:16:35.363071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:45:41.820132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:38.805967+0000","last_change":"2026-02-20T13:16:32.778364+0000","last_active":"2026-02-20T13:16:38.805967+0000","last_peered":"2026-02-20T13:16:38.805967+0000","last_clean":"2026-02-20T13:16:38.805967+0000","last_became_active":"2026-02-20T13:16:32.778185+0000","last_became_peered":"2026-02-20T13:16:32.778185+0000","last_unstale":"2026-02-20T13:16:38.805967+0000","last_undegraded":"2026-02-20T13:16:38.805967+0000","last_fullsized":"2026-02-20T13:16:38.805967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:03:57.499600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775615+0000","last_change":"2026-02-20T13:16:33.781589+0000","last_active":"2026-02-20T13:16:34.775615+0000","last_peered":"2026-02-20T13:16:34.775615+0000","last_clean":"2026-02-20T13:16:34.775615+0000","last_became_active":"2026-02-20T13:16:33.781436+0000","last_became_peered":"2026-02-20T13:16:33.781436+0000","last_unstale":"2026-02-20T13:16:34.775615+0000","last_undegraded":"2026-02-20T13:16:34.775615+0000","last_fullsized":"2026-02-20T13:16:34.775615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:48.281249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:36.794072+0000","last_change":"2026-02-20T13:16:32.768668+0000","last_active":"2026-02-20T13:16:36.794072+0000","last_peered":"2026-02-20T13:16:36.794072+0000","last_clean":"2026-02-20T13:16:36.794072+0000","last_became_active":"2026-02-20T13:16:32.768494+0000","last_became_peered":"2026-02-20T13:16:32.768494+0000","last_unstale":"2026-02-20T13:16:36.794072+0000","last_undegraded":"2026-02-20T13:16:36.794072+0000","last_fullsized":"2026-02-20T13:16:36.794072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:23:52.941307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.815380+0000","last_change":"2026-02-20T13:16:33.777569+0000","last_active":"2026-02-20T13:16:34.815380+0000","last_peered":"2026-02-20T13:16:34.815380+0000","last_clean":"2026-02-20T13:16:34.815380+0000","last_became_active":"2026-02-20T13:16:33.777339+0000","last_became_peered":"2026-02-20T13:16:33.777339+0000","last_unstale":"2026-02-20T13:16:34.815380+0000","last_undegraded":"2026-02-20T13:16:34.815380+0000","last_fullsized":"2026-02-20T13:16:34.815380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:37.218781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.363586+0000","last_change":"2026-02-20T13:16:33.770909+0000","last_active":"2026-02-20T13:16:35.363586+0000","last_peered":"2026-02-20T13:16:35.363586+0000","last_clean":"2026-02-20T13:16:35.363586+0000","last_became_active":"2026-02-20T13:16:33.770458+0000","last_became_peered":"2026-02-20T13:16:33.770458+0000","last_unstale":"2026-02-20T13:16:35.363586+0000","last_undegraded":"2026-02-20T13:16:35.363586+0000","last_fullsized":"2026-02-20T13:16:35.363586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:26.167236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077179+0000","last_change":"2026-02-20T13:16:32.768036+0000","last_active":"2026-02-20T13:16:39.077179+0000","last_peered":"2026-02-20T13:16:39.077179+0000","last_clean":"2026-02-20T13:16:39.077179+0000","last_became_active":"2026-02-20T13:16:32.767819+0000","last_became_peered":"2026-02-20T13:16:32.767819+0000","last_unstale":"2026-02-20T13:16:39.077179+0000","last_undegraded":"2026-02-20T13:16:39.077179+0000","last_fullsized":"2026-02-20T13:16:39.077179+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:21:18.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.205389+0000","last_change":"2026-02-20T13:16:33.775473+0000","last_active":"2026-02-20T13:16:35.205389+0000","last_peered":"2026-02-20T13:16:35.205389+0000","last_clean":"2026-02-20T13:16:35.205389+0000","last_became_active":"2026-02-20T13:16:33.775324+0000","last_became_peered":"2026-02-20T13:16:33.775324+0000","last_unstale":"2026-02-20T13:16:35.205389+0000","last_undegraded":"2026-02-20T13:16:35.205389+0000","last_fullsized":"2026-02-20T13:16:35.205389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:15:44.595341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:39.077443+0000","last_change":"2026-02-20T13:16:32.769128+0000","last_active":"2026-02-20T13:16:39.077443+0000","last_peered":"2026-02-20T13:16:39.077443+0000","last_clean":"2026-02-20T13:16:39.077443+0000","last_became_active":"2026-02-20T13:16:32.769025+0000","last_became_peered":"2026-02-20T13:16:32.769025+0000","last_unstale":"2026-02-20T13:16:39.077443+0000","last_undegraded":"2026-02-20T13:16:39.077443+0000","last_fullsized":"2026-02-20T13:16:39.077443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:28:51.853416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.776170+0000","last_change":"2026-02-20T13:16:33.781023+0000","last_active":"2026-02-20T13:16:34.776170+0000","last_peered":"2026-02-20T13:16:34.776170+0000","last_clean":"2026-02-20T13:16:34.776170+0000","last_became_active":"2026-02-20T13:16:33.780749+0000","last_became_peered":"2026-02-20T13:16:33.780749+0000","last_unstale":"2026-02-20T13:16:34.776170+0000","last_undegraded":"2026-02-20T13:16:34.776170+0000","last_fullsized":"2026-02-20T13:16:34.776170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:55:58.812477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:35.488122+0000","last_change":"2026-02-20T13:16:32.774903+0000","last_active":"2026-02-20T13:16:35.488122+0000","last_peered":"2026-02-20T13:16:35.488122+0000","last_clean":"2026-02-20T13:16:35.488122+0000","last_became_active":"2026-02-20T13:16:32.774805+0000","last_became_peered":"2026-02-20T13:16:32.774805+0000","last_unstale":"2026-02-20T13:16:35.488122+0000","last_undegraded":"2026-02-20T13:16:35.488122+0000","last_fullsized":"2026-02-20T13:16:35.488122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:48:52.469923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:16:34.775805+0000","last_change":"2026-02-20T13:16:33.777571+0000","last_active":"2026-02-20T13:16:34.775805+0000","last_peered":"2026-02-20T13:16:34.775805+0000","last_clean":"2026-02-20T13:16:34.775805+0000","last_became_active":"2026-02-20T13:16:33.777495+0000","last_became_peered":"2026-02-20T13:16:33.777495+0000","last_unstale":"2026-02-20T13:16:34.775805+0000","last_undegraded":"2026-02-20T13:16:34.775805+0000","last_fullsized":"2026-02-20T13:16:34.775805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:32.758365+0000","last_clean_scrub_stamp":"2026-02-20T13:16:32.758365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:34:15.313008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":65,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-20T13:17:13.102607+0000","last_change":"2026-02-20T13:16:32.770012+0000","last_active":"2026-02-20T13:17:13.102607+0000","last_peered":"2026-02-20T13:17:13.102607+0000","last_clean":"2026-02-20T13:17:13.102607+0000","last_became_active":"2026-02-20T13:16:32.769069+0000","last_became_peered":"2026-02-20T13:16:32.769069+0000","last_unstale":"2026-02-20T13:17:13.102607+0000","last_undegraded":"2026-02-20T13:17:13.102607+0000","last_fullsized":"2026-02-20T13:17:13.102607+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:16:31.755906+0000","last_clean_scrub_stamp":"2026-02-20T13:16:31.755906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:47:48.884889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78290,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":375,"num_read_kb":272,"num_write":245,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":606208,"data_stored":239363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185581,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":260317,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612623,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27964,"kb_used_data":1000,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975236,"statfs":{"total":751619276800,"available":751590641664,"internally_reserved":0,"allocated":1024000,"data_stored":1074003,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36168,"internal_metadata":27554488},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":34,"kb_used_meta":27165,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35051,"internal_metadata":27817749},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234003,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36782,"internal_metadata":27553874},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":1005001,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34603,"internal_metadata":27556053},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593751,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":844,"kb_used_omap":37,"kb_used_meta":27162,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":864256,"data_stored":411453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38337,"internal_metadata":27814463},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855385,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":1004291,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":39078,"internal_metadata":27551578},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986203,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":411724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44499,"internal_metadata":27546157},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215132,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080,"kb_used_data":860,"kb_used_omap":45,"kb_used_meta":27154,"kb_avail":733975120,"statfs":{"total":751619276800,"available":751590522880,"internally_reserved":0,"allocated":880640,"data_stored":411278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46410,"internal_metadata":27806390},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27900,"kb_used_data":936,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975300,"statfs":{"total":751619276800,"available":751590707200,"internally_reserved":0,"allocated":958464,"data_stored":483956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63431,"internal_metadata":27527225},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27884,"kb_used_data":920,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975316,"statfs":{"total":751619276800,"available":751590723584,"internally_reserved":0,"allocated":942080,"data_stored":487945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45658,"internal_metadata":27544998},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28084,"kb_used_data":864,"kb_used_omap":51,"kb_used_meta":27148,"kb_avail":733975116,"statfs":{"total":751619276800,"available":751590518784,"internally_reserved":0,"allocated":884736,"data_stored":412836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52630,"internal_metadata":27800170},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36275,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8020,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":77331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3840,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19795,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6750,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15030,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9566,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15927,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12980,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29976,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3619,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:17:17.137 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:17.320 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:17.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 -- 10.20.193.28:0/1241659232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200113000 msgr2=0x7fe2001739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:17.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 --2- 10.20.193.28:0/1241659232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200113000 0x7fe2001739d0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=7899048352132092656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1fc00aa30 tx=0x7fe1fc030270 comp rx=0 tx=0).stop 2026-02-20T13:17:17.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 -- 10.20.193.28:0/1241659232 shutdown_connections 2026-02-20T13:17:17.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 --2- 10.20.193.28:0/1241659232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200113000 0x7fe2001739d0 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=7899048352132092656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 --2- 10.20.193.28:0/1241659232 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe200060a00 0x7fe200112850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 --2- 10.20.193.28:0/1241659232 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe200060010 0x7fe2000603e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 -- 10.20.193.28:0/1241659232 >> 10.20.193.28:0/1241659232 conn(0x7fe2000e95a0 msgr2=0x7fe2001099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:17.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 -- 10.20.193.28:0/1241659232 shutdown_connections 2026-02-20T13:17:17.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.499+0000 7fe20751b640 1 -- 10.20.193.28:0/1241659232 wait complete. 2026-02-20T13:17:17.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.500+0000 7fe20751b640 1 Processor -- start 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.500+0000 7fe20751b640 1 -- start start 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.500+0000 7fe20751b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe200060010 0x7fe20010d3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.500+0000 7fe20751b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200060a00 0x7fe20010b960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.500+0000 7fe20751b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe200113000 0x7fe20010bea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.500+0000 7fe20751b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe20010c540 con 0x7fe200060a00 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.500+0000 7fe20751b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe20010c6b0 con 0x7fe200113000 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.500+0000 7fe20751b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe2001683d0 con 0x7fe200060010 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe200060010 0x7fe20010d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe200060010 0x7fe20010d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45342/0 (socket says 10.20.193.28:45342) 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 -- 10.20.193.28:0/4250978445 learned_addr learned my addr 10.20.193.28:0/4250978445 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe205d18640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200060a00 0x7fe20010b960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206d1a640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe200113000 0x7fe20010bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 -- 10.20.193.28:0/4250978445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe200113000 msgr2=0x7fe20010bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe200113000 0x7fe20010bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 -- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200060a00 msgr2=0x7fe20010b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200060a00 0x7fe20010b960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 -- 10.20.193.28:0/4250978445 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc00a650 con 0x7fe200060010 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206d1a640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe200113000 0x7fe20010bea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe205d18640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200060a00 0x7fe20010b960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe206519640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe200060010 0x7fe20010d3e0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1f0009480 tx=0x7fe1f000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe1e77fe640 1 -- 10.20.193.28:0/4250978445 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1f000cd40 con 0x7fe200060010 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe20751b640 1 -- 10.20.193.28:0/4250978445 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2001686b0 con 0x7fe200060010 2026-02-20T13:17:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe1e77fe640 1 -- 10.20.193.28:0/4250978445 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe1f0004d30 con 0x7fe200060010 2026-02-20T13:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.501+0000 7fe1e77fe640 1 -- 10.20.193.28:0/4250978445 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1f00106b0 con 0x7fe200060010 2026-02-20T13:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.502+0000 7fe20751b640 1 -- 10.20.193.28:0/4250978445 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe200168bd0 con 0x7fe200060010 2026-02-20T13:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.502+0000 7fe1e57fa640 1 -- 10.20.193.28:0/4250978445 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc005300 con 0x7fe200060010 2026-02-20T13:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.504+0000 7fe1e77fe640 1 -- 10.20.193.28:0/4250978445 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fe1f001f060 con 0x7fe200060010 2026-02-20T13:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.506+0000 7fe1e77fe640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1dc0b57f0 0x7fe1dc0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.506+0000 7fe1e77fe640 1 -- 10.20.193.28:0/4250978445 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fe1f0014070 con 0x7fe200060010 2026-02-20T13:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.506+0000 7fe1e77fe640 1 -- 10.20.193.28:0/4250978445 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe1f011f730 con 0x7fe200060010 2026-02-20T13:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.506+0000 7fe205d18640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1dc0b57f0 0x7fe1dc0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.506+0000 7fe205d18640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1dc0b57f0 0x7fe1dc0d5ca0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe20011f770 tx=0x7fe1f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:17.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.648+0000 7fe1e57fa640 1 -- 10.20.193.28:0/4250978445 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1cc005950 con 0x7fe200060010 2026-02-20T13:17:17.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.648+0000 7fe1e77fe640 1 -- 10.20.193.28:0/4250978445 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11996 (secure 0 0 0) 0x7fe1f00a9680 con 0x7fe200060010 2026-02-20T13:17:17.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:17 trial028 ceph-mon[37442]: from='client.25319 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:17.652 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:17 trial028 ceph-mon[37442]: from='client.25349 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:17.653 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:17.653 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T13:17:11:407313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:10.974665+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:17:17.653 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 -- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1dc0b57f0 msgr2=0x7fe1dc0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1dc0b57f0 0x7fe1dc0d5ca0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe20011f770 tx=0x7fe1f4005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 -- 10.20.193.28:0/4250978445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe200060010 msgr2=0x7fe20010d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe200060010 0x7fe20010d3e0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1f0009480 tx=0x7fe1f000ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 -- 10.20.193.28:0/4250978445 shutdown_connections 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1dc0b57f0 0x7fe1dc0d5ca0 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe200060a00 0x7fe20010b960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe200113000 0x7fe20010bea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 --2- 10.20.193.28:0/4250978445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe200060010 0x7fe20010d3e0 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:17.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 -- 10.20.193.28:0/4250978445 >> 10.20.193.28:0/4250978445 conn(0x7fe2000e95a0 msgr2=0x7fe200109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:17.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 -- 10.20.193.28:0/4250978445 shutdown_connections 2026-02-20T13:17:17.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:17.650+0000 7fe1e57fa640 1 -- 10.20.193.28:0/4250978445 wait complete. 2026-02-20T13:17:17.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:17 trial127 ceph-mon[43817]: from='client.25319 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:17.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:17 trial127 ceph-mon[43817]: from='client.25349 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:17.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:17 trial034 ceph-mon[43332]: from='client.25319 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:17.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:17 trial034 ceph-mon[43332]: from='client.25349 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:17.753 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:17.938 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:18.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 -- 10.20.193.28:0/1710289433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4113fa0 msgr2=0x7f97e4114370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 --2- 10.20.193.28:0/1710289433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4113fa0 0x7f97e4114370 secure :-1 s=READY pgs=139 gs=2 cs=0 l=1 c_cookie=11121343449347291600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d4009950 tx=0x7f97d402f190 comp rx=0 tx=0).stop 2026-02-20T13:17:18.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 -- 10.20.193.28:0/1710289433 shutdown_connections 2026-02-20T13:17:18.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 --2- 10.20.193.28:0/1710289433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97e4114990 0x7f97e41193f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 --2- 10.20.193.28:0/1710289433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97e4119ba0 0x7f97e417a570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 --2- 10.20.193.28:0/1710289433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4113fa0 0x7f97e4114370 unknown :-1 s=CLOSED pgs=139 gs=2 cs=0 l=1 c_cookie=11121343449347291600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 -- 10.20.193.28:0/1710289433 >> 10.20.193.28:0/1710289433 conn(0x7f97e4064a90 msgr2=0x7f97e4064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 -- 10.20.193.28:0/1710289433 shutdown_connections 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 -- 10.20.193.28:0/1710289433 wait complete. 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.115+0000 7f97eb014640 1 Processor -- start 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97eb014640 1 -- start start 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97eb014640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97e4113fa0 0x7f97e4105170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97eb014640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97e4114990 0x7f97e417a470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97eb014640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4119ba0 0x7f97e4105870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97eb014640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f97e4106000 con 0x7f97e4114990 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97eb014640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f97e410a1c0 con 0x7f97e4119ba0 2026-02-20T13:17:18.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97eb014640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f97e410a380 con 0x7f97e4113fa0 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97ea012640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97e4113fa0 0x7f97e4105170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97ea012640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97e4113fa0 0x7f97e4105170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45346/0 (socket says 10.20.193.28:45346) 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97ea012640 1 -- 10.20.193.28:0/3869571676 learned_addr learned my addr 10.20.193.28:0/3869571676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97e9811640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97e4114990 0x7f97e417a470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97ea813640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4119ba0 0x7f97e4105870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97e9811640 1 -- 10.20.193.28:0/3869571676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97e4113fa0 msgr2=0x7f97e4105170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97e9811640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97e4113fa0 0x7f97e4105170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97e9811640 1 -- 10.20.193.28:0/3869571676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4119ba0 msgr2=0x7f97e4105870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97e9811640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4119ba0 0x7f97e4105870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97e9811640 1 -- 10.20.193.28:0/3869571676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d80094b0 con 0x7f97e4114990 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97ea012640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97e4113fa0 0x7f97e4105170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:18.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.116+0000 7f97ea813640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4119ba0 0x7f97e4105870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:18.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.117+0000 7f97e9811640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97e4114990 0x7f97e417a470 secure :-1 s=READY pgs=352 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d8004680 tx=0x7f97d8002b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:18.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.117+0000 7f97cb7fe640 1 -- 10.20.193.28:0/3869571676 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97d800eb20 con 0x7f97e4114990 2026-02-20T13:17:18.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.117+0000 7f97cb7fe640 1 -- 10.20.193.28:0/3869571676 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97d800ec80 con 0x7f97e4114990 2026-02-20T13:17:18.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.117+0000 7f97cb7fe640 1 -- 10.20.193.28:0/3869571676 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97d800f870 con 0x7f97e4114990 2026-02-20T13:17:18.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.117+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d4009570 con 0x7f97e4114990 2026-02-20T13:17:18.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.117+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e410a950 con 0x7f97e4114990 2026-02-20T13:17:18.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.117+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e4114d80 con 0x7f97e4114990 2026-02-20T13:17:18.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.120+0000 7f97cb7fe640 1 -- 10.20.193.28:0/3869571676 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f97d801f060 con 0x7f97e4114990 2026-02-20T13:17:18.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.122+0000 7f97cb7fe640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97c00b5870 0x7f97c00d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:18.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.122+0000 7f97cb7fe640 1 -- 10.20.193.28:0/3869571676 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f97d80e6e10 con 0x7f97e4114990 2026-02-20T13:17:18.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.122+0000 7f97ea012640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97c00b5870 0x7f97c00d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:18.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.122+0000 7f97cb7fe640 1 -- 10.20.193.28:0/3869571676 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f97d8120690 con 0x7f97e4114990 2026-02-20T13:17:18.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.122+0000 7f97ea012640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97c00b5870 0x7f97c00d5d20 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d4038820 tx=0x7f97d403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:18.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.263+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97e405e180 con 0x7f97e4114990 2026-02-20T13:17:18.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.263+0000 7f97cb7fe640 1 -- 10.20.193.28:0/3869571676 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11996 (secure 0 0 0) 0x7f97d80a97f0 con 0x7f97e4114990 2026-02-20T13:17:18.267 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:18.267 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T13:17:11:407313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:10.974665+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:17:18.267 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T13:17:18.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.264+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97c00b5870 msgr2=0x7f97c00d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.264+0000 7f97eb014640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97c00b5870 0x7f97c00d5d20 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d4038820 tx=0x7f97d403a040 comp rx=0 tx=0).stop 2026-02-20T13:17:18.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.264+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97e4114990 msgr2=0x7f97e417a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.264+0000 7f97eb014640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97e4114990 0x7f97e417a470 secure :-1 s=READY pgs=352 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d8004680 tx=0x7f97d8002b40 comp rx=0 tx=0).stop 2026-02-20T13:17:18.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.266+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 shutdown_connections 2026-02-20T13:17:18.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.266+0000 7f97eb014640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97c00b5870 0x7f97c00d5d20 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.266+0000 7f97eb014640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97e4114990 0x7f97e417a470 unknown :-1 s=CLOSED pgs=352 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.266+0000 7f97eb014640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97e4119ba0 0x7f97e4105870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.266+0000 7f97eb014640 1 --2- 10.20.193.28:0/3869571676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97e4113fa0 0x7f97e4105170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.266+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 >> 10.20.193.28:0/3869571676 conn(0x7f97e4064a90 msgr2=0x7f97e41179f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:18.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.266+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 shutdown_connections 2026-02-20T13:17:18.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.266+0000 7f97eb014640 1 -- 10.20.193.28:0/3869571676 wait complete. 2026-02-20T13:17:18.406 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:17:18.591 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:18.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:18 trial028 ceph-mon[37442]: from='client.25355 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:18.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:18 trial028 ceph-mon[37442]: pgmap v178: 97 pgs: 97 active+clean; 658 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 11 op/s 2026-02-20T13:17:18.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:18 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4250978445' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:18.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:18 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3869571676' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:18.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:18 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:17:18.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:18 trial127 ceph-mon[43817]: from='client.25355 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:18.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:18 trial127 ceph-mon[43817]: pgmap v178: 97 pgs: 97 active+clean; 658 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 11 op/s 2026-02-20T13:17:18.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:18 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4250978445' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:18.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:18 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3869571676' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:18.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:18 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:17:18.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:18 trial034 ceph-mon[43332]: from='client.25355 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T13:17:18.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:18 trial034 ceph-mon[43332]: pgmap v178: 97 pgs: 97 active+clean; 658 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 11 op/s 2026-02-20T13:17:18.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:18 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4250978445' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:18.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:18 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3869571676' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:18.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:18 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:17:18.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1245363231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810b150 msgr2=0x7ff4a810b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1245363231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810b150 0x7ff4a810b520 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=9138964087011975237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff498009950 tx=0x7ff49802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:18.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1245363231 shutdown_connections 2026-02-20T13:17:18.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1245363231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4a8111160 0x7ff4a8111b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1245363231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4a810bb40 0x7ff4a81109d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1245363231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810b150 0x7ff4a810b520 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=9138964087011975237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1245363231 >> 10.20.193.28:0/1245363231 conn(0x7ff4a80e8ce0 msgr2=0x7ff4a81090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1245363231 shutdown_connections 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1245363231 wait complete. 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.767+0000 7ff4aec9b640 1 Processor -- start 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4aec9b640 1 -- start start 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4aec9b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4a810b150 0x7ff4a8123370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4aec9b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810bb40 0x7ff4a81238b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4aec9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4a8111160 0x7ff4a8128c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4aec9b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a81292a0 con 0x7ff4a8111160 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4aec9b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a8129410 con 0x7ff4a810b150 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4aec9b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a81295d0 con 0x7ff4a810bb40 2026-02-20T13:17:18.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4adc99640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4a810b150 0x7ff4a8123370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:18.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4adc99640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4a810b150 0x7ff4a8123370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45360/0 (socket says 10.20.193.28:45360) 2026-02-20T13:17:18.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4adc99640 1 -- 10.20.193.28:0/1832983325 learned_addr learned my addr 10.20.193.28:0/1832983325 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:18.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4ae49a640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4a8111160 0x7ff4a8128c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:18.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.768+0000 7ff4ad498640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810bb40 0x7ff4a81238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:18.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4ad498640 1 -- 10.20.193.28:0/1832983325 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4a810b150 msgr2=0x7ff4a8123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4ad498640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4a810b150 0x7ff4a8123370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4ad498640 1 -- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4a8111160 msgr2=0x7ff4a8128c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4ad498640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4a8111160 0x7ff4a8128c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4ad498640 1 -- 10.20.193.28:0/1832983325 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a400a590 con 0x7ff4a810bb40 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4ae49a640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4a8111160 0x7ff4a8128c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4ad498640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810bb40 0x7ff4a81238b0 secure :-1 s=READY pgs=110 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff49c004740 tx=0x7ff49c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff496ffd640 1 -- 10.20.193.28:0/1832983325 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff49c00cce0 con 0x7ff4a810bb40 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff496ffd640 1 -- 10.20.193.28:0/1832983325 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff49c00ce40 con 0x7ff4a810bb40 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff496ffd640 1 -- 10.20.193.28:0/1832983325 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff49c0052a0 con 0x7ff4a810bb40 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff498009570 con 0x7ff4a810bb40 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.769+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a8169e10 con 0x7ff4a810bb40 2026-02-20T13:17:18.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.770+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a810c270 con 0x7ff4a810bb40 2026-02-20T13:17:18.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.772+0000 7ff496ffd640 1 -- 10.20.193.28:0/1832983325 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7ff49c004770 con 0x7ff4a810bb40 2026-02-20T13:17:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.774+0000 7ff496ffd640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4840b57f0 0x7ff4840d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.774+0000 7ff496ffd640 1 -- 10.20.193.28:0/1832983325 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7ff49c014070 con 0x7ff4a810bb40 2026-02-20T13:17:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.774+0000 7ff496ffd640 1 -- 10.20.193.28:0/1832983325 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7ff49c0e6c50 con 0x7ff4a810bb40 2026-02-20T13:17:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.774+0000 7ff4adc99640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4840b57f0 0x7ff4840d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:18.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.775+0000 7ff4adc99640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4840b57f0 0x7ff4840d5ca0 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff498005b30 tx=0x7ff49803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.889+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4a81244d0 con 0x7ff4a810bb40 2026-02-20T13:17:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.890+0000 7ff496ffd640 1 -- 10.20.193.28:0/1832983325 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22326 (secure 0 0 0) 0x7ff49c0a92e0 con 0x7ff4a810bb40 2026-02-20T13:17:18.893 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:18.893 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:16:34.769763+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:17:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4840b57f0 msgr2=0x7ff4840d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4840b57f0 0x7ff4840d5ca0 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff498005b30 tx=0x7ff49803a040 comp rx=0 tx=0).stop 2026-02-20T13:17:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810bb40 msgr2=0x7ff4a81238b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810bb40 0x7ff4a81238b0 secure :-1 s=READY pgs=110 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff49c004740 tx=0x7ff49c00ec50 comp rx=0 tx=0).stop 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 shutdown_connections 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4840b57f0 0x7ff4840d5ca0 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4a8111160 0x7ff4a8128c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4a810bb40 0x7ff4a81238b0 unknown :-1 s=CLOSED pgs=110 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 --2- 10.20.193.28:0/1832983325 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4a810b150 0x7ff4a8123370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 >> 10.20.193.28:0/1832983325 conn(0x7ff4a80e8ce0 msgr2=0x7ff4a81090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 shutdown_connections 2026-02-20T13:17:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:18.891+0000 7ff4aec9b640 1 -- 10.20.193.28:0/1832983325 wait complete. 2026-02-20T13:17:18.997 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph daemon mon.a --format=json config get run_dir 2026-02-20T13:17:19.181 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:19.479 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:19 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:19.480 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:19 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1832983325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:19.481 INFO:teuthology.orchestra.run.trial028.stdout:{"run_dir":"/var/run/ceph"} 2026-02-20T13:17:19.482 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2026-02-20T13:17:19.482 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7416 2026-02-20T13:17:19.482 DEBUG:tasks.quiescer:Yielding 2026-02-20T13:17:19.482 INFO:teuthology.run_tasks:Running task workunit... 2026-02-20T13:17:19.509 INFO:tasks.workunit:Pulling workunits from ref 0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:17:19.509 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-20T13:17:19.509 INFO:tasks.workunit:timeout=3h 2026-02-20T13:17:19.510 INFO:tasks.workunit:cleanup=True 2026-02-20T13:17:19.510 DEBUG:teuthology.orchestra.run.trial028:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-20T13:17:19.511 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:19.551 INFO:teuthology.orchestra.run.trial028.stdout: File: /home/ubuntu/cephtest/mnt.0 2026-02-20T13:17:19.552 INFO:teuthology.orchestra.run.trial028.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2026-02-20T13:17:19.552 INFO:teuthology.orchestra.run.trial028.stdout:Device: 2bh/43d Inode: 1099511628283 Links: 2 2026-02-20T13:17:19.552 INFO:teuthology.orchestra.run.trial028.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:17:19.552 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:unlabeled_t:s0 2026-02-20T13:17:19.552 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 13:16:41.942645276 +0000 2026-02-20T13:17:19.552 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 13:16:41.942645276 +0000 2026-02-20T13:17:19.552 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 13:17:10.274226362 +0000 2026-02-20T13:17:19.552 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 13:16:41.942645276 +0000 2026-02-20T13:17:19.553 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2026-02-20T13:17:19.553 DEBUG:teuthology.orchestra.run.trial028:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2026-02-20T13:17:19.655 DEBUG:teuthology.orchestra.run.trial028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0917c15888a16c5bbbd9de28990cc81230360c9e 2026-02-20T13:17:19.703 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:19.706 INFO:tasks.workunit.client.0.trial028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-20T13:17:19.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:19 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:19.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:19 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1832983325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:19.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:19 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:19.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:19 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1832983325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:17:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 -- 10.20.193.28:0/315040388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f691410fea0 msgr2=0x7f6914114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 --2- 10.20.193.28:0/315040388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f691410fea0 0x7f6914114ef0 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=8654794280627623584 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6904009950 tx=0x7f690402f190 comp rx=0 tx=0).stop 2026-02-20T13:17:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 -- 10.20.193.28:0/315040388 shutdown_connections 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 --2- 10.20.193.28:0/315040388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f691410fea0 0x7f6914114ef0 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=8654794280627623584 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 --2- 10.20.193.28:0/315040388 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f69141156a0 0x7f6914176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 --2- 10.20.193.28:0/315040388 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f691410f4b0 0x7f691410f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 -- 10.20.193.28:0/315040388 >> 10.20.193.28:0/315040388 conn(0x7f69140ecda0 msgr2=0x7f691410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 -- 10.20.193.28:0/315040388 shutdown_connections 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 -- 10.20.193.28:0/315040388 wait complete. 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 Processor -- start 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.869+0000 7f6918b37640 1 -- start start 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6918b37640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f691410f4b0 0x7f69140f57a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6918b37640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f691410fea0 0x7f6914175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6918b37640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69141156a0 0x7f69140f5ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6918b37640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f69140fb0b0 con 0x7f69141156a0 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6918b37640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f69140fb220 con 0x7f691410f4b0 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6918b37640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f69140fb3e0 con 0x7f691410fea0 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69141156a0 0x7f69140f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f69137fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f691410f4b0 0x7f69140f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69141156a0 0x7f69140f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52126/0 (socket says 10.20.193.28:52126) 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 -- 10.20.193.28:0/265392382 learned_addr learned my addr 10.20.193.28:0/265392382 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6912ffd640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f691410fea0 0x7f6914175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 -- 10.20.193.28:0/265392382 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f691410fea0 msgr2=0x7f6914175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f691410fea0 0x7f6914175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 -- 10.20.193.28:0/265392382 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f691410f4b0 msgr2=0x7f69140f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f691410f4b0 0x7f69140f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:19.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 -- 10.20.193.28:0/265392382 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6904009570 con 0x7f69141156a0 2026-02-20T13:17:19.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.870+0000 7f6913fff640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69141156a0 0x7f69140f5ea0 secure :-1 s=READY pgs=354 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f690800f8d0 tx=0x7f690800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.871+0000 7f6910ff9640 1 -- 10.20.193.28:0/265392382 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f690800dce0 con 0x7f69141156a0 2026-02-20T13:17:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.871+0000 7f6910ff9640 1 -- 10.20.193.28:0/265392382 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f690800de40 con 0x7f69141156a0 2026-02-20T13:17:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.871+0000 7f6910ff9640 1 -- 10.20.193.28:0/265392382 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69080116b0 con 0x7f69141156a0 2026-02-20T13:17:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.871+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69140fb6c0 con 0x7f69141156a0 2026-02-20T13:17:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.871+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69140fbb40 con 0x7f69141156a0 2026-02-20T13:17:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.871+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6914110790 con 0x7f69141156a0 2026-02-20T13:17:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.873+0000 7f6910ff9640 1 -- 10.20.193.28:0/265392382 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f6908020060 con 0x7f69141156a0 2026-02-20T13:17:19.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.875+0000 7f6910ff9640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68e80b57e0 0x7f68e80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:19.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.875+0000 7f6910ff9640 1 -- 10.20.193.28:0/265392382 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6908015070 con 0x7f69141156a0 2026-02-20T13:17:19.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.875+0000 7f69137fe640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68e80b57e0 0x7f68e80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:19.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.876+0000 7f69137fe640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68e80b57e0 0x7f68e80d5c90 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6900004740 tx=0x7f6900005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:19.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:19.876+0000 7f6910ff9640 1 -- 10.20.193.28:0/265392382 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f69080aa640 con 0x7f69141156a0 2026-02-20T13:17:20.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.015+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69140f6900 con 0x7f69141156a0 2026-02-20T13:17:20.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.016+0000 7f6910ff9640 1 -- 10.20.193.28:0/265392382 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11997 (secure 0 0 0) 0x7f69080ad7f0 con 0x7f69141156a0 2026-02-20T13:17:20.020 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:20.021 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":25,"btime":"2026-02-20T13:17:18:427377+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:18.339314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[1],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 25 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68e80b57e0 msgr2=0x7f68e80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68e80b57e0 0x7f68e80d5c90 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6900004740 tx=0x7f6900005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69141156a0 msgr2=0x7f69140f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69141156a0 0x7f69140f5ea0 secure :-1 s=READY pgs=354 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f690800f8d0 tx=0x7f690800fda0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 shutdown_connections 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68e80b57e0 0x7f68e80d5c90 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69141156a0 0x7f69140f5ea0 unknown :-1 s=CLOSED pgs=354 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f691410fea0 0x7f6914175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 --2- 10.20.193.28:0/265392382 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f691410f4b0 0x7f69140f57a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 >> 10.20.193.28:0/265392382 conn(0x7f69140ecda0 msgr2=0x7f691410d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.017+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 shutdown_connections 2026-02-20T13:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.018+0000 7f6918b37640 1 -- 10.20.193.28:0/265392382 wait complete. 2026-02-20T13:17:20.120 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True, 'allow_referent_inodes': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-20T13:16:33.380729+0000', 'modified': '2026-02-20T13:17:18.339314+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24692, 'mds_1': 24677, 'mds_2': 24659, 'mds_3': 24655, 'mds_4': 24622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24617': {'gid': 24617, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.34:6833/4255317184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6832', 'nonce': 4255317184}, {'type': 'v1', 'addr': '10.20.193.34:6833', 'nonce': 4255317184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24622': {'gid': 24622, 'name': 'j', 'rank': 4, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '10.20.193.28:6835/2839011553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6834', 'nonce': 2839011553}, {'type': 'v1', 'addr': '10.20.193.28:6835', 'nonce': 2839011553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'd', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.28:6837/3921516269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6836', 'nonce': 3921516269}, {'type': 'v1', 'addr': '10.20.193.28:6837', 'nonce': 3921516269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.127:6835/519312474', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6834', 'nonce': 519312474}, {'type': 'v1', 'addr': '10.20.193.127:6835', 'nonce': 519312474}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24641': {'gid': 24641, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.34:6835/1117780356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6834', 'nonce': 1117780356}, {'type': 'v1', 'addr': '10.20.193.34:6835', 'nonce': 1117780356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.127:6837/2801639412', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6836', 'nonce': 2801639412}, {'type': 'v1', 'addr': '10.20.193.127:6837', 'nonce': 2801639412}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24655': {'gid': 24655, 'name': 'i', 'rank': 3, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.127:6839/3644236506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.127:6838', 'nonce': 3644236506}, {'type': 'v1', 'addr': '10.20.193.127:6839', 'nonce': 3644236506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 2, 'incarnation': 17, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.34:6837/3360165301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6836', 'nonce': 3360165301}, {'type': 'v1', 'addr': '10.20.193.34:6837', 'nonce': 3360165301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24677': {'gid': 24677, 'name': 'g', 'rank': 1, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.28:6839/1527574900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6838', 'nonce': 1527574900}, {'type': 'v1', 'addr': '10.20.193.28:6839', 'nonce': 1527574900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24692': {'gid': 24692, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.34:6839/1838974969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.34:6838', 'nonce': 1838974969}, {'type': 'v1', 'addr': '10.20.193.34:6839', 'nonce': 1838974969}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24692, 'qdb_cluster': [24692, 24677, 24659, 24655, 24622]} 2026-02-20T13:17:20.120 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2026-02-20T13:17:20.121 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.j status 2026-02-20T13:17:20.305 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:20.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 -- 10.20.193.28:0/1971435015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 msgr2=0x7f901410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 --2- 10.20.193.28:0/1971435015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 0x7f901410f600 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=182481931139462815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004009950 tx=0x7f900402f190 comp rx=0 tx=0).stop 2026-02-20T13:17:20.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 -- 10.20.193.28:0/1971435015 shutdown_connections 2026-02-20T13:17:20.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 --2- 10.20.193.28:0/1971435015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9014115420 0x7f9014175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 --2- 10.20.193.28:0/1971435015 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f901410fc20 0x7f9014114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 --2- 10.20.193.28:0/1971435015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 0x7f901410f600 unknown :-1 s=CLOSED pgs=355 gs=1 cs=0 l=1 c_cookie=182481931139462815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 -- 10.20.193.28:0/1971435015 >> 10.20.193.28:0/1971435015 conn(0x7f901405f830 msgr2=0x7f901410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:20.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 -- 10.20.193.28:0/1971435015 shutdown_connections 2026-02-20T13:17:20.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.481+0000 7f901c16b640 1 -- 10.20.193.28:0/1971435015 wait complete. 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f901c16b640 1 Processor -- start 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f901c16b640 1 -- start start 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f901c16b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 0x7f901411db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f901c16b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f901410fc20 0x7f901411e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f901c16b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9014115420 0x7f9014123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f901c16b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9014123a60 con 0x7f901410f230 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f901c16b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9014123bd0 con 0x7f901410fc20 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f901c16b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9014123d90 con 0x7f9014115420 2026-02-20T13:17:20.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 0x7f901411db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f90196df640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f901410fc20 0x7f901411e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 0x7f901411db30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55480/0 (socket says 10.20.193.28:55480) 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.482+0000 7f9019ee0640 1 -- 10.20.193.28:0/2543553762 learned_addr learned my addr 10.20.193.28:0/2543553762 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f901a6e1640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9014115420 0x7f9014123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9019ee0640 1 -- 10.20.193.28:0/2543553762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9014115420 msgr2=0x7f9014123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9014115420 0x7f9014123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9019ee0640 1 -- 10.20.193.28:0/2543553762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f901410fc20 msgr2=0x7f901411e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f901410fc20 0x7f901411e070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9019ee0640 1 -- 10.20.193.28:0/2543553762 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9004009570 con 0x7f901410f230 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 0x7f901411db30 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004038820 tx=0x7f9004004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9002ffd640 1 -- 10.20.193.28:0/2543553762 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f900403d070 con 0x7f901410f230 2026-02-20T13:17:20.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9002ffd640 1 -- 10.20.193.28:0/2543553762 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9004002ad0 con 0x7f901410f230 2026-02-20T13:17:20.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f9002ffd640 1 -- 10.20.193.28:0/2543553762 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9004041930 con 0x7f901410f230 2026-02-20T13:17:20.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f901c16b640 1 -- 10.20.193.28:0/2543553762 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9014124010 con 0x7f901410f230 2026-02-20T13:17:20.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.483+0000 7f901c16b640 1 -- 10.20.193.28:0/2543553762 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90141645d0 con 0x7f901410f230 2026-02-20T13:17:20.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.486+0000 7f9002ffd640 1 -- 10.20.193.28:0/2543553762 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f900402f9f0 con 0x7f901410f230 2026-02-20T13:17:20.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.488+0000 7f9002ffd640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ff00b57f0 0x7f8ff00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.488+0000 7f9002ffd640 1 -- 10.20.193.28:0/2543553762 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f900410b010 con 0x7f901410f230 2026-02-20T13:17:20.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.488+0000 7f90196df640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ff00b57f0 0x7f8ff00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.488+0000 7f901e165e00 1 Processor -- start 2026-02-20T13:17:20.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.488+0000 7f901e165e00 1 -- start start 2026-02-20T13:17:20.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f90196df640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ff00b57f0 0x7f8ff00d5ca0 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90141244d0 tx=0x7f9008005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f901e165e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a3365e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f901e165e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a37b280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f901e165e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a39bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f901e165e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557e0a1c8370 con 0x557e0a37b7c0 2026-02-20T13:17:20.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f901e165e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557e0a24c710 con 0x557e0a336210 2026-02-20T13:17:20.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f901e165e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557e0a248440 con 0x557e0a336b20 2026-02-20T13:17:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a3365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a3365e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51150/0 (socket says 10.20.193.28:51150) 2026-02-20T13:17:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f9019ee0640 1 -- 10.20.193.28:0/2674577650 learned_addr learned my addr 10.20.193.28:0/2674577650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f90196df640 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a37b280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f901a6e1640 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a39bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f9019ee0640 1 -- 10.20.193.28:0/2674577650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 msgr2=0x557e0a37b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a37b280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f9019ee0640 1 -- 10.20.193.28:0/2674577650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 msgr2=0x557e0a39bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a39bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f9019ee0640 1 -- 10.20.193.28:0/2674577650 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e0a1edcf0 con 0x557e0a336210 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.489+0000 7f901a6e1640 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a39bba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.490+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a3365e0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=10175157552185618871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90040cda30 tx=0x7f900402f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d356be227a831b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.490+0000 7f8fe24e6640 1 -- 10.20.193.28:0/2674577650 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90040d7180 con 0x557e0a336210 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.490+0000 7f8fe24e6640 1 -- 10.20.193.28:0/2674577650 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f90040d9760 con 0x557e0a336210 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.490+0000 7f8fe24e6640 1 -- 10.20.193.28:0/2674577650 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90040d20f0 con 0x557e0a336210 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 -- 10.20.193.28:0/2674577650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 msgr2=0x557e0a3365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a3365e0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=10175157552185618871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90040cda30 tx=0x7f900402f190 comp rx=0 tx=0).stop 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 -- 10.20.193.28:0/2674577650 shutdown_connections 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a39bba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a37b280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 --2- 10.20.193.28:0/2674577650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a3365e0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=10175157552185618871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 -- 10.20.193.28:0/2674577650 >> 10.20.193.28:0/2674577650 conn(0x557e0a255450 msgr2=0x557e0a334af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:20.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 -- 10.20.193.28:0/2674577650 shutdown_connections 2026-02-20T13:17:20.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.491+0000 7f901e165e00 1 -- 10.20.193.28:0/2674577650 wait complete. 2026-02-20T13:17:20.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.492+0000 7f901e165e00 1 -- start start 2026-02-20T13:17:20.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.492+0000 7f901e165e00 1 Processor -- start 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.492+0000 7f901e165e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a3570b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f901e165e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336b20 0x557e0a3575f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f901e165e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a37b7c0 0x557e0a35c5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f901e165e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557e09f00610 con 0x557e0a336210 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f901e165e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557e0a35cb20 con 0x557e0a336b20 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f901e165e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557e0a35cce0 con 0x557e0a37b7c0 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a3570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a3570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55500/0 (socket says 10.20.193.28:55500) 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 -- 10.20.193.28:0/1089116227 learned_addr learned my addr 10.20.193.28:0/1089116227 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f90196df640 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336b20 0x557e0a3575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f901a6e1640 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a37b7c0 0x557e0a35c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 -- 10.20.193.28:0/1089116227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a37b7c0 msgr2=0x557e0a35c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a37b7c0 0x557e0a35c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 -- 10.20.193.28:0/1089116227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336b20 msgr2=0x557e0a3575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336b20 0x557e0a3575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 -- 10.20.193.28:0/1089116227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e0a1c62c0 con 0x557e0a336210 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f90196df640 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336b20 0x557e0a3575f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f9019ee0640 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a3570b0 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=5758408203015621559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90040023d0 tx=0x7f9004038d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe9f9c054710bb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f8fcf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/1089116227 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90040d20f0 con 0x557e0a336210 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.493+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/1089116227 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f90040dc5a0 con 0x557e0a336210 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90141645d0 con 0x557e0a336210 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/1089116227 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90040355a0 con 0x557e0a336210 2026-02-20T13:17:20.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 10 client.15420 _ll_register_callbacks cb 0x557e0a1cba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e09ed8600 con 0x557e0a336210 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/1089116227 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f90040dc340 con 0x557e0a336210 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/1089116227 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f90040cf440 con 0x557e0a336210 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 10 client.15420 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=25}) -- 0x557e0a1d80c0 con 0x557e0a336210 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/1089116227 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7f90040d2e50 con 0x557e0a336210 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 10 client.15420 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 10 client.15420 resolve_mds: resolved name 'j' to daemon mds.j 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 20 client.15420 populate_metadata read hostname 'trial028' 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557e0a361fc0 0x557e0a363430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 4 client.15420 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:20.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.494+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e0a2150a0 con 0x557e0a361fc0 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.495+0000 7f90196df640 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557e0a361fc0 0x557e0a363430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.495+0000 7f90196df640 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557e0a361fc0 0x557e0a363430 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=10374688976905076682 s_cookie=17680418945944527045 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8ffa4ca833967fca server_cookie=f55d775b411c20c5 in_seq=0 out_seq=0 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.495+0000 7f8fcf7fe640 10 client.15420 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/1089116227 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557e0a2150a0 con 0x557e0a361fc0 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f8fcf7fe640 10 client.15420 handle_command_reply: tid=0 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 client.15420 shutdown 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 msgr2=0x557e0a3570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a3570b0 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=5758408203015621559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90040023d0 tx=0x7f9004038d90 comp rx=0 tx=0).stop 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 shutdown_connections 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557e0a361fc0 0x557e0a363430 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=10374688976905076682 s_cookie=17680418945944527045 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a37b7c0 0x557e0a35c5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336b20 0x557e0a3575f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 --2- 10.20.193.28:0/1089116227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a3570b0 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=5758408203015621559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 >> 10.20.193.28:0/1089116227 conn(0x557e0a255450 msgr2=0x557e0a3151f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:20.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f8fcf7fe640 0 client.15420 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:20.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 shutdown_connections 2026-02-20T13:17:20.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 1 -- 10.20.193.28:0/1089116227 wait complete. 2026-02-20T13:17:20.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.496+0000 7f901e165e00 20 client.15420 trim_cache size 0 max 16384 2026-02-20T13:17:20.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.506+0000 7f901e165e00 1 Processor -- start 2026-02-20T13:17:20.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.506+0000 7f901e165e00 1 -- start start 2026-02-20T13:17:20.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.506+0000 7f901e165e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a360d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.506+0000 7f901e165e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a356ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.506+0000 7f901e165e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a37b7c0 0x557e0a357530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.506+0000 7f901e165e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557e0a2425a0 con 0x557e0a336210 2026-02-20T13:17:20.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.506+0000 7f901e165e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557e0a2401d0 con 0x557e0a37b7c0 2026-02-20T13:17:20.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.506+0000 7f901e165e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557e09f00610 con 0x557e0a336b20 2026-02-20T13:17:20.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a360d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f901a6e1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a37b7c0 0x557e0a357530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a360d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55516/0 (socket says 10.20.193.28:55516) 2026-02-20T13:17:20.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f901a6e1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a37b7c0 0x557e0a357530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51160/0 (socket says 10.20.193.28:51160) 2026-02-20T13:17:20.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f901a6e1640 1 -- 10.20.193.28:0/2836689954 learned_addr learned my addr 10.20.193.28:0/2836689954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:20.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f90196df640 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a356ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f9019ee0640 1 -- 10.20.193.28:0/2836689954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 msgr2=0x557e0a356ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a356ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f9019ee0640 1 -- 10.20.193.28:0/2836689954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a37b7c0 msgr2=0x557e0a357530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a37b7c0 0x557e0a357530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f9019ee0640 1 -- 10.20.193.28:0/2836689954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e0a1d2b40 con 0x557e0a336210 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f90196df640 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a356ff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f9019ee0640 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a360d80 secure :-1 s=READY pgs=358 gs=3 cs=0 l=1 c_cookie=18170432509086913888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90040d1440 tx=0x7f90040ed000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2a58188f55d560 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f8fe1ce5640 1 -- 10.20.193.28:0/2836689954 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90040dc5a0 con 0x557e0a336210 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f8fe1ce5640 1 -- 10.20.193.28:0/2836689954 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f90040f0060 con 0x557e0a336210 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.507+0000 7f8fe1ce5640 1 -- 10.20.193.28:0/2836689954 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90040db460 con 0x557e0a336210 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 -- 10.20.193.28:0/2836689954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 msgr2=0x557e0a360d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a360d80 secure :-1 s=READY pgs=358 gs=3 cs=0 l=1 c_cookie=18170432509086913888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90040d1440 tx=0x7f90040ed000 comp rx=0 tx=0).stop 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 -- 10.20.193.28:0/2836689954 shutdown_connections 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a37b7c0 0x557e0a357530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a356ff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 --2- 10.20.193.28:0/2836689954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a336210 0x557e0a360d80 unknown :-1 s=CLOSED pgs=358 gs=3 cs=0 l=1 c_cookie=18170432509086913888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 -- 10.20.193.28:0/2836689954 >> 10.20.193.28:0/2836689954 conn(0x557e0a255450 msgr2=0x557e0a318310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 -- 10.20.193.28:0/2836689954 shutdown_connections 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 -- 10.20.193.28:0/2836689954 wait complete. 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.508+0000 7f901e165e00 1 -- start start 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f901e165e00 1 Processor -- start 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f901e165e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a376860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f901e165e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a371040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f901e165e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a371580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f901e165e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557e0a311560 con 0x557e0a37b7c0 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f901e165e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557e0a361b20 con 0x557e0a336210 2026-02-20T13:17:20.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f901e165e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557e0a24c710 con 0x557e0a336b20 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a376860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f9019ee0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a376860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51174/0 (socket says 10.20.193.28:51174) 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f9019ee0640 1 -- 10.20.193.28:0/702213787 learned_addr learned my addr 10.20.193.28:0/702213787 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f90196df640 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a371040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f9019ee0640 1 -- 10.20.193.28:0/702213787 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 msgr2=0x557e0a371040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f9019ee0640 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a371040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f901a6e1640 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a371580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f9019ee0640 1 -- 10.20.193.28:0/702213787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 msgr2=0x557e0a371580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f9019ee0640 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a371580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.509+0000 7f9019ee0640 1 -- 10.20.193.28:0/702213787 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e0a1c65f0 con 0x557e0a336210 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f9019ee0640 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a376860 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=16143477969476074044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004096b70 tx=0x7f9004108f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e00927ae71f73a3c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f8fcf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:20.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/702213787 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f900402fe40 con 0x557e0a336210 2026-02-20T13:17:20.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/702213787 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557e09ed8600 con 0x557e0a336210 2026-02-20T13:17:20.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/702213787 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90040cf6c0 con 0x557e0a336210 2026-02-20T13:17:20.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e0a1d80c0 con 0x557e0a336210 2026-02-20T13:17:20.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/702213787 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f90040d2e50 con 0x557e0a336210 2026-02-20T13:17:20.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f8fcf7fe640 10 client.25397 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:17:20.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f901e165e00 10 client.25397 _ll_register_callbacks cb 0x557e0a1cba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.510+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90040d9760 con 0x557e0a336210 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/702213787 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f90040d7180 con 0x557e0a336210 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f901e165e00 10 client.25397 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=25}) -- 0x557e0a1d8320 con 0x557e0a336210 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/702213787 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7f90040d1910 con 0x557e0a336210 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f901e165e00 10 client.25397 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f901e165e00 10 client.25397 resolve_mds: resolved name 'j' to daemon mds.j 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f901e165e00 20 client.25397 populate_metadata read hostname 'trial028' 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f901e165e00 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557e0a434e10 0x557e0a433af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f901e165e00 4 client.25397 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "status"}) -- 0x557e09ed5e50 con 0x557e0a434e10 2026-02-20T13:17:20.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f90196df640 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557e0a434e10 0x557e0a433af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f90196df640 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557e0a434e10 0x557e0a433af0 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=9372284543708573806 s_cookie=13271138006345374755 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=82110b22d1a2306e server_cookie=b82c8db40966dc23 in_seq=0 out_seq=0 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.511+0000 7f8fcf7fe640 10 client.25397 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f8fcf7fe640 1 -- 10.20.193.28:0/702213787 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1223 (crc 0 0 0) 0x557e09ed5e50 con 0x557e0a434e10 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f8fcf7fe640 10 client.25397 handle_command_reply: tid=0 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 client.25397 shutdown 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 msgr2=0x557e0a376860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a376860 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=16143477969476074044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004096b70 tx=0x7f9004108f90 comp rx=0 tx=0).stop 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 shutdown_connections 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557e0a434e10 0x557e0a433af0 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=9372284543708573806 s_cookie=13271138006345374755 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e0a37b7c0 0x557e0a371580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557e0a336b20 0x557e0a371040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 --2- 10.20.193.28:0/702213787 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557e0a336210 0x557e0a376860 unknown :-1 s=CLOSED pgs=141 gs=2 cs=0 l=1 c_cookie=16143477969476074044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 >> 10.20.193.28:0/702213787 conn(0x557e0a255450 msgr2=0x557e0a360d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:20.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f8fcf7fe640 0 client.25397 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:20.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 shutdown_connections 2026-02-20T13:17:20.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.512+0000 7f901e165e00 1 -- 10.20.193.28:0/702213787 wait complete. 2026-02-20T13:17:20.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901e165e00 20 client.25397 trim_cache size 0 max 16384 2026-02-20T13:17:20.523 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:20.523 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:20.523 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 4, 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24622, 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 41.444032888999999, 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 25, 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 60.281505981999999, 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:20.524 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial028", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-20T13:17:20.525 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:20.526 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448336", 2026-02-20T13:17:20.526 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:20.526 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:20.526 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:20.526 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 -- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ff00b57f0 msgr2=0x7f8ff00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ff00b57f0 0x7f8ff00d5ca0 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90141244d0 tx=0x7f9008005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 -- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 msgr2=0x7f901411db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 0x7f901411db30 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004038820 tx=0x7f9004004300 comp rx=0 tx=0).stop 2026-02-20T13:17:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 -- 10.20.193.28:0/2543553762 shutdown_connections 2026-02-20T13:17:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ff00b57f0 0x7f8ff00d5ca0 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9014115420 0x7f9014123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f901410fc20 0x7f901411e070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 --2- 10.20.193.28:0/2543553762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901410f230 0x7f901411db30 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 -- 10.20.193.28:0/2543553762 >> 10.20.193.28:0/2543553762 conn(0x7f901405f830 msgr2=0x7f901410cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 -- 10.20.193.28:0/2543553762 shutdown_connections 2026-02-20T13:17:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.513+0000 7f901c16b640 1 -- 10.20.193.28:0/2543553762 wait complete. 2026-02-20T13:17:20.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:20 trial028 ceph-mon[37442]: pgmap v179: 97 pgs: 97 active+clean; 658 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2026-02-20T13:17:20.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:20 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/265392382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:20.624 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.i status 2026-02-20T13:17:20.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:20 trial127 ceph-mon[43817]: pgmap v179: 97 pgs: 97 active+clean; 658 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2026-02-20T13:17:20.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:20 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/265392382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:20.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:20 trial034 ceph-mon[43332]: pgmap v179: 97 pgs: 97 active+clean; 658 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2026-02-20T13:17:20.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:20 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/265392382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:20.808 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:20.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 -- 10.20.193.28:0/2276266222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0114990 msgr2=0x7f6ac01193f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 --2- 10.20.193.28:0/2276266222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0114990 0x7f6ac01193f0 secure :-1 s=READY pgs=359 gs=2 cs=0 l=1 c_cookie=9647909567469109083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa8009950 tx=0x7f6aa802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 -- 10.20.193.28:0/2276266222 shutdown_connections 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 --2- 10.20.193.28:0/2276266222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0114990 0x7f6ac01193f0 unknown :-1 s=CLOSED pgs=359 gs=2 cs=0 l=1 c_cookie=9647909567469109083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 --2- 10.20.193.28:0/2276266222 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6ac0119ba0 0x7f6ac017a570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 --2- 10.20.193.28:0/2276266222 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ac0113fa0 0x7f6ac0114370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 -- 10.20.193.28:0/2276266222 >> 10.20.193.28:0/2276266222 conn(0x7f6ac0064a90 msgr2=0x7f6ac0064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 -- 10.20.193.28:0/2276266222 shutdown_connections 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.984+0000 7f6ac5962640 1 -- 10.20.193.28:0/2276266222 wait complete. 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac5962640 1 Processor -- start 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac5962640 1 -- start start 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac5962640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0113fa0 0x7f6ac0122320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac5962640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6ac0114990 0x7f6ac0122860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac5962640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ac0119ba0 0x7f6ac0127be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac5962640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0128200 con 0x7f6ac0113fa0 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac5962640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0128370 con 0x7f6ac0114990 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac5962640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0128530 con 0x7f6ac0119ba0 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ab7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6ac0114990 0x7f6ac0122860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ab7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6ac0114990 0x7f6ac0122860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51190/0 (socket says 10.20.193.28:51190) 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ab7fff640 1 -- 10.20.193.28:0/3215870779 learned_addr learned my addr 10.20.193.28:0/3215870779 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.985+0000 7f6ac4960640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0113fa0 0x7f6ac0122320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ac5161640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ac0119ba0 0x7f6ac0127be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab7fff640 1 -- 10.20.193.28:0/3215870779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ac0119ba0 msgr2=0x7f6ac0127be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ac0119ba0 0x7f6ac0127be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab7fff640 1 -- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0113fa0 msgr2=0x7f6ac0122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0113fa0 0x7f6ac0122320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab7fff640 1 -- 10.20.193.28:0/3215870779 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa8009570 con 0x7f6ac0114990 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ac5161640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ac0119ba0 0x7f6ac0127be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ac4960640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0113fa0 0x7f6ac0122320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6ac0114990 0x7f6ac0122860 secure :-1 s=READY pgs=142 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa8005b30 tx=0x7f6aa8004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab5ffb640 1 -- 10.20.193.28:0/3215870779 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa803d070 con 0x7f6ac0114990 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab5ffb640 1 -- 10.20.193.28:0/3215870779 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6aa8038920 con 0x7f6ac0114990 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ac5962640 1 -- 10.20.193.28:0/3215870779 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac01287b0 con 0x7f6ac0114990 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ab5ffb640 1 -- 10.20.193.28:0/3215870779 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80418a0 con 0x7f6ac0114990 2026-02-20T13:17:20.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.986+0000 7f6ac5962640 1 -- 10.20.193.28:0/3215870779 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac0168f10 con 0x7f6ac0114990 2026-02-20T13:17:20.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.989+0000 7f6ab5ffb640 1 -- 10.20.193.28:0/3215870779 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f6aa8048020 con 0x7f6ac0114990 2026-02-20T13:17:20.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.991+0000 7f6ab5ffb640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a9c0b5770 0x7f6a9c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.991+0000 7f6ab5ffb640 1 -- 10.20.193.28:0/3215870779 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6aa810aff0 con 0x7f6ac0114990 2026-02-20T13:17:20.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.991+0000 7f6ac4960640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a9c0b5770 0x7f6a9c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.991+0000 7f6ac4960640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a9c0b5770 0x7f6a9c0d5c20 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab0004740 tx=0x7f6ab0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.991+0000 7f6ac8be5e00 1 Processor -- start 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac8be5e00 1 -- start start 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedb85e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedb8b20 0x55f9cedfd280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedfd7c0 0x55f9cee1dba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9cec4a370 con 0x55f9cedfd7c0 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f9cecce710 con 0x55f9cedb8210 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f9cecca440 con 0x55f9cedb8b20 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ab7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedb8b20 0x55f9cedfd280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ab7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedb8b20 0x55f9cedfd280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35766/0 (socket says 10.20.193.28:35766) 2026-02-20T13:17:20.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ab7fff640 1 -- 10.20.193.28:0/4267944154 learned_addr learned my addr 10.20.193.28:0/4267944154 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac5161640 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedfd7c0 0x55f9cee1dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ac4960640 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedb85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ab7fff640 1 -- 10.20.193.28:0/4267944154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 msgr2=0x55f9cedb85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedb85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ab7fff640 1 -- 10.20.193.28:0/4267944154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedfd7c0 msgr2=0x55f9cee1dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedfd7c0 0x55f9cee1dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.992+0000 7f6ab7fff640 1 -- 10.20.193.28:0/4267944154 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cec6fcf0 con 0x55f9cedb8b20 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedb8b20 0x55f9cedfd280 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=10772514634152948156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa80044f0 tx=0x7f6aa80ce260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957fa8fc0a6231bc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6a8d4e4640 1 -- 10.20.193.28:0/4267944154 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80d4410 con 0x55f9cedb8b20 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6a8d4e4640 1 -- 10.20.193.28:0/4267944154 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6aa802fe00 con 0x55f9cedb8b20 2026-02-20T13:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6a8d4e4640 1 -- 10.20.193.28:0/4267944154 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80800b0 con 0x55f9cedb8b20 2026-02-20T13:17:21.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/4267944154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedb8b20 msgr2=0x55f9cedfd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedb8b20 0x55f9cedfd280 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=10772514634152948156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa80044f0 tx=0x7f6aa80ce260 comp rx=0 tx=0).stop 2026-02-20T13:17:21.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/4267944154 shutdown_connections 2026-02-20T13:17:21.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedfd7c0 0x55f9cee1dba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedb8b20 0x55f9cedfd280 unknown :-1 s=CLOSED pgs=111 gs=2 cs=0 l=1 c_cookie=10772514634152948156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/4267944154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedb85e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/4267944154 >> 10.20.193.28:0/4267944154 conn(0x55f9cecd7450 msgr2=0x55f9cedb6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/4267944154 shutdown_connections 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.993+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/4267944154 wait complete. 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac8be5e00 1 -- start start 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac8be5e00 1 Processor -- start 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedd0870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd0db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd5da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9ce982610 con 0x55f9cedb8b20 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f9cedd6310 con 0x55f9cedb8210 2026-02-20T13:17:21.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f9cedd64d0 con 0x55f9cedfd7c0 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac5161640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.995+0000 7f6ac5161640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35780/0 (socket says 10.20.193.28:35780) 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ac5161640 1 -- 10.20.193.28:0/2752902166 learned_addr learned my addr 10.20.193.28:0/2752902166 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ac4960640 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedd0870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ab7fff640 1 -- 10.20.193.28:0/2752902166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 msgr2=0x55f9cedd5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ab7fff640 1 -- 10.20.193.28:0/2752902166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 msgr2=0x55f9cedd0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedd0870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ab7fff640 1 -- 10.20.193.28:0/2752902166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cec482c0 con 0x55f9cedb8b20 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ac5161640 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd5da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:21.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd0db0 secure :-1 s=READY pgs=360 gs=3 cs=0 l=1 c_cookie=4081792452740193919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa80ce8c0 tx=0x7f6aa8009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a5709c08731e7f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6a7e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/2752902166 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80d4410 con 0x55f9cedb8b20 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/2752902166 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6aa80ce6e0 con 0x55f9cedb8b20 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/2752902166 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80dc410 con 0x55f9cedb8b20 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.996+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac0168f10 con 0x55f9cedb8b20 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 10 client.15435 _ll_register_callbacks cb 0x55f9cec4da90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9ce95a600 con 0x55f9cedb8b20 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/2752902166 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6aa80d15e0 con 0x55f9cedb8b20 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/2752902166 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6aa80802f0 con 0x55f9cedb8b20 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 10 client.15435 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55f9cec5a0c0 con 0x55f9cedb8b20 2026-02-20T13:17:21.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/2752902166 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7f6aa80ccae0 con 0x55f9cedb8b20 2026-02-20T13:17:21.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 10 client.15435 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:21.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 10 client.15435 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T13:17:21.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 20 client.15435 populate_metadata read hostname 'trial028' 2026-02-20T13:17:21.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f9cedfb750 0x55f9cedfcbc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 4 client.15435 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:21.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.997+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9cec970a0 con 0x55f9cedfb750 2026-02-20T13:17:21.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.998+0000 7f6ac4960640 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f9cedfb750 0x55f9cedfcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.998+0000 7f6ac4960640 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f9cedfb750 0x55f9cedfcbc0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=7740017583358448453 s_cookie=142434810109352795 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6b6a10fbd35b9345 server_cookie=1fa07b48437db5b in_seq=0 out_seq=0 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.998+0000 7f6a7e7fc640 10 client.15435 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/2752902166 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f9cec970a0 con 0x55f9cedfb750 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6a7e7fc640 10 client.15435 handle_command_reply: tid=0 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 client.15435 shutdown 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 msgr2=0x55f9cedd0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd0db0 secure :-1 s=READY pgs=360 gs=3 cs=0 l=1 c_cookie=4081792452740193919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa80ce8c0 tx=0x7f6aa8009420 comp rx=0 tx=0).stop 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 shutdown_connections 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f9cedfb750 0x55f9cedfcbc0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=7740017583358448453 s_cookie=142434810109352795 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd0db0 unknown :-1 s=CLOSED pgs=360 gs=3 cs=0 l=1 c_cookie=4081792452740193919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd5da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/2752902166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedd0870 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6a7e7fc640 0 client.15435 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:21.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 >> 10.20.193.28:0/2752902166 conn(0x55f9cecd7450 msgr2=0x55f9cedb7200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 shutdown_connections 2026-02-20T13:17:21.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/2752902166 wait complete. 2026-02-20T13:17:21.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:20.999+0000 7f6ac8be5e00 20 client.15435 trim_cache size 0 max 16384 2026-02-20T13:17:21.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac8be5e00 1 Processor -- start 2026-02-20T13:17:21.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac8be5e00 1 -- start start 2026-02-20T13:17:21.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedbdb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedb7400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedb7940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9cecc45a0 con 0x55f9cedb8b20 2026-02-20T13:17:21.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f9cecc21d0 con 0x55f9cedb8210 2026-02-20T13:17:21.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f9ce982610 con 0x55f9cedfd7c0 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedb7400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedb7400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55556/0 (socket says 10.20.193.28:55556) 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ab7fff640 1 -- 10.20.193.28:0/1814664235 learned_addr learned my addr 10.20.193.28:0/1814664235 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac5161640 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedb7940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ac4960640 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedbdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ab7fff640 1 -- 10.20.193.28:0/1814664235 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 msgr2=0x55f9cedb7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.009+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedb7940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ab7fff640 1 -- 10.20.193.28:0/1814664235 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 msgr2=0x55f9cedbdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedbdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ab7fff640 1 -- 10.20.193.28:0/1814664235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cec54b40 con 0x55f9cedb8b20 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac4960640 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedbdb10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedb7400 secure :-1 s=READY pgs=361 gs=2 cs=0 l=1 c_cookie=18391264737395936113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa80023d0 tx=0x7f6aa803a020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3ae5d66aa70b71 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6a8cce3640 1 -- 10.20.193.28:0/1814664235 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80d4410 con 0x55f9cedb8b20 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6a8cce3640 1 -- 10.20.193.28:0/1814664235 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f9ce95a600 con 0x55f9cedb8b20 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6a8cce3640 1 -- 10.20.193.28:0/1814664235 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80dc5d0 con 0x55f9cedb8b20 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/1814664235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 msgr2=0x55f9cedb7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedb7400 secure :-1 s=READY pgs=361 gs=2 cs=0 l=1 c_cookie=18391264737395936113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa80023d0 tx=0x7f6aa803a020 comp rx=0 tx=0).stop 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/1814664235 shutdown_connections 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedb7400 unknown :-1 s=CLOSED pgs=361 gs=2 cs=0 l=1 c_cookie=18391264737395936113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedb7940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/1814664235 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cedbdb10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/1814664235 >> 10.20.193.28:0/1814664235 conn(0x55f9cecd7450 msgr2=0x55f9cedbb010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/1814664235 shutdown_connections 2026-02-20T13:17:21.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.010+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/1814664235 wait complete. 2026-02-20T13:17:21.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ac8be5e00 1 -- start start 2026-02-20T13:17:21.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ac8be5e00 1 Processor -- start 2026-02-20T13:17:21.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cee63f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd6d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ac8be5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd72d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9ced93560 con 0x55f9cedb8b20 2026-02-20T13:17:21.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f9cedfc050 con 0x55f9cedb8210 2026-02-20T13:17:21.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ac8be5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f9ced27b90 con 0x55f9cedfd7c0 2026-02-20T13:17:21.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.011+0000 7f6ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55562/0 (socket says 10.20.193.28:55562) 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ab7fff640 1 -- 10.20.193.28:0/3546182592 learned_addr learned my addr 10.20.193.28:0/3546182592 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ac5161640 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ac4960640 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cee63f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ab7fff640 1 -- 10.20.193.28:0/3546182592 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 msgr2=0x55f9cedd72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ab7fff640 1 -- 10.20.193.28:0/3546182592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 msgr2=0x55f9cee63f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cee63f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ab7fff640 1 -- 10.20.193.28:0/3546182592 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cec485f0 con 0x55f9cedb8b20 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ac4960640 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cee63f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ab7fff640 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd6d90 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=17927555933073948276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa80800b0 tx=0x7f6aa80d08b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cb792309d1be74 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6a7e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:21.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/3546182592 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80dc5d0 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/3546182592 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6aa80d4410 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/3546182592 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6aa80dc220 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cec5a0c0 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ac8be5e00 10 client.15441 _ll_register_callbacks cb 0x55f9cec4da90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.012+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa802fe00 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/3546182592 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6aa80d3aa0 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/3546182592 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6aa80802f0 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac8be5e00 10 client.15441 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55f9cec5a320 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/3546182592 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7f6aa80ce560 con 0x55f9cedb8b20 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac8be5e00 10 client.15441 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac8be5e00 10 client.15441 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T13:17:21.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac8be5e00 20 client.15441 populate_metadata read hostname 'trial028' 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f9ceeae9a0 0x55f9ceead680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac8be5e00 4 client.15441 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "status"}) -- 0x55f9ce957e50 con 0x55f9ceeae9a0 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.013+0000 7f6ac4960640 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f9ceeae9a0 0x55f9ceead680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac4960640 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f9ceeae9a0 0x55f9ceead680 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=8604854035182524071 s_cookie=1008665949660228740 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=776a95278f2416a7 server_cookie=dff80564a87ac84 in_seq=0 out_seq=0 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6a7e7fc640 10 client.15441 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6a7e7fc640 1 -- 10.20.193.28:0/3546182592 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x55f9ce957e50 con 0x55f9ceeae9a0 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6a7e7fc640 10 client.15441 handle_command_reply: tid=0 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 client.15441 shutdown 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 msgr2=0x55f9cedd6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd6d90 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=17927555933073948276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa80800b0 tx=0x7f6aa80d08b0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 shutdown_connections 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f9ceeae9a0 0x55f9ceead680 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=8604854035182524071 s_cookie=1008665949660228740 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9cedb8b20 0x55f9cedd6d90 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=17927555933073948276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9cedfd7c0 0x55f9cedd72d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 --2- 10.20.193.28:0/3546182592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9cedb8210 0x55f9cee63f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 >> 10.20.193.28:0/3546182592 conn(0x55f9cecd7450 msgr2=0x55f9cedd0610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6a7e7fc640 0 client.15441 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 shutdown_connections 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 1 -- 10.20.193.28:0/3546182592 wait complete. 2026-02-20T13:17:21.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.014+0000 7f6ac8be5e00 20 client.15441 trim_cache size 0 max 16384 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 3, 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24655, 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 42.216703340000002, 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 25, 2026-02-20T13:17:21.025 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 55.987374164000002, 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial127", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:21.026 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial127", 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438940", 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:21.027 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 -- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a9c0b5770 msgr2=0x7f6a9c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a9c0b5770 0x7f6a9c0d5c20 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab0004740 tx=0x7f6ab0005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 -- 10.20.193.28:0/3215870779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6ac0114990 msgr2=0x7f6ac0122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6ac0114990 0x7f6ac0122860 secure :-1 s=READY pgs=142 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aa8005b30 tx=0x7f6aa8004340 comp rx=0 tx=0).stop 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 -- 10.20.193.28:0/3215870779 shutdown_connections 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a9c0b5770 0x7f6a9c0d5c20 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ac0119ba0 0x7f6ac0127be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6ac0114990 0x7f6ac0122860 unknown :-1 s=CLOSED pgs=142 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 --2- 10.20.193.28:0/3215870779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ac0113fa0 0x7f6ac0122320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 -- 10.20.193.28:0/3215870779 >> 10.20.193.28:0/3215870779 conn(0x7f6ac0064a90 msgr2=0x7f6ac01179f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 -- 10.20.193.28:0/3215870779 shutdown_connections 2026-02-20T13:17:21.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.015+0000 7f6ac5962640 1 -- 10.20.193.28:0/3215870779 wait complete. 2026-02-20T13:17:21.152 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.h status 2026-02-20T13:17:21.337 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:21.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/47776775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010fc20 msgr2=0x7f4fe0114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/47776775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010fc20 0x7f4fe0114c70 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=3443051160125621006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd4009950 tx=0x7f4fd402f190 comp rx=0 tx=0).stop 2026-02-20T13:17:21.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/47776775 shutdown_connections 2026-02-20T13:17:21.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/47776775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010fc20 0x7f4fe0114c70 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=3443051160125621006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/47776775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4fe0115420 0x7f4fe0175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/47776775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4fe010f230 0x7f4fe010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/47776775 >> 10.20.193.28:0/47776775 conn(0x7f4fe005f830 msgr2=0x7f4fe010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/47776775 shutdown_connections 2026-02-20T13:17:21.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.517+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/47776775 wait complete. 2026-02-20T13:17:21.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe7c9e640 1 Processor -- start 2026-02-20T13:17:21.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe7c9e640 1 -- start start 2026-02-20T13:17:21.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe7c9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010f230 0x7f4fe00f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe7c9e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4fe010fc20 0x7f4fe0175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe7c9e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4fe0115420 0x7f4fe00f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe7c9e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00fae90 con 0x7f4fe010f230 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe7c9e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00fb000 con 0x7f4fe0115420 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe7c9e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00fb1c0 con 0x7f4fe010fc20 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe5212640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4fe010fc20 0x7f4fe0175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.518+0000 7f4fe5a13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010f230 0x7f4fe00f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe6214640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4fe0115420 0x7f4fe00f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe5a13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010f230 0x7f4fe00f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55570/0 (socket says 10.20.193.28:55570) 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe6214640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4fe0115420 0x7f4fe00f5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51242/0 (socket says 10.20.193.28:51242) 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe5a13640 1 -- 10.20.193.28:0/1908769586 learned_addr learned my addr 10.20.193.28:0/1908769586 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe5a13640 1 -- 10.20.193.28:0/1908769586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4fe010fc20 msgr2=0x7f4fe0175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4fe010fc20 0x7f4fe0175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe5a13640 1 -- 10.20.193.28:0/1908769586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4fe0115420 msgr2=0x7f4fe00f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4fe0115420 0x7f4fe00f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe5a13640 1 -- 10.20.193.28:0/1908769586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd00094b0 con 0x7f4fe010f230 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010f230 0x7f4fe00f5580 secure :-1 s=READY pgs=364 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd0009fd0 tx=0x7f4fd0002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fceffd640 1 -- 10.20.193.28:0/1908769586 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fd000ed60 con 0x7f4fe010f230 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fceffd640 1 -- 10.20.193.28:0/1908769586 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fd0002e20 con 0x7f4fe010f230 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fceffd640 1 -- 10.20.193.28:0/1908769586 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fd0010960 con 0x7f4fe010f230 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/1908769586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd4009570 con 0x7f4fe010f230 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.519+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/1908769586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe00fb790 con 0x7f4fe010f230 2026-02-20T13:17:21.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.522+0000 7f4fceffd640 1 -- 10.20.193.28:0/1908769586 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f4fd0010af0 con 0x7f4fe010f230 2026-02-20T13:17:21.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.524+0000 7f4fceffd640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4fbc0b57e0 0x7f4fbc0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.524+0000 7f4fceffd640 1 -- 10.20.193.28:0/1908769586 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4fd00e71f0 con 0x7f4fe010f230 2026-02-20T13:17:21.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.524+0000 7f4fe5212640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4fbc0b57e0 0x7f4fbc0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe5212640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4fbc0b57e0 0x7f4fbc0d5c90 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fe00fbf20 tx=0x7f4fd403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe9c98e00 1 Processor -- start 2026-02-20T13:17:21.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe9c98e00 1 -- start start 2026-02-20T13:17:21.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf64280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf84ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5637ebdb1370 con 0x5637ebf647c0 2026-02-20T13:17:21.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5637ebe35710 con 0x5637ebf1fb20 2026-02-20T13:17:21.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5637ebe31440 con 0x5637ebf1f210 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe6214640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf84ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe5a13640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe5a13640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35812/0 (socket says 10.20.193.28:35812) 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe5a13640 1 -- 10.20.193.28:0/2270439830 learned_addr learned my addr 10.20.193.28:0/2270439830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe5212640 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf64280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.525+0000 7f4fe6214640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf84ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55584/0 (socket says 10.20.193.28:55584) 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe5a13640 1 -- 10.20.193.28:0/2270439830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 msgr2=0x5637ebf64280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf64280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe5a13640 1 -- 10.20.193.28:0/2270439830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 msgr2=0x5637ebf84ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf84ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe5a13640 1 -- 10.20.193.28:0/2270439830 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ebdd6cf0 con 0x5637ebf1f210 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe5212640 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf64280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe6214640 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf84ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1f5e0 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=1281528800355418320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd0004820 tx=0x7f4fd0010430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c8e7a7729e00d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fae4e6640 1 -- 10.20.193.28:0/2270439830 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fd00aced0 con 0x5637ebf1f210 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fae4e6640 1 -- 10.20.193.28:0/2270439830 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fd00accf0 con 0x5637ebf1f210 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fae4e6640 1 -- 10.20.193.28:0/2270439830 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fd00ad310 con 0x5637ebf1f210 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/2270439830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 msgr2=0x5637ebf1f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.526+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1f5e0 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=1281528800355418320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd0004820 tx=0x7f4fd0010430 comp rx=0 tx=0).stop 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.527+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/2270439830 shutdown_connections 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.527+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf84ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.527+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf64280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.527+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/2270439830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1f5e0 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=1281528800355418320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.527+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/2270439830 >> 10.20.193.28:0/2270439830 conn(0x5637ebe3e450 msgr2=0x5637ebf1daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.527+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/2270439830 shutdown_connections 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.527+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/2270439830 wait complete. 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.528+0000 7f4fe9c98e00 1 -- start start 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.528+0000 7f4fe9c98e00 1 Processor -- start 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.528+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf41830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.528+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf41d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.528+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf458f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.528+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5637ebae9610 con 0x5637ebf647c0 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.528+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5637ebf45e60 con 0x5637ebf1fb20 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.528+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5637ebf46020 con 0x5637ebf1f210 2026-02-20T13:17:21.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5212640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf41d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5212640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf41d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51264/0 (socket says 10.20.193.28:51264) 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5212640 1 -- 10.20.193.28:0/1488446598 learned_addr learned my addr 10.20.193.28:0/1488446598 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5212640 1 -- 10.20.193.28:0/1488446598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 msgr2=0x5637ebf41830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf41830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5212640 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf41830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe6214640 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5212640 1 -- 10.20.193.28:0/1488446598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 msgr2=0x5637ebf458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5212640 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe5212640 1 -- 10.20.193.28:0/1488446598 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe00fb790 con 0x5637ebf1fb20 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.529+0000 7f4fe6214640 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf458f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4fe5212640 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf41d70 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=8726797754600666066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd402f6a0 tx=0x7f4fd4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=791bd0523da633d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4f9b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:21.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1488446598 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fd4038d50 con 0x5637ebf1fb20 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe0176660 con 0x5637ebf1fb20 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4fe9c98e00 10 client.25427 _ll_register_callbacks cb 0x5637ebdb4a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637ebac1600 con 0x5637ebf1fb20 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1488446598 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fd403e040 con 0x5637ebf1fb20 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1488446598 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fd4050670 con 0x5637ebf1fb20 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1488446598 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4fd4044410 con 0x5637ebf1fb20 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1488446598 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4fd40445d0 con 0x5637ebf1fb20 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4fe9c98e00 10 client.25427 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5637ebdaf2c0 con 0x5637ebf1fb20 2026-02-20T13:17:21.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.530+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1488446598 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7f4fd404f070 con 0x5637ebf1fb20 2026-02-20T13:17:21.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.531+0000 7f4fe9c98e00 10 client.25427 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:21.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.531+0000 7f4fe9c98e00 10 client.25427 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T13:17:21.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.531+0000 7f4fe9c98e00 20 client.25427 populate_metadata read hostname 'trial028' 2026-02-20T13:17:21.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.531+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5637ebf4b890 0x5637ebf4cd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.531+0000 7f4fe9c98e00 4 client.25427 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:21.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.531+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637ebdfe0a0 con 0x5637ebf4b890 2026-02-20T13:17:21.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.531+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5637ebf4b890 0x5637ebf4cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.532+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5637ebf4b890 0x5637ebf4cd00 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=17688292560933380890 s_cookie=12017120232994910002 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f579705e199e631a server_cookie=a6c5632eb6d22f32 in_seq=0 out_seq=0 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.532+0000 7f4f9b7fe640 10 client.25427 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1488446598 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5637ebdfe0a0 con 0x5637ebf4b890 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4f9b7fe640 10 client.25427 handle_command_reply: tid=0 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 client.25427 shutdown 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 msgr2=0x5637ebf41d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf41d70 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=8726797754600666066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd402f6a0 tx=0x7f4fd4009310 comp rx=0 tx=0).stop 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 shutdown_connections 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5637ebf4b890 0x5637ebf4cd00 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=17688292560933380890 s_cookie=12017120232994910002 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf458f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf41d70 unknown :-1 s=CLOSED pgs=143 gs=1 cs=0 l=1 c_cookie=8726797754600666066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1488446598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf41830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4f9b7fe640 0 client.25427 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:21.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 >> 10.20.193.28:0/1488446598 conn(0x5637ebe3e450 msgr2=0x5637ebf06c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 shutdown_connections 2026-02-20T13:17:21.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1488446598 wait complete. 2026-02-20T13:17:21.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.533+0000 7f4fe9c98e00 20 client.25427 trim_cache size 0 max 16384 2026-02-20T13:17:21.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.542+0000 7f4fe9c98e00 1 Processor -- start 2026-02-20T13:17:21.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.542+0000 7f4fe9c98e00 1 -- start start 2026-02-20T13:17:21.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1c7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf1cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf09c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5637ebe2b5a0 con 0x5637ebf647c0 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5637ebe291d0 con 0x5637ebf1fb20 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5637ebefa560 con 0x5637ebf1f210 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf09c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf09c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55606/0 (socket says 10.20.193.28:55606) 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 -- 10.20.193.28:0/3689933472 learned_addr learned my addr 10.20.193.28:0/3689933472 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:21.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe5212640 1 --2- 10.20.193.28:0/3689933472 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf1cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 -- 10.20.193.28:0/3689933472 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 msgr2=0x5637ebf1c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 --2- 10.20.193.28:0/3689933472 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 -- 10.20.193.28:0/3689933472 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 msgr2=0x5637ebf1cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 --2- 10.20.193.28:0/3689933472 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf1cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 -- 10.20.193.28:0/3689933472 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ebdc10c0 con 0x5637ebf647c0 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fe6214640 1 --2- 10.20.193.28:0/3689933472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf09c20 secure :-1 s=READY pgs=365 gs=2 cs=0 l=1 c_cookie=3218176803383705153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fdc005400 tx=0x7f4fdc003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca942c086167e41 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.543+0000 7f4fadce5640 1 -- 10.20.193.28:0/3689933472 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fdc013b60 con 0x5637ebf647c0 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fadce5640 1 -- 10.20.193.28:0/3689933472 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fdc013cc0 con 0x5637ebf647c0 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fadce5640 1 -- 10.20.193.28:0/3689933472 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fdc011900 con 0x5637ebf647c0 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/3689933472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 msgr2=0x5637ebf09c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/3689933472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf09c20 secure :-1 s=READY pgs=365 gs=2 cs=0 l=1 c_cookie=3218176803383705153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fdc005400 tx=0x7f4fdc003ed0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/3689933472 shutdown_connections 2026-02-20T13:17:21.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/3689933472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf09c20 unknown :-1 s=CLOSED pgs=365 gs=2 cs=0 l=1 c_cookie=3218176803383705153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/3689933472 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1fb20 0x5637ebf1cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/3689933472 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1f210 0x5637ebf1c7e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/3689933472 >> 10.20.193.28:0/3689933472 conn(0x5637ebe3e450 msgr2=0x5637ebf4a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/3689933472 shutdown_connections 2026-02-20T13:17:21.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/3689933472 wait complete. 2026-02-20T13:17:21.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.544+0000 7f4fe9c98e00 1 -- start start 2026-02-20T13:17:21.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe9c98e00 1 Processor -- start 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1f210 0x5637ebf44c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1fb20 0x5637ebf45190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe9c98e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf62b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5637ebf47420 con 0x5637ebf647c0 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5637ebf63250 con 0x5637ebf1f210 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe9c98e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5637ebf63410 con 0x5637ebf1fb20 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe6214640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf62b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe6214640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf62b20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55608/0 (socket says 10.20.193.28:55608) 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe6214640 1 -- 10.20.193.28:0/1454145100 learned_addr learned my addr 10.20.193.28:0/1454145100 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1f210 0x5637ebf44c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe5212640 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1fb20 0x5637ebf45190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe6214640 1 -- 10.20.193.28:0/1454145100 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1fb20 msgr2=0x5637ebf45190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe6214640 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1fb20 0x5637ebf45190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe6214640 1 -- 10.20.193.28:0/1454145100 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1f210 msgr2=0x5637ebf44c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe6214640 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1f210 0x5637ebf44c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.545+0000 7f4fe6214640 1 -- 10.20.193.28:0/1454145100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ebdbbb40 con 0x5637ebf647c0 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4fe6214640 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf62b20 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=14656218441025629073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fdc01cd20 tx=0x7f4fdc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb65590527dcab91 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4f9b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1454145100 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fdc013b60 con 0x5637ebf647c0 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1454145100 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fdc01cd80 con 0x5637ebf647c0 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1454145100 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fdc005b60 con 0x5637ebf647c0 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc003780 con 0x5637ebf647c0 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1454145100 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f4fdc023070 con 0x5637ebf647c0 2026-02-20T13:17:21.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4f9b7fe640 10 client.15456 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4fe9c98e00 10 client.15456 _ll_register_callbacks cb 0x5637ebdb4a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fd00accf0 con 0x5637ebf647c0 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1454145100 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4fdc005d30 con 0x5637ebf647c0 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4fe9c98e00 10 client.15456 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.546+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5637ebdaf5f0 con 0x5637ebf647c0 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1454145100 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7f4fdc011ca0 con 0x5637ebf647c0 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4fe9c98e00 10 client.15456 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4fe9c98e00 10 client.15456 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4fe9c98e00 20 client.15456 populate_metadata read hostname 'trial028' 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5637ec01f5c0 0x5637ec01e2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4fe9c98e00 4 client.15456 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:21.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "status"}) -- 0x5637ebabee50 con 0x5637ec01f5c0 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5637ec01f5c0 0x5637ec01e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4fe5a13640 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5637ec01f5c0 0x5637ec01e2a0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=16909115057423696776 s_cookie=10598057995959368189 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eaa93e8e6ff2c388 server_cookie=9313dd98ae2579fd in_seq=0 out_seq=0 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.547+0000 7f4f9b7fe640 10 client.15456 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/1454145100 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x5637ebabee50 con 0x5637ec01f5c0 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4f9b7fe640 10 client.15456 handle_command_reply: tid=0 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 client.15456 shutdown 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 msgr2=0x5637ebf62b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf62b20 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=14656218441025629073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fdc01cd20 tx=0x7f4fdc011720 comp rx=0 tx=0).stop 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 shutdown_connections 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5637ec01f5c0 0x5637ec01e2a0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=16909115057423696776 s_cookie=10598057995959368189 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ebf647c0 0x5637ebf62b20 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=14656218441025629073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5637ebf1fb20 0x5637ebf45190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 --2- 10.20.193.28:0/1454145100 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5637ebf1f210 0x5637ebf44c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4f9b7fe640 0 client.15456 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:21.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 >> 10.20.193.28:0/1454145100 conn(0x5637ebe3e450 msgr2=0x5637ebf413d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 shutdown_connections 2026-02-20T13:17:21.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 1 -- 10.20.193.28:0/1454145100 wait complete. 2026-02-20T13:17:21.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe9c98e00 20 client.15456 trim_cache size 0 max 16384 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 2, 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24659, 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 43.757302445999997, 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 25, 2026-02-20T13:17:21.559 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 57.232427645000001, 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial034", 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:21.560 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial034", 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438948", 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:21.561 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4fbc0b57e0 msgr2=0x7f4fbc0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4fbc0b57e0 0x7f4fbc0d5c90 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fe00fbf20 tx=0x7f4fd403a040 comp rx=0 tx=0).stop 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010f230 msgr2=0x7f4fe00f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.548+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010f230 0x7f4fe00f5580 secure :-1 s=READY pgs=364 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd0009fd0 tx=0x7f4fd0002bc0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.549+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/1908769586 shutdown_connections 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.549+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4fbc0b57e0 0x7f4fbc0d5c90 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.549+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4fe0115420 0x7f4fe00f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.549+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4fe010fc20 0x7f4fe0175cf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.549+0000 7f4fe7c9e640 1 --2- 10.20.193.28:0/1908769586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4fe010f230 0x7f4fe00f5580 unknown :-1 s=CLOSED pgs=364 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:21.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.549+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/1908769586 >> 10.20.193.28:0/1908769586 conn(0x7f4fe005f830 msgr2=0x7f4fe010d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:21.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.549+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/1908769586 shutdown_connections 2026-02-20T13:17:21.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:21.549+0000 7f4fe7c9e640 1 -- 10.20.193.28:0/1908769586 wait complete. 2026-02-20T13:17:21.685 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.g status 2026-02-20T13:17:21.871 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:22.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.044+0000 7fd564e74640 1 -- 10.20.193.28:0/1161002327 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd56010dc30 msgr2=0x7fd560112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.044+0000 7fd564e74640 1 --2- 10.20.193.28:0/1161002327 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd56010dc30 0x7fd560112c80 secure :-1 s=READY pgs=113 gs=3 cs=0 l=1 c_cookie=5729974410098466646 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd550009950 tx=0x7fd55002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:22.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.045+0000 7fd564e74640 1 -- 10.20.193.28:0/1161002327 shutdown_connections 2026-02-20T13:17:22.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.045+0000 7fd564e74640 1 --2- 10.20.193.28:0/1161002327 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd560113430 0x7fd560173e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.045+0000 7fd564e74640 1 --2- 10.20.193.28:0/1161002327 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd56010dc30 0x7fd560112c80 unknown :-1 s=CLOSED pgs=113 gs=3 cs=0 l=1 c_cookie=5729974410098466646 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.045+0000 7fd564e74640 1 --2- 10.20.193.28:0/1161002327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd56010d240 0x7fd56010d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.045+0000 7fd564e74640 1 -- 10.20.193.28:0/1161002327 >> 10.20.193.28:0/1161002327 conn(0x7fd5600eaad0 msgr2=0x7fd56010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.045+0000 7fd564e74640 1 -- 10.20.193.28:0/1161002327 shutdown_connections 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.045+0000 7fd564e74640 1 -- 10.20.193.28:0/1161002327 wait complete. 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd564e74640 1 Processor -- start 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd564e74640 1 -- start start 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd564e74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd56010d240 0x7fd5600f5720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd564e74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd56010dc30 0x7fd560173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd564e74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd560113430 0x7fd5600f5e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd564e74640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd5600fb030 con 0x7fd56010dc30 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd564e74640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd5600fb1a0 con 0x7fd56010d240 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd564e74640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd5600fb360 con 0x7fd560113430 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd55effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd56010dc30 0x7fd560173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd55f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd56010d240 0x7fd5600f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd55effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd56010dc30 0x7fd560173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55612/0 (socket says 10.20.193.28:55612) 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd55effd640 1 -- 10.20.193.28:0/1730796881 learned_addr learned my addr 10.20.193.28:0/1730796881 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.046+0000 7fd55ffff640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd560113430 0x7fd5600f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55effd640 1 -- 10.20.193.28:0/1730796881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd560113430 msgr2=0x7fd5600f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55effd640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd560113430 0x7fd5600f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55effd640 1 -- 10.20.193.28:0/1730796881 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd56010d240 msgr2=0x7fd5600f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55effd640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd56010d240 0x7fd5600f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55effd640 1 -- 10.20.193.28:0/1730796881 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd550009570 con 0x7fd56010dc30 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd56010d240 0x7fd5600f5720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55effd640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd56010dc30 0x7fd560173d00 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd550038820 tx=0x7fd550004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55cff9640 1 -- 10.20.193.28:0/1730796881 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd55003d070 con 0x7fd56010dc30 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55cff9640 1 -- 10.20.193.28:0/1730796881 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd550002ad0 con 0x7fd56010dc30 2026-02-20T13:17:22.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd564e74640 1 -- 10.20.193.28:0/1730796881 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5600fb5e0 con 0x7fd56010dc30 2026-02-20T13:17:22.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd55cff9640 1 -- 10.20.193.28:0/1730796881 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd550041930 con 0x7fd56010dc30 2026-02-20T13:17:22.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.048+0000 7fd564e74640 1 -- 10.20.193.28:0/1730796881 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5600fba50 con 0x7fd56010dc30 2026-02-20T13:17:22.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.050+0000 7fd55cff9640 1 -- 10.20.193.28:0/1730796881 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fd55002f9f0 con 0x7fd56010dc30 2026-02-20T13:17:22.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.052+0000 7fd55cff9640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd5340b57e0 0x7fd5340d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.052+0000 7fd55cff9640 1 -- 10.20.193.28:0/1730796881 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fd55010af00 con 0x7fd56010dc30 2026-02-20T13:17:22.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd5680f7e00 1 Processor -- start 2026-02-20T13:17:22.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd5680f7e00 1 -- start start 2026-02-20T13:17:22.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd5340b57e0 0x7fd5340d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 0x55bd0a61f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a664280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a684ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a4b1370 con 0x55bd0a61fb20 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a535710 con 0x55bd0a61f210 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a531440 con 0x55bd0a6647c0 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd55effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a664280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd55ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a684ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd55ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a684ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35866/0 (socket says 10.20.193.28:35866) 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.053+0000 7fd55ffff640 1 -- 10.20.193.28:0/17813549 learned_addr learned my addr 10.20.193.28:0/17813549 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd5340b57e0 0x7fd5340d5c90 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd54c004740 tx=0x7fd54c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd55ffff640 1 -- 10.20.193.28:0/17813549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 msgr2=0x55bd0a61f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd55ffff640 1 --2- 10.20.193.28:0/17813549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 0x55bd0a61f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd55ffff640 1 -- 10.20.193.28:0/17813549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 msgr2=0x55bd0a664280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd55ffff640 1 --2- 10.20.193.28:0/17813549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a664280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd55ffff640 1 -- 10.20.193.28:0/17813549 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd0a4d6cf0 con 0x55bd0a6647c0 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd55effd640 1 --2- 10.20.193.28:0/17813549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a664280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd55ffff640 1 --2- 10.20.193.28:0/17813549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a684ba0 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=490986698677746918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd554005630 tx=0x7fd554003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d055cd1420fce6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd523fff640 1 -- 10.20.193.28:0/17813549 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd554003e30 con 0x55bd0a6647c0 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd523fff640 1 -- 10.20.193.28:0/17813549 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd554011910 con 0x55bd0a6647c0 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd523fff640 1 -- 10.20.193.28:0/17813549 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd55401baa0 con 0x55bd0a6647c0 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd5680f7e00 1 -- 10.20.193.28:0/17813549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 msgr2=0x55bd0a684ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/17813549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a684ba0 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=490986698677746918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd554005630 tx=0x7fd554003c30 comp rx=0 tx=0).stop 2026-02-20T13:17:22.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd5680f7e00 1 -- 10.20.193.28:0/17813549 shutdown_connections 2026-02-20T13:17:22.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/17813549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a664280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/17813549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a684ba0 unknown :-1 s=CLOSED pgs=114 gs=2 cs=0 l=1 c_cookie=490986698677746918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/17813549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 0x55bd0a61f5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd5680f7e00 1 -- 10.20.193.28:0/17813549 >> 10.20.193.28:0/17813549 conn(0x55bd0a53e450 msgr2=0x55bd0a61daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.054+0000 7fd5680f7e00 1 -- 10.20.193.28:0/17813549 shutdown_connections 2026-02-20T13:17:22.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.055+0000 7fd5680f7e00 1 -- 10.20.193.28:0/17813549 wait complete. 2026-02-20T13:17:22.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.056+0000 7fd5680f7e00 1 -- start start 2026-02-20T13:17:22.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.056+0000 7fd5680f7e00 1 Processor -- start 2026-02-20T13:17:22.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.056+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a67c340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.056+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a61fb20 0x55bd0a67c880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.056+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a6647c0 0x55bd0a681870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.056+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a1e9610 con 0x55bd0a61f210 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.056+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a681de0 con 0x55bd0a6647c0 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.056+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a681fa0 con 0x55bd0a61fb20 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a6647c0 0x55bd0a681870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a67c340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a61fb20 0x55bd0a67c880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a61fb20 0x55bd0a67c880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35880/0 (socket says 10.20.193.28:35880) 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a6647c0 0x55bd0a681870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51298/0 (socket says 10.20.193.28:51298) 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55effd640 1 -- 10.20.193.28:0/3771988624 learned_addr learned my addr 10.20.193.28:0/3771988624 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55ffff640 1 -- 10.20.193.28:0/3771988624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a61fb20 msgr2=0x55bd0a67c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55ffff640 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a61fb20 0x55bd0a67c880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55ffff640 1 -- 10.20.193.28:0/3771988624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 msgr2=0x55bd0a67c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55ffff640 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a67c340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55ffff640 1 -- 10.20.193.28:0/3771988624 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5540052d0 con 0x55bd0a6647c0 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a67c340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd55ffff640 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a6647c0 0x55bd0a681870 secure :-1 s=READY pgs=144 gs=2 cs=0 l=1 c_cookie=18024241005567411573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd554005790 tx=0x7fd554005050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa22f7b2b2e00575 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.057+0000 7fd5217fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5217fa640 1 -- 10.20.193.28:0/3771988624 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd554021070 con 0x55bd0a6647c0 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5217fa640 1 -- 10.20.193.28:0/3771988624 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd554011a80 con 0x55bd0a6647c0 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5217fa640 1 -- 10.20.193.28:0/3771988624 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd554006050 con 0x55bd0a6647c0 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5600fba50 con 0x55bd0a6647c0 2026-02-20T13:17:22.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 10 client.25442 _ll_register_callbacks cb 0x55bd0a4b4a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bd0a1c1600 con 0x55bd0a6647c0 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5217fa640 1 -- 10.20.193.28:0/3771988624 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fd5540061e0 con 0x55bd0a6647c0 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5217fa640 1 -- 10.20.193.28:0/3771988624 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd55401b690 con 0x55bd0a6647c0 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 10 client.25442 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55bd0a4af2c0 con 0x55bd0a6647c0 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5217fa640 1 -- 10.20.193.28:0/3771988624 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7fd55402d060 con 0x55bd0a6647c0 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 10 client.25442 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 10 client.25442 resolve_mds: resolved name 'g' to daemon mds.g 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 20 client.25442 populate_metadata read hostname 'trial028' 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bd0a662750 0x55bd0a663bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 4 client.25442 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:22.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.058+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd0a4fe0a0 con 0x55bd0a662750 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.059+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bd0a662750 0x55bd0a663bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.059+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bd0a662750 0x55bd0a663bc0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=17626850968786447955 s_cookie=5597074697423580091 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f49f2790a7442e53 server_cookie=4daccdc861426bbb in_seq=0 out_seq=0 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.059+0000 7fd5217fa640 10 client.25442 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5217fa640 1 -- 10.20.193.28:0/3771988624 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bd0a4fe0a0 con 0x55bd0a662750 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5217fa640 10 client.25442 handle_command_reply: tid=0 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 client.25442 shutdown 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a6647c0 msgr2=0x55bd0a681870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a6647c0 0x55bd0a681870 secure :-1 s=READY pgs=144 gs=2 cs=0 l=1 c_cookie=18024241005567411573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd554005790 tx=0x7fd554005050 comp rx=0 tx=0).stop 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 shutdown_connections 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bd0a662750 0x55bd0a663bc0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=17626850968786447955 s_cookie=5597074697423580091 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a6647c0 0x55bd0a681870 unknown :-1 s=CLOSED pgs=144 gs=2 cs=0 l=1 c_cookie=18024241005567411573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a61fb20 0x55bd0a67c880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/3771988624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a67c340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5217fa640 0 client.25442 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:22.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 >> 10.20.193.28:0/3771988624 conn(0x55bd0a53e450 msgr2=0x55bd0a61d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 shutdown_connections 2026-02-20T13:17:22.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 1 -- 10.20.193.28:0/3771988624 wait complete. 2026-02-20T13:17:22.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.060+0000 7fd5680f7e00 20 client.25442 trim_cache size 0 max 16384 2026-02-20T13:17:22.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.069+0000 7fd5680f7e00 1 Processor -- start 2026-02-20T13:17:22.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.069+0000 7fd5680f7e00 1 -- start start 2026-02-20T13:17:22.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a6672b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61fb20 0x55bd0a6acfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a6ad4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a52b5a0 con 0x55bd0a61f210 2026-02-20T13:17:22.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a5291d0 con 0x55bd0a61fb20 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a673de0 con 0x55bd0a6647c0 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61fb20 0x55bd0a6acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a6672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61fb20 0x55bd0a6acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51310/0 (socket says 10.20.193.28:51310) 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55effd640 1 -- 10.20.193.28:0/471244274 learned_addr learned my addr 10.20.193.28:0/471244274 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55ffff640 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a6ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55f7fe640 1 -- 10.20.193.28:0/471244274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 msgr2=0x55bd0a6ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a6ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55f7fe640 1 -- 10.20.193.28:0/471244274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61fb20 msgr2=0x55bd0a6acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61fb20 0x55bd0a6acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55f7fe640 1 -- 10.20.193.28:0/471244274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd0a66e710 con 0x55bd0a61f210 2026-02-20T13:17:22.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55effd640 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61fb20 0x55bd0a6acfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.070+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a6672b0 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=17230934235428884894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55bd0a6821f0 tx=0x7fd54c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef209364cadb119e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5237fe640 1 -- 10.20.193.28:0/471244274 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd54c021040 con 0x55bd0a61f210 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5237fe640 1 -- 10.20.193.28:0/471244274 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd54c029c60 con 0x55bd0a61f210 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5237fe640 1 -- 10.20.193.28:0/471244274 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd54c01bda0 con 0x55bd0a61f210 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 -- 10.20.193.28:0/471244274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 msgr2=0x55bd0a6672b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a6672b0 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=17230934235428884894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55bd0a6821f0 tx=0x7fd54c014000 comp rx=0 tx=0).stop 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 -- 10.20.193.28:0/471244274 shutdown_connections 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a6ad4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61fb20 0x55bd0a6acfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/471244274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61f210 0x55bd0a6672b0 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=17230934235428884894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 -- 10.20.193.28:0/471244274 >> 10.20.193.28:0/471244274 conn(0x55bd0a53e450 msgr2=0x55bd0a666ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 -- 10.20.193.28:0/471244274 shutdown_connections 2026-02-20T13:17:22.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 -- 10.20.193.28:0/471244274 wait complete. 2026-02-20T13:17:22.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.071+0000 7fd5680f7e00 1 -- start start 2026-02-20T13:17:22.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd5680f7e00 1 Processor -- start 2026-02-20T13:17:22.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 0x55bd0a61ebe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a68db80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd5680f7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a68e250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a68e790 con 0x55bd0a61fb20 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a68e900 con 0x55bd0a61f210 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd5680f7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bd0a692bd0 con 0x55bd0a6647c0 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a68db80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a68db80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55644/0 (socket says 10.20.193.28:55644) 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55effd640 1 -- 10.20.193.28:0/2317798947 learned_addr learned my addr 10.20.193.28:0/2317798947 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55ffff640 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a68e250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 0x55bd0a61ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55effd640 1 -- 10.20.193.28:0/2317798947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 msgr2=0x55bd0a68e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55effd640 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a68e250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55effd640 1 -- 10.20.193.28:0/2317798947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 msgr2=0x55bd0a61ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55effd640 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 0x55bd0a61ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.072+0000 7fd55effd640 1 -- 10.20.193.28:0/2317798947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c003d90 con 0x55bd0a61fb20 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd55effd640 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a68db80 secure :-1 s=READY pgs=369 gs=2 cs=0 l=1 c_cookie=5956016979169392640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd550108ac0 tx=0x7fd550041410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a805e2df963800 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5217fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5217fa640 1 -- 10.20.193.28:0/2317798947 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5500dc450 con 0x55bd0a61fb20 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5217fa640 1 -- 10.20.193.28:0/2317798947 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5500dbfc0 con 0x55bd0a61fb20 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5600fb5e0 con 0x55bd0a61fb20 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5217fa640 1 -- 10.20.193.28:0/2317798947 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5500d2f60 con 0x55bd0a61fb20 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5217fa640 1 -- 10.20.193.28:0/2317798947 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fd5500d06b0 con 0x55bd0a61fb20 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5217fa640 10 client.15474 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5680f7e00 10 client.15474 _ll_register_callbacks cb 0x55bd0a4b4a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd554011910 con 0x55bd0a61fb20 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5217fa640 1 -- 10.20.193.28:0/2317798947 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5500cf3a0 con 0x55bd0a61fb20 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5680f7e00 10 client.15474 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:22.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.073+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55bd0a4c10c0 con 0x55bd0a61fb20 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd5217fa640 1 -- 10.20.193.28:0/2317798947 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7fd5500d0870 con 0x55bd0a61fb20 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd5680f7e00 10 client.15474 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd5680f7e00 10 client.15474 resolve_mds: resolved name 'g' to daemon mds.g 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd5680f7e00 20 client.15474 populate_metadata read hostname 'trial028' 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bd0a689d30 0x55bd0a688a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd5680f7e00 4 client.15474 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "status"}) -- 0x55bd0a1bee50 con 0x55bd0a689d30 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bd0a689d30 0x55bd0a688a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd55f7fe640 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bd0a689d30 0x55bd0a688a10 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=1979777693453844692 s_cookie=10376499317639572871 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b799552a88f00d4 server_cookie=9000bb26fffd6d87 in_seq=0 out_seq=0 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.074+0000 7fd5217fa640 10 client.15474 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5217fa640 1 -- 10.20.193.28:0/2317798947 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1217 (crc 0 0 0) 0x55bd0a1bee50 con 0x55bd0a689d30 2026-02-20T13:17:22.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5217fa640 10 client.15474 handle_command_reply: tid=0 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 client.15474 shutdown 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 msgr2=0x55bd0a68db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a68db80 secure :-1 s=READY pgs=369 gs=2 cs=0 l=1 c_cookie=5956016979169392640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd550108ac0 tx=0x7fd550041410 comp rx=0 tx=0).stop 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 shutdown_connections 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bd0a689d30 0x55bd0a688a10 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=1979777693453844692 s_cookie=10376499317639572871 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd0a61fb20 0x55bd0a68db80 unknown :-1 s=CLOSED pgs=369 gs=2 cs=0 l=1 c_cookie=5956016979169392640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd0a6647c0 0x55bd0a68e250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 --2- 10.20.193.28:0/2317798947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd0a61f210 0x55bd0a61ebe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5217fa640 0 client.15474 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 >> 10.20.193.28:0/2317798947 conn(0x55bd0a53e450 msgr2=0x55bd0a67a520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 shutdown_connections 2026-02-20T13:17:22.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.075+0000 7fd5680f7e00 1 -- 10.20.193.28:0/2317798947 wait complete. 2026-02-20T13:17:22.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd5680f7e00 20 client.15474 trim_cache size 0 max 16384 2026-02-20T13:17:22.086 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:22.086 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:22.086 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 1, 2026-02-20T13:17:22.086 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24677, 2026-02-20T13:17:22.086 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:22.086 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 45.288710451, 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 25, 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 55.754217351000001, 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:22.087 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial028", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448336", 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:22.088 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:22.089 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:22.089 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:22.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 -- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd5340b57e0 msgr2=0x7fd5340d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd5340b57e0 0x7fd5340d5c90 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd54c004740 tx=0x7fd54c005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:22.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 -- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd56010dc30 msgr2=0x7fd560173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd56010dc30 0x7fd560173d00 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd550038820 tx=0x7fd550004300 comp rx=0 tx=0).stop 2026-02-20T13:17:22.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 -- 10.20.193.28:0/1730796881 shutdown_connections 2026-02-20T13:17:22.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd5340b57e0 0x7fd5340d5c90 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd56010dc30 0x7fd560173d00 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd560113430 0x7fd5600f5e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 --2- 10.20.193.28:0/1730796881 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd56010d240 0x7fd5600f5720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 -- 10.20.193.28:0/1730796881 >> 10.20.193.28:0/1730796881 conn(0x7fd5600eaad0 msgr2=0x7fd560111380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 -- 10.20.193.28:0/1730796881 shutdown_connections 2026-02-20T13:17:22.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.076+0000 7fd564e74640 1 -- 10.20.193.28:0/1730796881 wait complete. 2026-02-20T13:17:22.178 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.b status 2026-02-20T13:17:22.364 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:22.494 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:22 trial028 ceph-mon[37442]: pgmap v180: 97 pgs: 97 active+clean; 666 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 -- 10.20.193.28:0/915110019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c74113420 msgr2=0x7f6c74173df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/915110019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c74113420 0x7f6c74173df0 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=5137305690990399979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c6800aa30 tx=0x7f6c68030270 comp rx=0 tx=0).stop 2026-02-20T13:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 -- 10.20.193.28:0/915110019 shutdown_connections 2026-02-20T13:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/915110019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c74113420 0x7f6c74173df0 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=5137305690990399979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/915110019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c7410dc20 0x7f6c74112c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/915110019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c7410d230 0x7f6c7410d600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 -- 10.20.193.28:0/915110019 >> 10.20.193.28:0/915110019 conn(0x7f6c740eab00 msgr2=0x7f6c7410af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 -- 10.20.193.28:0/915110019 shutdown_connections 2026-02-20T13:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.538+0000 7f6c78c3d640 1 -- 10.20.193.28:0/915110019 wait complete. 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c78c3d640 1 Processor -- start 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c78c3d640 1 -- start start 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c78c3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c7410d230 0x7f6c740f57c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c78c3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c7410dc20 0x7f6c74173cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c78c3d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c74113420 0x7f6c740f5ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c78c3d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740fb080 con 0x7f6c7410d230 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c78c3d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740fb1f0 con 0x7f6c7410dc20 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c78c3d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740fb3b0 con 0x7f6c74113420 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c7410d230 0x7f6c740f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c7410d230 0x7f6c740f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55670/0 (socket says 10.20.193.28:55670) 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c737fe640 1 -- 10.20.193.28:0/2661134549 learned_addr learned my addr 10.20.193.28:0/2661134549 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c73fff640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c74113420 0x7f6c740f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c7410dc20 0x7f6c74173cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c737fe640 1 -- 10.20.193.28:0/2661134549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c74113420 msgr2=0x7f6c740f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.539+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c74113420 0x7f6c740f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c737fe640 1 -- 10.20.193.28:0/2661134549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c7410dc20 msgr2=0x7f6c74173cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c7410dc20 0x7f6c74173cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c737fe640 1 -- 10.20.193.28:0/2661134549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6800a650 con 0x7f6c7410d230 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c7410d230 0x7f6c740f57c0 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c60009480 tx=0x7f6c6000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c70ff9640 1 -- 10.20.193.28:0/2661134549 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c6000cd40 con 0x7f6c7410d230 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c70ff9640 1 -- 10.20.193.28:0/2661134549 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c60004d30 con 0x7f6c7410d230 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c70ff9640 1 -- 10.20.193.28:0/2661134549 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c60010740 con 0x7f6c7410d230 2026-02-20T13:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c78c3d640 1 -- 10.20.193.28:0/2661134549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c740fb690 con 0x7f6c7410d230 2026-02-20T13:17:22.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.540+0000 7f6c78c3d640 1 -- 10.20.193.28:0/2661134549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c740fbb10 con 0x7f6c7410d230 2026-02-20T13:17:22.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.543+0000 7f6c70ff9640 1 -- 10.20.193.28:0/2661134549 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f6c6001f060 con 0x7f6c7410d230 2026-02-20T13:17:22.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.545+0000 7f6c70ff9640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c480b57e0 0x7f6c480d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.545+0000 7f6c70ff9640 1 -- 10.20.193.28:0/2661134549 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6c60014070 con 0x7f6c7410d230 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.545+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c480b57e0 0x7f6c480d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.545+0000 7f6c7bec0e00 1 Processor -- start 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.545+0000 7f6c7bec0e00 1 -- start start 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.545+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a10ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.545+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c480b57e0 0x7f6c480d5c90 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c740fc110 tx=0x7f6c64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.545+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a55c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 0x55c886a765b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c88689a370 con 0x55c886a10c20 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c88691e710 con 0x55c886a561d0 2026-02-20T13:17:22.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c88691a440 con 0x55c886a11530 2026-02-20T13:17:22.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a10ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a10ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55674/0 (socket says 10.20.193.28:55674) 2026-02-20T13:17:22.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 -- 10.20.193.28:0/3176273068 learned_addr learned my addr 10.20.193.28:0/3176273068 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c73fff640 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 0x55c886a765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a55c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 -- 10.20.193.28:0/3176273068 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 msgr2=0x55c886a55c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a55c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 -- 10.20.193.28:0/3176273068 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 msgr2=0x55c886a765b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 0x55c886a765b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 -- 10.20.193.28:0/3176273068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8868bfcf0 con 0x55c886a10c20 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c73fff640 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 0x55c886a765b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a55c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c737fe640 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a10ff0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=1360918741724520703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c600a9810 tx=0x7f6c600a9890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e2f46298a960ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c37fff640 1 -- 10.20.193.28:0/3176273068 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c600acc20 con 0x55c886a10c20 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c37fff640 1 -- 10.20.193.28:0/3176273068 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c600aca40 con 0x55c886a10c20 2026-02-20T13:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.546+0000 7f6c37fff640 1 -- 10.20.193.28:0/3176273068 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c60005260 con 0x55c886a10c20 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/3176273068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 msgr2=0x55c886a10ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a10ff0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=1360918741724520703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c600a9810 tx=0x7f6c600a9890 comp rx=0 tx=0).stop 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/3176273068 shutdown_connections 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 0x55c886a765b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a55c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/3176273068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a10ff0 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=1360918741724520703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/3176273068 >> 10.20.193.28:0/3176273068 conn(0x55c886927450 msgr2=0x55c886a0f500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/3176273068 shutdown_connections 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.547+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/3176273068 wait complete. 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.548+0000 7f6c7bec0e00 1 -- start start 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.548+0000 7f6c7bec0e00 1 Processor -- start 2026-02-20T13:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a10c20 0x55c886a6dd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a6e2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a561d0 0x55c886a73290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c8865d2610 con 0x55c886a561d0 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c886a73800 con 0x55c886a10c20 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c886a739c0 con 0x55c886a11530 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a10c20 0x55c886a6dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a10c20 0x55c886a6dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51366/0 (socket says 10.20.193.28:51366) 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c737fe640 1 -- 10.20.193.28:0/2989114170 learned_addr learned my addr 10.20.193.28:0/2989114170 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c737fe640 1 -- 10.20.193.28:0/2989114170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 msgr2=0x55c886a6e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a6e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a6e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c737fe640 1 -- 10.20.193.28:0/2989114170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a561d0 msgr2=0x55c886a73290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a561d0 0x55c886a73290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.549+0000 7f6c737fe640 1 -- 10.20.193.28:0/2989114170 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8868982c0 con 0x55c886a10c20 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a10c20 0x55c886a6dd60 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=15555401993622099717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c60005650 tx=0x7f6c60004f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7dfe3b2783f9705 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c357fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c357fa640 1 -- 10.20.193.28:0/2989114170 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c6006f070 con 0x55c886a10c20 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c357fa640 1 -- 10.20.193.28:0/2989114170 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c600c7020 con 0x55c886a10c20 2026-02-20T13:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c357fa640 1 -- 10.20.193.28:0/2989114170 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c600aded0 con 0x55c886a10c20 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c740fbb10 con 0x55c886a10c20 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 10 client.25460 _ll_register_callbacks cb 0x55c88689da90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c8865aa600 con 0x55c886a10c20 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c357fa640 1 -- 10.20.193.28:0/2989114170 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6c600c8070 con 0x55c886a10c20 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c357fa640 1 -- 10.20.193.28:0/2989114170 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6c600ae050 con 0x55c886a10c20 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 10 client.25460 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55c8868aa0c0 con 0x55c886a10c20 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c357fa640 1 -- 10.20.193.28:0/2989114170 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7f6c600b7ef0 con 0x55c886a10c20 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 10 client.25460 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 10 client.25460 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 20 client.25460 populate_metadata read hostname 'trial028' 2026-02-20T13:17:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c886a54190 0x55c886a55550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 4 client.25460 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.550+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8868e70a0 con 0x55c886a54190 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.551+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c886a54190 0x55c886a55550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.551+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c886a54190 0x55c886a55550 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=12355494517763288916 s_cookie=553299198895942156 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7788cd3b912f54 server_cookie=7adb6b09cb36a0c in_seq=0 out_seq=0 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.551+0000 7f6c357fa640 10 client.25460 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c357fa640 1 -- 10.20.193.28:0/2989114170 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c8868e70a0 con 0x55c886a54190 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c357fa640 10 client.25460 handle_command_reply: tid=0 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 client.25460 shutdown 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a10c20 msgr2=0x55c886a6dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a10c20 0x55c886a6dd60 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=15555401993622099717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c60005650 tx=0x7f6c60004f10 comp rx=0 tx=0).stop 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 shutdown_connections 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c886a54190 0x55c886a55550 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=12355494517763288916 s_cookie=553299198895942156 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a561d0 0x55c886a73290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a11530 0x55c886a6e2a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2989114170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a10c20 0x55c886a6dd60 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=15555401993622099717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c357fa640 0 client.25460 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:22.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 >> 10.20.193.28:0/2989114170 conn(0x55c886927450 msgr2=0x55c886a0f500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 shutdown_connections 2026-02-20T13:17:22.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2989114170 wait complete. 2026-02-20T13:17:22.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.552+0000 7f6c7bec0e00 20 client.25460 trim_cache size 0 max 16384 2026-02-20T13:17:22.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c7bec0e00 1 Processor -- start 2026-02-20T13:17:22.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c7bec0e00 1 -- start start 2026-02-20T13:17:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a10c20 0x55c886a6df60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a11530 0x55c886a6b120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 0x55c886a6b660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c886a746c0 con 0x55c886a11530 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c8869145a0 con 0x55c886a561d0 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c8869121d0 con 0x55c886a10c20 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a10c20 0x55c886a6df60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c72ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a11530 0x55c886a6b120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a10c20 0x55c886a6df60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35936/0 (socket says 10.20.193.28:35936) 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.562+0000 7f6c737fe640 1 -- 10.20.193.28:0/2601358770 learned_addr learned my addr 10.20.193.28:0/2601358770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c72ffd640 1 -- 10.20.193.28:0/2601358770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a10c20 msgr2=0x55c886a6df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2601358770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a10c20 0x55c886a6df60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c72ffd640 1 -- 10.20.193.28:0/2601358770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 msgr2=0x55c886a6b660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:17:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2601358770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 0x55c886a6b660 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c72ffd640 1 -- 10.20.193.28:0/2601358770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c886a53e80 con 0x55c886a11530 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2601358770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a11530 0x55c886a6b120 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=8527057783964700166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55c886a970d0 tx=0x7f6c64013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765631e050720e06 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c377fe640 1 -- 10.20.193.28:0/2601358770 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c64023040 con 0x55c886a11530 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c377fe640 1 -- 10.20.193.28:0/2601358770 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c6401d480 con 0x55c886a11530 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c377fe640 1 -- 10.20.193.28:0/2601358770 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c64029320 con 0x55c886a11530 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2601358770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a11530 msgr2=0x55c886a6b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2601358770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a11530 0x55c886a6b120 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=8527057783964700166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55c886a970d0 tx=0x7f6c64013000 comp rx=0 tx=0).stop 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2601358770 shutdown_connections 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2601358770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a11530 0x55c886a6b120 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=8527057783964700166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2601358770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a561d0 0x55c886a6b660 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2601358770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a10c20 0x55c886a6df60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2601358770 >> 10.20.193.28:0/2601358770 conn(0x55c886927450 msgr2=0x55c886a52ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.563+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2601358770 shutdown_connections 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.564+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2601358770 wait complete. 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.564+0000 7f6c7bec0e00 1 -- start start 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.564+0000 7f6c7bec0e00 1 Processor -- start 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.564+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a6e1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.564+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a11530 0x55c886a6bf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.564+0000 7f6c7bec0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a561d0 0x55c886a6c630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c8869e3560 con 0x55c886a10c20 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c886a6cd60 con 0x55c886a11530 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c7bec0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c886a79bb0 con 0x55c886a561d0 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a6e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c73fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a561d0 0x55c886a6c630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a6e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55700/0 (socket says 10.20.193.28:55700) 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 -- 10.20.193.28:0/2087892749 learned_addr learned my addr 10.20.193.28:0/2087892749 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a11530 0x55c886a6bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 -- 10.20.193.28:0/2087892749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a561d0 msgr2=0x55c886a6c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a561d0 0x55c886a6c630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 -- 10.20.193.28:0/2087892749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a11530 msgr2=0x55c886a6bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a11530 0x55c886a6bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 -- 10.20.193.28:0/2087892749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8868a4b40 con 0x55c886a10c20 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c73fff640 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a561d0 0x55c886a6c630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c737fe640 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a6e1f0 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=11543563610074989613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c600ad4b0 tx=0x7f6c60004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a032f9f164a5442d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c357fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c357fa640 1 -- 10.20.193.28:0/2087892749 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c6006f040 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c357fa640 1 -- 10.20.193.28:0/2087892749 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c600c7070 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c357fa640 1 -- 10.20.193.28:0/2087892749 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c600b2f60 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c64009a70 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c357fa640 1 -- 10.20.193.28:0/2087892749 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7f6c60095020 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c357fa640 10 client.15489 inactive, discarding osd_map(78..78 src has 1..78) 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c7bec0e00 10 client.15489 _ll_register_callbacks cb 0x55c88689da90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.565+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c600aca40 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c357fa640 1 -- 10.20.193.28:0/2087892749 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6c600adc40 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c7bec0e00 10 client.15489 fetch_fsmap learned FSMap version 25 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55c8868985f0 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c357fa640 1 -- 10.20.193.28:0/2087892749 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 25) ==== 8366+0+0 (secure 0 0 0) 0x7f6c600abfa0 con 0x55c886a10c20 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c7bec0e00 10 client.15489 fetch_fsmap finished waiting for FSMap version 25 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c7bec0e00 10 client.15489 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T13:17:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c7bec0e00 20 client.15489 populate_metadata read hostname 'trial028' 2026-02-20T13:17:22.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c886a360c0 0x55c886a34da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:22.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c7bec0e00 4 client.15489 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T13:17:22.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "status"}) -- 0x55c8865a7e50 con 0x55c886a360c0 2026-02-20T13:17:22.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.566+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c886a360c0 0x55c886a34da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:22.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c72ffd640 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c886a360c0 0x55c886a34da0 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=11188139773744086665 s_cookie=13209926055011899728 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b4441d8cf6f7e89 server_cookie=b75315c202295950 in_seq=0 out_seq=0 2026-02-20T13:17:22.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c357fa640 10 client.15489 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c357fa640 1 -- 10.20.193.28:0/2087892749 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x55c8865a7e50 con 0x55c886a360c0 2026-02-20T13:17:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c357fa640 10 client.15489 handle_command_reply: tid=0 2026-02-20T13:17:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 client.15489 shutdown 2026-02-20T13:17:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 msgr2=0x55c886a6e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a6e1f0 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=11543563610074989613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c600ad4b0 tx=0x7f6c60004ea0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 shutdown_connections 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c886a360c0 0x55c886a34da0 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=11188139773744086665 s_cookie=13209926055011899728 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c886a561d0 0x55c886a6c630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c886a11530 0x55c886a6bf40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 --2- 10.20.193.28:0/2087892749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c886a10c20 0x55c886a6e1f0 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=11543563610074989613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c357fa640 0 client.15489 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 >> 10.20.193.28:0/2087892749 conn(0x55c886927450 msgr2=0x55c886a585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.567+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 shutdown_connections 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c7bec0e00 1 -- 10.20.193.28:0/2087892749 wait complete. 2026-02-20T13:17:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c7bec0e00 20 client.15489 trim_cache size 0 max 16384 2026-02-20T13:17:22.578 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:22.578 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "dd845518-0e5d-11f1-9909-d404e6e7d460", 2026-02-20T13:17:22.578 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-20T13:17:22.578 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24692, 2026-02-20T13:17:22.578 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T13:17:22.578 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T13:17:22.578 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T13:17:22.578 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 48.803230171999999, 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 25, 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 78, 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 78, 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 54.230658632000001, 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo)", 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5390-g0917c158", 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial034", 2026-02-20T13:17:22.579 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial034", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130438948", 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-20T13:17:22.580 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:22.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 -- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c480b57e0 msgr2=0x7f6c480d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c480b57e0 0x7f6c480d5c90 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c740fc110 tx=0x7f6c64005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:22.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 -- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c7410d230 msgr2=0x7f6c740f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c7410d230 0x7f6c740f57c0 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c60009480 tx=0x7f6c6000ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 -- 10.20.193.28:0/2661134549 shutdown_connections 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c480b57e0 0x7f6c480d5c90 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c74113420 0x7f6c740f5ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c7410dc20 0x7f6c74173cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 --2- 10.20.193.28:0/2661134549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c7410d230 0x7f6c740f57c0 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 -- 10.20.193.28:0/2661134549 >> 10.20.193.28:0/2661134549 conn(0x7f6c740eab00 msgr2=0x7f6c7410b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 -- 10.20.193.28:0/2661134549 shutdown_connections 2026-02-20T13:17:22.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:22.568+0000 7f6c78c3d640 1 -- 10.20.193.28:0/2661134549 wait complete. 2026-02-20T13:17:22.670 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2026-02-20T13:17:22.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:22 trial127 ceph-mon[43817]: pgmap v180: 97 pgs: 97 active+clean; 666 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:17:22.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:22 trial034 ceph-mon[43332]: pgmap v180: 97 pgs: 97 active+clean; 666 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:17:24.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:24 trial127 ceph-mon[43817]: pgmap v181: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2026-02-20T13:17:24.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:24 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:24.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:24 trial034 ceph-mon[43332]: pgmap v181: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2026-02-20T13:17:24.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:24 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:24 trial028 ceph-mon[37442]: pgmap v181: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2026-02-20T13:17:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:24 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:17:26.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:26 trial127 ceph-mon[43817]: pgmap v182: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2026-02-20T13:17:26.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:26 trial034 ceph-mon[43332]: pgmap v182: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2026-02-20T13:17:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:26 trial028 ceph-mon[37442]: pgmap v182: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2026-02-20T13:17:28.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 -- 10.20.193.28:0/1419561575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110330 msgr2=0x7fefd41107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 --2- 10.20.193.28:0/1419561575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110330 0x7fefd41107a0 secure :-1 s=READY pgs=375 gs=2 cs=0 l=1 c_cookie=11149342047002611545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc4009890 tx=0x7fefc402f120 comp rx=0 tx=0).stop 2026-02-20T13:17:28.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 -- 10.20.193.28:0/1419561575 shutdown_connections 2026-02-20T13:17:28.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 --2- 10.20.193.28:0/1419561575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110330 0x7fefd41107a0 unknown :-1 s=CLOSED pgs=375 gs=2 cs=0 l=1 c_cookie=11149342047002611545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 --2- 10.20.193.28:0/1419561575 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefd4110ce0 0x7fefd4171670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 --2- 10.20.193.28:0/1419561575 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefd410f1a0 0x7fefd410f590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 -- 10.20.193.28:0/1419561575 >> 10.20.193.28:0/1419561575 conn(0x7fefd40ec8f0 msgr2=0x7fefd410cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:28.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 -- 10.20.193.28:0/1419561575 shutdown_connections 2026-02-20T13:17:28.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 -- 10.20.193.28:0/1419561575 wait complete. 2026-02-20T13:17:28.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.359+0000 7fefda8cc640 1 Processor -- start 2026-02-20T13:17:28.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefda8cc640 1 -- start start 2026-02-20T13:17:28.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefda8cc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefd410f1a0 0x7fefd40f8850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefda8cc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefd4110330 0x7fefd4171650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefda8cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110ce0 0x7fefd40f9090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefda8cc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fefd40f9cf0 con 0x7fefd4110ce0 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefda8cc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fefd40f9e60 con 0x7fefd4110330 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefda8cc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fefd40fa020 con 0x7fefd410f1a0 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefd4110330 0x7fefd4171650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd8e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110ce0 0x7fefd40f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefd4110330 0x7fefd4171650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51404/0 (socket says 10.20.193.28:51404) 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd37fe640 1 -- 10.20.193.28:0/2119024897 learned_addr learned my addr 10.20.193.28:0/2119024897 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd3fff640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefd410f1a0 0x7fefd40f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd8e42640 1 -- 10.20.193.28:0/2119024897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefd410f1a0 msgr2=0x7fefd40f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd8e42640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefd410f1a0 0x7fefd40f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd8e42640 1 -- 10.20.193.28:0/2119024897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefd4110330 msgr2=0x7fefd4171650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd8e42640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefd4110330 0x7fefd4171650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd8e42640 1 -- 10.20.193.28:0/2119024897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc40094b0 con 0x7fefd4110ce0 2026-02-20T13:17:28.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd37fe640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefd4110330 0x7fefd4171650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:28.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd8e42640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110ce0 0x7fefd40f9090 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc800f940 tx=0x7fefc800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:28.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.360+0000 7fefd17fa640 1 -- 10.20.193.28:0/2119024897 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc800dce0 con 0x7fefd4110ce0 2026-02-20T13:17:28.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.361+0000 7fefd17fa640 1 -- 10.20.193.28:0/2119024897 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefc800de40 con 0x7fefd4110ce0 2026-02-20T13:17:28.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.361+0000 7fefd17fa640 1 -- 10.20.193.28:0/2119024897 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc80116b0 con 0x7fefd4110ce0 2026-02-20T13:17:28.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.361+0000 7fefda8cc640 1 -- 10.20.193.28:0/2119024897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd40fa300 con 0x7fefd4110ce0 2026-02-20T13:17:28.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.361+0000 7fefda8cc640 1 -- 10.20.193.28:0/2119024897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd40fa7d0 con 0x7fefd4110ce0 2026-02-20T13:17:28.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.363+0000 7fefd17fa640 1 -- 10.20.193.28:0/2119024897 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fefc8020060 con 0x7fefd4110ce0 2026-02-20T13:17:28.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.365+0000 7fefd17fa640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefa80b57f0 0x7fefa80d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.365+0000 7fefd17fa640 1 -- 10.20.193.28:0/2119024897 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fefc8015070 con 0x7fefd4110ce0 2026-02-20T13:17:28.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.365+0000 7fefd3fff640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefa80b57f0 0x7fefa80d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.365+0000 7fefd3fff640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefa80b57f0 0x7fefa80d5ca0 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc0005b30 tx=0x7fefc0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:28.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.372+0000 7fefdcfbce00 1 Processor -- start 2026-02-20T13:17:28.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.372+0000 7fefdcfbce00 1 -- start start 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.372+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846d934c0 0x55e846db38a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.372+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dd41c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.372+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846dd4700 0x55e846df4ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.372+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e846ca8fd0 con 0x55e846dd4700 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.372+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e846ca4d00 con 0x55e846db3de0 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.372+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e846c9eca0 con 0x55e846d934c0 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846dd4700 0x55e846df4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dd41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846d934c0 0x55e846db38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846dd4700 0x55e846df4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55718/0 (socket says 10.20.193.28:55718) 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846d934c0 0x55e846db38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35984/0 (socket says 10.20.193.28:35984) 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 -- 10.20.193.28:0/3126498426 learned_addr learned my addr 10.20.193.28:0/3126498426 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 -- 10.20.193.28:0/3126498426 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846d934c0 msgr2=0x55e846db38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 --2- 10.20.193.28:0/3126498426 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846d934c0 0x55e846db38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 -- 10.20.193.28:0/3126498426 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 msgr2=0x55e846dd41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 --2- 10.20.193.28:0/3126498426 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dd41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 -- 10.20.193.28:0/3126498426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e846c418b0 con 0x55e846dd4700 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd37fe640 1 --2- 10.20.193.28:0/3126498426 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dd41c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefd8e42640 1 --2- 10.20.193.28:0/3126498426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846dd4700 0x55e846df4ae0 secure :-1 s=READY pgs=377 gs=3 cs=0 l=1 c_cookie=9348405201964933790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc800ffd0 tx=0x7fefc80064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bc35004f88a29e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefa4bfe640 1 -- 10.20.193.28:0/3126498426 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc80b3d10 con 0x55e846dd4700 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefa4bfe640 1 -- 10.20.193.28:0/3126498426 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefc80b62f0 con 0x55e846dd4700 2026-02-20T13:17:28.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefa4bfe640 1 -- 10.20.193.28:0/3126498426 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc80adb90 con 0x55e846dd4700 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 -- 10.20.193.28:0/3126498426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846dd4700 msgr2=0x55e846df4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/3126498426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846dd4700 0x55e846df4ae0 secure :-1 s=READY pgs=377 gs=3 cs=0 l=1 c_cookie=9348405201964933790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc800ffd0 tx=0x7fefc80064e0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 -- 10.20.193.28:0/3126498426 shutdown_connections 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/3126498426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846dd4700 0x55e846df4ae0 unknown :-1 s=CLOSED pgs=377 gs=3 cs=0 l=1 c_cookie=9348405201964933790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/3126498426 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dd41c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/3126498426 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846d934c0 0x55e846db38a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 -- 10.20.193.28:0/3126498426 >> 10.20.193.28:0/3126498426 conn(0x55e846cb21c0 msgr2=0x55e846d91da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 -- 10.20.193.28:0/3126498426 shutdown_connections 2026-02-20T13:17:28.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.373+0000 7fefdcfbce00 1 -- 10.20.193.28:0/3126498426 wait complete. 2026-02-20T13:17:28.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefdcfbce00 1 -- start start 2026-02-20T13:17:28.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefdcfbce00 1 Processor -- start 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846dac960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dacfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 0x55e846dada10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e846dae070 con 0x55e846d934c0 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e846dae1e0 con 0x55e846db3de0 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e846dae3a0 con 0x55e846dd4700 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846dac960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dacfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846dac960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55734/0 (socket says 10.20.193.28:55734) 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd3fff640 1 -- 10.20.193.28:0/2643030535 learned_addr learned my addr 10.20.193.28:0/2643030535 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd8e42640 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 0x55e846dada10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd3fff640 1 -- 10.20.193.28:0/2643030535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 msgr2=0x55e846dada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd3fff640 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 0x55e846dada10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd3fff640 1 -- 10.20.193.28:0/2643030535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 msgr2=0x55e846dacfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd3fff640 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dacfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.391+0000 7fefd3fff640 1 -- 10.20.193.28:0/2643030535 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e846c4a400 con 0x55e846d934c0 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefd3fff640 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846dac960 secure :-1 s=READY pgs=378 gs=2 cs=0 l=1 c_cookie=1944556648044546821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc0003890 tx=0x7fefc00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afc73f7fc51cb05 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fef95ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fef95ffb640 1 -- 10.20.193.28:0/2643030535 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc0021070 con 0x55e846d934c0 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fef95ffb640 1 -- 10.20.193.28:0/2643030535 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefc0019900 con 0x55e846d934c0 2026-02-20T13:17:28.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd40fa7d0 con 0x55e846d934c0 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fef95ffb640 1 -- 10.20.193.28:0/2643030535 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc001cad0 con 0x55e846d934c0 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 10 client.15501 _ll_register_callbacks cb 0x55e846c29a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e84693e520 con 0x55e846d934c0 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fef95ffb640 1 -- 10.20.193.28:0/2643030535 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fefc001cc60 con 0x55e846d934c0 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fef95ffb640 1 -- 10.20.193.28:0/2643030535 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fefc001ce60 con 0x55e846d934c0 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 10 client.15501 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e846c22da0 con 0x55e846d934c0 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fef95ffb640 1 -- 10.20.193.28:0/2643030535 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fefc002d060 con 0x55e846d934c0 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 10 client.15501 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 20 client.15501 populate_metadata read hostname 'trial028' 2026-02-20T13:17:28.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e846db3060 0x55e846db3500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 4 client.15501 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.392+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e846cd0630 con 0x55e846db3060 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.393+0000 7fefd37fe640 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e846db3060 0x55e846db3500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.393+0000 7fefd37fe640 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e846db3060 0x55e846db3500 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=4658374580963950313 s_cookie=5989186622623327360 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a5df001110bee9 server_cookie=531ddd804efc2480 in_seq=0 out_seq=0 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.393+0000 7fef95ffb640 10 client.15501 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.393+0000 7fef95ffb640 1 -- 10.20.193.28:0/2643030535 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e846cd0630 con 0x55e846db3060 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.393+0000 7fef95ffb640 10 client.15501 handle_command_reply: tid=0 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.393+0000 7fefdcfbce00 1 client.15501 shutdown 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 msgr2=0x55e846dac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846dac960 secure :-1 s=READY pgs=378 gs=2 cs=0 l=1 c_cookie=1944556648044546821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc0003890 tx=0x7fefc00047e0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 shutdown_connections 2026-02-20T13:17:28.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e846db3060 0x55e846db3500 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=4658374580963950313 s_cookie=5989186622623327360 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 0x55e846dada10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dacfb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/2643030535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846dac960 unknown :-1 s=CLOSED pgs=378 gs=2 cs=0 l=1 c_cookie=1944556648044546821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 >> 10.20.193.28:0/2643030535 conn(0x55e846cb21c0 msgr2=0x55e846d94790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:28.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fef95ffb640 0 client.15501 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:28.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 shutdown_connections 2026-02-20T13:17:28.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 1 -- 10.20.193.28:0/2643030535 wait complete. 2026-02-20T13:17:28.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.394+0000 7fefdcfbce00 20 client.15501 trim_cache size 0 max 16384 2026-02-20T13:17:28.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.401+0000 7fefdcfbce00 1 Processor -- start 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.401+0000 7fefdcfbce00 1 -- start start 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d978b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dac6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 0x55e846da9c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e846daf1f0 con 0x55e846d934c0 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e846c9c8d0 con 0x55e846db3de0 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e8469ddf10 con 0x55e846dd4700 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55740/0 (socket says 10.20.193.28:55740) 2026-02-20T13:17:28.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 -- 10.20.193.28:0/1890431775 learned_addr learned my addr 10.20.193.28:0/1890431775 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd8e42640 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 0x55e846da9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 -- 10.20.193.28:0/1890431775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 msgr2=0x55e846da9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 0x55e846da9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 -- 10.20.193.28:0/1890431775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 msgr2=0x55e846dac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 -- 10.20.193.28:0/1890431775 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e846c34670 con 0x55e846d934c0 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd37fe640 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dac6f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fefd3fff640 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d978b0 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=18138214996466391643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc0011b10 tx=0x7fefc002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb7e2705c0ada5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fef97fff640 1 -- 10.20.193.28:0/1890431775 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc0021040 con 0x55e846d934c0 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fef97fff640 1 -- 10.20.193.28:0/1890431775 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefc0033020 con 0x55e846d934c0 2026-02-20T13:17:28.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.402+0000 7fef97fff640 1 -- 10.20.193.28:0/1890431775 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc002ed00 con 0x55e846d934c0 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 -- 10.20.193.28:0/1890431775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 msgr2=0x55e846d978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d978b0 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=18138214996466391643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc0011b10 tx=0x7fefc002b000 comp rx=0 tx=0).stop 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 -- 10.20.193.28:0/1890431775 shutdown_connections 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846dd4700 0x55e846da9c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846db3de0 0x55e846dac6f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/1890431775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d978b0 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=18138214996466391643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 -- 10.20.193.28:0/1890431775 >> 10.20.193.28:0/1890431775 conn(0x55e846cb21c0 msgr2=0x55e846dabfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 -- 10.20.193.28:0/1890431775 shutdown_connections 2026-02-20T13:17:28.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 -- 10.20.193.28:0/1890431775 wait complete. 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 -- start start 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.403+0000 7fefdcfbce00 1 Processor -- start 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d889f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846db3de0 0x55e846d89090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefdcfbce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846dd4700 0x55e846d89b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e846d9ea20 con 0x55e846d934c0 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e846dad0f0 con 0x55e846dd4700 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefdcfbce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e846d8a2f0 con 0x55e846db3de0 2026-02-20T13:17:28.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846db3de0 0x55e846d89090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd8e42640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846dd4700 0x55e846d89b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d889f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55756/0 (socket says 10.20.193.28:55756) 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd8e42640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846dd4700 0x55e846d89b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51448/0 (socket says 10.20.193.28:51448) 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 -- 10.20.193.28:0/4038451110 learned_addr learned my addr 10.20.193.28:0/4038451110 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 -- 10.20.193.28:0/4038451110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846db3de0 msgr2=0x55e846d89090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846db3de0 0x55e846d89090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 -- 10.20.193.28:0/4038451110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846dd4700 msgr2=0x55e846d89b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846dd4700 0x55e846d89b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 -- 10.20.193.28:0/4038451110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e846c22da0 con 0x55e846d934c0 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd8e42640 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846dd4700 0x55e846d89b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:28.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefd3fff640 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d889f0 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=11085836816442734265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc000f970 tx=0x7fefc0011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d8cdd96a0436b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fef95ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fef95ffb640 1 -- 10.20.193.28:0/4038451110 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc0021040 con 0x55e846d934c0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fef95ffb640 1 -- 10.20.193.28:0/4038451110 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e84693e520 con 0x55e846d934c0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fef95ffb640 1 -- 10.20.193.28:0/4038451110 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefc0002ae0 con 0x55e846d934c0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.404+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd4171fc0 con 0x55e846d934c0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fef95ffb640 1 -- 10.20.193.28:0/4038451110 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 7977+0+0 (secure 0 0 0) 0x7fefc0034060 con 0x55e846d934c0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 10 client.15507 _ll_register_callbacks cb 0x55e846c29a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e846d4eca0 con 0x55e846d934c0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fef95ffb640 1 -- 10.20.193.28:0/4038451110 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fefc002ea20 con 0x55e846d934c0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 10 client.15507 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e846c2f0f0 con 0x55e846d934c0 2026-02-20T13:17:28.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fef95ffb640 1 -- 10.20.193.28:0/4038451110 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fefc003f070 con 0x55e846d934c0 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 10 client.15507 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 20 client.15507 populate_metadata read hostname 'trial028' 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e846d8bf30 0x55e846d8c3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 4 client.15507 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e846982640 con 0x55e846d8bf30 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.405+0000 7fefd37fe640 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e846d8bf30 0x55e846d8c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.406+0000 7fefd37fe640 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e846d8bf30 0x55e846d8c3d0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=7361978138433048264 s_cookie=10104842451658844443 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=662b001c897e4ec8 server_cookie=8c3b9cac0a69a91b in_seq=0 out_seq=0 2026-02-20T13:17:28.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.406+0000 7fef95ffb640 10 client.15507 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:28.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fef95ffb640 1 -- 10.20.193.28:0/4038451110 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e846982640 con 0x55e846d8bf30 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fef95ffb640 10 client.15507 handle_command_reply: tid=0 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 client.15507 shutdown 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 msgr2=0x55e846d889f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d889f0 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=11085836816442734265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc000f970 tx=0x7fefc0011bb0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 shutdown_connections 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e846d8bf30 0x55e846d8c3d0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=7361978138433048264 s_cookie=10104842451658844443 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e846dd4700 0x55e846d89b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fef95ffb640 0 client.15507 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e846db3de0 0x55e846d89090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 --2- 10.20.193.28:0/4038451110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e846d934c0 0x55e846d889f0 unknown :-1 s=CLOSED pgs=380 gs=1 cs=0 l=1 c_cookie=11085836816442734265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 >> 10.20.193.28:0/4038451110 conn(0x55e846cb21c0 msgr2=0x55e846dac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:28.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 shutdown_connections 2026-02-20T13:17:28.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 1 -- 10.20.193.28:0/4038451110 wait complete. 2026-02-20T13:17:28.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefdcfbce00 20 client.15507 trim_cache size 0 max 16384 2026-02-20T13:17:28.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:17:28.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:17:28.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:17:28.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:17:28.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 -- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefa80b57f0 msgr2=0x7fefa80d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefa80b57f0 0x7fefa80d5ca0 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc0005b30 tx=0x7fefc0009310 comp rx=0 tx=0).stop 2026-02-20T13:17:28.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 -- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110ce0 msgr2=0x7fefd40f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:28.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110ce0 0x7fefd40f9090 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefc800f940 tx=0x7fefc800fe10 comp rx=0 tx=0).stop 2026-02-20T13:17:28.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 -- 10.20.193.28:0/2119024897 shutdown_connections 2026-02-20T13:17:28.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefa80b57f0 0x7fefa80d5ca0 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefd4110ce0 0x7fefd40f9090 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefd4110330 0x7fefd4171650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 --2- 10.20.193.28:0/2119024897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefd410f1a0 0x7fefd40f8850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:28.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.411+0000 7fefda8cc640 1 -- 10.20.193.28:0/2119024897 >> 10.20.193.28:0/2119024897 conn(0x7fefd40ec8f0 msgr2=0x7fefd40eee90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:28.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.412+0000 7fefda8cc640 1 -- 10.20.193.28:0/2119024897 shutdown_connections 2026-02-20T13:17:28.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:28.412+0000 7fefda8cc640 1 -- 10.20.193.28:0/2119024897 wait complete. 2026-02-20T13:17:28.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:28 trial127 ceph-mon[43817]: pgmap v183: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2026-02-20T13:17:28.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:28 trial034 ceph-mon[43332]: pgmap v183: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2026-02-20T13:17:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:28 trial028 ceph-mon[37442]: pgmap v183: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2026-02-20T13:17:30.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:30 trial127 ceph-mon[43817]: pgmap v184: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:17:30.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:30 trial034 ceph-mon[43332]: pgmap v184: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:17:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:30 trial028 ceph-mon[37442]: pgmap v184: 97 pgs: 97 active+clean; 671 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:17:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:17:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:31 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:17:31.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:31 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:17:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:31.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:31 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:32.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:32 trial127 ceph-mon[43817]: pgmap v185: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2026-02-20T13:17:32.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:32.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:32 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:32.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:32 trial034 ceph-mon[43332]: pgmap v185: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2026-02-20T13:17:32.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:32.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:32 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:32 trial028 ceph-mon[37442]: pgmap v185: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2026-02-20T13:17:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:32 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:33.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:17:33.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:17:33.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:33.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:17:33.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:17:33.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:17:33.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:33.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:17:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:17:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:17:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:17:33.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:17:34.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:34 trial127 ceph-mon[43817]: pgmap v186: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2026-02-20T13:17:34.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:34 trial034 ceph-mon[43332]: pgmap v186: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2026-02-20T13:17:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:34 trial028 ceph-mon[37442]: pgmap v186: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2026-02-20T13:17:36.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:36 trial127 ceph-mon[43817]: pgmap v187: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2026-02-20T13:17:36.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:36 trial034 ceph-mon[43332]: pgmap v187: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2026-02-20T13:17:36.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:36 trial028 ceph-mon[37442]: pgmap v187: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2026-02-20T13:17:37.671 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-20T13:17:37.671 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2026-02-20T13:17:37.672 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:37.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-20T13:17:37.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2026-02-20T13:17:37.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-20T13:17:37.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]} : dispatch 2026-02-20T13:17:37.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2026-02-20T13:17:37.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2026-02-20T13:17:37.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-20T13:17:37.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2026-02-20T13:17:37.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-20T13:17:37.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2026-02-20T13:17:37.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-20T13:17:37.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]} : dispatch 2026-02-20T13:17:37.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2026-02-20T13:17:37.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2026-02-20T13:17:37.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-20T13:17:37.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2026-02-20T13:17:37.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-20T13:17:37.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2026-02-20T13:17:37.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-20T13:17:37.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]} : dispatch 2026-02-20T13:17:37.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2026-02-20T13:17:37.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2026-02-20T13:17:37.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-20T13:17:37.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2026-02-20T13:17:37.863 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:38.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.048+0000 7f3f8c882640 1 -- 10.20.193.28:0/1385708896 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f8810dc30 msgr2=0x7f3f88112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.048+0000 7f3f8c882640 1 --2- 10.20.193.28:0/1385708896 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f8810dc30 0x7f3f88112c80 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=12268217859505052129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f78009950 tx=0x7f3f7802f1b0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.049+0000 7f3f8c882640 1 -- 10.20.193.28:0/1385708896 shutdown_connections 2026-02-20T13:17:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.049+0000 7f3f8c882640 1 --2- 10.20.193.28:0/1385708896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f88113430 0x7f3f88173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.049+0000 7f3f8c882640 1 --2- 10.20.193.28:0/1385708896 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f8810dc30 0x7f3f88112c80 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=12268217859505052129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.049+0000 7f3f8c882640 1 --2- 10.20.193.28:0/1385708896 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f8810d240 0x7f3f8810d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.049+0000 7f3f8c882640 1 -- 10.20.193.28:0/1385708896 >> 10.20.193.28:0/1385708896 conn(0x7f3f880eaad0 msgr2=0x7f3f8810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.049+0000 7f3f8c882640 1 -- 10.20.193.28:0/1385708896 shutdown_connections 2026-02-20T13:17:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.049+0000 7f3f8c882640 1 -- 10.20.193.28:0/1385708896 wait complete. 2026-02-20T13:17:38.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.050+0000 7f3f8c882640 1 Processor -- start 2026-02-20T13:17:38.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.050+0000 7f3f8c882640 1 -- start start 2026-02-20T13:17:38.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f8c882640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f8810d240 0x7f3f880f9c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f8c882640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f8810dc30 0x7f3f88173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f8810d240 0x7f3f880f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f8c882640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f88113430 0x7f3f880fa380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f8c882640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3f880ff540 con 0x7f3f8810dc30 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f8c882640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3f880ff6b0 con 0x7f3f88113430 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f8c882640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3f880ff870 con 0x7f3f8810d240 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f8810d240 0x7f3f880f9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34916/0 (socket says 10.20.193.28:34916) 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.051+0000 7f3f877fe640 1 -- 10.20.193.28:0/673992978 learned_addr learned my addr 10.20.193.28:0/673992978 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f86ffd640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f8810dc30 0x7f3f88173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f87fff640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f88113430 0x7f3f880fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f877fe640 1 -- 10.20.193.28:0/673992978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f88113430 msgr2=0x7f3f880fa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f877fe640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f88113430 0x7f3f880fa380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f877fe640 1 -- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f8810dc30 msgr2=0x7f3f88173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f877fe640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f8810dc30 0x7f3f88173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f877fe640 1 -- 10.20.193.28:0/673992978 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c00a590 con 0x7f3f8810d240 2026-02-20T13:17:38.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f87fff640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f88113430 0x7f3f880fa380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:38.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f877fe640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f8810d240 0x7f3f880f9c80 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f74009480 tx=0x7f3f7400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:38.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.052+0000 7f3f84ff9640 1 -- 10.20.193.28:0/673992978 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f7400cd40 con 0x7f3f8810d240 2026-02-20T13:17:38.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.053+0000 7f3f84ff9640 1 -- 10.20.193.28:0/673992978 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f74004d30 con 0x7f3f8810d240 2026-02-20T13:17:38.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.053+0000 7f3f84ff9640 1 -- 10.20.193.28:0/673992978 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f740106b0 con 0x7f3f8810d240 2026-02-20T13:17:38.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.053+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f78009570 con 0x7f3f8810d240 2026-02-20T13:17:38.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.053+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f880ffe40 con 0x7f3f8810d240 2026-02-20T13:17:38.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.053+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8810e520 con 0x7f3f8810d240 2026-02-20T13:17:38.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.055+0000 7f3f84ff9640 1 -- 10.20.193.28:0/673992978 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f3f7401f060 con 0x7f3f8810d240 2026-02-20T13:17:38.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.057+0000 7f3f84ff9640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f5c0b57e0 0x7f3f5c0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.057+0000 7f3f86ffd640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f5c0b57e0 0x7f3f5c0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.058+0000 7f3f84ff9640 1 -- 10.20.193.28:0/673992978 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8217+0+0 (secure 0 0 0) 0x7f3f74014070 con 0x7f3f8810d240 2026-02-20T13:17:38.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.058+0000 7f3f84ff9640 1 -- 10.20.193.28:0/673992978 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f3f740e7330 con 0x7f3f8810d240 2026-02-20T13:17:38.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.058+0000 7f3f86ffd640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f5c0b57e0 0x7f3f5c0d5c90 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f780023d0 tx=0x7f3f78031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:38.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.205+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f880fad90 con 0x7f3f8810d240 2026-02-20T13:17:38.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.206+0000 7f3f84ff9640 1 -- 10.20.193.28:0/673992978 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12003 (secure 0 0 0) 0x7f3f740a98c0 con 0x7f3f8810d240 2026-02-20T13:17:38.209 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:38.210 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T13:17:23:438313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:23.339303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:17:38.211 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T13:17:38.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.207+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f5c0b57e0 msgr2=0x7f3f5c0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.207+0000 7f3f8c882640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f5c0b57e0 0x7f3f5c0d5c90 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f780023d0 tx=0x7f3f78031040 comp rx=0 tx=0).stop 2026-02-20T13:17:38.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.207+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f8810d240 msgr2=0x7f3f880f9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.207+0000 7f3f8c882640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f8810d240 0x7f3f880f9c80 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f74009480 tx=0x7f3f7400ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:38.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.208+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 shutdown_connections 2026-02-20T13:17:38.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.208+0000 7f3f8c882640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f5c0b57e0 0x7f3f5c0d5c90 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.208+0000 7f3f8c882640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f8810dc30 0x7f3f88173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.208+0000 7f3f8c882640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f88113430 0x7f3f880fa380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.208+0000 7f3f8c882640 1 --2- 10.20.193.28:0/673992978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f8810d240 0x7f3f880f9c80 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.208+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 >> 10.20.193.28:0/673992978 conn(0x7f3f880eaad0 msgr2=0x7f3f8810fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:38.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.208+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 shutdown_connections 2026-02-20T13:17:38.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.208+0000 7f3f8c882640 1 -- 10.20.193.28:0/673992978 wait complete. 2026-02-20T13:17:38.312 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2026-02-20T13:17:38.312 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2026-02-20T13:17:38.505 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:38.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: pgmap v188: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2026-02-20T13:17:38.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-20T13:17:38.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2026-02-20T13:17:38.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-20T13:17:38.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2026-02-20T13:17:38.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2026-02-20T13:17:38.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2026-02-20T13:17:38.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-20T13:17:38.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2026-02-20T13:17:38.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: osdmap e79: 12 total, 12 up, 12 in 2026-02-20T13:17:38.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:38 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/673992978' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:38.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.701+0000 7f82cf930640 1 -- 10.20.193.28:0/3527101639 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c81135c0 msgr2=0x7f82c8173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.701+0000 7f82cf930640 1 --2- 10.20.193.28:0/3527101639 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c81135c0 0x7f82c8173f90 secure :-1 s=READY pgs=381 gs=2 cs=0 l=1 c_cookie=1125222425819117026 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82c400a970 tx=0x7f82c40301b0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.702+0000 7f82cf930640 1 -- 10.20.193.28:0/3527101639 shutdown_connections 2026-02-20T13:17:38.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.702+0000 7f82cf930640 1 --2- 10.20.193.28:0/3527101639 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c81135c0 0x7f82c8173f90 unknown :-1 s=CLOSED pgs=381 gs=2 cs=0 l=1 c_cookie=1125222425819117026 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.702+0000 7f82cf930640 1 --2- 10.20.193.28:0/3527101639 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82c810ddc0 0x7f82c8112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.702+0000 7f82cf930640 1 --2- 10.20.193.28:0/3527101639 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82c810d3d0 0x7f82c810d7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.702+0000 7f82cf930640 1 -- 10.20.193.28:0/3527101639 >> 10.20.193.28:0/3527101639 conn(0x7f82c80eacc0 msgr2=0x7f82c810b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:38.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.702+0000 7f82cf930640 1 -- 10.20.193.28:0/3527101639 shutdown_connections 2026-02-20T13:17:38.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.702+0000 7f82cf930640 1 -- 10.20.193.28:0/3527101639 wait complete. 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.703+0000 7f82cf930640 1 Processor -- start 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.703+0000 7f82cf930640 1 -- start start 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.703+0000 7f82cf930640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82c810d3d0 0x7f82c80f58d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cf930640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c810ddc0 0x7f82c8173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cf930640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82c81135c0 0x7f82c80f5fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cf930640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80fb1e0 con 0x7f82c810ddc0 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cf930640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80fb350 con 0x7f82c810d3d0 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cf930640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80fb510 con 0x7f82c81135c0 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cdea6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82c81135c0 0x7f82c80f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cdea6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82c81135c0 0x7f82c80f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34930/0 (socket says 10.20.193.28:34930) 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cdea6640 1 -- 10.20.193.28:0/2232451488 learned_addr learned my addr 10.20.193.28:0/2232451488 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82ccea4640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c810ddc0 0x7f82c8173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82c810d3d0 0x7f82c80f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cdea6640 1 -- 10.20.193.28:0/2232451488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82c810d3d0 msgr2=0x7f82c80f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cdea6640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82c810d3d0 0x7f82c80f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cdea6640 1 -- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c810ddc0 msgr2=0x7f82c8173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cdea6640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c810ddc0 0x7f82c8173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.704+0000 7f82cdea6640 1 -- 10.20.193.28:0/2232451488 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b8009570 con 0x7f82c81135c0 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.705+0000 7f82ccea4640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c810ddc0 0x7f82c8173e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:38.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.705+0000 7f82cdea6640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82c81135c0 0x7f82c80f5fd0 secure :-1 s=READY pgs=116 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82c400a2e0 tx=0x7f82c4030d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:38.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.705+0000 7f82b67fc640 1 -- 10.20.193.28:0/2232451488 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82c4005610 con 0x7f82c81135c0 2026-02-20T13:17:38.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.705+0000 7f82b67fc640 1 -- 10.20.193.28:0/2232451488 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82c4005770 con 0x7f82c81135c0 2026-02-20T13:17:38.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.705+0000 7f82b67fc640 1 -- 10.20.193.28:0/2232451488 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82c4042a60 con 0x7f82c81135c0 2026-02-20T13:17:38.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.705+0000 7f82cf930640 1 -- 10.20.193.28:0/2232451488 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c400a590 con 0x7f82c81135c0 2026-02-20T13:17:38.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.706+0000 7f82cf930640 1 -- 10.20.193.28:0/2232451488 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c80fba20 con 0x7f82c81135c0 2026-02-20T13:17:38.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.709+0000 7f82b67fc640 1 -- 10.20.193.28:0/2232451488 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f82c4042bf0 con 0x7f82c81135c0 2026-02-20T13:17:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.710+0000 7f82b67fc640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82a40b5860 0x7f82a40d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.711+0000 7f82b67fc640 1 -- 10.20.193.28:0/2232451488 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f82c410cdf0 con 0x7f82c81135c0 2026-02-20T13:17:38.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.711+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82a40b5860 0x7f82a40d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.711+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82a40b5860 0x7f82a40d5d10 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82b8005b30 tx=0x7f82b8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:38.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.716+0000 7f82d192ae00 1 Processor -- start 2026-02-20T13:17:38.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.716+0000 7f82d192ae00 1 -- start start 2026-02-20T13:17:38.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.716+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a7332b8c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.716+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332fd8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.716+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a73331e1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.716+0000 7f82d192ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a7331cd780 con 0x55a7332b8850 2026-02-20T13:17:38.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.716+0000 7f82d192ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a7331c94b0 con 0x55a7332fde00 2026-02-20T13:17:38.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.716+0000 7f82d192ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a7331c3610 con 0x55a7332b9160 2026-02-20T13:17:38.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cdea6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a73331e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cdea6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a73331e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39524/0 (socket says 10.20.193.28:39524) 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cdea6640 1 -- 10.20.193.28:0/4051568831 learned_addr learned my addr 10.20.193.28:0/4051568831 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82ccea4640 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a7332b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cdea6640 1 -- 10.20.193.28:0/4051568831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 msgr2=0x55a7332fd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cdea6640 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332fd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cdea6640 1 -- 10.20.193.28:0/4051568831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 msgr2=0x55a7332b8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cdea6640 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a7332b8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cdea6640 1 -- 10.20.193.28:0/4051568831 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a73316ec50 con 0x55a7332fde00 2026-02-20T13:17:38.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.717+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a7332b8c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:38.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.718+0000 7f82cdea6640 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a73331e1e0 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=12723778918257843412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82c4033040 tx=0x7f82c4039f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b093f1833f5cdcd4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:38.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.718+0000 7f8295ce5640 1 -- 10.20.193.28:0/4051568831 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82c40d2900 con 0x55a7332fde00 2026-02-20T13:17:38.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.718+0000 7f8295ce5640 1 -- 10.20.193.28:0/4051568831 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82c40d3b00 con 0x55a7332fde00 2026-02-20T13:17:38.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.718+0000 7f8295ce5640 1 -- 10.20.193.28:0/4051568831 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82c40d4010 con 0x55a7332fde00 2026-02-20T13:17:38.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.719+0000 7f82d192ae00 1 -- 10.20.193.28:0/4051568831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 msgr2=0x55a73331e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.719+0000 7f82d192ae00 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a73331e1e0 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=12723778918257843412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82c4033040 tx=0x7f82c4039f70 comp rx=0 tx=0).stop 2026-02-20T13:17:38.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.719+0000 7f82d192ae00 1 -- 10.20.193.28:0/4051568831 shutdown_connections 2026-02-20T13:17:38.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.719+0000 7f82d192ae00 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a73331e1e0 unknown :-1 s=CLOSED pgs=147 gs=1 cs=0 l=1 c_cookie=12723778918257843412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.719+0000 7f82d192ae00 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332fd8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.720+0000 7f82d192ae00 1 --2- 10.20.193.28:0/4051568831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a7332b8c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.720+0000 7f82d192ae00 1 -- 10.20.193.28:0/4051568831 >> 10.20.193.28:0/4051568831 conn(0x55a7331d6110 msgr2=0x55a7332b7130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.720+0000 7f82d192ae00 1 -- 10.20.193.28:0/4051568831 shutdown_connections 2026-02-20T13:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.720+0000 7f82d192ae00 1 -- 10.20.193.28:0/4051568831 wait complete. 2026-02-20T13:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.721+0000 7f82d192ae00 1 -- start start 2026-02-20T13:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.721+0000 7f82d192ae00 1 Processor -- start 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.722+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b8850 0x55a7332d9540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.722+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b9160 0x55a7332d9a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.722+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332fde00 0x55a7332de590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.722+0000 7f82d192ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a7332da3a0 con 0x55a7332fde00 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.722+0000 7f82d192ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a7332dead0 con 0x55a7332b9160 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82d192ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a7332dec90 con 0x55a7332b8850 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82cd6a5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b8850 0x55a7332d9540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82ccea4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b9160 0x55a7332d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82ccea4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b9160 0x55a7332d9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39528/0 (socket says 10.20.193.28:39528) 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82ccea4640 1 -- 10.20.193.28:0/1977162086 learned_addr learned my addr 10.20.193.28:0/1977162086 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:38.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82cdea6640 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332fde00 0x55a7332de590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82ccea4640 1 -- 10.20.193.28:0/1977162086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b8850 msgr2=0x55a7332d9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82ccea4640 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b8850 0x55a7332d9540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82ccea4640 1 -- 10.20.193.28:0/1977162086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332fde00 msgr2=0x55a7332de590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82ccea4640 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332fde00 0x55a7332de590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82ccea4640 1 -- 10.20.193.28:0/1977162086 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80fba20 con 0x55a7332b9160 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.723+0000 7f82cdea6640 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332fde00 0x55a7332de590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f82ccea4640 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b9160 0x55a7332d9a80 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=9407274320499070395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82bc0092a0 tx=0x7f82bc009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=828d5a27120055bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f8282ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f8282ffd640 1 -- 10.20.193.28:0/1977162086 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82bc016070 con 0x55a7332b9160 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f8282ffd640 1 -- 10.20.193.28:0/1977162086 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82bc011e10 con 0x55a7332b9160 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b8002db0 con 0x55a7332b9160 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f8282ffd640 1 -- 10.20.193.28:0/1977162086 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82bc01a640 con 0x55a7332b9160 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f8282ffd640 1 -- 10.20.193.28:0/1977162086 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f82bc01a7d0 con 0x55a7332b9160 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f82d192ae00 10 client.25499 _ll_register_callbacks cb 0x55a733144320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a732e59eb0 con 0x55a7332b9160 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f8282ffd640 1 -- 10.20.193.28:0/1977162086 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f82bc010e90 con 0x55a7332b9160 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f82d192ae00 10 client.25499 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.724+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a733146e60 con 0x55a7332b9160 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f8282ffd640 1 -- 10.20.193.28:0/1977162086 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f82bc022060 con 0x55a7332b9160 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f82d192ae00 10 client.25499 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f82d192ae00 10 client.25499 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f82d192ae00 20 client.25499 populate_metadata read hostname 'trial028' 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a7332e3660 0x55a7332e3b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f82d192ae00 4 client.25499 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a733195700 con 0x55a7332e3660 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a7332e3660 0x55a7332e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a7332e3660 0x55a7332e3b00 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=16732181054117382943 s_cookie=2826055901632064344 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e834a60490300b1f server_cookie=27382ade942ceb58 in_seq=0 out_seq=0 2026-02-20T13:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.725+0000 7f8282ffd640 10 client.25499 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:38.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: pgmap v188: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2026-02-20T13:17:38.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-20T13:17:38.731 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2026-02-20T13:17:38.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-20T13:17:38.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2026-02-20T13:17:38.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2026-02-20T13:17:38.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2026-02-20T13:17:38.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-20T13:17:38.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2026-02-20T13:17:38.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: osdmap e79: 12 total, 12 up, 12 in 2026-02-20T13:17:38.732 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:38 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/673992978' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f8282ffd640 1 -- 10.20.193.28:0/1977162086 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a733195700 con 0x55a7332e3660 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f8282ffd640 10 client.25499 handle_command_reply: tid=0 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 client.25499 shutdown 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b9160 msgr2=0x55a7332d9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b9160 0x55a7332d9a80 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=9407274320499070395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82bc0092a0 tx=0x7f82bc009920 comp rx=0 tx=0).stop 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 shutdown_connections 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a7332e3660 0x55a7332e3b00 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=16732181054117382943 s_cookie=2826055901632064344 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332fde00 0x55a7332de590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b9160 0x55a7332d9a80 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=9407274320499070395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1977162086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b8850 0x55a7332d9540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 >> 10.20.193.28:0/1977162086 conn(0x55a7331d6110 msgr2=0x55a7332a0240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:38.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f8282ffd640 0 client.25499 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:38.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 shutdown_connections 2026-02-20T13:17:38.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.726+0000 7f82d192ae00 1 -- 10.20.193.28:0/1977162086 wait complete. 2026-02-20T13:17:38.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.727+0000 7f82d192ae00 20 client.25499 trim_cache size 0 max 16384 2026-02-20T13:17:38.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.736+0000 7f82d192ae00 1 Processor -- start 2026-02-20T13:17:38.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.736+0000 7f82d192ae00 1 -- start start 2026-02-20T13:17:38.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.736+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a733297040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.736+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332b7220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.736+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a7332b7760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.736+0000 7f82d192ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a7331c1240 con 0x55a7332b8850 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.736+0000 7f82d192ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a732e81ec0 con 0x55a7332fde00 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.736+0000 7f82d192ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a7331c3610 con 0x55a7332b9160 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332b7220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34946/0 (socket says 10.20.193.28:34946) 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 -- 10.20.193.28:0/1529385140 learned_addr learned my addr 10.20.193.28:0/1529385140 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a733297040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82cdea6640 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a7332b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: pgmap v188: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2026-02-20T13:17:38.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-20T13:17:38.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2026-02-20T13:17:38.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-20T13:17:38.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2026-02-20T13:17:38.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2026-02-20T13:17:38.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2026-02-20T13:17:38.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-20T13:17:38.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2026-02-20T13:17:38.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: osdmap e79: 12 total, 12 up, 12 in 2026-02-20T13:17:38.742 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:38 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/673992978' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:38.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 -- 10.20.193.28:0/1529385140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 msgr2=0x55a7332b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:38.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a7332b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 -- 10.20.193.28:0/1529385140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 msgr2=0x55a733297040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a733297040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 -- 10.20.193.28:0/1529385140 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7332aac40 con 0x55a7332b9160 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82cdea6640 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a7332b7760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82ccea4640 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332b7220 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=18215806683233564127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82bc00ef20 tx=0x7f82bc020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fccb8baabb52b5df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82954e4640 1 -- 10.20.193.28:0/1529385140 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82bc016070 con 0x55a7332b9160 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82954e4640 1 -- 10.20.193.28:0/1529385140 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55a732e59eb0 con 0x55a7332b9160 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.737+0000 7f82954e4640 1 -- 10.20.193.28:0/1529385140 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82bc025d60 con 0x55a7332b9160 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 -- 10.20.193.28:0/1529385140 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 msgr2=0x55a7332b7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332b7220 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=18215806683233564127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82bc00ef20 tx=0x7f82bc020000 comp rx=0 tx=0).stop 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 -- 10.20.193.28:0/1529385140 shutdown_connections 2026-02-20T13:17:38.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332fde00 0x55a7332b7760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332b9160 0x55a7332b7220 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=18215806683233564127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 --2- 10.20.193.28:0/1529385140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b8850 0x55a733297040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 -- 10.20.193.28:0/1529385140 >> 10.20.193.28:0/1529385140 conn(0x55a7331d6110 msgr2=0x55a733296930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 -- 10.20.193.28:0/1529385140 shutdown_connections 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.738+0000 7f82d192ae00 1 -- 10.20.193.28:0/1529385140 wait complete. 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82d192ae00 1 -- start start 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82d192ae00 1 Processor -- start 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b8850 0x55a7332f28c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b9160 0x55a7332f2e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82d192ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332fde00 0x55a7332f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82d192ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a7332f52e0 con 0x55a7332b9160 2026-02-20T13:17:38.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82d192ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a7332f5450 con 0x55a7332b8850 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82d192ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a7332f5610 con 0x55a7332fde00 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82cd6a5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b8850 0x55a7332f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82cd6a5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b8850 0x55a7332f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39544/0 (socket says 10.20.193.28:39544) 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82cd6a5640 1 -- 10.20.193.28:0/388176462 learned_addr learned my addr 10.20.193.28:0/388176462 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.739+0000 7f82ccea4640 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b9160 0x55a7332f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82cdea6640 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332fde00 0x55a7332f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82cd6a5640 1 -- 10.20.193.28:0/388176462 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332fde00 msgr2=0x55a7332f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332fde00 0x55a7332f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82cd6a5640 1 -- 10.20.193.28:0/388176462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b9160 msgr2=0x55a7332f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b9160 0x55a7332f2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82cd6a5640 1 -- 10.20.193.28:0/388176462 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a733158d80 con 0x55a7332b8850 2026-02-20T13:17:38.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82cd6a5640 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b8850 0x55a7332f28c0 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=3008874447025033549 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82b8004740 tx=0x7f82b80047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c1ab5e2cad514d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:38.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f8282ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f8282ffd640 1 -- 10.20.193.28:0/388176462 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82b8025040 con 0x55a7332b8850 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f8282ffd640 1 -- 10.20.193.28:0/388176462 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82b802c4f0 con 0x55a7332b8850 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f8282ffd640 1 -- 10.20.193.28:0/388176462 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82b801f7d0 con 0x55a7332b8850 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a733146e60 con 0x55a7332b8850 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82d192ae00 10 client.25505 _ll_register_callbacks cb 0x55a733144320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.740+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82c40d3b00 con 0x55a7332b8850 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f8282ffd640 1 -- 10.20.193.28:0/388176462 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f82b801f930 con 0x55a7332b8850 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f8282ffd640 1 -- 10.20.193.28:0/388176462 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f82b801fb10 con 0x55a7332b8850 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82d192ae00 10 client.25505 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a733153800 con 0x55a7332b8850 2026-02-20T13:17:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f8282ffd640 1 -- 10.20.193.28:0/388176462 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f82b801a040 con 0x55a7332b8850 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82d192ae00 10 client.25505 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82d192ae00 10 client.25505 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82d192ae00 20 client.25505 populate_metadata read hostname 'trial028' 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82d192ae00 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a7333b3dc0 0x55a7333d4270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82d192ae00 4 client.25505 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55a732ea2a60 con 0x55a7333b3dc0 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.741+0000 7f82ccea4640 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a7333b3dc0 0x55a7333d4270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.742+0000 7f82ccea4640 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a7333b3dc0 0x55a7333d4270 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=2267139178708309190 s_cookie=8707741202802145109 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f767f123b4794c6 server_cookie=78d81c7d050df755 in_seq=0 out_seq=0 2026-02-20T13:17:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.742+0000 7f8282ffd640 10 client.25505 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:38.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.747+0000 7f8282ffd640 1 -- 10.20.193.28:0/388176462 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a732ea2a60 con 0x55a7333b3dc0 2026-02-20T13:17:38.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.747+0000 7f8282ffd640 10 client.25505 handle_command_reply: tid=0 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.747+0000 7f82d192ae00 1 client.25505 shutdown 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.747+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b8850 msgr2=0x55a7332f28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.747+0000 7f82d192ae00 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b8850 0x55a7332f28c0 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=3008874447025033549 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82b8004740 tx=0x7f82b80047e0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 shutdown_connections 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a7333b3dc0 0x55a7333d4270 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=2267139178708309190 s_cookie=8707741202802145109 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a7332b9160 0x55a7332f2e60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a7332fde00 0x55a7332f4cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 1 --2- 10.20.193.28:0/388176462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a7332b8850 0x55a7332f28c0 unknown :-1 s=CLOSED pgs=149 gs=2 cs=0 l=1 c_cookie=3008874447025033549 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 >> 10.20.193.28:0/388176462 conn(0x55a7331d6110 msgr2=0x55a733297120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f8282ffd640 0 client.25505 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:38.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 shutdown_connections 2026-02-20T13:17:38.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 1 -- 10.20.193.28:0/388176462 wait complete. 2026-02-20T13:17:38.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82d192ae00 20 client.25505 trim_cache size 0 max 16384 2026-02-20T13:17:38.752 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:38.752 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 26, 2026-02-20T13:17:38.752 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:17:38.752 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 2, 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "e0340c26": { 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "version": 2, 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T13:17:38.753 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:38.754 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:38.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82cf930640 1 -- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82a40b5860 msgr2=0x7f82a40d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82cf930640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82a40b5860 0x7f82a40d5d10 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82b8005b30 tx=0x7f82b8009310 comp rx=0 tx=0).stop 2026-02-20T13:17:38.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82cf930640 1 -- 10.20.193.28:0/2232451488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82c81135c0 msgr2=0x7f82c80f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:38.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.748+0000 7f82cf930640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82c81135c0 0x7f82c80f5fd0 secure :-1 s=READY pgs=116 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82c400a2e0 tx=0x7f82c4030d70 comp rx=0 tx=0).stop 2026-02-20T13:17:38.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.749+0000 7f82cf930640 1 -- 10.20.193.28:0/2232451488 shutdown_connections 2026-02-20T13:17:38.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.749+0000 7f82cf930640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82a40b5860 0x7f82a40d5d10 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.749+0000 7f82cf930640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82c810ddc0 0x7f82c8173e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.749+0000 7f82cf930640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82c81135c0 0x7f82c80f5fd0 unknown :-1 s=CLOSED pgs=116 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.749+0000 7f82cf930640 1 --2- 10.20.193.28:0/2232451488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82c810d3d0 0x7f82c80f58d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:38.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.749+0000 7f82cf930640 1 -- 10.20.193.28:0/2232451488 >> 10.20.193.28:0/2232451488 conn(0x7f82c80eacc0 msgr2=0x7f82c810b880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:38.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.749+0000 7f82cf930640 1 -- 10.20.193.28:0/2232451488 shutdown_connections 2026-02-20T13:17:38.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:38.749+0000 7f82cf930640 1 -- 10.20.193.28:0/2232451488 wait complete. 2026-02-20T13:17:38.855 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e0340c26', quiesce took 1.2 seconds. Will release after: 28.8 2026-02-20T13:17:39.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:39 trial127 ceph-mon[43817]: osdmap e80: 12 total, 12 up, 12 in 2026-02-20T13:17:39.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:39 trial034 ceph-mon[43332]: osdmap e80: 12 total, 12 up, 12 in 2026-02-20T13:17:39.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:39 trial028 ceph-mon[37442]: osdmap e80: 12 total, 12 up, 12 in 2026-02-20T13:17:40.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:40 trial127 ceph-mon[43817]: pgmap v191: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 10 op/s 2026-02-20T13:17:40.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:40 trial034 ceph-mon[43332]: pgmap v191: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 10 op/s 2026-02-20T13:17:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:40 trial028 ceph-mon[37442]: pgmap v191: 97 pgs: 97 active+clean; 675 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 10 op/s 2026-02-20T13:17:41.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.486+0000 7fcdd10cc640 1 -- 10.20.193.28:0/3549580724 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc10f1a0 msgr2=0x7fcdcc10f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.486+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/3549580724 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc10f1a0 0x7fcdcc10f590 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=12977997453489003980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc0009950 tx=0x7fcdc002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:41.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.487+0000 7fcdd10cc640 1 -- 10.20.193.28:0/3549580724 shutdown_connections 2026-02-20T13:17:41.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.487+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/3549580724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdcc110ce0 0x7fcdcc171670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.487+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/3549580724 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdcc110330 0x7fcdcc1107a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.487+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/3549580724 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc10f1a0 0x7fcdcc10f590 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=12977997453489003980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.487+0000 7fcdd10cc640 1 -- 10.20.193.28:0/3549580724 >> 10.20.193.28:0/3549580724 conn(0x7fcdcc0ec8f0 msgr2=0x7fcdcc10cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:41.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.487+0000 7fcdd10cc640 1 -- 10.20.193.28:0/3549580724 shutdown_connections 2026-02-20T13:17:41.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.487+0000 7fcdd10cc640 1 -- 10.20.193.28:0/3549580724 wait complete. 2026-02-20T13:17:41.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.487+0000 7fcdd10cc640 1 Processor -- start 2026-02-20T13:17:41.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdd10cc640 1 -- start start 2026-02-20T13:17:41.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdd10cc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdcc10f1a0 0x7fcdcc0f86c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdd10cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdcc110330 0x7fcdcc171670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdd10cc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc110ce0 0x7fcdcc0f8f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdd10cc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0f9b10 con 0x7fcdcc110330 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdd10cc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0f9c80 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdd10cc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0f9e40 con 0x7fcdcc110ce0 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdcad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdcc10f1a0 0x7fcdcc0f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdcad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdcc10f1a0 0x7fcdcc0f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59064/0 (socket says 10.20.193.28:59064) 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdcad76640 1 -- 10.20.193.28:0/1273195873 learned_addr learned my addr 10.20.193.28:0/1273195873 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdcb577640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc110ce0 0x7fcdcc0f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.488+0000 7fcdca575640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdcc110330 0x7fcdcc171670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdcad76640 1 -- 10.20.193.28:0/1273195873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc110ce0 msgr2=0x7fcdcc0f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdcad76640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc110ce0 0x7fcdcc0f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdcad76640 1 -- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdcc110330 msgr2=0x7fcdcc171670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdcad76640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdcc110330 0x7fcdcc171670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdcad76640 1 -- 10.20.193.28:0/1273195873 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc00a590 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdcb577640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc110ce0 0x7fcdcc0f8f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdcad76640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdcc10f1a0 0x7fcdcc0f86c0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc002f6a0 tx=0x7fcdc00028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdabfff640 1 -- 10.20.193.28:0/1273195873 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc003d070 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdabfff640 1 -- 10.20.193.28:0/1273195873 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdc00043d0 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdabfff640 1 -- 10.20.193.28:0/1273195873 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc0041ba0 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdd10cc640 1 -- 10.20.193.28:0/1273195873 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc0009570 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.489+0000 7fcdd10cc640 1 -- 10.20.193.28:0/1273195873 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc0fa350 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.492+0000 7fcdabfff640 1 -- 10.20.193.28:0/1273195873 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fcdc0038920 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.497 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.494+0000 7fcdabfff640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcda00b57f0 0x7fcda00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.497 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.494+0000 7fcdabfff640 1 -- 10.20.193.28:0/1273195873 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdc010b4a0 con 0x7fcdcc10f1a0 2026-02-20T13:17:41.497 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.494+0000 7fcdca575640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcda00b57f0 0x7fcda00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.494+0000 7fcdd36c9e00 1 Processor -- start 2026-02-20T13:17:41.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.494+0000 7fcdca575640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcda00b57f0 0x7fcda00d5ca0 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdb4004740 tx=0x7fcdb4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:41.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.494+0000 7fcdd36c9e00 1 -- start start 2026-02-20T13:17:41.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b314c0 0x556b29b518a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b51de0 0x556b29b721c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b92ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556b29a46fd0 con 0x556b29b51de0 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556b29a42d00 con 0x556b29b314c0 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556b29a3cca0 con 0x556b29b72700 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b51de0 0x556b29b721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b51de0 0x556b29b721c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48056/0 (socket says 10.20.193.28:48056) 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 -- 10.20.193.28:0/2552212475 learned_addr learned my addr 10.20.193.28:0/2552212475 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdcad76640 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b314c0 0x556b29b518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdcb577640 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b92ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 -- 10.20.193.28:0/2552212475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 msgr2=0x556b29b92ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b92ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 -- 10.20.193.28:0/2552212475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b314c0 msgr2=0x556b29b518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b314c0 0x556b29b518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 -- 10.20.193.28:0/2552212475 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b299df8b0 con 0x556b29b51de0 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.495+0000 7fcdca575640 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b51de0 0x556b29b721c0 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=17590040519636792600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdb4004220 tx=0x7fcdb4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41c60a815adb518 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcda93fe640 1 -- 10.20.193.28:0/2552212475 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdb4011e60 con 0x556b29b51de0 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcda93fe640 1 -- 10.20.193.28:0/2552212475 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdb4009da0 con 0x556b29b51de0 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcda93fe640 1 -- 10.20.193.28:0/2552212475 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdb401a6e0 con 0x556b29b51de0 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2552212475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b51de0 msgr2=0x556b29b721c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b51de0 0x556b29b721c0 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=17590040519636792600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdb4004220 tx=0x7fcdb4014000 comp rx=0 tx=0).stop 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2552212475 shutdown_connections 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b51de0 0x556b29b721c0 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=17590040519636792600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b92ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2552212475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b314c0 0x556b29b518a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2552212475 >> 10.20.193.28:0/2552212475 conn(0x556b29a501c0 msgr2=0x556b29b2fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:41.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2552212475 shutdown_connections 2026-02-20T13:17:41.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.496+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2552212475 wait complete. 2026-02-20T13:17:41.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.497+0000 7fcdd36c9e00 1 -- start start 2026-02-20T13:17:41.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdd36c9e00 1 Processor -- start 2026-02-20T13:17:41.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b4a950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b4afa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b4ba00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556b29b4c060 con 0x556b29b314c0 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556b29b4c1d0 con 0x556b29b51de0 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556b29b4c390 con 0x556b29b72700 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdcb577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b4ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdcb577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b4ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49526/0 (socket says 10.20.193.28:49526) 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdcb577640 1 -- 10.20.193.28:0/2562637190 learned_addr learned my addr 10.20.193.28:0/2562637190 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdca575640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b4afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.498+0000 7fcdcad76640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b4a950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdcb577640 1 -- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 msgr2=0x556b29b4afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:41.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdcb577640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b4afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdcb577640 1 -- 10.20.193.28:0/2562637190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 msgr2=0x556b29b4a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdcb577640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b4a950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdcb577640 1 -- 10.20.193.28:0/2562637190 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b299e8400 con 0x556b29b72700 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdca575640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b4afa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdcad76640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b4a950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdcb577640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b4ba00 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=17333880766403528211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdbc003a00 tx=0x7fcdbc003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f08e50b7dc754613 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcd94bfc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcd94bfc640 1 -- 10.20.193.28:0/2562637190 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdbc018070 con 0x556b29b72700 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb4009970 con 0x556b29b72700 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcd94bfc640 1 -- 10.20.193.28:0/2562637190 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdbc013b50 con 0x556b29b72700 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcd94bfc640 1 -- 10.20.193.28:0/2562637190 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdbc01d6a0 con 0x556b29b72700 2026-02-20T13:17:41.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdd36c9e00 10 client.25474 _ll_register_callbacks cb 0x556b299c7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcd94bfc640 1 -- 10.20.193.28:0/2562637190 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdbc0103c0 con 0x556b29b72700 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.499+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b296dc520 con 0x556b29b72700 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcd94bfc640 1 -- 10.20.193.28:0/2562637190 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcdbc013cc0 con 0x556b29b72700 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdd36c9e00 10 client.25474 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x556b299c0da0 con 0x556b29b72700 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcd94bfc640 1 -- 10.20.193.28:0/2562637190 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fcdbc005850 con 0x556b29b72700 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdd36c9e00 10 client.25474 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdd36c9e00 10 client.25474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdd36c9e00 20 client.25474 populate_metadata read hostname 'trial028' 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556b29b4f160 0x556b29b4f600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdd36c9e00 4 client.25474 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b29a6e630 con 0x556b29b4f160 2026-02-20T13:17:41.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.500+0000 7fcdcad76640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556b29b4f160 0x556b29b4f600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.501+0000 7fcdcad76640 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556b29b4f160 0x556b29b4f600 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=16707048570696817542 s_cookie=7839024881236886378 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7db5c284594db86 server_cookie=6cc9cf98b792c36a in_seq=0 out_seq=0 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.501+0000 7fcd94bfc640 10 client.25474 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.501+0000 7fcd94bfc640 1 -- 10.20.193.28:0/2562637190 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556b29a6e630 con 0x556b29b4f160 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.501+0000 7fcd94bfc640 10 client.25474 handle_command_reply: tid=0 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.501+0000 7fcdd36c9e00 1 client.25474 shutdown 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.501+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 msgr2=0x556b29b4ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.501+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b4ba00 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=17333880766403528211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdbc003a00 tx=0x7fcdbc003ed0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 shutdown_connections 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556b29b4f160 0x556b29b4f600 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=16707048570696817542 s_cookie=7839024881236886378 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b72700 0x556b29b4ba00 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=17333880766403528211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b4afa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2562637190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b4a950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 >> 10.20.193.28:0/2562637190 conn(0x556b29a501c0 msgr2=0x556b29b32790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:41.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcd94bfc640 0 client.25474 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:41.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 shutdown_connections 2026-02-20T13:17:41.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2562637190 wait complete. 2026-02-20T13:17:41.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.502+0000 7fcdd36c9e00 20 client.25474 trim_cache size 0 max 16384 2026-02-20T13:17:41.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.510+0000 7fcdd36c9e00 1 Processor -- start 2026-02-20T13:17:41.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.510+0000 7fcdd36c9e00 1 -- start start 2026-02-20T13:17:41.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.510+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b314c0 0x556b29b3c7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.510+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b714c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.510+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b72700 0x556b29b71a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.510+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556b29a3a8d0 con 0x556b29b72700 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.510+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556b2977bf10 con 0x556b29b51de0 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.510+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556b29b0c810 con 0x556b29b314c0 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b314c0 0x556b29b3c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b72700 0x556b29b71a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b314c0 0x556b29b3c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49536/0 (socket says 10.20.193.28:49536) 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 -- 10.20.193.28:0/2855481794 learned_addr learned my addr 10.20.193.28:0/2855481794 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdca575640 1 --2- 10.20.193.28:0/2855481794 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 -- 10.20.193.28:0/2855481794 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 msgr2=0x556b29b714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 --2- 10.20.193.28:0/2855481794 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 -- 10.20.193.28:0/2855481794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b72700 msgr2=0x556b29b71a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 --2- 10.20.193.28:0/2855481794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b72700 0x556b29b71a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 -- 10.20.193.28:0/2855481794 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b29b3cfb0 con 0x556b29b314c0 2026-02-20T13:17:41.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcdcad76640 1 --2- 10.20.193.28:0/2855481794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b314c0 0x556b29b3c7e0 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=13170909285371702255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc0108fc0 tx=0x7fcdc000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c878366b796bef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:41.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcda8bfd640 1 -- 10.20.193.28:0/2855481794 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc00bb030 con 0x556b29b314c0 2026-02-20T13:17:41.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcda8bfd640 1 -- 10.20.193.28:0/2855481794 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdc00d74d0 con 0x556b29b314c0 2026-02-20T13:17:41.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.511+0000 7fcda8bfd640 1 -- 10.20.193.28:0/2855481794 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc00d72f0 con 0x556b29b314c0 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2855481794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b314c0 msgr2=0x556b29b3c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2855481794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b314c0 0x556b29b3c7e0 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=13170909285371702255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc0108fc0 tx=0x7fcdc000b040 comp rx=0 tx=0).stop 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2855481794 shutdown_connections 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2855481794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b72700 0x556b29b71a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2855481794 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b51de0 0x556b29b714c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/2855481794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b314c0 0x556b29b3c7e0 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=13170909285371702255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2855481794 >> 10.20.193.28:0/2855481794 conn(0x556b29a501c0 msgr2=0x556b29b70db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2855481794 shutdown_connections 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/2855481794 wait complete. 2026-02-20T13:17:41.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.512+0000 7fcdd36c9e00 1 -- start start 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdd36c9e00 1 Processor -- start 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b53760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b51de0 0x556b29b53e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdd36c9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b72700 0x556b29b54900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556b29b3cd80 con 0x556b29b314c0 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556b29b0c810 con 0x556b29b72700 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdd36c9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556b29b55060 con 0x556b29b51de0 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdca575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b51de0 0x556b29b53e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdca575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b51de0 0x556b29b53e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49540/0 (socket says 10.20.193.28:49540) 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdca575640 1 -- 10.20.193.28:0/953030834 learned_addr learned my addr 10.20.193.28:0/953030834 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdcad76640 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b53760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.513+0000 7fcdcb577640 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b72700 0x556b29b54900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdcad76640 1 -- 10.20.193.28:0/953030834 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b51de0 msgr2=0x556b29b53e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdcad76640 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b51de0 0x556b29b53e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdcad76640 1 -- 10.20.193.28:0/953030834 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b72700 msgr2=0x556b29b54900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdcad76640 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b72700 0x556b29b54900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdcad76640 1 -- 10.20.193.28:0/953030834 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b299d2670 con 0x556b29b314c0 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdca575640 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b51de0 0x556b29b53e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdcad76640 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b53760 secure :-1 s=READY pgs=383 gs=2 cs=0 l=1 c_cookie=18302534700223535315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc002ffd0 tx=0x7fcdc002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdffaa56c01598d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcd94bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcd94bfc640 1 -- 10.20.193.28:0/953030834 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc010b2d0 con 0x556b29b314c0 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcd94bfc640 1 -- 10.20.193.28:0/953030834 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdc010b2d0 con 0x556b29b314c0 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc0fa350 con 0x556b29b314c0 2026-02-20T13:17:41.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdd36c9e00 10 client.15546 _ll_register_callbacks cb 0x556b299c7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b29aecca0 con 0x556b29b314c0 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcd94bfc640 1 -- 10.20.193.28:0/953030834 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc00d14d0 con 0x556b29b314c0 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcd94bfc640 1 -- 10.20.193.28:0/953030834 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdc00d1660 con 0x556b29b314c0 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcd94bfc640 1 -- 10.20.193.28:0/953030834 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcdc00dc460 con 0x556b29b314c0 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdd36c9e00 10 client.15546 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.514+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x556b299cd0f0 con 0x556b29b314c0 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcd94bfc640 1 -- 10.20.193.28:0/953030834 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fcdc00cf840 con 0x556b29b314c0 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcdd36c9e00 10 client.15546 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcdd36c9e00 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcdd36c9e00 20 client.15546 populate_metadata read hostname 'trial028' 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556b29b56c20 0x556b29b570c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:41.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcdd36c9e00 4 client.15546 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:17:41.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556b29720640 con 0x556b29b56c20 2026-02-20T13:17:41.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcdca575640 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556b29b56c20 0x556b29b570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:41.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcdca575640 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556b29b56c20 0x556b29b570c0 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=10137744441393802702 s_cookie=16757214161954468963 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cb080db7cf7edce server_cookie=e88d957f2c70f463 in_seq=0 out_seq=0 2026-02-20T13:17:41.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.515+0000 7fcd94bfc640 10 client.15546 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:41.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcd94bfc640 1 -- 10.20.193.28:0/953030834 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556b29720640 con 0x556b29b56c20 2026-02-20T13:17:41.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcd94bfc640 10 client.15546 handle_command_reply: tid=0 2026-02-20T13:17:41.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 client.15546 shutdown 2026-02-20T13:17:41.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 msgr2=0x556b29b53760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b53760 secure :-1 s=READY pgs=383 gs=2 cs=0 l=1 c_cookie=18302534700223535315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc002ffd0 tx=0x7fcdc002f190 comp rx=0 tx=0).stop 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 shutdown_connections 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556b29b56c20 0x556b29b570c0 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=10137744441393802702 s_cookie=16757214161954468963 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556b29b72700 0x556b29b54900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556b29b51de0 0x556b29b53e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 --2- 10.20.193.28:0/953030834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b29b314c0 0x556b29b53760 unknown :-1 s=CLOSED pgs=383 gs=2 cs=0 l=1 c_cookie=18302534700223535315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 >> 10.20.193.28:0/953030834 conn(0x556b29a501c0 msgr2=0x556b29b714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcd94bfc640 0 client.15546 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 shutdown_connections 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 1 -- 10.20.193.28:0/953030834 wait complete. 2026-02-20T13:17:41.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.520+0000 7fcdd36c9e00 20 client.15546 trim_cache size 0 max 16384 2026-02-20T13:17:41.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:17:41.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:17:41.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:17:41.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 -- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcda00b57f0 msgr2=0x7fcda00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcda00b57f0 0x7fcda00d5ca0 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdb4004740 tx=0x7fcdb4005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 -- 10.20.193.28:0/1273195873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdcc10f1a0 msgr2=0x7fcdcc0f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdcc10f1a0 0x7fcdcc0f86c0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc002f6a0 tx=0x7fcdc00028d0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 -- 10.20.193.28:0/1273195873 shutdown_connections 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcda00b57f0 0x7fcda00d5ca0 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdcc110330 0x7fcdcc171670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdcc110ce0 0x7fcdcc0f8f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 --2- 10.20.193.28:0/1273195873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdcc10f1a0 0x7fcdcc0f86c0 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:41.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 -- 10.20.193.28:0/1273195873 >> 10.20.193.28:0/1273195873 conn(0x7fcdcc0ec8f0 msgr2=0x7fcdcc0ee820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:41.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 -- 10.20.193.28:0/1273195873 shutdown_connections 2026-02-20T13:17:41.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:41.521+0000 7fcdd10cc640 1 -- 10.20.193.28:0/1273195873 wait complete. 2026-02-20T13:17:42.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:42 trial127 ceph-mon[43817]: pgmap v192: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 767 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:42.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:42 trial034 ceph-mon[43332]: pgmap v192: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 767 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:42 trial028 ceph-mon[37442]: pgmap v192: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 767 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:44.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:44 trial127 ceph-mon[43817]: pgmap v193: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:44.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:44 trial034 ceph-mon[43332]: pgmap v193: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:44.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:44 trial028 ceph-mon[37442]: pgmap v193: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:46.228 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:17:46.425 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:46.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:46 trial028 ceph-mon[37442]: pgmap v194: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:46.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 -- 10.20.193.28:0/473822917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab2410f5f0 msgr2=0x7fab2410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 --2- 10.20.193.28:0/473822917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab2410f5f0 0x7fab2410f9c0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=16795151172661831718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab18009950 tx=0x7fab1802f190 comp rx=0 tx=0).stop 2026-02-20T13:17:46.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 -- 10.20.193.28:0/473822917 shutdown_connections 2026-02-20T13:17:46.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 --2- 10.20.193.28:0/473822917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab2410ffe0 0x7fab24115030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 --2- 10.20.193.28:0/473822917 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab241157e0 0x7fab241761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 --2- 10.20.193.28:0/473822917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab2410f5f0 0x7fab2410f9c0 unknown :-1 s=CLOSED pgs=121 gs=1 cs=0 l=1 c_cookie=16795151172661831718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 -- 10.20.193.28:0/473822917 >> 10.20.193.28:0/473822917 conn(0x7fab240ecea0 msgr2=0x7fab2410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:46.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 -- 10.20.193.28:0/473822917 shutdown_connections 2026-02-20T13:17:46.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.626+0000 7fab29025640 1 -- 10.20.193.28:0/473822917 wait complete. 2026-02-20T13:17:46.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.627+0000 7fab29025640 1 Processor -- start 2026-02-20T13:17:46.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.627+0000 7fab29025640 1 -- start start 2026-02-20T13:17:46.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab29025640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab2410f5f0 0x7fab2411d5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab29025640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab2410ffe0 0x7fab2411daf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab29025640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab241157e0 0x7fab24122ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab29025640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab241234e0 con 0x7fab241157e0 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab29025640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fab24123650 con 0x7fab2410f5f0 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab29025640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fab24123810 con 0x7fab2410ffe0 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab2410f5f0 0x7fab2411d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab2410f5f0 0x7fab2411d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59116/0 (socket says 10.20.193.28:59116) 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22d76640 1 -- 10.20.193.28:0/659540047 learned_addr learned my addr 10.20.193.28:0/659540047 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22575640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab2410ffe0 0x7fab2411daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab23577640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab241157e0 0x7fab24122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22d76640 1 -- 10.20.193.28:0/659540047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab2410ffe0 msgr2=0x7fab2411daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22d76640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab2410ffe0 0x7fab2411daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22d76640 1 -- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab241157e0 msgr2=0x7fab24122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22d76640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab241157e0 0x7fab24122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab22d76640 1 -- 10.20.193.28:0/659540047 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab18009570 con 0x7fab2410f5f0 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.628+0000 7fab23577640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab241157e0 0x7fab24122ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.629+0000 7fab22d76640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab2410f5f0 0x7fab2411d5b0 secure :-1 s=READY pgs=151 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab18005b30 tx=0x7fab18004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.629+0000 7fab03fff640 1 -- 10.20.193.28:0/659540047 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab1803d070 con 0x7fab2410f5f0 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.629+0000 7fab03fff640 1 -- 10.20.193.28:0/659540047 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fab18038920 con 0x7fab2410f5f0 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.629+0000 7fab03fff640 1 -- 10.20.193.28:0/659540047 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab180418a0 con 0x7fab2410f5f0 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.629+0000 7fab29025640 1 -- 10.20.193.28:0/659540047 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab24123a90 con 0x7fab2410f5f0 2026-02-20T13:17:46.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.629+0000 7fab29025640 1 -- 10.20.193.28:0/659540047 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab24164050 con 0x7fab2410f5f0 2026-02-20T13:17:46.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.631+0000 7fab03fff640 1 -- 10.20.193.28:0/659540047 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fab18048020 con 0x7fab2410f5f0 2026-02-20T13:17:46.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.633+0000 7fab03fff640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faaf80b57f0 0x7faaf80d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.634+0000 7fab22575640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faaf80b57f0 0x7faaf80d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.634+0000 7fab03fff640 1 -- 10.20.193.28:0/659540047 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fab1810bf40 con 0x7fab2410f5f0 2026-02-20T13:17:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.634+0000 7fab22575640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faaf80b57f0 0x7faaf80d5ca0 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab24123f50 tx=0x7fab0c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.636+0000 7fab2b01fe00 1 Processor -- start 2026-02-20T13:17:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.636+0000 7fab2b01fe00 1 -- start start 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.636+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a48c550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.636+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4d1400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.636+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a4d1940 0x55ab2a4f1d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.636+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a3a27d0 con 0x55ab2a48ca90 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.636+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a39e500 con 0x55ab2a4d1940 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.636+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a3984a0 con 0x55ab2a48c180 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48122/0 (socket says 10.20.193.28:48122) 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 -- 10.20.193.28:0/968518046 learned_addr learned my addr 10.20.193.28:0/968518046 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab23577640 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a4d1940 0x55ab2a4f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a48c550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 -- 10.20.193.28:0/968518046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 msgr2=0x55ab2a48c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a48c550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 -- 10.20.193.28:0/968518046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a4d1940 msgr2=0x55ab2a4f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a4d1940 0x55ab2a4f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 -- 10.20.193.28:0/968518046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab2a343d80 con 0x55ab2a48ca90 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22d76640 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a48c550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.637+0000 7fab22575640 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4d1400 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=4523508810149186473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab0c007960 tx=0x7fab0c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec6bb4bd74acba9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7faaef7fe640 1 -- 10.20.193.28:0/968518046 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab0c011d50 con 0x55ab2a48ca90 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7faaef7fe640 1 -- 10.20.193.28:0/968518046 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fab0c015070 con 0x55ab2a48ca90 2026-02-20T13:17:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7faaef7fe640 1 -- 10.20.193.28:0/968518046 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab0c01d8c0 con 0x55ab2a48ca90 2026-02-20T13:17:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7fab2b01fe00 1 -- 10.20.193.28:0/968518046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 msgr2=0x55ab2a4d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4d1400 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=4523508810149186473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab0c007960 tx=0x7fab0c013000 comp rx=0 tx=0).stop 2026-02-20T13:17:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7fab2b01fe00 1 -- 10.20.193.28:0/968518046 shutdown_connections 2026-02-20T13:17:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4d1400 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=4523508810149186473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a4d1940 0x55ab2a4f1d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/968518046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a48c550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7fab2b01fe00 1 -- 10.20.193.28:0/968518046 >> 10.20.193.28:0/968518046 conn(0x55ab2a46a680 msgr2=0x55ab2a48aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.638+0000 7fab2b01fe00 1 -- 10.20.193.28:0/968518046 shutdown_connections 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.639+0000 7fab2b01fe00 1 -- 10.20.193.28:0/968518046 wait complete. 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.640+0000 7fab2b01fe00 1 -- start start 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.640+0000 7fab2b01fe00 1 Processor -- start 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.640+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4a47a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.640+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.640+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 0x55ab2a4a9cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.640+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a4aa210 con 0x55ab2a4d1940 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.640+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a4aa380 con 0x55ab2a48ca90 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.640+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a4aa540 con 0x55ab2a48c180 2026-02-20T13:17:46.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49572/0 (socket says 10.20.193.28:49572) 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22d76640 1 -- 10.20.193.28:0/1381864483 learned_addr learned my addr 10.20.193.28:0/1381864483 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22575640 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab23577640 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 0x55ab2a4a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22d76640 1 -- 10.20.193.28:0/1381864483 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 msgr2=0x55ab2a4a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22d76640 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22d76640 1 -- 10.20.193.28:0/1381864483 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 msgr2=0x55ab2a4a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22d76640 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 0x55ab2a4a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab22d76640 1 -- 10.20.193.28:0/1381864483 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c007c50 con 0x55ab2a48c180 2026-02-20T13:17:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.641+0000 7fab23577640 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 0x55ab2a4a9cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:46.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7fab22d76640 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4a47a0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=13836536742489384807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab18004050 tx=0x7fab18038d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c00540dbb1b86767 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:46.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7faaecff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:46.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7faaecff9640 1 -- 10.20.193.28:0/1381864483 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab180d7f70 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7faaecff9640 1 -- 10.20.193.28:0/1381864483 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fab180da550 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7faaecff9640 1 -- 10.20.193.28:0/1381864483 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab180d3c40 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab24164050 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7fab2b01fe00 10 client.25492 _ll_register_callbacks cb 0x55ab2a3199a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab2a02e6f0 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.642+0000 7faaecff9640 1 -- 10.20.193.28:0/1381864483 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fab180d3da0 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7faaecff9640 1 -- 10.20.193.28:0/1381864483 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fab180dd390 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab2b01fe00 10 client.25492 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55ab2a31c350 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7faaecff9640 1 -- 10.20.193.28:0/1381864483 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fab18097410 con 0x55ab2a48c180 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab2b01fe00 10 client.25492 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab2b01fe00 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab2b01fe00 20 client.25492 populate_metadata read hostname 'trial028' 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab2a4ceef0 0x55ab2a4cf390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab2b01fe00 4 client.25492 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab2a3a5d60 con 0x55ab2a4ceef0 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.643+0000 7fab22575640 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab2a4ceef0 0x55ab2a4cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.644+0000 7fab22575640 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab2a4ceef0 0x55ab2a4cf390 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=3442616686423955052 s_cookie=9360775691492657149 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fc6a1a2f421d66c server_cookie=81e827e5598807fd in_seq=0 out_seq=0 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.644+0000 7faaecff9640 10 client.25492 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.644+0000 7faaecff9640 1 -- 10.20.193.28:0/1381864483 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ab2a3a5d60 con 0x55ab2a4ceef0 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.644+0000 7faaecff9640 10 client.25492 handle_command_reply: tid=0 2026-02-20T13:17:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.645+0000 7fab2b01fe00 1 client.25492 shutdown 2026-02-20T13:17:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 msgr2=0x55ab2a4a47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4a47a0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=13836536742489384807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab18004050 tx=0x7fab18038d90 comp rx=0 tx=0).stop 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 shutdown_connections 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab2a4ceef0 0x55ab2a4cf390 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=3442616686423955052 s_cookie=9360775691492657149 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 0x55ab2a4a9cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a4ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/1381864483 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4a47a0 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=13836536742489384807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 >> 10.20.193.28:0/1381864483 conn(0x55ab2a46a680 msgr2=0x55ab2a48b250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7faaecff9640 0 client.25492 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 shutdown_connections 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.646+0000 7fab2b01fe00 1 -- 10.20.193.28:0/1381864483 wait complete. 2026-02-20T13:17:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.647+0000 7fab2b01fe00 20 client.25492 trim_cache size 0 max 16384 2026-02-20T13:17:46.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab2b01fe00 1 Processor -- start 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab2b01fe00 1 -- start start 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4967a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a9240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 0x55ab2a4d0c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a3960d0 con 0x55ab2a4d1940 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a056700 con 0x55ab2a48ca90 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a4cd4c0 con 0x55ab2a48c180 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a9240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59140/0 (socket says 10.20.193.28:59140) 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22575640 1 -- 10.20.193.28:0/2772402131 learned_addr learned my addr 10.20.193.28:0/2772402131 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22575640 1 -- 10.20.193.28:0/2772402131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 msgr2=0x55ab2a4967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22575640 1 --2- 10.20.193.28:0/2772402131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22575640 1 -- 10.20.193.28:0/2772402131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 msgr2=0x55ab2a4d0c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22575640 1 --2- 10.20.193.28:0/2772402131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 0x55ab2a4d0c80 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.661+0000 7fab22575640 1 -- 10.20.193.28:0/2772402131 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab2a496f70 con 0x55ab2a48ca90 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7fab22575640 1 --2- 10.20.193.28:0/2772402131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a9240 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=13628440506137686087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab0c0076e0 tx=0x7fab0c0078f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd21f26f0ae1b047 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7faaeeffd640 1 -- 10.20.193.28:0/2772402131 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab0c011d50 con 0x55ab2a48ca90 2026-02-20T13:17:46.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7faaeeffd640 1 -- 10.20.193.28:0/2772402131 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fab0c02d040 con 0x55ab2a48ca90 2026-02-20T13:17:46.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7faaeeffd640 1 -- 10.20.193.28:0/2772402131 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab0c004d10 con 0x55ab2a48ca90 2026-02-20T13:17:46.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2772402131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 msgr2=0x55ab2a4a9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2772402131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a9240 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=13628440506137686087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab0c0076e0 tx=0x7fab0c0078f0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2772402131 shutdown_connections 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2772402131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a4d1940 0x55ab2a4d0c80 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2772402131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48ca90 0x55ab2a4a9240 unknown :-1 s=CLOSED pgs=152 gs=2 cs=0 l=1 c_cookie=13628440506137686087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.662+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2772402131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a48c180 0x55ab2a4967a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.663+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2772402131 >> 10.20.193.28:0/2772402131 conn(0x55ab2a46a680 msgr2=0x55ab2a4a8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.663+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2772402131 shutdown_connections 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.663+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2772402131 wait complete. 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.663+0000 7fab2b01fe00 1 -- start start 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab2b01fe00 1 Processor -- start 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48c180 0x55ab2a4ac210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4ac750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab2b01fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a4d1940 0x55ab2a4acc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a51f860 con 0x55ab2a48ca90 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a51f9d0 con 0x55ab2a48c180 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab2b01fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab2a530fa0 con 0x55ab2a4d1940 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab22d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48c180 0x55ab2a4ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab22d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48c180 0x55ab2a4ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59152/0 (socket says 10.20.193.28:59152) 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab22d76640 1 -- 10.20.193.28:0/2854221328 learned_addr learned my addr 10.20.193.28:0/2854221328 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab22575640 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab23577640 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a4d1940 0x55ab2a4acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab22d76640 1 -- 10.20.193.28:0/2854221328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a4d1940 msgr2=0x55ab2a4acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab22d76640 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a4d1940 0x55ab2a4acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.664+0000 7fab22d76640 1 -- 10.20.193.28:0/2854221328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 msgr2=0x55ab2a4ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7fab22d76640 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4ac750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7fab22d76640 1 -- 10.20.193.28:0/2854221328 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab2a32e150 con 0x55ab2a48c180 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7fab22d76640 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48c180 0x55ab2a4ac210 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=6881982862474536307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab180d44e0 tx=0x7fab18009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f81b6f37c1ee573 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7faaecff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7faaecff9640 1 -- 10.20.193.28:0/2854221328 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab180d2ee0 con 0x55ab2a48c180 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab2a343d80 con 0x55ab2a48c180 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7fab2b01fe00 10 client.25541 _ll_register_callbacks cb 0x55ab2a3199a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab2a0f04a0 con 0x55ab2a48c180 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7faaecff9640 1 -- 10.20.193.28:0/2854221328 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ab2a02e6f0 con 0x55ab2a48c180 2026-02-20T13:17:46.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.665+0000 7faaecff9640 1 -- 10.20.193.28:0/2854221328 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab180d2ee0 con 0x55ab2a48c180 2026-02-20T13:17:46.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7faaecff9640 1 -- 10.20.193.28:0/2854221328 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fab180da550 con 0x55ab2a48c180 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7faaecff9640 1 -- 10.20.193.28:0/2854221328 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fab180d3a00 con 0x55ab2a48c180 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab2b01fe00 10 client.25541 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55ab2a328bd0 con 0x55ab2a48c180 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7faaecff9640 1 -- 10.20.193.28:0/2854221328 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fab180d2530 con 0x55ab2a48c180 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab2b01fe00 10 client.25541 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab2b01fe00 10 client.25541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab2b01fe00 20 client.25541 populate_metadata read hostname 'trial028' 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab2a532670 0x55ab2a532b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab2b01fe00 4 client.25541 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fab0c015070 con 0x55ab2a532670 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.666+0000 7fab22575640 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab2a532670 0x55ab2a532b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:46.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab22575640 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab2a532670 0x55ab2a532b10 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=16125599411871126643 s_cookie=12823456038707626079 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc9a33a5ed39473 server_cookie=b1f611535c01805f in_seq=0 out_seq=0 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7faaecff9640 10 client.25541 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7faaecff9640 1 -- 10.20.193.28:0/2854221328 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7fab0c015070 con 0x55ab2a532670 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7faaecff9640 10 client.25541 handle_command_reply: tid=0 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 client.25541 shutdown 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48c180 msgr2=0x55ab2a4ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48c180 0x55ab2a4ac210 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=6881982862474536307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab180d44e0 tx=0x7fab18009310 comp rx=0 tx=0).stop 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 shutdown_connections 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab2a532670 0x55ab2a532b10 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=16125599411871126643 s_cookie=12823456038707626079 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab2a48ca90 0x55ab2a4ac750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab2a4d1940 0x55ab2a4acc90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 --2- 10.20.193.28:0/2854221328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab2a48c180 0x55ab2a4ac210 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=6881982862474536307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 >> 10.20.193.28:0/2854221328 conn(0x55ab2a46a680 msgr2=0x55ab2a4a9320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:46.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7faaecff9640 0 client.25541 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:46.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 shutdown_connections 2026-02-20T13:17:46.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 1 -- 10.20.193.28:0/2854221328 wait complete. 2026-02-20T13:17:46.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.667+0000 7fab2b01fe00 20 client.25541 trim_cache size 0 max 16384 2026-02-20T13:17:46.675 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:46.675 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:17:46.675 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:17:46.675 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:46.676 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 -- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faaf80b57f0 msgr2=0x7faaf80d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faaf80b57f0 0x7faaf80d5ca0 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab24123f50 tx=0x7fab0c0073d0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 -- 10.20.193.28:0/659540047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab2410f5f0 msgr2=0x7fab2411d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab2410f5f0 0x7fab2411d5b0 secure :-1 s=READY pgs=151 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab18005b30 tx=0x7fab18004340 comp rx=0 tx=0).stop 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 -- 10.20.193.28:0/659540047 shutdown_connections 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faaf80b57f0 0x7faaf80d5ca0 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fab241157e0 0x7fab24122ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab2410ffe0 0x7fab2411daf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 --2- 10.20.193.28:0/659540047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fab2410f5f0 0x7fab2411d5b0 unknown :-1 s=CLOSED pgs=151 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:46.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 -- 10.20.193.28:0/659540047 >> 10.20.193.28:0/659540047 conn(0x7fab240ecea0 msgr2=0x7fab2410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:46.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 -- 10.20.193.28:0/659540047 shutdown_connections 2026-02-20T13:17:46.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:46.668+0000 7fab29025640 1 -- 10.20.193.28:0/659540047 wait complete. 2026-02-20T13:17:46.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:46 trial034 ceph-mon[43332]: pgmap v194: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:46.777 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:17:46.777 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:17:46.973 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:46 trial127 ceph-mon[43817]: pgmap v194: 97 pgs: 97 active+clean; 680 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 22 B/s, 1 keys/s, 2 objects/s recovering 2026-02-20T13:17:47.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.162+0000 7f20a55d9640 1 -- 10.20.193.28:0/513979794 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f20a0119ba0 msgr2=0x7f20a017a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.162+0000 7f20a55d9640 1 --2- 10.20.193.28:0/513979794 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f20a0119ba0 0x7f20a017a570 secure :-1 s=READY pgs=154 gs=3 cs=0 l=1 c_cookie=7020503088497883243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f209400aa30 tx=0x7f2094030290 comp rx=0 tx=0).stop 2026-02-20T13:17:47.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.163+0000 7f20a55d9640 1 -- 10.20.193.28:0/513979794 shutdown_connections 2026-02-20T13:17:47.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.163+0000 7f20a55d9640 1 --2- 10.20.193.28:0/513979794 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f20a0119ba0 0x7f20a017a570 unknown :-1 s=CLOSED pgs=154 gs=3 cs=0 l=1 c_cookie=7020503088497883243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.163+0000 7f20a55d9640 1 --2- 10.20.193.28:0/513979794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20a0114990 0x7f20a01193f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.163+0000 7f20a55d9640 1 --2- 10.20.193.28:0/513979794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20a0113fa0 0x7f20a0114370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.163+0000 7f20a55d9640 1 -- 10.20.193.28:0/513979794 >> 10.20.193.28:0/513979794 conn(0x7f20a0064a90 msgr2=0x7f20a0064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.163+0000 7f20a55d9640 1 -- 10.20.193.28:0/513979794 shutdown_connections 2026-02-20T13:17:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.163+0000 7f20a55d9640 1 -- 10.20.193.28:0/513979794 wait complete. 2026-02-20T13:17:47.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.163+0000 7f20a55d9640 1 Processor -- start 2026-02-20T13:17:47.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f20a55d9640 1 -- start start 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f20a55d9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20a0113fa0 0x7f20a0122330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f20a55d9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f20a0114990 0x7f20a0122870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f20a55d9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20a0119ba0 0x7f20a0127c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f20a55d9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f20a0128260 con 0x7f20a0119ba0 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f20a55d9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01283d0 con 0x7f20a0114990 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f20a55d9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f20a0128590 con 0x7f20a0113fa0 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f209ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20a0113fa0 0x7f20a0122330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f209ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20a0113fa0 0x7f20a0122330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49608/0 (socket says 10.20.193.28:49608) 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f209ffff640 1 -- 10.20.193.28:0/3170361270 learned_addr learned my addr 10.20.193.28:0/3170361270 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:47.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f209f7fe640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f20a0114990 0x7f20a0122870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.164+0000 7f20a4dd8640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20a0119ba0 0x7f20a0127c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209ffff640 1 -- 10.20.193.28:0/3170361270 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f20a0114990 msgr2=0x7f20a0122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209ffff640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f20a0114990 0x7f20a0122870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209ffff640 1 -- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20a0119ba0 msgr2=0x7f20a0127c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209ffff640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20a0119ba0 0x7f20a0127c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209ffff640 1 -- 10.20.193.28:0/3170361270 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209400a650 con 0x7f20a0113fa0 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209ffff640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20a0113fa0 0x7f20a0122330 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f208c009480 tx=0x7f208c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209d7fa640 1 -- 10.20.193.28:0/3170361270 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f208c00cd40 con 0x7f20a0113fa0 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209d7fa640 1 -- 10.20.193.28:0/3170361270 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f208c004d30 con 0x7f20a0113fa0 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f209d7fa640 1 -- 10.20.193.28:0/3170361270 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f208c0106b0 con 0x7f20a0113fa0 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a0128870 con 0x7f20a0113fa0 2026-02-20T13:17:47.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.165+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a0168f70 con 0x7f20a0113fa0 2026-02-20T13:17:47.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.166+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2064005300 con 0x7f20a0113fa0 2026-02-20T13:17:47.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.168+0000 7f209d7fa640 1 -- 10.20.193.28:0/3170361270 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f208c01f060 con 0x7f20a0113fa0 2026-02-20T13:17:47.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.170+0000 7f209d7fa640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f20740b57f0 0x7f20740d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.170+0000 7f209d7fa640 1 -- 10.20.193.28:0/3170361270 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f208c014070 con 0x7f20a0113fa0 2026-02-20T13:17:47.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.170+0000 7f209d7fa640 1 -- 10.20.193.28:0/3170361270 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f208c11f730 con 0x7f20a0113fa0 2026-02-20T13:17:47.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.171+0000 7f209f7fe640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f20740b57f0 0x7f20740d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.171+0000 7f209f7fe640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f20740b57f0 0x7f20740d5ca0 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20a0128cd0 tx=0x7f2090005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:47.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.321+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2064005950 con 0x7f20a0113fa0 2026-02-20T13:17:47.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.321+0000 7f209d7fa640 1 -- 10.20.193.28:0/3170361270 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12003 (secure 0 0 0) 0x7f208c0a95d0 con 0x7f20a0113fa0 2026-02-20T13:17:47.326 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:17:47.326 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T13:17:23:438313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:23.339303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f20740b57f0 msgr2=0x7f20740d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f20740b57f0 0x7f20740d5ca0 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20a0128cd0 tx=0x7f2090005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20a0113fa0 msgr2=0x7f20a0122330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20a0113fa0 0x7f20a0122330 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f208c009480 tx=0x7f208c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 shutdown_connections 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f20740b57f0 0x7f20740d5ca0 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20a0119ba0 0x7f20a0127c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f20a0114990 0x7f20a0122870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 --2- 10.20.193.28:0/3170361270 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20a0113fa0 0x7f20a0122330 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 >> 10.20.193.28:0/3170361270 conn(0x7f20a0064a90 msgr2=0x7f20a0065e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:47.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 shutdown_connections 2026-02-20T13:17:47.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.323+0000 7f20a55d9640 1 -- 10.20.193.28:0/3170361270 wait complete. 2026-02-20T13:17:47.431 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:17:47.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:47 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3170361270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:47.622 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:47.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:47 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3170361270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:47.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 -- 10.20.193.28:0/2938789475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 msgr2=0x7f08981177d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 --2- 10.20.193.28:0/2938789475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 0x7f08981177d0 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=14133617265034616353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0888007520 tx=0x7f088802fd90 comp rx=0 tx=0).stop 2026-02-20T13:17:47.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 -- 10.20.193.28:0/2938789475 shutdown_connections 2026-02-20T13:17:47.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 --2- 10.20.193.28:0/2938789475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0898117f80 0x7f089817a960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 --2- 10.20.193.28:0/2938789475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 0x7f08981177d0 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=14133617265034616353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 --2- 10.20.193.28:0/2938789475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0898116990 0x7f0898116d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 -- 10.20.193.28:0/2938789475 >> 10.20.193.28:0/2938789475 conn(0x7f089805b8b0 msgr2=0x7f089805bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:47.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 -- 10.20.193.28:0/2938789475 shutdown_connections 2026-02-20T13:17:47.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.807+0000 7f089c8ec640 1 -- 10.20.193.28:0/2938789475 wait complete. 2026-02-20T13:17:47.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.808+0000 7f089c8ec640 1 Processor -- start 2026-02-20T13:17:47.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.808+0000 7f089c8ec640 1 -- start start 2026-02-20T13:17:47.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.808+0000 7f089c8ec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0898116990 0x7f08981006b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.808+0000 7f089c8ec640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 0x7f089817a8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.808+0000 7f089c8ec640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0898117f80 0x7f0898100e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.808+0000 7f089c8ec640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0898106000 con 0x7f0898116990 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.808+0000 7f089c8ec640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0898106170 con 0x7f0898117380 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.808+0000 7f089c8ec640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0898106330 con 0x7f0898117f80 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0896ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 0x7f089817a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0896ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 0x7f089817a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59186/0 (socket says 10.20.193.28:59186) 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0896ffd640 1 -- 10.20.193.28:0/114855328 learned_addr learned my addr 10.20.193.28:0/114855328 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:47.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0897fff640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0898117f80 0x7f0898100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f08977fe640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0898116990 0x7f08981006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0897fff640 1 -- 10.20.193.28:0/114855328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 msgr2=0x7f089817a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0897fff640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 0x7f089817a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0897fff640 1 -- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0898116990 msgr2=0x7f08981006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0897fff640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0898116990 0x7f08981006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f0897fff640 1 -- 10.20.193.28:0/114855328 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880071c0 con 0x7f0898117f80 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.809+0000 7f08977fe640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0898116990 0x7f08981006b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.810+0000 7f0897fff640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0898117f80 0x7f0898100e70 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f088c006c10 tx=0x7f088c00fde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.810+0000 7f0894ff9640 1 -- 10.20.193.28:0/114855328 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f088c00dda0 con 0x7f0898117f80 2026-02-20T13:17:47.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.810+0000 7f089c8ec640 1 -- 10.20.193.28:0/114855328 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0898106610 con 0x7f0898117f80 2026-02-20T13:17:47.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.810+0000 7f0894ff9640 1 -- 10.20.193.28:0/114855328 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f088c005e10 con 0x7f0898117f80 2026-02-20T13:17:47.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.810+0000 7f0894ff9640 1 -- 10.20.193.28:0/114855328 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f088c00dda0 con 0x7f0898117f80 2026-02-20T13:17:47.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.810+0000 7f089c8ec640 1 -- 10.20.193.28:0/114855328 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0898106ae0 con 0x7f0898117f80 2026-02-20T13:17:47.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.814+0000 7f0894ff9640 1 -- 10.20.193.28:0/114855328 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f088c020070 con 0x7f0898117f80 2026-02-20T13:17:47.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.816+0000 7f089fb6fe00 1 Processor -- start 2026-02-20T13:17:47.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.816+0000 7f0894ff9640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f086c0b5850 0x7f086c0d5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.816+0000 7f089fb6fe00 1 -- start start 2026-02-20T13:17:47.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.817+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155aa140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.817+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7155eeff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.817+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e71560f910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.817+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e7154b7780 con 0x55e7155aa680 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.817+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e7154b34b0 con 0x55e7155ef530 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.817+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e7154ad450 con 0x55e7155a9d70 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.817+0000 7f0896ffd640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f086c0b5850 0x7f086c0d5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.817+0000 7f0894ff9640 1 -- 10.20.193.28:0/114855328 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f088c015070 con 0x7f0898117f80 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e71560f910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e71560f910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59188/0 (socket says 10.20.193.28:59188) 2026-02-20T13:17:47.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 -- 10.20.193.28:0/4185765750 learned_addr learned my addr 10.20.193.28:0/4185765750 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f08977fe640 1 --2- 10.20.193.28:0/4185765750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 -- 10.20.193.28:0/4185765750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 msgr2=0x55e7155aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 --2- 10.20.193.28:0/4185765750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155aa140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 -- 10.20.193.28:0/4185765750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 msgr2=0x55e7155eeff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 --2- 10.20.193.28:0/4185765750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7155eeff0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 -- 10.20.193.28:0/4185765750 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e715458d10 con 0x55e7155ef530 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0897fff640 1 --2- 10.20.193.28:0/4185765750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e71560f910 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=8778079577938845957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f088c0054d0 tx=0x7f088c0adc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79d200de2d27e105 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.818+0000 7f0896ffd640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f086c0b5850 0x7f086c0d5d00 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0898107000 tx=0x7f088803b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f085bfff640 1 -- 10.20.193.28:0/4185765750 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f088c0ae4b0 con 0x55e7155ef530 2026-02-20T13:17:47.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f085bfff640 1 -- 10.20.193.28:0/4185765750 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f088c0b37d0 con 0x55e7155ef530 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f085bfff640 1 -- 10.20.193.28:0/4185765750 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f088c0af970 con 0x55e7155ef530 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 -- 10.20.193.28:0/4185765750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 msgr2=0x55e71560f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/4185765750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e71560f910 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=8778079577938845957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f088c0054d0 tx=0x7f088c0adc30 comp rx=0 tx=0).stop 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 -- 10.20.193.28:0/4185765750 shutdown_connections 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/4185765750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7155eeff0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/4185765750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e71560f910 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=8778079577938845957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/4185765750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155aa140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 -- 10.20.193.28:0/4185765750 >> 10.20.193.28:0/4185765750 conn(0x55e715588270 msgr2=0x55e7155a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 -- 10.20.193.28:0/4185765750 shutdown_connections 2026-02-20T13:17:47.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.819+0000 7f089fb6fe00 1 -- 10.20.193.28:0/4185765750 wait complete. 2026-02-20T13:17:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.821+0000 7f089fb6fe00 1 -- start start 2026-02-20T13:17:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.821+0000 7f089fb6fe00 1 Processor -- start 2026-02-20T13:17:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.821+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7156071b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.821+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7156076f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.821+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155ef530 0x55e71560c6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.821+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e71560cc20 con 0x55e7155aa680 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.821+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e71560cd90 con 0x55e7155a9d70 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.821+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e71560cf50 con 0x55e7155ef530 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7156071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7156071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59190/0 (socket says 10.20.193.28:59190) 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 -- 10.20.193.28:0/3972901359 learned_addr learned my addr 10.20.193.28:0/3972901359 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f0897fff640 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155ef530 0x55e71560c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 -- 10.20.193.28:0/3972901359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155ef530 msgr2=0x55e71560c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155ef530 0x55e71560c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 -- 10.20.193.28:0/3972901359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 msgr2=0x55e7156076f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7156076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 -- 10.20.193.28:0/3972901359 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7154313c0 con 0x55e7155a9d70 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08977fe640 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7156071b0 secure :-1 s=READY pgs=157 gs=2 cs=0 l=1 c_cookie=5605755905727840440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0884009fd0 tx=0x7f08840046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dcba54bb274c0b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08597fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08597fa640 1 -- 10.20.193.28:0/3972901359 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0884012990 con 0x55e7155a9d70 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08597fa640 1 -- 10.20.193.28:0/3972901359 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f088401b440 con 0x55e7155a9d70 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.822+0000 7f08597fa640 1 -- 10.20.193.28:0/3972901359 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0884010770 con 0x55e7155a9d70 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0898106ae0 con 0x55e7155a9d70 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f08597fa640 1 -- 10.20.193.28:0/3972901359 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0884012af0 con 0x55e7155a9d70 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 10 client.25559 _ll_register_callbacks cb 0x55e71542ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7151436f0 con 0x55e7155a9d70 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f08597fa640 1 -- 10.20.193.28:0/3972901359 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0884012cb0 con 0x55e7155a9d70 2026-02-20T13:17:47.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 10 client.25559 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e7154430e0 con 0x55e7155a9d70 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f08597fa640 1 -- 10.20.193.28:0/3972901359 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f08840108d0 con 0x55e7155a9d70 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 10 client.25559 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 10 client.25559 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 20 client.25559 populate_metadata read hostname 'trial028' 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55e71560f7b0 0x55e7155ed2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 4 client.25559 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.823+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e71544ff80 con 0x55e71560f7b0 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.824+0000 7f0896ffd640 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55e71560f7b0 0x55e7155ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.824+0000 7f0896ffd640 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55e71560f7b0 0x55e7155ed2b0 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=5387607524700124837 s_cookie=2787010911688413998 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4ac4a07fbaf8f6a5 server_cookie=26ad73a87053532e in_seq=0 out_seq=0 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.824+0000 7f08597fa640 10 client.25559 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f08597fa640 1 -- 10.20.193.28:0/3972901359 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e71544ff80 con 0x55e71560f7b0 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f08597fa640 10 client.25559 handle_command_reply: tid=0 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 client.25559 shutdown 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 msgr2=0x55e7156071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7156071b0 secure :-1 s=READY pgs=157 gs=2 cs=0 l=1 c_cookie=5605755905727840440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0884009fd0 tx=0x7f08840046d0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 shutdown_connections 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55e71560f7b0 0x55e7155ed2b0 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=5387607524700124837 s_cookie=2787010911688413998 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7156076f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155ef530 0x55e71560c6e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/3972901359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7156071b0 unknown :-1 s=CLOSED pgs=157 gs=2 cs=0 l=1 c_cookie=5605755905727840440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 >> 10.20.193.28:0/3972901359 conn(0x55e715588270 msgr2=0x55e7155a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f08597fa640 0 client.25559 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.825+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 shutdown_connections 2026-02-20T13:17:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.826+0000 7f089fb6fe00 1 -- 10.20.193.28:0/3972901359 wait complete. 2026-02-20T13:17:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.826+0000 7f089fb6fe00 20 client.25559 trim_cache size 0 max 16384 2026-02-20T13:17:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.833+0000 7f089fb6fe00 1 Processor -- start 2026-02-20T13:17:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.833+0000 7f089fb6fe00 1 -- start start 2026-02-20T13:17:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.833+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155ea190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.833+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7155ea6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e7156033c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e7154ab080 con 0x55e7155aa680 2026-02-20T13:17:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e71516b700 con 0x55e7155ef530 2026-02-20T13:17:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e71557c2e0 con 0x55e7155a9d70 2026-02-20T13:17:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155ea190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49656/0 (socket says 10.20.193.28:49656) 2026-02-20T13:17:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 -- 10.20.193.28:0/797656589 learned_addr learned my addr 10.20.193.28:0/797656589 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 -- 10.20.193.28:0/797656589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 msgr2=0x55e7156033c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:17:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 --2- 10.20.193.28:0/797656589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e7156033c0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 -- 10.20.193.28:0/797656589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 msgr2=0x55e7155ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f0896ffd640 1 --2- 10.20.193.28:0/797656589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7155ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 --2- 10.20.193.28:0/797656589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7155ea6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 -- 10.20.193.28:0/797656589 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71543db60 con 0x55e7155a9d70 2026-02-20T13:17:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f08977fe640 1 --2- 10.20.193.28:0/797656589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155ea190 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=17654466602685967604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f088400fca0 tx=0x7f088401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f50143d678182cf4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:47.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f085b7fe640 1 -- 10.20.193.28:0/797656589 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0884009d10 con 0x55e7155a9d70 2026-02-20T13:17:47.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f085b7fe640 1 -- 10.20.193.28:0/797656589 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e7151436f0 con 0x55e7155a9d70 2026-02-20T13:17:47.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.834+0000 7f085b7fe640 1 -- 10.20.193.28:0/797656589 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0884024770 con 0x55e7155a9d70 2026-02-20T13:17:47.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.835+0000 7f089fb6fe00 1 -- 10.20.193.28:0/797656589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 msgr2=0x55e7155ea190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.835+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/797656589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155ea190 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=17654466602685967604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f088400fca0 tx=0x7f088401f000 comp rx=0 tx=0).stop 2026-02-20T13:17:47.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.835+0000 7f089fb6fe00 1 -- 10.20.193.28:0/797656589 shutdown_connections 2026-02-20T13:17:47.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.835+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/797656589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155aa680 0x55e7155ea6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.835+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/797656589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155ef530 0x55e7156033c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.835+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/797656589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155a9d70 0x55e7155ea190 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=17654466602685967604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.835+0000 7f089fb6fe00 1 -- 10.20.193.28:0/797656589 >> 10.20.193.28:0/797656589 conn(0x55e715588270 msgr2=0x55e7155ed990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:47.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.835+0000 7f089fb6fe00 1 -- 10.20.193.28:0/797656589 shutdown_connections 2026-02-20T13:17:47.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.836+0000 7f089fb6fe00 1 -- 10.20.193.28:0/797656589 wait complete. 2026-02-20T13:17:47.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.836+0000 7f089fb6fe00 1 -- start start 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.836+0000 7f089fb6fe00 1 Processor -- start 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7155899c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155aa680 0x55e715589f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f089fb6fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155ef530 0x55e71558a440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f08977fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7155899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f08977fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7155899c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59220/0 (socket says 10.20.193.28:59220) 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f0896ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155aa680 0x55e715589f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f0896ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155aa680 0x55e715589f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49660/0 (socket says 10.20.193.28:49660) 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f089fb6fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e715655300 con 0x55e7155ef530 2026-02-20T13:17:47.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f08977fe640 1 -- 10.20.193.28:0/379526677 learned_addr learned my addr 10.20.193.28:0/379526677 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:47.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.837+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e715655470 con 0x55e7155a9d70 2026-02-20T13:17:47.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e715655630 con 0x55e7155aa680 2026-02-20T13:17:47.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f0897fff640 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155ef530 0x55e71558a440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f0896ffd640 1 -- 10.20.193.28:0/379526677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 msgr2=0x55e7155899c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:47.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f0896ffd640 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7155899c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f0896ffd640 1 -- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155ef530 msgr2=0x55e71558a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:47.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f0896ffd640 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155ef530 0x55e71558a440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f0896ffd640 1 -- 10.20.193.28:0/379526677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7154316f0 con 0x55e7155aa680 2026-02-20T13:17:47.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f0897fff640 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155ef530 0x55e71558a440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:47.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f0896ffd640 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155aa680 0x55e715589f00 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=6941510952260211839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55e715513c30 tx=0x7f0888005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6055336ef1f4147f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:47.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f08597fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:47.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.838+0000 7f08597fa640 1 -- 10.20.193.28:0/379526677 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0888052170 con 0x55e7155aa680 2026-02-20T13:17:47.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f08597fa640 1 -- 10.20.193.28:0/379526677 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0888049040 con 0x55e7155aa680 2026-02-20T13:17:47.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7154430e0 con 0x55e7155aa680 2026-02-20T13:17:47.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f08597fa640 1 -- 10.20.193.28:0/379526677 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0888052db0 con 0x55e7155aa680 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f08597fa640 1 -- 10.20.193.28:0/379526677 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f088803e070 con 0x55e7155aa680 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f08597fa640 10 client.25516 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f089fb6fe00 10 client.25516 _ll_register_callbacks cb 0x55e71542ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f088c0b37d0 con 0x55e7155aa680 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f08597fa640 1 -- 10.20.193.28:0/379526677 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f08880525e0 con 0x55e7155aa680 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f089fb6fe00 10 client.25516 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.839+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e715443340 con 0x55e7155aa680 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f08597fa640 1 -- 10.20.193.28:0/379526677 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f0888002810 con 0x55e7155aa680 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f089fb6fe00 10 client.25516 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:47.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f089fb6fe00 10 client.25516 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:17:47.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f089fb6fe00 20 client.25516 populate_metadata read hostname 'trial028' 2026-02-20T13:17:47.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55e71569d4f0 0x55e7156bd9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:47.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f089fb6fe00 4 client.25516 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:17:47.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e715140f40 con 0x55e71569d4f0 2026-02-20T13:17:47.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f08977fe640 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55e71569d4f0 0x55e7156bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:47.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f08977fe640 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55e71569d4f0 0x55e7156bd9a0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=1843029479576891995 s_cookie=3323941993128092620 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1993c18c00c0f25b server_cookie=2e2103a1ba6763cc in_seq=0 out_seq=0 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.840+0000 7f08597fa640 10 client.25516 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f08597fa640 1 -- 10.20.193.28:0/379526677 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e715140f40 con 0x55e71569d4f0 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f08597fa640 10 client.25516 handle_command_reply: tid=0 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 client.25516 shutdown 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155aa680 msgr2=0x55e715589f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155aa680 0x55e715589f00 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=6941510952260211839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55e715513c30 tx=0x7f0888005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 shutdown_connections 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55e71569d4f0 0x55e7156bd9a0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=1843029479576891995 s_cookie=3323941993128092620 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7155ef530 0x55e71558a440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e7155aa680 0x55e715589f00 unknown :-1 s=CLOSED pgs=126 gs=2 cs=0 l=1 c_cookie=6941510952260211839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 --2- 10.20.193.28:0/379526677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e7155a9d70 0x55e7155899c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f08597fa640 0 client.25516 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:17:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 >> 10.20.193.28:0/379526677 conn(0x55e715588270 msgr2=0x55e7155ee180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 shutdown_connections 2026-02-20T13:17:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 1 -- 10.20.193.28:0/379526677 wait complete. 2026-02-20T13:17:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.841+0000 7f089fb6fe00 20 client.25516 trim_cache size 0 max 16384 2026-02-20T13:17:47.853 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:17:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 -- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f086c0b5850 msgr2=0x7f086c0d5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f086c0b5850 0x7f086c0d5d00 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0898107000 tx=0x7f088803b040 comp rx=0 tx=0).stop 2026-02-20T13:17:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 -- 10.20.193.28:0/114855328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0898117f80 msgr2=0x7f0898100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0898117f80 0x7f0898100e70 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f088c006c10 tx=0x7f088c00fde0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 -- 10.20.193.28:0/114855328 shutdown_connections 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f086c0b5850 0x7f086c0d5d00 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0898117f80 0x7f0898100e70 unknown :-1 s=CLOSED pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0898117380 0x7f089817a8d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 --2- 10.20.193.28:0/114855328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0898116990 0x7f08981006b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 -- 10.20.193.28:0/114855328 >> 10.20.193.28:0/114855328 conn(0x7f089805b8b0 msgr2=0x7f08980f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 -- 10.20.193.28:0/114855328 shutdown_connections 2026-02-20T13:17:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:47.842+0000 7f089c8ec640 1 -- 10.20.193.28:0/114855328 wait complete. 2026-02-20T13:17:47.958 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:17:47.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:47 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3170361270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:17:48.152 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:48.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 -- 10.20.193.28:0/3810875475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc10dc30 msgr2=0x7f9abc112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 --2- 10.20.193.28:0/3810875475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc10dc30 0x7f9abc112c80 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=10566837447539215700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aac009950 tx=0x7f9aac02f190 comp rx=0 tx=0).stop 2026-02-20T13:17:48.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 -- 10.20.193.28:0/3810875475 shutdown_connections 2026-02-20T13:17:48.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 --2- 10.20.193.28:0/3810875475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc10dc30 0x7f9abc112c80 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=10566837447539215700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 --2- 10.20.193.28:0/3810875475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9abc113430 0x7f9abc173e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 --2- 10.20.193.28:0/3810875475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9abc10d240 0x7f9abc10d610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 -- 10.20.193.28:0/3810875475 >> 10.20.193.28:0/3810875475 conn(0x7f9abc0eaad0 msgr2=0x7f9abc10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 -- 10.20.193.28:0/3810875475 shutdown_connections 2026-02-20T13:17:48.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.342+0000 7f9ac0978640 1 -- 10.20.193.28:0/3810875475 wait complete. 2026-02-20T13:17:48.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.344+0000 7f9ac0978640 1 Processor -- start 2026-02-20T13:17:48.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.344+0000 7f9ac0978640 1 -- start start 2026-02-20T13:17:48.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9ac0978640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9abc10d240 0x7f9abc0f9c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9ac0978640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9abc10dc30 0x7f9abc173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9ac0978640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc113430 0x7f9abc0fa360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9ac0978640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0ff570 con 0x7f9abc113430 2026-02-20T13:17:48.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9abbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc113430 0x7f9abc0fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9abb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9abc10d240 0x7f9abc0f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9ac0978640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0ff6e0 con 0x7f9abc10d240 2026-02-20T13:17:48.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9ac0978640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0ff8a0 con 0x7f9abc10dc30 2026-02-20T13:17:48.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9abbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc113430 0x7f9abc0fa360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48178/0 (socket says 10.20.193.28:48178) 2026-02-20T13:17:48.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.345+0000 7f9abbfff640 1 -- 10.20.193.28:0/447036277 learned_addr learned my addr 10.20.193.28:0/447036277 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.346+0000 7f9abaffd640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9abc10dc30 0x7f9abc173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.346+0000 7f9abbfff640 1 -- 10.20.193.28:0/447036277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9abc10dc30 msgr2=0x7f9abc173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.346+0000 7f9abbfff640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9abc10dc30 0x7f9abc173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.346+0000 7f9abbfff640 1 -- 10.20.193.28:0/447036277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9abc10d240 msgr2=0x7f9abc0f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.346+0000 7f9abbfff640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9abc10d240 0x7f9abc0f9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.346+0000 7f9abbfff640 1 -- 10.20.193.28:0/447036277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac009570 con 0x7f9abc113430 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.346+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9abc10d240 0x7f9abc0f9c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.347+0000 7f9abbfff640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc113430 0x7f9abc0fa360 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab000fcb0 tx=0x7f9ab000d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.347+0000 7f9ab8ff9640 1 -- 10.20.193.28:0/447036277 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ab000fdb0 con 0x7f9abc113430 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.347+0000 7f9ab8ff9640 1 -- 10.20.193.28:0/447036277 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9ab0005e10 con 0x7f9abc113430 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.347+0000 7f9ab8ff9640 1 -- 10.20.193.28:0/447036277 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ab0011740 con 0x7f9abc113430 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.347+0000 7f9ac0978640 1 -- 10.20.193.28:0/447036277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc0ffb80 con 0x7f9abc113430 2026-02-20T13:17:48.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.347+0000 7f9ac0978640 1 -- 10.20.193.28:0/447036277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc100050 con 0x7f9abc113430 2026-02-20T13:17:48.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.351+0000 7f9ab8ff9640 1 -- 10.20.193.28:0/447036277 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f9ab0005850 con 0x7f9abc113430 2026-02-20T13:17:48.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.353+0000 7f9ab8ff9640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a900b57e0 0x7f9a900d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.353+0000 7f9ab8ff9640 1 -- 10.20.193.28:0/447036277 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9ab0015070 con 0x7f9abc113430 2026-02-20T13:17:48.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.353+0000 7f9ac3bfbe00 1 Processor -- start 2026-02-20T13:17:48.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.353+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a900b57e0 0x7f9a900d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.353+0000 7f9ac3bfbe00 1 -- start start 2026-02-20T13:17:48.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611ca9e2730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 0x5611caa275e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa47f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5611ca8f8780 con 0x5611caa27b20 2026-02-20T13:17:48.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5611ca8f44b0 con 0x5611ca9e2360 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5611ca8ee450 con 0x5611ca9e2c70 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a900b57e0 0x7f9a900d5c90 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa8004740 tx=0x7f9aa8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa47f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa47f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48196/0 (socket says 10.20.193.28:48196) 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 -- 10.20.193.28:0/2715185635 learned_addr learned my addr 10.20.193.28:0/2715185635 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611ca9e2730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 -- 10.20.193.28:0/2715185635 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 msgr2=0x5611caa275e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 0x5611caa275e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 -- 10.20.193.28:0/2715185635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 msgr2=0x5611ca9e2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611ca9e2730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 -- 10.20.193.28:0/2715185635 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ca899d10 con 0x5611caa27b20 2026-02-20T13:17:48.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611ca9e2730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9abbfff640 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa47f00 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=18129770788459624827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab00e5c10 tx=0x7f9ab00aa420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb99e279f963b97b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9a7ffff640 1 -- 10.20.193.28:0/2715185635 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ab00aee60 con 0x5611caa27b20 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9a7ffff640 1 -- 10.20.193.28:0/2715185635 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9ab00b4180 con 0x5611caa27b20 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.354+0000 7f9a7ffff640 1 -- 10.20.193.28:0/2715185635 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ab00b9110 con 0x5611caa27b20 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2715185635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 msgr2=0x5611caa47f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa47f00 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=18129770788459624827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab00e5c10 tx=0x7f9ab00aa420 comp rx=0 tx=0).stop 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2715185635 shutdown_connections 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa47f00 unknown :-1 s=CLOSED pgs=387 gs=1 cs=0 l=1 c_cookie=18129770788459624827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 0x5611caa275e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2715185635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611ca9e2730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2715185635 >> 10.20.193.28:0/2715185635 conn(0x5611ca9c0860 msgr2=0x5611ca9e0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2715185635 shutdown_connections 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.355+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2715185635 wait complete. 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.356+0000 7f9ac3bfbe00 1 -- start start 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9ac3bfbe00 1 Processor -- start 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611caa3f6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 0x5611caa3fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa419c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5611caa41f30 con 0x5611caa27b20 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5611caa420a0 con 0x5611ca9e2360 2026-02-20T13:17:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5611caa42260 con 0x5611ca9e2c70 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9abb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611caa3f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9abbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9abb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611caa3f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59268/0 (socket says 10.20.193.28:59268) 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.357+0000 7f9abbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48202/0 (socket says 10.20.193.28:48202) 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9abbfff640 1 -- 10.20.193.28:0/2714985476 learned_addr learned my addr 10.20.193.28:0/2714985476 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9abaffd640 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 0x5611caa3fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9abbfff640 1 -- 10.20.193.28:0/2714985476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 msgr2=0x5611caa3fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9abbfff640 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 0x5611caa3fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9abbfff640 1 -- 10.20.193.28:0/2714985476 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 msgr2=0x5611caa3f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9abbfff640 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611caa3f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9abbfff640 1 -- 10.20.193.28:0/2714985476 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ca8723c0 con 0x5611caa27b20 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9abbfff640 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa419c0 secure :-1 s=READY pgs=388 gs=2 cs=0 l=1 c_cookie=1381946930869062226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab00063d0 tx=0x7f9ab00e60a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132da96968e44a52 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9a7d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/2714985476 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ab0073070 con 0x5611caa27b20 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/2714985476 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9ab00b95a0 con 0x5611caa27b20 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/2714985476 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ab00af0f0 con 0x5611caa27b20 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc100050 con 0x5611caa27b20 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9ac3bfbe00 10 client.15582 _ll_register_callbacks cb 0x5611ca86fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.358+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5611ca5846f0 con 0x5611caa27b20 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/2714985476 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9ab00aee60 con 0x5611caa27b20 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/2714985476 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ab00b6760 con 0x5611caa27b20 2026-02-20T13:17:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9ac3bfbe00 10 client.15582 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5611ca8840e0 con 0x5611caa27b20 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/2714985476 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f9ab00ac440 con 0x5611caa27b20 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9ac3bfbe00 10 client.15582 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9ac3bfbe00 10 client.15582 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9ac3bfbe00 20 client.15582 populate_metadata read hostname 'trial028' 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5611caa24d80 0x5611caa25220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9ac3bfbe00 4 client.15582 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.360+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611ca890f80 con 0x5611caa24d80 2026-02-20T13:17:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.361+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5611caa24d80 0x5611caa25220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.361+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5611caa24d80 0x5611caa25220 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=749198238268955545 s_cookie=3500128346299144538 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a65afd40a5e9b99 server_cookie=3092f42fbd6f995a in_seq=0 out_seq=0 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.361+0000 7f9a7d7fa640 10 client.15582 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.362+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/2714985476 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5611ca890f80 con 0x5611caa24d80 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.362+0000 7f9a7d7fa640 10 client.15582 handle_command_reply: tid=0 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.362+0000 7f9ac3bfbe00 1 client.15582 shutdown 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.362+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 msgr2=0x5611caa419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.362+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa419c0 secure :-1 s=READY pgs=388 gs=2 cs=0 l=1 c_cookie=1381946930869062226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab00063d0 tx=0x7f9ab00e60a0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 shutdown_connections 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5611caa24d80 0x5611caa25220 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=749198238268955545 s_cookie=3500128346299144538 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa419c0 unknown :-1 s=CLOSED pgs=388 gs=2 cs=0 l=1 c_cookie=1381946930869062226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2c70 0x5611caa3fc30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/2714985476 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2360 0x5611caa3f6f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 >> 10.20.193.28:0/2714985476 conn(0x5611ca9c0860 msgr2=0x5611ca9e0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9a7d7fa640 0 client.15582 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 shutdown_connections 2026-02-20T13:17:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/2714985476 wait complete. 2026-02-20T13:17:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.363+0000 7f9ac3bfbe00 20 client.15582 trim_cache size 0 max 16384 2026-02-20T13:17:48.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.370+0000 7f9ac3bfbe00 1 Processor -- start 2026-02-20T13:17:48.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.370+0000 7f9ac3bfbe00 1 -- start start 2026-02-20T13:17:48.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa251e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2c70 0x5611ca9e1d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa3c860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5611ca8ec080 con 0x5611caa27b20 2026-02-20T13:17:48.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5611ca5ac700 con 0x5611ca9e2c70 2026-02-20T13:17:48.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5611caa38540 con 0x5611ca9e2360 2026-02-20T13:17:48.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9abb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9abb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa251e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49708/0 (socket says 10.20.193.28:49708) 2026-02-20T13:17:48.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9abb7fe640 1 -- 10.20.193.28:0/1282367256 learned_addr learned my addr 10.20.193.28:0/1282367256 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9abaffd640 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2c70 0x5611ca9e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9abb7fe640 1 -- 10.20.193.28:0/1282367256 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2c70 msgr2=0x5611ca9e1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2c70 0x5611ca9e1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.371+0000 7f9abb7fe640 1 -- 10.20.193.28:0/1282367256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 msgr2=0x5611caa3c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:17:48.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.372+0000 7f9abbfff640 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa3c860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.372+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa3c860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.372+0000 7f9abb7fe640 1 -- 10.20.193.28:0/1282367256 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ca87eb60 con 0x5611ca9e2360 2026-02-20T13:17:48.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.372+0000 7f9abaffd640 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2c70 0x5611ca9e1d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:48.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.372+0000 7f9abbfff640 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa3c860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:48.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.372+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa251e0 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=6227950524813501488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa800f410 tx=0x7f9aa8013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=566e200156376430 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9a7f7fe640 1 -- 10.20.193.28:0/1282367256 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa801c270 con 0x5611ca9e2360 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9a7f7fe640 1 -- 10.20.193.28:0/1282367256 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9aa8022040 con 0x5611ca9e2360 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9a7f7fe640 1 -- 10.20.193.28:0/1282367256 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa800fdb0 con 0x5611ca9e2360 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/1282367256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 msgr2=0x5611caa251e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa251e0 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=6227950524813501488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa800f410 tx=0x7f9aa8013040 comp rx=0 tx=0).stop 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/1282367256 shutdown_connections 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611caa27b20 0x5611caa3c860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611ca9e2c70 0x5611ca9e1d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/1282367256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa251e0 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=6227950524813501488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/1282367256 >> 10.20.193.28:0/1282367256 conn(0x5611ca9c0860 msgr2=0x5611caa452d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/1282367256 shutdown_connections 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.373+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/1282367256 wait complete. 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.374+0000 7f9ac3bfbe00 1 -- start start 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.374+0000 7f9ac3bfbe00 1 Processor -- start 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.374+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa9f1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.374+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611ca9e2c70 0x5611caa9f730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.374+0000 7f9ac3bfbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611caa27b20 0x5611caa48900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.374+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5611caa48e40 con 0x5611ca9e2c70 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.374+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5611caa48fb0 con 0x5611caa27b20 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.374+0000 7f9ac3bfbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5611caa49170 con 0x5611ca9e2360 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa9f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611ca9e2c70 0x5611caa9f730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611ca9e2c70 0x5611caa9f730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48210/0 (socket says 10.20.193.28:48210) 2026-02-20T13:17:48.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abaffd640 1 -- 10.20.193.28:0/233235467 learned_addr learned my addr 10.20.193.28:0/233235467 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abbfff640 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611caa27b20 0x5611caa48900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abb7fe640 1 -- 10.20.193.28:0/233235467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611caa27b20 msgr2=0x5611caa48900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611caa27b20 0x5611caa48900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abb7fe640 1 -- 10.20.193.28:0/233235467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611ca9e2c70 msgr2=0x5611caa9f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611ca9e2c70 0x5611caa9f730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abb7fe640 1 -- 10.20.193.28:0/233235467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ca8726f0 con 0x5611ca9e2360 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.375+0000 7f9abaffd640 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611ca9e2c70 0x5611caa9f730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9abb7fe640 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa9f1f0 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=4777674473919210988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa8005db0 tx=0x7f9aa800f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=424db59eee67e5ec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9a7d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/233235467 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa801c270 con 0x5611ca9e2360 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/233235467 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9aa800f520 con 0x5611ca9e2360 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/233235467 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa8003930 con 0x5611ca9e2360 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa801c590 con 0x5611ca9e2360 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9ac3bfbe00 10 client.25531 _ll_register_callbacks cb 0x5611ca86fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:48.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ab00b4180 con 0x5611ca9e2360 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/233235467 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9aa8004510 con 0x5611ca9e2360 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/233235467 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9aa8003ac0 con 0x5611ca9e2360 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9ac3bfbe00 10 client.25531 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.376+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5611ca884340 con 0x5611ca9e2360 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.377+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/233235467 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f9aa8041060 con 0x5611ca9e2360 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.377+0000 7f9ac3bfbe00 10 client.25531 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.377+0000 7f9ac3bfbe00 10 client.25531 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.377+0000 7f9ac3bfbe00 20 client.25531 populate_metadata read hostname 'trial028' 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.377+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5611caae68e0 0x5611cab06d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.377+0000 7f9ac3bfbe00 4 client.25531 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.377+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5611ca581f40 con 0x5611caae68e0 2026-02-20T13:17:48.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.377+0000 7f9abaffd640 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5611caae68e0 0x5611cab06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9abaffd640 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5611caae68e0 0x5611cab06d90 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=10935699714635683866 s_cookie=8095250826876630392 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=97c368f35d33581a server_cookie=70581bbc8fab3578 in_seq=0 out_seq=0 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9a7d7fa640 10 client.25531 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9a7d7fa640 1 -- 10.20.193.28:0/233235467 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5611ca581f40 con 0x5611caae68e0 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9a7d7fa640 10 client.25531 handle_command_reply: tid=0 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 client.25531 shutdown 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 msgr2=0x5611caa9f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa9f1f0 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=4777674473919210988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa8005db0 tx=0x7f9aa800f6c0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 shutdown_connections 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5611caae68e0 0x5611cab06d90 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=10935699714635683866 s_cookie=8095250826876630392 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611ca9e2c70 0x5611caa9f730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611caa27b20 0x5611caa48900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 --2- 10.20.193.28:0/233235467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611ca9e2360 0x5611caa9f1f0 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=4777674473919210988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 >> 10.20.193.28:0/233235467 conn(0x5611ca9c0860 msgr2=0x5611ca9e0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9a7d7fa640 0 client.25531 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:17:48.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 shutdown_connections 2026-02-20T13:17:48.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 1 -- 10.20.193.28:0/233235467 wait complete. 2026-02-20T13:17:48.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.378+0000 7f9ac3bfbe00 20 client.25531 trim_cache size 0 max 16384 2026-02-20T13:17:48.387 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:17:48.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 -- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a900b57e0 msgr2=0x7f9a900d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a900b57e0 0x7f9a900d5c90 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa8004740 tx=0x7f9aa8005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 -- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc113430 msgr2=0x7f9abc0fa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc113430 0x7f9abc0fa360 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab000fcb0 tx=0x7f9ab000d6a0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 -- 10.20.193.28:0/447036277 shutdown_connections 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a900b57e0 0x7f9a900d5c90 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9abc113430 0x7f9abc0fa360 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9abc10dc30 0x7f9abc173d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 --2- 10.20.193.28:0/447036277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9abc10d240 0x7f9abc0f9c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.379+0000 7f9ac0978640 1 -- 10.20.193.28:0/447036277 >> 10.20.193.28:0/447036277 conn(0x7f9abc0eaad0 msgr2=0x7f9abc10fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.380+0000 7f9ac0978640 1 -- 10.20.193.28:0/447036277 shutdown_connections 2026-02-20T13:17:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.380+0000 7f9ac0978640 1 -- 10.20.193.28:0/447036277 wait complete. 2026-02-20T13:17:48.527 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:17:48.728 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:48.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:48 trial034 ceph-mon[43332]: pgmap v195: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:48 trial028 ceph-mon[37442]: pgmap v195: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.923+0000 7fcf513da640 1 -- 10.20.193.28:0/2373792384 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10dd50 msgr2=0x7fcf4c112da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.923+0000 7fcf49ffb640 1 -- 10.20.193.28:0/2373792384 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf3402fc10 con 0x7fcf4c10dd50 2026-02-20T13:17:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.923+0000 7fcf513da640 1 --2- 10.20.193.28:0/2373792384 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10dd50 0x7fcf4c112da0 secure :-1 s=READY pgs=129 gs=2 cs=0 l=1 c_cookie=17988149346294413460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf34009950 tx=0x7fcf3402f190 comp rx=0 tx=0).stop 2026-02-20T13:17:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.923+0000 7fcf513da640 1 -- 10.20.193.28:0/2373792384 shutdown_connections 2026-02-20T13:17:48.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.923+0000 7fcf513da640 1 --2- 10.20.193.28:0/2373792384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcf4c113550 0x7fcf4c173f20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.923+0000 7fcf513da640 1 --2- 10.20.193.28:0/2373792384 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10dd50 0x7fcf4c112da0 unknown :-1 s=CLOSED pgs=129 gs=2 cs=0 l=1 c_cookie=17988149346294413460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.923+0000 7fcf513da640 1 --2- 10.20.193.28:0/2373792384 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcf4c10d360 0x7fcf4c10d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.923+0000 7fcf513da640 1 -- 10.20.193.28:0/2373792384 >> 10.20.193.28:0/2373792384 conn(0x7fcf4c0eac30 msgr2=0x7fcf4c10b040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.924+0000 7fcf513da640 1 -- 10.20.193.28:0/2373792384 shutdown_connections 2026-02-20T13:17:48.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.924+0000 7fcf513da640 1 -- 10.20.193.28:0/2373792384 wait complete. 2026-02-20T13:17:48.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.924+0000 7fcf513da640 1 Processor -- start 2026-02-20T13:17:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.924+0000 7fcf513da640 1 -- start start 2026-02-20T13:17:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf513da640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10d360 0x7fcf4c0eff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf513da640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcf4c10dd50 0x7fcf4c173e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf513da640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcf4c113550 0x7fcf4c0ec1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10d360 0x7fcf4c0eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf513da640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0ec970 con 0x7fcf4c113550 2026-02-20T13:17:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf513da640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0ecae0 con 0x7fcf4c10dd50 2026-02-20T13:17:48.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf513da640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0ecca0 con 0x7fcf4c10d360 2026-02-20T13:17:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf4a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcf4c10dd50 0x7fcf4c173e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf4a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcf4c10dd50 0x7fcf4c173e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59310/0 (socket says 10.20.193.28:59310) 2026-02-20T13:17:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf4a7fc640 1 -- 10.20.193.28:0/1617672709 learned_addr learned my addr 10.20.193.28:0/1617672709 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.925+0000 7fcf4b7fe640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcf4c113550 0x7fcf4c0ec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf4affd640 1 -- 10.20.193.28:0/1617672709 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcf4c10dd50 msgr2=0x7fcf4c173e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf4affd640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcf4c10dd50 0x7fcf4c173e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf4affd640 1 -- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcf4c113550 msgr2=0x7fcf4c0ec1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf4affd640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcf4c113550 0x7fcf4c0ec1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf4affd640 1 -- 10.20.193.28:0/1617672709 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf400094b0 con 0x7fcf4c10d360 2026-02-20T13:17:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf4b7fe640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcf4c113550 0x7fcf4c0ec1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf4affd640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10d360 0x7fcf4c0eff50 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf40004680 tx=0x7fcf40002b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf2bfff640 1 -- 10.20.193.28:0/1617672709 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf4000eb20 con 0x7fcf4c10d360 2026-02-20T13:17:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf2bfff640 1 -- 10.20.193.28:0/1617672709 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcf4000ec80 con 0x7fcf4c10d360 2026-02-20T13:17:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.926+0000 7fcf2bfff640 1 -- 10.20.193.28:0/1617672709 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf4000f7d0 con 0x7fcf4c10d360 2026-02-20T13:17:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.927+0000 7fcf513da640 1 -- 10.20.193.28:0/1617672709 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3c00a590 con 0x7fcf4c10d360 2026-02-20T13:17:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.927+0000 7fcf513da640 1 -- 10.20.193.28:0/1617672709 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf34009570 con 0x7fcf4c10d360 2026-02-20T13:17:48.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.929+0000 7fcf2bfff640 1 -- 10.20.193.28:0/1617672709 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fcf4001f060 con 0x7fcf4c10d360 2026-02-20T13:17:48.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.931+0000 7fcf2bfff640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcf200b57f0 0x7fcf200d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.931+0000 7fcf2bfff640 1 -- 10.20.193.28:0/1617672709 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcf400e6f60 con 0x7fcf4c10d360 2026-02-20T13:17:48.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.932+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcf200b57f0 0x7fcf200d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.932+0000 7fcf533d4e00 1 Processor -- start 2026-02-20T13:17:48.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.932+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcf200b57f0 0x7fcf200d5ca0 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf4c0efcd0 tx=0x7fcf34005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.932+0000 7fcf533d4e00 1 -- start start 2026-02-20T13:17:48.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333e1730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1c70 0x55bc334265e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33446f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc332f7780 con 0x55bc33426b20 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bc332f34b0 con 0x55bc333e1c70 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bc332ed450 con 0x55bc333e1360 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33446f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333e1730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33446f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48246/0 (socket says 10.20.193.28:48246) 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4b7fe640 1 -- 10.20.193.28:0/1185349915 learned_addr learned my addr 10.20.193.28:0/1185349915 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333e1730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49750/0 (socket says 10.20.193.28:49750) 2026-02-20T13:17:48.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1c70 0x55bc334265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4affd640 1 -- 10.20.193.28:0/1185349915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1c70 msgr2=0x55bc334265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4affd640 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1c70 0x55bc334265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4affd640 1 -- 10.20.193.28:0/1185349915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 msgr2=0x55bc33446f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4affd640 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33446f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4affd640 1 -- 10.20.193.28:0/1185349915 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc33298d10 con 0x55bc333e1360 2026-02-20T13:17:48.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.933+0000 7fcf4b7fe640 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33446f00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:48.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf4affd640 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333e1730 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=12821494836066306640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf400a9730 tx=0x7fcf400ad2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ef199f493cca50 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf177fe640 1 -- 10.20.193.28:0/1185349915 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf400b2e80 con 0x55bc333e1360 2026-02-20T13:17:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf177fe640 1 -- 10.20.193.28:0/1185349915 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcf400b5460 con 0x55bc333e1360 2026-02-20T13:17:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf177fe640 1 -- 10.20.193.28:0/1185349915 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf400acd00 con 0x55bc333e1360 2026-02-20T13:17:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 -- 10.20.193.28:0/1185349915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 msgr2=0x55bc333e1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333e1730 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=12821494836066306640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf400a9730 tx=0x7fcf400ad2e0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 -- 10.20.193.28:0/1185349915 shutdown_connections 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33446f00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1c70 0x55bc334265e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/1185349915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333e1730 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=12821494836066306640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 -- 10.20.193.28:0/1185349915 >> 10.20.193.28:0/1185349915 conn(0x55bc333bf860 msgr2=0x55bc333dfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 -- 10.20.193.28:0/1185349915 shutdown_connections 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.934+0000 7fcf533d4e00 1 -- 10.20.193.28:0/1185349915 wait complete. 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.936+0000 7fcf533d4e00 1 -- start start 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.936+0000 7fcf533d4e00 1 Processor -- start 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc3343e6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc3343ec30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc33443c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc33444160 con 0x55bc333e1c70 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bc334442d0 con 0x55bc33426b20 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bc33444490 con 0x55bc333e1360 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc3343e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc3343e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49758/0 (socket says 10.20.193.28:49758) 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf4affd640 1 -- 10.20.193.28:0/2410675567 learned_addr learned my addr 10.20.193.28:0/2410675567 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc3343ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.937+0000 7fcf4b7fe640 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc33443c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf4affd640 1 -- 10.20.193.28:0/2410675567 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 msgr2=0x55bc33443c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf4affd640 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc33443c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf4affd640 1 -- 10.20.193.28:0/2410675567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 msgr2=0x55bc3343ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf4affd640 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc3343ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf4affd640 1 -- 10.20.193.28:0/2410675567 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf34009570 con 0x55bc333e1360 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc3343ec30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf4affd640 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc3343e6f0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=9812983597940406241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf400ad3d0 tx=0x7fcf400adc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882eb89745f8f7e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf14ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf14ff9640 1 -- 10.20.193.28:0/2410675567 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf400acd00 con 0x55bc333e1360 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf14ff9640 1 -- 10.20.193.28:0/2410675567 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcf4006f070 con 0x55bc333e1360 2026-02-20T13:17:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.938+0000 7fcf14ff9640 1 -- 10.20.193.28:0/2410675567 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf400ae070 con 0x55bc333e1360 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf3c00a7e0 con 0x55bc333e1360 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 10 client.25543 _ll_register_callbacks cb 0x55bc3326ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc32f836f0 con 0x55bc333e1360 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf14ff9640 1 -- 10.20.193.28:0/2410675567 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcf40010a10 con 0x55bc333e1360 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf14ff9640 1 -- 10.20.193.28:0/2410675567 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcf400b82a0 con 0x55bc333e1360 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 10 client.25543 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55bc332713c0 con 0x55bc333e1360 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf14ff9640 1 -- 10.20.193.28:0/2410675567 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fcf40016070 con 0x55bc333e1360 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 10 client.25543 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 10 client.25543 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:17:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 20 client.25543 populate_metadata read hostname 'trial028' 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bc33423d10 0x55bc334241b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 4 client.25543 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.939+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc3328ff80 con 0x55bc33423d10 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.940+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bc33423d10 0x55bc334241b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.940+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bc33423d10 0x55bc334241b0 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=1970621011369236101 s_cookie=2189202914755933785 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b590d5e79959685 server_cookie=1e619c73bb46f659 in_seq=0 out_seq=0 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.940+0000 7fcf14ff9640 10 client.25543 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf14ff9640 1 -- 10.20.193.28:0/2410675567 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bc3328ff80 con 0x55bc33423d10 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf14ff9640 10 client.25543 handle_command_reply: tid=0 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 client.25543 shutdown 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 msgr2=0x55bc3343e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc3343e6f0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=9812983597940406241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf400ad3d0 tx=0x7fcf400adc90 comp rx=0 tx=0).stop 2026-02-20T13:17:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 shutdown_connections 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bc33423d10 0x55bc334241b0 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=1970621011369236101 s_cookie=2189202914755933785 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc3343ec30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc33443c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2410675567 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc3343e6f0 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=9812983597940406241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 >> 10.20.193.28:0/2410675567 conn(0x55bc333bf860 msgr2=0x55bc333dfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf14ff9640 0 client.25543 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.941+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 shutdown_connections 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.942+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2410675567 wait complete. 2026-02-20T13:17:48.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.942+0000 7fcf533d4e00 20 client.25543 trim_cache size 0 max 16384 2026-02-20T13:17:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf533d4e00 1 Processor -- start 2026-02-20T13:17:48.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf533d4e00 1 -- start start 2026-02-20T13:17:48.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1360 0x55bc33430250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1c70 0x55bc33443190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33421780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc33430a20 con 0x55bc33426b20 2026-02-20T13:17:48.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bc332eb080 con 0x55bc333e1360 2026-02-20T13:17:48.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bc32fab700 con 0x55bc333e1c70 2026-02-20T13:17:48.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf4a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1c70 0x55bc33443190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1360 0x55bc33430250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1360 0x55bc33430250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59342/0 (socket says 10.20.193.28:59342) 2026-02-20T13:17:48.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf4affd640 1 -- 10.20.193.28:0/2002002157 learned_addr learned my addr 10.20.193.28:0/2002002157 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.949+0000 7fcf4b7fe640 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33421780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf4a7fc640 1 -- 10.20.193.28:0/2002002157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1360 msgr2=0x55bc33430250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1360 0x55bc33430250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf4a7fc640 1 -- 10.20.193.28:0/2002002157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 msgr2=0x55bc33421780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33421780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf4a7fc640 1 -- 10.20.193.28:0/2002002157 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc332830e0 con 0x55bc333e1c70 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf4affd640 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1360 0x55bc33430250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1c70 0x55bc33443190 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=12478430077445703003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf34009350 tx=0x7fcf34044000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad2c4a0ab8b3855b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf16ffd640 1 -- 10.20.193.28:0/2002002157 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf3400b0d0 con 0x55bc333e1c70 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf16ffd640 1 -- 10.20.193.28:0/2002002157 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcf3402f9f0 con 0x55bc333e1c70 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf16ffd640 1 -- 10.20.193.28:0/2002002157 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf34059d10 con 0x55bc333e1c70 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2002002157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1c70 msgr2=0x55bc33443190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.950+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1c70 0x55bc33443190 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=12478430077445703003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf34009350 tx=0x7fcf34044000 comp rx=0 tx=0).stop 2026-02-20T13:17:48.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2002002157 shutdown_connections 2026-02-20T13:17:48.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc33426b20 0x55bc33421780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1c70 0x55bc33443190 unknown :-1 s=CLOSED pgs=133 gs=2 cs=0 l=1 c_cookie=12478430077445703003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/2002002157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc333e1360 0x55bc33430250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2002002157 >> 10.20.193.28:0/2002002157 conn(0x55bc333bf860 msgr2=0x55bc33442a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2002002157 shutdown_connections 2026-02-20T13:17:48.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 -- 10.20.193.28:0/2002002157 wait complete. 2026-02-20T13:17:48.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 -- start start 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.951+0000 7fcf533d4e00 1 Processor -- start 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333bfde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc333c0320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf533d4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc333c4c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc333bf5d0 con 0x55bc333e1c70 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bc333bc2e0 con 0x55bc33426b20 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf533d4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bc333e2040 con 0x55bc333e1360 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc333c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333bfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333bfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49782/0 (socket says 10.20.193.28:49782) 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4affd640 1 -- 10.20.193.28:0/3405692688 learned_addr learned my addr 10.20.193.28:0/3405692688 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4b7fe640 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc333c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4affd640 1 -- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 msgr2=0x55bc333c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4affd640 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc333c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4affd640 1 -- 10.20.193.28:0/3405692688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 msgr2=0x55bc333c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.952+0000 7fcf4affd640 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc333c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf4affd640 1 -- 10.20.193.28:0/3405692688 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3404d040 con 0x55bc333e1360 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf4b7fe640 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc333c4c80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc333c0320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf4affd640 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333bfde0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=4420921605392857281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf400a9730 tx=0x7fcf400e4da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5a44c6ed4a78c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf14ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf14ff9640 1 -- 10.20.193.28:0/3405692688 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf4001fe70 con 0x55bc333e1360 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf14ff9640 1 -- 10.20.193.28:0/3405692688 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcf4006f070 con 0x55bc333e1360 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf14ff9640 1 -- 10.20.193.28:0/3405692688 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf400ac260 con 0x55bc333e1360 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc332713c0 con 0x55bc333e1360 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf14ff9640 1 -- 10.20.193.28:0/3405692688 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcf4008d020 con 0x55bc333e1360 2026-02-20T13:17:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.953+0000 7fcf14ff9640 10 client.25549 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 10 client.25549 _ll_register_callbacks cb 0x55bc3326ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf400b5460 con 0x55bc333e1360 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf14ff9640 1 -- 10.20.193.28:0/3405692688 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcf40010a10 con 0x55bc333e1360 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 10 client.25549 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55bc3327db60 con 0x55bc333e1360 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf14ff9640 1 -- 10.20.193.28:0/3405692688 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fcf40016070 con 0x55bc333e1360 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 10 client.25549 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 10 client.25549 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 20 client.25549 populate_metadata read hostname 'trial028' 2026-02-20T13:17:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bc334e5660 0x55bc33505ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 4 client.25549 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc32f80f40 con 0x55bc334e5660 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.954+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bc334e5660 0x55bc33505ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf4a7fc640 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bc334e5660 0x55bc33505ae0 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=18192083331627829125 s_cookie=3753805999181193002 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc77436781fb4785 server_cookie=341832aaf0ecdf2a in_seq=0 out_seq=0 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf14ff9640 10 client.25549 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf14ff9640 1 -- 10.20.193.28:0/3405692688 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc32f80f40 con 0x55bc334e5660 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf14ff9640 10 client.25549 handle_command_reply: tid=0 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 client.25549 shutdown 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 msgr2=0x55bc333bfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333bfde0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=4420921605392857281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf400a9730 tx=0x7fcf400e4da0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 shutdown_connections 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bc334e5660 0x55bc33505ae0 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=18192083331627829125 s_cookie=3753805999181193002 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc333e1c70 0x55bc333c0320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc33426b20 0x55bc333c4c80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 --2- 10.20.193.28:0/3405692688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc333e1360 0x55bc333bfde0 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=4420921605392857281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 >> 10.20.193.28:0/3405692688 conn(0x55bc333bf860 msgr2=0x55bc3343b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.955+0000 7fcf14ff9640 0 client.25549 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:17:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.956+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 shutdown_connections 2026-02-20T13:17:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.956+0000 7fcf533d4e00 1 -- 10.20.193.28:0/3405692688 wait complete. 2026-02-20T13:17:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.956+0000 7fcf533d4e00 20 client.25549 trim_cache size 0 max 16384 2026-02-20T13:17:48.962 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:17:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.956+0000 7fcf513da640 1 -- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcf200b57f0 msgr2=0x7fcf200d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.956+0000 7fcf513da640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcf200b57f0 0x7fcf200d5ca0 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf4c0efcd0 tx=0x7fcf34005ab0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.956+0000 7fcf513da640 1 -- 10.20.193.28:0/1617672709 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10d360 msgr2=0x7fcf4c0eff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.956+0000 7fcf513da640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10d360 0x7fcf4c0eff50 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf40004680 tx=0x7fcf40002b40 comp rx=0 tx=0).stop 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.957+0000 7fcf513da640 1 -- 10.20.193.28:0/1617672709 shutdown_connections 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.957+0000 7fcf513da640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcf200b57f0 0x7fcf200d5ca0 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.957+0000 7fcf513da640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcf4c113550 0x7fcf4c0ec1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.957+0000 7fcf513da640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcf4c10dd50 0x7fcf4c173e20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.957+0000 7fcf513da640 1 --2- 10.20.193.28:0/1617672709 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcf4c10d360 0x7fcf4c0eff50 unknown :-1 s=CLOSED pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.957+0000 7fcf513da640 1 -- 10.20.193.28:0/1617672709 >> 10.20.193.28:0/1617672709 conn(0x7fcf4c0eac30 msgr2=0x7fcf4c111c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.957+0000 7fcf513da640 1 -- 10.20.193.28:0/1617672709 shutdown_connections 2026-02-20T13:17:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:48.957+0000 7fcf513da640 1 -- 10.20.193.28:0/1617672709 wait complete. 2026-02-20T13:17:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:48 trial127 ceph-mon[43817]: pgmap v195: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:49.066 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:17:49.259 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:49.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.449+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/2017169897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010dd10 msgr2=0x7fe4c0112d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.449+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/2017169897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010dd10 0x7fe4c0112d60 secure :-1 s=READY pgs=158 gs=2 cs=0 l=1 c_cookie=6356897518089354617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4b4009950 tx=0x7fe4b402f190 comp rx=0 tx=0).stop 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.449+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/2017169897 shutdown_connections 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.449+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/2017169897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4c0113510 0x7fe4c0173ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.449+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/2017169897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010dd10 0x7fe4c0112d60 unknown :-1 s=CLOSED pgs=158 gs=2 cs=0 l=1 c_cookie=6356897518089354617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.449+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/2017169897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4c010d320 0x7fe4c010d6f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.449+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/2017169897 >> 10.20.193.28:0/2017169897 conn(0x7fe4c00eabb0 msgr2=0x7fe4c010afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.450+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/2017169897 shutdown_connections 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.450+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/2017169897 wait complete. 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.450+0000 7fe4c7a2a640 1 Processor -- start 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.450+0000 7fe4c7a2a640 1 -- start start 2026-02-20T13:17:49.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c7a2a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010d320 0x7fe4c00eee30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c7a2a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4c010dd10 0x7fe4c0173de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c7a2a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4c0113510 0x7fe4c00eb100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c7a2a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00eb890 con 0x7fe4c010dd10 2026-02-20T13:17:49.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c7a2a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00eba00 con 0x7fe4c010d320 2026-02-20T13:17:49.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c7a2a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00ebbc0 con 0x7fe4c0113510 2026-02-20T13:17:49.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c579f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010d320 0x7fe4c00eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c579f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010d320 0x7fe4c00eee30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59362/0 (socket says 10.20.193.28:59362) 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c579f640 1 -- 10.20.193.28:0/1407825285 learned_addr learned my addr 10.20.193.28:0/1407825285 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c4f9e640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4c010dd10 0x7fe4c0173de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.451+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4c0113510 0x7fe4c00eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c4f9e640 1 -- 10.20.193.28:0/1407825285 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4c0113510 msgr2=0x7fe4c00eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c4f9e640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4c0113510 0x7fe4c00eb100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c4f9e640 1 -- 10.20.193.28:0/1407825285 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010d320 msgr2=0x7fe4c00eee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c4f9e640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010d320 0x7fe4c00eee30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c4f9e640 1 -- 10.20.193.28:0/1407825285 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b4009570 con 0x7fe4c010dd10 2026-02-20T13:17:49.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4c0113510 0x7fe4c00eb100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:49.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c4f9e640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4c010dd10 0x7fe4c0173de0 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4b4009950 tx=0x7fe4b4002ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:49.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4ae7fc640 1 -- 10.20.193.28:0/1407825285 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4b402fc10 con 0x7fe4c010dd10 2026-02-20T13:17:49.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4ae7fc640 1 -- 10.20.193.28:0/1407825285 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4b4005dd0 con 0x7fe4c010dd10 2026-02-20T13:17:49.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4ae7fc640 1 -- 10.20.193.28:0/1407825285 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4b4041c00 con 0x7fe4c010dd10 2026-02-20T13:17:49.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/1407825285 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c00ebe40 con 0x7fe4c010dd10 2026-02-20T13:17:49.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.452+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/1407825285 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c00ff760 con 0x7fe4c010dd10 2026-02-20T13:17:49.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.456+0000 7fe4ae7fc640 1 -- 10.20.193.28:0/1407825285 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fe4b4038680 con 0x7fe4c010dd10 2026-02-20T13:17:49.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.458+0000 7fe4ae7fc640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe49c0b57f0 0x7fe49c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.458+0000 7fe4ae7fc640 1 -- 10.20.193.28:0/1407825285 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe4b4038e40 con 0x7fe4c010dd10 2026-02-20T13:17:49.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.458+0000 7fe4c579f640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe49c0b57f0 0x7fe49c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.459+0000 7fe4c579f640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe49c0b57f0 0x7fe49c0d5ca0 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4b0005c70 tx=0x7fe4b0007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:49.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.460+0000 7fe4c9a24e00 1 Processor -- start 2026-02-20T13:17:49.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.460+0000 7fe4c9a24e00 1 -- start start 2026-02-20T13:17:49.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.460+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765360 0x55709f765730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.460+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 0x55709f7aa5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.460+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f7aab20 0x55709f7caf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.460+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55709f67b780 con 0x55709f765c70 2026-02-20T13:17:49.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.460+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55709f6774b0 con 0x55709f7aab20 2026-02-20T13:17:49.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.460+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55709f671450 con 0x55709f765360 2026-02-20T13:17:49.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f7aab20 0x55709f7caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c4f9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 0x55709f7aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f7aab20 0x55709f7caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59368/0 (socket says 10.20.193.28:59368) 2026-02-20T13:17:49.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 -- 10.20.193.28:0/122457160 learned_addr learned my addr 10.20.193.28:0/122457160 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:49.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c579f640 1 --2- 10.20.193.28:0/122457160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765360 0x55709f765730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 -- 10.20.193.28:0/122457160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765360 msgr2=0x55709f765730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:49.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/122457160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765360 0x55709f765730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 -- 10.20.193.28:0/122457160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 msgr2=0x55709f7aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:49.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/122457160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 0x55709f7aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 -- 10.20.193.28:0/122457160 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709f61cd10 con 0x55709f7aab20 2026-02-20T13:17:49.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.461+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/122457160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f7aab20 0x55709f7caf00 secure :-1 s=READY pgs=159 gs=2 cs=0 l=1 c_cookie=17613563578170260392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4bc005170 tx=0x7fe4bc005640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f46ff2c0f198bba8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:49.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe48dce5640 1 -- 10.20.193.28:0/122457160 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4bc003dc0 con 0x55709f7aab20 2026-02-20T13:17:49.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe48dce5640 1 -- 10.20.193.28:0/122457160 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4bc011910 con 0x55709f7aab20 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe48dce5640 1 -- 10.20.193.28:0/122457160 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4bc00fa40 con 0x55709f7aab20 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/122457160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f7aab20 msgr2=0x55709f7caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/122457160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f7aab20 0x55709f7caf00 secure :-1 s=READY pgs=159 gs=2 cs=0 l=1 c_cookie=17613563578170260392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4bc005170 tx=0x7fe4bc005640 comp rx=0 tx=0).stop 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/122457160 shutdown_connections 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/122457160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 0x55709f7aa5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/122457160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f7aab20 0x55709f7caf00 unknown :-1 s=CLOSED pgs=159 gs=2 cs=0 l=1 c_cookie=17613563578170260392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/122457160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765360 0x55709f765730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/122457160 >> 10.20.193.28:0/122457160 conn(0x55709f743860 msgr2=0x55709f763c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/122457160 shutdown_connections 2026-02-20T13:17:49.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.462+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/122457160 wait complete. 2026-02-20T13:17:49.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c9a24e00 1 -- start start 2026-02-20T13:17:49.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c9a24e00 1 Processor -- start 2026-02-20T13:17:49.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c2720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 0x55709f7c2c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f7c49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55709f7c4f60 con 0x55709f765c70 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55709f7c50d0 con 0x55709f765360 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55709f7c5290 con 0x55709f7aab20 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.464+0000 7fe4c5fa0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f7c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c5fa0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f7c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49806/0 (socket says 10.20.193.28:49806) 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c5fa0640 1 -- 10.20.193.28:0/85115209 learned_addr learned my addr 10.20.193.28:0/85115209 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c5fa0640 1 -- 10.20.193.28:0/85115209 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 msgr2=0x55709f7c2720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c2720 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c5fa0640 1 -- 10.20.193.28:0/85115209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 msgr2=0x55709f7c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 0x55709f7c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c5fa0640 1 -- 10.20.193.28:0/85115209 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709f5f53c0 con 0x55709f7aab20 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f7c49f0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=3971319370767424252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4bc00a720 tx=0x7fe4bc006860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=371cf5ed40385afc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe47affd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe47affd640 1 -- 10.20.193.28:0/85115209 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4bc01f070 con 0x55709f7aab20 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc00adc0 con 0x55709f7aab20 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c9a24e00 10 client.25558 _ll_register_callbacks cb 0x55709f5f2a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.465+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55709f3076f0 con 0x55709f7aab20 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.466+0000 7fe47affd640 1 -- 10.20.193.28:0/85115209 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4bc020040 con 0x55709f7aab20 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.466+0000 7fe47affd640 1 -- 10.20.193.28:0/85115209 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4bc0258f0 con 0x55709f7aab20 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.466+0000 7fe47affd640 1 -- 10.20.193.28:0/85115209 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe4bc011a80 con 0x55709f7aab20 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.466+0000 7fe47affd640 1 -- 10.20.193.28:0/85115209 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe4bc011c40 con 0x55709f7aab20 2026-02-20T13:17:49.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.466+0000 7fe4c9a24e00 10 client.25558 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:49.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.466+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55709f6070e0 con 0x55709f7aab20 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.467+0000 7fe47affd640 1 -- 10.20.193.28:0/85115209 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fe4bc00f630 con 0x55709f7aab20 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.467+0000 7fe4c9a24e00 10 client.25558 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.467+0000 7fe4c9a24e00 10 client.25558 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.467+0000 7fe4c9a24e00 20 client.25558 populate_metadata read hostname 'trial028' 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.467+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55709f7cab30 0x55709f7a88a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.467+0000 7fe4c9a24e00 4 client.25558 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.467+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55709f613f80 con 0x55709f7cab30 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.467+0000 7fe4c579f640 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55709f7cab30 0x55709f7a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.468+0000 7fe4c579f640 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55709f7cab30 0x55709f7a88a0 crc :-1 s=READY pgs=27 gs=3 cs=0 l=0 c_cookie=427188093785967596 s_cookie=17766670707464001905 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5edad4ed6638bec server_cookie=f68fe4e067bad971 in_seq=0 out_seq=0 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.468+0000 7fe47affd640 10 client.25558 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:49.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.468+0000 7fe47affd640 1 -- 10.20.193.28:0/85115209 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55709f613f80 con 0x55709f7cab30 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.468+0000 7fe47affd640 10 client.25558 handle_command_reply: tid=0 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 client.25558 shutdown 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 msgr2=0x55709f7c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f7c49f0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=3971319370767424252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4bc00a720 tx=0x7fe4bc006860 comp rx=0 tx=0).stop 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 shutdown_connections 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55709f7cab30 0x55709f7a88a0 crc :-1 s=READY pgs=27 gs=3 cs=0 l=0 c_cookie=427188093785967596 s_cookie=17766670707464001905 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765c70 0x55709f7c2c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f7c49f0 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=3971319370767424252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/85115209 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c2720 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe47affd640 0 client.25558 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 >> 10.20.193.28:0/85115209 conn(0x55709f743860 msgr2=0x55709f763c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:49.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 shutdown_connections 2026-02-20T13:17:49.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/85115209 wait complete. 2026-02-20T13:17:49.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.469+0000 7fe4c9a24e00 20 client.25558 trim_cache size 0 max 16384 2026-02-20T13:17:49.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c9a24e00 1 Processor -- start 2026-02-20T13:17:49.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c9a24e00 1 -- start start 2026-02-20T13:17:49.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c4980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765c70 0x55709f7bf8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f7aab20 0x55709f7bfdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55709f66f080 con 0x55709f7aab20 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55709f32f700 con 0x55709f765360 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55709f7434d0 con 0x55709f765c70 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c579f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c579f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59390/0 (socket says 10.20.193.28:59390) 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c579f640 1 -- 10.20.193.28:0/2452675395 learned_addr learned my addr 10.20.193.28:0/2452675395 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c4f9e640 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765c70 0x55709f7bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.478+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f7aab20 0x55709f7bfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.479+0000 7fe4c579f640 1 -- 10.20.193.28:0/2452675395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765c70 msgr2=0x55709f7bf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:49.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.479+0000 7fe4c579f640 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765c70 0x55709f7bf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.479+0000 7fe4c579f640 1 -- 10.20.193.28:0/2452675395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f7aab20 msgr2=0x55709f7bfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:49.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.479+0000 7fe4c579f640 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f7aab20 0x55709f7bfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.479+0000 7fe4c579f640 1 -- 10.20.193.28:0/2452675395 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709f601b60 con 0x55709f765360 2026-02-20T13:17:49.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.479+0000 7fe4c579f640 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c4980 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=5952359573295170315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55709f7cb340 tx=0x7fe4b000b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=529b077eb5a7830b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:49.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe48d4e4640 1 -- 10.20.193.28:0/2452675395 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4b0023040 con 0x55709f765360 2026-02-20T13:17:49.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe48d4e4640 1 -- 10.20.193.28:0/2452675395 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4b0015070 con 0x55709f765360 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe48d4e4640 1 -- 10.20.193.28:0/2452675395 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4b001a690 con 0x55709f765360 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/2452675395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 msgr2=0x55709f7c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c4980 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=5952359573295170315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55709f7cb340 tx=0x7fe4b000b000 comp rx=0 tx=0).stop 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/2452675395 shutdown_connections 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f7aab20 0x55709f7bfdf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f765c70 0x55709f7bf8b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/2452675395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765360 0x55709f7c4980 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=5952359573295170315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/2452675395 >> 10.20.193.28:0/2452675395 conn(0x55709f743860 msgr2=0x55709f7c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/2452675395 shutdown_connections 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.480+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/2452675395 wait complete. 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.481+0000 7fe4c9a24e00 1 -- start start 2026-02-20T13:17:49.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.481+0000 7fe4c9a24e00 1 Processor -- start 2026-02-20T13:17:49.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.481+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765360 0x55709f746e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.481+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765c70 0x55709f747370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.481+0000 7fe4c9a24e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f745c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.481+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55709f747950 con 0x55709f765360 2026-02-20T13:17:49.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.481+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55709f747ac0 con 0x55709f765c70 2026-02-20T13:17:49.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.481+0000 7fe4c9a24e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55709f746190 con 0x55709f7aab20 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c4f9e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765c70 0x55709f747370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c4f9e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765c70 0x55709f747370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59392/0 (socket says 10.20.193.28:59392) 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c4f9e640 1 -- 10.20.193.28:0/3891217661 learned_addr learned my addr 10.20.193.28:0/3891217661 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c5fa0640 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f745c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c579f640 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765360 0x55709f746e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c579f640 1 -- 10.20.193.28:0/3891217661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 msgr2=0x55709f745c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c579f640 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f745c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c579f640 1 -- 10.20.193.28:0/3891217661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765c70 msgr2=0x55709f747370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c579f640 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765c70 0x55709f747370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c579f640 1 -- 10.20.193.28:0/3891217661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709f5f56f0 con 0x55709f765360 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.482+0000 7fe4c4f9e640 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765c70 0x55709f747370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:49.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe4c579f640 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765360 0x55709f746e30 secure :-1 s=READY pgs=390 gs=2 cs=0 l=1 c_cookie=12150162986379986787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4b0007e70 tx=0x7fe4b0005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89e0cdc9e474763 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe47affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe47affd640 1 -- 10.20.193.28:0/3891217661 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4b002c070 con 0x55709f765360 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b0011440 con 0x55709f765360 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe4c9a24e00 10 client.15618 _ll_register_callbacks cb 0x55709f5f2a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4bc011910 con 0x55709f765360 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe47affd640 1 -- 10.20.193.28:0/3891217661 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4b001ad00 con 0x55709f765360 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe47affd640 1 -- 10.20.193.28:0/3891217661 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4b00278c0 con 0x55709f765360 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe47affd640 1 -- 10.20.193.28:0/3891217661 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe4b0027a50 con 0x55709f765360 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe47affd640 1 -- 10.20.193.28:0/3891217661 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe4b001c400 con 0x55709f765360 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe4c9a24e00 10 client.15618 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.483+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55709f607340 con 0x55709f765360 2026-02-20T13:17:49.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.484+0000 7fe47affd640 1 -- 10.20.193.28:0/3891217661 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fe4b001a820 con 0x55709f765360 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.484+0000 7fe4c9a24e00 10 client.15618 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.484+0000 7fe4c9a24e00 10 client.15618 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.484+0000 7fe4c9a24e00 20 client.15618 populate_metadata read hostname 'trial028' 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.484+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55709f84a3f0 0x55709f84a890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.484+0000 7fe4c9a24e00 4 client.15618 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.484+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55709f304f40 con 0x55709f84a3f0 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.484+0000 7fe4c4f9e640 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55709f84a3f0 0x55709f84a890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe4c4f9e640 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55709f84a3f0 0x55709f84a890 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=7621905930321388985 s_cookie=5222848792392854398 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69c6730fa03fe5b9 server_cookie=487b494e0a276b7e in_seq=0 out_seq=0 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe47affd640 10 client.15618 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe47affd640 1 -- 10.20.193.28:0/3891217661 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55709f304f40 con 0x55709f84a3f0 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe47affd640 10 client.15618 handle_command_reply: tid=0 2026-02-20T13:17:49.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe4c9a24e00 1 client.15618 shutdown 2026-02-20T13:17:49.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765360 msgr2=0x55709f746e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765360 0x55709f746e30 secure :-1 s=READY pgs=390 gs=2 cs=0 l=1 c_cookie=12150162986379986787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4b0007e70 tx=0x7fe4b0005d00 comp rx=0 tx=0).stop 2026-02-20T13:17:49.492 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:17:49.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 shutdown_connections 2026-02-20T13:17:49.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55709f84a3f0 0x55709f84a890 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=7621905930321388985 s_cookie=5222848792392854398 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55709f7aab20 0x55709f745c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.485+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55709f765c70 0x55709f747370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c9a24e00 1 --2- 10.20.193.28:0/3891217661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709f765360 0x55709f746e30 unknown :-1 s=CLOSED pgs=390 gs=2 cs=0 l=1 c_cookie=12150162986379986787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe47affd640 0 client.15618 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:17:49.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 >> 10.20.193.28:0/3891217661 conn(0x55709f743860 msgr2=0x55709f764050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:49.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 shutdown_connections 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c9a24e00 1 -- 10.20.193.28:0/3891217661 wait complete. 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c9a24e00 20 client.15618 trim_cache size 0 max 16384 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe49c0b57f0 msgr2=0x7fe49c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe49c0b57f0 0x7fe49c0d5ca0 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4b0005c70 tx=0x7fe4b0007480 comp rx=0 tx=0).stop 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4c010dd10 msgr2=0x7fe4c0173de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4c010dd10 0x7fe4c0173de0 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4b4009950 tx=0x7fe4b4002ce0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/1407825285 shutdown_connections 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe49c0b57f0 0x7fe49c0d5ca0 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.486+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4c010dd10 0x7fe4c0173de0 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.487+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4c0113510 0x7fe4c00eb100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.487+0000 7fe4c7a2a640 1 --2- 10.20.193.28:0/1407825285 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4c010d320 0x7fe4c00eee30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:49.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.487+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/1407825285 >> 10.20.193.28:0/1407825285 conn(0x7fe4c00eabb0 msgr2=0x7fe4c0110ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:49.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.487+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/1407825285 shutdown_connections 2026-02-20T13:17:49.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.487+0000 7fe4c7a2a640 1 -- 10.20.193.28:0/1407825285 wait complete. 2026-02-20T13:17:49.593 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:17:49.789 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:49.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.996+0000 7fdff4fdb640 1 -- 10.20.193.28:0/2983666359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 msgr2=0x7fdff0176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:49.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.996+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/2983666359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 0x7fdff0176070 secure :-1 s=READY pgs=391 gs=2 cs=0 l=1 c_cookie=4498455367630310996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe400aa30 tx=0x7fdfe4030270 comp rx=0 tx=0).stop 2026-02-20T13:17:49.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.996+0000 7fdff4fdb640 1 -- 10.20.193.28:0/2983666359 shutdown_connections 2026-02-20T13:17:49.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.996+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/2983666359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 0x7fdff0176070 unknown :-1 s=CLOSED pgs=391 gs=2 cs=0 l=1 c_cookie=4498455367630310996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.996+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/2983666359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdff010fea0 0x7fdff0114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.996+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/2983666359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdff010f4b0 0x7fdff010f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.996+0000 7fdff4fdb640 1 -- 10.20.193.28:0/2983666359 >> 10.20.193.28:0/2983666359 conn(0x7fdff00ecd60 msgr2=0x7fdff010d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:50.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.997+0000 7fdff4fdb640 1 -- 10.20.193.28:0/2983666359 shutdown_connections 2026-02-20T13:17:50.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.997+0000 7fdff4fdb640 1 -- 10.20.193.28:0/2983666359 wait complete. 2026-02-20T13:17:50.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.997+0000 7fdff4fdb640 1 Processor -- start 2026-02-20T13:17:50.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.998+0000 7fdff4fdb640 1 -- start start 2026-02-20T13:17:50.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.998+0000 7fdff4fdb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdff010f4b0 0x7fdff010b030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.998+0000 7fdff4fdb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdff010fea0 0x7fdff0175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdff4fdb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 0x7fdff010b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdff4fdb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdff00ef150 con 0x7fdff01156a0 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdff010fea0 0x7fdff0175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdff4fdb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdff00ef2c0 con 0x7fdff010fea0 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdff4fdb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdff00ef480 con 0x7fdff010f4b0 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdff010fea0 0x7fdff0175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44584/0 (socket says 10.20.193.28:44584) 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeeffd640 1 -- 10.20.193.28:0/4157962493 learned_addr learned my addr 10.20.193.28:0/4157962493 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdff010f4b0 0x7fdff010b030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeeffd640 1 -- 10.20.193.28:0/4157962493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdff010f4b0 msgr2=0x7fdff010b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdff010f4b0 0x7fdff010b030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeeffd640 1 -- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 msgr2=0x7fdff010b730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:17:50.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeffff640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 0x7fdff010b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 0x7fdff010b730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeeffd640 1 -- 10.20.193.28:0/4157962493 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe400a650 con 0x7fdff010fea0 2026-02-20T13:17:50.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:49.999+0000 7fdfeffff640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 0x7fdff010b730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:50.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.000+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdff010fea0 0x7fdff0175f70 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe0009480 tx=0x7fdfe000ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:50.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.000+0000 7fdfecff9640 1 -- 10.20.193.28:0/4157962493 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe000cd40 con 0x7fdff010fea0 2026-02-20T13:17:50.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.000+0000 7fdfecff9640 1 -- 10.20.193.28:0/4157962493 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfe0004d30 con 0x7fdff010fea0 2026-02-20T13:17:50.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.000+0000 7fdfecff9640 1 -- 10.20.193.28:0/4157962493 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe00106b0 con 0x7fdff010fea0 2026-02-20T13:17:50.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.000+0000 7fdff4fdb640 1 -- 10.20.193.28:0/4157962493 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff00ef760 con 0x7fdff010fea0 2026-02-20T13:17:50.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.000+0000 7fdff4fdb640 1 -- 10.20.193.28:0/4157962493 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff00efbe0 con 0x7fdff010fea0 2026-02-20T13:17:50.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.003+0000 7fdfecff9640 1 -- 10.20.193.28:0/4157962493 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fdfe001f060 con 0x7fdff010fea0 2026-02-20T13:17:50.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.005+0000 7fdfecff9640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc40b57e0 0x7fdfc40d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.005+0000 7fdfecff9640 1 -- 10.20.193.28:0/4157962493 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdfe0014070 con 0x7fdff010fea0 2026-02-20T13:17:50.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.005+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc40b57e0 0x7fdfc40d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdff825ee00 1 Processor -- start 2026-02-20T13:17:50.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc40b57e0 0x7fdfc40d5c90 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc004740 tx=0x7fdfdc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:50.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdff825ee00 1 -- start start 2026-02-20T13:17:50.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330d360 0x56325330d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330dc70 0x5632533525e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253372f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdff825ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563253223780 con 0x56325330dc70 2026-02-20T13:17:50.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdff825ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56325321f4b0 con 0x56325330d360 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdff825ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563253219450 con 0x563253352b20 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdfef7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330d360 0x56325330d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdfef7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330d360 0x56325330d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44592/0 (socket says 10.20.193.28:44592) 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.006+0000 7fdfef7fe640 1 -- 10.20.193.28:0/2196501591 learned_addr learned my addr 10.20.193.28:0/2196501591 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.007+0000 7fdfeffff640 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253372f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.007+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330dc70 0x5632533525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.007+0000 7fdfef7fe640 1 -- 10.20.193.28:0/2196501591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 msgr2=0x563253372f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.007+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253372f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.007+0000 7fdfef7fe640 1 -- 10.20.193.28:0/2196501591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330dc70 msgr2=0x5632533525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.007+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330dc70 0x5632533525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.007+0000 7fdfef7fe640 1 -- 10.20.193.28:0/2196501591 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632531c4d10 con 0x56325330d360 2026-02-20T13:17:50.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.007+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330dc70 0x5632533525e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:50.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330d360 0x56325330d730 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=11387669957208282642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc010e00 tx=0x7fdfdc013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e09217ddac99612 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:50.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdfb3fff640 1 -- 10.20.193.28:0/2196501591 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfdc01f670 con 0x56325330d360 2026-02-20T13:17:50.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdfb3fff640 1 -- 10.20.193.28:0/2196501591 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfdc012e70 con 0x56325330d360 2026-02-20T13:17:50.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdfb3fff640 1 -- 10.20.193.28:0/2196501591 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfdc011c50 con 0x56325330d360 2026-02-20T13:17:50.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdff825ee00 1 -- 10.20.193.28:0/2196501591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330d360 msgr2=0x56325330d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdff825ee00 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330d360 0x56325330d730 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=11387669957208282642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc010e00 tx=0x7fdfdc013000 comp rx=0 tx=0).stop 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdff825ee00 1 -- 10.20.193.28:0/2196501591 shutdown_connections 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdff825ee00 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330dc70 0x5632533525e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdff825ee00 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253372f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdff825ee00 1 --2- 10.20.193.28:0/2196501591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330d360 0x56325330d730 unknown :-1 s=CLOSED pgs=162 gs=1 cs=0 l=1 c_cookie=11387669957208282642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.008+0000 7fdff825ee00 1 -- 10.20.193.28:0/2196501591 >> 10.20.193.28:0/2196501591 conn(0x5632532eb860 msgr2=0x56325330bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.009+0000 7fdff825ee00 1 -- 10.20.193.28:0/2196501591 shutdown_connections 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.009+0000 7fdff825ee00 1 -- 10.20.193.28:0/2196501591 wait complete. 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.010+0000 7fdff825ee00 1 -- start start 2026-02-20T13:17:50.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.010+0000 7fdff825ee00 1 Processor -- start 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330d360 0x56325336a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x56325336abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563253352b20 0x56325336fbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdff825ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563253370120 con 0x563253352b20 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdff825ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563253370290 con 0x56325330dc70 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdff825ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563253370450 con 0x56325330d360 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdfef7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330d360 0x56325336a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdfeeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x56325336abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdfeffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563253352b20 0x56325336fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdfeeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x56325336abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44604/0 (socket says 10.20.193.28:44604) 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.011+0000 7fdfeeffd640 1 -- 10.20.193.28:0/1746773679 learned_addr learned my addr 10.20.193.28:0/1746773679 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfeeffd640 1 -- 10.20.193.28:0/1746773679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330d360 msgr2=0x56325336a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330d360 0x56325336a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfeeffd640 1 -- 10.20.193.28:0/1746773679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563253352b20 msgr2=0x56325336fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330d360 0x56325336a6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563253352b20 0x56325336fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfeeffd640 1 -- 10.20.193.28:0/1746773679 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325319d3c0 con 0x56325330dc70 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfeffff640 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563253352b20 0x56325336fbe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x56325336abf0 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=16649328109352566060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe000cf50 tx=0x7fdfe0073650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e70e4bb41ae2bd2c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:50.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.012+0000 7fdfb17fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdfb17fa640 1 -- 10.20.193.28:0/1746773679 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe00b8170 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdfb17fa640 1 -- 10.20.193.28:0/1746773679 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfe00b4040 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdfb17fa640 1 -- 10.20.193.28:0/1746773679 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe00acf30 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfdc010af0 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdfb17fa640 1 -- 10.20.193.28:0/1746773679 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdfe00ad0c0 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdfb17fa640 10 client.25622 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdff825ee00 10 client.25622 _ll_register_callbacks cb 0x56325319aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563252eaf6f0 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdfb17fa640 1 -- 10.20.193.28:0/1746773679 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdfe00b8330 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdff825ee00 10 client.25622 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.013+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5632531af0e0 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdfb17fa640 1 -- 10.20.193.28:0/1746773679 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fdfe00a9b20 con 0x56325330dc70 2026-02-20T13:17:50.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdff825ee00 10 client.25622 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:50.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdff825ee00 10 client.25622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:50.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdff825ee00 20 client.25622 populate_metadata read hostname 'trial028' 2026-02-20T13:17:50.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdff825ee00 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5632533729f0 0x563253372e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdff825ee00 4 client.25622 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:50.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632531bbf80 con 0x5632533729f0 2026-02-20T13:17:50.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5632533729f0 0x563253372e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.014+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5632533729f0 0x563253372e90 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=15226083226486972664 s_cookie=7584035693993111812 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d34dea05f34a20f8 server_cookie=693fe8482057b104 in_seq=0 out_seq=0 2026-02-20T13:17:50.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdfb17fa640 10 client.25622 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:50.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdfb17fa640 1 -- 10.20.193.28:0/1746773679 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5632531bbf80 con 0x5632533729f0 2026-02-20T13:17:50.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdfb17fa640 10 client.25622 handle_command_reply: tid=0 2026-02-20T13:17:50.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdff825ee00 1 client.25622 shutdown 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 msgr2=0x56325336abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdff825ee00 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x56325336abf0 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=16649328109352566060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe000cf50 tx=0x7fdfe0073650 comp rx=0 tx=0).stop 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 shutdown_connections 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdff825ee00 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5632533729f0 0x563253372e90 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=15226083226486972664 s_cookie=7584035693993111812 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.015+0000 7fdff825ee00 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563253352b20 0x56325336fbe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.016+0000 7fdff825ee00 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x56325336abf0 unknown :-1 s=CLOSED pgs=163 gs=3 cs=0 l=1 c_cookie=16649328109352566060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.016+0000 7fdff825ee00 1 --2- 10.20.193.28:0/1746773679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330d360 0x56325336a6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.016+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 >> 10.20.193.28:0/1746773679 conn(0x5632532eb860 msgr2=0x56325330bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.016+0000 7fdfb17fa640 0 client.25622 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.016+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 shutdown_connections 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.016+0000 7fdff825ee00 1 -- 10.20.193.28:0/1746773679 wait complete. 2026-02-20T13:17:50.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.016+0000 7fdff825ee00 20 client.25622 trim_cache size 0 max 16384 2026-02-20T13:17:50.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.023+0000 7fdff825ee00 1 Processor -- start 2026-02-20T13:17:50.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.023+0000 7fdff825ee00 1 -- start start 2026-02-20T13:17:50.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x563253367860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x563253367da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253351c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdff825ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563253217080 con 0x56325330d360 2026-02-20T13:17:50.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdff825ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563252ed7700 con 0x56325330dc70 2026-02-20T13:17:50.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdff825ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563253363540 con 0x563253352b20 2026-02-20T13:17:50.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdfeeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x563253367da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdfeffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253351c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdfeffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253351c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:50586/0 (socket says 10.20.193.28:50586) 2026-02-20T13:17:50.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdfeffff640 1 -- 10.20.193.28:0/4174974576 learned_addr learned my addr 10.20.193.28:0/4174974576 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:50.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.024+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x563253367860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfeeffd640 1 -- 10.20.193.28:0/4174974576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 msgr2=0x563253351c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:50.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253351c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfeeffd640 1 -- 10.20.193.28:0/4174974576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 msgr2=0x563253367860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:50.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x563253367860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfeeffd640 1 -- 10.20.193.28:0/4174974576 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563253370bc0 con 0x56325330dc70 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfeffff640 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253351c50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x563253367860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x563253367da0 secure :-1 s=READY pgs=164 gs=2 cs=0 l=1 c_cookie=8257244441895467683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe00a9fd0 tx=0x7fdfe00e6050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7297a01236bf7aa3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfb37fe640 1 -- 10.20.193.28:0/4174974576 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe00b8170 con 0x56325330dc70 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfb37fe640 1 -- 10.20.193.28:0/4174974576 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfe00b4070 con 0x56325330dc70 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.025+0000 7fdfb37fe640 1 -- 10.20.193.28:0/4174974576 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe00af580 con 0x56325330dc70 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 -- 10.20.193.28:0/4174974576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 msgr2=0x563253367da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x563253367da0 secure :-1 s=READY pgs=164 gs=2 cs=0 l=1 c_cookie=8257244441895467683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe00a9fd0 tx=0x7fdfe00e6050 comp rx=0 tx=0).stop 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 -- 10.20.193.28:0/4174974576 shutdown_connections 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563253352b20 0x563253351c50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56325330dc70 0x563253367da0 unknown :-1 s=CLOSED pgs=164 gs=2 cs=0 l=1 c_cookie=8257244441895467683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 --2- 10.20.193.28:0/4174974576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x563253367860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 -- 10.20.193.28:0/4174974576 >> 10.20.193.28:0/4174974576 conn(0x5632532eb860 msgr2=0x563253354f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:50.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 -- 10.20.193.28:0/4174974576 shutdown_connections 2026-02-20T13:17:50.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.026+0000 7fdff825ee00 1 -- 10.20.193.28:0/4174974576 wait complete. 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdff825ee00 1 -- start start 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdff825ee00 1 Processor -- start 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x5632532f1710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330dc70 0x5632532ee1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdff825ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563253352b20 0x5632532ee6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdff825ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56325336b750 con 0x56325330d360 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdff825ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56325327bae0 con 0x563253352b20 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdff825ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5632532eedd0 con 0x56325330dc70 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdfef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x5632532f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdfef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x5632532f1710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57316/0 (socket says 10.20.193.28:57316) 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdfef7fe640 1 -- 10.20.193.28:0/832657306 learned_addr learned my addr 10.20.193.28:0/832657306 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdfeffff640 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563253352b20 0x5632532ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.027+0000 7fdfeeffd640 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330dc70 0x5632532ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfeffff640 1 -- 10.20.193.28:0/832657306 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330dc70 msgr2=0x5632532ee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfeffff640 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330dc70 0x5632532ee1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfeffff640 1 -- 10.20.193.28:0/832657306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 msgr2=0x5632532f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfeffff640 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x5632532f1710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfeffff640 1 -- 10.20.193.28:0/832657306 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff01768e0 con 0x563253352b20 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfeffff640 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563253352b20 0x5632532ee6e0 secure :-1 s=READY pgs=165 gs=3 cs=0 l=1 c_cookie=17989999787304868518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe4030e20 tx=0x7fdfe40039b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9a9517dcfa8daa6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfb17fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfb17fa640 1 -- 10.20.193.28:0/832657306 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe4040040 con 0x563253352b20 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfb17fa640 1 -- 10.20.193.28:0/832657306 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfe40055a0 con 0x563253352b20 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632531c4d10 con 0x563253352b20 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdff825ee00 10 client.25628 _ll_register_callbacks cb 0x56325319aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:50.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563252f714a0 con 0x563253352b20 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.028+0000 7fdfb17fa640 1 -- 10.20.193.28:0/832657306 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe4047b10 con 0x563253352b20 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdfb17fa640 1 -- 10.20.193.28:0/832657306 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdfe4039b40 con 0x563253352b20 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdfb17fa640 1 -- 10.20.193.28:0/832657306 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdfe4039d20 con 0x563253352b20 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdff825ee00 10 client.25628 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x7fdfe0071020 con 0x563253352b20 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdfb17fa640 1 -- 10.20.193.28:0/832657306 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fdfe404d020 con 0x563253352b20 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdff825ee00 10 client.25628 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdff825ee00 10 client.25628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdff825ee00 20 client.25628 populate_metadata read hostname 'trial028' 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdff825ee00 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5632533b9330 0x5632533e1020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdff825ee00 4 client.25628 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fdfdc012e70 con 0x5632533b9330 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.029+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5632533b9330 0x5632533e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.030+0000 7fdfef7fe640 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5632533b9330 0x5632533e1020 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=14750012902746653649 s_cookie=6473515537316241783 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccb292960ca483d1 server_cookie=59d68c1541b4e177 in_seq=0 out_seq=0 2026-02-20T13:17:50.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.030+0000 7fdfb17fa640 10 client.25628 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:50.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.030+0000 7fdfb17fa640 1 -- 10.20.193.28:0/832657306 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fdfdc012e70 con 0x5632533b9330 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.030+0000 7fdfb17fa640 10 client.25628 handle_command_reply: tid=0 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.030+0000 7fdff825ee00 1 client.25628 shutdown 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.030+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563253352b20 msgr2=0x5632532ee6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.030+0000 7fdff825ee00 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563253352b20 0x5632532ee6e0 secure :-1 s=READY pgs=165 gs=3 cs=0 l=1 c_cookie=17989999787304868518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe4030e20 tx=0x7fdfe40039b0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 shutdown_connections 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5632533b9330 0x5632533e1020 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=14750012902746653649 s_cookie=6473515537316241783 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563253352b20 0x5632532ee6e0 unknown :-1 s=CLOSED pgs=165 gs=3 cs=0 l=1 c_cookie=17989999787304868518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56325330dc70 0x5632532ee1a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 1 --2- 10.20.193.28:0/832657306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56325330d360 0x5632532f1710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdfb17fa640 0 client.25628 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 >> 10.20.193.28:0/832657306 conn(0x5632532eb860 msgr2=0x563253366850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 shutdown_connections 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 1 -- 10.20.193.28:0/832657306 wait complete. 2026-02-20T13:17:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff825ee00 20 client.25628 trim_cache size 0 max 16384 2026-02-20T13:17:50.038 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:17:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 -- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc40b57e0 msgr2=0x7fdfc40d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc40b57e0 0x7fdfc40d5c90 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc004740 tx=0x7fdfdc005f90 comp rx=0 tx=0).stop 2026-02-20T13:17:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 -- 10.20.193.28:0/4157962493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdff010fea0 msgr2=0x7fdff0175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdff010fea0 0x7fdff0175f70 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe0009480 tx=0x7fdfe000ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 -- 10.20.193.28:0/4157962493 shutdown_connections 2026-02-20T13:17:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc40b57e0 0x7fdfc40d5c90 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdff01156a0 0x7fdff010b730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdff010fea0 0x7fdff0175f70 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 --2- 10.20.193.28:0/4157962493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdff010f4b0 0x7fdff010b030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.031+0000 7fdff4fdb640 1 -- 10.20.193.28:0/4157962493 >> 10.20.193.28:0/4157962493 conn(0x7fdff00ecd60 msgr2=0x7fdff0111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.032+0000 7fdff4fdb640 1 -- 10.20.193.28:0/4157962493 shutdown_connections 2026-02-20T13:17:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:50.032+0000 7fdff4fdb640 1 -- 10.20.193.28:0/4157962493 wait complete. 2026-02-20T13:17:50.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:50 trial034 ceph-mon[43332]: pgmap v196: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:50 trial028 ceph-mon[37442]: pgmap v196: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:50 trial127 ceph-mon[43817]: pgmap v196: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:51.147 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:17:51.147 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:17:51.344 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:51.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 -- 10.20.193.28:0/2422230704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810fc20 msgr2=0x7fb278114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 --2- 10.20.193.28:0/2422230704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810fc20 0x7fb278114c70 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=4893062452131562496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb260009950 tx=0x7fb26002f1d0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 -- 10.20.193.28:0/2422230704 shutdown_connections 2026-02-20T13:17:51.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 --2- 10.20.193.28:0/2422230704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810fc20 0x7fb278114c70 unknown :-1 s=CLOSED pgs=392 gs=1 cs=0 l=1 c_cookie=4893062452131562496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 --2- 10.20.193.28:0/2422230704 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb278115420 0x7fb278175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 --2- 10.20.193.28:0/2422230704 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb27810f230 0x7fb27810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 -- 10.20.193.28:0/2422230704 >> 10.20.193.28:0/2422230704 conn(0x7fb27805f830 msgr2=0x7fb27810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:51.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 -- 10.20.193.28:0/2422230704 shutdown_connections 2026-02-20T13:17:51.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.529+0000 7fb27cb21640 1 -- 10.20.193.28:0/2422230704 wait complete. 2026-02-20T13:17:51.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb27cb21640 1 Processor -- start 2026-02-20T13:17:51.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb27cb21640 1 -- start start 2026-02-20T13:17:51.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb27cb21640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810f230 0x7fb2780f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb27cb21640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb27810fc20 0x7fb278175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb27cb21640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb278115420 0x7fb2780f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb27cb21640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780fae90 con 0x7fb27810f230 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb27cb21640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780fb000 con 0x7fb278115420 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb27cb21640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780fb1c0 con 0x7fb27810fc20 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb276575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810f230 0x7fb2780f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb276575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810f230 0x7fb2780f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57334/0 (socket says 10.20.193.28:57334) 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb276575640 1 -- 10.20.193.28:0/3617595502 learned_addr learned my addr 10.20.193.28:0/3617595502 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb276d76640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb278115420 0x7fb2780f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.530+0000 7fb275d74640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb27810fc20 0x7fb278175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb276575640 1 -- 10.20.193.28:0/3617595502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb27810fc20 msgr2=0x7fb278175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb276575640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb27810fc20 0x7fb278175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb276575640 1 -- 10.20.193.28:0/3617595502 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb278115420 msgr2=0x7fb2780f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb276575640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb278115420 0x7fb2780f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb276575640 1 -- 10.20.193.28:0/3617595502 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb260009570 con 0x7fb27810f230 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb275d74640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb27810fc20 0x7fb278175cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb276575640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810f230 0x7fb2780f5580 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb26c009480 tx=0x7fb26c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb25f7fe640 1 -- 10.20.193.28:0/3617595502 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb26c00cd40 con 0x7fb27810f230 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb25f7fe640 1 -- 10.20.193.28:0/3617595502 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb26c004d30 con 0x7fb27810f230 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb25f7fe640 1 -- 10.20.193.28:0/3617595502 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb26c0106b0 con 0x7fb27810f230 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb27cb21640 1 -- 10.20.193.28:0/3617595502 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2780fb4a0 con 0x7fb27810f230 2026-02-20T13:17:51.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.531+0000 7fb27cb21640 1 -- 10.20.193.28:0/3617595502 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2780fb9c0 con 0x7fb27810f230 2026-02-20T13:17:51.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.534+0000 7fb25f7fe640 1 -- 10.20.193.28:0/3617595502 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fb26c01f060 con 0x7fb27810f230 2026-02-20T13:17:51.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.536+0000 7fb25f7fe640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2500b57e0 0x7fb2500d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.536+0000 7fb25f7fe640 1 -- 10.20.193.28:0/3617595502 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb26c014070 con 0x7fb27810f230 2026-02-20T13:17:51.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.536+0000 7fb275d74640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2500b57e0 0x7fb2500d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.536+0000 7fb275d74640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2500b57e0 0x7fb2500d5c90 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2600023d0 tx=0x7fb260031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:51.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.537+0000 7fb27eb1be00 1 Processor -- start 2026-02-20T13:17:51.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.537+0000 7fb27eb1be00 1 -- start start 2026-02-20T13:17:51.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420410 0x5585fb4207e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420d20 0x5585fb465480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb485da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5585fb336a20 con 0x5585fb420410 2026-02-20T13:17:51.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5585fb332750 con 0x5585fb420d20 2026-02-20T13:17:51.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5585fb32c6f0 con 0x5585fb4659c0 2026-02-20T13:17:51.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420410 0x5585fb4207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb485da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420410 0x5585fb4207e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57350/0 (socket says 10.20.193.28:57350) 2026-02-20T13:17:51.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb485da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:50624/0 (socket says 10.20.193.28:50624) 2026-02-20T13:17:51.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276575640 1 -- 10.20.193.28:0/1521904065 learned_addr learned my addr 10.20.193.28:0/1521904065 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:51.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb275d74640 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420d20 0x5585fb465480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276d76640 1 -- 10.20.193.28:0/1521904065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420d20 msgr2=0x5585fb465480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:51.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276d76640 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420d20 0x5585fb465480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276d76640 1 -- 10.20.193.28:0/1521904065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420410 msgr2=0x5585fb4207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:51.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276d76640 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420410 0x5585fb4207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276d76640 1 -- 10.20.193.28:0/1521904065 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585fb2d8120 con 0x5585fb4659c0 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb276575640 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420410 0x5585fb4207e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.538+0000 7fb275d74640 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420d20 0x5585fb465480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb276d76640 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb485da0 secure :-1 s=READY pgs=136 gs=3 cs=0 l=1 c_cookie=15007537021000322005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2680054c0 tx=0x7fb268003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0457b68423f8bd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb25cff9640 1 -- 10.20.193.28:0/1521904065 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb268003d70 con 0x5585fb4659c0 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb25cff9640 1 -- 10.20.193.28:0/1521904065 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb26800ace0 con 0x5585fb4659c0 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb25cff9640 1 -- 10.20.193.28:0/1521904065 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2680117d0 con 0x5585fb4659c0 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 -- 10.20.193.28:0/1521904065 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 msgr2=0x5585fb485da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb485da0 secure :-1 s=READY pgs=136 gs=3 cs=0 l=1 c_cookie=15007537021000322005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2680054c0 tx=0x7fb268003c30 comp rx=0 tx=0).stop 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 -- 10.20.193.28:0/1521904065 shutdown_connections 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb485da0 unknown :-1 s=CLOSED pgs=136 gs=3 cs=0 l=1 c_cookie=15007537021000322005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420d20 0x5585fb465480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/1521904065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420410 0x5585fb4207e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 -- 10.20.193.28:0/1521904065 >> 10.20.193.28:0/1521904065 conn(0x5585fb3fe910 msgr2=0x5585fb41ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:51.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 -- 10.20.193.28:0/1521904065 shutdown_connections 2026-02-20T13:17:51.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.539+0000 7fb27eb1be00 1 -- 10.20.193.28:0/1521904065 wait complete. 2026-02-20T13:17:51.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb27eb1be00 1 -- start start 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb27eb1be00 1 Processor -- start 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb438bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4390f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb43e0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5585fb43e620 con 0x5585fb420d20 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5585fb43e790 con 0x5585fb420410 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5585fb43e950 con 0x5585fb4659c0 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.541+0000 7fb276575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb438bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb438bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44646/0 (socket says 10.20.193.28:44646) 2026-02-20T13:17:51.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276575640 1 -- 10.20.193.28:0/107752052 learned_addr learned my addr 10.20.193.28:0/107752052 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276d76640 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb43e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb275d74640 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276575640 1 -- 10.20.193.28:0/107752052 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 msgr2=0x5585fb43e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276575640 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb43e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276575640 1 -- 10.20.193.28:0/107752052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 msgr2=0x5585fb4390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276575640 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276575640 1 -- 10.20.193.28:0/107752052 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb268005160 con 0x5585fb420410 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb275d74640 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4390f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb276575640 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb438bb0 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=5017716321416542651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb26c009230 tx=0x7fb26c0a9080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a28268c9b679bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb227fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb227fff640 1 -- 10.20.193.28:0/107752052 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb26c0adfa0 con 0x5585fb420410 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb227fff640 1 -- 10.20.193.28:0/107752052 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb26c0adaf0 con 0x5585fb420410 2026-02-20T13:17:51.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb227fff640 1 -- 10.20.193.28:0/107752052 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb26c0721f0 con 0x5585fb420410 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.542+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2780fb9c0 con 0x5585fb420410 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb227fff640 1 -- 10.20.193.28:0/107752052 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb26c072380 con 0x5585fb420410 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb227fff640 10 client.25640 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 10 client.25640 _ll_register_callbacks cb 0x5585fb2e3b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5585fafc29d0 con 0x5585fb420410 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb227fff640 1 -- 10.20.193.28:0/107752052 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb26c06bea0 con 0x5585fb420410 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 10 client.25640 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5585fb2b0810 con 0x5585fb420410 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb227fff640 1 -- 10.20.193.28:0/107752052 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fb26c0ab0d0 con 0x5585fb420410 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 10 client.25640 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 10 client.25640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:51.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 20 client.25640 populate_metadata read hostname 'trial028' 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585fb4634d0 0x5585fb463970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 4 client.25640 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.543+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585fb339df0 con 0x5585fb4634d0 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.544+0000 7fb275d74640 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585fb4634d0 0x5585fb463970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.544+0000 7fb275d74640 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585fb4634d0 0x5585fb463970 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=9066801436010355489 s_cookie=5020067761397713503 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dd3bfde3a661b21 server_cookie=45aadd0812804a5f in_seq=0 out_seq=0 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.544+0000 7fb227fff640 10 client.25640 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb227fff640 1 -- 10.20.193.28:0/107752052 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5585fb339df0 con 0x5585fb4634d0 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb227fff640 10 client.25640 handle_command_reply: tid=0 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 client.25640 shutdown 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 msgr2=0x5585fb438bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb438bb0 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=5017716321416542651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb26c009230 tx=0x7fb26c0a9080 comp rx=0 tx=0).stop 2026-02-20T13:17:51.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 shutdown_connections 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585fb4634d0 0x5585fb463970 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=9066801436010355489 s_cookie=5020067761397713503 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4390f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb227fff640 0 client.25640 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb4659c0 0x5585fb43e0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/107752052 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb438bb0 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=5017716321416542651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 >> 10.20.193.28:0/107752052 conn(0x5585fb3fe910 msgr2=0x5585fb41f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 shutdown_connections 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 1 -- 10.20.193.28:0/107752052 wait complete. 2026-02-20T13:17:51.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.545+0000 7fb27eb1be00 20 client.25640 trim_cache size 0 max 16384 2026-02-20T13:17:51.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.555+0000 7fb27eb1be00 1 Processor -- start 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.555+0000 7fb27eb1be00 1 -- start start 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420410 0x5585fb435f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4364b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb4659c0 0x5585fb45e510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5585fb32a320 con 0x5585fb420d20 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5585fafea790 con 0x5585fb4659c0 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5585fb3bfea0 con 0x5585fb420410 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4364b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57370/0 (socket says 10.20.193.28:57370) 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 -- 10.20.193.28:0/982313431 learned_addr learned my addr 10.20.193.28:0/982313431 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb276575640 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420410 0x5585fb435f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb276d76640 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb4659c0 0x5585fb45e510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 -- 10.20.193.28:0/982313431 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420410 msgr2=0x5585fb435f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420410 0x5585fb435f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 -- 10.20.193.28:0/982313431 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb4659c0 msgr2=0x5585fb45e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb4659c0 0x5585fb45e510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 -- 10.20.193.28:0/982313431 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585fb42aeb0 con 0x5585fb420d20 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb276575640 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420410 0x5585fb435f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:51.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.556+0000 7fb275d74640 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4364b0 secure :-1 s=READY pgs=394 gs=2 cs=0 l=1 c_cookie=15674696910818827597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb26002f6e0 tx=0x7fb26003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d987b5cad344dd4d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb2424e6640 1 -- 10.20.193.28:0/982313431 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb260002d30 con 0x5585fb420d20 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb2424e6640 1 -- 10.20.193.28:0/982313431 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2600550d0 con 0x5585fb420d20 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb2424e6640 1 -- 10.20.193.28:0/982313431 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb260038ba0 con 0x5585fb420d20 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 -- 10.20.193.28:0/982313431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 msgr2=0x5585fb4364b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4364b0 secure :-1 s=READY pgs=394 gs=2 cs=0 l=1 c_cookie=15674696910818827597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb26002f6e0 tx=0x7fb26003b000 comp rx=0 tx=0).stop 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 -- 10.20.193.28:0/982313431 shutdown_connections 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb420d20 0x5585fb4364b0 unknown :-1 s=CLOSED pgs=394 gs=2 cs=0 l=1 c_cookie=15674696910818827597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb4659c0 0x5585fb45e510 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/982313431 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420410 0x5585fb435f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 -- 10.20.193.28:0/982313431 >> 10.20.193.28:0/982313431 conn(0x5585fb3fe910 msgr2=0x5585fb43d730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:51.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 -- 10.20.193.28:0/982313431 shutdown_connections 2026-02-20T13:17:51.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.557+0000 7fb27eb1be00 1 -- 10.20.193.28:0/982313431 wait complete. 2026-02-20T13:17:51.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb27eb1be00 1 -- start start 2026-02-20T13:17:51.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb27eb1be00 1 Processor -- start 2026-02-20T13:17:51.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb43fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420d20 0x5585fb4401e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb27eb1be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb4659c0 0x5585fb512440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5585fb43e1f0 con 0x5585fb4659c0 2026-02-20T13:17:51.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5585fb45fc80 con 0x5585fb420410 2026-02-20T13:17:51.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb27eb1be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5585fb440960 con 0x5585fb420d20 2026-02-20T13:17:51.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb275d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420d20 0x5585fb4401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb275d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420d20 0x5585fb4401e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:50644/0 (socket says 10.20.193.28:50644) 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.558+0000 7fb275d74640 1 -- 10.20.193.28:0/414858862 learned_addr learned my addr 10.20.193.28:0/414858862 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb276575640 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb43fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb276d76640 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb4659c0 0x5585fb512440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb275d74640 1 -- 10.20.193.28:0/414858862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 msgr2=0x5585fb43fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb275d74640 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb43fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb275d74640 1 -- 10.20.193.28:0/414858862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb4659c0 msgr2=0x5585fb512440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb275d74640 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb4659c0 0x5585fb512440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb275d74640 1 -- 10.20.193.28:0/414858862 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585fb2c24f0 con 0x5585fb420d20 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb276d76640 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb4659c0 0x5585fb512440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb275d74640 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420d20 0x5585fb4401e0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=3514813553550292449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb260038560 tx=0x7fb260009320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c7204dff17f5e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb227fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:51.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb227fff640 1 -- 10.20.193.28:0/414858862 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb26002fc10 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb227fff640 1 -- 10.20.193.28:0/414858862 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb260038920 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb227fff640 1 -- 10.20.193.28:0/414858862 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb260055e00 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.559+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb278176660 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb227fff640 1 -- 10.20.193.28:0/414858862 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb2600026a0 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 10 client.25597 _ll_register_callbacks cb 0x5585fb2e3b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5585fb084530 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb227fff640 1 -- 10.20.193.28:0/414858862 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb260038ab0 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 10 client.25597 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5585fb2bcf70 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb227fff640 1 -- 10.20.193.28:0/414858862 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fb26005c070 con 0x5585fb420d20 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 10 client.25597 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 10 client.25597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:51.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 20 client.25597 populate_metadata read hostname 'trial028' 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585fb5142b0 0x5585fb534760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 4 client.25597 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fb26800ace0 con 0x5585fb5142b0 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.560+0000 7fb276575640 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585fb5142b0 0x5585fb534760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.561+0000 7fb276575640 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585fb5142b0 0x5585fb534760 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=14826654097223259297 s_cookie=11587262413890631519 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdc2db58b09514a1 server_cookie=a0ce39c6032fb75f in_seq=0 out_seq=0 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.561+0000 7fb227fff640 10 client.25597 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb227fff640 1 -- 10.20.193.28:0/414858862 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fb26800ace0 con 0x5585fb5142b0 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb227fff640 10 client.25597 handle_command_reply: tid=0 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 client.25597 shutdown 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420d20 msgr2=0x5585fb4401e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420d20 0x5585fb4401e0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=3514813553550292449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb260038560 tx=0x7fb260009320 comp rx=0 tx=0).stop 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 shutdown_connections 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585fb5142b0 0x5585fb534760 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=14826654097223259297 s_cookie=11587262413890631519 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585fb4659c0 0x5585fb512440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585fb420d20 0x5585fb4401e0 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=3514813553550292449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 --2- 10.20.193.28:0/414858862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585fb420410 0x5585fb43fca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 >> 10.20.193.28:0/414858862 conn(0x5585fb3fe910 msgr2=0x5585fb43be10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.562+0000 7fb227fff640 0 client.25597 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.563+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 shutdown_connections 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.563+0000 7fb27eb1be00 1 -- 10.20.193.28:0/414858862 wait complete. 2026-02-20T13:17:51.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.563+0000 7fb27eb1be00 20 client.25597 trim_cache size 0 max 16384 2026-02-20T13:17:51.573 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:17:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "bc028937-4d0d-43c2-ab15-dc51bb66bd30", 2026-02-20T13:17:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:17:51.573 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:51.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.563+0000 7fb27cb21640 1 -- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2500b57e0 msgr2=0x7fb2500d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.563+0000 7fb27cb21640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2500b57e0 0x7fb2500d5c90 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2600023d0 tx=0x7fb260031040 comp rx=0 tx=0).stop 2026-02-20T13:17:51.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.563+0000 7fb27cb21640 1 -- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810f230 msgr2=0x7fb2780f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:51.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.563+0000 7fb27cb21640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810f230 0x7fb2780f5580 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb26c009480 tx=0x7fb26c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:51.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.564+0000 7fb27cb21640 1 -- 10.20.193.28:0/3617595502 shutdown_connections 2026-02-20T13:17:51.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.564+0000 7fb27cb21640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2500b57e0 0x7fb2500d5c90 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.564+0000 7fb27cb21640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb278115420 0x7fb2780f5c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.564+0000 7fb27cb21640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb27810fc20 0x7fb278175cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.564+0000 7fb27cb21640 1 --2- 10.20.193.28:0/3617595502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb27810f230 0x7fb2780f5580 unknown :-1 s=CLOSED pgs=393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:51.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.564+0000 7fb27cb21640 1 -- 10.20.193.28:0/3617595502 >> 10.20.193.28:0/3617595502 conn(0x7fb27805f830 msgr2=0x7fb27810d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:51.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.564+0000 7fb27cb21640 1 -- 10.20.193.28:0/3617595502 shutdown_connections 2026-02-20T13:17:51.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:51.564+0000 7fb27cb21640 1 -- 10.20.193.28:0/3617595502 wait complete. 2026-02-20T13:17:51.671 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:17:51.860 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:17:52.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 -- 10.20.193.28:0/500806959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410d270 msgr2=0x7f5e44111bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 --2- 10.20.193.28:0/500806959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410d270 0x7f5e44111bb0 secure :-1 s=READY pgs=395 gs=2 cs=0 l=1 c_cookie=18254067300784206258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e2c009890 tx=0x7f5e2c02f120 comp rx=0 tx=0).stop 2026-02-20T13:17:52.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 -- 10.20.193.28:0/500806959 shutdown_connections 2026-02-20T13:17:52.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 --2- 10.20.193.28:0/500806959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410d270 0x7f5e44111bb0 unknown :-1 s=CLOSED pgs=395 gs=2 cs=0 l=1 c_cookie=18254067300784206258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 --2- 10.20.193.28:0/500806959 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e44112360 0x7f5e44172d30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 --2- 10.20.193.28:0/500806959 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e4410c880 0x7f5e4410cc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 -- 10.20.193.28:0/500806959 >> 10.20.193.28:0/500806959 conn(0x7f5e440e9160 msgr2=0x7f5e44109570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:52.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 -- 10.20.193.28:0/500806959 shutdown_connections 2026-02-20T13:17:52.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.046+0000 7f5e4948a640 1 -- 10.20.193.28:0/500806959 wait complete. 2026-02-20T13:17:52.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e4948a640 1 Processor -- start 2026-02-20T13:17:52.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e4948a640 1 -- start start 2026-02-20T13:17:52.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e4948a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410c880 0x7f5e44119900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e4948a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e4410d270 0x7f5e44119e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e4948a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e44112360 0x7f5e4411f210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e4948a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4411f830 con 0x7f5e4410c880 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e4948a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4411f9a0 con 0x7f5e44112360 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e4948a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4411fb60 con 0x7f5e4410d270 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410c880 0x7f5e44119900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410c880 0x7f5e44119900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57380/0 (socket says 10.20.193.28:57380) 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e42ffd640 1 -- 10.20.193.28:0/598353301 learned_addr learned my addr 10.20.193.28:0/598353301 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e427fc640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e4410d270 0x7f5e44119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e437fe640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e44112360 0x7f5e4411f210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e42ffd640 1 -- 10.20.193.28:0/598353301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e4410d270 msgr2=0x7f5e44119e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e4410d270 0x7f5e44119e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e42ffd640 1 -- 10.20.193.28:0/598353301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e44112360 msgr2=0x7f5e4411f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e44112360 0x7f5e4411f210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.047+0000 7f5e42ffd640 1 -- 10.20.193.28:0/598353301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0094b0 con 0x7f5e4410c880 2026-02-20T13:17:52.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.048+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410c880 0x7f5e44119900 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e38005940 tx=0x7f5e3800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:52.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.048+0000 7f5e23fff640 1 -- 10.20.193.28:0/598353301 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e3800cd10 con 0x7f5e4410c880 2026-02-20T13:17:52.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.048+0000 7f5e4948a640 1 -- 10.20.193.28:0/598353301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4411fe40 con 0x7f5e4410c880 2026-02-20T13:17:52.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.048+0000 7f5e23fff640 1 -- 10.20.193.28:0/598353301 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e3800ce70 con 0x7f5e4410c880 2026-02-20T13:17:52.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.048+0000 7f5e23fff640 1 -- 10.20.193.28:0/598353301 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e380053c0 con 0x7f5e4410c880 2026-02-20T13:17:52.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.048+0000 7f5e4948a640 1 -- 10.20.193.28:0/598353301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e44160540 con 0x7f5e4410c880 2026-02-20T13:17:52.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.051+0000 7f5e23fff640 1 -- 10.20.193.28:0/598353301 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f5e38005550 con 0x7f5e4410c880 2026-02-20T13:17:52.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.053+0000 7f5e23fff640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e180b57f0 0x7f5e180d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.053+0000 7f5e23fff640 1 -- 10.20.193.28:0/598353301 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e38014070 con 0x7f5e4410c880 2026-02-20T13:17:52.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.053+0000 7f5e427fc640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e180b57f0 0x7f5e180d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.053+0000 7f5e4b484e00 1 Processor -- start 2026-02-20T13:17:52.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.053+0000 7f5e4b484e00 1 -- start start 2026-02-20T13:17:52.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x556289931550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289976400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 0x556289996d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5562898477d0 con 0x556289931180 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556289843500 con 0x556289976940 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55628983d4a0 con 0x556289931a90 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x556289931550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e427fc640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e180b57f0 0x7f5e180d5ca0 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e441202a0 tx=0x7f5e2c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x556289931550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57384/0 (socket says 10.20.193.28:57384) 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e427fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289976400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 -- 10.20.193.28:0/1312995706 learned_addr learned my addr 10.20.193.28:0/1312995706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 -- 10.20.193.28:0/1312995706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 msgr2=0x556289976400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/1312995706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289976400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 -- 10.20.193.28:0/1312995706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 msgr2=0x556289996d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/1312995706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 0x556289996d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 -- 10.20.193.28:0/1312995706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562897e8d80 con 0x556289931180 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e427fc640 1 --2- 10.20.193.28:0/1312995706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289976400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/1312995706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x556289931550 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=10533798013480247729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e380ace20 tx=0x7f5e380a8e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922f917b9934a1b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e0f7fe640 1 -- 10.20.193.28:0/1312995706 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e380b2b60 con 0x556289931180 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e0f7fe640 1 -- 10.20.193.28:0/1312995706 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e380b5140 con 0x556289931180 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.054+0000 7f5e0f7fe640 1 -- 10.20.193.28:0/1312995706 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e380ac9e0 con 0x556289931180 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1312995706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 msgr2=0x556289931550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/1312995706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x556289931550 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=10533798013480247729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e380ace20 tx=0x7f5e380a8e00 comp rx=0 tx=0).stop 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1312995706 shutdown_connections 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/1312995706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 0x556289996d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/1312995706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289976400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/1312995706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x556289931550 unknown :-1 s=CLOSED pgs=397 gs=1 cs=0 l=1 c_cookie=10533798013480247729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1312995706 >> 10.20.193.28:0/1312995706 conn(0x55628990f680 msgr2=0x55628992fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:52.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1312995706 shutdown_connections 2026-02-20T13:17:52.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.055+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1312995706 wait complete. 2026-02-20T13:17:52.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.056+0000 7f5e4b484e00 1 -- start start 2026-02-20T13:17:52.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.056+0000 7f5e4b484e00 1 Processor -- start 2026-02-20T13:17:52.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x556289952560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289952aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289976940 0x556289955450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556289955990 con 0x556289976940 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556289955b00 con 0x556289931180 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556289955cc0 con 0x556289931a90 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x556289952560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x556289952560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44688/0 (socket says 10.20.193.28:44688) 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e42ffd640 1 -- 10.20.193.28:0/2589884942 learned_addr learned my addr 10.20.193.28:0/2589884942 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e427fc640 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289952aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e437fe640 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289976940 0x556289955450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e42ffd640 1 -- 10.20.193.28:0/2589884942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 msgr2=0x556289952aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289952aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e42ffd640 1 -- 10.20.193.28:0/2589884942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289976940 msgr2=0x556289955450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:52.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289976940 0x556289955450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.057+0000 7f5e42ffd640 1 -- 10.20.193.28:0/2589884942 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562897c1350 con 0x556289931180 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x556289952560 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=11820837549108452716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e380aa0b0 tx=0x7f5e380e4590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a40c0d1f16355d6c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e0cff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2589884942 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e380acc00 con 0x556289931180 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e44160540 con 0x556289931180 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e4b484e00 10 client.25655 _ll_register_callbacks cb 0x5562897be9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2589884942 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e380b2b60 con 0x556289931180 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5562894d36f0 con 0x556289931180 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2589884942 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e380b7d50 con 0x556289931180 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2589884942 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e38071fd0 con 0x556289931180 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2589884942 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5e380721b0 con 0x556289931180 2026-02-20T13:17:52.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e4b484e00 10 client.25655 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5562897d3150 con 0x556289931180 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.058+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2589884942 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f5e380aae20 con 0x556289931180 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e4b484e00 10 client.25655 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e4b484e00 10 client.25655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e4b484e00 20 client.25655 populate_metadata read hostname 'trial028' 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55628995c4c0 0x55628995c960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e4b484e00 4 client.25655 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55628984ad60 con 0x55628995c4c0 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e427fc640 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55628995c4c0 0x55628995c960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e427fc640 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55628995c4c0 0x55628995c960 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=956056148549337320 s_cookie=12000438833877561923 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4498006f9c80e8 server_cookie=a68a1f89d2133243 in_seq=0 out_seq=0 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.059+0000 7f5e0cff9640 10 client.25655 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:52.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2589884942 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55628984ad60 con 0x55628995c4c0 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e0cff9640 10 client.25655 handle_command_reply: tid=0 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 client.25655 shutdown 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 msgr2=0x556289952560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x556289952560 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=11820837549108452716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e380aa0b0 tx=0x7f5e380e4590 comp rx=0 tx=0).stop 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 shutdown_connections 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55628995c4c0 0x55628995c960 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=956056148549337320 s_cookie=12000438833877561923 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289976940 0x556289955450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289952aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/2589884942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x556289952560 unknown :-1 s=CLOSED pgs=167 gs=1 cs=0 l=1 c_cookie=11820837549108452716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e0cff9640 0 client.25655 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:52.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 >> 10.20.193.28:0/2589884942 conn(0x55628990f680 msgr2=0x556289918c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:52.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 shutdown_connections 2026-02-20T13:17:52.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 1 -- 10.20.193.28:0/2589884942 wait complete. 2026-02-20T13:17:52.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.060+0000 7f5e4b484e00 20 client.25655 trim_cache size 0 max 16384 2026-02-20T13:17:52.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.070+0000 7f5e4b484e00 1 Processor -- start 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.070+0000 7f5e4b484e00 1 -- start start 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.070+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x55628992e2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.070+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931a90 0x55628992e7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.070+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289976940 0x556289975c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.070+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55628983b0d0 con 0x556289931a90 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.070+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5562894fb700 con 0x556289931180 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.070+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556289956340 con 0x556289976940 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e427fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931a90 0x55628992e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x55628992e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x55628992e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44692/0 (socket says 10.20.193.28:44692) 2026-02-20T13:17:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 -- 10.20.193.28:0/1677526129 learned_addr learned my addr 10.20.193.28:0/1677526129 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e437fe640 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289976940 0x556289975c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 -- 10.20.193.28:0/1677526129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289976940 msgr2=0x556289975c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289976940 0x556289975c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 -- 10.20.193.28:0/1677526129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931a90 msgr2=0x55628992e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931a90 0x55628992e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 -- 10.20.193.28:0/1677526129 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562897cdbd0 con 0x556289931180 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e437fe640 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289976940 0x556289975c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x55628992e2b0 secure :-1 s=READY pgs=168 gs=2 cs=0 l=1 c_cookie=8311249257153194674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e38004d20 tx=0x7f5e38004020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73577d2a1c586ab2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e427fc640 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931a90 0x55628992e7f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e0effd640 1 -- 10.20.193.28:0/1677526129 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e38096640 con 0x556289931180 2026-02-20T13:17:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e0effd640 1 -- 10.20.193.28:0/1677526129 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5562894d36f0 con 0x556289931180 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.071+0000 7f5e0effd640 1 -- 10.20.193.28:0/1677526129 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e38004a00 con 0x556289931180 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1677526129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 msgr2=0x55628992e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x55628992e2b0 secure :-1 s=READY pgs=168 gs=2 cs=0 l=1 c_cookie=8311249257153194674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e38004d20 tx=0x7f5e38004020 comp rx=0 tx=0).stop 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1677526129 shutdown_connections 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931a90 0x55628992e7f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289976940 0x556289975c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/1677526129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289931180 0x55628992e2b0 unknown :-1 s=CLOSED pgs=168 gs=2 cs=0 l=1 c_cookie=8311249257153194674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1677526129 >> 10.20.193.28:0/1677526129 conn(0x55628990f680 msgr2=0x5562899524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1677526129 shutdown_connections 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.072+0000 7f5e4b484e00 1 -- 10.20.193.28:0/1677526129 wait complete. 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.073+0000 7f5e4b484e00 1 -- start start 2026-02-20T13:17:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.073+0000 7f5e4b484e00 1 Processor -- start 2026-02-20T13:17:52.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.073+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x5562899698a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.073+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289969de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.073+0000 7f5e4b484e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 0x55628996a320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.073+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556289929f90 con 0x556289931180 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.073+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55628996e8f0 con 0x556289976940 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.073+0000 7f5e4b484e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55628996eab0 con 0x556289931a90 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289969de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e42ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x5562899698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289969de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:50698/0 (socket says 10.20.193.28:50698) 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 -- 10.20.193.28:0/4137805660 learned_addr learned my addr 10.20.193.28:0/4137805660 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e437fe640 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 0x55628996a320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 -- 10.20.193.28:0/4137805660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 msgr2=0x55628996a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 0x55628996a320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 -- 10.20.193.28:0/4137805660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 msgr2=0x5562899698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x5562899698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 -- 10.20.193.28:0/4137805660 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562897d3150 con 0x556289931a90 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x5562899698a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e427fc640 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289969de0 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=17723161955290966852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e2c005c70 tx=0x7f5e2c002390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5f551e5a1d5eb44 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.074+0000 7f5e0cff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e0cff9640 1 -- 10.20.193.28:0/4137805660 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e2c02fb10 con 0x556289931a90 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e0cff9640 1 -- 10.20.193.28:0/4137805660 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e2c03e040 con 0x556289931a90 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e0cff9640 1 -- 10.20.193.28:0/4137805660 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e2c0386b0 con 0x556289931a90 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e34003a40 con 0x556289931a90 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e0cff9640 1 -- 10.20.193.28:0/4137805660 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e2c038840 con 0x556289931a90 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e0cff9640 10 client.25612 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:17:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 10 client.25612 _ll_register_callbacks cb 0x5562899530c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e380b5140 con 0x556289931a90 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e0cff9640 1 -- 10.20.193.28:0/4137805660 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5e2c02fc70 con 0x556289931a90 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 10 client.25612 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5562897c1680 con 0x556289931a90 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e0cff9640 1 -- 10.20.193.28:0/4137805660 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f5e2c05d070 con 0x556289931a90 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 10 client.25612 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 10 client.25612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 20 client.25612 populate_metadata read hostname 'trial028' 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5562899110a0 0x556289911540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 4 client.25612 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.075+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5562894d0f40 con 0x5562899110a0 2026-02-20T13:17:52.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.076+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5562899110a0 0x556289911540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.076+0000 7f5e42ffd640 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5562899110a0 0x556289911540 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=9456996682695692175 s_cookie=10683913758395293043 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=833e0060aa1fcf8f server_cookie=9444e2f51c0f5d73 in_seq=0 out_seq=0 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.076+0000 7f5e0cff9640 10 client.25612 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.076+0000 7f5e0cff9640 1 -- 10.20.193.28:0/4137805660 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x5562894d0f40 con 0x5562899110a0 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.076+0000 7f5e0cff9640 10 client.25612 handle_command_reply: tid=0 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.076+0000 7f5e4b484e00 1 client.25612 shutdown 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.076+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 msgr2=0x556289969de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.076+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289969de0 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=17723161955290966852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e2c005c70 tx=0x7f5e2c002390 comp rx=0 tx=0).stop 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 shutdown_connections 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5562899110a0 0x556289911540 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=9456996682695692175 s_cookie=10683913758395293043 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556289976940 0x55628996a320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556289931a90 0x556289969de0 unknown :-1 s=CLOSED pgs=138 gs=1 cs=0 l=1 c_cookie=17723161955290966852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 1 --2- 10.20.193.28:0/4137805660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556289931180 0x5562899698a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e0cff9640 0 client.25612 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:52.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 >> 10.20.193.28:0/4137805660 conn(0x55628990f680 msgr2=0x556289975c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:52.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 shutdown_connections 2026-02-20T13:17:52.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 1 -- 10.20.193.28:0/4137805660 wait complete. 2026-02-20T13:17:52.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4b484e00 20 client.25612 trim_cache size 0 max 16384 2026-02-20T13:17:52.085 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:17:52.085 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:17:52.085 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "bc028937-4d0d-43c2-ab15-dc51bb66bd30", 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:17:52.086 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:17:52.087 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:17:52.087 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:17:52.087 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:17:52.087 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:17:52.087 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:17:52.087 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:17:52.087 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:17:52.088 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:17:52.088 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:17:52.088 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:17:52.088 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:17:52.088 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:52.088 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:17:52.088 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:17:52.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4948a640 1 -- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e180b57f0 msgr2=0x7f5e180d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4948a640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e180b57f0 0x7f5e180d5ca0 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e441202a0 tx=0x7f5e2c03a040 comp rx=0 tx=0).stop 2026-02-20T13:17:52.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4948a640 1 -- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410c880 msgr2=0x7f5e44119900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:52.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.077+0000 7f5e4948a640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410c880 0x7f5e44119900 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e38005940 tx=0x7f5e3800ee60 comp rx=0 tx=0).stop 2026-02-20T13:17:52.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.078+0000 7f5e4948a640 1 -- 10.20.193.28:0/598353301 shutdown_connections 2026-02-20T13:17:52.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.078+0000 7f5e4948a640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e180b57f0 0x7f5e180d5ca0 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.078+0000 7f5e4948a640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e44112360 0x7f5e4411f210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.078+0000 7f5e4948a640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e4410d270 0x7f5e44119e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.078+0000 7f5e4948a640 1 --2- 10.20.193.28:0/598353301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4410c880 0x7f5e44119900 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:52.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.078+0000 7f5e4948a640 1 -- 10.20.193.28:0/598353301 >> 10.20.193.28:0/598353301 conn(0x7f5e440e9160 msgr2=0x7f5e44109540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:52.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.078+0000 7f5e4948a640 1 -- 10.20.193.28:0/598353301 shutdown_connections 2026-02-20T13:17:52.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:17:52.078+0000 7f5e4948a640 1 -- 10.20.193.28:0/598353301 wait complete. 2026-02-20T13:17:52.184 INFO:tasks.cephfs.filesystem:scrub status for tag:bc028937-4d0d-43c2-ab15-dc51bb66bd30 - {'path': '/', 'tag': 'bc028937-4d0d-43c2-ab15-dc51bb66bd30', 'options': 'recursive,force'} 2026-02-20T13:17:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:52 trial028 ceph-mon[37442]: pgmap v197: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:52 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:17:52.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:52 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:17:52.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:52 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:52.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:52 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:17:52.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:52 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:52.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:52 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:52 trial127 ceph-mon[43817]: pgmap v197: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:52.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:52 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:17:52.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:52 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:17:52.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:52 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:52.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:52 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:17:52.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:52 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:52.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:52 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:52 trial034 ceph-mon[43332]: pgmap v197: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2026-02-20T13:17:52.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:52 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:17:52.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:52 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:17:52.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:52 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:52.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:52 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:17:52.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:52 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:52.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:52 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:17:54.520 INFO:tasks.workunit.client.0.trial028.stderr:Note: switching to '0917c15888a16c5bbbd9de28990cc81230360c9e'. 2026-02-20T13:17:54.520 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T13:17:54.520 INFO:tasks.workunit.client.0.trial028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-20T13:17:54.520 INFO:tasks.workunit.client.0.trial028.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr:state without impacting any branches by switching back to a branch. 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr: git switch -c 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr:Or undo this operation with: 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr: git switch - 2026-02-20T13:17:54.521 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T13:17:54.522 INFO:tasks.workunit.client.0.trial028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-20T13:17:54.522 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T13:17:54.522 INFO:tasks.workunit.client.0.trial028.stderr:HEAD is now at 0917c15888a Merge PR #61929 into wip-vshankar-testing-20260219.125903 2026-02-20T13:17:54.540 DEBUG:teuthology.orchestra.run.trial028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-20T13:17:54.582 INFO:tasks.workunit.client.0.trial028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-20T13:17:54.587 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T13:17:54.588 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-20T13:17:54.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 -- 10.20.193.28:0/4235060625 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 msgr2=0x7f099810b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 --2- 10.20.193.28:0/4235060625 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 0x7f099810b340 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=8051094953359556066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0988009950 tx=0x7f098802f130 comp rx=0 tx=0).stop 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 -- 10.20.193.28:0/4235060625 shutdown_connections 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 --2- 10.20.193.28:0/4235060625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099810b880 0x7f099810bcf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 --2- 10.20.193.28:0/4235060625 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f099810c230 0x7f099810c6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 --2- 10.20.193.28:0/4235060625 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 0x7f099810b340 unknown :-1 s=CLOSED pgs=169 gs=1 cs=0 l=1 c_cookie=8051094953359556066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 -- 10.20.193.28:0/4235060625 >> 10.20.193.28:0/4235060625 conn(0x7f09980e8f40 msgr2=0x7f0998109350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 -- 10.20.193.28:0/4235060625 shutdown_connections 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.594+0000 7f099ebd2640 1 -- 10.20.193.28:0/4235060625 wait complete. 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099ebd2640 1 Processor -- start 2026-02-20T13:17:54.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099ebd2640 1 -- start start 2026-02-20T13:17:54.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099ebd2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 0x7f09980f4720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099ebd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099810b880 0x7f09980f4d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099ebd2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f099810c230 0x7f09980f5970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099ebd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f09980f6100 con 0x7f099810b880 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099ebd2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f09980f6270 con 0x7f0998060730 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099ebd2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f09980f6430 con 0x7f099810c230 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099d3cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099810b880 0x7f09980f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099e3d1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f099810c230 0x7f09980f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099dbd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 0x7f09980f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099d3cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099810b880 0x7f09980f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57406/0 (socket says 10.20.193.28:57406) 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.595+0000 7f099d3cf640 1 -- 10.20.193.28:0/3704267782 learned_addr learned my addr 10.20.193.28:0/3704267782 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:54.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099d3cf640 1 -- 10.20.193.28:0/3704267782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f099810c230 msgr2=0x7f09980f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099d3cf640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f099810c230 0x7f09980f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099d3cf640 1 -- 10.20.193.28:0/3704267782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 msgr2=0x7f09980f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099d3cf640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 0x7f09980f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099d3cf640 1 -- 10.20.193.28:0/3704267782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098c0094b0 con 0x7f099810b880 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099dbd0640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 0x7f09980f4720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099d3cf640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099810b880 0x7f09980f4d70 secure :-1 s=READY pgs=398 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c009fd0 tx=0x7f098c002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f0986ffd640 1 -- 10.20.193.28:0/3704267782 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098c00ed60 con 0x7f099810b880 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099ebd2640 1 -- 10.20.193.28:0/3704267782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0988009570 con 0x7f099810b880 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f0986ffd640 1 -- 10.20.193.28:0/3704267782 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f098c002e20 con 0x7f099810b880 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f0986ffd640 1 -- 10.20.193.28:0/3704267782 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098c0189f0 con 0x7f099810b880 2026-02-20T13:17:54.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.596+0000 7f099ebd2640 1 -- 10.20.193.28:0/3704267782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09980f6b80 con 0x7f099810b880 2026-02-20T13:17:54.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.599+0000 7f0986ffd640 1 -- 10.20.193.28:0/3704267782 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7f098c016020 con 0x7f099810b880 2026-02-20T13:17:54.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.600+0000 7f0986ffd640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b57f0 0x7f09740d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.600+0000 7f0986ffd640 1 -- 10.20.193.28:0/3704267782 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f098c0e6d20 con 0x7f099810b880 2026-02-20T13:17:54.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.601+0000 7f099dbd0640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b57f0 0x7f09740d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.601+0000 7f099dbd0640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b57f0 0x7f09740d5ca0 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09880098a0 tx=0x7f098803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:54.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.602+0000 7f09a245ce00 1 Processor -- start 2026-02-20T13:17:54.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.602+0000 7f09a245ce00 1 -- start start 2026-02-20T13:17:54.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddf378a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddf581c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddf78ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f09a245ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5565dde2cfd0 con 0x5565ddf174c0 2026-02-20T13:17:54.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f09a245ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5565dde28d00 con 0x5565ddf58700 2026-02-20T13:17:54.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f09a245ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5565dde22ca0 con 0x5565ddf37de0 2026-02-20T13:17:54.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099dbd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddf378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddf581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddf581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:50714/0 (socket says 10.20.193.28:50714) 2026-02-20T13:17:54.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 -- 10.20.193.28:0/3688451637 learned_addr learned my addr 10.20.193.28:0/3688451637 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099e3d1640 1 --2- 10.20.193.28:0/3688451637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddf78ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 -- 10.20.193.28:0/3688451637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 msgr2=0x5565ddf78ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 --2- 10.20.193.28:0/3688451637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddf78ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 -- 10.20.193.28:0/3688451637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 msgr2=0x5565ddf378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 --2- 10.20.193.28:0/3688451637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddf378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 -- 10.20.193.28:0/3688451637 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565dddc58b0 con 0x5565ddf37de0 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f099d3cf640 1 --2- 10.20.193.28:0/3688451637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddf581c0 secure :-1 s=READY pgs=139 gs=2 cs=0 l=1 c_cookie=14805652618689368994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c0a94f0 tx=0x7f098c002390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd783e9ceccfd3a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f0965bfe640 1 -- 10.20.193.28:0/3688451637 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098c0b2c40 con 0x5565ddf37de0 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f0965bfe640 1 -- 10.20.193.28:0/3688451637 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f098c0b5220 con 0x5565ddf37de0 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.603+0000 7f0965bfe640 1 -- 10.20.193.28:0/3688451637 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098c0acac0 con 0x5565ddf37de0 2026-02-20T13:17:54.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 -- 10.20.193.28:0/3688451637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 msgr2=0x5565ddf581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 --2- 10.20.193.28:0/3688451637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddf581c0 secure :-1 s=READY pgs=139 gs=2 cs=0 l=1 c_cookie=14805652618689368994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c0a94f0 tx=0x7f098c002390 comp rx=0 tx=0).stop 2026-02-20T13:17:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 -- 10.20.193.28:0/3688451637 shutdown_connections 2026-02-20T13:17:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 --2- 10.20.193.28:0/3688451637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddf78ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 --2- 10.20.193.28:0/3688451637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddf581c0 unknown :-1 s=CLOSED pgs=139 gs=2 cs=0 l=1 c_cookie=14805652618689368994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 --2- 10.20.193.28:0/3688451637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddf378a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 -- 10.20.193.28:0/3688451637 >> 10.20.193.28:0/3688451637 conn(0x5565dde361c0 msgr2=0x5565ddf15da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 -- 10.20.193.28:0/3688451637 shutdown_connections 2026-02-20T13:17:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.604+0000 7f09a245ce00 1 -- 10.20.193.28:0/3688451637 wait complete. 2026-02-20T13:17:54.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.605+0000 7f09a245ce00 1 -- start start 2026-02-20T13:17:54.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.605+0000 7f09a245ce00 1 Processor -- start 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf37de0 0x5565ddef7370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf58700 0x5565ddef7dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f09a245ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5565ddef8430 con 0x5565ddf174c0 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099dbd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099dbd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57420/0 (socket says 10.20.193.28:57420) 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099dbd0640 1 -- 10.20.193.28:0/1092894969 learned_addr learned my addr 10.20.193.28:0/1092894969 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099d3cf640 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf37de0 0x5565ddef7370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5565ddef85a0 con 0x5565ddf37de0 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5565ddef8760 con 0x5565ddf58700 2026-02-20T13:17:54.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099e3d1640 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf58700 0x5565ddef7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099dbd0640 1 -- 10.20.193.28:0/1092894969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf58700 msgr2=0x5565ddef7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099dbd0640 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf58700 0x5565ddef7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099dbd0640 1 -- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf37de0 msgr2=0x5565ddef7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099dbd0640 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf37de0 0x5565ddef7370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099dbd0640 1 -- 10.20.193.28:0/1092894969 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565dddce400 con 0x5565ddf174c0 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.606+0000 7f099d3cf640 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf37de0 0x5565ddef7370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f099dbd0640 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6d20 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=3221974995092642058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0988005b00 tx=0x7f0988002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb6c12ff1b0190a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f094effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f094effd640 1 -- 10.20.193.28:0/1092894969 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098802fea0 con 0x5565ddf174c0 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f094effd640 1 -- 10.20.193.28:0/1092894969 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f098803e040 con 0x5565ddf174c0 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f094effd640 1 -- 10.20.193.28:0/1092894969 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09880509e0 con 0x5565ddf174c0 2026-02-20T13:17:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09980f6b80 con 0x5565ddf174c0 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f094effd640 1 -- 10.20.193.28:0/1092894969 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0988050b70 con 0x5565ddf174c0 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f09a245ce00 10 client.15675 _ll_register_callbacks cb 0x5565dddada40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5565ddac2520 con 0x5565ddf174c0 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.607+0000 7f094effd640 1 -- 10.20.193.28:0/1092894969 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0988038470 con 0x5565ddf174c0 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f09a245ce00 10 client.15675 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5565ddda6da0 con 0x5565ddf174c0 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f094effd640 1 -- 10.20.193.28:0/1092894969 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f0988060020 con 0x5565ddf174c0 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f09a245ce00 10 client.15675 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f09a245ce00 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f09a245ce00 20 client.15675 populate_metadata read hostname 'trial028' 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f09a245ce00 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565ddefd390 0x5565ddefd830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f09a245ce00 4 client.15675 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:17:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565dde54630 con 0x5565ddefd390 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.608+0000 7f099d3cf640 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565ddefd390 0x5565ddefd830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f099d3cf640 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565ddefd390 0x5565ddefd830 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=10801965032309615963 s_cookie=1625596688650175470 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95e849f733016d5b server_cookie=168f4793570b83ee in_seq=0 out_seq=0 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f094effd640 10 client.15675 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f094effd640 1 -- 10.20.193.28:0/1092894969 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5565dde54630 con 0x5565ddefd390 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f094effd640 10 client.15675 handle_command_reply: tid=0 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 client.15675 shutdown 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 msgr2=0x5565ddef6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6d20 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=3221974995092642058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0988005b00 tx=0x7f0988002390 comp rx=0 tx=0).stop 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 shutdown_connections 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565ddefd390 0x5565ddefd830 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=10801965032309615963 s_cookie=1625596688650175470 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf58700 0x5565ddef7dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf37de0 0x5565ddef7370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 --2- 10.20.193.28:0/1092894969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6d20 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=3221974995092642058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f094effd640 0 client.15675 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:54.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 >> 10.20.193.28:0/1092894969 conn(0x5565dde361c0 msgr2=0x5565ddf211a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:54.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 shutdown_connections 2026-02-20T13:17:54.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.609+0000 7f09a245ce00 1 -- 10.20.193.28:0/1092894969 wait complete. 2026-02-20T13:17:54.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.610+0000 7f09a245ce00 20 client.15675 trim_cache size 0 max 16384 2026-02-20T13:17:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.617+0000 7f09a245ce00 1 Processor -- start 2026-02-20T13:17:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.617+0000 7f09a245ce00 1 -- start start 2026-02-20T13:17:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.617+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf174c0 0x5565ddf24600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.617+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddef5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.617+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf58700 0x5565ddf166b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.617+0000 7f09a245ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5565dde208d0 con 0x5565ddf58700 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.617+0000 7f09a245ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5565ddb61f10 con 0x5565ddf174c0 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.617+0000 7f09a245ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5565dde86490 con 0x5565ddf37de0 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf58700 0x5565ddf166b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf58700 0x5565ddf166b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57430/0 (socket says 10.20.193.28:57430) 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 -- 10.20.193.28:0/3480045852 learned_addr learned my addr 10.20.193.28:0/3480045852 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099dbd0640 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf174c0 0x5565ddf24600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099d3cf640 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddef5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 -- 10.20.193.28:0/3480045852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 msgr2=0x5565ddef5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddef5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 -- 10.20.193.28:0/3480045852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf174c0 msgr2=0x5565ddf24600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf174c0 0x5565ddf24600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 -- 10.20.193.28:0/3480045852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565dddb8670 con 0x5565ddf58700 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f099e3d1640 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf58700 0x5565ddf166b0 secure :-1 s=READY pgs=400 gs=2 cs=0 l=1 c_cookie=3070697688657489544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0994005770 tx=0x7f0994004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9d4f47510aee88 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f09653fd640 1 -- 10.20.193.28:0/3480045852 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099400ad80 con 0x5565ddf58700 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f09653fd640 1 -- 10.20.193.28:0/3480045852 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0994019040 con 0x5565ddf58700 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f09653fd640 1 -- 10.20.193.28:0/3480045852 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099401d9e0 con 0x5565ddf58700 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f09a245ce00 1 -- 10.20.193.28:0/3480045852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf58700 msgr2=0x5565ddf166b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.618+0000 7f09a245ce00 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf58700 0x5565ddf166b0 secure :-1 s=READY pgs=400 gs=2 cs=0 l=1 c_cookie=3070697688657489544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0994005770 tx=0x7f0994004d10 comp rx=0 tx=0).stop 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 -- 10.20.193.28:0/3480045852 shutdown_connections 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf58700 0x5565ddf166b0 unknown :-1 s=CLOSED pgs=400 gs=2 cs=0 l=1 c_cookie=3070697688657489544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddef5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 --2- 10.20.193.28:0/3480045852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf174c0 0x5565ddf24600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 -- 10.20.193.28:0/3480045852 >> 10.20.193.28:0/3480045852 conn(0x5565dde361c0 msgr2=0x5565ddef55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:54.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 -- 10.20.193.28:0/3480045852 shutdown_connections 2026-02-20T13:17:54.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 -- 10.20.193.28:0/3480045852 wait complete. 2026-02-20T13:17:54.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 -- start start 2026-02-20T13:17:54.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 Processor -- start 2026-02-20T13:17:54.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddef6b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddeff220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5565ddeff920 con 0x5565ddf174c0 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5565ddeffa90 con 0x5565ddf58700 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.619+0000 7f09a245ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5565ddeffc50 con 0x5565ddf37de0 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddeff220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddeff220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44738/0 (socket says 10.20.193.28:44738) 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099d3cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddef6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 -- 10.20.193.28:0/4219186173 learned_addr learned my addr 10.20.193.28:0/4219186173 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099dbd0640 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 -- 10.20.193.28:0/4219186173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 msgr2=0x5565ddef6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddef6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 -- 10.20.193.28:0/4219186173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 msgr2=0x5565ddef6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 -- 10.20.193.28:0/4219186173 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565dddb30f0 con 0x5565ddf58700 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f099e3d1640 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddeff220 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=8107274645406209155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099400a530 tx=0x7f099401dd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7082d355f7f7d483 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f094effd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f094effd640 1 -- 10.20.193.28:0/4219186173 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0994011ea0 con 0x5565ddf58700 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0994005410 con 0x5565ddf58700 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f09a245ce00 10 client.25679 _ll_register_callbacks cb 0x5565dddada40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5565dded2ca0 con 0x5565ddf58700 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f094effd640 1 -- 10.20.193.28:0/4219186173 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0994005d00 con 0x5565ddf58700 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f094effd640 1 -- 10.20.193.28:0/4219186173 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0994011430 con 0x5565ddf58700 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.620+0000 7f094effd640 1 -- 10.20.193.28:0/4219186173 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f09940115c0 con 0x5565ddf58700 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f094effd640 1 -- 10.20.193.28:0/4219186173 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f09940117a0 con 0x5565ddf58700 2026-02-20T13:17:54.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f09a245ce00 10 client.25679 fetch_fsmap learned FSMap version 26 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5565ddda70d0 con 0x5565ddf58700 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f094effd640 1 -- 10.20.193.28:0/4219186173 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f0994011900 con 0x5565ddf58700 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f09a245ce00 10 client.25679 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f09a245ce00 10 client.25679 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f09a245ce00 20 client.25679 populate_metadata read hostname 'trial028' 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f09a245ce00 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565ddf01b80 0x5565ddf02020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f09a245ce00 4 client.25679 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5565ddb06640 con 0x5565ddf01b80 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.621+0000 7f099dbd0640 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565ddf01b80 0x5565ddf02020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.622+0000 7f099dbd0640 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565ddf01b80 0x5565ddf02020 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=17811538672803837372 s_cookie=2261635431401996584 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f72f4c0da79af5bc server_cookie=1f62f17134274128 in_seq=0 out_seq=0 2026-02-20T13:17:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.622+0000 7f094effd640 10 client.25679 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.624+0000 7f094effd640 1 -- 10.20.193.28:0/4219186173 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5565ddb06640 con 0x5565ddf01b80 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.624+0000 7f094effd640 10 client.25679 handle_command_reply: tid=0 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.624+0000 7f09a245ce00 1 client.25679 shutdown 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 msgr2=0x5565ddeff220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddeff220 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=8107274645406209155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099400a530 tx=0x7f099401dd80 comp rx=0 tx=0).stop 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 shutdown_connections 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565ddf01b80 0x5565ddf02020 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=17811538672803837372 s_cookie=2261635431401996584 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565ddf58700 0x5565ddeff220 unknown :-1 s=CLOSED pgs=170 gs=1 cs=0 l=1 c_cookie=8107274645406209155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565ddf37de0 0x5565ddef6b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 --2- 10.20.193.28:0/4219186173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565ddf174c0 0x5565ddef6520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f094effd640 0 client.25679 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:17:54.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 >> 10.20.193.28:0/4219186173 conn(0x5565dde361c0 msgr2=0x5565ddf166b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:54.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 shutdown_connections 2026-02-20T13:17:54.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 1 -- 10.20.193.28:0/4219186173 wait complete. 2026-02-20T13:17:54.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.625+0000 7f09a245ce00 20 client.25679 trim_cache size 0 max 16384 2026-02-20T13:17:54.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:17:54.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:17:54.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:17:54.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:17:54.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 -- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b57f0 msgr2=0x7f09740d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b57f0 0x7f09740d5ca0 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09880098a0 tx=0x7f098803a040 comp rx=0 tx=0).stop 2026-02-20T13:17:54.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 -- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099810b880 msgr2=0x7f09980f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099810b880 0x7f09980f4d70 secure :-1 s=READY pgs=398 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c009fd0 tx=0x7f098c002bc0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 -- 10.20.193.28:0/3704267782 shutdown_connections 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09740b57f0 0x7f09740d5ca0 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099810b880 0x7f09980f4d70 unknown :-1 s=CLOSED pgs=398 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f099810c230 0x7f09980f5970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 --2- 10.20.193.28:0/3704267782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998060730 0x7f09980f4720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 -- 10.20.193.28:0/3704267782 >> 10.20.193.28:0/3704267782 conn(0x7f09980e8f40 msgr2=0x7f09980eabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 -- 10.20.193.28:0/3704267782 shutdown_connections 2026-02-20T13:17:54.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:17:54.626+0000 7f099ebd2640 1 -- 10.20.193.28:0/3704267782 wait complete. 2026-02-20T13:17:54.745 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-20T13:17:54.807 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-20T13:17:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:54 trial028 ceph-mon[37442]: pgmap v198: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 11 op/s 2026-02-20T13:17:54.859 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T13:17:54.863 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T13:17:54.863 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-20T13:17:54.915 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T13:17:54.922 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:17:54.922 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-20T13:17:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:54 trial127 ceph-mon[43817]: pgmap v198: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 11 op/s 2026-02-20T13:17:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:54 trial034 ceph-mon[43332]: pgmap v198: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 11 op/s 2026-02-20T13:17:55.002 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2026-02-20T13:17:55.005 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2026-02-20T13:17:55.005 DEBUG:teuthology.orchestra.run.trial028:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2026-02-20T13:17:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:56 trial028 ceph-mon[37442]: pgmap v199: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:17:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:56 trial127 ceph-mon[43817]: pgmap v199: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:17:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:56 trial034 ceph-mon[43332]: pgmap v199: 97 pgs: 97 active+clean; 684 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:17:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:17:58 trial028 ceph-mon[37442]: pgmap v200: 97 pgs: 97 active+clean; 687 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:17:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:17:58 trial127 ceph-mon[43817]: pgmap v200: 97 pgs: 97 active+clean; 687 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:17:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:17:58 trial034 ceph-mon[43332]: pgmap v200: 97 pgs: 97 active+clean; 687 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:18:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:00 trial028 ceph-mon[37442]: pgmap v201: 97 pgs: 97 active+clean; 687 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:18:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:00 trial127 ceph-mon[43817]: pgmap v201: 97 pgs: 97 active+clean; 687 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:18:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:00 trial034 ceph-mon[43332]: pgmap v201: 97 pgs: 97 active+clean; 687 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:18:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:02 trial028 ceph-mon[37442]: pgmap v202: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 853 B/s wr, 12 op/s 2026-02-20T13:18:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:02 trial127 ceph-mon[43817]: pgmap v202: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 853 B/s wr, 12 op/s 2026-02-20T13:18:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:02 trial034 ceph-mon[43332]: pgmap v202: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 853 B/s wr, 12 op/s 2026-02-20T13:18:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:04 trial028 ceph-mon[37442]: pgmap v203: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-20T13:18:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:04 trial127 ceph-mon[43817]: pgmap v203: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-20T13:18:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:04 trial034 ceph-mon[43332]: pgmap v203: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-20T13:18:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:06 trial028 ceph-mon[37442]: pgmap v204: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:18:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:06 trial127 ceph-mon[43817]: pgmap v204: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:18:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:06 trial034 ceph-mon[43332]: pgmap v204: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:18:07.656 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:18:07.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 -- 10.20.193.28:0/1535707810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10dd00 msgr2=0x7ff3fc10aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 --2- 10.20.193.28:0/1535707810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10dd00 0x7ff3fc10aec0 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=18131603171138770608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3f0009950 tx=0x7ff3f002f190 comp rx=0 tx=0).stop 2026-02-20T13:18:07.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 -- 10.20.193.28:0/1535707810 shutdown_connections 2026-02-20T13:18:07.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 --2- 10.20.193.28:0/1535707810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10dd00 0x7ff3fc10aec0 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=18131603171138770608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 --2- 10.20.193.28:0/1535707810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3fc10b510 0x7ff3fc10b9b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 --2- 10.20.193.28:0/1535707810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3fc10d340 0x7ff3fc10d730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 -- 10.20.193.28:0/1535707810 >> 10.20.193.28:0/1535707810 conn(0x7ff3fc0e8a80 msgr2=0x7ff3fc108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:07.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 -- 10.20.193.28:0/1535707810 shutdown_connections 2026-02-20T13:18:07.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.697+0000 7ff402fd2640 1 -- 10.20.193.28:0/1535707810 wait complete. 2026-02-20T13:18:07.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.698+0000 7ff402fd2640 1 Processor -- start 2026-02-20T13:18:07.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.698+0000 7ff402fd2640 1 -- start start 2026-02-20T13:18:07.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.698+0000 7ff402fd2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3fc10b510 0x7ff3fc0f4460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.698+0000 7ff402fd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10d340 0x7ff3fc0f4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.698+0000 7ff402fd2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3fc10dd00 0x7ff3fc0f56b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.698+0000 7ff402fd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0f5df0 con 0x7ff3fc10d340 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.698+0000 7ff402fd2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0f5f60 con 0x7ff3fc10b510 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.698+0000 7ff402fd2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0f6120 con 0x7ff3fc10dd00 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10d340 0x7ff3fc0f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff401fd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3fc10b510 0x7ff3fc0f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10d340 0x7ff3fc0f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36574/0 (socket says 10.20.193.28:36574) 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 -- 10.20.193.28:0/2182757468 learned_addr learned my addr 10.20.193.28:0/2182757468 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4027d1640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3fc10dd00 0x7ff3fc0f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 -- 10.20.193.28:0/2182757468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3fc10dd00 msgr2=0x7ff3fc0f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3fc10dd00 0x7ff3fc0f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 -- 10.20.193.28:0/2182757468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3fc10b510 msgr2=0x7ff3fc0f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3fc10b510 0x7ff3fc0f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 -- 10.20.193.28:0/2182757468 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f0009570 con 0x7ff3fc10d340 2026-02-20T13:18:07.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff401fd0640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3fc10b510 0x7ff3fc0f4460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:07.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff4017cf640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10d340 0x7ff3fc0f4ab0 secure :-1 s=READY pgs=402 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3f0002d80 tx=0x7ff3f00028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:07.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff3eaffd640 1 -- 10.20.193.28:0/2182757468 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3f003d070 con 0x7ff3fc10d340 2026-02-20T13:18:07.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff3eaffd640 1 -- 10.20.193.28:0/2182757468 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3f0002a40 con 0x7ff3fc10d340 2026-02-20T13:18:07.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff3eaffd640 1 -- 10.20.193.28:0/2182757468 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3f0041ba0 con 0x7ff3fc10d340 2026-02-20T13:18:07.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff402fd2640 1 -- 10.20.193.28:0/2182757468 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc0f63a0 con 0x7ff3fc10d340 2026-02-20T13:18:07.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.699+0000 7ff402fd2640 1 -- 10.20.193.28:0/2182757468 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc0f68c0 con 0x7ff3fc10d340 2026-02-20T13:18:07.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.702+0000 7ff3eaffd640 1 -- 10.20.193.28:0/2182757468 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7ff3f0038920 con 0x7ff3fc10d340 2026-02-20T13:18:07.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.704+0000 7ff3eaffd640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3d80b5770 0x7ff3d80d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.704+0000 7ff3eaffd640 1 -- 10.20.193.28:0/2182757468 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff3f010b530 con 0x7ff3fc10d340 2026-02-20T13:18:07.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.704+0000 7ff401fd0640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3d80b5770 0x7ff3d80d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff401fd0640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3d80b5770 0x7ff3d80d5c20 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3ec004740 tx=0x7ff3ec0043a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff40686ee00 1 Processor -- start 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff40686ee00 1 -- start start 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f4d2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f6dbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 0x55a700f8e4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff40686ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a700e39fd0 con 0x55a700f2ced0 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff40686ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a700e35d00 con 0x55a700f4d7f0 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff40686ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a700e2fca0 con 0x55a700f6e110 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff401fd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f4d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff4017cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f6dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff4017cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f6dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35578/0 (socket says 10.20.193.28:35578) 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff4017cf640 1 -- 10.20.193.28:0/2193220793 learned_addr learned my addr 10.20.193.28:0/2193220793 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff4027d1640 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 0x55a700f8e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.705+0000 7ff401fd0640 1 -- 10.20.193.28:0/2193220793 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 msgr2=0x55a700f8e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff401fd0640 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 0x55a700f8e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff401fd0640 1 -- 10.20.193.28:0/2193220793 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 msgr2=0x55a700f6dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff401fd0640 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f6dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff401fd0640 1 -- 10.20.193.28:0/2193220793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a700dd28b0 con 0x55a700f2ced0 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff4017cf640 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f6dbd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff401fd0640 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f4d2b0 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=7041007332629368667 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3ec004690 tx=0x7ff3ec012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b6aedd3a4b4f5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff3ca3ff640 1 -- 10.20.193.28:0/2193220793 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3ec004190 con 0x55a700f2ced0 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff3ca3ff640 1 -- 10.20.193.28:0/2193220793 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3ec011e30 con 0x55a700f2ced0 2026-02-20T13:18:07.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff3ca3ff640 1 -- 10.20.193.28:0/2193220793 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3ec010b60 con 0x55a700f2ced0 2026-02-20T13:18:07.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 -- 10.20.193.28:0/2193220793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 msgr2=0x55a700f4d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f4d2b0 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=7041007332629368667 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3ec004690 tx=0x7ff3ec012000 comp rx=0 tx=0).stop 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 -- 10.20.193.28:0/2193220793 shutdown_connections 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 0x55a700f8e4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f6dbd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 --2- 10.20.193.28:0/2193220793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f4d2b0 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=7041007332629368667 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 -- 10.20.193.28:0/2193220793 >> 10.20.193.28:0/2193220793 conn(0x55a700e431c0 msgr2=0x55a700f22da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 -- 10.20.193.28:0/2193220793 shutdown_connections 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.706+0000 7ff40686ee00 1 -- 10.20.193.28:0/2193220793 wait complete. 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.708+0000 7ff40686ee00 1 -- start start 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.708+0000 7ff40686ee00 1 Processor -- start 2026-02-20T13:18:07.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.708+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f464b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.708+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f46b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.708+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 0x55a700f47560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.708+0000 7ff40686ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a700f47bc0 con 0x55a700f2ced0 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.708+0000 7ff40686ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a700f47d30 con 0x55a700f4d7f0 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.708+0000 7ff40686ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a700f47ef0 con 0x55a700f6e110 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36606/0 (socket says 10.20.193.28:36606) 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 -- 10.20.193.28:0/3447852528 learned_addr learned my addr 10.20.193.28:0/3447852528 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff4017cf640 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f46b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff4027d1640 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 0x55a700f47560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 -- 10.20.193.28:0/3447852528 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 msgr2=0x55a700f47560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:07.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 0x55a700f47560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 -- 10.20.193.28:0/3447852528 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 msgr2=0x55a700f46b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f46b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 -- 10.20.193.28:0/3447852528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a700ddb400 con 0x55a700f2ced0 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff401fd0640 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f464b0 secure :-1 s=READY pgs=404 gs=2 cs=0 l=1 c_cookie=595921492946917927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3ec005800 tx=0x7ff3ec01ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8452370c51f1a27 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff3b77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff3b77fe640 1 -- 10.20.193.28:0/3447852528 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3ec010cf0 con 0x55a700f2ced0 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff3b77fe640 1 -- 10.20.193.28:0/3447852528 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3ec010e50 con 0x55a700f2ced0 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff3b77fe640 1 -- 10.20.193.28:0/3447852528 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3ec0346c0 con 0x55a700f2ced0 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.709+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ec00f9e0 con 0x55a700f2ced0 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff3b77fe640 1 -- 10.20.193.28:0/3447852528 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff3ec01ed20 con 0x55a700f2ced0 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff3b77fe640 10 client.15693 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:07.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 10 client.15693 _ll_register_callbacks cb 0x55a700dbaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a700acf520 con 0x55a700f2ced0 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff3b77fe640 1 -- 10.20.193.28:0/3447852528 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff3ec0108c0 con 0x55a700f2ced0 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 10 client.15693 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a700db3da0 con 0x55a700f2ced0 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff3b77fe640 1 -- 10.20.193.28:0/3447852528 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7ff3ec01e460 con 0x55a700f2ced0 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 10 client.15693 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 20 client.15693 populate_metadata read hostname 'trial028' 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a700f4ac10 0x55a700f4b0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 4 client.15693 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a700e61630 con 0x55a700f4ac10 2026-02-20T13:18:07.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.710+0000 7ff4017cf640 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a700f4ac10 0x55a700f4b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.711+0000 7ff4017cf640 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a700f4ac10 0x55a700f4b0b0 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=17105559596271813025 s_cookie=14216879448223275987 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed6327d2dc0e41a1 server_cookie=c54c8088ade65bd3 in_seq=0 out_seq=0 2026-02-20T13:18:07.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.711+0000 7ff3b77fe640 10 client.15693 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.711+0000 7ff3b77fe640 1 -- 10.20.193.28:0/3447852528 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a700e61630 con 0x55a700f4ac10 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.711+0000 7ff3b77fe640 10 client.15693 handle_command_reply: tid=0 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.711+0000 7ff40686ee00 1 client.15693 shutdown 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.711+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 msgr2=0x55a700f464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.711+0000 7ff40686ee00 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f464b0 secure :-1 s=READY pgs=404 gs=2 cs=0 l=1 c_cookie=595921492946917927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3ec005800 tx=0x7ff3ec01ff60 comp rx=0 tx=0).stop 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 shutdown_connections 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a700f4ac10 0x55a700f4b0b0 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=17105559596271813025 s_cookie=14216879448223275987 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f6e110 0x55a700f47560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f4d7f0 0x55a700f46b00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 1 --2- 10.20.193.28:0/3447852528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f2ced0 0x55a700f464b0 unknown :-1 s=CLOSED pgs=404 gs=2 cs=0 l=1 c_cookie=595921492946917927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff3b77fe640 0 client.15693 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:07.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 >> 10.20.193.28:0/3447852528 conn(0x55a700e431c0 msgr2=0x55a700f2e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:07.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 shutdown_connections 2026-02-20T13:18:07.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 1 -- 10.20.193.28:0/3447852528 wait complete. 2026-02-20T13:18:07.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.712+0000 7ff40686ee00 20 client.15693 trim_cache size 0 max 16384 2026-02-20T13:18:07.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.720+0000 7ff40686ee00 1 Processor -- start 2026-02-20T13:18:07.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.720+0000 7ff40686ee00 1 -- start start 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.720+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f46320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.720+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f6bfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.720+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 0x55a700f6c510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.720+0000 7ff40686ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a700e2d8d0 con 0x55a700f4d7f0 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.720+0000 7ff40686ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a700b6ef10 con 0x55a700f6e110 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.720+0000 7ff40686ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a700f46d30 con 0x55a700f2ced0 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff401fd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f46320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff4017cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f6bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff401fd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f46320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41470/0 (socket says 10.20.193.28:41470) 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff401fd0640 1 -- 10.20.193.28:0/2123305731 learned_addr learned my addr 10.20.193.28:0/2123305731 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:07.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff4027d1640 1 --2- 10.20.193.28:0/2123305731 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 0x55a700f6c510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff4017cf640 1 -- 10.20.193.28:0/2123305731 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 msgr2=0x55a700f46320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff4017cf640 1 --2- 10.20.193.28:0/2123305731 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f46320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff4017cf640 1 -- 10.20.193.28:0/2123305731 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 msgr2=0x55a700f6c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff4017cf640 1 --2- 10.20.193.28:0/2123305731 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 0x55a700f6c510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff4017cf640 1 -- 10.20.193.28:0/2123305731 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a700dc5670 con 0x55a700f4d7f0 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff4017cf640 1 --2- 10.20.193.28:0/2123305731 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f6bfd0 secure :-1 s=READY pgs=405 gs=2 cs=0 l=1 c_cookie=8535136298414292906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3f00d1820 tx=0x7ff3f00bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7672e53e0886bfaa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff3c9bfe640 1 -- 10.20.193.28:0/2123305731 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3f00d18f0 con 0x55a700f4d7f0 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff3c9bfe640 1 -- 10.20.193.28:0/2123305731 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3f00d1220 con 0x55a700f4d7f0 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.721+0000 7ff3c9bfe640 1 -- 10.20.193.28:0/2123305731 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3f00d18f0 con 0x55a700f4d7f0 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 -- 10.20.193.28:0/2123305731 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 msgr2=0x55a700f6bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 --2- 10.20.193.28:0/2123305731 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f6bfd0 secure :-1 s=READY pgs=405 gs=2 cs=0 l=1 c_cookie=8535136298414292906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3f00d1820 tx=0x7ff3f00bb040 comp rx=0 tx=0).stop 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 -- 10.20.193.28:0/2123305731 shutdown_connections 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 --2- 10.20.193.28:0/2123305731 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f6bfd0 unknown :-1 s=CLOSED pgs=405 gs=2 cs=0 l=1 c_cookie=8535136298414292906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 --2- 10.20.193.28:0/2123305731 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 0x55a700f6c510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 --2- 10.20.193.28:0/2123305731 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f46320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 -- 10.20.193.28:0/2123305731 >> 10.20.193.28:0/2123305731 conn(0x55a700e431c0 msgr2=0x55a700f427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 -- 10.20.193.28:0/2123305731 shutdown_connections 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 -- 10.20.193.28:0/2123305731 wait complete. 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 -- start start 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.722+0000 7ff40686ee00 1 Processor -- start 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f4f440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f4fae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff40686ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 0x55a700f50570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff40686ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a700f48030 con 0x55a700f4d7f0 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff40686ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a700e93490 con 0x55a700f6e110 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff40686ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a700e2d8d0 con 0x55a700f2ced0 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff401fd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f4f440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff4017cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f4fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff401fd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f4f440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41482/0 (socket says 10.20.193.28:41482) 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff401fd0640 1 -- 10.20.193.28:0/1506627922 learned_addr learned my addr 10.20.193.28:0/1506627922 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff4027d1640 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 0x55a700f50570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff4017cf640 1 -- 10.20.193.28:0/1506627922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 msgr2=0x55a700f4f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff4017cf640 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f4f440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff4017cf640 1 -- 10.20.193.28:0/1506627922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 msgr2=0x55a700f50570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff4017cf640 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 0x55a700f50570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff4017cf640 1 -- 10.20.193.28:0/1506627922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a700dc00f0 con 0x55a700f4d7f0 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff401fd0640 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f4f440 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff4017cf640 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f4fae0 secure :-1 s=READY pgs=406 gs=2 cs=0 l=1 c_cookie=2913408261428769834 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3f0109050 tx=0x7ff3f002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286e8160bc26742a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff3b77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff3b77fe640 1 -- 10.20.193.28:0/1506627922 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3f00d18f0 con 0x55a700f4d7f0 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.723+0000 7ff3b77fe640 1 -- 10.20.193.28:0/1506627922 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3f00d7380 con 0x55a700f4d7f0 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff3b77fe640 1 -- 10.20.193.28:0/1506627922 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3f00dc4f0 con 0x55a700f4d7f0 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc0f63a0 con 0x55a700f4d7f0 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 10 client.15699 _ll_register_callbacks cb 0x55a700dbaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:07.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a700edfca0 con 0x55a700f4d7f0 2026-02-20T13:18:07.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff3b77fe640 1 -- 10.20.193.28:0/1506627922 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff3f00d9b40 con 0x55a700f4d7f0 2026-02-20T13:18:07.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff3b77fe640 1 -- 10.20.193.28:0/1506627922 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff3f00dc680 con 0x55a700f4d7f0 2026-02-20T13:18:07.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 10 client.15699 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a700db40d0 con 0x55a700f4d7f0 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff3b77fe640 1 -- 10.20.193.28:0/1506627922 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7ff3f00f0050 con 0x55a700f4d7f0 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 10 client.15699 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 20 client.15699 populate_metadata read hostname 'trial028' 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a700f52800 0x55a700f52ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 4 client.15699 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.724+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a700b13640 con 0x55a700f52800 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.725+0000 7ff401fd0640 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a700f52800 0x55a700f52ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.725+0000 7ff401fd0640 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a700f52800 0x55a700f52ca0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=8897757914161470169 s_cookie=4247233967784042955 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7b2fae3b03dad9 server_cookie=3af134ca77bda1cb in_seq=0 out_seq=0 2026-02-20T13:18:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.725+0000 7ff3b77fe640 10 client.15699 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff3b77fe640 1 -- 10.20.193.28:0/1506627922 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a700b13640 con 0x55a700f52800 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff3b77fe640 10 client.15699 handle_command_reply: tid=0 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 client.15699 shutdown 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 msgr2=0x55a700f4fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f4fae0 secure :-1 s=READY pgs=406 gs=2 cs=0 l=1 c_cookie=2913408261428769834 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3f0109050 tx=0x7ff3f002f190 comp rx=0 tx=0).stop 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 shutdown_connections 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a700f52800 0x55a700f52ca0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=8897757914161470169 s_cookie=4247233967784042955 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a700f4d7f0 0x55a700f4fae0 unknown :-1 s=CLOSED pgs=406 gs=2 cs=0 l=1 c_cookie=2913408261428769834 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a700f6e110 0x55a700f50570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 --2- 10.20.193.28:0/1506627922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a700f2ced0 0x55a700f4f440 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 >> 10.20.193.28:0/1506627922 conn(0x55a700e431c0 msgr2=0x55a700f427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff3b77fe640 0 client.15699 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 shutdown_connections 2026-02-20T13:18:07.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 1 -- 10.20.193.28:0/1506627922 wait complete. 2026-02-20T13:18:07.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.728+0000 7ff40686ee00 20 client.15699 trim_cache size 0 max 16384 2026-02-20T13:18:07.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:18:07.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:18:07.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:18:07.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:18:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 -- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3d80b5770 msgr2=0x7ff3d80d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3d80b5770 0x7ff3d80d5c20 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3ec004740 tx=0x7ff3ec0043a0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 -- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10d340 msgr2=0x7ff3fc0f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10d340 0x7ff3fc0f4ab0 secure :-1 s=READY pgs=402 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3f0002d80 tx=0x7ff3f00028d0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 -- 10.20.193.28:0/2182757468 shutdown_connections 2026-02-20T13:18:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff3d80b5770 0x7ff3d80d5c20 unknown :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3fc10d340 0x7ff3fc0f4ab0 unknown :-1 s=CLOSED pgs=402 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3fc10dd00 0x7ff3fc0f56b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 --2- 10.20.193.28:0/2182757468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff3fc10b510 0x7ff3fc0f4460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.729+0000 7ff402fd2640 1 -- 10.20.193.28:0/2182757468 >> 10.20.193.28:0/2182757468 conn(0x7ff3fc0e8a80 msgr2=0x7ff3fc0ea730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.730+0000 7ff402fd2640 1 -- 10.20.193.28:0/2182757468 shutdown_connections 2026-02-20T13:18:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:07.730+0000 7ff402fd2640 1 -- 10.20.193.28:0/2182757468 wait complete. 2026-02-20T13:18:07.844 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:08.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 -- 10.20.193.28:0/1661736703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 msgr2=0x7feba4155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 --2- 10.20.193.28:0/1661736703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 0x7feba4155440 secure :-1 s=READY pgs=407 gs=2 cs=0 l=1 c_cookie=5054183814743837100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb98009950 tx=0x7feb9802f190 comp rx=0 tx=0).stop 2026-02-20T13:18:08.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 -- 10.20.193.28:0/1661736703 shutdown_connections 2026-02-20T13:18:08.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 --2- 10.20.193.28:0/1661736703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 0x7feba4155440 unknown :-1 s=CLOSED pgs=407 gs=2 cs=0 l=1 c_cookie=5054183814743837100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 --2- 10.20.193.28:0/1661736703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feba4155980 0x7feba4175d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 --2- 10.20.193.28:0/1661736703 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feba4060f30 0x7feba4061300 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 -- 10.20.193.28:0/1661736703 >> 10.20.193.28:0/1661736703 conn(0x7feba40eaad0 msgr2=0x7feba410aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 -- 10.20.193.28:0/1661736703 shutdown_connections 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.016+0000 7febaa8c4640 1 -- 10.20.193.28:0/1661736703 wait complete. 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.017+0000 7febaa8c4640 1 Processor -- start 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.017+0000 7febaa8c4640 1 -- start start 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.017+0000 7febaa8c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feba4060f30 0x7feba41620f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.017+0000 7febaa8c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 0x7feba4162630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7febaa8c4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feba4155980 0x7feba4167a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7febaa8c4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feba4168020 con 0x7feba4061840 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7febaa8c4640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7feba4168190 con 0x7feba4155980 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7febaa8c4640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7feba4168350 con 0x7feba4060f30 2026-02-20T13:18:08.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 0x7feba4162630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 0x7feba4162630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36654/0 (socket says 10.20.193.28:36654) 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 -- 10.20.193.28:0/2352784436 learned_addr learned my addr 10.20.193.28:0/2352784436 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba98c2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feba4060f30 0x7feba41620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7febaa0c3640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feba4155980 0x7feba4167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 -- 10.20.193.28:0/2352784436 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feba4060f30 msgr2=0x7feba41620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feba4060f30 0x7feba41620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 -- 10.20.193.28:0/2352784436 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feba4155980 msgr2=0x7feba4167a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feba4155980 0x7feba4167a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 -- 10.20.193.28:0/2352784436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb940094b0 con 0x7feba4061840 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.018+0000 7feba90c1640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 0x7feba4162630 secure :-1 s=READY pgs=408 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb98004820 tx=0x7feb98004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.019+0000 7feb92ffd640 1 -- 10.20.193.28:0/2352784436 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb9803d070 con 0x7feba4061840 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.019+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb98009570 con 0x7feba4061840 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.019+0000 7feb92ffd640 1 -- 10.20.193.28:0/2352784436 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb98002ad0 con 0x7feba4061840 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.019+0000 7feb92ffd640 1 -- 10.20.193.28:0/2352784436 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb9803d070 con 0x7feba4061840 2026-02-20T13:18:08.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.019+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba4151400 con 0x7feba4061840 2026-02-20T13:18:08.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.019+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba4062440 con 0x7feba4061840 2026-02-20T13:18:08.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.021+0000 7feb92ffd640 1 -- 10.20.193.28:0/2352784436 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7feb98038920 con 0x7feba4061840 2026-02-20T13:18:08.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.023+0000 7feb92ffd640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb800b5830 0x7feb800d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.023+0000 7feb92ffd640 1 -- 10.20.193.28:0/2352784436 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feb9810b150 con 0x7feba4061840 2026-02-20T13:18:08.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.023+0000 7feb92ffd640 1 -- 10.20.193.28:0/2352784436 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7feb9810b5d0 con 0x7feba4061840 2026-02-20T13:18:08.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.023+0000 7feba98c2640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb800b5830 0x7feb800d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.024+0000 7feba98c2640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb800b5830 0x7feb800d5ce0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb94004740 tx=0x7feb94005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:08.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.167+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feba4168510 con 0x7feba4061840 2026-02-20T13:18:08.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.167+0000 7feb92ffd640 1 -- 10.20.193.28:0/2352784436 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12003 (secure 0 0 0) 0x7feb980cdb40 con 0x7feba4061840 2026-02-20T13:18:08.171 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:18:08.171 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T13:17:23:438313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:23.339303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:18:08.172 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T13:18:08.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb800b5830 msgr2=0x7feb800d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb800b5830 0x7feb800d5ce0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb94004740 tx=0x7feb94005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:08.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 msgr2=0x7feba4162630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 0x7feba4162630 secure :-1 s=READY pgs=408 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb98004820 tx=0x7feb98004290 comp rx=0 tx=0).stop 2026-02-20T13:18:08.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 shutdown_connections 2026-02-20T13:18:08.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb800b5830 0x7feb800d5ce0 unknown :-1 s=CLOSED pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feba4061840 0x7feba4162630 unknown :-1 s=CLOSED pgs=408 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feba4155980 0x7feba4167a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.168+0000 7febaa8c4640 1 --2- 10.20.193.28:0/2352784436 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feba4060f30 0x7feba41620f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.169+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 >> 10.20.193.28:0/2352784436 conn(0x7feba40eaad0 msgr2=0x7feba410aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:08.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.169+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 shutdown_connections 2026-02-20T13:18:08.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.169+0000 7febaa8c4640 1 -- 10.20.193.28:0/2352784436 wait complete. 2026-02-20T13:18:08.271 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id e0340c26 --release --await' 2026-02-20T13:18:08.271 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id e0340c26 --release --await 2026-02-20T13:18:08.497 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:08.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.676+0000 7fd3a7577640 1 -- 10.20.193.28:0/2473731514 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a8159d80 msgr2=0x7fd3a817a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.676+0000 7fd3a7577640 1 --2- 10.20.193.28:0/2473731514 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a8159d80 0x7fd3a817a160 secure :-1 s=READY pgs=171 gs=2 cs=0 l=1 c_cookie=9408661380304244860 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd39800aa30 tx=0x7fd398030270 comp rx=0 tx=0).stop 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.677+0000 7fd3a7577640 1 -- 10.20.193.28:0/2473731514 shutdown_connections 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.677+0000 7fd3a7577640 1 --2- 10.20.193.28:0/2473731514 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a8159d80 0x7fd3a817a160 unknown :-1 s=CLOSED pgs=171 gs=2 cs=0 l=1 c_cookie=9408661380304244860 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.677+0000 7fd3a7577640 1 --2- 10.20.193.28:0/2473731514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3a80614f0 0x7fd3a8061920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.677+0000 7fd3a7577640 1 --2- 10.20.193.28:0/2473731514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3a8062ae0 0x7fd3a8060fb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.677+0000 7fd3a7577640 1 -- 10.20.193.28:0/2473731514 >> 10.20.193.28:0/2473731514 conn(0x7fd3a80eab00 msgr2=0x7fd3a810af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.677+0000 7fd3a7577640 1 -- 10.20.193.28:0/2473731514 shutdown_connections 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.677+0000 7fd3a7577640 1 -- 10.20.193.28:0/2473731514 wait complete. 2026-02-20T13:18:08.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a7577640 1 Processor -- start 2026-02-20T13:18:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a7577640 1 -- start start 2026-02-20T13:18:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a7577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a80614f0 0x7fd3a80f2e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a7577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3a8062ae0 0x7fd3a80f3340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3a8159d80 0x7fd3a80f8710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a7577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a80f8d30 con 0x7fd3a8159d80 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a7577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a80f8ea0 con 0x7fd3a80614f0 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a7577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a80f9060 con 0x7fd3a8062ae0 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a6575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a80614f0 0x7fd3a80f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a6575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a80614f0 0x7fd3a80f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35614/0 (socket says 10.20.193.28:35614) 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a6575640 1 -- 10.20.193.28:0/748008943 learned_addr learned my addr 10.20.193.28:0/748008943 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3a8062ae0 0x7fd3a80f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.678+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3a8159d80 0x7fd3a80f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd3a6575640 1 -- 10.20.193.28:0/748008943 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3a8062ae0 msgr2=0x7fd3a80f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd3a6575640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3a8062ae0 0x7fd3a80f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd3a6575640 1 -- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3a8159d80 msgr2=0x7fd3a80f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd3a6575640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3a8159d80 0x7fd3a80f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd3a6575640 1 -- 10.20.193.28:0/748008943 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c0094b0 con 0x7fd3a80614f0 2026-02-20T13:18:08.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd3a6575640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a80614f0 0x7fd3a80f2e00 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd39c009fd0 tx=0x7fd39c002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:08.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd38f7fe640 1 -- 10.20.193.28:0/748008943 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd39c00ece0 con 0x7fd3a80614f0 2026-02-20T13:18:08.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd38f7fe640 1 -- 10.20.193.28:0/748008943 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd39c00ee40 con 0x7fd3a80614f0 2026-02-20T13:18:08.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd38f7fe640 1 -- 10.20.193.28:0/748008943 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd39c018950 con 0x7fd3a80614f0 2026-02-20T13:18:08.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd3a7577640 1 -- 10.20.193.28:0/748008943 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39800a650 con 0x7fd3a80614f0 2026-02-20T13:18:08.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.679+0000 7fd3a7577640 1 -- 10.20.193.28:0/748008943 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a80f9880 con 0x7fd3a80614f0 2026-02-20T13:18:08.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.682+0000 7fd38f7fe640 1 -- 10.20.193.28:0/748008943 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7fd39c016020 con 0x7fd3a80614f0 2026-02-20T13:18:08.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.684+0000 7fd38f7fe640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3800b57f0 0x7fd3800d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.684+0000 7fd38f7fe640 1 -- 10.20.193.28:0/748008943 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd39c0e6c70 con 0x7fd3a80614f0 2026-02-20T13:18:08.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.684+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3800b57f0 0x7fd3800d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.684+0000 7fd3aeeb7e00 1 Processor -- start 2026-02-20T13:18:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.684+0000 7fd3aeeb7e00 1 -- start start 2026-02-20T13:18:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3800b57f0 0x7fd3800d5ca0 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3a80f97a0 tx=0x7fd390005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f8b68f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fb590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f91beb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f7cbc70 con 0x55cb3f8b6e30 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f7c79a0 con 0x55cb3f8fbad0 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f7c1b00 con 0x55cb3f8b6520 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a6575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f8b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36680/0 (socket says 10.20.193.28:36680) 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 -- 10.20.193.28:0/3363570835 learned_addr learned my addr 10.20.193.28:0/3363570835 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f91beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 -- 10.20.193.28:0/3363570835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 msgr2=0x55cb3f8b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f8b68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 -- 10.20.193.28:0/3363570835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 msgr2=0x55cb3f91beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f91beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a5d74640 1 -- 10.20.193.28:0/3363570835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3f76cf80 con 0x55cb3f8b6e30 2026-02-20T13:18:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.685+0000 7fd3a6575640 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f8b68f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fb590 secure :-1 s=READY pgs=409 gs=3 cs=0 l=1 c_cookie=6405399900311063044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd390004200 tx=0x7fd390014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e48d45a65d0a04 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd38cff9640 1 -- 10.20.193.28:0/3363570835 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd390011e60 con 0x55cb3f8b6e30 2026-02-20T13:18:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd38cff9640 1 -- 10.20.193.28:0/3363570835 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd390009dc0 con 0x55cb3f8b6e30 2026-02-20T13:18:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd38cff9640 1 -- 10.20.193.28:0/3363570835 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd39001b9c0 con 0x55cb3f8b6e30 2026-02-20T13:18:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/3363570835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 msgr2=0x55cb3f8fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fb590 secure :-1 s=READY pgs=409 gs=3 cs=0 l=1 c_cookie=6405399900311063044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd390004200 tx=0x7fd390014000 comp rx=0 tx=0).stop 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/3363570835 shutdown_connections 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fb590 unknown :-1 s=CLOSED pgs=409 gs=3 cs=0 l=1 c_cookie=6405399900311063044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f91beb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/3363570835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f8b68f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/3363570835 >> 10.20.193.28:0/3363570835 conn(0x55cb3f7d4a60 msgr2=0x55cb3f8b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/3363570835 shutdown_connections 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.686+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/3363570835 wait complete. 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3aeeb7e00 1 -- start start 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3aeeb7e00 1 Processor -- start 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f9132e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f913820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f918810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f918d50 con 0x55cb3f8b6520 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f918ec0 con 0x55cb3f8b6e30 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f919080 con 0x55cb3f8fbad0 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3a6d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f918810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3a6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f9132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3a5d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f913820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3a6d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f918810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41548/0 (socket says 10.20.193.28:41548) 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.688+0000 7fd3a6d76640 1 -- 10.20.193.28:0/369178458 learned_addr learned my addr 10.20.193.28:0/369178458 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd3a5d74640 1 -- 10.20.193.28:0/369178458 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 msgr2=0x55cb3f918810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f918810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd3a5d74640 1 -- 10.20.193.28:0/369178458 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 msgr2=0x55cb3f9132e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f9132e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd3a5d74640 1 -- 10.20.193.28:0/369178458 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd390009940 con 0x55cb3f8b6e30 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f918810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f913820 secure :-1 s=READY pgs=173 gs=2 cs=0 l=1 c_cookie=10809890118589327312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd390004200 tx=0x7fd39001b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=960471ca2385a7d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd357fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd357fff640 1 -- 10.20.193.28:0/369178458 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd390005240 con 0x55cb3f8b6e30 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd357fff640 1 -- 10.20.193.28:0/369178458 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd390004c00 con 0x55cb3f8b6e30 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd357fff640 1 -- 10.20.193.28:0/369178458 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd39001a460 con 0x55cb3f8b6e30 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a80f9880 con 0x55cb3f8b6e30 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.689+0000 7fd357fff640 1 -- 10.20.193.28:0/369178458 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd39001a5c0 con 0x55cb3f8b6e30 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 10 client.25715 _ll_register_callbacks cb 0x55cb3f742d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb3f457ba0 con 0x55cb3f8b6e30 2026-02-20T13:18:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd357fff640 1 -- 10.20.193.28:0/369178458 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd390004d70 con 0x55cb3f8b6e30 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 10 client.25715 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55cb3f745710 con 0x55cb3f8b6e30 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd357fff640 1 -- 10.20.193.28:0/369178458 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fd390035060 con 0x55cb3f8b6e30 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 10 client.25715 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 10 client.25715 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 20 client.25715 populate_metadata read hostname 'trial028' 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cb3f8f8910 0x55cb3f8f8db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 4 client.25715 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb3f794410 con 0x55cb3f8f8910 2026-02-20T13:18:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.690+0000 7fd3a6575640 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cb3f8f8910 0x55cb3f8f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.691+0000 7fd3a6575640 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cb3f8f8910 0x55cb3f8f8db0 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=6106448913461152668 s_cookie=4607312745424675288 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54be76eef5ec0b9c server_cookie=3ff07688082ae1d8 in_seq=0 out_seq=0 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.691+0000 7fd357fff640 10 client.25715 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.691+0000 7fd357fff640 1 -- 10.20.193.28:0/369178458 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cb3f794410 con 0x55cb3f8f8910 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.691+0000 7fd357fff640 10 client.25715 handle_command_reply: tid=0 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.691+0000 7fd3aeeb7e00 1 client.25715 shutdown 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.691+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 msgr2=0x55cb3f913820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.691+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f913820 secure :-1 s=READY pgs=173 gs=2 cs=0 l=1 c_cookie=10809890118589327312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd390004200 tx=0x7fd39001b800 comp rx=0 tx=0).stop 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 shutdown_connections 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cb3f8f8910 0x55cb3f8f8db0 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=6106448913461152668 s_cookie=4607312745424675288 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f918810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f913820 unknown :-1 s=CLOSED pgs=173 gs=2 cs=0 l=1 c_cookie=10809890118589327312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/369178458 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f9132e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 >> 10.20.193.28:0/369178458 conn(0x55cb3f7d4a60 msgr2=0x55cb3f8b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd357fff640 0 client.25715 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 shutdown_connections 2026-02-20T13:18:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/369178458 wait complete. 2026-02-20T13:18:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.692+0000 7fd3aeeb7e00 20 client.25715 trim_cache size 0 max 16384 2026-02-20T13:18:08.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3aeeb7e00 1 Processor -- start 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3aeeb7e00 1 -- start start 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f911de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fdeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f9107a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f7bf730 con 0x55cb3f8b6e30 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f47f960 con 0x55cb3f8fbad0 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f900b50 con 0x55cb3f8b6520 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3a6d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f9107a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3a6575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f911de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3a6d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f9107a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35646/0 (socket says 10.20.193.28:35646) 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3a6d76640 1 -- 10.20.193.28:0/4089040039 learned_addr learned my addr 10.20.193.28:0/4089040039 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:08.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.701+0000 7fd3a5d74640 1 --2- 10.20.193.28:0/4089040039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3a6d76640 1 -- 10.20.193.28:0/4089040039 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 msgr2=0x55cb3f911de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:08.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/4089040039 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f911de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3a6d76640 1 -- 10.20.193.28:0/4089040039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 msgr2=0x55cb3f8fdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:08.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/4089040039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3a6d76640 1 -- 10.20.193.28:0/4089040039 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3f757350 con 0x55cb3f8fbad0 2026-02-20T13:18:08.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/4089040039 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f9107a0 secure :-1 s=READY pgs=174 gs=3 cs=0 l=1 c_cookie=9232285735705746451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd398033040 tx=0x7fd398003e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=801faaf63da59c13 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:08.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3724e6640 1 -- 10.20.193.28:0/4089040039 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd39803e040 con 0x55cb3f8fbad0 2026-02-20T13:18:08.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3724e6640 1 -- 10.20.193.28:0/4089040039 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd39803f040 con 0x55cb3f8fbad0 2026-02-20T13:18:08.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3724e6640 1 -- 10.20.193.28:0/4089040039 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3980054b0 con 0x55cb3f8fbad0 2026-02-20T13:18:08.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/4089040039 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 msgr2=0x55cb3f9107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/4089040039 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f9107a0 secure :-1 s=READY pgs=174 gs=3 cs=0 l=1 c_cookie=9232285735705746451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd398033040 tx=0x7fd398003e60 comp rx=0 tx=0).stop 2026-02-20T13:18:08.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/4089040039 shutdown_connections 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/4089040039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6e30 0x55cb3f8fdeb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/4089040039 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8fbad0 0x55cb3f9107a0 unknown :-1 s=CLOSED pgs=174 gs=3 cs=0 l=1 c_cookie=9232285735705746451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/4089040039 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8b6520 0x55cb3f911de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/4089040039 >> 10.20.193.28:0/4089040039 conn(0x55cb3f7d4a60 msgr2=0x55cb3f910090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/4089040039 shutdown_connections 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.702+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/4089040039 wait complete. 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.703+0000 7fd3aeeb7e00 1 -- start start 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.703+0000 7fd3aeeb7e00 1 Processor -- start 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.703+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f89a3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.703+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f895930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.703+0000 7fd3aeeb7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f8960a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.703+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f8967a0 con 0x55cb3f8b6520 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.703+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f972850 con 0x55cb3f8b6e30 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.703+0000 7fd3aeeb7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cb3f9729e0 con 0x55cb3f8fbad0 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f89a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f8960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a5d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f895930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f8960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41568/0 (socket says 10.20.193.28:41568) 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 -- 10.20.193.28:0/1724228379 learned_addr learned my addr 10.20.193.28:0/1724228379 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 -- 10.20.193.28:0/1724228379 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 msgr2=0x55cb3f895930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f895930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 -- 10.20.193.28:0/1724228379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 msgr2=0x55cb3f89a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f89a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 -- 10.20.193.28:0/1724228379 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3f751dd0 con 0x55cb3f8fbad0 2026-02-20T13:18:08.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6575640 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f89a3d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd3a6d76640 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f8960a0 secure :-1 s=READY pgs=140 gs=2 cs=0 l=1 c_cookie=10779491674145142248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd398006ad0 tx=0x7fd39800a390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95987290c0b3b5e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.704+0000 7fd357fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd357fff640 1 -- 10.20.193.28:0/1724228379 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd39803e040 con 0x55cb3f8fbad0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd357fff640 1 -- 10.20.193.28:0/1724228379 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd3980052e0 con 0x55cb3f8fbad0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd357fff640 1 -- 10.20.193.28:0/1724228379 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd398057bc0 con 0x55cb3f8fbad0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a817adc0 con 0x55cb3f8fbad0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd357fff640 1 -- 10.20.193.28:0/1724228379 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd398046400 con 0x55cb3f8fbad0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd357fff640 10 client.25672 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd3aeeb7e00 10 client.25672 _ll_register_callbacks cb 0x55cb3f742d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb3f519700 con 0x55cb3f8fbad0 2026-02-20T13:18:08.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd357fff640 1 -- 10.20.193.28:0/1724228379 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd398005450 con 0x55cb3f8fbad0 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd3aeeb7e00 10 client.25672 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55cb3f745a40 con 0x55cb3f8fbad0 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd357fff640 1 -- 10.20.193.28:0/1724228379 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fd39804c020 con 0x55cb3f8fbad0 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.705+0000 7fd3aeeb7e00 10 client.25672 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.706+0000 7fd3aeeb7e00 10 client.25672 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.706+0000 7fd3aeeb7e00 20 client.25672 populate_metadata read hostname 'trial028' 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.706+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cb3f9ba780 0x55cb3f9dac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.706+0000 7fd3aeeb7e00 4 client.25672 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e0340c26", "release": true, "await": true}] 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.706+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e0340c26", "release": true, "await": true}) -- 0x7fd390009dc0 con 0x55cb3f9ba780 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.706+0000 7fd3a6575640 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cb3f9ba780 0x55cb3f9dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.706+0000 7fd3a6575640 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cb3f9ba780 0x55cb3f9dac30 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=14014734678662383544 s_cookie=13768477747956137589 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c27e56efdf0507b8 server_cookie=bf13759030cbbe75 in_seq=0 out_seq=0 2026-02-20T13:18:08.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.706+0000 7fd357fff640 10 client.25672 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.709+0000 7fd357fff640 1 -- 10.20.193.28:0/1724228379 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fd390009dc0 con 0x55cb3f9ba780 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.709+0000 7fd357fff640 10 client.25672 handle_command_reply: tid=0 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.709+0000 7fd3aeeb7e00 1 client.25672 shutdown 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.709+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 msgr2=0x55cb3f8960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.709+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f8960a0 secure :-1 s=READY pgs=140 gs=2 cs=0 l=1 c_cookie=10779491674145142248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd398006ad0 tx=0x7fd39800a390 comp rx=0 tx=0).stop 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 shutdown_connections 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cb3f9ba780 0x55cb3f9dac30 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=14014734678662383544 s_cookie=13768477747956137589 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb3f8fbad0 0x55cb3f8960a0 unknown :-1 s=CLOSED pgs=140 gs=2 cs=0 l=1 c_cookie=10779491674145142248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb3f8b6e30 0x55cb3f895930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 1 --2- 10.20.193.28:0/1724228379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb3f8b6520 0x55cb3f89a3d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd357fff640 0 client.25672 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:08.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 >> 10.20.193.28:0/1724228379 conn(0x55cb3f7d4a60 msgr2=0x55cb3f9107a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:08.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 shutdown_connections 2026-02-20T13:18:08.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 1 -- 10.20.193.28:0/1724228379 wait complete. 2026-02-20T13:18:08.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3aeeb7e00 20 client.25672 trim_cache size 0 max 16384 2026-02-20T13:18:08.716 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:18:08.716 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 26, 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 4, 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "e0340c26": { 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "version": 4, 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:08.717 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:08.718 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:08.719 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:18:08.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3a7577640 1 -- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3800b57f0 msgr2=0x7fd3800d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3a7577640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3800b57f0 0x7fd3800d5ca0 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3a80f97a0 tx=0x7fd390005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3a7577640 1 -- 10.20.193.28:0/748008943 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a80614f0 msgr2=0x7fd3a80f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.710+0000 7fd3a7577640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a80614f0 0x7fd3a80f2e00 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd39c009fd0 tx=0x7fd39c002bc0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.711+0000 7fd3a7577640 1 -- 10.20.193.28:0/748008943 shutdown_connections 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.711+0000 7fd3a7577640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3800b57f0 0x7fd3800d5ca0 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.711+0000 7fd3a7577640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3a8159d80 0x7fd3a80f8710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.711+0000 7fd3a7577640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3a8062ae0 0x7fd3a80f3340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.711+0000 7fd3a7577640 1 --2- 10.20.193.28:0/748008943 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3a80614f0 0x7fd3a80f2e00 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.711+0000 7fd3a7577640 1 -- 10.20.193.28:0/748008943 >> 10.20.193.28:0/748008943 conn(0x7fd3a80eab00 msgr2=0x7fd3a810fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.711+0000 7fd3a7577640 1 -- 10.20.193.28:0/748008943 shutdown_connections 2026-02-20T13:18:08.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:08.711+0000 7fd3a7577640 1 -- 10.20.193.28:0/748008943 wait complete. 2026-02-20T13:18:08.722 INFO:tasks.workunit.client.0.trial028.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2026-02-20T13:18:08.724 INFO:tasks.workunit.client.0.trial028.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2026-02-20T13:18:08.724 INFO:tasks.workunit.client.0.trial028.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2026-02-20T13:18:08.768 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:08 trial028 ceph-mon[37442]: pgmap v205: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-20T13:18:08.768 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:08 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2352784436' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:08.810 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e0340c26', total seconds elapsed: 31.1 2026-02-20T13:18:08.810 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2026-02-20T13:18:08.810 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:18:08.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:08 trial127 ceph-mon[43817]: pgmap v205: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-20T13:18:08.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:08 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2352784436' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:08 trial034 ceph-mon[43332]: pgmap v205: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-20T13:18:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:08 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2352784436' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:08.995 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:09.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 -- 10.20.193.28:0/2816705905 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff82c10f4b0 msgr2=0x7ff82c10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 --2- 10.20.193.28:0/2816705905 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff82c10f4b0 0x7ff82c10f880 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=4979885863239156397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff818009950 tx=0x7ff81802f190 comp rx=0 tx=0).stop 2026-02-20T13:18:09.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 -- 10.20.193.28:0/2816705905 shutdown_connections 2026-02-20T13:18:09.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 --2- 10.20.193.28:0/2816705905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff82c1156a0 0x7ff82c176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 --2- 10.20.193.28:0/2816705905 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff82c10fea0 0x7ff82c114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 --2- 10.20.193.28:0/2816705905 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff82c10f4b0 0x7ff82c10f880 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=4979885863239156397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 -- 10.20.193.28:0/2816705905 >> 10.20.193.28:0/2816705905 conn(0x7ff82c0ecda0 msgr2=0x7ff82c10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 -- 10.20.193.28:0/2816705905 shutdown_connections 2026-02-20T13:18:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.164+0000 7ff8310e9640 1 -- 10.20.193.28:0/2816705905 wait complete. 2026-02-20T13:18:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.165+0000 7ff8310e9640 1 Processor -- start 2026-02-20T13:18:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.165+0000 7ff8310e9640 1 -- start start 2026-02-20T13:18:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.165+0000 7ff8310e9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff82c10f4b0 0x7ff82c11ded0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.165+0000 7ff8310e9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff82c10fea0 0x7ff82c11e410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.165+0000 7ff8310e9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff82c1156a0 0x7ff82c1237e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.165+0000 7ff8310e9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c123e00 con 0x7ff82c10fea0 2026-02-20T13:18:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.165+0000 7ff8310e9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c123f70 con 0x7ff82c1156a0 2026-02-20T13:18:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.165+0000 7ff8310e9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c124130 con 0x7ff82c10f4b0 2026-02-20T13:18:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff82c10f4b0 0x7ff82c11ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff82c10fea0 0x7ff82c11e410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff82c10fea0 0x7ff82c11e410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36738/0 (socket says 10.20.193.28:36738) 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 -- 10.20.193.28:0/687461989 learned_addr learned my addr 10.20.193.28:0/687461989 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff8308e8640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff82c1156a0 0x7ff82c1237e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 -- 10.20.193.28:0/687461989 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff82c10f4b0 msgr2=0x7ff82c11ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff82c10f4b0 0x7ff82c11ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 -- 10.20.193.28:0/687461989 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff82c1156a0 msgr2=0x7ff82c1237e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff82c1156a0 0x7ff82c1237e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 -- 10.20.193.28:0/687461989 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff818009570 con 0x7ff82c10fea0 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff82b7fe640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff82c10fea0 0x7ff82c11e410 secure :-1 s=READY pgs=410 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff81c009480 tx=0x7ff81c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff8297fa640 1 -- 10.20.193.28:0/687461989 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff81c00cd40 con 0x7ff82c10fea0 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82c124410 con 0x7ff82c10fea0 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff8297fa640 1 -- 10.20.193.28:0/687461989 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff81c004d30 con 0x7ff82c10fea0 2026-02-20T13:18:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff8297fa640 1 -- 10.20.193.28:0/687461989 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff81c010740 con 0x7ff82c10fea0 2026-02-20T13:18:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.166+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82c164b10 con 0x7ff82c10fea0 2026-02-20T13:18:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.167+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff82c110790 con 0x7ff82c10fea0 2026-02-20T13:18:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.170+0000 7ff8297fa640 1 -- 10.20.193.28:0/687461989 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 157173+0+0 (secure 0 0 0) 0x7ff81c01f060 con 0x7ff82c10fea0 2026-02-20T13:18:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.171+0000 7ff8297fa640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8000b57f0 0x7ff8000d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.171+0000 7ff8297fa640 1 -- 10.20.193.28:0/687461989 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff81c014070 con 0x7ff82c10fea0 2026-02-20T13:18:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.172+0000 7ff8297fa640 1 -- 10.20.193.28:0/687461989 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7ff81c0e73a0 con 0x7ff82c10fea0 2026-02-20T13:18:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.172+0000 7ff82bfff640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8000b57f0 0x7ff8000d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.172+0000 7ff82bfff640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8000b57f0 0x7ff8000d5ca0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8180098a0 tx=0x7ff81803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:09.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.312+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff82c10f8e0 con 0x7ff82c10fea0 2026-02-20T13:18:09.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.313+0000 7ff8297fa640 1 -- 10.20.193.28:0/687461989 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12003 (secure 0 0 0) 0x7ff81c0a9900 con 0x7ff82c10fea0 2026-02-20T13:18:09.316 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:18:09.317 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T13:17:23:438313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:23.339303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:18:09.317 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8000b57f0 msgr2=0x7ff8000d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8000b57f0 0x7ff8000d5ca0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8180098a0 tx=0x7ff81803a040 comp rx=0 tx=0).stop 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff82c10fea0 msgr2=0x7ff82c11e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff82c10fea0 0x7ff82c11e410 secure :-1 s=READY pgs=410 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff81c009480 tx=0x7ff81c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 shutdown_connections 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8000b57f0 0x7ff8000d5ca0 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff82c10fea0 0x7ff82c11e410 unknown :-1 s=CLOSED pgs=410 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff82c1156a0 0x7ff82c1237e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 --2- 10.20.193.28:0/687461989 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff82c10f4b0 0x7ff82c11ded0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 >> 10.20.193.28:0/687461989 conn(0x7ff82c0ecda0 msgr2=0x7ff82c10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 shutdown_connections 2026-02-20T13:18:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.314+0000 7ff8310e9640 1 -- 10.20.193.28:0/687461989 wait complete. 2026-02-20T13:18:09.416 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2026-02-20T13:18:09.417 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2026-02-20T13:18:09.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:09 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/687461989' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:09.604 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.793+0000 7fcabdbf0640 1 -- 10.20.193.28:0/619190694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810f230 msgr2=0x7fcab810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.793+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/619190694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810f230 0x7fcab810f600 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=11957838220991159640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa4009950 tx=0x7fcaa402f190 comp rx=0 tx=0).stop 2026-02-20T13:18:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.793+0000 7fcabdbf0640 1 -- 10.20.193.28:0/619190694 shutdown_connections 2026-02-20T13:18:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.793+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/619190694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcab8115420 0x7fcab8175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.793+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/619190694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcab810fc20 0x7fcab8114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.793+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/619190694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810f230 0x7fcab810f600 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=11957838220991159640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.793+0000 7fcabdbf0640 1 -- 10.20.193.28:0/619190694 >> 10.20.193.28:0/619190694 conn(0x7fcab805f830 msgr2=0x7fcab810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.793+0000 7fcabdbf0640 1 -- 10.20.193.28:0/619190694 shutdown_connections 2026-02-20T13:18:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.794+0000 7fcabdbf0640 1 -- 10.20.193.28:0/619190694 wait complete. 2026-02-20T13:18:09.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcabdbf0640 1 Processor -- start 2026-02-20T13:18:09.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcabdbf0640 1 -- start start 2026-02-20T13:18:09.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcabdbf0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcab810f230 0x7fcab811db40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcabdbf0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810fc20 0x7fcab811e080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcabdbf0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcab8115420 0x7fcab8123450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcabdbf0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8123a70 con 0x7fcab810fc20 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcabdbf0640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8123be0 con 0x7fcab810f230 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcabdbf0640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8123da0 con 0x7fcab8115420 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcab810f230 0x7fcab811db40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcab810f230 0x7fcab811db40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35672/0 (socket says 10.20.193.28:35672) 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcab77fe640 1 -- 10.20.193.28:0/2853631211 learned_addr learned my addr 10.20.193.28:0/2853631211 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcab7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcab8115420 0x7fcab8123450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.795+0000 7fcab6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810fc20 0x7fcab811e080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab6ffd640 1 -- 10.20.193.28:0/2853631211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcab8115420 msgr2=0x7fcab8123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab6ffd640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcab8115420 0x7fcab8123450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab6ffd640 1 -- 10.20.193.28:0/2853631211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcab810f230 msgr2=0x7fcab811db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab6ffd640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcab810f230 0x7fcab811db40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab6ffd640 1 -- 10.20.193.28:0/2853631211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa4009570 con 0x7fcab810fc20 2026-02-20T13:18:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcab810f230 0x7fcab811db40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab6ffd640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810fc20 0x7fcab811e080 secure :-1 s=READY pgs=412 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa800e9c0 tx=0x7fcaa800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab4ff9640 1 -- 10.20.193.28:0/2853631211 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa800ccb0 con 0x7fcab810fc20 2026-02-20T13:18:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab4ff9640 1 -- 10.20.193.28:0/2853631211 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcaa800ce10 con 0x7fcab810fc20 2026-02-20T13:18:09.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcab4ff9640 1 -- 10.20.193.28:0/2853631211 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa80106b0 con 0x7fcab810fc20 2026-02-20T13:18:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcabdbf0640 1 -- 10.20.193.28:0/2853631211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab8124080 con 0x7fcab810fc20 2026-02-20T13:18:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.796+0000 7fcabdbf0640 1 -- 10.20.193.28:0/2853631211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab8164780 con 0x7fcab810fc20 2026-02-20T13:18:09.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.799+0000 7fcab4ff9640 1 -- 10.20.193.28:0/2853631211 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcaa801f060 con 0x7fcab810fc20 2026-02-20T13:18:09.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.801+0000 7fcab4ff9640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca8c0b5760 0x7fca8c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.801+0000 7fcab4ff9640 1 -- 10.20.193.28:0/2853631211 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcaa8014070 con 0x7fcab810fc20 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.801+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca8c0b5760 0x7fca8c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.801+0000 7fcabfbeae00 1 Processor -- start 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.801+0000 7fcabfbeae00 1 -- start start 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.801+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca8c0b5760 0x7fca8c0d5c10 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa4038820 tx=0x7fcaa403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a45f5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a463a8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a463ae00 0x55a3a465b1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3a450a780 con 0x55a3a45f6160 2026-02-20T13:18:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3a45064b0 con 0x55a3a463ae00 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3a4500610 con 0x55a3a45f5850 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a45f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a463a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a45f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41630/0 (socket says 10.20.193.28:41630) 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 -- 10.20.193.28:0/2352751115 learned_addr learned my addr 10.20.193.28:0/2352751115 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab7fff640 1 --2- 10.20.193.28:0/2352751115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a463ae00 0x55a3a465b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 -- 10.20.193.28:0/2352751115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a463ae00 msgr2=0x55a3a465b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2352751115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a463ae00 0x55a3a465b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 -- 10.20.193.28:0/2352751115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 msgr2=0x55a3a463a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2352751115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a463a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 -- 10.20.193.28:0/2352751115 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a44abc50 con 0x55a3a45f5850 2026-02-20T13:18:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.802+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2352751115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a45f5c20 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=8894430018609272517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa4005c90 tx=0x7fcaa4040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b6f5cfa2ac6d6c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fca7bfff640 1 -- 10.20.193.28:0/2352751115 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa402fc10 con 0x55a3a45f5850 2026-02-20T13:18:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fca7bfff640 1 -- 10.20.193.28:0/2352751115 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcaa403e040 con 0x55a3a45f5850 2026-02-20T13:18:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2352751115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 msgr2=0x55a3a45f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2352751115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a45f5c20 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=8894430018609272517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa4005c90 tx=0x7fcaa4040000 comp rx=0 tx=0).stop 2026-02-20T13:18:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2352751115 shutdown_connections 2026-02-20T13:18:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2352751115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a463a8c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2352751115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a463ae00 0x55a3a465b1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2352751115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a45f5c20 unknown :-1 s=CLOSED pgs=141 gs=2 cs=0 l=1 c_cookie=8894430018609272517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2352751115 >> 10.20.193.28:0/2352751115 conn(0x55a3a4513110 msgr2=0x55a3a45f4130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2352751115 shutdown_connections 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.803+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2352751115 wait complete. 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcabfbeae00 1 -- start start 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcabfbeae00 1 Processor -- start 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f5850 0x55a3a460d660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 0x55a3a460dba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a4612b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3a46130d0 con 0x55a3a45f5850 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3a4613240 con 0x55a3a45f6160 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3a4613400 con 0x55a3a463ae00 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f5850 0x55a3a460d660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcab6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 0x55a3a460dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f5850 0x55a3a460d660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36778/0 (socket says 10.20.193.28:36778) 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcab77fe640 1 -- 10.20.193.28:0/2158352972 learned_addr learned my addr 10.20.193.28:0/2158352972 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcab7fff640 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a4612b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcab77fe640 1 -- 10.20.193.28:0/2158352972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 msgr2=0x55a3a4612b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.805+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a4612b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcab77fe640 1 -- 10.20.193.28:0/2158352972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 msgr2=0x55a3a460dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 0x55a3a460dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcab77fe640 1 -- 10.20.193.28:0/2158352972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a4483e60 con 0x55a3a45f5850 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f5850 0x55a3a460d660 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=4117715236872552212 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa4044a80 tx=0x7fcaa4005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39251030fc007f14 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fca797fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fca797fa640 1 -- 10.20.193.28:0/2158352972 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa4044da0 con 0x55a3a45f5850 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fca797fa640 1 -- 10.20.193.28:0/2158352972 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcaa402fe30 con 0x55a3a45f5850 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fca797fa640 1 -- 10.20.193.28:0/2158352972 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa4046480 con 0x55a3a45f5850 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab8176660 con 0x55a3a45f5850 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcabfbeae00 10 client.15741 _ll_register_callbacks cb 0x55a3a4481320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3a4196eb0 con 0x55a3a45f5850 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fca797fa640 1 -- 10.20.193.28:0/2158352972 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcaa4046610 con 0x55a3a45f5850 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fca797fa640 1 -- 10.20.193.28:0/2158352972 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcaa40467d0 con 0x55a3a45f5850 2026-02-20T13:18:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcabfbeae00 10 client.15741 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.806+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a3a4495d80 con 0x55a3a45f5850 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fca797fa640 1 -- 10.20.193.28:0/2158352972 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fcaa4038920 con 0x55a3a45f5850 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fcabfbeae00 10 client.15741 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fcabfbeae00 10 client.15741 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fcabfbeae00 20 client.15741 populate_metadata read hostname 'trial028' 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3a4637c20 0x55a3a46380c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fcabfbeae00 4 client.15741 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3a44d2700 con 0x55a3a4637c20 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fcab6ffd640 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3a4637c20 0x55a3a46380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fcab6ffd640 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3a4637c20 0x55a3a46380c0 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=5376895238384788529 s_cookie=9955183606792712568 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a9e91bb366a2431 server_cookie=8a27eabedcabf178 in_seq=0 out_seq=0 2026-02-20T13:18:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.807+0000 7fca797fa640 10 client.15741 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:09.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fca797fa640 1 -- 10.20.193.28:0/2158352972 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a3a44d2700 con 0x55a3a4637c20 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fca797fa640 10 client.15741 handle_command_reply: tid=0 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 client.15741 shutdown 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f5850 msgr2=0x55a3a460d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f5850 0x55a3a460d660 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=4117715236872552212 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa4044a80 tx=0x7fcaa4005ab0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 shutdown_connections 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3a4637c20 0x55a3a46380c0 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=5376895238384788529 s_cookie=9955183606792712568 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a4612b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 0x55a3a460dba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2158352972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f5850 0x55a3a460d660 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=4117715236872552212 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 >> 10.20.193.28:0/2158352972 conn(0x55a3a4513110 msgr2=0x55a3a45f4840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:09.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fca797fa640 0 client.15741 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:09.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 shutdown_connections 2026-02-20T13:18:09.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2158352972 wait complete. 2026-02-20T13:18:09.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.808+0000 7fcabfbeae00 20 client.15741 trim_cache size 0 max 16384 2026-02-20T13:18:09.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.817+0000 7fcabfbeae00 1 Processor -- start 2026-02-20T13:18:09.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.817+0000 7fcabfbeae00 1 -- start start 2026-02-20T13:18:09.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.817+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a460ac60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.817+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 0x55a3a45f4a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.817+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a463ae00 0x55a3a45f4f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.817+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3a44fe240 con 0x55a3a463ae00 2026-02-20T13:18:09.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.817+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3a41beec0 con 0x55a3a45f6160 2026-02-20T13:18:09.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.817+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3a4613540 con 0x55a3a45f5850 2026-02-20T13:18:09.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a460ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a463ae00 0x55a3a45f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a460ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41650/0 (socket says 10.20.193.28:41650) 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 -- 10.20.193.28:0/2663294242 learned_addr learned my addr 10.20.193.28:0/2663294242 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab6ffd640 1 --2- 10.20.193.28:0/2663294242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 0x55a3a45f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 -- 10.20.193.28:0/2663294242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 msgr2=0x55a3a45f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2663294242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 0x55a3a45f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 -- 10.20.193.28:0/2663294242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a463ae00 msgr2=0x55a3a45f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2663294242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a463ae00 0x55a3a45f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 -- 10.20.193.28:0/2663294242 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a46002d0 con 0x55a3a45f5850 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fcab77fe640 1 --2- 10.20.193.28:0/2663294242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a460ac60 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=1904571856067601479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa40023d0 tx=0x7fcaa406e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a6e6603221da447 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:09.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fca7b7fe640 1 -- 10.20.193.28:0/2663294242 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa4073030 con 0x55a3a45f5850 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fca7b7fe640 1 -- 10.20.193.28:0/2663294242 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55a3a4196eb0 con 0x55a3a45f5850 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.818+0000 7fca7b7fe640 1 -- 10.20.193.28:0/2663294242 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa4046080 con 0x55a3a45f5850 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2663294242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 msgr2=0x55a3a460ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2663294242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a460ac60 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=1904571856067601479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa40023d0 tx=0x7fcaa406e000 comp rx=0 tx=0).stop 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2663294242 shutdown_connections 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2663294242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a463ae00 0x55a3a45f4f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2663294242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f6160 0x55a3a45f4a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/2663294242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a45f5850 0x55a3a460ac60 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=1904571856067601479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2663294242 >> 10.20.193.28:0/2663294242 conn(0x55a3a4513110 msgr2=0x55a3a46121e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2663294242 shutdown_connections 2026-02-20T13:18:09.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.819+0000 7fcabfbeae00 1 -- 10.20.193.28:0/2663294242 wait complete. 2026-02-20T13:18:09.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcabfbeae00 1 -- start start 2026-02-20T13:18:09.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcabfbeae00 1 Processor -- start 2026-02-20T13:18:09.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f5850 0x55a3a4619360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a4614db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcabfbeae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a46152f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3a46344e0 con 0x55a3a45f6160 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3a4615830 con 0x55a3a45f5850 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcabfbeae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3a46159f0 con 0x55a3a463ae00 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcab7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a46152f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f5850 0x55a3a4619360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcab7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a46152f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41652/0 (socket says 10.20.193.28:41652) 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcab7fff640 1 -- 10.20.193.28:0/1057650661 learned_addr learned my addr 10.20.193.28:0/1057650661 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.820+0000 7fcab6ffd640 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a4614db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcab7fff640 1 -- 10.20.193.28:0/1057650661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f5850 msgr2=0x55a3a4619360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:09.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcab7fff640 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f5850 0x55a3a4619360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcab7fff640 1 -- 10.20.193.28:0/1057650661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 msgr2=0x55a3a4614db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcab7fff640 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a4614db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcab7fff640 1 -- 10.20.193.28:0/1057650661 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a4490800 con 0x55a3a463ae00 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcab6ffd640 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a4614db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcab7fff640 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a46152f0 secure :-1 s=READY pgs=143 gs=2 cs=0 l=1 c_cookie=15916012234674857296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac0052c0 tx=0x7fcaac00aab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce108cd0090e550 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fca797fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fca797fa640 1 -- 10.20.193.28:0/1057650661 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaac018040 con 0x55a3a463ae00 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fca797fa640 1 -- 10.20.193.28:0/1057650661 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcaac019040 con 0x55a3a463ae00 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fca797fa640 1 -- 10.20.193.28:0/1057650661 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaac01fd50 con 0x55a3a463ae00 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a4495d80 con 0x55a3a463ae00 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fca797fa640 1 -- 10.20.193.28:0/1057650661 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcaac011430 con 0x55a3a463ae00 2026-02-20T13:18:09.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcabfbeae00 10 client.25696 _ll_register_callbacks cb 0x55a3a4481320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3a4194700 con 0x55a3a463ae00 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fca797fa640 1 -- 10.20.193.28:0/1057650661 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcaac01f440 con 0x55a3a463ae00 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcabfbeae00 10 client.25696 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.821+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a3a4484190 con 0x55a3a463ae00 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fca797fa640 1 -- 10.20.193.28:0/1057650661 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fcaac01f5a0 con 0x55a3a463ae00 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fcabfbeae00 10 client.25696 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fcabfbeae00 10 client.25696 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fcabfbeae00 20 client.25696 populate_metadata read hostname 'trial028' 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3a46e8020 0x55a3a47084d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fcabfbeae00 4 client.25696 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x7fcaa403e040 con 0x55a3a46e8020 2026-02-20T13:18:09.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fcab77fe640 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3a46e8020 0x55a3a47084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:09.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fca797fa640 10 client.25696 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:09.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.822+0000 7fcab77fe640 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3a46e8020 0x55a3a47084d0 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=15344858388444028248 s_cookie=6268549504067555701 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4f3e3675be11d58 server_cookie=56fe5c8fcee5d175 in_seq=0 out_seq=0 2026-02-20T13:18:09.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fca797fa640 1 -- 10.20.193.28:0/1057650661 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fcaa403e040 con 0x55a3a46e8020 2026-02-20T13:18:09.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fca797fa640 10 client.25696 handle_command_reply: tid=0 2026-02-20T13:18:09.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 client.25696 shutdown 2026-02-20T13:18:09.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 msgr2=0x55a3a46152f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a46152f0 secure :-1 s=READY pgs=143 gs=2 cs=0 l=1 c_cookie=15916012234674857296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac0052c0 tx=0x7fcaac00aab0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 shutdown_connections 2026-02-20T13:18:09.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3a46e8020 0x55a3a47084d0 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=15344858388444028248 s_cookie=6268549504067555701 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3a45f6160 0x55a3a4614db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3a463ae00 0x55a3a46152f0 unknown :-1 s=CLOSED pgs=143 gs=2 cs=0 l=1 c_cookie=15916012234674857296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 --2- 10.20.193.28:0/1057650661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3a45f5850 0x55a3a4619360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fca797fa640 0 client.25696 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:09.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 >> 10.20.193.28:0/1057650661 conn(0x55a3a4513110 msgr2=0x55a3a46108c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:09.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 shutdown_connections 2026-02-20T13:18:09.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 1 -- 10.20.193.28:0/1057650661 wait complete. 2026-02-20T13:18:09.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.828+0000 7fcabfbeae00 20 client.25696 trim_cache size 0 max 16384 2026-02-20T13:18:09.833 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 26, 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 6, 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "890389b6": { 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "version": 6, 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:18:09.834 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:09.835 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:09.836 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:09.836 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:18:09.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 -- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca8c0b5760 msgr2=0x7fca8c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca8c0b5760 0x7fca8c0d5c10 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa4038820 tx=0x7fcaa403a040 comp rx=0 tx=0).stop 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 -- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810fc20 msgr2=0x7fcab811e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810fc20 0x7fcab811e080 secure :-1 s=READY pgs=412 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa800e9c0 tx=0x7fcaa800ee90 comp rx=0 tx=0).stop 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 -- 10.20.193.28:0/2853631211 shutdown_connections 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca8c0b5760 0x7fca8c0d5c10 unknown :-1 s=CLOSED pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcab810fc20 0x7fcab811e080 unknown :-1 s=CLOSED pgs=412 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcab8115420 0x7fcab8123450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 --2- 10.20.193.28:0/2853631211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcab810f230 0x7fcab811db40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 -- 10.20.193.28:0/2853631211 >> 10.20.193.28:0/2853631211 conn(0x7fcab805f830 msgr2=0x7fcab810cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 -- 10.20.193.28:0/2853631211 shutdown_connections 2026-02-20T13:18:09.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:09.829+0000 7fcabdbf0640 1 -- 10.20.193.28:0/2853631211 wait complete. 2026-02-20T13:18:09.932 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '890389b6', quiesce took 1.1 seconds. Will release after: 28.9 2026-02-20T13:18:09.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:09 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/687461989' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:09 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/687461989' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:10 trial028 ceph-mon[37442]: pgmap v206: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-20T13:18:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:10 trial028 ceph-mon[37442]: mgrmap e16: x(active, since 4m), standbys: z, y 2026-02-20T13:18:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:10 trial127 ceph-mon[43817]: pgmap v206: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-20T13:18:10.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:10 trial127 ceph-mon[43817]: mgrmap e16: x(active, since 4m), standbys: z, y 2026-02-20T13:18:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:10 trial034 ceph-mon[43332]: pgmap v206: 97 pgs: 97 active+clean; 690 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-20T13:18:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:10 trial034 ceph-mon[43332]: mgrmap e16: x(active, since 4m), standbys: z, y 2026-02-20T13:18:12.779 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:12 trial127 ceph-mon[43817]: pgmap v207: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:18:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:12 trial028 ceph-mon[37442]: pgmap v207: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:18:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:12 trial034 ceph-mon[43332]: pgmap v207: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:18:14.792 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:14 trial034 ceph-mon[43332]: pgmap v208: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2026-02-20T13:18:14.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:14 trial028 ceph-mon[37442]: pgmap v208: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2026-02-20T13:18:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:14 trial127 ceph-mon[43817]: pgmap v208: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2026-02-20T13:18:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:16 trial028 ceph-mon[37442]: pgmap v209: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2026-02-20T13:18:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:16 trial127 ceph-mon[43817]: pgmap v209: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2026-02-20T13:18:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:16 trial034 ceph-mon[43332]: pgmap v209: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2026-02-20T13:18:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:18 trial028 ceph-mon[37442]: pgmap v210: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2026-02-20T13:18:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:18 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:18:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:18 trial127 ceph-mon[43817]: pgmap v210: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2026-02-20T13:18:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:18 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:18:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:18 trial034 ceph-mon[43332]: pgmap v210: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2026-02-20T13:18:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:18 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:18:19.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:19 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:18:19.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:19 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:18:19.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:19 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:18:20.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.805+0000 7fe2c3577640 1 -- 10.20.193.28:0/556136335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 msgr2=0x7fe2c4154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.805+0000 7fe2c3577640 1 --2- 10.20.193.28:0/556136335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 0x7fe2c4154ba0 secure :-1 s=READY pgs=414 gs=2 cs=0 l=1 c_cookie=3728692192572067342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2ac009950 tx=0x7fe2ac02f190 comp rx=0 tx=0).stop 2026-02-20T13:18:20.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.805+0000 7fe2c3577640 1 -- 10.20.193.28:0/556136335 shutdown_connections 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.805+0000 7fe2c3577640 1 --2- 10.20.193.28:0/556136335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 0x7fe2c4154ba0 unknown :-1 s=CLOSED pgs=414 gs=2 cs=0 l=1 c_cookie=3728692192572067342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.805+0000 7fe2c3577640 1 --2- 10.20.193.28:0/556136335 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe2c4155330 0x7fe2c41757e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.805+0000 7fe2c3577640 1 --2- 10.20.193.28:0/556136335 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe2c4113d70 0x7fe2c4134150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.805+0000 7fe2c3577640 1 -- 10.20.193.28:0/556136335 >> 10.20.193.28:0/556136335 conn(0x7fe2c4064440 msgr2=0x7fe2c4064860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.805+0000 7fe2c3577640 1 -- 10.20.193.28:0/556136335 shutdown_connections 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 -- 10.20.193.28:0/556136335 wait complete. 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 Processor -- start 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 -- start start 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe2c4113d70 0x7fe2c41757b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 0x7fe2c4154b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe2c4155330 0x7fe2c40ff9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4100170 con 0x7fe2c4134720 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c41002e0 con 0x7fe2c4155330 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.806+0000 7fe2c3577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4100950 con 0x7fe2c4113d70 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 0x7fe2c4154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 0x7fe2c4154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57020/0 (socket says 10.20.193.28:57020) 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c2575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe2c4113d70 0x7fe2c41757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 -- 10.20.193.28:0/1651781604 learned_addr learned my addr 10.20.193.28:0/1651781604 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe2c4155330 0x7fe2c40ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 -- 10.20.193.28:0/1651781604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe2c4113d70 msgr2=0x7fe2c41757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe2c4113d70 0x7fe2c41757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 -- 10.20.193.28:0/1651781604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe2c4155330 msgr2=0x7fe2c40ff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe2c4155330 0x7fe2c40ff9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 -- 10.20.193.28:0/1651781604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac009570 con 0x7fe2c4134720 2026-02-20T13:18:20.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c1d74640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 0x7fe2c4154b40 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2ac002d80 tx=0x7fe2ac0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:20.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2ab7fe640 1 -- 10.20.193.28:0/1651781604 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2ac03d070 con 0x7fe2c4134720 2026-02-20T13:18:20.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2ab7fe640 1 -- 10.20.193.28:0/1651781604 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe2ac0043d0 con 0x7fe2c4134720 2026-02-20T13:18:20.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2ab7fe640 1 -- 10.20.193.28:0/1651781604 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2ac041be0 con 0x7fe2c4134720 2026-02-20T13:18:20.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c3577640 1 -- 10.20.193.28:0/1651781604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c4100b80 con 0x7fe2c4134720 2026-02-20T13:18:20.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.807+0000 7fe2c3577640 1 -- 10.20.193.28:0/1651781604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c4100fa0 con 0x7fe2c4134720 2026-02-20T13:18:20.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.810+0000 7fe2ab7fe640 1 -- 10.20.193.28:0/1651781604 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe2ac038920 con 0x7fe2c4134720 2026-02-20T13:18:20.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.812+0000 7fe2ab7fe640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe29c0b5760 0x7fe29c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.812+0000 7fe2ab7fe640 1 -- 10.20.193.28:0/1651781604 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe2ac10b510 con 0x7fe2c4134720 2026-02-20T13:18:20.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.812+0000 7fe2c2575640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe29c0b5760 0x7fe29c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.812+0000 7fe2cb444e00 1 Processor -- start 2026-02-20T13:18:20.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.812+0000 7fe2cb444e00 1 -- start start 2026-02-20T13:18:20.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.812+0000 7fe2c2575640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe29c0b5760 0x7fe29c0d5c10 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2c4175cf0 tx=0x7fe2b80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:20.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.812+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3bb4c0 0x55687c3db8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 0x55687c3fc1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3fc700 0x55687c41cae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55687c2d0fd0 con 0x55687c3fc700 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55687c2ccd00 con 0x55687c3dbde0 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55687c2c6ca0 con 0x55687c3bb4c0 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3bb4c0 0x55687c3db8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3fc700 0x55687c41cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3bb4c0 0x55687c3db8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60846/0 (socket says 10.20.193.28:60846) 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2575640 1 -- 10.20.193.28:0/1422697118 learned_addr learned my addr 10.20.193.28:0/1422697118 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c1d74640 1 --2- 10.20.193.28:0/1422697118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 0x55687c3fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2d76640 1 -- 10.20.193.28:0/1422697118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3bb4c0 msgr2=0x55687c3db8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/1422697118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3bb4c0 0x55687c3db8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2d76640 1 -- 10.20.193.28:0/1422697118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 msgr2=0x55687c3fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/1422697118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 0x55687c3fc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2d76640 1 -- 10.20.193.28:0/1422697118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687c2698b0 con 0x55687c3fc700 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/1422697118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3fc700 0x55687c41cae0 secure :-1 s=READY pgs=416 gs=2 cs=0 l=1 c_cookie=7714979072410205879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2b4003920 tx=0x7fe2b4003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b111c9734953eb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2a8ff9640 1 -- 10.20.193.28:0/1422697118 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2b4010c20 con 0x55687c3fc700 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2a8ff9640 1 -- 10.20.193.28:0/1422697118 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe2b4010d80 con 0x55687c3fc700 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.813+0000 7fe2a8ff9640 1 -- 10.20.193.28:0/1422697118 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2b4011880 con 0x55687c3fc700 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1422697118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3fc700 msgr2=0x55687c41cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1422697118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3fc700 0x55687c41cae0 secure :-1 s=READY pgs=416 gs=2 cs=0 l=1 c_cookie=7714979072410205879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2b4003920 tx=0x7fe2b4003df0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1422697118 shutdown_connections 2026-02-20T13:18:20.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1422697118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3fc700 0x55687c41cae0 unknown :-1 s=CLOSED pgs=416 gs=2 cs=0 l=1 c_cookie=7714979072410205879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1422697118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 0x55687c3fc1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1422697118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3bb4c0 0x55687c3db8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1422697118 >> 10.20.193.28:0/1422697118 conn(0x55687c2da1c0 msgr2=0x55687c3b9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:20.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1422697118 shutdown_connections 2026-02-20T13:18:20.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.814+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1422697118 wait complete. 2026-02-20T13:18:20.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.815+0000 7fe2cb444e00 1 -- start start 2026-02-20T13:18:20.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.815+0000 7fe2cb444e00 1 Processor -- start 2026-02-20T13:18:20.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.815+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.815+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 0x55687c3d5100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.815+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3fc700 0x55687c3d5b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.815+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55687c3d61c0 con 0x55687c3bb4c0 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.815+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55687c3d6330 con 0x55687c3dbde0 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.815+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55687c3d64f0 con 0x55687c3fc700 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3fc700 0x55687c3d5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c1d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 0x55687c3d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3fc700 0x55687c3d5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60860/0 (socket says 10.20.193.28:60860) 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 -- 10.20.193.28:0/1404155153 learned_addr learned my addr 10.20.193.28:0/1404155153 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2575640 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 -- 10.20.193.28:0/1404155153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 msgr2=0x55687c3d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 0x55687c3d5100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 -- 10.20.193.28:0/1404155153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 msgr2=0x55687c3d4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:20.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 -- 10.20.193.28:0/1404155153 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687c272400 con 0x55687c3fc700 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3fc700 0x55687c3d5b60 secure :-1 s=READY pgs=144 gs=2 cs=0 l=1 c_cookie=286640470567337949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2b4014040 tx=0x7fe2b4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa59fd426abfdd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe273fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe273fff640 1 -- 10.20.193.28:0/1404155153 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2b4022070 con 0x55687c3fc700 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe273fff640 1 -- 10.20.193.28:0/1404155153 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe2b4012d70 con 0x55687c3fc700 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b40054c0 con 0x55687c3fc700 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.816+0000 7fe273fff640 1 -- 10.20.193.28:0/1404155153 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2b4005a40 con 0x55687c3fc700 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe273fff640 1 -- 10.20.193.28:0/1404155153 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe2b4012a70 con 0x55687c3fc700 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 10 client.25708 _ll_register_callbacks cb 0x55687c251a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55687bf66520 con 0x55687c3fc700 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe273fff640 1 -- 10.20.193.28:0/1404155153 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe2b4011e40 con 0x55687c3fc700 2026-02-20T13:18:20.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 10 client.25708 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55687c24ada0 con 0x55687c3fc700 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe273fff640 1 -- 10.20.193.28:0/1404155153 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fe2b4012440 con 0x55687c3fc700 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 10 client.25708 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 10 client.25708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 20 client.25708 populate_metadata read hostname 'trial028' 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55687c3d9180 0x55687c3d9620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 4 client.25708 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55687c2f8630 con 0x55687c3d9180 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.817+0000 7fe2c2575640 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55687c3d9180 0x55687c3d9620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.818+0000 7fe2c2575640 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55687c3d9180 0x55687c3d9620 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=1576564329086638467 s_cookie=5902013830372000371 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15e114e780c2d983 server_cookie=51e82a4efac40273 in_seq=0 out_seq=0 2026-02-20T13:18:20.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.818+0000 7fe273fff640 10 client.25708 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe273fff640 1 -- 10.20.193.28:0/1404155153 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55687c2f8630 con 0x55687c3d9180 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe273fff640 10 client.25708 handle_command_reply: tid=0 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 client.25708 shutdown 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3fc700 msgr2=0x55687c3d5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3fc700 0x55687c3d5b60 secure :-1 s=READY pgs=144 gs=2 cs=0 l=1 c_cookie=286640470567337949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2b4014040 tx=0x7fe2b4011810 comp rx=0 tx=0).stop 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 shutdown_connections 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55687c3d9180 0x55687c3d9620 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=1576564329086638467 s_cookie=5902013830372000371 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3fc700 0x55687c3d5b60 unknown :-1 s=CLOSED pgs=144 gs=2 cs=0 l=1 c_cookie=286640470567337949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3dbde0 0x55687c3d5100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe273fff640 0 client.25708 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/1404155153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 >> 10.20.193.28:0/1404155153 conn(0x55687c2da1c0 msgr2=0x55687c3bc790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:20.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 shutdown_connections 2026-02-20T13:18:20.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 1 -- 10.20.193.28:0/1404155153 wait complete. 2026-02-20T13:18:20.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.819+0000 7fe2cb444e00 20 client.25708 trim_cache size 0 max 16384 2026-02-20T13:18:20.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2cb444e00 1 Processor -- start 2026-02-20T13:18:20.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2cb444e00 1 -- start start 2026-02-20T13:18:20.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 0x55687c3c6950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3fa5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55687c2c48d0 con 0x55687c3bb4c0 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55687c005f10 con 0x55687c3fc700 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55687c32c4f0 con 0x55687c3dbde0 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2c2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2c1d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 0x55687c3c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2c2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57040/0 (socket says 10.20.193.28:57040) 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2c2d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.827+0000 7fe2c2575640 1 -- 10.20.193.28:0/2755587747 learned_addr learned my addr 10.20.193.28:0/2755587747 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2c2575640 1 -- 10.20.193.28:0/2755587747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 msgr2=0x55687c3c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2c2575640 1 --2- 10.20.193.28:0/2755587747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 0x55687c3c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2c2575640 1 -- 10.20.193.28:0/2755587747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 msgr2=0x55687c3fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:20.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2c2575640 1 --2- 10.20.193.28:0/2755587747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2c2575640 1 -- 10.20.193.28:0/2755587747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687c3c7120 con 0x55687c3bb4c0 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2c2575640 1 --2- 10.20.193.28:0/2755587747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4940 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=16564324908891533530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55687c3d9ed0 tx=0x7fe2b8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e04dbe3aa270da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe28e3ff640 1 -- 10.20.193.28:0/2755587747 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2b8022040 con 0x55687c3bb4c0 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe28e3ff640 1 -- 10.20.193.28:0/2755587747 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe2b8023040 con 0x55687c3bb4c0 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe28e3ff640 1 -- 10.20.193.28:0/2755587747 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2b801d720 con 0x55687c3bb4c0 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2755587747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 msgr2=0x55687c3d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2755587747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4940 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=16564324908891533530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55687c3d9ed0 tx=0x7fe2b8013000 comp rx=0 tx=0).stop 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2755587747 shutdown_connections 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2755587747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3fa5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2755587747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 0x55687c3c6950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2755587747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3d4940 unknown :-1 s=CLOSED pgs=417 gs=1 cs=0 l=1 c_cookie=16564324908891533530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2755587747 >> 10.20.193.28:0/2755587747 conn(0x55687c2da1c0 msgr2=0x55687c3d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:20.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2755587747 shutdown_connections 2026-02-20T13:18:20.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.828+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2755587747 wait complete. 2026-02-20T13:18:20.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2cb444e00 1 -- start start 2026-02-20T13:18:20.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2cb444e00 1 Processor -- start 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3db7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 0x55687c3dc210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2cb444e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3dc900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55687c3dd000 con 0x55687c3bb4c0 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55687c3dd170 con 0x55687c3fc700 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2cb444e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55687c3dd330 con 0x55687c3dbde0 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2c2d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2c2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3db7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2c1d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 0x55687c3dc210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2c2d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3dc900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45552/0 (socket says 10.20.193.28:45552) 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.829+0000 7fe2c2d76640 1 -- 10.20.193.28:0/2880541887 learned_addr learned my addr 10.20.193.28:0/2880541887 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2c2d76640 1 -- 10.20.193.28:0/2880541887 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 msgr2=0x55687c3dc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 0x55687c3dc210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2c2d76640 1 -- 10.20.193.28:0/2880541887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 msgr2=0x55687c3db7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3db7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2c2d76640 1 -- 10.20.193.28:0/2880541887 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687c25c670 con 0x55687c3fc700 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2c2575640 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3db7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2c2d76640 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3dc900 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=7135996770977532317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2b4006a20 tx=0x7fe2b4010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=630827414c73499d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe273fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe273fff640 1 -- 10.20.193.28:0/2880541887 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2b4022050 con 0x55687c3fc700 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe273fff640 1 -- 10.20.193.28:0/2880541887 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55687bf66520 con 0x55687c3fc700 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b8011600 con 0x55687c3fc700 2026-02-20T13:18:20.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe273fff640 1 -- 10.20.193.28:0/2880541887 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2b4005a40 con 0x55687c3fc700 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe273fff640 1 -- 10.20.193.28:0/2880541887 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe2b4011400 con 0x55687c3fc700 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2cb444e00 10 client.25763 _ll_register_callbacks cb 0x55687c251a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.830+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55687c376ca0 con 0x55687c3fc700 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe273fff640 1 -- 10.20.193.28:0/2880541887 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe2b4005c20 con 0x55687c3fc700 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2cb444e00 10 client.25763 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55687c2570f0 con 0x55687c3fc700 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe273fff640 1 -- 10.20.193.28:0/2880541887 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fe2b40316e0 con 0x55687c3fc700 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2cb444e00 10 client.25763 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2cb444e00 10 client.25763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2cb444e00 20 client.25763 populate_metadata read hostname 'trial028' 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55687c3dedc0 0x55687c3df260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2cb444e00 4 client.25763 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:18:20.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55687bfaa640 con 0x55687c3dedc0 2026-02-20T13:18:20.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.831+0000 7fe2c2575640 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55687c3dedc0 0x55687c3df260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:20.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.832+0000 7fe2c2575640 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55687c3dedc0 0x55687c3df260 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=9250283853250930980 s_cookie=14412911782949407086 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=805f9c27888da924 server_cookie=c804f2e759bdc96e in_seq=0 out_seq=0 2026-02-20T13:18:20.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.832+0000 7fe273fff640 10 client.25763 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:20.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe273fff640 1 -- 10.20.193.28:0/2880541887 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55687bfaa640 con 0x55687c3dedc0 2026-02-20T13:18:20.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe273fff640 10 client.25763 handle_command_reply: tid=0 2026-02-20T13:18:20.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 client.25763 shutdown 2026-02-20T13:18:20.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 msgr2=0x55687c3dc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3dc900 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=7135996770977532317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2b4006a20 tx=0x7fe2b4010860 comp rx=0 tx=0).stop 2026-02-20T13:18:20.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 shutdown_connections 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55687c3dedc0 0x55687c3df260 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=9250283853250930980 s_cookie=14412911782949407086 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55687c3fc700 0x55687c3dc900 unknown :-1 s=CLOSED pgs=176 gs=2 cs=0 l=1 c_cookie=7135996770977532317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55687c3dbde0 0x55687c3dc210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 --2- 10.20.193.28:0/2880541887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55687c3bb4c0 0x55687c3db7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 >> 10.20.193.28:0/2880541887 conn(0x55687c2da1c0 msgr2=0x55687c3d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe273fff640 0 client.25763 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 shutdown_connections 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 1 -- 10.20.193.28:0/2880541887 wait complete. 2026-02-20T13:18:20.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.835+0000 7fe2cb444e00 20 client.25763 trim_cache size 0 max 16384 2026-02-20T13:18:20.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:18:20.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:18:20.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:18:20.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 -- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe29c0b5760 msgr2=0x7fe29c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe29c0b5760 0x7fe29c0d5c10 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2c4175cf0 tx=0x7fe2b80073d0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 -- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 msgr2=0x7fe2c4154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 0x7fe2c4154b40 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2ac002d80 tx=0x7fe2ac0028d0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 -- 10.20.193.28:0/1651781604 shutdown_connections 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe29c0b5760 0x7fe29c0d5c10 unknown :-1 s=CLOSED pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2c4134720 0x7fe2c4154b40 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe2c4155330 0x7fe2c40ff9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 --2- 10.20.193.28:0/1651781604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe2c4113d70 0x7fe2c41757b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:20.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 -- 10.20.193.28:0/1651781604 >> 10.20.193.28:0/1651781604 conn(0x7fe2c4064440 msgr2=0x7fe2c40f61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:20.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 -- 10.20.193.28:0/1651781604 shutdown_connections 2026-02-20T13:18:20.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:20.836+0000 7fe2c3577640 1 -- 10.20.193.28:0/1651781604 wait complete. 2026-02-20T13:18:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:20 trial028 ceph-mon[37442]: pgmap v211: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2026-02-20T13:18:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:20 trial127 ceph-mon[43817]: pgmap v211: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2026-02-20T13:18:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:20 trial034 ceph-mon[43332]: pgmap v211: 97 pgs: 97 active+clean; 716 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2026-02-20T13:18:22.185 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:18:22.370 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:22.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 -- 10.20.193.28:0/2687294220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 msgr2=0x7fcde810f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 --2- 10.20.193.28:0/2687294220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 0x7fcde810f990 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=12346196985418968961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8009950 tx=0x7fcdd802f190 comp rx=0 tx=0).stop 2026-02-20T13:18:22.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 -- 10.20.193.28:0/2687294220 shutdown_connections 2026-02-20T13:18:22.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 --2- 10.20.193.28:0/2687294220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 0x7fcde810f990 unknown :-1 s=CLOSED pgs=418 gs=1 cs=0 l=1 c_cookie=12346196985418968961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 --2- 10.20.193.28:0/2687294220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcde8110140 0x7fcde8173d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 --2- 10.20.193.28:0/2687294220 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcde810b650 0x7fcde810ba20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 -- 10.20.193.28:0/2687294220 >> 10.20.193.28:0/2687294220 conn(0x7fcde80e9080 msgr2=0x7fcde8109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:22.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 -- 10.20.193.28:0/2687294220 shutdown_connections 2026-02-20T13:18:22.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.549+0000 7fcdecede640 1 -- 10.20.193.28:0/2687294220 wait complete. 2026-02-20T13:18:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcdecede640 1 Processor -- start 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcdecede640 1 -- start start 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcdecede640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcde810b650 0x7fcde80f3d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcdecede640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 0x7fcde8173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcdecede640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcde8110140 0x7fcde80f4410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcdecede640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcde80f9620 con 0x7fcde810c040 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcdecede640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcde80f9790 con 0x7fcde810b650 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcdecede640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcde80f9950 con 0x7fcde8110140 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcde6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 0x7fcde8173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.550+0000 7fcde6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 0x7fcde8173c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57068/0 (socket says 10.20.193.28:57068) 2026-02-20T13:18:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde6ffd640 1 -- 10.20.193.28:0/665469237 learned_addr learned my addr 10.20.193.28:0/665469237 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde7fff640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcde8110140 0x7fcde80f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde77fe640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcde810b650 0x7fcde80f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde6ffd640 1 -- 10.20.193.28:0/665469237 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcde8110140 msgr2=0x7fcde80f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcde8110140 0x7fcde80f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde6ffd640 1 -- 10.20.193.28:0/665469237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcde810b650 msgr2=0x7fcde80f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcde810b650 0x7fcde80f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde6ffd640 1 -- 10.20.193.28:0/665469237 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd8009570 con 0x7fcde810c040 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 0x7fcde8173c50 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8038820 tx=0x7fcdd8004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde4ff9640 1 -- 10.20.193.28:0/665469237 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd803d070 con 0x7fcde810c040 2026-02-20T13:18:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde4ff9640 1 -- 10.20.193.28:0/665469237 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdd8002ad0 con 0x7fcde810c040 2026-02-20T13:18:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcde4ff9640 1 -- 10.20.193.28:0/665469237 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd8041930 con 0x7fcde810c040 2026-02-20T13:18:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcdecede640 1 -- 10.20.193.28:0/665469237 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde80f9bd0 con 0x7fcde810c040 2026-02-20T13:18:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.551+0000 7fcdecede640 1 -- 10.20.193.28:0/665469237 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde80f9ff0 con 0x7fcde810c040 2026-02-20T13:18:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.554+0000 7fcde4ff9640 1 -- 10.20.193.28:0/665469237 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcdd802f9f0 con 0x7fcde810c040 2026-02-20T13:18:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.556+0000 7fcde4ff9640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdbc0b5750 0x7fcdbc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.556+0000 7fcde4ff9640 1 -- 10.20.193.28:0/665469237 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdd810b070 con 0x7fcde810c040 2026-02-20T13:18:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.556+0000 7fcde77fe640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdbc0b5750 0x7fcdbc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.556+0000 7fcdf0161e00 1 Processor -- start 2026-02-20T13:18:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.556+0000 7fcde77fe640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdbc0b5750 0x7fcdbc0d5c00 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd4004740 tx=0x7fcdd4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcdf0161e00 1 -- start start 2026-02-20T13:18:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c512550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c512a90 0x55754c557400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c557940 0x55754c577d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55754c4287d0 con 0x55754c557940 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55754c424500 con 0x55754c512a90 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55754c41e4a0 con 0x55754c512180 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c557940 0x55754c577d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c512550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c512a90 0x55754c557400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c557940 0x55754c577d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57072/0 (socket says 10.20.193.28:57072) 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde7fff640 1 -- 10.20.193.28:0/3005206778 learned_addr learned my addr 10.20.193.28:0/3005206778 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde7fff640 1 -- 10.20.193.28:0/3005206778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 msgr2=0x55754c512550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:22.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde7fff640 1 --2- 10.20.193.28:0/3005206778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c512550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde7fff640 1 -- 10.20.193.28:0/3005206778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c512a90 msgr2=0x55754c557400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde7fff640 1 --2- 10.20.193.28:0/3005206778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c512a90 0x55754c557400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.557+0000 7fcde7fff640 1 -- 10.20.193.28:0/3005206778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754c3c9d80 con 0x55754c557940 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcde7fff640 1 --2- 10.20.193.28:0/3005206778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c557940 0x55754c577d20 secure :-1 s=READY pgs=420 gs=2 cs=0 l=1 c_cookie=7755222509341744153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcddc0055b0 tx=0x7fcddc003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba015c8876d9c19 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdabfff640 1 -- 10.20.193.28:0/3005206778 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcddc003e30 con 0x55754c557940 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdabfff640 1 -- 10.20.193.28:0/3005206778 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcddc00ace0 con 0x55754c557940 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdabfff640 1 -- 10.20.193.28:0/3005206778 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcddc0118e0 con 0x55754c557940 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3005206778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c557940 msgr2=0x55754c577d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3005206778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c557940 0x55754c577d20 secure :-1 s=READY pgs=420 gs=2 cs=0 l=1 c_cookie=7755222509341744153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcddc0055b0 tx=0x7fcddc003c30 comp rx=0 tx=0).stop 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3005206778 shutdown_connections 2026-02-20T13:18:22.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3005206778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c557940 0x55754c577d20 unknown :-1 s=CLOSED pgs=420 gs=2 cs=0 l=1 c_cookie=7755222509341744153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3005206778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c512a90 0x55754c557400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3005206778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c512550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3005206778 >> 10.20.193.28:0/3005206778 conn(0x55754c4f0680 msgr2=0x55754c510a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:22.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3005206778 shutdown_connections 2026-02-20T13:18:22.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.558+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3005206778 wait complete. 2026-02-20T13:18:22.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.560+0000 7fcdf0161e00 1 -- start start 2026-02-20T13:18:22.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.560+0000 7fcdf0161e00 1 Processor -- start 2026-02-20T13:18:22.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.560+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56f170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.560+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56f6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.560+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5746a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.560+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55754c574be0 con 0x55754c512a90 2026-02-20T13:18:22.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.560+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55754c574d50 con 0x55754c557940 2026-02-20T13:18:22.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.560+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55754c574f10 con 0x55754c512180 2026-02-20T13:18:22.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56f170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56f170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60914/0 (socket says 10.20.193.28:60914) 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde77fe640 1 -- 10.20.193.28:0/3802726891 learned_addr learned my addr 10.20.193.28:0/3802726891 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde7fff640 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde6ffd640 1 -- 10.20.193.28:0/3802726891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 msgr2=0x55754c56f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56f170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde6ffd640 1 -- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 msgr2=0x55754c5746a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5746a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde6ffd640 1 -- 10.20.193.28:0/3802726891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754c3a2350 con 0x55754c512a90 2026-02-20T13:18:22.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde7fff640 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5746a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56f6b0 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=9663385063476996418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8108c30 tx=0x7fcdd80d1570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861b3d84345ca942 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcda97fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcda97fa640 1 -- 10.20.193.28:0/3802726891 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd80d9710 con 0x55754c512a90 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcda97fa640 1 -- 10.20.193.28:0/3802726891 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdd80dc550 con 0x55754c512a90 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcda97fa640 1 -- 10.20.193.28:0/3802726891 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd80cf4a0 con 0x55754c512a90 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcddc005250 con 0x55754c512a90 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcda97fa640 1 -- 10.20.193.28:0/3802726891 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdd80cf600 con 0x55754c512a90 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcda97fa640 10 client.15777 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.561+0000 7fcdf0161e00 10 client.15777 _ll_register_callbacks cb 0x55754c39f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55754c0b46f0 con 0x55754c512a90 2026-02-20T13:18:22.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcda97fa640 1 -- 10.20.193.28:0/3802726891 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcdd80dc0c0 con 0x55754c512a90 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 10 client.15777 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55754c3b4150 con 0x55754c512a90 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcda97fa640 1 -- 10.20.193.28:0/3802726891 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fcdd80d2e00 con 0x55754c512a90 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 10 client.15777 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 20 client.15777 populate_metadata read hostname 'trial028' 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55754c554910 0x55754c554db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 4 client.15777 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55754c42bd60 con 0x55754c554910 2026-02-20T13:18:22.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.562+0000 7fcde77fe640 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55754c554910 0x55754c554db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcde77fe640 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55754c554910 0x55754c554db0 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=3627553670146428256 s_cookie=6719147891138187252 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3257a8d7e8be0d60 server_cookie=5d3f35684c9b4ff4 in_seq=0 out_seq=0 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcda97fa640 10 client.15777 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcda97fa640 1 -- 10.20.193.28:0/3802726891 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55754c42bd60 con 0x55754c554910 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcda97fa640 10 client.15777 handle_command_reply: tid=0 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 client.15777 shutdown 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 msgr2=0x55754c56f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56f6b0 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=9663385063476996418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8108c30 tx=0x7fcdd80d1570 comp rx=0 tx=0).stop 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 shutdown_connections 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55754c554910 0x55754c554db0 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=3627553670146428256 s_cookie=6719147891138187252 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56f6b0 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=9663385063476996418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5746a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3802726891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56f170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcda97fa640 0 client.15777 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 >> 10.20.193.28:0/3802726891 conn(0x55754c4f0680 msgr2=0x55754c510a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.563+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 shutdown_connections 2026-02-20T13:18:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.564+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3802726891 wait complete. 2026-02-20T13:18:22.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.564+0000 7fcdf0161e00 20 client.15777 trim_cache size 0 max 16384 2026-02-20T13:18:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcdf0161e00 1 Processor -- start 2026-02-20T13:18:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcdf0161e00 1 -- start start 2026-02-20T13:18:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56c570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56cab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5566a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55754c41c0d0 con 0x55754c512a90 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55754c0dc700 con 0x55754c557940 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55754c512790 con 0x55754c512180 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56c570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57090/0 (socket says 10.20.193.28:57090) 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde6ffd640 1 -- 10.20.193.28:0/868731749 learned_addr learned my addr 10.20.193.28:0/868731749 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde7fff640 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde6ffd640 1 -- 10.20.193.28:0/868731749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 msgr2=0x55754c56c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56c570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde6ffd640 1 -- 10.20.193.28:0/868731749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 msgr2=0x55754c5566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde6ffd640 1 -- 10.20.193.28:0/868731749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754c3aebd0 con 0x55754c512a90 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.573+0000 7fcde7fff640 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5566a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56cab0 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=10968403419211298470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8009480 tx=0x7fcdd809b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983798cbf344f6a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdab7fe640 1 -- 10.20.193.28:0/868731749 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd80d1c60 con 0x55754c512a90 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdab7fe640 1 -- 10.20.193.28:0/868731749 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55754c0b46f0 con 0x55754c512a90 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdab7fe640 1 -- 10.20.193.28:0/868731749 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd8004870 con 0x55754c512a90 2026-02-20T13:18:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 -- 10.20.193.28:0/868731749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 msgr2=0x55754c56cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56cab0 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=10968403419211298470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8009480 tx=0x7fcdd809b000 comp rx=0 tx=0).stop 2026-02-20T13:18:22.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 -- 10.20.193.28:0/868731749 shutdown_connections 2026-02-20T13:18:22.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512a90 0x55754c56cab0 unknown :-1 s=CLOSED pgs=422 gs=1 cs=0 l=1 c_cookie=10968403419211298470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c5566a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/868731749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512180 0x55754c56c570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 -- 10.20.193.28:0/868731749 >> 10.20.193.28:0/868731749 conn(0x55754c4f0680 msgr2=0x55754c559d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:22.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 -- 10.20.193.28:0/868731749 shutdown_connections 2026-02-20T13:18:22.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.574+0000 7fcdf0161e00 1 -- 10.20.193.28:0/868731749 wait complete. 2026-02-20T13:18:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.575+0000 7fcdf0161e00 1 -- start start 2026-02-20T13:18:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.575+0000 7fcdf0161e00 1 Processor -- start 2026-02-20T13:18:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.575+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512180 0x55754c4f6510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.575+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512a90 0x55754c4f5000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.575+0000 7fcdf0161e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c4f5540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.575+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55754c4f5b80 con 0x55754c512180 2026-02-20T13:18:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.575+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55754c4f5cf0 con 0x55754c557940 2026-02-20T13:18:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.575+0000 7fcdf0161e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55754c4f5eb0 con 0x55754c512a90 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512a90 0x55754c4f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512a90 0x55754c4f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60940/0 (socket says 10.20.193.28:60940) 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 -- 10.20.193.28:0/3603476876 learned_addr learned my addr 10.20.193.28:0/3603476876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde77fe640 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512180 0x55754c4f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde7fff640 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c4f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 -- 10.20.193.28:0/3603476876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 msgr2=0x55754c4f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c4f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 -- 10.20.193.28:0/3603476876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512180 msgr2=0x55754c4f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512180 0x55754c4f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 -- 10.20.193.28:0/3603476876 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754c3a2680 con 0x55754c512a90 2026-02-20T13:18:22.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde77fe640 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512180 0x55754c4f6510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcde6ffd640 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512a90 0x55754c4f5000 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=9906832185262848229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8032040 tx=0x7fcdd80d1570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=897c236243ffb8e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcda97fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcda97fa640 1 -- 10.20.193.28:0/3603476876 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd80d9710 con 0x55754c512a90 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcda97fa640 1 -- 10.20.193.28:0/3603476876 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdd80dc550 con 0x55754c512a90 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754c3b4150 con 0x55754c512a90 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcda97fa640 1 -- 10.20.193.28:0/3603476876 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd80d1930 con 0x55754c512a90 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcdf0161e00 10 client.25732 _ll_register_callbacks cb 0x55754c39f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55754c1764a0 con 0x55754c512a90 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.576+0000 7fcda97fa640 1 -- 10.20.193.28:0/3603476876 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdd80cf4a0 con 0x55754c512a90 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcda97fa640 1 -- 10.20.193.28:0/3603476876 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcdd80dc0c0 con 0x55754c512a90 2026-02-20T13:18:22.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcdf0161e00 10 client.25732 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55754c3b43b0 con 0x55754c512a90 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcda97fa640 1 -- 10.20.193.28:0/3603476876 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fcdd80d2600 con 0x55754c512a90 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcdf0161e00 10 client.25732 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcdf0161e00 10 client.25732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcdf0161e00 20 client.25732 populate_metadata read hostname 'trial028' 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55754c6049d0 0x55754c624db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcdf0161e00 4 client.25732 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fcddc00ace0 con 0x55754c6049d0 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.577+0000 7fcde77fe640 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55754c6049d0 0x55754c624db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcde77fe640 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55754c6049d0 0x55754c624db0 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=8940540523416280102 s_cookie=9104182587700430112 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c132e3cae365c26 server_cookie=7e588dd3d62e4520 in_seq=0 out_seq=0 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcda97fa640 10 client.25732 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:22.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcda97fa640 1 -- 10.20.193.28:0/3603476876 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x7fcddc00ace0 con 0x55754c6049d0 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcda97fa640 10 client.25732 handle_command_reply: tid=0 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 client.25732 shutdown 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512a90 msgr2=0x55754c4f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512a90 0x55754c4f5000 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=9906832185262848229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8032040 tx=0x7fcdd80d1570 comp rx=0 tx=0).stop 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 shutdown_connections 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55754c6049d0 0x55754c624db0 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=8940540523416280102 s_cookie=9104182587700430112 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55754c557940 0x55754c4f5540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcda97fa640 0 client.25732 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55754c512a90 0x55754c4f5000 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=9906832185262848229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 --2- 10.20.193.28:0/3603476876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55754c512180 0x55754c4f6510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 >> 10.20.193.28:0/3603476876 conn(0x55754c4f0680 msgr2=0x55754c56b560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:22.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 shutdown_connections 2026-02-20T13:18:22.589 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:18:22.589 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:18:22.589 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:18:22.589 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:18:22.589 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:18:22.589 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:18:22.590 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:18:22.591 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:18:22.591 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:18:22.591 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:22.591 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:22.591 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:18:22.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 1 -- 10.20.193.28:0/3603476876 wait complete. 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdf0161e00 20 client.25732 trim_cache size 0 max 16384 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdecede640 1 -- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdbc0b5750 msgr2=0x7fcdbc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdecede640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdbc0b5750 0x7fcdbc0d5c00 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd4004740 tx=0x7fcdd4005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdecede640 1 -- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 msgr2=0x7fcde8173c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.578+0000 7fcdecede640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 0x7fcde8173c50 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8038820 tx=0x7fcdd8004300 comp rx=0 tx=0).stop 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.579+0000 7fcdecede640 1 -- 10.20.193.28:0/665469237 shutdown_connections 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.579+0000 7fcdecede640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdbc0b5750 0x7fcdbc0d5c00 unknown :-1 s=CLOSED pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.579+0000 7fcdecede640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde810c040 0x7fcde8173c50 unknown :-1 s=CLOSED pgs=419 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.579+0000 7fcdecede640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcde8110140 0x7fcde80f4410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.579+0000 7fcdecede640 1 --2- 10.20.193.28:0/665469237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcde810b650 0x7fcde80f3d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:22.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.579+0000 7fcdecede640 1 -- 10.20.193.28:0/665469237 >> 10.20.193.28:0/665469237 conn(0x7fcde80e9080 msgr2=0x7fcde810ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:22.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.579+0000 7fcdecede640 1 -- 10.20.193.28:0/665469237 shutdown_connections 2026-02-20T13:18:22.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:22.579+0000 7fcdecede640 1 -- 10.20.193.28:0/665469237 wait complete. 2026-02-20T13:18:22.679 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:18:22.680 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:18:22.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:22 trial028 ceph-mon[37442]: pgmap v212: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2026-02-20T13:18:22.867 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:22 trial127 ceph-mon[43817]: pgmap v212: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2026-02-20T13:18:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:22 trial034 ceph-mon[43332]: pgmap v212: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2026-02-20T13:18:23.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 -- 10.20.193.28:0/435125620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6afc159d80 msgr2=0x7f6afc17a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 --2- 10.20.193.28:0/435125620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6afc159d80 0x7f6afc17a160 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=7300622502139247107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6af000aa30 tx=0x7f6af0030270 comp rx=0 tx=0).stop 2026-02-20T13:18:23.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 -- 10.20.193.28:0/435125620 shutdown_connections 2026-02-20T13:18:23.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 --2- 10.20.193.28:0/435125620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6afc0614f0 0x7f6afc061920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 --2- 10.20.193.28:0/435125620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6afc159d80 0x7f6afc17a160 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=7300622502139247107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 --2- 10.20.193.28:0/435125620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6afc062ae0 0x7f6afc060fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 -- 10.20.193.28:0/435125620 >> 10.20.193.28:0/435125620 conn(0x7f6afc0eab00 msgr2=0x7f6afc10af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:23.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 -- 10.20.193.28:0/435125620 shutdown_connections 2026-02-20T13:18:23.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.040+0000 7f6b00d63640 1 -- 10.20.193.28:0/435125620 wait complete. 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6b00d63640 1 Processor -- start 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6b00d63640 1 -- start start 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6b00d63640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6afc0614f0 0x7f6afc0f2e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6b00d63640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6afc062ae0 0x7f6afc0f3340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6b00d63640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6afc159d80 0x7f6afc0f8710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6b00d63640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc0f8d30 con 0x7f6afc159d80 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6b00d63640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc0f8ea0 con 0x7f6afc062ae0 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6b00d63640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc0f9060 con 0x7f6afc0614f0 2026-02-20T13:18:23.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6afb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6afc0614f0 0x7f6afc0f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6afbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6afc159d80 0x7f6afc0f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6afb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6afc0614f0 0x7f6afc0f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60950/0 (socket says 10.20.193.28:60950) 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6afbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6afc159d80 0x7f6afc0f8710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57116/0 (socket says 10.20.193.28:57116) 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6afb7fe640 1 -- 10.20.193.28:0/1635913670 learned_addr learned my addr 10.20.193.28:0/1635913670 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.041+0000 7f6afaffd640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6afc062ae0 0x7f6afc0f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6afbfff640 1 -- 10.20.193.28:0/1635913670 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6afc0614f0 msgr2=0x7f6afc0f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6afbfff640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6afc0614f0 0x7f6afc0f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6afbfff640 1 -- 10.20.193.28:0/1635913670 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6afc062ae0 msgr2=0x7f6afc0f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6afbfff640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6afc062ae0 0x7f6afc0f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6afbfff640 1 -- 10.20.193.28:0/1635913670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af000a650 con 0x7f6afc159d80 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6afbfff640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6afc159d80 0x7f6afc0f8710 secure :-1 s=READY pgs=423 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6af000aa30 tx=0x7f6af0030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6af8ff9640 1 -- 10.20.193.28:0/1635913670 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6af003e070 con 0x7f6afc159d80 2026-02-20T13:18:23.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6af8ff9640 1 -- 10.20.193.28:0/1635913670 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6af0039e00 con 0x7f6afc159d80 2026-02-20T13:18:23.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6afc0f92e0 con 0x7f6afc159d80 2026-02-20T13:18:23.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6af8ff9640 1 -- 10.20.193.28:0/1635913670 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6af0042820 con 0x7f6afc159d80 2026-02-20T13:18:23.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.042+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6afc0f9880 con 0x7f6afc159d80 2026-02-20T13:18:23.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.043+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6afc0624c0 con 0x7f6afc159d80 2026-02-20T13:18:23.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.045+0000 7f6af8ff9640 1 -- 10.20.193.28:0/1635913670 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6af0039920 con 0x7f6afc159d80 2026-02-20T13:18:23.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.046+0000 7f6af8ff9640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6ad00b56e0 0x7f6ad00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.046+0000 7f6af8ff9640 1 -- 10.20.193.28:0/1635913670 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6af010c890 con 0x7f6afc159d80 2026-02-20T13:18:23.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.047+0000 7f6afb7fe640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6ad00b56e0 0x7f6ad00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.047+0000 7f6af8ff9640 1 -- 10.20.193.28:0/1635913670 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f6af00cf240 con 0x7f6afc159d80 2026-02-20T13:18:23.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.047+0000 7f6afb7fe640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6ad00b56e0 0x7f6ad00d5b90 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ae80095b0 tx=0x7f6ae8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:23.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.188+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6afc0f3f60 con 0x7f6afc159d80 2026-02-20T13:18:23.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.189+0000 7f6af8ff9640 1 -- 10.20.193.28:0/1635913670 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12003 (secure 0 0 0) 0x7f6af00d23f0 con 0x7f6afc159d80 2026-02-20T13:18:23.192 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:18:23.193 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T13:18:23.193 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T13:17:23:438313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:23.339303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6ad00b56e0 msgr2=0x7f6ad00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6ad00b56e0 0x7f6ad00d5b90 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ae80095b0 tx=0x7f6ae8005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6afc159d80 msgr2=0x7f6afc0f8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6afc159d80 0x7f6afc0f8710 secure :-1 s=READY pgs=423 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6af000aa30 tx=0x7f6af0030d70 comp rx=0 tx=0).stop 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 shutdown_connections 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6ad00b56e0 0x7f6ad00d5b90 unknown :-1 s=CLOSED pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6afc159d80 0x7f6afc0f8710 unknown :-1 s=CLOSED pgs=423 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6afc062ae0 0x7f6afc0f3340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 --2- 10.20.193.28:0/1635913670 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6afc0614f0 0x7f6afc0f2e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 >> 10.20.193.28:0/1635913670 conn(0x7f6afc0eab00 msgr2=0x7f6afc10e450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:23.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 shutdown_connections 2026-02-20T13:18:23.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.190+0000 7f6b00d63640 1 -- 10.20.193.28:0/1635913670 wait complete. 2026-02-20T13:18:23.291 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:18:23.477 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.653+0000 7fd327fff640 1 -- 10.20.193.28:0/4230871372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810f4b0 msgr2=0x7fd32810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.653+0000 7fd327fff640 1 --2- 10.20.193.28:0/4230871372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810f4b0 0x7fd32810f880 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=16205679723095908072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd31c009950 tx=0x7fd31c02f190 comp rx=0 tx=0).stop 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.653+0000 7fd327fff640 1 -- 10.20.193.28:0/4230871372 shutdown_connections 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.653+0000 7fd327fff640 1 --2- 10.20.193.28:0/4230871372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3281156a0 0x7fd328176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.653+0000 7fd327fff640 1 --2- 10.20.193.28:0/4230871372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd32810fea0 0x7fd328114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.653+0000 7fd327fff640 1 --2- 10.20.193.28:0/4230871372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810f4b0 0x7fd32810f880 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=16205679723095908072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.653+0000 7fd327fff640 1 -- 10.20.193.28:0/4230871372 >> 10.20.193.28:0/4230871372 conn(0x7fd3280ecda0 msgr2=0x7fd32810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.653+0000 7fd327fff640 1 -- 10.20.193.28:0/4230871372 shutdown_connections 2026-02-20T13:18:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.654+0000 7fd327fff640 1 -- 10.20.193.28:0/4230871372 wait complete. 2026-02-20T13:18:23.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.654+0000 7fd327fff640 1 Processor -- start 2026-02-20T13:18:23.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.654+0000 7fd327fff640 1 -- start start 2026-02-20T13:18:23.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd327fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd32810f4b0 0x7fd32811de40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd327fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810fea0 0x7fd32811e380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd327fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3281156a0 0x7fd328123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd327fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd328123d20 con 0x7fd32810fea0 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd327fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd328123e90 con 0x7fd3281156a0 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd327fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd328124050 con 0x7fd32810f4b0 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810fea0 0x7fd32811e380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810fea0 0x7fd32811e380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57140/0 (socket says 10.20.193.28:57140) 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 -- 10.20.193.28:0/1968308420 learned_addr learned my addr 10.20.193.28:0/1968308420 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd326ffd640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd32810f4b0 0x7fd32811de40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3277fe640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3281156a0 0x7fd328123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 -- 10.20.193.28:0/1968308420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd32810f4b0 msgr2=0x7fd32811de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd32810f4b0 0x7fd32811de40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 -- 10.20.193.28:0/1968308420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3281156a0 msgr2=0x7fd328123700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3281156a0 0x7fd328123700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 -- 10.20.193.28:0/1968308420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c009570 con 0x7fd32810fea0 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3277fe640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3281156a0 0x7fd328123700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd3267fc640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810fea0 0x7fd32811e380 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3100072a0 tx=0x7fd31000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd307fff640 1 -- 10.20.193.28:0/1968308420 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd310004500 con 0x7fd32810fea0 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd307fff640 1 -- 10.20.193.28:0/1968308420 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd31000bd20 con 0x7fd32810fea0 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd307fff640 1 -- 10.20.193.28:0/1968308420 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd310002ea0 con 0x7fd32810fea0 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.655+0000 7fd327fff640 1 -- 10.20.193.28:0/1968308420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd328124330 con 0x7fd32810fea0 2026-02-20T13:18:23.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.656+0000 7fd327fff640 1 -- 10.20.193.28:0/1968308420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd328164a30 con 0x7fd32810fea0 2026-02-20T13:18:23.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.658+0000 7fd307fff640 1 -- 10.20.193.28:0/1968308420 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd31000b840 con 0x7fd32810fea0 2026-02-20T13:18:23.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.660+0000 7fd307fff640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2fc0b5760 0x7fd2fc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.660+0000 7fd307fff640 1 -- 10.20.193.28:0/1968308420 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd3100e6c50 con 0x7fd32810fea0 2026-02-20T13:18:23.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.660+0000 7fd326ffd640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2fc0b5760 0x7fd2fc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd326ffd640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2fc0b5760 0x7fd2fc0d5c10 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd31c0023d0 tx=0x7fd31c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:23.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd32f651e00 1 Processor -- start 2026-02-20T13:18:23.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd32f651e00 1 -- start start 2026-02-20T13:18:23.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79c64730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79c64c70 0x559d79ca95e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79ca9b20 0x559d79cc9f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd32f651e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d79b7a780 con 0x559d79c64360 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd32f651e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d79b764b0 con 0x559d79ca9b20 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd32f651e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d79b70450 con 0x559d79c64c70 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.661+0000 7fd326ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79c64730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd326ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79c64730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57146/0 (socket says 10.20.193.28:57146) 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd326ffd640 1 -- 10.20.193.28:0/933224128 learned_addr learned my addr 10.20.193.28:0/933224128 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd3277fe640 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79ca9b20 0x559d79cc9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd3267fc640 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79c64c70 0x559d79ca95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd326ffd640 1 -- 10.20.193.28:0/933224128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79c64c70 msgr2=0x559d79ca95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd326ffd640 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79c64c70 0x559d79ca95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd326ffd640 1 -- 10.20.193.28:0/933224128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79ca9b20 msgr2=0x559d79cc9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd326ffd640 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79ca9b20 0x559d79cc9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd326ffd640 1 -- 10.20.193.28:0/933224128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d79b1bd10 con 0x559d79c64360 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd3267fc640 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79c64c70 0x559d79ca95e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd326ffd640 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79c64730 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=4524275360435935241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd31c002dd0 tx=0x7fd31c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec974783cd61809 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd2f37fe640 1 -- 10.20.193.28:0/933224128 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd31c002a80 con 0x559d79c64360 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd2f37fe640 1 -- 10.20.193.28:0/933224128 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd31c038920 con 0x559d79c64360 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd2f37fe640 1 -- 10.20.193.28:0/933224128 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd31c0438b0 con 0x559d79c64360 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd32f651e00 1 -- 10.20.193.28:0/933224128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 msgr2=0x559d79c64730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd32f651e00 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79c64730 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=4524275360435935241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd31c002dd0 tx=0x7fd31c040000 comp rx=0 tx=0).stop 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd32f651e00 1 -- 10.20.193.28:0/933224128 shutdown_connections 2026-02-20T13:18:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd32f651e00 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79ca9b20 0x559d79cc9f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd32f651e00 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79c64c70 0x559d79ca95e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.662+0000 7fd32f651e00 1 --2- 10.20.193.28:0/933224128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79c64730 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=4524275360435935241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.663+0000 7fd32f651e00 1 -- 10.20.193.28:0/933224128 >> 10.20.193.28:0/933224128 conn(0x559d79c42860 msgr2=0x559d79c62c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.663+0000 7fd32f651e00 1 -- 10.20.193.28:0/933224128 shutdown_connections 2026-02-20T13:18:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.663+0000 7fd32f651e00 1 -- 10.20.193.28:0/933224128 wait complete. 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.664+0000 7fd32f651e00 1 -- start start 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.664+0000 7fd32f651e00 1 Processor -- start 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.664+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79cc1720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.664+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64c70 0x559d79cc1c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.664+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79cc39f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.664+0000 7fd32f651e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d79cc3f60 con 0x559d79c64360 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.664+0000 7fd32f651e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d79cc40d0 con 0x559d79c64c70 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.664+0000 7fd32f651e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d79cc4290 con 0x559d79ca9b20 2026-02-20T13:18:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3277fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79cc39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3267fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64c70 0x559d79cc1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3277fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79cc39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60984/0 (socket says 10.20.193.28:60984) 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3277fe640 1 -- 10.20.193.28:0/728307106 learned_addr learned my addr 10.20.193.28:0/728307106 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd326ffd640 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79cc1720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3267fc640 1 -- 10.20.193.28:0/728307106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 msgr2=0x559d79cc39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3267fc640 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79cc39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3267fc640 1 -- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 msgr2=0x559d79cc1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3277fe640 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79cc39f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3267fc640 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79cc1720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd3267fc640 1 -- 10.20.193.28:0/728307106 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d79af43c0 con 0x559d79c64c70 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.665+0000 7fd326ffd640 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79cc1720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd3267fc640 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64c70 0x559d79cc1c60 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=11079888899470193604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3100e4720 tx=0x7fd3100a8e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c3ac4013b6f3c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd2f0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/728307106 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3100ade60 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/728307106 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd3100ad9b0 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3281768e0 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/728307106 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3100b7ee0 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/728307106 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd31000bb20 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd32f651e00 10 client.25796 _ll_register_callbacks cb 0x559d79af1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d798066f0 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/728307106 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd310009320 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd32f651e00 10 client.25796 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.666+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x559d79b060e0 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/728307106 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fd3100d20a0 con 0x559d79c64c70 2026-02-20T13:18:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd32f651e00 10 client.25796 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd32f651e00 10 client.25796 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd32f651e00 20 client.25796 populate_metadata read hostname 'trial028' 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd32f651e00 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559d79cc9c40 0x559d79ca78a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd32f651e00 4 client.25796 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d79b12f80 con 0x559d79cc9c40 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd326ffd640 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559d79cc9c40 0x559d79ca78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd326ffd640 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559d79cc9c40 0x559d79ca78a0 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=3361645914136286755 s_cookie=13002374744752716530 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2ea6f725ecbc9623 server_cookie=b471b6f0d97efaf2 in_seq=0 out_seq=0 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.667+0000 7fd2f0ff9640 10 client.25796 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/728307106 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559d79b12f80 con 0x559d79cc9c40 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd2f0ff9640 10 client.25796 handle_command_reply: tid=0 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 client.25796 shutdown 2026-02-20T13:18:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64c70 msgr2=0x559d79cc1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64c70 0x559d79cc1c60 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=11079888899470193604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3100e4720 tx=0x7fd3100a8e50 comp rx=0 tx=0).stop 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 shutdown_connections 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559d79cc9c40 0x559d79ca78a0 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=3361645914136286755 s_cookie=13002374744752716530 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79cc39f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64c70 0x559d79cc1c60 unknown :-1 s=CLOSED pgs=178 gs=2 cs=0 l=1 c_cookie=11079888899470193604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 --2- 10.20.193.28:0/728307106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64360 0x559d79cc1720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd2f0ff9640 0 client.25796 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 >> 10.20.193.28:0/728307106 conn(0x559d79c42860 msgr2=0x559d79c62c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 shutdown_connections 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 1 -- 10.20.193.28:0/728307106 wait complete. 2026-02-20T13:18:23.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.668+0000 7fd32f651e00 20 client.25796 trim_cache size 0 max 16384 2026-02-20T13:18:23.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.675+0000 7fd32f651e00 1 Processor -- start 2026-02-20T13:18:23.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.675+0000 7fd32f651e00 1 -- start start 2026-02-20T13:18:23.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79cc3980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca8e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79ca9390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd32f651e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d79b6e080 con 0x559d79c64c70 2026-02-20T13:18:23.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd32f651e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d7982e700 con 0x559d79c64360 2026-02-20T13:18:23.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd32f651e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d79cba570 con 0x559d79ca9b20 2026-02-20T13:18:23.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd3267fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd326ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79cc3980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd326ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79cc3980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45686/0 (socket says 10.20.193.28:45686) 2026-02-20T13:18:23.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd326ffd640 1 -- 10.20.193.28:0/1424196198 learned_addr learned my addr 10.20.193.28:0/1424196198 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:23.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd3277fe640 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79ca9390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd3267fc640 1 -- 10.20.193.28:0/1424196198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 msgr2=0x559d79ca9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd3267fc640 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79ca9390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd3267fc640 1 -- 10.20.193.28:0/1424196198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 msgr2=0x559d79cc3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd3267fc640 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79cc3980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd3267fc640 1 -- 10.20.193.28:0/1424196198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d79b00b60 con 0x559d79c64c70 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.676+0000 7fd326ffd640 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79cc3980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd3267fc640 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca8e50 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=14902439074679218421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3100c7000 tx=0x7fd31006e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced01961c527e0f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd2f2ffd640 1 -- 10.20.193.28:0/1424196198 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3100b2d20 con 0x559d79c64c70 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd2f2ffd640 1 -- 10.20.193.28:0/1424196198 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559d798066f0 con 0x559d79c64c70 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd2f2ffd640 1 -- 10.20.193.28:0/1424196198 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3100b5340 con 0x559d79c64c70 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 -- 10.20.193.28:0/1424196198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 msgr2=0x559d79ca8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca8e50 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=14902439074679218421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3100c7000 tx=0x7fd31006e000 comp rx=0 tx=0).stop 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 -- 10.20.193.28:0/1424196198 shutdown_connections 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca8e50 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=14902439074679218421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79ca9390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 --2- 10.20.193.28:0/1424196198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79cc3980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 -- 10.20.193.28:0/1424196198 >> 10.20.193.28:0/1424196198 conn(0x559d79c42860 msgr2=0x559d79cc6280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 -- 10.20.193.28:0/1424196198 shutdown_connections 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.677+0000 7fd32f651e00 1 -- 10.20.193.28:0/1424196198 wait complete. 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd32f651e00 1 -- start start 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd32f651e00 1 Processor -- start 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79ca8eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca93f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd32f651e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79ca3770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd32f651e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d79bd2ae0 con 0x559d79c64c70 2026-02-20T13:18:23.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd32f651e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d79ca3d80 con 0x559d79c64360 2026-02-20T13:18:23.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd32f651e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d79ca3f40 con 0x559d79ca9b20 2026-02-20T13:18:23.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd3267fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd326ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79ca8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd3267fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57180/0 (socket says 10.20.193.28:57180) 2026-02-20T13:18:23.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.678+0000 7fd3267fc640 1 -- 10.20.193.28:0/3178827339 learned_addr learned my addr 10.20.193.28:0/3178827339 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:23.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd3277fe640 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79ca3770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd3267fc640 1 -- 10.20.193.28:0/3178827339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 msgr2=0x559d79ca3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:23.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd3267fc640 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79ca3770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd3267fc640 1 -- 10.20.193.28:0/3178827339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 msgr2=0x559d79ca8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:23.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd3267fc640 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79ca8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd3267fc640 1 -- 10.20.193.28:0/3178827339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d79b060e0 con 0x559d79c64c70 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd326ffd640 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79ca8eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd3267fc640 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca93f0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=15125382499946200323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3100ad220 tx=0x7fd3100ae8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e8273ef933fd03 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd2f0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/3178827339 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3100b5320 con 0x559d79c64c70 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/3178827339 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd310096370 con 0x559d79c64c70 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/3178827339 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3100d2310 con 0x559d79c64c70 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d79b1bd10 con 0x559d79c64c70 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/3178827339 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd3100092b0 con 0x559d79c64c70 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd2f0ff9640 10 client.15807 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd32f651e00 10 client.15807 _ll_register_callbacks cb 0x559d79af1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:23.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.679+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd31c038920 con 0x559d79c64c70 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/3178827339 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd3100b2cd0 con 0x559d79c64c70 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd32f651e00 10 client.15807 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x559d79af46f0 con 0x559d79c64c70 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/3178827339 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fd3100b2880 con 0x559d79c64c70 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd32f651e00 10 client.15807 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd32f651e00 10 client.15807 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd32f651e00 20 client.15807 populate_metadata read hostname 'trial028' 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd32f651e00 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559d79c45c60 0x559d79c460d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd32f651e00 4 client.15807 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d79803f40 con 0x559d79c45c60 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd326ffd640 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559d79c45c60 0x559d79c460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.680+0000 7fd326ffd640 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559d79c45c60 0x559d79c460d0 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=2026635313668484589 s_cookie=11857848976383019788 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1c200e148878eded server_cookie=a48f8ad1858a0b0c in_seq=0 out_seq=0 2026-02-20T13:18:23.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd2f0ff9640 10 client.15807 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd2f0ff9640 1 -- 10.20.193.28:0/3178827339 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d79803f40 con 0x559d79c45c60 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd2f0ff9640 10 client.15807 handle_command_reply: tid=0 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 client.15807 shutdown 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 msgr2=0x559d79ca93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca93f0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=15125382499946200323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3100ad220 tx=0x7fd3100ae8b0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 shutdown_connections 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559d79c45c60 0x559d79c460d0 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=2026635313668484589 s_cookie=11857848976383019788 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d79c64c70 0x559d79ca93f0 unknown :-1 s=CLOSED pgs=428 gs=1 cs=0 l=1 c_cookie=15125382499946200323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d79ca9b20 0x559d79ca3770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 --2- 10.20.193.28:0/3178827339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d79c64360 0x559d79ca8eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 >> 10.20.193.28:0/3178827339 conn(0x559d79c42860 msgr2=0x559d79cc49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:23.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd2f0ff9640 0 client.15807 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:18:23.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 shutdown_connections 2026-02-20T13:18:23.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 1 -- 10.20.193.28:0/3178827339 wait complete. 2026-02-20T13:18:23.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd32f651e00 20 client.15807 trim_cache size 0 max 16384 2026-02-20T13:18:23.691 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:18:23.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd327fff640 1 -- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2fc0b5760 msgr2=0x7fd2fc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.681+0000 7fd327fff640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2fc0b5760 0x7fd2fc0d5c10 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd31c0023d0 tx=0x7fd31c031040 comp rx=0 tx=0).stop 2026-02-20T13:18:23.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 -- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810fea0 msgr2=0x7fd32811e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:23.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810fea0 0x7fd32811e380 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3100072a0 tx=0x7fd31000ddf0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 -- 10.20.193.28:0/1968308420 shutdown_connections 2026-02-20T13:18:23.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd2fc0b5760 0x7fd2fc0d5c10 unknown :-1 s=CLOSED pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd32810fea0 0x7fd32811e380 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3281156a0 0x7fd328123700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 --2- 10.20.193.28:0/1968308420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd32810f4b0 0x7fd32811de40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:23.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 -- 10.20.193.28:0/1968308420 >> 10.20.193.28:0/1968308420 conn(0x7fd3280ecda0 msgr2=0x7fd32810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:23.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 -- 10.20.193.28:0/1968308420 shutdown_connections 2026-02-20T13:18:23.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:23.682+0000 7fd327fff640 1 -- 10.20.193.28:0/1968308420 wait complete. 2026-02-20T13:18:23.781 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:23 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1635913670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:23.783 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:18:23.966 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:23.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:23 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1635913670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:23.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:23 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1635913670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:24.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2924904113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 msgr2=0x7ffb6810b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2924904113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 0x7ffb6810b900 secure :-1 s=READY pgs=429 gs=2 cs=0 l=1 c_cookie=12642908307538803488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb54009950 tx=0x7ffb5402f190 comp rx=0 tx=0).stop 2026-02-20T13:18:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2924904113 shutdown_connections 2026-02-20T13:18:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2924904113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffb6810ee70 0x7ffb6810f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2924904113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffb6810be40 0x7ffb6810e820 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2924904113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 0x7ffb6810b900 unknown :-1 s=CLOSED pgs=429 gs=2 cs=0 l=1 c_cookie=12642908307538803488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2924904113 >> 10.20.193.28:0/2924904113 conn(0x7ffb680e90a0 msgr2=0x7ffb681094b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2924904113 shutdown_connections 2026-02-20T13:18:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.142+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2924904113 wait complete. 2026-02-20T13:18:24.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.143+0000 7ffb6cd19640 1 Processor -- start 2026-02-20T13:18:24.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.143+0000 7ffb6cd19640 1 -- start start 2026-02-20T13:18:24.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.143+0000 7ffb6cd19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 0x7ffb68122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.143+0000 7ffb6cd19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffb6810be40 0x7ffb681233f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.143+0000 7ffb6cd19640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffb6810ee70 0x7ffb681287c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.143+0000 7ffb6cd19640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68128de0 con 0x7ffb6810b530 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.143+0000 7ffb6cd19640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68128f50 con 0x7ffb6810be40 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.143+0000 7ffb6cd19640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68129110 con 0x7ffb6810ee70 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb67fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffb6810ee70 0x7ffb681287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 0x7ffb68122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb66ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffb6810be40 0x7ffb681233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb67fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffb6810ee70 0x7ffb681287c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32774/0 (socket says 10.20.193.28:32774) 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb67fff640 1 -- 10.20.193.28:0/2682487469 learned_addr learned my addr 10.20.193.28:0/2682487469 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb677fe640 1 -- 10.20.193.28:0/2682487469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffb6810ee70 msgr2=0x7ffb681287c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb677fe640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffb6810ee70 0x7ffb681287c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb677fe640 1 -- 10.20.193.28:0/2682487469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffb6810be40 msgr2=0x7ffb681233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb677fe640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffb6810be40 0x7ffb681233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb677fe640 1 -- 10.20.193.28:0/2682487469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb54009570 con 0x7ffb6810b530 2026-02-20T13:18:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb677fe640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 0x7ffb68122eb0 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb5402f6a0 tx=0x7ffb54004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb64ff9640 1 -- 10.20.193.28:0/2682487469 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb5403d070 con 0x7ffb6810b530 2026-02-20T13:18:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb64ff9640 1 -- 10.20.193.28:0/2682487469 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffb54002ad0 con 0x7ffb6810b530 2026-02-20T13:18:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb64ff9640 1 -- 10.20.193.28:0/2682487469 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb540418a0 con 0x7ffb6810b530 2026-02-20T13:18:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2682487469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb68129390 con 0x7ffb6810b530 2026-02-20T13:18:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.144+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2682487469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb68169af0 con 0x7ffb6810b530 2026-02-20T13:18:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.147+0000 7ffb64ff9640 1 -- 10.20.193.28:0/2682487469 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ffb54038b40 con 0x7ffb6810b530 2026-02-20T13:18:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.149+0000 7ffb64ff9640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffb3c0b5760 0x7ffb3c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.149+0000 7ffb64ff9640 1 -- 10.20.193.28:0/2682487469 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ffb5410adc0 con 0x7ffb6810b530 2026-02-20T13:18:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.149+0000 7ffb66ffd640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffb3c0b5760 0x7ffb3c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.150+0000 7ffb66ffd640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffb3c0b5760 0x7ffb3c0d5c10 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb68129850 tx=0x7ffb580073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.151+0000 7ffb6ff9ce00 1 Processor -- start 2026-02-20T13:18:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.151+0000 7ffb6ff9ce00 1 -- start start 2026-02-20T13:18:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2efb730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f405e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2f40b20 0x5555f2f60f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555f2e11780 con 0x5555f2efbc70 2026-02-20T13:18:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555f2e0d4b0 con 0x5555f2efb360 2026-02-20T13:18:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555f2e07450 con 0x5555f2f40b20 2026-02-20T13:18:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2efb730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2efb730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45734/0 (socket says 10.20.193.28:45734) 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb677fe640 1 -- 10.20.193.28:0/2284568650 learned_addr learned my addr 10.20.193.28:0/2284568650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb67fff640 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2f40b20 0x5555f2f60f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb66ffd640 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb67fff640 1 -- 10.20.193.28:0/2284568650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 msgr2=0x5555f2efb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb67fff640 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2efb730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb67fff640 1 -- 10.20.193.28:0/2284568650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 msgr2=0x5555f2f405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb67fff640 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb67fff640 1 -- 10.20.193.28:0/2284568650 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f2db2d10 con 0x5555f2f40b20 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb677fe640 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2efb730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.152+0000 7ffb67fff640 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2f40b20 0x5555f2f60f00 secure :-1 s=READY pgs=146 gs=2 cs=0 l=1 c_cookie=4244180488429748261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb5c00ad20 tx=0x7ffb5c005420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae65baae77fc025 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb2bfff640 1 -- 10.20.193.28:0/2284568650 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb5c005560 con 0x5555f2f40b20 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb2bfff640 1 -- 10.20.193.28:0/2284568650 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffb5c003d60 con 0x5555f2f40b20 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb2bfff640 1 -- 10.20.193.28:0/2284568650 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb5c00f850 con 0x5555f2f40b20 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2284568650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2f40b20 msgr2=0x5555f2f60f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2f40b20 0x5555f2f60f00 secure :-1 s=READY pgs=146 gs=2 cs=0 l=1 c_cookie=4244180488429748261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb5c00ad20 tx=0x7ffb5c005420 comp rx=0 tx=0).stop 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2284568650 shutdown_connections 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f405e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2f40b20 0x5555f2f60f00 unknown :-1 s=CLOSED pgs=146 gs=2 cs=0 l=1 c_cookie=4244180488429748261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2284568650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2efb730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2284568650 >> 10.20.193.28:0/2284568650 conn(0x5555f2ed9860 msgr2=0x5555f2ef9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2284568650 shutdown_connections 2026-02-20T13:18:24.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.153+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2284568650 wait complete. 2026-02-20T13:18:24.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.155+0000 7ffb6ff9ce00 1 -- start start 2026-02-20T13:18:24.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.155+0000 7ffb6ff9ce00 1 Processor -- start 2026-02-20T13:18:24.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.155+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efb360 0x5555f2f586e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.155+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f58c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.155+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2f5dc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.155+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555f2f5e1c0 con 0x5555f2efbc70 2026-02-20T13:18:24.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.155+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555f2f5e330 con 0x5555f2f40b20 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.155+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555f2f5e4f0 con 0x5555f2efb360 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efb360 0x5555f2f586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb66ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f58c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efb360 0x5555f2f586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32792/0 (socket says 10.20.193.28:32792) 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb677fe640 1 -- 10.20.193.28:0/2896335795 learned_addr learned my addr 10.20.193.28:0/2896335795 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb67fff640 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2f5dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb66ffd640 1 -- 10.20.193.28:0/2896335795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efb360 msgr2=0x5555f2f586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb66ffd640 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efb360 0x5555f2f586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb66ffd640 1 -- 10.20.193.28:0/2896335795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 msgr2=0x5555f2f5dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb66ffd640 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2f5dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb66ffd640 1 -- 10.20.193.28:0/2896335795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c00a9c0 con 0x5555f2efbc70 2026-02-20T13:18:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb67fff640 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2f5dc80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb66ffd640 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f58c20 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=7460350514917520409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb681119d0 tx=0x7ffb580047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67887d44458fb419 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.156+0000 7ffb297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb297fa640 1 -- 10.20.193.28:0/2896335795 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb58022070 con 0x5555f2efbc70 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb297fa640 1 -- 10.20.193.28:0/2896335795 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffb58015070 con 0x5555f2efbc70 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb297fa640 1 -- 10.20.193.28:0/2896335795 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb5801a750 con 0x5555f2efbc70 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb68169af0 con 0x5555f2efbc70 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 10 client.15819 _ll_register_callbacks cb 0x5555f2d88a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb297fa640 1 -- 10.20.193.28:0/2896335795 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ffb58004250 con 0x5555f2efbc70 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555f2a9d6f0 con 0x5555f2efbc70 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb297fa640 1 -- 10.20.193.28:0/2896335795 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffb5801a8e0 con 0x5555f2efbc70 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 10 client.15819 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5555f2d8b3c0 con 0x5555f2efbc70 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb297fa640 1 -- 10.20.193.28:0/2896335795 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7ffb5801aa80 con 0x5555f2efbc70 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 10 client.15819 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 10 client.15819 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 20 client.15819 populate_metadata read hostname 'trial028' 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.157+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5555f2f60d30 0x5555f2f3e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.158+0000 7ffb6ff9ce00 4 client.15819 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.158+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555f2da9f80 con 0x5555f2f60d30 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.158+0000 7ffb677fe640 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5555f2f60d30 0x5555f2f3e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.158+0000 7ffb677fe640 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5555f2f60d30 0x5555f2f3e8a0 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=4742423344176083846 s_cookie=17852307800666283228 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=41d078e7b422b386 server_cookie=f7c0235befa61cdc in_seq=0 out_seq=0 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.158+0000 7ffb297fa640 10 client.15819 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb297fa640 1 -- 10.20.193.28:0/2896335795 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5555f2da9f80 con 0x5555f2f60d30 2026-02-20T13:18:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb297fa640 10 client.15819 handle_command_reply: tid=0 2026-02-20T13:18:24.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 client.15819 shutdown 2026-02-20T13:18:24.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 msgr2=0x5555f2f58c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f58c20 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=7460350514917520409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb681119d0 tx=0x7ffb580047e0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 shutdown_connections 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5555f2f60d30 0x5555f2f3e8a0 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=4742423344176083846 s_cookie=17852307800666283228 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efbc70 0x5555f2f58c20 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=7460350514917520409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2f5dc80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/2896335795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efb360 0x5555f2f586e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb297fa640 0 client.15819 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 >> 10.20.193.28:0/2896335795 conn(0x5555f2ed9860 msgr2=0x5555f2ef9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.159+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 shutdown_connections 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.160+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/2896335795 wait complete. 2026-02-20T13:18:24.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.160+0000 7ffb6ff9ce00 20 client.15819 trim_cache size 0 max 16384 2026-02-20T13:18:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb6ff9ce00 1 Processor -- start 2026-02-20T13:18:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb6ff9ce00 1 -- start start 2026-02-20T13:18:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2f557f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2f55d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2f40b20 0x5555f2f3b780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555f2e05080 con 0x5555f2f40b20 2026-02-20T13:18:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555f2ac5700 con 0x5555f2efb360 2026-02-20T13:18:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555f2f4d080 con 0x5555f2efbc70 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb66ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2f55d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2f40b20 0x5555f2f3b780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2f557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2f557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45758/0 (socket says 10.20.193.28:45758) 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb677fe640 1 -- 10.20.193.28:0/594306346 learned_addr learned my addr 10.20.193.28:0/594306346 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.167+0000 7ffb67fff640 1 --2- 10.20.193.28:0/594306346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2f40b20 0x5555f2f3b780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57218/0 (socket says 10.20.193.28:57218) 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb67fff640 1 -- 10.20.193.28:0/594306346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 msgr2=0x5555f2f55d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb67fff640 1 --2- 10.20.193.28:0/594306346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2f55d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb67fff640 1 -- 10.20.193.28:0/594306346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 msgr2=0x5555f2f557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb67fff640 1 --2- 10.20.193.28:0/594306346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2f557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb67fff640 1 -- 10.20.193.28:0/594306346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f2f4aa30 con 0x5555f2f40b20 2026-02-20T13:18:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb67fff640 1 --2- 10.20.193.28:0/594306346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2f40b20 0x5555f2f3b780 secure :-1 s=READY pgs=432 gs=3 cs=0 l=1 c_cookie=16058096686527770887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb5c00f430 tx=0x7ffb5c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded9d1db615d7107 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb2b7fe640 1 -- 10.20.193.28:0/594306346 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb5c005620 con 0x5555f2f40b20 2026-02-20T13:18:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb2b7fe640 1 -- 10.20.193.28:0/594306346 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffb5c020070 con 0x5555f2f40b20 2026-02-20T13:18:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb2b7fe640 1 -- 10.20.193.28:0/594306346 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb5c00f9f0 con 0x5555f2f40b20 2026-02-20T13:18:24.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/594306346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2f40b20 msgr2=0x5555f2f3b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/594306346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2f40b20 0x5555f2f3b780 secure :-1 s=READY pgs=432 gs=3 cs=0 l=1 c_cookie=16058096686527770887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb5c00f430 tx=0x7ffb5c00f3c0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/594306346 shutdown_connections 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/594306346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2f40b20 0x5555f2f3b780 unknown :-1 s=CLOSED pgs=432 gs=3 cs=0 l=1 c_cookie=16058096686527770887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/594306346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2f55d30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/594306346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2efb360 0x5555f2f557f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.168+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/594306346 >> 10.20.193.28:0/594306346 conn(0x5555f2ed9860 msgr2=0x5555f2f550e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/594306346 shutdown_connections 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/594306346 wait complete. 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 -- start start 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 Processor -- start 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efb360 0x5555f2edb420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2edb960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2fa6950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555f2edc2b0 con 0x5555f2efb360 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555f2fa6e90 con 0x5555f2f40b20 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.169+0000 7ffb6ff9ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555f2fa7050 con 0x5555f2efbc70 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb66ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2edb960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efb360 0x5555f2edb420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb66ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2edb960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32810/0 (socket says 10.20.193.28:32810) 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb66ffd640 1 -- 10.20.193.28:0/1452127299 learned_addr learned my addr 10.20.193.28:0/1452127299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb67fff640 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2fa6950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb677fe640 1 -- 10.20.193.28:0/1452127299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 msgr2=0x5555f2edb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb677fe640 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2edb960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb677fe640 1 -- 10.20.193.28:0/1452127299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 msgr2=0x5555f2fa6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb677fe640 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2fa6950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb677fe640 1 -- 10.20.193.28:0/1452127299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f2d9d0e0 con 0x5555f2efb360 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb677fe640 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efb360 0x5555f2edb420 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=16364989115020859466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb541088f0 tx=0x7ffb540047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31c1ee509f3d84a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb297fa640 1 -- 10.20.193.28:0/1452127299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb54092040 con 0x5555f2efb360 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb297fa640 1 -- 10.20.193.28:0/1452127299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffb54096420 con 0x5555f2efb360 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb297fa640 1 -- 10.20.193.28:0/1452127299 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb54035320 con 0x5555f2efb360 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f2db2d10 con 0x5555f2efb360 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.170+0000 7ffb297fa640 1 -- 10.20.193.28:0/1452127299 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ffb540354b0 con 0x5555f2efb360 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb297fa640 10 client.15825 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 10 client.15825 _ll_register_callbacks cb 0x5555f2d88a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb5c003d60 con 0x5555f2efb360 2026-02-20T13:18:24.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb297fa640 1 -- 10.20.193.28:0/1452127299 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffb54096590 con 0x5555f2efb360 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 10 client.15825 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5555f2d97b60 con 0x5555f2efb360 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb297fa640 1 -- 10.20.193.28:0/1452127299 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7ffb540d0d70 con 0x5555f2efb360 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 10 client.15825 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 10 client.15825 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 20 client.15825 populate_metadata read hostname 'trial028' 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5555f2feeeb0 0x5555f300f290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 4 client.15825 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555f2a9af40 con 0x5555f2feeeb0 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.171+0000 7ffb66ffd640 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5555f2feeeb0 0x5555f300f290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb66ffd640 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5555f2feeeb0 0x5555f300f290 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=502329991493723187 s_cookie=8037128104337491150 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6f8a2773f022433 server_cookie=6f899d6da95844ce in_seq=0 out_seq=0 2026-02-20T13:18:24.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb297fa640 10 client.15825 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb297fa640 1 -- 10.20.193.28:0/1452127299 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555f2a9af40 con 0x5555f2feeeb0 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb297fa640 10 client.15825 handle_command_reply: tid=0 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 client.15825 shutdown 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efb360 msgr2=0x5555f2edb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efb360 0x5555f2edb420 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=16364989115020859466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb541088f0 tx=0x7ffb540047b0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 shutdown_connections 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5555f2feeeb0 0x5555f300f290 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=502329991493723187 s_cookie=8037128104337491150 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555f2f40b20 0x5555f2fa6950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555f2efbc70 0x5555f2edb960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 --2- 10.20.193.28:0/1452127299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555f2efb360 0x5555f2edb420 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=16364989115020859466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb297fa640 0 client.15825 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 >> 10.20.193.28:0/1452127299 conn(0x5555f2ed9860 msgr2=0x5555f2f557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 shutdown_connections 2026-02-20T13:18:24.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 1 -- 10.20.193.28:0/1452127299 wait complete. 2026-02-20T13:18:24.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.172+0000 7ffb6ff9ce00 20 client.15825 trim_cache size 0 max 16384 2026-02-20T13:18:24.182 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffb3c0b5760 msgr2=0x7ffb3c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffb3c0b5760 0x7ffb3c0d5c10 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb68129850 tx=0x7ffb580073d0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 msgr2=0x7ffb68122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 0x7ffb68122eb0 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb5402f6a0 tx=0x7ffb54004270 comp rx=0 tx=0).stop 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2682487469 shutdown_connections 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffb3c0b5760 0x7ffb3c0d5c10 unknown :-1 s=CLOSED pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffb6810ee70 0x7ffb681287c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffb6810be40 0x7ffb681233f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 --2- 10.20.193.28:0/2682487469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb6810b530 0x7ffb68122eb0 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2682487469 >> 10.20.193.28:0/2682487469 conn(0x7ffb680e90a0 msgr2=0x7ffb68109480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2682487469 shutdown_connections 2026-02-20T13:18:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.173+0000 7ffb6cd19640 1 -- 10.20.193.28:0/2682487469 wait complete. 2026-02-20T13:18:24.275 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:18:24.458 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:24.594 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:24 trial028 ceph-mon[37442]: pgmap v213: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:18:24.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.632+0000 7fd82e79d640 1 -- 10.20.193.28:0/3033298203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810ffe0 msgr2=0x7fd828115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.632+0000 7fd82e79d640 1 --2- 10.20.193.28:0/3033298203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810ffe0 0x7fd828115030 secure :-1 s=READY pgs=434 gs=2 cs=0 l=1 c_cookie=3939793026872732763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd818009950 tx=0x7fd81802f190 comp rx=0 tx=0).stop 2026-02-20T13:18:24.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.632+0000 7fd82e79d640 1 -- 10.20.193.28:0/3033298203 shutdown_connections 2026-02-20T13:18:24.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.632+0000 7fd82e79d640 1 --2- 10.20.193.28:0/3033298203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810ffe0 0x7fd828115030 unknown :-1 s=CLOSED pgs=434 gs=2 cs=0 l=1 c_cookie=3939793026872732763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.632+0000 7fd82e79d640 1 --2- 10.20.193.28:0/3033298203 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd8281157e0 0x7fd8281761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.632+0000 7fd82e79d640 1 --2- 10.20.193.28:0/3033298203 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd82810f5f0 0x7fd82810f9c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.632+0000 7fd82e79d640 1 -- 10.20.193.28:0/3033298203 >> 10.20.193.28:0/3033298203 conn(0x7fd8280ecea0 msgr2=0x7fd82810d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.632+0000 7fd82e79d640 1 -- 10.20.193.28:0/3033298203 shutdown_connections 2026-02-20T13:18:24.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.633+0000 7fd82e79d640 1 -- 10.20.193.28:0/3033298203 wait complete. 2026-02-20T13:18:24.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.633+0000 7fd82e79d640 1 Processor -- start 2026-02-20T13:18:24.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.633+0000 7fd82e79d640 1 -- start start 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd82e79d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810f5f0 0x7fd8280f4e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd82e79d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd82810ffe0 0x7fd8281760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd82e79d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd8281157e0 0x7fd8280f5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd82e79d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280fa750 con 0x7fd82810f5f0 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd82e79d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280fa8c0 con 0x7fd8281157e0 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd82e79d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280faa80 con 0x7fd82810ffe0 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd8277fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd82810ffe0 0x7fd8281760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd827fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810f5f0 0x7fd8280f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd8277fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd82810ffe0 0x7fd8281760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32824/0 (socket says 10.20.193.28:32824) 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd8277fe640 1 -- 10.20.193.28:0/983114519 learned_addr learned my addr 10.20.193.28:0/983114519 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd82cd13640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd8281157e0 0x7fd8280f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd8277fe640 1 -- 10.20.193.28:0/983114519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd8281157e0 msgr2=0x7fd8280f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd8277fe640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd8281157e0 0x7fd8280f5590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd8277fe640 1 -- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810f5f0 msgr2=0x7fd8280f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd8277fe640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810f5f0 0x7fd8280f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd8277fe640 1 -- 10.20.193.28:0/983114519 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd818009570 con 0x7fd82810ffe0 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd82cd13640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd8281157e0 0x7fd8280f5590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.634+0000 7fd827fff640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810f5f0 0x7fd8280f4e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.635+0000 7fd8277fe640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd82810ffe0 0x7fd8281760b0 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd818038820 tx=0x7fd818004300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.635+0000 7fd8257fa640 1 -- 10.20.193.28:0/983114519 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd81803d070 con 0x7fd82810ffe0 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.635+0000 7fd8257fa640 1 -- 10.20.193.28:0/983114519 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd818002ad0 con 0x7fd82810ffe0 2026-02-20T13:18:24.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.635+0000 7fd82e79d640 1 -- 10.20.193.28:0/983114519 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8280fad00 con 0x7fd82810ffe0 2026-02-20T13:18:24.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.635+0000 7fd8257fa640 1 -- 10.20.193.28:0/983114519 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd818041930 con 0x7fd82810ffe0 2026-02-20T13:18:24.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.635+0000 7fd82e79d640 1 -- 10.20.193.28:0/983114519 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8280fb170 con 0x7fd82810ffe0 2026-02-20T13:18:24.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.638+0000 7fd8257fa640 1 -- 10.20.193.28:0/983114519 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd81802f9f0 con 0x7fd82810ffe0 2026-02-20T13:18:24.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.639+0000 7fd8257fa640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7fc0b56d0 0x7fd7fc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.640+0000 7fd8257fa640 1 -- 10.20.193.28:0/983114519 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd81810b180 con 0x7fd82810ffe0 2026-02-20T13:18:24.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.640+0000 7fd827fff640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7fc0b56d0 0x7fd7fc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.640+0000 7fd827fff640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7fc0b56d0 0x7fd7fc0d5b80 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd814004740 tx=0x7fd814005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.640+0000 7fd830797e00 1 Processor -- start 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd830797e00 1 -- start start 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd830797e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f36be730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd830797e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37035e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd830797e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3723f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd830797e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5556f35d4780 con 0x5556f3703b20 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd830797e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5556f35d04b0 con 0x5556f36bec70 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd830797e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5556f35ca450 con 0x5556f36be360 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd827fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f36be730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd827fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f36be730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32828/0 (socket says 10.20.193.28:32828) 2026-02-20T13:18:24.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd827fff640 1 -- 10.20.193.28:0/2860693487 learned_addr learned my addr 10.20.193.28:0/2860693487 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd82cd13640 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3723f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd8277fe640 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd82cd13640 1 -- 10.20.193.28:0/2860693487 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 msgr2=0x5556f36be730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd82cd13640 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f36be730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd82cd13640 1 -- 10.20.193.28:0/2860693487 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 msgr2=0x5556f37035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd82cd13640 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.641+0000 7fd82cd13640 1 -- 10.20.193.28:0/2860693487 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f3575d10 con 0x5556f3703b20 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd82cd13640 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3723f00 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=9805684849495350031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd81c005660 tx=0x7fd81c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8814ca6af9999b0f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd7f8ce3640 1 -- 10.20.193.28:0/2860693487 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd81c00add0 con 0x5556f3703b20 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd7f8ce3640 1 -- 10.20.193.28:0/2860693487 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd81c003e90 con 0x5556f3703b20 2026-02-20T13:18:24.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd7f8ce3640 1 -- 10.20.193.28:0/2860693487 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd81c011a50 con 0x5556f3703b20 2026-02-20T13:18:24.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 -- 10.20.193.28:0/2860693487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 msgr2=0x5556f3723f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3723f00 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=9805684849495350031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd81c005660 tx=0x7fd81c003c30 comp rx=0 tx=0).stop 2026-02-20T13:18:24.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 -- 10.20.193.28:0/2860693487 shutdown_connections 2026-02-20T13:18:24.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3723f00 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=9805684849495350031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37035e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 --2- 10.20.193.28:0/2860693487 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f36be730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 -- 10.20.193.28:0/2860693487 >> 10.20.193.28:0/2860693487 conn(0x5556f369c860 msgr2=0x5556f36bcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 -- 10.20.193.28:0/2860693487 shutdown_connections 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.642+0000 7fd830797e00 1 -- 10.20.193.28:0/2860693487 wait complete. 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.643+0000 7fd830797e00 1 -- start start 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd830797e00 1 Processor -- start 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd830797e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f371b710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd830797e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f371bc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd830797e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f371d9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd830797e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5556f371df50 con 0x5556f3703b20 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd830797e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5556f371e0c0 con 0x5556f36bec70 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd830797e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5556f371e280 con 0x5556f36be360 2026-02-20T13:18:24.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd827fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f371b710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd827fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f371b710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32838/0 (socket says 10.20.193.28:32838) 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.644+0000 7fd827fff640 1 -- 10.20.193.28:0/3495457900 learned_addr learned my addr 10.20.193.28:0/3495457900 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd827fff640 1 -- 10.20.193.28:0/3495457900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 msgr2=0x5556f371bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd827fff640 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f371bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd827fff640 1 -- 10.20.193.28:0/3495457900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 msgr2=0x5556f371d9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd82cd13640 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f371d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd827fff640 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f371d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd827fff640 1 -- 10.20.193.28:0/3495457900 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f354e3c0 con 0x5556f36be360 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd82cd13640 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f371d9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:24.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd827fff640 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f371b710 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=806756007126388200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8140091e0 tx=0x7fd814013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b322c50692e4de8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd7e9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/3495457900 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd814021040 con 0x5556f36be360 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/3495457900 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd814004d30 con 0x5556f36be360 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/3495457900 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd81401a6e0 con 0x5556f36be360 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.645+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81c005280 con 0x5556f36be360 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/3495457900 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd81401a870 con 0x5556f36be360 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 10 client.25783 _ll_register_callbacks cb 0x5556f354ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556f32606f0 con 0x5556f36be360 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/3495457900 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd814004a60 con 0x5556f36be360 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 10 client.25783 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5556f35600e0 con 0x5556f36be360 2026-02-20T13:18:24.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/3495457900 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fd814002d20 con 0x5556f36be360 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 10 client.25783 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 10 client.25783 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 20 client.25783 populate_metadata read hostname 'trial028' 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5556f3723cb0 0x5556f37018a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 4 client.25783 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.646+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556f356cf80 con 0x5556f3723cb0 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.647+0000 7fd8277fe640 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5556f3723cb0 0x5556f37018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.647+0000 7fd8277fe640 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5556f3723cb0 0x5556f37018a0 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=7413602052150906502 s_cookie=14618520253843661254 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=66e267c9988fce86 server_cookie=cadf6ab7f83461c6 in_seq=0 out_seq=0 2026-02-20T13:18:24.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.647+0000 7fd7e9ffb640 10 client.25783 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.647+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/3495457900 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5556f356cf80 con 0x5556f3723cb0 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.647+0000 7fd7e9ffb640 10 client.25783 handle_command_reply: tid=0 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 client.25783 shutdown 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 msgr2=0x5556f371b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f371b710 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=806756007126388200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8140091e0 tx=0x7fd814013040 comp rx=0 tx=0).stop 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 shutdown_connections 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5556f3723cb0 0x5556f37018a0 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=7413602052150906502 s_cookie=14618520253843661254 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f371d9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f371bc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 --2- 10.20.193.28:0/3495457900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f371b710 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=806756007126388200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd7e9ffb640 0 client.25783 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:18:24.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 >> 10.20.193.28:0/3495457900 conn(0x5556f369c860 msgr2=0x5556f36bcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 shutdown_connections 2026-02-20T13:18:24.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 1 -- 10.20.193.28:0/3495457900 wait complete. 2026-02-20T13:18:24.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.648+0000 7fd830797e00 20 client.25783 trim_cache size 0 max 16384 2026-02-20T13:18:24.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.655+0000 7fd830797e00 1 Processor -- start 2026-02-20T13:18:24.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.655+0000 7fd830797e00 1 -- start start 2026-02-20T13:18:24.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.655+0000 7fd830797e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3720550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.655+0000 7fd830797e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f36bec70 0x5556f371d970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.655+0000 7fd830797e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f3703b20 0x5556f36bdd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.655+0000 7fd830797e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5556f35c8080 con 0x5556f36bec70 2026-02-20T13:18:24.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.655+0000 7fd830797e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5556f3288700 con 0x5556f3703b20 2026-02-20T13:18:24.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.655+0000 7fd830797e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5556f3721c70 con 0x5556f36be360 2026-02-20T13:18:24.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3720550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3720550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32846/0 (socket says 10.20.193.28:32846) 2026-02-20T13:18:24.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 -- 10.20.193.28:0/2657432835 learned_addr learned my addr 10.20.193.28:0/2657432835 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd82cd13640 1 --2- 10.20.193.28:0/2657432835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f3703b20 0x5556f36bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 -- 10.20.193.28:0/2657432835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f3703b20 msgr2=0x5556f36bdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 --2- 10.20.193.28:0/2657432835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f3703b20 0x5556f36bdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 -- 10.20.193.28:0/2657432835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f36bec70 msgr2=0x5556f371d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 --2- 10.20.193.28:0/2657432835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f36bec70 0x5556f371d970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 -- 10.20.193.28:0/2657432835 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f370d9b0 con 0x5556f36be360 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd827fff640 1 --2- 10.20.193.28:0/2657432835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3720550 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=7010183169842847724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd81400f710 tx=0x7fd81401d030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61492c7390e79fec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.656+0000 7fd7ebfff640 1 -- 10.20.193.28:0/2657432835 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd81403d070 con 0x5556f36be360 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd7ebfff640 1 -- 10.20.193.28:0/2657432835 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5556f32606f0 con 0x5556f36be360 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd7ebfff640 1 -- 10.20.193.28:0/2657432835 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd81402f420 con 0x5556f36be360 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 -- 10.20.193.28:0/2657432835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 msgr2=0x5556f3720550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 --2- 10.20.193.28:0/2657432835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3720550 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=7010183169842847724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd81400f710 tx=0x7fd81401d030 comp rx=0 tx=0).stop 2026-02-20T13:18:24.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 -- 10.20.193.28:0/2657432835 shutdown_connections 2026-02-20T13:18:24.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 --2- 10.20.193.28:0/2657432835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f36bec70 0x5556f371d970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 --2- 10.20.193.28:0/2657432835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f3703b20 0x5556f36bdd40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 --2- 10.20.193.28:0/2657432835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3720550 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=7010183169842847724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 -- 10.20.193.28:0/2657432835 >> 10.20.193.28:0/2657432835 conn(0x5556f369c860 msgr2=0x5556f371f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 -- 10.20.193.28:0/2657432835 shutdown_connections 2026-02-20T13:18:24.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.657+0000 7fd830797e00 1 -- 10.20.193.28:0/2657432835 wait complete. 2026-02-20T13:18:24.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd830797e00 1 -- start start 2026-02-20T13:18:24.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd830797e00 1 Processor -- start 2026-02-20T13:18:24.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd830797e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3718b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd830797e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37190c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd830797e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3717a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd830797e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5556f37180f0 con 0x5556f3703b20 2026-02-20T13:18:24.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd830797e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5556f3718260 con 0x5556f36bec70 2026-02-20T13:18:24.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd830797e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5556f3718420 con 0x5556f36be360 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd82cd13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3717a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd82cd13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3717a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57272/0 (socket says 10.20.193.28:57272) 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd827fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3718b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.658+0000 7fd82cd13640 1 -- 10.20.193.28:0/408402070 learned_addr learned my addr 10.20.193.28:0/408402070 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd8277fe640 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd82cd13640 1 -- 10.20.193.28:0/408402070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 msgr2=0x5556f3718b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd82cd13640 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3718b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd82cd13640 1 -- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 msgr2=0x5556f37190c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd82cd13640 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37190c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd82cd13640 1 -- 10.20.193.28:0/408402070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f355ab60 con 0x5556f3703b20 2026-02-20T13:18:24.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd827fff640 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3718b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd8277fe640 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37190c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd82cd13640 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3717a20 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=8575721387635417115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd81c005050 tx=0x7fd81c0068a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7703152a7abaa01b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd7e9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/408402070 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd81c021070 con 0x5556f3703b20 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/408402070 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd81c012b40 con 0x5556f3703b20 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/408402070 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd81c01cc10 con 0x5556f3703b20 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.659+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd814034040 con 0x5556f3703b20 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/408402070 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd81c01cda0 con 0x5556f3703b20 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd7e9ffb640 10 client.15837 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 10 client.15837 _ll_register_callbacks cb 0x5556f354ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd81c003e90 con 0x5556f3703b20 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/408402070 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd81c01c430 con 0x5556f3703b20 2026-02-20T13:18:24.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 10 client.15837 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5556f354e6f0 con 0x5556f3703b20 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/408402070 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fd81c027070 con 0x5556f3703b20 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 10 client.15837 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 10 client.15837 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 20 client.15837 populate_metadata read hostname 'trial028' 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5556f3729ca0 0x5556f372a140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 4 client.15837 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.660+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556f325df40 con 0x5556f3729ca0 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd827fff640 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5556f3729ca0 0x5556f372a140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd827fff640 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5556f3729ca0 0x5556f372a140 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=1808317982337630117 s_cookie=14484645165790458952 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19186f9fc22f7fa5 server_cookie=c903cc090c84f448 in_seq=0 out_seq=0 2026-02-20T13:18:24.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd7e9ffb640 10 client.15837 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd7e9ffb640 1 -- 10.20.193.28:0/408402070 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556f325df40 con 0x5556f3729ca0 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd7e9ffb640 10 client.15837 handle_command_reply: tid=0 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 client.15837 shutdown 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 msgr2=0x5556f3717a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3717a20 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=8575721387635417115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd81c005050 tx=0x7fd81c0068a0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 shutdown_connections 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5556f3729ca0 0x5556f372a140 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=1808317982337630117 s_cookie=14484645165790458952 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f3703b20 0x5556f3717a20 unknown :-1 s=CLOSED pgs=436 gs=1 cs=0 l=1 c_cookie=8575721387635417115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f36bec70 0x5556f37190c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 --2- 10.20.193.28:0/408402070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f36be360 0x5556f3718b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd7e9ffb640 0 client.15837 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 >> 10.20.193.28:0/408402070 conn(0x5556f369c860 msgr2=0x5556f371ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.661+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 shutdown_connections 2026-02-20T13:18:24.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd830797e00 1 -- 10.20.193.28:0/408402070 wait complete. 2026-02-20T13:18:24.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd830797e00 20 client.15837 trim_cache size 0 max 16384 2026-02-20T13:18:24.671 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 -- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7fc0b56d0 msgr2=0x7fd7fc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7fc0b56d0 0x7fd7fc0d5b80 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd814004740 tx=0x7fd814005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 -- 10.20.193.28:0/983114519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd82810ffe0 msgr2=0x7fd8281760b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd82810ffe0 0x7fd8281760b0 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd818038820 tx=0x7fd818004300 comp rx=0 tx=0).stop 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 -- 10.20.193.28:0/983114519 shutdown_connections 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7fc0b56d0 0x7fd7fc0d5b80 unknown :-1 s=CLOSED pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd8281157e0 0x7fd8280f5590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd82810ffe0 0x7fd8281760b0 unknown :-1 s=CLOSED pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 --2- 10.20.193.28:0/983114519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd82810f5f0 0x7fd8280f4e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:24.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.662+0000 7fd82e79d640 1 -- 10.20.193.28:0/983114519 >> 10.20.193.28:0/983114519 conn(0x7fd8280ecea0 msgr2=0x7fd82810db00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:24.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.663+0000 7fd82e79d640 1 -- 10.20.193.28:0/983114519 shutdown_connections 2026-02-20T13:18:24.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:24.663+0000 7fd82e79d640 1 -- 10.20.193.28:0/983114519 wait complete. 2026-02-20T13:18:24.767 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:18:24.952 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:24 trial127 ceph-mon[43817]: pgmap v213: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:18:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:24 trial034 ceph-mon[43332]: pgmap v213: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2026-02-20T13:18:25.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 -- 10.20.193.28:0/2697633419 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f764810fea0 msgr2=0x7f7648114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 --2- 10.20.193.28:0/2697633419 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f764810fea0 0x7f7648114ef0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=2066054930771193491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630009950 tx=0x7f763002f190 comp rx=0 tx=0).stop 2026-02-20T13:18:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 -- 10.20.193.28:0/2697633419 shutdown_connections 2026-02-20T13:18:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 --2- 10.20.193.28:0/2697633419 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f76481156a0 0x7f7648176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 --2- 10.20.193.28:0/2697633419 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f764810fea0 0x7f7648114ef0 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=2066054930771193491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 --2- 10.20.193.28:0/2697633419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f764810f4b0 0x7f764810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 -- 10.20.193.28:0/2697633419 >> 10.20.193.28:0/2697633419 conn(0x7f76480ecda0 msgr2=0x7f764810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 -- 10.20.193.28:0/2697633419 shutdown_connections 2026-02-20T13:18:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.126+0000 7f764da9f640 1 -- 10.20.193.28:0/2697633419 wait complete. 2026-02-20T13:18:25.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.127+0000 7f764da9f640 1 Processor -- start 2026-02-20T13:18:25.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.127+0000 7f764da9f640 1 -- start start 2026-02-20T13:18:25.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.127+0000 7f764da9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f764810f4b0 0x7f76480f5760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.127+0000 7f764da9f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764810fea0 0x7f7648175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764da9f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f76481156a0 0x7f76480f5e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764da9f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f76480fb070 con 0x7f764810f4b0 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764da9f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f76480fb1e0 con 0x7f76481156a0 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764da9f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f76480fb3a0 con 0x7f764810fea0 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f763ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764810fea0 0x7f7648175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764ca9d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f764810f4b0 0x7f76480f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f763ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764810fea0 0x7f7648175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32868/0 (socket says 10.20.193.28:32868) 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f763ffff640 1 -- 10.20.193.28:0/845043927 learned_addr learned my addr 10.20.193.28:0/845043927 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764d29e640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f76481156a0 0x7f76480f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764ca9d640 1 -- 10.20.193.28:0/845043927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764810fea0 msgr2=0x7f7648175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764ca9d640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764810fea0 0x7f7648175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764ca9d640 1 -- 10.20.193.28:0/845043927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f76481156a0 msgr2=0x7f76480f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764ca9d640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f76481156a0 0x7f76480f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764ca9d640 1 -- 10.20.193.28:0/845043927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7630009570 con 0x7f764810f4b0 2026-02-20T13:18:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f763ffff640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764810fea0 0x7f7648175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.128+0000 7f764ca9d640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f764810f4b0 0x7f76480f5760 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f763800d700 tx=0x7f763800dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.129+0000 7f763dffb640 1 -- 10.20.193.28:0/845043927 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7638004500 con 0x7f764810f4b0 2026-02-20T13:18:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.129+0000 7f763dffb640 1 -- 10.20.193.28:0/845043927 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f763800de30 con 0x7f764810f4b0 2026-02-20T13:18:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.129+0000 7f763dffb640 1 -- 10.20.193.28:0/845043927 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76380052a0 con 0x7f764810f4b0 2026-02-20T13:18:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.129+0000 7f764da9f640 1 -- 10.20.193.28:0/845043927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76480fb680 con 0x7f764810f4b0 2026-02-20T13:18:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.129+0000 7f764da9f640 1 -- 10.20.193.28:0/845043927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76480fbb00 con 0x7f764810f4b0 2026-02-20T13:18:25.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.132+0000 7f763dffb640 1 -- 10.20.193.28:0/845043927 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7638005430 con 0x7f764810f4b0 2026-02-20T13:18:25.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.133+0000 7f763dffb640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76240b5750 0x7f76240d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.134+0000 7f763dffb640 1 -- 10.20.193.28:0/845043927 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f76380e6800 con 0x7f764810f4b0 2026-02-20T13:18:25.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.134+0000 7f763ffff640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76240b5750 0x7f76240d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.134+0000 7f763ffff640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76240b5750 0x7f76240d5c00 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630038820 tx=0x7f763003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.134+0000 7f7650d22e00 1 Processor -- start 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.134+0000 7f7650d22e00 1 -- start start 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb9b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbe05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafc00f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f7650d22e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559dafab1780 con 0x559dafbe0b20 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f7650d22e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559dafaad4b0 con 0x559dafb9b360 2026-02-20T13:18:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f7650d22e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559dafaa7450 con 0x559dafb9bc70 2026-02-20T13:18:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f763ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbe05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f764ca9d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb9b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f763ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbe05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32876/0 (socket says 10.20.193.28:32876) 2026-02-20T13:18:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f763ffff640 1 -- 10.20.193.28:0/3696578703 learned_addr learned my addr 10.20.193.28:0/3696578703 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f764d29e640 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafc00f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f763ffff640 1 -- 10.20.193.28:0/3696578703 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 msgr2=0x559dafb9b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f763ffff640 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb9b730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.135+0000 7f763ffff640 1 -- 10.20.193.28:0/3696578703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 msgr2=0x559dafc00f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f763ffff640 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafc00f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f763ffff640 1 -- 10.20.193.28:0/3696578703 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dafa52d10 con 0x559dafb9bc70 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f764d29e640 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafc00f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f763ffff640 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbe05e0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=13905079431434680738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630002e70 tx=0x7f7630040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f8c412144139a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f76154e4640 1 -- 10.20.193.28:0/3696578703 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f763002fcd0 con 0x559dafb9bc70 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f76154e4640 1 -- 10.20.193.28:0/3696578703 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f763003e040 con 0x559dafb9bc70 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f76154e4640 1 -- 10.20.193.28:0/3696578703 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7630044c90 con 0x559dafb9bc70 2026-02-20T13:18:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f7650d22e00 1 -- 10.20.193.28:0/3696578703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 msgr2=0x559dafbe05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f7650d22e00 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbe05e0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=13905079431434680738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630002e70 tx=0x7f7630040000 comp rx=0 tx=0).stop 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f7650d22e00 1 -- 10.20.193.28:0/3696578703 shutdown_connections 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f7650d22e00 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafc00f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f7650d22e00 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbe05e0 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=13905079431434680738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.136+0000 7f7650d22e00 1 --2- 10.20.193.28:0/3696578703 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb9b730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.137+0000 7f7650d22e00 1 -- 10.20.193.28:0/3696578703 >> 10.20.193.28:0/3696578703 conn(0x559dafb79860 msgr2=0x559dafb99c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.137+0000 7f7650d22e00 1 -- 10.20.193.28:0/3696578703 shutdown_connections 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.137+0000 7f7650d22e00 1 -- 10.20.193.28:0/3696578703 wait complete. 2026-02-20T13:18:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f7650d22e00 1 -- start start 2026-02-20T13:18:25.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f7650d22e00 1 Processor -- start 2026-02-20T13:18:25.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf8740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf8c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 0x559dafbfdc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f7650d22e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559dafbfe1b0 con 0x559dafb9b360 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f7650d22e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559dafbfe320 con 0x559dafbe0b20 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f7650d22e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559dafbfe4e0 con 0x559dafb9bc70 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.138+0000 7f763ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f763ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32886/0 (socket says 10.20.193.28:32886) 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f763ffff640 1 -- 10.20.193.28:0/2981571447 learned_addr learned my addr 10.20.193.28:0/2981571447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f764ca9d640 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf8740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f764d29e640 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 0x559dafbfdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f763ffff640 1 -- 10.20.193.28:0/2981571447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 msgr2=0x559dafbfdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f763ffff640 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 0x559dafbfdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f763ffff640 1 -- 10.20.193.28:0/2981571447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 msgr2=0x559dafbf8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f763ffff640 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf8740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f763ffff640 1 -- 10.20.193.28:0/2981571447 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76481768e0 con 0x559dafb9bc70 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f763ffff640 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf8c80 secure :-1 s=READY pgs=151 gs=2 cs=0 l=1 c_cookie=3602284244916975951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630005f40 tx=0x7f7630044410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31fde26f5e43394f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.139+0000 7f76067fc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f76067fc640 1 -- 10.20.193.28:0/2981571447 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7630038d50 con 0x559dafb9bc70 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f76067fc640 1 -- 10.20.193.28:0/2981571447 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f76300598f0 con 0x559dafb9bc70 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f76067fc640 1 -- 10.20.193.28:0/2981571447 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f763004f680 con 0x559dafb9bc70 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76440087c0 con 0x559dafb9bc70 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f76067fc640 1 -- 10.20.193.28:0/2981571447 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7630059410 con 0x559dafb9bc70 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f7650d22e00 10 client.25801 _ll_register_callbacks cb 0x559dafa28a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559daf73d6f0 con 0x559dafb9bc70 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f76067fc640 1 -- 10.20.193.28:0/2981571447 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7630059a60 con 0x559dafb9bc70 2026-02-20T13:18:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f7650d22e00 10 client.25801 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x559dafa2b3c0 con 0x559dafb9bc70 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f76067fc640 1 -- 10.20.193.28:0/2981571447 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f7630059610 con 0x559dafb9bc70 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.140+0000 7f7650d22e00 10 client.25801 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.141+0000 7f7650d22e00 10 client.25801 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.141+0000 7f7650d22e00 20 client.25801 populate_metadata read hostname 'trial028' 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.141+0000 7f7650d22e00 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559dafbdddd0 0x559dafbde270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.141+0000 7f7650d22e00 4 client.25801 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.141+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dafa49f80 con 0x559dafbdddd0 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.141+0000 7f764ca9d640 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559dafbdddd0 0x559dafbde270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.141+0000 7f764ca9d640 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559dafbdddd0 0x559dafbde270 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=5144013531063291450 s_cookie=2229581629183507888 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4763350d66d48e3a server_cookie=1ef110adcd383db0 in_seq=0 out_seq=0 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.141+0000 7f76067fc640 10 client.25801 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f76067fc640 1 -- 10.20.193.28:0/2981571447 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559dafa49f80 con 0x559dafbdddd0 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f76067fc640 10 client.25801 handle_command_reply: tid=0 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 client.25801 shutdown 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 msgr2=0x559dafbf8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf8c80 secure :-1 s=READY pgs=151 gs=2 cs=0 l=1 c_cookie=3602284244916975951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630005f40 tx=0x7f7630044410 comp rx=0 tx=0).stop 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 shutdown_connections 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559dafbdddd0 0x559dafbde270 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=5144013531063291450 s_cookie=2229581629183507888 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 0x559dafbfdc70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf8c80 unknown :-1 s=CLOSED pgs=151 gs=2 cs=0 l=1 c_cookie=3602284244916975951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 --2- 10.20.193.28:0/2981571447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf8740 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 >> 10.20.193.28:0/2981571447 conn(0x559dafb79860 msgr2=0x559dafb99c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f76067fc640 0 client.25801 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:18:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 shutdown_connections 2026-02-20T13:18:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 1 -- 10.20.193.28:0/2981571447 wait complete. 2026-02-20T13:18:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.142+0000 7f7650d22e00 20 client.25801 trim_cache size 0 max 16384 2026-02-20T13:18:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.149+0000 7f7650d22e00 1 Processor -- start 2026-02-20T13:18:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.149+0000 7f7650d22e00 1 -- start start 2026-02-20T13:18:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf5960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf5ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 0x559dafbda770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f7650d22e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559dafaa5080 con 0x559dafb9b360 2026-02-20T13:18:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f7650d22e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559daf765700 con 0x559dafbe0b20 2026-02-20T13:18:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f7650d22e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559dafbed0e0 con 0x559dafb9bc70 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf5960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf5960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57320/0 (socket says 10.20.193.28:57320) 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 -- 10.20.193.28:0/3368777322 learned_addr learned my addr 10.20.193.28:0/3368777322 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764d29e640 1 --2- 10.20.193.28:0/3368777322 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 0x559dafbda770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 -- 10.20.193.28:0/3368777322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 msgr2=0x559dafbf5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 --2- 10.20.193.28:0/3368777322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 -- 10.20.193.28:0/3368777322 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 msgr2=0x559dafbda770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 --2- 10.20.193.28:0/3368777322 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 0x559dafbda770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 -- 10.20.193.28:0/3368777322 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dafbeaa90 con 0x559dafb9b360 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f764ca9d640 1 --2- 10.20.193.28:0/3368777322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf5960 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=4660994031149156018 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f763800b630 tx=0x7f76380e6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40af2d6056dc86b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.150+0000 7f7614ce3640 1 -- 10.20.193.28:0/3368777322 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76380b7ca0 con 0x559dafb9b360 2026-02-20T13:18:25.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7614ce3640 1 -- 10.20.193.28:0/3368777322 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559dafa49f80 con 0x559dafb9b360 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7614ce3640 1 -- 10.20.193.28:0/3368777322 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76380b7a90 con 0x559dafb9b360 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 -- 10.20.193.28:0/3368777322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 msgr2=0x559dafbf5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 --2- 10.20.193.28:0/3368777322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf5960 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=4660994031149156018 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f763800b630 tx=0x7f76380e6040 comp rx=0 tx=0).stop 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 -- 10.20.193.28:0/3368777322 shutdown_connections 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 --2- 10.20.193.28:0/3368777322 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafbe0b20 0x559dafbda770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 --2- 10.20.193.28:0/3368777322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafbf5ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 --2- 10.20.193.28:0/3368777322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafb9b360 0x559dafbf5960 unknown :-1 s=CLOSED pgs=438 gs=1 cs=0 l=1 c_cookie=4660994031149156018 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 -- 10.20.193.28:0/3368777322 >> 10.20.193.28:0/3368777322 conn(0x559dafb79860 msgr2=0x559dafbe2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 -- 10.20.193.28:0/3368777322 shutdown_connections 2026-02-20T13:18:25.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 -- 10.20.193.28:0/3368777322 wait complete. 2026-02-20T13:18:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.151+0000 7f7650d22e00 1 -- start start 2026-02-20T13:18:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f7650d22e00 1 Processor -- start 2026-02-20T13:18:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb7f9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafb7ae90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f7650d22e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafb7b620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f7650d22e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559dafb7bd20 con 0x559dafbe0b20 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f7650d22e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559dafc468f0 con 0x559dafb9b360 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f7650d22e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559dafc46ab0 con 0x559dafb9bc70 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f764ca9d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb7f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f764d29e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafb7b620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f764ca9d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb7f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45880/0 (socket says 10.20.193.28:45880) 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f764ca9d640 1 -- 10.20.193.28:0/1033954655 learned_addr learned my addr 10.20.193.28:0/1033954655 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.152+0000 7f763ffff640 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafb7ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f764ca9d640 1 -- 10.20.193.28:0/1033954655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 msgr2=0x559dafb7ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f764ca9d640 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafb7ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f764ca9d640 1 -- 10.20.193.28:0/1033954655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 msgr2=0x559dafb7b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f764ca9d640 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafb7b620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f764ca9d640 1 -- 10.20.193.28:0/1033954655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dafa3d0e0 con 0x559dafb9b360 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f764ca9d640 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb7f9b0 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=14697129308212990641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76380acbf0 tx=0x7f76380b4f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf6b13cb20492b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f76067fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f76067fc640 1 -- 10.20.193.28:0/1033954655 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76380b7a30 con 0x559dafb9b360 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76480fbb00 con 0x559dafb9b360 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f7650d22e00 10 client.25853 _ll_register_callbacks cb 0x559dafa28a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f763003e040 con 0x559dafb9b360 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f76067fc640 1 -- 10.20.193.28:0/1033954655 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f76380b5e90 con 0x559dafb9b360 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f76067fc640 1 -- 10.20.193.28:0/1033954655 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76380ae550 con 0x559dafb9b360 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f76067fc640 1 -- 10.20.193.28:0/1033954655 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f76380ae6e0 con 0x559dafb9b360 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f76067fc640 1 -- 10.20.193.28:0/1033954655 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f76380abf00 con 0x559dafb9b360 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f7650d22e00 10 client.25853 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:25.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.153+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x559dafa37b60 con 0x559dafb9b360 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f76067fc640 1 -- 10.20.193.28:0/1033954655 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f76380ac0e0 con 0x559dafb9b360 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f7650d22e00 10 client.25853 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f7650d22e00 10 client.25853 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f7650d22e00 20 client.25853 populate_metadata read hostname 'trial028' 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f7650d22e00 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559dafc8e740 0x559dafcaebf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f7650d22e00 4 client.25853 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559daf73af40 con 0x559dafc8e740 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f763ffff640 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559dafc8e740 0x559dafcaebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f763ffff640 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559dafc8e740 0x559dafcaebf0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=4787089315623293327 s_cookie=11937658148495589537 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=426f285e95cb518f server_cookie=a5ab14d66f2080a1 in_seq=0 out_seq=0 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.154+0000 7f76067fc640 10 client.25853 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f76067fc640 1 -- 10.20.193.28:0/1033954655 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559daf73af40 con 0x559dafc8e740 2026-02-20T13:18:25.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f76067fc640 10 client.25853 handle_command_reply: tid=0 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 client.25853 shutdown 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 msgr2=0x559dafb7f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb7f9b0 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=14697129308212990641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76380acbf0 tx=0x7f76380b4f20 comp rx=0 tx=0).stop 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 shutdown_connections 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559dafc8e740 0x559dafcaebf0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=4787089315623293327 s_cookie=11937658148495589537 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559dafbe0b20 0x559dafb7b620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559dafb9bc70 0x559dafb7ae90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 --2- 10.20.193.28:0/1033954655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559dafb9b360 0x559dafb7f9b0 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=14697129308212990641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f76067fc640 0 client.25853 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 >> 10.20.193.28:0/1033954655 conn(0x559dafb79860 msgr2=0x559dafbf4950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 shutdown_connections 2026-02-20T13:18:25.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 1 -- 10.20.193.28:0/1033954655 wait complete. 2026-02-20T13:18:25.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f7650d22e00 20 client.25853 trim_cache size 0 max 16384 2026-02-20T13:18:25.165 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:18:25.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f764da9f640 1 -- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76240b5750 msgr2=0x7f76240d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f764da9f640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76240b5750 0x7f76240d5c00 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630038820 tx=0x7f763003a040 comp rx=0 tx=0).stop 2026-02-20T13:18:25.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f764da9f640 1 -- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f764810f4b0 msgr2=0x7f76480f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.155+0000 7f764da9f640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f764810f4b0 0x7f76480f5760 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f763800d700 tx=0x7f763800dbd0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.156+0000 7f764da9f640 1 -- 10.20.193.28:0/845043927 shutdown_connections 2026-02-20T13:18:25.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.156+0000 7f764da9f640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76240b5750 0x7f76240d5c00 unknown :-1 s=CLOSED pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.156+0000 7f764da9f640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f76481156a0 0x7f76480f5e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.156+0000 7f764da9f640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764810fea0 0x7f7648175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.156+0000 7f764da9f640 1 --2- 10.20.193.28:0/845043927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f764810f4b0 0x7f76480f5760 unknown :-1 s=CLOSED pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.156+0000 7f764da9f640 1 -- 10.20.193.28:0/845043927 >> 10.20.193.28:0/845043927 conn(0x7f76480ecda0 msgr2=0x7f7648111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.157+0000 7f764da9f640 1 -- 10.20.193.28:0/845043927 shutdown_connections 2026-02-20T13:18:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.157+0000 7f764da9f640 1 -- 10.20.193.28:0/845043927 wait complete. 2026-02-20T13:18:25.292 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:18:25.476 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:25.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 -- 10.20.193.28:0/2448204980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 msgr2=0x7f0ab810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/2448204980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 0x7f0ab810f880 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=15282551143159441501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4009950 tx=0x7f0aa402f190 comp rx=0 tx=0).stop 2026-02-20T13:18:25.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 -- 10.20.193.28:0/2448204980 shutdown_connections 2026-02-20T13:18:25.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/2448204980 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ab81156a0 0x7f0ab8176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/2448204980 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ab810fea0 0x7f0ab8114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/2448204980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 0x7f0ab810f880 unknown :-1 s=CLOSED pgs=439 gs=1 cs=0 l=1 c_cookie=15282551143159441501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 -- 10.20.193.28:0/2448204980 >> 10.20.193.28:0/2448204980 conn(0x7f0ab80ecda0 msgr2=0x7f0ab810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 -- 10.20.193.28:0/2448204980 shutdown_connections 2026-02-20T13:18:25.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.675+0000 7f0abd4ed640 1 -- 10.20.193.28:0/2448204980 wait complete. 2026-02-20T13:18:25.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.676+0000 7f0abd4ed640 1 Processor -- start 2026-02-20T13:18:25.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.676+0000 7f0abd4ed640 1 -- start start 2026-02-20T13:18:25.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.676+0000 7f0abd4ed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 0x7f0ab811dde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.676+0000 7f0abd4ed640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ab810fea0 0x7f0ab811e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.676+0000 7f0abd4ed640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ab81156a0 0x7f0ab81236f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.676+0000 7f0abd4ed640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8123d10 con 0x7f0ab810f4b0 2026-02-20T13:18:25.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.676+0000 7f0abd4ed640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8123e80 con 0x7f0ab810fea0 2026-02-20T13:18:25.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.676+0000 7f0abd4ed640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8124040 con 0x7f0ab81156a0 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 0x7f0ab811dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 0x7f0ab811dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57336/0 (socket says 10.20.193.28:57336) 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 -- 10.20.193.28:0/956851953 learned_addr learned my addr 10.20.193.28:0/956851953 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0abccec640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ab81156a0 0x7f0ab81236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab77fe640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ab810fea0 0x7f0ab811e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 -- 10.20.193.28:0/956851953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ab81156a0 msgr2=0x7f0ab81236f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ab81156a0 0x7f0ab81236f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 -- 10.20.193.28:0/956851953 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ab810fea0 msgr2=0x7f0ab811e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ab810fea0 0x7f0ab811e320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 -- 10.20.193.28:0/956851953 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa4009570 con 0x7f0ab810f4b0 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0abccec640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ab81156a0 0x7f0ab81236f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:25.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.677+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 0x7f0ab811dde0 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4038820 tx=0x7f0aa4004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.678+0000 7f0ab57fa640 1 -- 10.20.193.28:0/956851953 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa403d070 con 0x7f0ab810f4b0 2026-02-20T13:18:25.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.678+0000 7f0ab57fa640 1 -- 10.20.193.28:0/956851953 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aa4002ad0 con 0x7f0ab810f4b0 2026-02-20T13:18:25.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.678+0000 7f0ab57fa640 1 -- 10.20.193.28:0/956851953 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa4041940 con 0x7f0ab810f4b0 2026-02-20T13:18:25.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.678+0000 7f0abd4ed640 1 -- 10.20.193.28:0/956851953 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab81242c0 con 0x7f0ab810f4b0 2026-02-20T13:18:25.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.678+0000 7f0abd4ed640 1 -- 10.20.193.28:0/956851953 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab8164880 con 0x7f0ab810f4b0 2026-02-20T13:18:25.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.681+0000 7f0ab57fa640 1 -- 10.20.193.28:0/956851953 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0aa4041ad0 con 0x7f0ab810f4b0 2026-02-20T13:18:25.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ab57fa640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a8c0b5760 0x7f0a8c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ab57fa640 1 -- 10.20.193.28:0/956851953 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0aa410b010 con 0x7f0ab810f4b0 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ac0770e00 1 Processor -- start 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ac0770e00 1 -- start start 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ab77fe640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a8c0b5760 0x7f0a8c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a654730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654c70 0x55b62a6995e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a699b20 0x55b62a6b9f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b62a56a780 con 0x55b62a699b20 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b62a5664b0 con 0x55b62a654c70 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.683+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b62a560450 con 0x55b62a654360 2026-02-20T13:18:25.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0abccec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a699b20 0x55b62a6b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0abccec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a699b20 0x55b62a6b9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57346/0 (socket says 10.20.193.28:57346) 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0abccec640 1 -- 10.20.193.28:0/3678883539 learned_addr learned my addr 10.20.193.28:0/3678883539 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/3678883539 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a654730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0abccec640 1 -- 10.20.193.28:0/3678883539 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 msgr2=0x55b62a654730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0abccec640 1 --2- 10.20.193.28:0/3678883539 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a654730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0abccec640 1 -- 10.20.193.28:0/3678883539 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654c70 msgr2=0x55b62a6995e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0abccec640 1 --2- 10.20.193.28:0/3678883539 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654c70 0x55b62a6995e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.684+0000 7f0abccec640 1 -- 10.20.193.28:0/3678883539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b62a50bd10 con 0x55b62a699b20 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0abccec640 1 --2- 10.20.193.28:0/3678883539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a699b20 0x55b62a6b9f00 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=11015315165027372585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aac00afd0 tx=0x7f0aac0056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98de42c7ec6e0e29 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ab77fe640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a8c0b5760 0x7f0a8c0d5c10 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ab8124780 tx=0x7f0aa800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0a88ce3640 1 -- 10.20.193.28:0/3678883539 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aac01b440 con 0x55b62a699b20 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0a88ce3640 1 -- 10.20.193.28:0/3678883539 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aac011910 con 0x55b62a699b20 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0a88ce3640 1 -- 10.20.193.28:0/3678883539 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aac00fab0 con 0x55b62a699b20 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 -- 10.20.193.28:0/3678883539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a699b20 msgr2=0x55b62a6b9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/3678883539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a699b20 0x55b62a6b9f00 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=11015315165027372585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aac00afd0 tx=0x7f0aac0056c0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 -- 10.20.193.28:0/3678883539 shutdown_connections 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/3678883539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a699b20 0x55b62a6b9f00 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=11015315165027372585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/3678883539 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654c70 0x55b62a6995e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/3678883539 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a654730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 -- 10.20.193.28:0/3678883539 >> 10.20.193.28:0/3678883539 conn(0x55b62a632860 msgr2=0x55b62a652c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 -- 10.20.193.28:0/3678883539 shutdown_connections 2026-02-20T13:18:25.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.685+0000 7f0ac0770e00 1 -- 10.20.193.28:0/3678883539 wait complete. 2026-02-20T13:18:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0ac0770e00 1 -- start start 2026-02-20T13:18:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0ac0770e00 1 Processor -- start 2026-02-20T13:18:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654360 0x55b62a655730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654c70 0x55b62a655c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a658620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b62a658b60 con 0x55b62a654360 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b62a658cd0 con 0x55b62a699b20 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b62a658e90 con 0x55b62a654c70 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0abccec640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a658620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0abccec640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a658620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45912/0 (socket says 10.20.193.28:45912) 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.687+0000 7f0abccec640 1 -- 10.20.193.28:0/2776456790 learned_addr learned my addr 10.20.193.28:0/2776456790 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0abccec640 1 -- 10.20.193.28:0/2776456790 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654c70 msgr2=0x55b62a655c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0ab77fe640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654c70 0x55b62a655c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654360 0x55b62a655730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0abccec640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654c70 0x55b62a655c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0abccec640 1 -- 10.20.193.28:0/2776456790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654360 msgr2=0x55b62a655730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0abccec640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654360 0x55b62a655730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0abccec640 1 -- 10.20.193.28:0/2776456790 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b62a4e43c0 con 0x55b62a699b20 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0ab77fe640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654c70 0x55b62a655c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654360 0x55b62a655730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0abccec640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a658620 secure :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=16628213715244840211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aac003f70 tx=0x7f0aac011660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6c3484622727513 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0a79ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2776456790 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aac01f070 con 0x55b62a699b20 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2776456790 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aac020040 con 0x55b62a699b20 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2776456790 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aac006030 con 0x55b62a699b20 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.688+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac00ae40 con 0x55b62a699b20 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2776456790 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0aac0061c0 con 0x55b62a699b20 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0a79ffb640 10 client.25862 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:25.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 10 client.25862 _ll_register_callbacks cb 0x55b62a4e1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b62a1f66f0 con 0x55b62a699b20 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2776456790 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0aac00f8b0 con 0x55b62a699b20 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 10 client.25862 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55b62a4f60e0 con 0x55b62a699b20 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2776456790 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f0aac0057e0 con 0x55b62a699b20 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 10 client.25862 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 10 client.25862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 20 client.25862 populate_metadata read hostname 'trial028' 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b62a67fb20 0x55b62a67ffc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 4 client.25862 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.689+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b62a502f80 con 0x55b62a67fb20 2026-02-20T13:18:25.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.690+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b62a67fb20 0x55b62a67ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.690+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b62a67fb20 0x55b62a67ffc0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=659650959061612914 s_cookie=876390395107020723 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9278d0d629cf972 server_cookie=c29906bc8eb0fb3 in_seq=0 out_seq=0 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.690+0000 7f0a79ffb640 10 client.25862 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.690+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2776456790 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b62a502f80 con 0x55b62a67fb20 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.690+0000 7f0a79ffb640 10 client.25862 handle_command_reply: tid=0 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.690+0000 7f0ac0770e00 1 client.25862 shutdown 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 msgr2=0x55b62a658620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a658620 secure :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=16628213715244840211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aac003f70 tx=0x7f0aac011660 comp rx=0 tx=0).stop 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 shutdown_connections 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b62a67fb20 0x55b62a67ffc0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=659650959061612914 s_cookie=876390395107020723 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a658620 unknown :-1 s=CLOSED pgs=181 gs=1 cs=0 l=1 c_cookie=16628213715244840211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654c70 0x55b62a655c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2776456790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654360 0x55b62a655730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 >> 10.20.193.28:0/2776456790 conn(0x55b62a632860 msgr2=0x55b62a652c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0a79ffb640 0 client.25862 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:25.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 shutdown_connections 2026-02-20T13:18:25.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2776456790 wait complete. 2026-02-20T13:18:25.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.691+0000 7f0ac0770e00 20 client.25862 trim_cache size 0 max 16384 2026-02-20T13:18:25.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.698+0000 7f0ac0770e00 1 Processor -- start 2026-02-20T13:18:25.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.698+0000 7f0ac0770e00 1 -- start start 2026-02-20T13:18:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.698+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a6b7360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.698+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6b78a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a655580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b62a55e080 con 0x55b62a654c70 2026-02-20T13:18:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b62a21e700 con 0x55b62a699b20 2026-02-20T13:18:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b62a6aeac0 con 0x55b62a654360 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ab7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a6b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ab7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a6b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32944/0 (socket says 10.20.193.28:32944) 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ab7fff640 1 -- 10.20.193.28:0/1841095860 learned_addr learned my addr 10.20.193.28:0/1841095860 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0abccec640 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a655580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ab77fe640 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ab7fff640 1 -- 10.20.193.28:0/1841095860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 msgr2=0x55b62a655580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a655580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.699+0000 7f0ab7fff640 1 -- 10.20.193.28:0/1841095860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 msgr2=0x55b62a6b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ab7fff640 1 -- 10.20.193.28:0/1841095860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b62a4f0b60 con 0x55b62a654360 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a6b7360 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=17102775020481741632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4108b20 tx=0x7f0aa40bb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed594344493d0340 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0a7bfff640 1 -- 10.20.193.28:0/1841095860 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa40d9ba0 con 0x55b62a654360 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0a7bfff640 1 -- 10.20.193.28:0/1841095860 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aa40cd040 con 0x55b62a654360 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0a7bfff640 1 -- 10.20.193.28:0/1841095860 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa40dc060 con 0x55b62a654360 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ac0770e00 1 -- 10.20.193.28:0/1841095860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 msgr2=0x55b62a6b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a6b7360 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=17102775020481741632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4108b20 tx=0x7f0aa40bb040 comp rx=0 tx=0).stop 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ac0770e00 1 -- 10.20.193.28:0/1841095860 shutdown_connections 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6b78a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a699b20 0x55b62a655580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.700+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/1841095860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a654360 0x55b62a6b7360 unknown :-1 s=CLOSED pgs=152 gs=2 cs=0 l=1 c_cookie=17102775020481741632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.701+0000 7f0ac0770e00 1 -- 10.20.193.28:0/1841095860 >> 10.20.193.28:0/1841095860 conn(0x55b62a632860 msgr2=0x55b62a67fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.701+0000 7f0ac0770e00 1 -- 10.20.193.28:0/1841095860 shutdown_connections 2026-02-20T13:18:25.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.701+0000 7f0ac0770e00 1 -- 10.20.193.28:0/1841095860 wait complete. 2026-02-20T13:18:25.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.701+0000 7f0ac0770e00 1 -- start start 2026-02-20T13:18:25.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.701+0000 7f0ac0770e00 1 Processor -- start 2026-02-20T13:18:25.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654360 0x55b62a67b060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6799c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ac0770e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a699b20 0x55b62a679f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b62a67a4c0 con 0x55b62a654c70 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b62a67a630 con 0x55b62a654360 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ac0770e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b62a67a7f0 con 0x55b62a699b20 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ab7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654360 0x55b62a67b060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0abccec640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a699b20 0x55b62a679f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0abccec640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a699b20 0x55b62a679f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32952/0 (socket says 10.20.193.28:32952) 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0abccec640 1 -- 10.20.193.28:0/2524545801 learned_addr learned my addr 10.20.193.28:0/2524545801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ab7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654360 0x55b62a67b060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45942/0 (socket says 10.20.193.28:45942) 2026-02-20T13:18:25.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0ab77fe640 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0abccec640 1 -- 10.20.193.28:0/2524545801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654360 msgr2=0x55b62a67b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0abccec640 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654360 0x55b62a67b060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0abccec640 1 -- 10.20.193.28:0/2524545801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 msgr2=0x55b62a6799c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0abccec640 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6799c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.702+0000 7f0abccec640 1 -- 10.20.193.28:0/2524545801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b62a4e46f0 con 0x55b62a699b20 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654360 0x55b62a67b060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0ab77fe640 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6799c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0abccec640 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a699b20 0x55b62a679f00 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=18045036785770411271 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aac010550 tx=0x7f0aac003f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa6cd95996b3b507 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0a79ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:25.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2524545801 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aac01f040 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab8164880 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2524545801 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aac032020 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2524545801 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aac02e8c0 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0ac0770e00 10 client.25816 _ll_register_callbacks cb 0x55b62a4e1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aac011910 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2524545801 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0aac033030 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2524545801 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0aac02ea40 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0ac0770e00 10 client.25816 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55b62a4f6340 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.703+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2524545801 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f0aac040030 con 0x55b62a699b20 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0ac0770e00 10 client.25816 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:25.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0ac0770e00 10 client.25816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0ac0770e00 20 client.25816 populate_metadata read hostname 'trial028' 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b62a685f30 0x55b62a6863d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0ac0770e00 4 client.25816 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b62a1f3f40 con 0x55b62a685f30 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b62a685f30 0x55b62a6863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0ab7fff640 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b62a685f30 0x55b62a6863d0 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=11875576431561076397 s_cookie=9414946207885371232 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4ce85d85232eead server_cookie=82a89bb18c6b2760 in_seq=0 out_seq=0 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.704+0000 7f0a79ffb640 10 client.25816 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0a79ffb640 1 -- 10.20.193.28:0/2524545801 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b62a1f3f40 con 0x55b62a685f30 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0a79ffb640 10 client.25816 handle_command_reply: tid=0 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 client.25816 shutdown 2026-02-20T13:18:25.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a699b20 msgr2=0x55b62a679f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a699b20 0x55b62a679f00 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=18045036785770411271 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aac010550 tx=0x7f0aac003f70 comp rx=0 tx=0).stop 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 shutdown_connections 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b62a685f30 0x55b62a6863d0 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=11875576431561076397 s_cookie=9414946207885371232 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b62a654c70 0x55b62a6799c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b62a699b20 0x55b62a679f00 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=18045036785770411271 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 --2- 10.20.193.28:0/2524545801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b62a654360 0x55b62a67b060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0a79ffb640 0 client.25816 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 >> 10.20.193.28:0/2524545801 conn(0x55b62a632860 msgr2=0x55b62a655580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 shutdown_connections 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 1 -- 10.20.193.28:0/2524545801 wait complete. 2026-02-20T13:18:25.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.705+0000 7f0ac0770e00 20 client.25816 trim_cache size 0 max 16384 2026-02-20T13:18:25.715 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:18:25.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 -- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a8c0b5760 msgr2=0x7f0a8c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a8c0b5760 0x7f0a8c0d5c10 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ab8124780 tx=0x7f0aa800b410 comp rx=0 tx=0).stop 2026-02-20T13:18:25.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 -- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 msgr2=0x7f0ab811dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 0x7f0ab811dde0 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4038820 tx=0x7f0aa4004300 comp rx=0 tx=0).stop 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 -- 10.20.193.28:0/956851953 shutdown_connections 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a8c0b5760 0x7f0a8c0d5c10 unknown :-1 s=CLOSED pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ab81156a0 0x7f0ab81236f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ab810fea0 0x7f0ab811e320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 --2- 10.20.193.28:0/956851953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab810f4b0 0x7f0ab811dde0 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 -- 10.20.193.28:0/956851953 >> 10.20.193.28:0/956851953 conn(0x7f0ab80ecda0 msgr2=0x7f0ab810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 -- 10.20.193.28:0/956851953 shutdown_connections 2026-02-20T13:18:25.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:25.706+0000 7f0abd4ed640 1 -- 10.20.193.28:0/956851953 wait complete. 2026-02-20T13:18:26.817 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:18:26.818 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:18:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:26 trial028 ceph-mon[37442]: pgmap v214: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:18:26.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:26 trial127 ceph-mon[43817]: pgmap v214: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:18:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:26 trial034 ceph-mon[43332]: pgmap v214: 97 pgs: 97 active+clean; 722 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:18:27.004 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:27.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 -- 10.20.193.28:0/166508671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 msgr2=0x7f5470061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 --2- 10.20.193.28:0/166508671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 0x7f5470061300 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=12303564518658347329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5460009950 tx=0x7f546002f190 comp rx=0 tx=0).stop 2026-02-20T13:18:27.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 -- 10.20.193.28:0/166508671 shutdown_connections 2026-02-20T13:18:27.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 --2- 10.20.193.28:0/166508671 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5470155980 0x7f5470175d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 --2- 10.20.193.28:0/166508671 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5470061840 0x7f5470155440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 --2- 10.20.193.28:0/166508671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 0x7f5470061300 unknown :-1 s=CLOSED pgs=442 gs=1 cs=0 l=1 c_cookie=12303564518658347329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 -- 10.20.193.28:0/166508671 >> 10.20.193.28:0/166508671 conn(0x7f54700eaad0 msgr2=0x7f547010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 -- 10.20.193.28:0/166508671 shutdown_connections 2026-02-20T13:18:27.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.176+0000 7f5475d68640 1 -- 10.20.193.28:0/166508671 wait complete. 2026-02-20T13:18:27.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.177+0000 7f5475d68640 1 Processor -- start 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.177+0000 7f5475d68640 1 -- start start 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.177+0000 7f5475d68640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 0x7f54701620f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.177+0000 7f5475d68640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5470061840 0x7f5470162630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.177+0000 7f5475d68640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5470155980 0x7f5470167a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.177+0000 7f5475d68640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5470168020 con 0x7f5470060f30 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.177+0000 7f5475d68640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5470168190 con 0x7f5470155980 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.177+0000 7f5475d68640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5470168350 con 0x7f5470061840 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 0x7f54701620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 0x7f54701620f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57400/0 (socket says 10.20.193.28:57400) 2026-02-20T13:18:27.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 -- 10.20.193.28:0/2670646033 learned_addr learned my addr 10.20.193.28:0/2670646033 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5467fff640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5470061840 0x7f5470162630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5475567640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5470155980 0x7f5470167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 -- 10.20.193.28:0/2670646033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5470061840 msgr2=0x7f5470162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5470061840 0x7f5470162630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 -- 10.20.193.28:0/2670646033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5470155980 msgr2=0x7f5470167a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5470155980 0x7f5470167a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 -- 10.20.193.28:0/2670646033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5460009570 con 0x7f5470060f30 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5474d66640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 0x7f54701620f0 secure :-1 s=READY pgs=443 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5460038820 tx=0x7f54600028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5465ffb640 1 -- 10.20.193.28:0/2670646033 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f546003d070 con 0x7f5470060f30 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5475d68640 1 -- 10.20.193.28:0/2670646033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54701685d0 con 0x7f5470060f30 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5465ffb640 1 -- 10.20.193.28:0/2670646033 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f54600043d0 con 0x7f5470060f30 2026-02-20T13:18:27.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5465ffb640 1 -- 10.20.193.28:0/2670646033 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5460041960 con 0x7f5470060f30 2026-02-20T13:18:27.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.178+0000 7f5475d68640 1 -- 10.20.193.28:0/2670646033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54701515a0 con 0x7f5470060f30 2026-02-20T13:18:27.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.181+0000 7f5465ffb640 1 -- 10.20.193.28:0/2670646033 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5460041af0 con 0x7f5470060f30 2026-02-20T13:18:27.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.183+0000 7f5465ffb640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f544c0b5760 0x7f544c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.183+0000 7f5465ffb640 1 -- 10.20.193.28:0/2670646033 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f546010aef0 con 0x7f5470060f30 2026-02-20T13:18:27.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.183+0000 7f5467fff640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f544c0b5760 0x7f544c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.184+0000 7f5467fff640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f544c0b5760 0x7f544c0d5c10 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5470168a90 tx=0x7f5458005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.184+0000 7f5478febe00 1 Processor -- start 2026-02-20T13:18:27.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.184+0000 7f5478febe00 1 -- start start 2026-02-20T13:18:27.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5478febe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c640e20 0x56471c6411f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5478febe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c641730 0x56471c685e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5478febe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c6863d0 0x56471c6a67b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5478febe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56471c54ea20 con 0x56471c6863d0 2026-02-20T13:18:27.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5478febe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56471c54a750 con 0x56471c641730 2026-02-20T13:18:27.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5478febe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56471c5446f0 con 0x56471c640e20 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c640e20 0x56471c6411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c640e20 0x56471c6411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32976/0 (socket says 10.20.193.28:32976) 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 -- 10.20.193.28:0/3856134772 learned_addr learned my addr 10.20.193.28:0/3856134772 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5467fff640 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c641730 0x56471c685e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5475567640 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c6863d0 0x56471c6a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 -- 10.20.193.28:0/3856134772 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c641730 msgr2=0x56471c685e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c641730 0x56471c685e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 -- 10.20.193.28:0/3856134772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c6863d0 msgr2=0x56471c6a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c6863d0 0x56471c6a67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 -- 10.20.193.28:0/3856134772 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471c4f0120 con 0x56471c640e20 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5475567640 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c6863d0 0x56471c6a67b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:27.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.185+0000 7f5474d66640 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c640e20 0x56471c6411f0 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=2303830563990348866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54600d1570 tx=0x7f5460038f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ff8d9b115552442 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f543d4e4640 1 -- 10.20.193.28:0/3856134772 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54600d0b00 con 0x56471c640e20 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f543d4e4640 1 -- 10.20.193.28:0/3856134772 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f54600d6f70 con 0x56471c640e20 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f543d4e4640 1 -- 10.20.193.28:0/3856134772 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54600dc180 con 0x56471c640e20 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 -- 10.20.193.28:0/3856134772 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c640e20 msgr2=0x56471c6411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c640e20 0x56471c6411f0 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=2303830563990348866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54600d1570 tx=0x7f5460038f10 comp rx=0 tx=0).stop 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 -- 10.20.193.28:0/3856134772 shutdown_connections 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c6863d0 0x56471c6a67b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c641730 0x56471c685e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 --2- 10.20.193.28:0/3856134772 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c640e20 0x56471c6411f0 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=2303830563990348866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 -- 10.20.193.28:0/3856134772 >> 10.20.193.28:0/3856134772 conn(0x56471c616910 msgr2=0x56471c636cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 -- 10.20.193.28:0/3856134772 shutdown_connections 2026-02-20T13:18:27.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.186+0000 7f5478febe00 1 -- 10.20.193.28:0/3856134772 wait complete. 2026-02-20T13:18:27.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.187+0000 7f5478febe00 1 -- start start 2026-02-20T13:18:27.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.188+0000 7f5478febe00 1 Processor -- start 2026-02-20T13:18:27.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.188+0000 7f5478febe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c640e20 0x56471c659430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.188+0000 7f5478febe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c641730 0x56471c659970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.188+0000 7f5478febe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c6863d0 0x56471c65e960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.188+0000 7f5478febe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56471c65eea0 con 0x56471c640e20 2026-02-20T13:18:27.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.188+0000 7f5478febe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56471c65f010 con 0x56471c6863d0 2026-02-20T13:18:27.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.188+0000 7f5478febe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56471c65f1d0 con 0x56471c641730 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.188+0000 7f5467fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c641730 0x56471c659970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5467fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c641730 0x56471c659970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32990/0 (socket says 10.20.193.28:32990) 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5467fff640 1 -- 10.20.193.28:0/1101385199 learned_addr learned my addr 10.20.193.28:0/1101385199 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5474d66640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c640e20 0x56471c659430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5475567640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c6863d0 0x56471c65e960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5467fff640 1 -- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c6863d0 msgr2=0x56471c65e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5467fff640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c6863d0 0x56471c65e960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5467fff640 1 -- 10.20.193.28:0/1101385199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c640e20 msgr2=0x56471c659430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5467fff640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c640e20 0x56471c659430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5467fff640 1 -- 10.20.193.28:0/1101385199 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471c4c8810 con 0x56471c641730 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5474d66640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c640e20 0x56471c659430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:27.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5475567640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c6863d0 0x56471c65e960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5467fff640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c641730 0x56471c659970 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=374452577998557556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54580116c0 tx=0x7f54580047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53252a2c0d55174 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f542e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f542e7fc640 1 -- 10.20.193.28:0/1101385199 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5458002af0 con 0x56471c641730 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f542e7fc640 1 -- 10.20.193.28:0/1101385199 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5458002c50 con 0x56471c641730 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54701515a0 con 0x56471c641730 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f542e7fc640 1 -- 10.20.193.28:0/1101385199 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f545801c960 con 0x56471c641730 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.189+0000 7f542e7fc640 1 -- 10.20.193.28:0/1101385199 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f545801caf0 con 0x56471c641730 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 10 client.25828 _ll_register_callbacks cb 0x56471c4fbb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56471c1da9d0 con 0x56471c641730 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f542e7fc640 1 -- 10.20.193.28:0/1101385199 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f545801c410 con 0x56471c641730 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 10 client.25828 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56471c4da4f0 con 0x56471c641730 2026-02-20T13:18:27.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f542e7fc640 1 -- 10.20.193.28:0/1101385199 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f5458003050 con 0x56471c641730 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 10 client.25828 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 10 client.25828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 20 client.25828 populate_metadata read hostname 'trial028' 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56471c683e30 0x56471c6842d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 4 client.25828 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56471c551df0 con 0x56471c683e30 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.190+0000 7f5474d66640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56471c683e30 0x56471c6842d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.191+0000 7f5474d66640 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56471c683e30 0x56471c6842d0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=4799328781853361444 s_cookie=14424685982468813682 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429aa41962ad8524 server_cookie=c82ec779cd9c3372 in_seq=0 out_seq=0 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.191+0000 7f542e7fc640 10 client.25828 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.191+0000 7f542e7fc640 1 -- 10.20.193.28:0/1101385199 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56471c551df0 con 0x56471c683e30 2026-02-20T13:18:27.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.191+0000 7f542e7fc640 10 client.25828 handle_command_reply: tid=0 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.191+0000 7f5478febe00 1 client.25828 shutdown 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.191+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c641730 msgr2=0x56471c659970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.191+0000 7f5478febe00 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c641730 0x56471c659970 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=374452577998557556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54580116c0 tx=0x7f54580047e0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 shutdown_connections 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56471c683e30 0x56471c6842d0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=4799328781853361444 s_cookie=14424685982468813682 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c6863d0 0x56471c65e960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f542e7fc640 0 client.25828 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c641730 0x56471c659970 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=374452577998557556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 1 --2- 10.20.193.28:0/1101385199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c640e20 0x56471c659430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 >> 10.20.193.28:0/1101385199 conn(0x56471c616910 msgr2=0x56471c6374e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 shutdown_connections 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 1 -- 10.20.193.28:0/1101385199 wait complete. 2026-02-20T13:18:27.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.192+0000 7f5478febe00 20 client.25828 trim_cache size 0 max 16384 2026-02-20T13:18:27.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.201+0000 7f5478febe00 1 Processor -- start 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.201+0000 7f5478febe00 1 -- start start 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.201+0000 7f5478febe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6567f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.201+0000 7f5478febe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c656d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.201+0000 7f5478febe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c685890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.201+0000 7f5478febe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56471c542320 con 0x56471c641730 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.201+0000 7f5478febe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56471c202790 con 0x56471c640e20 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.201+0000 7f5478febe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56471c613390 con 0x56471c683e30 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5474d66640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c656d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5475567640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c685890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c656d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57432/0 (socket says 10.20.193.28:57432) 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 -- 10.20.193.28:0/3521927182 learned_addr learned my addr 10.20.193.28:0/3521927182 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 -- 10.20.193.28:0/3521927182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 msgr2=0x56471c685890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 --2- 10.20.193.28:0/3521927182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c685890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 -- 10.20.193.28:0/3521927182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 msgr2=0x56471c6567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 --2- 10.20.193.28:0/3521927182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 -- 10.20.193.28:0/3521927182 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471c64b730 con 0x56471c641730 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f5467fff640 1 --2- 10.20.193.28:0/3521927182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c656d30 secure :-1 s=READY pgs=444 gs=2 cs=0 l=1 c_cookie=6031683837657918599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5458011c60 tx=0x7f5458029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b4d87e3d10ac87 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f543cce3640 1 -- 10.20.193.28:0/3521927182 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f545801caf0 con 0x56471c641730 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f543cce3640 1 -- 10.20.193.28:0/3521927182 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56471c1da9d0 con 0x56471c641730 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.202+0000 7f543cce3640 1 -- 10.20.193.28:0/3521927182 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f545801aec0 con 0x56471c641730 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 -- 10.20.193.28:0/3521927182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 msgr2=0x56471c656d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 --2- 10.20.193.28:0/3521927182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c656d30 secure :-1 s=READY pgs=444 gs=2 cs=0 l=1 c_cookie=6031683837657918599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5458011c60 tx=0x7f5458029000 comp rx=0 tx=0).stop 2026-02-20T13:18:27.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 -- 10.20.193.28:0/3521927182 shutdown_connections 2026-02-20T13:18:27.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 --2- 10.20.193.28:0/3521927182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c656d30 unknown :-1 s=CLOSED pgs=444 gs=2 cs=0 l=1 c_cookie=6031683837657918599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 --2- 10.20.193.28:0/3521927182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c685890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 --2- 10.20.193.28:0/3521927182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6567f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 -- 10.20.193.28:0/3521927182 >> 10.20.193.28:0/3521927182 conn(0x56471c616910 msgr2=0x56471c685180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 -- 10.20.193.28:0/3521927182 shutdown_connections 2026-02-20T13:18:27.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 -- 10.20.193.28:0/3521927182 wait complete. 2026-02-20T13:18:27.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 -- start start 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.203+0000 7f5478febe00 1 Processor -- start 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5478febe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6655e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5478febe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c65fbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5478febe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c660130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5478febe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56471c660740 con 0x56471c641730 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5478febe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56471c6608b0 con 0x56471c640e20 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5478febe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56471c660a70 con 0x56471c683e30 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5474d66640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5474d66640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6655e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45994/0 (socket says 10.20.193.28:45994) 2026-02-20T13:18:27.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5474d66640 1 -- 10.20.193.28:0/4132537422 learned_addr learned my addr 10.20.193.28:0/4132537422 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5467fff640 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c65fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5475567640 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c660130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5474d66640 1 -- 10.20.193.28:0/4132537422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 msgr2=0x56471c660130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5474d66640 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c660130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5474d66640 1 -- 10.20.193.28:0/4132537422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 msgr2=0x56471c65fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5474d66640 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c65fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5474d66640 1 -- 10.20.193.28:0/4132537422 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471c4d4f70 con 0x56471c640e20 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.204+0000 7f5475567640 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c660130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5474d66640 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6655e0 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=6303166442566871083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54600cd670 tx=0x7f5460009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5779587be15c682b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f542e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f542e7fc640 1 -- 10.20.193.28:0/4132537422 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54600dc120 con 0x56471c640e20 2026-02-20T13:18:27.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56471c4da4f0 con 0x56471c640e20 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 10 client.25883 _ll_register_callbacks cb 0x56471c4fbb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56471c29c530 con 0x56471c640e20 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f542e7fc640 1 -- 10.20.193.28:0/4132537422 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5460038920 con 0x56471c640e20 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f542e7fc640 1 -- 10.20.193.28:0/4132537422 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54600dc120 con 0x56471c640e20 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f542e7fc640 1 -- 10.20.193.28:0/4132537422 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f54600cbc40 con 0x56471c640e20 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f542e7fc640 1 -- 10.20.193.28:0/4132537422 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f54600cbe00 con 0x56471c640e20 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 10 client.25883 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56471c4c8b40 con 0x56471c640e20 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f542e7fc640 1 -- 10.20.193.28:0/4132537422 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f54600d2c40 con 0x56471c640e20 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 10 client.25883 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 10 client.25883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:27.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 20 client.25883 populate_metadata read hostname 'trial028' 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56471c6863d0 0x56471c7546b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 4 client.25883 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.205+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f54600d6f70 con 0x56471c6863d0 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.206+0000 7f5467fff640 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56471c6863d0 0x56471c7546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.206+0000 7f5467fff640 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56471c6863d0 0x56471c7546b0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=1800767278401892070 s_cookie=4638688974742701172 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18fd9c4c804aaee6 server_cookie=405fef0bb30f4474 in_seq=0 out_seq=0 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.206+0000 7f542e7fc640 10 client.25883 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f542e7fc640 1 -- 10.20.193.28:0/4132537422 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f54600d6f70 con 0x56471c6863d0 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f542e7fc640 10 client.25883 handle_command_reply: tid=0 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 client.25883 shutdown 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 msgr2=0x56471c6655e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6655e0 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=6303166442566871083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54600cd670 tx=0x7f5460009310 comp rx=0 tx=0).stop 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 shutdown_connections 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56471c6863d0 0x56471c7546b0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=1800767278401892070 s_cookie=4638688974742701172 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56471c641730 0x56471c65fbf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56471c683e30 0x56471c660130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 --2- 10.20.193.28:0/4132537422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56471c640e20 0x56471c6655e0 unknown :-1 s=CLOSED pgs=182 gs=2 cs=0 l=1 c_cookie=6303166442566871083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 >> 10.20.193.28:0/4132537422 conn(0x56471c616910 msgr2=0x56471c685890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f542e7fc640 0 client.25883 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 shutdown_connections 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 1 -- 10.20.193.28:0/4132537422 wait complete. 2026-02-20T13:18:27.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.207+0000 7f5478febe00 20 client.25883 trim_cache size 0 max 16384 2026-02-20T13:18:27.217 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:18:27.217 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:18:27.217 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "9dc67d71-e707-4884-aa48-2368952af421", 2026-02-20T13:18:27.217 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:18:27.217 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:18:27.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 -- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f544c0b5760 msgr2=0x7f544c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f544c0b5760 0x7f544c0d5c10 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5470168a90 tx=0x7f5458005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:27.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 -- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 msgr2=0x7f54701620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 0x7f54701620f0 secure :-1 s=READY pgs=443 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5460038820 tx=0x7f54600028d0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 -- 10.20.193.28:0/2670646033 shutdown_connections 2026-02-20T13:18:27.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f544c0b5760 0x7f544c0d5c10 unknown :-1 s=CLOSED pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5470155980 0x7f5470167a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5470061840 0x7f5470162630 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 --2- 10.20.193.28:0/2670646033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5470060f30 0x7f54701620f0 unknown :-1 s=CLOSED pgs=443 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 -- 10.20.193.28:0/2670646033 >> 10.20.193.28:0/2670646033 conn(0x7f54700eaad0 msgr2=0x7f547010aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 -- 10.20.193.28:0/2670646033 shutdown_connections 2026-02-20T13:18:27.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.208+0000 7f5475d68640 1 -- 10.20.193.28:0/2670646033 wait complete. 2026-02-20T13:18:27.310 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:18:27.533 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:27.668 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:27 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:18:27.668 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:27 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:18:27.668 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:27 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:27.669 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:27 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:18:27.669 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:27 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:27.669 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:27 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.711+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/1473704576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8119ba0 msgr2=0x7f6cf817a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.711+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/1473704576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8119ba0 0x7f6cf817a570 secure :-1 s=READY pgs=445 gs=2 cs=0 l=1 c_cookie=2790742337608250327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cf400aa30 tx=0x7f6cf4030270 comp rx=0 tx=0).stop 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.711+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/1473704576 shutdown_connections 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.711+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/1473704576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8119ba0 0x7f6cf817a570 unknown :-1 s=CLOSED pgs=445 gs=2 cs=0 l=1 c_cookie=2790742337608250327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.711+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/1473704576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cf8114990 0x7f6cf81193f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.712+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/1473704576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6cf8113fa0 0x7f6cf8114370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.712+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/1473704576 >> 10.20.193.28:0/1473704576 conn(0x7f6cf8064a90 msgr2=0x7f6cf8064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.712+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/1473704576 shutdown_connections 2026-02-20T13:18:27.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.712+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/1473704576 wait complete. 2026-02-20T13:18:27.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.712+0000 7f6cfdf8d640 1 Processor -- start 2026-02-20T13:18:27.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.712+0000 7f6cfdf8d640 1 -- start start 2026-02-20T13:18:27.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6cfdf8d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cf8113fa0 0x7f6cf8122270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6cfdf8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8114990 0x7f6cf81227b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6cfdf8d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6cf8119ba0 0x7f6cf8127b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6cfdf8d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81281a0 con 0x7f6cf8114990 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6cfdf8d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8128310 con 0x7f6cf8119ba0 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6cfdf8d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81284d0 con 0x7f6cf8113fa0 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8114990 0x7f6cf81227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cf8113fa0 0x7f6cf8122270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8114990 0x7f6cf81227b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57460/0 (socket says 10.20.193.28:57460) 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 -- 10.20.193.28:0/886312921 learned_addr learned my addr 10.20.193.28:0/886312921 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6cfd78c640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6cf8119ba0 0x7f6cf8127b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 -- 10.20.193.28:0/886312921 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cf8113fa0 msgr2=0x7f6cf8122270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cf8113fa0 0x7f6cf8122270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 -- 10.20.193.28:0/886312921 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6cf8119ba0 msgr2=0x7f6cf8127b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6cf8119ba0 0x7f6cf8127b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 -- 10.20.193.28:0/886312921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce80094b0 con 0x7f6cf8114990 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.713+0000 7f6ceffff640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8114990 0x7f6cf81227b0 secure :-1 s=READY pgs=446 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce0009480 tx=0x7f6ce000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.714+0000 7f6cedffb640 1 -- 10.20.193.28:0/886312921 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce000cd40 con 0x7f6cf8114990 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.714+0000 7f6cedffb640 1 -- 10.20.193.28:0/886312921 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ce0004d30 con 0x7f6cf8114990 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.714+0000 7f6cedffb640 1 -- 10.20.193.28:0/886312921 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce0010740 con 0x7f6cf8114990 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.714+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/886312921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf400a650 con 0x7f6cf8114990 2026-02-20T13:18:27.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.714+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/886312921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf8168d10 con 0x7f6cf8114990 2026-02-20T13:18:27.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.717+0000 7f6cedffb640 1 -- 10.20.193.28:0/886312921 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6ce001f060 con 0x7f6cf8114990 2026-02-20T13:18:27.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.718+0000 7f6cedffb640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6cd40b5760 0x7f6cd40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.719+0000 7f6cedffb640 1 -- 10.20.193.28:0/886312921 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6ce0014070 con 0x7f6cf8114990 2026-02-20T13:18:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.719+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6cd40b5760 0x7f6cd40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.719+0000 7f6d01210e00 1 Processor -- start 2026-02-20T13:18:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.719+0000 7f6d01210e00 1 -- start start 2026-02-20T13:18:27.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.719+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6cd40b5760 0x7f6cd40d5c10 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8004740 tx=0x7f6ce8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.719+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x5585744c6550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.719+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 0x55857450b400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x55857452bd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6d01210e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5585743dc7d0 con 0x55857450b940 2026-02-20T13:18:27.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6d01210e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5585743d8500 con 0x5585744c6180 2026-02-20T13:18:27.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6d01210e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5585743d24a0 con 0x5585744c6a90 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x5585744c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x5585744c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46016/0 (socket says 10.20.193.28:46016) 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/3814379893 learned_addr learned my addr 10.20.193.28:0/3814379893 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/3814379893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 msgr2=0x55857450b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 0x55857450b400 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/3814379893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 msgr2=0x55857452bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfd78c640 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x55857452bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x55857452bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/3814379893 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55857437dd80 con 0x5585744c6180 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.720+0000 7f6cfd78c640 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x55857452bd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x5585744c6550 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=213728387005080296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8009460 tx=0x7f6ce8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f750d5e9dae2e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6cc54e4640 1 -- 10.20.193.28:0/3814379893 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce8011e60 con 0x5585744c6180 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6cc54e4640 1 -- 10.20.193.28:0/3814379893 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ce8025960 con 0x5585744c6180 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6cc54e4640 1 -- 10.20.193.28:0/3814379893 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce801ac40 con 0x5585744c6180 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 -- 10.20.193.28:0/3814379893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 msgr2=0x5585744c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x5585744c6550 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=213728387005080296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8009460 tx=0x7f6ce8014000 comp rx=0 tx=0).stop 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 -- 10.20.193.28:0/3814379893 shutdown_connections 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x55857452bd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 0x55857450b400 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3814379893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x5585744c6550 unknown :-1 s=CLOSED pgs=183 gs=1 cs=0 l=1 c_cookie=213728387005080296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 -- 10.20.193.28:0/3814379893 >> 10.20.193.28:0/3814379893 conn(0x5585744a4680 msgr2=0x5585744c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 -- 10.20.193.28:0/3814379893 shutdown_connections 2026-02-20T13:18:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.721+0000 7f6d01210e00 1 -- 10.20.193.28:0/3814379893 wait complete. 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.722+0000 7f6d01210e00 1 -- start start 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6d01210e00 1 Processor -- start 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x558574523060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 0x5585745235a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x558574528590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6d01210e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558574528ad0 con 0x55857450b940 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6d01210e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558574528c40 con 0x5585744c6180 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6d01210e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558574528e00 con 0x5585744c6a90 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x558574523060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x558574523060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46018/0 (socket says 10.20.193.28:46018) 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/3678344914 learned_addr learned my addr 10.20.193.28:0/3678344914 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.723+0000 7f6ceffff640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 0x5585745235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/3678344914 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 msgr2=0x5585745235a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cfd78c640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x558574528590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 0x5585745235a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/3678344914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 msgr2=0x558574528590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x558574528590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/3678344914 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558574356350 con 0x5585744c6180 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6ceffff640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 0x5585745235a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cfd78c640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x558574528590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x558574523060 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=13382346798350904463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8002a70 tx=0x7f6ce8026d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b7a582a8caac8f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cb67fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:18:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cb67fc640 1 -- 10.20.193.28:0/3678344914 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce8026e80 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cb67fc640 1 -- 10.20.193.28:0/3678344914 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ce801ae70 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6cb67fc640 1 -- 10.20.193.28:0/3678344914 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce801be40 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.724+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce8009e20 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6cb67fc640 1 -- 10.20.193.28:0/3678344914 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6ce802f440 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 10 client.25895 _ll_register_callbacks cb 0x5585743539a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5585740686f0 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6cb67fc640 1 -- 10.20.193.28:0/3678344914 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6ce801aa40 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 10 client.25895 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x558574368150 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6cb67fc640 1 -- 10.20.193.28:0/3678344914 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f6ce8036060 con 0x5585744c6180 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 10 client.25895 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 10 client.25895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 20 client.25895 populate_metadata read hostname 'trial028' 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558574508950 0x558574508df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 4 client.25895 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585743dfd60 con 0x558574508950 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.725+0000 7f6ceffff640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558574508950 0x558574508df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.726+0000 7f6ceffff640 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558574508950 0x558574508df0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=12135293487082463775 s_cookie=2970554758179430747 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a869392186a9621f server_cookie=293987d05b21a15b in_seq=0 out_seq=0 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.726+0000 7f6cb67fc640 10 client.25895 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.726+0000 7f6cb67fc640 1 -- 10.20.193.28:0/3678344914 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5585743dfd60 con 0x558574508950 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.726+0000 7f6cb67fc640 10 client.25895 handle_command_reply: tid=0 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.726+0000 7f6d01210e00 1 client.25895 shutdown 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.726+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 msgr2=0x558574523060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.726+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x558574523060 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=13382346798350904463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8002a70 tx=0x7f6ce8026d10 comp rx=0 tx=0).stop 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 shutdown_connections 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558574508950 0x558574508df0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=12135293487082463775 s_cookie=2970554758179430747 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55857450b940 0x558574528590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6a90 0x5585745235a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 1 --2- 10.20.193.28:0/3678344914 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5585744c6180 0x558574523060 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=13382346798350904463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 >> 10.20.193.28:0/3678344914 conn(0x5585744a4680 msgr2=0x5585744c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6cb67fc640 0 client.25895 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 shutdown_connections 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 1 -- 10.20.193.28:0/3678344914 wait complete. 2026-02-20T13:18:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.727+0000 7f6d01210e00 20 client.25895 trim_cache size 0 max 16384 2026-02-20T13:18:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6d01210e00 1 Processor -- start 2026-02-20T13:18:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6d01210e00 1 -- start start 2026-02-20T13:18:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x558574520430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x558574520970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x5585745065a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6d01210e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5585743d00d0 con 0x5585744c6a90 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6d01210e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558574090700 con 0x55857450b940 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6d01210e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55857451c110 con 0x5585744c6180 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x558574520430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x558574520430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33036/0 (socket says 10.20.193.28:33036) 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/1336039456 learned_addr learned my addr 10.20.193.28:0/1336039456 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6cfd78c640 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x5585745065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/1336039456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 msgr2=0x5585745065a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x5585745065a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/1336039456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 msgr2=0x558574520970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.736+0000 7f6ceffff640 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x558574520970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x558574520970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/1336039456 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558574362bd0 con 0x5585744c6180 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6ceffff640 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x558574520970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x558574520430 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=595149943279114575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce801a800 tx=0x7f6ce8034000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84265b85d3ed94f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6cc4ce3640 1 -- 10.20.193.28:0/1336039456 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce800e710 con 0x5585744c6180 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6cc4ce3640 1 -- 10.20.193.28:0/1336039456 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5585740686f0 con 0x5585744c6180 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6cc4ce3640 1 -- 10.20.193.28:0/1336039456 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce801bcc0 con 0x5585744c6180 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 -- 10.20.193.28:0/1336039456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 msgr2=0x558574520430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x558574520430 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=595149943279114575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce801a800 tx=0x7f6ce8034000 comp rx=0 tx=0).stop 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 -- 10.20.193.28:0/1336039456 shutdown_connections 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x558574520970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x5585745065a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 --2- 10.20.193.28:0/1336039456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x558574520430 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=595149943279114575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 -- 10.20.193.28:0/1336039456 >> 10.20.193.28:0/1336039456 conn(0x5585744a4680 msgr2=0x558574508950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 -- 10.20.193.28:0/1336039456 shutdown_connections 2026-02-20T13:18:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.737+0000 7f6d01210e00 1 -- 10.20.193.28:0/1336039456 wait complete. 2026-02-20T13:18:27.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.738+0000 7f6d01210e00 1 -- start start 2026-02-20T13:18:27.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.738+0000 7f6d01210e00 1 Processor -- start 2026-02-20T13:18:27.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.738+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x5585744aa230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.738+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x5585744aa770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.738+0000 7f6d01210e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x558574506250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.738+0000 7f6d01210e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5585744c6ea0 con 0x5585744c6a90 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.738+0000 7f6d01210e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5585745067f0 con 0x55857450b940 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.738+0000 7f6d01210e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5585745069b0 con 0x5585744c6180 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x5585744aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x5585744aa230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33046/0 (socket says 10.20.193.28:33046) 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/177221063 learned_addr learned my addr 10.20.193.28:0/177221063 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6ceffff640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x5585744aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfd78c640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x558574506250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 msgr2=0x558574506250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x558574506250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/177221063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 msgr2=0x5585744aa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:27.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x5585744aa770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 -- 10.20.193.28:0/177221063 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558574356680 con 0x5585744c6180 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfd78c640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x558574506250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6ceffff640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x5585744aa770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cfcf8b640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x5585744aa230 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=15033170142611510290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8016040 tx=0x7f6ce800e5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0a08c98765e1412 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cb67fc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cb67fc640 1 -- 10.20.193.28:0/177221063 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce800e6e0 con 0x5585744c6180 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cb67fc640 1 -- 10.20.193.28:0/177221063 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ce8037e10 con 0x5585744c6180 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558574368150 con 0x5585744c6180 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.739+0000 7f6cb67fc640 1 -- 10.20.193.28:0/177221063 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ce8037540 con 0x5585744c6180 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6cb67fc640 1 -- 10.20.193.28:0/177221063 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6ce80376d0 con 0x5585744c6180 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 10 client.25846 _ll_register_callbacks cb 0x5585743539a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:27.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce8025960 con 0x5585744c6180 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6cb67fc640 1 -- 10.20.193.28:0/177221063 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6ce802e3e0 con 0x5585744c6180 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 10 client.25846 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5585743683b0 con 0x5585744c6180 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6cb67fc640 1 -- 10.20.193.28:0/177221063 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f6ce804a020 con 0x5585744c6180 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 10 client.25846 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 10 client.25846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 20 client.25846 populate_metadata read hostname 'trial028' 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585745b8ab0 0x5585745d8e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 4 client.25846 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558574065f40 con 0x5585745b8ab0 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.740+0000 7f6ceffff640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585745b8ab0 0x5585745d8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:27.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6ceffff640 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585745b8ab0 0x5585745d8e90 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=6675943774789446579 s_cookie=746979792990855789 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca5b77e14ce2bb3 server_cookie=a5dce29ff9d626d in_seq=0 out_seq=0 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6cb67fc640 10 client.25846 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6cb67fc640 1 -- 10.20.193.28:0/177221063 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x558574065f40 con 0x5585745b8ab0 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6cb67fc640 10 client.25846 handle_command_reply: tid=0 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 client.25846 shutdown 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 msgr2=0x5585744aa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x5585744aa230 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=15033170142611510290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8016040 tx=0x7f6ce800e5f0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 shutdown_connections 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5585745b8ab0 0x5585745d8e90 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=6675943774789446579 s_cookie=746979792990855789 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585744c6a90 0x5585744aa770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55857450b940 0x558574506250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 --2- 10.20.193.28:0/177221063 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5585744c6180 0x5585744aa230 unknown :-1 s=CLOSED pgs=157 gs=1 cs=0 l=1 c_cookie=15033170142611510290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 >> 10.20.193.28:0/177221063 conn(0x5585744a4680 msgr2=0x5585745094b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6cb67fc640 0 client.25846 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:27.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 shutdown_connections 2026-02-20T13:18:27.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 1 -- 10.20.193.28:0/177221063 wait complete. 2026-02-20T13:18:27.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.741+0000 7f6d01210e00 20 client.25846 trim_cache size 0 max 16384 2026-02-20T13:18:27.752 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:18:27.752 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "9dc67d71-e707-4884-aa48-2368952af421", 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:18:27.753 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:18:27.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:27.755 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:18:27.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6cd40b5760 msgr2=0x7f6cd40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6cd40b5760 0x7f6cd40d5c10 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8004740 tx=0x7f6ce8005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:27.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8114990 msgr2=0x7f6cf81227b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:27.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8114990 0x7f6cf81227b0 secure :-1 s=READY pgs=446 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce0009480 tx=0x7f6ce000ee60 comp rx=0 tx=0).stop 2026-02-20T13:18:27.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/886312921 shutdown_connections 2026-02-20T13:18:27.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6cd40b5760 0x7f6cd40d5c10 unknown :-1 s=CLOSED pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cf8114990 0x7f6cf81227b0 unknown :-1 s=CLOSED pgs=446 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6cf8119ba0 0x7f6cf8127b80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 --2- 10.20.193.28:0/886312921 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cf8113fa0 0x7f6cf8122270 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:27.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/886312921 >> 10.20.193.28:0/886312921 conn(0x7f6cf8064a90 msgr2=0x7f6cf81169a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/886312921 shutdown_connections 2026-02-20T13:18:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:27.742+0000 7f6cfdf8d640 1 -- 10.20.193.28:0/886312921 wait complete. 2026-02-20T13:18:27.842 INFO:tasks.cephfs.filesystem:scrub status for tag:9dc67d71-e707-4884-aa48-2368952af421 - {'path': '/', 'tag': '9dc67d71-e707-4884-aa48-2368952af421', 'options': 'recursive,force'} 2026-02-20T13:18:27.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:27 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:18:27.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:27 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:18:27.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:27 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:27.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:27 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:18:27.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:27 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:27.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:27 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:27.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:27 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:18:27.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:27 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:18:27.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:27 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:27.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:27 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:18:27.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:27 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:27.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:27 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:18:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:28 trial028 ceph-mon[37442]: pgmap v215: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:18:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:28 trial127 ceph-mon[43817]: pgmap v215: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:18:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:28 trial034 ceph-mon[43332]: pgmap v215: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:18:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:30 trial028 ceph-mon[37442]: pgmap v216: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:18:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:30 trial127 ceph-mon[43817]: pgmap v216: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:18:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:30 trial034 ceph-mon[43332]: pgmap v216: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:18:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:32 trial028 ceph-mon[37442]: pgmap v217: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2026-02-20T13:18:32.913 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:32 trial034 ceph-mon[43332]: pgmap v217: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2026-02-20T13:18:32.917 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:32 trial127 ceph-mon[43817]: pgmap v217: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2026-02-20T13:18:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:18:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:33 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 -- 10.20.193.28:0/1438795861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170062a40 msgr2=0x7fe170060fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 --2- 10.20.193.28:0/1438795861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170062a40 0x7fe170060fd0 secure :-1 s=READY pgs=447 gs=2 cs=0 l=1 c_cookie=4790416706512884524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c009890 tx=0x7fe15c02f120 comp rx=0 tx=0).stop 2026-02-20T13:18:33.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 -- 10.20.193.28:0/1438795861 shutdown_connections 2026-02-20T13:18:33.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 --2- 10.20.193.28:0/1438795861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe170150e50 0x7fe170171290 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 --2- 10.20.193.28:0/1438795861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe170061510 0x7fe170061980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 --2- 10.20.193.28:0/1438795861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170062a40 0x7fe170060fd0 unknown :-1 s=CLOSED pgs=447 gs=2 cs=0 l=1 c_cookie=4790416706512884524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 -- 10.20.193.28:0/1438795861 >> 10.20.193.28:0/1438795861 conn(0x7fe1700ea4c0 msgr2=0x7fe17010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:33.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 -- 10.20.193.28:0/1438795861 shutdown_connections 2026-02-20T13:18:33.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.908+0000 7fe174f89640 1 -- 10.20.193.28:0/1438795861 wait complete. 2026-02-20T13:18:33.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.909+0000 7fe174f89640 1 Processor -- start 2026-02-20T13:18:33.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.909+0000 7fe174f89640 1 -- start start 2026-02-20T13:18:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.909+0000 7fe174f89640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe170061510 0x7fe17015c6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.909+0000 7fe174f89640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe170062a40 0x7fe17015cd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe174f89640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170150e50 0x7fe17015d900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe174f89640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe17015e040 con 0x7fe170150e50 2026-02-20T13:18:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe174f89640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe17015e1b0 con 0x7fe170061510 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe174f89640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe17015e370 con 0x7fe170062a40 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe170061510 0x7fe17015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe170061510 0x7fe17015c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51412/0 (socket says 10.20.193.28:51412) 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 -- 10.20.193.28:0/2938144011 learned_addr learned my addr 10.20.193.28:0/2938144011 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16effd640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe170062a40 0x7fe17015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16ffff640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170150e50 0x7fe17015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 -- 10.20.193.28:0/2938144011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe170062a40 msgr2=0x7fe17015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe170062a40 0x7fe17015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 -- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170150e50 msgr2=0x7fe17015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170150e50 0x7fe17015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 -- 10.20.193.28:0/2938144011 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16400a650 con 0x7fe170061510 2026-02-20T13:18:33.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16ffff640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170150e50 0x7fe17015d900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:33.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe170061510 0x7fe17015c6b0 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c0023b0 tx=0x7fe15c02fb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:33.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16cff9640 1 -- 10.20.193.28:0/2938144011 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15c03d070 con 0x7fe170061510 2026-02-20T13:18:33.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16cff9640 1 -- 10.20.193.28:0/2938144011 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe15c0044f0 con 0x7fe170061510 2026-02-20T13:18:33.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe174f89640 1 -- 10.20.193.28:0/2938144011 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c0094b0 con 0x7fe170061510 2026-02-20T13:18:33.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.910+0000 7fe16cff9640 1 -- 10.20.193.28:0/2938144011 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15c041a50 con 0x7fe170061510 2026-02-20T13:18:33.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.911+0000 7fe174f89640 1 -- 10.20.193.28:0/2938144011 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17015e970 con 0x7fe170061510 2026-02-20T13:18:33.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.913+0000 7fe16cff9640 1 -- 10.20.193.28:0/2938144011 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe15c0386b0 con 0x7fe170061510 2026-02-20T13:18:33.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.914+0000 7fe16cff9640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1440b56e0 0x7fe1440d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.915+0000 7fe16cff9640 1 -- 10.20.193.28:0/2938144011 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe15c10b970 con 0x7fe170061510 2026-02-20T13:18:33.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.915+0000 7fe16effd640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1440b56e0 0x7fe1440d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.915+0000 7fe16effd640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1440b56e0 0x7fe1440d5b90 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe160004740 tx=0x7fe160005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:33.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe1787fce00 1 Processor -- start 2026-02-20T13:18:33.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe1787fce00 1 -- start start 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x5611564628a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x5611564831c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 0x5611564a3ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe1787fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561156357fd0 con 0x5611564424c0 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe1787fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561156353d00 con 0x561156462de0 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe1787fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56115634dca0 con 0x561156483700 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe16effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x5611564831c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe16f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x5611564628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe16effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x5611564831c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51416/0 (socket says 10.20.193.28:51416) 2026-02-20T13:18:33.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe16effd640 1 -- 10.20.193.28:0/3261144208 learned_addr learned my addr 10.20.193.28:0/3261144208 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.916+0000 7fe16ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 0x5611564a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe16f7fe640 1 -- 10.20.193.28:0/3261144208 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 msgr2=0x5611564a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/3261144208 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 0x5611564a3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe16f7fe640 1 -- 10.20.193.28:0/3261144208 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 msgr2=0x5611564831c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/3261144208 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x5611564831c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe16f7fe640 1 -- 10.20.193.28:0/3261144208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611562f08b0 con 0x5611564424c0 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe16effd640 1 --2- 10.20.193.28:0/3261144208 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x5611564831c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/3261144208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x5611564628a0 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=8523263507149089080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c0ce2a0 tx=0x7fe15c038f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7648b70066abe938 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe133fff640 1 -- 10.20.193.28:0/3261144208 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15c005d40 con 0x5611564424c0 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe133fff640 1 -- 10.20.193.28:0/3261144208 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe15c005b60 con 0x5611564424c0 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe133fff640 1 -- 10.20.193.28:0/3261144208 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15c005d40 con 0x5611564424c0 2026-02-20T13:18:33.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 -- 10.20.193.28:0/3261144208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 msgr2=0x5611564628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 --2- 10.20.193.28:0/3261144208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x5611564628a0 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=8523263507149089080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c0ce2a0 tx=0x7fe15c038f70 comp rx=0 tx=0).stop 2026-02-20T13:18:33.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 -- 10.20.193.28:0/3261144208 shutdown_connections 2026-02-20T13:18:33.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 --2- 10.20.193.28:0/3261144208 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 0x5611564a3ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 --2- 10.20.193.28:0/3261144208 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x5611564831c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 --2- 10.20.193.28:0/3261144208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x5611564628a0 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=8523263507149089080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 -- 10.20.193.28:0/3261144208 >> 10.20.193.28:0/3261144208 conn(0x5611563611c0 msgr2=0x561156440da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:33.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 -- 10.20.193.28:0/3261144208 shutdown_connections 2026-02-20T13:18:33.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.917+0000 7fe1787fce00 1 -- 10.20.193.28:0/3261144208 wait complete. 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe1787fce00 1 -- start start 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe1787fce00 1 Processor -- start 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x56115645b8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x56115645bf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 0x56115645c9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe1787fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56115645d000 con 0x5611564424c0 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe1787fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56115645d170 con 0x561156462de0 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe1787fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56115645d330 con 0x561156483700 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x56115645b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x56115645b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56668/0 (socket says 10.20.193.28:56668) 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16f7fe640 1 -- 10.20.193.28:0/4172652196 learned_addr learned my addr 10.20.193.28:0/4172652196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16effd640 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x56115645bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16ffff640 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 0x56115645c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16f7fe640 1 -- 10.20.193.28:0/4172652196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 msgr2=0x56115645c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 0x56115645c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16f7fe640 1 -- 10.20.193.28:0/4172652196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 msgr2=0x56115645bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x56115645bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.919+0000 7fe16f7fe640 1 -- 10.20.193.28:0/4172652196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611562f9400 con 0x5611564424c0 2026-02-20T13:18:33.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x56115645b8f0 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=10133035327237662745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c031040 tx=0x7fe15c02fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9fc5f1687c2819 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1317fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1317fa640 1 -- 10.20.193.28:0/4172652196 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15c005d40 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1317fa640 1 -- 10.20.193.28:0/4172652196 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe15c005b60 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1317fa640 1 -- 10.20.193.28:0/4172652196 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15c0cff10 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17015e970 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1787fce00 10 client.15906 _ll_register_callbacks cb 0x5611562d8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561155fed520 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1317fa640 1 -- 10.20.193.28:0/4172652196 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe15c0d79f0 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1317fa640 1 -- 10.20.193.28:0/4172652196 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe15c0d26d0 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1787fce00 10 client.15906 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5611562d1da0 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.920+0000 7fe1317fa640 1 -- 10.20.193.28:0/4172652196 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fe15c090bc0 con 0x5611564424c0 2026-02-20T13:18:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.921+0000 7fe1787fce00 10 client.15906 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.921+0000 7fe1787fce00 10 client.15906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.921+0000 7fe1787fce00 20 client.15906 populate_metadata read hostname 'trial028' 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.921+0000 7fe1787fce00 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561156461b90 0x561156462030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.921+0000 7fe1787fce00 4 client.15906 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.921+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56115637f630 con 0x561156461b90 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.921+0000 7fe16effd640 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561156461b90 0x561156462030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe16effd640 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561156461b90 0x561156462030 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=3171018573908120251 s_cookie=2900048510784818436 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c01b89799f592bb server_cookie=283f0ac164bacd04 in_seq=0 out_seq=0 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1317fa640 10 client.15906 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1317fa640 1 -- 10.20.193.28:0/4172652196 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56115637f630 con 0x561156461b90 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1317fa640 10 client.15906 handle_command_reply: tid=0 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1787fce00 1 client.15906 shutdown 2026-02-20T13:18:33.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 msgr2=0x56115645b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1787fce00 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x56115645b8f0 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=10133035327237662745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c031040 tx=0x7fe15c02fd90 comp rx=0 tx=0).stop 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 shutdown_connections 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1787fce00 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561156461b90 0x561156462030 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=3171018573908120251 s_cookie=2900048510784818436 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1787fce00 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156483700 0x56115645c9a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1787fce00 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x56115645bf40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.922+0000 7fe1787fce00 1 --2- 10.20.193.28:0/4172652196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5611564424c0 0x56115645b8f0 unknown :-1 s=CLOSED pgs=449 gs=1 cs=0 l=1 c_cookie=10133035327237662745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.923+0000 7fe1317fa640 0 client.15906 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.923+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 >> 10.20.193.28:0/4172652196 conn(0x5611563611c0 msgr2=0x561156443790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.923+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 shutdown_connections 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.923+0000 7fe1787fce00 1 -- 10.20.193.28:0/4172652196 wait complete. 2026-02-20T13:18:33.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.923+0000 7fe1787fce00 20 client.15906 trim_cache size 0 max 16384 2026-02-20T13:18:33.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe1787fce00 1 Processor -- start 2026-02-20T13:18:33.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe1787fce00 1 -- start start 2026-02-20T13:18:33.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611564424c0 0x561156448c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x56115645b6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x561156458c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe1787fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56115634b8d0 con 0x561156483700 2026-02-20T13:18:33.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe1787fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56115608cf10 con 0x561156462de0 2026-02-20T13:18:33.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe1787fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5611563b1990 con 0x5611564424c0 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x561156458c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611564424c0 0x561156448c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611564424c0 0x561156448c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:59020/0 (socket says 10.20.193.28:59020) 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x56115645b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x561156458c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56682/0 (socket says 10.20.193.28:56682) 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16f7fe640 1 -- 10.20.193.28:0/610533145 learned_addr learned my addr 10.20.193.28:0/610533145 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16ffff640 1 -- 10.20.193.28:0/610533145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611564424c0 msgr2=0x561156448c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16ffff640 1 --2- 10.20.193.28:0/610533145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611564424c0 0x561156448c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16ffff640 1 -- 10.20.193.28:0/610533145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 msgr2=0x56115645b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16ffff640 1 --2- 10.20.193.28:0/610533145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x56115645b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16ffff640 1 -- 10.20.193.28:0/610533145 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611562e3670 con 0x561156483700 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.931+0000 7fe16ffff640 1 --2- 10.20.193.28:0/610533145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x561156458c20 secure :-1 s=READY pgs=450 gs=2 cs=0 l=1 c_cookie=9276127240926490207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5611563b3c90 tx=0x7fe1640054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bb6c941ebf6e5f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1337fe640 1 -- 10.20.193.28:0/610533145 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe164003d70 con 0x561156483700 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1337fe640 1 -- 10.20.193.28:0/610533145 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe164019040 con 0x561156483700 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1337fe640 1 -- 10.20.193.28:0/610533145 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe164010860 con 0x561156483700 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 -- 10.20.193.28:0/610533145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 msgr2=0x561156458c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 --2- 10.20.193.28:0/610533145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x561156458c20 secure :-1 s=READY pgs=450 gs=2 cs=0 l=1 c_cookie=9276127240926490207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5611563b3c90 tx=0x7fe1640054f0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 -- 10.20.193.28:0/610533145 shutdown_connections 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 --2- 10.20.193.28:0/610533145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x561156458c20 unknown :-1 s=CLOSED pgs=450 gs=2 cs=0 l=1 c_cookie=9276127240926490207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 --2- 10.20.193.28:0/610533145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561156462de0 0x56115645b6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 --2- 10.20.193.28:0/610533145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5611564424c0 0x561156448c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 -- 10.20.193.28:0/610533145 >> 10.20.193.28:0/610533145 conn(0x5611563611c0 msgr2=0x56115645af90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 -- 10.20.193.28:0/610533145 shutdown_connections 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.932+0000 7fe1787fce00 1 -- 10.20.193.28:0/610533145 wait complete. 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe1787fce00 1 -- start start 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe1787fce00 1 Processor -- start 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611564424c0 0x56115643ce20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156462de0 0x56115643d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe1787fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x56115643df20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe1787fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5611563b1490 con 0x561156483700 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe1787fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561156353d00 con 0x5611564424c0 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe1787fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56115643e680 con 0x561156462de0 2026-02-20T13:18:33.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe16ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x56115643df20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe16f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611564424c0 0x56115643ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe16effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156462de0 0x56115643d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe16ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x56115643df20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56692/0 (socket says 10.20.193.28:56692) 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.933+0000 7fe16ffff640 1 -- 10.20.193.28:0/343591864 learned_addr learned my addr 10.20.193.28:0/343591864 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe16ffff640 1 -- 10.20.193.28:0/343591864 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156462de0 msgr2=0x56115643d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe16ffff640 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156462de0 0x56115643d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe16ffff640 1 -- 10.20.193.28:0/343591864 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611564424c0 msgr2=0x56115643ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe16ffff640 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611564424c0 0x56115643ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe16ffff640 1 -- 10.20.193.28:0/343591864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611562de0f0 con 0x561156483700 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe16ffff640 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x56115643df20 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=15849076346371105408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe164020040 tx=0x7fe164003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf33af70b7ee280 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1317fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:33.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1317fa640 1 -- 10.20.193.28:0/343591864 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe164010e20 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1317fa640 1 -- 10.20.193.28:0/343591864 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe164005d00 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16400abf0 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1317fa640 1 -- 10.20.193.28:0/343591864 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1640136d0 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1787fce00 10 client.15912 _ll_register_callbacks cb 0x5611562d8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5611563fdca0 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1317fa640 1 -- 10.20.193.28:0/343591864 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe164013860 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1317fa640 1 -- 10.20.193.28:0/343591864 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe164013a60 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1787fce00 10 client.15912 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5611562d20d0 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.934+0000 7fe1317fa640 1 -- 10.20.193.28:0/343591864 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fe164013bc0 con 0x561156483700 2026-02-20T13:18:33.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.935+0000 7fe1787fce00 10 client.15912 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:33.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.935+0000 7fe1787fce00 10 client.15912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:33.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.935+0000 7fe1787fce00 20 client.15912 populate_metadata read hostname 'trial028' 2026-02-20T13:18:33.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.935+0000 7fe1787fce00 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5611564406c0 0x561156440b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:33.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.935+0000 7fe1787fce00 4 client.15912 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:18:33.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.935+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561156031640 con 0x5611564406c0 2026-02-20T13:18:33.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.935+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5611564406c0 0x561156440b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:33.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.936+0000 7fe16f7fe640 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5611564406c0 0x561156440b60 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=13276134894152252136 s_cookie=8655167960738982367 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b83e4e58a41cfae8 server_cookie=781d55673b3069df in_seq=0 out_seq=0 2026-02-20T13:18:33.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.936+0000 7fe1317fa640 10 client.15912 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:33.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.938+0000 7fe1317fa640 1 -- 10.20.193.28:0/343591864 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561156031640 con 0x5611564406c0 2026-02-20T13:18:33.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1317fa640 10 client.15912 handle_command_reply: tid=0 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 client.15912 shutdown 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 msgr2=0x56115643df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x56115643df20 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=15849076346371105408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe164020040 tx=0x7fe164003d80 comp rx=0 tx=0).stop 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 shutdown_connections 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5611564406c0 0x561156440b60 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=13276134894152252136 s_cookie=8655167960738982367 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561156483700 0x56115643df20 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=15849076346371105408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561156462de0 0x56115643d4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 --2- 10.20.193.28:0/343591864 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5611564424c0 0x56115643ce20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 >> 10.20.193.28:0/343591864 conn(0x5611563611c0 msgr2=0x56115645b710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1317fa640 0 client.15912 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:33.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 shutdown_connections 2026-02-20T13:18:33.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 1 -- 10.20.193.28:0/343591864 wait complete. 2026-02-20T13:18:33.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe1787fce00 20 client.15912 trim_cache size 0 max 16384 2026-02-20T13:18:33.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:18:33.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:18:33.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:18:33.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:18:33.947 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 -- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1440b56e0 msgr2=0x7fe1440d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.947 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1440b56e0 0x7fe1440d5b90 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe160004740 tx=0x7fe160005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:33.947 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 -- 10.20.193.28:0/2938144011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe170061510 msgr2=0x7fe17015c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:33.947 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe170061510 0x7fe17015c6b0 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c0023b0 tx=0x7fe15c02fb70 comp rx=0 tx=0).stop 2026-02-20T13:18:33.947 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 -- 10.20.193.28:0/2938144011 shutdown_connections 2026-02-20T13:18:33.947 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1440b56e0 0x7fe1440d5b90 unknown :-1 s=CLOSED pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe170150e50 0x7fe17015d900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe170062a40 0x7fe17015cd00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 --2- 10.20.193.28:0/2938144011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe170061510 0x7fe17015c6b0 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:33.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.939+0000 7fe174f89640 1 -- 10.20.193.28:0/2938144011 >> 10.20.193.28:0/2938144011 conn(0x7fe1700ea4c0 msgr2=0x7fe17010a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:33.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.940+0000 7fe174f89640 1 -- 10.20.193.28:0/2938144011 shutdown_connections 2026-02-20T13:18:33.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:33.940+0000 7fe174f89640 1 -- 10.20.193.28:0/2938144011 wait complete. 2026-02-20T13:18:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:18:33.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:33 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:18:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:33 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:34 trial028 ceph-mon[37442]: pgmap v218: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2026-02-20T13:18:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:18:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:18:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:18:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:34 trial127 ceph-mon[43817]: pgmap v218: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2026-02-20T13:18:34.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:18:34.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:18:34.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:18:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:34 trial034 ceph-mon[43332]: pgmap v218: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2026-02-20T13:18:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:18:34.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:18:34.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:18:34.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:18:36.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:36 trial028 ceph-mon[37442]: pgmap v219: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:18:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:36 trial127 ceph-mon[43817]: pgmap v219: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:18:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:36 trial034 ceph-mon[43332]: pgmap v219: 97 pgs: 97 active+clean; 725 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:18:38.833 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:18:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:38 trial028 ceph-mon[37442]: pgmap v220: 97 pgs: 97 active+clean; 729 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:18:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:38 trial127 ceph-mon[43817]: pgmap v220: 97 pgs: 97 active+clean; 729 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:18:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:38 trial034 ceph-mon[43332]: pgmap v220: 97 pgs: 97 active+clean; 729 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2026-02-20T13:18:39.020 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:39.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.186+0000 7fe4e00e9640 1 -- 10.20.193.28:0/3135204995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d8115420 msgr2=0x7fe4d8175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.186+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/3135204995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d8115420 0x7fe4d8175df0 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=2060988055924569646 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d400aa30 tx=0x7fe4d4030270 comp rx=0 tx=0).stop 2026-02-20T13:18:39.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.186+0000 7fe4e00e9640 1 -- 10.20.193.28:0/3135204995 shutdown_connections 2026-02-20T13:18:39.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.186+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/3135204995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d8115420 0x7fe4d8175df0 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=2060988055924569646 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.186+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/3135204995 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4d810fc20 0x7fe4d8114c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.186+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/3135204995 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4d810f230 0x7fe4d810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.186+0000 7fe4e00e9640 1 -- 10.20.193.28:0/3135204995 >> 10.20.193.28:0/3135204995 conn(0x7fe4d805f830 msgr2=0x7fe4d810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:39.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.187+0000 7fe4e00e9640 1 -- 10.20.193.28:0/3135204995 shutdown_connections 2026-02-20T13:18:39.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.187+0000 7fe4e00e9640 1 -- 10.20.193.28:0/3135204995 wait complete. 2026-02-20T13:18:39.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4e00e9640 1 Processor -- start 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4e00e9640 1 -- start start 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4e00e9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4d810f230 0x7fe4d811db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4e00e9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d810fc20 0x7fe4d811e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4e00e9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4d8115420 0x7fe4d8123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4e00e9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8123a60 con 0x7fe4d810fc20 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4e00e9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8123bd0 con 0x7fe4d8115420 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4e00e9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8123d90 con 0x7fe4d810f230 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4dde5e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4d810f230 0x7fe4d811db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4dde5e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4d810f230 0x7fe4d811db30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:59054/0 (socket says 10.20.193.28:59054) 2026-02-20T13:18:39.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4dde5e640 1 -- 10.20.193.28:0/798931035 learned_addr learned my addr 10.20.193.28:0/798931035 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.188+0000 7fe4dd65d640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d810fc20 0x7fe4d811e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4dd65d640 1 -- 10.20.193.28:0/798931035 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4d810f230 msgr2=0x7fe4d811db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4dd65d640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4d810f230 0x7fe4d811db30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4de65f640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4d8115420 0x7fe4d8123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4dd65d640 1 -- 10.20.193.28:0/798931035 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4d8115420 msgr2=0x7fe4d8123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4dd65d640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4d8115420 0x7fe4d8123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4dd65d640 1 -- 10.20.193.28:0/798931035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d400a650 con 0x7fe4d810fc20 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4de65f640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4d8115420 0x7fe4d8123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4dd65d640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d810fc20 0x7fe4d811e070 secure :-1 s=READY pgs=453 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4cc00e7b0 tx=0x7fe4cc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4c6ffd640 1 -- 10.20.193.28:0/798931035 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4cc00cce0 con 0x7fe4d810fc20 2026-02-20T13:18:39.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d8124070 con 0x7fe4d810fc20 2026-02-20T13:18:39.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4c6ffd640 1 -- 10.20.193.28:0/798931035 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4cc00ce40 con 0x7fe4d810fc20 2026-02-20T13:18:39.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4c6ffd640 1 -- 10.20.193.28:0/798931035 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4cc00cce0 con 0x7fe4d810fc20 2026-02-20T13:18:39.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.189+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d8164770 con 0x7fe4d810fc20 2026-02-20T13:18:39.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.190+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d8110510 con 0x7fe4d810fc20 2026-02-20T13:18:39.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.192+0000 7fe4c6ffd640 1 -- 10.20.193.28:0/798931035 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe4cc004f30 con 0x7fe4d810fc20 2026-02-20T13:18:39.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.193+0000 7fe4c6ffd640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe4b40b57c0 0x7fe4b40d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.194+0000 7fe4c6ffd640 1 -- 10.20.193.28:0/798931035 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe4cc014070 con 0x7fe4d810fc20 2026-02-20T13:18:39.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.194+0000 7fe4c6ffd640 1 -- 10.20.193.28:0/798931035 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe4cc0a92f0 con 0x7fe4d810fc20 2026-02-20T13:18:39.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.194+0000 7fe4dde5e640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe4b40b57c0 0x7fe4b40d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.194+0000 7fe4dde5e640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe4b40b57c0 0x7fe4b40d5c70 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4c80095d0 tx=0x7fe4c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:39.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.335+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4d810f600 con 0x7fe4d810fc20 2026-02-20T13:18:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.336+0000 7fe4c6ffd640 1 -- 10.20.193.28:0/798931035 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12003 (secure 0 0 0) 0x7fe4cc0ac4a0 con 0x7fe4d810fc20 2026-02-20T13:18:39.339 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:18:39.339 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T13:17:23:438313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:23.339303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:18:39.340 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T13:18:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe4b40b57c0 msgr2=0x7fe4b40d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe4b40b57c0 0x7fe4b40d5c70 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4c80095d0 tx=0x7fe4c8005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d810fc20 msgr2=0x7fe4d811e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d810fc20 0x7fe4d811e070 secure :-1 s=READY pgs=453 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4cc00e7b0 tx=0x7fe4cc00ec80 comp rx=0 tx=0).stop 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 shutdown_connections 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe4b40b57c0 0x7fe4b40d5c70 unknown :-1 s=CLOSED pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d810fc20 0x7fe4d811e070 unknown :-1 s=CLOSED pgs=453 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4d8115420 0x7fe4d8123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 --2- 10.20.193.28:0/798931035 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4d810f230 0x7fe4d811db30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 >> 10.20.193.28:0/798931035 conn(0x7fe4d805f830 msgr2=0x7fe4d810cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 shutdown_connections 2026-02-20T13:18:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.337+0000 7fe4e00e9640 1 -- 10.20.193.28:0/798931035 wait complete. 2026-02-20T13:18:39.446 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id 890389b6 --release --await' 2026-02-20T13:18:39.446 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id 890389b6 --release --await 2026-02-20T13:18:39.673 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:39.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:39 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/798931035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:39.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.851+0000 7feb89cad640 1 -- 10.20.193.28:0/1185420511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410f0c0 msgr2=0x7feb8410f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.851+0000 7feb89cad640 1 --2- 10.20.193.28:0/1185420511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410f0c0 0x7feb8410f500 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=13646502567656359144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb7800aa30 tx=0x7feb78030270 comp rx=0 tx=0).stop 2026-02-20T13:18:39.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.851+0000 7feb89cad640 1 -- 10.20.193.28:0/1185420511 shutdown_connections 2026-02-20T13:18:39.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.851+0000 7feb89cad640 1 --2- 10.20.193.28:0/1185420511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410f0c0 0x7feb8410f500 unknown :-1 s=CLOSED pgs=454 gs=1 cs=0 l=1 c_cookie=13646502567656359144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.851+0000 7feb89cad640 1 --2- 10.20.193.28:0/1185420511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb8410c090 0x7feb8410ea70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.851+0000 7feb89cad640 1 --2- 10.20.193.28:0/1185420511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb8410b780 0x7feb8410bb50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.851+0000 7feb89cad640 1 -- 10.20.193.28:0/1185420511 >> 10.20.193.28:0/1185420511 conn(0x7feb840e9310 msgr2=0x7feb84109720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:39.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.852+0000 7feb89cad640 1 -- 10.20.193.28:0/1185420511 shutdown_connections 2026-02-20T13:18:39.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.852+0000 7feb89cad640 1 -- 10.20.193.28:0/1185420511 wait complete. 2026-02-20T13:18:39.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.852+0000 7feb89cad640 1 Processor -- start 2026-02-20T13:18:39.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb89cad640 1 -- start start 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb89cad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410b780 0x7feb84123050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb89cad640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb8410c090 0x7feb84123590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb89cad640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb8410f0c0 0x7feb84128960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb89cad640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feb84128f80 con 0x7feb8410b780 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb89cad640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7feb841290f0 con 0x7feb8410c090 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb89cad640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7feb841292b0 con 0x7feb8410f0c0 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410b780 0x7feb84123050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb82ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb8410c090 0x7feb84123590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410b780 0x7feb84123050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56720/0 (socket says 10.20.193.28:56720) 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 -- 10.20.193.28:0/1277114353 learned_addr learned my addr 10.20.193.28:0/1277114353 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb83fff640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb8410f0c0 0x7feb84128960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 -- 10.20.193.28:0/1277114353 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb8410f0c0 msgr2=0x7feb84128960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb8410f0c0 0x7feb84128960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 -- 10.20.193.28:0/1277114353 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb8410c090 msgr2=0x7feb84123590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb8410c090 0x7feb84123590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 -- 10.20.193.28:0/1277114353 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7800a650 con 0x7feb8410b780 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.853+0000 7feb837fe640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410b780 0x7feb84123050 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb70009480 tx=0x7feb7000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.854+0000 7feb80ff9640 1 -- 10.20.193.28:0/1277114353 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb7000cd40 con 0x7feb8410b780 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.854+0000 7feb80ff9640 1 -- 10.20.193.28:0/1277114353 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb70004d30 con 0x7feb8410b780 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.854+0000 7feb80ff9640 1 -- 10.20.193.28:0/1277114353 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb700106b0 con 0x7feb8410b780 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.854+0000 7feb89cad640 1 -- 10.20.193.28:0/1277114353 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb84129590 con 0x7feb8410b780 2026-02-20T13:18:39.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.854+0000 7feb89cad640 1 -- 10.20.193.28:0/1277114353 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb84169c90 con 0x7feb8410b780 2026-02-20T13:18:39.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.857+0000 7feb80ff9640 1 -- 10.20.193.28:0/1277114353 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7feb7001f060 con 0x7feb8410b780 2026-02-20T13:18:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.858+0000 7feb80ff9640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb580b5760 0x7feb580d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.858+0000 7feb80ff9640 1 -- 10.20.193.28:0/1277114353 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feb70014070 con 0x7feb8410b780 2026-02-20T13:18:39.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.859+0000 7feb82ffd640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb580b5760 0x7feb580d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.859+0000 7feb8bca7e00 1 Processor -- start 2026-02-20T13:18:39.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.859+0000 7feb8bca7e00 1 -- start start 2026-02-20T13:18:39.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.859+0000 7feb82ffd640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb580b5760 0x7feb580d5c10 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb841299f0 tx=0x7feb74005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:39.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.859+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696d520 0x56048696d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.859+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x5604869b2590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604869b2ad0 0x5604869d2eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560486882c70 con 0x5604869b2ad0 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56048687e9a0 con 0x56048696d520 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560486878b00 con 0x56048696de30 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb83fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604869b2ad0 0x5604869d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb837fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696d520 0x56048696d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb83fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604869b2ad0 0x5604869d2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56726/0 (socket says 10.20.193.28:56726) 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb83fff640 1 -- 10.20.193.28:0/1967682084 learned_addr learned my addr 10.20.193.28:0/1967682084 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb82ffd640 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x5604869b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb837fe640 1 -- 10.20.193.28:0/1967682084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 msgr2=0x5604869b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb837fe640 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x5604869b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb837fe640 1 -- 10.20.193.28:0/1967682084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604869b2ad0 msgr2=0x5604869d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:39.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb837fe640 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604869b2ad0 0x5604869d2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb837fe640 1 -- 10.20.193.28:0/1967682084 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560486823f80 con 0x56048696d520 2026-02-20T13:18:39.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb82ffd640 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x5604869b2590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:18:39.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb837fe640 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696d520 0x56048696d8f0 secure :-1 s=READY pgs=186 gs=2 cs=0 l=1 c_cookie=3023028854441679385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb700058d0 tx=0x7feb700a9740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f3f4b9f6c09a19 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:39.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb47fff640 1 -- 10.20.193.28:0/1967682084 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb700ac820 con 0x56048696d520 2026-02-20T13:18:39.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.860+0000 7feb47fff640 1 -- 10.20.193.28:0/1967682084 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb70016ea0 con 0x56048696d520 2026-02-20T13:18:39.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb47fff640 1 -- 10.20.193.28:0/1967682084 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb700adf30 con 0x56048696d520 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 -- 10.20.193.28:0/1967682084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696d520 msgr2=0x56048696d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696d520 0x56048696d8f0 secure :-1 s=READY pgs=186 gs=2 cs=0 l=1 c_cookie=3023028854441679385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb700058d0 tx=0x7feb700a9740 comp rx=0 tx=0).stop 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 -- 10.20.193.28:0/1967682084 shutdown_connections 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604869b2ad0 0x5604869d2eb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x5604869b2590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/1967682084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696d520 0x56048696d8f0 unknown :-1 s=CLOSED pgs=186 gs=2 cs=0 l=1 c_cookie=3023028854441679385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 -- 10.20.193.28:0/1967682084 >> 10.20.193.28:0/1967682084 conn(0x56048688ba60 msgr2=0x56048696be00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 -- 10.20.193.28:0/1967682084 shutdown_connections 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.861+0000 7feb8bca7e00 1 -- 10.20.193.28:0/1967682084 wait complete. 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.862+0000 7feb8bca7e00 1 -- start start 2026-02-20T13:18:39.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.862+0000 7feb8bca7e00 1 Processor -- start 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x560486985460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 0x5604869859a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x56048698a990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56048698aed0 con 0x56048696d520 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56048698b040 con 0x56048696de30 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56048698b200 con 0x5604869b2ad0 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb83fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x56048698a990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb83fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x56048698a990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:59090/0 (socket says 10.20.193.28:59090) 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb83fff640 1 -- 10.20.193.28:0/2161638448 learned_addr learned my addr 10.20.193.28:0/2161638448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb837fe640 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x560486985460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb82ffd640 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 0x5604869859a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb83fff640 1 -- 10.20.193.28:0/2161638448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 msgr2=0x5604869859a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb83fff640 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 0x5604869859a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb83fff640 1 -- 10.20.193.28:0/2161638448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 msgr2=0x560486985460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb83fff640 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x560486985460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.863+0000 7feb83fff640 1 -- 10.20.193.28:0/2161638448 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604867fc710 con 0x5604869b2ad0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb83fff640 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x56048698a990 secure :-1 s=READY pgs=158 gs=3 cs=0 l=1 c_cookie=8117487038713562964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb7800a230 tx=0x7feb78006f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70a71b74135c0754 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb457fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb457fa640 1 -- 10.20.193.28:0/2161638448 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb7803e040 con 0x5604869b2ad0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb457fa640 1 -- 10.20.193.28:0/2161638448 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb78039e00 con 0x5604869b2ad0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb84169c90 con 0x5604869b2ad0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb457fa640 1 -- 10.20.193.28:0/2161638448 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb78044470 con 0x5604869b2ad0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb8bca7e00 10 client.25879 _ll_register_callbacks cb 0x5604867f9d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb457fa640 1 -- 10.20.193.28:0/2161638448 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feb780050c0 con 0x5604869b2ad0 2026-02-20T13:18:39.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56048650eba0 con 0x5604869b2ad0 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb457fa640 1 -- 10.20.193.28:0/2161638448 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feb780039a0 con 0x5604869b2ad0 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb8bca7e00 10 client.25879 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56048680e350 con 0x5604869b2ad0 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.864+0000 7feb457fa640 1 -- 10.20.193.28:0/2161638448 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7feb78039920 con 0x5604869b2ad0 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.865+0000 7feb8bca7e00 10 client.25879 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.865+0000 7feb8bca7e00 10 client.25879 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.865+0000 7feb8bca7e00 20 client.25879 populate_metadata read hostname 'trial028' 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.865+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604869afdd0 0x5604869b0270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.865+0000 7feb8bca7e00 4 client.25879 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.865+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56048684b410 con 0x5604869afdd0 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.865+0000 7feb837fe640 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604869afdd0 0x5604869b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.866+0000 7feb837fe640 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604869afdd0 0x5604869b0270 crc :-1 s=READY pgs=72 gs=4 cs=0 l=0 c_cookie=4508117262081507361 s_cookie=8054963954600929740 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e900cc3cc2cc021 server_cookie=6fc8fb0a289069cc in_seq=0 out_seq=0 2026-02-20T13:18:39.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.866+0000 7feb457fa640 10 client.25879 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:39.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.866+0000 7feb457fa640 1 -- 10.20.193.28:0/2161638448 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56048684b410 con 0x5604869afdd0 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.866+0000 7feb457fa640 10 client.25879 handle_command_reply: tid=0 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.866+0000 7feb8bca7e00 1 client.25879 shutdown 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 msgr2=0x56048698a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x56048698a990 secure :-1 s=READY pgs=158 gs=3 cs=0 l=1 c_cookie=8117487038713562964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb7800a230 tx=0x7feb78006f20 comp rx=0 tx=0).stop 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 shutdown_connections 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604869afdd0 0x5604869b0270 crc :-1 s=READY pgs=72 gs=4 cs=0 l=0 c_cookie=4508117262081507361 s_cookie=8054963954600929740 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x56048698a990 unknown :-1 s=CLOSED pgs=158 gs=3 cs=0 l=1 c_cookie=8117487038713562964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 0x5604869859a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2161638448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x560486985460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb457fa640 0 client.25879 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 >> 10.20.193.28:0/2161638448 conn(0x56048688ba60 msgr2=0x56048696c510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:39.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 shutdown_connections 2026-02-20T13:18:39.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2161638448 wait complete. 2026-02-20T13:18:39.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.867+0000 7feb8bca7e00 20 client.25879 trim_cache size 0 max 16384 2026-02-20T13:18:39.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb8bca7e00 1 Processor -- start 2026-02-20T13:18:39.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb8bca7e00 1 -- start start 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x5604869a9e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 0x5604869aa3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x5604869aa8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560486876730 con 0x56048696d520 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560486536960 con 0x56048696de30 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56048697e7f0 con 0x5604869b2ad0 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.876+0000 7feb837fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x5604869a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb82ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 0x5604869aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb837fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x5604869a9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56742/0 (socket says 10.20.193.28:56742) 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb837fe640 1 -- 10.20.193.28:0/3561715521 learned_addr learned my addr 10.20.193.28:0/3561715521 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:39.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb83fff640 1 --2- 10.20.193.28:0/3561715521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x5604869aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb837fe640 1 -- 10.20.193.28:0/3561715521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 msgr2=0x5604869aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb837fe640 1 --2- 10.20.193.28:0/3561715521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x5604869aa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb837fe640 1 -- 10.20.193.28:0/3561715521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 msgr2=0x5604869aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb837fe640 1 --2- 10.20.193.28:0/3561715521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 0x5604869aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb837fe640 1 -- 10.20.193.28:0/3561715521 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560486808dd0 con 0x56048696d520 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb837fe640 1 --2- 10.20.193.28:0/3561715521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x5604869a9e60 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=12806716017122912006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb700a9030 tx=0x7feb700054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ba985d5beaa706 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb477fe640 1 -- 10.20.193.28:0/3561715521 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb700ac820 con 0x56048696d520 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb477fe640 1 -- 10.20.193.28:0/3561715521 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb700b8160 con 0x56048696d520 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb477fe640 1 -- 10.20.193.28:0/3561715521 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb700adcb0 con 0x56048696d520 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb8bca7e00 1 -- 10.20.193.28:0/3561715521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 msgr2=0x5604869a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/3561715521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x5604869a9e60 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=12806716017122912006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb700a9030 tx=0x7feb700054e0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb8bca7e00 1 -- 10.20.193.28:0/3561715521 shutdown_connections 2026-02-20T13:18:39.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/3561715521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604869b2ad0 0x5604869aa8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/3561715521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56048696de30 0x5604869aa3a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/3561715521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x5604869a9e60 unknown :-1 s=CLOSED pgs=456 gs=1 cs=0 l=1 c_cookie=12806716017122912006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.877+0000 7feb8bca7e00 1 -- 10.20.193.28:0/3561715521 >> 10.20.193.28:0/3561715521 conn(0x56048688ba60 msgr2=0x56048696b700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:39.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.878+0000 7feb8bca7e00 1 -- 10.20.193.28:0/3561715521 shutdown_connections 2026-02-20T13:18:39.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.878+0000 7feb8bca7e00 1 -- 10.20.193.28:0/3561715521 wait complete. 2026-02-20T13:18:39.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.878+0000 7feb8bca7e00 1 -- start start 2026-02-20T13:18:39.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.878+0000 7feb8bca7e00 1 Processor -- start 2026-02-20T13:18:39.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x56048698efc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x56048698f500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb8bca7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604869b2ad0 0x56048698fa40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604868dce10 con 0x56048696d520 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560486a18100 con 0x5604869b2ad0 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb8bca7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560486a182c0 con 0x56048696de30 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb837fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x56048698efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb837fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x56048698efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56750/0 (socket says 10.20.193.28:56750) 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb837fe640 1 -- 10.20.193.28:0/2793972848 learned_addr learned my addr 10.20.193.28:0/2793972848 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb82ffd640 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x56048698f500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb83fff640 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604869b2ad0 0x56048698fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb82ffd640 1 -- 10.20.193.28:0/2793972848 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604869b2ad0 msgr2=0x56048698fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb82ffd640 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604869b2ad0 0x56048698fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb82ffd640 1 -- 10.20.193.28:0/2793972848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 msgr2=0x56048698efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb82ffd640 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x56048698efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb82ffd640 1 -- 10.20.193.28:0/2793972848 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604867fca40 con 0x56048696de30 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb837fe640 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x56048698efc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb82ffd640 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x56048698f500 secure :-1 s=READY pgs=159 gs=2 cs=0 l=1 c_cookie=17245196073703192508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x56048698ba20 tx=0x7feb740047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef533e75c70a37bc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.879+0000 7feb457fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb457fa640 1 -- 10.20.193.28:0/2793972848 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb74021070 con 0x56048696de30 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb457fa640 1 -- 10.20.193.28:0/2793972848 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb74022040 con 0x56048696de30 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb457fa640 1 -- 10.20.193.28:0/2793972848 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb74026c40 con 0x56048696de30 2026-02-20T13:18:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560486823f80 con 0x56048696de30 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb457fa640 1 -- 10.20.193.28:0/2793972848 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feb74026dd0 con 0x56048696de30 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 10 client.25885 _ll_register_callbacks cb 0x5604867f9d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604865d0700 con 0x56048696de30 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb457fa640 1 -- 10.20.193.28:0/2793972848 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feb74026400 con 0x56048696de30 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 10 client.25885 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56048680e5b0 con 0x56048696de30 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb457fa640 1 -- 10.20.193.28:0/2793972848 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7feb7401b7d0 con 0x56048696de30 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 10 client.25885 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 10 client.25885 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 20 client.25885 populate_metadata read hostname 'trial028' 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560486a60460 0x560486a80910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:39.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 4 client.25885 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "890389b6", "release": true, "await": true}] 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.880+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "890389b6", "release": true, "await": true}) -- 0x7feb70016ea0 con 0x560486a60460 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.881+0000 7feb837fe640 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560486a60460 0x560486a80910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.881+0000 7feb837fe640 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560486a60460 0x560486a80910 crc :-1 s=READY pgs=73 gs=4 cs=0 l=0 c_cookie=7114958456368371705 s_cookie=754384181278212781 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62bd6904f77f97f9 server_cookie=a781c6a7d4302ad in_seq=0 out_seq=0 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.881+0000 7feb457fa640 10 client.25885 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb457fa640 1 -- 10.20.193.28:0/2793972848 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7feb70016ea0 con 0x560486a60460 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb457fa640 10 client.25885 handle_command_reply: tid=0 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 client.25885 shutdown 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 msgr2=0x56048698f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x56048698f500 secure :-1 s=READY pgs=159 gs=2 cs=0 l=1 c_cookie=17245196073703192508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x56048698ba20 tx=0x7feb740047e0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 shutdown_connections 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560486a60460 0x560486a80910 crc :-1 s=READY pgs=73 gs=4 cs=0 l=0 c_cookie=7114958456368371705 s_cookie=754384181278212781 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604869b2ad0 0x56048698fa40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56048696de30 0x56048698f500 unknown :-1 s=CLOSED pgs=159 gs=2 cs=0 l=1 c_cookie=17245196073703192508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 --2- 10.20.193.28:0/2793972848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56048696d520 0x56048698efc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb457fa640 0 client.25885 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:39.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.883+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 >> 10.20.193.28:0/2793972848 conn(0x56048688ba60 msgr2=0x56048696bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:39.891 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:18:39.891 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 26, 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 8, 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "890389b6": { 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "version": 8, 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:39.892 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:39.893 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:39.894 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:18:39.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 shutdown_connections 2026-02-20T13:18:39.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb8bca7e00 1 -- 10.20.193.28:0/2793972848 wait complete. 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb8bca7e00 20 client.25885 trim_cache size 0 max 16384 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 -- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb580b5760 msgr2=0x7feb580d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb580b5760 0x7feb580d5c10 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb841299f0 tx=0x7feb74005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 -- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410b780 msgr2=0x7feb84123050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410b780 0x7feb84123050 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb70009480 tx=0x7feb7000ee60 comp rx=0 tx=0).stop 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 -- 10.20.193.28:0/1277114353 shutdown_connections 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb580b5760 0x7feb580d5c10 unknown :-1 s=CLOSED pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb8410f0c0 0x7feb84128960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb8410c090 0x7feb84123590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 --2- 10.20.193.28:0/1277114353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb8410b780 0x7feb84123050 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 -- 10.20.193.28:0/1277114353 >> 10.20.193.28:0/1277114353 conn(0x7feb840e9310 msgr2=0x7feb841096f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:39.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 -- 10.20.193.28:0/1277114353 shutdown_connections 2026-02-20T13:18:39.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:39.884+0000 7feb89cad640 1 -- 10.20.193.28:0/1277114353 wait complete. 2026-02-20T13:18:39.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:39 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/798931035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:39.985 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '890389b6', total seconds elapsed: 31.2 2026-02-20T13:18:39.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:39 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/798931035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:40 trial028 ceph-mon[37442]: pgmap v221: 97 pgs: 97 active+clean; 729 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:18:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:40 trial127 ceph-mon[43817]: pgmap v221: 97 pgs: 97 active+clean; 729 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:18:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:40 trial034 ceph-mon[43332]: pgmap v221: 97 pgs: 97 active+clean; 729 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2026-02-20T13:18:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:42 trial028 ceph-mon[37442]: pgmap v222: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:18:42.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:42 trial127 ceph-mon[43817]: pgmap v222: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:18:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:42 trial034 ceph-mon[43332]: pgmap v222: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:18:44.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:44 trial028 ceph-mon[37442]: pgmap v223: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:18:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:44 trial127 ceph-mon[43817]: pgmap v223: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:18:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:44 trial034 ceph-mon[43332]: pgmap v223: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:18:46.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:46 trial028 ceph-mon[37442]: pgmap v224: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:18:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:46 trial127 ceph-mon[43817]: pgmap v224: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:18:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:46 trial034 ceph-mon[43332]: pgmap v224: 97 pgs: 97 active+clean; 740 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-20T13:18:47.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 -- 10.20.193.28:0/2919286865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c1100b0 msgr2=0x7f5d4c1104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 --2- 10.20.193.28:0/2919286865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c1100b0 0x7f5d4c1104a0 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=18268233040560742575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d38009980 tx=0x7f5d3802f190 comp rx=0 tx=0).stop 2026-02-20T13:18:47.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 -- 10.20.193.28:0/2919286865 shutdown_connections 2026-02-20T13:18:47.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 --2- 10.20.193.28:0/2919286865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d4c10f2f0 0x7f5d4c171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 --2- 10.20.193.28:0/2919286865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d4c10e940 0x7f5d4c10edb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 --2- 10.20.193.28:0/2919286865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c1100b0 0x7f5d4c1104a0 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=18268233040560742575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 -- 10.20.193.28:0/2919286865 >> 10.20.193.28:0/2919286865 conn(0x7f5d4c0ec320 msgr2=0x7f5d4c10c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 -- 10.20.193.28:0/2919286865 shutdown_connections 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.009+0000 7f5d51603640 1 -- 10.20.193.28:0/2919286865 wait complete. 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d51603640 1 Processor -- start 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d51603640 1 -- start start 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d51603640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c10e940 0x7f5d4c0f8200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d51603640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d4c10f2f0 0x7f5d4c171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d51603640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d4c1100b0 0x7f5d4c0f8a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d51603640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0f9650 con 0x7f5d4c10e940 2026-02-20T13:18:47.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d51603640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0f97c0 con 0x7f5d4c1100b0 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d51603640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0f9980 con 0x7f5d4c10f2f0 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c10e940 0x7f5d4c0f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c10e940 0x7f5d4c0f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38618/0 (socket says 10.20.193.28:38618) 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4bfff640 1 -- 10.20.193.28:0/4120626447 learned_addr learned my addr 10.20.193.28:0/4120626447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4b7fe640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d4c10f2f0 0x7f5d4c171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d50e02640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d4c1100b0 0x7f5d4c0f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4bfff640 1 -- 10.20.193.28:0/4120626447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d4c10f2f0 msgr2=0x7f5d4c171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d4c10f2f0 0x7f5d4c171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4bfff640 1 -- 10.20.193.28:0/4120626447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d4c1100b0 msgr2=0x7f5d4c0f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d4c1100b0 0x7f5d4c0f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.010+0000 7f5d4bfff640 1 -- 10.20.193.28:0/4120626447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d38009570 con 0x7f5d4c10e940 2026-02-20T13:18:47.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.011+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c10e940 0x7f5d4c0f8200 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d380028d0 tx=0x7f5d38002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:47.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.011+0000 7f5d497fa640 1 -- 10.20.193.28:0/4120626447 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d3803d070 con 0x7f5d4c10e940 2026-02-20T13:18:47.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.011+0000 7f5d497fa640 1 -- 10.20.193.28:0/4120626447 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d38002aa0 con 0x7f5d4c10e940 2026-02-20T13:18:47.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.011+0000 7f5d497fa640 1 -- 10.20.193.28:0/4120626447 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d38041a90 con 0x7f5d4c10e940 2026-02-20T13:18:47.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.011+0000 7f5d51603640 1 -- 10.20.193.28:0/4120626447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c0f9c00 con 0x7f5d4c10e940 2026-02-20T13:18:47.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.011+0000 7f5d51603640 1 -- 10.20.193.28:0/4120626447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c0fa020 con 0x7f5d4c10e940 2026-02-20T13:18:47.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.014+0000 7f5d497fa640 1 -- 10.20.193.28:0/4120626447 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5d38038920 con 0x7f5d4c10e940 2026-02-20T13:18:47.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.015+0000 7f5d497fa640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5d200b5760 0x7f5d200d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.015+0000 7f5d497fa640 1 -- 10.20.193.28:0/4120626447 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5d3810b390 con 0x7f5d4c10e940 2026-02-20T13:18:47.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.015+0000 7f5d4b7fe640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5d200b5760 0x7f5d200d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d54e92e00 1 Processor -- start 2026-02-20T13:18:47.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d54e92e00 1 -- start start 2026-02-20T13:18:47.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4b7fe640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5d200b5760 0x7f5d200d5c10 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d3c004740 tx=0x7f5d3c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:47.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda5298a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda529de0 0x563eda54a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda54a700 0x563eda56aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563eda41efd0 con 0x563eda5094c0 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563eda41ad00 con 0x563eda529de0 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563eda414ca0 con 0x563eda54a700 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda5298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda529de0 0x563eda54a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda5298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38626/0 (socket says 10.20.193.28:38626) 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4bfff640 1 -- 10.20.193.28:0/1917436781 learned_addr learned my addr 10.20.193.28:0/1917436781 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d50e02640 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda54a700 0x563eda56aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4bfff640 1 -- 10.20.193.28:0/1917436781 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda54a700 msgr2=0x563eda56aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda54a700 0x563eda56aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4bfff640 1 -- 10.20.193.28:0/1917436781 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda529de0 msgr2=0x563eda54a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda529de0 0x563eda54a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d4bfff640 1 -- 10.20.193.28:0/1917436781 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eda3b78b0 con 0x563eda5094c0 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.016+0000 7f5d50e02640 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda54a700 0x563eda56aae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda5298a0 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=2631478530675431570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d3810b5a0 tx=0x7f5d3802fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2484e3c80ef9d892 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d1cbfe640 1 -- 10.20.193.28:0/1917436781 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d380043b0 con 0x563eda5094c0 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d1cbfe640 1 -- 10.20.193.28:0/1917436781 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d380d7410 con 0x563eda5094c0 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d1cbfe640 1 -- 10.20.193.28:0/1917436781 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d380dc600 con 0x563eda5094c0 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1917436781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 msgr2=0x563eda5298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda5298a0 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=2631478530675431570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d3810b5a0 tx=0x7f5d3802fe20 comp rx=0 tx=0).stop 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1917436781 shutdown_connections 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda54a700 0x563eda56aae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda529de0 0x563eda54a1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1917436781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda5298a0 unknown :-1 s=CLOSED pgs=459 gs=1 cs=0 l=1 c_cookie=2631478530675431570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1917436781 >> 10.20.193.28:0/1917436781 conn(0x563eda4281c0 msgr2=0x563eda507da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:47.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1917436781 shutdown_connections 2026-02-20T13:18:47.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.017+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1917436781 wait complete. 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d54e92e00 1 -- start start 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d54e92e00 1 Processor -- start 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda5094c0 0x563eda522a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda523030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda54a700 0x563eda5239f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563eda524050 con 0x563eda54a700 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563eda5241c0 con 0x563eda5094c0 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563eda524380 con 0x563eda529de0 2026-02-20T13:18:47.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.019+0000 7f5d50e02640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda54a700 0x563eda5239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda5094c0 0x563eda522a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda5094c0 0x563eda522a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:45498/0 (socket says 10.20.193.28:45498) 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d4bfff640 1 -- 10.20.193.28:0/252625378 learned_addr learned my addr 10.20.193.28:0/252625378 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d4b7fe640 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda523030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d50e02640 1 -- 10.20.193.28:0/252625378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 msgr2=0x563eda523030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d50e02640 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda523030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d50e02640 1 -- 10.20.193.28:0/252625378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda5094c0 msgr2=0x563eda522a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d50e02640 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda5094c0 0x563eda522a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d50e02640 1 -- 10.20.193.28:0/252625378 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eda3c0400 con 0x563eda54a700 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d4b7fe640 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda523030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d50e02640 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda54a700 0x563eda5239f0 secure :-1 s=READY pgs=460 gs=3 cs=0 l=1 c_cookie=1661873962829827732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d40005820 tx=0x7f5d40003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171029906ff14e94 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:47.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d0dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d0dffb640 1 -- 10.20.193.28:0/252625378 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d40018070 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c0fa020 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d54e92e00 10 client.15948 _ll_register_callbacks cb 0x563eda39fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563eda0b4520 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d0dffb640 1 -- 10.20.193.28:0/252625378 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x563eda0b4520 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d0dffb640 1 -- 10.20.193.28:0/252625378 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d4001dcc0 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.020+0000 7f5d0dffb640 1 -- 10.20.193.28:0/252625378 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5d400103c0 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d0dffb640 1 -- 10.20.193.28:0/252625378 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5d40010620 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d54e92e00 10 client.15948 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x563eda398da0 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d0dffb640 1 -- 10.20.193.28:0/252625378 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f5d4001d3d0 con 0x563eda54a700 2026-02-20T13:18:47.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d54e92e00 10 client.15948 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d54e92e00 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d54e92e00 20 client.15948 populate_metadata read hostname 'trial028' 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563eda5270c0 0x563eda527560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d54e92e00 4 client.15948 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563eda446630 con 0x563eda5270c0 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563eda5270c0 0x563eda527560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563eda5270c0 0x563eda527560 crc :-1 s=READY pgs=74 gs=4 cs=0 l=0 c_cookie=14516143987319344793 s_cookie=814612628944157456 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c973b40bf0978e99 server_cookie=b4e15deb9c37b10 in_seq=0 out_seq=0 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.021+0000 7f5d0dffb640 10 client.15948 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d0dffb640 1 -- 10.20.193.28:0/252625378 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563eda446630 con 0x563eda5270c0 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d0dffb640 10 client.15948 handle_command_reply: tid=0 2026-02-20T13:18:47.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 client.15948 shutdown 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda54a700 msgr2=0x563eda5239f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda54a700 0x563eda5239f0 secure :-1 s=READY pgs=460 gs=3 cs=0 l=1 c_cookie=1661873962829827732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d40005820 tx=0x7f5d40003f80 comp rx=0 tx=0).stop 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 shutdown_connections 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563eda5270c0 0x563eda527560 crc :-1 s=READY pgs=74 gs=4 cs=0 l=0 c_cookie=14516143987319344793 s_cookie=814612628944157456 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda54a700 0x563eda5239f0 unknown :-1 s=CLOSED pgs=460 gs=3 cs=0 l=1 c_cookie=1661873962829827732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda523030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/252625378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda5094c0 0x563eda522a00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d0dffb640 0 client.15948 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 >> 10.20.193.28:0/252625378 conn(0x563eda4281c0 msgr2=0x563eda50a790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 shutdown_connections 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 1 -- 10.20.193.28:0/252625378 wait complete. 2026-02-20T13:18:47.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.022+0000 7f5d54e92e00 20 client.15948 trim_cache size 0 max 16384 2026-02-20T13:18:47.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d54e92e00 1 Processor -- start 2026-02-20T13:18:47.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d54e92e00 1 -- start start 2026-02-20T13:18:47.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda50fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda5485c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 0x563eda548b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563eda4128d0 con 0x563eda5094c0 2026-02-20T13:18:47.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563eda153f10 con 0x563eda54a700 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563eda41ad00 con 0x563eda529de0 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda50fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda5485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda50fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38640/0 (socket says 10.20.193.28:38640) 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4bfff640 1 -- 10.20.193.28:0/2873084356 learned_addr learned my addr 10.20.193.28:0/2873084356 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d50e02640 1 --2- 10.20.193.28:0/2873084356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 0x563eda548b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4bfff640 1 -- 10.20.193.28:0/2873084356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 msgr2=0x563eda5485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/2873084356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda5485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4bfff640 1 -- 10.20.193.28:0/2873084356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 msgr2=0x563eda548b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/2873084356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 0x563eda548b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.031+0000 7f5d4bfff640 1 -- 10.20.193.28:0/2873084356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eda3aa670 con 0x563eda5094c0 2026-02-20T13:18:47.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/2873084356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda50fdf0 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=16878717781219741338 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d38032040 tx=0x7f5d380cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3d40650dac0e9a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d0ffff640 1 -- 10.20.193.28:0/2873084356 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d38095070 con 0x563eda5094c0 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d0ffff640 1 -- 10.20.193.28:0/2873084356 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d380d71d0 con 0x563eda5094c0 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d0ffff640 1 -- 10.20.193.28:0/2873084356 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d380dc620 con 0x563eda5094c0 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 -- 10.20.193.28:0/2873084356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 msgr2=0x563eda50fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/2873084356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda50fdf0 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=16878717781219741338 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d38032040 tx=0x7f5d380cd040 comp rx=0 tx=0).stop 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 -- 10.20.193.28:0/2873084356 shutdown_connections 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/2873084356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 0x563eda548b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/2873084356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda5485c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/2873084356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda50fdf0 unknown :-1 s=CLOSED pgs=461 gs=1 cs=0 l=1 c_cookie=16878717781219741338 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 -- 10.20.193.28:0/2873084356 >> 10.20.193.28:0/2873084356 conn(0x563eda4281c0 msgr2=0x563eda51ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 -- 10.20.193.28:0/2873084356 shutdown_connections 2026-02-20T13:18:47.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.032+0000 7f5d54e92e00 1 -- 10.20.193.28:0/2873084356 wait complete. 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d54e92e00 1 -- start start 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d54e92e00 1 Processor -- start 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda52b690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda52bcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d54e92e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 0x563eda52c5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563eda52cb90 con 0x563eda5094c0 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563eda52cd00 con 0x563eda54a700 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d54e92e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563eda52cec0 con 0x563eda529de0 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda52b690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda52bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda52bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:47942/0 (socket says 10.20.193.28:47942) 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4b7fe640 1 -- 10.20.193.28:0/1288360485 learned_addr learned my addr 10.20.193.28:0/1288360485 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda52b690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38648/0 (socket says 10.20.193.28:38648) 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d50e02640 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 0x563eda52c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4bfff640 1 -- 10.20.193.28:0/1288360485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 msgr2=0x563eda52bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda52bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4bfff640 1 -- 10.20.193.28:0/1288360485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 msgr2=0x563eda52c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 0x563eda52c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.033+0000 7f5d4bfff640 1 -- 10.20.193.28:0/1288360485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eda3a50f0 con 0x563eda5094c0 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d4bfff640 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda52b690 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=4935370725781281083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d38032040 tx=0x7f5d380d7340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447df586c10e193b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d0dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:47.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d0dffb640 1 -- 10.20.193.28:0/1288360485 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d38095070 con 0x563eda5094c0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d0dffb640 1 -- 10.20.193.28:0/1288360485 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d380dc830 con 0x563eda5094c0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d0dffb640 1 -- 10.20.193.28:0/1288360485 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d380d3360 con 0x563eda5094c0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d380d7040 con 0x563eda5094c0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d0dffb640 1 -- 10.20.193.28:0/1288360485 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5d380d0a90 con 0x563eda5094c0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d0dffb640 10 client.15954 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d54e92e00 10 client.15954 _ll_register_callbacks cb 0x563eda39fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563eda4c4ca0 con 0x563eda5094c0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d0dffb640 1 -- 10.20.193.28:0/1288360485 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5d380d7410 con 0x563eda5094c0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d54e92e00 10 client.15954 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x563eda3990d0 con 0x563eda5094c0 2026-02-20T13:18:47.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d0dffb640 1 -- 10.20.193.28:0/1288360485 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f5d380d0c50 con 0x563eda5094c0 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d54e92e00 10 client.15954 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d54e92e00 10 client.15954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.034+0000 7f5d54e92e00 20 client.15954 populate_metadata read hostname 'trial028' 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.035+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563eda52e7d0 0x563eda52ec70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.035+0000 7f5d54e92e00 4 client.15954 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.035+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563eda0f8640 con 0x563eda52e7d0 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.035+0000 7f5d4b7fe640 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563eda52e7d0 0x563eda52ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.035+0000 7f5d4b7fe640 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563eda52e7d0 0x563eda52ec70 crc :-1 s=READY pgs=75 gs=4 cs=0 l=0 c_cookie=11113162243573520047 s_cookie=6257231968372012714 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a39e22e337b96af server_cookie=56d62752b00836aa in_seq=0 out_seq=0 2026-02-20T13:18:47.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.035+0000 7f5d0dffb640 10 client.15954 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:47.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d0dffb640 1 -- 10.20.193.28:0/1288360485 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563eda0f8640 con 0x563eda52e7d0 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d0dffb640 10 client.15954 handle_command_reply: tid=0 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 client.15954 shutdown 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 msgr2=0x563eda52b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda52b690 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=4935370725781281083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d38032040 tx=0x7f5d380d7340 comp rx=0 tx=0).stop 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 shutdown_connections 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563eda52e7d0 0x563eda52ec70 crc :-1 s=READY pgs=75 gs=4 cs=0 l=0 c_cookie=11113162243573520047 s_cookie=6257231968372012714 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563eda54a700 0x563eda52c5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563eda529de0 0x563eda52bcb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 --2- 10.20.193.28:0/1288360485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563eda5094c0 0x563eda52b690 unknown :-1 s=CLOSED pgs=462 gs=1 cs=0 l=1 c_cookie=4935370725781281083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 >> 10.20.193.28:0/1288360485 conn(0x563eda4281c0 msgr2=0x563eda51f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:47.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d0dffb640 0 client.15954 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:47.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 shutdown_connections 2026-02-20T13:18:47.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 1 -- 10.20.193.28:0/1288360485 wait complete. 2026-02-20T13:18:47.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d54e92e00 20 client.15954 trim_cache size 0 max 16384 2026-02-20T13:18:47.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:18:47.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:18:47.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:18:47.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:18:47.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d51603640 1 -- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5d200b5760 msgr2=0x7f5d200d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d51603640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5d200b5760 0x7f5d200d5c10 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d3c004740 tx=0x7f5d3c005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:47.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d51603640 1 -- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c10e940 msgr2=0x7f5d4c0f8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:47.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.039+0000 7f5d51603640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c10e940 0x7f5d4c0f8200 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d380028d0 tx=0x7f5d38002900 comp rx=0 tx=0).stop 2026-02-20T13:18:47.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.040+0000 7f5d51603640 1 -- 10.20.193.28:0/4120626447 shutdown_connections 2026-02-20T13:18:47.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.040+0000 7f5d51603640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5d200b5760 0x7f5d200d5c10 unknown :-1 s=CLOSED pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.040+0000 7f5d51603640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5d4c1100b0 0x7f5d4c0f8a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.040+0000 7f5d51603640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5d4c10f2f0 0x7f5d4c171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.040+0000 7f5d51603640 1 --2- 10.20.193.28:0/4120626447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d4c10e940 0x7f5d4c0f8200 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:47.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.040+0000 7f5d51603640 1 -- 10.20.193.28:0/4120626447 >> 10.20.193.28:0/4120626447 conn(0x7f5d4c0ec320 msgr2=0x7f5d4c0ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:47.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.040+0000 7f5d51603640 1 -- 10.20.193.28:0/4120626447 shutdown_connections 2026-02-20T13:18:47.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:18:47.040+0000 7f5d51603640 1 -- 10.20.193.28:0/4120626447 wait complete. 2026-02-20T13:18:48.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:48 trial028 ceph-mon[37442]: pgmap v225: 97 pgs: 97 active+clean; 797 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 13 op/s 2026-02-20T13:18:48.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:48 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:18:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:48 trial127 ceph-mon[43817]: pgmap v225: 97 pgs: 97 active+clean; 797 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 13 op/s 2026-02-20T13:18:48.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:48 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:18:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:48 trial034 ceph-mon[43332]: pgmap v225: 97 pgs: 97 active+clean; 797 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 13 op/s 2026-02-20T13:18:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:48 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:18:49.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:49 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:18:49.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:49 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:18:49.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:49 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:18:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:50 trial028 ceph-mon[37442]: pgmap v226: 97 pgs: 97 active+clean; 797 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2026-02-20T13:18:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:50 trial127 ceph-mon[43817]: pgmap v226: 97 pgs: 97 active+clean; 797 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2026-02-20T13:18:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:50 trial034 ceph-mon[43332]: pgmap v226: 97 pgs: 97 active+clean; 797 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2026-02-20T13:18:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:52 trial028 ceph-mon[37442]: pgmap v227: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:18:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:52 trial127 ceph-mon[43817]: pgmap v227: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:18:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:52 trial034 ceph-mon[43332]: pgmap v227: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:18:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:54 trial028 ceph-mon[37442]: pgmap v228: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:18:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:54 trial127 ceph-mon[43817]: pgmap v228: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:18:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:54 trial034 ceph-mon[43332]: pgmap v228: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:18:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:56 trial028 ceph-mon[37442]: pgmap v229: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:18:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:56 trial127 ceph-mon[43817]: pgmap v229: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:18:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:56 trial034 ceph-mon[43332]: pgmap v229: 97 pgs: 97 active+clean; 856 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:18:57.843 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:18:58.030 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:58.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 -- 10.20.193.28:0/118761429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f24153180 msgr2=0x7f9f241735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/118761429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f24153180 0x7f9f241735a0 secure :-1 s=READY pgs=187 gs=2 cs=0 l=1 c_cookie=15669251118107240102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f1800aa30 tx=0x7f9f18030270 comp rx=0 tx=0).stop 2026-02-20T13:18:58.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 -- 10.20.193.28:0/118761429 shutdown_connections 2026-02-20T13:18:58.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/118761429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f24153180 0x7f9f241735a0 unknown :-1 s=CLOSED pgs=187 gs=2 cs=0 l=1 c_cookie=15669251118107240102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/118761429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f2410e5c0 0x7f9f24152c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/118761429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f2410dbd0 0x7f9f2410dfa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 -- 10.20.193.28:0/118761429 >> 10.20.193.28:0/118761429 conn(0x7f9f240e95a0 msgr2=0x7f9f241099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:58.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 -- 10.20.193.28:0/118761429 shutdown_connections 2026-02-20T13:18:58.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.208+0000 7f9f28a2d640 1 -- 10.20.193.28:0/118761429 wait complete. 2026-02-20T13:18:58.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f28a2d640 1 Processor -- start 2026-02-20T13:18:58.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f28a2d640 1 -- start start 2026-02-20T13:18:58.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f28a2d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f2410dbd0 0x7f9f2415f8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f28a2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f2410e5c0 0x7f9f2415bb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f28a2d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f24153180 0x7f9f2415c1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f28a2d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2415c960 con 0x7f9f2410dbd0 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f28a2d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2414ec00 con 0x7f9f2410e5c0 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f28a2d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2414edc0 con 0x7f9f24153180 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f2410dbd0 0x7f9f2415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f22ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f2410e5c0 0x7f9f2415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f2410dbd0 0x7f9f2415f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46988/0 (socket says 10.20.193.28:46988) 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f237fe640 1 -- 10.20.193.28:0/3813104813 learned_addr learned my addr 10.20.193.28:0/3813104813 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.209+0000 7f9f23fff640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f24153180 0x7f9f2415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f237fe640 1 -- 10.20.193.28:0/3813104813 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f24153180 msgr2=0x7f9f2415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f237fe640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f24153180 0x7f9f2415c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f237fe640 1 -- 10.20.193.28:0/3813104813 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f2410e5c0 msgr2=0x7f9f2415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f237fe640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f2410e5c0 0x7f9f2415bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f237fe640 1 -- 10.20.193.28:0/3813104813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1800a650 con 0x7f9f2410dbd0 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f23fff640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f24153180 0x7f9f2415c1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f2410e5c0 0x7f9f2415bb20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f237fe640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f2410dbd0 0x7f9f2415f8b0 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f10009480 tx=0x7f9f1000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f20ff9640 1 -- 10.20.193.28:0/3813104813 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f1000cd40 con 0x7f9f2410dbd0 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f28a2d640 1 -- 10.20.193.28:0/3813104813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2414f040 con 0x7f9f2410dbd0 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f20ff9640 1 -- 10.20.193.28:0/3813104813 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f10004d30 con 0x7f9f2410dbd0 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f20ff9640 1 -- 10.20.193.28:0/3813104813 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f100106b0 con 0x7f9f2410dbd0 2026-02-20T13:18:58.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.210+0000 7f9f28a2d640 1 -- 10.20.193.28:0/3813104813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2414f560 con 0x7f9f2410dbd0 2026-02-20T13:18:58.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.213+0000 7f9f20ff9640 1 -- 10.20.193.28:0/3813104813 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9f1001f060 con 0x7f9f2410dbd0 2026-02-20T13:18:58.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.214+0000 7f9f20ff9640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ef80b5760 0x7f9ef80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.215+0000 7f9f20ff9640 1 -- 10.20.193.28:0/3813104813 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f10014070 con 0x7f9f2410dbd0 2026-02-20T13:18:58.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.215+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ef80b5760 0x7f9ef80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.215+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ef80b5760 0x7f9ef80d5c10 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2415f630 tx=0x7f9f14005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:58.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.215+0000 7f9f2bcb0e00 1 Processor -- start 2026-02-20T13:18:58.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.215+0000 7f9f2bcb0e00 1 -- start start 2026-02-20T13:18:58.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af09c4550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a09400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a29d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564af08da7d0 con 0x564af09c4a90 2026-02-20T13:18:58.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564af08d6500 con 0x564af09c4180 2026-02-20T13:18:58.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564af08d04a0 con 0x564af0a09940 2026-02-20T13:18:58.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af09c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a09400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af09c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52756/0 (socket says 10.20.193.28:52756) 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f237fe640 1 -- 10.20.193.28:0/615723809 learned_addr learned my addr 10.20.193.28:0/615723809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f23fff640 1 --2- 10.20.193.28:0/615723809 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a29d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f22ffd640 1 -- 10.20.193.28:0/615723809 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 msgr2=0x564af0a29d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/615723809 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a29d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f22ffd640 1 -- 10.20.193.28:0/615723809 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 msgr2=0x564af09c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/615723809 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af09c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f22ffd640 1 -- 10.20.193.28:0/615723809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af087bd80 con 0x564af09c4a90 2026-02-20T13:18:58.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/615723809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a09400 secure :-1 s=READY pgs=464 gs=2 cs=0 l=1 c_cookie=16260925548800501451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f14004010 tx=0x7f9f14014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1aa69a1ef53e6cb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.216+0000 7f9ee7fff640 1 -- 10.20.193.28:0/615723809 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f14004850 con 0x564af09c4a90 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9ee7fff640 1 -- 10.20.193.28:0/615723809 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f14004e90 con 0x564af09c4a90 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9ee7fff640 1 -- 10.20.193.28:0/615723809 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f1401a9b0 con 0x564af09c4a90 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/615723809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 msgr2=0x564af0a09400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/615723809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a09400 secure :-1 s=READY pgs=464 gs=2 cs=0 l=1 c_cookie=16260925548800501451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f14004010 tx=0x7f9f14014000 comp rx=0 tx=0).stop 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/615723809 shutdown_connections 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/615723809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a09400 unknown :-1 s=CLOSED pgs=464 gs=2 cs=0 l=1 c_cookie=16260925548800501451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/615723809 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a29d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/615723809 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af09c4550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/615723809 >> 10.20.193.28:0/615723809 conn(0x564af09a2680 msgr2=0x564af09c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:58.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/615723809 shutdown_connections 2026-02-20T13:18:58.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.217+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/615723809 wait complete. 2026-02-20T13:18:58.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.218+0000 7f9f2bcb0e00 1 -- start start 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.218+0000 7f9f2bcb0e00 1 Processor -- start 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a21170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a216b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a266a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564af0a26be0 con 0x564af09c4a90 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564af0a26d50 con 0x564af09c4180 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564af0a26f10 con 0x564af0a09940 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a21170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a216b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47006/0 (socket says 10.20.193.28:47006) 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 -- 10.20.193.28:0/2801545948 learned_addr learned my addr 10.20.193.28:0/2801545948 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f23fff640 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 -- 10.20.193.28:0/2801545948 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 msgr2=0x564af0a266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 -- 10.20.193.28:0/2801545948 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 msgr2=0x564af0a21170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a21170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 -- 10.20.193.28:0/2801545948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af0854350 con 0x564af09c4a90 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a216b0 secure :-1 s=READY pgs=465 gs=2 cs=0 l=1 c_cookie=7841324811272191572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f140092d0 tx=0x7f9f140052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd1fb5ee855fe54 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.219+0000 7f9ee57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2801545948 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f140056a0 con 0x564af09c4a90 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2801545948 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f14004720 con 0x564af09c4a90 2026-02-20T13:18:58.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2801545948 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f140249b0 con 0x564af09c4a90 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f14003d00 con 0x564af09c4a90 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2801545948 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f14024b40 con 0x564af09c4a90 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 10 client.15966 _ll_register_callbacks cb 0x564af08519a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564af05666f0 con 0x564af09c4a90 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2801545948 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9f14024d00 con 0x564af09c4a90 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 10 client.15966 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x564af0866150 con 0x564af09c4a90 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2801545948 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f9f14034030 con 0x564af09c4a90 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 10 client.15966 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 10 client.15966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 20 client.15966 populate_metadata read hostname 'trial028' 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564af0a069d0 0x564af0a06e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 4 client.15966 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.220+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564af08ddd60 con 0x564af0a069d0 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.221+0000 7f9f237fe640 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564af0a069d0 0x564af0a06e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.221+0000 7f9f237fe640 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564af0a069d0 0x564af0a06e70 crc :-1 s=READY pgs=76 gs=4 cs=0 l=0 c_cookie=4864837804283542059 s_cookie=4419346226977958340 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=438360353e363a2b server_cookie=3d54abfa8e7be9c4 in_seq=0 out_seq=0 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.221+0000 7f9ee57fa640 10 client.15966 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2801545948 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x7f9f100c4e90 con 0x564af0a069d0 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9ee57fa640 10 client.15966 handle_command_reply: tid=0 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 client.15966 shutdown 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 msgr2=0x564af0a216b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a216b0 secure :-1 s=READY pgs=465 gs=2 cs=0 l=1 c_cookie=7841324811272191572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f140092d0 tx=0x7f9f140052b0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 shutdown_connections 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564af0a069d0 0x564af0a06e70 crc :-1 s=READY pgs=76 gs=4 cs=0 l=0 c_cookie=4864837804283542059 s_cookie=4419346226977958340 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a216b0 unknown :-1 s=CLOSED pgs=465 gs=2 cs=0 l=1 c_cookie=7841324811272191572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a266a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2801545948 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a21170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 >> 10.20.193.28:0/2801545948 conn(0x564af09a2680 msgr2=0x564af09c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9ee57fa640 0 client.15966 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 shutdown_connections 2026-02-20T13:18:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2801545948 wait complete. 2026-02-20T13:18:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.222+0000 7f9f2bcb0e00 20 client.15966 trim_cache size 0 max 16384 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.231+0000 7f9f2bcb0e00 1 Processor -- start 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.231+0000 7f9f2bcb0e00 1 -- start start 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.231+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a1e570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.231+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a1eab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.231+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a08540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.231+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564af08ce0d0 con 0x564af09c4a90 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.231+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564af058e700 con 0x564af09c4180 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.231+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564af09a23f0 con 0x564af0a09940 2026-02-20T13:18:58.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a1e570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a1eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a1e570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52778/0 (socket says 10.20.193.28:52778) 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 -- 10.20.193.28:0/2419519546 learned_addr learned my addr 10.20.193.28:0/2419519546 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f23fff640 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a08540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 -- 10.20.193.28:0/2419519546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 msgr2=0x564af0a08540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a08540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 -- 10.20.193.28:0/2419519546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 msgr2=0x564af0a1eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a1eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 -- 10.20.193.28:0/2419519546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af0a13940 con 0x564af09c4180 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a1eab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:58.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f23fff640 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a08540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9f237fe640 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a1e570 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=1424114422979083945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f100ad010 tx=0x7f9f10005580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13c37885bd2dbea9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9ee77fe640 1 -- 10.20.193.28:0/2419519546 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f100b2d50 con 0x564af09c4180 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9ee77fe640 1 -- 10.20.193.28:0/2419519546 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f100c4e90 con 0x564af09c4180 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.232+0000 7f9ee77fe640 1 -- 10.20.193.28:0/2419519546 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f100adcc0 con 0x564af09c4180 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2419519546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 msgr2=0x564af0a1e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a1e570 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=1424114422979083945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f100ad010 tx=0x7f9f10005580 comp rx=0 tx=0).stop 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2419519546 shutdown_connections 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af09c4a90 0x564af0a1eab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af0a09940 0x564af0a08540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2419519546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4180 0x564af0a1e570 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=1424114422979083945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2419519546 >> 10.20.193.28:0/2419519546 conn(0x564af09a2680 msgr2=0x564af0a069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:58.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2419519546 shutdown_connections 2026-02-20T13:18:58.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2419519546 wait complete. 2026-02-20T13:18:58.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 -- start start 2026-02-20T13:18:58.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.233+0000 7f9f2bcb0e00 1 Processor -- start 2026-02-20T13:18:58.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af09c4180 0x564af09a8670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4a90 0x564af09a3d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f2bcb0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af0a09940 0x564af09a4340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564af09a4a40 con 0x564af0a09940 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af09c4180 0x564af09a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f2bcb0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564af09a4bb0 con 0x564af09c4a90 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f237fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af09c4180 0x564af09a8670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35086/0 (socket says 10.20.193.28:35086) 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f237fe640 1 -- 10.20.193.28:0/2244650096 learned_addr learned my addr 10.20.193.28:0/2244650096 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.234+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564af0a6f340 con 0x564af09c4180 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4a90 0x564af09a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f23fff640 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af0a09940 0x564af09a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f22ffd640 1 -- 10.20.193.28:0/2244650096 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af09c4180 msgr2=0x564af09a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af09c4180 0x564af09a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f22ffd640 1 -- 10.20.193.28:0/2244650096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af0a09940 msgr2=0x564af09a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af0a09940 0x564af09a4340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f22ffd640 1 -- 10.20.193.28:0/2244650096 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1006be70 con 0x564af09c4a90 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f237fe640 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af09c4180 0x564af09a8670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f22ffd640 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4a90 0x564af09a3d80 secure :-1 s=READY pgs=189 gs=2 cs=0 l=1 c_cookie=3500428008512389770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f14002c10 tx=0x7f9f14004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=309404ba4935828a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9ee57fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2244650096 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f14044070 con 0x564af09c4a90 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2244650096 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564af05666f0 con 0x564af09c4a90 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2244650096 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f1400fcb0 con 0x564af09c4a90 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.235+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af0866150 con 0x564af09c4a90 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2244650096 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f1400fe10 con 0x564af09c4a90 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 10 client.25973 _ll_register_callbacks cb 0x564af08519a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f14004e90 con 0x564af09c4a90 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2244650096 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9f14005170 con 0x564af09c4a90 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 10 client.25973 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:58.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x564af0860bd0 con 0x564af09c4a90 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2244650096 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f9f14034040 con 0x564af09c4a90 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 10 client.25973 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 10 client.25973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 20 client.25973 populate_metadata read hostname 'trial028' 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564af0ab6f00 0x564af0ad73b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 4 client.25973 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.236+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564af0563f40 con 0x564af0ab6f00 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9f237fe640 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564af0ab6f00 0x564af0ad73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9f237fe640 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564af0ab6f00 0x564af0ad73b0 crc :-1 s=READY pgs=77 gs=4 cs=0 l=0 c_cookie=12885787396127299110 s_cookie=7483091052203370472 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2d3835d6d5f9626 server_cookie=67d947aa347c67e8 in_seq=0 out_seq=0 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9ee57fa640 10 client.25973 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9ee57fa640 1 -- 10.20.193.28:0/2244650096 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x564af0563f40 con 0x564af0ab6f00 2026-02-20T13:18:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9ee57fa640 10 client.25973 handle_command_reply: tid=0 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9f2bcb0e00 1 client.25973 shutdown 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4a90 msgr2=0x564af09a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4a90 0x564af09a3d80 secure :-1 s=READY pgs=189 gs=2 cs=0 l=1 c_cookie=3500428008512389770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f14002c10 tx=0x7f9f14004660 comp rx=0 tx=0).stop 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 shutdown_connections 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564af0ab6f00 0x564af0ad73b0 crc :-1 s=READY pgs=77 gs=4 cs=0 l=0 c_cookie=12885787396127299110 s_cookie=7483091052203370472 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.237+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564af0a09940 0x564af09a4340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564af09c4a90 0x564af09a3d80 unknown :-1 s=CLOSED pgs=189 gs=2 cs=0 l=1 c_cookie=3500428008512389770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f2bcb0e00 1 --2- 10.20.193.28:0/2244650096 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564af09c4180 0x564af09a8670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9ee57fa640 0 client.25973 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 >> 10.20.193.28:0/2244650096 conn(0x564af09a2680 msgr2=0x564af0a1d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 shutdown_connections 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f2bcb0e00 1 -- 10.20.193.28:0/2244650096 wait complete. 2026-02-20T13:18:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f2bcb0e00 20 client.25973 trim_cache size 0 max 16384 2026-02-20T13:18:58.248 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:18:58.248 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:18:58.248 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:18:58.248 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:18:58.248 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:58.249 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:58.250 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:18:58.251 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f28a2d640 1 -- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ef80b5760 msgr2=0x7f9ef80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ef80b5760 0x7f9ef80d5c10 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2415f630 tx=0x7f9f14005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f28a2d640 1 -- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f2410dbd0 msgr2=0x7f9f2415f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.238+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f2410dbd0 0x7f9f2415f8b0 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f10009480 tx=0x7f9f1000ee60 comp rx=0 tx=0).stop 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.239+0000 7f9f28a2d640 1 -- 10.20.193.28:0/3813104813 shutdown_connections 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.239+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ef80b5760 0x7f9ef80d5c10 unknown :-1 s=CLOSED pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.239+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f24153180 0x7f9f2415c1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.239+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f2410e5c0 0x7f9f2415bb20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.239+0000 7f9f28a2d640 1 --2- 10.20.193.28:0/3813104813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f2410dbd0 0x7f9f2415f8b0 unknown :-1 s=CLOSED pgs=463 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.239+0000 7f9f28a2d640 1 -- 10.20.193.28:0/3813104813 >> 10.20.193.28:0/3813104813 conn(0x7f9f240e95a0 msgr2=0x7f9f24109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:58.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.239+0000 7f9f28a2d640 1 -- 10.20.193.28:0/3813104813 shutdown_connections 2026-02-20T13:18:58.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.239+0000 7f9f28a2d640 1 -- 10.20.193.28:0/3813104813 wait complete. 2026-02-20T13:18:58.340 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:18:58.340 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:18:58.527 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:58.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 -- 10.20.193.28:0/2093208296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 msgr2=0x7f96ac1162c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 --2- 10.20.193.28:0/2093208296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 0x7f96ac1162c0 secure :-1 s=READY pgs=466 gs=2 cs=0 l=1 c_cookie=13073186802654354206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f969c009890 tx=0x7f969c02f120 comp rx=0 tx=0).stop 2026-02-20T13:18:58.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 -- 10.20.193.28:0/2093208296 shutdown_connections 2026-02-20T13:18:58.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 --2- 10.20.193.28:0/2093208296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 0x7f96ac1162c0 unknown :-1 s=CLOSED pgs=466 gs=2 cs=0 l=1 c_cookie=13073186802654354206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 --2- 10.20.193.28:0/2093208296 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96ac116a70 0x7f96ac17a680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 --2- 10.20.193.28:0/2093208296 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f96ac113fa0 0x7f96ac114370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 -- 10.20.193.28:0/2093208296 >> 10.20.193.28:0/2093208296 conn(0x7f96ac064b80 msgr2=0x7f96ac064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:58.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 -- 10.20.193.28:0/2093208296 shutdown_connections 2026-02-20T13:18:58.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.696+0000 7f96b2a79640 1 -- 10.20.193.28:0/2093208296 wait complete. 2026-02-20T13:18:58.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b2a79640 1 Processor -- start 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b2a79640 1 -- start start 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b2a79640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96ac113fa0 0x7f96ac122420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b2a79640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 0x7f96ac122960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b2a79640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f96ac116a70 0x7f96ac127d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b2a79640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac128350 con 0x7f96ac114990 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b2a79640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac1284c0 con 0x7f96ac116a70 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b2a79640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac128680 con 0x7f96ac113fa0 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 0x7f96ac122960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96abfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96ac113fa0 0x7f96ac122420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96abfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96ac113fa0 0x7f96ac122420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35114/0 (socket says 10.20.193.28:35114) 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96abfff640 1 -- 10.20.193.28:0/1259105429 learned_addr learned my addr 10.20.193.28:0/1259105429 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 0x7f96ac122960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47040/0 (socket says 10.20.193.28:47040) 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96b0fef640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f96ac116a70 0x7f96ac127d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96ab7fe640 1 -- 10.20.193.28:0/1259105429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96ac113fa0 msgr2=0x7f96ac122420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96ab7fe640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96ac113fa0 0x7f96ac122420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.697+0000 7f96ab7fe640 1 -- 10.20.193.28:0/1259105429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f96ac116a70 msgr2=0x7f96ac127d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.698+0000 7f96ab7fe640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f96ac116a70 0x7f96ac127d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.698+0000 7f96ab7fe640 1 -- 10.20.193.28:0/1259105429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96980094b0 con 0x7f96ac114990 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.698+0000 7f96ab7fe640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 0x7f96ac122960 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f969c009230 tx=0x7f969c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.698+0000 7f96a97fa640 1 -- 10.20.193.28:0/1259105429 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f969c03d070 con 0x7f96ac114990 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.698+0000 7f96a97fa640 1 -- 10.20.193.28:0/1259105429 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f969c02fcb0 con 0x7f96ac114990 2026-02-20T13:18:58.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.698+0000 7f96a97fa640 1 -- 10.20.193.28:0/1259105429 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f969c0418c0 con 0x7f96ac114990 2026-02-20T13:18:58.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.698+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a000a650 con 0x7f96ac114990 2026-02-20T13:18:58.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.698+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c0094b0 con 0x7f96ac114990 2026-02-20T13:18:58.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.699+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ac114f90 con 0x7f96ac114990 2026-02-20T13:18:58.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.701+0000 7f96a97fa640 1 -- 10.20.193.28:0/1259105429 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f969c041a50 con 0x7f96ac114990 2026-02-20T13:18:58.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.702+0000 7f96a97fa640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96800b5760 0x7f96800d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:58.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.702+0000 7f96a97fa640 1 -- 10.20.193.28:0/1259105429 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f969c10b5a0 con 0x7f96ac114990 2026-02-20T13:18:58.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.702+0000 7f96abfff640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96800b5760 0x7f96800d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:58.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.702+0000 7f96a97fa640 1 -- 10.20.193.28:0/1259105429 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f969c0cdf50 con 0x7f96ac114990 2026-02-20T13:18:58.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.703+0000 7f96abfff640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96800b5760 0x7f96800d5c10 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9698005c70 tx=0x7f9698005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:58.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.844+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96ac123580 con 0x7f96ac114990 2026-02-20T13:18:58.848 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:58 trial028 ceph-mon[37442]: pgmap v230: 97 pgs: 97 active+clean; 917 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:18:58.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.845+0000 7f96a97fa640 1 -- 10.20.193.28:0/1259105429 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12003 (secure 0 0 0) 0x7f969c038470 con 0x7f96ac114990 2026-02-20T13:18:58.849 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:18:58.849 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T13:17:23:438313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:17:23.339303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:18:58.850 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T13:18:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96800b5760 msgr2=0x7f96800d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96800b5760 0x7f96800d5c10 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9698005c70 tx=0x7f9698005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 msgr2=0x7f96ac122960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 0x7f96ac122960 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f969c009230 tx=0x7f969c0028d0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 shutdown_connections 2026-02-20T13:18:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96800b5760 0x7f96800d5c10 unknown :-1 s=CLOSED pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96ac114990 0x7f96ac122960 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f96ac116a70 0x7f96ac127d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 --2- 10.20.193.28:0/1259105429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96ac113fa0 0x7f96ac122420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 >> 10.20.193.28:0/1259105429 conn(0x7f96ac064b80 msgr2=0x7f96ac1152b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 shutdown_connections 2026-02-20T13:18:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:58.846+0000 7f96b2a79640 1 -- 10.20.193.28:0/1259105429 wait complete. 2026-02-20T13:18:58.949 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:18:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:58 trial127 ceph-mon[43817]: pgmap v230: 97 pgs: 97 active+clean; 917 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:18:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:58 trial034 ceph-mon[43332]: pgmap v230: 97 pgs: 97 active+clean; 917 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:18:59.135 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 -- 10.20.193.28:0/3240036636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c6010ffe0 msgr2=0x7f0c60115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 --2- 10.20.193.28:0/3240036636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c6010ffe0 0x7f0c60115030 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=8854857976219393775 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c48009950 tx=0x7f0c4802f190 comp rx=0 tx=0).stop 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 -- 10.20.193.28:0/3240036636 shutdown_connections 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 --2- 10.20.193.28:0/3240036636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c6010ffe0 0x7f0c60115030 unknown :-1 s=CLOSED pgs=468 gs=1 cs=0 l=1 c_cookie=8854857976219393775 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 --2- 10.20.193.28:0/3240036636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c601157e0 0x7f0c601761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 --2- 10.20.193.28:0/3240036636 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0c6010f5f0 0x7f0c6010f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 -- 10.20.193.28:0/3240036636 >> 10.20.193.28:0/3240036636 conn(0x7f0c600ecea0 msgr2=0x7f0c6010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 -- 10.20.193.28:0/3240036636 shutdown_connections 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 -- 10.20.193.28:0/3240036636 wait complete. 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 Processor -- start 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.309+0000 7f0c66eed640 1 -- start start 2026-02-20T13:18:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c66eed640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0c6010f5f0 0x7f0c600f4e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c66eed640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c6010ffe0 0x7f0c601760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c66eed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c601157e0 0x7f0c600f5500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c66eed640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0c600fa710 con 0x7f0c601157e0 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c66eed640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0c600fa880 con 0x7f0c6010f5f0 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c66eed640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0c600faa40 con 0x7f0c6010ffe0 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c64c62640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0c6010f5f0 0x7f0c600f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c601157e0 0x7f0c600f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c601157e0 0x7f0c600f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47052/0 (socket says 10.20.193.28:47052) 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 -- 10.20.193.28:0/4202266984 learned_addr learned my addr 10.20.193.28:0/4202266984 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c57fff640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c6010ffe0 0x7f0c601760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 -- 10.20.193.28:0/4202266984 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c6010ffe0 msgr2=0x7f0c601760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c6010ffe0 0x7f0c601760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 -- 10.20.193.28:0/4202266984 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0c6010f5f0 msgr2=0x7f0c600f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0c6010f5f0 0x7f0c600f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 -- 10.20.193.28:0/4202266984 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c48009570 con 0x7f0c601157e0 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.310+0000 7f0c65463640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c601157e0 0x7f0c600f5500 secure :-1 s=READY pgs=469 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c00f8d0 tx=0x7f0c5c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.311+0000 7f0c55ffb640 1 -- 10.20.193.28:0/4202266984 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5c00dce0 con 0x7f0c601157e0 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.311+0000 7f0c55ffb640 1 -- 10.20.193.28:0/4202266984 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c5c00de40 con 0x7f0c601157e0 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.311+0000 7f0c55ffb640 1 -- 10.20.193.28:0/4202266984 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5c0116b0 con 0x7f0c601157e0 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.311+0000 7f0c66eed640 1 -- 10.20.193.28:0/4202266984 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c600fad20 con 0x7f0c601157e0 2026-02-20T13:18:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.311+0000 7f0c66eed640 1 -- 10.20.193.28:0/4202266984 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c600fb1a0 con 0x7f0c601157e0 2026-02-20T13:18:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.313+0000 7f0c55ffb640 1 -- 10.20.193.28:0/4202266984 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0c5c020060 con 0x7f0c601157e0 2026-02-20T13:18:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.315+0000 7f0c55ffb640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0c3c0b5750 0x7f0c3c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.315+0000 7f0c55ffb640 1 -- 10.20.193.28:0/4202266984 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0c5c015070 con 0x7f0c601157e0 2026-02-20T13:18:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.315+0000 7f0c64c62640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0c3c0b5750 0x7f0c3c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c64c62640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0c3c0b5750 0x7f0c3c0d5c00 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c50004740 tx=0x7f0c50005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c68ee7e00 1 Processor -- start 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c68ee7e00 1 -- start start 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddbdc140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc41910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5634ddae9780 con 0x5634ddbdbd70 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5634ddae54b0 con 0x5634ddbdc680 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5634ddadf450 con 0x5634ddc21530 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c64c62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddbdc140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.316+0000 7f0c57fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c57fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52820/0 (socket says 10.20.193.28:52820) 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c57fff640 1 -- 10.20.193.28:0/1880493284 learned_addr learned my addr 10.20.193.28:0/1880493284 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c65463640 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc41910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c64c62640 1 -- 10.20.193.28:0/1880493284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 msgr2=0x5634ddc41910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc41910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c64c62640 1 -- 10.20.193.28:0/1880493284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 msgr2=0x5634ddc20ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c64c62640 1 -- 10.20.193.28:0/1880493284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dda8ad10 con 0x5634ddbdbd70 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c65463640 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc41910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c57fff640 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddbdc140 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=11939386218487714490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c50011cb0 tx=0x7f0c50014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b13882152792ba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c2d4e4640 1 -- 10.20.193.28:0/1880493284 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c50004050 con 0x5634ddbdbd70 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c2d4e4640 1 -- 10.20.193.28:0/1880493284 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c500036b0 con 0x5634ddbdbd70 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c2d4e4640 1 -- 10.20.193.28:0/1880493284 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5001a750 con 0x5634ddbdbd70 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1880493284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 msgr2=0x5634ddbdc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.317+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddbdc140 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=11939386218487714490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c50011cb0 tx=0x7f0c50014000 comp rx=0 tx=0).stop 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.318+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1880493284 shutdown_connections 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.318+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc41910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.318+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.318+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1880493284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddbdc140 unknown :-1 s=CLOSED pgs=470 gs=1 cs=0 l=1 c_cookie=11939386218487714490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.318+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1880493284 >> 10.20.193.28:0/1880493284 conn(0x5634ddbb1860 msgr2=0x5634ddbd1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.318+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1880493284 shutdown_connections 2026-02-20T13:18:59.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.318+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1880493284 wait complete. 2026-02-20T13:18:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.319+0000 7f0c68ee7e00 1 -- start start 2026-02-20T13:18:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.319+0000 7f0c68ee7e00 1 Processor -- start 2026-02-20T13:18:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddc391c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc39700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc3b490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc3ba00 con 0x5634ddbdbd70 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc3bb70 con 0x5634ddbdc680 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc3bd30 con 0x5634ddc21530 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c65463640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc3b490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c65463640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc3b490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35152/0 (socket says 10.20.193.28:35152) 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c65463640 1 -- 10.20.193.28:0/1926956835 learned_addr learned my addr 10.20.193.28:0/1926956835 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c57fff640 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc39700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddc391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c65463640 1 -- 10.20.193.28:0/1926956835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 msgr2=0x5634ddc39700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c65463640 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc39700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c65463640 1 -- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 msgr2=0x5634ddc391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c65463640 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddc391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c65463640 1 -- 10.20.193.28:0/1926956835 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c50009d00 con 0x5634ddc21530 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.320+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddc391c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c65463640 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc3b490 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=14550339732259778767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c0e5750 tx=0x7f0c5c0ad780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9ed30e53e98b0cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c1e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/1926956835 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5c0b6280 con 0x5634ddc21530 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/1926956835 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c5c0b90c0 con 0x5634ddc21530 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c60176a20 con 0x5634ddc21530 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/1926956835 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5c0aec10 con 0x5634ddc21530 2026-02-20T13:18:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/1926956835 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0c5c0aeda0 con 0x5634ddc21530 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c1e7fc640 10 client.25939 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c68ee7e00 10 client.25939 _ll_register_callbacks cb 0x5634dda60a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634dd7756f0 con 0x5634ddc21530 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/1926956835 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0c5c073300 con 0x5634ddc21530 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c68ee7e00 10 client.25939 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.321+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5634dda633c0 con 0x5634ddc21530 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/1926956835 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f0c5c0b8040 con 0x5634ddc21530 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c68ee7e00 10 client.25939 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c68ee7e00 10 client.25939 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c68ee7e00 20 client.25939 populate_metadata read hostname 'trial028' 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5634ddc41640 0x5634ddc1f2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c68ee7e00 4 client.25939 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634dda81f80 con 0x5634ddc41640 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5634ddc41640 0x5634ddc1f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5634ddc41640 0x5634ddc1f2b0 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=7651509209035305862 s_cookie=18008325370751646464 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a2f9f16102df386 server_cookie=f9ea6c83334e7b00 in_seq=0 out_seq=0 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.322+0000 7f0c1e7fc640 10 client.25939 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/1926956835 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5634dda81f80 con 0x5634ddc41640 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c1e7fc640 10 client.25939 handle_command_reply: tid=0 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 client.25939 shutdown 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 msgr2=0x5634ddc3b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc3b490 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=14550339732259778767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c0e5750 tx=0x7f0c5c0ad780 comp rx=0 tx=0).stop 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 shutdown_connections 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5634ddc41640 0x5634ddc1f2b0 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=7651509209035305862 s_cookie=18008325370751646464 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc21530 0x5634ddc3b490 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=14550339732259778767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc39700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c1e7fc640 0 client.25939 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:18:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1926956835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddbdbd70 0x5634ddc391c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 >> 10.20.193.28:0/1926956835 conn(0x5634ddbb1860 msgr2=0x5634ddbd1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 shutdown_connections 2026-02-20T13:18:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.323+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1926956835 wait complete. 2026-02-20T13:18:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.324+0000 7f0c68ee7e00 20 client.25939 trim_cache size 0 max 16384 2026-02-20T13:18:59.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c68ee7e00 1 Processor -- start 2026-02-20T13:18:59.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c68ee7e00 1 -- start start 2026-02-20T13:18:59.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc20830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc36350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5634ddadd080 con 0x5634ddc21530 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5634dd79d700 con 0x5634ddbdc680 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5634ddbdca50 con 0x5634ddbdbd70 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c64c62640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc20830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c64c62640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc20830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35158/0 (socket says 10.20.193.28:35158) 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c64c62640 1 -- 10.20.193.28:0/1358207274 learned_addr learned my addr 10.20.193.28:0/1358207274 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c65463640 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc36350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.331+0000 7f0c64c62640 1 -- 10.20.193.28:0/1358207274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 msgr2=0x5634ddc20d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c57fff640 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c64c62640 1 -- 10.20.193.28:0/1358207274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 msgr2=0x5634ddc36350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc36350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c64c62640 1 -- 10.20.193.28:0/1358207274 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dda750e0 con 0x5634ddbdbd70 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c65463640 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc36350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c64c62640 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc20830 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=9404152260717792340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c50011cb0 tx=0x7f0c50009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828242a7e1c54c54 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c2cce3640 1 -- 10.20.193.28:0/1358207274 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c50003820 con 0x5634ddbdbd70 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c2cce3640 1 -- 10.20.193.28:0/1358207274 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c50004000 con 0x5634ddbdbd70 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.332+0000 7f0c2cce3640 1 -- 10.20.193.28:0/1358207274 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c50005410 con 0x5634ddbdbd70 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1358207274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 msgr2=0x5634ddc20830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc20830 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=9404152260717792340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c50011cb0 tx=0x7f0c50009a20 comp rx=0 tx=0).stop 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1358207274 shutdown_connections 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc36350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc20d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/1358207274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc20830 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=9404152260717792340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1358207274 >> 10.20.193.28:0/1358207274 conn(0x5634ddbb1860 msgr2=0x5634ddc23910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1358207274 shutdown_connections 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/1358207274 wait complete. 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.333+0000 7f0c68ee7e00 1 -- start start 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c68ee7e00 1 Processor -- start 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc1ca50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc202e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c68ee7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc209d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc210d0 con 0x5634ddc21530 2026-02-20T13:18:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5634ddbb4c60 con 0x5634ddbdc680 2026-02-20T13:18:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c68ee7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5634ddbb4e20 con 0x5634ddbdbd70 2026-02-20T13:18:59.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c57fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c64c62640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc1ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c65463640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c57fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc202e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52842/0 (socket says 10.20.193.28:52842) 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c57fff640 1 -- 10.20.193.28:0/788549837 learned_addr learned my addr 10.20.193.28:0/788549837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c65463640 1 -- 10.20.193.28:0/788549837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 msgr2=0x5634ddc1ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c65463640 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc1ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c65463640 1 -- 10.20.193.28:0/788549837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 msgr2=0x5634ddc202e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c65463640 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc202e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.334+0000 7f0c65463640 1 -- 10.20.193.28:0/788549837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dda6fb60 con 0x5634ddc21530 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c64c62640 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc1ca50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:18:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c65463640 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc209d0 secure :-1 s=READY pgs=471 gs=2 cs=0 l=1 c_cookie=1257172659823667367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c0adcb0 tx=0x7f0c5c0065a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11725fdf921f68a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c1e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/788549837 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5c0adb20 con 0x5634ddc21530 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/788549837 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5634dd7756f0 con 0x5634ddc21530 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/788549837 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5c0b6280 con 0x5634ddc21530 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c50029040 con 0x5634ddc21530 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/788549837 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0c5c0b90c0 con 0x5634ddc21530 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c1e7fc640 10 client.15996 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c68ee7e00 10 client.15996 _ll_register_callbacks cb 0x5634dda60a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c500036b0 con 0x5634ddc21530 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/788549837 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0c5c0e5520 con 0x5634ddc21530 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c68ee7e00 10 client.15996 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5634dda636f0 con 0x5634ddc21530 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/788549837 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f0c5c0b8040 con 0x5634ddc21530 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.335+0000 7f0c68ee7e00 10 client.15996 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c68ee7e00 10 client.15996 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c68ee7e00 20 client.15996 populate_metadata read hostname 'trial028' 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5634ddbb64e0 0x5634ddbb6980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c68ee7e00 4 client.15996 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634dd772f40 con 0x5634ddbb64e0 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c64c62640 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5634ddbb64e0 0x5634ddbb6980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c64c62640 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5634ddbb64e0 0x5634ddbb6980 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=10380620562136672278 s_cookie=5433447989915152678 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=900f5f670245a816 server_cookie=4b677c28c073f126 in_seq=0 out_seq=0 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c1e7fc640 10 client.15996 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c1e7fc640 1 -- 10.20.193.28:0/788549837 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634dd772f40 con 0x5634ddbb64e0 2026-02-20T13:18:59.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c1e7fc640 10 client.15996 handle_command_reply: tid=0 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c68ee7e00 1 client.15996 shutdown 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 msgr2=0x5634ddc209d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.336+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc209d0 secure :-1 s=READY pgs=471 gs=2 cs=0 l=1 c_cookie=1257172659823667367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c0adcb0 tx=0x7f0c5c0065a0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 shutdown_connections 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5634ddbb64e0 0x5634ddbb6980 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=10380620562136672278 s_cookie=5433447989915152678 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc21530 0x5634ddc209d0 unknown :-1 s=CLOSED pgs=471 gs=2 cs=0 l=1 c_cookie=1257172659823667367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddbdc680 0x5634ddc202e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 1 --2- 10.20.193.28:0/788549837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddbdbd70 0x5634ddc1ca50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 >> 10.20.193.28:0/788549837 conn(0x5634ddbb1860 msgr2=0x5634ddc3d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c1e7fc640 0 client.15996 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:18:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 shutdown_connections 2026-02-20T13:18:59.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 1 -- 10.20.193.28:0/788549837 wait complete. 2026-02-20T13:18:59.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c68ee7e00 20 client.15996 trim_cache size 0 max 16384 2026-02-20T13:18:59.347 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c66eed640 1 -- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0c3c0b5750 msgr2=0x7f0c3c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c66eed640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0c3c0b5750 0x7f0c3c0d5c00 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c50004740 tx=0x7f0c50005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c66eed640 1 -- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c601157e0 msgr2=0x7f0c600f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.337+0000 7f0c66eed640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c601157e0 0x7f0c600f5500 secure :-1 s=READY pgs=469 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c00f8d0 tx=0x7f0c5c00fda0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.338+0000 7f0c66eed640 1 -- 10.20.193.28:0/4202266984 shutdown_connections 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.338+0000 7f0c66eed640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0c3c0b5750 0x7f0c3c0d5c00 unknown :-1 s=CLOSED pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.338+0000 7f0c66eed640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c601157e0 0x7f0c600f5500 unknown :-1 s=CLOSED pgs=469 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.338+0000 7f0c66eed640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c6010ffe0 0x7f0c601760b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.338+0000 7f0c66eed640 1 --2- 10.20.193.28:0/4202266984 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0c6010f5f0 0x7f0c600f4e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.338+0000 7f0c66eed640 1 -- 10.20.193.28:0/4202266984 >> 10.20.193.28:0/4202266984 conn(0x7f0c600ecea0 msgr2=0x7f0c6010db60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.338+0000 7f0c66eed640 1 -- 10.20.193.28:0/4202266984 shutdown_connections 2026-02-20T13:18:59.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.338+0000 7f0c66eed640 1 -- 10.20.193.28:0/4202266984 wait complete. 2026-02-20T13:18:59.437 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:18:59.623 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:18:59.700 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:18:59 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1259105429' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:59.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 -- 10.20.193.28:0/2558694954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69c10bb40 msgr2=0x7fd69c1109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/2558694954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69c10bb40 0x7fd69c1109d0 secure :-1 s=READY pgs=472 gs=2 cs=0 l=1 c_cookie=8988019417659523770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd690009950 tx=0x7fd69002f190 comp rx=0 tx=0).stop 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 -- 10.20.193.28:0/2558694954 shutdown_connections 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/2558694954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69c10bb40 0x7fd69c1109d0 unknown :-1 s=CLOSED pgs=472 gs=2 cs=0 l=1 c_cookie=8988019417659523770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/2558694954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd69c111160 0x7fd69c111b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/2558694954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd69c10b150 0x7fd69c10b520 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 -- 10.20.193.28:0/2558694954 >> 10.20.193.28:0/2558694954 conn(0x7fd69c0e8ce0 msgr2=0x7fd69c1090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 -- 10.20.193.28:0/2558694954 shutdown_connections 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.813+0000 7fd6a24b6640 1 -- 10.20.193.28:0/2558694954 wait complete. 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.814+0000 7fd6a24b6640 1 Processor -- start 2026-02-20T13:18:59.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.814+0000 7fd6a24b6640 1 -- start start 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.814+0000 7fd6a24b6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd69c10b150 0x7fd69c0f1130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.814+0000 7fd6a24b6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd69c10bb40 0x7fd69c0f1670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.814+0000 7fd6a24b6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69c111160 0x7fd69c0f6a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.814+0000 7fd6a24b6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0f7060 con 0x7fd69c111160 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.814+0000 7fd6a24b6640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0f71d0 con 0x7fd69c10bb40 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.814+0000 7fd6a24b6640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0f7390 con 0x7fd69c10b150 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd69c10bb40 0x7fd69c0f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd69c10bb40 0x7fd69c0f1670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52860/0 (socket says 10.20.193.28:52860) 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/1823556699 learned_addr learned my addr 10.20.193.28:0/1823556699 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd69c10b150 0x7fd69c0f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a1cb5640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69c111160 0x7fd69c0f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/1823556699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd69c10b150 msgr2=0x7fd69c0f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd69c10b150 0x7fd69c0f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69c111160 msgr2=0x7fd69c0f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69c111160 0x7fd69c0f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/1823556699 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd690009570 con 0x7fd69c10bb40 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd69c10bb40 0x7fd69c0f1670 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd690038820 tx=0x7fd690004290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd68a7fc640 1 -- 10.20.193.28:0/1823556699 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd69003d070 con 0x7fd69c10bb40 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd68a7fc640 1 -- 10.20.193.28:0/1823556699 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd690002ad0 con 0x7fd69c10bb40 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd68a7fc640 1 -- 10.20.193.28:0/1823556699 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd690041960 con 0x7fd69c10bb40 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a24b6640 1 -- 10.20.193.28:0/1823556699 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c0f7610 con 0x7fd69c10bb40 2026-02-20T13:18:59.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.815+0000 7fd6a24b6640 1 -- 10.20.193.28:0/1823556699 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c0f7bb0 con 0x7fd69c10bb40 2026-02-20T13:18:59.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.818+0000 7fd68a7fc640 1 -- 10.20.193.28:0/1823556699 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd69002f9f0 con 0x7fd69c10bb40 2026-02-20T13:18:59.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.819+0000 7fd68a7fc640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6780b5760 0x7fd6780d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.819+0000 7fd68a7fc640 1 -- 10.20.193.28:0/1823556699 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd69010af70 con 0x7fd69c10bb40 2026-02-20T13:18:59.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.820+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6780b5760 0x7fd6780d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.820+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6780b5760 0x7fd6780d5c10 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c004740 tx=0x7fd68c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a5739e00 1 Processor -- start 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a5739e00 1 -- start start 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f64730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa95e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc9f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0e7a780 con 0x55cbb0f64360 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0e764b0 con 0x55cbb0f64c70 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0e70450 con 0x55cbb0fa9b20 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a0cb3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a0cb3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52866/0 (socket says 10.20.193.28:52866) 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/854479038 learned_addr learned my addr 10.20.193.28:0/854479038 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a1cb5640 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.821+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f64730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/854479038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 msgr2=0x55cbb0fc9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/854479038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 msgr2=0x55cbb0f64730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f64730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/854479038 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb0e1bd10 con 0x55cbb0f64c70 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a1cb5640 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc9f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa95e0 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=17304605389533796710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd690038ec0 tx=0x7fd69002f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0264eeb0578d966 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd669ce5640 1 -- 10.20.193.28:0/854479038 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6900d6ff0 con 0x55cbb0f64c70 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd669ce5640 1 -- 10.20.193.28:0/854479038 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6900d95d0 con 0x55cbb0f64c70 2026-02-20T13:18:59.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd669ce5640 1 -- 10.20.193.28:0/854479038 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6900dc200 con 0x55cbb0f64c70 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a5739e00 1 -- 10.20.193.28:0/854479038 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 msgr2=0x55cbb0fa95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa95e0 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=17304605389533796710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd690038ec0 tx=0x7fd69002f190 comp rx=0 tx=0).stop 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a5739e00 1 -- 10.20.193.28:0/854479038 shutdown_connections 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc9f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa95e0 unknown :-1 s=CLOSED pgs=191 gs=1 cs=0 l=1 c_cookie=17304605389533796710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/854479038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f64730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.822+0000 7fd6a5739e00 1 -- 10.20.193.28:0/854479038 >> 10.20.193.28:0/854479038 conn(0x55cbb0f42860 msgr2=0x55cbb0f62c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.823+0000 7fd6a5739e00 1 -- 10.20.193.28:0/854479038 shutdown_connections 2026-02-20T13:18:59.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.823+0000 7fd6a5739e00 1 -- 10.20.193.28:0/854479038 wait complete. 2026-02-20T13:18:59.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.824+0000 7fd6a5739e00 1 -- start start 2026-02-20T13:18:59.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.824+0000 7fd6a5739e00 1 Processor -- start 2026-02-20T13:18:59.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.824+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fc16d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.824+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fc1c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.824+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc6c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.824+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0fc7140 con 0x55cbb0f64c70 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.824+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0fc72b0 con 0x55cbb0fa9b20 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.824+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0fc7470 con 0x55cbb0f64360 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fc1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a1cb5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fc1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47144/0 (socket says 10.20.193.28:47144) 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/3524940551 learned_addr learned my addr 10.20.193.28:0/3524940551 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fc16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/3524940551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 msgr2=0x55cbb0fc16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fc16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/3524940551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 msgr2=0x55cbb0fc6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/3524940551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c0f7bb0 con 0x55cbb0f64c70 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fc1c10 secure :-1 s=READY pgs=473 gs=3 cs=0 l=1 c_cookie=6439785084856474766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6900d15a0 tx=0x7fd690038f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595eb66a4cba9c8e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd656ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd656ffd640 1 -- 10.20.193.28:0/3524940551 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6900dc1a0 con 0x55cbb0f64c70 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd656ffd640 1 -- 10.20.193.28:0/3524940551 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd690038920 con 0x55cbb0f64c70 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd656ffd640 1 -- 10.20.193.28:0/3524940551 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6900d0670 con 0x55cbb0f64c70 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.825+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6980051e0 con 0x55cbb0f64c70 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd656ffd640 1 -- 10.20.193.28:0/3524940551 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6900d0800 con 0x55cbb0f64c70 2026-02-20T13:18:59.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 10 client.16008 _ll_register_callbacks cb 0x55cbb0df1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cbb0b066f0 con 0x55cbb0f64c70 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd656ffd640 1 -- 10.20.193.28:0/3524940551 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd6900ea020 con 0x55cbb0f64c70 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 10 client.16008 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55cbb0df43c0 con 0x55cbb0f64c70 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd656ffd640 1 -- 10.20.193.28:0/3524940551 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fd690041ac0 con 0x55cbb0f64c70 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 10 client.16008 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 10 client.16008 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 20 client.16008 populate_metadata read hostname 'trial028' 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55cbb0fa69a0 0x55cbb0fa6e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 4 client.16008 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbb0e12f80 con 0x55cbb0fa69a0 2026-02-20T13:18:59.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.826+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55cbb0fa69a0 0x55cbb0fa6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.827+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55cbb0fa69a0 0x55cbb0fa6e40 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=18180579186732905444 s_cookie=6972970109455730770 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fc4e64720c1333e4 server_cookie=60c4f75ec3868852 in_seq=0 out_seq=0 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.827+0000 7fd656ffd640 10 client.16008 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd656ffd640 1 -- 10.20.193.28:0/3524940551 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cbb0e12f80 con 0x55cbb0fa69a0 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd656ffd640 10 client.16008 handle_command_reply: tid=0 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 client.16008 shutdown 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 msgr2=0x55cbb0fc1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fc1c10 secure :-1 s=READY pgs=473 gs=3 cs=0 l=1 c_cookie=6439785084856474766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6900d15a0 tx=0x7fd690038f10 comp rx=0 tx=0).stop 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 shutdown_connections 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55cbb0fa69a0 0x55cbb0fa6e40 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=18180579186732905444 s_cookie=6972970109455730770 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fc1c10 unknown :-1 s=CLOSED pgs=473 gs=3 cs=0 l=1 c_cookie=6439785084856474766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fc6c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/3524940551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fc16d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd656ffd640 0 client.16008 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:18:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 >> 10.20.193.28:0/3524940551 conn(0x55cbb0f42860 msgr2=0x55cbb0f62c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 shutdown_connections 2026-02-20T13:18:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 1 -- 10.20.193.28:0/3524940551 wait complete. 2026-02-20T13:18:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.828+0000 7fd6a5739e00 20 client.16008 trim_cache size 0 max 16384 2026-02-20T13:18:59.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a5739e00 1 Processor -- start 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a5739e00 1 -- start start 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fa4780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa4cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fbe790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0fb3a00 con 0x55cbb0f64c70 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0e6e080 con 0x55cbb0fa9b20 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0b2e700 con 0x55cbb0f64360 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a0cb3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a14b4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fa4780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a14b4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fa4780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35204/0 (socket says 10.20.193.28:35204) 2026-02-20T13:18:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.835+0000 7fd6a14b4640 1 -- 10.20.193.28:0/1576836395 learned_addr learned my addr 10.20.193.28:0/1576836395 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a1cb5640 1 --2- 10.20.193.28:0/1576836395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fbe790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/1576836395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 msgr2=0x55cbb0fa4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/1576836395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fa4780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/1576836395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 msgr2=0x55cbb0fbe790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/1576836395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fbe790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a0cb3640 1 -- 10.20.193.28:0/1576836395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb0e060e0 con 0x55cbb0f64c70 2026-02-20T13:18:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/1576836395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa4cc0 secure :-1 s=READY pgs=474 gs=2 cs=0 l=1 c_cookie=3563309222685584798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd690038fd0 tx=0x7fd69003a020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31736adbdb0c2d9e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6694e4640 1 -- 10.20.193.28:0/1576836395 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6900ea070 con 0x55cbb0f64c70 2026-02-20T13:18:59.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6694e4640 1 -- 10.20.193.28:0/1576836395 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55cbb0b066f0 con 0x55cbb0f64c70 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6694e4640 1 -- 10.20.193.28:0/1576836395 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6900cf360 con 0x55cbb0f64c70 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a5739e00 1 -- 10.20.193.28:0/1576836395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 msgr2=0x55cbb0fa4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/1576836395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa4cc0 secure :-1 s=READY pgs=474 gs=2 cs=0 l=1 c_cookie=3563309222685584798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd690038fd0 tx=0x7fd69003a020 comp rx=0 tx=0).stop 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.836+0000 7fd6a5739e00 1 -- 10.20.193.28:0/1576836395 shutdown_connections 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/1576836395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64c70 0x55cbb0fa4cc0 unknown :-1 s=CLOSED pgs=474 gs=2 cs=0 l=1 c_cookie=3563309222685584798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/1576836395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0fa9b20 0x55cbb0fbe790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/1576836395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0f64360 0x55cbb0fa4780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 -- 10.20.193.28:0/1576836395 >> 10.20.193.28:0/1576836395 conn(0x55cbb0f42860 msgr2=0x55cbb0fbe080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 -- 10.20.193.28:0/1576836395 shutdown_connections 2026-02-20T13:18:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 -- 10.20.193.28:0/1576836395 wait complete. 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 -- start start 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 Processor -- start 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f48930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0f43f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0f44630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0fca0b0 con 0x55cbb0f64360 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0fb3a00 con 0x55cbb0f64c70 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.837+0000 7fd6a5739e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cbb0e6e080 con 0x55cbb0fa9b20 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f48930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a1cb5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0f44630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f48930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47160/0 (socket says 10.20.193.28:47160) 2026-02-20T13:18:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 -- 10.20.193.28:0/55864027 learned_addr learned my addr 10.20.193.28:0/55864027 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0f43f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 -- 10.20.193.28:0/55864027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 msgr2=0x55cbb0f44630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0f44630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 -- 10.20.193.28:0/55864027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 msgr2=0x55cbb0f43f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0f43f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 -- 10.20.193.28:0/55864027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb0e00b60 con 0x55cbb0f64360 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a14b4640 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f48930 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=14039946810727250262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c005920 tx=0x7fd68c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d7e93ccec6b956 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd656ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd656ffd640 1 -- 10.20.193.28:0/55864027 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68c01ae00 con 0x55cbb0f64360 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd656ffd640 1 -- 10.20.193.28:0/55864027 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd68c022040 con 0x55cbb0f64360 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbb0df43c0 con 0x55cbb0f64360 2026-02-20T13:18:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd656ffd640 1 -- 10.20.193.28:0/55864027 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68c011a30 con 0x55cbb0f64360 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a5739e00 10 client.16014 _ll_register_callbacks cb 0x55cbb0df1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.838+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6900d95d0 con 0x55cbb0f64360 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd656ffd640 1 -- 10.20.193.28:0/55864027 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd68c011bc0 con 0x55cbb0f64360 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd656ffd640 1 -- 10.20.193.28:0/55864027 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd68c011d80 con 0x55cbb0f64360 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a5739e00 10 client.16014 fetch_fsmap learned FSMap version 26 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55cbb0df46f0 con 0x55cbb0f64360 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd656ffd640 1 -- 10.20.193.28:0/55864027 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fd68c029b90 con 0x55cbb0f64360 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a5739e00 10 client.16014 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a5739e00 10 client.16014 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a5739e00 20 client.16014 populate_metadata read hostname 'trial028' 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55cbb1057310 0x55cbb10777c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:18:59.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a5739e00 4 client.16014 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cbb0b03f40 con 0x55cbb1057310 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.839+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55cbb1057310 0x55cbb10777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a0cb3640 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55cbb1057310 0x55cbb10777c0 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=11527692497238616100 s_cookie=11286147126691542876 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ffa973ff9d7e824 server_cookie=9ca07303e13eb75c in_seq=0 out_seq=0 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd656ffd640 10 client.16014 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd656ffd640 1 -- 10.20.193.28:0/55864027 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cbb0b03f40 con 0x55cbb1057310 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd656ffd640 10 client.16014 handle_command_reply: tid=0 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 client.16014 shutdown 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 msgr2=0x55cbb0f48930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f48930 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=14039946810727250262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c005920 tx=0x7fd68c0047e0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 shutdown_connections 2026-02-20T13:18:59.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55cbb1057310 0x55cbb10777c0 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=11527692497238616100 s_cookie=11286147126691542876 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cbb0fa9b20 0x55cbb0f44630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cbb0f64c70 0x55cbb0f43f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 --2- 10.20.193.28:0/55864027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbb0f64360 0x55cbb0f48930 unknown :-1 s=CLOSED pgs=475 gs=1 cs=0 l=1 c_cookie=14039946810727250262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd656ffd640 0 client.16014 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 >> 10.20.193.28:0/55864027 conn(0x55cbb0f42860 msgr2=0x55cbb0fbe790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 shutdown_connections 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 1 -- 10.20.193.28:0/55864027 wait complete. 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.840+0000 7fd6a5739e00 20 client.16014 trim_cache size 0 max 16384 2026-02-20T13:18:59.850 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:18:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 -- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6780b5760 msgr2=0x7fd6780d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6780b5760 0x7fd6780d5c10 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c004740 tx=0x7fd68c005f90 comp rx=0 tx=0).stop 2026-02-20T13:18:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 -- 10.20.193.28:0/1823556699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd69c10bb40 msgr2=0x7fd69c0f1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd69c10bb40 0x7fd69c0f1670 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd690038820 tx=0x7fd690004290 comp rx=0 tx=0).stop 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 -- 10.20.193.28:0/1823556699 shutdown_connections 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6780b5760 0x7fd6780d5c10 unknown :-1 s=CLOSED pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69c111160 0x7fd69c0f6a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd69c10bb40 0x7fd69c0f1670 unknown :-1 s=CLOSED pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 --2- 10.20.193.28:0/1823556699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd69c10b150 0x7fd69c0f1130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 -- 10.20.193.28:0/1823556699 >> 10.20.193.28:0/1823556699 conn(0x7fd69c0e8ce0 msgr2=0x7fd69c10efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 -- 10.20.193.28:0/1823556699 shutdown_connections 2026-02-20T13:18:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:18:59.841+0000 7fd6a24b6640 1 -- 10.20.193.28:0/1823556699 wait complete. 2026-02-20T13:18:59.941 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:18:59.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:18:59 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1259105429' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:18:59.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:18:59 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1259105429' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:19:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2233418540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc1100b0 msgr2=0x7fa6dc1104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2233418540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc1100b0 0x7fa6dc1104a0 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=5960550636096004332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c8009980 tx=0x7fa6c802f190 comp rx=0 tx=0).stop 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2233418540 shutdown_connections 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2233418540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6dc10f2f0 0x7fa6dc171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2233418540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa6dc10e940 0x7fa6dc10edb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2233418540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc1100b0 0x7fa6dc1104a0 unknown :-1 s=CLOSED pgs=476 gs=1 cs=0 l=1 c_cookie=5960550636096004332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2233418540 >> 10.20.193.28:0/2233418540 conn(0x7fa6dc0ec320 msgr2=0x7fa6dc10c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2233418540 shutdown_connections 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.111+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2233418540 wait complete. 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6e0e83640 1 Processor -- start 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6e0e83640 1 -- start start 2026-02-20T13:19:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6e0e83640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa6dc10e940 0x7fa6dc0f8200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6e0e83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc10f2f0 0x7fa6dc171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6e0e83640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6dc1100b0 0x7fa6dc0f8a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6e0e83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc0f9650 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6e0e83640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc0f97c0 con 0x7fa6dc10e940 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6e0e83640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc0f9980 con 0x7fa6dc1100b0 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6db7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa6dc10e940 0x7fa6dc0f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6daffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc10f2f0 0x7fa6dc171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6db7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa6dc10e940 0x7fa6dc0f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33204/0 (socket says 10.20.193.28:33204) 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.112+0000 7fa6db7fe640 1 -- 10.20.193.28:0/2676290213 learned_addr learned my addr 10.20.193.28:0/2676290213 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6dbfff640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6dc1100b0 0x7fa6dc0f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6daffd640 1 -- 10.20.193.28:0/2676290213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6dc1100b0 msgr2=0x7fa6dc0f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6daffd640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6dc1100b0 0x7fa6dc0f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6daffd640 1 -- 10.20.193.28:0/2676290213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa6dc10e940 msgr2=0x7fa6dc0f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6daffd640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa6dc10e940 0x7fa6dc0f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6daffd640 1 -- 10.20.193.28:0/2676290213 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c8009570 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa6dc10e940 0x7fa6dc0f8200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6daffd640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc10f2f0 0x7fa6dc171080 secure :-1 s=READY pgs=477 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6cc00e9c0 tx=0x7fa6cc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6d8ff9640 1 -- 10.20.193.28:0/2676290213 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6cc00ccb0 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2676290213 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc0f9c60 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2676290213 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc0fa180 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6d8ff9640 1 -- 10.20.193.28:0/2676290213 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa6cc00ce10 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.113+0000 7fa6d8ff9640 1 -- 10.20.193.28:0/2676290213 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6cc0106b0 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.116+0000 7fa6d8ff9640 1 -- 10.20.193.28:0/2676290213 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa6cc01f060 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.117+0000 7fa6d8ff9640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa6b00b5760 0x7fa6b00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.118+0000 7fa6d8ff9640 1 -- 10.20.193.28:0/2676290213 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa6cc014070 con 0x7fa6dc10f2f0 2026-02-20T13:19:00.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.118+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa6b00b5760 0x7fa6b00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.118+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa6b00b5760 0x7fa6b00d5c10 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c8038820 tx=0x7fa6c803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.118+0000 7fa6e4822e00 1 Processor -- start 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.118+0000 7fa6e4822e00 1 -- start start 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d098a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d09de0 0x5654d0d2a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d4aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654d0bfefd0 con 0x5654d0ce94c0 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5654d0bfad00 con 0x5654d0d2a700 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5654d0bf4ca0 con 0x5654d0d09de0 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d09de0 0x5654d0d2a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d09de0 0x5654d0d2a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41916/0 (socket says 10.20.193.28:41916) 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 -- 10.20.193.28:0/97910137 learned_addr learned my addr 10.20.193.28:0/97910137 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6dbfff640 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d4aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 -- 10.20.193.28:0/97910137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 msgr2=0x5654d0d4aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d4aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 -- 10.20.193.28:0/97910137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 msgr2=0x5654d0d098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 -- 10.20.193.28:0/97910137 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d0b978b0 con 0x5654d0d09de0 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d098a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:00.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.119+0000 7fa6daffd640 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d09de0 0x5654d0d2a1c0 secure :-1 s=READY pgs=162 gs=2 cs=0 l=1 c_cookie=504162979767996714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6cc009600 tx=0x7fa6cc0ae160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ff258f15f9512a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa69ffff640 1 -- 10.20.193.28:0/97910137 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6cc0ae9e0 con 0x5654d0d09de0 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa69ffff640 1 -- 10.20.193.28:0/97910137 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa6cc0b3d00 con 0x5654d0d09de0 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa69ffff640 1 -- 10.20.193.28:0/97910137 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6cc0d3350 con 0x5654d0d09de0 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 -- 10.20.193.28:0/97910137 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d09de0 msgr2=0x5654d0d2a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d09de0 0x5654d0d2a1c0 secure :-1 s=READY pgs=162 gs=2 cs=0 l=1 c_cookie=504162979767996714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6cc009600 tx=0x7fa6cc0ae160 comp rx=0 tx=0).stop 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 -- 10.20.193.28:0/97910137 shutdown_connections 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d4aae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d09de0 0x5654d0d2a1c0 unknown :-1 s=CLOSED pgs=162 gs=2 cs=0 l=1 c_cookie=504162979767996714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/97910137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d098a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 -- 10.20.193.28:0/97910137 >> 10.20.193.28:0/97910137 conn(0x5654d0c081c0 msgr2=0x5654d0ce7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 -- 10.20.193.28:0/97910137 shutdown_connections 2026-02-20T13:19:00.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.120+0000 7fa6e4822e00 1 -- 10.20.193.28:0/97910137 wait complete. 2026-02-20T13:19:00.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.121+0000 7fa6e4822e00 1 -- start start 2026-02-20T13:19:00.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6e4822e00 1 Processor -- start 2026-02-20T13:19:00.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0ce94c0 0x5654d0d02b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d03180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 0x5654d0d03be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654d0d04240 con 0x5654d0d09de0 2026-02-20T13:19:00.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5654d0d043b0 con 0x5654d0ce94c0 2026-02-20T13:19:00.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5654d0d04570 con 0x5654d0d2a700 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6db7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0ce94c0 0x5654d0d02b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6daffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d03180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6daffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d03180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54026/0 (socket says 10.20.193.28:54026) 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6daffd640 1 -- 10.20.193.28:0/1795335486 learned_addr learned my addr 10.20.193.28:0/1795335486 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6dbfff640 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 0x5654d0d03be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6daffd640 1 -- 10.20.193.28:0/1795335486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 msgr2=0x5654d0d03be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6daffd640 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 0x5654d0d03be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6daffd640 1 -- 10.20.193.28:0/1795335486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0ce94c0 msgr2=0x5654d0d02b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6daffd640 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0ce94c0 0x5654d0d02b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.122+0000 7fa6daffd640 1 -- 10.20.193.28:0/1795335486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d0ba0400 con 0x5654d0d09de0 2026-02-20T13:19:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6daffd640 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d03180 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=1312442215408283202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6cc0ae250 tx=0x7fa6cc0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1236bb3dc5a32e42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa69d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa69d7fa640 1 -- 10.20.193.28:0/1795335486 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6cc070070 con 0x5654d0d09de0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa69d7fa640 1 -- 10.20.193.28:0/1795335486 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa6cc072070 con 0x5654d0d09de0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa69d7fa640 1 -- 10.20.193.28:0/1795335486 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6cc0b8eb0 con 0x5654d0d09de0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc0fa180 con 0x5654d0d09de0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa69d7fa640 1 -- 10.20.193.28:0/1795335486 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa6cc0c5e40 con 0x5654d0d09de0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa69d7fa640 10 client.16026 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6e4822e00 10 client.16026 _ll_register_callbacks cb 0x5654d0b7fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654d0894520 con 0x5654d0d09de0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa69d7fa640 1 -- 10.20.193.28:0/1795335486 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa6cc0ae9e0 con 0x5654d0d09de0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6e4822e00 10 client.16026 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5654d0b78da0 con 0x5654d0d09de0 2026-02-20T13:19:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa69d7fa640 1 -- 10.20.193.28:0/1795335486 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fa6cc08b030 con 0x5654d0d09de0 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6e4822e00 10 client.16026 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6e4822e00 10 client.16026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.123+0000 7fa6e4822e00 20 client.16026 populate_metadata read hostname 'trial028' 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.124+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654d0d06f50 0x5654d0d073f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.124+0000 7fa6e4822e00 4 client.16026 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.124+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654d0c26630 con 0x5654d0d06f50 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.124+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654d0d06f50 0x5654d0d073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.124+0000 7fa69d7fa640 10 client.16026 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.124+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654d0d06f50 0x5654d0d073f0 crc :-1 s=READY pgs=78 gs=4 cs=0 l=0 c_cookie=13350046274100354697 s_cookie=14982061120044798303 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b944e45acec75e89 server_cookie=cfeaf935d776115f in_seq=0 out_seq=0 2026-02-20T13:19:00.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa69d7fa640 1 -- 10.20.193.28:0/1795335486 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5654d0c26630 con 0x5654d0d06f50 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa69d7fa640 10 client.16026 handle_command_reply: tid=0 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 client.16026 shutdown 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 msgr2=0x5654d0d03180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d03180 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=1312442215408283202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6cc0ae250 tx=0x7fa6cc0058e0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 shutdown_connections 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654d0d06f50 0x5654d0d073f0 crc :-1 s=READY pgs=78 gs=4 cs=0 l=0 c_cookie=13350046274100354697 s_cookie=14982061120044798303 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa69d7fa640 0 client.16026 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d03180 unknown :-1 s=CLOSED pgs=478 gs=1 cs=0 l=1 c_cookie=1312442215408283202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 0x5654d0d03be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/1795335486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0ce94c0 0x5654d0d02b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.125+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 >> 10.20.193.28:0/1795335486 conn(0x5654d0c081c0 msgr2=0x5654d0cea790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.126+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 shutdown_connections 2026-02-20T13:19:00.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.126+0000 7fa6e4822e00 1 -- 10.20.193.28:0/1795335486 wait complete. 2026-02-20T13:19:00.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.126+0000 7fa6e4822e00 20 client.16026 trim_cache size 0 max 16384 2026-02-20T13:19:00.135 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:00.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6e4822e00 1 Processor -- start 2026-02-20T13:19:00.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6e4822e00 1 -- start start 2026-02-20T13:19:00.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d029c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d09de0 0x5654d0cf49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 0x5654d0d285c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654d0bf28d0 con 0x5654d0ce94c0 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5654d0933f10 con 0x5654d0d09de0 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5654d0d03310 con 0x5654d0d2a700 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6daffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d09de0 0x5654d0cf49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6dbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 0x5654d0d285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6daffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d09de0 0x5654d0cf49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33228/0 (socket says 10.20.193.28:33228) 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6daffd640 1 -- 10.20.193.28:0/83150003 learned_addr learned my addr 10.20.193.28:0/83150003 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6daffd640 1 -- 10.20.193.28:0/83150003 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 msgr2=0x5654d0d285c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6daffd640 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 0x5654d0d285c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6daffd640 1 -- 10.20.193.28:0/83150003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 msgr2=0x5654d0d029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6daffd640 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6daffd640 1 -- 10.20.193.28:0/83150003 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d0cf51a0 con 0x5654d0d09de0 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.138+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d029c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6daffd640 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d09de0 0x5654d0cf49d0 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=9883386479695714303 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6cc0053e0 tx=0x7fa6cc0cf000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8928d7a38c2957ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa69f7fe640 1 -- 10.20.193.28:0/83150003 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6cc070070 con 0x5654d0d09de0 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa69f7fe640 1 -- 10.20.193.28:0/83150003 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5654d0894520 con 0x5654d0d09de0 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa69f7fe640 1 -- 10.20.193.28:0/83150003 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6cc0b6350 con 0x5654d0d09de0 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 -- 10.20.193.28:0/83150003 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d09de0 msgr2=0x5654d0cf49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d09de0 0x5654d0cf49d0 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=9883386479695714303 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6cc0053e0 tx=0x7fa6cc0cf000 comp rx=0 tx=0).stop 2026-02-20T13:19:00.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 -- 10.20.193.28:0/83150003 shutdown_connections 2026-02-20T13:19:00.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0d2a700 0x5654d0d285c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d09de0 0x5654d0cf49d0 unknown :-1 s=CLOSED pgs=192 gs=2 cs=0 l=1 c_cookie=9883386479695714303 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/83150003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0ce94c0 0x5654d0d029c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 -- 10.20.193.28:0/83150003 >> 10.20.193.28:0/83150003 conn(0x5654d0c081c0 msgr2=0x5654d0cfee50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 -- 10.20.193.28:0/83150003 shutdown_connections 2026-02-20T13:19:00.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.139+0000 7fa6e4822e00 1 -- 10.20.193.28:0/83150003 wait complete. 2026-02-20T13:19:00.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.140+0000 7fa6e4822e00 1 -- start start 2026-02-20T13:19:00.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.140+0000 7fa6e4822e00 1 Processor -- start 2026-02-20T13:19:00.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.140+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0ce94c0 0x5654d0d0d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.140+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d0d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.140+0000 7fa6e4822e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d0e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.140+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654d0933f10 con 0x5654d0d09de0 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.140+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5654d0bf28d0 con 0x5654d0d2a700 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.140+0000 7fa6e4822e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5654d0d0e930 con 0x5654d0ce94c0 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d0e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d0e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33234/0 (socket says 10.20.193.28:33234) 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 -- 10.20.193.28:0/2210418601 learned_addr learned my addr 10.20.193.28:0/2210418601 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6daffd640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d0d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0ce94c0 0x5654d0d0d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 -- 10.20.193.28:0/2210418601 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0ce94c0 msgr2=0x5654d0d0d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0ce94c0 0x5654d0d0d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 -- 10.20.193.28:0/2210418601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 msgr2=0x5654d0d0d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d0d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 -- 10.20.193.28:0/2210418601 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d0b8a670 con 0x5654d0d2a700 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0ce94c0 0x5654d0d0d1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6daffd640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d0d710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6dbfff640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d0e3c0 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=3104425248434146370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6d0005610 tx=0x7fa6d000aa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b152250c4abcc42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa69d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa69d7fa640 1 -- 10.20.193.28:0/2210418601 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6d00147a0 con 0x5654d0d2a700 2026-02-20T13:19:00.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa69d7fa640 1 -- 10.20.193.28:0/2210418601 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa6d0014de0 con 0x5654d0d2a700 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa69d7fa640 1 -- 10.20.193.28:0/2210418601 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6d001f430 con 0x5654d0d2a700 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654d0b78da0 con 0x5654d0d2a700 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa69d7fa640 1 -- 10.20.193.28:0/2210418601 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa6d001f5c0 con 0x5654d0d2a700 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa69d7fa640 10 client.26030 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6e4822e00 10 client.26030 _ll_register_callbacks cb 0x5654d0b7fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.141+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654d0ca4ca0 con 0x5654d0d2a700 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa69d7fa640 1 -- 10.20.193.28:0/2210418601 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa6d0012560 con 0x5654d0d2a700 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6e4822e00 10 client.26030 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5654d0b850f0 con 0x5654d0d2a700 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa69d7fa640 1 -- 10.20.193.28:0/2210418601 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fa6d0014900 con 0x5654d0d2a700 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6e4822e00 10 client.26030 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6e4822e00 10 client.26030 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:00.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6e4822e00 20 client.26030 populate_metadata read hostname 'trial028' 2026-02-20T13:19:00.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654d0dd76d0 0x5654d0df7b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6e4822e00 4 client.26030 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:19:00.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5654d08d8640 con 0x5654d0dd76d0 2026-02-20T13:19:00.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.142+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654d0dd76d0 0x5654d0df7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.143+0000 7fa6db7fe640 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654d0dd76d0 0x5654d0df7b80 crc :-1 s=READY pgs=79 gs=4 cs=0 l=0 c_cookie=16798268855837186559 s_cookie=9504984042768726718 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e91f7085f9aed9ff server_cookie=83e87ca098fc7abe in_seq=0 out_seq=0 2026-02-20T13:19:00.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.143+0000 7fa69d7fa640 10 client.26030 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:00.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa69d7fa640 1 -- 10.20.193.28:0/2210418601 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5654d08d8640 con 0x5654d0dd76d0 2026-02-20T13:19:00.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa69d7fa640 10 client.26030 handle_command_reply: tid=0 2026-02-20T13:19:00.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 client.26030 shutdown 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 msgr2=0x5654d0d0e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d0e3c0 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=3104425248434146370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6d0005610 tx=0x7fa6d000aa00 comp rx=0 tx=0).stop 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 shutdown_connections 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654d0dd76d0 0x5654d0df7b80 crc :-1 s=READY pgs=79 gs=4 cs=0 l=0 c_cookie=16798268855837186559 s_cookie=9504984042768726718 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654d0d09de0 0x5654d0d0d710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654d0d2a700 0x5654d0d0e3c0 unknown :-1 s=CLOSED pgs=193 gs=2 cs=0 l=1 c_cookie=3104425248434146370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 --2- 10.20.193.28:0/2210418601 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654d0ce94c0 0x5654d0d0d1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa69d7fa640 0 client.26030 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 >> 10.20.193.28:0/2210418601 conn(0x5654d0c081c0 msgr2=0x5654d0cfee50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 shutdown_connections 2026-02-20T13:19:00.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 1 -- 10.20.193.28:0/2210418601 wait complete. 2026-02-20T13:19:00.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.147+0000 7fa6e4822e00 20 client.26030 trim_cache size 0 max 16384 2026-02-20T13:19:00.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:19:00.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:19:00.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:19:00.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:19:00.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa6b00b5760 msgr2=0x7fa6b00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa6b00b5760 0x7fa6b00d5c10 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c8038820 tx=0x7fa6c803a040 comp rx=0 tx=0).stop 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc10f2f0 msgr2=0x7fa6dc171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc10f2f0 0x7fa6dc171080 secure :-1 s=READY pgs=477 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6cc00e9c0 tx=0x7fa6cc00ee90 comp rx=0 tx=0).stop 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2676290213 shutdown_connections 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa6b00b5760 0x7fa6b00d5c10 unknown :-1 s=CLOSED pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6dc10f2f0 0x7fa6dc171080 unknown :-1 s=CLOSED pgs=477 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6dc1100b0 0x7fa6dc0f8a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 --2- 10.20.193.28:0/2676290213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa6dc10e940 0x7fa6dc0f8200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2676290213 >> 10.20.193.28:0/2676290213 conn(0x7fa6dc0ec320 msgr2=0x7fa6dc0ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2676290213 shutdown_connections 2026-02-20T13:19:00.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:00.148+0000 7fa6e0e83640 1 -- 10.20.193.28:0/2676290213 wait complete. 2026-02-20T13:19:00.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.307+0000 7fce8ef8c640 1 -- 10.20.193.28:0/743063664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce88118010 msgr2=0x7fce881183e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.307+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/743063664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce88118010 0x7fce881183e0 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=14405721637897259992 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce78009890 tx=0x7fce7802f0e0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 -- 10.20.193.28:0/743063664 shutdown_connections 2026-02-20T13:19:00.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/743063664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce8811e200 0x7fce8817ebd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/743063664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce88118a00 0x7fce8811da50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/743063664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce88118010 0x7fce881183e0 unknown :-1 s=CLOSED pgs=163 gs=3 cs=0 l=1 c_cookie=14405721637897259992 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 -- 10.20.193.28:0/743063664 >> 10.20.193.28:0/743063664 conn(0x7fce880f58a0 msgr2=0x7fce88115cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 -- 10.20.193.28:0/743063664 shutdown_connections 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 -- 10.20.193.28:0/743063664 wait complete. 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 Processor -- start 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.308+0000 7fce8ef8c640 1 -- start start 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8ef8c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce88118010 0x7fce88126010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8ef8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce88118a00 0x7fce88126550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8ef8c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce8811e200 0x7fce8812b8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8ef8c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fce8812bef0 con 0x7fce88118a00 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8ef8c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fce8812c060 con 0x7fce88118010 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8ef8c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fce8812c220 con 0x7fce8811e200 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce7ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce88118a00 0x7fce88126550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8d502640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce8811e200 0x7fce8812b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8d502640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce8811e200 0x7fce8812b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41964/0 (socket says 10.20.193.28:41964) 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8d502640 1 -- 10.20.193.28:0/1438099795 learned_addr learned my addr 10.20.193.28:0/1438099795 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce8cd01640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce88118010 0x7fce88126010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce7ffff640 1 -- 10.20.193.28:0/1438099795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce8811e200 msgr2=0x7fce8812b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce7ffff640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce8811e200 0x7fce8812b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce7ffff640 1 -- 10.20.193.28:0/1438099795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce88118010 msgr2=0x7fce88126010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce7ffff640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce88118010 0x7fce88126010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.309+0000 7fce7ffff640 1 -- 10.20.193.28:0/1438099795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8400a590 con 0x7fce88118a00 2026-02-20T13:19:00.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.310+0000 7fce7ffff640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce88118a00 0x7fce88126550 secure :-1 s=READY pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce70005b30 tx=0x7fce7000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.310+0000 7fce7dffb640 1 -- 10.20.193.28:0/1438099795 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce70004460 con 0x7fce88118a00 2026-02-20T13:19:00.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.310+0000 7fce7dffb640 1 -- 10.20.193.28:0/1438099795 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce700045c0 con 0x7fce88118a00 2026-02-20T13:19:00.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.310+0000 7fce7dffb640 1 -- 10.20.193.28:0/1438099795 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce70005280 con 0x7fce88118a00 2026-02-20T13:19:00.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.310+0000 7fce8ef8c640 1 -- 10.20.193.28:0/1438099795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce780094b0 con 0x7fce88118a00 2026-02-20T13:19:00.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.310+0000 7fce8ef8c640 1 -- 10.20.193.28:0/1438099795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8816ca60 con 0x7fce88118a00 2026-02-20T13:19:00.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.313+0000 7fce7dffb640 1 -- 10.20.193.28:0/1438099795 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fce70005410 con 0x7fce88118a00 2026-02-20T13:19:00.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.315+0000 7fce7dffb640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce640b5760 0x7fce640d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.315+0000 7fce7dffb640 1 -- 10.20.193.28:0/1438099795 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fce70014070 con 0x7fce88118a00 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.315+0000 7fce8cd01640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce640b5760 0x7fce640d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.315+0000 7fce8cd01640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce640b5760 0x7fce640d5c10 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce780097e0 tx=0x7fce7803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.315+0000 7fce90f86e00 1 Processor -- start 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce90f86e00 1 -- start start 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeabe730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb035e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb23f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce90f86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560fae9d4780 con 0x560faeb03b20 2026-02-20T13:19:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce90f86e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560fae9d04b0 con 0x560faeabec70 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce90f86e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560fae9ca450 con 0x560faeabe360 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8cd01640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeabe730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8cd01640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeabe730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41978/0 (socket says 10.20.193.28:41978) 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8cd01640 1 -- 10.20.193.28:0/3582741605 learned_addr learned my addr 10.20.193.28:0/3582741605 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce7ffff640 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8d502640 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb23f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8cd01640 1 -- 10.20.193.28:0/3582741605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 msgr2=0x560faeb035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8cd01640 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8cd01640 1 -- 10.20.193.28:0/3582741605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 msgr2=0x560faeb23f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8cd01640 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb23f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8cd01640 1 -- 10.20.193.28:0/3582741605 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fae975d10 con 0x560faeabe360 2026-02-20T13:19:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.316+0000 7fce8d502640 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb23f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce8cd01640 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeabe730 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=1917880708803316324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce78002ce0 tx=0x7fce78040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9dae57e1cbca64 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce554e4640 1 -- 10.20.193.28:0/3582741605 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce780042e0 con 0x560faeabe360 2026-02-20T13:19:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce554e4640 1 -- 10.20.193.28:0/3582741605 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce7803e040 con 0x560faeabe360 2026-02-20T13:19:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce554e4640 1 -- 10.20.193.28:0/3582741605 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce7804e710 con 0x560faeabe360 2026-02-20T13:19:00.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 -- 10.20.193.28:0/3582741605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 msgr2=0x560faeabe730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeabe730 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=1917880708803316324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce78002ce0 tx=0x7fce78040000 comp rx=0 tx=0).stop 2026-02-20T13:19:00.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 -- 10.20.193.28:0/3582741605 shutdown_connections 2026-02-20T13:19:00.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb23f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb035e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 --2- 10.20.193.28:0/3582741605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeabe730 unknown :-1 s=CLOSED pgs=164 gs=1 cs=0 l=1 c_cookie=1917880708803316324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 -- 10.20.193.28:0/3582741605 >> 10.20.193.28:0/3582741605 conn(0x560faea9c860 msgr2=0x560faeabcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 -- 10.20.193.28:0/3582741605 shutdown_connections 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.317+0000 7fce90f86e00 1 -- 10.20.193.28:0/3582741605 wait complete. 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.319+0000 7fce90f86e00 1 -- start start 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.319+0000 7fce90f86e00 1 Processor -- start 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.319+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeb1b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.319+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeb1bc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.319+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 0x560faeb20c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.319+0000 7fce90f86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560faeb211a0 con 0x560faeabec70 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.319+0000 7fce90f86e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560faeb21310 con 0x560faeabe360 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.319+0000 7fce90f86e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560faeb214d0 con 0x560faeb03b20 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce8cd01640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeb1b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce7ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeb1bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce8cd01640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeb1b730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33274/0 (socket says 10.20.193.28:33274) 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce8cd01640 1 -- 10.20.193.28:0/2692823245 learned_addr learned my addr 10.20.193.28:0/2692823245 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce8d502640 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 0x560faeb20c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce7ffff640 1 -- 10.20.193.28:0/2692823245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 msgr2=0x560faeb20c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce7ffff640 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 0x560faeb20c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce7ffff640 1 -- 10.20.193.28:0/2692823245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 msgr2=0x560faeb1b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce7ffff640 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeb1b730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce7ffff640 1 -- 10.20.193.28:0/2692823245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fae94e3c0 con 0x560faeabec70 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce8cd01640 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeb1b730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce7ffff640 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeb1bc70 secure :-1 s=READY pgs=480 gs=2 cs=0 l=1 c_cookie=5135040984257541697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce7000ccf0 tx=0x7fce700ad850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474354918dbe3641 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce467fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce467fc640 1 -- 10.20.193.28:0/2692823245 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce700d22e0 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce467fc640 1 -- 10.20.193.28:0/2692823245 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce700b80f0 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce467fc640 1 -- 10.20.193.28:0/2692823245 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce700abf60 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8817f440 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce467fc640 1 -- 10.20.193.28:0/2692823245 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fce700ac0c0 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce90f86e00 10 client.16041 _ll_register_callbacks cb 0x560fae94ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.320+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560fae6606f0 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce467fc640 1 -- 10.20.193.28:0/2692823245 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fce70073340 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce90f86e00 10 client.16041 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x560fae9600e0 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce467fc640 1 -- 10.20.193.28:0/2692823245 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fce700aec10 con 0x560faeabec70 2026-02-20T13:19:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce90f86e00 10 client.16041 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce90f86e00 10 client.16041 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce90f86e00 20 client.16041 populate_metadata read hostname 'trial028' 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce90f86e00 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x560faeb23b40 0x560faeb018a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce90f86e00 4 client.16041 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fae96cf80 con 0x560faeb23b40 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.321+0000 7fce8cd01640 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x560faeb23b40 0x560faeb018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.322+0000 7fce8cd01640 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x560faeb23b40 0x560faeb018a0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=15820720129760331473 s_cookie=16660692722553039713 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db8e7d22e13c86d1 server_cookie=e736abc24fb5ab61 in_seq=0 out_seq=0 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.322+0000 7fce467fc640 10 client.16041 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce467fc640 1 -- 10.20.193.28:0/2692823245 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560fae96cf80 con 0x560faeb23b40 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce467fc640 10 client.16041 handle_command_reply: tid=0 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 client.16041 shutdown 2026-02-20T13:19:00.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 msgr2=0x560faeb1bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeb1bc70 secure :-1 s=READY pgs=480 gs=2 cs=0 l=1 c_cookie=5135040984257541697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce7000ccf0 tx=0x7fce700ad850 comp rx=0 tx=0).stop 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 shutdown_connections 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x560faeb23b40 0x560faeb018a0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=15820720129760331473 s_cookie=16660692722553039713 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeb1bc70 unknown :-1 s=CLOSED pgs=480 gs=2 cs=0 l=1 c_cookie=5135040984257541697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 0x560faeb20c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 --2- 10.20.193.28:0/2692823245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeb1b730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 >> 10.20.193.28:0/2692823245 conn(0x560faea9c860 msgr2=0x560faeabcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce467fc640 0 client.16041 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 shutdown_connections 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 1 -- 10.20.193.28:0/2692823245 wait complete. 2026-02-20T13:19:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.323+0000 7fce90f86e00 20 client.16041 trim_cache size 0 max 16384 2026-02-20T13:19:00.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce90f86e00 1 Processor -- start 2026-02-20T13:19:00.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce90f86e00 1 -- start start 2026-02-20T13:19:00.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeb18900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb18e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb028b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce90f86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560fae9c8080 con 0x560faeb03b20 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce90f86e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560fae688700 con 0x560faeabec70 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce90f86e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560faeb10060 con 0x560faeabe360 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce8cd01640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeb18900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.330+0000 7fce7ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb18e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce8d502640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce7ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb18e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33290/0 (socket says 10.20.193.28:33290) 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce7ffff640 1 -- 10.20.193.28:0/731951239 learned_addr learned my addr 10.20.193.28:0/731951239 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce7ffff640 1 -- 10.20.193.28:0/731951239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 msgr2=0x560faeb18900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce7ffff640 1 --2- 10.20.193.28:0/731951239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeb18900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce7ffff640 1 -- 10.20.193.28:0/731951239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 msgr2=0x560faeb028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce7ffff640 1 --2- 10.20.193.28:0/731951239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce7ffff640 1 -- 10.20.193.28:0/731951239 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fae95ab60 con 0x560faeabec70 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce7ffff640 1 --2- 10.20.193.28:0/731951239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb18e40 secure :-1 s=READY pgs=194 gs=3 cs=0 l=1 c_cookie=8047714482701268068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce700e46f0 tx=0x7fce70071000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6faf39aef32cf464 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce54ce3640 1 -- 10.20.193.28:0/731951239 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce700af970 con 0x560faeabec70 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce54ce3640 1 -- 10.20.193.28:0/731951239 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce700ca020 con 0x560faeabec70 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce54ce3640 1 -- 10.20.193.28:0/731951239 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce700afc70 con 0x560faeabec70 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce90f86e00 1 -- 10.20.193.28:0/731951239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 msgr2=0x560faeb18e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce90f86e00 1 --2- 10.20.193.28:0/731951239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb18e40 secure :-1 s=READY pgs=194 gs=3 cs=0 l=1 c_cookie=8047714482701268068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce700e46f0 tx=0x7fce70071000 comp rx=0 tx=0).stop 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce90f86e00 1 -- 10.20.193.28:0/731951239 shutdown_connections 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce90f86e00 1 --2- 10.20.193.28:0/731951239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeb03b20 0x560faeb028b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce90f86e00 1 --2- 10.20.193.28:0/731951239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabec70 0x560faeb18e40 unknown :-1 s=CLOSED pgs=194 gs=3 cs=0 l=1 c_cookie=8047714482701268068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce90f86e00 1 --2- 10.20.193.28:0/731951239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeabe360 0x560faeb18900 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.331+0000 7fce90f86e00 1 -- 10.20.193.28:0/731951239 >> 10.20.193.28:0/731951239 conn(0x560faea9c860 msgr2=0x560faeb05f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.332+0000 7fce90f86e00 1 -- 10.20.193.28:0/731951239 shutdown_connections 2026-02-20T13:19:00.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.332+0000 7fce90f86e00 1 -- 10.20.193.28:0/731951239 wait complete. 2026-02-20T13:19:00.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.332+0000 7fce90f86e00 1 -- start start 2026-02-20T13:19:00.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.332+0000 7fce90f86e00 1 Processor -- start 2026-02-20T13:19:00.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeaa24c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeaa2a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce90f86e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 0x560faea9dc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce90f86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560faea992e0 con 0x560faeabec70 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce90f86e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560faea9e300 con 0x560faeabe360 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce90f86e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560faea9e4c0 con 0x560faeb03b20 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeaa24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce7ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeaa2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeaa24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33304/0 (socket says 10.20.193.28:33304) 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 -- 10.20.193.28:0/519727210 learned_addr learned my addr 10.20.193.28:0/519727210 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8d502640 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 0x560faea9dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 -- 10.20.193.28:0/519727210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 msgr2=0x560faea9dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 0x560faea9dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 -- 10.20.193.28:0/519727210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 msgr2=0x560faeaa2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeaa2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 -- 10.20.193.28:0/519727210 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fae94e6f0 con 0x560faeabe360 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce7ffff640 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeaa2a00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce8cd01640 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeaa24c0 secure :-1 s=READY pgs=195 gs=3 cs=0 l=1 c_cookie=15326566293119314384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce78038da0 tx=0x7fce780047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b2e6d707da29d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.333+0000 7fce467fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce467fc640 1 -- 10.20.193.28:0/519727210 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce780388d0 con 0x560faeabe360 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce467fc640 1 -- 10.20.193.28:0/519727210 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce780045a0 con 0x560faeabe360 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce467fc640 1 -- 10.20.193.28:0/519727210 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce7804ec10 con 0x560faeabe360 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8817f440 con 0x560faeabe360 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce467fc640 1 -- 10.20.193.28:0/519727210 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fce7805d040 con 0x560faeabe360 2026-02-20T13:19:00.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 10 client.26048 _ll_register_callbacks cb 0x560fae94ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce7803e040 con 0x560faeabe360 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce467fc640 1 -- 10.20.193.28:0/519727210 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fce7804e680 con 0x560faeabe360 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 10 client.26048 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x560fae960340 con 0x560faeabe360 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce467fc640 1 -- 10.20.193.28:0/519727210 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7fce780040c0 con 0x560faeabe360 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 10 client.26048 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 10 client.26048 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 20 client.26048 populate_metadata read hostname 'trial028' 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x560faebb0ff0 0x560faebd1470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 4 client.26048 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.334+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560fae65df40 con 0x560faebb0ff0 2026-02-20T13:19:00.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce7ffff640 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x560faebb0ff0 0x560faebd1470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce7ffff640 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x560faebb0ff0 0x560faebd1470 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=8445696561734635609 s_cookie=6407832236634281600 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7535244692ee5059 server_cookie=58ed317814e21680 in_seq=0 out_seq=0 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce467fc640 10 client.26048 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce467fc640 1 -- 10.20.193.28:0/519727210 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560fae65df40 con 0x560faebb0ff0 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce467fc640 10 client.26048 handle_command_reply: tid=0 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce90f86e00 1 client.26048 shutdown 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 msgr2=0x560faeaa24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce90f86e00 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeaa24c0 secure :-1 s=READY pgs=195 gs=3 cs=0 l=1 c_cookie=15326566293119314384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce78038da0 tx=0x7fce780047e0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 shutdown_connections 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.335+0000 7fce90f86e00 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x560faebb0ff0 0x560faebd1470 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=8445696561734635609 s_cookie=6407832236634281600 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce90f86e00 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560faeabec70 0x560faeaa2a00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce90f86e00 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560faeb03b20 0x560faea9dc00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce90f86e00 1 --2- 10.20.193.28:0/519727210 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560faeabe360 0x560faeaa24c0 unknown :-1 s=CLOSED pgs=195 gs=3 cs=0 l=1 c_cookie=15326566293119314384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 >> 10.20.193.28:0/519727210 conn(0x560faea9c860 msgr2=0x560faeb178f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce467fc640 0 client.26048 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:19:00.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 shutdown_connections 2026-02-20T13:19:00.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce90f86e00 1 -- 10.20.193.28:0/519727210 wait complete. 2026-02-20T13:19:00.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce90f86e00 20 client.26048 trim_cache size 0 max 16384 2026-02-20T13:19:00.346 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:19:00.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 -- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce640b5760 msgr2=0x7fce640d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce640b5760 0x7fce640d5c10 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce780097e0 tx=0x7fce7803a040 comp rx=0 tx=0).stop 2026-02-20T13:19:00.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 -- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce88118a00 msgr2=0x7fce88126550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce88118a00 0x7fce88126550 secure :-1 s=READY pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce70005b30 tx=0x7fce7000ee60 comp rx=0 tx=0).stop 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 -- 10.20.193.28:0/1438099795 shutdown_connections 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fce640b5760 0x7fce640d5c10 unknown :-1 s=CLOSED pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce88118a00 0x7fce88126550 unknown :-1 s=CLOSED pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fce8811e200 0x7fce8812b8d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 --2- 10.20.193.28:0/1438099795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fce88118010 0x7fce88126010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 -- 10.20.193.28:0/1438099795 >> 10.20.193.28:0/1438099795 conn(0x7fce880f58a0 msgr2=0x7fce88115c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 -- 10.20.193.28:0/1438099795 shutdown_connections 2026-02-20T13:19:00.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.336+0000 7fce8ef8c640 1 -- 10.20.193.28:0/1438099795 wait complete. 2026-02-20T13:19:00.437 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:19:00.622 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:00.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 -- 10.20.193.28:0/564013681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c010dd10 msgr2=0x7f56c0112d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 --2- 10.20.193.28:0/564013681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c010dd10 0x7f56c0112d60 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=6439863797190578575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56b0009950 tx=0x7f56b002f190 comp rx=0 tx=0).stop 2026-02-20T13:19:00.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 -- 10.20.193.28:0/564013681 shutdown_connections 2026-02-20T13:19:00.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 --2- 10.20.193.28:0/564013681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0113510 0x7f56c0173ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 --2- 10.20.193.28:0/564013681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c010dd10 0x7f56c0112d60 unknown :-1 s=CLOSED pgs=196 gs=1 cs=0 l=1 c_cookie=6439863797190578575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 --2- 10.20.193.28:0/564013681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56c010d320 0x7f56c010d6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 -- 10.20.193.28:0/564013681 >> 10.20.193.28:0/564013681 conn(0x7f56c00eabb0 msgr2=0x7f56c010afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 -- 10.20.193.28:0/564013681 shutdown_connections 2026-02-20T13:19:00.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.798+0000 7f56c683f640 1 -- 10.20.193.28:0/564013681 wait complete. 2026-02-20T13:19:00.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c683f640 1 Processor -- start 2026-02-20T13:19:00.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c683f640 1 -- start start 2026-02-20T13:19:00.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c683f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c010d320 0x7f56c00f4e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c683f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56c010dd10 0x7f56c0173de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c683f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c0113510 0x7f56c00f5500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c683f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56c00fa710 con 0x7f56c010d320 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c683f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f56c00fa880 con 0x7f56c0113510 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c683f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f56c00faa40 con 0x7f56c010dd10 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c010d320 0x7f56c00f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c4db5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c0113510 0x7f56c00f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c010d320 0x7f56c00f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54112/0 (socket says 10.20.193.28:54112) 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56bffff640 1 -- 10.20.193.28:0/1381263742 learned_addr learned my addr 10.20.193.28:0/1381263742 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56c4db5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c0113510 0x7f56c00f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33324/0 (socket says 10.20.193.28:33324) 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.799+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56c010dd10 0x7f56c0173de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56c4db5640 1 -- 10.20.193.28:0/1381263742 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56c010dd10 msgr2=0x7f56c0173de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56c4db5640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56c010dd10 0x7f56c0173de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56c4db5640 1 -- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c010d320 msgr2=0x7f56c00f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56c4db5640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c010d320 0x7f56c00f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56c4db5640 1 -- 10.20.193.28:0/1381263742 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b0009570 con 0x7f56c0113510 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56bffff640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c010d320 0x7f56c00f4e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56c4db5640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c0113510 0x7f56c00f5500 secure :-1 s=READY pgs=197 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56b400a580 tx=0x7f56b400aa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56bd7fa640 1 -- 10.20.193.28:0/1381263742 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56b400c8b0 con 0x7f56c0113510 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56bd7fa640 1 -- 10.20.193.28:0/1381263742 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56b401e410 con 0x7f56c0113510 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56bd7fa640 1 -- 10.20.193.28:0/1381263742 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56b401d630 con 0x7f56c0113510 2026-02-20T13:19:00.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56c683f640 1 -- 10.20.193.28:0/1381263742 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c00facc0 con 0x7f56c0113510 2026-02-20T13:19:00.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.800+0000 7f56c683f640 1 -- 10.20.193.28:0/1381263742 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c00fb140 con 0x7f56c0113510 2026-02-20T13:19:00.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.804+0000 7f56bd7fa640 1 -- 10.20.193.28:0/1381263742 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f56b400ca10 con 0x7f56c0113510 2026-02-20T13:19:00.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.805+0000 7f56bd7fa640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56940b56d0 0x7f56940d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c8839e00 1 Processor -- start 2026-02-20T13:19:00.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56bd7fa640 1 -- 10.20.193.28:0/1381263742 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56b40eff10 con 0x7f56c0113510 2026-02-20T13:19:00.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c8839e00 1 -- start start 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56bffff640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56940b56d0 0x7f56940d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930360 0x55c86f930730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f9755e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f995f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c8839e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c86f846780 con 0x55c86f930c70 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c8839e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c86f8424b0 con 0x55c86f975b20 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c8839e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c86f83c450 con 0x55c86f930360 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c4db5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f995f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c4db5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f995f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33328/0 (socket says 10.20.193.28:33328) 2026-02-20T13:19:00.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c4db5640 1 -- 10.20.193.28:0/3488063291 learned_addr learned my addr 10.20.193.28:0/3488063291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f9755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56bffff640 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930360 0x55c86f930730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56bffff640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56940b56d0 0x7f56940d5b80 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ac00b2a0 tx=0x7f56ac002f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c4db5640 1 -- 10.20.193.28:0/3488063291 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930360 msgr2=0x55c86f930730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c4db5640 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930360 0x55c86f930730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c4db5640 1 -- 10.20.193.28:0/3488063291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 msgr2=0x55c86f9755e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c4db5640 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f9755e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.806+0000 7f56c4db5640 1 -- 10.20.193.28:0/3488063291 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86f7e7d10 con 0x55c86f975b20 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c4db5640 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f995f00 secure :-1 s=READY pgs=198 gs=2 cs=0 l=1 c_cookie=4849467980330445495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56b40b6300 tx=0x7f56b40b29f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=434cc56f3d3a2ab7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f5690ce3640 1 -- 10.20.193.28:0/3488063291 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56b40b5b20 con 0x55c86f975b20 2026-02-20T13:19:00.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f5690ce3640 1 -- 10.20.193.28:0/3488063291 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56b40bbf90 con 0x55c86f975b20 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f5690ce3640 1 -- 10.20.193.28:0/3488063291 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56b40c0f20 con 0x55c86f975b20 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 -- 10.20.193.28:0/3488063291 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 msgr2=0x55c86f995f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f995f00 secure :-1 s=READY pgs=198 gs=2 cs=0 l=1 c_cookie=4849467980330445495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56b40b6300 tx=0x7f56b40b29f0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 -- 10.20.193.28:0/3488063291 shutdown_connections 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f9755e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f995f00 unknown :-1 s=CLOSED pgs=198 gs=2 cs=0 l=1 c_cookie=4849467980330445495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3488063291 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930360 0x55c86f930730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 -- 10.20.193.28:0/3488063291 >> 10.20.193.28:0/3488063291 conn(0x55c86f90e860 msgr2=0x55c86f92ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 -- 10.20.193.28:0/3488063291 shutdown_connections 2026-02-20T13:19:00.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.807+0000 7f56c8839e00 1 -- 10.20.193.28:0/3488063291 wait complete. 2026-02-20T13:19:00.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c8839e00 1 -- start start 2026-02-20T13:19:00.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c8839e00 1 Processor -- start 2026-02-20T13:19:00.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f98d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f98dc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 0x55c86f98f990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c8839e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c86f98ff00 con 0x55c86f930c70 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c8839e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c86f990070 con 0x55c86f930360 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c8839e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c86f990230 con 0x55c86f975b20 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f98dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56bffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f98d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f98dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54126/0 (socket says 10.20.193.28:54126) 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56bf7fe640 1 -- 10.20.193.28:0/3266460935 learned_addr learned my addr 10.20.193.28:0/3266460935 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.809+0000 7f56c4db5640 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 0x55c86f98f990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56bffff640 1 -- 10.20.193.28:0/3266460935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 msgr2=0x55c86f98f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56bffff640 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 0x55c86f98f990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56bffff640 1 -- 10.20.193.28:0/3266460935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 msgr2=0x55c86f98dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56bffff640 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f98dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56bffff640 1 -- 10.20.193.28:0/3266460935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86f7c03c0 con 0x55c86f930360 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f98dc00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56bffff640 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f98d6c0 secure :-1 s=READY pgs=199 gs=2 cs=0 l=1 c_cookie=16268652732175983391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ac005db0 tx=0x7f56ac0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c5dd770389a31f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f5681ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f5681ffb640 1 -- 10.20.193.28:0/3266460935 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56ac021070 con 0x55c86f930360 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f5681ffb640 1 -- 10.20.193.28:0/3266460935 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56ac011e40 con 0x55c86f930360 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f5681ffb640 1 -- 10.20.193.28:0/3266460935 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56ac0103d0 con 0x55c86f930360 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c00fb140 con 0x55c86f930360 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f5681ffb640 1 -- 10.20.193.28:0/3266460935 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56ac010550 con 0x55c86f930360 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56c8839e00 10 client.26060 _ll_register_callbacks cb 0x55c86f7bda10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.810+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c86f4d26f0 con 0x55c86f930360 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f5681ffb640 1 -- 10.20.193.28:0/3266460935 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f56ac011960 con 0x55c86f930360 2026-02-20T13:19:00.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56c8839e00 10 client.26060 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55c86f7d20e0 con 0x55c86f930360 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f5681ffb640 1 -- 10.20.193.28:0/3266460935 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f56ac011b00 con 0x55c86f930360 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56c8839e00 10 client.26060 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56c8839e00 10 client.26060 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56c8839e00 20 client.26060 populate_metadata read hostname 'trial028' 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c86f995d80 0x55c86f9738a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56c8839e00 4 client.26060 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c86f7def80 con 0x55c86f995d80 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.811+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c86f995d80 0x55c86f9738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.812+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c86f995d80 0x55c86f9738a0 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=11638367128571434788 s_cookie=13071422098451984720 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a183c93da0155724 server_cookie=b5670524a76bf150 in_seq=0 out_seq=0 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.812+0000 7f5681ffb640 10 client.26060 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:19:00.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.812+0000 7f5681ffb640 1 -- 10.20.193.28:0/3266460935 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c86f7def80 con 0x55c86f995d80 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.812+0000 7f5681ffb640 10 client.26060 handle_command_reply: tid=0 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.812+0000 7f56c8839e00 1 client.26060 shutdown 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 msgr2=0x55c86f98d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f98d6c0 secure :-1 s=READY pgs=199 gs=2 cs=0 l=1 c_cookie=16268652732175983391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ac005db0 tx=0x7f56ac0047e0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 shutdown_connections 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c86f995d80 0x55c86f9738a0 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=11638367128571434788 s_cookie=13071422098451984720 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f98dc00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 0x55c86f98f990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 --2- 10.20.193.28:0/3266460935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f98d6c0 unknown :-1 s=CLOSED pgs=199 gs=2 cs=0 l=1 c_cookie=16268652732175983391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 >> 10.20.193.28:0/3266460935 conn(0x55c86f90e860 msgr2=0x55c86f92ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f5681ffb640 0 client.26060 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:19:00.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 shutdown_connections 2026-02-20T13:19:00.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 1 -- 10.20.193.28:0/3266460935 wait complete. 2026-02-20T13:19:00.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.813+0000 7f56c8839e00 20 client.26060 trim_cache size 0 max 16384 2026-02-20T13:19:00.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.820+0000 7f56c8839e00 1 Processor -- start 2026-02-20T13:19:00.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.820+0000 7f56c8839e00 1 -- start start 2026-02-20T13:19:00.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.820+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930360 0x55c86f98f920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.820+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930c70 0x55c86f974e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.820+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f9753c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.820+0000 7f56c8839e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c86f83a080 con 0x55c86f930360 2026-02-20T13:19:00.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.820+0000 7f56c8839e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c86f4fa700 con 0x55c86f975b20 2026-02-20T13:19:00.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.820+0000 7f56c8839e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c86f931040 con 0x55c86f930c70 2026-02-20T13:19:00.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930c70 0x55c86f974e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930360 0x55c86f98f920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930c70 0x55c86f974e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42068/0 (socket says 10.20.193.28:42068) 2026-02-20T13:19:00.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 -- 10.20.193.28:0/1395198607 learned_addr learned my addr 10.20.193.28:0/1395198607 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56c4db5640 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f9753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 -- 10.20.193.28:0/1395198607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 msgr2=0x55c86f9753c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f9753c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 -- 10.20.193.28:0/1395198607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930360 msgr2=0x55c86f98f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930360 0x55c86f98f920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 -- 10.20.193.28:0/1395198607 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86f7ccb60 con 0x55c86f930c70 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bffff640 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930360 0x55c86f98f920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930c70 0x55c86f974e80 secure :-1 s=READY pgs=165 gs=2 cs=0 l=1 c_cookie=11029889514010118924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55c86f97fac0 tx=0x7f56b002f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99120a12fa610b0c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f5683fff640 1 -- 10.20.193.28:0/1395198607 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56b003d040 con 0x55c86f930c70 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f5683fff640 1 -- 10.20.193.28:0/1395198607 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56b003e040 con 0x55c86f930c70 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.821+0000 7f5683fff640 1 -- 10.20.193.28:0/1395198607 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56b0038ba0 con 0x55c86f930c70 2026-02-20T13:19:00.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 -- 10.20.193.28:0/1395198607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930c70 msgr2=0x55c86f974e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930c70 0x55c86f974e80 secure :-1 s=READY pgs=165 gs=2 cs=0 l=1 c_cookie=11029889514010118924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55c86f97fac0 tx=0x7f56b002f190 comp rx=0 tx=0).stop 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 -- 10.20.193.28:0/1395198607 shutdown_connections 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f975b20 0x55c86f9753c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f930c70 0x55c86f974e80 unknown :-1 s=CLOSED pgs=165 gs=2 cs=0 l=1 c_cookie=11029889514010118924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 --2- 10.20.193.28:0/1395198607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930360 0x55c86f98f920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 -- 10.20.193.28:0/1395198607 >> 10.20.193.28:0/1395198607 conn(0x55c86f90e860 msgr2=0x55c86f992220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 -- 10.20.193.28:0/1395198607 shutdown_connections 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 -- 10.20.193.28:0/1395198607 wait complete. 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.822+0000 7f56c8839e00 1 -- start start 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56c8839e00 1 Processor -- start 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f970780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f970cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56c8839e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 0x55c86f973d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56c8839e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c86f97ae20 con 0x55c86f930c70 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56c8839e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c86f90e4d0 con 0x55c86f930360 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56c8839e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c86f993c20 con 0x55c86f975b20 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f970cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f970cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54140/0 (socket says 10.20.193.28:54140) 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56bf7fe640 1 -- 10.20.193.28:0/933435138 learned_addr learned my addr 10.20.193.28:0/933435138 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56bffff640 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f970780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56c4db5640 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 0x55c86f973d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.823+0000 7f56bffff640 1 -- 10.20.193.28:0/933435138 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 msgr2=0x55c86f973d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56bffff640 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 0x55c86f973d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56bffff640 1 -- 10.20.193.28:0/933435138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 msgr2=0x55c86f970cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56bffff640 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f970cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56bffff640 1 -- 10.20.193.28:0/933435138 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c0174750 con 0x55c86f930360 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f970cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56bffff640 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f970780 secure :-1 s=READY pgs=200 gs=2 cs=0 l=1 c_cookie=1440647088362540891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ac026630 tx=0x7f56ac02de50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13fe34e4dc8ccf5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f5681ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f5681ffb640 1 -- 10.20.193.28:0/933435138 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56ac021040 con 0x55c86f930360 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f5681ffb640 1 -- 10.20.193.28:0/933435138 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c86f4d26f0 con 0x55c86f930360 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c86f7d20e0 con 0x55c86f930360 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f5681ffb640 1 -- 10.20.193.28:0/933435138 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56ac01b500 con 0x55c86f930360 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56c8839e00 10 client.26066 _ll_register_callbacks cb 0x55c86f7bda10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:00.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56b40bbf90 con 0x55c86f930360 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f5681ffb640 1 -- 10.20.193.28:0/933435138 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56ac011e40 con 0x55c86f930360 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f5681ffb640 1 -- 10.20.193.28:0/933435138 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f56ac01b690 con 0x55c86f930360 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56c8839e00 10 client.26066 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.824+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55c86f7c06f0 con 0x55c86f930360 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.825+0000 7f5681ffb640 1 -- 10.20.193.28:0/933435138 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f56ac00d350 con 0x55c86f930360 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.825+0000 7f56c8839e00 10 client.26066 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.825+0000 7f56c8839e00 10 client.26066 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.825+0000 7f56c8839e00 20 client.26066 populate_metadata read hostname 'trial028' 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.825+0000 7f56c8839e00 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c86f911f00 0x55c86f912370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.825+0000 7f56c8839e00 4 client.26066 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:19:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.825+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c86f4cff40 con 0x55c86f911f00 2026-02-20T13:19:00.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:00 trial028 ceph-mon[37442]: pgmap v231: 97 pgs: 97 active+clean; 917 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:19:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.825+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c86f911f00 0x55c86f912370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c86f911f00 0x55c86f912370 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=9708123895319575283 s_cookie=7264208825173304838 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86ba2f3f38013af3 server_cookie=64cfa77066b66606 in_seq=0 out_seq=0 2026-02-20T13:19:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f5681ffb640 10 client.26066 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:19:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f5681ffb640 1 -- 10.20.193.28:0/933435138 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c86f4cff40 con 0x55c86f911f00 2026-02-20T13:19:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f5681ffb640 10 client.26066 handle_command_reply: tid=0 2026-02-20T13:19:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 client.26066 shutdown 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 msgr2=0x55c86f970780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f970780 secure :-1 s=READY pgs=200 gs=2 cs=0 l=1 c_cookie=1440647088362540891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ac026630 tx=0x7f56ac02de50 comp rx=0 tx=0).stop 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 shutdown_connections 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c86f911f00 0x55c86f912370 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=9708123895319575283 s_cookie=7264208825173304838 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c86f930c70 0x55c86f970cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c86f975b20 0x55c86f973d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 --2- 10.20.193.28:0/933435138 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c86f930360 0x55c86f970780 unknown :-1 s=CLOSED pgs=200 gs=2 cs=0 l=1 c_cookie=1440647088362540891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 >> 10.20.193.28:0/933435138 conn(0x55c86f90e860 msgr2=0x55c86f992ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f5681ffb640 0 client.26066 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 shutdown_connections 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 1 -- 10.20.193.28:0/933435138 wait complete. 2026-02-20T13:19:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.826+0000 7f56c8839e00 20 client.26066 trim_cache size 0 max 16384 2026-02-20T13:19:00.837 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:19:00.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 -- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56940b56d0 msgr2=0x7f56940d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56940b56d0 0x7f56940d5b80 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ac00b2a0 tx=0x7f56ac002f30 comp rx=0 tx=0).stop 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 -- 10.20.193.28:0/1381263742 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c0113510 msgr2=0x7f56c00f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c0113510 0x7f56c00f5500 secure :-1 s=READY pgs=197 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56b400a580 tx=0x7f56b400aa50 comp rx=0 tx=0).stop 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 -- 10.20.193.28:0/1381263742 shutdown_connections 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56940b56d0 0x7f56940d5b80 unknown :-1 s=CLOSED pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56c0113510 0x7f56c00f5500 unknown :-1 s=CLOSED pgs=197 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56c010dd10 0x7f56c0173de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 --2- 10.20.193.28:0/1381263742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c010d320 0x7f56c00f4e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 -- 10.20.193.28:0/1381263742 >> 10.20.193.28:0/1381263742 conn(0x7f56c00eabb0 msgr2=0x7f56c0111bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 -- 10.20.193.28:0/1381263742 shutdown_connections 2026-02-20T13:19:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:00.827+0000 7f56c683f640 1 -- 10.20.193.28:0/1381263742 wait complete. 2026-02-20T13:19:00.926 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:19:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:00 trial127 ceph-mon[43817]: pgmap v231: 97 pgs: 97 active+clean; 917 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:19:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:00 trial034 ceph-mon[43332]: pgmap v231: 97 pgs: 97 active+clean; 917 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:19:01.110 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.279+0000 7f8619ca8640 1 -- 10.20.193.28:0/1107230420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86141119a0 msgr2=0x7f8614172370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.279+0000 7f8619ca8640 1 --2- 10.20.193.28:0/1107230420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86141119a0 0x7f8614172370 secure :-1 s=READY pgs=201 gs=2 cs=0 l=1 c_cookie=4817888936774637386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f861000aa30 tx=0x7f8610030270 comp rx=0 tx=0).stop 2026-02-20T13:19:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 -- 10.20.193.28:0/1107230420 shutdown_connections 2026-02-20T13:19:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 --2- 10.20.193.28:0/1107230420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86141119a0 0x7f8614172370 unknown :-1 s=CLOSED pgs=201 gs=2 cs=0 l=1 c_cookie=4817888936774637386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 --2- 10.20.193.28:0/1107230420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f861410c1a0 0x7f86141111f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 --2- 10.20.193.28:0/1107230420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f861410b7b0 0x7f861410bb80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 -- 10.20.193.28:0/1107230420 >> 10.20.193.28:0/1107230420 conn(0x7f86140e9080 msgr2=0x7f8614109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 -- 10.20.193.28:0/1107230420 shutdown_connections 2026-02-20T13:19:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 -- 10.20.193.28:0/1107230420 wait complete. 2026-02-20T13:19:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 Processor -- start 2026-02-20T13:19:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.280+0000 7f8619ca8640 1 -- start start 2026-02-20T13:19:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f8619ca8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f861410b7b0 0x7f86140f5f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f8619ca8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f861410c1a0 0x7f8614172270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f8619ca8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86141119a0 0x7f86140f6630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f8619ca8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f86140fb840 con 0x7f861410b7b0 2026-02-20T13:19:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f8619ca8640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f86140fb9b0 con 0x7f861410c1a0 2026-02-20T13:19:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f8619ca8640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f86140fbb70 con 0x7f86141119a0 2026-02-20T13:19:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f860bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f861410c1a0 0x7f8614172270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f860bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f861410c1a0 0x7f8614172270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33372/0 (socket says 10.20.193.28:33372) 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f860bfff640 1 -- 10.20.193.28:0/3633947654 learned_addr learned my addr 10.20.193.28:0/3633947654 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f86194a7640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86141119a0 0x7f86140f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f8618ca6640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f861410b7b0 0x7f86140f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f860bfff640 1 -- 10.20.193.28:0/3633947654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86141119a0 msgr2=0x7f86140f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f860bfff640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86141119a0 0x7f86140f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f860bfff640 1 -- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f861410b7b0 msgr2=0x7f86140f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f860bfff640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f861410b7b0 0x7f86140f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.281+0000 7f860bfff640 1 -- 10.20.193.28:0/3633947654 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861000a650 con 0x7f861410c1a0 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.282+0000 7f860bfff640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f861410c1a0 0x7f8614172270 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85fc00a2b0 tx=0x7f85fc00eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.282+0000 7f8609ffb640 1 -- 10.20.193.28:0/3633947654 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85fc00cbe0 con 0x7f861410c1a0 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.282+0000 7f8609ffb640 1 -- 10.20.193.28:0/3633947654 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f85fc00cd40 con 0x7f861410c1a0 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.282+0000 7f8609ffb640 1 -- 10.20.193.28:0/3633947654 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85fc016410 con 0x7f861410c1a0 2026-02-20T13:19:01.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.282+0000 7f8619ca8640 1 -- 10.20.193.28:0/3633947654 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86140fbe50 con 0x7f861410c1a0 2026-02-20T13:19:01.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.282+0000 7f8619ca8640 1 -- 10.20.193.28:0/3633947654 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86140fc2d0 con 0x7f861410c1a0 2026-02-20T13:19:01.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.284+0000 7f8609ffb640 1 -- 10.20.193.28:0/3633947654 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f85fc004e50 con 0x7f861410c1a0 2026-02-20T13:19:01.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.286+0000 7f8609ffb640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85f00b5750 0x7f85f00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.286+0000 7f8609ffb640 1 -- 10.20.193.28:0/3633947654 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f85fc0e6810 con 0x7f861410c1a0 2026-02-20T13:19:01.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.287+0000 7f8618ca6640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85f00b5750 0x7f85f00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.287+0000 7f8618ca6640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85f00b5750 0x7f85f00d5c00 secure :-1 s=READY pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8604004740 tx=0x7f8604005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:01.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.287+0000 7f861cf2be00 1 Processor -- start 2026-02-20T13:19:01.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f861cf2be00 1 -- start start 2026-02-20T13:19:01.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acaffb3730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acafff85e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0018f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f861cf2be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55acafec9780 con 0x55acaffb3c70 2026-02-20T13:19:01.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f861cf2be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55acafec54b0 con 0x55acafff8b20 2026-02-20T13:19:01.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f861cf2be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55acafebf450 con 0x55acaffb3360 2026-02-20T13:19:01.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f860bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acafff85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f860bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acafff85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54166/0 (socket says 10.20.193.28:54166) 2026-02-20T13:19:01.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f860bfff640 1 -- 10.20.193.28:0/2533755301 learned_addr learned my addr 10.20.193.28:0/2533755301 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:01.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f8618ca6640 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acaffb3730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f86194a7640 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0018f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f860bfff640 1 -- 10.20.193.28:0/2533755301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 msgr2=0x55acaffb3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f860bfff640 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acaffb3730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f860bfff640 1 -- 10.20.193.28:0/2533755301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 msgr2=0x55acb0018f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f860bfff640 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0018f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.288+0000 7f860bfff640 1 -- 10.20.193.28:0/2533755301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acafe6ad10 con 0x55acaffb3c70 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f860bfff640 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acafff85e0 secure :-1 s=READY pgs=481 gs=2 cs=0 l=1 c_cookie=4192045317131510248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85fc0d2050 tx=0x7f85fc005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2d230169f6a1e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f85e14e4640 1 -- 10.20.193.28:0/2533755301 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85fc0b5ea0 con 0x55acaffb3c70 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f85e14e4640 1 -- 10.20.193.28:0/2533755301 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f85fc0aee90 con 0x55acaffb3c70 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f85e14e4640 1 -- 10.20.193.28:0/2533755301 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85fc0ada80 con 0x55acaffb3c70 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 -- 10.20.193.28:0/2533755301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 msgr2=0x55acafff85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acafff85e0 secure :-1 s=READY pgs=481 gs=2 cs=0 l=1 c_cookie=4192045317131510248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85fc0d2050 tx=0x7f85fc005340 comp rx=0 tx=0).stop 2026-02-20T13:19:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 -- 10.20.193.28:0/2533755301 shutdown_connections 2026-02-20T13:19:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acafff85e0 unknown :-1 s=CLOSED pgs=481 gs=2 cs=0 l=1 c_cookie=4192045317131510248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0018f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2533755301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acaffb3730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 -- 10.20.193.28:0/2533755301 >> 10.20.193.28:0/2533755301 conn(0x55acaff91860 msgr2=0x55acaffb1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 -- 10.20.193.28:0/2533755301 shutdown_connections 2026-02-20T13:19:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.289+0000 7f861cf2be00 1 -- 10.20.193.28:0/2533755301 wait complete. 2026-02-20T13:19:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.290+0000 7f861cf2be00 1 -- start start 2026-02-20T13:19:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f861cf2be00 1 Processor -- start 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb0010760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0010ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0012a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f861cf2be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55acb0012fa0 con 0x55acaffb3c70 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f861cf2be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55acb0013110 con 0x55acafff8b20 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f861cf2be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55acb00132d0 con 0x55acaffb3360 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f8618ca6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb0010760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f86194a7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0012a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f86194a7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0012a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33388/0 (socket says 10.20.193.28:33388) 2026-02-20T13:19:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f86194a7640 1 -- 10.20.193.28:0/89864606 learned_addr learned my addr 10.20.193.28:0/89864606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.291+0000 7f860bfff640 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0010ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f86194a7640 1 -- 10.20.193.28:0/89864606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 msgr2=0x55acb0010760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f86194a7640 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb0010760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f86194a7640 1 -- 10.20.193.28:0/89864606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 msgr2=0x55acb0010ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f86194a7640 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0010ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f86194a7640 1 -- 10.20.193.28:0/89864606 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acafe433c0 con 0x55acafff8b20 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f8618ca6640 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb0010760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f860bfff640 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0010ca0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f86194a7640 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0012a30 secure :-1 s=READY pgs=203 gs=3 cs=0 l=1 c_cookie=12272342613017891738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f861000a230 tx=0x7f86100396a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa501e95bad2139a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f85d27fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f85d27fc640 1 -- 10.20.193.28:0/89864606 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f861003e070 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f85d27fc640 1 -- 10.20.193.28:0/89864606 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f861003f040 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.292+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86140fc2d0 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f85d27fc640 1 -- 10.20.193.28:0/89864606 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8610045440 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 10 client.26078 _ll_register_callbacks cb 0x55acafe40a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55acafb556f0 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f85d27fc640 1 -- 10.20.193.28:0/89864606 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f86100050c0 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f85d27fc640 1 -- 10.20.193.28:0/89864606 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8610054050 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 10 client.26078 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55acafe550e0 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f85d27fc640 1 -- 10.20.193.28:0/89864606 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f861004c020 con 0x55acafff8b20 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 10 client.26078 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 10 client.26078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 20 client.26078 populate_metadata read hostname 'trial028' 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55acb0018d80 0x55acafff68a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 4 client.26078 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.293+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acafe61f80 con 0x55acb0018d80 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.294+0000 7f8618ca6640 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55acb0018d80 0x55acafff68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f8618ca6640 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55acb0018d80 0x55acafff68a0 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=1891919756215440806 s_cookie=9275019386245228890 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a4172fe94c3d5a6 server_cookie=80b77cfd9a02295a in_seq=0 out_seq=0 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f85d27fc640 10 client.26078 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f85d27fc640 1 -- 10.20.193.28:0/89864606 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55acafe61f80 con 0x55acb0018d80 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f85d27fc640 10 client.26078 handle_command_reply: tid=0 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 client.26078 shutdown 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 msgr2=0x55acb0012a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0012a30 secure :-1 s=READY pgs=203 gs=3 cs=0 l=1 c_cookie=12272342613017891738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f861000a230 tx=0x7f86100396a0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 shutdown_connections 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55acb0018d80 0x55acafff68a0 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=1891919756215440806 s_cookie=9275019386245228890 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0010ca0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb0012a30 unknown :-1 s=CLOSED pgs=203 gs=3 cs=0 l=1 c_cookie=12272342613017891738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 --2- 10.20.193.28:0/89864606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb0010760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 >> 10.20.193.28:0/89864606 conn(0x55acaff91860 msgr2=0x55acaffb1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f85d27fc640 0 client.26078 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.295+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 shutdown_connections 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.296+0000 7f861cf2be00 1 -- 10.20.193.28:0/89864606 wait complete. 2026-02-20T13:19:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.296+0000 7f861cf2be00 20 client.26078 trim_cache size 0 max 16384 2026-02-20T13:19:01.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.302+0000 7f861cf2be00 1 Processor -- start 2026-02-20T13:19:01.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.302+0000 7f861cf2be00 1 -- start start 2026-02-20T13:19:01.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb00129c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0014150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acafff7fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f861cf2be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55acafebd080 con 0x55acaffb3c70 2026-02-20T13:19:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f861cf2be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55acafb7d700 con 0x55acafff8b20 2026-02-20T13:19:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f861cf2be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55acb00176c0 con 0x55acaffb3360 2026-02-20T13:19:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f860bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0014150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f86194a7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acafff7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f86194a7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acafff7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33396/0 (socket says 10.20.193.28:33396) 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f86194a7640 1 -- 10.20.193.28:0/1605653182 learned_addr learned my addr 10.20.193.28:0/1605653182 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f8618ca6640 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb00129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f86194a7640 1 -- 10.20.193.28:0/1605653182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 msgr2=0x55acb00129c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f86194a7640 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb00129c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.303+0000 7f86194a7640 1 -- 10.20.193.28:0/1605653182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 msgr2=0x55acb0014150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f86194a7640 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0014150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f86194a7640 1 -- 10.20.193.28:0/1605653182 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acafe4fb60 con 0x55acafff8b20 2026-02-20T13:19:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f860bfff640 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0014150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:01.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f86194a7640 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acafff7fc0 secure :-1 s=READY pgs=204 gs=2 cs=0 l=1 c_cookie=12718120241678832768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8610039b50 tx=0x7f861004e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b07fd6f9eff8d480 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:01.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f85e0ce3640 1 -- 10.20.193.28:0/1605653182 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f861003e070 con 0x55acafff8b20 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f85e0ce3640 1 -- 10.20.193.28:0/1605653182 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55acafb556f0 con 0x55acafff8b20 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f85e0ce3640 1 -- 10.20.193.28:0/1605653182 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8610038eb0 con 0x55acafff8b20 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f861cf2be00 1 -- 10.20.193.28:0/1605653182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 msgr2=0x55acafff7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f861cf2be00 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acafff7fc0 secure :-1 s=READY pgs=204 gs=2 cs=0 l=1 c_cookie=12718120241678832768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8610039b50 tx=0x7f861004e000 comp rx=0 tx=0).stop 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f861cf2be00 1 -- 10.20.193.28:0/1605653182 shutdown_connections 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f861cf2be00 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3c70 0x55acb0014150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f861cf2be00 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acafff7fc0 unknown :-1 s=CLOSED pgs=204 gs=2 cs=0 l=1 c_cookie=12718120241678832768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.304+0000 7f861cf2be00 1 --2- 10.20.193.28:0/1605653182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3360 0x55acb00129c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 -- 10.20.193.28:0/1605653182 >> 10.20.193.28:0/1605653182 conn(0x55acaff91860 msgr2=0x55acb0013a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 -- 10.20.193.28:0/1605653182 shutdown_connections 2026-02-20T13:19:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 -- 10.20.193.28:0/1605653182 wait complete. 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 -- start start 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 Processor -- start 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3360 0x55acafff3930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3c70 0x55acafff3e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb000c8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55acb000cfe0 con 0x55acaffb3360 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55acb000d150 con 0x55acafff8b20 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.305+0000 7f861cf2be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55acb000d310 con 0x55acaffb3c70 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3360 0x55acafff3930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3360 0x55acafff3930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54182/0 (socket says 10.20.193.28:54182) 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 -- 10.20.193.28:0/2497491284 learned_addr learned my addr 10.20.193.28:0/2497491284 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f86194a7640 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb000c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f860bfff640 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3c70 0x55acafff3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 -- 10.20.193.28:0/2497491284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3c70 msgr2=0x55acafff3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3c70 0x55acafff3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 -- 10.20.193.28:0/2497491284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 msgr2=0x55acb000c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb000c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 -- 10.20.193.28:0/2497491284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acafe550e0 con 0x55acaffb3360 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f8618ca6640 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3360 0x55acafff3930 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=7517945972407903214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55acb000fe30 tx=0x7f86040047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68551c07b5f3a3ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f85d27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f85d27fc640 1 -- 10.20.193.28:0/2497491284 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8604025070 con 0x55acaffb3360 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f85d27fc640 1 -- 10.20.193.28:0/2497491284 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8604026040 con 0x55acaffb3360 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acafe6ad10 con 0x55acaffb3360 2026-02-20T13:19:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.306+0000 7f85d27fc640 1 -- 10.20.193.28:0/2497491284 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8604029950 con 0x55acaffb3360 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f85d27fc640 1 -- 10.20.193.28:0/2497491284 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8604029ae0 con 0x55acaffb3360 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 10 client.16083 _ll_register_callbacks cb 0x55acafe40a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85fc0aee90 con 0x55acaffb3360 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f85d27fc640 1 -- 10.20.193.28:0/2497491284 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8604011440 con 0x55acaffb3360 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 10 client.16083 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55acafe436f0 con 0x55acaffb3360 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f85d27fc640 1 -- 10.20.193.28:0/2497491284 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f86040115a0 con 0x55acaffb3360 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 10 client.16083 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 20 client.16083 populate_metadata read hostname 'trial028' 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55acaff95700 0x55acaff95ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:01.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 4 client.16083 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.307+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55acafb52f40 con 0x55acaff95700 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.308+0000 7f860bfff640 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55acaff95700 0x55acaff95ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.308+0000 7f860bfff640 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55acaff95700 0x55acaff95ba0 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=567304198263554617 s_cookie=9259105871012410892 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7df7829a1164239 server_cookie=807ef3bb9b6db60c in_seq=0 out_seq=0 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.308+0000 7f85d27fc640 10 client.16083 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.308+0000 7f85d27fc640 1 -- 10.20.193.28:0/2497491284 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55acafb52f40 con 0x55acaff95700 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.308+0000 7f85d27fc640 10 client.16083 handle_command_reply: tid=0 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.308+0000 7f861cf2be00 1 client.16083 shutdown 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3360 msgr2=0x55acafff3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3360 0x55acafff3930 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=7517945972407903214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55acb000fe30 tx=0x7f86040047e0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 shutdown_connections 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55acaff95700 0x55acaff95ba0 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=567304198263554617 s_cookie=9259105871012410892 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55acafff8b20 0x55acb000c8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55acaffb3c70 0x55acafff3e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 --2- 10.20.193.28:0/2497491284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55acaffb3360 0x55acafff3930 unknown :-1 s=CLOSED pgs=482 gs=1 cs=0 l=1 c_cookie=7517945972407903214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f85d27fc640 0 client.16083 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:01.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 >> 10.20.193.28:0/2497491284 conn(0x55acaff91860 msgr2=0x55acaffb2050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:01.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 shutdown_connections 2026-02-20T13:19:01.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 1 -- 10.20.193.28:0/2497491284 wait complete. 2026-02-20T13:19:01.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f861cf2be00 20 client.16083 trim_cache size 0 max 16384 2026-02-20T13:19:01.318 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:19:01.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 -- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85f00b5750 msgr2=0x7f85f00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85f00b5750 0x7f85f00d5c00 secure :-1 s=READY pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8604004740 tx=0x7f8604005d00 comp rx=0 tx=0).stop 2026-02-20T13:19:01.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 -- 10.20.193.28:0/3633947654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f861410c1a0 msgr2=0x7f8614172270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:01.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f861410c1a0 0x7f8614172270 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85fc00a2b0 tx=0x7f85fc00eb70 comp rx=0 tx=0).stop 2026-02-20T13:19:01.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 -- 10.20.193.28:0/3633947654 shutdown_connections 2026-02-20T13:19:01.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f85f00b5750 0x7f85f00d5c00 unknown :-1 s=CLOSED pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86141119a0 0x7f86140f6630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f861410c1a0 0x7f8614172270 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 --2- 10.20.193.28:0/3633947654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f861410b7b0 0x7f86140f5f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:01.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 -- 10.20.193.28:0/3633947654 >> 10.20.193.28:0/3633947654 conn(0x7f86140e9080 msgr2=0x7f8614109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:01.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 -- 10.20.193.28:0/3633947654 shutdown_connections 2026-02-20T13:19:01.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:01.309+0000 7f8619ca8640 1 -- 10.20.193.28:0/3633947654 wait complete. 2026-02-20T13:19:02.412 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:19:02.413 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:19:02.598 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:02.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:02 trial028 ceph-mon[37442]: pgmap v232: 97 pgs: 97 active+clean; 988 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:19:02.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/1009941817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 msgr2=0x7f7c6810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/1009941817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 0x7f7c6810f880 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=11060042993077630278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5c009950 tx=0x7f7c5c02f190 comp rx=0 tx=0).stop 2026-02-20T13:19:02.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/1009941817 shutdown_connections 2026-02-20T13:19:02.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/1009941817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c681156a0 0x7f7c68176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/1009941817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c6810fea0 0x7f7c68114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/1009941817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 0x7f7c6810f880 unknown :-1 s=CLOSED pgs=483 gs=1 cs=0 l=1 c_cookie=11060042993077630278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/1009941817 >> 10.20.193.28:0/1009941817 conn(0x7f7c680ecda0 msgr2=0x7f7c6810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:02.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/1009941817 shutdown_connections 2026-02-20T13:19:02.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.776+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/1009941817 wait complete. 2026-02-20T13:19:02.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.777+0000 7f7c6ca1a640 1 Processor -- start 2026-02-20T13:19:02.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.777+0000 7f7c6ca1a640 1 -- start start 2026-02-20T13:19:02.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c6ca1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 0x7f7c6811de20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c6ca1a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c6810fea0 0x7f7c6811e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c6ca1a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c681156a0 0x7f7c68123730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c6ca1a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68123d50 con 0x7f7c6810f4b0 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c6ca1a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68123ec0 con 0x7f7c6810fea0 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c6ca1a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68124080 con 0x7f7c681156a0 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 0x7f7c6811de20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 0x7f7c6811de20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54206/0 (socket says 10.20.193.28:54206) 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 -- 10.20.193.28:0/3647377400 learned_addr learned my addr 10.20.193.28:0/3647377400 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 -- 10.20.193.28:0/3647377400 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c681156a0 msgr2=0x7f7c68123730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c681156a0 0x7f7c68123730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 -- 10.20.193.28:0/3647377400 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c6810fea0 msgr2=0x7f7c6811e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c6810fea0 0x7f7c6811e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 -- 10.20.193.28:0/3647377400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c009570 con 0x7f7c6810f4b0 2026-02-20T13:19:02.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.778+0000 7f7c66d76640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 0x7f7c6811de20 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5c0023d0 tx=0x7f7c5c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:02.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.779+0000 7f7c47fff640 1 -- 10.20.193.28:0/3647377400 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c5c03d070 con 0x7f7c6810f4b0 2026-02-20T13:19:02.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.779+0000 7f7c47fff640 1 -- 10.20.193.28:0/3647377400 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c5c038920 con 0x7f7c6810f4b0 2026-02-20T13:19:02.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.779+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/3647377400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c68124300 con 0x7f7c6810f4b0 2026-02-20T13:19:02.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.779+0000 7f7c47fff640 1 -- 10.20.193.28:0/3647377400 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c5c0419d0 con 0x7f7c6810f4b0 2026-02-20T13:19:02.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.779+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/3647377400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c68164a60 con 0x7f7c6810f4b0 2026-02-20T13:19:02.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.781+0000 7f7c47fff640 1 -- 10.20.193.28:0/3647377400 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7c5c041b60 con 0x7f7c6810f4b0 2026-02-20T13:19:02.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.783+0000 7f7c47fff640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c3c0b5760 0x7f7c3c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.783+0000 7f7c47fff640 1 -- 10.20.193.28:0/3647377400 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7c5c10b270 con 0x7f7c6810f4b0 2026-02-20T13:19:02.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.783+0000 7f7c66575640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c3c0b5760 0x7f7c3c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.784+0000 7f7c66575640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c3c0b5760 0x7f7c3c0d5c10 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c50005970 tx=0x7f7c50005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.784+0000 7f7c6f215e00 1 Processor -- start 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.784+0000 7f7c6f215e00 1 -- start start 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46bfc7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfcd20 0x55ab46c41480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46c419c0 0x55ab46c61da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab46b12a20 con 0x55ab46bfc410 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab46b0e750 con 0x55ab46bfcd20 2026-02-20T13:19:02.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab46b086f0 con 0x55ab46c419c0 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46bfc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46bfc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54216/0 (socket says 10.20.193.28:54216) 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 -- 10.20.193.28:0/248793998 learned_addr learned my addr 10.20.193.28:0/248793998 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c67577640 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46c419c0 0x55ab46c61da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66575640 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfcd20 0x55ab46c41480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 -- 10.20.193.28:0/248793998 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46c419c0 msgr2=0x55ab46c61da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46c419c0 0x55ab46c61da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 -- 10.20.193.28:0/248793998 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfcd20 msgr2=0x55ab46c41480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfcd20 0x55ab46c41480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 -- 10.20.193.28:0/248793998 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab46ab4120 con 0x55ab46bfc410 2026-02-20T13:19:02.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c66d76640 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46bfc7e0 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=12509215278131521973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5c004030 tx=0x7f7c5c038de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad99a904cfeb29b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c337fe640 1 -- 10.20.193.28:0/248793998 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c5c0d1fd0 con 0x55ab46bfc410 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c337fe640 1 -- 10.20.193.28:0/248793998 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c5c0d72f0 con 0x55ab46bfc410 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.785+0000 7f7c337fe640 1 -- 10.20.193.28:0/248793998 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c5c0d24e0 con 0x55ab46bfc410 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 -- 10.20.193.28:0/248793998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 msgr2=0x55ab46bfc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46bfc7e0 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=12509215278131521973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5c004030 tx=0x7f7c5c038de0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 -- 10.20.193.28:0/248793998 shutdown_connections 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46c419c0 0x55ab46c61da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfcd20 0x55ab46c41480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/248793998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46bfc7e0 unknown :-1 s=CLOSED pgs=485 gs=1 cs=0 l=1 c_cookie=12509215278131521973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 -- 10.20.193.28:0/248793998 >> 10.20.193.28:0/248793998 conn(0x55ab46bda910 msgr2=0x55ab46bfacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:02.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 -- 10.20.193.28:0/248793998 shutdown_connections 2026-02-20T13:19:02.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.786+0000 7f7c6f215e00 1 -- 10.20.193.28:0/248793998 wait complete. 2026-02-20T13:19:02.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.787+0000 7f7c6f215e00 1 -- start start 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.787+0000 7f7c6f215e00 1 Processor -- start 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46c14a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c14fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46c419c0 0x55ab46c19fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab46c1a500 con 0x55ab46bfc410 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab46c1a670 con 0x55ab46c419c0 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab46c1a830 con 0x55ab46bfcd20 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46c14a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46c14a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54232/0 (socket says 10.20.193.28:54232) 2026-02-20T13:19:02.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 -- 10.20.193.28:0/1868546851 learned_addr learned my addr 10.20.193.28:0/1868546851 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c67577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46c419c0 0x55ab46c19fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66575640 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c14fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 -- 10.20.193.28:0/1868546851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 msgr2=0x55ab46c14fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c14fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 -- 10.20.193.28:0/1868546851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46c419c0 msgr2=0x55ab46c19fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46c419c0 0x55ab46c19fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 -- 10.20.193.28:0/1868546851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab46a8c810 con 0x55ab46bfc410 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c67577640 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46c419c0 0x55ab46c19fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c66d76640 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46c14a90 secure :-1 s=READY pgs=486 gs=1 cs=0 l=1 c_cookie=10535786405624819407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5c108da0 tx=0x7f7c5c0dc630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9236a1ea38a82ecf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.788+0000 7f7c30ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:02.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c30ff9640 1 -- 10.20.193.28:0/1868546851 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c5c096070 con 0x55ab46bfc410 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c30ff9640 1 -- 10.20.193.28:0/1868546851 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c5c0d98d0 con 0x55ab46bfc410 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c30ff9640 1 -- 10.20.193.28:0/1868546851 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c5c096a70 con 0x55ab46bfc410 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c68164a60 con 0x55ab46bfc410 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c30ff9640 1 -- 10.20.193.28:0/1868546851 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7c5c041e40 con 0x55ab46bfc410 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c30ff9640 10 client.16095 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 10 client.16095 _ll_register_callbacks cb 0x55ab46abfb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab4679e9d0 con 0x55ab46bfc410 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c30ff9640 1 -- 10.20.193.28:0/1868546851 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7c5c0d2480 con 0x55ab46bfc410 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 10 client.16095 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:02.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55ab46a9e4f0 con 0x55ab46bfc410 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c30ff9640 1 -- 10.20.193.28:0/1868546851 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f7c5c0d2fc0 con 0x55ab46bfc410 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 10 client.16095 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 20 client.16095 populate_metadata read hostname 'trial028' 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab46c3ede0 0x55ab46c3f280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 4 client.16095 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.789+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab46b15df0 con 0x55ab46c3ede0 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.790+0000 7f7c66575640 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab46c3ede0 0x55ab46c3f280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.791+0000 7f7c66575640 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab46c3ede0 0x55ab46c3f280 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=12216692101590399162 s_cookie=12157935896482597650 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a98a68bd559db8ba server_cookie=a8b9aa4847d0cb12 in_seq=0 out_seq=0 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.791+0000 7f7c30ff9640 10 client.16095 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:02.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.791+0000 7f7c30ff9640 1 -- 10.20.193.28:0/1868546851 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ab46b15df0 con 0x55ab46c3ede0 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.791+0000 7f7c30ff9640 10 client.16095 handle_command_reply: tid=0 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.791+0000 7f7c6f215e00 1 client.16095 shutdown 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 msgr2=0x55ab46c14a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46c14a90 secure :-1 s=READY pgs=486 gs=1 cs=0 l=1 c_cookie=10535786405624819407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5c108da0 tx=0x7f7c5c0dc630 comp rx=0 tx=0).stop 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 shutdown_connections 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab46c3ede0 0x55ab46c3f280 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=12216692101590399162 s_cookie=12157935896482597650 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46c419c0 0x55ab46c19fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c14fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/1868546851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46bfc410 0x55ab46c14a90 unknown :-1 s=CLOSED pgs=486 gs=1 cs=0 l=1 c_cookie=10535786405624819407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c30ff9640 0 client.16095 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 >> 10.20.193.28:0/1868546851 conn(0x55ab46bda910 msgr2=0x55ab46bfb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:02.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 shutdown_connections 2026-02-20T13:19:02.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 1 -- 10.20.193.28:0/1868546851 wait complete. 2026-02-20T13:19:02.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.792+0000 7f7c6f215e00 20 client.16095 trim_cache size 0 max 16384 2026-02-20T13:19:02.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.801+0000 7f7c6f215e00 1 Processor -- start 2026-02-20T13:19:02.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c6f215e00 1 -- start start 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c40b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c410b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c10e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab46b06320 con 0x55ab46c419c0 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab467c6790 con 0x55ab46bfc410 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab46b9bea0 con 0x55ab46bfcd20 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c40b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c66575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c66575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42192/0 (socket says 10.20.193.28:42192) 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c66575640 1 -- 10.20.193.28:0/4026873507 learned_addr learned my addr 10.20.193.28:0/4026873507 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:02.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.802+0000 7f7c67577640 1 --2- 10.20.193.28:0/4026873507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c10e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c66575640 1 -- 10.20.193.28:0/4026873507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 msgr2=0x55ab46c40b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:02.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c66575640 1 --2- 10.20.193.28:0/4026873507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c40b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c66575640 1 -- 10.20.193.28:0/4026873507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 msgr2=0x55ab46c10e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:02.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c66575640 1 --2- 10.20.193.28:0/4026873507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c10e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c66575640 1 -- 10.20.193.28:0/4026873507 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab46c06d90 con 0x55ab46bfcd20 2026-02-20T13:19:02.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c66575640 1 --2- 10.20.193.28:0/4026873507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c410b0 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=15186161811543396258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c50005db0 tx=0x7f7c50010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2c015b536a58fa2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:02.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c32ffd640 1 -- 10.20.193.28:0/4026873507 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c50026070 con 0x55ab46bfcd20 2026-02-20T13:19:02.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c32ffd640 1 -- 10.20.193.28:0/4026873507 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c50002da0 con 0x55ab46bfcd20 2026-02-20T13:19:02.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.803+0000 7f7c32ffd640 1 -- 10.20.193.28:0/4026873507 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c50015040 con 0x55ab46bfcd20 2026-02-20T13:19:02.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 -- 10.20.193.28:0/4026873507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 msgr2=0x55ab46c410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/4026873507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c410b0 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=15186161811543396258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c50005db0 tx=0x7f7c50010000 comp rx=0 tx=0).stop 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 -- 10.20.193.28:0/4026873507 shutdown_connections 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/4026873507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c10e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/4026873507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c410b0 unknown :-1 s=CLOSED pgs=166 gs=2 cs=0 l=1 c_cookie=15186161811543396258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/4026873507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c40b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 -- 10.20.193.28:0/4026873507 >> 10.20.193.28:0/4026873507 conn(0x55ab46bda910 msgr2=0x55ab46c19610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 -- 10.20.193.28:0/4026873507 shutdown_connections 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.804+0000 7f7c6f215e00 1 -- 10.20.193.28:0/4026873507 wait complete. 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.805+0000 7f7c6f215e00 1 -- start start 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.805+0000 7f7c6f215e00 1 Processor -- start 2026-02-20T13:19:02.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.805+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c1cbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.805+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c1d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.805+0000 7f7c6f215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c86f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.805+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab46c874b0 con 0x55ab46c419c0 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.805+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab46c87620 con 0x55ab46bfc410 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.805+0000 7f7c6f215e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab46c877e0 con 0x55ab46bfcd20 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c1cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c66d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c1cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33456/0 (socket says 10.20.193.28:33456) 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c66d76640 1 -- 10.20.193.28:0/3592648023 learned_addr learned my addr 10.20.193.28:0/3592648023 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c66575640 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c1d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c67577640 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c86f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c67577640 1 -- 10.20.193.28:0/3592648023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 msgr2=0x55ab46c1d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c67577640 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c1d130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c67577640 1 -- 10.20.193.28:0/3592648023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 msgr2=0x55ab46c1cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c67577640 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c1cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c67577640 1 -- 10.20.193.28:0/3592648023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab46a98f70 con 0x55ab46c419c0 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c67577640 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c86f40 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=9082654585005439657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c58005820 tx=0x7f7c58014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0c12391cd27aa9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c30ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.806+0000 7f7c30ff9640 1 -- 10.20.193.28:0/3592648023 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c58005930 con 0x55ab46c419c0 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c30ff9640 1 -- 10.20.193.28:0/3592648023 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c58006020 con 0x55ab46c419c0 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c30ff9640 1 -- 10.20.193.28:0/3592648023 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c58012980 con 0x55ab46c419c0 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c50004470 con 0x55ab46c419c0 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c30ff9640 1 -- 10.20.193.28:0/3592648023 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7c58012b10 con 0x55ab46c419c0 2026-02-20T13:19:02.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c30ff9640 10 client.16101 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 10 client.16101 _ll_register_callbacks cb 0x55ab46abfb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c5c0d72f0 con 0x55ab46c419c0 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c30ff9640 1 -- 10.20.193.28:0/3592648023 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7c58012450 con 0x55ab46c419c0 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 10 client.16101 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55ab46a8cb40 con 0x55ab46c419c0 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c30ff9640 1 -- 10.20.193.28:0/3592648023 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f7c58012cd0 con 0x55ab46c419c0 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 10 client.16101 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:02.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 20 client.16101 populate_metadata read hostname 'trial028' 2026-02-20T13:19:02.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab46cef930 0x55ab46d0fde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:02.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 4 client.16101 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:19:02.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.807+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ab4679c220 con 0x55ab46cef930 2026-02-20T13:19:02.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.808+0000 7f7c66d76640 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab46cef930 0x55ab46d0fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:02.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.808+0000 7f7c66d76640 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab46cef930 0x55ab46d0fde0 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=15583459407019826426 s_cookie=9195725277083824825 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d84391c41722dcfa server_cookie=7f9dc76b20a972b9 in_seq=0 out_seq=0 2026-02-20T13:19:02.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.808+0000 7f7c30ff9640 10 client.16101 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:02.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.809+0000 7f7c30ff9640 1 -- 10.20.193.28:0/3592648023 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ab4679c220 con 0x55ab46cef930 2026-02-20T13:19:02.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.809+0000 7f7c30ff9640 10 client.16101 handle_command_reply: tid=0 2026-02-20T13:19:02.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.809+0000 7f7c6f215e00 1 client.16101 shutdown 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.809+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 msgr2=0x55ab46c86f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.809+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c86f40 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=9082654585005439657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c58005820 tx=0x7f7c58014830 comp rx=0 tx=0).stop 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 shutdown_connections 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab46cef930 0x55ab46d0fde0 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=15583459407019826426 s_cookie=9195725277083824825 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab46c419c0 0x55ab46c86f40 unknown :-1 s=CLOSED pgs=487 gs=1 cs=0 l=1 c_cookie=9082654585005439657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab46bfcd20 0x55ab46c1d130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 1 --2- 10.20.193.28:0/3592648023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab46bfc410 0x55ab46c1cbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c30ff9640 0 client.16101 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 >> 10.20.193.28:0/3592648023 conn(0x55ab46bda910 msgr2=0x55ab46c17cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 shutdown_connections 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 1 -- 10.20.193.28:0/3592648023 wait complete. 2026-02-20T13:19:02.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.810+0000 7f7c6f215e00 20 client.16101 trim_cache size 0 max 16384 2026-02-20T13:19:02.819 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:19:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:19:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "a2152168-91c4-42bf-a9fa-9c45db8a05d3", 2026-02-20T13:19:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:19:02.819 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:19:02.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c3c0b5760 msgr2=0x7f7c3c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c3c0b5760 0x7f7c3c0d5c10 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c50005970 tx=0x7f7c50005900 comp rx=0 tx=0).stop 2026-02-20T13:19:02.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 msgr2=0x7f7c6811de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:02.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 0x7f7c6811de20 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5c0023d0 tx=0x7f7c5c0043d0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/3647377400 shutdown_connections 2026-02-20T13:19:02.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c3c0b5760 0x7f7c3c0d5c10 unknown :-1 s=CLOSED pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c681156a0 0x7f7c68123730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c6810fea0 0x7f7c6811e360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 --2- 10.20.193.28:0/3647377400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c6810f4b0 0x7f7c6811de20 unknown :-1 s=CLOSED pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:02.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/3647377400 >> 10.20.193.28:0/3647377400 conn(0x7f7c680ecda0 msgr2=0x7f7c6810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:02.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/3647377400 shutdown_connections 2026-02-20T13:19:02.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:02.811+0000 7f7c6ca1a640 1 -- 10.20.193.28:0/3647377400 wait complete. 2026-02-20T13:19:02.914 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:19:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:02 trial127 ceph-mon[43817]: pgmap v232: 97 pgs: 97 active+clean; 988 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:19:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:02 trial034 ceph-mon[43332]: pgmap v232: 97 pgs: 97 active+clean; 988 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:19:03.098 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:03.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 -- 10.20.193.28:0/592571061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83881157e0 msgr2=0x7f83881761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 --2- 10.20.193.28:0/592571061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83881157e0 0x7f83881761b0 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=2394458027335615909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f837c00aa30 tx=0x7f837c030270 comp rx=0 tx=0).stop 2026-02-20T13:19:03.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 -- 10.20.193.28:0/592571061 shutdown_connections 2026-02-20T13:19:03.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 --2- 10.20.193.28:0/592571061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83881157e0 0x7f83881761b0 unknown :-1 s=CLOSED pgs=488 gs=1 cs=0 l=1 c_cookie=2394458027335615909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 --2- 10.20.193.28:0/592571061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f838810ffe0 0x7f8388115030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 --2- 10.20.193.28:0/592571061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f838810f5f0 0x7f838810f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 -- 10.20.193.28:0/592571061 >> 10.20.193.28:0/592571061 conn(0x7f83880ecea0 msgr2=0x7f838810d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 -- 10.20.193.28:0/592571061 shutdown_connections 2026-02-20T13:19:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.276+0000 7f838e26f640 1 -- 10.20.193.28:0/592571061 wait complete. 2026-02-20T13:19:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f838e26f640 1 Processor -- start 2026-02-20T13:19:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f838e26f640 1 -- start start 2026-02-20T13:19:03.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f838e26f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838810f5f0 0x7f838811d510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f838e26f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f838810ffe0 0x7f838811da50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f838e26f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83881157e0 0x7f8388122e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f838e26f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8388123440 con 0x7f838810f5f0 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f838e26f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f83881235b0 con 0x7f838810ffe0 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f838e26f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8388123770 con 0x7f83881157e0 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f83877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838810f5f0 0x7f838811d510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f83877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838810f5f0 0x7f838811d510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54276/0 (socket says 10.20.193.28:54276) 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f83877fe640 1 -- 10.20.193.28:0/4207236251 learned_addr learned my addr 10.20.193.28:0/4207236251 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:03.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.277+0000 7f8386ffd640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f838810ffe0 0x7f838811da50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f8387fff640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83881157e0 0x7f8388122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f83877fe640 1 -- 10.20.193.28:0/4207236251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83881157e0 msgr2=0x7f8388122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f83877fe640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83881157e0 0x7f8388122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f83877fe640 1 -- 10.20.193.28:0/4207236251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f838810ffe0 msgr2=0x7f838811da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f83877fe640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f838810ffe0 0x7f838811da50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f83877fe640 1 -- 10.20.193.28:0/4207236251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c00a650 con 0x7f838810f5f0 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f83877fe640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838810f5f0 0x7f838811d510 secure :-1 s=READY pgs=489 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8374005db0 tx=0x7f837400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f8384ff9640 1 -- 10.20.193.28:0/4207236251 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8374004500 con 0x7f838810f5f0 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f8384ff9640 1 -- 10.20.193.28:0/4207236251 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8374004d30 con 0x7f838810f5f0 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f8384ff9640 1 -- 10.20.193.28:0/4207236251 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83740053c0 con 0x7f838810f5f0 2026-02-20T13:19:03.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f838e26f640 1 -- 10.20.193.28:0/4207236251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8388123a50 con 0x7f838810f5f0 2026-02-20T13:19:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.278+0000 7f838e26f640 1 -- 10.20.193.28:0/4207236251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8388164150 con 0x7f838810f5f0 2026-02-20T13:19:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.281+0000 7f8384ff9640 1 -- 10.20.193.28:0/4207236251 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8374009940 con 0x7f838810f5f0 2026-02-20T13:19:03.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.283+0000 7f8384ff9640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f835c0b5760 0x7f835c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.283+0000 7f8384ff9640 1 -- 10.20.193.28:0/4207236251 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f83740e6c80 con 0x7f838810f5f0 2026-02-20T13:19:03.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.283+0000 7f8386ffd640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f835c0b5760 0x7f835c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f835c0b5760 0x7f835c0d5c10 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8388123eb0 tx=0x7f8378004340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:03.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8390269e00 1 Processor -- start 2026-02-20T13:19:03.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8390269e00 1 -- start start 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8390269e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdad7d550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8390269e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdadc2400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8390269e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 0x55ffdade2d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8390269e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffdac937d0 con 0x55ffdad7da90 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8390269e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffdac8f500 con 0x55ffdadc2940 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8390269e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffdac894a0 con 0x55ffdad7d180 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdadc2400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8387fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 0x55ffdade2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdadc2400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54284/0 (socket says 10.20.193.28:54284) 2026-02-20T13:19:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 -- 10.20.193.28:0/1409361427 learned_addr learned my addr 10.20.193.28:0/1409361427 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 -- 10.20.193.28:0/1409361427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 msgr2=0x55ffdad7d550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:19:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 --2- 10.20.193.28:0/1409361427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdad7d550 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 -- 10.20.193.28:0/1409361427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 msgr2=0x55ffdade2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 --2- 10.20.193.28:0/1409361427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 0x55ffdade2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.284+0000 7f8386ffd640 1 -- 10.20.193.28:0/1409361427 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdac34d80 con 0x55ffdad7da90 2026-02-20T13:19:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8386ffd640 1 --2- 10.20.193.28:0/1409361427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdadc2400 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=4312345281720312976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f837800fd10 tx=0x7f8378012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd8872f99c56490 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f834bfff640 1 -- 10.20.193.28:0/1409361427 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f837800fe10 con 0x55ffdad7da90 2026-02-20T13:19:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f834bfff640 1 -- 10.20.193.28:0/1409361427 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f837801e940 con 0x55ffdad7da90 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f834bfff640 1 -- 10.20.193.28:0/1409361427 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83780109c0 con 0x55ffdad7da90 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 -- 10.20.193.28:0/1409361427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 msgr2=0x55ffdadc2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 --2- 10.20.193.28:0/1409361427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdadc2400 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=4312345281720312976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f837800fd10 tx=0x7f8378012000 comp rx=0 tx=0).stop 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 -- 10.20.193.28:0/1409361427 shutdown_connections 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 --2- 10.20.193.28:0/1409361427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdadc2400 unknown :-1 s=CLOSED pgs=490 gs=1 cs=0 l=1 c_cookie=4312345281720312976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 --2- 10.20.193.28:0/1409361427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 0x55ffdade2d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 --2- 10.20.193.28:0/1409361427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdad7d550 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 -- 10.20.193.28:0/1409361427 >> 10.20.193.28:0/1409361427 conn(0x55ffdad5b680 msgr2=0x55ffdad7ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 -- 10.20.193.28:0/1409361427 shutdown_connections 2026-02-20T13:19:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.285+0000 7f8390269e00 1 -- 10.20.193.28:0/1409361427 wait complete. 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8390269e00 1 -- start start 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8390269e00 1 Processor -- start 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8390269e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7d180 0x55ffdad957b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8390269e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdad95cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8390269e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdadc2940 0x55ffdad9ace0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8390269e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffdad9b220 con 0x55ffdad7da90 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8390269e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffdad9b390 con 0x55ffdad7d180 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8390269e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffdad9b550 con 0x55ffdadc2940 2026-02-20T13:19:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f83877fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7d180 0x55ffdad957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8386ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdad95cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f8387fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdadc2940 0x55ffdad9ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f83877fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7d180 0x55ffdad957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33494/0 (socket says 10.20.193.28:33494) 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.287+0000 7f83877fe640 1 -- 10.20.193.28:0/3396317510 learned_addr learned my addr 10.20.193.28:0/3396317510 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83877fe640 1 -- 10.20.193.28:0/3396317510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdadc2940 msgr2=0x55ffdad9ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83877fe640 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdadc2940 0x55ffdad9ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83877fe640 1 -- 10.20.193.28:0/3396317510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 msgr2=0x55ffdad95cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83877fe640 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdad95cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83877fe640 1 -- 10.20.193.28:0/3396317510 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdac0d350 con 0x55ffdad7d180 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f8387fff640 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdadc2940 0x55ffdad9ace0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83877fe640 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7d180 0x55ffdad957b0 secure :-1 s=READY pgs=205 gs=2 cs=0 l=1 c_cookie=13058152031721951508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83740040a0 tx=0x7f83740a8f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b537e01679d51114 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83497fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83497fa640 1 -- 10.20.193.28:0/3396317510 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f837400e350 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837800f9b0 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f8390269e00 10 client.26111 _ll_register_callbacks cb 0x55ffdac0a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ffda91f6f0 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83497fa640 1 -- 10.20.193.28:0/3396317510 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f83740ad9e0 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.288+0000 7f83497fa640 1 -- 10.20.193.28:0/3396317510 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83740b7c90 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f83497fa640 1 -- 10.20.193.28:0/3396317510 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f83740c4e40 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f83497fa640 1 -- 10.20.193.28:0/3396317510 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f83740b7df0 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8390269e00 10 client.26111 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55ffdac1f150 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f83497fa640 1 -- 10.20.193.28:0/3396317510 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f837400e5e0 con 0x55ffdad7d180 2026-02-20T13:19:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8390269e00 10 client.26111 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8390269e00 10 client.26111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8390269e00 20 client.26111 populate_metadata read hostname 'trial028' 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8390269e00 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffdadbfe40 0x55ffdadc02e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8390269e00 4 client.26111 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffdac96d60 con 0x55ffdadbfe40 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.289+0000 7f8386ffd640 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffdadbfe40 0x55ffdadc02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.290+0000 7f8386ffd640 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffdadbfe40 0x55ffdadc02e0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=17909102970637800635 s_cookie=2218983480369748077 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f889ea43eac254bb server_cookie=1ecb69b7fde6186d in_seq=0 out_seq=0 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.290+0000 7f83497fa640 10 client.26111 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.290+0000 7f83497fa640 1 -- 10.20.193.28:0/3396317510 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ffdac96d60 con 0x55ffdadbfe40 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.290+0000 7f83497fa640 10 client.26111 handle_command_reply: tid=0 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.290+0000 7f8390269e00 1 client.26111 shutdown 2026-02-20T13:19:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.290+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7d180 msgr2=0x55ffdad957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.290+0000 7f8390269e00 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7d180 0x55ffdad957b0 secure :-1 s=READY pgs=205 gs=2 cs=0 l=1 c_cookie=13058152031721951508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83740040a0 tx=0x7f83740a8f50 comp rx=0 tx=0).stop 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 shutdown_connections 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffdadbfe40 0x55ffdadc02e0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=17909102970637800635 s_cookie=2218983480369748077 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdad95cf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdadc2940 0x55ffdad9ace0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 1 --2- 10.20.193.28:0/3396317510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7d180 0x55ffdad957b0 unknown :-1 s=CLOSED pgs=205 gs=2 cs=0 l=1 c_cookie=13058152031721951508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 >> 10.20.193.28:0/3396317510 conn(0x55ffdad5b680 msgr2=0x55ffdad7c250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f83497fa640 0 client.26111 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 shutdown_connections 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 1 -- 10.20.193.28:0/3396317510 wait complete. 2026-02-20T13:19:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.291+0000 7f8390269e00 20 client.26111 trim_cache size 0 max 16384 2026-02-20T13:19:03.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8390269e00 1 Processor -- start 2026-02-20T13:19:03.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8390269e00 1 -- start start 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8390269e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdad959e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8390269e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7da90 0x55ffdad9a250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8390269e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdadc2940 0x55ffdadbb1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8390269e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffdac870d0 con 0x55ffdadc2940 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8390269e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffda947700 con 0x55ffdad7da90 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8390269e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffdad5b0c0 con 0x55ffdad7d180 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f83877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdad959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f83877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdad959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42232/0 (socket says 10.20.193.28:42232) 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f83877fe640 1 -- 10.20.193.28:0/2755218027 learned_addr learned my addr 10.20.193.28:0/2755218027 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8386ffd640 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7da90 0x55ffdad9a250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8387fff640 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdadc2940 0x55ffdadbb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8386ffd640 1 -- 10.20.193.28:0/2755218027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 msgr2=0x55ffdad959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8386ffd640 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdad959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.300+0000 7f8386ffd640 1 -- 10.20.193.28:0/2755218027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdadc2940 msgr2=0x55ffdadbb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8386ffd640 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdadc2940 0x55ffdadbb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8386ffd640 1 -- 10.20.193.28:0/2755218027 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdac19bd0 con 0x55ffdad7da90 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8387fff640 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdadc2940 0x55ffdadbb1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8386ffd640 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7da90 0x55ffdad9a250 secure :-1 s=READY pgs=206 gs=3 cs=0 l=1 c_cookie=15809353141424356802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55ffdadc0b90 tx=0x7f8378010510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db661aebab4dfdc2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f834b7fe640 1 -- 10.20.193.28:0/2755218027 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8378030040 con 0x55ffdad7da90 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f834b7fe640 1 -- 10.20.193.28:0/2755218027 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f837800fe90 con 0x55ffdad7da90 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f834b7fe640 1 -- 10.20.193.28:0/2755218027 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8378010ad0 con 0x55ffdad7da90 2026-02-20T13:19:03.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 -- 10.20.193.28:0/2755218027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7da90 msgr2=0x55ffdad9a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7da90 0x55ffdad9a250 secure :-1 s=READY pgs=206 gs=3 cs=0 l=1 c_cookie=15809353141424356802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55ffdadc0b90 tx=0x7f8378010510 comp rx=0 tx=0).stop 2026-02-20T13:19:03.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 -- 10.20.193.28:0/2755218027 shutdown_connections 2026-02-20T13:19:03.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdadc2940 0x55ffdadbb1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdad7da90 0x55ffdad9a250 unknown :-1 s=CLOSED pgs=206 gs=3 cs=0 l=1 c_cookie=15809353141424356802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 --2- 10.20.193.28:0/2755218027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdad959e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 -- 10.20.193.28:0/2755218027 >> 10.20.193.28:0/2755218027 conn(0x55ffdad5b680 msgr2=0x55ffdad99b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:03.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 -- 10.20.193.28:0/2755218027 shutdown_connections 2026-02-20T13:19:03.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.301+0000 7f8390269e00 1 -- 10.20.193.28:0/2755218027 wait complete. 2026-02-20T13:19:03.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.302+0000 7f8390269e00 1 -- start start 2026-02-20T13:19:03.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.302+0000 7f8390269e00 1 Processor -- start 2026-02-20T13:19:03.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.302+0000 7f8390269e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdada0f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.302+0000 7f8390269e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdada14d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.302+0000 7f8390269e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 0x55ffdad9fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.302+0000 7f8390269e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffdada01f0 con 0x55ffdad7da90 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.302+0000 7f8390269e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffdada0360 con 0x55ffdadc2940 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.302+0000 7f8390269e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffdada0520 con 0x55ffdad7d180 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f8386ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdada14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdada0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdada0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42242/0 (socket says 10.20.193.28:42242) 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 -- 10.20.193.28:0/1449162612 learned_addr learned my addr 10.20.193.28:0/1449162612 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f8387fff640 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 0x55ffdad9fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 -- 10.20.193.28:0/1449162612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 msgr2=0x55ffdad9fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 0x55ffdad9fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 -- 10.20.193.28:0/1449162612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 msgr2=0x55ffdada14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdada14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 -- 10.20.193.28:0/1449162612 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdac34d80 con 0x55ffdad7d180 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83877fe640 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdada0f90 secure :-1 s=READY pgs=167 gs=2 cs=0 l=1 c_cookie=10017652616843922446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83740040a0 tx=0x7f837406d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b05d9faae3e8c0e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83497fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.303+0000 7f83497fa640 1 -- 10.20.193.28:0/1449162612 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83740c8030 con 0x55ffdad7d180 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f83497fa640 1 -- 10.20.193.28:0/1449162612 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f83740ca050 con 0x55ffdad7d180 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f83497fa640 1 -- 10.20.193.28:0/1449162612 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83740b2d00 con 0x55ffdad7d180 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8388176a20 con 0x55ffdad7d180 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f83497fa640 1 -- 10.20.193.28:0/1449162612 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f83740c9070 con 0x55ffdad7d180 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f83497fa640 10 client.26056 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 10 client.26056 _ll_register_callbacks cb 0x55ffdac0a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f837801e940 con 0x55ffdad7d180 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f83497fa640 1 -- 10.20.193.28:0/1449162612 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f83740ad9e0 con 0x55ffdad7d180 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 10 client.26056 fetch_fsmap learned FSMap version 26 2026-02-20T13:19:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55ffdac0d680 con 0x55ffdad7d180 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f83497fa640 1 -- 10.20.193.28:0/1449162612 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 26) ==== 8378+0+0 (secure 0 0 0) 0x7f8374093020 con 0x55ffdad7d180 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 10 client.26056 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 10 client.26056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 20 client.26056 populate_metadata read hostname 'trial028' 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffdae128b0 0x55ffdae12d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 4 client.26056 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.304+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ffda91cf40 con 0x55ffdae128b0 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8386ffd640 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffdae128b0 0x55ffdae12d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8386ffd640 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffdae128b0 0x55ffdae12d50 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=605272315514979077 s_cookie=15751086091822255983 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8665bf6cea60305 server_cookie=da97195901a94f6f in_seq=0 out_seq=0 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f83497fa640 10 client.26056 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:03.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f83497fa640 1 -- 10.20.193.28:0/1449162612 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55ffda91cf40 con 0x55ffdae128b0 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f83497fa640 10 client.26056 handle_command_reply: tid=0 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 client.26056 shutdown 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 msgr2=0x55ffdada0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdada0f90 secure :-1 s=READY pgs=167 gs=2 cs=0 l=1 c_cookie=10017652616843922446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83740040a0 tx=0x7f837406d000 comp rx=0 tx=0).stop 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 shutdown_connections 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffdae128b0 0x55ffdae12d50 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=605272315514979077 s_cookie=15751086091822255983 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffdad7da90 0x55ffdada14d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffdadc2940 0x55ffdad9fcb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 --2- 10.20.193.28:0/1449162612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffdad7d180 0x55ffdada0f90 unknown :-1 s=CLOSED pgs=167 gs=2 cs=0 l=1 c_cookie=10017652616843922446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f83497fa640 0 client.26056 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 >> 10.20.193.28:0/1449162612 conn(0x55ffdad5b680 msgr2=0x55ffdad92390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 shutdown_connections 2026-02-20T13:19:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.305+0000 7f8390269e00 1 -- 10.20.193.28:0/1449162612 wait complete. 2026-02-20T13:19:03.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f8390269e00 20 client.26056 trim_cache size 0 max 16384 2026-02-20T13:19:03.316 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:19:03.316 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:19:03.316 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:19:03.316 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:19:03.316 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "a2152168-91c4-42bf-a9fa-9c45db8a05d3", 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:03.317 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:03.318 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:03.319 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:03.320 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:03.320 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:03.320 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:03.320 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:19:03.320 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:19:03.320 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 -- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f835c0b5760 msgr2=0x7f835c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f835c0b5760 0x7f835c0d5c10 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8388123eb0 tx=0x7f8378004340 comp rx=0 tx=0).stop 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 -- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838810f5f0 msgr2=0x7f838811d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838810f5f0 0x7f838811d510 secure :-1 s=READY pgs=489 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8374005db0 tx=0x7f837400ddf0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 -- 10.20.193.28:0/4207236251 shutdown_connections 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f835c0b5760 0x7f835c0d5c10 unknown :-1 s=CLOSED pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83881157e0 0x7f8388122e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f838810ffe0 0x7f838811da50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 --2- 10.20.193.28:0/4207236251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838810f5f0 0x7f838811d510 unknown :-1 s=CLOSED pgs=489 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:03.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.306+0000 7f838e26f640 1 -- 10.20.193.28:0/4207236251 >> 10.20.193.28:0/4207236251 conn(0x7f83880ecea0 msgr2=0x7f838810d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:03.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.307+0000 7f838e26f640 1 -- 10.20.193.28:0/4207236251 shutdown_connections 2026-02-20T13:19:03.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:03.307+0000 7f838e26f640 1 -- 10.20.193.28:0/4207236251 wait complete. 2026-02-20T13:19:03.409 INFO:tasks.cephfs.filesystem:scrub status for tag:a2152168-91c4-42bf-a9fa-9c45db8a05d3 - {'path': '/', 'tag': 'a2152168-91c4-42bf-a9fa-9c45db8a05d3', 'options': 'recursive,force'} 2026-02-20T13:19:03.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:03 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:19:03.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:03 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:19:03.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:03 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:03 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:19:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:03 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:03 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:03.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:03 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:19:03.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:03 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:19:03.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:03 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:03.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:03 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:19:03.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:03 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:03.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:03 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:03.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:03 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:19:03.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:03 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:19:03.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:03 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:03.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:03 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:19:03.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:03 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:03.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:03 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:04 trial028 ceph-mon[37442]: pgmap v233: 97 pgs: 97 active+clean; 988 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:19:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:04 trial127 ceph-mon[43817]: pgmap v233: 97 pgs: 97 active+clean; 988 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:19:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:04 trial034 ceph-mon[43332]: pgmap v233: 97 pgs: 97 active+clean; 988 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:19:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:06 trial028 ceph-mon[37442]: pgmap v234: 97 pgs: 97 active+clean; 988 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:06 trial127 ceph-mon[43817]: pgmap v234: 97 pgs: 97 active+clean; 988 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:06 trial034 ceph-mon[43332]: pgmap v234: 97 pgs: 97 active+clean; 988 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:08 trial028 ceph-mon[37442]: pgmap v235: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:19:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:19:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:08 trial127 ceph-mon[43817]: pgmap v235: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:19:08.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:19:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:08 trial034 ceph-mon[43332]: pgmap v235: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:19:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:19:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:09 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:19:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:09 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:19:09.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:09 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:19:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:09 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:19:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:09 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:19:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:09 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:19:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:10 trial028 ceph-mon[37442]: pgmap v236: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:10 trial127 ceph-mon[43817]: pgmap v236: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:10 trial034 ceph-mon[43332]: pgmap v236: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:12 trial028 ceph-mon[37442]: pgmap v237: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:12 trial127 ceph-mon[43817]: pgmap v237: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:12.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:12 trial034 ceph-mon[43332]: pgmap v237: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:13.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 -- 10.20.193.28:0/3027702367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fee281100b0 msgr2=0x7fee281104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 --2- 10.20.193.28:0/3027702367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fee281100b0 0x7fee281104a0 secure :-1 s=READY pgs=168 gs=3 cs=0 l=1 c_cookie=11051119091452158687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c0098c0 tx=0x7fee1c02f0c0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 -- 10.20.193.28:0/3027702367 shutdown_connections 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 --2- 10.20.193.28:0/3027702367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2810e940 0x7fee2810edb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 --2- 10.20.193.28:0/3027702367 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fee2810f2f0 0x7fee28171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 --2- 10.20.193.28:0/3027702367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fee281100b0 0x7fee281104a0 unknown :-1 s=CLOSED pgs=168 gs=3 cs=0 l=1 c_cookie=11051119091452158687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 -- 10.20.193.28:0/3027702367 >> 10.20.193.28:0/3027702367 conn(0x7fee280ec320 msgr2=0x7fee2810c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 -- 10.20.193.28:0/3027702367 shutdown_connections 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.222+0000 7fee27fff640 1 -- 10.20.193.28:0/3027702367 wait complete. 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee27fff640 1 Processor -- start 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee27fff640 1 -- start start 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee27fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2810e940 0x7fee280f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee27fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fee2810f2f0 0x7fee28171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee27fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fee281100b0 0x7fee280f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee27fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fee280f96a0 con 0x7fee2810e940 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee27fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fee280f9810 con 0x7fee281100b0 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee27fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fee280f99d0 con 0x7fee2810f2f0 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee26ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2810e940 0x7fee280f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee26ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2810e940 0x7fee280f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34294/0 (socket says 10.20.193.28:34294) 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee26ffd640 1 -- 10.20.193.28:0/2522378450 learned_addr learned my addr 10.20.193.28:0/2522378450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee267fc640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fee2810f2f0 0x7fee28171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee277fe640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fee281100b0 0x7fee280f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee26ffd640 1 -- 10.20.193.28:0/2522378450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fee2810f2f0 msgr2=0x7fee28171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee26ffd640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fee2810f2f0 0x7fee28171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee26ffd640 1 -- 10.20.193.28:0/2522378450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fee281100b0 msgr2=0x7fee280f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee26ffd640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fee281100b0 0x7fee280f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.223+0000 7fee26ffd640 1 -- 10.20.193.28:0/2522378450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee10009570 con 0x7fee2810e940 2026-02-20T13:19:13.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.224+0000 7fee26ffd640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2810e940 0x7fee280f8250 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c0099c0 tx=0x7fee1c02fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:13.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.224+0000 7fee2c90a640 1 -- 10.20.193.28:0/2522378450 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee1c03d070 con 0x7fee2810e940 2026-02-20T13:19:13.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.224+0000 7fee2c90a640 1 -- 10.20.193.28:0/2522378450 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee1c005d40 con 0x7fee2810e940 2026-02-20T13:19:13.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.224+0000 7fee27fff640 1 -- 10.20.193.28:0/2522378450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1c0094b0 con 0x7fee2810e940 2026-02-20T13:19:13.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.224+0000 7fee2c90a640 1 -- 10.20.193.28:0/2522378450 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee1c041ba0 con 0x7fee2810e940 2026-02-20T13:19:13.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.224+0000 7fee27fff640 1 -- 10.20.193.28:0/2522378450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee280f9f80 con 0x7fee2810e940 2026-02-20T13:19:13.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.227+0000 7fee2c90a640 1 -- 10.20.193.28:0/2522378450 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fee1c0386e0 con 0x7fee2810e940 2026-02-20T13:19:13.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.228+0000 7fee2c90a640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fedfc0b5760 0x7fedfc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.228+0000 7fee2c90a640 1 -- 10.20.193.28:0/2522378450 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fee1c10b8e0 con 0x7fee2810e940 2026-02-20T13:19:13.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.228+0000 7fee267fc640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fedfc0b5760 0x7fedfc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee267fc640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fedfc0b5760 0x7fedfc0d5c10 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee10005b30 tx=0x7fee10009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:13.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee3001be00 1 Processor -- start 2026-02-20T13:19:13.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee3001be00 1 -- start start 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee3001be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a098a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee3001be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a2a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee3001be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a4aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee3001be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555aa58fefd0 con 0x555aa5a09de0 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee3001be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555aa58fad00 con 0x555aa5a2a700 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee3001be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555aa58f4ca0 con 0x555aa59e94c0 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee26ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee267fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a2a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee26ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:46430/0 (socket says 10.20.193.28:46430) 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.229+0000 7fee26ffd640 1 -- 10.20.193.28:0/3829379849 learned_addr learned my addr 10.20.193.28:0/3829379849 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee277fe640 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a4aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee26ffd640 1 -- 10.20.193.28:0/3829379849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 msgr2=0x555aa5a4aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee26ffd640 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a4aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee26ffd640 1 -- 10.20.193.28:0/3829379849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 msgr2=0x555aa5a2a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee26ffd640 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a2a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee26ffd640 1 -- 10.20.193.28:0/3829379849 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa58978b0 con 0x555aa59e94c0 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee267fc640 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a2a1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee26ffd640 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a098a0 secure :-1 s=READY pgs=169 gs=2 cs=0 l=1 c_cookie=1423182682662472705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c1093b0 tx=0x7fee1c0415b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13c0291c0a958c01 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fedf37fe640 1 -- 10.20.193.28:0/3829379849 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee1c0d1440 con 0x555aa59e94c0 2026-02-20T13:19:13.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fedf37fe640 1 -- 10.20.193.28:0/3829379849 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee1c0d2640 con 0x555aa59e94c0 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fedf37fe640 1 -- 10.20.193.28:0/3829379849 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee1c038e90 con 0x555aa59e94c0 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 -- 10.20.193.28:0/3829379849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 msgr2=0x555aa5a098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a098a0 secure :-1 s=READY pgs=169 gs=2 cs=0 l=1 c_cookie=1423182682662472705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c1093b0 tx=0x7fee1c0415b0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 -- 10.20.193.28:0/3829379849 shutdown_connections 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a2a1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a4aae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 --2- 10.20.193.28:0/3829379849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a098a0 unknown :-1 s=CLOSED pgs=169 gs=2 cs=0 l=1 c_cookie=1423182682662472705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 -- 10.20.193.28:0/3829379849 >> 10.20.193.28:0/3829379849 conn(0x555aa59081c0 msgr2=0x555aa59e7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 -- 10.20.193.28:0/3829379849 shutdown_connections 2026-02-20T13:19:13.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.230+0000 7fee3001be00 1 -- 10.20.193.28:0/3829379849 wait complete. 2026-02-20T13:19:13.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.232+0000 7fee3001be00 1 -- start start 2026-02-20T13:19:13.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.232+0000 7fee3001be00 1 Processor -- start 2026-02-20T13:19:13.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.232+0000 7fee3001be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a028c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.232+0000 7fee3001be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a02f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.232+0000 7fee3001be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a03970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.232+0000 7fee3001be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555aa5a03fd0 con 0x555aa5a09de0 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.232+0000 7fee3001be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555aa5a04140 con 0x555aa5a2a700 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.232+0000 7fee3001be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555aa5a04300 con 0x555aa59e94c0 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee277fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a03970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a028c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:46442/0 (socket says 10.20.193.28:46442) 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 -- 10.20.193.28:0/316782546 learned_addr learned my addr 10.20.193.28:0/316782546 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee267fc640 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a02f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 -- 10.20.193.28:0/316782546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 msgr2=0x555aa5a03970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a03970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 -- 10.20.193.28:0/316782546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 msgr2=0x555aa5a02f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a02f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 -- 10.20.193.28:0/316782546 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa58a0400 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee26ffd640 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a028c0 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=12258933431208496380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c0d1bd0 tx=0x7fee1c038bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa207b014c57ccfc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fedf0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fedf0ff9640 1 -- 10.20.193.28:0/316782546 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee1c038e70 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fedf0ff9640 1 -- 10.20.193.28:0/316782546 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee1c0d1440 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee280f9f80 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fedf0ff9640 1 -- 10.20.193.28:0/316782546 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee1c0d2b50 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee3001be00 10 client.26068 _ll_register_callbacks cb 0x555aa587fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555aa5594520 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.233+0000 7fedf0ff9640 1 -- 10.20.193.28:0/316782546 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fee1c0d3630 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fedf0ff9640 1 -- 10.20.193.28:0/316782546 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee1c0d3850 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee3001be00 10 client.26068 fetch_fsmap learned FSMap version 27 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=27}) -- 0x555aa5878da0 con 0x555aa59e94c0 2026-02-20T13:19:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fedf0ff9640 1 -- 10.20.193.28:0/316782546 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7fee1c090bc0 con 0x555aa59e94c0 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee3001be00 10 client.26068 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee3001be00 10 client.26068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee3001be00 20 client.26068 populate_metadata read hostname 'trial028' 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee3001be00 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555aa5a06ce0 0x555aa5a07180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee3001be00 4 client.26068 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aa5926630 con 0x555aa5a06ce0 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.234+0000 7fee267fc640 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555aa5a06ce0 0x555aa5a07180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee267fc640 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555aa5a06ce0 0x555aa5a07180 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=15701333552949268647 s_cookie=5426908391470284198 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e657ad5b7690a7 server_cookie=4b50406dd62c3da6 in_seq=0 out_seq=0 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fedf0ff9640 10 client.26068 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fedf0ff9640 1 -- 10.20.193.28:0/316782546 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555aa5926630 con 0x555aa5a06ce0 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fedf0ff9640 10 client.26068 handle_command_reply: tid=0 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 client.26068 shutdown 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 msgr2=0x555aa5a028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a028c0 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=12258933431208496380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c0d1bd0 tx=0x7fee1c038bf0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 shutdown_connections 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555aa5a06ce0 0x555aa5a07180 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=15701333552949268647 s_cookie=5426908391470284198 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a02f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a03970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 --2- 10.20.193.28:0/316782546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a028c0 unknown :-1 s=CLOSED pgs=170 gs=1 cs=0 l=1 c_cookie=12258933431208496380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fedf0ff9640 0 client.26068 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 >> 10.20.193.28:0/316782546 conn(0x555aa59081c0 msgr2=0x555aa59ea790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:13.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 shutdown_connections 2026-02-20T13:19:13.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 1 -- 10.20.193.28:0/316782546 wait complete. 2026-02-20T13:19:13.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.235+0000 7fee3001be00 20 client.26068 trim_cache size 0 max 16384 2026-02-20T13:19:13.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee3001be00 1 Processor -- start 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee3001be00 1 -- start start 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee3001be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a285c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee3001be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a28b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee3001be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a29040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee3001be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555aa58f28d0 con 0x555aa5a09de0 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee3001be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555aa5633f10 con 0x555aa5a2a700 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee3001be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555aa58fefd0 con 0x555aa59e94c0 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee267fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a28b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee267fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a28b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34332/0 (socket says 10.20.193.28:34332) 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee267fc640 1 -- 10.20.193.28:0/4253064768 learned_addr learned my addr 10.20.193.28:0/4253064768 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee26ffd640 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee277fe640 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a29040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee267fc640 1 -- 10.20.193.28:0/4253064768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 msgr2=0x555aa5a285c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee267fc640 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a285c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.243+0000 7fee267fc640 1 -- 10.20.193.28:0/4253064768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 msgr2=0x555aa5a29040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee267fc640 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a29040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee267fc640 1 -- 10.20.193.28:0/4253064768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa588a670 con 0x555aa5a09de0 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee277fe640 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a29040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee267fc640 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a28b00 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=5276375574049726783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee10005e70 tx=0x7fee10014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493973a110c8213f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fedf2ffd640 1 -- 10.20.193.28:0/4253064768 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee10021040 con 0x555aa5a09de0 2026-02-20T13:19:13.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fedf2ffd640 1 -- 10.20.193.28:0/4253064768 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee10029190 con 0x555aa5a09de0 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fedf2ffd640 1 -- 10.20.193.28:0/4253064768 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee1001b790 con 0x555aa5a09de0 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 -- 10.20.193.28:0/4253064768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 msgr2=0x555aa5a28b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a28b00 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=5276375574049726783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee10005e70 tx=0x7fee10014000 comp rx=0 tx=0).stop 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 -- 10.20.193.28:0/4253064768 shutdown_connections 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a09de0 0x555aa5a28b00 unknown :-1 s=CLOSED pgs=492 gs=1 cs=0 l=1 c_cookie=5276375574049726783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa5a2a700 0x555aa5a29040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 --2- 10.20.193.28:0/4253064768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa59e94c0 0x555aa5a285c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 -- 10.20.193.28:0/4253064768 >> 10.20.193.28:0/4253064768 conn(0x555aa59081c0 msgr2=0x555aa59febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 -- 10.20.193.28:0/4253064768 shutdown_connections 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.244+0000 7fee3001be00 1 -- 10.20.193.28:0/4253064768 wait complete. 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.245+0000 7fee3001be00 1 -- start start 2026-02-20T13:19:13.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.245+0000 7fee3001be00 1 Processor -- start 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.245+0000 7fee3001be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa59e94c0 0x555aa5a0f910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.245+0000 7fee3001be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa5a09de0 0x555aa5a0fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.245+0000 7fee3001be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a2a700 0x555aa5a0e620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.245+0000 7fee3001be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555aa5a0ecc0 con 0x555aa5a2a700 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.245+0000 7fee3001be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555aa5a0ee30 con 0x555aa59e94c0 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.245+0000 7fee3001be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555aa5a0eff0 con 0x555aa5a09de0 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a2a700 0x555aa5a0e620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a2a700 0x555aa5a0e620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34334/0 (socket says 10.20.193.28:34334) 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 -- 10.20.193.28:0/1546726196 learned_addr learned my addr 10.20.193.28:0/1546726196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee26ffd640 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa59e94c0 0x555aa5a0f910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee267fc640 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa5a09de0 0x555aa5a0fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 -- 10.20.193.28:0/1546726196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa5a09de0 msgr2=0x555aa5a0fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa5a09de0 0x555aa5a0fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 -- 10.20.193.28:0/1546726196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa59e94c0 msgr2=0x555aa5a0f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa59e94c0 0x555aa5a0f910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 -- 10.20.193.28:0/1546726196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa58850f0 con 0x555aa5a2a700 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee277fe640 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a2a700 0x555aa5a0e620 secure :-1 s=READY pgs=493 gs=3 cs=0 l=1 c_cookie=11620645654182122978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee18005820 tx=0x7fee18014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a144d3a7563655e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fedf0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fedf0ff9640 1 -- 10.20.193.28:0/1546726196 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee18019070 con 0x555aa5a2a700 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fedf0ff9640 1 -- 10.20.193.28:0/1546726196 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee18012d60 con 0x555aa5a2a700 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fedf0ff9640 1 -- 10.20.193.28:0/1546726196 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee18011e70 con 0x555aa5a2a700 2026-02-20T13:19:13.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee10009dc0 con 0x555aa5a2a700 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fedf0ff9640 1 -- 10.20.193.28:0/1546726196 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fee1801d3c0 con 0x555aa5a2a700 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.246+0000 7fedf0ff9640 10 client.16137 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 10 client.16137 _ll_register_callbacks cb 0x555aa587fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555aa59a4ca0 con 0x555aa5a2a700 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fedf0ff9640 1 -- 10.20.193.28:0/1546726196 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee18012ed0 con 0x555aa5a2a700 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 10 client.16137 fetch_fsmap learned FSMap version 27 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x555aa58790d0 con 0x555aa5a2a700 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fedf0ff9640 1 -- 10.20.193.28:0/1546726196 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7fee18025060 con 0x555aa5a2a700 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 10 client.16137 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 20 client.16137 populate_metadata read hostname 'trial028' 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555aa5ad7ab0 0x555aa5af7f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:13.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 4 client.16137 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:19:13.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555aa55d8640 con 0x555aa5ad7ab0 2026-02-20T13:19:13.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.247+0000 7fee26ffd640 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555aa5ad7ab0 0x555aa5af7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:13.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.248+0000 7fee26ffd640 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555aa5ad7ab0 0x555aa5af7f60 crc :-1 s=READY pgs=87 gs=4 cs=0 l=0 c_cookie=7314009747231515070 s_cookie=15735765967472160004 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6580951d237aa1be server_cookie=da60abc697dbed04 in_seq=0 out_seq=0 2026-02-20T13:19:13.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.248+0000 7fedf0ff9640 10 client.16137 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:13.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fedf0ff9640 1 -- 10.20.193.28:0/1546726196 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555aa55d8640 con 0x555aa5ad7ab0 2026-02-20T13:19:13.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fedf0ff9640 10 client.16137 handle_command_reply: tid=0 2026-02-20T13:19:13.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 client.16137 shutdown 2026-02-20T13:19:13.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a2a700 msgr2=0x555aa5a0e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a2a700 0x555aa5a0e620 secure :-1 s=READY pgs=493 gs=3 cs=0 l=1 c_cookie=11620645654182122978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee18005820 tx=0x7fee18014830 comp rx=0 tx=0).stop 2026-02-20T13:19:13.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 shutdown_connections 2026-02-20T13:19:13.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555aa5ad7ab0 0x555aa5af7f60 crc :-1 s=READY pgs=87 gs=4 cs=0 l=0 c_cookie=7314009747231515070 s_cookie=15735765967472160004 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555aa5a2a700 0x555aa5a0e620 unknown :-1 s=CLOSED pgs=493 gs=3 cs=0 l=1 c_cookie=11620645654182122978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555aa5a09de0 0x555aa5a0fe50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 --2- 10.20.193.28:0/1546726196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555aa59e94c0 0x555aa5a0f910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 >> 10.20.193.28:0/1546726196 conn(0x555aa59081c0 msgr2=0x555aa59ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fedf0ff9640 0 client.16137 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 shutdown_connections 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 1 -- 10.20.193.28:0/1546726196 wait complete. 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.252+0000 7fee3001be00 20 client.16137 trim_cache size 0 max 16384 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:19:13.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:19:13.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:19:13.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:19:13.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 -- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fedfc0b5760 msgr2=0x7fedfc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fedfc0b5760 0x7fedfc0d5c10 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee10005b30 tx=0x7fee10009310 comp rx=0 tx=0).stop 2026-02-20T13:19:13.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 -- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2810e940 msgr2=0x7fee280f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2810e940 0x7fee280f8250 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c0099c0 tx=0x7fee1c02fb50 comp rx=0 tx=0).stop 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 -- 10.20.193.28:0/2522378450 shutdown_connections 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fedfc0b5760 0x7fedfc0d5c10 unknown :-1 s=CLOSED pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fee281100b0 0x7fee280f8ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fee2810f2f0 0x7fee28171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 --2- 10.20.193.28:0/2522378450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2810e940 0x7fee280f8250 unknown :-1 s=CLOSED pgs=491 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 -- 10.20.193.28:0/2522378450 >> 10.20.193.28:0/2522378450 conn(0x7fee280ec320 msgr2=0x7fee280ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 -- 10.20.193.28:0/2522378450 shutdown_connections 2026-02-20T13:19:13.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:13.253+0000 7fee27fff640 1 -- 10.20.193.28:0/2522378450 wait complete. 2026-02-20T13:19:14.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:14 trial028 ceph-mon[37442]: pgmap v238: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:19:14.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:14 trial127 ceph-mon[43817]: pgmap v238: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:19:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:14 trial034 ceph-mon[43332]: pgmap v238: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:19:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:16 trial028 ceph-mon[37442]: pgmap v239: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:19:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:16 trial127 ceph-mon[43817]: pgmap v239: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:19:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:16 trial034 ceph-mon[43332]: pgmap v239: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:19:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:18 trial028 ceph-mon[37442]: pgmap v240: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:19:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:18 trial127 ceph-mon[43817]: pgmap v240: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:19:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:18 trial034 ceph-mon[43332]: pgmap v240: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:19:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:20 trial127 ceph-mon[43817]: pgmap v241: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:20 trial034 ceph-mon[43332]: pgmap v241: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:20 trial028 ceph-mon[37442]: pgmap v241: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:22 trial127 ceph-mon[43817]: pgmap v242: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:22 trial034 ceph-mon[43332]: pgmap v242: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:23.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:22 trial028 ceph-mon[37442]: pgmap v242: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:24 trial127 ceph-mon[43817]: pgmap v243: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:24 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:19:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:24 trial034 ceph-mon[43332]: pgmap v243: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:24 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:19:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:24 trial028 ceph-mon[37442]: pgmap v243: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:24 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:19:26.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/573095276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810d4b0 msgr2=0x7fcc2816f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/573095276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810d4b0 0x7fcc2816f240 secure :-1 s=READY pgs=494 gs=3 cs=0 l=1 c_cookie=16412471219777280369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2400aa60 tx=0x7fcc24030270 comp rx=0 tx=0).stop 2026-02-20T13:19:26.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/573095276 shutdown_connections 2026-02-20T13:19:26.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/573095276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810d4b0 0x7fcc2816f240 unknown :-1 s=CLOSED pgs=494 gs=3 cs=0 l=1 c_cookie=16412471219777280369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/573095276 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc2810cb00 0x7fcc2810cf70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/573095276 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc2810e270 0x7fcc2810e660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/573095276 >> 10.20.193.28:0/573095276 conn(0x7fcc280ea4c0 msgr2=0x7fcc2810a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:26.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/573095276 shutdown_connections 2026-02-20T13:19:26.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.327+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/573095276 wait complete. 2026-02-20T13:19:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2e3d2640 1 Processor -- start 2026-02-20T13:19:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2e3d2640 1 -- start start 2026-02-20T13:19:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2e3d2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc2810cb00 0x7fcc280f8640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2e3d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc2810d4b0 0x7fcc2816f220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2e3d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810e270 0x7fcc280f8e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2e3d2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcc280f9ae0 con 0x7fcc2810e270 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2e3d2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcc280f9c50 con 0x7fcc2810cb00 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2e3d2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcc280f9e10 con 0x7fcc2810d4b0 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2dbd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810e270 0x7fcc280f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2dbd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810e270 0x7fcc280f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46174/0 (socket says 10.20.193.28:46174) 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2dbd1640 1 -- 10.20.193.28:0/341924170 learned_addr learned my addr 10.20.193.28:0/341924170 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc2810cb00 0x7fcc280f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc2810d4b0 0x7fcc2816f220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2dbd1640 1 -- 10.20.193.28:0/341924170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc2810d4b0 msgr2=0x7fcc2816f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2dbd1640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc2810d4b0 0x7fcc2816f220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2dbd1640 1 -- 10.20.193.28:0/341924170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc2810cb00 msgr2=0x7fcc280f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2dbd1640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc2810cb00 0x7fcc280f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.328+0000 7fcc2dbd1640 1 -- 10.20.193.28:0/341924170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2400a650 con 0x7fcc2810e270 2026-02-20T13:19:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.329+0000 7fcc2dbd1640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810e270 0x7fcc280f8e80 secure :-1 s=READY pgs=495 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2400a360 tx=0x7fcc240039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.329+0000 7fcc167fc640 1 -- 10.20.193.28:0/341924170 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc2403e070 con 0x7fcc2810e270 2026-02-20T13:19:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.329+0000 7fcc167fc640 1 -- 10.20.193.28:0/341924170 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc24006eb0 con 0x7fcc2810e270 2026-02-20T13:19:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.329+0000 7fcc167fc640 1 -- 10.20.193.28:0/341924170 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc240429a0 con 0x7fcc2810e270 2026-02-20T13:19:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.329+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/341924170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc280fa090 con 0x7fcc2810e270 2026-02-20T13:19:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.329+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/341924170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc280fa4b0 con 0x7fcc2810e270 2026-02-20T13:19:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.332+0000 7fcc167fc640 1 -- 10.20.193.28:0/341924170 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcc24039c60 con 0x7fcc2810e270 2026-02-20T13:19:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.333+0000 7fcc167fc640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcc040b5760 0x7fcc040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.333+0000 7fcc167fc640 1 -- 10.20.193.28:0/341924170 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcc2410c600 con 0x7fcc2810e270 2026-02-20T13:19:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.334+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcc040b5760 0x7fcc040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.334+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcc040b5760 0x7fcc040d5c10 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc18004740 tx=0x7fcc18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.334+0000 7fcc31c48e00 1 Processor -- start 2026-02-20T13:19:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.334+0000 7fcc31c48e00 1 -- start start 2026-02-20T13:19:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787c24c0 0x555f787e28a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787e2de0 0x555f788031c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 0x555f78823ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555f786d7fd0 con 0x555f787c24c0 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555f786d3d00 con 0x555f787e2de0 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555f786cdca0 con 0x555f78803700 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787c24c0 0x555f787e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787c24c0 0x555f787e28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46188/0 (socket says 10.20.193.28:46188) 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 -- 10.20.193.28:0/3328269257 learned_addr learned my addr 10.20.193.28:0/3328269257 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2dbd1640 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 0x555f78823ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787e2de0 0x555f788031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 -- 10.20.193.28:0/3328269257 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 msgr2=0x555f78823ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 0x555f78823ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 -- 10.20.193.28:0/3328269257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787e2de0 msgr2=0x555f788031c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787e2de0 0x555f788031c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 -- 10.20.193.28:0/3328269257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f786708b0 con 0x555f787c24c0 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787c24c0 0x555f787e28a0 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=15581811402287090672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc18009c20 tx=0x7fcc18013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83db6ea16740bf0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcbf57fe640 1 -- 10.20.193.28:0/3328269257 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1801d460 con 0x555f787c24c0 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcbf57fe640 1 -- 10.20.193.28:0/3328269257 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc1801daa0 con 0x555f787c24c0 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.335+0000 7fcbf57fe640 1 -- 10.20.193.28:0/3328269257 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1801abf0 con 0x555f787c24c0 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3328269257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787c24c0 msgr2=0x555f787e28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787c24c0 0x555f787e28a0 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=15581811402287090672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc18009c20 tx=0x7fcc18013000 comp rx=0 tx=0).stop 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3328269257 shutdown_connections 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 0x555f78823ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787e2de0 0x555f788031c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3328269257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787c24c0 0x555f787e28a0 unknown :-1 s=CLOSED pgs=496 gs=1 cs=0 l=1 c_cookie=15581811402287090672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3328269257 >> 10.20.193.28:0/3328269257 conn(0x555f786e11c0 msgr2=0x555f787c0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:26.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3328269257 shutdown_connections 2026-02-20T13:19:26.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.336+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3328269257 wait complete. 2026-02-20T13:19:26.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.337+0000 7fcc31c48e00 1 -- start start 2026-02-20T13:19:26.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.337+0000 7fcc31c48e00 1 Processor -- start 2026-02-20T13:19:26.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787c24c0 0x555f787dbb40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787dc190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 0x555f787dcbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555f787dd250 con 0x555f787e2de0 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555f787dd3c0 con 0x555f787c24c0 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555f787dd580 con 0x555f78803700 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787dc190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787dc190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46202/0 (socket says 10.20.193.28:46202) 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/3375350791 learned_addr learned my addr 10.20.193.28:0/3375350791 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787c24c0 0x555f787dbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2dbd1640 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 0x555f787dcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/3375350791 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 msgr2=0x555f787dcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 0x555f787dcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787c24c0 msgr2=0x555f787dbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787c24c0 0x555f787dbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/3375350791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f78679400 con 0x555f787e2de0 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787c24c0 0x555f787dbb40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787dc190 secure :-1 s=READY pgs=497 gs=1 cs=0 l=1 c_cookie=3718038936749199904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1c004130 tx=0x7fcc1c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339920b6c601d220 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.338+0000 7fcbe27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcbe27fc640 1 -- 10.20.193.28:0/3375350791 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1c010670 con 0x555f787e2de0 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcbe27fc640 1 -- 10.20.193.28:0/3375350791 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc1c010cb0 con 0x555f787e2de0 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcbe27fc640 1 -- 10.20.193.28:0/3375350791 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1c00f3c0 con 0x555f787e2de0 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc180098c0 con 0x555f787e2de0 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcbe27fc640 1 -- 10.20.193.28:0/3375350791 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcc1c00f550 con 0x555f787e2de0 2026-02-20T13:19:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 10 client.16149 _ll_register_callbacks cb 0x555f78658a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f7836d520 con 0x555f787e2de0 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcbe27fc640 1 -- 10.20.193.28:0/3375350791 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc1c010e20 con 0x555f787e2de0 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 10 client.16149 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555f78651da0 con 0x555f787e2de0 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcbe27fc640 1 -- 10.20.193.28:0/3375350791 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcc1c025020 con 0x555f787e2de0 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 10 client.16149 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 20 client.16149 populate_metadata read hostname 'trial028' 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555f787e0280 0x555f787e0720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 4 client.16149 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.339+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f786ff630 con 0x555f787e0280 2026-02-20T13:19:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.340+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555f787e0280 0x555f787e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.340+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555f787e0280 0x555f787e0720 crc :-1 s=READY pgs=88 gs=4 cs=0 l=0 c_cookie=825911389043239864 s_cookie=14288301954603717055 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b763a084fdf2bb8 server_cookie=c64a3eeccfac91bf in_seq=0 out_seq=0 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.340+0000 7fcbe27fc640 10 client.16149 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcbe27fc640 1 -- 10.20.193.28:0/3375350791 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555f786ff630 con 0x555f787e0280 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcbe27fc640 10 client.16149 handle_command_reply: tid=0 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 client.16149 shutdown 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 msgr2=0x555f787dc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787dc190 secure :-1 s=READY pgs=497 gs=1 cs=0 l=1 c_cookie=3718038936749199904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1c004130 tx=0x7fcc1c009920 comp rx=0 tx=0).stop 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 shutdown_connections 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555f787e0280 0x555f787e0720 crc :-1 s=READY pgs=88 gs=4 cs=0 l=0 c_cookie=825911389043239864 s_cookie=14288301954603717055 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787dc190 unknown :-1 s=CLOSED pgs=497 gs=1 cs=0 l=1 c_cookie=3718038936749199904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f78803700 0x555f787dcbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3375350791 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f787c24c0 0x555f787dbb40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 >> 10.20.193.28:0/3375350791 conn(0x555f786e11c0 msgr2=0x555f787c3790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcbe27fc640 0 client.16149 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 shutdown_connections 2026-02-20T13:19:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3375350791 wait complete. 2026-02-20T13:19:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.341+0000 7fcc31c48e00 20 client.16149 trim_cache size 0 max 16384 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc31c48e00 1 Processor -- start 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc31c48e00 1 -- start start 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787dc250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787d8e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 0x555f787d93b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555f786cb8d0 con 0x555f787e2de0 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555f7840cf10 con 0x555f78803700 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555f787c9250 con 0x555f787c24c0 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787d8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2d3d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787dc250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787d8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46204/0 (socket says 10.20.193.28:46204) 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2d3d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787dc250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48082/0 (socket says 10.20.193.28:48082) 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/3624950888 learned_addr learned my addr 10.20.193.28:0/3624950888 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2dbd1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 0x555f787d93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/3624950888 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 msgr2=0x555f787dc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/3624950888 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787dc250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/3624950888 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 msgr2=0x555f787d93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/3624950888 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 0x555f787d93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/3624950888 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f78663670 con 0x555f787e2de0 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/3624950888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787d8e70 secure :-1 s=READY pgs=498 gs=2 cs=0 l=1 c_cookie=16508650596716520355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1c012550 tx=0x7fcc1c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51a82404a5423a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:26.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.349+0000 7fcbf4ffd640 1 -- 10.20.193.28:0/3624950888 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1c00f3c0 con 0x555f787e2de0 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcbf4ffd640 1 -- 10.20.193.28:0/3624950888 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555f7836d520 con 0x555f787e2de0 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcbf4ffd640 1 -- 10.20.193.28:0/3624950888 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1c01ae60 con 0x555f787e2de0 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3624950888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 msgr2=0x555f787d8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3624950888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787d8e70 secure :-1 s=READY pgs=498 gs=2 cs=0 l=1 c_cookie=16508650596716520355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1c012550 tx=0x7fcc1c01f000 comp rx=0 tx=0).stop 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3624950888 shutdown_connections 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3624950888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787d8e70 unknown :-1 s=CLOSED pgs=498 gs=2 cs=0 l=1 c_cookie=16508650596716520355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3624950888 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 0x555f787d93b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/3624950888 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787dc250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3624950888 >> 10.20.193.28:0/3624950888 conn(0x555f786e11c0 msgr2=0x555f787dbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3624950888 shutdown_connections 2026-02-20T13:19:26.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 -- 10.20.193.28:0/3624950888 wait complete. 2026-02-20T13:19:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 -- start start 2026-02-20T13:19:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.350+0000 7fcc31c48e00 1 Processor -- start 2026-02-20T13:19:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787e1f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787e25e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc31c48e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 0x555f787e3320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555f787e39d0 con 0x555f787e2de0 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555f787e3b40 con 0x555f78803700 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc31c48e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555f787e3d00 con 0x555f787c24c0 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787e25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2d3d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2dbd1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 0x555f787e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787e25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46210/0 (socket says 10.20.193.28:46210) 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/2388771884 learned_addr learned my addr 10.20.193.28:0/2388771884 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787e1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48098/0 (socket says 10.20.193.28:48098) 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/2388771884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 msgr2=0x555f787e1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787e1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/2388771884 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 msgr2=0x555f787e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 0x555f787e3320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 -- 10.20.193.28:0/2388771884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f7865e0f0 con 0x555f787e2de0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcc2cbcf640 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787e25e0 secure :-1 s=READY pgs=499 gs=1 cs=0 l=1 c_cookie=16820951865880884852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1c004130 tx=0x7fcc1c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9700699cdc63674 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcbe27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.351+0000 7fcbe27fc640 1 -- 10.20.193.28:0/2388771884 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1c01bcd0 con 0x555f787e2de0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcbe27fc640 1 -- 10.20.193.28:0/2388771884 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc1c01be30 con 0x555f787e2de0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcbe27fc640 1 -- 10.20.193.28:0/2388771884 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1c00d780 con 0x555f787e2de0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f78651da0 con 0x555f787e2de0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcbe27fc640 1 -- 10.20.193.28:0/2388771884 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcc1c00d910 con 0x555f787e2de0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 10 client.16155 _ll_register_callbacks cb 0x555f787c0d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f7877dca0 con 0x555f787e2de0 2026-02-20T13:19:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcbe27fc640 1 -- 10.20.193.28:0/2388771884 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc1c010670 con 0x555f787e2de0 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 10 client.16155 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555f786520d0 con 0x555f787e2de0 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcbe27fc640 1 -- 10.20.193.28:0/2388771884 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcc1c025070 con 0x555f787e2de0 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 10 client.16155 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 20 client.16155 populate_metadata read hostname 'trial028' 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555f787e59c0 0x555f787e5e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 4 client.16155 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555f783b1640 con 0x555f787e59c0 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.352+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555f787e59c0 0x555f787e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.353+0000 7fcc2d3d0640 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555f787e59c0 0x555f787e5e60 crc :-1 s=READY pgs=89 gs=4 cs=0 l=0 c_cookie=8671983726812174203 s_cookie=6606875016953146532 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78591340de9b977b server_cookie=5bb055d2bce52ca4 in_seq=0 out_seq=0 2026-02-20T13:19:26.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.353+0000 7fcbe27fc640 10 client.16155 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcbe27fc640 1 -- 10.20.193.28:0/2388771884 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555f783b1640 con 0x555f787e59c0 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcbe27fc640 10 client.16155 handle_command_reply: tid=0 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 client.16155 shutdown 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 msgr2=0x555f787e25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787e25e0 secure :-1 s=READY pgs=499 gs=1 cs=0 l=1 c_cookie=16820951865880884852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1c004130 tx=0x7fcc1c009260 comp rx=0 tx=0).stop 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 shutdown_connections 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555f787e59c0 0x555f787e5e60 crc :-1 s=READY pgs=89 gs=4 cs=0 l=0 c_cookie=8671983726812174203 s_cookie=6606875016953146532 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f787e2de0 0x555f787e25e0 unknown :-1 s=CLOSED pgs=499 gs=1 cs=0 l=1 c_cookie=16820951865880884852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555f78803700 0x555f787e3320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 --2- 10.20.193.28:0/2388771884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555f787c24c0 0x555f787e1f40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 >> 10.20.193.28:0/2388771884 conn(0x555f786e11c0 msgr2=0x555f787dc160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:26.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.357+0000 7fcbe27fc640 0 client.16155 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:26.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 shutdown_connections 2026-02-20T13:19:26.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc31c48e00 1 -- 10.20.193.28:0/2388771884 wait complete. 2026-02-20T13:19:26.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc31c48e00 20 client.16155 trim_cache size 0 max 16384 2026-02-20T13:19:26.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:19:26.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:19:26.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:19:26.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:19:26.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcc040b5760 msgr2=0x7fcc040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcc040b5760 0x7fcc040d5c10 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc18004740 tx=0x7fcc18005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810e270 msgr2=0x7fcc280f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810e270 0x7fcc280f8e80 secure :-1 s=READY pgs=495 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2400a360 tx=0x7fcc240039b0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/341924170 shutdown_connections 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcc040b5760 0x7fcc040d5c10 unknown :-1 s=CLOSED pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc2810e270 0x7fcc280f8e80 unknown :-1 s=CLOSED pgs=495 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc2810d4b0 0x7fcc2816f220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 --2- 10.20.193.28:0/341924170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc2810cb00 0x7fcc280f8640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/341924170 >> 10.20.193.28:0/341924170 conn(0x7fcc280ea4c0 msgr2=0x7fcc28061720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/341924170 shutdown_connections 2026-02-20T13:19:26.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:26.358+0000 7fcc2e3d2640 1 -- 10.20.193.28:0/341924170 wait complete. 2026-02-20T13:19:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:26 trial127 ceph-mon[43817]: pgmap v244: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:26 trial034 ceph-mon[43332]: pgmap v244: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:27.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:26 trial028 ceph-mon[37442]: pgmap v244: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:19:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:28 trial127 ceph-mon[43817]: pgmap v245: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:19:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:28 trial034 ceph-mon[43332]: pgmap v245: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:19:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:28 trial028 ceph-mon[37442]: pgmap v245: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:19:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:30 trial127 ceph-mon[43817]: pgmap v246: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:19:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:30 trial034 ceph-mon[43332]: pgmap v246: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:19:31.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:30 trial028 ceph-mon[37442]: pgmap v246: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:19:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:32 trial127 ceph-mon[43817]: pgmap v247: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:32 trial034 ceph-mon[43332]: pgmap v247: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:33.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:32 trial028 ceph-mon[37442]: pgmap v247: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:19:33.410 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:19:33.598 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:33.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 -- 10.20.193.28:0/333193404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 msgr2=0x7f4768061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 --2- 10.20.193.28:0/333193404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 0x7f4768061380 secure :-1 s=READY pgs=500 gs=1 cs=0 l=1 c_cookie=8616223626289064584 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c009950 tx=0x7f475c02f190 comp rx=0 tx=0).stop 2026-02-20T13:19:33.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 -- 10.20.193.28:0/333193404 shutdown_connections 2026-02-20T13:19:33.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 --2- 10.20.193.28:0/333193404 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4768155a40 0x7f4768175e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 --2- 10.20.193.28:0/333193404 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f47680618c0 0x7f4768155500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 --2- 10.20.193.28:0/333193404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 0x7f4768061380 unknown :-1 s=CLOSED pgs=500 gs=1 cs=0 l=1 c_cookie=8616223626289064584 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 -- 10.20.193.28:0/333193404 >> 10.20.193.28:0/333193404 conn(0x7f47680eac10 msgr2=0x7f476810b020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:33.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 -- 10.20.193.28:0/333193404 shutdown_connections 2026-02-20T13:19:33.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.777+0000 7f476d6fc640 1 -- 10.20.193.28:0/333193404 wait complete. 2026-02-20T13:19:33.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.778+0000 7f476d6fc640 1 Processor -- start 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.778+0000 7f476d6fc640 1 -- start start 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.778+0000 7f476d6fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 0x7f476816a1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.778+0000 7f476d6fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47680618c0 0x7f476816a710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.778+0000 7f476d6fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4768155a40 0x7f476816fae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.778+0000 7f476d6fc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4768170100 con 0x7f4768060fb0 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.778+0000 7f476d6fc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4768170270 con 0x7f47680618c0 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.778+0000 7f476d6fc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4768170430 con 0x7f4768155a40 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 0x7f476816a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 0x7f476816a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56004/0 (socket says 10.20.193.28:56004) 2026-02-20T13:19:33.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 -- 10.20.193.28:0/3922650877 learned_addr learned my addr 10.20.193.28:0/3922650877 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f47667fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47680618c0 0x7f476816a710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f47677fe640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4768155a40 0x7f476816fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 -- 10.20.193.28:0/3922650877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4768155a40 msgr2=0x7f476816fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4768155a40 0x7f476816fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 -- 10.20.193.28:0/3922650877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47680618c0 msgr2=0x7f476816a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47680618c0 0x7f476816a710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 -- 10.20.193.28:0/3922650877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c009570 con 0x7f4768060fb0 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 0x7f476816a1d0 secure :-1 s=READY pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c005b30 tx=0x7f475c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4747fff640 1 -- 10.20.193.28:0/3922650877 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475c03d070 con 0x7f4768060fb0 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4747fff640 1 -- 10.20.193.28:0/3922650877 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f475c038920 con 0x7f4768060fb0 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f4747fff640 1 -- 10.20.193.28:0/3922650877 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475c0418a0 con 0x7f4768060fb0 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f476d6fc640 1 -- 10.20.193.28:0/3922650877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47681706b0 con 0x7f4768060fb0 2026-02-20T13:19:33.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.779+0000 7f476d6fc640 1 -- 10.20.193.28:0/3922650877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4768170df0 con 0x7f4768060fb0 2026-02-20T13:19:33.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.782+0000 7f4747fff640 1 -- 10.20.193.28:0/3922650877 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f475c048020 con 0x7f4768060fb0 2026-02-20T13:19:33.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.784+0000 7f4747fff640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f473c0b5760 0x7f473c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.784+0000 7f4747fff640 1 -- 10.20.193.28:0/3922650877 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f475c10adc0 con 0x7f4768060fb0 2026-02-20T13:19:33.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.784+0000 7f47667fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f473c0b5760 0x7f473c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.784+0000 7f47667fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f473c0b5760 0x7f473c0d5c10 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4768170b70 tx=0x7f4750005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:33.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.785+0000 7f476f6f6e00 1 Processor -- start 2026-02-20T13:19:33.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f476f6f6e00 1 -- start start 2026-02-20T13:19:33.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e2c550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e71400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 0x55ba45e91d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ba45d427d0 con 0x55ba45e2c180 2026-02-20T13:19:33.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ba45d3e500 con 0x55ba45e2ca90 2026-02-20T13:19:33.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ba45d384a0 con 0x55ba45e71940 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e2c550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e2c550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56008/0 (socket says 10.20.193.28:56008) 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 -- 10.20.193.28:0/2300863321 learned_addr learned my addr 10.20.193.28:0/2300863321 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f47667fc640 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e71400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f47677fe640 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 0x55ba45e91d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 -- 10.20.193.28:0/2300863321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 msgr2=0x55ba45e91d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 0x55ba45e91d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 -- 10.20.193.28:0/2300863321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 msgr2=0x55ba45e71400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e71400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 -- 10.20.193.28:0/2300863321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba45ce3d80 con 0x55ba45e2c180 2026-02-20T13:19:33.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f47667fc640 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e71400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.786+0000 7f4766ffd640 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e2c550 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=15406878263807979541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c005940 tx=0x7f475c0044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d03a26dbf63015 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f47337fe640 1 -- 10.20.193.28:0/2300863321 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475c0d1b20 con 0x55ba45e2c180 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f47337fe640 1 -- 10.20.193.28:0/2300863321 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f475c0d6e40 con 0x55ba45e2c180 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f47337fe640 1 -- 10.20.193.28:0/2300863321 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475c0d1db0 con 0x55ba45e2c180 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 -- 10.20.193.28:0/2300863321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 msgr2=0x55ba45e2c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e2c550 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=15406878263807979541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c005940 tx=0x7f475c0044b0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 -- 10.20.193.28:0/2300863321 shutdown_connections 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 0x55ba45e91d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e71400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/2300863321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e2c550 unknown :-1 s=CLOSED pgs=502 gs=1 cs=0 l=1 c_cookie=15406878263807979541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 -- 10.20.193.28:0/2300863321 >> 10.20.193.28:0/2300863321 conn(0x55ba45e0a680 msgr2=0x55ba45e2aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 -- 10.20.193.28:0/2300863321 shutdown_connections 2026-02-20T13:19:33.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.787+0000 7f476f6f6e00 1 -- 10.20.193.28:0/2300863321 wait complete. 2026-02-20T13:19:33.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.788+0000 7f476f6f6e00 1 -- start start 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f476f6f6e00 1 Processor -- start 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e44430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e44970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 0x55ba45e49960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ba45e49ea0 con 0x55ba45e2ca90 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ba45e4a010 con 0x55ba45e71940 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ba45e4a1d0 con 0x55ba45e2c180 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e44430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e44430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42018/0 (socket says 10.20.193.28:42018) 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f4766ffd640 1 -- 10.20.193.28:0/1030209145 learned_addr learned my addr 10.20.193.28:0/1030209145 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:33.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f47667fc640 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e44970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.789+0000 7f47677fe640 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 0x55ba45e49960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4766ffd640 1 -- 10.20.193.28:0/1030209145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 msgr2=0x55ba45e49960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4766ffd640 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 0x55ba45e49960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4766ffd640 1 -- 10.20.193.28:0/1030209145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 msgr2=0x55ba45e44970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4766ffd640 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e44970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4766ffd640 1 -- 10.20.193.28:0/1030209145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba45cbc350 con 0x55ba45e2c180 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f47667fc640 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e44970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4766ffd640 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e44430 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=17874763048959436794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c10b020 tx=0x7f475c0d6fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f80fea49d98167fa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4730ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4730ff9640 1 -- 10.20.193.28:0/1030209145 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475c0d9420 con 0x55ba45e2c180 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4768170df0 con 0x55ba45e2c180 2026-02-20T13:19:33.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4730ff9640 1 -- 10.20.193.28:0/1030209145 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f475c0cd390 con 0x55ba45e2c180 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f4730ff9640 1 -- 10.20.193.28:0/1030209145 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475c0d2b10 con 0x55ba45e2c180 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f476f6f6e00 10 client.26101 _ll_register_callbacks cb 0x55ba45cb99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.790+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ba459ce6f0 con 0x55ba45e2c180 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f4730ff9640 1 -- 10.20.193.28:0/1030209145 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f475c0d2c70 con 0x55ba45e2c180 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f4730ff9640 1 -- 10.20.193.28:0/1030209145 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f475c0db040 con 0x55ba45e2c180 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f476f6f6e00 10 client.26101 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ba45cce150 con 0x55ba45e2c180 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f4730ff9640 1 -- 10.20.193.28:0/1030209145 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f475c0ef020 con 0x55ba45e2c180 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f476f6f6e00 10 client.26101 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f476f6f6e00 10 client.26101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f476f6f6e00 20 client.26101 populate_metadata read hostname 'trial028' 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ba45e6e690 0x55ba45e6eb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f476f6f6e00 4 client.26101 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba45d45d60 con 0x55ba45e6e690 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.791+0000 7f47667fc640 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ba45e6e690 0x55ba45e6eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.792+0000 7f47667fc640 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ba45e6e690 0x55ba45e6eb30 crc :-1 s=READY pgs=90 gs=4 cs=0 l=0 c_cookie=9181374038365642015 s_cookie=12875421705647591543 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6acb0afac71d1f server_cookie=b2aeafd30a7a9077 in_seq=0 out_seq=0 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.792+0000 7f4730ff9640 10 client.26101 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.792+0000 7f4730ff9640 1 -- 10.20.193.28:0/1030209145 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ba45d45d60 con 0x55ba45e6e690 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.792+0000 7f4730ff9640 10 client.26101 handle_command_reply: tid=0 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.792+0000 7f476f6f6e00 1 client.26101 shutdown 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.792+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 msgr2=0x55ba45e44430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.792+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e44430 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=17874763048959436794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c10b020 tx=0x7f475c0d6fb0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 shutdown_connections 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ba45e6e690 0x55ba45e6eb30 crc :-1 s=READY pgs=90 gs=4 cs=0 l=0 c_cookie=9181374038365642015 s_cookie=12875421705647591543 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e44970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 0x55ba45e49960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/1030209145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e44430 unknown :-1 s=CLOSED pgs=171 gs=1 cs=0 l=1 c_cookie=17874763048959436794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f4730ff9640 0 client.26101 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:33.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 >> 10.20.193.28:0/1030209145 conn(0x55ba45e0a680 msgr2=0x55ba45e2b250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:33.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 shutdown_connections 2026-02-20T13:19:33.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 1 -- 10.20.193.28:0/1030209145 wait complete. 2026-02-20T13:19:33.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.793+0000 7f476f6f6e00 20 client.26101 trim_cache size 0 max 16384 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f476f6f6e00 1 Processor -- start 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f476f6f6e00 1 -- start start 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e44620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e48ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 0x55ba45e41800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ba45d360d0 con 0x55ba45e2c180 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ba459f6700 con 0x55ba45e2ca90 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ba45e3d4e0 con 0x55ba45e71940 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e44620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e44620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56022/0 (socket says 10.20.193.28:56022) 2026-02-20T13:19:33.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f4766ffd640 1 -- 10.20.193.28:0/3820830470 learned_addr learned my addr 10.20.193.28:0/3820830470 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f47677fe640 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 0x55ba45e41800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.802+0000 7f47667fc640 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e48ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4766ffd640 1 -- 10.20.193.28:0/3820830470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 msgr2=0x55ba45e41800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 0x55ba45e41800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4766ffd640 1 -- 10.20.193.28:0/3820830470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 msgr2=0x55ba45e48ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e48ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4766ffd640 1 -- 10.20.193.28:0/3820830470 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba45cc8bd0 con 0x55ba45e2c180 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f47667fc640 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e48ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e44620 secure :-1 s=READY pgs=503 gs=1 cs=0 l=1 c_cookie=4621965460993969310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c005ca0 tx=0x7f475c10a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402485193aab8c9e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4732ffd640 1 -- 10.20.193.28:0/3820830470 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475c0d9420 con 0x55ba45e2c180 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4732ffd640 1 -- 10.20.193.28:0/3820830470 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ba459ce6f0 con 0x55ba45e2c180 2026-02-20T13:19:33.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f4732ffd640 1 -- 10.20.193.28:0/3820830470 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475c0d1490 con 0x55ba45e2c180 2026-02-20T13:19:33.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3820830470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 msgr2=0x55ba45e44620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e44620 secure :-1 s=READY pgs=503 gs=1 cs=0 l=1 c_cookie=4621965460993969310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c005ca0 tx=0x7f475c10a000 comp rx=0 tx=0).stop 2026-02-20T13:19:33.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3820830470 shutdown_connections 2026-02-20T13:19:33.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e71940 0x55ba45e41800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e2ca90 0x55ba45e48ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3820830470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2c180 0x55ba45e44620 unknown :-1 s=CLOSED pgs=503 gs=1 cs=0 l=1 c_cookie=4621965460993969310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3820830470 >> 10.20.193.28:0/3820830470 conn(0x55ba45e0a680 msgr2=0x55ba45e487c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3820830470 shutdown_connections 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.803+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3820830470 wait complete. 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.804+0000 7f476f6f6e00 1 -- start start 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.804+0000 7f476f6f6e00 1 Processor -- start 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.804+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e4cbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.804+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e4d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.804+0000 7f476f6f6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 0x55ba45e482a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.804+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ba45e48830 con 0x55ba45e2ca90 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.804+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ba45e489a0 con 0x55ba45e71940 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.804+0000 7f476f6f6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ba45e48b60 con 0x55ba45e2c180 2026-02-20T13:19:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e4cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f47667fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e4d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f47677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 0x55ba45e482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f4766ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e4cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42036/0 (socket says 10.20.193.28:42036) 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f4766ffd640 1 -- 10.20.193.28:0/3923321200 learned_addr learned my addr 10.20.193.28:0/3923321200 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f47667fc640 1 -- 10.20.193.28:0/3923321200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 msgr2=0x55ba45e4cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f47667fc640 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e4cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f47667fc640 1 -- 10.20.193.28:0/3923321200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 msgr2=0x55ba45e482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f47667fc640 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 0x55ba45e482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f47667fc640 1 -- 10.20.193.28:0/3923321200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba45cbc680 con 0x55ba45e2ca90 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e4cbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f47667fc640 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e4d150 secure :-1 s=READY pgs=504 gs=3 cs=0 l=1 c_cookie=1481491591343403400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55ba45e6f130 tx=0x7f4750004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148f50c0c7c07188 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f4730ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f4730ff9640 1 -- 10.20.193.28:0/3923321200 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4750023040 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f4730ff9640 1 -- 10.20.193.28:0/3923321200 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f475001ede0 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f4730ff9640 1 -- 10.20.193.28:0/3923321200 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47500118f0 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.805+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4768170df0 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 10 client.16173 _ll_register_callbacks cb 0x55ba45cb99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f475c0d6e40 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f4730ff9640 1 -- 10.20.193.28:0/3923321200 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4750011a80 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f4730ff9640 1 -- 10.20.193.28:0/3923321200 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4750011c40 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 10 client.16173 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ba45cce3b0 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f4730ff9640 1 -- 10.20.193.28:0/3923321200 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f475002a4f0 con 0x55ba45e2ca90 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 10 client.16173 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 20 client.16173 populate_metadata read hostname 'trial028' 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ba45f2fae0 0x55ba45f4ff90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 4 client.16173 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba459cbf40 con 0x55ba45f2fae0 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.806+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ba45f2fae0 0x55ba45f4ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f4766ffd640 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ba45f2fae0 0x55ba45f4ff90 crc :-1 s=READY pgs=91 gs=4 cs=0 l=0 c_cookie=13518772036749694160 s_cookie=7920684021909811525 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9c538ab9f314d0 server_cookie=6debec27000bf145 in_seq=0 out_seq=0 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f4730ff9640 10 client.16173 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f4730ff9640 1 -- 10.20.193.28:0/3923321200 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55ba459cbf40 con 0x55ba45f2fae0 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f4730ff9640 10 client.16173 handle_command_reply: tid=0 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f476f6f6e00 1 client.16173 shutdown 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 msgr2=0x55ba45e4d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e4d150 secure :-1 s=READY pgs=504 gs=3 cs=0 l=1 c_cookie=1481491591343403400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55ba45e6f130 tx=0x7f4750004770 comp rx=0 tx=0).stop 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 shutdown_connections 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ba45f2fae0 0x55ba45f4ff90 crc :-1 s=READY pgs=91 gs=4 cs=0 l=0 c_cookie=13518772036749694160 s_cookie=7920684021909811525 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ba45e2ca90 0x55ba45e4d150 unknown :-1 s=CLOSED pgs=504 gs=3 cs=0 l=1 c_cookie=1481491591343403400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ba45e71940 0x55ba45e482a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f476f6f6e00 1 --2- 10.20.193.28:0/3923321200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ba45e2c180 0x55ba45e4cbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.807+0000 7f4730ff9640 0 client.16173 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 >> 10.20.193.28:0/3923321200 conn(0x55ba45e0a680 msgr2=0x55ba45e6fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 shutdown_connections 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476f6f6e00 1 -- 10.20.193.28:0/3923321200 wait complete. 2026-02-20T13:19:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476f6f6e00 20 client.16173 trim_cache size 0 max 16384 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:33.817 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:33.818 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:33.819 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:33.820 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:33.820 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:19:33.820 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:19:33.820 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:19:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 -- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f473c0b5760 msgr2=0x7f473c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f473c0b5760 0x7f473c0d5c10 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4768170b70 tx=0x7f4750005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 -- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 msgr2=0x7f476816a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 0x7f476816a1d0 secure :-1 s=READY pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c005b30 tx=0x7f475c004340 comp rx=0 tx=0).stop 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 -- 10.20.193.28:0/3922650877 shutdown_connections 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f473c0b5760 0x7f473c0d5c10 unknown :-1 s=CLOSED pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4768155a40 0x7f476816fae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47680618c0 0x7f476816a710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 --2- 10.20.193.28:0/3922650877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4768060fb0 0x7f476816a1d0 unknown :-1 s=CLOSED pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 -- 10.20.193.28:0/3922650877 >> 10.20.193.28:0/3922650877 conn(0x7f47680eac10 msgr2=0x7f476810aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.808+0000 7f476d6fc640 1 -- 10.20.193.28:0/3922650877 shutdown_connections 2026-02-20T13:19:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:33.809+0000 7f476d6fc640 1 -- 10.20.193.28:0/3922650877 wait complete. 2026-02-20T13:19:33.909 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:19:33.910 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:19:34.096 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:34.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 -- 10.20.193.28:0/2663329170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 msgr2=0x7fe420114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2663329170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 0x7fe420114c70 secure :-1 s=READY pgs=505 gs=1 cs=0 l=1 c_cookie=13266108047031537980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe408009950 tx=0x7fe40802f190 comp rx=0 tx=0).stop 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 -- 10.20.193.28:0/2663329170 shutdown_connections 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2663329170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 0x7fe420114c70 unknown :-1 s=CLOSED pgs=505 gs=1 cs=0 l=1 c_cookie=13266108047031537980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2663329170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe420115420 0x7fe420175df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2663329170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe42010f230 0x7fe42010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 -- 10.20.193.28:0/2663329170 >> 10.20.193.28:0/2663329170 conn(0x7fe42005f830 msgr2=0x7fe42010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 -- 10.20.193.28:0/2663329170 shutdown_connections 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.273+0000 7fe426b2f640 1 -- 10.20.193.28:0/2663329170 wait complete. 2026-02-20T13:19:34.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe426b2f640 1 Processor -- start 2026-02-20T13:19:34.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe426b2f640 1 -- start start 2026-02-20T13:19:34.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe426b2f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe42010f230 0x7fe4200f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe426b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 0x7fe420175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe426b2f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe420115420 0x7fe4200f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe426b2f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4200fae90 con 0x7fe42010fc20 2026-02-20T13:19:34.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe426b2f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe42010d440 con 0x7fe420115420 2026-02-20T13:19:34.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe426b2f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe4200fafd0 con 0x7fe42010f230 2026-02-20T13:19:34.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe417fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 0x7fe420175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe4248a4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe42010f230 0x7fe4200f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe4250a5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe420115420 0x7fe4200f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe4248a4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe42010f230 0x7fe4200f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42056/0 (socket says 10.20.193.28:42056) 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe4250a5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe420115420 0x7fe4200f5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58776/0 (socket says 10.20.193.28:58776) 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe4248a4640 1 -- 10.20.193.28:0/2834771124 learned_addr learned my addr 10.20.193.28:0/2834771124 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe417fff640 1 -- 10.20.193.28:0/2834771124 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe42010f230 msgr2=0x7fe4200f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe417fff640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe42010f230 0x7fe4200f5580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe417fff640 1 -- 10.20.193.28:0/2834771124 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe420115420 msgr2=0x7fe4200f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe417fff640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe420115420 0x7fe4200f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.274+0000 7fe417fff640 1 -- 10.20.193.28:0/2834771124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe408009570 con 0x7fe42010fc20 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.275+0000 7fe417fff640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 0x7fe420175cf0 secure :-1 s=READY pgs=506 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe40802f6a0 tx=0x7fe408004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:34.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.275+0000 7fe415ffb640 1 -- 10.20.193.28:0/2834771124 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe40803d070 con 0x7fe42010fc20 2026-02-20T13:19:34.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.275+0000 7fe415ffb640 1 -- 10.20.193.28:0/2834771124 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe408002ad0 con 0x7fe42010fc20 2026-02-20T13:19:34.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.275+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4200fb250 con 0x7fe42010fc20 2026-02-20T13:19:34.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.275+0000 7fe415ffb640 1 -- 10.20.193.28:0/2834771124 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4080418a0 con 0x7fe42010fc20 2026-02-20T13:19:34.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.275+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4200fb710 con 0x7fe42010fc20 2026-02-20T13:19:34.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.276+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe420110510 con 0x7fe42010fc20 2026-02-20T13:19:34.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.278+0000 7fe415ffb640 1 -- 10.20.193.28:0/2834771124 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe408038b40 con 0x7fe42010fc20 2026-02-20T13:19:34.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.279+0000 7fe415ffb640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3fc0b5750 0x7fe3fc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.279+0000 7fe415ffb640 1 -- 10.20.193.28:0/2834771124 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe40810b320 con 0x7fe42010fc20 2026-02-20T13:19:34.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.279+0000 7fe4248a4640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3fc0b5750 0x7fe3fc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.280+0000 7fe415ffb640 1 -- 10.20.193.28:0/2834771124 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe4080cdd80 con 0x7fe42010fc20 2026-02-20T13:19:34.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.280+0000 7fe4248a4640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3fc0b5750 0x7fe3fc0d5c00 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe41000b2c0 tx=0x7fe41000b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:34.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.423+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe42010f600 con 0x7fe42010fc20 2026-02-20T13:19:34.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.423+0000 7fe415ffb640 1 -- 10.20.193.28:0/2834771124 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fe4080d0f30 con 0x7fe42010fc20 2026-02-20T13:19:34.427 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:19:34.427 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:19:34.428 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:19:34.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3fc0b5750 msgr2=0x7fe3fc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3fc0b5750 0x7fe3fc0d5c00 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe41000b2c0 tx=0x7fe41000b4a0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 msgr2=0x7fe420175cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 0x7fe420175cf0 secure :-1 s=READY pgs=506 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe40802f6a0 tx=0x7fe408004270 comp rx=0 tx=0).stop 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 shutdown_connections 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3fc0b5750 0x7fe3fc0d5c00 unknown :-1 s=CLOSED pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe42010fc20 0x7fe420175cf0 unknown :-1 s=CLOSED pgs=506 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe420115420 0x7fe4200f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 --2- 10.20.193.28:0/2834771124 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe42010f230 0x7fe4200f5580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 >> 10.20.193.28:0/2834771124 conn(0x7fe42005f830 msgr2=0x7fe42010d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 shutdown_connections 2026-02-20T13:19:34.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.425+0000 7fe426b2f640 1 -- 10.20.193.28:0/2834771124 wait complete. 2026-02-20T13:19:34.526 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:19:34.713 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:34.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:34 trial028 ceph-mon[37442]: pgmap v248: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:34.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:34 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2834771124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:19:34.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:34 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:19:34.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/617002148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 msgr2=0x7f7f341108f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/617002148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 0x7f7f341108f0 secure :-1 s=READY pgs=507 gs=1 cs=0 l=1 c_cookie=1477734584398154129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f28009980 tx=0x7f7f2802f190 comp rx=0 tx=0).stop 2026-02-20T13:19:34.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/617002148 shutdown_connections 2026-02-20T13:19:34.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/617002148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 0x7f7f341108f0 unknown :-1 s=CLOSED pgs=507 gs=1 cs=0 l=1 c_cookie=1477734584398154129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/617002148 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f34110f10 0x7f7f341113b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/617002148 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f3410b930 0x7f7f3410bd00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/617002148 >> 10.20.193.28:0/617002148 conn(0x7f7f340e95c0 msgr2=0x7f7f341099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:34.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/617002148 shutdown_connections 2026-02-20T13:19:34.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/617002148 wait complete. 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.890+0000 7f7f3ae2e640 1 Processor -- start 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3ae2e640 1 -- start start 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3ae2e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f3410b930 0x7f7f34122430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3ae2e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 0x7f7f34122970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3ae2e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f34110f10 0x7f7f34127d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3ae2e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34128360 con 0x7f7f3410c320 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3ae2e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341284d0 con 0x7f7f3410b930 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3ae2e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34128690 con 0x7f7f34110f10 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f39e2c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f3410b930 0x7f7f34122430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3962b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 0x7f7f34122970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f39e2c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f3410b930 0x7f7f34122430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58782/0 (socket says 10.20.193.28:58782) 2026-02-20T13:19:34.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f39e2c640 1 -- 10.20.193.28:0/2220755097 learned_addr learned my addr 10.20.193.28:0/2220755097 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f34110f10 0x7f7f34127d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3962b640 1 -- 10.20.193.28:0/2220755097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f34110f10 msgr2=0x7f7f34127d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3962b640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f34110f10 0x7f7f34127d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3962b640 1 -- 10.20.193.28:0/2220755097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f3410b930 msgr2=0x7f7f34122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3962b640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f3410b930 0x7f7f34122430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.891+0000 7f7f3962b640 1 -- 10.20.193.28:0/2220755097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f28009570 con 0x7f7f3410c320 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.892+0000 7f7f3962b640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 0x7f7f34122970 secure :-1 s=READY pgs=508 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f280098a0 tx=0x7f7f28004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.892+0000 7f7f22ffd640 1 -- 10.20.193.28:0/2220755097 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f2803d070 con 0x7f7f3410c320 2026-02-20T13:19:34.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.892+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/2220755097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f34128970 con 0x7f7f3410c320 2026-02-20T13:19:34.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.892+0000 7f7f22ffd640 1 -- 10.20.193.28:0/2220755097 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7f28002ad0 con 0x7f7f3410c320 2026-02-20T13:19:34.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.892+0000 7f7f22ffd640 1 -- 10.20.193.28:0/2220755097 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f280418c0 con 0x7f7f3410c320 2026-02-20T13:19:34.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.892+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/2220755097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f34169070 con 0x7f7f3410c320 2026-02-20T13:19:34.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.895+0000 7f7f22ffd640 1 -- 10.20.193.28:0/2220755097 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7f28041a50 con 0x7f7f3410c320 2026-02-20T13:19:34.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.896+0000 7f7f22ffd640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f100b5760 0x7f7f100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.897+0000 7f7f22ffd640 1 -- 10.20.193.28:0/2220755097 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7f2810aff0 con 0x7f7f3410c320 2026-02-20T13:19:34.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.897+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f100b5760 0x7f7f100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.897+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f100b5760 0x7f7f100d5c10 secure :-1 s=READY pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f240095d0 tx=0x7f7f24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:34.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.897+0000 7f7f3e0b1e00 1 Processor -- start 2026-02-20T13:19:34.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3e0b1e00 1 -- start start 2026-02-20T13:19:34.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaa360 0x55cdcdfaa730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdcdfef5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfefb20 0x55cdce00ff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdec0780 con 0x55cdcdfaa360 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdebc4b0 con 0x55cdcdfaac70 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdeb6450 con 0x55cdcdfefb20 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f39e2c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaa360 0x55cdcdfaa730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f39e2c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaa360 0x55cdcdfaa730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56070/0 (socket says 10.20.193.28:56070) 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f39e2c640 1 -- 10.20.193.28:0/1290389179 learned_addr learned my addr 10.20.193.28:0/1290389179 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3962b640 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdcdfef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3962b640 1 -- 10.20.193.28:0/1290389179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfefb20 msgr2=0x55cdce00ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfefb20 0x55cdce00ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3962b640 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfefb20 0x55cdce00ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3962b640 1 -- 10.20.193.28:0/1290389179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaa360 msgr2=0x55cdcdfaa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:34.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3962b640 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaa360 0x55cdcdfaa730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.898+0000 7f7f3962b640 1 -- 10.20.193.28:0/1290389179 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdcde61d10 con 0x55cdcdfaac70 2026-02-20T13:19:34.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaa360 0x55cdcdfaa730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:34.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3962b640 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdcdfef5e0 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=162311878880989604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f28108b00 tx=0x7f7f2802f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240a5cb3b8711a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:34.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f024e6640 1 -- 10.20.193.28:0/1290389179 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f280d1df0 con 0x55cdcdfaac70 2026-02-20T13:19:34.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f024e6640 1 -- 10.20.193.28:0/1290389179 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7f280d1c10 con 0x55cdcdfaac70 2026-02-20T13:19:34.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f024e6640 1 -- 10.20.193.28:0/1290389179 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f280d2230 con 0x55cdcdfaac70 2026-02-20T13:19:34.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/1290389179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 msgr2=0x55cdcdfef5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdcdfef5e0 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=162311878880989604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f28108b00 tx=0x7f7f2802f190 comp rx=0 tx=0).stop 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/1290389179 shutdown_connections 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfefb20 0x55cdce00ff00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdcdfef5e0 unknown :-1 s=CLOSED pgs=207 gs=2 cs=0 l=1 c_cookie=162311878880989604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/1290389179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaa360 0x55cdcdfaa730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/1290389179 >> 10.20.193.28:0/1290389179 conn(0x55cdcdf88860 msgr2=0x55cdcdfa8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.899+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/1290389179 shutdown_connections 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.900+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/1290389179 wait complete. 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.901+0000 7f7f3e0b1e00 1 -- start start 2026-02-20T13:19:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.901+0000 7f7f3e0b1e00 1 Processor -- start 2026-02-20T13:19:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0076d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaac70 0x55cdce007c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfefb20 0x55cdce00cc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cdce00d140 con 0x55cdcdfaac70 2026-02-20T13:19:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cdce00d2b0 con 0x55cdcdfefb20 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cdce00d470 con 0x55cdcdfaa360 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0076d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42102/0 (socket says 10.20.193.28:42102) 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 -- 10.20.193.28:0/2289308084 learned_addr learned my addr 10.20.193.28:0/2289308084 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfefb20 0x55cdce00cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f3962b640 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaac70 0x55cdce007c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 -- 10.20.193.28:0/2289308084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfefb20 msgr2=0x55cdce00cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfefb20 0x55cdce00cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 -- 10.20.193.28:0/2289308084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaac70 msgr2=0x55cdce007c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaac70 0x55cdce007c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 -- 10.20.193.28:0/2289308084 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f34169070 con 0x55cdcdfaa360 2026-02-20T13:19:34.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0076d0 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=2831699064667785710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f24009700 tx=0x7f7f24013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=274c374bdc5449ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.902+0000 7f7eef7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2289308084 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f24021040 con 0x55cdcdfaa360 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f24003c80 con 0x55cdcdfaa360 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2289308084 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7f2401be10 con 0x55cdcdfaa360 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 10 client.26122 _ll_register_callbacks cb 0x55cdcde37a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cdcdb4c6f0 con 0x55cdcdfaa360 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2289308084 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f24021040 con 0x55cdcdfaa360 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2289308084 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7f24005720 con 0x55cdcdfaa360 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2289308084 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7f2401a460 con 0x55cdcdfaa360 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 10 client.26122 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cdcde3a3c0 con 0x55cdcdfaa360 2026-02-20T13:19:34.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2289308084 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7f2401a680 con 0x55cdcdfaa360 2026-02-20T13:19:34.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 10 client.26122 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:34.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 10 client.26122 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:19:34.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 20 client.26122 populate_metadata read hostname 'trial028' 2026-02-20T13:19:34.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cdce00fbe0 0x55cdcdfed8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 4 client.26122 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:34.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.903+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdcde58f80 con 0x55cdce00fbe0 2026-02-20T13:19:34.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.904+0000 7f7f3962b640 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cdce00fbe0 0x55cdcdfed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.904+0000 7f7f3962b640 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cdce00fbe0 0x55cdcdfed8a0 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=17650756041880532623 s_cookie=15960791052975887827 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f4f4151a355e768f server_cookie=dd801ee616dc55d3 in_seq=0 out_seq=0 2026-02-20T13:19:34.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.904+0000 7f7eef7fe640 10 client.26122 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:19:34.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.905+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2289308084 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cdcde58f80 con 0x55cdce00fbe0 2026-02-20T13:19:34.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.905+0000 7f7eef7fe640 10 client.26122 handle_command_reply: tid=0 2026-02-20T13:19:34.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.905+0000 7f7f3e0b1e00 1 client.26122 shutdown 2026-02-20T13:19:34.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.905+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 msgr2=0x55cdce0076d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.905+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0076d0 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=2831699064667785710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f24009700 tx=0x7f7f24013040 comp rx=0 tx=0).stop 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.905+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 shutdown_connections 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.905+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cdce00fbe0 0x55cdcdfed8a0 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=17650756041880532623 s_cookie=15960791052975887827 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.906+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfaac70 0x55cdce007c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.906+0000 7f7eef7fe640 0 client.26122 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.906+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfefb20 0x55cdce00cc00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.906+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2289308084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0076d0 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=2831699064667785710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.906+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 >> 10.20.193.28:0/2289308084 conn(0x55cdcdf88860 msgr2=0x55cdcdfa8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:34.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.906+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 shutdown_connections 2026-02-20T13:19:34.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.906+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2289308084 wait complete. 2026-02-20T13:19:34.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.906+0000 7f7f3e0b1e00 20 client.26122 trim_cache size 0 max 16384 2026-02-20T13:19:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3e0b1e00 1 Processor -- start 2026-02-20T13:19:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3e0b1e00 1 -- start start 2026-02-20T13:19:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0048f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdce004e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdfea780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdeb4080 con 0x55cdcdfefb20 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdb74700 con 0x55cdcdfaac70 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdffc070 con 0x55cdcdfaa360 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3962b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdce004e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3a62d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdfea780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3962b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdce004e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58812/0 (socket says 10.20.193.28:58812) 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f3962b640 1 -- 10.20.193.28:0/2464663185 learned_addr learned my addr 10.20.193.28:0/2464663185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.914+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3a62d640 1 -- 10.20.193.28:0/2464663185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 msgr2=0x55cdce0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:34.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3a62d640 1 -- 10.20.193.28:0/2464663185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 msgr2=0x55cdce004e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdce004e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3a62d640 1 -- 10.20.193.28:0/2464663185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdcde4c0e0 con 0x55cdcdfefb20 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0048f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3962b640 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdce004e30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdfea780 secure :-1 s=READY pgs=509 gs=2 cs=0 l=1 c_cookie=7641344417222993251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f300039e0 tx=0x7f7f30003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0b82430afda563 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f01ce5640 1 -- 10.20.193.28:0/2464663185 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f30018070 con 0x55cdcdfefb20 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f01ce5640 1 -- 10.20.193.28:0/2464663185 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7f30005e10 con 0x55cdcdfefb20 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f01ce5640 1 -- 10.20.193.28:0/2464663185 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f3001d470 con 0x55cdcdfefb20 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2464663185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 msgr2=0x55cdcdfea780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdfea780 secure :-1 s=READY pgs=509 gs=2 cs=0 l=1 c_cookie=7641344417222993251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f300039e0 tx=0x7f7f30003eb0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2464663185 shutdown_connections 2026-02-20T13:19:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdfea780 unknown :-1 s=CLOSED pgs=509 gs=2 cs=0 l=1 c_cookie=7641344417222993251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaac70 0x55cdce004e30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2464663185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaa360 0x55cdce0048f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2464663185 >> 10.20.193.28:0/2464663185 conn(0x55cdcdf88860 msgr2=0x55cdcdff1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2464663185 shutdown_connections 2026-02-20T13:19:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.915+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2464663185 wait complete. 2026-02-20T13:19:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.916+0000 7f7f3e0b1e00 1 -- start start 2026-02-20T13:19:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.916+0000 7f7f3e0b1e00 1 Processor -- start 2026-02-20T13:19:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.916+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaa360 0x55cdce00c410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.916+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaac70 0x55cdcdf88c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.916+0000 7f7f3e0b1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdf89170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.916+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdf896b0 con 0x55cdcdfefb20 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.916+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdf89820 con 0x55cdcdfaa360 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.916+0000 7f7f3e0b1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cdcdf899e0 con 0x55cdcdfaac70 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f39e2c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaa360 0x55cdce00c410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdf89170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3962b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaac70 0x55cdcdf88c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdf89170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56090/0 (socket says 10.20.193.28:56090) 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 -- 10.20.193.28:0/2646600913 learned_addr learned my addr 10.20.193.28:0/2646600913 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 -- 10.20.193.28:0/2646600913 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaac70 msgr2=0x55cdcdf88c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaac70 0x55cdcdf88c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 -- 10.20.193.28:0/2646600913 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaa360 msgr2=0x55cdce00c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaa360 0x55cdce00c410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 -- 10.20.193.28:0/2646600913 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f30005600 con 0x55cdcdfefb20 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3a62d640 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdf89170 secure :-1 s=READY pgs=510 gs=1 cs=0 l=1 c_cookie=17988461358782747089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f30006e10 tx=0x7f7f300061d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a3da4c821611d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7eef7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2646600913 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f30018030 con 0x55cdcdfefb20 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2646600913 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7f30022040 con 0x55cdcdfefb20 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2646600913 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f3001dcf0 con 0x55cdcdfefb20 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.917+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdcde61d10 con 0x55cdcdfefb20 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2646600913 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7f30011440 con 0x55cdcdfefb20 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 10 client.16197 _ll_register_callbacks cb 0x55cdcde37a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cdcdc0e4a0 con 0x55cdcdfefb20 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2646600913 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7f3001de80 con 0x55cdcdfefb20 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 10 client.16197 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cdcde46b60 con 0x55cdcdfefb20 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2646600913 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7f3002d030 con 0x55cdcdfefb20 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 10 client.16197 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 10 client.16197 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 20 client.16197 populate_metadata read hostname 'trial028' 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cdce00fbe0 0x55cdce0bd6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 4 client.16197 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7f280d1c10 con 0x55cdce00fbe0 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.918+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cdce00fbe0 0x55cdce0bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f39e2c640 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cdce00fbe0 0x55cdce0bd6f0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=14774093297777721237 s_cookie=6865129968266012554 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cd081f93ec853f95 server_cookie=5f45d7554762678a in_seq=0 out_seq=0 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7eef7fe640 10 client.16197 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7eef7fe640 1 -- 10.20.193.28:0/2646600913 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7f280d1c10 con 0x55cdce00fbe0 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7eef7fe640 10 client.16197 handle_command_reply: tid=0 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 client.16197 shutdown 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 msgr2=0x55cdcdf89170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdf89170 secure :-1 s=READY pgs=510 gs=1 cs=0 l=1 c_cookie=17988461358782747089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f30006e10 tx=0x7f7f300061d0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 shutdown_connections 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cdce00fbe0 0x55cdce0bd6f0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=14774093297777721237 s_cookie=6865129968266012554 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cdcdfefb20 0x55cdcdf89170 unknown :-1 s=CLOSED pgs=510 gs=1 cs=0 l=1 c_cookie=17988461358782747089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cdcdfaac70 0x55cdcdf88c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 --2- 10.20.193.28:0/2646600913 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cdcdfaa360 0x55cdce00c410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7eef7fe640 0 client.16197 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:19:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.919+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 >> 10.20.193.28:0/2646600913 conn(0x55cdcdf88860 msgr2=0x55cdce0038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:34.928 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:19:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 shutdown_connections 2026-02-20T13:19:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3e0b1e00 1 -- 10.20.193.28:0/2646600913 wait complete. 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3e0b1e00 20 client.16197 trim_cache size 0 max 16384 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f100b5760 msgr2=0x7f7f100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f100b5760 0x7f7f100d5c10 secure :-1 s=READY pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f240095d0 tx=0x7f7f24005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 msgr2=0x7f7f34122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 0x7f7f34122970 secure :-1 s=READY pgs=508 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f280098a0 tx=0x7f7f28004290 comp rx=0 tx=0).stop 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/2220755097 shutdown_connections 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f100b5760 0x7f7f100d5c10 unknown :-1 s=CLOSED pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f3410c320 0x7f7f34122970 unknown :-1 s=CLOSED pgs=508 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f34110f10 0x7f7f34127d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 --2- 10.20.193.28:0/2220755097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f3410b930 0x7f7f34122430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/2220755097 >> 10.20.193.28:0/2220755097 conn(0x7f7f340e95c0 msgr2=0x7f7f341099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/2220755097 shutdown_connections 2026-02-20T13:19:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:34.920+0000 7f7f3ae2e640 1 -- 10.20.193.28:0/2220755097 wait complete. 2026-02-20T13:19:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:34 trial127 ceph-mon[43817]: pgmap v248: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:34.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:34 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2834771124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:19:34.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:34 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:19:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:34 trial034 ceph-mon[43332]: pgmap v248: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:34.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:34 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2834771124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:19:34.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:34 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:19:35.023 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:19:35.216 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 -- 10.20.193.28:0/3870262199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410f4b0 msgr2=0x7f137410f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 --2- 10.20.193.28:0/3870262199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410f4b0 0x7f137410f880 secure :-1 s=READY pgs=511 gs=1 cs=0 l=1 c_cookie=7333959118048420289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1364009950 tx=0x7f136402f190 comp rx=0 tx=0).stop 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 -- 10.20.193.28:0/3870262199 shutdown_connections 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 --2- 10.20.193.28:0/3870262199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f13741156a0 0x7f1374176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 --2- 10.20.193.28:0/3870262199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f137410fea0 0x7f1374114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 --2- 10.20.193.28:0/3870262199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410f4b0 0x7f137410f880 unknown :-1 s=CLOSED pgs=511 gs=1 cs=0 l=1 c_cookie=7333959118048420289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 -- 10.20.193.28:0/3870262199 >> 10.20.193.28:0/3870262199 conn(0x7f13740ecda0 msgr2=0x7f137410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 -- 10.20.193.28:0/3870262199 shutdown_connections 2026-02-20T13:19:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 -- 10.20.193.28:0/3870262199 wait complete. 2026-02-20T13:19:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.402+0000 7f137acea640 1 Processor -- start 2026-02-20T13:19:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137acea640 1 -- start start 2026-02-20T13:19:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137acea640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f137410f4b0 0x7f137411ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137acea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410fea0 0x7f137411e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137acea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f13741156a0 0x7f13741236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137acea640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1374123d00 con 0x7f137410fea0 2026-02-20T13:19:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137acea640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1374123e70 con 0x7f137410f4b0 2026-02-20T13:19:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137acea640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1374124030 con 0x7f13741156a0 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f1379ce8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f137410f4b0 0x7f137411ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f13794e7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410fea0 0x7f137411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137a4e9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f13741156a0 0x7f13741236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137a4e9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f13741156a0 0x7f13741236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42126/0 (socket says 10.20.193.28:42126) 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137a4e9640 1 -- 10.20.193.28:0/1642755520 learned_addr learned my addr 10.20.193.28:0/1642755520 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f13794e7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410fea0 0x7f137411e310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56116/0 (socket says 10.20.193.28:56116) 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137a4e9640 1 -- 10.20.193.28:0/1642755520 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f137410f4b0 msgr2=0x7f137411ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137a4e9640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f137410f4b0 0x7f137411ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137a4e9640 1 -- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410fea0 msgr2=0x7f137411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137a4e9640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410fea0 0x7f137411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.403+0000 7f137a4e9640 1 -- 10.20.193.28:0/1642755520 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1364009570 con 0x7f13741156a0 2026-02-20T13:19:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.404+0000 7f137a4e9640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f13741156a0 0x7f13741236e0 secure :-1 s=READY pgs=173 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f137000f8d0 tx=0x7f137000fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.404+0000 7f1362ffd640 1 -- 10.20.193.28:0/1642755520 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f137000dce0 con 0x7f13741156a0 2026-02-20T13:19:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.404+0000 7f1362ffd640 1 -- 10.20.193.28:0/1642755520 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f137000de40 con 0x7f13741156a0 2026-02-20T13:19:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.404+0000 7f1362ffd640 1 -- 10.20.193.28:0/1642755520 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13700116b0 con 0x7f13741156a0 2026-02-20T13:19:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.404+0000 7f137acea640 1 -- 10.20.193.28:0/1642755520 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1374124310 con 0x7f13741156a0 2026-02-20T13:19:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.404+0000 7f137acea640 1 -- 10.20.193.28:0/1642755520 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1374164a10 con 0x7f13741156a0 2026-02-20T13:19:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.407+0000 7f1362ffd640 1 -- 10.20.193.28:0/1642755520 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1370020060 con 0x7f13741156a0 2026-02-20T13:19:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.408+0000 7f1362ffd640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f13500b56e0 0x7f13500d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.408+0000 7f1362ffd640 1 -- 10.20.193.28:0/1642755520 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1370015070 con 0x7f13741156a0 2026-02-20T13:19:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.408+0000 7f1379ce8640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f13500b56e0 0x7f13500d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.409+0000 7f1379ce8640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f13500b56e0 0x7f13500d5b90 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13640098a0 tx=0x7f136403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137df6de00 1 Processor -- start 2026-02-20T13:19:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137df6de00 1 -- start start 2026-02-20T13:19:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137df6de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d378b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137df6de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 0x55f8d37d05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137df6de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d37d0b20 0x55f8d37f0f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137df6de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8d36a1780 con 0x55f8d378bc70 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137df6de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f8d369d4b0 con 0x55f8d378b360 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137df6de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f8d3697450 con 0x55f8d37d0b20 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f1379ce8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d378b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f137a4e9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d37d0b20 0x55f8d37f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f1379ce8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d378b730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58850/0 (socket says 10.20.193.28:58850) 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f1379ce8640 1 -- 10.20.193.28:0/1974072679 learned_addr learned my addr 10.20.193.28:0/1974072679 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.410+0000 7f13794e7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 0x55f8d37d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137a4e9640 1 -- 10.20.193.28:0/1974072679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 msgr2=0x55f8d378b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137a4e9640 1 --2- 10.20.193.28:0/1974072679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d378b730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137a4e9640 1 -- 10.20.193.28:0/1974072679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 msgr2=0x55f8d37d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137a4e9640 1 --2- 10.20.193.28:0/1974072679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 0x55f8d37d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137a4e9640 1 -- 10.20.193.28:0/1974072679 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d3642d10 con 0x55f8d37d0b20 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137a4e9640 1 --2- 10.20.193.28:0/1974072679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d37d0b20 0x55f8d37f0f00 secure :-1 s=READY pgs=174 gs=3 cs=0 l=1 c_cookie=14681282672586797228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13700e56b0 tx=0x7f137000a4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbbe64ce52a230ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f13424e6640 1 -- 10.20.193.28:0/1974072679 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13700b3c60 con 0x55f8d37d0b20 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f13424e6640 1 -- 10.20.193.28:0/1974072679 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f13700b6240 con 0x55f8d37d0b20 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f13424e6640 1 -- 10.20.193.28:0/1974072679 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13700b8e70 con 0x55f8d37d0b20 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 -- 10.20.193.28:0/1974072679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d37d0b20 msgr2=0x55f8d37f0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 --2- 10.20.193.28:0/1974072679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d37d0b20 0x55f8d37f0f00 secure :-1 s=READY pgs=174 gs=3 cs=0 l=1 c_cookie=14681282672586797228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13700e56b0 tx=0x7f137000a4a0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 -- 10.20.193.28:0/1974072679 shutdown_connections 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 --2- 10.20.193.28:0/1974072679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 0x55f8d37d05e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 --2- 10.20.193.28:0/1974072679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d37d0b20 0x55f8d37f0f00 unknown :-1 s=CLOSED pgs=174 gs=3 cs=0 l=1 c_cookie=14681282672586797228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 --2- 10.20.193.28:0/1974072679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d378b730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 -- 10.20.193.28:0/1974072679 >> 10.20.193.28:0/1974072679 conn(0x55f8d3769860 msgr2=0x55f8d3789c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 -- 10.20.193.28:0/1974072679 shutdown_connections 2026-02-20T13:19:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.411+0000 7f137df6de00 1 -- 10.20.193.28:0/1974072679 wait complete. 2026-02-20T13:19:35.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f137df6de00 1 -- start start 2026-02-20T13:19:35.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f137df6de00 1 Processor -- start 2026-02-20T13:19:35.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f137df6de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378b360 0x55f8d37e86d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f137df6de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 0x55f8d37e8c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f137df6de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37ea9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f137df6de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8d37eaf10 con 0x55f8d378bc70 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f137df6de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f8d37eb080 con 0x55f8d37d0b20 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f137df6de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f8d37eb240 con 0x55f8d378b360 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f1379ce8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378b360 0x55f8d37e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f1379ce8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378b360 0x55f8d37e86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42144/0 (socket says 10.20.193.28:42144) 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.413+0000 7f1379ce8640 1 -- 10.20.193.28:0/158340182 learned_addr learned my addr 10.20.193.28:0/158340182 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f137a4e9640 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f13794e7640 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 0x55f8d37e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f1379ce8640 1 -- 10.20.193.28:0/158340182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 msgr2=0x55f8d37ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f1379ce8640 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37ea9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f1379ce8640 1 -- 10.20.193.28:0/158340182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 msgr2=0x55f8d37e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f1379ce8640 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 0x55f8d37e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f1379ce8640 1 -- 10.20.193.28:0/158340182 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d361b3c0 con 0x55f8d378b360 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f1379ce8640 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378b360 0x55f8d37e86d0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=13321566333545965267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1364009950 tx=0x7f1364009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8dfb5ffeacf66d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f132f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f132f7fe640 1 -- 10.20.193.28:0/158340182 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1364038d50 con 0x55f8d378b360 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f132f7fe640 1 -- 10.20.193.28:0/158340182 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f136403e040 con 0x55f8d378b360 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1374164a10 con 0x55f8d378b360 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f132f7fe640 1 -- 10.20.193.28:0/158340182 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1364050670 con 0x55f8d378b360 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f132f7fe640 1 -- 10.20.193.28:0/158340182 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1364050800 con 0x55f8d378b360 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f137df6de00 10 client.26140 _ll_register_callbacks cb 0x55f8d3618a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.414+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8d332d6f0 con 0x55f8d378b360 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f132f7fe640 1 -- 10.20.193.28:0/158340182 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13640043a0 con 0x55f8d378b360 2026-02-20T13:19:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f137df6de00 10 client.26140 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f8d362d0e0 con 0x55f8d378b360 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f132f7fe640 1 -- 10.20.193.28:0/158340182 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f136404f070 con 0x55f8d378b360 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f137df6de00 10 client.26140 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f137df6de00 10 client.26140 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f137df6de00 20 client.26140 populate_metadata read hostname 'trial028' 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f137df6de00 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f8d37f0bd0 0x55f8d37ce8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f137df6de00 4 client.26140 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8d3639f80 con 0x55f8d37f0bd0 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.415+0000 7f13794e7640 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f8d37f0bd0 0x55f8d37ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.416+0000 7f13794e7640 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f8d37f0bd0 0x55f8d37ce8a0 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=15666176687738525940 s_cookie=1297074654920664100 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d96970b1cd2918f4 server_cookie=12002286c5b56424 in_seq=0 out_seq=0 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.416+0000 7f132f7fe640 10 client.26140 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:19:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.416+0000 7f132f7fe640 1 -- 10.20.193.28:0/158340182 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f8d3639f80 con 0x55f8d37f0bd0 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.416+0000 7f132f7fe640 10 client.26140 handle_command_reply: tid=0 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 client.26140 shutdown 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378b360 msgr2=0x55f8d37e86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378b360 0x55f8d37e86d0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=13321566333545965267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1364009950 tx=0x7f1364009310 comp rx=0 tx=0).stop 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 shutdown_connections 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f8d37f0bd0 0x55f8d37ce8a0 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=15666176687738525940 s_cookie=1297074654920664100 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378bc70 0x55f8d37e8c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37ea9a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 --2- 10.20.193.28:0/158340182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378b360 0x55f8d37e86d0 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=13321566333545965267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 >> 10.20.193.28:0/158340182 conn(0x55f8d3769860 msgr2=0x55f8d3789c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f132f7fe640 0 client.26140 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:19:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 shutdown_connections 2026-02-20T13:19:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 1 -- 10.20.193.28:0/158340182 wait complete. 2026-02-20T13:19:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.417+0000 7f137df6de00 20 client.26140 trim_cache size 0 max 16384 2026-02-20T13:19:35.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f137df6de00 1 Processor -- start 2026-02-20T13:19:35.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f137df6de00 1 -- start start 2026-02-20T13:19:35.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f137df6de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378b360 0x55f8d37ea930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f137df6de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37ec0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f137df6de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37e5860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f137df6de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8d3695080 con 0x55f8d378b360 2026-02-20T13:19:35.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f137df6de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f8d3355700 con 0x55f8d37d0b20 2026-02-20T13:19:35.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f137df6de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f8d36f9ae0 con 0x55f8d378bc70 2026-02-20T13:19:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f13794e7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37ec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f1379ce8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378b360 0x55f8d37ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f13794e7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37ec0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42152/0 (socket says 10.20.193.28:42152) 2026-02-20T13:19:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.424+0000 7f13794e7640 1 -- 10.20.193.28:0/1723812711 learned_addr learned my addr 10.20.193.28:0/1723812711 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f137a4e9640 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f13794e7640 1 -- 10.20.193.28:0/1723812711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 msgr2=0x55f8d37e5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f13794e7640 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37e5860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f13794e7640 1 -- 10.20.193.28:0/1723812711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378b360 msgr2=0x55f8d37ea930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f13794e7640 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378b360 0x55f8d37ea930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f13794e7640 1 -- 10.20.193.28:0/1723812711 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d3627b60 con 0x55f8d378bc70 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f137a4e9640 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37e5860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f13794e7640 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37ec0c0 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=18176697581811373113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55f8d37daad0 tx=0x7f1368005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc409a2579919439 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f1341ce5640 1 -- 10.20.193.28:0/1723812711 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1368017070 con 0x55f8d378bc70 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f1341ce5640 1 -- 10.20.193.28:0/1723812711 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1368018040 con 0x55f8d378bc70 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f1341ce5640 1 -- 10.20.193.28:0/1723812711 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13680052a0 con 0x55f8d378bc70 2026-02-20T13:19:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f137df6de00 1 -- 10.20.193.28:0/1723812711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 msgr2=0x55f8d37ec0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.425+0000 7f137df6de00 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37ec0c0 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=18176697581811373113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55f8d37daad0 tx=0x7f1368005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 -- 10.20.193.28:0/1723812711 shutdown_connections 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d37d0b20 0x55f8d37e5860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37ec0c0 unknown :-1 s=CLOSED pgs=176 gs=2 cs=0 l=1 c_cookie=18176697581811373113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 --2- 10.20.193.28:0/1723812711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d378b360 0x55f8d37ea930 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 -- 10.20.193.28:0/1723812711 >> 10.20.193.28:0/1723812711 conn(0x55f8d3769860 msgr2=0x55f8d37eb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 -- 10.20.193.28:0/1723812711 shutdown_connections 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 -- 10.20.193.28:0/1723812711 wait complete. 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 -- start start 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 Processor -- start 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d37ca770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37cacb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d37d0b20 0x55f8d37cb1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8d37d36d0 con 0x55f8d37d0b20 2026-02-20T13:19:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f8d37d3130 con 0x55f8d378b360 2026-02-20T13:19:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.426+0000 7f137df6de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f8d37d5e00 con 0x55f8d378bc70 2026-02-20T13:19:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42168/0 (socket says 10.20.193.28:42168) 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 -- 10.20.193.28:0/2840444013 learned_addr learned my addr 10.20.193.28:0/2840444013 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f137a4e9640 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d37d0b20 0x55f8d37cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 -- 10.20.193.28:0/2840444013 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 msgr2=0x55f8d37ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f1379ce8640 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d37ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d37ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 -- 10.20.193.28:0/2840444013 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d37d0b20 msgr2=0x55f8d37cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d37d0b20 0x55f8d37cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 -- 10.20.193.28:0/2840444013 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d361b6f0 con 0x55f8d378bc70 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f13794e7640 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37cacb0 secure :-1 s=READY pgs=177 gs=2 cs=0 l=1 c_cookie=5632408299774104245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1368003fa0 tx=0x7f1368009390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e2a5581c1ff52b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f132f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f132f7fe640 1 -- 10.20.193.28:0/2840444013 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1368017030 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f132f7fe640 1 -- 10.20.193.28:0/2840444013 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1368005220 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f132f7fe640 1 -- 10.20.193.28:0/2840444013 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13680207f0 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.427+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13680039d0 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f132f7fe640 1 -- 10.20.193.28:0/2840444013 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1368020980 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 10 client.26146 _ll_register_callbacks cb 0x55f8d3618a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13700b6240 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f132f7fe640 1 -- 10.20.193.28:0/2840444013 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1368004b20 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 10 client.26146 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f8d362d340 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f132f7fe640 1 -- 10.20.193.28:0/2840444013 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1368028040 con 0x55f8d378bc70 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 10 client.26146 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 10 client.26146 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 20 client.26146 populate_metadata read hostname 'trial028' 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f8d376f770 0x55f8d3822350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 4 client.26146 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f8d332af40 con 0x55f8d376f770 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.428+0000 7f1379ce8640 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f8d376f770 0x55f8d3822350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f1379ce8640 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f8d376f770 0x55f8d3822350 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=9042857793808151747 s_cookie=7333757117713292944 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7d7eaf409a4eb4c3 server_cookie=65c6bd3e1e4b1e90 in_seq=0 out_seq=0 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f132f7fe640 10 client.26146 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f132f7fe640 1 -- 10.20.193.28:0/2840444013 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f136403e020 con 0x55f8d376f770 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f132f7fe640 10 client.26146 handle_command_reply: tid=0 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 client.26146 shutdown 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 msgr2=0x55f8d37cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37cacb0 secure :-1 s=READY pgs=177 gs=2 cs=0 l=1 c_cookie=5632408299774104245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1368003fa0 tx=0x7f1368009390 comp rx=0 tx=0).stop 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 shutdown_connections 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f8d376f770 0x55f8d3822350 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=9042857793808151747 s_cookie=7333757117713292944 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8d37d0b20 0x55f8d37cb1f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8d378bc70 0x55f8d37cacb0 unknown :-1 s=CLOSED pgs=177 gs=2 cs=0 l=1 c_cookie=5632408299774104245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 --2- 10.20.193.28:0/2840444013 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8d378b360 0x55f8d37ca770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 >> 10.20.193.28:0/2840444013 conn(0x55f8d3769860 msgr2=0x55f8d37ee2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f132f7fe640 0 client.26146 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 shutdown_connections 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.429+0000 7f137df6de00 1 -- 10.20.193.28:0/2840444013 wait complete. 2026-02-20T13:19:35.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137df6de00 20 client.26146 trim_cache size 0 max 16384 2026-02-20T13:19:35.439 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:19:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 -- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f13500b56e0 msgr2=0x7f13500d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f13500b56e0 0x7f13500d5b90 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13640098a0 tx=0x7f136403a040 comp rx=0 tx=0).stop 2026-02-20T13:19:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 -- 10.20.193.28:0/1642755520 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f13741156a0 msgr2=0x7f13741236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f13741156a0 0x7f13741236e0 secure :-1 s=READY pgs=173 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f137000f8d0 tx=0x7f137000fda0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 -- 10.20.193.28:0/1642755520 shutdown_connections 2026-02-20T13:19:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f13500b56e0 0x7f13500d5b90 unknown :-1 s=CLOSED pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f137410fea0 0x7f137411e310 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f13741156a0 0x7f13741236e0 unknown :-1 s=CLOSED pgs=173 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 --2- 10.20.193.28:0/1642755520 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f137410f4b0 0x7f137411ddd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 -- 10.20.193.28:0/1642755520 >> 10.20.193.28:0/1642755520 conn(0x7f13740ecda0 msgr2=0x7f137410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 -- 10.20.193.28:0/1642755520 shutdown_connections 2026-02-20T13:19:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.430+0000 7f137acea640 1 -- 10.20.193.28:0/1642755520 wait complete. 2026-02-20T13:19:35.532 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:19:35.718 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:35.833 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:19:35.833 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:19:35.833 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:19:35.834 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:19:35.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 -- 10.20.193.28:0/507621924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b810fea0 msgr2=0x7f89b8114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 --2- 10.20.193.28:0/507621924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b810fea0 0x7f89b8114ef0 secure :-1 s=READY pgs=208 gs=3 cs=0 l=1 c_cookie=14225846628425393693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ac009950 tx=0x7f89ac02f190 comp rx=0 tx=0).stop 2026-02-20T13:19:35.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 -- 10.20.193.28:0/507621924 shutdown_connections 2026-02-20T13:19:35.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 --2- 10.20.193.28:0/507621924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89b81156a0 0x7f89b8176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 --2- 10.20.193.28:0/507621924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b810fea0 0x7f89b8114ef0 unknown :-1 s=CLOSED pgs=208 gs=3 cs=0 l=1 c_cookie=14225846628425393693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 --2- 10.20.193.28:0/507621924 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f89b810f4b0 0x7f89b810f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 -- 10.20.193.28:0/507621924 >> 10.20.193.28:0/507621924 conn(0x7f89b80ecda0 msgr2=0x7f89b810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 -- 10.20.193.28:0/507621924 shutdown_connections 2026-02-20T13:19:35.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 -- 10.20.193.28:0/507621924 wait complete. 2026-02-20T13:19:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.899+0000 7f89bed3a640 1 Processor -- start 2026-02-20T13:19:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bed3a640 1 -- start start 2026-02-20T13:19:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bed3a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89b810f4b0 0x7f89b80f57b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bed3a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f89b810fea0 0x7f89b8175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bed3a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b81156a0 0x7f89b80f5eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bed3a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f89b80fb0c0 con 0x7f89b810f4b0 2026-02-20T13:19:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bed3a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f89b80fb230 con 0x7f89b81156a0 2026-02-20T13:19:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bed3a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f89b80fb3f0 con 0x7f89b810fea0 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89be539640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b81156a0 0x7f89b80f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89be539640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b81156a0 0x7f89b80f5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58896/0 (socket says 10.20.193.28:58896) 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89be539640 1 -- 10.20.193.28:0/2369110054 learned_addr learned my addr 10.20.193.28:0/2369110054 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bd537640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f89b810fea0 0x7f89b8175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.900+0000 7f89bdd38640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89b810f4b0 0x7f89b80f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89bd537640 1 -- 10.20.193.28:0/2369110054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b81156a0 msgr2=0x7f89b80f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89bd537640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b81156a0 0x7f89b80f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89bd537640 1 -- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89b810f4b0 msgr2=0x7f89b80f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89bd537640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89b810f4b0 0x7f89b80f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89bd537640 1 -- 10.20.193.28:0/2369110054 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b400a590 con 0x7f89b810fea0 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89bd537640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f89b810fea0 0x7f89b8175f70 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ac02f6a0 tx=0x7f89ac004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89a6ffd640 1 -- 10.20.193.28:0/2369110054 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89ac03d070 con 0x7f89b810fea0 2026-02-20T13:19:35.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89a6ffd640 1 -- 10.20.193.28:0/2369110054 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f89ac002ad0 con 0x7f89b810fea0 2026-02-20T13:19:35.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89bed3a640 1 -- 10.20.193.28:0/2369110054 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac009570 con 0x7f89b810fea0 2026-02-20T13:19:35.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89a6ffd640 1 -- 10.20.193.28:0/2369110054 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89ac041820 con 0x7f89b810fea0 2026-02-20T13:19:35.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.901+0000 7f89bed3a640 1 -- 10.20.193.28:0/2369110054 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b80fb950 con 0x7f89b810fea0 2026-02-20T13:19:35.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.904+0000 7f89a6ffd640 1 -- 10.20.193.28:0/2369110054 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f89ac02f9f0 con 0x7f89b810fea0 2026-02-20T13:19:35.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.905+0000 7f89a6ffd640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89940b56d0 0x7f89940d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.905+0000 7f89a6ffd640 1 -- 10.20.193.28:0/2369110054 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f89ac10b0a0 con 0x7f89b810fea0 2026-02-20T13:19:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.906+0000 7f89bdd38640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89940b56d0 0x7f89940d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.906+0000 7f89bdd38640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89940b56d0 0x7f89940d5b80 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89a8004740 tx=0x7f89a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.906+0000 7f89c1fbde00 1 Processor -- start 2026-02-20T13:19:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.906+0000 7f89c1fbde00 1 -- start start 2026-02-20T13:19:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576e0730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0c70 0x5572577255e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257745f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572575f6780 con 0x557257725b20 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5572575f24b0 con 0x5572576e0c70 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5572575ec450 con 0x5572576e0360 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257745f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89bdd38640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576e0730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257745f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56182/0 (socket says 10.20.193.28:56182) 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 -- 10.20.193.28:0/312282536 learned_addr learned my addr 10.20.193.28:0/312282536 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89bd537640 1 --2- 10.20.193.28:0/312282536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0c70 0x5572577255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 -- 10.20.193.28:0/312282536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 msgr2=0x5572576e0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 --2- 10.20.193.28:0/312282536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576e0730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 -- 10.20.193.28:0/312282536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0c70 msgr2=0x5572577255e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 --2- 10.20.193.28:0/312282536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0c70 0x5572577255e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 -- 10.20.193.28:0/312282536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557257597d10 con 0x557257725b20 2026-02-20T13:19:35.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.907+0000 7f89be539640 1 --2- 10.20.193.28:0/312282536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257745f00 secure :-1 s=READY pgs=512 gs=3 cs=0 l=1 c_cookie=11032338323809329249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89b400a8c0 tx=0x7f89b400ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991abd40f0956061 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89864e6640 1 -- 10.20.193.28:0/312282536 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89b4003e20 con 0x557257725b20 2026-02-20T13:19:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89864e6640 1 -- 10.20.193.28:0/312282536 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f89b401b920 con 0x557257725b20 2026-02-20T13:19:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89864e6640 1 -- 10.20.193.28:0/312282536 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89b4011b90 con 0x557257725b20 2026-02-20T13:19:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 -- 10.20.193.28:0/312282536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 msgr2=0x557257745f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/312282536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257745f00 secure :-1 s=READY pgs=512 gs=3 cs=0 l=1 c_cookie=11032338323809329249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89b400a8c0 tx=0x7f89b400ad90 comp rx=0 tx=0).stop 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 -- 10.20.193.28:0/312282536 shutdown_connections 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/312282536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257745f00 unknown :-1 s=CLOSED pgs=512 gs=3 cs=0 l=1 c_cookie=11032338323809329249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/312282536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0c70 0x5572577255e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/312282536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576e0730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 -- 10.20.193.28:0/312282536 >> 10.20.193.28:0/312282536 conn(0x5572576be860 msgr2=0x5572576dec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 -- 10.20.193.28:0/312282536 shutdown_connections 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.908+0000 7f89c1fbde00 1 -- 10.20.193.28:0/312282536 wait complete. 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.909+0000 7f89c1fbde00 1 -- start start 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.909+0000 7f89c1fbde00 1 Processor -- start 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725773dc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257742c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557257743180 con 0x557257725b20 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5572577432f0 con 0x5572576e0360 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5572577434b0 con 0x5572576e0c70 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bd537640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725773dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bd537640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725773dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42200/0 (socket says 10.20.193.28:42200) 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bd537640 1 -- 10.20.193.28:0/1972471292 learned_addr learned my addr 10.20.193.28:0/1972471292 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bdd38640 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89be539640 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257742c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bd537640 1 -- 10.20.193.28:0/1972471292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 msgr2=0x55725773d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bd537640 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bd537640 1 -- 10.20.193.28:0/1972471292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 msgr2=0x557257742c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bd537640 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257742c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89bd537640 1 -- 10.20.193.28:0/1972471292 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572575703c0 con 0x5572576e0c70 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.910+0000 7f89be539640 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257742c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89bd537640 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725773dc50 secure :-1 s=READY pgs=179 gs=2 cs=0 l=1 c_cookie=14735627132221203405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ac0d1760 tx=0x7f89ac038af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7f76cdd6a723cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89737fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89737fe640 1 -- 10.20.193.28:0/1972471292 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89ac0d0ed0 con 0x5572576e0c70 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89737fe640 1 -- 10.20.193.28:0/1972471292 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f89ac0d0cf0 con 0x5572576e0c70 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89737fe640 1 -- 10.20.193.28:0/1972471292 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89ac0cf7b0 con 0x5572576e0c70 2026-02-20T13:19:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b4005580 con 0x5572576e0c70 2026-02-20T13:19:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89737fe640 1 -- 10.20.193.28:0/1972471292 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f89ac0d30b0 con 0x5572576e0c70 2026-02-20T13:19:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89737fe640 10 client.26158 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:19:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89c1fbde00 10 client.26158 _ll_register_callbacks cb 0x55725756da10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5572572826f0 con 0x5572576e0c70 2026-02-20T13:19:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.911+0000 7f89737fe640 1 -- 10.20.193.28:0/1972471292 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89ac0d7160 con 0x5572576e0c70 2026-02-20T13:19:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89c1fbde00 10 client.26158 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5572575820e0 con 0x5572576e0c70 2026-02-20T13:19:35.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89737fe640 1 -- 10.20.193.28:0/1972471292 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f89ac0d07e0 con 0x5572576e0c70 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89c1fbde00 10 client.26158 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89c1fbde00 10 client.26158 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89c1fbde00 20 client.26158 populate_metadata read hostname 'trial028' 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x557257722c60 0x557257723100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89c1fbde00 4 client.26158 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55725758ef80 con 0x557257722c60 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.912+0000 7f89bdd38640 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x557257722c60 0x557257723100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.913+0000 7f89bdd38640 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x557257722c60 0x557257723100 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=9893020783061090524 s_cookie=3541067088042402852 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=894b11fc99e9c0dc server_cookie=312465c154982424 in_seq=0 out_seq=0 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.913+0000 7f89737fe640 10 client.26158 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.913+0000 7f89737fe640 1 -- 10.20.193.28:0/1972471292 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55725758ef80 con 0x557257722c60 2026-02-20T13:19:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.913+0000 7f89737fe640 10 client.26158 handle_command_reply: tid=0 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 client.26158 shutdown 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 msgr2=0x55725773dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725773dc50 secure :-1 s=READY pgs=179 gs=2 cs=0 l=1 c_cookie=14735627132221203405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ac0d1760 tx=0x7f89ac038af0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 shutdown_connections 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x557257722c60 0x557257723100 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=9893020783061090524 s_cookie=3541067088042402852 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x557257742c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725773dc50 unknown :-1 s=CLOSED pgs=179 gs=2 cs=0 l=1 c_cookie=14735627132221203405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/1972471292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773d710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89737fe640 0 client.26158 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 >> 10.20.193.28:0/1972471292 conn(0x5572576be860 msgr2=0x5572576dec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 shutdown_connections 2026-02-20T13:19:35.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 1 -- 10.20.193.28:0/1972471292 wait complete. 2026-02-20T13:19:35.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.914+0000 7f89c1fbde00 20 client.26158 trim_cache size 0 max 16384 2026-02-20T13:19:35.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.921+0000 7f89c1fbde00 1 Processor -- start 2026-02-20T13:19:35.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89c1fbde00 1 -- start start 2026-02-20T13:19:35.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773b010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725771f770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x55725771fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572575ea080 con 0x557257725b20 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5572572aa700 con 0x5572576e0360 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557257732080 con 0x5572576e0c70 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bdd38640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773b010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bdd38640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773b010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58916/0 (socket says 10.20.193.28:58916) 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bdd38640 1 -- 10.20.193.28:0/3389763293 learned_addr learned my addr 10.20.193.28:0/3389763293 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89be539640 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x55725771fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bd537640 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725771f770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bdd38640 1 -- 10.20.193.28:0/3389763293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 msgr2=0x55725771f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bdd38640 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725771f770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bdd38640 1 -- 10.20.193.28:0/3389763293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 msgr2=0x55725771fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bdd38640 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x55725771fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bdd38640 1 -- 10.20.193.28:0/3389763293 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55725772fa30 con 0x5572576e0360 2026-02-20T13:19:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.922+0000 7f89bd537640 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725771f770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89bdd38640 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773b010 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=13405481172187348361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89a8009c40 tx=0x7f89a8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba09d619cf69fd89 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f8985ce5640 1 -- 10.20.193.28:0/3389763293 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89a8021040 con 0x5572576e0360 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f8985ce5640 1 -- 10.20.193.28:0/3389763293 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f89a802a170 con 0x5572576e0360 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f8985ce5640 1 -- 10.20.193.28:0/3389763293 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89a80269d0 con 0x5572576e0360 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3389763293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 msgr2=0x55725773b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773b010 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=13405481172187348361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89a8009c40 tx=0x7f89a8014000 comp rx=0 tx=0).stop 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3389763293 shutdown_connections 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557257725b20 0x55725771fcb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0c70 0x55725771f770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3389763293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572576e0360 0x55725773b010 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=13405481172187348361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3389763293 >> 10.20.193.28:0/3389763293 conn(0x5572576be860 msgr2=0x5572577398f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3389763293 shutdown_connections 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.923+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3389763293 wait complete. 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89c1fbde00 1 -- start start 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89c1fbde00 1 Processor -- start 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576c02a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572576e0c70 0x5572576c07e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89c1fbde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557257725b20 0x5572576c0d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55725778b9d0 con 0x5572576e0c70 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55725778bb40 con 0x557257725b20 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89c1fbde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55725778bd00 con 0x5572576e0360 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89bdd38640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89be539640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557257725b20 0x5572576c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89bd537640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572576e0c70 0x5572576c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89bdd38640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576c02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42216/0 (socket says 10.20.193.28:42216) 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.924+0000 7f89bdd38640 1 -- 10.20.193.28:0/3947251022 learned_addr learned my addr 10.20.193.28:0/3947251022 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89bd537640 1 -- 10.20.193.28:0/3947251022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 msgr2=0x5572576c02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89bd537640 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576c02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89bd537640 1 -- 10.20.193.28:0/3947251022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557257725b20 msgr2=0x5572576c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89bd537640 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557257725b20 0x5572576c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89bd537640 1 -- 10.20.193.28:0/3947251022 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55725757cb60 con 0x5572576e0c70 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89bd537640 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572576e0c70 0x5572576c07e0 secure :-1 s=READY pgs=513 gs=3 cs=0 l=1 c_cookie=15599721792291269698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ac0d14d0 tx=0x7f89ac09a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87d5851b870ec42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89737fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89737fe640 1 -- 10.20.193.28:0/3947251022 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89ac0dbf00 con 0x5572576e0c70 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89737fe640 1 -- 10.20.193.28:0/3947251022 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5572572826f0 con 0x5572576e0c70 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89737fe640 1 -- 10.20.193.28:0/3947251022 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89ac0d2af0 con 0x5572576e0c70 2026-02-20T13:19:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a8009980 con 0x5572576e0c70 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89737fe640 1 -- 10.20.193.28:0/3947251022 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f89ac0d17d0 con 0x5572576e0c70 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89c1fbde00 10 client.16233 _ll_register_callbacks cb 0x55725756da10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.925+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89b401b920 con 0x5572576e0c70 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89737fe640 1 -- 10.20.193.28:0/3947251022 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89ac0d0ed0 con 0x5572576e0c70 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89c1fbde00 10 client.16233 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5572575706f0 con 0x5572576e0c70 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89737fe640 1 -- 10.20.193.28:0/3947251022 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f89ac096b50 con 0x5572576e0c70 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89c1fbde00 10 client.16233 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89c1fbde00 10 client.16233 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89c1fbde00 20 client.16233 populate_metadata read hostname 'trial028' 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5572577d36b0 0x5572577f3b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89c1fbde00 4 client.16233 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55725727ff40 con 0x5572577d36b0 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.926+0000 7f89bdd38640 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5572577d36b0 0x5572577f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89bdd38640 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5572577d36b0 0x5572577f3b60 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=7887193507528174551 s_cookie=3414925426148482555 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d74f0b4fafbebd7 server_cookie=2f64409500079dfb in_seq=0 out_seq=0 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89737fe640 10 client.16233 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89737fe640 1 -- 10.20.193.28:0/3947251022 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55725727ff40 con 0x5572577d36b0 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89737fe640 10 client.16233 handle_command_reply: tid=0 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 client.16233 shutdown 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572576e0c70 msgr2=0x5572576c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572576e0c70 0x5572576c07e0 secure :-1 s=READY pgs=513 gs=3 cs=0 l=1 c_cookie=15599721792291269698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ac0d14d0 tx=0x7f89ac09a000 comp rx=0 tx=0).stop 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 shutdown_connections 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5572577d36b0 0x5572577f3b60 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=7887193507528174551 s_cookie=3414925426148482555 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572576e0c70 0x5572576c07e0 unknown :-1 s=CLOSED pgs=513 gs=3 cs=0 l=1 c_cookie=15599721792291269698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557257725b20 0x5572576c0d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 --2- 10.20.193.28:0/3947251022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572576e0360 0x5572576c02a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 >> 10.20.193.28:0/3947251022 conn(0x5572576be860 msgr2=0x55725773a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89737fe640 0 client.16233 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:19:35.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 shutdown_connections 2026-02-20T13:19:35.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 1 -- 10.20.193.28:0/3947251022 wait complete. 2026-02-20T13:19:35.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89c1fbde00 20 client.16233 trim_cache size 0 max 16384 2026-02-20T13:19:35.936 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:19:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.927+0000 7f89bed3a640 1 -- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89940b56d0 msgr2=0x7f89940d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89940b56d0 0x7f89940d5b80 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89a8004740 tx=0x7f89a8005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 -- 10.20.193.28:0/2369110054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f89b810fea0 msgr2=0x7f89b8175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f89b810fea0 0x7f89b8175f70 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ac02f6a0 tx=0x7f89ac004290 comp rx=0 tx=0).stop 2026-02-20T13:19:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 -- 10.20.193.28:0/2369110054 shutdown_connections 2026-02-20T13:19:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f89940b56d0 0x7f89940d5b80 unknown :-1 s=CLOSED pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f89b81156a0 0x7f89b80f5eb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f89b810fea0 0x7f89b8175f70 unknown :-1 s=CLOSED pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 --2- 10.20.193.28:0/2369110054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89b810f4b0 0x7f89b80f57b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 -- 10.20.193.28:0/2369110054 >> 10.20.193.28:0/2369110054 conn(0x7f89b80ecda0 msgr2=0x7f89b8111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 -- 10.20.193.28:0/2369110054 shutdown_connections 2026-02-20T13:19:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:35.928+0000 7f89bed3a640 1 -- 10.20.193.28:0/2369110054 wait complete. 2026-02-20T13:19:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:19:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:19:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:19:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:19:35.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:19:35.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:19:35.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:19:35.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:19:36.028 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:19:36.215 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:36.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 -- 10.20.193.28:0/2389784464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09980614f0 msgr2=0x7f0998061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 --2- 10.20.193.28:0/2389784464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09980614f0 0x7f0998061920 secure :-1 s=READY pgs=514 gs=1 cs=0 l=1 c_cookie=7725878111807453232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0980009950 tx=0x7f098002f190 comp rx=0 tx=0).stop 2026-02-20T13:19:36.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 -- 10.20.193.28:0/2389784464 shutdown_connections 2026-02-20T13:19:36.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 --2- 10.20.193.28:0/2389784464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f09980614f0 0x7f0998061920 unknown :-1 s=CLOSED pgs=514 gs=1 cs=0 l=1 c_cookie=7725878111807453232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 --2- 10.20.193.28:0/2389784464 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0998159d80 0x7f099817a160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 --2- 10.20.193.28:0/2389784464 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998062ae0 0x7f0998060fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 -- 10.20.193.28:0/2389784464 >> 10.20.193.28:0/2389784464 conn(0x7f09980eab00 msgr2=0x7f099810af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 -- 10.20.193.28:0/2389784464 shutdown_connections 2026-02-20T13:19:36.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.399+0000 7f0997577640 1 -- 10.20.193.28:0/2389784464 wait complete. 2026-02-20T13:19:36.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0997577640 1 Processor -- start 2026-02-20T13:19:36.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0997577640 1 -- start start 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0997577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09980614f0 0x7f09980f2e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0997577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998062ae0 0x7f09980f33c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0997577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0998159d80 0x7f09980f8790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0997577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f09980f8db0 con 0x7f0998159d80 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0997577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f09980f8f20 con 0x7f0998062ae0 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0997577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f09980f90e0 con 0x7f09980614f0 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.400+0000 7f0996575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09980614f0 0x7f09980f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0995d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998062ae0 0x7f09980f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0998159d80 0x7f09980f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09980614f0 0x7f09980f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42244/0 (socket says 10.20.193.28:42244) 2026-02-20T13:19:36.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996575640 1 -- 10.20.193.28:0/1354179188 learned_addr learned my addr 10.20.193.28:0/1354179188 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0995d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998062ae0 0x7f09980f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58946/0 (socket says 10.20.193.28:58946) 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996d76640 1 -- 10.20.193.28:0/1354179188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09980614f0 msgr2=0x7f09980f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996d76640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09980614f0 0x7f09980f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996d76640 1 -- 10.20.193.28:0/1354179188 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998062ae0 msgr2=0x7f09980f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996d76640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998062ae0 0x7f09980f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996d76640 1 -- 10.20.193.28:0/1354179188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0980009570 con 0x7f0998159d80 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0996d76640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0998159d80 0x7f09980f8790 secure :-1 s=READY pgs=515 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098800f940 tx=0x7f098800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f097f7fe640 1 -- 10.20.193.28:0/1354179188 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098800dce0 con 0x7f0998159d80 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f097f7fe640 1 -- 10.20.193.28:0/1354179188 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f098800de40 con 0x7f0998159d80 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f097f7fe640 1 -- 10.20.193.28:0/1354179188 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09880116b0 con 0x7f0998159d80 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0997577640 1 -- 10.20.193.28:0/1354179188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09980f93c0 con 0x7f0998159d80 2026-02-20T13:19:36.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.401+0000 7f0997577640 1 -- 10.20.193.28:0/1354179188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09980f9aa0 con 0x7f0998159d80 2026-02-20T13:19:36.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.405+0000 7f097f7fe640 1 -- 10.20.193.28:0/1354179188 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0988020060 con 0x7f0998159d80 2026-02-20T13:19:36.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.406+0000 7f097f7fe640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09700b5760 0x7f09700d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.406+0000 7f097f7fe640 1 -- 10.20.193.28:0/1354179188 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0988015070 con 0x7f0998159d80 2026-02-20T13:19:36.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f0996575640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09700b5760 0x7f09700d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f099ed32e00 1 Processor -- start 2026-02-20T13:19:36.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f099ed32e00 1 -- start start 2026-02-20T13:19:36.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f0996575640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09700b5760 0x7f09700d5c10 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c0095d0 tx=0x7f098c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f633b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f63805e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f63a0f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f099ed32e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5653f6251780 con 0x5653f633b360 2026-02-20T13:19:36.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f099ed32e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5653f624d4b0 con 0x5653f6380b20 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f099ed32e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5653f6247450 con 0x5653f633bc70 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f0996575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f633b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f0996575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f633b730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56242/0 (socket says 10.20.193.28:56242) 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f0996575640 1 -- 10.20.193.28:0/2106168660 learned_addr learned my addr 10.20.193.28:0/2106168660 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.407+0000 7f0996d76640 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f63a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f0995d74640 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f63805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f0996575640 1 -- 10.20.193.28:0/2106168660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 msgr2=0x5653f63805e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f0996575640 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f63805e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f0996575640 1 -- 10.20.193.28:0/2106168660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 msgr2=0x5653f63a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f0996575640 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f63a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f0996575640 1 -- 10.20.193.28:0/2106168660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f61f2d10 con 0x5653f633b360 2026-02-20T13:19:36.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f0996d76640 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f63a0f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:19:36.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f0996575640 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f633b730 secure :-1 s=READY pgs=516 gs=1 cs=0 l=1 c_cookie=15437898716725923302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c0095a0 tx=0x7f098c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63e6f16e0e84de6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f097cff9640 1 -- 10.20.193.28:0/2106168660 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098c009e90 con 0x5653f633b360 2026-02-20T13:19:36.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f097cff9640 1 -- 10.20.193.28:0/2106168660 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f098c00ee20 con 0x5653f633b360 2026-02-20T13:19:36.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f097cff9640 1 -- 10.20.193.28:0/2106168660 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098c026e20 con 0x5653f633b360 2026-02-20T13:19:36.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f099ed32e00 1 -- 10.20.193.28:0/2106168660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 msgr2=0x5653f633b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.408+0000 7f099ed32e00 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f633b730 secure :-1 s=READY pgs=516 gs=1 cs=0 l=1 c_cookie=15437898716725923302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c0095a0 tx=0x7f098c014000 comp rx=0 tx=0).stop 2026-02-20T13:19:36.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.409+0000 7f099ed32e00 1 -- 10.20.193.28:0/2106168660 shutdown_connections 2026-02-20T13:19:36.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.409+0000 7f099ed32e00 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f63a0f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.409+0000 7f099ed32e00 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f63805e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.409+0000 7f099ed32e00 1 --2- 10.20.193.28:0/2106168660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f633b730 unknown :-1 s=CLOSED pgs=516 gs=1 cs=0 l=1 c_cookie=15437898716725923302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.409+0000 7f099ed32e00 1 -- 10.20.193.28:0/2106168660 >> 10.20.193.28:0/2106168660 conn(0x5653f6319860 msgr2=0x5653f6339c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.409+0000 7f099ed32e00 1 -- 10.20.193.28:0/2106168660 shutdown_connections 2026-02-20T13:19:36.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.409+0000 7f099ed32e00 1 -- 10.20.193.28:0/2106168660 wait complete. 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.410+0000 7f099ed32e00 1 -- start start 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.410+0000 7f099ed32e00 1 Processor -- start 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.410+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f63986d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.410+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633bc70 0x5653f6398c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.410+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f6380b20 0x5653f639a9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.410+0000 7f099ed32e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5653f639af10 con 0x5653f633bc70 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.410+0000 7f099ed32e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5653f639b080 con 0x5653f633b360 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.410+0000 7f099ed32e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5653f639b240 con 0x5653f6380b20 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f6380b20 0x5653f639a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0995d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633bc70 0x5653f6398c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f6380b20 0x5653f639a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42250/0 (socket says 10.20.193.28:42250) 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 -- 10.20.193.28:0/3585364462 learned_addr learned my addr 10.20.193.28:0/3585364462 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996575640 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f63986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 -- 10.20.193.28:0/3585364462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 msgr2=0x5653f63986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f63986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 -- 10.20.193.28:0/3585364462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633bc70 msgr2=0x5653f6398c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633bc70 0x5653f6398c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 -- 10.20.193.28:0/3585364462 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f61cb3c0 con 0x5653f6380b20 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0995d74640 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633bc70 0x5653f6398c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996575640 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f63986d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0996d76640 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f6380b20 0x5653f639a9a0 secure :-1 s=READY pgs=180 gs=3 cs=0 l=1 c_cookie=6954204531083622207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09880adf40 tx=0x7f09880ad760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60824c2d12a6b73f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0947fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0947fff640 1 -- 10.20.193.28:0/3585364462 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09880d32f0 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0947fff640 1 -- 10.20.193.28:0/3585364462 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f09880b6260 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f098c01c3b0 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.411+0000 7f0947fff640 1 -- 10.20.193.28:0/3585364462 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09880aebf0 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 10 client.26176 _ll_register_callbacks cb 0x5653f61c8a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5653f5edd6f0 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f0947fff640 1 -- 10.20.193.28:0/3585364462 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0988073300 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f0947fff640 1 -- 10.20.193.28:0/3585364462 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f09880aed80 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 10 client.26176 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5653f61dd0e0 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f0947fff640 1 -- 10.20.193.28:0/3585364462 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0988073020 con 0x5653f6380b20 2026-02-20T13:19:36.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 10 client.26176 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 10 client.26176 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 20 client.26176 populate_metadata read hostname 'trial028' 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5653f63a0bb0 0x5653f637e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 4 client.26176 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653f61e9f80 con 0x5653f63a0bb0 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.412+0000 7f0996575640 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5653f63a0bb0 0x5653f637e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.413+0000 7f0947fff640 10 client.26176 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.413+0000 7f0996575640 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5653f63a0bb0 0x5653f637e8a0 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=7274939891380119437 s_cookie=12072959430254721323 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64f5c7497407e78d server_cookie=a78bc4a2f408f92b in_seq=0 out_seq=0 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.413+0000 7f0947fff640 1 -- 10.20.193.28:0/3585364462 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5653f61e9f80 con 0x5653f63a0bb0 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.413+0000 7f0947fff640 10 client.26176 handle_command_reply: tid=0 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.413+0000 7f099ed32e00 1 client.26176 shutdown 2026-02-20T13:19:36.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.413+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f6380b20 msgr2=0x5653f639a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.413+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f6380b20 0x5653f639a9a0 secure :-1 s=READY pgs=180 gs=3 cs=0 l=1 c_cookie=6954204531083622207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09880adf40 tx=0x7f09880ad760 comp rx=0 tx=0).stop 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 shutdown_connections 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5653f63a0bb0 0x5653f637e8a0 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=7274939891380119437 s_cookie=12072959430254721323 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633bc70 0x5653f6398c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f6380b20 0x5653f639a9a0 unknown :-1 s=CLOSED pgs=180 gs=3 cs=0 l=1 c_cookie=6954204531083622207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3585364462 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f63986d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f0947fff640 0 client.26176 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 >> 10.20.193.28:0/3585364462 conn(0x5653f6319860 msgr2=0x5653f6339c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 shutdown_connections 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 1 -- 10.20.193.28:0/3585364462 wait complete. 2026-02-20T13:19:36.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.414+0000 7f099ed32e00 20 client.26176 trim_cache size 0 max 16384 2026-02-20T13:19:36.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.421+0000 7f099ed32e00 1 Processor -- start 2026-02-20T13:19:36.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.421+0000 7f099ed32e00 1 -- start start 2026-02-20T13:19:36.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.421+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f639a930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.421+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f6395840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f6380b20 0x5653f6395d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f099ed32e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5653f6245080 con 0x5653f6380b20 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f099ed32e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5653f5f05700 con 0x5653f633b360 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f099ed32e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5653f6391520 con 0x5653f633bc70 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f639a930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f639a930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58982/0 (socket says 10.20.193.28:58982) 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f6380b20 0x5653f6395d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996575640 1 -- 10.20.193.28:0/3020321530 learned_addr learned my addr 10.20.193.28:0/3020321530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0995d74640 1 --2- 10.20.193.28:0/3020321530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f6395840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996d76640 1 -- 10.20.193.28:0/3020321530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 msgr2=0x5653f6395840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996d76640 1 --2- 10.20.193.28:0/3020321530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f6395840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996d76640 1 -- 10.20.193.28:0/3020321530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 msgr2=0x5653f639a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996d76640 1 --2- 10.20.193.28:0/3020321530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f639a930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996d76640 1 -- 10.20.193.28:0/3020321530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f61d7b60 con 0x5653f6380b20 2026-02-20T13:19:36.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f0996d76640 1 --2- 10.20.193.28:0/3020321530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f6380b20 0x5653f6395d80 secure :-1 s=READY pgs=517 gs=1 cs=0 l=1 c_cookie=7704150241245285261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09880b9260 tx=0x7f0988072000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeaa3d379aa4b8d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f09624e6640 1 -- 10.20.193.28:0/3020321530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09880aebf0 con 0x5653f6380b20 2026-02-20T13:19:36.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f09624e6640 1 -- 10.20.193.28:0/3020321530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5653f5edd6f0 con 0x5653f6380b20 2026-02-20T13:19:36.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.422+0000 7f09624e6640 1 -- 10.20.193.28:0/3020321530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09880b4ec0 con 0x5653f6380b20 2026-02-20T13:19:36.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 -- 10.20.193.28:0/3020321530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f6380b20 msgr2=0x5653f6395d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3020321530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f6380b20 0x5653f6395d80 secure :-1 s=READY pgs=517 gs=1 cs=0 l=1 c_cookie=7704150241245285261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09880b9260 tx=0x7f0988072000 comp rx=0 tx=0).stop 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 -- 10.20.193.28:0/3020321530 shutdown_connections 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3020321530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f6380b20 0x5653f6395d80 unknown :-1 s=CLOSED pgs=517 gs=1 cs=0 l=1 c_cookie=7704150241245285261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3020321530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f6395840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 --2- 10.20.193.28:0/3020321530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f633b360 0x5653f639a930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 -- 10.20.193.28:0/3020321530 >> 10.20.193.28:0/3020321530 conn(0x5653f6319860 msgr2=0x5653f639d230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 -- 10.20.193.28:0/3020321530 shutdown_connections 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 -- 10.20.193.28:0/3020321530 wait complete. 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 -- start start 2026-02-20T13:19:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.423+0000 7f099ed32e00 1 Processor -- start 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f63968d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f6396e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f099ed32e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f6397350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f099ed32e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5653f62a9ae0 con 0x5653f633b360 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f099ed32e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5653f631cc60 con 0x5653f6380b20 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f099ed32e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5653f631ce20 con 0x5653f633bc70 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f63968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f6397350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f6397350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58988/0 (socket says 10.20.193.28:58988) 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996d76640 1 -- 10.20.193.28:0/1687545119 learned_addr learned my addr 10.20.193.28:0/1687545119 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0995d74640 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f6396e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996575640 1 -- 10.20.193.28:0/1687545119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 msgr2=0x5653f6396e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996575640 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f6396e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996575640 1 -- 10.20.193.28:0/1687545119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 msgr2=0x5653f6397350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996575640 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f6397350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.424+0000 7f0996575640 1 -- 10.20.193.28:0/1687545119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f61cb6f0 con 0x5653f633b360 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f0996575640 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f63968d0 secure :-1 s=READY pgs=518 gs=1 cs=0 l=1 c_cookie=9629556536819041344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c009480 tx=0x7f098c00e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a30ea691a3c440 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f0947fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f0947fff640 1 -- 10.20.193.28:0/1687545119 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098c02a040 con 0x5653f633b360 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f098c01c3b0 con 0x5653f633b360 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f099ed32e00 10 client.16251 _ll_register_callbacks cb 0x5653f61c8a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f098c00ee20 con 0x5653f633b360 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f0947fff640 1 -- 10.20.193.28:0/1687545119 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f098c036130 con 0x5653f633b360 2026-02-20T13:19:36.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f0947fff640 1 -- 10.20.193.28:0/1687545119 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f098c0055e0 con 0x5653f633b360 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f0947fff640 1 -- 10.20.193.28:0/1687545119 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f098c004770 con 0x5653f633b360 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f0947fff640 1 -- 10.20.193.28:0/1687545119 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f098c0269e0 con 0x5653f633b360 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f099ed32e00 10 client.16251 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.425+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5653f61dd340 con 0x5653f633b360 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f0947fff640 1 -- 10.20.193.28:0/1687545119 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f098c01cc80 con 0x5653f633b360 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f099ed32e00 10 client.16251 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f099ed32e00 10 client.16251 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f099ed32e00 20 client.16251 populate_metadata read hostname 'trial028' 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f099ed32e00 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5653f631eae0 0x5653f631ef80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f099ed32e00 4 client.16251 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653f5edaf40 con 0x5653f631eae0 2026-02-20T13:19:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f0995d74640 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5653f631eae0 0x5653f631ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f0995d74640 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5653f631eae0 0x5653f631ef80 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=14753594987189987452 s_cookie=6887170538516659114 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ccbf4c791371687c server_cookie=5f94251d6fd23baa in_seq=0 out_seq=0 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.426+0000 7f0947fff640 10 client.16251 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f0947fff640 1 -- 10.20.193.28:0/1687545119 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653f5edaf40 con 0x5653f631eae0 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f0947fff640 10 client.16251 handle_command_reply: tid=0 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 client.16251 shutdown 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 msgr2=0x5653f63968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f63968d0 secure :-1 s=READY pgs=518 gs=1 cs=0 l=1 c_cookie=9629556536819041344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c009480 tx=0x7f098c00e8c0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 shutdown_connections 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5653f631eae0 0x5653f631ef80 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=14753594987189987452 s_cookie=6887170538516659114 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5653f6380b20 0x5653f6397350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5653f633bc70 0x5653f6396e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 --2- 10.20.193.28:0/1687545119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653f633b360 0x5653f63968d0 unknown :-1 s=CLOSED pgs=518 gs=1 cs=0 l=1 c_cookie=9629556536819041344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f0947fff640 0 client.16251 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:19:36.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 >> 10.20.193.28:0/1687545119 conn(0x5653f6319860 msgr2=0x5653f639b730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 shutdown_connections 2026-02-20T13:19:36.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 1 -- 10.20.193.28:0/1687545119 wait complete. 2026-02-20T13:19:36.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.427+0000 7f099ed32e00 20 client.16251 trim_cache size 0 max 16384 2026-02-20T13:19:36.436 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:19:36.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 -- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09700b5760 msgr2=0x7f09700d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09700b5760 0x7f09700d5c10 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c0095d0 tx=0x7f098c005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:36.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 -- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0998159d80 msgr2=0x7f09980f8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0998159d80 0x7f09980f8790 secure :-1 s=READY pgs=515 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098800f940 tx=0x7f098800fe10 comp rx=0 tx=0).stop 2026-02-20T13:19:36.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 -- 10.20.193.28:0/1354179188 shutdown_connections 2026-02-20T13:19:36.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09700b5760 0x7f09700d5c10 unknown :-1 s=CLOSED pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0998159d80 0x7f09980f8790 unknown :-1 s=CLOSED pgs=515 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0998062ae0 0x7f09980f33c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 --2- 10.20.193.28:0/1354179188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f09980614f0 0x7f09980f2e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 -- 10.20.193.28:0/1354179188 >> 10.20.193.28:0/1354179188 conn(0x7f09980eab00 msgr2=0x7f099810fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 -- 10.20.193.28:0/1354179188 shutdown_connections 2026-02-20T13:19:36.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.428+0000 7f0997577640 1 -- 10.20.193.28:0/1354179188 wait complete. 2026-02-20T13:19:36.529 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:19:36.714 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:36.756 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:36 trial028 ceph-mon[37442]: pgmap v249: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:36.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 -- 10.20.193.28:0/3601901997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04113fa0 msgr2=0x7f3b04114370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 --2- 10.20.193.28:0/3601901997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04113fa0 0x7f3b04114370 secure :-1 s=READY pgs=519 gs=1 cs=0 l=1 c_cookie=15100396319289013259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af4009890 tx=0x7f3af402f120 comp rx=0 tx=0).stop 2026-02-20T13:19:36.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 -- 10.20.193.28:0/3601901997 shutdown_connections 2026-02-20T13:19:36.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 --2- 10.20.193.28:0/3601901997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b04119ba0 0x7f3b0417a570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 --2- 10.20.193.28:0/3601901997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b04114990 0x7f3b041193f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 --2- 10.20.193.28:0/3601901997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04113fa0 0x7f3b04114370 unknown :-1 s=CLOSED pgs=519 gs=1 cs=0 l=1 c_cookie=15100396319289013259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 -- 10.20.193.28:0/3601901997 >> 10.20.193.28:0/3601901997 conn(0x7f3b04064a90 msgr2=0x7f3b04064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 -- 10.20.193.28:0/3601901997 shutdown_connections 2026-02-20T13:19:36.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.901+0000 7f3b098df640 1 -- 10.20.193.28:0/3601901997 wait complete. 2026-02-20T13:19:36.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b098df640 1 Processor -- start 2026-02-20T13:19:36.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b098df640 1 -- start start 2026-02-20T13:19:36.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b098df640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b04113fa0 0x7f3b04122310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b098df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04114990 0x7f3b04122850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b098df640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b04119ba0 0x7f3b04127bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b098df640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041281f0 con 0x7f3b04114990 2026-02-20T13:19:36.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b098df640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3b04128360 con 0x7f3b04119ba0 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b098df640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3b04128520 con 0x7f3b04113fa0 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3afbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04114990 0x7f3b04122850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b04113fa0 0x7f3b04122310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3afbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04114990 0x7f3b04122850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56296/0 (socket says 10.20.193.28:56296) 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3afbfff640 1 -- 10.20.193.28:0/1913095992 learned_addr learned my addr 10.20.193.28:0/1913095992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.902+0000 7f3b090de640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b04119ba0 0x7f3b04127bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3b090de640 1 -- 10.20.193.28:0/1913095992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b04113fa0 msgr2=0x7f3b04122310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3b090de640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b04113fa0 0x7f3b04122310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3b090de640 1 -- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04114990 msgr2=0x7f3b04122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3b090de640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04114990 0x7f3b04122850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3b090de640 1 -- 10.20.193.28:0/1913095992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af40094b0 con 0x7f3b04119ba0 2026-02-20T13:19:36.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3afbfff640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04114990 0x7f3b04122850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:36.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3b090de640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b04119ba0 0x7f3b04127bd0 secure :-1 s=READY pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b0000f940 tx=0x7f3b0000fe10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3af9ffb640 1 -- 10.20.193.28:0/1913095992 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b0000dce0 con 0x7f3b04119ba0 2026-02-20T13:19:36.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3af9ffb640 1 -- 10.20.193.28:0/1913095992 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b0000de40 con 0x7f3b04119ba0 2026-02-20T13:19:36.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3af9ffb640 1 -- 10.20.193.28:0/1913095992 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b000116b0 con 0x7f3b04119ba0 2026-02-20T13:19:36.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3b098df640 1 -- 10.20.193.28:0/1913095992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b04128800 con 0x7f3b04119ba0 2026-02-20T13:19:36.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.903+0000 7f3b098df640 1 -- 10.20.193.28:0/1913095992 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b04168f00 con 0x7f3b04119ba0 2026-02-20T13:19:36.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.906+0000 7f3af9ffb640 1 -- 10.20.193.28:0/1913095992 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3b00020060 con 0x7f3b04119ba0 2026-02-20T13:19:36.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.907+0000 7f3af9ffb640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ae00b5760 0x7f3ae00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.908+0000 7f3af9ffb640 1 -- 10.20.193.28:0/1913095992 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3b00015070 con 0x7f3b04119ba0 2026-02-20T13:19:36.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.908+0000 7f3b088dd640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ae00b5760 0x7f3ae00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.908+0000 7f3b088dd640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ae00b5760 0x7f3ae00d5c10 secure :-1 s=READY pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af40097e0 tx=0x7f3af403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.908+0000 7f3b0cb62e00 1 Processor -- start 2026-02-20T13:19:36.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b0cb62e00 1 -- start start 2026-02-20T13:19:36.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e30730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e755e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e95f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f51d46780 con 0x563f51e30c70 2026-02-20T13:19:36.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563f51d424b0 con 0x563f51e30360 2026-02-20T13:19:36.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563f51d3c450 con 0x563f51e75b20 2026-02-20T13:19:36.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e30730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e30730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59032/0 (socket says 10.20.193.28:59032) 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b088dd640 1 -- 10.20.193.28:0/2379632213 learned_addr learned my addr 10.20.193.28:0/2379632213 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b090de640 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e95f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3afbfff640 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3afbfff640 1 -- 10.20.193.28:0/2379632213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 msgr2=0x563f51e95f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3afbfff640 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e95f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3afbfff640 1 -- 10.20.193.28:0/2379632213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 msgr2=0x563f51e30730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3afbfff640 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e30730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3afbfff640 1 -- 10.20.193.28:0/2379632213 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f51ce7d10 con 0x563f51e30c70 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.909+0000 7f3b088dd640 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e30730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:36.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3afbfff640 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e755e0 secure :-1 s=READY pgs=520 gs=2 cs=0 l=1 c_cookie=16968881783902227833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec005970 tx=0x7f3aec004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7d9413d516cd79 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3ad14e4640 1 -- 10.20.193.28:0/2379632213 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec002e80 con 0x563f51e30c70 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3ad14e4640 1 -- 10.20.193.28:0/2379632213 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3aec010910 con 0x563f51e30c70 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3ad14e4640 1 -- 10.20.193.28:0/2379632213 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec00ea20 con 0x563f51e30c70 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/2379632213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 msgr2=0x563f51e755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e755e0 secure :-1 s=READY pgs=520 gs=2 cs=0 l=1 c_cookie=16968881783902227833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec005970 tx=0x7f3aec004610 comp rx=0 tx=0).stop 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/2379632213 shutdown_connections 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e755e0 unknown :-1 s=CLOSED pgs=520 gs=2 cs=0 l=1 c_cookie=16968881783902227833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e95f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/2379632213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e30730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/2379632213 >> 10.20.193.28:0/2379632213 conn(0x563f51e0e860 msgr2=0x563f51e2ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/2379632213 shutdown_connections 2026-02-20T13:19:36.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.910+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/2379632213 wait complete. 2026-02-20T13:19:36.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.911+0000 7f3b0cb62e00 1 -- start start 2026-02-20T13:19:36.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b0cb62e00 1 Processor -- start 2026-02-20T13:19:36.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e8dc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e8fa00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f51e8ff70 con 0x563f51e30c70 2026-02-20T13:19:36.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563f51e900e0 con 0x563f51e30360 2026-02-20T13:19:36.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563f51e902a0 con 0x563f51e75b20 2026-02-20T13:19:36.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b090de640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e8fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3afbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e8dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59048/0 (socket says 10.20.193.28:59048) 2026-02-20T13:19:36.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3afbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e8dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56316/0 (socket says 10.20.193.28:56316) 2026-02-20T13:19:36.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.912+0000 7f3b088dd640 1 -- 10.20.193.28:0/1498699616 learned_addr learned my addr 10.20.193.28:0/1498699616 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3b088dd640 1 -- 10.20.193.28:0/1498699616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 msgr2=0x563f51e8fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3b088dd640 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e8fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3b088dd640 1 -- 10.20.193.28:0/1498699616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 msgr2=0x563f51e8dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3b088dd640 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e8dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3b088dd640 1 -- 10.20.193.28:0/1498699616 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec009d40 con 0x563f51e30360 2026-02-20T13:19:36.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3b090de640 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e8fa00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:36.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3afbfff640 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e8dc70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:36.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3b088dd640 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8d730 secure :-1 s=READY pgs=211 gs=3 cs=0 l=1 c_cookie=11059112279266252378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af402fc40 tx=0x7f3af4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9979dc0638d3565a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3ac27fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:36.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3ac27fc640 1 -- 10.20.193.28:0/1498699616 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af40388d0 con 0x563f51e30360 2026-02-20T13:19:36.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3ac27fc640 1 -- 10.20.193.28:0/1498699616 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3af403e040 con 0x563f51e30360 2026-02-20T13:19:36.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3ac27fc640 1 -- 10.20.193.28:0/1498699616 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af4044670 con 0x563f51e30360 2026-02-20T13:19:36.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.913+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0417ade0 con 0x563f51e30360 2026-02-20T13:19:36.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3ac27fc640 1 -- 10.20.193.28:0/1498699616 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3af4044800 con 0x563f51e30360 2026-02-20T13:19:36.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 10 client.26249 _ll_register_callbacks cb 0x563f51cbda10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:36.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f519d26f0 con 0x563f51e30360 2026-02-20T13:19:36.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3ac27fc640 1 -- 10.20.193.28:0/1498699616 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3af4038a30 con 0x563f51e30360 2026-02-20T13:19:36.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 10 client.26249 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:36.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563f51cc03c0 con 0x563f51e30360 2026-02-20T13:19:36.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3ac27fc640 1 -- 10.20.193.28:0/1498699616 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3af4038b90 con 0x563f51e30360 2026-02-20T13:19:36.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 10 client.26249 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:36.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 10 client.26249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:36.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 20 client.26249 populate_metadata read hostname 'trial028' 2026-02-20T13:19:36.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f51e95c80 0x563f51e738a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 4 client.26249 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:36.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.914+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f51cdef80 con 0x563f51e95c80 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.915+0000 7f3afbfff640 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f51e95c80 0x563f51e738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.915+0000 7f3afbfff640 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f51e95c80 0x563f51e738a0 crc :-1 s=READY pgs=92 gs=4 cs=0 l=0 c_cookie=13581474763570221740 s_cookie=17014914856285384791 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc7b1756f88912ac server_cookie=ec211ee9b4683057 in_seq=0 out_seq=0 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.915+0000 7f3ac27fc640 10 client.26249 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3ac27fc640 1 -- 10.20.193.28:0/1498699616 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563f51cdef80 con 0x563f51e95c80 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3ac27fc640 10 client.26249 handle_command_reply: tid=0 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 client.26249 shutdown 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 msgr2=0x563f51e8d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8d730 secure :-1 s=READY pgs=211 gs=3 cs=0 l=1 c_cookie=11059112279266252378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af402fc40 tx=0x7f3af4005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 shutdown_connections 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f51e95c80 0x563f51e738a0 crc :-1 s=READY pgs=92 gs=4 cs=0 l=0 c_cookie=13581474763570221740 s_cookie=17014914856285384791 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e8dc70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e8fa00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1498699616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8d730 unknown :-1 s=CLOSED pgs=211 gs=3 cs=0 l=1 c_cookie=11059112279266252378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3ac27fc640 0 client.26249 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:36.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 >> 10.20.193.28:0/1498699616 conn(0x563f51e0e860 msgr2=0x563f51e2ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 shutdown_connections 2026-02-20T13:19:36.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1498699616 wait complete. 2026-02-20T13:19:36.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.916+0000 7f3b0cb62e00 20 client.26249 trim_cache size 0 max 16384 2026-02-20T13:19:36.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.923+0000 7f3b0cb62e00 1 Processor -- start 2026-02-20T13:19:36.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.923+0000 7f3b0cb62e00 1 -- start start 2026-02-20T13:19:36.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.923+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8f990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.923+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e74e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.923+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e753c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.923+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f51d3a080 con 0x563f51e30c70 2026-02-20T13:19:36.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.923+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563f519fa700 con 0x563f51e30360 2026-02-20T13:19:36.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.923+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563f51e93c90 con 0x563f51e75b20 2026-02-20T13:19:36.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8f990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8f990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59060/0 (socket says 10.20.193.28:59060) 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 -- 10.20.193.28:0/1524803449 learned_addr learned my addr 10.20.193.28:0/1524803449 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3afbfff640 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e74e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b090de640 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 -- 10.20.193.28:0/1524803449 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 msgr2=0x563f51e753c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e753c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 -- 10.20.193.28:0/1524803449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 msgr2=0x563f51e74e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e74e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 -- 10.20.193.28:0/1524803449 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f51cd20e0 con 0x563f51e30360 2026-02-20T13:19:36.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.924+0000 7f3b088dd640 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8f990 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=12161737410374735346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af402f630 tx=0x7f3af405b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c72bbd34f715f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3ad0ce3640 1 -- 10.20.193.28:0/1524803449 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af40423c0 con 0x563f51e30360 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3ad0ce3640 1 -- 10.20.193.28:0/1524803449 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3af403e040 con 0x563f51e30360 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3ad0ce3640 1 -- 10.20.193.28:0/1524803449 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af40583b0 con 0x563f51e30360 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1524803449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 msgr2=0x563f51e8f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8f990 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=12161737410374735346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af402f630 tx=0x7f3af405b000 comp rx=0 tx=0).stop 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1524803449 shutdown_connections 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e74e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e753c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/1524803449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e8f990 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=12161737410374735346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1524803449 >> 10.20.193.28:0/1524803449 conn(0x563f51e0e860 msgr2=0x563f51e92290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1524803449 shutdown_connections 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.925+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/1524803449 wait complete. 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b0cb62e00 1 -- start start 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b0cb62e00 1 Processor -- start 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e708d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e70e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b0cb62e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e6f770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f519fa700 con 0x563f51e30c70 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563f51e6fcb0 con 0x563f51e30360 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b0cb62e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563f51e6fe70 con 0x563f51e75b20 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3afbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e70e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b090de640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e6f770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b088dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59064/0 (socket says 10.20.193.28:59064) 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.926+0000 7f3b088dd640 1 -- 10.20.193.28:0/67995953 learned_addr learned my addr 10.20.193.28:0/67995953 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b090de640 1 -- 10.20.193.28:0/67995953 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 msgr2=0x563f51e708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b090de640 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b090de640 1 -- 10.20.193.28:0/67995953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 msgr2=0x563f51e70e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b090de640 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e70e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b090de640 1 -- 10.20.193.28:0/67995953 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f51cccb60 con 0x563f51e75b20 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3afbfff640 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e70e10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b090de640 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e6f770 secure :-1 s=READY pgs=181 gs=3 cs=0 l=1 c_cookie=5130855707739435189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b000e56b0 tx=0x7f3b000064e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47347614ed9830b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3ac27fc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3ac27fc640 1 -- 10.20.193.28:0/67995953 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b00073390 con 0x563f51e75b20 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3ac27fc640 1 -- 10.20.193.28:0/67995953 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b000b6240 con 0x563f51e75b20 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3ac27fc640 1 -- 10.20.193.28:0/67995953 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b000aebd0 con 0x563f51e75b20 2026-02-20T13:19:36.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af4044e70 con 0x563f51e75b20 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3ac27fc640 1 -- 10.20.193.28:0/67995953 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3b000aed30 con 0x563f51e75b20 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3ac27fc640 10 client.26200 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b0cb62e00 10 client.26200 _ll_register_callbacks cb 0x563f51cbda10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aec010910 con 0x563f51e75b20 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3ac27fc640 1 -- 10.20.193.28:0/67995953 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b000adae0 con 0x563f51e75b20 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b0cb62e00 10 client.26200 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.927+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563f51cc06f0 con 0x563f51e75b20 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.928+0000 7f3ac27fc640 1 -- 10.20.193.28:0/67995953 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b0008c020 con 0x563f51e75b20 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.928+0000 7f3b0cb62e00 10 client.26200 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:36.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.928+0000 7f3b0cb62e00 10 client.26200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.928+0000 7f3b0cb62e00 20 client.26200 populate_metadata read hostname 'trial028' 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.928+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f51e11fb0 0x563f51e12450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.928+0000 7f3b0cb62e00 4 client.26200 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.928+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f519cff40 con 0x563f51e11fb0 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.928+0000 7f3b088dd640 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f51e11fb0 0x563f51e12450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b088dd640 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f51e11fb0 0x563f51e12450 crc :-1 s=READY pgs=93 gs=4 cs=0 l=0 c_cookie=14089870007166253408 s_cookie=2926451790483516529 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c389461ec4933960 server_cookie=289cd86600136c71 in_seq=0 out_seq=0 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3ac27fc640 10 client.26200 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3ac27fc640 1 -- 10.20.193.28:0/67995953 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f519cff40 con 0x563f51e11fb0 2026-02-20T13:19:36.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3ac27fc640 10 client.26200 handle_command_reply: tid=0 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 client.26200 shutdown 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 msgr2=0x563f51e6f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e6f770 secure :-1 s=READY pgs=181 gs=3 cs=0 l=1 c_cookie=5130855707739435189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b000e56b0 tx=0x7f3b000064e0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 shutdown_connections 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f51e11fb0 0x563f51e12450 crc :-1 s=READY pgs=93 gs=4 cs=0 l=0 c_cookie=14089870007166253408 s_cookie=2926451790483516529 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f51e30c70 0x563f51e70e10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f51e75b20 0x563f51e6f770 unknown :-1 s=CLOSED pgs=181 gs=3 cs=0 l=1 c_cookie=5130855707739435189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 --2- 10.20.193.28:0/67995953 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f51e30360 0x563f51e708d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3ac27fc640 0 client.26200 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:36.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 >> 10.20.193.28:0/67995953 conn(0x563f51e0e860 msgr2=0x563f51e909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 shutdown_connections 2026-02-20T13:19:36.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 1 -- 10.20.193.28:0/67995953 wait complete. 2026-02-20T13:19:36.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b0cb62e00 20 client.26200 trim_cache size 0 max 16384 2026-02-20T13:19:36.942 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:19:36.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b098df640 1 -- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ae00b5760 msgr2=0x7f3ae00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b098df640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ae00b5760 0x7f3ae00d5c10 secure :-1 s=READY pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af40097e0 tx=0x7f3af403a040 comp rx=0 tx=0).stop 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b098df640 1 -- 10.20.193.28:0/1913095992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b04119ba0 msgr2=0x7f3b04127bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.929+0000 7f3b098df640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b04119ba0 0x7f3b04127bd0 secure :-1 s=READY pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b0000f940 tx=0x7f3b0000fe10 comp rx=0 tx=0).stop 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.930+0000 7f3b098df640 1 -- 10.20.193.28:0/1913095992 shutdown_connections 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.930+0000 7f3b098df640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ae00b5760 0x7f3ae00d5c10 unknown :-1 s=CLOSED pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.930+0000 7f3b098df640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b04114990 0x7f3b04122850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.930+0000 7f3b098df640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b04119ba0 0x7f3b04127bd0 unknown :-1 s=CLOSED pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.930+0000 7f3b098df640 1 --2- 10.20.193.28:0/1913095992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b04113fa0 0x7f3b04122310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.930+0000 7f3b098df640 1 -- 10.20.193.28:0/1913095992 >> 10.20.193.28:0/1913095992 conn(0x7f3b04064a90 msgr2=0x7f3b041179f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.930+0000 7f3b098df640 1 -- 10.20.193.28:0/1913095992 shutdown_connections 2026-02-20T13:19:36.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:36.930+0000 7f3b098df640 1 -- 10.20.193.28:0/1913095992 wait complete. 2026-02-20T13:19:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:36 trial127 ceph-mon[43817]: pgmap v249: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:36 trial034 ceph-mon[43332]: pgmap v249: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:38.032 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:19:38.032 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:19:38.221 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:38.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 -- 10.20.193.28:0/2262824438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48601156a0 msgr2=0x7f4860176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 --2- 10.20.193.28:0/2262824438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48601156a0 0x7f4860176070 secure :-1 s=READY pgs=521 gs=3 cs=0 l=1 c_cookie=13258287002853756769 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f485400aa30 tx=0x7f4854030270 comp rx=0 tx=0).stop 2026-02-20T13:19:38.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 -- 10.20.193.28:0/2262824438 shutdown_connections 2026-02-20T13:19:38.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 --2- 10.20.193.28:0/2262824438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48601156a0 0x7f4860176070 unknown :-1 s=CLOSED pgs=521 gs=3 cs=0 l=1 c_cookie=13258287002853756769 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 --2- 10.20.193.28:0/2262824438 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f486010fea0 0x7f4860114ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 --2- 10.20.193.28:0/2262824438 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f486010f4b0 0x7f486010f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 -- 10.20.193.28:0/2262824438 >> 10.20.193.28:0/2262824438 conn(0x7f48600ecda0 msgr2=0x7f486010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 -- 10.20.193.28:0/2262824438 shutdown_connections 2026-02-20T13:19:38.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.402+0000 7f48654e3640 1 -- 10.20.193.28:0/2262824438 wait complete. 2026-02-20T13:19:38.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.403+0000 7f48654e3640 1 Processor -- start 2026-02-20T13:19:38.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.403+0000 7f48654e3640 1 -- start start 2026-02-20T13:19:38.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.403+0000 7f48654e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f486010f4b0 0x7f486011ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.403+0000 7f48654e3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f486010fea0 0x7f486011e300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.403+0000 7f48654e3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48601156a0 0x7f48601236d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.403+0000 7f48654e3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4860123cf0 con 0x7f486010f4b0 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.403+0000 7f48654e3640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4860123e60 con 0x7f486010fea0 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.403+0000 7f48654e3640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4860124020 con 0x7f48601156a0 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f486010f4b0 0x7f486011ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f486010f4b0 0x7f486011ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56360/0 (socket says 10.20.193.28:56360) 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 -- 10.20.193.28:0/599081422 learned_addr learned my addr 10.20.193.28:0/599081422 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485f7fe640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f486010fea0 0x7f486011e300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f4864ce2640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48601156a0 0x7f48601236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 -- 10.20.193.28:0/599081422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48601156a0 msgr2=0x7f48601236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48601156a0 0x7f48601236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 -- 10.20.193.28:0/599081422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f486010fea0 msgr2=0x7f486011e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f486010fea0 0x7f486011e300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 -- 10.20.193.28:0/599081422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485400a650 con 0x7f486010f4b0 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485ffff640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f486010f4b0 0x7f486011ddc0 secure :-1 s=READY pgs=522 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f484c009480 tx=0x7f484c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485d7fa640 1 -- 10.20.193.28:0/599081422 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f484c00cd40 con 0x7f486010f4b0 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485d7fa640 1 -- 10.20.193.28:0/599081422 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f484c004d30 con 0x7f486010f4b0 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f485d7fa640 1 -- 10.20.193.28:0/599081422 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f484c0106b0 con 0x7f486010f4b0 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f48654e3640 1 -- 10.20.193.28:0/599081422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4860124300 con 0x7f486010f4b0 2026-02-20T13:19:38.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.404+0000 7f48654e3640 1 -- 10.20.193.28:0/599081422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4860164a00 con 0x7f486010f4b0 2026-02-20T13:19:38.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.407+0000 7f485d7fa640 1 -- 10.20.193.28:0/599081422 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f484c01f060 con 0x7f486010f4b0 2026-02-20T13:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.409+0000 7f485d7fa640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48340b5760 0x7f48340d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.409+0000 7f485d7fa640 1 -- 10.20.193.28:0/599081422 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f484c014070 con 0x7f486010f4b0 2026-02-20T13:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.409+0000 7f485f7fe640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48340b5760 0x7f48340d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4868766e00 1 Processor -- start 2026-02-20T13:19:38.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f485f7fe640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48340b5760 0x7f48340d5c10 secure :-1 s=READY pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4860124760 tx=0x7f4850005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4868766e00 1 -- start start 2026-02-20T13:19:38.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4868766e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d782017e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4868766e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d78201d20 0x559d78246480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4868766e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d782469c0 0x559d78266da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4868766e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d78117a20 con 0x559d782469c0 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4868766e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d78113750 con 0x559d78201d20 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4868766e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d7810d6f0 con 0x559d78201410 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f485f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d78201d20 0x559d78246480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f485f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d78201d20 0x559d78246480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59090/0 (socket says 10.20.193.28:59090) 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f485f7fe640 1 -- 10.20.193.28:0/1869864436 learned_addr learned my addr 10.20.193.28:0/1869864436 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f4864ce2640 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d782469c0 0x559d78266da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.410+0000 7f485ffff640 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d782017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f485f7fe640 1 -- 10.20.193.28:0/1869864436 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 msgr2=0x559d782017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f485f7fe640 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d782017e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f485f7fe640 1 -- 10.20.193.28:0/1869864436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d782469c0 msgr2=0x559d78266da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f485f7fe640 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d782469c0 0x559d78266da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f485f7fe640 1 -- 10.20.193.28:0/1869864436 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d780b9120 con 0x559d78201d20 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f4864ce2640 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d782469c0 0x559d78266da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f485ffff640 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d782017e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f485f7fe640 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d78201d20 0x559d78246480 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=9408985835410203171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48500043f0 tx=0x7f4850013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82936ec4304ea223 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f4830ce3640 1 -- 10.20.193.28:0/1869864436 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f485001d460 con 0x559d78201d20 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f4830ce3640 1 -- 10.20.193.28:0/1869864436 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f485001daa0 con 0x559d78201d20 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.411+0000 7f4830ce3640 1 -- 10.20.193.28:0/1869864436 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f485001aae0 con 0x559d78201d20 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 -- 10.20.193.28:0/1869864436 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d78201d20 msgr2=0x559d78246480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d78201d20 0x559d78246480 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=9408985835410203171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48500043f0 tx=0x7f4850013000 comp rx=0 tx=0).stop 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 -- 10.20.193.28:0/1869864436 shutdown_connections 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d782469c0 0x559d78266da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d78201d20 0x559d78246480 unknown :-1 s=CLOSED pgs=213 gs=1 cs=0 l=1 c_cookie=9408985835410203171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 --2- 10.20.193.28:0/1869864436 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d782017e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 -- 10.20.193.28:0/1869864436 >> 10.20.193.28:0/1869864436 conn(0x559d781df910 msgr2=0x559d781ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 -- 10.20.193.28:0/1869864436 shutdown_connections 2026-02-20T13:19:38.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.412+0000 7f4868766e00 1 -- 10.20.193.28:0/1869864436 wait complete. 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.413+0000 7f4868766e00 1 -- start start 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.413+0000 7f4868766e00 1 Processor -- start 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4868766e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d78219cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4868766e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201d20 0x559d7821a210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4868766e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d7821f200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4868766e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d7821f740 con 0x559d78201d20 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4868766e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d7821f8b0 con 0x559d782469c0 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4868766e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d7821fa70 con 0x559d78201410 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201d20 0x559d7821a210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d78219cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d78219cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42368/0 (socket says 10.20.193.28:42368) 2026-02-20T13:19:38.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485ffff640 1 -- 10.20.193.28:0/243961546 learned_addr learned my addr 10.20.193.28:0/243961546 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4864ce2640 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d7821f200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485f7fe640 1 -- 10.20.193.28:0/243961546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 msgr2=0x559d78219cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485f7fe640 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d78219cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485f7fe640 1 -- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 msgr2=0x559d7821f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485f7fe640 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d7821f200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485f7fe640 1 -- 10.20.193.28:0/243961546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d78091810 con 0x559d78201d20 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4864ce2640 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d7821f200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f485f7fe640 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201d20 0x559d7821a210 secure :-1 s=READY pgs=523 gs=1 cs=0 l=1 c_cookie=8306645222341737266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48500043f0 tx=0x7f4850011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734721d1b8dffb32 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.414+0000 7f4821ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4821ffb640 1 -- 10.20.193.28:0/243961546 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f485002c070 con 0x559d78201d20 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4821ffb640 1 -- 10.20.193.28:0/243961546 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f485001a3f0 con 0x559d78201d20 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4821ffb640 1 -- 10.20.193.28:0/243961546 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4850004b50 con 0x559d78201d20 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4850009890 con 0x559d78201d20 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4821ffb640 1 -- 10.20.193.28:0/243961546 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4850004ce0 con 0x559d78201d20 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 10 client.16281 _ll_register_callbacks cb 0x559d780c4b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d77da39d0 con 0x559d78201d20 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4821ffb640 1 -- 10.20.193.28:0/243961546 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4850004ea0 con 0x559d78201d20 2026-02-20T13:19:38.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 10 client.16281 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559d780a34f0 con 0x559d78201d20 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4821ffb640 1 -- 10.20.193.28:0/243961546 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4850039060 con 0x559d78201d20 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 10 client.16281 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 20 client.16281 populate_metadata read hostname 'trial028' 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d78244410 0x559d782448b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 4 client.16281 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.415+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d7811adf0 con 0x559d78244410 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.416+0000 7f485ffff640 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d78244410 0x559d782448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.416+0000 7f485ffff640 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d78244410 0x559d782448b0 crc :-1 s=READY pgs=94 gs=4 cs=0 l=0 c_cookie=526418310801462345 s_cookie=13738666808095899259 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74e36aa22951449 server_cookie=bea98cabe0017e7b in_seq=0 out_seq=0 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.416+0000 7f4821ffb640 10 client.16281 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:38.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4821ffb640 1 -- 10.20.193.28:0/243961546 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559d7811adf0 con 0x559d78244410 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4821ffb640 10 client.16281 handle_command_reply: tid=0 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 client.16281 shutdown 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201d20 msgr2=0x559d7821a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201d20 0x559d7821a210 secure :-1 s=READY pgs=523 gs=1 cs=0 l=1 c_cookie=8306645222341737266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48500043f0 tx=0x7f4850011f20 comp rx=0 tx=0).stop 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 shutdown_connections 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d78244410 0x559d782448b0 crc :-1 s=READY pgs=94 gs=4 cs=0 l=0 c_cookie=526418310801462345 s_cookie=13738666808095899259 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201d20 0x559d7821a210 unknown :-1 s=CLOSED pgs=523 gs=1 cs=0 l=1 c_cookie=8306645222341737266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d7821f200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 --2- 10.20.193.28:0/243961546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201410 0x559d78219cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4821ffb640 0 client.16281 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:38.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 >> 10.20.193.28:0/243961546 conn(0x559d781df910 msgr2=0x559d782004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 shutdown_connections 2026-02-20T13:19:38.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 1 -- 10.20.193.28:0/243961546 wait complete. 2026-02-20T13:19:38.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.417+0000 7f4868766e00 20 client.16281 trim_cache size 0 max 16384 2026-02-20T13:19:38.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4868766e00 1 Processor -- start 2026-02-20T13:19:38.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4868766e00 1 -- start start 2026-02-20T13:19:38.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4868766e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78219ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4868766e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 0x559d78217080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4868766e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d782175c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4868766e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d7820be20 con 0x559d78201410 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4868766e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d7810b320 con 0x559d782469c0 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4868766e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d77dcb790 con 0x559d78201d20 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f485ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78219ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4864ce2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d782175c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4864ce2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d782175c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59102/0 (socket says 10.20.193.28:59102) 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.426+0000 7f4864ce2640 1 -- 10.20.193.28:0/2174273944 learned_addr learned my addr 10.20.193.28:0/2174273944 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f485f7fe640 1 --2- 10.20.193.28:0/2174273944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 0x559d78217080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f485ffff640 1 -- 10.20.193.28:0/2174273944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 msgr2=0x559d78217080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f485ffff640 1 --2- 10.20.193.28:0/2174273944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 0x559d78217080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f485ffff640 1 -- 10.20.193.28:0/2174273944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 msgr2=0x559d782175c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f485ffff640 1 --2- 10.20.193.28:0/2174273944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d782175c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f485ffff640 1 -- 10.20.193.28:0/2174273944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7809df70 con 0x559d78201410 2026-02-20T13:19:38.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f485ffff640 1 --2- 10.20.193.28:0/2174273944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78219ef0 secure :-1 s=READY pgs=524 gs=1 cs=0 l=1 c_cookie=12826351657451104390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f484c0ad0b0 tx=0x7f484c0e47a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2005ae0229da886 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f4823fff640 1 -- 10.20.193.28:0/2174273944 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f484c0b2df0 con 0x559d78201410 2026-02-20T13:19:38.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f4823fff640 1 -- 10.20.193.28:0/2174273944 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f484c0b53d0 con 0x559d78201410 2026-02-20T13:19:38.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f4823fff640 1 -- 10.20.193.28:0/2174273944 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f484c0aef90 con 0x559d78201410 2026-02-20T13:19:38.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f4868766e00 1 -- 10.20.193.28:0/2174273944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 msgr2=0x559d78219ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.427+0000 7f4868766e00 1 --2- 10.20.193.28:0/2174273944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78219ef0 secure :-1 s=READY pgs=524 gs=1 cs=0 l=1 c_cookie=12826351657451104390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f484c0ad0b0 tx=0x7f484c0e47a0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 -- 10.20.193.28:0/2174273944 shutdown_connections 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 --2- 10.20.193.28:0/2174273944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d782175c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 --2- 10.20.193.28:0/2174273944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 0x559d78217080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 --2- 10.20.193.28:0/2174273944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78219ef0 unknown :-1 s=CLOSED pgs=524 gs=1 cs=0 l=1 c_cookie=12826351657451104390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 -- 10.20.193.28:0/2174273944 >> 10.20.193.28:0/2174273944 conn(0x559d781df910 msgr2=0x559d78245760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 -- 10.20.193.28:0/2174273944 shutdown_connections 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 -- 10.20.193.28:0/2174273944 wait complete. 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 -- start start 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 Processor -- start 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78225d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 0x559d78222310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d78222aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d7820bce0 con 0x559d78201410 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d782958f0 con 0x559d782469c0 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.428+0000 7f4868766e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d78295ab0 con 0x559d78201d20 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78225d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78225d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56406/0 (socket says 10.20.193.28:56406) 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 -- 10.20.193.28:0/1249862268 learned_addr learned my addr 10.20.193.28:0/1249862268 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f4864ce2640 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d78222aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485f7fe640 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 0x559d78222310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 -- 10.20.193.28:0/1249862268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 msgr2=0x559d78222310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 0x559d78222310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 -- 10.20.193.28:0/1249862268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 msgr2=0x559d78222aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d78222aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 -- 10.20.193.28:0/1249862268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d78091b40 con 0x559d78201410 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f485ffff640 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78225d10 secure :-1 s=READY pgs=525 gs=2 cs=0 l=1 c_cookie=11119546685110659277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f484c0e6010 tx=0x7f484c0acbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5090cbd564a8cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f4821ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f4821ffb640 1 -- 10.20.193.28:0/1249862268 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f484c0b8210 con 0x559d78201410 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f4821ffb640 1 -- 10.20.193.28:0/1249862268 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f484c0b2df0 con 0x559d78201410 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4860164a00 con 0x559d78201410 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f4868766e00 10 client.16287 _ll_register_callbacks cb 0x559d780c4b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f485001daa0 con 0x559d78201410 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.429+0000 7f4821ffb640 1 -- 10.20.193.28:0/1249862268 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f484c0adfe0 con 0x559d78201410 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4821ffb640 1 -- 10.20.193.28:0/1249862268 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f484c0b7f90 con 0x559d78201410 2026-02-20T13:19:38.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4821ffb640 1 -- 10.20.193.28:0/1249862268 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f484c072260 con 0x559d78201410 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4868766e00 10 client.16287 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559d780a3750 con 0x559d78201410 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4821ffb640 1 -- 10.20.193.28:0/1249862268 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f484c0ab0b0 con 0x559d78201410 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4868766e00 10 client.16287 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4868766e00 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4868766e00 20 client.16287 populate_metadata read hostname 'trial028' 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4868766e00 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d782973d0 0x559d78297870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4868766e00 4 client.16287 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559d77da1220 con 0x559d782973d0 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.430+0000 7f485f7fe640 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d782973d0 0x559d78297870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.431+0000 7f485f7fe640 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d782973d0 0x559d78297870 crc :-1 s=READY pgs=95 gs=4 cs=0 l=0 c_cookie=331611372046387065 s_cookie=12258589889118511805 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49a1ec9324e0779 server_cookie=aa1f428e2c1aa2bd in_seq=0 out_seq=0 2026-02-20T13:19:38.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.431+0000 7f4821ffb640 10 client.16287 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4821ffb640 1 -- 10.20.193.28:0/1249862268 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559d77da1220 con 0x559d782973d0 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4821ffb640 10 client.16287 handle_command_reply: tid=0 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 client.16287 shutdown 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 msgr2=0x559d78225d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78225d10 secure :-1 s=READY pgs=525 gs=2 cs=0 l=1 c_cookie=11119546685110659277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f484c0e6010 tx=0x7f484c0acbe0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 shutdown_connections 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d782973d0 0x559d78297870 crc :-1 s=READY pgs=95 gs=4 cs=0 l=0 c_cookie=331611372046387065 s_cookie=12258589889118511805 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d782469c0 0x559d78222aa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d78201d20 0x559d78222310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 --2- 10.20.193.28:0/1249862268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d78201410 0x559d78225d10 unknown :-1 s=CLOSED pgs=525 gs=2 cs=0 l=1 c_cookie=11119546685110659277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 >> 10.20.193.28:0/1249862268 conn(0x559d781df910 msgr2=0x559d78245e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4821ffb640 0 client.16287 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:38.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 shutdown_connections 2026-02-20T13:19:38.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 1 -- 10.20.193.28:0/1249862268 wait complete. 2026-02-20T13:19:38.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.432+0000 7f4868766e00 20 client.16287 trim_cache size 0 max 16384 2026-02-20T13:19:38.441 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:19:38.441 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:19:38.441 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "c4589a3f-bba1-4bc2-9899-286bfc82b52c", 2026-02-20T13:19:38.441 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 -- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48340b5760 msgr2=0x7f48340d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48340b5760 0x7f48340d5c10 secure :-1 s=READY pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4860124760 tx=0x7f4850005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 -- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f486010f4b0 msgr2=0x7f486011ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f486010f4b0 0x7f486011ddc0 secure :-1 s=READY pgs=522 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f484c009480 tx=0x7f484c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 -- 10.20.193.28:0/599081422 shutdown_connections 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48340b5760 0x7f48340d5c10 unknown :-1 s=CLOSED pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f48601156a0 0x7f48601236d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f486010fea0 0x7f486011e300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 --2- 10.20.193.28:0/599081422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f486010f4b0 0x7f486011ddc0 unknown :-1 s=CLOSED pgs=522 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 -- 10.20.193.28:0/599081422 >> 10.20.193.28:0/599081422 conn(0x7f48600ecda0 msgr2=0x7f486010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 -- 10.20.193.28:0/599081422 shutdown_connections 2026-02-20T13:19:38.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.433+0000 7f48654e3640 1 -- 10.20.193.28:0/599081422 wait complete. 2026-02-20T13:19:38.535 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:19:38.721 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:19:38.843 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:38 trial028 ceph-mon[37442]: pgmap v250: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:19:38.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 -- 10.20.193.28:0/453486282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 msgr2=0x7f552410f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 --2- 10.20.193.28:0/453486282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 0x7f552410f880 secure :-1 s=READY pgs=526 gs=1 cs=0 l=1 c_cookie=12730974517961141126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5518009950 tx=0x7f551802f190 comp rx=0 tx=0).stop 2026-02-20T13:19:38.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 -- 10.20.193.28:0/453486282 shutdown_connections 2026-02-20T13:19:38.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 --2- 10.20.193.28:0/453486282 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f55241156a0 0x7f5524176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 --2- 10.20.193.28:0/453486282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f552410fea0 0x7f5524114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 --2- 10.20.193.28:0/453486282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 0x7f552410f880 unknown :-1 s=CLOSED pgs=526 gs=1 cs=0 l=1 c_cookie=12730974517961141126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 -- 10.20.193.28:0/453486282 >> 10.20.193.28:0/453486282 conn(0x7f55240ecda0 msgr2=0x7f552410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 -- 10.20.193.28:0/453486282 shutdown_connections 2026-02-20T13:19:38.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.907+0000 7f5523fff640 1 -- 10.20.193.28:0/453486282 wait complete. 2026-02-20T13:19:38.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5523fff640 1 Processor -- start 2026-02-20T13:19:38.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5523fff640 1 -- start start 2026-02-20T13:19:38.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5523fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 0x7f552411de20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5523fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f552410fea0 0x7f552411e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5523fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55241156a0 0x7f5524123730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5523fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5524123cc0 con 0x7f552410f4b0 2026-02-20T13:19:38.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5523fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5524123e30 con 0x7f552410fea0 2026-02-20T13:19:38.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5523fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5524123ff0 con 0x7f55241156a0 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5522ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 0x7f552411de20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5522ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 0x7f552411de20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56436/0 (socket says 10.20.193.28:56436) 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f5522ffd640 1 -- 10.20.193.28:0/3624964789 learned_addr learned my addr 10.20.193.28:0/3624964789 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.908+0000 7f55227fc640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f552410fea0 0x7f552411e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f55237fe640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55241156a0 0x7f5524123730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5522ffd640 1 -- 10.20.193.28:0/3624964789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55241156a0 msgr2=0x7f5524123730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55241156a0 0x7f5524123730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5522ffd640 1 -- 10.20.193.28:0/3624964789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f552410fea0 msgr2=0x7f552411e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f552410fea0 0x7f552411e360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5522ffd640 1 -- 10.20.193.28:0/3624964789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5518009570 con 0x7f552410f4b0 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 0x7f552411de20 secure :-1 s=READY pgs=527 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5518004820 tx=0x7f5518005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5528a11640 1 -- 10.20.193.28:0/3624964789 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5518043cf0 con 0x7f552410f4b0 2026-02-20T13:19:38.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5528a11640 1 -- 10.20.193.28:0/3624964789 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5518043e50 con 0x7f552410f4b0 2026-02-20T13:19:38.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5528a11640 1 -- 10.20.193.28:0/3624964789 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f551804b720 con 0x7f552410f4b0 2026-02-20T13:19:38.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5523fff640 1 -- 10.20.193.28:0/3624964789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5524124270 con 0x7f552410f4b0 2026-02-20T13:19:38.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.909+0000 7f5523fff640 1 -- 10.20.193.28:0/3624964789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5524063080 con 0x7f552410f4b0 2026-02-20T13:19:38.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.912+0000 7f5528a11640 1 -- 10.20.193.28:0/3624964789 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f551802f9f0 con 0x7f552410f4b0 2026-02-20T13:19:38.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.914+0000 7f5528a11640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f54f80b5760 0x7f54f80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.914+0000 7f5528a11640 1 -- 10.20.193.28:0/3624964789 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5518114330 con 0x7f552410f4b0 2026-02-20T13:19:38.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.914+0000 7f55227fc640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f54f80b5760 0x7f54f80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.914+0000 7f552ba0de00 1 Processor -- start 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f552ba0de00 1 -- start start 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448921550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b448966400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448966940 0x55b448986d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f552ba0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b4488377d0 con 0x55b448966940 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f552ba0de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b448833500 con 0x55b448921180 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f552ba0de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b44882d4a0 con 0x55b448921a90 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55227fc640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f54f80b5760 0x7f54f80d5c10 secure :-1 s=READY pgs=316 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55241247c0 tx=0x7f550c005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448966940 0x55b448986d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448966940 0x55b448986d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56440/0 (socket says 10.20.193.28:56440) 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55237fe640 1 -- 10.20.193.28:0/2057331176 learned_addr learned my addr 10.20.193.28:0/2057331176 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f5522ffd640 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448921550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55227fc640 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b448966400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55237fe640 1 -- 10.20.193.28:0/2057331176 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 msgr2=0x55b448966400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55237fe640 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b448966400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55237fe640 1 -- 10.20.193.28:0/2057331176 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 msgr2=0x55b448921550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55237fe640 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448921550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.915+0000 7f55237fe640 1 -- 10.20.193.28:0/2057331176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4487d8d80 con 0x55b448966940 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f55237fe640 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448966940 0x55b448986d20 secure :-1 s=READY pgs=528 gs=2 cs=0 l=1 c_cookie=11239436489997908111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f551400b3d0 tx=0x7f551400f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfa7ff045e3788f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f54e7fff640 1 -- 10.20.193.28:0/2057331176 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5514005b50 con 0x55b448966940 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f54e7fff640 1 -- 10.20.193.28:0/2057331176 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f55140055b0 con 0x55b448966940 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f54e7fff640 1 -- 10.20.193.28:0/2057331176 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5514006020 con 0x55b448966940 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 -- 10.20.193.28:0/2057331176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448966940 msgr2=0x55b448986d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448966940 0x55b448986d20 secure :-1 s=READY pgs=528 gs=2 cs=0 l=1 c_cookie=11239436489997908111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f551400b3d0 tx=0x7f551400f720 comp rx=0 tx=0).stop 2026-02-20T13:19:38.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 -- 10.20.193.28:0/2057331176 shutdown_connections 2026-02-20T13:19:38.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448966940 0x55b448986d20 unknown :-1 s=CLOSED pgs=528 gs=2 cs=0 l=1 c_cookie=11239436489997908111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b448966400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 --2- 10.20.193.28:0/2057331176 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448921550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 -- 10.20.193.28:0/2057331176 >> 10.20.193.28:0/2057331176 conn(0x55b4488ff680 msgr2=0x55b44891fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 -- 10.20.193.28:0/2057331176 shutdown_connections 2026-02-20T13:19:38.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.916+0000 7f552ba0de00 1 -- 10.20.193.28:0/2057331176 wait complete. 2026-02-20T13:19:38.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.917+0000 7f552ba0de00 1 -- start start 2026-02-20T13:19:38.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f552ba0de00 1 Processor -- start 2026-02-20T13:19:38.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921180 0x55b44897dff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b44897e530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448966940 0x55b448983520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f552ba0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b448983a60 con 0x55b448921180 2026-02-20T13:19:38.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f552ba0de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b448983bd0 con 0x55b448966940 2026-02-20T13:19:38.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f552ba0de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b448983d90 con 0x55b448921a90 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f5522ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921180 0x55b44897dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f5522ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921180 0x55b44897dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56456/0 (socket says 10.20.193.28:56456) 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f5522ffd640 1 -- 10.20.193.28:0/3943962478 learned_addr learned my addr 10.20.193.28:0/3943962478 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f55227fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b44897e530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f55237fe640 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448966940 0x55b448983520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f5522ffd640 1 -- 10.20.193.28:0/3943962478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 msgr2=0x55b44897e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b44897e530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f5522ffd640 1 -- 10.20.193.28:0/3943962478 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448966940 msgr2=0x55b448983520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448966940 0x55b448983520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.918+0000 7f5522ffd640 1 -- 10.20.193.28:0/3943962478 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4487b1350 con 0x55b448921180 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921180 0x55b44897dff0 secure :-1 s=READY pgs=529 gs=1 cs=0 l=1 c_cookie=538935128862569477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f551802ffd0 tx=0x7f5518005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77aaea4f0d53405 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f54e57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f54e57fa640 1 -- 10.20.193.28:0/3943962478 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55180da450 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f54e57fa640 1 -- 10.20.193.28:0/3943962478 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f55180e0180 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f54e57fa640 1 -- 10.20.193.28:0/3943962478 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55180e5860 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551400b8d0 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f54e57fa640 1 -- 10.20.193.28:0/3943962478 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5518038920 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f552ba0de00 10 client.16299 _ll_register_callbacks cb 0x55b4487ae9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4484c36f0 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f54e57fa640 1 -- 10.20.193.28:0/3943962478 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55180e55c0 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f552ba0de00 10 client.16299 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.919+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b4487c3150 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.920+0000 7f54e57fa640 1 -- 10.20.193.28:0/3943962478 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f55180db320 con 0x55b448921180 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.920+0000 7f552ba0de00 10 client.16299 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.920+0000 7f552ba0de00 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:38.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.920+0000 7f552ba0de00 20 client.16299 populate_metadata read hostname 'trial028' 2026-02-20T13:19:38.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.920+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b448963610 0x55b448963ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.920+0000 7f552ba0de00 4 client.16299 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:38.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.920+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b44883ad60 con 0x55b448963610 2026-02-20T13:19:38.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.920+0000 7f55227fc640 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b448963610 0x55b448963ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f55227fc640 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b448963610 0x55b448963ab0 crc :-1 s=READY pgs=96 gs=4 cs=0 l=0 c_cookie=12770135977591859927 s_cookie=5486253069684753553 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b138a30335cc6ad7 server_cookie=4c2316197674c491 in_seq=0 out_seq=0 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f54e57fa640 10 client.16299 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f54e57fa640 1 -- 10.20.193.28:0/3943962478 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b44883ad60 con 0x55b448963610 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f54e57fa640 10 client.16299 handle_command_reply: tid=0 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f552ba0de00 1 client.16299 shutdown 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921180 msgr2=0x55b44897dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921180 0x55b44897dff0 secure :-1 s=READY pgs=529 gs=1 cs=0 l=1 c_cookie=538935128862569477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f551802ffd0 tx=0x7f5518005ab0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 shutdown_connections 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.921+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b448963610 0x55b448963ab0 crc :-1 s=READY pgs=96 gs=4 cs=0 l=0 c_cookie=12770135977591859927 s_cookie=5486253069684753553 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.922+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448966940 0x55b448983520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.922+0000 7f54e57fa640 0 client.16299 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.922+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b44897e530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.922+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3943962478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921180 0x55b44897dff0 unknown :-1 s=CLOSED pgs=529 gs=1 cs=0 l=1 c_cookie=538935128862569477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.922+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 >> 10.20.193.28:0/3943962478 conn(0x55b4488ff680 msgr2=0x55b44891fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.922+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 shutdown_connections 2026-02-20T13:19:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.922+0000 7f552ba0de00 1 -- 10.20.193.28:0/3943962478 wait complete. 2026-02-20T13:19:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.922+0000 7f552ba0de00 20 client.16299 trim_cache size 0 max 16384 2026-02-20T13:19:38.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f552ba0de00 1 Processor -- start 2026-02-20T13:19:38.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f552ba0de00 1 -- start start 2026-02-20T13:19:38.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b44897b3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921a90 0x55b44897b930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448963610 0x55b4489615a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f552ba0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b44882b0d0 con 0x55b448921a90 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f552ba0de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b4484eb700 con 0x55b448921180 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f552ba0de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b44897eb10 con 0x55b448963610 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f55237fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448963610 0x55b4489615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f55237fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448963610 0x55b4489615a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42426/0 (socket says 10.20.193.28:42426) 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f55237fe640 1 -- 10.20.193.28:0/1390486386 learned_addr learned my addr 10.20.193.28:0/1390486386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f55227fc640 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921a90 0x55b44897b930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.931+0000 7f5522ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b44897b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f55237fe640 1 -- 10.20.193.28:0/1390486386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 msgr2=0x55b44897b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f55237fe640 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b44897b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f55237fe640 1 -- 10.20.193.28:0/1390486386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921a90 msgr2=0x55b44897b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f55237fe640 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921a90 0x55b44897b930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f55237fe640 1 -- 10.20.193.28:0/1390486386 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4487bdbd0 con 0x55b448963610 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f55227fc640 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921a90 0x55b44897b930 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f55237fe640 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448963610 0x55b4489615a0 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=16617699832201372473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f551400b2b0 tx=0x7f5514003b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e69dedf3fa6e6339 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f54e77fe640 1 -- 10.20.193.28:0/1390486386 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5514003a10 con 0x55b448963610 2026-02-20T13:19:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f54e77fe640 1 -- 10.20.193.28:0/1390486386 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5514020040 con 0x55b448963610 2026-02-20T13:19:38.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.932+0000 7f54e77fe640 1 -- 10.20.193.28:0/1390486386 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5514005e90 con 0x55b448963610 2026-02-20T13:19:38.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 -- 10.20.193.28:0/1390486386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448963610 msgr2=0x55b4489615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448963610 0x55b4489615a0 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=16617699832201372473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f551400b2b0 tx=0x7f5514003b70 comp rx=0 tx=0).stop 2026-02-20T13:19:38.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 -- 10.20.193.28:0/1390486386 shutdown_connections 2026-02-20T13:19:38.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448921a90 0x55b44897b930 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448963610 0x55b4489615a0 unknown :-1 s=CLOSED pgs=182 gs=2 cs=0 l=1 c_cookie=16617699832201372473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 --2- 10.20.193.28:0/1390486386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b44897b3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 -- 10.20.193.28:0/1390486386 >> 10.20.193.28:0/1390486386 conn(0x55b4488ff680 msgr2=0x55b44896fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 -- 10.20.193.28:0/1390486386 shutdown_connections 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 -- 10.20.193.28:0/1390486386 wait complete. 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 -- start start 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.933+0000 7f552ba0de00 1 Processor -- start 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448965b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b4488ffa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f552ba0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448963610 0x55b4488fff90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f552ba0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b4489660d0 con 0x55b448963610 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f552ba0de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b448966240 con 0x55b448921180 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f552ba0de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b448900550 con 0x55b448921a90 2026-02-20T13:19:38.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f55237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448963610 0x55b4488fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f5522ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448965b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f55237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448963610 0x55b4488fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56466/0 (socket says 10.20.193.28:56466) 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f55237fe640 1 -- 10.20.193.28:0/3080611200 learned_addr learned my addr 10.20.193.28:0/3080611200 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f55227fc640 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b4488ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f5522ffd640 1 -- 10.20.193.28:0/3080611200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 msgr2=0x55b4488ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b4488ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f5522ffd640 1 -- 10.20.193.28:0/3080611200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448963610 msgr2=0x55b4488fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448963610 0x55b4488fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f5522ffd640 1 -- 10.20.193.28:0/3080611200 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4487d8d80 con 0x55b448921180 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.934+0000 7f55227fc640 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b4488ffa50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:38.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f5522ffd640 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448965b10 secure :-1 s=READY pgs=214 gs=3 cs=0 l=1 c_cookie=14129372041041347544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5518111e60 tx=0x7f551809d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4159d02bd9b03d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f54e57fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f54e57fa640 1 -- 10.20.193.28:0/3080611200 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55180dc9b0 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c0040d0 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f54e57fa640 1 -- 10.20.193.28:0/3080611200 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f55180f8020 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 10 client.26288 _ll_register_callbacks cb 0x55b4487ae9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f54e57fa640 1 -- 10.20.193.28:0/3080611200 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55180e5860 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55140055b0 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f54e57fa640 1 -- 10.20.193.28:0/3080611200 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f55180f9060 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f54e57fa640 1 -- 10.20.193.28:0/3080611200 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55180e03b0 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 10 client.26288 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b4487b1680 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f54e57fa640 1 -- 10.20.193.28:0/3080611200 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f55180fd070 con 0x55b448921180 2026-02-20T13:19:38.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 10 client.26288 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:38.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 10 client.26288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:38.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 20 client.26288 populate_metadata read hostname 'trial028' 2026-02-20T13:19:38.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b448966940 0x55b448a33c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:38.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 4 client.26288 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:19:38.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.935+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b4484c0f40 con 0x55b448966940 2026-02-20T13:19:38.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.936+0000 7f55227fc640 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b448966940 0x55b448a33c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:38.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.936+0000 7f55227fc640 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b448966940 0x55b448a33c30 crc :-1 s=READY pgs=97 gs=4 cs=0 l=0 c_cookie=4034639851863296330 s_cookie=12954684424794857300 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37fdeb919ef2494a server_cookie=b3c848d8f52edf54 in_seq=0 out_seq=0 2026-02-20T13:19:38.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.936+0000 7f54e57fa640 10 client.26288 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.936+0000 7f54e57fa640 1 -- 10.20.193.28:0/3080611200 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x55b4484c0f40 con 0x55b448966940 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.936+0000 7f54e57fa640 10 client.26288 handle_command_reply: tid=0 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.936+0000 7f552ba0de00 1 client.26288 shutdown 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 msgr2=0x55b448965b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448965b10 secure :-1 s=READY pgs=214 gs=3 cs=0 l=1 c_cookie=14129372041041347544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5518111e60 tx=0x7f551809d000 comp rx=0 tx=0).stop 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 shutdown_connections 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b448966940 0x55b448a33c30 crc :-1 s=READY pgs=97 gs=4 cs=0 l=0 c_cookie=4034639851863296330 s_cookie=12954684424794857300 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b448963610 0x55b4488fff90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b448921a90 0x55b4488ffa50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 --2- 10.20.193.28:0/3080611200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b448921180 0x55b448965b10 unknown :-1 s=CLOSED pgs=214 gs=3 cs=0 l=1 c_cookie=14129372041041347544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f54e57fa640 0 client.26288 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 >> 10.20.193.28:0/3080611200 conn(0x55b4488ff680 msgr2=0x55b448982380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 shutdown_connections 2026-02-20T13:19:38.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 1 -- 10.20.193.28:0/3080611200 wait complete. 2026-02-20T13:19:38.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f552ba0de00 20 client.26288 trim_cache size 0 max 16384 2026-02-20T13:19:38.947 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:19:38.947 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:19:38.947 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:19:38.947 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "c4589a3f-bba1-4bc2-9899-286bfc82b52c", 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:38.948 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:38.949 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:38.950 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:38.951 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:38.951 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:38.951 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:38.951 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:19:38.951 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:19:38.951 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:19:38.951 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:19:38.951 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f5523fff640 1 -- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f54f80b5760 msgr2=0x7f54f80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f5523fff640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f54f80b5760 0x7f54f80d5c10 secure :-1 s=READY pgs=316 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55241247c0 tx=0x7f550c005f70 comp rx=0 tx=0).stop 2026-02-20T13:19:38.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f5523fff640 1 -- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 msgr2=0x7f552411de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.937+0000 7f5523fff640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 0x7f552411de20 secure :-1 s=READY pgs=527 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5518004820 tx=0x7f5518005f10 comp rx=0 tx=0).stop 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.938+0000 7f5523fff640 1 -- 10.20.193.28:0/3624964789 shutdown_connections 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.938+0000 7f5523fff640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f54f80b5760 0x7f54f80d5c10 unknown :-1 s=CLOSED pgs=316 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.938+0000 7f5523fff640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55241156a0 0x7f5524123730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.938+0000 7f5523fff640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f552410fea0 0x7f552411e360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.938+0000 7f5523fff640 1 --2- 10.20.193.28:0/3624964789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f552410f4b0 0x7f552411de20 unknown :-1 s=CLOSED pgs=527 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.938+0000 7f5523fff640 1 -- 10.20.193.28:0/3624964789 >> 10.20.193.28:0/3624964789 conn(0x7f55240ecda0 msgr2=0x7f552410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.938+0000 7f5523fff640 1 -- 10.20.193.28:0/3624964789 shutdown_connections 2026-02-20T13:19:38.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:19:38.938+0000 7f5523fff640 1 -- 10.20.193.28:0/3624964789 wait complete. 2026-02-20T13:19:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:38 trial127 ceph-mon[43817]: pgmap v250: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:19:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:38 trial034 ceph-mon[43332]: pgmap v250: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:19:39.075 INFO:tasks.cephfs.filesystem:scrub status for tag:c4589a3f-bba1-4bc2-9899-286bfc82b52c - {'path': '/', 'tag': 'c4589a3f-bba1-4bc2-9899-286bfc82b52c', 'options': 'recursive,force'} 2026-02-20T13:19:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 -- 10.20.193.28:0/3944433618 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c1100b0 msgr2=0x7fe72c1104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 --2- 10.20.193.28:0/3944433618 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c1100b0 0x7fe72c1104a0 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=10035651786664328945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c009980 tx=0x7fe71c02f190 comp rx=0 tx=0).stop 2026-02-20T13:19:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 -- 10.20.193.28:0/3944433618 shutdown_connections 2026-02-20T13:19:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 --2- 10.20.193.28:0/3944433618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe72c10e940 0x7fe72c10edb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 --2- 10.20.193.28:0/3944433618 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe72c10f2f0 0x7fe72c171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 --2- 10.20.193.28:0/3944433618 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c1100b0 0x7fe72c1104a0 unknown :-1 s=CLOSED pgs=183 gs=2 cs=0 l=1 c_cookie=10035651786664328945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 -- 10.20.193.28:0/3944433618 >> 10.20.193.28:0/3944433618 conn(0x7fe72c0ec320 msgr2=0x7fe72c10c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 -- 10.20.193.28:0/3944433618 shutdown_connections 2026-02-20T13:19:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.431+0000 7fe732243640 1 -- 10.20.193.28:0/3944433618 wait complete. 2026-02-20T13:19:39.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe732243640 1 Processor -- start 2026-02-20T13:19:39.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe732243640 1 -- start start 2026-02-20T13:19:39.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe732243640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c10e940 0x7fe72c0f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe732243640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe72c10f2f0 0x7fe72c171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe732243640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe72c1100b0 0x7fe72c0f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe732243640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c0f96a0 con 0x7fe72c1100b0 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe732243640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c0f9810 con 0x7fe72c10f2f0 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe732243640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c0f99d0 con 0x7fe72c10e940 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe731241640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c10e940 0x7fe72c0f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe731241640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c10e940 0x7fe72c0f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42460/0 (socket says 10.20.193.28:42460) 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe731241640 1 -- 10.20.193.28:0/3208667139 learned_addr learned my addr 10.20.193.28:0/3208667139 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe730a40640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe72c10f2f0 0x7fe72c171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.432+0000 7fe731a42640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe72c1100b0 0x7fe72c0f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe731241640 1 -- 10.20.193.28:0/3208667139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe72c10f2f0 msgr2=0x7fe72c171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe731241640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe72c10f2f0 0x7fe72c171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe731241640 1 -- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe72c1100b0 msgr2=0x7fe72c0f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe731241640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe72c1100b0 0x7fe72c0f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe731241640 1 -- 10.20.193.28:0/3208667139 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7200094b0 con 0x7fe72c10e940 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe730a40640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe72c10f2f0 0x7fe72c171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe731241640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c10e940 0x7fe72c0f8250 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c038820 tx=0x7fe71c0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe71affd640 1 -- 10.20.193.28:0/3208667139 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe71c03d070 con 0x7fe72c10e940 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe71affd640 1 -- 10.20.193.28:0/3208667139 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe71c002e20 con 0x7fe72c10e940 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe732243640 1 -- 10.20.193.28:0/3208667139 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c009570 con 0x7fe72c10e940 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe71affd640 1 -- 10.20.193.28:0/3208667139 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe71c0419a0 con 0x7fe72c10e940 2026-02-20T13:19:39.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.433+0000 7fe732243640 1 -- 10.20.193.28:0/3208667139 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72c0f9f30 con 0x7fe72c10e940 2026-02-20T13:19:39.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.436+0000 7fe71affd640 1 -- 10.20.193.28:0/3208667139 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe71c041b30 con 0x7fe72c10e940 2026-02-20T13:19:39.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.437+0000 7fe71affd640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6fc0b56e0 0x7fe6fc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.437+0000 7fe71affd640 1 -- 10.20.193.28:0/3208667139 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe71c10ae50 con 0x7fe72c10e940 2026-02-20T13:19:39.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.437+0000 7fe730a40640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6fc0b56e0 0x7fe6fc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe730a40640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6fc0b56e0 0x7fe6fc0d5b90 secure :-1 s=READY pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe720004740 tx=0x7fe720005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe735bc6e00 1 Processor -- start 2026-02-20T13:19:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe735bc6e00 1 -- start start 2026-02-20T13:19:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1148a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc1351c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 0x55ecbc155ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc009fd0 con 0x55ecbc0f44c0 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc005d00 con 0x55ecbc114de0 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.438+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ecbbfffca0 con 0x55ecbc135700 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc1351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe731241640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1148a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc1351c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59184/0 (socket says 10.20.193.28:59184) 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 -- 10.20.193.28:0/2043092042 learned_addr learned my addr 10.20.193.28:0/2043092042 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe731a42640 1 --2- 10.20.193.28:0/2043092042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 0x55ecbc155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 -- 10.20.193.28:0/2043092042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 msgr2=0x55ecbc155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 --2- 10.20.193.28:0/2043092042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 0x55ecbc155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 -- 10.20.193.28:0/2043092042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 msgr2=0x55ecbc1148a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 --2- 10.20.193.28:0/2043092042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1148a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 -- 10.20.193.28:0/2043092042 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbbfa28b0 con 0x55ecbc114de0 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe730a40640 1 --2- 10.20.193.28:0/2043092042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc1351c0 secure :-1 s=READY pgs=215 gs=2 cs=0 l=1 c_cookie=4127025372897030824 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7200117d0 tx=0x7fe720014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=394623b5f28d32a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe7111ff640 1 -- 10.20.193.28:0/2043092042 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe720011ca0 con 0x55ecbc114de0 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe7111ff640 1 -- 10.20.193.28:0/2043092042 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe72001ce60 con 0x55ecbc114de0 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.439+0000 7fe7111ff640 1 -- 10.20.193.28:0/2043092042 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe72000e3e0 con 0x55ecbc114de0 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2043092042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 msgr2=0x55ecbc1351c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2043092042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc1351c0 secure :-1 s=READY pgs=215 gs=2 cs=0 l=1 c_cookie=4127025372897030824 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7200117d0 tx=0x7fe720014000 comp rx=0 tx=0).stop 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2043092042 shutdown_connections 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2043092042 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 0x55ecbc155ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2043092042 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc1351c0 unknown :-1 s=CLOSED pgs=215 gs=2 cs=0 l=1 c_cookie=4127025372897030824 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2043092042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1148a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2043092042 >> 10.20.193.28:0/2043092042 conn(0x55ecbc0131c0 msgr2=0x55ecbc0f2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2043092042 shutdown_connections 2026-02-20T13:19:39.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.440+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2043092042 wait complete. 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.441+0000 7fe735bc6e00 1 -- start start 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.441+0000 7fe735bc6e00 1 Processor -- start 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc10dac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc114de0 0x55ecbc10e110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 0x55ecbc10eb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc10f1d0 con 0x55ecbc0f44c0 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc10f340 con 0x55ecbc135700 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc10f500 con 0x55ecbc114de0 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731a42640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 0x55ecbc10eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc10dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56484/0 (socket says 10.20.193.28:56484) 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 -- 10.20.193.28:0/2858926572 learned_addr learned my addr 10.20.193.28:0/2858926572 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe730a40640 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc114de0 0x55ecbc10e110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 -- 10.20.193.28:0/2858926572 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc114de0 msgr2=0x55ecbc10e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc114de0 0x55ecbc10e110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 -- 10.20.193.28:0/2858926572 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 msgr2=0x55ecbc10eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 0x55ecbc10eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 -- 10.20.193.28:0/2858926572 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbbfab400 con 0x55ecbc0f44c0 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe731241640 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc10dac0 secure :-1 s=READY pgs=530 gs=1 cs=0 l=1 c_cookie=12468919940409035595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c02ffd0 tx=0x7fe71c0d32f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0a809f64dd8b4b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.442+0000 7fe6ea7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/2858926572 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe71c0dc080 con 0x55ecbc0f44c0 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe720011440 con 0x55ecbc0f44c0 2026-02-20T13:19:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/2858926572 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe71c0d0a60 con 0x55ecbc0f44c0 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/2858926572 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe71c0dc380 con 0x55ecbc0f44c0 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 10 client.16317 _ll_register_callbacks cb 0x55ecbbf8aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ecbbc9f520 con 0x55ecbc0f44c0 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/2858926572 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe71c0cf4c0 con 0x55ecbc0f44c0 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/2858926572 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe71c096430 con 0x55ecbc0f44c0 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 10 client.16317 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ecbbf83da0 con 0x55ecbc0f44c0 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/2858926572 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe71c0d2ba0 con 0x55ecbc0f44c0 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 10 client.16317 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 20 client.16317 populate_metadata read hostname 'trial028' 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ecbc111ee0 0x55ecbc112350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 4 client.16317 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecbc031630 con 0x55ecbc111ee0 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.443+0000 7fe730a40640 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ecbc111ee0 0x55ecbc112350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe730a40640 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ecbc111ee0 0x55ecbc112350 crc :-1 s=READY pgs=98 gs=4 cs=0 l=0 c_cookie=2308699497277701536 s_cookie=17549807646259999439 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=200a25f5f45c3da0 server_cookie=f38d711247c2f2cf in_seq=0 out_seq=0 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe6ea7fc640 10 client.16317 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/2858926572 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ecbc031630 con 0x55ecbc111ee0 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe6ea7fc640 10 client.16317 handle_command_reply: tid=0 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 client.16317 shutdown 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 msgr2=0x55ecbc10dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc10dac0 secure :-1 s=READY pgs=530 gs=1 cs=0 l=1 c_cookie=12468919940409035595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c02ffd0 tx=0x7fe71c0d32f0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 shutdown_connections 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ecbc111ee0 0x55ecbc112350 crc :-1 s=READY pgs=98 gs=4 cs=0 l=0 c_cookie=2308699497277701536 s_cookie=17549807646259999439 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 0x55ecbc10eb70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc114de0 0x55ecbc10e110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2858926572 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc10dac0 unknown :-1 s=CLOSED pgs=530 gs=1 cs=0 l=1 c_cookie=12468919940409035595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe6ea7fc640 0 client.16317 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:39.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 >> 10.20.193.28:0/2858926572 conn(0x55ecbc0131c0 msgr2=0x55ecbc0f5790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:39.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.444+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 shutdown_connections 2026-02-20T13:19:39.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.445+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2858926572 wait complete. 2026-02-20T13:19:39.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.445+0000 7fe735bc6e00 20 client.16317 trim_cache size 0 max 16384 2026-02-20T13:19:39.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe735bc6e00 1 Processor -- start 2026-02-20T13:19:39.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe735bc6e00 1 -- start start 2026-02-20T13:19:39.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc0f44c0 0x55ecbc0f8d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc114de0 0x55ecbc1335c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 0x55ecbc133b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecbbffd8d0 con 0x55ecbc114de0 2026-02-20T13:19:39.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ecbbd3ef10 con 0x55ecbc135700 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc10f3c0 con 0x55ecbc0f44c0 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.452+0000 7fe731241640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc0f44c0 0x55ecbc0f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731241640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc0f44c0 0x55ecbc0f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42490/0 (socket says 10.20.193.28:42490) 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731241640 1 -- 10.20.193.28:0/2649827385 learned_addr learned my addr 10.20.193.28:0/2649827385 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe730a40640 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc114de0 0x55ecbc1335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731a42640 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 0x55ecbc133b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731241640 1 -- 10.20.193.28:0/2649827385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 msgr2=0x55ecbc133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731241640 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 0x55ecbc133b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731241640 1 -- 10.20.193.28:0/2649827385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc114de0 msgr2=0x55ecbc1335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731241640 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc114de0 0x55ecbc1335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731241640 1 -- 10.20.193.28:0/2649827385 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbc100120 con 0x55ecbc0f44c0 2026-02-20T13:19:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe730a40640 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc114de0 0x55ecbc1335c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe731241640 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc0f44c0 0x55ecbc0f8d10 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=3276451334877367418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c108980 tx=0x7fe71c092000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d784b2133384c7a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe7109fe640 1 -- 10.20.193.28:0/2649827385 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe71c0d0a60 con 0x55ecbc0f44c0 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe7109fe640 1 -- 10.20.193.28:0/2649827385 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ecbbc9f520 con 0x55ecbc0f44c0 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe7109fe640 1 -- 10.20.193.28:0/2649827385 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe71c0d94b0 con 0x55ecbc0f44c0 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2649827385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc0f44c0 msgr2=0x55ecbc0f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.453+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc0f44c0 0x55ecbc0f8d10 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=3276451334877367418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c108980 tx=0x7fe71c092000 comp rx=0 tx=0).stop 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2649827385 shutdown_connections 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc114de0 0x55ecbc1335c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc135700 0x55ecbc133b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/2649827385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc0f44c0 0x55ecbc0f8d10 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=3276451334877367418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2649827385 >> 10.20.193.28:0/2649827385 conn(0x55ecbc0131c0 msgr2=0x55ecbc109dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2649827385 shutdown_connections 2026-02-20T13:19:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 -- 10.20.193.28:0/2649827385 wait complete. 2026-02-20T13:19:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 -- start start 2026-02-20T13:19:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.454+0000 7fe735bc6e00 1 Processor -- start 2026-02-20T13:19:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1166d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc116c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe735bc6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 0x55ecbc117300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecbbffd8d0 con 0x55ecbc0f44c0 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc117a30 con 0x55ecbc114de0 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe735bc6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc117bf0 con 0x55ecbc135700 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc116c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc116c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59220/0 (socket says 10.20.193.28:59220) 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 -- 10.20.193.28:0/3634592059 learned_addr learned my addr 10.20.193.28:0/3634592059 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe731a42640 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 0x55ecbc117300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe731241640 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1166d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 -- 10.20.193.28:0/3634592059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 msgr2=0x55ecbc117300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 0x55ecbc117300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 -- 10.20.193.28:0/3634592059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 msgr2=0x55ecbc1166d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1166d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 -- 10.20.193.28:0/3634592059 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbbf95670 con 0x55ecbc114de0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe731241640 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1166d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe730a40640 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc116c10 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=5551954400780500318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe720011770 tx=0x7fe720009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0c811cabb03d5e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.455+0000 7fe6ea7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/3634592059 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe72001a670 con 0x55ecbc114de0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/3634592059 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe72001c980 con 0x55ecbc114de0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe720011440 con 0x55ecbc114de0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/3634592059 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe720035c00 con 0x55ecbc114de0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 10 client.26306 _ll_register_callbacks cb 0x55ecbbf8aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ecbc0afca0 con 0x55ecbc114de0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/3634592059 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe720035d90 con 0x55ecbc114de0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/3634592059 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe72002f410 con 0x55ecbc114de0 2026-02-20T13:19:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 10 client.26306 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ecbbf900f0 con 0x55ecbc114de0 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/3634592059 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe72002b040 con 0x55ecbc114de0 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 10 client.26306 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 10 client.26306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 20 client.26306 populate_metadata read hostname 'trial028' 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ecbc119b00 0x55ecbc119fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 4 client.26306 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.456+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ecbbce3640 con 0x55ecbc119b00 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.457+0000 7fe731241640 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ecbc119b00 0x55ecbc119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.457+0000 7fe731241640 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ecbc119b00 0x55ecbc119fa0 crc :-1 s=READY pgs=99 gs=4 cs=0 l=0 c_cookie=8842367443563848169 s_cookie=15061536407376903812 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ab666574f1a21e9 server_cookie=d105539025503e84 in_seq=0 out_seq=0 2026-02-20T13:19:39.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.457+0000 7fe6ea7fc640 10 client.26306 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:39.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.461+0000 7fe6ea7fc640 1 -- 10.20.193.28:0/3634592059 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ecbbce3640 con 0x55ecbc119b00 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.461+0000 7fe6ea7fc640 10 client.26306 handle_command_reply: tid=0 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 client.26306 shutdown 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 msgr2=0x55ecbc116c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc116c10 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=5551954400780500318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe720011770 tx=0x7fe720009260 comp rx=0 tx=0).stop 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 shutdown_connections 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ecbc119b00 0x55ecbc119fa0 crc :-1 s=READY pgs=99 gs=4 cs=0 l=0 c_cookie=8842367443563848169 s_cookie=15061536407376903812 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc135700 0x55ecbc117300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc114de0 0x55ecbc116c10 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=5551954400780500318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 --2- 10.20.193.28:0/3634592059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc0f44c0 0x55ecbc1166d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 >> 10.20.193.28:0/3634592059 conn(0x55ecbc0131c0 msgr2=0x55ecbc10a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:39.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe6ea7fc640 0 client.26306 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:39.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 shutdown_connections 2026-02-20T13:19:39.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 1 -- 10.20.193.28:0/3634592059 wait complete. 2026-02-20T13:19:39.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe735bc6e00 20 client.26306 trim_cache size 0 max 16384 2026-02-20T13:19:39.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:19:39.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:19:39.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:19:39.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:19:39.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 -- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6fc0b56e0 msgr2=0x7fe6fc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6fc0b56e0 0x7fe6fc0d5b90 secure :-1 s=READY pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe720004740 tx=0x7fe720005f90 comp rx=0 tx=0).stop 2026-02-20T13:19:39.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 -- 10.20.193.28:0/3208667139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c10e940 msgr2=0x7fe72c0f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c10e940 0x7fe72c0f8250 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c038820 tx=0x7fe71c0028d0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 -- 10.20.193.28:0/3208667139 shutdown_connections 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6fc0b56e0 0x7fe6fc0d5b90 unknown :-1 s=CLOSED pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe72c1100b0 0x7fe72c0f8ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe72c10f2f0 0x7fe72c171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 --2- 10.20.193.28:0/3208667139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe72c10e940 0x7fe72c0f8250 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 -- 10.20.193.28:0/3208667139 >> 10.20.193.28:0/3208667139 conn(0x7fe72c0ec320 msgr2=0x7fe72c0ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 -- 10.20.193.28:0/3208667139 shutdown_connections 2026-02-20T13:19:39.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:39.462+0000 7fe732243640 1 -- 10.20.193.28:0/3208667139 wait complete. 2026-02-20T13:19:39.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:39 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:19:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:39 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:19:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:39 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:39 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:19:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:39 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:39 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:39.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:39 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:19:39.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:39 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:19:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:39 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:39 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:19:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:39 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:39 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:40.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:39 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:19:40.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:39 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:19:40.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:39 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:40.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:39 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:19:40.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:39 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:40.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:39 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:19:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:40 trial127 ceph-mon[43817]: pgmap v251: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:40 trial034 ceph-mon[43332]: pgmap v251: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:40 trial028 ceph-mon[37442]: pgmap v251: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:19:41.103 INFO:tasks.workunit.client.0.trial028.stdout:1/600: open fd = 3 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:2/600: open fd = 3 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:3/600: open fd = 3 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.104 INFO:tasks.workunit.client.0.trial028.stdout:4/600: open fd = 3 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:5/600: open fd = 3 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:6/600: open fd = 3 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:7/600: open fd = 3 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.105 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:8/600: open fd = 3 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:9/600: open fd = 3 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:10/600: open fd = 3 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:11/600: open fd = 3 2026-02-20T13:19:41.106 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:12/600: open fd = 3 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:13/600: open fd = 3 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:14/600: open fd = 3 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:15/600: open fd = 3 2026-02-20T13:19:41.107 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:16/600: open fd = 3 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:17/600: open fd = 3 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:18/600: open fd = 3 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:19/600: open fd = 3 2026-02-20T13:19:41.108 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:20/600: open fd = 3 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:21/600: open fd = 3 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:22/600: open fd = 3 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:23/600: open fd = 3 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.109 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:24/600: open fd = 3 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:25/600: open fd = 3 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:26/600: open fd = 3 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:27/600: open fd = 3 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.110 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:28/600: open fd = 3 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:29/600: open fd = 3 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:30/600: open fd = 3 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:31/600: open fd = 3 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:32/600: open fd = 3 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.111 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:33/600: open fd = 3 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:34/600: open fd = 3 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:35/600: open fd = 3 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:36/600: open fd = 3 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:37/600: open fd = 3 2026-02-20T13:19:41.112 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:38/600: open fd = 3 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:39/600: open fd = 3 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:40/600: open fd = 3 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:41/600: open fd = 3 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.113 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:42/600: open fd = 3 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:43/600: open fd = 3 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:44/600: open fd = 3 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:45/600: open fd = 3 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:46/600: open fd = 3 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.114 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:47/600: open fd = 3 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:48/600: open fd = 3 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:49/600: open fd = 3 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:50/600: open fd = 3 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:51/600: open fd = 3 2026-02-20T13:19:41.115 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:52/600: open fd = 3 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:53/600: open fd = 3 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:54/600: open fd = 3 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:55/600: open fd = 3 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.116 INFO:tasks.workunit.client.0.trial028.stdout:56/600: open fd = 3 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:57/600: open fd = 3 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:58/600: open fd = 3 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:59/600: open fd = 3 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:60/600: open fd = 3 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:61/600: open fd = 3 2026-02-20T13:19:41.117 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:62/600: open fd = 3 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:63/600: open fd = 3 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:19:41.118 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:19:42.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:42 trial127 ceph-mon[43817]: pgmap v252: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-20T13:19:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:42 trial034 ceph-mon[43332]: pgmap v252: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-20T13:19:43.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:42 trial028 ceph-mon[37442]: pgmap v252: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-20T13:19:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:44 trial127 ceph-mon[43817]: pgmap v253: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:19:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:44 trial034 ceph-mon[43332]: pgmap v253: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:19:45.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:44 trial028 ceph-mon[37442]: pgmap v253: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:19:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:46 trial127 ceph-mon[43817]: pgmap v254: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:19:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:46 trial034 ceph-mon[43332]: pgmap v254: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:19:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:46 trial028 ceph-mon[37442]: pgmap v254: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:19:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:48 trial127 ceph-mon[43817]: pgmap v255: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:19:48.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:48 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:19:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:48 trial034 ceph-mon[43332]: pgmap v255: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:19:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:48 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:19:49.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:48 trial028 ceph-mon[37442]: pgmap v255: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:19:49.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:48 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:19:49.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:49 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:19:49.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:49 trial127 ceph-mon[43817]: pgmap v256: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:19:49.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:49 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:19:49.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:49 trial034 ceph-mon[43332]: pgmap v256: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:19:50.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:49 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:19:50.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:49 trial028 ceph-mon[37442]: pgmap v256: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:19:52.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 -- 10.20.193.28:0/366178736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810e270 msgr2=0x7f41d810e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 --2- 10.20.193.28:0/366178736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810e270 0x7f41d810e660 secure :-1 s=READY pgs=531 gs=1 cs=0 l=1 c_cookie=10861796632629331697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41c8009980 tx=0x7f41c802f190 comp rx=0 tx=0).stop 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 -- 10.20.193.28:0/366178736 shutdown_connections 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 --2- 10.20.193.28:0/366178736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f41d810d4b0 0x7f41d816f240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 --2- 10.20.193.28:0/366178736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f41d810cb00 0x7f41d810cf70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 --2- 10.20.193.28:0/366178736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810e270 0x7f41d810e660 unknown :-1 s=CLOSED pgs=531 gs=1 cs=0 l=1 c_cookie=10861796632629331697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 -- 10.20.193.28:0/366178736 >> 10.20.193.28:0/366178736 conn(0x7f41d80ea4c0 msgr2=0x7f41d810a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 -- 10.20.193.28:0/366178736 shutdown_connections 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.533+0000 7f41de603640 1 -- 10.20.193.28:0/366178736 wait complete. 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.534+0000 7f41de603640 1 Processor -- start 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.534+0000 7f41de603640 1 -- start start 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.534+0000 7f41de603640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f41d810cb00 0x7f41d80f86d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.534+0000 7f41de603640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810d4b0 0x7f41d816f240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.534+0000 7f41de603640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f41d810e270 0x7f41d80f8f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.534+0000 7f41de603640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80f9b20 con 0x7f41d810d4b0 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.534+0000 7f41de603640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80f9c90 con 0x7f41d810cb00 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.534+0000 7f41de603640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80f9e50 con 0x7f41d810e270 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810d4b0 0x7f41d816f240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810d4b0 0x7f41d816f240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33842/0 (socket says 10.20.193.28:33842) 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 -- 10.20.193.28:0/14895823 learned_addr learned my addr 10.20.193.28:0/14895823 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dd601640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f41d810cb00 0x7f41d80f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dde02640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f41d810e270 0x7f41d80f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 -- 10.20.193.28:0/14895823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f41d810e270 msgr2=0x7f41d80f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f41d810e270 0x7f41d80f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 -- 10.20.193.28:0/14895823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f41d810cb00 msgr2=0x7f41d80f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f41d810cb00 0x7f41d80f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 -- 10.20.193.28:0/14895823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c8009570 con 0x7f41d810d4b0 2026-02-20T13:19:52.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41dce00640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810d4b0 0x7f41d816f240 secure :-1 s=READY pgs=532 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41cc00c8c0 tx=0x7f41cc00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:52.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41c67fc640 1 -- 10.20.193.28:0/14895823 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41cc0044a0 con 0x7f41d810d4b0 2026-02-20T13:19:52.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41c67fc640 1 -- 10.20.193.28:0/14895823 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41cc007c80 con 0x7f41d810d4b0 2026-02-20T13:19:52.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41de603640 1 -- 10.20.193.28:0/14895823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d80fa130 con 0x7f41d810d4b0 2026-02-20T13:19:52.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41c67fc640 1 -- 10.20.193.28:0/14895823 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41cc00f6d0 con 0x7f41d810d4b0 2026-02-20T13:19:52.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.535+0000 7f41de603640 1 -- 10.20.193.28:0/14895823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d80fa600 con 0x7f41d810d4b0 2026-02-20T13:19:52.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.538+0000 7f41c67fc640 1 -- 10.20.193.28:0/14895823 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f41cc0026a0 con 0x7f41d810d4b0 2026-02-20T13:19:52.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.540+0000 7f41c67fc640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f41b40b5760 0x7f41b40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.540+0000 7f41c67fc640 1 -- 10.20.193.28:0/14895823 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f41cc0e6a60 con 0x7f41d810d4b0 2026-02-20T13:19:52.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.540+0000 7f41dd601640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f41b40b5760 0x7f41b40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.540+0000 7f41dd601640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f41b40b5760 0x7f41b40d5c10 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41c80098a0 tx=0x7f41c803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:52.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41e1e8fe00 1 Processor -- start 2026-02-20T13:19:52.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41e1e8fe00 1 -- start start 2026-02-20T13:19:52.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90288a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec90491c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 0x559ec9069ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ec8f1dfd0 con 0x559ec90084c0 2026-02-20T13:19:52.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559ec8f19d00 con 0x559ec9049700 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559ec8f13ca0 con 0x559ec9028de0 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dd601640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dd601640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90288a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33850/0 (socket says 10.20.193.28:33850) 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dd601640 1 -- 10.20.193.28:0/4058514747 learned_addr learned my addr 10.20.193.28:0/4058514747 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dce00640 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec90491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dde02640 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 0x559ec9069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dd601640 1 -- 10.20.193.28:0/4058514747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 msgr2=0x559ec90491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dd601640 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec90491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dd601640 1 -- 10.20.193.28:0/4058514747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 msgr2=0x559ec9069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dd601640 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 0x559ec9069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.543+0000 7f41dd601640 1 -- 10.20.193.28:0/4058514747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec8eb68b0 con 0x559ec90084c0 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41dd601640 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90288a0 secure :-1 s=READY pgs=533 gs=1 cs=0 l=1 c_cookie=1424048316472622440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41c802f6a0 tx=0x7f41c8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c33c661e57fd68 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41a5bfe640 1 -- 10.20.193.28:0/4058514747 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41c802fc10 con 0x559ec90084c0 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41a5bfe640 1 -- 10.20.193.28:0/4058514747 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41c803e040 con 0x559ec90084c0 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41a5bfe640 1 -- 10.20.193.28:0/4058514747 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41c804fbd0 con 0x559ec90084c0 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/4058514747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 msgr2=0x559ec90288a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90288a0 secure :-1 s=READY pgs=533 gs=1 cs=0 l=1 c_cookie=1424048316472622440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41c802f6a0 tx=0x7f41c8040000 comp rx=0 tx=0).stop 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/4058514747 shutdown_connections 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 0x559ec9069ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec90491c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/4058514747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90288a0 unknown :-1 s=CLOSED pgs=533 gs=1 cs=0 l=1 c_cookie=1424048316472622440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/4058514747 >> 10.20.193.28:0/4058514747 conn(0x559ec8f271c0 msgr2=0x559ec9006da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:52.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/4058514747 shutdown_connections 2026-02-20T13:19:52.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.544+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/4058514747 wait complete. 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41e1e8fe00 1 -- start start 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41e1e8fe00 1 Processor -- start 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec9022120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9049700 0x559ec9022b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ec90231e0 con 0x559ec9049700 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559ec9023350 con 0x559ec90084c0 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559ec9023510 con 0x559ec9028de0 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.546+0000 7f41dde02640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9049700 0x559ec9022b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dde02640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9049700 0x559ec9022b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33858/0 (socket says 10.20.193.28:33858) 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dde02640 1 -- 10.20.193.28:0/2041276855 learned_addr learned my addr 10.20.193.28:0/2041276855 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dce00640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec9022120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dd601640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dde02640 1 -- 10.20.193.28:0/2041276855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 msgr2=0x559ec9022120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dde02640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec9022120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dde02640 1 -- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 msgr2=0x559ec9021ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dde02640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dde02640 1 -- 10.20.193.28:0/2041276855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec8ebf400 con 0x559ec9049700 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dce00640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec9022120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dd601640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:19:52.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41dde02640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9049700 0x559ec9022b80 secure :-1 s=READY pgs=534 gs=1 cs=0 l=1 c_cookie=8859639903525909956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41d4005110 tx=0x7f41d40105b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af3c38d4789b5c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f4192ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f4192ffd640 1 -- 10.20.193.28:0/2041276855 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41d4014620 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f4192ffd640 1 -- 10.20.193.28:0/2041276855 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41d4014c60 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d816fca0 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41e1e8fe00 10 client.16335 _ll_register_callbacks cb 0x559ec8e9ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ec8bb3520 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.547+0000 7f4192ffd640 1 -- 10.20.193.28:0/2041276855 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41d4013e70 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f4192ffd640 1 -- 10.20.193.28:0/2041276855 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f41d401e460 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f4192ffd640 1 -- 10.20.193.28:0/2041276855 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f41d401e660 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41e1e8fe00 10 client.16335 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559ec8e97da0 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f4192ffd640 1 -- 10.20.193.28:0/2041276855 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f41d4014780 con 0x559ec9049700 2026-02-20T13:19:52.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41e1e8fe00 10 client.16335 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41e1e8fe00 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41e1e8fe00 20 client.16335 populate_metadata read hostname 'trial028' 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559ec9026200 0x559ec9026670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41e1e8fe00 4 client.16335 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ec8f45630 con 0x559ec9026200 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.548+0000 7f41dd601640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559ec9026200 0x559ec9026670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.549+0000 7f41dd601640 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559ec9026200 0x559ec9026670 crc :-1 s=READY pgs=100 gs=4 cs=0 l=0 c_cookie=12499695344197771173 s_cookie=4548323203655136255 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad77d6b077831fa5 server_cookie=3f1ee3db0d87f3ff in_seq=0 out_seq=0 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.549+0000 7f4192ffd640 10 client.16335 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f4192ffd640 1 -- 10.20.193.28:0/2041276855 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559ec8f45630 con 0x559ec9026200 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f4192ffd640 10 client.16335 handle_command_reply: tid=0 2026-02-20T13:19:52.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 client.16335 shutdown 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9049700 msgr2=0x559ec9022b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9049700 0x559ec9022b80 secure :-1 s=READY pgs=534 gs=1 cs=0 l=1 c_cookie=8859639903525909956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41d4005110 tx=0x7f41d40105b0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 shutdown_connections 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559ec9026200 0x559ec9026670 crc :-1 s=READY pgs=100 gs=4 cs=0 l=0 c_cookie=12499695344197771173 s_cookie=4548323203655136255 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9049700 0x559ec9022b80 unknown :-1 s=CLOSED pgs=534 gs=1 cs=0 l=1 c_cookie=8859639903525909956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec9022120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2041276855 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f4192ffd640 0 client.16335 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 >> 10.20.193.28:0/2041276855 conn(0x559ec8f271c0 msgr2=0x559ec9009790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 shutdown_connections 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2041276855 wait complete. 2026-02-20T13:19:52.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.550+0000 7f41e1e8fe00 20 client.16335 trim_cache size 0 max 16384 2026-02-20T13:19:52.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41e1e8fe00 1 Processor -- start 2026-02-20T13:19:52.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41e1e8fe00 1 -- start start 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9028de0 0x559ec90475c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9049700 0x559ec9047b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ec8f118d0 con 0x559ec9028de0 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559ec8c52f10 con 0x559ec90084c0 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559ec8f794f0 con 0x559ec9049700 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dce00640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9028de0 0x559ec90475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dce00640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9028de0 0x559ec90475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33870/0 (socket says 10.20.193.28:33870) 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dce00640 1 -- 10.20.193.28:0/2577685785 learned_addr learned my addr 10.20.193.28:0/2577685785 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dd601640 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dde02640 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9049700 0x559ec9047b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dce00640 1 -- 10.20.193.28:0/2577685785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9049700 msgr2=0x559ec9047b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dce00640 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9049700 0x559ec9047b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dce00640 1 -- 10.20.193.28:0/2577685785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 msgr2=0x559ec9021960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dce00640 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.558+0000 7f41dce00640 1 -- 10.20.193.28:0/2577685785 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec8ea9670 con 0x559ec9028de0 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41dce00640 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9028de0 0x559ec90475c0 secure :-1 s=READY pgs=535 gs=2 cs=0 l=1 c_cookie=1167207702515684889 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41cc007590 tx=0x7f41cc002b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1032c138a78c1619 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41a53fd640 1 -- 10.20.193.28:0/2577685785 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41cc007df0 con 0x559ec9028de0 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41a53fd640 1 -- 10.20.193.28:0/2577685785 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41cc0ad7c0 con 0x559ec9028de0 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41a53fd640 1 -- 10.20.193.28:0/2577685785 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41cc0a91c0 con 0x559ec9028de0 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2577685785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9028de0 msgr2=0x559ec90475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9028de0 0x559ec90475c0 secure :-1 s=READY pgs=535 gs=2 cs=0 l=1 c_cookie=1167207702515684889 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41cc007590 tx=0x7f41cc002b80 comp rx=0 tx=0).stop 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2577685785 shutdown_connections 2026-02-20T13:19:52.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec9028de0 0x559ec90475c0 unknown :-1 s=CLOSED pgs=535 gs=2 cs=0 l=1 c_cookie=1167207702515684889 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9049700 0x559ec9047b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/2577685785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec90084c0 0x559ec9021960 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2577685785 >> 10.20.193.28:0/2577685785 conn(0x559ec8f271c0 msgr2=0x559ec901ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2577685785 shutdown_connections 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/2577685785 wait complete. 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.559+0000 7f41e1e8fe00 1 -- start start 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41e1e8fe00 1 Processor -- start 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90293a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec90298e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41e1e8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 0x559ec9029fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ec8fe3810 con 0x559ec90084c0 2026-02-20T13:19:52.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559ec902a6e0 con 0x559ec9049700 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41e1e8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559ec902a8a0 con 0x559ec9028de0 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dd601640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dd601640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90293a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33880/0 (socket says 10.20.193.28:33880) 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dd601640 1 -- 10.20.193.28:0/3872438919 learned_addr learned my addr 10.20.193.28:0/3872438919 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dde02640 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 0x559ec9029fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dce00640 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec90298e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dd601640 1 -- 10.20.193.28:0/3872438919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 msgr2=0x559ec90298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dd601640 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec90298e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dd601640 1 -- 10.20.193.28:0/3872438919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 msgr2=0x559ec9029fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dd601640 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 0x559ec9029fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.560+0000 7f41dd601640 1 -- 10.20.193.28:0/3872438919 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec8ea40f0 con 0x559ec90084c0 2026-02-20T13:19:52.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41dd601640 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90293a0 secure :-1 s=READY pgs=536 gs=1 cs=0 l=1 c_cookie=18351028361445904109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41c804f4b0 tx=0x7f41c8002ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feabf3111b1a0eed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f4192ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f4192ffd640 1 -- 10.20.193.28:0/3872438919 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41c802fe20 con 0x559ec90084c0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f4192ffd640 1 -- 10.20.193.28:0/3872438919 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41c803e040 con 0x559ec90084c0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d80fa600 con 0x559ec90084c0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f4192ffd640 1 -- 10.20.193.28:0/3872438919 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41c804fe60 con 0x559ec90084c0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 10 client.16341 _ll_register_callbacks cb 0x559ec8e9ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ec8c45250 con 0x559ec90084c0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f4192ffd640 1 -- 10.20.193.28:0/3872438919 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f41c80606c0 con 0x559ec90084c0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f4192ffd640 1 -- 10.20.193.28:0/3872438919 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f41c8060880 con 0x559ec90084c0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 10 client.16341 fetch_fsmap learned FSMap version 28 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559ec8e980d0 con 0x559ec90084c0 2026-02-20T13:19:52.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f4192ffd640 1 -- 10.20.193.28:0/3872438919 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f41c8060a20 con 0x559ec90084c0 2026-02-20T13:19:52.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 10 client.16341 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:19:52.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 10 client.16341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:19:52.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 20 client.16341 populate_metadata read hostname 'trial028' 2026-02-20T13:19:52.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559ec902c4a0 0x559ec902c940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:19:52.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 4 client.16341 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:19:52.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.561+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559ec8fc3ca0 con 0x559ec902c4a0 2026-02-20T13:19:52.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.562+0000 7f41dce00640 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559ec902c4a0 0x559ec902c940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.562+0000 7f41dce00640 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559ec902c4a0 0x559ec902c940 crc :-1 s=READY pgs=101 gs=4 cs=0 l=0 c_cookie=6977312398321974726 s_cookie=9636367688843725739 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d464a8ace8fdc6 server_cookie=85bb415b7a950bab in_seq=0 out_seq=0 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.562+0000 7f4192ffd640 10 client.16341 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f4192ffd640 1 -- 10.20.193.28:0/3872438919 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559ec8fc3ca0 con 0x559ec902c4a0 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f4192ffd640 10 client.16341 handle_command_reply: tid=0 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 client.16341 shutdown 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 msgr2=0x559ec90293a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90293a0 secure :-1 s=READY pgs=536 gs=1 cs=0 l=1 c_cookie=18351028361445904109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41c804f4b0 tx=0x7f41c8002ba0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 shutdown_connections 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559ec902c4a0 0x559ec902c940 crc :-1 s=READY pgs=101 gs=4 cs=0 l=0 c_cookie=6977312398321974726 s_cookie=9636367688843725739 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ec9049700 0x559ec9029fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ec9028de0 0x559ec90298e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 --2- 10.20.193.28:0/3872438919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec90084c0 0x559ec90293a0 unknown :-1 s=CLOSED pgs=536 gs=1 cs=0 l=1 c_cookie=18351028361445904109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f4192ffd640 0 client.16341 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:19:52.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.567+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 >> 10.20.193.28:0/3872438919 conn(0x559ec8f271c0 msgr2=0x559ec901ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:52.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 shutdown_connections 2026-02-20T13:19:52.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41e1e8fe00 1 -- 10.20.193.28:0/3872438919 wait complete. 2026-02-20T13:19:52.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41e1e8fe00 20 client.16341 trim_cache size 0 max 16384 2026-02-20T13:19:52.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:19:52.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:19:52.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:19:52.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 -- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f41b40b5760 msgr2=0x7f41b40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f41b40b5760 0x7f41b40d5c10 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41c80098a0 tx=0x7f41c803a040 comp rx=0 tx=0).stop 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 -- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810d4b0 msgr2=0x7f41d816f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810d4b0 0x7f41d816f240 secure :-1 s=READY pgs=532 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41cc00c8c0 tx=0x7f41cc00cd90 comp rx=0 tx=0).stop 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 -- 10.20.193.28:0/14895823 shutdown_connections 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f41b40b5760 0x7f41b40d5c10 unknown :-1 s=CLOSED pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41d810d4b0 0x7f41d816f240 unknown :-1 s=CLOSED pgs=532 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f41d810e270 0x7f41d80f8f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 --2- 10.20.193.28:0/14895823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f41d810cb00 0x7f41d80f86d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:19:52.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 -- 10.20.193.28:0/14895823 >> 10.20.193.28:0/14895823 conn(0x7f41d80ea4c0 msgr2=0x7f41d8061780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:19:52.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 -- 10.20.193.28:0/14895823 shutdown_connections 2026-02-20T13:19:52.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:19:52.568+0000 7f41de603640 1 -- 10.20.193.28:0/14895823 wait complete. 2026-02-20T13:19:52.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:52 trial127 ceph-mon[43817]: pgmap v257: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:19:52.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:52 trial034 ceph-mon[43332]: pgmap v257: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:19:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:52 trial028 ceph-mon[37442]: pgmap v257: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:19:54.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:54 trial127 ceph-mon[43817]: pgmap v258: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:19:54.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:54 trial034 ceph-mon[43332]: pgmap v258: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:19:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:54 trial028 ceph-mon[37442]: pgmap v258: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:19:56.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:56 trial127 ceph-mon[43817]: pgmap v259: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:19:56.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:56 trial034 ceph-mon[43332]: pgmap v259: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:19:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:56 trial028 ceph-mon[37442]: pgmap v259: 97 pgs: 97 active+clean; 1.6 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:19:58.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:19:58 trial127 ceph-mon[43817]: pgmap v260: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:19:58.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:19:58 trial034 ceph-mon[43332]: pgmap v260: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:19:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:19:58 trial028 ceph-mon[37442]: pgmap v260: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:20:00.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:00 trial127 ceph-mon[43817]: pgmap v261: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:20:00.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:00 trial127 ceph-mon[43817]: overall HEALTH_OK 2026-02-20T13:20:00.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:00 trial034 ceph-mon[43332]: pgmap v261: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:20:00.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:00 trial034 ceph-mon[43332]: overall HEALTH_OK 2026-02-20T13:20:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:00 trial028 ceph-mon[37442]: pgmap v261: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:20:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:00 trial028 ceph-mon[37442]: overall HEALTH_OK 2026-02-20T13:20:02.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:02 trial127 ceph-mon[43817]: pgmap v262: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:02.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:02 trial034 ceph-mon[43332]: pgmap v262: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:02 trial028 ceph-mon[37442]: pgmap v262: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:04.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:04 trial127 ceph-mon[43817]: pgmap v263: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:20:04.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:04 trial034 ceph-mon[43332]: pgmap v263: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:20:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:04 trial028 ceph-mon[37442]: pgmap v263: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:20:05.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.640+0000 7f5f8ee43640 1 -- 10.20.193.28:0/1232382659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 msgr2=0x7f5f88061980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.640+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/1232382659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 0x7f5f88061980 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=1830447699627081613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f7c009950 tx=0x7f5f7c02f190 comp rx=0 tx=0).stop 2026-02-20T13:20:05.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.640+0000 7f5f8ee43640 1 -- 10.20.193.28:0/1232382659 shutdown_connections 2026-02-20T13:20:05.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.640+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/1232382659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f88150e50 0x7f5f88171290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.640+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/1232382659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 0x7f5f88061980 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=1830447699627081613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.640+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/1232382659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5f88062a40 0x7f5f88060fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.640+0000 7f5f8ee43640 1 -- 10.20.193.28:0/1232382659 >> 10.20.193.28:0/1232382659 conn(0x7f5f880ea4c0 msgr2=0x7f5f8810a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:05.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.640+0000 7f5f8ee43640 1 -- 10.20.193.28:0/1232382659 shutdown_connections 2026-02-20T13:20:05.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 -- 10.20.193.28:0/1232382659 wait complete. 2026-02-20T13:20:05.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 Processor -- start 2026-02-20T13:20:05.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 -- start start 2026-02-20T13:20:05.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 0x7f5f8815c6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f88062a40 0x7f5f8815cd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5f88150e50 0x7f5f8815d900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8815e040 con 0x7f5f88062a40 2026-02-20T13:20:05.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8815e1b0 con 0x7f5f88061510 2026-02-20T13:20:05.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.641+0000 7f5f8ee43640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8815e370 con 0x7f5f88150e50 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f88062a40 0x7f5f8815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f88062a40 0x7f5f8815cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49064/0 (socket says 10.20.193.28:49064) 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8de41640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 0x7f5f8815c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 -- 10.20.193.28:0/3313121152 learned_addr learned my addr 10.20.193.28:0/3313121152 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8e642640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5f88150e50 0x7f5f8815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 -- 10.20.193.28:0/3313121152 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5f88150e50 msgr2=0x7f5f8815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5f88150e50 0x7f5f8815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 -- 10.20.193.28:0/3313121152 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 msgr2=0x7f5f8815c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 0x7f5f8815c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 -- 10.20.193.28:0/3313121152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c009570 con 0x7f5f88062a40 2026-02-20T13:20:05.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8de41640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 0x7f5f8815c6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:05.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8d640640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f88062a40 0x7f5f8815cd00 secure :-1 s=READY pgs=537 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f7c038820 tx=0x7f5f7c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:05.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f76ffd640 1 -- 10.20.193.28:0/3313121152 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f7c03d070 con 0x7f5f88062a40 2026-02-20T13:20:05.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f76ffd640 1 -- 10.20.193.28:0/3313121152 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5f7c002e90 con 0x7f5f88062a40 2026-02-20T13:20:05.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8ee43640 1 -- 10.20.193.28:0/3313121152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8815e5f0 con 0x7f5f88062a40 2026-02-20T13:20:05.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f76ffd640 1 -- 10.20.193.28:0/3313121152 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f7c041b70 con 0x7f5f88062a40 2026-02-20T13:20:05.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.642+0000 7f5f8ee43640 1 -- 10.20.193.28:0/3313121152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8815eb10 con 0x7f5f88062a40 2026-02-20T13:20:05.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.645+0000 7f5f76ffd640 1 -- 10.20.193.28:0/3313121152 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5f7c038920 con 0x7f5f88062a40 2026-02-20T13:20:05.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.647+0000 7f5f76ffd640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5f640b5760 0x7f5f640d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.647+0000 7f5f76ffd640 1 -- 10.20.193.28:0/3313121152 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5f7c10b530 con 0x7f5f88062a40 2026-02-20T13:20:05.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.647+0000 7f5f8de41640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5f640b5760 0x7f5f640d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.647+0000 7f5f926b3e00 1 Processor -- start 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.647+0000 7f5f926b3e00 1 -- start start 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.647+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.647+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae84c1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.647+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 0x55dfae86cae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dfae720fd0 con 0x55dfae80b4c0 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dfae71cd00 con 0x55dfae82bde0 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dfae716ca0 con 0x55dfae84c700 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae84c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae84c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58148/0 (socket says 10.20.193.28:58148) 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 -- 10.20.193.28:0/1645017098 learned_addr learned my addr 10.20.193.28:0/1645017098 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8de41640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5f640b5760 0x7f5f640d5c10 secure :-1 s=READY pgs=319 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f78004740 tx=0x7f5f78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8e642640 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 0x55dfae86cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 -- 10.20.193.28:0/1645017098 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 msgr2=0x55dfae86cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 0x55dfae86cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8de41640 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 -- 10.20.193.28:0/1645017098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 msgr2=0x55dfae82b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 -- 10.20.193.28:0/1645017098 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfae6b98b0 con 0x55dfae82bde0 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8de41640 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82b8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f8d640640 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae84c1c0 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=627968077416384090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f7c004030 tx=0x7f5f7c041620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6fda3a8b0465a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:05.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f563ff640 1 -- 10.20.193.28:0/1645017098 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f7c0d1270 con 0x55dfae82bde0 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f563ff640 1 -- 10.20.193.28:0/1645017098 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5f7c0d1090 con 0x55dfae82bde0 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.648+0000 7f5f563ff640 1 -- 10.20.193.28:0/1645017098 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f7c0dca60 con 0x55dfae82bde0 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1645017098 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 msgr2=0x55dfae84c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae84c1c0 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=627968077416384090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f7c004030 tx=0x7f5f7c041620 comp rx=0 tx=0).stop 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1645017098 shutdown_connections 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 0x55dfae86cae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae84c1c0 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=627968077416384090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1645017098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82b8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1645017098 >> 10.20.193.28:0/1645017098 conn(0x55dfae72a1c0 msgr2=0x55dfae809da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1645017098 shutdown_connections 2026-02-20T13:20:05.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.649+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1645017098 wait complete. 2026-02-20T13:20:05.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.650+0000 7f5f926b3e00 1 -- start start 2026-02-20T13:20:05.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.650+0000 7f5f926b3e00 1 Processor -- start 2026-02-20T13:20:05.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae824e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae8258d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dfae825f30 con 0x55dfae84c700 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dfae8260a0 con 0x55dfae80b4c0 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dfae826260 con 0x55dfae82bde0 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8de41640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8d640640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae824e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8de41640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58152/0 (socket says 10.20.193.28:58152) 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8de41640 1 -- 10.20.193.28:0/3950119875 learned_addr learned my addr 10.20.193.28:0/3950119875 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8e642640 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae8258d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8de41640 1 -- 10.20.193.28:0/3950119875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 msgr2=0x55dfae824e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8de41640 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae824e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8de41640 1 -- 10.20.193.28:0/3950119875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 msgr2=0x55dfae8258d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8de41640 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae8258d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8de41640 1 -- 10.20.193.28:0/3950119875 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfae6c2400 con 0x55dfae80b4c0 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.651+0000 7f5f8d640640 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae824e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f8de41640 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824820 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=6826913441047170966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f78005db0 tx=0x7f5f780047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ebe119aa5f4cf96 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f437fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f437fe640 1 -- 10.20.193.28:0/3950119875 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f78004850 con 0x55dfae80b4c0 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f437fe640 1 -- 10.20.193.28:0/3950119875 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5f78004e90 con 0x55dfae80b4c0 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8815eb10 con 0x55dfae80b4c0 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f437fe640 1 -- 10.20.193.28:0/3950119875 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f7801d980 con 0x55dfae80b4c0 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f926b3e00 10 client.26333 _ll_register_callbacks cb 0x55dfae6a1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:05.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dfae3b6520 con 0x55dfae80b4c0 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f437fe640 1 -- 10.20.193.28:0/3950119875 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5f7801db10 con 0x55dfae80b4c0 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f437fe640 1 -- 10.20.193.28:0/3950119875 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f7801dcd0 con 0x55dfae80b4c0 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f926b3e00 10 client.26333 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dfae69ada0 con 0x55dfae80b4c0 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.652+0000 7f5f437fe640 1 -- 10.20.193.28:0/3950119875 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f780049b0 con 0x55dfae80b4c0 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.653+0000 7f5f926b3e00 10 client.26333 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.653+0000 7f5f926b3e00 10 client.26333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.653+0000 7f5f926b3e00 20 client.26333 populate_metadata read hostname 'trial028' 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.653+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dfae828ff0 0x55dfae829470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.653+0000 7f5f926b3e00 4 client.26333 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:05.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.653+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfae748630 con 0x55dfae828ff0 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.653+0000 7f5f8d640640 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dfae828ff0 0x55dfae829470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f8d640640 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dfae828ff0 0x55dfae829470 crc :-1 s=READY pgs=102 gs=4 cs=0 l=0 c_cookie=9706470030058103292 s_cookie=3677030384061215466 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86b44f10b496a1fc server_cookie=33076fa70e4972ea in_seq=0 out_seq=0 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f437fe640 10 client.26333 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f437fe640 1 -- 10.20.193.28:0/3950119875 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dfae748630 con 0x55dfae828ff0 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f437fe640 10 client.26333 handle_command_reply: tid=0 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 client.26333 shutdown 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 msgr2=0x55dfae824820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824820 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=6826913441047170966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f78005db0 tx=0x7f5f780047e0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 shutdown_connections 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dfae828ff0 0x55dfae829470 crc :-1 s=READY pgs=102 gs=4 cs=0 l=0 c_cookie=9706470030058103292 s_cookie=3677030384061215466 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae8258d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f437fe640 0 client.26333 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:05.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae824e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/3950119875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824820 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=6826913441047170966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 >> 10.20.193.28:0/3950119875 conn(0x55dfae72a1c0 msgr2=0x55dfae80c790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:05.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 shutdown_connections 2026-02-20T13:20:05.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.654+0000 7f5f926b3e00 1 -- 10.20.193.28:0/3950119875 wait complete. 2026-02-20T13:20:05.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.655+0000 7f5f926b3e00 20 client.26333 trim_cache size 0 max 16384 2026-02-20T13:20:05.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f926b3e00 1 Processor -- start 2026-02-20T13:20:05.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f926b3e00 1 -- start start 2026-02-20T13:20:05.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae807690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae807bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dfae7148d0 con 0x55dfae84c700 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dfae455f10 con 0x55dfae80b4c0 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dfae81d8f0 con 0x55dfae82bde0 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f8e642640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae807bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f8d640640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae807690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f8e642640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae807bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49086/0 (socket says 10.20.193.28:49086) 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f8de41640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.662+0000 7f5f8e642640 1 -- 10.20.193.28:0/1795206330 learned_addr learned my addr 10.20.193.28:0/1795206330 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f8e642640 1 -- 10.20.193.28:0/1795206330 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 msgr2=0x55dfae807690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f8e642640 1 --2- 10.20.193.28:0/1795206330 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae807690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f8e642640 1 -- 10.20.193.28:0/1795206330 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 msgr2=0x55dfae824690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f8e642640 1 --2- 10.20.193.28:0/1795206330 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f8e642640 1 -- 10.20.193.28:0/1795206330 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfae6ac670 con 0x55dfae84c700 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f8e642640 1 --2- 10.20.193.28:0/1795206330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae807bd0 secure :-1 s=READY pgs=538 gs=1 cs=0 l=1 c_cookie=15906028709080798315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f84005820 tx=0x7f5f840137c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbd90d64fed146b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f55bfe640 1 -- 10.20.193.28:0/1795206330 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f84018070 con 0x55dfae84c700 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f55bfe640 1 -- 10.20.193.28:0/1795206330 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5f840118c0 con 0x55dfae84c700 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f55bfe640 1 -- 10.20.193.28:0/1795206330 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f8401c980 con 0x55dfae84c700 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1795206330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 msgr2=0x55dfae807bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1795206330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae807bd0 secure :-1 s=READY pgs=538 gs=1 cs=0 l=1 c_cookie=15906028709080798315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f84005820 tx=0x7f5f840137c0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1795206330 shutdown_connections 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1795206330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae84c700 0x55dfae807bd0 unknown :-1 s=CLOSED pgs=538 gs=1 cs=0 l=1 c_cookie=15906028709080798315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1795206330 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae82bde0 0x55dfae807690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1795206330 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae80b4c0 0x55dfae824690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1795206330 >> 10.20.193.28:0/1795206330 conn(0x55dfae72a1c0 msgr2=0x55dfae84a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:05.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1795206330 shutdown_connections 2026-02-20T13:20:05.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.663+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1795206330 wait complete. 2026-02-20T13:20:05.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f926b3e00 1 -- start start 2026-02-20T13:20:05.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f926b3e00 1 Processor -- start 2026-02-20T13:20:05.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae82ddb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f926b3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 0x55dfae82e780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dfae71cd00 con 0x55dfae80b4c0 2026-02-20T13:20:05.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dfae720fd0 con 0x55dfae82bde0 2026-02-20T13:20:05.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f926b3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dfae82eee0 con 0x55dfae84c700 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f8d640640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae82ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f8de41640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f8de41640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82d710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49100/0 (socket says 10.20.193.28:49100) 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f8d640640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae82ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58176/0 (socket says 10.20.193.28:58176) 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f8de41640 1 -- 10.20.193.28:0/1830904219 learned_addr learned my addr 10.20.193.28:0/1830904219 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.664+0000 7f5f8e642640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 0x55dfae82e780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f8de41640 1 -- 10.20.193.28:0/1830904219 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 msgr2=0x55dfae82e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f8de41640 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 0x55dfae82e780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f8de41640 1 -- 10.20.193.28:0/1830904219 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 msgr2=0x55dfae82ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f8de41640 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae82ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f8de41640 1 -- 10.20.193.28:0/1830904219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfae6a70f0 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f8de41640 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82d710 secure :-1 s=READY pgs=539 gs=1 cs=0 l=1 c_cookie=16671519562985057206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f78005200 tx=0x7f5f78002fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75d22b689b32bb6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f437fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f437fe640 1 -- 10.20.193.28:0/1830904219 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f7802f5f0 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f84005050 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f437fe640 1 -- 10.20.193.28:0/1830904219 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55dfae3b6520 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f926b3e00 10 client.16356 _ll_register_callbacks cb 0x55dfae6a1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dfae7c6ca0 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f437fe640 1 -- 10.20.193.28:0/1830904219 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f7802f5f0 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.665+0000 7f5f437fe640 1 -- 10.20.193.28:0/1830904219 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5f7801a9e0 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f437fe640 1 -- 10.20.193.28:0/1830904219 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f7801aba0 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f926b3e00 10 client.16356 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dfae69b0d0 con 0x55dfae80b4c0 2026-02-20T13:20:05.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f437fe640 1 -- 10.20.193.28:0/1830904219 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f78025560 con 0x55dfae80b4c0 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f926b3e00 10 client.16356 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f926b3e00 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f926b3e00 20 client.16356 populate_metadata read hostname 'trial028' 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dfae830d30 0x55dfae8311d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f926b3e00 4 client.16356 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dfae3fa640 con 0x55dfae830d30 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.666+0000 7f5f8d640640 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dfae830d30 0x55dfae8311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.667+0000 7f5f8d640640 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dfae830d30 0x55dfae8311d0 crc :-1 s=READY pgs=103 gs=4 cs=0 l=0 c_cookie=9165510671563419279 s_cookie=8645031861680222289 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f326f651396ee8f server_cookie=77f952acc3623051 in_seq=0 out_seq=0 2026-02-20T13:20:05.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.667+0000 7f5f437fe640 10 client.16356 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:05.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.671+0000 7f5f437fe640 1 -- 10.20.193.28:0/1830904219 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfae3fa640 con 0x55dfae830d30 2026-02-20T13:20:05.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.671+0000 7f5f437fe640 10 client.16356 handle_command_reply: tid=0 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.671+0000 7f5f926b3e00 1 client.16356 shutdown 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 msgr2=0x55dfae82d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82d710 secure :-1 s=READY pgs=539 gs=1 cs=0 l=1 c_cookie=16671519562985057206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f78005200 tx=0x7f5f78002fa0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 shutdown_connections 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dfae830d30 0x55dfae8311d0 crc :-1 s=READY pgs=103 gs=4 cs=0 l=0 c_cookie=9165510671563419279 s_cookie=8645031861680222289 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dfae84c700 0x55dfae82e780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dfae82bde0 0x55dfae82ddb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 --2- 10.20.193.28:0/1830904219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfae80b4c0 0x55dfae82d710 unknown :-1 s=CLOSED pgs=539 gs=1 cs=0 l=1 c_cookie=16671519562985057206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f437fe640 0 client.16356 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 >> 10.20.193.28:0/1830904219 conn(0x55dfae72a1c0 msgr2=0x55dfae84a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:05.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 shutdown_connections 2026-02-20T13:20:05.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 1 -- 10.20.193.28:0/1830904219 wait complete. 2026-02-20T13:20:05.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f926b3e00 20 client.16356 trim_cache size 0 max 16384 2026-02-20T13:20:05.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:20:05.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:20:05.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:20:05.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:20:05.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 -- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5f640b5760 msgr2=0x7f5f640d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5f640b5760 0x7f5f640d5c10 secure :-1 s=READY pgs=319 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f78004740 tx=0x7f5f78005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:05.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 -- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f88062a40 msgr2=0x7f5f8815cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f88062a40 0x7f5f8815cd00 secure :-1 s=READY pgs=537 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f7c038820 tx=0x7f5f7c0028d0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 -- 10.20.193.28:0/3313121152 shutdown_connections 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5f640b5760 0x7f5f640d5c10 unknown :-1 s=CLOSED pgs=319 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f88062a40 0x7f5f8815cd00 unknown :-1 s=CLOSED pgs=537 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5f88150e50 0x7f5f8815d900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 --2- 10.20.193.28:0/3313121152 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5f88061510 0x7f5f8815c6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 -- 10.20.193.28:0/3313121152 >> 10.20.193.28:0/3313121152 conn(0x7f5f880ea4c0 msgr2=0x7f5f8810a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 -- 10.20.193.28:0/3313121152 shutdown_connections 2026-02-20T13:20:05.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:05.672+0000 7f5f8ee43640 1 -- 10.20.193.28:0/3313121152 wait complete. 2026-02-20T13:20:06.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:06 trial127 ceph-mon[43817]: pgmap v264: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:06.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:06 trial034 ceph-mon[43332]: pgmap v264: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:06 trial028 ceph-mon[37442]: pgmap v264: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:08.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:08 trial127 ceph-mon[43817]: pgmap v265: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:20:08.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:08 trial034 ceph-mon[43332]: pgmap v265: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:20:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:08 trial028 ceph-mon[37442]: pgmap v265: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:20:09.076 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:20:09.265 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:09.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 -- 10.20.193.28:0/1145328586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 msgr2=0x7f78f4176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/1145328586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 0x7f78f4176070 secure :-1 s=READY pgs=540 gs=1 cs=0 l=1 c_cookie=9750873340724889537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f000a970 tx=0x7f78f00301b0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 -- 10.20.193.28:0/1145328586 shutdown_connections 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/1145328586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 0x7f78f4176070 unknown :-1 s=CLOSED pgs=540 gs=1 cs=0 l=1 c_cookie=9750873340724889537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/1145328586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78f410fea0 0x7f78f4114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/1145328586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78f410f4b0 0x7f78f410f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 -- 10.20.193.28:0/1145328586 >> 10.20.193.28:0/1145328586 conn(0x7f78f40ecda0 msgr2=0x7f78f410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 -- 10.20.193.28:0/1145328586 shutdown_connections 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.449+0000 7f78fa2f6640 1 -- 10.20.193.28:0/1145328586 wait complete. 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78fa2f6640 1 Processor -- start 2026-02-20T13:20:09.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78fa2f6640 1 -- start start 2026-02-20T13:20:09.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78fa2f6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78f410f4b0 0x7f78f411ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78fa2f6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78f410fea0 0x7f78f411e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78fa2f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 0x7f78f41236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78fa2f6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4123d00 con 0x7f78f41156a0 2026-02-20T13:20:09.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78fa2f6640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4123e70 con 0x7f78f410f4b0 2026-02-20T13:20:09.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78fa2f6640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4124030 con 0x7f78f410fea0 2026-02-20T13:20:09.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f92f4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78f410f4b0 0x7f78f411ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f9af5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 0x7f78f41236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f8af3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78f410fea0 0x7f78f411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f92f4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78f410f4b0 0x7f78f411ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58188/0 (socket says 10.20.193.28:58188) 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f92f4640 1 -- 10.20.193.28:0/2097867881 learned_addr learned my addr 10.20.193.28:0/2097867881 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f9af5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 0x7f78f41236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49120/0 (socket says 10.20.193.28:49120) 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f9af5640 1 -- 10.20.193.28:0/2097867881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78f410fea0 msgr2=0x7f78f411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f9af5640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78f410fea0 0x7f78f411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f9af5640 1 -- 10.20.193.28:0/2097867881 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78f410f4b0 msgr2=0x7f78f411ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f9af5640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78f410f4b0 0x7f78f411ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.450+0000 7f78f9af5640 1 -- 10.20.193.28:0/2097867881 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f000a590 con 0x7f78f41156a0 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.451+0000 7f78f9af5640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 0x7f78f41236e0 secure :-1 s=READY pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f00306c0 tx=0x7f78f0030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.451+0000 7f78e27fc640 1 -- 10.20.193.28:0/2097867881 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78f003e070 con 0x7f78f41156a0 2026-02-20T13:20:09.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.451+0000 7f78e27fc640 1 -- 10.20.193.28:0/2097867881 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78f0003ad0 con 0x7f78f41156a0 2026-02-20T13:20:09.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.451+0000 7f78fa2f6640 1 -- 10.20.193.28:0/2097867881 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f41242b0 con 0x7f78f41156a0 2026-02-20T13:20:09.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.451+0000 7f78fa2f6640 1 -- 10.20.193.28:0/2097867881 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f4164a10 con 0x7f78f41156a0 2026-02-20T13:20:09.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.451+0000 7f78e27fc640 1 -- 10.20.193.28:0/2097867881 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78f0042870 con 0x7f78f41156a0 2026-02-20T13:20:09.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.454+0000 7f78e27fc640 1 -- 10.20.193.28:0/2097867881 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f78f004a060 con 0x7f78f41156a0 2026-02-20T13:20:09.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78e27fc640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78d00b5760 0x7f78d00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78e27fc640 1 -- 10.20.193.28:0/2097867881 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f78f010c410 con 0x7f78f41156a0 2026-02-20T13:20:09.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78f92f4640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78d00b5760 0x7f78d00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78fd579e00 1 Processor -- start 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78fd579e00 1 -- start start 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78f92f4640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78d00b5760 0x7f78d00d5c10 secure :-1 s=READY pgs=320 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e40097c0 tx=0x7f78e4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee36180 0x55592ee36550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee7b400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee7b940 0x55592ee9bd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78fd579e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55592ed4c7d0 con 0x55592ee7b940 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78fd579e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55592ed48500 con 0x55592ee36a90 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.456+0000 7f78fd579e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55592ed424a0 con 0x55592ee36180 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f8af3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee7b400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f92f4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee36180 0x55592ee36550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f9af5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee7b940 0x55592ee9bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f8af3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee7b400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58202/0 (socket says 10.20.193.28:58202) 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f8af3640 1 -- 10.20.193.28:0/3610029043 learned_addr learned my addr 10.20.193.28:0/3610029043 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f9af5640 1 -- 10.20.193.28:0/3610029043 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee36180 msgr2=0x55592ee36550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f9af5640 1 --2- 10.20.193.28:0/3610029043 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee36180 0x55592ee36550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f9af5640 1 -- 10.20.193.28:0/3610029043 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 msgr2=0x55592ee7b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f9af5640 1 --2- 10.20.193.28:0/3610029043 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee7b400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f9af5640 1 -- 10.20.193.28:0/3610029043 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592ecedd80 con 0x55592ee7b940 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f8af3640 1 --2- 10.20.193.28:0/3610029043 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee7b400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78f9af5640 1 --2- 10.20.193.28:0/3610029043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee7b940 0x55592ee9bd20 secure :-1 s=READY pgs=542 gs=3 cs=0 l=1 c_cookie=4054527857854757074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f00ce050 tx=0x7f78f0039f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3844939adb5bb8d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78c1ce5640 1 -- 10.20.193.28:0/3610029043 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78f00d1f70 con 0x55592ee7b940 2026-02-20T13:20:09.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78c1ce5640 1 -- 10.20.193.28:0/3610029043 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78f0039b40 con 0x55592ee7b940 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.457+0000 7f78c1ce5640 1 -- 10.20.193.28:0/3610029043 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78f00dd420 con 0x55592ee7b940 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 -- 10.20.193.28:0/3610029043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee7b940 msgr2=0x55592ee9bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 --2- 10.20.193.28:0/3610029043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee7b940 0x55592ee9bd20 secure :-1 s=READY pgs=542 gs=3 cs=0 l=1 c_cookie=4054527857854757074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f00ce050 tx=0x7f78f0039f60 comp rx=0 tx=0).stop 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 -- 10.20.193.28:0/3610029043 shutdown_connections 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 --2- 10.20.193.28:0/3610029043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee7b940 0x55592ee9bd20 unknown :-1 s=CLOSED pgs=542 gs=3 cs=0 l=1 c_cookie=4054527857854757074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 --2- 10.20.193.28:0/3610029043 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee7b400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 --2- 10.20.193.28:0/3610029043 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee36180 0x55592ee36550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 -- 10.20.193.28:0/3610029043 >> 10.20.193.28:0/3610029043 conn(0x55592ee14680 msgr2=0x55592ee34a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 -- 10.20.193.28:0/3610029043 shutdown_connections 2026-02-20T13:20:09.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.458+0000 7f78fd579e00 1 -- 10.20.193.28:0/3610029043 wait complete. 2026-02-20T13:20:09.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.459+0000 7f78fd579e00 1 -- start start 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.459+0000 7f78fd579e00 1 Processor -- start 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee4e6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4ec00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee53bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78fd579e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55592ee54130 con 0x55592ee36180 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78fd579e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55592ee542a0 con 0x55592ee36a90 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78fd579e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55592ee54460 con 0x55592ee7b940 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f8af3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f92f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee4e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f9af5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee53bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f8af3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58214/0 (socket says 10.20.193.28:58214) 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f8af3640 1 -- 10.20.193.28:0/1842076939 learned_addr learned my addr 10.20.193.28:0/1842076939 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f8af3640 1 -- 10.20.193.28:0/1842076939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 msgr2=0x55592ee53bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f8af3640 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee53bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f8af3640 1 -- 10.20.193.28:0/1842076939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 msgr2=0x55592ee4e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f8af3640 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee4e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f8af3640 1 -- 10.20.193.28:0/1842076939 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f4164a10 con 0x55592ee36a90 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f9af5640 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee53bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.460+0000 7f78f92f4640 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee4e6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78f8af3640 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4ec00 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=15380024354761690769 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e8004050 tx=0x7f78e8009d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d570d2a9ee6d4e91 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78aeffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:09.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78aeffd640 1 -- 10.20.193.28:0/1842076939 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78e8017070 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78aeffd640 1 -- 10.20.193.28:0/1842076939 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78e8012ba0 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78aeffd640 1 -- 10.20.193.28:0/1842076939 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78e801b640 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e80042b0 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78aeffd640 1 -- 10.20.193.28:0/1842076939 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f78e8010e00 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78fd579e00 10 client.26351 _ll_register_callbacks cb 0x55592ecc39a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55592e9d86f0 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78aeffd640 1 -- 10.20.193.28:0/1842076939 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78e801b7d0 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78fd579e00 10 client.26351 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.461+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55592ecc6350 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.462+0000 7f78aeffd640 1 -- 10.20.193.28:0/1842076939 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78e801b970 con 0x55592ee36a90 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.462+0000 7f78fd579e00 10 client.26351 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:09.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.462+0000 7f78fd579e00 10 client.26351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.462+0000 7f78fd579e00 20 client.26351 populate_metadata read hostname 'trial028' 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.462+0000 7f78fd579e00 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55592ee78f50 0x55592ee793f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.462+0000 7f78fd579e00 4 client.26351 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.462+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55592ed4fd60 con 0x55592ee78f50 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.462+0000 7f78f92f4640 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55592ee78f50 0x55592ee793f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78f92f4640 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55592ee78f50 0x55592ee793f0 crc :-1 s=READY pgs=104 gs=4 cs=0 l=0 c_cookie=13501396348588340310 s_cookie=8935325531168395135 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb5e9872115d3456 server_cookie=7c00a73aadc54f7f in_seq=0 out_seq=0 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78aeffd640 10 client.26351 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78aeffd640 1 -- 10.20.193.28:0/1842076939 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55592ed4fd60 con 0x55592ee78f50 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78aeffd640 10 client.26351 handle_command_reply: tid=0 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 client.26351 shutdown 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 msgr2=0x55592ee4ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4ec00 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=15380024354761690769 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e8004050 tx=0x7f78e8009d40 comp rx=0 tx=0).stop 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 shutdown_connections 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55592ee78f50 0x55592ee793f0 crc :-1 s=READY pgs=104 gs=4 cs=0 l=0 c_cookie=13501396348588340310 s_cookie=8935325531168395135 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee53bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4ec00 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=15380024354761690769 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 --2- 10.20.193.28:0/1842076939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee4e6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 >> 10.20.193.28:0/1842076939 conn(0x55592ee14680 msgr2=0x55592ee35250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78aeffd640 0 client.26351 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 shutdown_connections 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.463+0000 7f78fd579e00 1 -- 10.20.193.28:0/1842076939 wait complete. 2026-02-20T13:20:09.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.464+0000 7f78fd579e00 20 client.26351 trim_cache size 0 max 16384 2026-02-20T13:20:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78fd579e00 1 Processor -- start 2026-02-20T13:20:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78fd579e00 1 -- start start 2026-02-20T13:20:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee393b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4b9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee4bef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78fd579e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55592ed400d0 con 0x55592ee36180 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78fd579e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55592ea00700 con 0x55592ee36a90 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78fd579e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55592ee11100 con 0x55592ee7b940 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78f8af3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78f8af3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58222/0 (socket says 10.20.193.28:58222) 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.473+0000 7f78f8af3640 1 -- 10.20.193.28:0/3151440066 learned_addr learned my addr 10.20.193.28:0/3151440066 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78f92f4640 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78f9af5640 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee4bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78f8af3640 1 -- 10.20.193.28:0/3151440066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 msgr2=0x55592ee4bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78f8af3640 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee4bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78f8af3640 1 -- 10.20.193.28:0/3151440066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 msgr2=0x55592ee393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78f8af3640 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee393b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78f8af3640 1 -- 10.20.193.28:0/3151440066 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592ecd8150 con 0x55592ee36a90 2026-02-20T13:20:09.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78f8af3640 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4b9b0 secure :-1 s=READY pgs=221 gs=2 cs=0 l=1 c_cookie=1613338603591163037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e801bee0 tx=0x7f78e801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1663bae98179dc9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:09.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78c14e4640 1 -- 10.20.193.28:0/3151440066 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78e8017070 con 0x55592ee36a90 2026-02-20T13:20:09.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78c14e4640 1 -- 10.20.193.28:0/3151440066 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55592e9d86f0 con 0x55592ee36a90 2026-02-20T13:20:09.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.474+0000 7f78c14e4640 1 -- 10.20.193.28:0/3151440066 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78e801b640 con 0x55592ee36a90 2026-02-20T13:20:09.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 -- 10.20.193.28:0/3151440066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 msgr2=0x55592ee4b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4b9b0 secure :-1 s=READY pgs=221 gs=2 cs=0 l=1 c_cookie=1613338603591163037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e801bee0 tx=0x7f78e801f000 comp rx=0 tx=0).stop 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 -- 10.20.193.28:0/3151440066 shutdown_connections 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592ee4bef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee4b9b0 unknown :-1 s=CLOSED pgs=221 gs=2 cs=0 l=1 c_cookie=1613338603591163037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 --2- 10.20.193.28:0/3151440066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee393b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 -- 10.20.193.28:0/3151440066 >> 10.20.193.28:0/3151440066 conn(0x55592ee14680 msgr2=0x55592ee4b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 -- 10.20.193.28:0/3151440066 shutdown_connections 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.475+0000 7f78fd579e00 1 -- 10.20.193.28:0/3151440066 wait complete. 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78fd579e00 1 -- start start 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78fd579e00 1 Processor -- start 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee56850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee56d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78fd579e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592eec0e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78fd579e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55592eec1390 con 0x55592ee36180 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78fd579e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55592eec1500 con 0x55592ee36a90 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78fd579e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55592eec16c0 con 0x55592ee7b940 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78f92f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee56850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78f92f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee56850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49156/0 (socket says 10.20.193.28:49156) 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.476+0000 7f78f92f4640 1 -- 10.20.193.28:0/866346876 learned_addr learned my addr 10.20.193.28:0/866346876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f8af3640 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee56d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f9af5640 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592eec0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f92f4640 1 -- 10.20.193.28:0/866346876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 msgr2=0x55592eec0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f92f4640 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592eec0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f92f4640 1 -- 10.20.193.28:0/866346876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 msgr2=0x55592ee56d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f92f4640 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee56d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f92f4640 1 -- 10.20.193.28:0/866346876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592ecd2bd0 con 0x55592ee36180 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f9af5640 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592eec0e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78f92f4640 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee56850 secure :-1 s=READY pgs=543 gs=1 cs=0 l=1 c_cookie=9221189907956971183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55592ee79ca0 tx=0x7f78e40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff83f5d863136af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78aeffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78aeffd640 1 -- 10.20.193.28:0/866346876 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78e4021030 con 0x55592ee36180 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78aeffd640 1 -- 10.20.193.28:0/866346876 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78e4022040 con 0x55592ee36180 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78aeffd640 1 -- 10.20.193.28:0/866346876 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78e401cba0 con 0x55592ee36180 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.477+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55592ecc6350 con 0x55592ee36180 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 10 client.16374 _ll_register_callbacks cb 0x55592ecc39a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55592ea9a4a0 con 0x55592ee36180 2026-02-20T13:20:09.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78aeffd640 1 -- 10.20.193.28:0/866346876 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f78e401cd30 con 0x55592ee36180 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78aeffd640 1 -- 10.20.193.28:0/866346876 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78e401c410 con 0x55592ee36180 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 10 client.16374 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55592ecc6680 con 0x55592ee36180 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78aeffd640 1 -- 10.20.193.28:0/866346876 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78e401c5b0 con 0x55592ee36180 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 10 client.16374 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 20 client.16374 populate_metadata read hostname 'trial028' 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55592ef29920 0x55592ef49dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 4 client.16374 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f78f0039b40 con 0x55592ef29920 2026-02-20T13:20:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.478+0000 7f78f8af3640 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55592ef29920 0x55592ef49dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.479+0000 7f78f8af3640 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55592ef29920 0x55592ef49dd0 crc :-1 s=READY pgs=105 gs=4 cs=0 l=0 c_cookie=12211596836787786657 s_cookie=5157750702764390757 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9784e9f8d0513a1 server_cookie=479402efee4af965 in_seq=0 out_seq=0 2026-02-20T13:20:09.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.479+0000 7f78aeffd640 10 client.16374 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:09.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.479+0000 7f78aeffd640 1 -- 10.20.193.28:0/866346876 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x7f78f0039b40 con 0x55592ef29920 2026-02-20T13:20:09.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.479+0000 7f78aeffd640 10 client.16374 handle_command_reply: tid=0 2026-02-20T13:20:09.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.479+0000 7f78fd579e00 1 client.16374 shutdown 2026-02-20T13:20:09.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 msgr2=0x55592ee56850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee56850 secure :-1 s=READY pgs=543 gs=1 cs=0 l=1 c_cookie=9221189907956971183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55592ee79ca0 tx=0x7f78e40047e0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 shutdown_connections 2026-02-20T13:20:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55592ef29920 0x55592ef49dd0 crc :-1 s=READY pgs=105 gs=4 cs=0 l=0 c_cookie=12211596836787786657 s_cookie=5157750702764390757 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55592ee7b940 0x55592eec0e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55592ee36a90 0x55592ee56d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 --2- 10.20.193.28:0/866346876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592ee36180 0x55592ee56850 unknown :-1 s=CLOSED pgs=543 gs=1 cs=0 l=1 c_cookie=9221189907956971183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.488 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:09.489 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:09.490 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:09.491 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:09.492 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:20:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 >> 10.20.193.28:0/866346876 conn(0x55592ee14680 msgr2=0x55592ee4b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78aeffd640 0 client.16374 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 shutdown_connections 2026-02-20T13:20:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 1 -- 10.20.193.28:0/866346876 wait complete. 2026-02-20T13:20:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fd579e00 20 client.16374 trim_cache size 0 max 16384 2026-02-20T13:20:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 -- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78d00b5760 msgr2=0x7f78d00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78d00b5760 0x7f78d00d5c10 secure :-1 s=READY pgs=320 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e40097c0 tx=0x7f78e4009310 comp rx=0 tx=0).stop 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 -- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 msgr2=0x7f78f41236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 0x7f78f41236e0 secure :-1 s=READY pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f00306c0 tx=0x7f78f0030d70 comp rx=0 tx=0).stop 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 -- 10.20.193.28:0/2097867881 shutdown_connections 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78d00b5760 0x7f78d00d5c10 unknown :-1 s=CLOSED pgs=320 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78f41156a0 0x7f78f41236e0 unknown :-1 s=CLOSED pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78f410fea0 0x7f78f411e310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.480+0000 7f78fa2f6640 1 --2- 10.20.193.28:0/2097867881 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78f410f4b0 0x7f78f411ddd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.481+0000 7f78fa2f6640 1 -- 10.20.193.28:0/2097867881 >> 10.20.193.28:0/2097867881 conn(0x7f78f40ecda0 msgr2=0x7f78f410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.481+0000 7f78fa2f6640 1 -- 10.20.193.28:0/2097867881 shutdown_connections 2026-02-20T13:20:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.481+0000 7f78fa2f6640 1 -- 10.20.193.28:0/2097867881 wait complete. 2026-02-20T13:20:09.621 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:20:09.622 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:20:09.809 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:09.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 -- 10.20.193.28:0/2216798433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010f4b0 msgr2=0x7f5e3010f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2216798433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010f4b0 0x7f5e3010f880 secure :-1 s=READY pgs=544 gs=1 cs=0 l=1 c_cookie=8149124560854206716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e24009950 tx=0x7f5e2402f190 comp rx=0 tx=0).stop 2026-02-20T13:20:09.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 -- 10.20.193.28:0/2216798433 shutdown_connections 2026-02-20T13:20:09.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2216798433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e301156a0 0x7f5e30176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2216798433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e3010fea0 0x7f5e30114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2216798433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010f4b0 0x7f5e3010f880 unknown :-1 s=CLOSED pgs=544 gs=1 cs=0 l=1 c_cookie=8149124560854206716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 -- 10.20.193.28:0/2216798433 >> 10.20.193.28:0/2216798433 conn(0x7f5e300ecda0 msgr2=0x7f5e3010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:09.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 -- 10.20.193.28:0/2216798433 shutdown_connections 2026-02-20T13:20:09.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.982+0000 7f5e2f577640 1 -- 10.20.193.28:0/2216798433 wait complete. 2026-02-20T13:20:09.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2f577640 1 Processor -- start 2026-02-20T13:20:09.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2f577640 1 -- start start 2026-02-20T13:20:09.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2f577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e3010f4b0 0x7f5e3010b050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010fea0 0x7f5e30175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e301156a0 0x7f5e3010b750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e300f0210 con 0x7f5e3010fea0 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2f577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5e300f0380 con 0x7f5e3010f4b0 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2f577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5e300f0540 con 0x7f5e301156a0 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.983+0000 7f5e2dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010fea0 0x7f5e30175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e3010f4b0 0x7f5e3010b050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e3010f4b0 0x7f5e3010b050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52464/0 (socket says 10.20.193.28:52464) 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 -- 10.20.193.28:0/2833959104 learned_addr learned my addr 10.20.193.28:0/2833959104 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2ed76640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e301156a0 0x7f5e3010b750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 -- 10.20.193.28:0/2833959104 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e301156a0 msgr2=0x7f5e3010b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e301156a0 0x7f5e3010b750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 -- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010fea0 msgr2=0x7f5e30175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:09.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010fea0 0x7f5e30175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 -- 10.20.193.28:0/2833959104 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e24009570 con 0x7f5e3010f4b0 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2dd74640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010fea0 0x7f5e30175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2e575640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e3010f4b0 0x7f5e3010b050 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e24005b30 tx=0x7f5e24004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e177fe640 1 -- 10.20.193.28:0/2833959104 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e2403d070 con 0x7f5e3010f4b0 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e177fe640 1 -- 10.20.193.28:0/2833959104 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e24038920 con 0x7f5e3010f4b0 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e177fe640 1 -- 10.20.193.28:0/2833959104 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e240418a0 con 0x7f5e3010f4b0 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.984+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e300f07c0 con 0x7f5e3010f4b0 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.985+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e300f0be0 con 0x7f5e3010f4b0 2026-02-20T13:20:09.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.985+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e30110790 con 0x7f5e3010f4b0 2026-02-20T13:20:09.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.987+0000 7f5e177fe640 1 -- 10.20.193.28:0/2833959104 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5e24048020 con 0x7f5e3010f4b0 2026-02-20T13:20:09.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.989+0000 7f5e177fe640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e080b5750 0x7f5e080d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:09.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.989+0000 7f5e177fe640 1 -- 10.20.193.28:0/2833959104 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e2410aeb0 con 0x7f5e3010f4b0 2026-02-20T13:20:09.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.989+0000 7f5e2dd74640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e080b5750 0x7f5e080d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:09.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.989+0000 7f5e177fe640 1 -- 10.20.193.28:0/2833959104 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f5e2410b330 con 0x7f5e3010f4b0 2026-02-20T13:20:09.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:09.990+0000 7f5e2dd74640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e080b5750 0x7f5e080d5c00 secure :-1 s=READY pgs=321 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e300f12a0 tx=0x7f5e18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:10.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.131+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e3010c1b0 con 0x7f5e3010f4b0 2026-02-20T13:20:10.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.132+0000 7f5e177fe640 1 -- 10.20.193.28:0/2833959104 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f5e240cd860 con 0x7f5e3010f4b0 2026-02-20T13:20:10.135 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:20:10.136 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:20:10.136 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e080b5750 msgr2=0x7f5e080d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e080b5750 0x7f5e080d5c00 secure :-1 s=READY pgs=321 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e300f12a0 tx=0x7f5e18005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e3010f4b0 msgr2=0x7f5e3010b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e3010f4b0 0x7f5e3010b050 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e24005b30 tx=0x7f5e24004340 comp rx=0 tx=0).stop 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 shutdown_connections 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e080b5750 0x7f5e080d5c00 unknown :-1 s=CLOSED pgs=321 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3010fea0 0x7f5e30175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e301156a0 0x7f5e3010b750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 --2- 10.20.193.28:0/2833959104 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e3010f4b0 0x7f5e3010b050 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 >> 10.20.193.28:0/2833959104 conn(0x7f5e300ecda0 msgr2=0x7f5e30112960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:10.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 shutdown_connections 2026-02-20T13:20:10.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.133+0000 7f5e2f577640 1 -- 10.20.193.28:0/2833959104 wait complete. 2026-02-20T13:20:10.235 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:20:10.420 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:10.465 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:10 trial028 ceph-mon[37442]: pgmap v266: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:20:10.465 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:10 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2833959104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 -- 10.20.193.28:0/1117184463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 msgr2=0x7f43e8114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1117184463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 0x7f43e8114ef0 secure :-1 s=READY pgs=545 gs=1 cs=0 l=1 c_cookie=14185936672544217689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43d4009950 tx=0x7f43d402f190 comp rx=0 tx=0).stop 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 -- 10.20.193.28:0/1117184463 shutdown_connections 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1117184463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 0x7f43e8114ef0 unknown :-1 s=CLOSED pgs=545 gs=1 cs=0 l=1 c_cookie=14185936672544217689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1117184463 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43e81156a0 0x7f43e8176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1117184463 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43e810f4b0 0x7f43e810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 -- 10.20.193.28:0/1117184463 >> 10.20.193.28:0/1117184463 conn(0x7f43e80ecd60 msgr2=0x7f43e810d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 -- 10.20.193.28:0/1117184463 shutdown_connections 2026-02-20T13:20:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.606+0000 7f43ef72a640 1 -- 10.20.193.28:0/1117184463 wait complete. 2026-02-20T13:20:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ef72a640 1 Processor -- start 2026-02-20T13:20:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ef72a640 1 -- start start 2026-02-20T13:20:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ef72a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43e810f4b0 0x7f43e80f5760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ef72a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 0x7f43e8175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ef72a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43e81156a0 0x7f43e80f5e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ef72a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80fb070 con 0x7f43e810fea0 2026-02-20T13:20:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ef72a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80fb1e0 con 0x7f43e810f4b0 2026-02-20T13:20:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ef72a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80fb3a0 con 0x7f43e81156a0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43edf27640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 0x7f43e8175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43edf27640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 0x7f43e8175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58218/0 (socket says 10.20.193.28:58218) 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43edf27640 1 -- 10.20.193.28:0/1251485277 learned_addr learned my addr 10.20.193.28:0/1251485277 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43ee728640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43e810f4b0 0x7f43e80f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.607+0000 7f43eef29640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43e81156a0 0x7f43e80f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43edf27640 1 -- 10.20.193.28:0/1251485277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43e81156a0 msgr2=0x7f43e80f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43edf27640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43e81156a0 0x7f43e80f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43edf27640 1 -- 10.20.193.28:0/1251485277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43e810f4b0 msgr2=0x7f43e80f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43edf27640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43e810f4b0 0x7f43e80f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43edf27640 1 -- 10.20.193.28:0/1251485277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d4009570 con 0x7f43e810fea0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43edf27640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 0x7f43e8175f70 secure :-1 s=READY pgs=546 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43d4005b30 tx=0x7f43d4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43d37fe640 1 -- 10.20.193.28:0/1251485277 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43d403d070 con 0x7f43e810fea0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43d37fe640 1 -- 10.20.193.28:0/1251485277 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f43d4038920 con 0x7f43e810fea0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43d37fe640 1 -- 10.20.193.28:0/1251485277 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43d40418a0 con 0x7f43e810fea0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43ef72a640 1 -- 10.20.193.28:0/1251485277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e80fb620 con 0x7f43e810fea0 2026-02-20T13:20:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.608+0000 7f43ef72a640 1 -- 10.20.193.28:0/1251485277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e80fba40 con 0x7f43e810fea0 2026-02-20T13:20:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.611+0000 7f43d37fe640 1 -- 10.20.193.28:0/1251485277 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f43d4048020 con 0x7f43e810fea0 2026-02-20T13:20:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.613+0000 7f43d37fe640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43c40b5750 0x7f43c40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.613+0000 7f43d37fe640 1 -- 10.20.193.28:0/1251485277 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f43d410af10 con 0x7f43e810fea0 2026-02-20T13:20:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.613+0000 7f43ee728640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43c40b5750 0x7f43c40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.613+0000 7f43f29ade00 1 Processor -- start 2026-02-20T13:20:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.613+0000 7f43ee728640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43c40b5750 0x7f43c40d5c00 secure :-1 s=READY pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43e0004740 tx=0x7f43e00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43f29ade00 1 -- start start 2026-02-20T13:20:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d981730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9c65e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d9c6b20 0x55923d9e6f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43f29ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55923d897780 con 0x55923d9c6b20 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43f29ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55923d8934b0 con 0x55923d981c70 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43f29ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55923d88d450 con 0x55923d981360 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43ee728640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d981730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43eef29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d9c6b20 0x55923d9e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43edf27640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43ee728640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d981730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43116/0 (socket says 10.20.193.28:43116) 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43ee728640 1 -- 10.20.193.28:0/1070100728 learned_addr learned my addr 10.20.193.28:0/1070100728 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43eef29640 1 -- 10.20.193.28:0/1070100728 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 msgr2=0x55923d981730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43eef29640 1 --2- 10.20.193.28:0/1070100728 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d981730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43eef29640 1 -- 10.20.193.28:0/1070100728 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 msgr2=0x55923d9c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43eef29640 1 --2- 10.20.193.28:0/1070100728 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43eef29640 1 -- 10.20.193.28:0/1070100728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923d838d10 con 0x55923d9c6b20 2026-02-20T13:20:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.614+0000 7f43eef29640 1 --2- 10.20.193.28:0/1070100728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d9c6b20 0x55923d9e6f00 secure :-1 s=READY pgs=547 gs=2 cs=0 l=1 c_cookie=13728226588612970327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43dc005540 tx=0x7f43dc003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be847558da594757 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43d0cf3640 1 -- 10.20.193.28:0/1070100728 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43dc00ac10 con 0x55923d9c6b20 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43d0cf3640 1 -- 10.20.193.28:0/1070100728 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f43dc00ad70 con 0x55923d9c6b20 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43d0cf3640 1 -- 10.20.193.28:0/1070100728 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43dc0128f0 con 0x55923d9c6b20 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 -- 10.20.193.28:0/1070100728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d9c6b20 msgr2=0x55923d9e6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 --2- 10.20.193.28:0/1070100728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d9c6b20 0x55923d9e6f00 secure :-1 s=READY pgs=547 gs=2 cs=0 l=1 c_cookie=13728226588612970327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43dc005540 tx=0x7f43dc003c30 comp rx=0 tx=0).stop 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 -- 10.20.193.28:0/1070100728 shutdown_connections 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 --2- 10.20.193.28:0/1070100728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d9c6b20 0x55923d9e6f00 unknown :-1 s=CLOSED pgs=547 gs=2 cs=0 l=1 c_cookie=13728226588612970327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 --2- 10.20.193.28:0/1070100728 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9c65e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 --2- 10.20.193.28:0/1070100728 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d981730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 -- 10.20.193.28:0/1070100728 >> 10.20.193.28:0/1070100728 conn(0x55923d95f860 msgr2=0x55923d97fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 -- 10.20.193.28:0/1070100728 shutdown_connections 2026-02-20T13:20:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.615+0000 7f43f29ade00 1 -- 10.20.193.28:0/1070100728 wait complete. 2026-02-20T13:20:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43f29ade00 1 -- start start 2026-02-20T13:20:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43f29ade00 1 Processor -- start 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9de770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9decb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9e0a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43f29ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55923d9e0fb0 con 0x55923d981c70 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43f29ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55923d9e1120 con 0x55923d9c6b20 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43f29ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55923d9e12e0 con 0x55923d981360 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43ee728640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9de770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43ee728640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9de770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43124/0 (socket says 10.20.193.28:43124) 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43ee728640 1 -- 10.20.193.28:0/2350987037 learned_addr learned my addr 10.20.193.28:0/2350987037 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.617+0000 7f43edf27640 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9decb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43eef29640 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9e0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43ee728640 1 -- 10.20.193.28:0/2350987037 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 msgr2=0x55923d9e0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43ee728640 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9e0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43ee728640 1 -- 10.20.193.28:0/2350987037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 msgr2=0x55923d9decb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43ee728640 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9decb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43ee728640 1 -- 10.20.193.28:0/2350987037 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923d8113c0 con 0x55923d981360 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43ee728640 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9de770 secure :-1 s=READY pgs=186 gs=2 cs=0 l=1 c_cookie=7941757005766302175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43e0005930 tx=0x7f43e00047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e36c9eb652b99df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f439bfff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f439bfff640 1 -- 10.20.193.28:0/2350987037 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43e0022070 con 0x55923d981360 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f439bfff640 1 -- 10.20.193.28:0/2350987037 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f43e0015070 con 0x55923d981360 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f439bfff640 1 -- 10.20.193.28:0/2350987037 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43e001db00 con 0x55923d981360 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc0051e0 con 0x55923d981360 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f439bfff640 1 -- 10.20.193.28:0/2350987037 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f43e001dc90 con 0x55923d981360 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43f29ade00 10 client.26314 _ll_register_callbacks cb 0x55923d80ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:10.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.618+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55923d5236f0 con 0x55923d981360 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f439bfff640 1 -- 10.20.193.28:0/2350987037 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43e001d410 con 0x55923d981360 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43f29ade00 10 client.26314 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55923d8230e0 con 0x55923d981360 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f439bfff640 1 -- 10.20.193.28:0/2350987037 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43e0027640 con 0x55923d981360 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43f29ade00 10 client.26314 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43f29ade00 10 client.26314 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43f29ade00 20 client.26314 populate_metadata read hostname 'trial028' 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55923d9e6cc0 0x55923d9c48a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43f29ade00 4 client.26314 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55923d82ff80 con 0x55923d9e6cc0 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.619+0000 7f43edf27640 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55923d9e6cc0 0x55923d9c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43edf27640 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55923d9e6cc0 0x55923d9c48a0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=31285542521396147 s_cookie=3921486481017470662 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6f26090097dbb3 server_cookie=366beb2d748afec6 in_seq=0 out_seq=0 2026-02-20T13:20:10.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f439bfff640 10 client.26314 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f439bfff640 1 -- 10.20.193.28:0/2350987037 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55923d82ff80 con 0x55923d9e6cc0 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f439bfff640 10 client.26314 handle_command_reply: tid=0 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 client.26314 shutdown 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 msgr2=0x55923d9de770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9de770 secure :-1 s=READY pgs=186 gs=2 cs=0 l=1 c_cookie=7941757005766302175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43e0005930 tx=0x7f43e00047e0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 shutdown_connections 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55923d9e6cc0 0x55923d9c48a0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=31285542521396147 s_cookie=3921486481017470662 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9decb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9e0a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2350987037 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9de770 unknown :-1 s=CLOSED pgs=186 gs=2 cs=0 l=1 c_cookie=7941757005766302175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f439bfff640 0 client.26314 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:20:10.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.620+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 >> 10.20.193.28:0/2350987037 conn(0x55923d95f860 msgr2=0x55923d97fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:10.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.621+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 shutdown_connections 2026-02-20T13:20:10.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.621+0000 7f43f29ade00 1 -- 10.20.193.28:0/2350987037 wait complete. 2026-02-20T13:20:10.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.621+0000 7f43f29ade00 20 client.26314 trim_cache size 0 max 16384 2026-02-20T13:20:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43f29ade00 1 Processor -- start 2026-02-20T13:20:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43f29ade00 1 -- start start 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9e4630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9db900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9dbe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43f29ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55923d88b080 con 0x55923d981c70 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43f29ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55923d54b700 con 0x55923d9c6b20 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43f29ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55923d9e4cd0 con 0x55923d981360 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43ee728640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43ee728640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9e4630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43126/0 (socket says 10.20.193.28:43126) 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43ee728640 1 -- 10.20.193.28:0/75375753 learned_addr learned my addr 10.20.193.28:0/75375753 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43eef29640 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43edf27640 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9db900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.628+0000 7f43ee728640 1 -- 10.20.193.28:0/75375753 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 msgr2=0x55923d9dbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43ee728640 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9dbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43ee728640 1 -- 10.20.193.28:0/75375753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 msgr2=0x55923d9db900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43ee728640 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9db900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43ee728640 1 -- 10.20.193.28:0/75375753 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923d9d0a10 con 0x55923d981360 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43eef29640 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9dbe40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43edf27640 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9db900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43ee728640 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9e4630 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=16730237549027296677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43e001bca0 tx=0x7f43e002b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e82dbe6905ac85a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43b64e6640 1 -- 10.20.193.28:0/75375753 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43e0022040 con 0x55923d981360 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43b64e6640 1 -- 10.20.193.28:0/75375753 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f43e0015070 con 0x55923d981360 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43b64e6640 1 -- 10.20.193.28:0/75375753 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43e002fc50 con 0x55923d981360 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 -- 10.20.193.28:0/75375753 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 msgr2=0x55923d9e4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9e4630 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=16730237549027296677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43e001bca0 tx=0x7f43e002b000 comp rx=0 tx=0).stop 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 -- 10.20.193.28:0/75375753 shutdown_connections 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981c70 0x55923d9db900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d9c6b20 0x55923d9dbe40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 --2- 10.20.193.28:0/75375753 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d981360 0x55923d9e4630 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=16730237549027296677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 -- 10.20.193.28:0/75375753 >> 10.20.193.28:0/75375753 conn(0x55923d95f860 msgr2=0x55923d980840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 -- 10.20.193.28:0/75375753 shutdown_connections 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.629+0000 7f43f29ade00 1 -- 10.20.193.28:0/75375753 wait complete. 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.630+0000 7f43f29ade00 1 -- start start 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.630+0000 7f43f29ade00 1 Processor -- start 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.630+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981360 0x55923d965460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.630+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9659a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.630+0000 7f43f29ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d9c6b20 0x55923d95fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.630+0000 7f43f29ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55923d960240 con 0x55923d981360 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.630+0000 7f43f29ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55923d9603b0 con 0x55923d981c70 2026-02-20T13:20:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.630+0000 7f43f29ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55923d960570 con 0x55923d9c6b20 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43eef29640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d9c6b20 0x55923d95fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9659a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52520/0 (socket says 10.20.193.28:52520) 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 -- 10.20.193.28:0/2954192153 learned_addr learned my addr 10.20.193.28:0/2954192153 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43ee728640 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981360 0x55923d965460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 -- 10.20.193.28:0/2954192153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d9c6b20 msgr2=0x55923d95fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d9c6b20 0x55923d95fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 -- 10.20.193.28:0/2954192153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981360 msgr2=0x55923d965460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981360 0x55923d965460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 -- 10.20.193.28:0/2954192153 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923d81db60 con 0x55923d981c70 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43edf27640 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9659a0 secure :-1 s=READY pgs=223 gs=2 cs=0 l=1 c_cookie=7423192920172120345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43d404d030 tx=0x7f43d4108940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67047aa1920dc919 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f439bfff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f439bfff640 1 -- 10.20.193.28:0/2954192153 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43d4038cb0 con 0x55923d981c70 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f439bfff640 1 -- 10.20.193.28:0/2954192153 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f43d40d9570 con 0x55923d981c70 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f439bfff640 1 -- 10.20.193.28:0/2954192153 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43d40dbf20 con 0x55923d981c70 2026-02-20T13:20:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923d8230e0 con 0x55923d981c70 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f439bfff640 1 -- 10.20.193.28:0/2954192153 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f43d40dc0a0 con 0x55923d981c70 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f439bfff640 10 client.26378 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43f29ade00 10 client.26378 _ll_register_callbacks cb 0x55923d80ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.631+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43dc00ad70 con 0x55923d981c70 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f439bfff640 1 -- 10.20.193.28:0/2954192153 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43d40dc3b0 con 0x55923d981c70 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43f29ade00 10 client.26378 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55923d8116f0 con 0x55923d981c70 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f439bfff640 1 -- 10.20.193.28:0/2954192153 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43d40d3130 con 0x55923d981c70 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43f29ade00 10 client.26378 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43f29ade00 10 client.26378 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43f29ade00 20 client.26378 populate_metadata read hostname 'trial028' 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55923da75110 0x55923da955c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43f29ade00 4 client.26378 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55923d520f40 con 0x55923da75110 2026-02-20T13:20:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.632+0000 7f43ee728640 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55923da75110 0x55923da955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43ee728640 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55923da75110 0x55923da955c0 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=10904428513122329660 s_cookie=14037899658675300404 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=97544ff5634c243c server_cookie=c2d0a35d13eb2834 in_seq=0 out_seq=0 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f439bfff640 10 client.26378 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f439bfff640 1 -- 10.20.193.28:0/2954192153 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55923d520f40 con 0x55923da75110 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f439bfff640 10 client.26378 handle_command_reply: tid=0 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 client.26378 shutdown 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 msgr2=0x55923d9659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9659a0 secure :-1 s=READY pgs=223 gs=2 cs=0 l=1 c_cookie=7423192920172120345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43d404d030 tx=0x7f43d4108940 comp rx=0 tx=0).stop 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 shutdown_connections 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55923da75110 0x55923da955c0 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=10904428513122329660 s_cookie=14037899658675300404 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55923d9c6b20 0x55923d95fc30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55923d981c70 0x55923d9659a0 unknown :-1 s=CLOSED pgs=223 gs=2 cs=0 l=1 c_cookie=7423192920172120345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 --2- 10.20.193.28:0/2954192153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55923d981360 0x55923d965460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 >> 10.20.193.28:0/2954192153 conn(0x55923d95f860 msgr2=0x55923d9dde00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f439bfff640 0 client.26378 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 shutdown_connections 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.633+0000 7f43f29ade00 1 -- 10.20.193.28:0/2954192153 wait complete. 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43f29ade00 20 client.26378 trim_cache size 0 max 16384 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 -- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43c40b5750 msgr2=0x7f43c40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43c40b5750 0x7f43c40d5c00 secure :-1 s=READY pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43e0004740 tx=0x7f43e00073d0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 -- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 msgr2=0x7f43e8175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 0x7f43e8175f70 secure :-1 s=READY pgs=546 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43d4005b30 tx=0x7f43d4004340 comp rx=0 tx=0).stop 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 -- 10.20.193.28:0/1251485277 shutdown_connections 2026-02-20T13:20:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f43c40b5750 0x7f43c40d5c00 unknown :-1 s=CLOSED pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43e810fea0 0x7f43e8175f70 unknown :-1 s=CLOSED pgs=546 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43e81156a0 0x7f43e80f5e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 --2- 10.20.193.28:0/1251485277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43e810f4b0 0x7f43e80f5760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.634+0000 7f43ef72a640 1 -- 10.20.193.28:0/1251485277 >> 10.20.193.28:0/1251485277 conn(0x7f43e80ecd60 msgr2=0x7f43e810d920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.635+0000 7f43ef72a640 1 -- 10.20.193.28:0/1251485277 shutdown_connections 2026-02-20T13:20:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:10.635+0000 7f43ef72a640 1 -- 10.20.193.28:0/1251485277 wait complete. 2026-02-20T13:20:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:10 trial127 ceph-mon[43817]: pgmap v266: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:20:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:10 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2833959104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:10.735 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:20:10.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:10 trial034 ceph-mon[43332]: pgmap v266: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:20:10.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:10 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2833959104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:10.922 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 -- 10.20.193.28:0/2324697329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 msgr2=0x7f8760112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 --2- 10.20.193.28:0/2324697329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 0x7f8760112c80 secure :-1 s=READY pgs=548 gs=1 cs=0 l=1 c_cookie=12590480547893829231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8754009890 tx=0x7f875402f120 comp rx=0 tx=0).stop 2026-02-20T13:20:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 -- 10.20.193.28:0/2324697329 shutdown_connections 2026-02-20T13:20:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 --2- 10.20.193.28:0/2324697329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 0x7f8760112c80 unknown :-1 s=CLOSED pgs=548 gs=1 cs=0 l=1 c_cookie=12590480547893829231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 --2- 10.20.193.28:0/2324697329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8760113430 0x7f8760173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 --2- 10.20.193.28:0/2324697329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f876010d240 0x7f876010d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 -- 10.20.193.28:0/2324697329 >> 10.20.193.28:0/2324697329 conn(0x7f87600eaad0 msgr2=0x7f876010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 -- 10.20.193.28:0/2324697329 shutdown_connections 2026-02-20T13:20:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 -- 10.20.193.28:0/2324697329 wait complete. 2026-02-20T13:20:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.106+0000 7f87668ab640 1 Processor -- start 2026-02-20T13:20:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87668ab640 1 -- start start 2026-02-20T13:20:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87668ab640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f876010d240 0x7f87600f5770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87668ab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 0x7f8760173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87668ab640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8760113430 0x7f87600f5e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87668ab640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f87600fb080 con 0x7f876010dc30 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87668ab640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f87600fb1f0 con 0x7f876010d240 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87668ab640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f87600fb3b0 con 0x7f8760113430 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87650a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 0x7f8760173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87658a9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f876010d240 0x7f87600f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87658a9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f876010d240 0x7f87600f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52540/0 (socket says 10.20.193.28:52540) 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87650a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 0x7f8760173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58262/0 (socket says 10.20.193.28:58262) 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87658a9640 1 -- 10.20.193.28:0/2090187966 learned_addr learned my addr 10.20.193.28:0/2090187966 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87660aa640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8760113430 0x7f87600f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87650a8640 1 -- 10.20.193.28:0/2090187966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8760113430 msgr2=0x7f87600f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87650a8640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8760113430 0x7f87600f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87650a8640 1 -- 10.20.193.28:0/2090187966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f876010d240 msgr2=0x7f87600f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87650a8640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f876010d240 0x7f87600f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87650a8640 1 -- 10.20.193.28:0/2090187966 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87540094b0 con 0x7f876010dc30 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.107+0000 7f87658a9640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f876010d240 0x7f87600f5770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.108+0000 7f87650a8640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 0x7f8760173d00 secure :-1 s=READY pgs=549 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8754009230 tx=0x7f87540028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.108+0000 7f874effd640 1 -- 10.20.193.28:0/2090187966 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f875403d070 con 0x7f876010dc30 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.108+0000 7f874effd640 1 -- 10.20.193.28:0/2090187966 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f875402fcb0 con 0x7f876010dc30 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.108+0000 7f874effd640 1 -- 10.20.193.28:0/2090187966 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8754041800 con 0x7f876010dc30 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.108+0000 7f87668ab640 1 -- 10.20.193.28:0/2090187966 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87600fb630 con 0x7f876010dc30 2026-02-20T13:20:11.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.108+0000 7f87668ab640 1 -- 10.20.193.28:0/2090187966 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87600fba50 con 0x7f876010dc30 2026-02-20T13:20:11.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.111+0000 7f874effd640 1 -- 10.20.193.28:0/2090187966 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f87540386b0 con 0x7f876010dc30 2026-02-20T13:20:11.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.112+0000 7f874effd640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f873c0b5750 0x7f873c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.112+0000 7f874effd640 1 -- 10.20.193.28:0/2090187966 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f875410b1b0 con 0x7f876010dc30 2026-02-20T13:20:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f87658a9640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f873c0b5750 0x7f873c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f87658a9640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f873c0b5750 0x7f873c0d5c00 secure :-1 s=READY pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87500097c0 tx=0x7f8750009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f8769b2ee00 1 Processor -- start 2026-02-20T13:20:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f8769b2ee00 1 -- start start 2026-02-20T13:20:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7d360 0x55e6c6a7d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac25e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 0x55e6c6ae2f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6993780 con 0x55e6c6ac2b20 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e6c698f4b0 con 0x55e6c6a7d360 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.113+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6989450 con 0x55e6c6a7dc70 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43156/0 (socket says 10.20.193.28:43156) 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 -- 10.20.193.28:0/3394447571 learned_addr learned my addr 10.20.193.28:0/3394447571 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87660aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 0x55e6c6ae2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87658a9640 1 --2- 10.20.193.28:0/3394447571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7d360 0x55e6c6a7d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 -- 10.20.193.28:0/3394447571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7d360 msgr2=0x55e6c6a7d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 --2- 10.20.193.28:0/3394447571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7d360 0x55e6c6a7d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 -- 10.20.193.28:0/3394447571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 msgr2=0x55e6c6ae2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 --2- 10.20.193.28:0/3394447571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 0x55e6c6ae2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 -- 10.20.193.28:0/3394447571 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c6934d10 con 0x55e6c6a7dc70 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f87650a8640 1 --2- 10.20.193.28:0/3394447571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac25e0 secure :-1 s=READY pgs=188 gs=3 cs=0 l=1 c_cookie=230921642855434537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87540093c0 tx=0x7f87540385a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3346602bd590929 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f872e4e6640 1 -- 10.20.193.28:0/3394447571 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87540d0fa0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f872e4e6640 1 -- 10.20.193.28:0/3394447571 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f87540d0dc0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.114+0000 7f872e4e6640 1 -- 10.20.193.28:0/3394447571 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87540dc440 con 0x55e6c6a7dc70 2026-02-20T13:20:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 -- 10.20.193.28:0/3394447571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 msgr2=0x55e6c6ac25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/3394447571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac25e0 secure :-1 s=READY pgs=188 gs=3 cs=0 l=1 c_cookie=230921642855434537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87540093c0 tx=0x7f87540385a0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 -- 10.20.193.28:0/3394447571 shutdown_connections 2026-02-20T13:20:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/3394447571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 0x55e6c6ae2f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/3394447571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac25e0 unknown :-1 s=CLOSED pgs=188 gs=3 cs=0 l=1 c_cookie=230921642855434537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/3394447571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7d360 0x55e6c6a7d730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 -- 10.20.193.28:0/3394447571 >> 10.20.193.28:0/3394447571 conn(0x55e6c6a5b860 msgr2=0x55e6c6a7bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 -- 10.20.193.28:0/3394447571 shutdown_connections 2026-02-20T13:20:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.115+0000 7f8769b2ee00 1 -- 10.20.193.28:0/3394447571 wait complete. 2026-02-20T13:20:11.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.116+0000 7f8769b2ee00 1 -- start start 2026-02-20T13:20:11.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.116+0000 7f8769b2ee00 1 Processor -- start 2026-02-20T13:20:11.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6ada6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7dc70 0x55e6c6adac20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 0x55e6c6adfc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6ae0150 con 0x55e6c6ac2b20 2026-02-20T13:20:11.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6ae02c0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6ae0480 con 0x55e6c6a7d360 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87650a8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7dc70 0x55e6c6adac20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87650a8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7dc70 0x55e6c6adac20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52552/0 (socket says 10.20.193.28:52552) 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87660aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 0x55e6c6adfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87650a8640 1 -- 10.20.193.28:0/580605862 learned_addr learned my addr 10.20.193.28:0/580605862 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87658a9640 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6ada6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87650a8640 1 -- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 msgr2=0x55e6c6ada6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87650a8640 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6ada6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87650a8640 1 -- 10.20.193.28:0/580605862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 msgr2=0x55e6c6adfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87650a8640 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 0x55e6c6adfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87650a8640 1 -- 10.20.193.28:0/580605862 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c690d3c0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.117+0000 7f87658a9640 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6ada6e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f87650a8640 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7dc70 0x55e6c6adac20 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=15606066245222473615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87540cdb90 tx=0x7f8754005930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d893e290c7b31f8f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f871b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f871b7fe640 1 -- 10.20.193.28:0/580605862 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87540d0fa0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f871b7fe640 1 -- 10.20.193.28:0/580605862 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f87540d7230 con 0x55e6c6a7dc70 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87600fba50 con 0x55e6c6a7dc70 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f8769b2ee00 10 client.26390 _ll_register_callbacks cb 0x55e6c690aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f871b7fe640 1 -- 10.20.193.28:0/580605862 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87540d08b0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6c661f6f0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f871b7fe640 1 -- 10.20.193.28:0/580605862 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f87540d0a10 con 0x55e6c6a7dc70 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f871b7fe640 1 -- 10.20.193.28:0/580605862 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f87540d0bd0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f8769b2ee00 10 client.26390 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.118+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e6c691f0e0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.119+0000 7f871b7fe640 1 -- 10.20.193.28:0/580605862 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f87540cf5a0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.119+0000 7f8769b2ee00 10 client.26390 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.119+0000 7f8769b2ee00 10 client.26390 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.119+0000 7f8769b2ee00 20 client.26390 populate_metadata read hostname 'trial028' 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.119+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55e6c6abfac0 0x55e6c6abff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.119+0000 7f8769b2ee00 4 client.26390 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.119+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6c692bf80 con 0x55e6c6abfac0 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.119+0000 7f87658a9640 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55e6c6abfac0 0x55e6c6abff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.120+0000 7f871b7fe640 10 client.26390 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.120+0000 7f87658a9640 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55e6c6abfac0 0x55e6c6abff30 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=4775116843829545794 s_cookie=10565544965801491808 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=42449f784571cb42 server_cookie=92a05b2af103bd60 in_seq=0 out_seq=0 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.120+0000 7f871b7fe640 1 -- 10.20.193.28:0/580605862 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e6c692bf80 con 0x55e6c6abfac0 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.120+0000 7f871b7fe640 10 client.26390 handle_command_reply: tid=0 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.120+0000 7f8769b2ee00 1 client.26390 shutdown 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7dc70 msgr2=0x55e6c6adac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7dc70 0x55e6c6adac20 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=15606066245222473615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87540cdb90 tx=0x7f8754005930 comp rx=0 tx=0).stop 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 shutdown_connections 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55e6c6abfac0 0x55e6c6abff30 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=4775116843829545794 s_cookie=10565544965801491808 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6ac2b20 0x55e6c6adfc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6a7dc70 0x55e6c6adac20 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=15606066245222473615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/580605862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6ada6e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f871b7fe640 0 client.26390 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 >> 10.20.193.28:0/580605862 conn(0x55e6c6a5b860 msgr2=0x55e6c6a7bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 shutdown_connections 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 1 -- 10.20.193.28:0/580605862 wait complete. 2026-02-20T13:20:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.121+0000 7f8769b2ee00 20 client.26390 trim_cache size 0 max 16384 2026-02-20T13:20:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.128+0000 7f8769b2ee00 1 Processor -- start 2026-02-20T13:20:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.128+0000 7f8769b2ee00 1 -- start start 2026-02-20T13:20:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7d360 0x55e6c6ad7fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac1820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6ac1d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6987080 con 0x55e6c6a7d360 2026-02-20T13:20:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6647700 con 0x55e6c6ac2b20 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6acf010 con 0x55e6c6a7dc70 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7d360 0x55e6c6ad7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7d360 0x55e6c6ad7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58284/0 (socket says 10.20.193.28:58284) 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 -- 10.20.193.28:0/1389010450 learned_addr learned my addr 10.20.193.28:0/1389010450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87660aa640 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6ac1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87650a8640 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac1820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 -- 10.20.193.28:0/1389010450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 msgr2=0x55e6c6ac1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac1820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 -- 10.20.193.28:0/1389010450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 msgr2=0x55e6c6ac1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6ac1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 -- 10.20.193.28:0/1389010450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c6919b60 con 0x55e6c6a7d360 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f87658a9640 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7d360 0x55e6c6ad7fc0 secure :-1 s=READY pgs=550 gs=1 cs=0 l=1 c_cookie=1785970469847202655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750012940 tx=0x7f8750014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c90aae0a947b5f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f872dce5640 1 -- 10.20.193.28:0/1389010450 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f875002d070 con 0x55e6c6a7d360 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f872dce5640 1 -- 10.20.193.28:0/1389010450 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8750022040 con 0x55e6c6a7d360 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.129+0000 7f872dce5640 1 -- 10.20.193.28:0/1389010450 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8750029780 con 0x55e6c6a7d360 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 -- 10.20.193.28:0/1389010450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7d360 msgr2=0x55e6c6ad7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7d360 0x55e6c6ad7fc0 secure :-1 s=READY pgs=550 gs=1 cs=0 l=1 c_cookie=1785970469847202655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750012940 tx=0x7f8750014000 comp rx=0 tx=0).stop 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 -- 10.20.193.28:0/1389010450 shutdown_connections 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6ac1d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7dc70 0x55e6c6ac1820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/1389010450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7d360 0x55e6c6ad7fc0 unknown :-1 s=CLOSED pgs=550 gs=1 cs=0 l=1 c_cookie=1785970469847202655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 -- 10.20.193.28:0/1389010450 >> 10.20.193.28:0/1389010450 conn(0x55e6c6a5b860 msgr2=0x55e6c6ad68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 -- 10.20.193.28:0/1389010450 shutdown_connections 2026-02-20T13:20:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 -- 10.20.193.28:0/1389010450 wait complete. 2026-02-20T13:20:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.130+0000 7f8769b2ee00 1 -- start start 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f8769b2ee00 1 Processor -- start 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6a615b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7dc70 0x55e6c6a5cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f8769b2ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6a5d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6ae1370 con 0x55e6c6a7dc70 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6993780 con 0x55e6c6ac2b20 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f8769b2ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e6c6a5da10 con 0x55e6c6a7d360 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f87658a9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6a615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f87658a9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6a615b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43190/0 (socket says 10.20.193.28:43190) 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f87658a9640 1 -- 10.20.193.28:0/55928171 learned_addr learned my addr 10.20.193.28:0/55928171 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f87660aa640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6a5d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.131+0000 7f87650a8640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7dc70 0x55e6c6a5cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f87650a8640 1 -- 10.20.193.28:0/55928171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 msgr2=0x55e6c6a615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f87650a8640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6a615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f87650a8640 1 -- 10.20.193.28:0/55928171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 msgr2=0x55e6c6a5d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f87650a8640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6a5d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f87650a8640 1 -- 10.20.193.28:0/55928171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c690d6f0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f87658a9640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6a615b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:11.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f87660aa640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6a5d4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f87650a8640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7dc70 0x55e6c6a5cf60 secure :-1 s=READY pgs=551 gs=3 cs=0 l=1 c_cookie=9902487428918583776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87540cd090 tx=0x7f87540385a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896cb3d9d976a1e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f871b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f871b7fe640 1 -- 10.20.193.28:0/55928171 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87540ccf10 con 0x55e6c6a7dc70 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f871b7fe640 1 -- 10.20.193.28:0/55928171 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e6c661f6f0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f871b7fe640 1 -- 10.20.193.28:0/55928171 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87540d3830 con 0x55e6c6a7dc70 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8750012630 con 0x55e6c6a7dc70 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f871b7fe640 1 -- 10.20.193.28:0/55928171 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f87540d1fc0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f871b7fe640 10 client.16416 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f8769b2ee00 10 client.16416 _ll_register_callbacks cb 0x55e6c690aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87540d0dc0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f871b7fe640 1 -- 10.20.193.28:0/55928171 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f87540d0fa0 con 0x55e6c6a7dc70 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f8769b2ee00 10 client.16416 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.132+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e6c691f340 con 0x55e6c6a7dc70 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.133+0000 7f871b7fe640 1 -- 10.20.193.28:0/55928171 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f87540f6660 con 0x55e6c6a7dc70 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.133+0000 7f8769b2ee00 10 client.16416 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.133+0000 7f8769b2ee00 10 client.16416 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.133+0000 7f8769b2ee00 20 client.16416 populate_metadata read hostname 'trial028' 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.133+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55e6c6b6fd50 0x55e6c6b90130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.133+0000 7f8769b2ee00 4 client.16416 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.133+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6c661cf40 con 0x55e6c6b6fd50 2026-02-20T13:20:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.133+0000 7f87658a9640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55e6c6b6fd50 0x55e6c6b90130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f87658a9640 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55e6c6b6fd50 0x55e6c6b90130 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=14962974316407395935 s_cookie=6068798469509255945 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cfa729dd10c1965f server_cookie=5438b40ddc889309 in_seq=0 out_seq=0 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f871b7fe640 10 client.16416 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f871b7fe640 1 -- 10.20.193.28:0/55928171 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6c661cf40 con 0x55e6c6b6fd50 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f871b7fe640 10 client.16416 handle_command_reply: tid=0 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 client.16416 shutdown 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7dc70 msgr2=0x55e6c6a5cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7dc70 0x55e6c6a5cf60 secure :-1 s=READY pgs=551 gs=3 cs=0 l=1 c_cookie=9902487428918583776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87540cd090 tx=0x7f87540385a0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 shutdown_connections 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55e6c6b6fd50 0x55e6c6b90130 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=14962974316407395935 s_cookie=6068798469509255945 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6c6a7dc70 0x55e6c6a5cf60 unknown :-1 s=CLOSED pgs=551 gs=3 cs=0 l=1 c_cookie=9902487428918583776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e6c6ac2b20 0x55e6c6a5d4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 --2- 10.20.193.28:0/55928171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e6c6a7d360 0x55e6c6a615b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 >> 10.20.193.28:0/55928171 conn(0x55e6c6a5b860 msgr2=0x55e6c6ad7090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f871b7fe640 0 client.16416 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:20:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 shutdown_connections 2026-02-20T13:20:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 1 -- 10.20.193.28:0/55928171 wait complete. 2026-02-20T13:20:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.134+0000 7f8769b2ee00 20 client.16416 trim_cache size 0 max 16384 2026-02-20T13:20:11.145 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:11.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 -- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f873c0b5750 msgr2=0x7f873c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f873c0b5750 0x7f873c0d5c00 secure :-1 s=READY pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87500097c0 tx=0x7f8750009310 comp rx=0 tx=0).stop 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 -- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 msgr2=0x7f8760173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 0x7f8760173d00 secure :-1 s=READY pgs=549 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8754009230 tx=0x7f87540028d0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 -- 10.20.193.28:0/2090187966 shutdown_connections 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f873c0b5750 0x7f873c0d5c00 unknown :-1 s=CLOSED pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f876010dc30 0x7f8760173d00 unknown :-1 s=CLOSED pgs=549 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8760113430 0x7f87600f5e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 --2- 10.20.193.28:0/2090187966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f876010d240 0x7f87600f5770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 -- 10.20.193.28:0/2090187966 >> 10.20.193.28:0/2090187966 conn(0x7f87600eaad0 msgr2=0x7f8760111320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 -- 10.20.193.28:0/2090187966 shutdown_connections 2026-02-20T13:20:11.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.135+0000 7f87668ab640 1 -- 10.20.193.28:0/2090187966 wait complete. 2026-02-20T13:20:11.272 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:20:11.458 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.629+0000 7f08c686d640 1 -- 10.20.193.28:0/3895892061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c01156a0 msgr2=0x7f08c0176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.629+0000 7f08c686d640 1 --2- 10.20.193.28:0/3895892061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c01156a0 0x7f08c0176070 secure :-1 s=READY pgs=552 gs=1 cs=0 l=1 c_cookie=16854747956692014620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc00aa30 tx=0x7f08bc030270 comp rx=0 tx=0).stop 2026-02-20T13:20:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.629+0000 7f08c686d640 1 -- 10.20.193.28:0/3895892061 shutdown_connections 2026-02-20T13:20:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.629+0000 7f08c686d640 1 --2- 10.20.193.28:0/3895892061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c01156a0 0x7f08c0176070 unknown :-1 s=CLOSED pgs=552 gs=1 cs=0 l=1 c_cookie=16854747956692014620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.629+0000 7f08c686d640 1 --2- 10.20.193.28:0/3895892061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010fea0 0x7f08c0114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.629+0000 7f08c686d640 1 --2- 10.20.193.28:0/3895892061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010f4b0 0x7f08c010f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.629+0000 7f08c686d640 1 -- 10.20.193.28:0/3895892061 >> 10.20.193.28:0/3895892061 conn(0x7f08c00ecda0 msgr2=0x7f08c010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.630+0000 7f08c686d640 1 -- 10.20.193.28:0/3895892061 shutdown_connections 2026-02-20T13:20:11.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.630+0000 7f08c686d640 1 -- 10.20.193.28:0/3895892061 wait complete. 2026-02-20T13:20:11.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c686d640 1 Processor -- start 2026-02-20T13:20:11.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c686d640 1 -- start start 2026-02-20T13:20:11.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c686d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010f4b0 0x7f08c011ddf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c686d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010fea0 0x7f08c011e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c686d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c01156a0 0x7f08c0123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c686d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f08c0123d20 con 0x7f08c010fea0 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c686d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f08c0123e90 con 0x7f08c01156a0 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c686d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f08c0124050 con 0x7f08c010f4b0 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c586b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010f4b0 0x7f08c011ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c586b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010f4b0 0x7f08c011ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43214/0 (socket says 10.20.193.28:43214) 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c606c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c01156a0 0x7f08c0123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c586b640 1 -- 10.20.193.28:0/1502679762 learned_addr learned my addr 10.20.193.28:0/1502679762 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.631+0000 7f08c506a640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010fea0 0x7f08c011e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c586b640 1 -- 10.20.193.28:0/1502679762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c01156a0 msgr2=0x7f08c0123700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c586b640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c01156a0 0x7f08c0123700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c586b640 1 -- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010fea0 msgr2=0x7f08c011e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c586b640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010fea0 0x7f08c011e330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c586b640 1 -- 10.20.193.28:0/1502679762 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc00a650 con 0x7f08c010f4b0 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c506a640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010fea0 0x7f08c011e330 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c586b640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010f4b0 0x7f08c011ddf0 secure :-1 s=READY pgs=189 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b0005db0 tx=0x7f08b000dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08aeffd640 1 -- 10.20.193.28:0/1502679762 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b000bea0 con 0x7f08c010f4b0 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08aeffd640 1 -- 10.20.193.28:0/1502679762 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f08b0004500 con 0x7f08c010f4b0 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08aeffd640 1 -- 10.20.193.28:0/1502679762 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b0005330 con 0x7f08c010f4b0 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c686d640 1 -- 10.20.193.28:0/1502679762 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c0124330 con 0x7f08c010f4b0 2026-02-20T13:20:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.632+0000 7f08c686d640 1 -- 10.20.193.28:0/1502679762 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c0164a30 con 0x7f08c010f4b0 2026-02-20T13:20:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.635+0000 7f08aeffd640 1 -- 10.20.193.28:0/1502679762 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f08b0009940 con 0x7f08c010f4b0 2026-02-20T13:20:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.637+0000 7f08aeffd640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b5760 0x7f089c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.637+0000 7f08aeffd640 1 -- 10.20.193.28:0/1502679762 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f08b00e6a80 con 0x7f08c010f4b0 2026-02-20T13:20:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.637+0000 7f08c506a640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b5760 0x7f089c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c506a640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b5760 0x7f089c0d5c10 secure :-1 s=READY pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b4005970 tx=0x7f08b4005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c9af0e00 1 Processor -- start 2026-02-20T13:20:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c9af0e00 1 -- start start 2026-02-20T13:20:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0360 0x56481b4a0730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 0x56481b4e55e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 0x56481b505f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56481b3b6780 con 0x56481b4a0360 2026-02-20T13:20:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56481b3b24b0 con 0x56481b4e5b20 2026-02-20T13:20:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56481b3ac450 con 0x56481b4a0c70 2026-02-20T13:20:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c586b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0360 0x56481b4a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c586b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0360 0x56481b4a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58322/0 (socket says 10.20.193.28:58322) 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c586b640 1 -- 10.20.193.28:0/1371308792 learned_addr learned my addr 10.20.193.28:0/1371308792 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c506a640 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 0x56481b4e55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.638+0000 7f08c606c640 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 0x56481b505f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c586b640 1 -- 10.20.193.28:0/1371308792 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 msgr2=0x56481b4e55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c586b640 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 0x56481b4e55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c586b640 1 -- 10.20.193.28:0/1371308792 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 msgr2=0x56481b505f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c586b640 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 0x56481b505f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c586b640 1 -- 10.20.193.28:0/1371308792 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481b357d10 con 0x56481b4a0360 2026-02-20T13:20:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c586b640 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0360 0x56481b4a0730 secure :-1 s=READY pgs=553 gs=1 cs=0 l=1 c_cookie=8015957488667905761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b00e4550 tx=0x7f08b0009db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3e66dd96aecee1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f088e4e6640 1 -- 10.20.193.28:0/1371308792 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b00b2b00 con 0x56481b4a0360 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f088e4e6640 1 -- 10.20.193.28:0/1371308792 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f08b00b50e0 con 0x56481b4a0360 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f088e4e6640 1 -- 10.20.193.28:0/1371308792 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b00adcf0 con 0x56481b4a0360 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 -- 10.20.193.28:0/1371308792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0360 msgr2=0x56481b4a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0360 0x56481b4a0730 secure :-1 s=READY pgs=553 gs=1 cs=0 l=1 c_cookie=8015957488667905761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b00e4550 tx=0x7f08b0009db0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 -- 10.20.193.28:0/1371308792 shutdown_connections 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 0x56481b505f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 0x56481b4e55e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/1371308792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0360 0x56481b4a0730 unknown :-1 s=CLOSED pgs=553 gs=1 cs=0 l=1 c_cookie=8015957488667905761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 -- 10.20.193.28:0/1371308792 >> 10.20.193.28:0/1371308792 conn(0x56481b47e860 msgr2=0x56481b49ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 -- 10.20.193.28:0/1371308792 shutdown_connections 2026-02-20T13:20:11.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.639+0000 7f08c9af0e00 1 -- 10.20.193.28:0/1371308792 wait complete. 2026-02-20T13:20:11.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c9af0e00 1 -- start start 2026-02-20T13:20:11.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c9af0e00 1 Processor -- start 2026-02-20T13:20:11.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0360 0x56481b4a5790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 0x56481b4a5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4a45b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56481b4a4b20 con 0x56481b4e5b20 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56481b4a4c90 con 0x56481b4a0360 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56481b4a4e50 con 0x56481b4a0c70 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c586b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0360 0x56481b4a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c586b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0360 0x56481b4a5790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52586/0 (socket says 10.20.193.28:52586) 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c586b640 1 -- 10.20.193.28:0/2880260553 learned_addr learned my addr 10.20.193.28:0/2880260553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c506a640 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 0x56481b4a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.641+0000 7f08c606c640 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c586b640 1 -- 10.20.193.28:0/2880260553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 msgr2=0x56481b4a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c586b640 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 0x56481b4a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c586b640 1 -- 10.20.193.28:0/2880260553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 msgr2=0x56481b4a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c586b640 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c586b640 1 -- 10.20.193.28:0/2880260553 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481b3303c0 con 0x56481b4a0360 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c606c640 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4a45b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c586b640 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0360 0x56481b4a5790 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=1006196699951706761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b00a93b0 tx=0x7f08b00b7f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df6ba914acab289 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f087b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f087b7fe640 1 -- 10.20.193.28:0/2880260553 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b00b7cb0 con 0x56481b4a0360 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c0164a30 con 0x56481b4a0360 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c9af0e00 10 client.26408 _ll_register_callbacks cb 0x56481b32da10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:11.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56481b0426f0 con 0x56481b4a0360 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f087b7fe640 1 -- 10.20.193.28:0/2880260553 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f08b00ada70 con 0x56481b4a0360 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f087b7fe640 1 -- 10.20.193.28:0/2880260553 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b00ab040 con 0x56481b4a0360 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f087b7fe640 1 -- 10.20.193.28:0/2880260553 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f08b00ae7d0 con 0x56481b4a0360 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f087b7fe640 1 -- 10.20.193.28:0/2880260553 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f08b00ae9d0 con 0x56481b4a0360 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c9af0e00 10 client.26408 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.642+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56481b3420e0 con 0x56481b4a0360 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.643+0000 7f087b7fe640 1 -- 10.20.193.28:0/2880260553 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f08b00cb060 con 0x56481b4a0360 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.643+0000 7f08c9af0e00 10 client.26408 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.643+0000 7f08c9af0e00 10 client.26408 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.643+0000 7f08c9af0e00 20 client.26408 populate_metadata read hostname 'trial028' 2026-02-20T13:20:11.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.643+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56481b4cb5d0 0x56481b4cba40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.643+0000 7f08c9af0e00 4 client.26408 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.643+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56481b34ef80 con 0x56481b4cb5d0 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.643+0000 7f08c506a640 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56481b4cb5d0 0x56481b4cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.644+0000 7f08c506a640 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56481b4cb5d0 0x56481b4cba40 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=11039204518418124487 s_cookie=11642495940860130567 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9933220573330ec7 server_cookie=a192745fa5e53507 in_seq=0 out_seq=0 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.644+0000 7f087b7fe640 10 client.26408 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.644+0000 7f087b7fe640 1 -- 10.20.193.28:0/2880260553 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56481b34ef80 con 0x56481b4cb5d0 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.644+0000 7f087b7fe640 10 client.26408 handle_command_reply: tid=0 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.644+0000 7f08c9af0e00 1 client.26408 shutdown 2026-02-20T13:20:11.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0360 msgr2=0x56481b4a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0360 0x56481b4a5790 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=1006196699951706761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b00a93b0 tx=0x7f08b00b7f20 comp rx=0 tx=0).stop 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 shutdown_connections 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56481b4cb5d0 0x56481b4cba40 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=11039204518418124487 s_cookie=11642495940860130567 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4a45b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0c70 0x56481b4a5cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/2880260553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0360 0x56481b4a5790 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=1006196699951706761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f087b7fe640 0 client.26408 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 >> 10.20.193.28:0/2880260553 conn(0x56481b47e860 msgr2=0x56481b49ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 shutdown_connections 2026-02-20T13:20:11.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 1 -- 10.20.193.28:0/2880260553 wait complete. 2026-02-20T13:20:11.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.645+0000 7f08c9af0e00 20 client.26408 trim_cache size 0 max 16384 2026-02-20T13:20:11.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.652+0000 7f08c9af0e00 1 Processor -- start 2026-02-20T13:20:11.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.652+0000 7f08c9af0e00 1 -- start start 2026-02-20T13:20:11.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.652+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4a5cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.652+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0c70 0x56481b4a45a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.652+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4e5410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.652+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56481b3aa080 con 0x56481b4e5b20 2026-02-20T13:20:11.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.652+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56481b06a700 con 0x56481b4a0c70 2026-02-20T13:20:11.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.652+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56481b40eae0 con 0x56481b4a0360 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c586b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c606c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c586b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43240/0 (socket says 10.20.193.28:43240) 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c586b640 1 -- 10.20.193.28:0/3830085057 learned_addr learned my addr 10.20.193.28:0/3830085057 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c506a640 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0c70 0x56481b4a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c606c640 1 -- 10.20.193.28:0/3830085057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 msgr2=0x56481b4a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c606c640 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c606c640 1 -- 10.20.193.28:0/3830085057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0c70 msgr2=0x56481b4a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c606c640 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0c70 0x56481b4a45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c606c640 1 -- 10.20.193.28:0/3830085057 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481b4f8440 con 0x56481b4e5b20 2026-02-20T13:20:11.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c506a640 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0c70 0x56481b4a45a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f08c606c640 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4e5410 secure :-1 s=READY pgs=554 gs=2 cs=0 l=1 c_cookie=11891052704964144524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc00a980 tx=0x7f08bc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a505816f04d5ed8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.653+0000 7f088dce5640 1 -- 10.20.193.28:0/3830085057 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08bc03e070 con 0x56481b4e5b20 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f088dce5640 1 -- 10.20.193.28:0/3830085057 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f08bc03f040 con 0x56481b4e5b20 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f088dce5640 1 -- 10.20.193.28:0/3830085057 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08bc005450 con 0x56481b4e5b20 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3830085057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 msgr2=0x56481b4e5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4e5410 secure :-1 s=READY pgs=554 gs=2 cs=0 l=1 c_cookie=11891052704964144524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc00a980 tx=0x7f08bc003f10 comp rx=0 tx=0).stop 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3830085057 shutdown_connections 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4e5b20 0x56481b4e5410 unknown :-1 s=CLOSED pgs=554 gs=2 cs=0 l=1 c_cookie=11891052704964144524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4a0c70 0x56481b4a45a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3830085057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4a5cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3830085057 >> 10.20.193.28:0/3830085057 conn(0x56481b47e860 msgr2=0x56481b4e4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3830085057 shutdown_connections 2026-02-20T13:20:11.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.654+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3830085057 wait complete. 2026-02-20T13:20:11.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.655+0000 7f08c9af0e00 1 -- start start 2026-02-20T13:20:11.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.655+0000 7f08c9af0e00 1 Processor -- start 2026-02-20T13:20:11.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.655+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4de070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.655+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0c70 0x56481b4de5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.655+0000 7f08c9af0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 0x56481b4d8a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.655+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56481b47e2a0 con 0x56481b4a0c70 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.655+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56481b4d91a0 con 0x56481b4e5b20 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.655+0000 7f08c9af0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56481b4d9360 con 0x56481b4a0360 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4de070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c606c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 0x56481b4d8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4de070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43242/0 (socket says 10.20.193.28:43242) 2026-02-20T13:20:11.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 -- 10.20.193.28:0/3138769279 learned_addr learned my addr 10.20.193.28:0/3138769279 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c506a640 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0c70 0x56481b4de5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 -- 10.20.193.28:0/3138769279 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 msgr2=0x56481b4d8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 0x56481b4d8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 -- 10.20.193.28:0/3138769279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0c70 msgr2=0x56481b4de5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0c70 0x56481b4de5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 -- 10.20.193.28:0/3138769279 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c01768e0 con 0x56481b4a0360 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c506a640 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0c70 0x56481b4de5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c586b640 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4de070 secure :-1 s=READY pgs=190 gs=2 cs=0 l=1 c_cookie=193872084562823997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b00af070 tx=0x7f08b0009d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b0c5a23c3b4b3d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f087b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:11.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f087b7fe640 1 -- 10.20.193.28:0/3138769279 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b00b7cb0 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f087b7fe640 1 -- 10.20.193.28:0/3138769279 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56481b0426f0 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.656+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b400fd90 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f087b7fe640 1 -- 10.20.193.28:0/3138769279 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b00b7850 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 10 client.26356 _ll_register_callbacks cb 0x56481b32da10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08b00b50e0 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f087b7fe640 1 -- 10.20.193.28:0/3138769279 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f08b008c070 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f087b7fe640 1 -- 10.20.193.28:0/3138769279 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f08b00ada70 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 10 client.26356 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56481b33cb60 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f087b7fe640 1 -- 10.20.193.28:0/3138769279 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f08b00aadc0 con 0x56481b4a0360 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 10 client.26356 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:11.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 10 client.26356 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 20 client.26356 populate_metadata read hostname 'trial028' 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56481b59b9d0 0x56481b5bbe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 4 client.26356 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.657+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56481b03ff40 con 0x56481b59b9d0 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c506a640 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56481b59b9d0 0x56481b5bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c506a640 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56481b59b9d0 0x56481b5bbe80 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=7255198630537130348 s_cookie=10992639282537660993 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64afa4b6fc10f16c server_cookie=988db32f9ba98241 in_seq=0 out_seq=0 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f087b7fe640 10 client.26356 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f087b7fe640 1 -- 10.20.193.28:0/3138769279 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56481b03ff40 con 0x56481b59b9d0 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f087b7fe640 10 client.26356 handle_command_reply: tid=0 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 client.26356 shutdown 2026-02-20T13:20:11.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 msgr2=0x56481b4de070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4de070 secure :-1 s=READY pgs=190 gs=2 cs=0 l=1 c_cookie=193872084562823997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b00af070 tx=0x7f08b0009d10 comp rx=0 tx=0).stop 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 shutdown_connections 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56481b59b9d0 0x56481b5bbe80 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=7255198630537130348 s_cookie=10992639282537660993 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56481b4a0c70 0x56481b4de5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56481b4e5b20 0x56481b4d8a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 --2- 10.20.193.28:0/3138769279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56481b4a0360 0x56481b4de070 unknown :-1 s=CLOSED pgs=190 gs=2 cs=0 l=1 c_cookie=193872084562823997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f087b7fe640 0 client.26356 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.658+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 >> 10.20.193.28:0/3138769279 conn(0x56481b47e860 msgr2=0x56481b4a3590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 shutdown_connections 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c9af0e00 1 -- 10.20.193.28:0/3138769279 wait complete. 2026-02-20T13:20:11.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c9af0e00 20 client.26356 trim_cache size 0 max 16384 2026-02-20T13:20:11.670 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 -- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b5760 msgr2=0x7f089c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b5760 0x7f089c0d5c10 secure :-1 s=READY pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b4005970 tx=0x7f08b4005900 comp rx=0 tx=0).stop 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 -- 10.20.193.28:0/1502679762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010f4b0 msgr2=0x7f08c011ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010f4b0 0x7f08c011ddf0 secure :-1 s=READY pgs=189 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b0005db0 tx=0x7f08b000dd70 comp rx=0 tx=0).stop 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 -- 10.20.193.28:0/1502679762 shutdown_connections 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b5760 0x7f089c0d5c10 unknown :-1 s=CLOSED pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010fea0 0x7f08c011e330 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c01156a0 0x7f08c0123700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 --2- 10.20.193.28:0/1502679762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010f4b0 0x7f08c011ddf0 unknown :-1 s=CLOSED pgs=189 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 -- 10.20.193.28:0/1502679762 >> 10.20.193.28:0/1502679762 conn(0x7f08c00ecda0 msgr2=0x7f08c010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:11.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 -- 10.20.193.28:0/1502679762 shutdown_connections 2026-02-20T13:20:11.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:11.659+0000 7f08c686d640 1 -- 10.20.193.28:0/1502679762 wait complete. 2026-02-20T13:20:11.795 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:20:11.982 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:12.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 -- 10.20.193.28:0/1774355970 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 msgr2=0x7fd0ac10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 --2- 10.20.193.28:0/1774355970 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 0x7fd0ac10f880 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=16215075048315856741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0a0009950 tx=0x7fd0a002f190 comp rx=0 tx=0).stop 2026-02-20T13:20:12.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 -- 10.20.193.28:0/1774355970 shutdown_connections 2026-02-20T13:20:12.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 --2- 10.20.193.28:0/1774355970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0ac1156a0 0x7fd0ac176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 --2- 10.20.193.28:0/1774355970 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0ac10fea0 0x7fd0ac114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 --2- 10.20.193.28:0/1774355970 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 0x7fd0ac10f880 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=16215075048315856741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 -- 10.20.193.28:0/1774355970 >> 10.20.193.28:0/1774355970 conn(0x7fd0ac0ecda0 msgr2=0x7fd0ac10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 -- 10.20.193.28:0/1774355970 shutdown_connections 2026-02-20T13:20:12.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.166+0000 7fd0b0891640 1 -- 10.20.193.28:0/1774355970 wait complete. 2026-02-20T13:20:12.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0b0891640 1 Processor -- start 2026-02-20T13:20:12.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0b0891640 1 -- start start 2026-02-20T13:20:12.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0b0891640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 0x7fd0ac11de00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0b0891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0ac10fea0 0x7fd0ac11e340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0b0891640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0ac1156a0 0x7fd0ac123710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0b0891640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac123d30 con 0x7fd0ac10fea0 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0b0891640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac123ea0 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0b0891640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac124060 con 0x7fd0ac1156a0 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0aad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 0x7fd0ac11de00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0aad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 0x7fd0ac11de00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52612/0 (socket says 10.20.193.28:52612) 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0aad76640 1 -- 10.20.193.28:0/2290185835 learned_addr learned my addr 10.20.193.28:0/2290185835 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0aa575640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0ac10fea0 0x7fd0ac11e340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.167+0000 7fd0ab577640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0ac1156a0 0x7fd0ac123710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0aad76640 1 -- 10.20.193.28:0/2290185835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0ac1156a0 msgr2=0x7fd0ac123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0aad76640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0ac1156a0 0x7fd0ac123710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0aad76640 1 -- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0ac10fea0 msgr2=0x7fd0ac11e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0aad76640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0ac10fea0 0x7fd0ac11e340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0aad76640 1 -- 10.20.193.28:0/2290185835 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a0009570 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0aa575640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0ac10fea0 0x7fd0ac11e340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0aad76640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 0x7fd0ac11de00 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0a0005b30 tx=0x7fd0a0004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd08bfff640 1 -- 10.20.193.28:0/2290185835 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0a003d070 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd08bfff640 1 -- 10.20.193.28:0/2290185835 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0a0038920 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0b0891640 1 -- 10.20.193.28:0/2290185835 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ac1242e0 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd08bfff640 1 -- 10.20.193.28:0/2290185835 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0a00418a0 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.168+0000 7fd0b0891640 1 -- 10.20.193.28:0/2290185835 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ac164a40 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.171+0000 7fd08bfff640 1 -- 10.20.193.28:0/2290185835 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd0a0048020 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.173+0000 7fd08bfff640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd0800b56e0 0x7fd0800d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.173+0000 7fd08bfff640 1 -- 10.20.193.28:0/2290185835 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd0a010af10 con 0x7fd0ac10f4b0 2026-02-20T13:20:12.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.173+0000 7fd0aa575640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd0800b56e0 0x7fd0800d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0aa575640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd0800b56e0 0x7fd0800d5b90 secure :-1 s=READY pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ac1247a0 tx=0x7fd09400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0b308ce00 1 Processor -- start 2026-02-20T13:20:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0b308ce00 1 -- start start 2026-02-20T13:20:12.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f728730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f76d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f76db20 0x55c53f78df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c53f63e780 con 0x55c53f728c70 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c53f63a4b0 con 0x55c53f728360 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c53f634450 con 0x55c53f76db20 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0aa575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f76d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0aad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f728730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0aa575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f76d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58366/0 (socket says 10.20.193.28:58366) 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0aa575640 1 -- 10.20.193.28:0/652339478 learned_addr learned my addr 10.20.193.28:0/652339478 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.174+0000 7fd0ab577640 1 --2- 10.20.193.28:0/652339478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f76db20 0x55c53f78df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0aa575640 1 -- 10.20.193.28:0/652339478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f76db20 msgr2=0x55c53f78df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0aa575640 1 --2- 10.20.193.28:0/652339478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f76db20 0x55c53f78df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0aa575640 1 -- 10.20.193.28:0/652339478 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 msgr2=0x55c53f728730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0aa575640 1 --2- 10.20.193.28:0/652339478 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f728730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0aa575640 1 -- 10.20.193.28:0/652339478 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c53f5dfd10 con 0x55c53f728c70 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0aa575640 1 --2- 10.20.193.28:0/652339478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f76d5e0 secure :-1 s=READY pgs=555 gs=2 cs=0 l=1 c_cookie=4323310891484102876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd094011840 tx=0x7fd094013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bff7c59947cc0dc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0777fe640 1 -- 10.20.193.28:0/652339478 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd094011ea0 con 0x55c53f728c70 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0777fe640 1 -- 10.20.193.28:0/652339478 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd094015070 con 0x55c53f728c70 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0777fe640 1 -- 10.20.193.28:0/652339478 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd094026680 con 0x55c53f728c70 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0b308ce00 1 -- 10.20.193.28:0/652339478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 msgr2=0x55c53f76d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/652339478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f76d5e0 secure :-1 s=READY pgs=555 gs=2 cs=0 l=1 c_cookie=4323310891484102876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd094011840 tx=0x7fd094013000 comp rx=0 tx=0).stop 2026-02-20T13:20:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0b308ce00 1 -- 10.20.193.28:0/652339478 shutdown_connections 2026-02-20T13:20:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/652339478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f76d5e0 unknown :-1 s=CLOSED pgs=555 gs=2 cs=0 l=1 c_cookie=4323310891484102876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/652339478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f76db20 0x55c53f78df00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/652339478 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f728730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.175+0000 7fd0b308ce00 1 -- 10.20.193.28:0/652339478 >> 10.20.193.28:0/652339478 conn(0x55c53f706860 msgr2=0x55c53f726c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.176+0000 7fd0b308ce00 1 -- 10.20.193.28:0/652339478 shutdown_connections 2026-02-20T13:20:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.176+0000 7fd0b308ce00 1 -- 10.20.193.28:0/652339478 wait complete. 2026-02-20T13:20:12.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0b308ce00 1 -- start start 2026-02-20T13:20:12.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0b308ce00 1 Processor -- start 2026-02-20T13:20:12.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f785770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728c70 0x55c53f785cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f787a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c53f787fb0 con 0x55c53f76db20 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c53f788120 con 0x55c53f728360 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c53f7882e0 con 0x55c53f728c70 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f787a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.177+0000 7fd0aad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f785770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f787a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58376/0 (socket says 10.20.193.28:58376) 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 -- 10.20.193.28:0/3552543318 learned_addr learned my addr 10.20.193.28:0/3552543318 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0aa575640 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728c70 0x55c53f785cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 -- 10.20.193.28:0/3552543318 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728c70 msgr2=0x55c53f785cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728c70 0x55c53f785cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 -- 10.20.193.28:0/3552543318 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 msgr2=0x55c53f785770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f785770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 -- 10.20.193.28:0/3552543318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c53f5b83c0 con 0x55c53f76db20 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0aad76640 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f785770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0ab577640 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f787a40 secure :-1 s=READY pgs=556 gs=3 cs=0 l=1 c_cookie=9686825507668037300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd09c003d10 tx=0x7fd09c00aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866e8479e9bf0eb4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd074ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd074ff9640 1 -- 10.20.193.28:0/3552543318 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd09c017070 con 0x55c53f76db20 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd074ff9640 1 -- 10.20.193.28:0/3552543318 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd09c012e10 con 0x55c53f76db20 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0940114e0 con 0x55c53f76db20 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd074ff9640 1 -- 10.20.193.28:0/3552543318 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd09c010640 con 0x55c53f76db20 2026-02-20T13:20:12.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0b308ce00 10 client.16446 _ll_register_callbacks cb 0x55c53f5b5a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.178+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c53f2ca6f0 con 0x55c53f76db20 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd074ff9640 1 -- 10.20.193.28:0/3552543318 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd09c011e40 con 0x55c53f76db20 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd074ff9640 1 -- 10.20.193.28:0/3552543318 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd09c0107d0 con 0x55c53f76db20 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0b308ce00 10 client.16446 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c53f5ca0e0 con 0x55c53f76db20 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd074ff9640 1 -- 10.20.193.28:0/3552543318 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd09c023070 con 0x55c53f76db20 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0b308ce00 10 client.16446 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0b308ce00 10 client.16446 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0b308ce00 20 client.16446 populate_metadata read hostname 'trial028' 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c53f78dda0 0x55c53f76b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0b308ce00 4 client.16446 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c53f5d6f80 con 0x55c53f78dda0 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.179+0000 7fd0aad76640 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c53f78dda0 0x55c53f76b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.180+0000 7fd0aad76640 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c53f78dda0 0x55c53f76b8a0 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=7099473013138369268 s_cookie=8016799203618009982 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=628665174095aaf4 server_cookie=6f4164669f49337e in_seq=0 out_seq=0 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.180+0000 7fd074ff9640 10 client.16446 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.180+0000 7fd074ff9640 1 -- 10.20.193.28:0/3552543318 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c53f5d6f80 con 0x55c53f78dda0 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.180+0000 7fd074ff9640 10 client.16446 handle_command_reply: tid=0 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.180+0000 7fd0b308ce00 1 client.16446 shutdown 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.180+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 msgr2=0x55c53f787a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.180+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f787a40 secure :-1 s=READY pgs=556 gs=3 cs=0 l=1 c_cookie=9686825507668037300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd09c003d10 tx=0x7fd09c00aa00 comp rx=0 tx=0).stop 2026-02-20T13:20:12.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 shutdown_connections 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c53f78dda0 0x55c53f76b8a0 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=7099473013138369268 s_cookie=8016799203618009982 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f787a40 unknown :-1 s=CLOSED pgs=556 gs=3 cs=0 l=1 c_cookie=9686825507668037300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728c70 0x55c53f785cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/3552543318 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728360 0x55c53f785770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 >> 10.20.193.28:0/3552543318 conn(0x55c53f706860 msgr2=0x55c53f726c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd074ff9640 0 client.16446 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 shutdown_connections 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 1 -- 10.20.193.28:0/3552543318 wait complete. 2026-02-20T13:20:12.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.181+0000 7fd0b308ce00 20 client.16446 trim_cache size 0 max 16384 2026-02-20T13:20:12.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0b308ce00 1 Processor -- start 2026-02-20T13:20:12.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0b308ce00 1 -- start start 2026-02-20T13:20:12.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f7879d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728c70 0x55c53f782900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f782e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c53f632080 con 0x55c53f76db20 2026-02-20T13:20:12.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c53f2f2700 con 0x55c53f728c70 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c53f78c900 con 0x55c53f728360 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0ab577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f782e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0aa575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728c70 0x55c53f782900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0ab577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f782e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58380/0 (socket says 10.20.193.28:58380) 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0ab577640 1 -- 10.20.193.28:0/2881791029 learned_addr learned my addr 10.20.193.28:0/2881791029 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.188+0000 7fd0aad76640 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f7879d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0ab577640 1 -- 10.20.193.28:0/2881791029 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 msgr2=0x55c53f7879d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0ab577640 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f7879d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0ab577640 1 -- 10.20.193.28:0/2881791029 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728c70 msgr2=0x55c53f782900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0ab577640 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728c70 0x55c53f782900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0ab577640 1 -- 10.20.193.28:0/2881791029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c53f5c4b60 con 0x55c53f76db20 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0aad76640 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f7879d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0ab577640 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f782e40 secure :-1 s=READY pgs=557 gs=2 cs=0 l=1 c_cookie=924974330805949084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd09c01bca0 tx=0x7fd09c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd62b40ce0b129c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd076ffd640 1 -- 10.20.193.28:0/2881791029 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd09c017040 con 0x55c53f76db20 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd076ffd640 1 -- 10.20.193.28:0/2881791029 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c53f2ca6f0 con 0x55c53f76db20 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd076ffd640 1 -- 10.20.193.28:0/2881791029 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd09c012710 con 0x55c53f76db20 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 -- 10.20.193.28:0/2881791029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 msgr2=0x55c53f782e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f782e40 secure :-1 s=READY pgs=557 gs=2 cs=0 l=1 c_cookie=924974330805949084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd09c01bca0 tx=0x7fd09c020000 comp rx=0 tx=0).stop 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 -- 10.20.193.28:0/2881791029 shutdown_connections 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f76db20 0x55c53f782e40 unknown :-1 s=CLOSED pgs=557 gs=2 cs=0 l=1 c_cookie=924974330805949084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f728c70 0x55c53f782900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/2881791029 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f7879d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 -- 10.20.193.28:0/2881791029 >> 10.20.193.28:0/2881791029 conn(0x55c53f706860 msgr2=0x55c53f78a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 -- 10.20.193.28:0/2881791029 shutdown_connections 2026-02-20T13:20:12.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.189+0000 7fd0b308ce00 1 -- 10.20.193.28:0/2881791029 wait complete. 2026-02-20T13:20:12.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.190+0000 7fd0b308ce00 1 -- start start 2026-02-20T13:20:12.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.190+0000 7fd0b308ce00 1 Processor -- start 2026-02-20T13:20:12.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f783b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f784080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0b308ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f76db20 0x55c53f709c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c53f70a1a0 con 0x55c53f728c70 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c53f70a310 con 0x55c53f76db20 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0b308ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c53f70a4d0 con 0x55c53f728360 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f784080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f784080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58386/0 (socket says 10.20.193.28:58386) 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 -- 10.20.193.28:0/1453984062 learned_addr learned my addr 10.20.193.28:0/1453984062 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f783b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0ab577640 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f76db20 0x55c53f709c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 -- 10.20.193.28:0/1453984062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 msgr2=0x55c53f783b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f783b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 -- 10.20.193.28:0/1453984062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f76db20 msgr2=0x55c53f709c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f76db20 0x55c53f709c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 -- 10.20.193.28:0/1453984062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c53f5b86f0 con 0x55c53f728c70 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd0aa575640 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f784080 secure :-1 s=READY pgs=558 gs=1 cs=0 l=1 c_cookie=10176435753045330313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd09400d720 tx=0x7fd09401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d39f6667bda0989 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd074ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.191+0000 7fd074ff9640 1 -- 10.20.193.28:0/1453984062 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd09402a040 con 0x55c53f728c70 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd074ff9640 1 -- 10.20.193.28:0/1453984062 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd09402b040 con 0x55c53f728c70 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd074ff9640 1 -- 10.20.193.28:0/1453984062 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd094031d00 con 0x55c53f728c70 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c53f5ca0e0 con 0x55c53f728c70 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd074ff9640 1 -- 10.20.193.28:0/1453984062 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd094017070 con 0x55c53f728c70 2026-02-20T13:20:12.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 10 client.16452 _ll_register_callbacks cb 0x55c53f5b5a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c53f38c4a0 con 0x55c53f728c70 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd074ff9640 1 -- 10.20.193.28:0/1453984062 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd09400de90 con 0x55c53f728c70 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 10 client.16452 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c53f5ca340 con 0x55c53f728c70 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd074ff9640 1 -- 10.20.193.28:0/1453984062 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd094037020 con 0x55c53f728c70 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 10 client.16452 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 10 client.16452 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 20 client.16452 populate_metadata read hostname 'trial028' 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c53f70be90 0x55c53f70c330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 4 client.16452 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd094015070 con 0x55c53f70be90 2026-02-20T13:20:12.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.192+0000 7fd0aad76640 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c53f70be90 0x55c53f70c330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0aad76640 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c53f70be90 0x55c53f70c330 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=16808101994122022403 s_cookie=13331879773192150891 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9425fb5e42d8e03 server_cookie=b9045a04b5555f6b in_seq=0 out_seq=0 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd074ff9640 10 client.16452 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd074ff9640 1 -- 10.20.193.28:0/1453984062 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd094015070 con 0x55c53f70be90 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd074ff9640 10 client.16452 handle_command_reply: tid=0 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 client.16452 shutdown 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 msgr2=0x55c53f784080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f784080 secure :-1 s=READY pgs=558 gs=1 cs=0 l=1 c_cookie=10176435753045330313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd09400d720 tx=0x7fd09401ebc0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 shutdown_connections 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c53f70be90 0x55c53f70c330 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=16808101994122022403 s_cookie=13331879773192150891 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c53f728c70 0x55c53f784080 unknown :-1 s=CLOSED pgs=558 gs=1 cs=0 l=1 c_cookie=10176435753045330313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c53f76db20 0x55c53f709c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 --2- 10.20.193.28:0/1453984062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c53f728360 0x55c53f783b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd074ff9640 0 client.16452 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:20:12.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 >> 10.20.193.28:0/1453984062 conn(0x55c53f706860 msgr2=0x55c53f788a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 shutdown_connections 2026-02-20T13:20:12.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 1 -- 10.20.193.28:0/1453984062 wait complete. 2026-02-20T13:20:12.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.193+0000 7fd0b308ce00 20 client.16452 trim_cache size 0 max 16384 2026-02-20T13:20:12.204 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:12.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 -- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd0800b56e0 msgr2=0x7fd0800d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd0800b56e0 0x7fd0800d5b90 secure :-1 s=READY pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ac1247a0 tx=0x7fd09400b410 comp rx=0 tx=0).stop 2026-02-20T13:20:12.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 -- 10.20.193.28:0/2290185835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 msgr2=0x7fd0ac11de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 0x7fd0ac11de00 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0a0005b30 tx=0x7fd0a0004340 comp rx=0 tx=0).stop 2026-02-20T13:20:12.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 -- 10.20.193.28:0/2290185835 shutdown_connections 2026-02-20T13:20:12.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd0800b56e0 0x7fd0800d5b90 unknown :-1 s=CLOSED pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0ac10fea0 0x7fd0ac11e340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0ac1156a0 0x7fd0ac123710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 --2- 10.20.193.28:0/2290185835 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0ac10f4b0 0x7fd0ac11de00 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 -- 10.20.193.28:0/2290185835 >> 10.20.193.28:0/2290185835 conn(0x7fd0ac0ecda0 msgr2=0x7fd0ac10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 -- 10.20.193.28:0/2290185835 shutdown_connections 2026-02-20T13:20:12.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.194+0000 7fd0b0891640 1 -- 10.20.193.28:0/2290185835 wait complete. 2026-02-20T13:20:12.294 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:20:12.478 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:12 trial028 ceph-mon[37442]: pgmap v267: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:20:12.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 -- 10.20.193.28:0/4134207839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810b230 msgr2=0x7fdac810b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 --2- 10.20.193.28:0/4134207839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810b230 0x7fdac810b600 secure :-1 s=READY pgs=559 gs=1 cs=0 l=1 c_cookie=17153461101424220275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab8009890 tx=0x7fdab802f120 comp rx=0 tx=0).stop 2026-02-20T13:20:12.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 -- 10.20.193.28:0/4134207839 shutdown_connections 2026-02-20T13:20:12.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 --2- 10.20.193.28:0/4134207839 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdac8155850 0x7fdac8175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 --2- 10.20.193.28:0/4134207839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdac810bb40 0x7fdac81551e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 --2- 10.20.193.28:0/4134207839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810b230 0x7fdac810b600 unknown :-1 s=CLOSED pgs=559 gs=1 cs=0 l=1 c_cookie=17153461101424220275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 -- 10.20.193.28:0/4134207839 >> 10.20.193.28:0/4134207839 conn(0x7fdac80e8ce0 msgr2=0x7fdac81090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 -- 10.20.193.28:0/4134207839 shutdown_connections 2026-02-20T13:20:12.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 -- 10.20.193.28:0/4134207839 wait complete. 2026-02-20T13:20:12.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.652+0000 7fdaceee2640 1 Processor -- start 2026-02-20T13:20:12.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdaceee2640 1 -- start start 2026-02-20T13:20:12.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdaceee2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdac810b230 0x7fdac8160030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdaceee2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810bb40 0x7fdac8160570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdaceee2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdac8155850 0x7fdac8165940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdaceee2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdac8165f60 con 0x7fdac810bb40 2026-02-20T13:20:12.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdaceee2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81660d0 con 0x7fdac810b230 2026-02-20T13:20:12.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdaceee2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdac8166290 con 0x7fdac8155850 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdacdee0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdac810b230 0x7fdac8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdacdee0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdac810b230 0x7fdac8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52662/0 (socket says 10.20.193.28:52662) 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdacdee0640 1 -- 10.20.193.28:0/20672036 learned_addr learned my addr 10.20.193.28:0/20672036 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdacd6df640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810bb40 0x7fdac8160570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdace6e1640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdac8155850 0x7fdac8165940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdacdee0640 1 -- 10.20.193.28:0/20672036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdac8155850 msgr2=0x7fdac8165940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdacdee0640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdac8155850 0x7fdac8165940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.653+0000 7fdacdee0640 1 -- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810bb40 msgr2=0x7fdac8160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdacdee0640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810bb40 0x7fdac8160570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdacdee0640 1 -- 10.20.193.28:0/20672036 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac400a650 con 0x7fdac810b230 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdacd6df640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810bb40 0x7fdac8160570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:12.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdacdee0640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdac810b230 0x7fdac8160030 secure :-1 s=READY pgs=228 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab80023b0 tx=0x7fdab80028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdab6ffd640 1 -- 10.20.193.28:0/20672036 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab803d070 con 0x7fdac810b230 2026-02-20T13:20:12.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdaceee2640 1 -- 10.20.193.28:0/20672036 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab80094b0 con 0x7fdac810b230 2026-02-20T13:20:12.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdab6ffd640 1 -- 10.20.193.28:0/20672036 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdab802fcb0 con 0x7fdac810b230 2026-02-20T13:20:12.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdab6ffd640 1 -- 10.20.193.28:0/20672036 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab80418c0 con 0x7fdac810b230 2026-02-20T13:20:12.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.654+0000 7fdaceee2640 1 -- 10.20.193.28:0/20672036 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac81531c0 con 0x7fdac810b230 2026-02-20T13:20:12.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.657+0000 7fdab6ffd640 1 -- 10.20.193.28:0/20672036 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fdab80386b0 con 0x7fdac810b230 2026-02-20T13:20:12.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.659+0000 7fdab6ffd640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdaa40b5760 0x7fdaa40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.659+0000 7fdab6ffd640 1 -- 10.20.193.28:0/20672036 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdab810b180 con 0x7fdac810b230 2026-02-20T13:20:12.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.659+0000 7fdacd6df640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdaa40b5760 0x7fdaa40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.659+0000 7fdacd6df640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdaa40b5760 0x7fdaa40d5c10 secure :-1 s=READY pgs=326 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac81669d0 tx=0x7fdabc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.659+0000 7fdad2165e00 1 Processor -- start 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdad2165e00 1 -- start start 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba83ca730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842ff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdad2165e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dba82e0780 con 0x55dba83ca360 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdad2165e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dba82dc4b0 con 0x55dba83cac70 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdad2165e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dba82d6450 con 0x55dba840fb20 2026-02-20T13:20:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdacdee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba83ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdace6e1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdacdee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba83ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58418/0 (socket says 10.20.193.28:58418) 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdacdee0640 1 -- 10.20.193.28:0/244931751 learned_addr learned my addr 10.20.193.28:0/244931751 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.660+0000 7fdacd6df640 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fdace6e1640 1 -- 10.20.193.28:0/244931751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 msgr2=0x55dba840f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fdace6e1640 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fdace6e1640 1 -- 10.20.193.28:0/244931751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 msgr2=0x55dba83ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fdace6e1640 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba83ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fdace6e1640 1 -- 10.20.193.28:0/244931751 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba8281d10 con 0x55dba840fb20 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fdacdee0640 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba83ca730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fdace6e1640 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842ff00 secure :-1 s=READY pgs=191 gs=3 cs=0 l=1 c_cookie=14381299034373989142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac4006c10 tx=0x7fdac400ac50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c794a346c087a316 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fda964e6640 1 -- 10.20.193.28:0/244931751 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdac4003d30 con 0x55dba840fb20 2026-02-20T13:20:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fda964e6640 1 -- 10.20.193.28:0/244931751 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdac4003e90 con 0x55dba840fb20 2026-02-20T13:20:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.661+0000 7fda964e6640 1 -- 10.20.193.28:0/244931751 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdac4011960 con 0x55dba840fb20 2026-02-20T13:20:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 -- 10.20.193.28:0/244931751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 msgr2=0x55dba842ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842ff00 secure :-1 s=READY pgs=191 gs=3 cs=0 l=1 c_cookie=14381299034373989142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac4006c10 tx=0x7fdac400ac50 comp rx=0 tx=0).stop 2026-02-20T13:20:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 -- 10.20.193.28:0/244931751 shutdown_connections 2026-02-20T13:20:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842ff00 unknown :-1 s=CLOSED pgs=191 gs=3 cs=0 l=1 c_cookie=14381299034373989142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840f5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 --2- 10.20.193.28:0/244931751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba83ca730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 -- 10.20.193.28:0/244931751 >> 10.20.193.28:0/244931751 conn(0x55dba83a8860 msgr2=0x55dba83c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 -- 10.20.193.28:0/244931751 shutdown_connections 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.662+0000 7fdad2165e00 1 -- 10.20.193.28:0/244931751 wait complete. 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.663+0000 7fdad2165e00 1 -- start start 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.663+0000 7fdad2165e00 1 Processor -- start 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83ca360 0x55dba8427750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba8427c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842cc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdad2165e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dba842d1c0 con 0x55dba83cac70 2026-02-20T13:20:12.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdad2165e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dba842d330 con 0x55dba83ca360 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdad2165e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dba842d4f0 con 0x55dba840fb20 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdace6e1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdace6e1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43336/0 (socket says 10.20.193.28:43336) 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdace6e1640 1 -- 10.20.193.28:0/110969386 learned_addr learned my addr 10.20.193.28:0/110969386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdacdee0640 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83ca360 0x55dba8427750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdacd6df640 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba8427c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdacd6df640 1 -- 10.20.193.28:0/110969386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 msgr2=0x55dba842cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdacd6df640 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdacd6df640 1 -- 10.20.193.28:0/110969386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83ca360 msgr2=0x55dba8427750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdacd6df640 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83ca360 0x55dba8427750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.664+0000 7fdacd6df640 1 -- 10.20.193.28:0/110969386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac4005360 con 0x55dba83cac70 2026-02-20T13:20:12.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fdacd6df640 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba8427c90 secure :-1 s=READY pgs=560 gs=1 cs=0 l=1 c_cookie=11094787576856388333 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac810ea30 tx=0x7fdabc013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f89a84b8f122ed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fda837fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fda837fe640 1 -- 10.20.193.28:0/110969386 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdabc021040 con 0x55dba83cac70 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fda837fe640 1 -- 10.20.193.28:0/110969386 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdabc004d30 con 0x55dba83cac70 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac81531c0 con 0x55dba83cac70 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fda837fe640 1 -- 10.20.193.28:0/110969386 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdabc01a460 con 0x55dba83cac70 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fdad2165e00 10 client.16464 _ll_register_callbacks cb 0x55dba8257a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dba7f6c6f0 con 0x55dba83cac70 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fda837fe640 1 -- 10.20.193.28:0/110969386 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdabc01a5f0 con 0x55dba83cac70 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fda837fe640 1 -- 10.20.193.28:0/110969386 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdabc01a7f0 con 0x55dba83cac70 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fdad2165e00 10 client.16464 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.665+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dba825a3c0 con 0x55dba83cac70 2026-02-20T13:20:12.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.666+0000 7fda837fe640 1 -- 10.20.193.28:0/110969386 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdabc005000 con 0x55dba83cac70 2026-02-20T13:20:12.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.666+0000 7fdad2165e00 10 client.16464 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:12.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.666+0000 7fdad2165e00 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:12.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.666+0000 7fdad2165e00 20 client.16464 populate_metadata read hostname 'trial028' 2026-02-20T13:20:12.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.666+0000 7fdad2165e00 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dba842fcd0 0x55dba840d8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.666+0000 7fdad2165e00 4 client.16464 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:12.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.666+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dba8278f80 con 0x55dba842fcd0 2026-02-20T13:20:12.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.666+0000 7fdacdee0640 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dba842fcd0 0x55dba840d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.667+0000 7fdacdee0640 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dba842fcd0 0x55dba840d8a0 crc :-1 s=READY pgs=106 gs=4 cs=0 l=0 c_cookie=16979398035638695230 s_cookie=3424089882184714200 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eba2f08d7e35b53e server_cookie=2f84cf9b32a107d8 in_seq=0 out_seq=0 2026-02-20T13:20:12.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.667+0000 7fda837fe640 10 client.16464 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:12.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.667+0000 7fda837fe640 1 -- 10.20.193.28:0/110969386 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dba8278f80 con 0x55dba842fcd0 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.667+0000 7fda837fe640 10 client.16464 handle_command_reply: tid=0 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.667+0000 7fdad2165e00 1 client.16464 shutdown 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.667+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 msgr2=0x55dba8427c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.667+0000 7fdad2165e00 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba8427c90 secure :-1 s=READY pgs=560 gs=1 cs=0 l=1 c_cookie=11094787576856388333 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac810ea30 tx=0x7fdabc013040 comp rx=0 tx=0).stop 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 shutdown_connections 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dba842fcd0 0x55dba840d8a0 crc :-1 s=READY pgs=106 gs=4 cs=0 l=0 c_cookie=16979398035638695230 s_cookie=3424089882184714200 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba8427c90 unknown :-1 s=CLOSED pgs=560 gs=1 cs=0 l=1 c_cookie=11094787576856388333 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba842cc80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 1 --2- 10.20.193.28:0/110969386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83ca360 0x55dba8427750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fda837fe640 0 client.16464 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 >> 10.20.193.28:0/110969386 conn(0x55dba83a8860 msgr2=0x55dba83c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 shutdown_connections 2026-02-20T13:20:12.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 1 -- 10.20.193.28:0/110969386 wait complete. 2026-02-20T13:20:12.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.668+0000 7fdad2165e00 20 client.16464 trim_cache size 0 max 16384 2026-02-20T13:20:12.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdad2165e00 1 Processor -- start 2026-02-20T13:20:12.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdad2165e00 1 -- start start 2026-02-20T13:20:12.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba8425080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840e8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba840edf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdad2165e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dba82d4080 con 0x55dba83ca360 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdad2165e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dba7f94700 con 0x55dba83cac70 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdad2165e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dba841c0f0 con 0x55dba840fb20 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdacdee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba8425080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdacdee0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba8425080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58432/0 (socket says 10.20.193.28:58432) 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdacdee0640 1 -- 10.20.193.28:0/1802696184 learned_addr learned my addr 10.20.193.28:0/1802696184 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdacd6df640 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.675+0000 7fdace6e1640 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba840edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdacdee0640 1 -- 10.20.193.28:0/1802696184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 msgr2=0x55dba840edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdacdee0640 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba840edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdacdee0640 1 -- 10.20.193.28:0/1802696184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 msgr2=0x55dba840e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdacdee0640 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdacdee0640 1 -- 10.20.193.28:0/1802696184 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba8419aa0 con 0x55dba83ca360 2026-02-20T13:20:12.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdacd6df640 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840e8b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:12.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdacdee0640 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba8425080 secure :-1 s=READY pgs=561 gs=1 cs=0 l=1 c_cookie=13516985146720144731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab80cdab0 tx=0x7fdab8038e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb95fa5ff87c4d5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fda95ce5640 1 -- 10.20.193.28:0/1802696184 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab8005b40 con 0x55dba83ca360 2026-02-20T13:20:12.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fda95ce5640 1 -- 10.20.193.28:0/1802696184 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdab80d1ee0 con 0x55dba83ca360 2026-02-20T13:20:12.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fda95ce5640 1 -- 10.20.193.28:0/1802696184 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab8108dc0 con 0x55dba83ca360 2026-02-20T13:20:12.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdad2165e00 1 -- 10.20.193.28:0/1802696184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 msgr2=0x55dba8425080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdad2165e00 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba8425080 secure :-1 s=READY pgs=561 gs=1 cs=0 l=1 c_cookie=13516985146720144731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab80cdab0 tx=0x7fdab8038e80 comp rx=0 tx=0).stop 2026-02-20T13:20:12.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdad2165e00 1 -- 10.20.193.28:0/1802696184 shutdown_connections 2026-02-20T13:20:12.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdad2165e00 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba840fb20 0x55dba840edf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdad2165e00 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba83cac70 0x55dba840e8b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.676+0000 7fdad2165e00 1 --2- 10.20.193.28:0/1802696184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83ca360 0x55dba8425080 unknown :-1 s=CLOSED pgs=561 gs=1 cs=0 l=1 c_cookie=13516985146720144731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 -- 10.20.193.28:0/1802696184 >> 10.20.193.28:0/1802696184 conn(0x55dba83a8860 msgr2=0x55dba8423960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 -- 10.20.193.28:0/1802696184 shutdown_connections 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 -- 10.20.193.28:0/1802696184 wait complete. 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 -- start start 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 Processor -- start 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba83ca360 0x55dba83aa430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba83aa970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba840fb20 0x55dba8475950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dba83ab160 con 0x55dba83cac70 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dba83ab2d0 con 0x55dba840fb20 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.677+0000 7fdad2165e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dba8475ee0 con 0x55dba83ca360 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacd6df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba83aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba83ca360 0x55dba83aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdace6e1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba840fb20 0x55dba8475950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba83ca360 0x55dba83aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43348/0 (socket says 10.20.193.28:43348) 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 -- 10.20.193.28:0/3477674457 learned_addr learned my addr 10.20.193.28:0/3477674457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdace6e1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba840fb20 0x55dba8475950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52712/0 (socket says 10.20.193.28:52712) 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 -- 10.20.193.28:0/3477674457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba840fb20 msgr2=0x55dba8475950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba840fb20 0x55dba8475950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 -- 10.20.193.28:0/3477674457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 msgr2=0x55dba83aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba83aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 -- 10.20.193.28:0/3477674457 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab80094b0 con 0x55dba83ca360 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdacdee0640 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba83ca360 0x55dba83aa430 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=10911005080787513341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab80d1700 tx=0x7fdab802f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=976bad4fded26ffd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fda837fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fda837fe640 1 -- 10.20.193.28:0/3477674457 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab80d12a0 con 0x55dba83ca360 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fda837fe640 1 -- 10.20.193.28:0/3477674457 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdab8038ba0 con 0x55dba83ca360 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fda837fe640 1 -- 10.20.193.28:0/3477674457 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab80dc3b0 con 0x55dba83ca360 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.678+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba825a3c0 con 0x55dba83ca360 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fda837fe640 1 -- 10.20.193.28:0/3477674457 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdab8108d30 con 0x55dba83ca360 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fda837fe640 10 client.26392 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 10 client.26392 _ll_register_callbacks cb 0x55dba8257a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdac4003e90 con 0x55dba83ca360 2026-02-20T13:20:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fda837fe640 1 -- 10.20.193.28:0/3477674457 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdab80d7200 con 0x55dba83ca360 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 10 client.26392 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dba826c0e0 con 0x55dba83ca360 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fda837fe640 1 -- 10.20.193.28:0/3477674457 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdab80d2170 con 0x55dba83ca360 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 10 client.26392 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 10 client.26392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 20 client.26392 populate_metadata read hostname 'trial028' 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dba84bdad0 0x55dba84ddf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 4 client.26392 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.679+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dba7f69f40 con 0x55dba84bdad0 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdacd6df640 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dba84bdad0 0x55dba84ddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdacd6df640 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dba84bdad0 0x55dba84ddf50 crc :-1 s=READY pgs=107 gs=4 cs=0 l=0 c_cookie=2564958164381847911 s_cookie=10339304839573875726 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23988fdc5bb7d167 server_cookie=8f7c96f8bb472c0e in_seq=0 out_seq=0 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fda837fe640 10 client.26392 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fda837fe640 1 -- 10.20.193.28:0/3477674457 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dba7f69f40 con 0x55dba84bdad0 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fda837fe640 10 client.26392 handle_command_reply: tid=0 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 client.26392 shutdown 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba83ca360 msgr2=0x55dba83aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba83ca360 0x55dba83aa430 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=10911005080787513341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab80d1700 tx=0x7fdab802f120 comp rx=0 tx=0).stop 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 shutdown_connections 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dba84bdad0 0x55dba84ddf50 crc :-1 s=READY pgs=107 gs=4 cs=0 l=0 c_cookie=2564958164381847911 s_cookie=10339304839573875726 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba83cac70 0x55dba83aa970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dba840fb20 0x55dba8475950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 --2- 10.20.193.28:0/3477674457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dba83ca360 0x55dba83aa430 unknown :-1 s=CLOSED pgs=192 gs=2 cs=0 l=1 c_cookie=10911005080787513341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fda837fe640 0 client.26392 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:12.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.680+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 >> 10.20.193.28:0/3477674457 conn(0x55dba83a8860 msgr2=0x55dba8424150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 shutdown_connections 2026-02-20T13:20:12.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdad2165e00 1 -- 10.20.193.28:0/3477674457 wait complete. 2026-02-20T13:20:12.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdad2165e00 20 client.26392 trim_cache size 0 max 16384 2026-02-20T13:20:12.690 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 -- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdaa40b5760 msgr2=0x7fdaa40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdaa40b5760 0x7fdaa40d5c10 secure :-1 s=READY pgs=326 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac81669d0 tx=0x7fdabc005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 -- 10.20.193.28:0/20672036 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdac810b230 msgr2=0x7fdac8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdac810b230 0x7fdac8160030 secure :-1 s=READY pgs=228 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab80023b0 tx=0x7fdab80028d0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 -- 10.20.193.28:0/20672036 shutdown_connections 2026-02-20T13:20:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdaa40b5760 0x7fdaa40d5c10 unknown :-1 s=CLOSED pgs=326 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdac810bb40 0x7fdac8160570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdac8155850 0x7fdac8165940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 --2- 10.20.193.28:0/20672036 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdac810b230 0x7fdac8160030 unknown :-1 s=CLOSED pgs=228 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 -- 10.20.193.28:0/20672036 >> 10.20.193.28:0/20672036 conn(0x7fdac80e8ce0 msgr2=0x7fdac81090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 -- 10.20.193.28:0/20672036 shutdown_connections 2026-02-20T13:20:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:12.681+0000 7fdaceee2640 1 -- 10.20.193.28:0/20672036 wait complete. 2026-02-20T13:20:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:12 trial127 ceph-mon[43817]: pgmap v267: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:20:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:12 trial034 ceph-mon[43332]: pgmap v267: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:20:13.783 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:20:13.783 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:20:13.970 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:14.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.141+0000 7fe763fff640 1 -- 10.20.193.28:0/4128722710 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7640386f0 con 0x7fe77410f230 2026-02-20T13:20:14.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.141+0000 7fe77b8bc640 1 -- 10.20.193.28:0/4128722710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77410f230 msgr2=0x7fe77410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.141+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/4128722710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77410f230 0x7fe77410f600 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=8249893500599384955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764009950 tx=0x7fe76402f190 comp rx=0 tx=0).stop 2026-02-20T13:20:14.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.142+0000 7fe77b8bc640 1 -- 10.20.193.28:0/4128722710 shutdown_connections 2026-02-20T13:20:14.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.142+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/4128722710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe774115420 0x7fe774175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.142+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/4128722710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe77410fc20 0x7fe774114c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.142+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/4128722710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77410f230 0x7fe77410f600 unknown :-1 s=CLOSED pgs=193 gs=2 cs=0 l=1 c_cookie=8249893500599384955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.142+0000 7fe77b8bc640 1 -- 10.20.193.28:0/4128722710 >> 10.20.193.28:0/4128722710 conn(0x7fe77405f830 msgr2=0x7fe77410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.142+0000 7fe77b8bc640 1 -- 10.20.193.28:0/4128722710 shutdown_connections 2026-02-20T13:20:14.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.142+0000 7fe77b8bc640 1 -- 10.20.193.28:0/4128722710 wait complete. 2026-02-20T13:20:14.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.142+0000 7fe77b8bc640 1 Processor -- start 2026-02-20T13:20:14.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe77b8bc640 1 -- start start 2026-02-20T13:20:14.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe77b8bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77410f230 0x7fe77411dba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe77b8bc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77410fc20 0x7fe77411e0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe77b8bc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe774115420 0x7fe7741234b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe77b8bc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe774123ad0 con 0x7fe77410f230 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe77b8bc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe774123c40 con 0x7fe774115420 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe77b8bc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe774123e00 con 0x7fe77410fc20 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779631640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77410f230 0x7fe77411dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779e32640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe774115420 0x7fe7741234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779631640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77410f230 0x7fe77411dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58456/0 (socket says 10.20.193.28:58456) 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779631640 1 -- 10.20.193.28:0/141122761 learned_addr learned my addr 10.20.193.28:0/141122761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe778e30640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77410fc20 0x7fe77411e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779631640 1 -- 10.20.193.28:0/141122761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77410fc20 msgr2=0x7fe77411e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779631640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77410fc20 0x7fe77411e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779631640 1 -- 10.20.193.28:0/141122761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe774115420 msgr2=0x7fe7741234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779631640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe774115420 0x7fe7741234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.143+0000 7fe779631640 1 -- 10.20.193.28:0/141122761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe764009570 con 0x7fe77410f230 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.144+0000 7fe779631640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77410f230 0x7fe77411dba0 secure :-1 s=READY pgs=562 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764038820 tx=0x7fe764004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.144+0000 7fe7627fc640 1 -- 10.20.193.28:0/141122761 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe76403d070 con 0x7fe77410f230 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.144+0000 7fe7627fc640 1 -- 10.20.193.28:0/141122761 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe764002ad0 con 0x7fe77410f230 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.144+0000 7fe7627fc640 1 -- 10.20.193.28:0/141122761 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe764041940 con 0x7fe77410f230 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.144+0000 7fe77b8bc640 1 -- 10.20.193.28:0/141122761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe774124080 con 0x7fe77410f230 2026-02-20T13:20:14.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.144+0000 7fe77b8bc640 1 -- 10.20.193.28:0/141122761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe774164640 con 0x7fe77410f230 2026-02-20T13:20:14.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.148+0000 7fe7627fc640 1 -- 10.20.193.28:0/141122761 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe764041ad0 con 0x7fe77410f230 2026-02-20T13:20:14.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe7627fc640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7500b5760 0x7fe7500d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe7627fc640 1 -- 10.20.193.28:0/141122761 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe76410b180 con 0x7fe77410f230 2026-02-20T13:20:14.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe77d8b6e00 1 Processor -- start 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe778e30640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7500b5760 0x7fe7500d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe77d8b6e00 1 -- start start 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923597e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d29239e480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d2923beda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d29226fa20 con 0x55d292359410 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d29226b750 con 0x55d29239e9c0 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d2922656f0 con 0x55d292359d20 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe779631640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe779631640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58468/0 (socket says 10.20.193.28:58468) 2026-02-20T13:20:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe779631640 1 -- 10.20.193.28:0/3385760569 learned_addr learned my addr 10.20.193.28:0/3385760569 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe779e32640 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d2923beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.150+0000 7fe778e30640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7500b5760 0x7fe7500d5c10 secure :-1 s=READY pgs=327 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe768005970 tx=0x7fe768005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe778e30640 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d29239e480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe779631640 1 -- 10.20.193.28:0/3385760569 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 msgr2=0x55d29239e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe779631640 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d29239e480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe779631640 1 -- 10.20.193.28:0/3385760569 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 msgr2=0x55d2923beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe779631640 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d2923beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe779631640 1 -- 10.20.193.28:0/3385760569 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d292211120 con 0x55d292359410 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe779631640 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923597e0 secure :-1 s=READY pgs=563 gs=1 cs=0 l=1 c_cookie=3124129387584304901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764108c50 tx=0x7fe764038f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5b23202b523705 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe741ce5640 1 -- 10.20.193.28:0/3385760569 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7640d7200 con 0x55d292359410 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe741ce5640 1 -- 10.20.193.28:0/3385760569 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7640d97e0 con 0x55d292359410 2026-02-20T13:20:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe741ce5640 1 -- 10.20.193.28:0/3385760569 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7640d23f0 con 0x55d292359410 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/3385760569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 msgr2=0x55d2923597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923597e0 secure :-1 s=READY pgs=563 gs=1 cs=0 l=1 c_cookie=3124129387584304901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764108c50 tx=0x7fe764038f40 comp rx=0 tx=0).stop 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/3385760569 shutdown_connections 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d2923beda0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d29239e480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/3385760569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923597e0 unknown :-1 s=CLOSED pgs=563 gs=1 cs=0 l=1 c_cookie=3124129387584304901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.151+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/3385760569 >> 10.20.193.28:0/3385760569 conn(0x55d292337910 msgr2=0x55d292357cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.152+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/3385760569 shutdown_connections 2026-02-20T13:20:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.152+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/3385760569 wait complete. 2026-02-20T13:20:14.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.153+0000 7fe77d8b6e00 1 -- start start 2026-02-20T13:20:14.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.153+0000 7fe77d8b6e00 1 Processor -- start 2026-02-20T13:20:14.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.153+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359410 0x55d292371a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.153+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359d20 0x55d292371f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.153+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d292376f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.153+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d292377480 con 0x55d292359d20 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.153+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d2923775f0 con 0x55d29239e9c0 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.153+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d2923777b0 con 0x55d292359410 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359410 0x55d292371a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359410 0x55d292371a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43390/0 (socket says 10.20.193.28:43390) 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 -- 10.20.193.28:0/2272962850 learned_addr learned my addr 10.20.193.28:0/2272962850 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe778e30640 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359d20 0x55d292371f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779e32640 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d292376f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 -- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 msgr2=0x55d292376f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d292376f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 -- 10.20.193.28:0/2272962850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359d20 msgr2=0x55d292371f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359d20 0x55d292371f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 -- 10.20.193.28:0/2272962850 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2921e9810 con 0x55d292359410 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779e32640 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d292376f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe779631640 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359410 0x55d292371a10 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=10996897224028612468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764005b30 tx=0x7fe764041410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=989cd3c2ddb46774 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe72effd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe72effd640 1 -- 10.20.193.28:0/2272962850 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7640d7040 con 0x55d292359410 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe72effd640 1 -- 10.20.193.28:0/2272962850 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7640d7200 con 0x55d292359410 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe72effd640 1 -- 10.20.193.28:0/2272962850 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7640cf4c0 con 0x55d292359410 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe774164640 con 0x55d292359410 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe72effd640 1 -- 10.20.193.28:0/2272962850 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe7640cf620 con 0x55d292359410 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe77d8b6e00 10 client.26404 _ll_register_callbacks cb 0x55d29221cb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:14.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.154+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d291efb9d0 con 0x55d292359410 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe72effd640 1 -- 10.20.193.28:0/2272962850 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe7640dc620 con 0x55d292359410 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe77d8b6e00 10 client.26404 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d2921fb4f0 con 0x55d292359410 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe72effd640 1 -- 10.20.193.28:0/2272962850 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe7640f2060 con 0x55d292359410 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe77d8b6e00 10 client.26404 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe77d8b6e00 10 client.26404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe77d8b6e00 20 client.26404 populate_metadata read hostname 'trial028' 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d29239bc70 0x55d29239c110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe77d8b6e00 4 client.26404 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d292272df0 con 0x55d29239bc70 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.155+0000 7fe778e30640 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d29239bc70 0x55d29239c110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.156+0000 7fe778e30640 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d29239bc70 0x55d29239c110 crc :-1 s=READY pgs=108 gs=4 cs=0 l=0 c_cookie=3287409488519584502 s_cookie=8114539544949125179 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d9f39832a755af6 server_cookie=709ca2b9348d703b in_seq=0 out_seq=0 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.156+0000 7fe72effd640 10 client.26404 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.156+0000 7fe72effd640 1 -- 10.20.193.28:0/2272962850 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d292272df0 con 0x55d29239bc70 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.156+0000 7fe72effd640 10 client.26404 handle_command_reply: tid=0 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.156+0000 7fe77d8b6e00 1 client.26404 shutdown 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359410 msgr2=0x55d292371a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359410 0x55d292371a10 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=10996897224028612468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764005b30 tx=0x7fe764041410 comp rx=0 tx=0).stop 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 shutdown_connections 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d29239bc70 0x55d29239c110 crc :-1 s=READY pgs=108 gs=4 cs=0 l=0 c_cookie=3287409488519584502 s_cookie=8114539544949125179 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359d20 0x55d292371f50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d292376f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/2272962850 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359410 0x55d292371a10 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=10996897224028612468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 >> 10.20.193.28:0/2272962850 conn(0x55d292337910 msgr2=0x55d2923584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe72effd640 0 client.26404 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:14.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 shutdown_connections 2026-02-20T13:20:14.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/2272962850 wait complete. 2026-02-20T13:20:14.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.157+0000 7fe77d8b6e00 20 client.26404 trim_cache size 0 max 16384 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe77d8b6e00 1 Processor -- start 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe77d8b6e00 1 -- start start 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923764b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d29239da00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d29239df40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d292263320 con 0x55d292359410 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d291f23790 con 0x55d29239e9c0 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d29226b750 con 0x55d292359d20 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe779631640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe778e30640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d29239da00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe779e32640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d29239df40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe779631640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923764b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58482/0 (socket says 10.20.193.28:58482) 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.166+0000 7fe779631640 1 -- 10.20.193.28:0/215565143 learned_addr learned my addr 10.20.193.28:0/215565143 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe779631640 1 -- 10.20.193.28:0/215565143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 msgr2=0x55d29239da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe779631640 1 --2- 10.20.193.28:0/215565143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d29239da00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe779631640 1 -- 10.20.193.28:0/215565143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 msgr2=0x55d29239df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe779631640 1 --2- 10.20.193.28:0/215565143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d29239df40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe779631640 1 -- 10.20.193.28:0/215565143 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2921f5f70 con 0x55d292359410 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe779631640 1 --2- 10.20.193.28:0/215565143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923764b0 secure :-1 s=READY pgs=564 gs=1 cs=0 l=1 c_cookie=8518290647724797122 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764009480 tx=0x7fe76403a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76370c36572b2cc2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe7414e4640 1 -- 10.20.193.28:0/215565143 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7640d7040 con 0x55d292359410 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe7414e4640 1 -- 10.20.193.28:0/215565143 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d291efb9d0 con 0x55d292359410 2026-02-20T13:20:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe7414e4640 1 -- 10.20.193.28:0/215565143 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe764038b70 con 0x55d292359410 2026-02-20T13:20:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/215565143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 msgr2=0x55d2923764b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/215565143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923764b0 secure :-1 s=READY pgs=564 gs=1 cs=0 l=1 c_cookie=8518290647724797122 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764009480 tx=0x7fe76403a050 comp rx=0 tx=0).stop 2026-02-20T13:20:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/215565143 shutdown_connections 2026-02-20T13:20:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/215565143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d29239df40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/215565143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d29239da00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/215565143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d2923764b0 unknown :-1 s=CLOSED pgs=564 gs=1 cs=0 l=1 c_cookie=8518290647724797122 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/215565143 >> 10.20.193.28:0/215565143 conn(0x55d292337910 msgr2=0x55d292375da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/215565143 shutdown_connections 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.167+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/215565143 wait complete. 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.168+0000 7fe77d8b6e00 1 -- start start 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.168+0000 7fe77d8b6e00 1 Processor -- start 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.168+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d29237d970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.168+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d292379160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.168+0000 7fe77d8b6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d2923796a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.168+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d292263320 con 0x55d292359410 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.168+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d291f23790 con 0x55d29239e9c0 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.168+0000 7fe77d8b6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d292379e50 con 0x55d292359d20 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779e32640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d2923796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d29237d970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d29237d970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58490/0 (socket says 10.20.193.28:58490) 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 -- 10.20.193.28:0/1615034198 learned_addr learned my addr 10.20.193.28:0/1615034198 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe778e30640 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d292379160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 -- 10.20.193.28:0/1615034198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 msgr2=0x55d292379160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d292379160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 -- 10.20.193.28:0/1615034198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 msgr2=0x55d2923796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d2923796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 -- 10.20.193.28:0/1615034198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2921e9b40 con 0x55d292359410 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe778e30640 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d292379160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe779631640 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d29237d970 secure :-1 s=READY pgs=565 gs=1 cs=0 l=1 c_cookie=11142597976449577511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764041aa0 tx=0x7fe764041410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa275d2d5437227 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe72effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:14.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe72effd640 1 -- 10.20.193.28:0/1615034198 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7640d7040 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe72effd640 1 -- 10.20.193.28:0/1615034198 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7640d2170 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe72effd640 1 -- 10.20.193.28:0/1615034198 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe764048630 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe774164640 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.169+0000 7fe77d8b6e00 10 client.16488 _ll_register_callbacks cb 0x55d29221cb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7640d97e0 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe72effd640 1 -- 10.20.193.28:0/1615034198 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe7640d7200 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe72effd640 1 -- 10.20.193.28:0/1615034198 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe764048310 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 10 client.16488 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d2921fb750 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe72effd640 1 -- 10.20.193.28:0/1615034198 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe7640f2020 con 0x55d292359410 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 10 client.16488 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 20 client.16488 populate_metadata read hostname 'trial028' 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d29244b440 0x55d29246b820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 4 client.16488 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d291ef9220 con 0x55d29244b440 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.170+0000 7fe778e30640 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d29244b440 0x55d29246b820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.171+0000 7fe778e30640 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d29244b440 0x55d29246b820 crc :-1 s=READY pgs=109 gs=4 cs=0 l=0 c_cookie=14876688227093179870 s_cookie=7726907005044558192 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce749d1f5a1fedde server_cookie=6b3b7cfb70288970 in_seq=0 out_seq=0 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.171+0000 7fe72effd640 10 client.16488 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe72effd640 1 -- 10.20.193.28:0/1615034198 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d291ef9220 con 0x55d29244b440 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe72effd640 10 client.16488 handle_command_reply: tid=0 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 client.16488 shutdown 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 msgr2=0x55d29237d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d29237d970 secure :-1 s=READY pgs=565 gs=1 cs=0 l=1 c_cookie=11142597976449577511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764041aa0 tx=0x7fe764041410 comp rx=0 tx=0).stop 2026-02-20T13:20:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 shutdown_connections 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d29244b440 0x55d29246b820 crc :-1 s=READY pgs=109 gs=4 cs=0 l=0 c_cookie=14876688227093179870 s_cookie=7726907005044558192 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29239e9c0 0x55d2923796a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d292359d20 0x55d292379160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 --2- 10.20.193.28:0/1615034198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d292359410 0x55d29237d970 unknown :-1 s=CLOSED pgs=565 gs=1 cs=0 l=1 c_cookie=11142597976449577511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 >> 10.20.193.28:0/1615034198 conn(0x55d292337910 msgr2=0x55d29236e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe72effd640 0 client.16488 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 shutdown_connections 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 1 -- 10.20.193.28:0/1615034198 wait complete. 2026-02-20T13:20:14.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77d8b6e00 20 client.16488 trim_cache size 0 max 16384 2026-02-20T13:20:14.181 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:20:14.181 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:20:14.181 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "7c48936c-1512-47fd-8543-212e62d9a87e", 2026-02-20T13:20:14.181 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:20:14.181 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:20:14.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77b8bc640 1 -- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7500b5760 msgr2=0x7fe7500d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7500b5760 0x7fe7500d5c10 secure :-1 s=READY pgs=327 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe768005970 tx=0x7fe768005900 comp rx=0 tx=0).stop 2026-02-20T13:20:14.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77b8bc640 1 -- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77410f230 msgr2=0x7fe77411dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.172+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77410f230 0x7fe77411dba0 secure :-1 s=READY pgs=562 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764038820 tx=0x7fe764004300 comp rx=0 tx=0).stop 2026-02-20T13:20:14.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.173+0000 7fe77b8bc640 1 -- 10.20.193.28:0/141122761 shutdown_connections 2026-02-20T13:20:14.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.173+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7500b5760 0x7fe7500d5c10 unknown :-1 s=CLOSED pgs=327 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.173+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe774115420 0x7fe7741234b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.173+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77410fc20 0x7fe77411e0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.173+0000 7fe77b8bc640 1 --2- 10.20.193.28:0/141122761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77410f230 0x7fe77411dba0 unknown :-1 s=CLOSED pgs=562 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.173+0000 7fe77b8bc640 1 -- 10.20.193.28:0/141122761 >> 10.20.193.28:0/141122761 conn(0x7fe77405f830 msgr2=0x7fe77410cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.173+0000 7fe77b8bc640 1 -- 10.20.193.28:0/141122761 shutdown_connections 2026-02-20T13:20:14.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.173+0000 7fe77b8bc640 1 -- 10.20.193.28:0/141122761 wait complete. 2026-02-20T13:20:14.274 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:20:14.459 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:14.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 -- 10.20.193.28:0/2092595557 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 msgr2=0x7f2a1010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/2092595557 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 0x7f2a1010f9c0 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=3345598257435155759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29fc009950 tx=0x7f29fc02f190 comp rx=0 tx=0).stop 2026-02-20T13:20:14.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 -- 10.20.193.28:0/2092595557 shutdown_connections 2026-02-20T13:20:14.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/2092595557 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a101157e0 0x7f2a101761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/2092595557 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a1010ffe0 0x7f2a10115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/2092595557 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 0x7f2a1010f9c0 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=3345598257435155759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 -- 10.20.193.28:0/2092595557 >> 10.20.193.28:0/2092595557 conn(0x7f2a100ecea0 msgr2=0x7f2a1010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 -- 10.20.193.28:0/2092595557 shutdown_connections 2026-02-20T13:20:14.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.634+0000 7f2a15b7c640 1 -- 10.20.193.28:0/2092595557 wait complete. 2026-02-20T13:20:14.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a15b7c640 1 Processor -- start 2026-02-20T13:20:14.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a15b7c640 1 -- start start 2026-02-20T13:20:14.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a15b7c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 0x7f2a1011d4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a15b7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a1010ffe0 0x7f2a1011da20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a15b7c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a101157e0 0x7f2a10122df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a15b7c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2a10123410 con 0x7f2a1010ffe0 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a15b7c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2a10123580 con 0x7f2a1010f5f0 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a15b7c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2a10123740 con 0x7f2a101157e0 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a0ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a101157e0 0x7f2a10122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a0ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a101157e0 0x7f2a10122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43416/0 (socket says 10.20.193.28:43416) 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0ffff640 1 -- 10.20.193.28:0/1201880832 learned_addr learned my addr 10.20.193.28:0/1201880832 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.635+0000 7f2a0f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 0x7f2a1011d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0effd640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a1010ffe0 0x7f2a1011da20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0ffff640 1 -- 10.20.193.28:0/1201880832 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 msgr2=0x7f2a1011d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 0x7f2a1011d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0ffff640 1 -- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a1010ffe0 msgr2=0x7f2a1011da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a1010ffe0 0x7f2a1011da20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0ffff640 1 -- 10.20.193.28:0/1201880832 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29fc009570 con 0x7f2a101157e0 2026-02-20T13:20:14.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 0x7f2a1011d4e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:14.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a101157e0 0x7f2a10122df0 secure :-1 s=READY pgs=195 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a0400f8d0 tx=0x7f2a0400fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0cff9640 1 -- 10.20.193.28:0/1201880832 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a0400dce0 con 0x7f2a101157e0 2026-02-20T13:20:14.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0cff9640 1 -- 10.20.193.28:0/1201880832 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a0400de40 con 0x7f2a101157e0 2026-02-20T13:20:14.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a15b7c640 1 -- 10.20.193.28:0/1201880832 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a10123a20 con 0x7f2a101157e0 2026-02-20T13:20:14.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a0cff9640 1 -- 10.20.193.28:0/1201880832 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a040116b0 con 0x7f2a101157e0 2026-02-20T13:20:14.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.636+0000 7f2a15b7c640 1 -- 10.20.193.28:0/1201880832 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a10164120 con 0x7f2a101157e0 2026-02-20T13:20:14.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.639+0000 7f2a0cff9640 1 -- 10.20.193.28:0/1201880832 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2a04020060 con 0x7f2a101157e0 2026-02-20T13:20:14.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.641+0000 7f2a0cff9640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29e40b5760 0x7f29e40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.641+0000 7f2a0cff9640 1 -- 10.20.193.28:0/1201880832 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2a04015070 con 0x7f2a101157e0 2026-02-20T13:20:14.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.641+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29e40b5760 0x7f29e40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a17b76e00 1 Processor -- start 2026-02-20T13:20:14.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29e40b5760 0x7f29e40d5c10 secure :-1 s=READY pgs=328 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29fc038820 tx=0x7f29fc03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a17b76e00 1 -- start start 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debcc550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0dec11400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0dec31d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0deae27d0 con 0x55c0debcca90 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c0deade500 con 0x55c0debcc180 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c0dead84a0 con 0x55c0dec11940 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debcc550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0dec31d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0dec31d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43428/0 (socket says 10.20.193.28:43428) 2026-02-20T13:20:14.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0ffff640 1 -- 10.20.193.28:0/2389797410 learned_addr learned my addr 10.20.193.28:0/2389797410 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0effd640 1 --2- 10.20.193.28:0/2389797410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0dec11400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0ffff640 1 -- 10.20.193.28:0/2389797410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 msgr2=0x55c0debcc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/2389797410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debcc550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0ffff640 1 -- 10.20.193.28:0/2389797410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 msgr2=0x55c0dec11400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/2389797410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0dec11400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.642+0000 7f2a0ffff640 1 -- 10.20.193.28:0/2389797410 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0dea83d80 con 0x55c0dec11940 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.643+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/2389797410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0dec31d20 secure :-1 s=READY pgs=196 gs=3 cs=0 l=1 c_cookie=13672492238767792631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a04006a50 tx=0x7f2a040ae050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdbe73404e0a21f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.643+0000 7f29d3fff640 1 -- 10.20.193.28:0/2389797410 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a040b3bf0 con 0x55c0dec11940 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.643+0000 7f29d3fff640 1 -- 10.20.193.28:0/2389797410 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a040b61d0 con 0x55c0dec11940 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.643+0000 7f29d3fff640 1 -- 10.20.193.28:0/2389797410 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a040ada70 con 0x55c0dec11940 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.643+0000 7f2a17b76e00 1 -- 10.20.193.28:0/2389797410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 msgr2=0x55c0dec31d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.643+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/2389797410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0dec31d20 secure :-1 s=READY pgs=196 gs=3 cs=0 l=1 c_cookie=13672492238767792631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a04006a50 tx=0x7f2a040ae050 comp rx=0 tx=0).stop 2026-02-20T13:20:14.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.643+0000 7f2a17b76e00 1 -- 10.20.193.28:0/2389797410 shutdown_connections 2026-02-20T13:20:14.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.643+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/2389797410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0dec11400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.644+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/2389797410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0dec31d20 unknown :-1 s=CLOSED pgs=196 gs=3 cs=0 l=1 c_cookie=13672492238767792631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.644+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/2389797410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debcc550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.644+0000 7f2a17b76e00 1 -- 10.20.193.28:0/2389797410 >> 10.20.193.28:0/2389797410 conn(0x55c0debaa680 msgr2=0x55c0debcaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.644+0000 7f2a17b76e00 1 -- 10.20.193.28:0/2389797410 shutdown_connections 2026-02-20T13:20:14.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.644+0000 7f2a17b76e00 1 -- 10.20.193.28:0/2389797410 wait complete. 2026-02-20T13:20:14.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.645+0000 7f2a17b76e00 1 -- start start 2026-02-20T13:20:14.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.645+0000 7f2a17b76e00 1 Processor -- start 2026-02-20T13:20:14.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe4670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debe4bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0debe9ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0debea0e0 con 0x55c0debcca90 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c0debea250 con 0x55c0dec11940 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c0debea410 con 0x55c0debcc180 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe4670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe4670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43434/0 (socket says 10.20.193.28:43434) 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/1448839940 learned_addr learned my addr 10.20.193.28:0/1448839940 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0debe9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0effd640 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debe4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/1448839940 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 msgr2=0x55c0debe9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0debe9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/1448839940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 msgr2=0x55c0debe4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debe4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/1448839940 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0dea5c350 con 0x55c0debcc180 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0effd640 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debe4bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.646+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0debe9ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe4670 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=15385341653931156656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29fc002920 tx=0x7f29fc009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d583b6b81e9664b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f29d17fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f29d17fa640 1 -- 10.20.193.28:0/1448839940 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29fc044630 con 0x55c0debcc180 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f29d17fa640 1 -- 10.20.193.28:0/1448839940 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f29fc03e040 con 0x55c0debcc180 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a10164120 con 0x55c0debcc180 2026-02-20T13:20:14.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f2a17b76e00 10 client.26419 _ll_register_callbacks cb 0x55c0dea599a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f29d17fa640 1 -- 10.20.193.28:0/1448839940 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29fc050940 con 0x55c0debcc180 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c0de76e6f0 con 0x55c0debcc180 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f29d17fa640 1 -- 10.20.193.28:0/1448839940 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f29fc050ad0 con 0x55c0debcc180 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f29d17fa640 1 -- 10.20.193.28:0/1448839940 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29fc050c90 con 0x55c0debcc180 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f2a17b76e00 10 client.26419 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c0dea6e150 con 0x55c0debcc180 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.647+0000 7f29d17fa640 1 -- 10.20.193.28:0/1448839940 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29fc04f070 con 0x55c0debcc180 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f2a17b76e00 10 client.26419 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f2a17b76e00 10 client.26419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f2a17b76e00 20 client.26419 populate_metadata read hostname 'trial028' 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c0dec0ef50 0x55c0dec0f3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f2a17b76e00 4 client.26419 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0deae5d60 con 0x55c0dec0ef50 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f2a0effd640 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c0dec0ef50 0x55c0dec0f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f2a0effd640 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c0dec0ef50 0x55c0dec0f3f0 crc :-1 s=READY pgs=110 gs=4 cs=0 l=0 c_cookie=9948711472074558277 s_cookie=5188174144113848741 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a10ec5f91db8b45 server_cookie=480018e55cc5b1a5 in_seq=0 out_seq=0 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.648+0000 7f29d17fa640 10 client.26419 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f29d17fa640 1 -- 10.20.193.28:0/1448839940 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c0deae5d60 con 0x55c0dec0ef50 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f29d17fa640 10 client.26419 handle_command_reply: tid=0 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 client.26419 shutdown 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 msgr2=0x55c0debe4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe4670 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=15385341653931156656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29fc002920 tx=0x7f29fc009310 comp rx=0 tx=0).stop 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 shutdown_connections 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c0dec0ef50 0x55c0dec0f3f0 crc :-1 s=READY pgs=110 gs=4 cs=0 l=0 c_cookie=9948711472074558277 s_cookie=5188174144113848741 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debe4bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0debe9ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/1448839940 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe4670 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=15385341653931156656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f29d17fa640 0 client.26419 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:14.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 >> 10.20.193.28:0/1448839940 conn(0x55c0debaa680 msgr2=0x55c0debcb250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 shutdown_connections 2026-02-20T13:20:14.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 1 -- 10.20.193.28:0/1448839940 wait complete. 2026-02-20T13:20:14.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.649+0000 7f2a17b76e00 20 client.26419 trim_cache size 0 max 16384 2026-02-20T13:20:14.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.658+0000 7f2a17b76e00 1 Processor -- start 2026-02-20T13:20:14.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.658+0000 7f2a17b76e00 1 -- start start 2026-02-20T13:20:14.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe9110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0dec10ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0dec11220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0dead60d0 con 0x55c0debcca90 2026-02-20T13:20:14.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c0de796700 con 0x55c0dec11940 2026-02-20T13:20:14.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c0debe5190 con 0x55c0debcc180 2026-02-20T13:20:14.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe9110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe9110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43436/0 (socket says 10.20.193.28:43436) 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/691358952 learned_addr learned my addr 10.20.193.28:0/691358952 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0effd640 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0dec10ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0dec11220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/691358952 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 msgr2=0x55c0dec11220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0dec11220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/691358952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 msgr2=0x55c0dec10ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0dec10ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/691358952 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0dea68bd0 con 0x55c0debcc180 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.659+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe9110 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=8868238413746638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29fc005b30 tx=0x7f29fc05a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f819da86f51ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f29d37fe640 1 -- 10.20.193.28:0/691358952 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29fc038da0 con 0x55c0debcc180 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f29d37fe640 1 -- 10.20.193.28:0/691358952 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f29fc048030 con 0x55c0debcc180 2026-02-20T13:20:14.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f29d37fe640 1 -- 10.20.193.28:0/691358952 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29fc0373d0 con 0x55c0debcc180 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 -- 10.20.193.28:0/691358952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 msgr2=0x55c0debe9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe9110 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=8868238413746638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29fc005b30 tx=0x7f29fc05a000 comp rx=0 tx=0).stop 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 -- 10.20.193.28:0/691358952 shutdown_connections 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0dec10ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0dec11940 0x55c0dec11220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/691358952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0debcc180 0x55c0debe9110 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=8868238413746638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 -- 10.20.193.28:0/691358952 >> 10.20.193.28:0/691358952 conn(0x55c0debaa680 msgr2=0x55c0debe8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 -- 10.20.193.28:0/691358952 shutdown_connections 2026-02-20T13:20:14.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.660+0000 7f2a17b76e00 1 -- 10.20.193.28:0/691358952 wait complete. 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a17b76e00 1 -- start start 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a17b76e00 1 Processor -- start 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debeff10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debf0450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a17b76e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0debeeca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0debef1e0 con 0x55c0debcca90 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c0debef350 con 0x55c0debcc180 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a17b76e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c0debef510 con 0x55c0dec11940 2026-02-20T13:20:14.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a0f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debeff10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a0f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debeff10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52808/0 (socket says 10.20.193.28:52808) 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a0f7fe640 1 -- 10.20.193.28:0/262695860 learned_addr learned my addr 10.20.193.28:0/262695860 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a0effd640 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debf0450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.661+0000 7f2a0ffff640 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0debeeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a0effd640 1 -- 10.20.193.28:0/262695860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 msgr2=0x55c0debeeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a0effd640 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0debeeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a0effd640 1 -- 10.20.193.28:0/262695860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 msgr2=0x55c0debeff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a0effd640 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debeff10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a0effd640 1 -- 10.20.193.28:0/262695860 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0dea5c680 con 0x55c0debcca90 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debeff10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a0effd640 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debf0450 secure :-1 s=READY pgs=566 gs=2 cs=0 l=1 c_cookie=18417110927559603311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55c0dec0f320 tx=0x7f2a00003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff96b8cf8227b46f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:14.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f29d17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f29d17fa640 1 -- 10.20.193.28:0/262695860 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a00016040 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f29d17fa640 1 -- 10.20.193.28:0/262695860 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a00017040 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f29d17fa640 1 -- 10.20.193.28:0/262695860 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a0001d390 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0dea6e150 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a17b76e00 10 client.16506 _ll_register_callbacks cb 0x55c0dea599a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a040b61d0 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f29d17fa640 1 -- 10.20.193.28:0/262695860 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2a0001d520 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f29d17fa640 1 -- 10.20.193.28:0/262695860 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a0001d700 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a17b76e00 10 client.16506 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.662+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c0dea6e3b0 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f29d17fa640 1 -- 10.20.193.28:0/262695860 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a0001c040 con 0x55c0debcca90 2026-02-20T13:20:14.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f2a17b76e00 10 client.16506 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f2a17b76e00 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f2a17b76e00 20 client.16506 populate_metadata read hostname 'trial028' 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c0dec61d80 0x55c0dec62220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f2a17b76e00 4 client.16506 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c0de76bf40 con 0x55c0dec61d80 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c0dec61d80 0x55c0dec62220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f2a0f7fe640 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c0dec61d80 0x55c0dec62220 crc :-1 s=READY pgs=111 gs=4 cs=0 l=0 c_cookie=4700786284677986739 s_cookie=8960109193942845681 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=413c8c38574279b3 server_cookie=7c58b3d6d5acc8f1 in_seq=0 out_seq=0 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.663+0000 7f29d17fa640 10 client.16506 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f29d17fa640 1 -- 10.20.193.28:0/262695860 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55c0de76bf40 con 0x55c0dec61d80 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f29d17fa640 10 client.16506 handle_command_reply: tid=0 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 client.16506 shutdown 2026-02-20T13:20:14.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 msgr2=0x55c0debf0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debf0450 secure :-1 s=READY pgs=566 gs=2 cs=0 l=1 c_cookie=18417110927559603311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55c0dec0f320 tx=0x7f2a00003780 comp rx=0 tx=0).stop 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 shutdown_connections 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c0dec61d80 0x55c0dec62220 crc :-1 s=READY pgs=111 gs=4 cs=0 l=0 c_cookie=4700786284677986739 s_cookie=8960109193942845681 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0debcca90 0x55c0debf0450 unknown :-1 s=CLOSED pgs=566 gs=2 cs=0 l=1 c_cookie=18417110927559603311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0dec11940 0x55c0debeeca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 --2- 10.20.193.28:0/262695860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0debcc180 0x55c0debeff10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f29d17fa640 0 client.16506 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 >> 10.20.193.28:0/262695860 conn(0x55c0debaa680 msgr2=0x55c0debe1250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 shutdown_connections 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 1 -- 10.20.193.28:0/262695860 wait complete. 2026-02-20T13:20:14.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.664+0000 7f2a17b76e00 20 client.16506 trim_cache size 0 max 16384 2026-02-20T13:20:14.673 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:20:14.673 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:20:14.673 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:20:14.673 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:20:14.673 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:14.673 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "7c48936c-1512-47fd-8543-212e62d9a87e", 2026-02-20T13:20:14.673 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:14.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:14.675 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:14.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:14.677 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 -- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29e40b5760 msgr2=0x7f29e40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29e40b5760 0x7f29e40d5c10 secure :-1 s=READY pgs=328 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29fc038820 tx=0x7f29fc03a040 comp rx=0 tx=0).stop 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 -- 10.20.193.28:0/1201880832 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a101157e0 msgr2=0x7f2a10122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:14.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a101157e0 0x7f2a10122df0 secure :-1 s=READY pgs=195 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a0400f8d0 tx=0x7f2a0400fda0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 -- 10.20.193.28:0/1201880832 shutdown_connections 2026-02-20T13:20:14.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29e40b5760 0x7f29e40d5c10 unknown :-1 s=CLOSED pgs=328 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a1010ffe0 0x7f2a1011da20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a101157e0 0x7f2a10122df0 unknown :-1 s=CLOSED pgs=195 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 --2- 10.20.193.28:0/1201880832 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a1010f5f0 0x7f2a1011d4e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:14.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 -- 10.20.193.28:0/1201880832 >> 10.20.193.28:0/1201880832 conn(0x7f2a100ecea0 msgr2=0x7f2a1010d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:14.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 -- 10.20.193.28:0/1201880832 shutdown_connections 2026-02-20T13:20:14.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:14.665+0000 7f2a15b7c640 1 -- 10.20.193.28:0/1201880832 wait complete. 2026-02-20T13:20:14.705 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:14 trial028 ceph-mon[37442]: pgmap v268: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:20:14.705 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:14 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:20:14.705 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:14 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.705 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:14 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:20:14.706 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:14 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:20:14.706 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:14 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.706 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:14 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:14 trial127 ceph-mon[43817]: pgmap v268: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:20:14.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:14 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:20:14.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:14 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:14 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:20:14.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:14 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:20:14.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:14 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:14 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:14 trial034 ceph-mon[43332]: pgmap v268: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:20:14.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:14 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:20:14.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:14 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:14 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:20:14.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:14 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:20:14.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:14 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:14 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:14.765 INFO:tasks.cephfs.filesystem:scrub status for tag:7c48936c-1512-47fd-8543-212e62d9a87e - {'path': '/', 'tag': '7c48936c-1512-47fd-8543-212e62d9a87e', 'options': 'recursive,force'} 2026-02-20T13:20:16.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:16 trial127 ceph-mon[43817]: pgmap v269: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:20:16.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:16 trial034 ceph-mon[43332]: pgmap v269: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:20:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:16 trial028 ceph-mon[37442]: pgmap v269: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:20:18.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:18 trial127 ceph-mon[43817]: pgmap v270: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:18.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:18 trial034 ceph-mon[43332]: pgmap v270: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 -- 10.20.193.28:0/3712870876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91901100b0 msgr2=0x7f91901104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 --2- 10.20.193.28:0/3712870876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91901100b0 0x7f91901104a0 secure :-1 s=READY pgs=567 gs=1 cs=0 l=1 c_cookie=12260417583804168687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f917c0098c0 tx=0x7f917c02f0c0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 -- 10.20.193.28:0/3712870876 shutdown_connections 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 --2- 10.20.193.28:0/3712870876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f919010f2f0 0x7f9190171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 --2- 10.20.193.28:0/3712870876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f919010e940 0x7f919010edb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 --2- 10.20.193.28:0/3712870876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91901100b0 0x7f91901104a0 unknown :-1 s=CLOSED pgs=567 gs=1 cs=0 l=1 c_cookie=12260417583804168687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 -- 10.20.193.28:0/3712870876 >> 10.20.193.28:0/3712870876 conn(0x7f91900ec320 msgr2=0x7f919010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 -- 10.20.193.28:0/3712870876 shutdown_connections 2026-02-20T13:20:18.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 -- 10.20.193.28:0/3712870876 wait complete. 2026-02-20T13:20:18.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 Processor -- start 2026-02-20T13:20:18.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.745+0000 7f9195403640 1 -- start start 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f9195403640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f919010e940 0x7f91900f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f9195403640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f919010f2f0 0x7f9190171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f9195403640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91901100b0 0x7f91900f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f9195403640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f91900f96a0 con 0x7f919010e940 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f9195403640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f91900f9810 con 0x7f919010f2f0 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f9195403640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f91900f99d0 con 0x7f91901100b0 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f919010e940 0x7f91900f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f919010e940 0x7f91900f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58552/0 (socket says 10.20.193.28:58552) 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 -- 10.20.193.28:0/417589865 learned_addr learned my addr 10.20.193.28:0/417589865 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918f7fe640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f919010f2f0 0x7f9190171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f9194c02640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91901100b0 0x7f91900f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 -- 10.20.193.28:0/417589865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91901100b0 msgr2=0x7f91900f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91901100b0 0x7f91900f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 -- 10.20.193.28:0/417589865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f919010f2f0 msgr2=0x7f9190171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f919010f2f0 0x7f9190171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 -- 10.20.193.28:0/417589865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c0094b0 con 0x7f919010e940 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918f7fe640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f919010f2f0 0x7f9190171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.746+0000 7f918ffff640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f919010e940 0x7f91900f8250 secure :-1 s=READY pgs=568 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f917c002c60 tx=0x7f917c02fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.747+0000 7f918d7fa640 1 -- 10.20.193.28:0/417589865 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f917c03d070 con 0x7f919010e940 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.747+0000 7f918d7fa640 1 -- 10.20.193.28:0/417589865 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f917c0044f0 con 0x7f919010e940 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.747+0000 7f918d7fa640 1 -- 10.20.193.28:0/417589865 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f917c041b00 con 0x7f919010e940 2026-02-20T13:20:18.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.747+0000 7f9195403640 1 -- 10.20.193.28:0/417589865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91900f9c50 con 0x7f919010e940 2026-02-20T13:20:18.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.747+0000 7f9195403640 1 -- 10.20.193.28:0/417589865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91900fa110 con 0x7f919010e940 2026-02-20T13:20:18.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.749+0000 7f918d7fa640 1 -- 10.20.193.28:0/417589865 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f917c0386e0 con 0x7f919010e940 2026-02-20T13:20:18.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.751+0000 7f918d7fa640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91640b5760 0x7f91640d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.751+0000 7f918d7fa640 1 -- 10.20.193.28:0/417589865 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f917c10b9a0 con 0x7f919010e940 2026-02-20T13:20:18.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.751+0000 7f918f7fe640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91640b5760 0x7f91640d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9198c8fe00 1 Processor -- start 2026-02-20T13:20:18.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9198c8fe00 1 -- start start 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe781e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 0x55ffe783f1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe785fae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffe7713fd0 con 0x55ffe77fe4c0 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffe770fd00 con 0x55ffe781ede0 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffe7709ca0 con 0x55ffe783f700 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f918f7fe640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91640b5760 0x7f91640d5c10 secure :-1 s=READY pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9180004740 tx=0x7f9180005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9194c02640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe785fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f918ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe781e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9194c02640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe785fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43460/0 (socket says 10.20.193.28:43460) 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9194c02640 1 -- 10.20.193.28:0/339344771 learned_addr learned my addr 10.20.193.28:0/339344771 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f918f7fe640 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 0x55ffe783f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9194c02640 1 -- 10.20.193.28:0/339344771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 msgr2=0x55ffe783f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9194c02640 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 0x55ffe783f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9194c02640 1 -- 10.20.193.28:0/339344771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 msgr2=0x55ffe781e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9194c02640 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe781e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f9194c02640 1 -- 10.20.193.28:0/339344771 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffe76ac8b0 con 0x55ffe783f700 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.752+0000 7f918ffff640 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe781e8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9194c02640 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe785fae0 secure :-1 s=READY pgs=199 gs=2 cs=0 l=1 c_cookie=8706501306908030634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9184005460 tx=0x7f91840117a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78d3b4cf42ba36aa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9153fff640 1 -- 10.20.193.28:0/339344771 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9184012440 con 0x55ffe783f700 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9153fff640 1 -- 10.20.193.28:0/339344771 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9184012a80 con 0x55ffe783f700 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9153fff640 1 -- 10.20.193.28:0/339344771 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f918401aae0 con 0x55ffe783f700 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 -- 10.20.193.28:0/339344771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 msgr2=0x55ffe785fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe785fae0 secure :-1 s=READY pgs=199 gs=2 cs=0 l=1 c_cookie=8706501306908030634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9184005460 tx=0x7f91840117a0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 -- 10.20.193.28:0/339344771 shutdown_connections 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe785fae0 unknown :-1 s=CLOSED pgs=199 gs=2 cs=0 l=1 c_cookie=8706501306908030634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 0x55ffe783f1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/339344771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe781e8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 -- 10.20.193.28:0/339344771 >> 10.20.193.28:0/339344771 conn(0x55ffe771d1c0 msgr2=0x55ffe77fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 -- 10.20.193.28:0/339344771 shutdown_connections 2026-02-20T13:20:18.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.753+0000 7f9198c8fe00 1 -- 10.20.193.28:0/339344771 wait complete. 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.754+0000 7f9198c8fe00 1 -- start start 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9198c8fe00 1 Processor -- start 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe781ede0 0x55ffe7818140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe7818ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffe7819200 con 0x55ffe781ede0 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffe7819370 con 0x55ffe783f700 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffe7819530 con 0x55ffe77fe4c0 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9194c02640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe7818ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9194c02640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe7818ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52836/0 (socket says 10.20.193.28:52836) 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9194c02640 1 -- 10.20.193.28:0/1106907836 learned_addr learned my addr 10.20.193.28:0/1106907836 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f918ffff640 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f918f7fe640 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe781ede0 0x55ffe7818140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9194c02640 1 -- 10.20.193.28:0/1106907836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe77fe4c0 msgr2=0x55ffe7817af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9194c02640 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9194c02640 1 -- 10.20.193.28:0/1106907836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe781ede0 msgr2=0x55ffe7818140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9194c02640 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe781ede0 0x55ffe7818140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.755+0000 7f9194c02640 1 -- 10.20.193.28:0/1106907836 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffe76b5400 con 0x55ffe783f700 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f9194c02640 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe7818ba0 secure :-1 s=READY pgs=230 gs=2 cs=0 l=1 c_cookie=8989431199489913171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9184003d10 tx=0x7f918401aad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cc0e00c4268f153 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f91517fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f91517fa640 1 -- 10.20.193.28:0/1106907836 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9184006480 con 0x55ffe783f700 2026-02-20T13:20:18.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9184005050 con 0x55ffe783f700 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f91517fa640 1 -- 10.20.193.28:0/1106907836 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91840065e0 con 0x55ffe783f700 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f9198c8fe00 10 client.26495 _ll_register_callbacks cb 0x55ffe7694a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ffe73a9520 con 0x55ffe783f700 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f91517fa640 1 -- 10.20.193.28:0/1106907836 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91840126c0 con 0x55ffe783f700 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f91517fa640 1 -- 10.20.193.28:0/1106907836 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9184012850 con 0x55ffe783f700 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f91517fa640 1 -- 10.20.193.28:0/1106907836 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9184012a70 con 0x55ffe783f700 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f9198c8fe00 10 client.26495 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ffe768dda0 con 0x55ffe783f700 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.756+0000 7f91517fa640 1 -- 10.20.193.28:0/1106907836 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9184033020 con 0x55ffe783f700 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f9198c8fe00 10 client.26495 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f9198c8fe00 10 client.26495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f9198c8fe00 20 client.26495 populate_metadata read hostname 'trial028' 2026-02-20T13:20:18.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffe781e030 0x55ffe781e4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f9198c8fe00 4 client.26495 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffe773b630 con 0x55ffe781e030 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f918ffff640 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffe781e030 0x55ffe781e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f91517fa640 10 client.26495 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.757+0000 7f918ffff640 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffe781e030 0x55ffe781e4d0 crc :-1 s=READY pgs=112 gs=4 cs=0 l=0 c_cookie=12427294393660867021 s_cookie=18335854980096745720 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac769e688d5c01cd server_cookie=fe760af4f5be60f8 in_seq=0 out_seq=0 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f91517fa640 1 -- 10.20.193.28:0/1106907836 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ffe773b630 con 0x55ffe781e030 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f91517fa640 10 client.26495 handle_command_reply: tid=0 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 client.26495 shutdown 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 msgr2=0x55ffe7818ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe7818ba0 secure :-1 s=READY pgs=230 gs=2 cs=0 l=1 c_cookie=8989431199489913171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9184003d10 tx=0x7f918401aad0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 shutdown_connections 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffe781e030 0x55ffe781e4d0 crc :-1 s=READY pgs=112 gs=4 cs=0 l=0 c_cookie=12427294393660867021 s_cookie=18335854980096745720 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe781ede0 0x55ffe7818140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe7818ba0 unknown :-1 s=CLOSED pgs=230 gs=2 cs=0 l=1 c_cookie=8989431199489913171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1106907836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 >> 10.20.193.28:0/1106907836 conn(0x55ffe771d1c0 msgr2=0x55ffe77ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f91517fa640 0 client.26495 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 shutdown_connections 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1106907836 wait complete. 2026-02-20T13:20:18.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.758+0000 7f9198c8fe00 20 client.26495 trim_cache size 0 max 16384 2026-02-20T13:20:18.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9198c8fe00 1 Processor -- start 2026-02-20T13:20:18.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9198c8fe00 1 -- start start 2026-02-20T13:20:18.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 0x55ffe7814e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe7815360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffe77078d0 con 0x55ffe77fe4c0 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffe7448f10 con 0x55ffe781ede0 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffe776f4f0 con 0x55ffe783f700 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 0x55ffe7814e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58592/0 (socket says 10.20.193.28:58592) 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918ffff640 1 -- 10.20.193.28:0/1084337044 learned_addr learned my addr 10.20.193.28:0/1084337044 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f9194c02640 1 --2- 10.20.193.28:0/1084337044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe7815360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918ffff640 1 -- 10.20.193.28:0/1084337044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 msgr2=0x55ffe7815360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918ffff640 1 --2- 10.20.193.28:0/1084337044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe7815360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918ffff640 1 -- 10.20.193.28:0/1084337044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 msgr2=0x55ffe7814e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918ffff640 1 --2- 10.20.193.28:0/1084337044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 0x55ffe7814e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.766+0000 7f918ffff640 1 -- 10.20.193.28:0/1084337044 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffe769f670 con 0x55ffe77fe4c0 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f918ffff640 1 --2- 10.20.193.28:0/1084337044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817190 secure :-1 s=READY pgs=569 gs=1 cs=0 l=1 c_cookie=13394365812921953059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f917c1094d0 tx=0x7f917c0f7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e258bd8ed96b23 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f91537fe640 1 -- 10.20.193.28:0/1084337044 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f917c0d1500 con 0x55ffe77fe4c0 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f91537fe640 1 -- 10.20.193.28:0/1084337044 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f917c0d2700 con 0x55ffe77fe4c0 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f91537fe640 1 -- 10.20.193.28:0/1084337044 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f917c0ce000 con 0x55ffe77fe4c0 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1084337044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 msgr2=0x55ffe7817190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1084337044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817190 secure :-1 s=READY pgs=569 gs=1 cs=0 l=1 c_cookie=13394365812921953059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f917c1094d0 tx=0x7f917c0f7040 comp rx=0 tx=0).stop 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1084337044 shutdown_connections 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1084337044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe783f700 0x55ffe7815360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1084337044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe781ede0 0x55ffe7814e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/1084337044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe7817190 unknown :-1 s=CLOSED pgs=569 gs=1 cs=0 l=1 c_cookie=13394365812921953059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1084337044 >> 10.20.193.28:0/1084337044 conn(0x55ffe771d1c0 msgr2=0x55ffe781e030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:18.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1084337044 shutdown_connections 2026-02-20T13:20:18.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.767+0000 7f9198c8fe00 1 -- 10.20.193.28:0/1084337044 wait complete. 2026-02-20T13:20:18.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9198c8fe00 1 -- start start 2026-02-20T13:20:18.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9198c8fe00 1 Processor -- start 2026-02-20T13:20:18.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe77f9140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe781ede0 0x55ffe77f97e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9198c8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe77fa290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffe7819670 con 0x55ffe77fe4c0 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffe77078d0 con 0x55ffe783f700 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9198c8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffe7448f10 con 0x55ffe781ede0 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f918ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe77f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f9194c02640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe77fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f918f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe781ede0 0x55ffe77f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f918ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe77f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58602/0 (socket says 10.20.193.28:58602) 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.768+0000 7f918ffff640 1 -- 10.20.193.28:0/4125649831 learned_addr learned my addr 10.20.193.28:0/4125649831 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f918ffff640 1 -- 10.20.193.28:0/4125649831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe781ede0 msgr2=0x55ffe77f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f918ffff640 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe781ede0 0x55ffe77f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f918ffff640 1 -- 10.20.193.28:0/4125649831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 msgr2=0x55ffe77fa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f918ffff640 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe77fa290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f918ffff640 1 -- 10.20.193.28:0/4125649831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffe769a0f0 con 0x55ffe77fe4c0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f918ffff640 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe77f9140 secure :-1 s=READY pgs=570 gs=1 cs=0 l=1 c_cookie=14410127441236901876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f917c038fd0 tx=0x7f917c041510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fb0e8f4708bff4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f91517fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f91517fa640 1 -- 10.20.193.28:0/4125649831 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f917c0d1500 con 0x55ffe77fe4c0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91900f9c50 con 0x55ffe77fe4c0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f9198c8fe00 10 client.16524 _ll_register_callbacks cb 0x55ffe7694a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ffe77b9ca0 con 0x55ffe77fe4c0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f91517fa640 1 -- 10.20.193.28:0/4125649831 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ffe77b9ca0 con 0x55ffe77fe4c0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f91517fa640 1 -- 10.20.193.28:0/4125649831 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f917c0d1b10 con 0x55ffe77fe4c0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f91517fa640 1 -- 10.20.193.28:0/4125649831 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f917c0d7a20 con 0x55ffe77fe4c0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f91517fa640 1 -- 10.20.193.28:0/4125649831 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f917c0dce40 con 0x55ffe77fe4c0 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f9198c8fe00 10 client.16524 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:18.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.769+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ffe768e0d0 con 0x55ffe77fe4c0 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f91517fa640 1 -- 10.20.193.28:0/4125649831 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f917c097020 con 0x55ffe77fe4c0 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f9198c8fe00 10 client.16524 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f9198c8fe00 10 client.16524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f9198c8fe00 20 client.16524 populate_metadata read hostname 'trial028' 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffe77fc360 0x55ffe77fc800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f9198c8fe00 4 client.16524 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffe73ed640 con 0x55ffe77fc360 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f918f7fe640 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffe77fc360 0x55ffe77fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f918f7fe640 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffe77fc360 0x55ffe77fc800 crc :-1 s=READY pgs=113 gs=4 cs=0 l=0 c_cookie=86991940500677595 s_cookie=776528939660853895 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1350eb57fdd63db server_cookie=ac6c8f4d64bc287 in_seq=0 out_seq=0 2026-02-20T13:20:18.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.770+0000 7f91517fa640 10 client.16524 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f91517fa640 1 -- 10.20.193.28:0/4125649831 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffe73ed640 con 0x55ffe77fc360 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f91517fa640 10 client.16524 handle_command_reply: tid=0 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 client.16524 shutdown 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 msgr2=0x55ffe77f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe77f9140 secure :-1 s=READY pgs=570 gs=1 cs=0 l=1 c_cookie=14410127441236901876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f917c038fd0 tx=0x7f917c041510 comp rx=0 tx=0).stop 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 shutdown_connections 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffe77fc360 0x55ffe77fc800 crc :-1 s=READY pgs=113 gs=4 cs=0 l=0 c_cookie=86991940500677595 s_cookie=776528939660853895 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffe783f700 0x55ffe77fa290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffe781ede0 0x55ffe77f97e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 --2- 10.20.193.28:0/4125649831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffe77fe4c0 0x55ffe77f9140 unknown :-1 s=CLOSED pgs=570 gs=1 cs=0 l=1 c_cookie=14410127441236901876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 >> 10.20.193.28:0/4125649831 conn(0x55ffe771d1c0 msgr2=0x55ffe781e030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:18.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f91517fa640 0 client.16524 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:18.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 shutdown_connections 2026-02-20T13:20:18.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 1 -- 10.20.193.28:0/4125649831 wait complete. 2026-02-20T13:20:18.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.775+0000 7f9198c8fe00 20 client.16524 trim_cache size 0 max 16384 2026-02-20T13:20:18.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:20:18.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:20:18.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:20:18.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:20:18.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 -- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91640b5760 msgr2=0x7f91640d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91640b5760 0x7f91640d5c10 secure :-1 s=READY pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9180004740 tx=0x7f9180005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:18.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 -- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f919010e940 msgr2=0x7f91900f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f919010e940 0x7f91900f8250 secure :-1 s=READY pgs=568 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f917c002c60 tx=0x7f917c02fb30 comp rx=0 tx=0).stop 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 -- 10.20.193.28:0/417589865 shutdown_connections 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91640b5760 0x7f91640d5c10 unknown :-1 s=CLOSED pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91901100b0 0x7f91900f8ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f919010f2f0 0x7f9190171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 --2- 10.20.193.28:0/417589865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f919010e940 0x7f91900f8250 unknown :-1 s=CLOSED pgs=568 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 -- 10.20.193.28:0/417589865 >> 10.20.193.28:0/417589865 conn(0x7f91900ec320 msgr2=0x7f91900ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 -- 10.20.193.28:0/417589865 shutdown_connections 2026-02-20T13:20:18.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:18.776+0000 7f9195403640 1 -- 10.20.193.28:0/417589865 wait complete. 2026-02-20T13:20:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:18 trial028 ceph-mon[37442]: pgmap v270: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:20.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:20 trial127 ceph-mon[43817]: pgmap v271: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:20.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:20 trial034 ceph-mon[43332]: pgmap v271: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:20 trial028 ceph-mon[37442]: pgmap v271: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:22.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:22 trial127 ceph-mon[43817]: pgmap v272: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 22 op/s 2026-02-20T13:20:22.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:22 trial034 ceph-mon[43332]: pgmap v272: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 22 op/s 2026-02-20T13:20:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:22 trial028 ceph-mon[37442]: pgmap v272: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 22 op/s 2026-02-20T13:20:23.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:23 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:20:23.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:23 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:20:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:23 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:20:24.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:24 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:20:24.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:24 trial127 ceph-mon[43817]: pgmap v273: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:24.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:24 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:20:24.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:24 trial034 ceph-mon[43332]: pgmap v273: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:24 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:20:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:24 trial028 ceph-mon[37442]: pgmap v273: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:20:26.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:26 trial127 ceph-mon[43817]: pgmap v274: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:20:26.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:26 trial034 ceph-mon[43332]: pgmap v274: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:20:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:26 trial028 ceph-mon[37442]: pgmap v274: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:20:28.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:28 trial127 ceph-mon[43817]: pgmap v275: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:28.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:28 trial034 ceph-mon[43332]: pgmap v275: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:28 trial028 ceph-mon[37442]: pgmap v275: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:20:30.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:30 trial127 ceph-mon[43817]: pgmap v276: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:20:30.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:30 trial034 ceph-mon[43332]: pgmap v276: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:20:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:30 trial028 ceph-mon[37442]: pgmap v276: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:20:31.414 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.2) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-20T13:20:31.415 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.1 2026-02-20T13:20:31.415 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:20:31.600 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 -- 10.20.193.28:0/1591263450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 msgr2=0x7f5cdc175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/1591263450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 0x7f5cdc175df0 secure :-1 s=READY pgs=571 gs=3 cs=0 l=1 c_cookie=2858389570404605712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd000aa30 tx=0x7f5cd0030270 comp rx=0 tx=0).stop 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 -- 10.20.193.28:0/1591263450 shutdown_connections 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/1591263450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 0x7f5cdc175df0 unknown :-1 s=CLOSED pgs=571 gs=3 cs=0 l=1 c_cookie=2858389570404605712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/1591263450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cdc10fc20 0x7f5cdc114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/1591263450 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cdc10f230 0x7f5cdc10f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 -- 10.20.193.28:0/1591263450 >> 10.20.193.28:0/1591263450 conn(0x7f5cdc05f830 msgr2=0x7f5cdc10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 -- 10.20.193.28:0/1591263450 shutdown_connections 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 -- 10.20.193.28:0/1591263450 wait complete. 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.775+0000 7f5ce49fa640 1 Processor -- start 2026-02-20T13:20:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce49fa640 1 -- start start 2026-02-20T13:20:31.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce49fa640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cdc10f230 0x7f5cdc11db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce49fa640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cdc10fc20 0x7f5cdc11e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce49fa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 0x7f5cdc123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce49fa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc123a60 con 0x7f5cdc115420 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce49fa640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc123bd0 con 0x7f5cdc10f230 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce49fa640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc123d90 con 0x7f5cdc10fc20 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce2f70640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 0x7f5cdc123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce276f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cdc10f230 0x7f5cdc11db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce1f6e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cdc10fc20 0x7f5cdc11e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce2f70640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 0x7f5cdc123440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46130/0 (socket says 10.20.193.28:46130) 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce2f70640 1 -- 10.20.193.28:0/558236027 learned_addr learned my addr 10.20.193.28:0/558236027 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce276f640 1 -- 10.20.193.28:0/558236027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cdc10fc20 msgr2=0x7f5cdc11e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce276f640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cdc10fc20 0x7f5cdc11e070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce276f640 1 -- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 msgr2=0x7f5cdc123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce276f640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 0x7f5cdc123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce276f640 1 -- 10.20.193.28:0/558236027 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd40094b0 con 0x7f5cdc10f230 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.776+0000 7f5ce2f70640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 0x7f5cdc123440 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.777+0000 7f5ce276f640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cdc10f230 0x7f5cdc11db30 secure :-1 s=READY pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd4004680 tx=0x7f5cd4002b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.777+0000 7f5cc77fe640 1 -- 10.20.193.28:0/558236027 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cd400eb20 con 0x7f5cdc10f230 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.777+0000 7f5cc77fe640 1 -- 10.20.193.28:0/558236027 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5cd400ec80 con 0x7f5cdc10f230 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.777+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd000a650 con 0x7f5cdc10f230 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.777+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cdc1645d0 con 0x7f5cdc10f230 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.777+0000 7f5cc77fe640 1 -- 10.20.193.28:0/558236027 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cd400f7d0 con 0x7f5cdc10f230 2026-02-20T13:20:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.778+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cdc110510 con 0x7f5cdc10f230 2026-02-20T13:20:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.780+0000 7f5cc77fe640 1 -- 10.20.193.28:0/558236027 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5cd401f060 con 0x7f5cdc10f230 2026-02-20T13:20:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.781+0000 7f5cc77fe640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5cb80b56e0 0x7f5cb80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.781+0000 7f5cc77fe640 1 -- 10.20.193.28:0/558236027 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5cd40e6f70 con 0x7f5cdc10f230 2026-02-20T13:20:31.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.782+0000 7f5cc77fe640 1 -- 10.20.193.28:0/558236027 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f5cd40accb0 con 0x7f5cdc10f230 2026-02-20T13:20:31.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.782+0000 7f5ce1f6e640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5cb80b56e0 0x7f5cb80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.782+0000 7f5ce1f6e640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5cb80b56e0 0x7f5cb80d5b90 secure :-1 s=READY pgs=330 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cdc1244d0 tx=0x7f5cc8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:31.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f312a7fc640 1 -- 10.20.193.28:0/485077889 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31200396f0 con 0x7f312c1152a0 2026-02-20T13:20:31.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 -- 10.20.193.28:0/485077889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c1152a0 msgr2=0x7f312c115740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 --2- 10.20.193.28:0/485077889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c1152a0 0x7f312c115740 secure :-1 s=READY pgs=232 gs=2 cs=0 l=1 c_cookie=5392163814134027502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f312000aa30 tx=0x7f3120030270 comp rx=0 tx=0).stop 2026-02-20T13:20:31.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 -- 10.20.193.28:0/485077889 shutdown_connections 2026-02-20T13:20:31.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 --2- 10.20.193.28:0/485077889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c1152a0 0x7f312c115740 unknown :-1 s=CLOSED pgs=232 gs=2 cs=0 l=1 c_cookie=5392163814134027502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 --2- 10.20.193.28:0/485077889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f312c114710 0x7f312c114b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 --2- 10.20.193.28:0/485077889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f312c113de0 0x7f312c1141d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 -- 10.20.193.28:0/485077889 >> 10.20.193.28:0/485077889 conn(0x7f312c05be90 msgr2=0x7f312c05c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:31.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 -- 10.20.193.28:0/485077889 shutdown_connections 2026-02-20T13:20:31.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.848+0000 7f3130f89640 1 -- 10.20.193.28:0/485077889 wait complete. 2026-02-20T13:20:31.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f3130f89640 1 Processor -- start 2026-02-20T13:20:31.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f3130f89640 1 -- start start 2026-02-20T13:20:31.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f3130f89640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f312c113de0 0x7f312c0fdc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f3130f89640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c114710 0x7f312c0fe290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f3130f89640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f312c1152a0 0x7f312c0fee90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f3130f89640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f312c0ff5d0 con 0x7f312c113de0 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f3130f89640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f312c0ff740 con 0x7f312c114710 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f3130f89640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f312c0ff900 con 0x7f312c1152a0 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.849+0000 7f312affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c114710 0x7f312c0fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c114710 0x7f312c0fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40518/0 (socket says 10.20.193.28:40518) 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312affd640 1 -- 10.20.193.28:0/995387617 learned_addr learned my addr 10.20.193.28:0/995387617 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312bfff640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f312c1152a0 0x7f312c0fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312b7fe640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f312c113de0 0x7f312c0fdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312affd640 1 -- 10.20.193.28:0/995387617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f312c1152a0 msgr2=0x7f312c0fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312affd640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f312c1152a0 0x7f312c0fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312affd640 1 -- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f312c113de0 msgr2=0x7f312c0fdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312affd640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f312c113de0 0x7f312c0fdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312affd640 1 -- 10.20.193.28:0/995387617 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312000a650 con 0x7f312c114710 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f312affd640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c114710 0x7f312c0fe290 secure :-1 s=READY pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f311c009480 tx=0x7f311c00ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f3128ff9640 1 -- 10.20.193.28:0/995387617 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f311c00cce0 con 0x7f312c114710 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f3128ff9640 1 -- 10.20.193.28:0/995387617 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f311c00ce40 con 0x7f312c114710 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f3130f89640 1 -- 10.20.193.28:0/995387617 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c0ffbe0 con 0x7f312c114710 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f3128ff9640 1 -- 10.20.193.28:0/995387617 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f311c0106b0 con 0x7f312c114710 2026-02-20T13:20:31.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.850+0000 7f3130f89640 1 -- 10.20.193.28:0/995387617 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c100100 con 0x7f312c114710 2026-02-20T13:20:31.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.853+0000 7f3128ff9640 1 -- 10.20.193.28:0/995387617 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f311c01f060 con 0x7f312c114710 2026-02-20T13:20:31.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.854+0000 7f3128ff9640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f31000b56e0 0x7f31000d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.854+0000 7f3128ff9640 1 -- 10.20.193.28:0/995387617 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f311c014070 con 0x7f312c114710 2026-02-20T13:20:31.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.855+0000 7f312b7fe640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f31000b56e0 0x7f31000d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.855+0000 7f312b7fe640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f31000b56e0 0x7f31000d5b90 secure :-1 s=READY pgs=331 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3118004740 tx=0x7f3118005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:31.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f31347fbe00 1 Processor -- start 2026-02-20T13:20:31.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f31347fbe00 1 -- start start 2026-02-20T13:20:31.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb03688a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0368de0 0x564bb03891c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0389700 0x564bb03a9ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f31347fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564bb025dfd0 con 0x564bb0368de0 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f31347fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564bb0259d00 con 0x564bb03484c0 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f31347fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564bb0253ca0 con 0x564bb0389700 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f312b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb03688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f312affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0368de0 0x564bb03891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f312b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb03688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40520/0 (socket says 10.20.193.28:40520) 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f312b7fe640 1 -- 10.20.193.28:0/2260490235 learned_addr learned my addr 10.20.193.28:0/2260490235 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.857+0000 7f312bfff640 1 --2- 10.20.193.28:0/2260490235 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0389700 0x564bb03a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f312affd640 1 -- 10.20.193.28:0/2260490235 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0389700 msgr2=0x564bb03a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f312affd640 1 --2- 10.20.193.28:0/2260490235 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0389700 0x564bb03a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f312affd640 1 -- 10.20.193.28:0/2260490235 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 msgr2=0x564bb03688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:31.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f312affd640 1 --2- 10.20.193.28:0/2260490235 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb03688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f312affd640 1 -- 10.20.193.28:0/2260490235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bb01f68b0 con 0x564bb0368de0 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f312affd640 1 --2- 10.20.193.28:0/2260490235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0368de0 0x564bb03891c0 secure :-1 s=READY pgs=572 gs=1 cs=0 l=1 c_cookie=16242815836394276777 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f311c0ad020 tx=0x7f311c0a8fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16a12f1f05ec7a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f30effff640 1 -- 10.20.193.28:0/2260490235 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f311c0ada40 con 0x564bb0368de0 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f30effff640 1 -- 10.20.193.28:0/2260490235 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f311c0b2d60 con 0x564bb0368de0 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f30effff640 1 -- 10.20.193.28:0/2260490235 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f311c0adcd0 con 0x564bb0368de0 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 -- 10.20.193.28:0/2260490235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0368de0 msgr2=0x564bb03891c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 --2- 10.20.193.28:0/2260490235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0368de0 0x564bb03891c0 secure :-1 s=READY pgs=572 gs=1 cs=0 l=1 c_cookie=16242815836394276777 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f311c0ad020 tx=0x7f311c0a8fb0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 -- 10.20.193.28:0/2260490235 shutdown_connections 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 --2- 10.20.193.28:0/2260490235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0368de0 0x564bb03891c0 unknown :-1 s=CLOSED pgs=572 gs=1 cs=0 l=1 c_cookie=16242815836394276777 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 --2- 10.20.193.28:0/2260490235 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0389700 0x564bb03a9ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 --2- 10.20.193.28:0/2260490235 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb03688a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 -- 10.20.193.28:0/2260490235 >> 10.20.193.28:0/2260490235 conn(0x564bb02671c0 msgr2=0x564bb0346da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:31.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 -- 10.20.193.28:0/2260490235 shutdown_connections 2026-02-20T13:20:31.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.858+0000 7f31347fbe00 1 -- 10.20.193.28:0/2260490235 wait complete. 2026-02-20T13:20:31.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f31347fbe00 1 -- start start 2026-02-20T13:20:31.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f31347fbe00 1 Processor -- start 2026-02-20T13:20:31.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb0361ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb0362130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb0362b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f31347fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564bb03631f0 con 0x564bb0389700 2026-02-20T13:20:31.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f31347fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564bb0363360 con 0x564bb03484c0 2026-02-20T13:20:31.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f31347fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564bb0363520 con 0x564bb0368de0 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f312bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb0362b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f312b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb0361ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f312bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb0362b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46168/0 (socket says 10.20.193.28:46168) 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f312bfff640 1 -- 10.20.193.28:0/4227889652 learned_addr learned my addr 10.20.193.28:0/4227889652 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.860+0000 7f312affd640 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb0362130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f312bfff640 1 -- 10.20.193.28:0/4227889652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 msgr2=0x564bb0362130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f312bfff640 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb0362130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f312bfff640 1 -- 10.20.193.28:0/4227889652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 msgr2=0x564bb0361ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f312bfff640 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb0361ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f312bfff640 1 -- 10.20.193.28:0/4227889652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bb01ff400 con 0x564bb0389700 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f312b7fe640 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb0361ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:31.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f312bfff640 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb0362b90 secure :-1 s=READY pgs=573 gs=1 cs=0 l=1 c_cookie=1183104486572473564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f312000a230 tx=0x7f31200396a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106b3b431e52bcdc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f30ed7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f30ed7fa640 1 -- 10.20.193.28:0/4227889652 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f312003e040 con 0x564bb0389700 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f30ed7fa640 1 -- 10.20.193.28:0/4227889652 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f312003f040 con 0x564bb0389700 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f30ed7fa640 1 -- 10.20.193.28:0/4227889652 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31200456d0 con 0x564bb0389700 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.861+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c100100 con 0x564bb0389700 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f30ed7fa640 1 -- 10.20.193.28:0/4227889652 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3120045860 con 0x564bb0389700 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f30ed7fa640 10 client.16542 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 10 client.16542 _ll_register_callbacks cb 0x564bb01dea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564bafef3520 con 0x564bb0389700 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f30ed7fa640 1 -- 10.20.193.28:0/4227889652 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31200050c0 con 0x564bb0389700 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 10 client.16542 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:31.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564bb01d7da0 con 0x564bb0389700 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f30ed7fa640 1 -- 10.20.193.28:0/4227889652 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3120005220 con 0x564bb0389700 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 10 client.16542 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 10 client.16542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 20 client.16542 populate_metadata read hostname 'trial028' 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564bb03661c0 0x564bb0366660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 4 client.16542 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bb0285630 con 0x564bb03661c0 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.862+0000 7f312b7fe640 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564bb03661c0 0x564bb0366660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.863+0000 7f312b7fe640 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564bb03661c0 0x564bb0366660 crc :-1 s=READY pgs=114 gs=4 cs=0 l=0 c_cookie=15163507878655814779 s_cookie=3542177386579179683 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26f9a13701dec7b server_cookie=31285790da7938a3 in_seq=0 out_seq=0 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.863+0000 7f30ed7fa640 10 client.16542 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.863+0000 7f30ed7fa640 1 -- 10.20.193.28:0/4227889652 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564bb0285630 con 0x564bb03661c0 2026-02-20T13:20:31.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.863+0000 7f30ed7fa640 10 client.16542 handle_command_reply: tid=0 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.863+0000 7f31347fbe00 1 client.16542 shutdown 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 msgr2=0x564bb0362b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb0362b90 secure :-1 s=READY pgs=573 gs=1 cs=0 l=1 c_cookie=1183104486572473564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f312000a230 tx=0x7f31200396a0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 shutdown_connections 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564bb03661c0 0x564bb0366660 crc :-1 s=READY pgs=114 gs=4 cs=0 l=0 c_cookie=15163507878655814779 s_cookie=3542177386579179683 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb0362b90 unknown :-1 s=CLOSED pgs=573 gs=1 cs=0 l=1 c_cookie=1183104486572473564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb0362130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 --2- 10.20.193.28:0/4227889652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb0361ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f30ed7fa640 0 client.16542 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 >> 10.20.193.28:0/4227889652 conn(0x564bb02671c0 msgr2=0x564bb0349790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 shutdown_connections 2026-02-20T13:20:31.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 1 -- 10.20.193.28:0/4227889652 wait complete. 2026-02-20T13:20:31.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.864+0000 7f31347fbe00 20 client.16542 trim_cache size 0 max 16384 2026-02-20T13:20:31.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f31347fbe00 1 Processor -- start 2026-02-20T13:20:31.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f31347fbe00 1 -- start start 2026-02-20T13:20:31.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb035ee00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb035f340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb03875c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f31347fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564bb02518d0 con 0x564bb0389700 2026-02-20T13:20:31.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f31347fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564baff92f10 con 0x564bb03484c0 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb035ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f31347fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564bb0323810 con 0x564bb0368de0 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb035ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40530/0 (socket says 10.20.193.28:40530) 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312b7fe640 1 -- 10.20.193.28:0/3125150736 learned_addr learned my addr 10.20.193.28:0/3125150736 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312affd640 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb035f340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312bfff640 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb03875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312b7fe640 1 -- 10.20.193.28:0/3125150736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 msgr2=0x564bb035f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312b7fe640 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb035f340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312b7fe640 1 -- 10.20.193.28:0/3125150736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 msgr2=0x564bb03875c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:31.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.872+0000 7f312b7fe640 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb03875c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f312b7fe640 1 -- 10.20.193.28:0/3125150736 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bb01e9670 con 0x564bb03484c0 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f312b7fe640 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb035ee00 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=7570532009278781736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3118009550 tx=0x7f3118013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=690feec085c93928 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f30ef7fe640 1 -- 10.20.193.28:0/3125150736 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3118022030 con 0x564bb03484c0 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f30ef7fe640 1 -- 10.20.193.28:0/3125150736 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3118023040 con 0x564bb03484c0 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f30ef7fe640 1 -- 10.20.193.28:0/3125150736 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3118011cb0 con 0x564bb03484c0 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 -- 10.20.193.28:0/3125150736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 msgr2=0x564bb035ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb035ee00 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=7570532009278781736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3118009550 tx=0x7f3118013000 comp rx=0 tx=0).stop 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 -- 10.20.193.28:0/3125150736 shutdown_connections 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb0389700 0x564bb03875c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb035f340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 --2- 10.20.193.28:0/3125150736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb03484c0 0x564bb035ee00 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=7570532009278781736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 -- 10.20.193.28:0/3125150736 >> 10.20.193.28:0/3125150736 conn(0x564bb02671c0 msgr2=0x564bb0361950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:31.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 -- 10.20.193.28:0/3125150736 shutdown_connections 2026-02-20T13:20:31.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.873+0000 7f31347fbe00 1 -- 10.20.193.28:0/3125150736 wait complete. 2026-02-20T13:20:31.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.874+0000 7f31347fbe00 1 -- start start 2026-02-20T13:20:31.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.874+0000 7f31347fbe00 1 Processor -- start 2026-02-20T13:20:31.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.874+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb03484c0 0x564bb03684c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.874+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb03691b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.874+0000 7f31347fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb0389700 0x564bb03696f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.874+0000 7f31347fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564bb0369d00 con 0x564bb03484c0 2026-02-20T13:20:31.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.874+0000 7f31347fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564bb0369e70 con 0x564bb0389700 2026-02-20T13:20:31.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.874+0000 7f31347fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564bb036a030 con 0x564bb0368de0 2026-02-20T13:20:31.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb03484c0 0x564bb03684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb0389700 0x564bb03696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb0389700 0x564bb03696f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40540/0 (socket says 10.20.193.28:40540) 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 -- 10.20.193.28:0/1489580718 learned_addr learned my addr 10.20.193.28:0/1489580718 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb03484c0 0x564bb03684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46192/0 (socket says 10.20.193.28:46192) 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb03691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 -- 10.20.193.28:0/1489580718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 msgr2=0x564bb03691b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb03691b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 -- 10.20.193.28:0/1489580718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb03484c0 msgr2=0x564bb03684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb03484c0 0x564bb03684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 -- 10.20.193.28:0/1489580718 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bb01e40f0 con 0x564bb0389700 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f312bfff640 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb0389700 0x564bb03696f0 secure :-1 s=READY pgs=235 gs=2 cs=0 l=1 c_cookie=3272742300944754520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3120038600 tx=0x7f3120030910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d6b1dc87134e758 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:31.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f30ed7fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f30ed7fa640 1 -- 10.20.193.28:0/1489580718 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f312003e030 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.875+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3118009a10 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 10 client.26525 _ll_register_callbacks cb 0x564bb01dea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564bb0303ca0 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f30ed7fa640 1 -- 10.20.193.28:0/1489580718 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f312003f040 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f30ed7fa640 1 -- 10.20.193.28:0/1489580718 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3120057c90 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f30ed7fa640 1 -- 10.20.193.28:0/1489580718 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3120045e40 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f30ed7fa640 1 -- 10.20.193.28:0/1489580718 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3120057e20 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 10 client.26525 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564bb01d80d0 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f30ed7fa640 1 -- 10.20.193.28:0/1489580718 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f312004d530 con 0x564bb0389700 2026-02-20T13:20:31.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 10 client.26525 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:31.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 10 client.26525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:31.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 20 client.26525 populate_metadata read hostname 'trial028' 2026-02-20T13:20:31.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564bb036bce0 0x564bb036c180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:31.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 4 client.26525 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:20:31.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564baff37640 con 0x564bb036bce0 2026-02-20T13:20:31.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.876+0000 7f312b7fe640 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564bb036bce0 0x564bb036c180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:31.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.877+0000 7f312b7fe640 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564bb036bce0 0x564bb036c180 crc :-1 s=READY pgs=115 gs=4 cs=0 l=0 c_cookie=6171423045068468243 s_cookie=327388924442939580 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a54c8fd7f73013 server_cookie=48b1e7e00d190bc in_seq=0 out_seq=0 2026-02-20T13:20:31.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.877+0000 7f30ed7fa640 10 client.26525 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:31.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f30ed7fa640 1 -- 10.20.193.28:0/1489580718 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564baff37640 con 0x564bb036bce0 2026-02-20T13:20:31.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f30ed7fa640 10 client.26525 handle_command_reply: tid=0 2026-02-20T13:20:31.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 client.26525 shutdown 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb0389700 msgr2=0x564bb03696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb0389700 0x564bb03696f0 secure :-1 s=READY pgs=235 gs=2 cs=0 l=1 c_cookie=3272742300944754520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3120038600 tx=0x7f3120030910 comp rx=0 tx=0).stop 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 shutdown_connections 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564bb036bce0 0x564bb036c180 crc :-1 s=READY pgs=115 gs=4 cs=0 l=0 c_cookie=6171423045068468243 s_cookie=327388924442939580 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564bb0389700 0x564bb03696f0 unknown :-1 s=CLOSED pgs=235 gs=2 cs=0 l=1 c_cookie=3272742300944754520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564bb0368de0 0x564bb03691b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 --2- 10.20.193.28:0/1489580718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564bb03484c0 0x564bb03684c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f30ed7fa640 0 client.26525 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 >> 10.20.193.28:0/1489580718 conn(0x564bb02671c0 msgr2=0x564bb035ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 shutdown_connections 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 1 -- 10.20.193.28:0/1489580718 wait complete. 2026-02-20T13:20:31.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.882+0000 7f31347fbe00 20 client.26525 trim_cache size 0 max 16384 2026-02-20T13:20:31.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:20:31.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:20:31.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:20:31.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:20:31.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 -- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f31000b56e0 msgr2=0x7f31000d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f31000b56e0 0x7f31000d5b90 secure :-1 s=READY pgs=331 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3118004740 tx=0x7f3118005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:31.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 -- 10.20.193.28:0/995387617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c114710 msgr2=0x7f312c0fe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c114710 0x7f312c0fe290 secure :-1 s=READY pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f311c009480 tx=0x7f311c00ede0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 -- 10.20.193.28:0/995387617 shutdown_connections 2026-02-20T13:20:31.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f31000b56e0 0x7f31000d5b90 unknown :-1 s=CLOSED pgs=331 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f312c1152a0 0x7f312c0fee90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f312c114710 0x7f312c0fe290 unknown :-1 s=CLOSED pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 --2- 10.20.193.28:0/995387617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f312c113de0 0x7f312c0fdc40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 -- 10.20.193.28:0/995387617 >> 10.20.193.28:0/995387617 conn(0x7f312c05be90 msgr2=0x7f312c05ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:31.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 -- 10.20.193.28:0/995387617 shutdown_connections 2026-02-20T13:20:31.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:31.883+0000 7f3130f89640 1 -- 10.20.193.28:0/995387617 wait complete. 2026-02-20T13:20:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.924+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cdc11ecf0 con 0x7f5cdc10f230 2026-02-20T13:20:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.924+0000 7f5cc77fe640 1 -- 10.20.193.28:0/558236027 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f5cd40acea0 con 0x7f5cdc10f230 2026-02-20T13:20:31.929 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:20:31.929 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:20:31.930 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:20:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5cb80b56e0 msgr2=0x7f5cb80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5cb80b56e0 0x7f5cb80d5b90 secure :-1 s=READY pgs=330 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cdc1244d0 tx=0x7f5cc8005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cdc10f230 msgr2=0x7f5cdc11db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cdc10f230 0x7f5cdc11db30 secure :-1 s=READY pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd4004680 tx=0x7f5cd4002b40 comp rx=0 tx=0).stop 2026-02-20T13:20:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 shutdown_connections 2026-02-20T13:20:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5cb80b56e0 0x7f5cb80d5b90 unknown :-1 s=CLOSED pgs=330 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cdc115420 0x7f5cdc123440 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cdc10fc20 0x7f5cdc11e070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 --2- 10.20.193.28:0/558236027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cdc10f230 0x7f5cdc11db30 unknown :-1 s=CLOSED pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 >> 10.20.193.28:0/558236027 conn(0x7f5cdc05f830 msgr2=0x7f5cdc10cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 shutdown_connections 2026-02-20T13:20:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:31.927+0000 7f5ce49fa640 1 -- 10.20.193.28:0/558236027 wait complete. 2026-02-20T13:20:32.030 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 148.1 --await-for 45.0' 2026-02-20T13:20:32.030 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 148.1 --await-for 45.0 2026-02-20T13:20:32.214 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.390+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3074314490 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f810bb40 msgr2=0x7fe7f81109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.390+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3074314490 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f810bb40 0x7fe7f81109d0 secure :-1 s=READY pgs=200 gs=2 cs=0 l=1 c_cookie=2265032901673870530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e0009890 tx=0x7fe7e002f120 comp rx=0 tx=0).stop 2026-02-20T13:20:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.391+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3074314490 shutdown_connections 2026-02-20T13:20:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.391+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3074314490 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7f8111160 0x7fe7f8111b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.391+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3074314490 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f810bb40 0x7fe7f81109d0 unknown :-1 s=CLOSED pgs=200 gs=2 cs=0 l=1 c_cookie=2265032901673870530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.391+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3074314490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7f810b150 0x7fe7f810b520 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.391+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3074314490 >> 10.20.193.28:0/3074314490 conn(0x7fe7f80e8ce0 msgr2=0x7fe7f81090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.391+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3074314490 shutdown_connections 2026-02-20T13:20:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.391+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3074314490 wait complete. 2026-02-20T13:20:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.391+0000 7fe7fde2f640 1 Processor -- start 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fde2f640 1 -- start start 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fde2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7f810b150 0x7fe7f80f1170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fde2f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f810bb40 0x7fe7f80f16b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fde2f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7f8111160 0x7fe7f80f6a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fde2f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f80f7050 con 0x7fe7f810b150 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fde2f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f80f7190 con 0x7fe7f8111160 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fde2f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f80f7350 con 0x7fe7f810bb40 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fd62e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7f8111160 0x7fe7f80f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fd62e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7f8111160 0x7fe7f80f6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40552/0 (socket says 10.20.193.28:40552) 2026-02-20T13:20:32.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fd62e640 1 -- 10.20.193.28:0/3534884838 learned_addr learned my addr 10.20.193.28:0/3534884838 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7f810b150 0x7fe7f80f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7effff640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f810bb40 0x7fe7f80f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fce2d640 1 -- 10.20.193.28:0/3534884838 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f810bb40 msgr2=0x7fe7f80f16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f810bb40 0x7fe7f80f16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fce2d640 1 -- 10.20.193.28:0/3534884838 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7f8111160 msgr2=0x7fe7f80f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7f8111160 0x7fe7f80f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.392+0000 7fe7fce2d640 1 -- 10.20.193.28:0/3534884838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e00094b0 con 0x7fe7f810b150 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.393+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7f810b150 0x7fe7f80f1170 secure :-1 s=READY pgs=574 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e8004740 tx=0x7fe7e800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.393+0000 7fe7edffb640 1 -- 10.20.193.28:0/3534884838 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7e800cd40 con 0x7fe7f810b150 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.393+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3534884838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f80f7630 con 0x7fe7f810b150 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.393+0000 7fe7edffb640 1 -- 10.20.193.28:0/3534884838 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7e8004d30 con 0x7fe7f810b150 2026-02-20T13:20:32.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.393+0000 7fe7edffb640 1 -- 10.20.193.28:0/3534884838 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7e80106b0 con 0x7fe7f810b150 2026-02-20T13:20:32.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.393+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3534884838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f80f7d90 con 0x7fe7f810b150 2026-02-20T13:20:32.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.396+0000 7fe7edffb640 1 -- 10.20.193.28:0/3534884838 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe7e801f060 con 0x7fe7f810b150 2026-02-20T13:20:32.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.398+0000 7fe7edffb640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7d40b5760 0x7fe7d40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.398+0000 7fe7edffb640 1 -- 10.20.193.28:0/3534884838 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe7e8014070 con 0x7fe7f810b150 2026-02-20T13:20:32.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.398+0000 7fe7effff640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7d40b5760 0x7fe7d40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.398+0000 7fe7effff640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7d40b5760 0x7fe7d40d5c10 secure :-1 s=READY pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f80f7b10 tx=0x7fe7e003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:32.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.398+0000 7fe8010b2e00 1 Processor -- start 2026-02-20T13:20:32.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe8010b2e00 1 -- start start 2026-02-20T13:20:32.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f8867c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 0x5654f88ac8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88cd1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654f877c780 con 0x5654f88ace00 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5654f87784b0 con 0x5654f8868160 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5654f8772610 con 0x5654f8867850 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fce2d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f8867c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7effff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 0x5654f88ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fce2d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f8867c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35830/0 (socket says 10.20.193.28:35830) 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fce2d640 1 -- 10.20.193.28:0/2325046506 learned_addr learned my addr 10.20.193.28:0/2325046506 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fd62e640 1 --2- 10.20.193.28:0/2325046506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fce2d640 1 -- 10.20.193.28:0/2325046506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 msgr2=0x5654f88ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:32.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/2325046506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 0x5654f88ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fce2d640 1 -- 10.20.193.28:0/2325046506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 msgr2=0x5654f88cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/2325046506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.399+0000 7fe7fce2d640 1 -- 10.20.193.28:0/2325046506 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654f871dc50 con 0x5654f8867850 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/2325046506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f8867c20 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=17871445862991998253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e80a93b0 tx=0x7fe7e80a8680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f80421534e432d2d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe7c54e4640 1 -- 10.20.193.28:0/2325046506 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7e80ad7e0 con 0x5654f8867850 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe7c54e4640 1 -- 10.20.193.28:0/2325046506 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7e80b2b00 con 0x5654f8867850 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe7c54e4640 1 -- 10.20.193.28:0/2325046506 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7e80e40d0 con 0x5654f8867850 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2325046506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 msgr2=0x5654f8867c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2325046506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f8867c20 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=17871445862991998253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e80a93b0 tx=0x7fe7e80a8680 comp rx=0 tx=0).stop 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2325046506 shutdown_connections 2026-02-20T13:20:32.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2325046506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88cd1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2325046506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 0x5654f88ac8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2325046506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f8867c20 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=17871445862991998253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2325046506 >> 10.20.193.28:0/2325046506 conn(0x5654f8785110 msgr2=0x5654f8866130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:32.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2325046506 shutdown_connections 2026-02-20T13:20:32.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.400+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2325046506 wait complete. 2026-02-20T13:20:32.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe8010b2e00 1 -- start start 2026-02-20T13:20:32.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe8010b2e00 1 Processor -- start 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f887f790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f8868160 0x5654f887fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f88ace00 0x5654f8884cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654f8885200 con 0x5654f8868160 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5654f8885370 con 0x5654f88ace00 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5654f8885530 con 0x5654f8867850 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe7fce2d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f887f790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe7effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f8868160 0x5654f887fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe7fce2d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f887f790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35834/0 (socket says 10.20.193.28:35834) 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.402+0000 7fe7fce2d640 1 -- 10.20.193.28:0/3760102826 learned_addr learned my addr 10.20.193.28:0/3760102826 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:32.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7fd62e640 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f88ace00 0x5654f8884cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7effff640 1 -- 10.20.193.28:0/3760102826 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 msgr2=0x5654f887f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7effff640 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f887f790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7effff640 1 -- 10.20.193.28:0/3760102826 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f88ace00 msgr2=0x5654f8884cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7effff640 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f88ace00 0x5654f8884cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7effff640 1 -- 10.20.193.28:0/3760102826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654f86f5e60 con 0x5654f8868160 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7effff640 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f8868160 0x5654f887fcd0 secure :-1 s=READY pgs=575 gs=1 cs=0 l=1 c_cookie=12066796378834282769 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e00097e0 tx=0x7fe7e0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a775df5fb9632911 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7b67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7b67fc640 1 -- 10.20.193.28:0/3760102826 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7e00388d0 con 0x5654f8868160 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7b67fc640 1 -- 10.20.193.28:0/3760102826 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7e003e040 con 0x5654f8868160 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7b67fc640 1 -- 10.20.193.28:0/3760102826 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7e0050e90 con 0x5654f8868160 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f80f7d90 con 0x5654f8868160 2026-02-20T13:20:32.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7b67fc640 1 -- 10.20.193.28:0/3760102826 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe7e00443f0 con 0x5654f8868160 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.403+0000 7fe7b67fc640 10 client.16560 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 10 client.16560 _ll_register_callbacks cb 0x5654f86f3320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654f8408eb0 con 0x5654f8868160 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe7b67fc640 1 -- 10.20.193.28:0/3760102826 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe7e0038a30 con 0x5654f8868160 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 10 client.16560 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5654f8707d80 con 0x5654f8868160 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe7b67fc640 1 -- 10.20.193.28:0/3760102826 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe7e0038bd0 con 0x5654f8868160 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 10 client.16560 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 10 client.16560 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 20 client.16560 populate_metadata read hostname 'trial028' 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654f88a9f20 0x5654f88aa3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 4 client.16560 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:32.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654f8744700 con 0x5654f88a9f20 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.404+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654f88a9f20 0x5654f88aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.405+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654f88a9f20 0x5654f88aa3c0 crc :-1 s=READY pgs=116 gs=4 cs=0 l=0 c_cookie=6647533451904742503 s_cookie=15151854188271828731 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c40c874514ef467 server_cookie=d246331b3474fefb in_seq=0 out_seq=0 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.405+0000 7fe7b67fc640 10 client.16560 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe7b67fc640 1 -- 10.20.193.28:0/3760102826 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5654f8744700 con 0x5654f88a9f20 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe7b67fc640 10 client.16560 handle_command_reply: tid=0 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 client.16560 shutdown 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f8868160 msgr2=0x5654f887fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f8868160 0x5654f887fcd0 secure :-1 s=READY pgs=575 gs=1 cs=0 l=1 c_cookie=12066796378834282769 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e00097e0 tx=0x7fe7e0005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 shutdown_connections 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654f88a9f20 0x5654f88aa3c0 crc :-1 s=READY pgs=116 gs=4 cs=0 l=0 c_cookie=6647533451904742503 s_cookie=15151854188271828731 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f8868160 0x5654f887fcd0 unknown :-1 s=CLOSED pgs=575 gs=1 cs=0 l=1 c_cookie=12066796378834282769 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f88ace00 0x5654f8884cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/3760102826 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f887f790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 >> 10.20.193.28:0/3760102826 conn(0x5654f8785110 msgr2=0x5654f8866840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:32.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe7b67fc640 0 client.16560 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:32.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 shutdown_connections 2026-02-20T13:20:32.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 1 -- 10.20.193.28:0/3760102826 wait complete. 2026-02-20T13:20:32.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.406+0000 7fe8010b2e00 20 client.16560 trim_cache size 0 max 16384 2026-02-20T13:20:32.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.416+0000 7fe8010b2e00 1 Processor -- start 2026-02-20T13:20:32.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.416+0000 7fe8010b2e00 1 -- start start 2026-02-20T13:20:32.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.416+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f88a40e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.416+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 0x5654f88a4620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.416+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88a4b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.416+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654f8770240 con 0x5654f88ace00 2026-02-20T13:20:32.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.416+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5654f8430ec0 con 0x5654f8868160 2026-02-20T13:20:32.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.416+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5654f8842ba0 con 0x5654f8867850 2026-02-20T13:20:32.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fce2d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f88a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46236/0 (socket says 10.20.193.28:46236) 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 -- 10.20.193.28:0/4140726304 learned_addr learned my addr 10.20.193.28:0/4140726304 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7effff640 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 0x5654f88a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 -- 10.20.193.28:0/4140726304 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 msgr2=0x5654f88a40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f88a40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 -- 10.20.193.28:0/4140726304 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 msgr2=0x5654f88a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 0x5654f88a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 -- 10.20.193.28:0/4140726304 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654f8872400 con 0x5654f88ace00 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f88a40e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.417+0000 7fe7fd62e640 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88a4b60 secure :-1 s=READY pgs=576 gs=1 cs=0 l=1 c_cookie=8578282851013407720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f400afa0 tx=0x7fe7f400a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770c2ecda57ab3e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:32.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe7c4ce3640 1 -- 10.20.193.28:0/4140726304 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7f4018040 con 0x5654f88ace00 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe7c4ce3640 1 -- 10.20.193.28:0/4140726304 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7f4003c60 con 0x5654f88ace00 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe7c4ce3640 1 -- 10.20.193.28:0/4140726304 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7f401dc40 con 0x5654f88ace00 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 -- 10.20.193.28:0/4140726304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 msgr2=0x5654f88a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88a4b60 secure :-1 s=READY pgs=576 gs=1 cs=0 l=1 c_cookie=8578282851013407720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f400afa0 tx=0x7fe7f400a310 comp rx=0 tx=0).stop 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 -- 10.20.193.28:0/4140726304 shutdown_connections 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f88a4b60 unknown :-1 s=CLOSED pgs=576 gs=1 cs=0 l=1 c_cookie=8578282851013407720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8868160 0x5654f88a4620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/4140726304 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8867850 0x5654f88a40e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 -- 10.20.193.28:0/4140726304 >> 10.20.193.28:0/4140726304 conn(0x5654f8785110 msgr2=0x5654f8865a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 -- 10.20.193.28:0/4140726304 shutdown_connections 2026-02-20T13:20:32.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.418+0000 7fe8010b2e00 1 -- 10.20.193.28:0/4140726304 wait complete. 2026-02-20T13:20:32.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe8010b2e00 1 -- start start 2026-02-20T13:20:32.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe8010b2e00 1 Processor -- start 2026-02-20T13:20:32.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8867850 0x5654f8887ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8868160 0x5654f8888060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe8010b2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f888af00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654f8885670 con 0x5654f88ace00 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5654f888b440 con 0x5654f8867850 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe8010b2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5654f888b600 con 0x5654f8868160 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe7fd62e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f888af00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe7fd62e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f888af00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46242/0 (socket says 10.20.193.28:46242) 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.419+0000 7fe7fd62e640 1 -- 10.20.193.28:0/2170089201 learned_addr learned my addr 10.20.193.28:0/2170089201 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8867850 0x5654f8887ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7effff640 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8868160 0x5654f8888060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7fd62e640 1 -- 10.20.193.28:0/2170089201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8868160 msgr2=0x5654f8888060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7fd62e640 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8868160 0x5654f8888060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7fd62e640 1 -- 10.20.193.28:0/2170089201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8867850 msgr2=0x5654f8887ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:32.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7fd62e640 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8867850 0x5654f8887ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7fd62e640 1 -- 10.20.193.28:0/2170089201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f400ac40 con 0x5654f88ace00 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7fd62e640 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f888af00 secure :-1 s=READY pgs=577 gs=1 cs=0 l=1 c_cookie=2474211420271419436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f400b010 tx=0x7fe7f4003470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22562a2d847e202c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7b67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7b67fc640 1 -- 10.20.193.28:0/2170089201 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7f4003780 con 0x5654f88ace00 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7b67fc640 1 -- 10.20.193.28:0/2170089201 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7f40038e0 con 0x5654f88ace00 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7b67fc640 1 -- 10.20.193.28:0/2170089201 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7f4028d00 con 0x5654f88ace00 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654f871dc50 con 0x5654f88ace00 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe8010b2e00 10 client.16566 _ll_register_callbacks cb 0x5654f86f3320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7e80b2b00 con 0x5654f88ace00 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.420+0000 7fe7b67fc640 1 -- 10.20.193.28:0/2170089201 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe7f4003a50 con 0x5654f88ace00 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe7b67fc640 1 -- 10.20.193.28:0/2170089201 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe7f40051d0 con 0x5654f88ace00 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe8010b2e00 10 client.16566 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:32.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5654f8702800 con 0x5654f88ace00 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe7b67fc640 1 -- 10.20.193.28:0/2170089201 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe7f402f060 con 0x5654f88ace00 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe8010b2e00 10 client.16566 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe8010b2e00 10 client.16566 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe8010b2e00 20 client.16566 populate_metadata read hostname 'trial028' 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654f895ab30 0x5654f897afe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe8010b2e00 4 client.16566 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.1, "await_for": 45.0}] 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.1, "await_for": 45.0}) -- 0x5654f8451a60 con 0x5654f895ab30 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.421+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654f895ab30 0x5654f897afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.422+0000 7fe7fce2d640 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654f895ab30 0x5654f897afe0 crc :-1 s=READY pgs=117 gs=4 cs=0 l=0 c_cookie=18035687384847633201 s_cookie=8023388944050972365 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4ba21e8dd64b31 server_cookie=6f58cdbc20f466cd in_seq=0 out_seq=0 2026-02-20T13:20:32.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.422+0000 7fe7b67fc640 10 client.16566 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:32.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.428+0000 7fe7b67fc640 1 -- 10.20.193.28:0/2170089201 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5654f8451a60 con 0x5654f895ab30 2026-02-20T13:20:32.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.428+0000 7fe7b67fc640 10 client.16566 handle_command_reply: tid=0 2026-02-20T13:20:32.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.428+0000 7fe8010b2e00 1 client.16566 shutdown 2026-02-20T13:20:32.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 msgr2=0x5654f888af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f888af00 secure :-1 s=READY pgs=577 gs=1 cs=0 l=1 c_cookie=2474211420271419436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f400b010 tx=0x7fe7f4003470 comp rx=0 tx=0).stop 2026-02-20T13:20:32.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 shutdown_connections 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5654f895ab30 0x5654f897afe0 crc :-1 s=READY pgs=117 gs=4 cs=0 l=0 c_cookie=18035687384847633201 s_cookie=8023388944050972365 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654f88ace00 0x5654f888af00 unknown :-1 s=CLOSED pgs=577 gs=1 cs=0 l=1 c_cookie=2474211420271419436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5654f8868160 0x5654f8888060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 --2- 10.20.193.28:0/2170089201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5654f8867850 0x5654f8887ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 >> 10.20.193.28:0/2170089201 conn(0x5654f8785110 msgr2=0x5654f8866220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe7b67fc640 0 client.16566 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 shutdown_connections 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 1 -- 10.20.193.28:0/2170089201 wait complete. 2026-02-20T13:20:32.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.429+0000 7fe8010b2e00 20 client.16566 trim_cache size 0 max 16384 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 10, 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout: "f92cbbdf": { 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout: "version": 10, 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:20:32.434 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 148.1, 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:20:32.435 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:32.436 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:32.436 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:32.436 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:32.436 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:32.436 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7d40b5760 msgr2=0x7fe7d40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7d40b5760 0x7fe7d40d5c10 secure :-1 s=READY pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f80f7b10 tx=0x7fe7e003a040 comp rx=0 tx=0).stop 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7f810b150 msgr2=0x7fe7f80f1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7f810b150 0x7fe7f80f1170 secure :-1 s=READY pgs=574 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e8004740 tx=0x7fe7e800ee60 comp rx=0 tx=0).stop 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3534884838 shutdown_connections 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7d40b5760 0x7fe7d40d5c10 unknown :-1 s=CLOSED pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7f8111160 0x7fe7f80f6a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f810bb40 0x7fe7f80f16b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 --2- 10.20.193.28:0/3534884838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7f810b150 0x7fe7f80f1170 unknown :-1 s=CLOSED pgs=574 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:32.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3534884838 >> 10.20.193.28:0/3534884838 conn(0x7fe7f80e8ce0 msgr2=0x7fe7f810efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:32.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3534884838 shutdown_connections 2026-02-20T13:20:32.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:32.430+0000 7fe7fde2f640 1 -- 10.20.193.28:0/3534884838 wait complete. 2026-02-20T13:20:32.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:32 trial028 ceph-mon[37442]: pgmap v277: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:20:32.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:32 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/558236027' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:32.533 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f92cbbdf', quiesce took 1.1 seconds. Will release after: 27.0 2026-02-20T13:20:32.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:32 trial127 ceph-mon[43817]: pgmap v277: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:20:32.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:32 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/558236027' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:32.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:32 trial034 ceph-mon[43332]: pgmap v277: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:20:32.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:32 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/558236027' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:34.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:34 trial127 ceph-mon[43817]: pgmap v278: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:20:34.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:34 trial034 ceph-mon[43332]: pgmap v278: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:20:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:34 trial028 ceph-mon[37442]: pgmap v278: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:20:35.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:35 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:20:35.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:35 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:20:35.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:35 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:20:36.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:36 trial127 ceph-mon[43817]: pgmap v279: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:20:36.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:20:36.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:20:36.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:20:36.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:20:36.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:36 trial034 ceph-mon[43332]: pgmap v279: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:20:36.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:20:36.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:20:36.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:20:36.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:20:36.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:36 trial028 ceph-mon[37442]: pgmap v279: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:20:36.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:20:36.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:20:36.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:20:36.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:20:38.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:38 trial127 ceph-mon[43817]: pgmap v280: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:20:38.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:38 trial034 ceph-mon[43332]: pgmap v280: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:20:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:38 trial028 ceph-mon[37442]: pgmap v280: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:20:40.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:40 trial127 ceph-mon[43817]: pgmap v281: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 15 op/s 2026-02-20T13:20:40.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:40 trial034 ceph-mon[43332]: pgmap v281: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 15 op/s 2026-02-20T13:20:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:40 trial028 ceph-mon[37442]: pgmap v281: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 15 op/s 2026-02-20T13:20:42.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:42 trial127 ceph-mon[43817]: pgmap v282: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 17 op/s 2026-02-20T13:20:42.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:42 trial034 ceph-mon[43332]: pgmap v282: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 17 op/s 2026-02-20T13:20:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:42 trial028 ceph-mon[37442]: pgmap v282: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 17 op/s 2026-02-20T13:20:44.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:44 trial127 ceph-mon[43817]: pgmap v283: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2026-02-20T13:20:44.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:44 trial034 ceph-mon[43332]: pgmap v283: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2026-02-20T13:20:44.766 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:20:44.819 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:44 trial028 ceph-mon[37442]: pgmap v283: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2026-02-20T13:20:44.956 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 -- 10.20.193.28:0/1983887137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c410e940 msgr2=0x7f97c410edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 --2- 10.20.193.28:0/1983887137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c410e940 0x7f97c410edb0 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=14827150232105449046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b8009950 tx=0x7f97b802f190 comp rx=0 tx=0).stop 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 -- 10.20.193.28:0/1983887137 shutdown_connections 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 --2- 10.20.193.28:0/1983887137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97c410f2f0 0x7f97c4171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 --2- 10.20.193.28:0/1983887137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c410e940 0x7f97c410edb0 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=14827150232105449046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 --2- 10.20.193.28:0/1983887137 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97c41100b0 0x7f97c41104a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 -- 10.20.193.28:0/1983887137 >> 10.20.193.28:0/1983887137 conn(0x7f97c40ec320 msgr2=0x7f97c410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 -- 10.20.193.28:0/1983887137 shutdown_connections 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.954+0000 7f97caf54640 1 -- 10.20.193.28:0/1983887137 wait complete. 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97caf54640 1 Processor -- start 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97caf54640 1 -- start start 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97caf54640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97c410e940 0x7f97c40f8240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97caf54640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97c410f2f0 0x7f97c4171060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97caf54640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c41100b0 0x7f97c40f8a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97caf54640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40f96e0 con 0x7f97c410e940 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97caf54640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40f9850 con 0x7f97c41100b0 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97caf54640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40f9a10 con 0x7f97c410f2f0 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97c9f52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97c410e940 0x7f97c40f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97c9f52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97c410e940 0x7f97c40f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54010/0 (socket says 10.20.193.28:54010) 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97c9751640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97c410f2f0 0x7f97c4171060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97c9f52640 1 -- 10.20.193.28:0/1543452274 learned_addr learned my addr 10.20.193.28:0/1543452274 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.955+0000 7f97ca753640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c41100b0 0x7f97c40f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97c9f52640 1 -- 10.20.193.28:0/1543452274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97c410f2f0 msgr2=0x7f97c4171060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97c9f52640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97c410f2f0 0x7f97c4171060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97c9f52640 1 -- 10.20.193.28:0/1543452274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c41100b0 msgr2=0x7f97c40f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97c9f52640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c41100b0 0x7f97c40f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97c9f52640 1 -- 10.20.193.28:0/1543452274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c000a590 con 0x7f97c410e940 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97ca753640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c41100b0 0x7f97c40f8a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97c9f52640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97c410e940 0x7f97c40f8240 secure :-1 s=READY pgs=578 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b4009480 tx=0x7f97b400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97b2ffd640 1 -- 10.20.193.28:0/1543452274 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97b400cd40 con 0x7f97c410e940 2026-02-20T13:20:44.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97caf54640 1 -- 10.20.193.28:0/1543452274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b8009570 con 0x7f97c410e940 2026-02-20T13:20:44.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97b2ffd640 1 -- 10.20.193.28:0/1543452274 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97b4004d30 con 0x7f97c410e940 2026-02-20T13:20:44.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97b2ffd640 1 -- 10.20.193.28:0/1543452274 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97b40106b0 con 0x7f97c410e940 2026-02-20T13:20:44.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.956+0000 7f97caf54640 1 -- 10.20.193.28:0/1543452274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c40fa030 con 0x7f97c410e940 2026-02-20T13:20:44.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.959+0000 7f97b2ffd640 1 -- 10.20.193.28:0/1543452274 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f97b401f060 con 0x7f97c410e940 2026-02-20T13:20:44.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.960+0000 7f97b2ffd640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97a00b5760 0x7f97a00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.960+0000 7f97b2ffd640 1 -- 10.20.193.28:0/1543452274 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97b4014070 con 0x7f97c410e940 2026-02-20T13:20:44.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97c9751640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97a00b5760 0x7f97a00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ce7bfe00 1 Processor -- start 2026-02-20T13:20:44.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ce7bfe00 1 -- start start 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b168a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b371c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b57ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e302a0bfd0 con 0x55e302b16de0 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e302a07d00 con 0x55e302af64c0 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e302a01ca0 con 0x55e302b37700 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97c9751640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97a00b5760 0x7f97a00d5c10 secure :-1 s=READY pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b8002db0 tx=0x7f97b803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ca753640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b57ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97c9f52640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ca753640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b57ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:55912/0 (socket says 10.20.193.28:55912) 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.961+0000 7f97ca753640 1 -- 10.20.193.28:0/4114269187 learned_addr learned my addr 10.20.193.28:0/4114269187 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97c9751640 1 --2- 10.20.193.28:0/4114269187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97c9f52640 1 -- 10.20.193.28:0/4114269187 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 msgr2=0x55e302b57ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97c9f52640 1 --2- 10.20.193.28:0/4114269187 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b57ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97c9f52640 1 -- 10.20.193.28:0/4114269187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 msgr2=0x55e302b371c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97c9f52640 1 --2- 10.20.193.28:0/4114269187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b371c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97c9f52640 1 -- 10.20.193.28:0/4114269187 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3029a48b0 con 0x55e302af64c0 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97c9f52640 1 --2- 10.20.193.28:0/4114269187 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b168a0 secure :-1 s=READY pgs=237 gs=2 cs=0 l=1 c_cookie=15671353873240935842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b40e48f0 tx=0x7f97b40a9050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97bd5513bf7cda2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97923ff640 1 -- 10.20.193.28:0/4114269187 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97b40ac9b0 con 0x55e302af64c0 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97923ff640 1 -- 10.20.193.28:0/4114269187 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97b40adbb0 con 0x55e302af64c0 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97923ff640 1 -- 10.20.193.28:0/4114269187 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97b40acfd0 con 0x55e302af64c0 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4114269187 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 msgr2=0x55e302b168a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4114269187 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b168a0 secure :-1 s=READY pgs=237 gs=2 cs=0 l=1 c_cookie=15671353873240935842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b40e48f0 tx=0x7f97b40a9050 comp rx=0 tx=0).stop 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4114269187 shutdown_connections 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4114269187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b371c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4114269187 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b57ae0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4114269187 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b168a0 unknown :-1 s=CLOSED pgs=237 gs=2 cs=0 l=1 c_cookie=15671353873240935842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4114269187 >> 10.20.193.28:0/4114269187 conn(0x55e302a151c0 msgr2=0x55e302af4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4114269187 shutdown_connections 2026-02-20T13:20:44.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.962+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4114269187 wait complete. 2026-02-20T13:20:44.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ce7bfe00 1 -- start start 2026-02-20T13:20:44.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ce7bfe00 1 Processor -- start 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b0fb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b10170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b10bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e302b11230 con 0x55e302b16de0 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e302b113a0 con 0x55e302af64c0 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e302b11560 con 0x55e302b37700 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97c9f52640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b0fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97c9f52640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b0fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52006/0 (socket says 10.20.193.28:52006) 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97c9f52640 1 -- 10.20.193.28:0/2853090660 learned_addr learned my addr 10.20.193.28:0/2853090660 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.964+0000 7f97ca753640 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b10bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97c9751640 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b10170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97c9f52640 1 -- 10.20.193.28:0/2853090660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 msgr2=0x55e302b10bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97c9f52640 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b10bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97c9f52640 1 -- 10.20.193.28:0/2853090660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 msgr2=0x55e302b10170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97c9f52640 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b10170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97c9f52640 1 -- 10.20.193.28:0/2853090660 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3029ad400 con 0x55e302af64c0 2026-02-20T13:20:44.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97c9751640 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b10170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97c9f52640 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b0fb20 secure :-1 s=READY pgs=238 gs=2 cs=0 l=1 c_cookie=15880415941478903564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b40aa420 tx=0x7f97b40052e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc629229254cef0c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f977f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f977f7fe640 1 -- 10.20.193.28:0/2853090660 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97b406f070 con 0x55e302af64c0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f977f7fe640 1 -- 10.20.193.28:0/2853090660 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97b4071070 con 0x55e302af64c0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b40d0e70 con 0x55e302af64c0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f977f7fe640 1 -- 10.20.193.28:0/2853090660 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97b40ae0c0 con 0x55e302af64c0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f977f7fe640 1 -- 10.20.193.28:0/2853090660 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97b40b7e60 con 0x55e302af64c0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.965+0000 7f97ce7bfe00 10 client.26555 _ll_register_callbacks cb 0x55e30298ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e3026a1520 con 0x55e302af64c0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f977f7fe640 1 -- 10.20.193.28:0/2853090660 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97b40b82f0 con 0x55e302af64c0 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 10 client.26555 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:44.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e302985da0 con 0x55e302af64c0 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f977f7fe640 1 -- 10.20.193.28:0/2853090660 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97b4072340 con 0x55e302af64c0 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 10 client.26555 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 10 client.26555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 20 client.26555 populate_metadata read hostname 'trial028' 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e302b13f40 0x55e302b143e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 4 client.26555 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e302a33630 con 0x55e302b13f40 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.966+0000 7f97c9751640 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e302b13f40 0x55e302b143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97c9751640 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e302b13f40 0x55e302b143e0 crc :-1 s=READY pgs=118 gs=4 cs=0 l=0 c_cookie=16427049657600889220 s_cookie=11804574637699415265 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f89aa11d00d184 server_cookie=a3d24616f4a8bce1 in_seq=0 out_seq=0 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f977f7fe640 10 client.26555 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:44.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f977f7fe640 1 -- 10.20.193.28:0/2853090660 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e302a33630 con 0x55e302b13f40 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f977f7fe640 10 client.26555 handle_command_reply: tid=0 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 client.26555 shutdown 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 msgr2=0x55e302b0fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b0fb20 secure :-1 s=READY pgs=238 gs=2 cs=0 l=1 c_cookie=15880415941478903564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b40aa420 tx=0x7f97b40052e0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 shutdown_connections 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e302b13f40 0x55e302b143e0 crc :-1 s=READY pgs=118 gs=4 cs=0 l=0 c_cookie=16427049657600889220 s_cookie=11804574637699415265 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b10170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b10bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2853090660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b0fb20 unknown :-1 s=CLOSED pgs=238 gs=2 cs=0 l=1 c_cookie=15880415941478903564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f977f7fe640 0 client.26555 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 >> 10.20.193.28:0/2853090660 conn(0x55e302a151c0 msgr2=0x55e302af7790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.967+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 shutdown_connections 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.968+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2853090660 wait complete. 2026-02-20T13:20:44.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.968+0000 7f97ce7bfe00 20 client.26555 trim_cache size 0 max 16384 2026-02-20T13:20:44.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.975+0000 7f97ce7bfe00 1 Processor -- start 2026-02-20T13:20:44.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ce7bfe00 1 -- start start 2026-02-20T13:20:44.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302af64c0 0x55e302b0ce50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b0d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302b37700 0x55e302b355c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e3029ff8d0 con 0x55e302b16de0 2026-02-20T13:20:44.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e302740f10 con 0x55e302b37700 2026-02-20T13:20:44.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e302afaae0 con 0x55e302af64c0 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302b37700 0x55e302b355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302b37700 0x55e302b355c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52016/0 (socket says 10.20.193.28:52016) 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 -- 10.20.193.28:0/2387363476 learned_addr learned my addr 10.20.193.28:0/2387363476 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97c9f52640 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302af64c0 0x55e302b0ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97c9751640 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b0d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 -- 10.20.193.28:0/2387363476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302af64c0 msgr2=0x55e302b0ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302af64c0 0x55e302b0ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 -- 10.20.193.28:0/2387363476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 msgr2=0x55e302b0d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b0d390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 -- 10.20.193.28:0/2387363476 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e302997670 con 0x55e302b37700 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97c9f52640 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302af64c0 0x55e302b0ce50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97c9751640 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b0d390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.976+0000 7f97ca753640 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302b37700 0x55e302b355c0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=11723825672143535526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c000a8e0 tx=0x7f97c000a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b3655554b87da6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f9791bfe640 1 -- 10.20.193.28:0/2387363476 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97c0018070 con 0x55e302b37700 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f9791bfe640 1 -- 10.20.193.28:0/2387363476 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97c0019040 con 0x55e302b37700 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2387363476 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302b37700 msgr2=0x55e302b355c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302b37700 0x55e302b355c0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=11723825672143535526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c000a8e0 tx=0x7f97c000a310 comp rx=0 tx=0).stop 2026-02-20T13:20:44.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2387363476 shutdown_connections 2026-02-20T13:20:44.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b0d390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302b37700 0x55e302b355c0 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=11723825672143535526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/2387363476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302af64c0 0x55e302b0ce50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2387363476 >> 10.20.193.28:0/2387363476 conn(0x55e302a151c0 msgr2=0x55e302b0f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:44.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2387363476 shutdown_connections 2026-02-20T13:20:44.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.977+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/2387363476 wait complete. 2026-02-20T13:20:44.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ce7bfe00 1 -- start start 2026-02-20T13:20:44.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ce7bfe00 1 Processor -- start 2026-02-20T13:20:44.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b1a160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b1a6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ce7bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b1b350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e302b1b890 con 0x55e302b16de0 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e302b1ba00 con 0x55e302af64c0 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ce7bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e302b1bbc0 con 0x55e302b37700 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ca753640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b1b350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ca753640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b1b350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:55932/0 (socket says 10.20.193.28:55932) 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97ca753640 1 -- 10.20.193.28:0/4082709950 learned_addr learned my addr 10.20.193.28:0/4082709950 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.978+0000 7f97c9f52640 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b1a160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ca753640 1 -- 10.20.193.28:0/4082709950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 msgr2=0x55e302b1a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:44.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ca753640 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b1a160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ca753640 1 -- 10.20.193.28:0/4082709950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 msgr2=0x55e302b1a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:44.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97c9751640 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b1a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ca753640 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b1a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ca753640 1 -- 10.20.193.28:0/4082709950 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3029920f0 con 0x55e302b37700 2026-02-20T13:20:44.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97c9751640 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b1a6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:44.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ca753640 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b1b350 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=13375507307910242280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c000a560 tx=0x7f97c0013f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b99f5907b2a19fe8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:44.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f977f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:44.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f977f7fe640 1 -- 10.20.193.28:0/4082709950 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97c0018070 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f977f7fe640 1 -- 10.20.193.28:0/4082709950 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97c0003e00 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f977f7fe640 1 -- 10.20.193.28:0/4082709950 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97c001e870 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c0005540 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f977f7fe640 1 -- 10.20.193.28:0/4082709950 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97c001ea00 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ce7bfe00 10 client.26500 _ll_register_callbacks cb 0x55e30298ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.979+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e302ab1ca0 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f977f7fe640 1 -- 10.20.193.28:0/4082709950 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97c0005c30 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97ce7bfe00 10 client.26500 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e3029860d0 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f977f7fe640 1 -- 10.20.193.28:0/4082709950 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97c0006030 con 0x55e302b37700 2026-02-20T13:20:44.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97ce7bfe00 10 client.26500 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:44.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97ce7bfe00 10 client.26500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:44.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97ce7bfe00 20 client.26500 populate_metadata read hostname 'trial028' 2026-02-20T13:20:44.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e302be4750 0x55e302c04c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:44.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97ce7bfe00 4 client.26500 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:20:44.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3026e5640 con 0x55e302be4750 2026-02-20T13:20:44.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.980+0000 7f97c9f52640 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e302be4750 0x55e302c04c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:44.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.981+0000 7f97c9f52640 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e302be4750 0x55e302c04c00 crc :-1 s=READY pgs=119 gs=4 cs=0 l=0 c_cookie=2272298647331981842 s_cookie=2632944526154756956 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f88d394a1d2ca12 server_cookie=248a1918bac3735c in_seq=0 out_seq=0 2026-02-20T13:20:44.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.981+0000 7f977f7fe640 10 client.26500 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:44.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f977f7fe640 1 -- 10.20.193.28:0/4082709950 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e3026e5640 con 0x55e302be4750 2026-02-20T13:20:44.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f977f7fe640 10 client.26500 handle_command_reply: tid=0 2026-02-20T13:20:44.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 client.26500 shutdown 2026-02-20T13:20:44.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 msgr2=0x55e302b1b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b1b350 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=13375507307910242280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c000a560 tx=0x7f97c0013f50 comp rx=0 tx=0).stop 2026-02-20T13:20:44.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 shutdown_connections 2026-02-20T13:20:44.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e302be4750 0x55e302c04c00 crc :-1 s=READY pgs=119 gs=4 cs=0 l=0 c_cookie=2272298647331981842 s_cookie=2632944526154756956 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e302b16de0 0x55e302b1a6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e302b37700 0x55e302b1b350 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=13375507307910242280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 --2- 10.20.193.28:0/4082709950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e302af64c0 0x55e302b1a160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f977f7fe640 0 client.26500 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 >> 10.20.193.28:0/4082709950 conn(0x55e302a151c0 msgr2=0x55e302b0be40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 shutdown_connections 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 1 -- 10.20.193.28:0/4082709950 wait complete. 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97ce7bfe00 20 client.26500 trim_cache size 0 max 16384 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:20:44.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:20:44.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:20:44.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:20:44.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97caf54640 1 -- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97a00b5760 msgr2=0x7f97a00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97caf54640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97a00b5760 0x7f97a00d5c10 secure :-1 s=READY pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b8002db0 tx=0x7f97b803a040 comp rx=0 tx=0).stop 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97caf54640 1 -- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97c410e940 msgr2=0x7f97c40f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.987+0000 7f97caf54640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97c410e940 0x7f97c40f8240 secure :-1 s=READY pgs=578 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b4009480 tx=0x7f97b400ee60 comp rx=0 tx=0).stop 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.989+0000 7f97caf54640 1 -- 10.20.193.28:0/1543452274 shutdown_connections 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.989+0000 7f97caf54640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97a00b5760 0x7f97a00d5c10 unknown :-1 s=CLOSED pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.989+0000 7f97caf54640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97c41100b0 0x7f97c40f8a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.989+0000 7f97caf54640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97c410f2f0 0x7f97c4171060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.989+0000 7f97caf54640 1 --2- 10.20.193.28:0/1543452274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97c410e940 0x7f97c40f8240 unknown :-1 s=CLOSED pgs=578 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.989+0000 7f97caf54640 1 -- 10.20.193.28:0/1543452274 >> 10.20.193.28:0/1543452274 conn(0x7f97c40ec320 msgr2=0x7f97c40ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.989+0000 7f97caf54640 1 -- 10.20.193.28:0/1543452274 shutdown_connections 2026-02-20T13:20:44.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:44.989+0000 7f97caf54640 1 -- 10.20.193.28:0/1543452274 wait complete. 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 -- 10.20.193.28:0/3040710546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e1810dbd0 msgr2=0x7f5e1810dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/3040710546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e1810dbd0 0x7f5e1810dfa0 secure :-1 s=READY pgs=240 gs=2 cs=0 l=1 c_cookie=3274505274261742082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e08009890 tx=0x7f5e0802f0e0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 -- 10.20.193.28:0/3040710546 shutdown_connections 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/3040710546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e1810e5c0 0x7f5e18152c40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/3040710546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e18153180 0x7f5e181735a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/3040710546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e1810dbd0 0x7f5e1810dfa0 unknown :-1 s=CLOSED pgs=240 gs=2 cs=0 l=1 c_cookie=3274505274261742082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 -- 10.20.193.28:0/3040710546 >> 10.20.193.28:0/3040710546 conn(0x7f5e180e95a0 msgr2=0x7f5e181099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 -- 10.20.193.28:0/3040710546 shutdown_connections 2026-02-20T13:20:45.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.124+0000 7f5e1df7e640 1 -- 10.20.193.28:0/3040710546 wait complete. 2026-02-20T13:20:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.125+0000 7f5e1df7e640 1 Processor -- start 2026-02-20T13:20:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.125+0000 7f5e1df7e640 1 -- start start 2026-02-20T13:20:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1df7e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e1810dbd0 0x7f5e18161bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1df7e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e1810e5c0 0x7f5e18162100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1df7e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e18153180 0x7f5e181674d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1df7e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e18167af0 con 0x7f5e1810dbd0 2026-02-20T13:20:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1df7e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5e18167c60 con 0x7f5e18153180 2026-02-20T13:20:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1df7e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5e18167e20 con 0x7f5e1810e5c0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e1810dbd0 0x7f5e18161bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e1810e5c0 0x7f5e18162100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e1810dbd0 0x7f5e18161bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54048/0 (socket says 10.20.193.28:54048) 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/1695962571 learned_addr learned my addr 10.20.193.28:0/1695962571 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e18153180 0x7f5e181674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/1695962571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e1810e5c0 msgr2=0x7f5e18162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e1810e5c0 0x7f5e18162100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/1695962571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e18153180 msgr2=0x7f5e181674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e18153180 0x7f5e181674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/1695962571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080094b0 con 0x7f5e1810dbd0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.126+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e1810dbd0 0x7f5e18161bc0 secure :-1 s=READY pgs=579 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e080023b0 tx=0x7f5e080028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.127+0000 7f5e0dffb640 1 -- 10.20.193.28:0/1695962571 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e0803d070 con 0x7f5e1810dbd0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.127+0000 7f5e0dffb640 1 -- 10.20.193.28:0/1695962571 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e080044f0 con 0x7f5e1810dbd0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.127+0000 7f5e0dffb640 1 -- 10.20.193.28:0/1695962571 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e080419e0 con 0x7f5e1810dbd0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.127+0000 7f5e1df7e640 1 -- 10.20.193.28:0/1695962571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e181680a0 con 0x7f5e1810dbd0 2026-02-20T13:20:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.127+0000 7f5e1df7e640 1 -- 10.20.193.28:0/1695962571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e1814ec00 con 0x7f5e1810dbd0 2026-02-20T13:20:45.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.130+0000 7f5e0dffb640 1 -- 10.20.193.28:0/1695962571 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5e08048020 con 0x7f5e1810dbd0 2026-02-20T13:20:45.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.131+0000 7f5e0dffb640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5df40b5760 0x7f5df40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.131+0000 7f5e0dffb640 1 -- 10.20.193.28:0/1695962571 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e0810ad80 con 0x7f5e1810dbd0 2026-02-20T13:20:45.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.131+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5df40b5760 0x7f5df40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.132+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5df40b5760 0x7f5df40d5c10 secure :-1 s=READY pgs=334 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e18168560 tx=0x7f5e00009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:45.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.132+0000 7f5e21201e00 1 Processor -- start 2026-02-20T13:20:45.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.132+0000 7f5e21201e00 1 -- start start 2026-02-20T13:20:45.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fd180 0x5620c40fd550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4142400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4162d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e21201e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5620c40137d0 con 0x5620c4142940 2026-02-20T13:20:45.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e21201e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5620c400f500 con 0x5620c40fda90 2026-02-20T13:20:45.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e21201e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5620c40094a0 con 0x5620c40fd180 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4142400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fd180 0x5620c40fd550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4142400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52062/0 (socket says 10.20.193.28:52062) 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 -- 10.20.193.28:0/566313801 learned_addr learned my addr 10.20.193.28:0/566313801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4162d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 -- 10.20.193.28:0/566313801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fd180 msgr2=0x5620c40fd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fd180 0x5620c40fd550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 -- 10.20.193.28:0/566313801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 msgr2=0x5620c4162d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4162d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 -- 10.20.193.28:0/566313801 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c3fb4d80 con 0x5620c40fda90 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4162d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.133+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4142400 secure :-1 s=READY pgs=241 gs=2 cs=0 l=1 c_cookie=7456790017148740162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e000040c0 tx=0x7f5e00013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=677bd70348d46242 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5de54e4640 1 -- 10.20.193.28:0/566313801 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e0001d460 con 0x5620c40fda90 2026-02-20T13:20:45.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5de54e4640 1 -- 10.20.193.28:0/566313801 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e0001daa0 con 0x5620c40fda90 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5de54e4640 1 -- 10.20.193.28:0/566313801 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e0001aaa0 con 0x5620c40fda90 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 -- 10.20.193.28:0/566313801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 msgr2=0x5620c4142400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4142400 secure :-1 s=READY pgs=241 gs=2 cs=0 l=1 c_cookie=7456790017148740162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e000040c0 tx=0x7f5e00013000 comp rx=0 tx=0).stop 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 -- 10.20.193.28:0/566313801 shutdown_connections 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4162d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4142400 unknown :-1 s=CLOSED pgs=241 gs=2 cs=0 l=1 c_cookie=7456790017148740162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 --2- 10.20.193.28:0/566313801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fd180 0x5620c40fd550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 -- 10.20.193.28:0/566313801 >> 10.20.193.28:0/566313801 conn(0x5620c40db680 msgr2=0x5620c40fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 -- 10.20.193.28:0/566313801 shutdown_connections 2026-02-20T13:20:45.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.134+0000 7f5e21201e00 1 -- 10.20.193.28:0/566313801 wait complete. 2026-02-20T13:20:45.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.135+0000 7f5e21201e00 1 -- start start 2026-02-20T13:20:45.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.136+0000 7f5e21201e00 1 Processor -- start 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.136+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c415a180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.136+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c415a6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.136+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c4142940 0x5620c415f6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.136+0000 7f5e21201e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5620c415fbf0 con 0x5620c40fd180 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.136+0000 7f5e21201e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5620c415fd60 con 0x5620c4142940 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.136+0000 7f5e21201e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5620c415ff20 con 0x5620c40fda90 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.136+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54064/0 (socket says 10.20.193.28:54064) 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/2722259861 learned_addr learned my addr 10.20.193.28:0/2722259861 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c4142940 0x5620c415f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/2722259861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 msgr2=0x5620c415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c4142940 msgr2=0x5620c415f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c4142940 0x5620c415f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/2722259861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c3f8d350 con 0x5620c40fd180 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c4142940 0x5620c415f6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c415a180 secure :-1 s=READY pgs=580 gs=1 cs=0 l=1 c_cookie=2243841403709880169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e080093c0 tx=0x7f5e0802f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f23b9de4870f769 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5dd67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5dd67fc640 1 -- 10.20.193.28:0/2722259861 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e080d08e0 con 0x5620c40fd180 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5dd67fc640 1 -- 10.20.193.28:0/2722259861 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e08005d40 con 0x5620c40fd180 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5dd67fc640 1 -- 10.20.193.28:0/2722259861 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e080964f0 con 0x5620c40fd180 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e00009890 con 0x5620c40fd180 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5dd67fc640 1 -- 10.20.193.28:0/2722259861 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e080cf0c0 con 0x5620c40fd180 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5dd67fc640 10 client.16590 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.137+0000 7f5e21201e00 10 client.16590 _ll_register_callbacks cb 0x5620c3f8a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5620c3c9f6f0 con 0x5620c40fd180 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5dd67fc640 1 -- 10.20.193.28:0/2722259861 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e080d93e0 con 0x5620c40fd180 2026-02-20T13:20:45.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 10 client.16590 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5620c3f9f150 con 0x5620c40fd180 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5dd67fc640 1 -- 10.20.193.28:0/2722259861 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e080db040 con 0x5620c40fd180 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 10 client.16590 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 20 client.16590 populate_metadata read hostname 'trial028' 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5620c413f850 0x5620c413fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 4 client.16590 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620c4016d60 con 0x5620c413f850 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.138+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5620c413f850 0x5620c413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.139+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5620c413f850 0x5620c413fcf0 crc :-1 s=READY pgs=120 gs=4 cs=0 l=0 c_cookie=13803767826914980792 s_cookie=2216591489137540032 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf90d5b3fd3bb3b8 server_cookie=1ec2ea3722327bc0 in_seq=0 out_seq=0 2026-02-20T13:20:45.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.139+0000 7f5dd67fc640 10 client.16590 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:45.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.139+0000 7f5dd67fc640 1 -- 10.20.193.28:0/2722259861 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5620c4016d60 con 0x5620c413f850 2026-02-20T13:20:45.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.139+0000 7f5dd67fc640 10 client.16590 handle_command_reply: tid=0 2026-02-20T13:20:45.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.139+0000 7f5e21201e00 1 client.16590 shutdown 2026-02-20T13:20:45.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 msgr2=0x5620c415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c415a180 secure :-1 s=READY pgs=580 gs=1 cs=0 l=1 c_cookie=2243841403709880169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e080093c0 tx=0x7f5e0802f0e0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 shutdown_connections 2026-02-20T13:20:45.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5620c413f850 0x5620c413fcf0 crc :-1 s=READY pgs=120 gs=4 cs=0 l=0 c_cookie=13803767826914980792 s_cookie=2216591489137540032 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c4142940 0x5620c415f6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c415a6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2722259861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c415a180 unknown :-1 s=CLOSED pgs=580 gs=1 cs=0 l=1 c_cookie=2243841403709880169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 >> 10.20.193.28:0/2722259861 conn(0x5620c40db680 msgr2=0x5620c40fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:45.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5dd67fc640 0 client.16590 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:45.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 shutdown_connections 2026-02-20T13:20:45.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 1 -- 10.20.193.28:0/2722259861 wait complete. 2026-02-20T13:20:45.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.140+0000 7f5e21201e00 20 client.16590 trim_cache size 0 max 16384 2026-02-20T13:20:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.150+0000 7f5e21201e00 1 Processor -- start 2026-02-20T13:20:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.150+0000 7f5e21201e00 1 -- start start 2026-02-20T13:20:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.150+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fd180 0x5620c415a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.150+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c4157580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.150+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4157ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.150+0000 7f5e21201e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5620c40070d0 con 0x5620c4142940 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.150+0000 7f5e21201e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5620c3cc7700 con 0x5620c40fd180 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.150+0000 7f5e21201e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5620c4160a80 con 0x5620c40fda90 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fd180 0x5620c415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fd180 0x5620c415a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52092/0 (socket says 10.20.193.28:52092) 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c4157580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/2286434593 learned_addr learned my addr 10.20.193.28:0/2286434593 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/2286434593 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 msgr2=0x5620c4157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c4157580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/2286434593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 msgr2=0x5620c4157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/2286434593 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c3f99bd0 con 0x5620c40fd180 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c4157580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4157ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fd180 0x5620c415a6b0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=9627994163666868965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e08004730 tx=0x7f5e08094000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=859d81ae38e5dae5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5de4ce3640 1 -- 10.20.193.28:0/2286434593 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e080d83c0 con 0x5620c40fd180 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5de4ce3640 1 -- 10.20.193.28:0/2286434593 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e080ec030 con 0x5620c40fd180 2026-02-20T13:20:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.151+0000 7f5de4ce3640 1 -- 10.20.193.28:0/2286434593 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e080d7fb0 con 0x5620c40fd180 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 -- 10.20.193.28:0/2286434593 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fd180 msgr2=0x5620c415a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fd180 0x5620c415a6b0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=9627994163666868965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e08004730 tx=0x7f5e08094000 comp rx=0 tx=0).stop 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 -- 10.20.193.28:0/2286434593 shutdown_connections 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c4142940 0x5620c4157ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c40fda90 0x5620c4157580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 --2- 10.20.193.28:0/2286434593 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fd180 0x5620c415a6b0 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=9627994163666868965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 -- 10.20.193.28:0/2286434593 >> 10.20.193.28:0/2286434593 conn(0x5620c40db680 msgr2=0x5620c4159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 -- 10.20.193.28:0/2286434593 shutdown_connections 2026-02-20T13:20:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 -- 10.20.193.28:0/2286434593 wait complete. 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.152+0000 7f5e21201e00 1 -- start start 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e21201e00 1 Processor -- start 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c4159880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4159dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e21201e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c4142940 0x5620c40dfa90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e21201e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5620c40db0c0 con 0x5620c40fd180 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e21201e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5620c415a400 con 0x5620c40fda90 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e21201e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5620c40dffd0 con 0x5620c4142940 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e1cf7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c4159880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54068/0 (socket says 10.20.193.28:54068) 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/1595924284 learned_addr learned my addr 10.20.193.28:0/1595924284 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:45.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.153+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c4142940 0x5620c40dfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/1595924284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c4142940 msgr2=0x5620c40dfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c4142940 0x5620c40dfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/1595924284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 msgr2=0x5620c4159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e1cf7c640 1 -- 10.20.193.28:0/1595924284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c3f9f150 con 0x5620c40fd180 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e1d77d640 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c4142940 0x5620c40dfa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e1cf7c640 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c4159880 secure :-1 s=READY pgs=581 gs=1 cs=0 l=1 c_cookie=15341817551424900365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e08004730 tx=0x7f5e0802ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e915c75188cd0d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5dd67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5dd67fc640 1 -- 10.20.193.28:0/1595924284 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e080d7fb0 con 0x5620c40fd180 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5dd67fc640 1 -- 10.20.193.28:0/1595924284 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5620c3c9f6f0 con 0x5620c40fd180 2026-02-20T13:20:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5dd67fc640 1 -- 10.20.193.28:0/1595924284 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e080d83c0 con 0x5620c40fd180 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620c3fb4d80 con 0x5620c40fd180 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e21201e00 10 client.16593 _ll_register_callbacks cb 0x5620c3f8a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e0001daa0 con 0x5620c40fd180 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5dd67fc640 1 -- 10.20.193.28:0/1595924284 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e080d6e00 con 0x5620c40fd180 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5dd67fc640 1 -- 10.20.193.28:0/1595924284 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e080d08e0 con 0x5620c40fd180 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e21201e00 10 client.16593 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.154+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5620c3f8d680 con 0x5620c40fd180 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5dd67fc640 1 -- 10.20.193.28:0/1595924284 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e080cf0c0 con 0x5620c40fd180 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5e21201e00 10 client.16593 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5e21201e00 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5e21201e00 20 client.16593 populate_metadata read hostname 'trial028' 2026-02-20T13:20:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5e21201e00 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5620c40e11d0 0x5620c40e1670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5e21201e00 4 client.16593 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5620c3c9cf40 con 0x5620c40e11d0 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5620c40e11d0 0x5620c40e1670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5620c40e11d0 0x5620c40e1670 crc :-1 s=READY pgs=121 gs=4 cs=0 l=0 c_cookie=11908375676284361324 s_cookie=14833869056643157612 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5430c9594d4da6c server_cookie=cddc7d5055dfce6c in_seq=0 out_seq=0 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.155+0000 7f5dd67fc640 10 client.16593 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5dd67fc640 1 -- 10.20.193.28:0/1595924284 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x5620c3c9cf40 con 0x5620c40e11d0 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5dd67fc640 10 client.16593 handle_command_reply: tid=0 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 client.16593 shutdown 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 msgr2=0x5620c4159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c4159880 secure :-1 s=READY pgs=581 gs=1 cs=0 l=1 c_cookie=15341817551424900365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e08004730 tx=0x7f5e0802ff90 comp rx=0 tx=0).stop 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 shutdown_connections 2026-02-20T13:20:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5620c40e11d0 0x5620c40e1670 crc :-1 s=READY pgs=121 gs=4 cs=0 l=0 c_cookie=11908375676284361324 s_cookie=14833869056643157612 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5620c4142940 0x5620c40dfa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5620c40fda90 0x5620c4159dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 --2- 10.20.193.28:0/1595924284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620c40fd180 0x5620c4159880 unknown :-1 s=CLOSED pgs=581 gs=1 cs=0 l=1 c_cookie=15341817551424900365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5dd67fc640 0 client.16593 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 >> 10.20.193.28:0/1595924284 conn(0x5620c40db680 msgr2=0x5620c4156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 shutdown_connections 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 1 -- 10.20.193.28:0/1595924284 wait complete. 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e21201e00 20 client.16593 trim_cache size 0 max 16384 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:20:45.166 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:45.167 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:45.168 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:45.169 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:45.170 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e1df7e640 1 -- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5df40b5760 msgr2=0x7f5df40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5df40b5760 0x7f5df40d5c10 secure :-1 s=READY pgs=334 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e18168560 tx=0x7f5e00009310 comp rx=0 tx=0).stop 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e1df7e640 1 -- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e1810dbd0 msgr2=0x7f5e18161bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.156+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e1810dbd0 0x7f5e18161bc0 secure :-1 s=READY pgs=579 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e080023b0 tx=0x7f5e080028d0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.157+0000 7f5e1df7e640 1 -- 10.20.193.28:0/1695962571 shutdown_connections 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.157+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5df40b5760 0x7f5df40d5c10 unknown :-1 s=CLOSED pgs=334 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.157+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e18153180 0x7f5e181674d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.157+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e1810e5c0 0x7f5e18162100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.157+0000 7f5e1df7e640 1 --2- 10.20.193.28:0/1695962571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e1810dbd0 0x7f5e18161bc0 unknown :-1 s=CLOSED pgs=579 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.157+0000 7f5e1df7e640 1 -- 10.20.193.28:0/1695962571 >> 10.20.193.28:0/1695962571 conn(0x7f5e180e95a0 msgr2=0x7f5e18109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.157+0000 7f5e1df7e640 1 -- 10.20.193.28:0/1695962571 shutdown_connections 2026-02-20T13:20:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.157+0000 7f5e1df7e640 1 -- 10.20.193.28:0/1695962571 wait complete. 2026-02-20T13:20:45.260 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:20:45.260 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:20:45.445 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.621+0000 7f07bf24b640 1 -- 10.20.193.28:0/2941205253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810fea0 msgr2=0x7f07b8114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.621+0000 7f07bf24b640 1 --2- 10.20.193.28:0/2941205253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810fea0 0x7f07b8114ef0 secure :-1 s=READY pgs=582 gs=2 cs=0 l=1 c_cookie=8033795819294367566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07ac009950 tx=0x7f07ac02f190 comp rx=0 tx=0).stop 2026-02-20T13:20:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.621+0000 7f07bf24b640 1 -- 10.20.193.28:0/2941205253 shutdown_connections 2026-02-20T13:20:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.621+0000 7f07bf24b640 1 --2- 10.20.193.28:0/2941205253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810fea0 0x7f07b8114ef0 unknown :-1 s=CLOSED pgs=582 gs=2 cs=0 l=1 c_cookie=8033795819294367566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.621+0000 7f07bf24b640 1 --2- 10.20.193.28:0/2941205253 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f07b81156a0 0x7f07b8176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.621+0000 7f07bf24b640 1 --2- 10.20.193.28:0/2941205253 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f07b810f4b0 0x7f07b810f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.621+0000 7f07bf24b640 1 -- 10.20.193.28:0/2941205253 >> 10.20.193.28:0/2941205253 conn(0x7f07b80ecda0 msgr2=0x7f07b810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.622+0000 7f07bf24b640 1 -- 10.20.193.28:0/2941205253 shutdown_connections 2026-02-20T13:20:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.622+0000 7f07bf24b640 1 -- 10.20.193.28:0/2941205253 wait complete. 2026-02-20T13:20:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.622+0000 7f07bf24b640 1 Processor -- start 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.622+0000 7f07bf24b640 1 -- start start 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bf24b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810f4b0 0x7f07b80f5790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bf24b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f07b810fea0 0x7f07b8175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bf24b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f07b81156a0 0x7f07b80f5e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bf24b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f07b80fb0a0 con 0x7f07b810f4b0 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bf24b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f07b80fb210 con 0x7f07b81156a0 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bf24b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f07b80fb3d0 con 0x7f07b810fea0 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07be249640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810f4b0 0x7f07b80f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bda48640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f07b810fea0 0x7f07b8175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bda48640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f07b810fea0 0x7f07b8175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56018/0 (socket says 10.20.193.28:56018) 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bda48640 1 -- 10.20.193.28:0/2697915301 learned_addr learned my addr 10.20.193.28:0/2697915301 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bea4a640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f07b81156a0 0x7f07b80f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07be249640 1 -- 10.20.193.28:0/2697915301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f07b810fea0 msgr2=0x7f07b8175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07be249640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f07b810fea0 0x7f07b8175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07be249640 1 -- 10.20.193.28:0/2697915301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f07b81156a0 msgr2=0x7f07b80f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07be249640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f07b81156a0 0x7f07b80f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07be249640 1 -- 10.20.193.28:0/2697915301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ac009570 con 0x7f07b810f4b0 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07bda48640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f07b810fea0 0x7f07b8175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.623+0000 7f07be249640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810f4b0 0x7f07b80f5790 secure :-1 s=READY pgs=583 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07a800e9c0 tx=0x7f07a800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.624+0000 7f079f7fe640 1 -- 10.20.193.28:0/2697915301 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07a800ccb0 con 0x7f07b810f4b0 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.624+0000 7f079f7fe640 1 -- 10.20.193.28:0/2697915301 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f07a800ce10 con 0x7f07b810f4b0 2026-02-20T13:20:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.624+0000 7f079f7fe640 1 -- 10.20.193.28:0/2697915301 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07a80106b0 con 0x7f07b810f4b0 2026-02-20T13:20:45.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.624+0000 7f07bf24b640 1 -- 10.20.193.28:0/2697915301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b80fb6b0 con 0x7f07b810f4b0 2026-02-20T13:20:45.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.624+0000 7f07bf24b640 1 -- 10.20.193.28:0/2697915301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b80fbb30 con 0x7f07b810f4b0 2026-02-20T13:20:45.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.624+0000 7f079d7fa640 1 -- 10.20.193.28:0/2697915301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b8110790 con 0x7f07b810f4b0 2026-02-20T13:20:45.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.626+0000 7f079f7fe640 1 -- 10.20.193.28:0/2697915301 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f07a801f060 con 0x7f07b810f4b0 2026-02-20T13:20:45.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.628+0000 7f079f7fe640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f07940b5750 0x7f07940d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:45.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.628+0000 7f079f7fe640 1 -- 10.20.193.28:0/2697915301 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f07a8014070 con 0x7f07b810f4b0 2026-02-20T13:20:45.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.628+0000 7f07bda48640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f07940b5750 0x7f07940d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:45.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.628+0000 7f079f7fe640 1 -- 10.20.193.28:0/2697915301 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f07a80a9740 con 0x7f07b810f4b0 2026-02-20T13:20:45.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.629+0000 7f07bda48640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f07940b5750 0x7f07940d5c00 secure :-1 s=READY pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07ac038820 tx=0x7f07ac03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.769+0000 7f079d7fa640 1 -- 10.20.193.28:0/2697915301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07b80f68f0 con 0x7f07b810f4b0 2026-02-20T13:20:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.769+0000 7f079f7fe640 1 -- 10.20.193.28:0/2697915301 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f07a80ac8f0 con 0x7f07b810f4b0 2026-02-20T13:20:45.774 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:20:45.774 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:20:45.775 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:20:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.770+0000 7f079d7fa640 1 -- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f07940b5750 msgr2=0x7f07940d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.770+0000 7f079d7fa640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f07940b5750 0x7f07940d5c00 secure :-1 s=READY pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07ac038820 tx=0x7f07ac03a040 comp rx=0 tx=0).stop 2026-02-20T13:20:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.770+0000 7f079d7fa640 1 -- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810f4b0 msgr2=0x7f07b80f5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.770+0000 7f079d7fa640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810f4b0 0x7f07b80f5790 secure :-1 s=READY pgs=583 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07a800e9c0 tx=0x7f07a800ee90 comp rx=0 tx=0).stop 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.771+0000 7f079d7fa640 1 -- 10.20.193.28:0/2697915301 shutdown_connections 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.771+0000 7f079d7fa640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f07940b5750 0x7f07940d5c00 unknown :-1 s=CLOSED pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.771+0000 7f079d7fa640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f07b81156a0 0x7f07b80f5e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.771+0000 7f079d7fa640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f07b810fea0 0x7f07b8175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.771+0000 7f079d7fa640 1 --2- 10.20.193.28:0/2697915301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07b810f4b0 0x7f07b80f5790 unknown :-1 s=CLOSED pgs=583 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.771+0000 7f079d7fa640 1 -- 10.20.193.28:0/2697915301 >> 10.20.193.28:0/2697915301 conn(0x7f07b80ecda0 msgr2=0x7f07b8111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.771+0000 7f079d7fa640 1 -- 10.20.193.28:0/2697915301 shutdown_connections 2026-02-20T13:20:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:45.771+0000 7f079d7fa640 1 -- 10.20.193.28:0/2697915301 wait complete. 2026-02-20T13:20:45.877 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:20:46.063 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 -- 10.20.193.28:0/2154146836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a9810bb40 msgr2=0x7f4a981109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 --2- 10.20.193.28:0/2154146836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a9810bb40 0x7f4a981109d0 secure :-1 s=READY pgs=584 gs=1 cs=0 l=1 c_cookie=3329028558406386828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a8c009950 tx=0x7f4a8c02f190 comp rx=0 tx=0).stop 2026-02-20T13:20:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 -- 10.20.193.28:0/2154146836 shutdown_connections 2026-02-20T13:20:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 --2- 10.20.193.28:0/2154146836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a9810bb40 0x7f4a981109d0 unknown :-1 s=CLOSED pgs=584 gs=1 cs=0 l=1 c_cookie=3329028558406386828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 --2- 10.20.193.28:0/2154146836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4a98111160 0x7f4a98111b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 --2- 10.20.193.28:0/2154146836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a9810b150 0x7f4a9810b520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 -- 10.20.193.28:0/2154146836 >> 10.20.193.28:0/2154146836 conn(0x7f4a980e8ce0 msgr2=0x7f4a981090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 -- 10.20.193.28:0/2154146836 shutdown_connections 2026-02-20T13:20:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.246+0000 7f4a9e280640 1 -- 10.20.193.28:0/2154146836 wait complete. 2026-02-20T13:20:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.247+0000 7f4a9e280640 1 Processor -- start 2026-02-20T13:20:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.247+0000 7f4a9e280640 1 -- start start 2026-02-20T13:20:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9e280640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a9810b150 0x7f4a98123380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9e280640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4a9810bb40 0x7f4a981238c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9e280640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a98111160 0x7f4a98128c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9e280640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981292b0 con 0x7f4a98111160 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9e280640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98129420 con 0x7f4a9810bb40 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9e280640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981295e0 con 0x7f4a9810b150 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a98111160 0x7f4a98128c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9ca7d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4a9810bb40 0x7f4a981238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a9810b150 0x7f4a98123380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a98111160 0x7f4a98128c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54098/0 (socket says 10.20.193.28:54098) 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 -- 10.20.193.28:0/1202549524 learned_addr learned my addr 10.20.193.28:0/1202549524 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 -- 10.20.193.28:0/1202549524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a9810b150 msgr2=0x7f4a98123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a9810b150 0x7f4a98123380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 -- 10.20.193.28:0/1202549524 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4a9810bb40 msgr2=0x7f4a981238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4a9810bb40 0x7f4a981238c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 -- 10.20.193.28:0/1202549524 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9400a590 con 0x7f4a98111160 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9ca7d640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4a9810bb40 0x7f4a981238c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9da7f640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a98111160 0x7f4a98128c90 secure :-1 s=READY pgs=585 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a94005790 tx=0x7f4a94003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a867fc640 1 -- 10.20.193.28:0/1202549524 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a9400fd60 con 0x7f4a98111160 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a867fc640 1 -- 10.20.193.28:0/1202549524 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4a94003e80 con 0x7f4a98111160 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a867fc640 1 -- 10.20.193.28:0/1202549524 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a94019a80 con 0x7f4a98111160 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.248+0000 7f4a9e280640 1 -- 10.20.193.28:0/1202549524 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c009570 con 0x7f4a98111160 2026-02-20T13:20:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.249+0000 7f4a9e280640 1 -- 10.20.193.28:0/1202549524 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a98169e20 con 0x7f4a98111160 2026-02-20T13:20:46.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.252+0000 7f4a867fc640 1 -- 10.20.193.28:0/1202549524 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f4a94017020 con 0x7f4a98111160 2026-02-20T13:20:46.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.254+0000 7f4a867fc640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4a740b5760 0x7f4a740d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.254+0000 7f4a867fc640 1 -- 10.20.193.28:0/1202549524 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4a940e7ca0 con 0x7f4a98111160 2026-02-20T13:20:46.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.254+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4a740b5760 0x7f4a740d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.254+0000 7f4aa1503e00 1 Processor -- start 2026-02-20T13:20:46.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.254+0000 7f4aa1503e00 1 -- start start 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.254+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4a740b5760 0x7f4a740d5c10 secure :-1 s=READY pgs=336 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a88004740 tx=0x7f4a88005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.254+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd16676730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.254+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166bb5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166bbb20 0x55cd166dbf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd1658c780 con 0x55cd16676360 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cd165884b0 con 0x55cd166bbb20 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cd16582450 con 0x55cd16676c70 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd16676730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9da7f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166bbb20 0x55cd166dbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9da7f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166bbb20 0x55cd166dbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52132/0 (socket says 10.20.193.28:52132) 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd16676730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54108/0 (socket says 10.20.193.28:54108) 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9da7f640 1 -- 10.20.193.28:0/1070012659 learned_addr learned my addr 10.20.193.28:0/1070012659 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9ca7d640 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9d27e640 1 -- 10.20.193.28:0/1070012659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 msgr2=0x55cd166bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166bb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9d27e640 1 -- 10.20.193.28:0/1070012659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166bbb20 msgr2=0x55cd166dbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166bbb20 0x55cd166dbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9d27e640 1 -- 10.20.193.28:0/1070012659 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1652dd10 con 0x55cd16676360 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9ca7d640 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166bb5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd16676730 secure :-1 s=READY pgs=586 gs=1 cs=0 l=1 c_cookie=4086443998851690305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a8801c470 tx=0x7f4a88014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b5f72a8214ef41 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a65ce5640 1 -- 10.20.193.28:0/1070012659 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a88004050 con 0x55cd16676360 2026-02-20T13:20:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a65ce5640 1 -- 10.20.193.28:0/1070012659 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4a880036b0 con 0x55cd16676360 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.255+0000 7f4a65ce5640 1 -- 10.20.193.28:0/1070012659 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a880197a0 con 0x55cd16676360 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 -- 10.20.193.28:0/1070012659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 msgr2=0x55cd16676730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd16676730 secure :-1 s=READY pgs=586 gs=1 cs=0 l=1 c_cookie=4086443998851690305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a8801c470 tx=0x7f4a88014000 comp rx=0 tx=0).stop 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 -- 10.20.193.28:0/1070012659 shutdown_connections 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166bbb20 0x55cd166dbf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166bb5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/1070012659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd16676730 unknown :-1 s=CLOSED pgs=586 gs=1 cs=0 l=1 c_cookie=4086443998851690305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 -- 10.20.193.28:0/1070012659 >> 10.20.193.28:0/1070012659 conn(0x55cd16654860 msgr2=0x55cd16674c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 -- 10.20.193.28:0/1070012659 shutdown_connections 2026-02-20T13:20:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.256+0000 7f4aa1503e00 1 -- 10.20.193.28:0/1070012659 wait complete. 2026-02-20T13:20:46.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.257+0000 7f4aa1503e00 1 -- start start 2026-02-20T13:20:46.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.257+0000 7f4aa1503e00 1 Processor -- start 2026-02-20T13:20:46.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676360 0x55cd166d3770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676c70 0x55cd166d3cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166bbb20 0x55cd166d5a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd166d5fb0 con 0x55cd166bbb20 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cd166d6120 con 0x55cd16676c70 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cd166d62e0 con 0x55cd16676360 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676360 0x55cd166d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676360 0x55cd166d3770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56050/0 (socket says 10.20.193.28:56050) 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 -- 10.20.193.28:0/3055498345 learned_addr learned my addr 10.20.193.28:0/3055498345 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9ca7d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676c70 0x55cd166d3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9da7f640 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166bbb20 0x55cd166d5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 -- 10.20.193.28:0/3055498345 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676c70 msgr2=0x55cd166d3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676c70 0x55cd166d3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 -- 10.20.193.28:0/3055498345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166bbb20 msgr2=0x55cd166d5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166bbb20 0x55cd166d5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 -- 10.20.193.28:0/3055498345 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd165063c0 con 0x55cd16676360 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676360 0x55cd166d3770 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=9774219320665987049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a88003dd0 tx=0x7f4a88003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a500afa50e57e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.258+0000 7f4a52ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4a52ffd640 1 -- 10.20.193.28:0/3055498345 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a880196d0 con 0x55cd16676360 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4a52ffd640 1 -- 10.20.193.28:0/3055498345 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4a88004050 con 0x55cd16676360 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a88009d00 con 0x55cd16676360 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4a52ffd640 1 -- 10.20.193.28:0/3055498345 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a88030620 con 0x55cd16676360 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4a52ffd640 1 -- 10.20.193.28:0/3055498345 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4a880307b0 con 0x55cd16676360 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4aa1503e00 10 client.26536 _ll_register_callbacks cb 0x55cd16503a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd162186f0 con 0x55cd16676360 2026-02-20T13:20:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4a52ffd640 1 -- 10.20.193.28:0/3055498345 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a880199d0 con 0x55cd16676360 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4aa1503e00 10 client.26536 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cd165180e0 con 0x55cd16676360 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4a52ffd640 1 -- 10.20.193.28:0/3055498345 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4a88019bb0 con 0x55cd16676360 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4aa1503e00 10 client.26536 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.259+0000 7f4aa1503e00 10 client.26536 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.260+0000 7f4aa1503e00 20 client.26536 populate_metadata read hostname 'trial028' 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.260+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cd166b8ef0 0x55cd166b9390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.260+0000 7f4aa1503e00 4 client.26536 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.260+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd16524f80 con 0x55cd166b8ef0 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.260+0000 7f4a9ca7d640 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cd166b8ef0 0x55cd166b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.260+0000 7f4a9ca7d640 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cd166b8ef0 0x55cd166b9390 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=925569967974128135 s_cookie=5209125147797108538 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cd848fb63de1a07 server_cookie=484a87b90900373a in_seq=0 out_seq=0 2026-02-20T13:20:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.260+0000 7f4a52ffd640 10 client.26536 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4a52ffd640 1 -- 10.20.193.28:0/3055498345 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cd16524f80 con 0x55cd166b8ef0 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4a52ffd640 10 client.26536 handle_command_reply: tid=0 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 client.26536 shutdown 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676360 msgr2=0x55cd166d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676360 0x55cd166d3770 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=9774219320665987049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a88003dd0 tx=0x7f4a88003a50 comp rx=0 tx=0).stop 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 shutdown_connections 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cd166b8ef0 0x55cd166b9390 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=925569967974128135 s_cookie=5209125147797108538 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166bbb20 0x55cd166d5a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676c70 0x55cd166d3cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3055498345 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676360 0x55cd166d3770 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=9774219320665987049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4a52ffd640 0 client.26536 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:20:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 >> 10.20.193.28:0/3055498345 conn(0x55cd16654860 msgr2=0x55cd16674c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 shutdown_connections 2026-02-20T13:20:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3055498345 wait complete. 2026-02-20T13:20:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.261+0000 7f4aa1503e00 20 client.26536 trim_cache size 0 max 16384 2026-02-20T13:20:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.268+0000 7f4aa1503e00 1 Processor -- start 2026-02-20T13:20:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4aa1503e00 1 -- start start 2026-02-20T13:20:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd166d85b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166d59d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166b8ef0 0x55cd166d0900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd16580080 con 0x55cd16676360 2026-02-20T13:20:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cd16240700 con 0x55cd166b8ef0 2026-02-20T13:20:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cd166d9cd0 con 0x55cd16676c70 2026-02-20T13:20:46.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd166d85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9ca7d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166d59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd166d85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54118/0 (socket says 10.20.193.28:54118) 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9d27e640 1 -- 10.20.193.28:0/3997844226 learned_addr learned my addr 10.20.193.28:0/3997844226 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9da7f640 1 --2- 10.20.193.28:0/3997844226 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166b8ef0 0x55cd166d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9d27e640 1 -- 10.20.193.28:0/3997844226 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 msgr2=0x55cd166d59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/3997844226 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166d59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9d27e640 1 -- 10.20.193.28:0/3997844226 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166b8ef0 msgr2=0x55cd166d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/3997844226 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166b8ef0 0x55cd166d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.269+0000 7f4a9d27e640 1 -- 10.20.193.28:0/3997844226 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd16512b60 con 0x55cd16676360 2026-02-20T13:20:46.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/3997844226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd166d85b0 secure :-1 s=READY pgs=587 gs=1 cs=0 l=1 c_cookie=3559626645958536054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a88011cb0 tx=0x7f4a8803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31665593255fab76 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4a654e4640 1 -- 10.20.193.28:0/3997844226 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a88004300 con 0x55cd16676360 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4a654e4640 1 -- 10.20.193.28:0/3997844226 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55cd162186f0 con 0x55cd16676360 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4a654e4640 1 -- 10.20.193.28:0/3997844226 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a88003f80 con 0x55cd16676360 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3997844226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 msgr2=0x55cd166d85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3997844226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd166d85b0 secure :-1 s=READY pgs=587 gs=1 cs=0 l=1 c_cookie=3559626645958536054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a88011cb0 tx=0x7f4a8803d000 comp rx=0 tx=0).stop 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3997844226 shutdown_connections 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3997844226 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd166b8ef0 0x55cd166d0900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3997844226 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166d59d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/3997844226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd16676360 0x55cd166d85b0 unknown :-1 s=CLOSED pgs=587 gs=1 cs=0 l=1 c_cookie=3559626645958536054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3997844226 >> 10.20.193.28:0/3997844226 conn(0x55cd16654860 msgr2=0x55cd166d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3997844226 shutdown_connections 2026-02-20T13:20:46.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.270+0000 7f4aa1503e00 1 -- 10.20.193.28:0/3997844226 wait complete. 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4aa1503e00 1 -- start start 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4aa1503e00 1 Processor -- start 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676360 0x55cd166b5770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166b5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4aa1503e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166b8ef0 0x55cd166b62c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd166c0c30 con 0x55cd166b8ef0 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cd166b69f0 con 0x55cd16676360 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4aa1503e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cd166b6bb0 con 0x55cd16676c70 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.271+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676360 0x55cd166b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9d27e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676360 0x55cd166b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52160/0 (socket says 10.20.193.28:52160) 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9ca7d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9d27e640 1 -- 10.20.193.28:0/2933325457 learned_addr learned my addr 10.20.193.28:0/2933325457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9da7f640 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166b8ef0 0x55cd166b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9d27e640 1 -- 10.20.193.28:0/2933325457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 msgr2=0x55cd166b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9d27e640 1 -- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166b8ef0 msgr2=0x55cd166b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166b8ef0 0x55cd166b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9d27e640 1 -- 10.20.193.28:0/2933325457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd165066f0 con 0x55cd16676360 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9da7f640 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166b8ef0 0x55cd166b62c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a9d27e640 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676360 0x55cd166b5770 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=4115141698099531194 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a88016040 tx=0x7f4a88009a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=391beb924b9ecdba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a52ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a52ffd640 1 -- 10.20.193.28:0/2933325457 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a88003f80 con 0x55cd16676360 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a52ffd640 1 -- 10.20.193.28:0/2933325457 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4a880196d0 con 0x55cd16676360 2026-02-20T13:20:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd165180e0 con 0x55cd16676360 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a52ffd640 1 -- 10.20.193.28:0/2933325457 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a88024a50 con 0x55cd16676360 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.272+0000 7f4a52ffd640 1 -- 10.20.193.28:0/2933325457 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4a8800fa20 con 0x55cd16676360 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 10 client.26600 _ll_register_callbacks cb 0x55cd16503a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a880036b0 con 0x55cd16676360 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4a52ffd640 1 -- 10.20.193.28:0/2933325457 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a88024be0 con 0x55cd16676360 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 10 client.26600 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cd16518340 con 0x55cd16676360 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4a52ffd640 1 -- 10.20.193.28:0/2933325457 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4a88049070 con 0x55cd16676360 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 10 client.26600 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 10 client.26600 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:20:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 20 client.26600 populate_metadata read hostname 'trial028' 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cd166bbb20 0x55cd166598c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 4 client.26600 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd16215f40 con 0x55cd166bbb20 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.273+0000 7f4a9ca7d640 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cd166bbb20 0x55cd166598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4a52ffd640 10 client.26600 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4a9ca7d640 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cd166bbb20 0x55cd166598c0 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=9212004097176218100 s_cookie=13234763699505254141 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7fd79ceb49a1a9f4 server_cookie=b7ab5376c33ecefd in_seq=0 out_seq=0 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4a52ffd640 1 -- 10.20.193.28:0/2933325457 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd16215f40 con 0x55cd166bbb20 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4a52ffd640 10 client.26600 handle_command_reply: tid=0 2026-02-20T13:20:46.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 client.26600 shutdown 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676360 msgr2=0x55cd166b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676360 0x55cd166b5770 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=4115141698099531194 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a88016040 tx=0x7f4a88009a70 comp rx=0 tx=0).stop 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 shutdown_connections 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55cd166bbb20 0x55cd166598c0 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=9212004097176218100 s_cookie=13234763699505254141 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd166b8ef0 0x55cd166b62c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd16676c70 0x55cd166b5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 --2- 10.20.193.28:0/2933325457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd16676360 0x55cd166b5770 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=4115141698099531194 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4a52ffd640 0 client.26600 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 >> 10.20.193.28:0/2933325457 conn(0x55cd16654860 msgr2=0x55cd16675050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 shutdown_connections 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 1 -- 10.20.193.28:0/2933325457 wait complete. 2026-02-20T13:20:46.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.274+0000 7f4aa1503e00 20 client.26600 trim_cache size 0 max 16384 2026-02-20T13:20:46.284 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:46.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 -- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4a740b5760 msgr2=0x7f4a740d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4a740b5760 0x7f4a740d5c10 secure :-1 s=READY pgs=336 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a88004740 tx=0x7f4a88005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 -- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a98111160 msgr2=0x7f4a98128c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a98111160 0x7f4a98128c90 secure :-1 s=READY pgs=585 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a94005790 tx=0x7f4a94003c20 comp rx=0 tx=0).stop 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 -- 10.20.193.28:0/1202549524 shutdown_connections 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4a740b5760 0x7f4a740d5c10 unknown :-1 s=CLOSED pgs=336 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a98111160 0x7f4a98128c90 unknown :-1 s=CLOSED pgs=585 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4a9810bb40 0x7f4a981238c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 --2- 10.20.193.28:0/1202549524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a9810b150 0x7f4a98123380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 -- 10.20.193.28:0/1202549524 >> 10.20.193.28:0/1202549524 conn(0x7f4a980e8ce0 msgr2=0x7f4a981090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 -- 10.20.193.28:0/1202549524 shutdown_connections 2026-02-20T13:20:46.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.275+0000 7f4a9e280640 1 -- 10.20.193.28:0/1202549524 wait complete. 2026-02-20T13:20:46.376 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:20:46.562 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:46.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:46 trial127 ceph-mon[43817]: pgmap v284: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2026-02-20T13:20:46.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:46 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2697915301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:46.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:46 trial034 ceph-mon[43332]: pgmap v284: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2026-02-20T13:20:46.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:46 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2697915301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:46.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 -- 10.20.193.28:0/1330706248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e7c153290 msgr2=0x7f5e7c1736b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 --2- 10.20.193.28:0/1330706248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e7c153290 0x7f5e7c1736b0 secure :-1 s=READY pgs=588 gs=1 cs=0 l=1 c_cookie=18232218695599070174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7800aa30 tx=0x7f5e78030270 comp rx=0 tx=0).stop 2026-02-20T13:20:46.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 -- 10.20.193.28:0/1330706248 shutdown_connections 2026-02-20T13:20:46.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 --2- 10.20.193.28:0/1330706248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e7c153290 0x7f5e7c1736b0 unknown :-1 s=CLOSED pgs=588 gs=1 cs=0 l=1 c_cookie=18232218695599070174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 --2- 10.20.193.28:0/1330706248 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7c10e6d0 0x7f5e7c152d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 --2- 10.20.193.28:0/1330706248 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e7c10dce0 0x7f5e7c10e0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 -- 10.20.193.28:0/1330706248 >> 10.20.193.28:0/1330706248 conn(0x7f5e7c0e9670 msgr2=0x7f5e7c109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 -- 10.20.193.28:0/1330706248 shutdown_connections 2026-02-20T13:20:46.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.742+0000 7f5e8443c640 1 -- 10.20.193.28:0/1330706248 wait complete. 2026-02-20T13:20:46.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e8443c640 1 Processor -- start 2026-02-20T13:20:46.747 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:46 trial028 ceph-mon[37442]: pgmap v284: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2026-02-20T13:20:46.747 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:46 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2697915301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:20:46.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e8443c640 1 -- start start 2026-02-20T13:20:46.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e8443c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e7c10dce0 0x7f5e7c161230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e8443c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e7c10e6d0 0x7f5e7c161770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e8443c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7c153290 0x7f5e7c166b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e8443c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c167160 con 0x7f5e7c10e6d0 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e8443c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c1672d0 con 0x7f5e7c10dce0 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e8443c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c167490 con 0x7f5e7c153290 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e829b2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7c153290 0x7f5e7c166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e829b2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7c153290 0x7f5e7c166b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56076/0 (socket says 10.20.193.28:56076) 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e829b2640 1 -- 10.20.193.28:0/204723085 learned_addr learned my addr 10.20.193.28:0/204723085 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.743+0000 7f5e821b1640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e7c10dce0 0x7f5e7c161230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e829b2640 1 -- 10.20.193.28:0/204723085 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e7c10dce0 msgr2=0x7f5e7c161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e829b2640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e7c10dce0 0x7f5e7c161230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e829b2640 1 -- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e7c10e6d0 msgr2=0x7f5e7c161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e829b2640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e7c10e6d0 0x7f5e7c161770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e829b2640 1 -- 10.20.193.28:0/204723085 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7800a650 con 0x7f5e7c153290 2026-02-20T13:20:46.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e829b2640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7c153290 0x7f5e7c166b40 secure :-1 s=READY pgs=204 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e78006a50 tx=0x7f5e780039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e637fe640 1 -- 10.20.193.28:0/204723085 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e7803e070 con 0x7f5e7c153290 2026-02-20T13:20:46.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e637fe640 1 -- 10.20.193.28:0/204723085 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e780055a0 con 0x7f5e7c153290 2026-02-20T13:20:46.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e8443c640 1 -- 10.20.193.28:0/204723085 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7c167710 con 0x7f5e7c153290 2026-02-20T13:20:46.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e637fe640 1 -- 10.20.193.28:0/204723085 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e78042960 con 0x7f5e7c153290 2026-02-20T13:20:46.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.744+0000 7f5e8443c640 1 -- 10.20.193.28:0/204723085 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7c14ed10 con 0x7f5e7c153290 2026-02-20T13:20:46.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.748+0000 7f5e637fe640 1 -- 10.20.193.28:0/204723085 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5e78039b40 con 0x7f5e7c153290 2026-02-20T13:20:46.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.749+0000 7f5e637fe640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e580b56e0 0x7f5e580d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.749+0000 7f5e637fe640 1 -- 10.20.193.28:0/204723085 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e7810c7b0 con 0x7f5e7c153290 2026-02-20T13:20:46.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.749+0000 7f5e821b1640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e580b56e0 0x7f5e580d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.750+0000 7f5e821b1640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e580b56e0 0x7f5e580d5b90 secure :-1 s=READY pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e6c004740 tx=0x7f5e6c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e86436e00 1 Processor -- start 2026-02-20T13:20:46.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e86436e00 1 -- start start 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6360 0x555db22b6730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6c70 0x555db22fb5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db231bf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e86436e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555db21cc780 con 0x555db22fbb20 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e86436e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555db21c84b0 con 0x555db22b6c70 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e86436e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555db21c2450 con 0x555db22b6360 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e829b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db231bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e829b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db231bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54156/0 (socket says 10.20.193.28:54156) 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e829b2640 1 -- 10.20.193.28:0/3128261720 learned_addr learned my addr 10.20.193.28:0/3128261720 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e821b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6360 0x555db22b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.751+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3128261720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6c70 0x555db22fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e829b2640 1 -- 10.20.193.28:0/3128261720 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6360 msgr2=0x555db22b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e829b2640 1 --2- 10.20.193.28:0/3128261720 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6360 0x555db22b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e829b2640 1 -- 10.20.193.28:0/3128261720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6c70 msgr2=0x555db22fb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e829b2640 1 --2- 10.20.193.28:0/3128261720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6c70 0x555db22fb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e829b2640 1 -- 10.20.193.28:0/3128261720 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db216dd10 con 0x555db22fbb20 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e829b2640 1 --2- 10.20.193.28:0/3128261720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db231bf00 secure :-1 s=READY pgs=589 gs=2 cs=0 l=1 c_cookie=17094033813162324916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e780cf0e0 tx=0x7f5e78003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3a352f5c0e73b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e60884640 1 -- 10.20.193.28:0/3128261720 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e780d3510 con 0x555db22fbb20 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e60884640 1 -- 10.20.193.28:0/3128261720 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e780d8830 con 0x555db22fbb20 2026-02-20T13:20:46.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e60884640 1 -- 10.20.193.28:0/3128261720 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e780d3a00 con 0x555db22fbb20 2026-02-20T13:20:46.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e86436e00 1 -- 10.20.193.28:0/3128261720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 msgr2=0x555db231bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3128261720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db231bf00 secure :-1 s=READY pgs=589 gs=2 cs=0 l=1 c_cookie=17094033813162324916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e780cf0e0 tx=0x7f5e78003cb0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e86436e00 1 -- 10.20.193.28:0/3128261720 shutdown_connections 2026-02-20T13:20:46.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3128261720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db231bf00 unknown :-1 s=CLOSED pgs=589 gs=2 cs=0 l=1 c_cookie=17094033813162324916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3128261720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6c70 0x555db22fb5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3128261720 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6360 0x555db22b6730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e86436e00 1 -- 10.20.193.28:0/3128261720 >> 10.20.193.28:0/3128261720 conn(0x555db2294860 msgr2=0x555db22b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.752+0000 7f5e86436e00 1 -- 10.20.193.28:0/3128261720 shutdown_connections 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.753+0000 7f5e86436e00 1 -- 10.20.193.28:0/3128261720 wait complete. 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e86436e00 1 -- start start 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e86436e00 1 Processor -- start 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22bb7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22ba5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e86436e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555db22baaf0 con 0x555db22fbb20 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e86436e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555db22bac60 con 0x555db22b6360 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e86436e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555db22bae20 con 0x555db22b6c70 2026-02-20T13:20:46.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e829b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22ba5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e819b0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e819b0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56096/0 (socket says 10.20.193.28:56096) 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e819b0640 1 -- 10.20.193.28:0/3305686599 learned_addr learned my addr 10.20.193.28:0/3305686599 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.754+0000 7f5e821b1640 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22bb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e819b0640 1 -- 10.20.193.28:0/3305686599 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 msgr2=0x555db22bb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22bb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e819b0640 1 -- 10.20.193.28:0/3305686599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 msgr2=0x555db22ba5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22ba5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e819b0640 1 -- 10.20.193.28:0/3305686599 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db21463c0 con 0x555db22b6c70 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e829b2640 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22ba5b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbcf0 secure :-1 s=READY pgs=205 gs=2 cs=0 l=1 c_cookie=6386273632057835895 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e70009b70 tx=0x7f5e70002a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58a09a084d404177 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e2ffff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3305686599 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e70010640 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3305686599 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e70010c80 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7c14ed10 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3305686599 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e7000edc0 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e86436e00 10 client.26554 _ll_register_callbacks cb 0x555db2143a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.755+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555db1e586f0 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3305686599 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e700107a0 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3305686599 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e700109a0 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e86436e00 10 client.26554 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555db21580e0 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3305686599 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e70021070 con 0x555db22b6c70 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e86436e00 10 client.26554 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e86436e00 10 client.26554 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:20:46.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e86436e00 20 client.26554 populate_metadata read hostname 'trial028' 2026-02-20T13:20:46.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555db22e1b50 0x555db22e1ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e86436e00 4 client.26554 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:46.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555db2164f80 con 0x555db22e1b50 2026-02-20T13:20:46.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.756+0000 7f5e821b1640 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555db22e1b50 0x555db22e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.757+0000 7f5e821b1640 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555db22e1b50 0x555db22e1ff0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=12983779813209104706 s_cookie=17590712017258490682 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b42fa6f2f8376142 server_cookie=f41ec3614ee32b3a in_seq=0 out_seq=0 2026-02-20T13:20:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.757+0000 7f5e2ffff640 10 client.26554 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:20:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.757+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3305686599 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555db2164f80 con 0x555db22e1b50 2026-02-20T13:20:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.757+0000 7f5e2ffff640 10 client.26554 handle_command_reply: tid=0 2026-02-20T13:20:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.757+0000 7f5e86436e00 1 client.26554 shutdown 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.757+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 msgr2=0x555db22bbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.757+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbcf0 secure :-1 s=READY pgs=205 gs=2 cs=0 l=1 c_cookie=6386273632057835895 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e70009b70 tx=0x7f5e70002a70 comp rx=0 tx=0).stop 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 shutdown_connections 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555db22e1b50 0x555db22e1ff0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=12983779813209104706 s_cookie=17590712017258490682 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22ba5b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbcf0 unknown :-1 s=CLOSED pgs=205 gs=2 cs=0 l=1 c_cookie=6386273632057835895 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3305686599 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22bb7b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e2ffff640 0 client.26554 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 >> 10.20.193.28:0/3305686599 conn(0x555db2294860 msgr2=0x555db22b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 shutdown_connections 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 1 -- 10.20.193.28:0/3305686599 wait complete. 2026-02-20T13:20:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.758+0000 7f5e86436e00 20 client.26554 trim_cache size 0 max 16384 2026-02-20T13:20:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e86436e00 1 Processor -- start 2026-02-20T13:20:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e86436e00 1 -- start start 2026-02-20T13:20:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22b5d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22fb2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e86436e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555db21c0080 con 0x555db22fbb20 2026-02-20T13:20:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e86436e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555db1e80700 con 0x555db22b6360 2026-02-20T13:20:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e86436e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555db2310a50 con 0x555db22b6c70 2026-02-20T13:20:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e829b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e821b1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e821b1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52216/0 (socket says 10.20.193.28:52216) 2026-02-20T13:20:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e821b1640 1 -- 10.20.193.28:0/3057933720 learned_addr learned my addr 10.20.193.28:0/3057933720 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.765+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e821b1640 1 -- 10.20.193.28:0/3057933720 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 msgr2=0x555db22bbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e821b1640 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e821b1640 1 -- 10.20.193.28:0/3057933720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 msgr2=0x555db22fb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e821b1640 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22fb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e821b1640 1 -- 10.20.193.28:0/3057933720 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db22fb990 con 0x555db22b6360 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e829b2640 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22fb2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e821b1640 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22b5d40 secure :-1 s=READY pgs=244 gs=2 cs=0 l=1 c_cookie=3361613536271956874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e6c011010 tx=0x7f5e6c013070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea6d9b35da27b8a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e4a4e6640 1 -- 10.20.193.28:0/3057933720 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e6c024040 con 0x555db22b6360 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e4a4e6640 1 -- 10.20.193.28:0/3057933720 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e6c015070 con 0x555db22b6360 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e4a4e6640 1 -- 10.20.193.28:0/3057933720 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e6c02a320 con 0x555db22b6360 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e86436e00 1 -- 10.20.193.28:0/3057933720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 msgr2=0x555db22b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22b5d40 secure :-1 s=READY pgs=244 gs=2 cs=0 l=1 c_cookie=3361613536271956874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e6c011010 tx=0x7f5e6c013070 comp rx=0 tx=0).stop 2026-02-20T13:20:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e86436e00 1 -- 10.20.193.28:0/3057933720 shutdown_connections 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22fbb20 0x555db22fb2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22b6c70 0x555db22bbb60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3057933720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22b5d40 unknown :-1 s=CLOSED pgs=244 gs=2 cs=0 l=1 c_cookie=3361613536271956874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.766+0000 7f5e86436e00 1 -- 10.20.193.28:0/3057933720 >> 10.20.193.28:0/3057933720 conn(0x555db2294860 msgr2=0x555db22b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.767+0000 7f5e86436e00 1 -- 10.20.193.28:0/3057933720 shutdown_connections 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.767+0000 7f5e86436e00 1 -- 10.20.193.28:0/3057933720 wait complete. 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.767+0000 7f5e86436e00 1 -- start start 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.767+0000 7f5e86436e00 1 Processor -- start 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22ef4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22b6c70 0x555db22efa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e86436e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22fbb20 0x555db23b0640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e86436e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555db22942a0 con 0x555db22b6c70 2026-02-20T13:20:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e86436e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555db22f0220 con 0x555db22b6360 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e829b2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22fbb20 0x555db23b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e821b1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e829b2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22fbb20 0x555db23b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56124/0 (socket says 10.20.193.28:56124) 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e829b2640 1 -- 10.20.193.28:0/3092372115 learned_addr learned my addr 10.20.193.28:0/3092372115 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e86436e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555db23b0b80 con 0x555db22fbb20 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22b6c70 0x555db22efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e819b0640 1 -- 10.20.193.28:0/3092372115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22fbb20 msgr2=0x555db23b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22fbb20 0x555db23b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e819b0640 1 -- 10.20.193.28:0/3092372115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 msgr2=0x555db22ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.768+0000 7f5e819b0640 1 -- 10.20.193.28:0/3092372115 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c0116c0 con 0x555db22b6c70 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e819b0640 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22b6c70 0x555db22efa20 secure :-1 s=READY pgs=590 gs=1 cs=0 l=1 c_cookie=12212644361738821845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7000e580 tx=0x7f5e7000e5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97c0757759ea0d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e2ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3092372115 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e70022e50 con 0x555db22b6c70 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3092372115 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555db1e586f0 con 0x555db22b6c70 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3092372115 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e7000dde0 con 0x555db22b6c70 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db216dd10 con 0x555db22b6c70 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e86436e00 10 client.16629 _ll_register_callbacks cb 0x555db2143a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e780d8830 con 0x555db22b6c70 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3092372115 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e70018e30 con 0x555db22b6c70 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3092372115 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e70018510 con 0x555db22b6c70 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e86436e00 10 client.16629 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.769+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555db2152b60 con 0x555db22b6c70 2026-02-20T13:20:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3092372115 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e70033070 con 0x555db22b6c70 2026-02-20T13:20:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e86436e00 10 client.16629 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e86436e00 10 client.16629 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:20:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e86436e00 20 client.16629 populate_metadata read hostname 'trial028' 2026-02-20T13:20:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555db23b2560 0x555db23d2a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e86436e00 4 client.16629 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555db1e55f40 con 0x555db23b2560 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e821b1640 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555db23b2560 0x555db23d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e821b1640 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555db23b2560 0x555db23d2a10 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=16874927518082476909 s_cookie=16173330581582602839 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ea2fc92ba5c52b6d server_cookie=e073367956316257 in_seq=0 out_seq=0 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.770+0000 7f5e2ffff640 10 client.16629 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e2ffff640 1 -- 10.20.193.28:0/3092372115 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555db1e55f40 con 0x555db23b2560 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e2ffff640 10 client.16629 handle_command_reply: tid=0 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 client.16629 shutdown 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22b6c70 msgr2=0x555db22efa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22b6c70 0x555db22efa20 secure :-1 s=READY pgs=590 gs=1 cs=0 l=1 c_cookie=12212644361738821845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7000e580 tx=0x7f5e7000e5b0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 shutdown_connections 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555db23b2560 0x555db23d2a10 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=16874927518082476909 s_cookie=16173330581582602839 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555db22b6c70 0x555db22efa20 unknown :-1 s=CLOSED pgs=590 gs=1 cs=0 l=1 c_cookie=12212644361738821845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555db22fbb20 0x555db23b0640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 --2- 10.20.193.28:0/3092372115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555db22b6360 0x555db22ef4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 >> 10.20.193.28:0/3092372115 conn(0x555db2294860 msgr2=0x555db22bba80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e2ffff640 0 client.16629 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 shutdown_connections 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 1 -- 10.20.193.28:0/3092372115 wait complete. 2026-02-20T13:20:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e86436e00 20 client.16629 trim_cache size 0 max 16384 2026-02-20T13:20:46.781 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e8443c640 1 -- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e580b56e0 msgr2=0x7f5e580d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e8443c640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e580b56e0 0x7f5e580d5b90 secure :-1 s=READY pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e6c004740 tx=0x7f5e6c00b410 comp rx=0 tx=0).stop 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e8443c640 1 -- 10.20.193.28:0/204723085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7c153290 msgr2=0x7f5e7c166b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.771+0000 7f5e8443c640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7c153290 0x7f5e7c166b40 secure :-1 s=READY pgs=204 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e78006a50 tx=0x7f5e780039b0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.772+0000 7f5e8443c640 1 -- 10.20.193.28:0/204723085 shutdown_connections 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.772+0000 7f5e8443c640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e580b56e0 0x7f5e580d5b90 unknown :-1 s=CLOSED pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.772+0000 7f5e8443c640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e7c10e6d0 0x7f5e7c161770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.772+0000 7f5e8443c640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7c153290 0x7f5e7c166b40 unknown :-1 s=CLOSED pgs=204 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.772+0000 7f5e8443c640 1 --2- 10.20.193.28:0/204723085 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5e7c10dce0 0x7f5e7c161230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:46.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.772+0000 7f5e8443c640 1 -- 10.20.193.28:0/204723085 >> 10.20.193.28:0/204723085 conn(0x7f5e7c0e9670 msgr2=0x7f5e7c109a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:46.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.772+0000 7f5e8443c640 1 -- 10.20.193.28:0/204723085 shutdown_connections 2026-02-20T13:20:46.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:46.772+0000 7f5e8443c640 1 -- 10.20.193.28:0/204723085 wait complete. 2026-02-20T13:20:46.873 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:20:47.060 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:47.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 -- 10.20.193.28:0/2156008421 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810c320 msgr2=0x7fe7681108f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 --2- 10.20.193.28:0/2156008421 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810c320 0x7fe7681108f0 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=8612281588557267574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75c009980 tx=0x7fe75c02f190 comp rx=0 tx=0).stop 2026-02-20T13:20:47.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 -- 10.20.193.28:0/2156008421 shutdown_connections 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 --2- 10.20.193.28:0/2156008421 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe768110f10 0x7fe7681113b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 --2- 10.20.193.28:0/2156008421 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810c320 0x7fe7681108f0 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=8612281588557267574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 --2- 10.20.193.28:0/2156008421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810b930 0x7fe76810bd00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 -- 10.20.193.28:0/2156008421 >> 10.20.193.28:0/2156008421 conn(0x7fe7680e95c0 msgr2=0x7fe7681099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 -- 10.20.193.28:0/2156008421 shutdown_connections 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.239+0000 7fe76e672640 1 -- 10.20.193.28:0/2156008421 wait complete. 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.240+0000 7fe76e672640 1 Processor -- start 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.240+0000 7fe76e672640 1 -- start start 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.240+0000 7fe76e672640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810b930 0x7fe7681222d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.240+0000 7fe76e672640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810c320 0x7fe768122810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.240+0000 7fe76e672640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe768110f10 0x7fe768127be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.240+0000 7fe76e672640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe768128200 con 0x7fe76810c320 2026-02-20T13:20:47.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.240+0000 7fe76e672640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe768128370 con 0x7fe76810b930 2026-02-20T13:20:47.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.240+0000 7fe76e672640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe768128530 con 0x7fe768110f10 2026-02-20T13:20:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76d670640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810b930 0x7fe7681222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76ce6f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810c320 0x7fe768122810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76d670640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810b930 0x7fe7681222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52244/0 (socket says 10.20.193.28:52244) 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76d670640 1 -- 10.20.193.28:0/201217505 learned_addr learned my addr 10.20.193.28:0/201217505 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76de71640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe768110f10 0x7fe768127be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76ce6f640 1 -- 10.20.193.28:0/201217505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe768110f10 msgr2=0x7fe768127be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe768110f10 0x7fe768127be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76ce6f640 1 -- 10.20.193.28:0/201217505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810b930 msgr2=0x7fe7681222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810b930 0x7fe7681222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76ce6f640 1 -- 10.20.193.28:0/201217505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c009570 con 0x7fe76810c320 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76de71640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe768110f10 0x7fe768127be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810c320 0x7fe768122810 secure :-1 s=READY pgs=591 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75c0098a0 tx=0x7fe75c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe7567fc640 1 -- 10.20.193.28:0/201217505 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe75c03d070 con 0x7fe76810c320 2026-02-20T13:20:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76e672640 1 -- 10.20.193.28:0/201217505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe768128810 con 0x7fe76810c320 2026-02-20T13:20:47.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe7567fc640 1 -- 10.20.193.28:0/201217505 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe75c002ad0 con 0x7fe76810c320 2026-02-20T13:20:47.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe7567fc640 1 -- 10.20.193.28:0/201217505 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe75c041820 con 0x7fe76810c320 2026-02-20T13:20:47.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.241+0000 7fe76e672640 1 -- 10.20.193.28:0/201217505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe768168f10 con 0x7fe76810c320 2026-02-20T13:20:47.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.244+0000 7fe7567fc640 1 -- 10.20.193.28:0/201217505 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe75c038a40 con 0x7fe76810c320 2026-02-20T13:20:47.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.246+0000 7fe7567fc640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7440b5760 0x7fe7440d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.246+0000 7fe7567fc640 1 -- 10.20.193.28:0/201217505 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe75c10aeb0 con 0x7fe76810c320 2026-02-20T13:20:47.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.246+0000 7fe76d670640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7440b5760 0x7fe7440d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.246+0000 7fe76d670640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7440b5760 0x7fe7440d5c10 secure :-1 s=READY pgs=338 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7580095d0 tx=0x7fe758005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe7718f5e00 1 Processor -- start 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe7718f5e00 1 -- start start 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f75a9730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f75ee5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 0x55f4f760ef00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f4f74bf780 con 0x55f4f75a9360 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f4f74bb4b0 con 0x55f4f75a9c70 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f4f74b5450 con 0x55f4f75eeb20 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe76ce6f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f75ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe76ce6f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f75ee5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52254/0 (socket says 10.20.193.28:52254) 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.247+0000 7fe76ce6f640 1 -- 10.20.193.28:0/2710447766 learned_addr learned my addr 10.20.193.28:0/2710447766 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76de71640 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 0x55f4f760ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76d670640 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f75a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76ce6f640 1 -- 10.20.193.28:0/2710447766 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 msgr2=0x55f4f760ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 0x55f4f760ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76ce6f640 1 -- 10.20.193.28:0/2710447766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 msgr2=0x55f4f75a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f75a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76ce6f640 1 -- 10.20.193.28:0/2710447766 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f7460d10 con 0x55f4f75a9c70 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76d670640 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f75a9730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f75ee5e0 secure :-1 s=READY pgs=246 gs=2 cs=0 l=1 c_cookie=3385345815037058191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75c032040 tx=0x7fe75c038de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efb2a151b239c8f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe735ce5640 1 -- 10.20.193.28:0/2710447766 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe75c0d0c30 con 0x55f4f75a9c70 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe735ce5640 1 -- 10.20.193.28:0/2710447766 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe75c0d0a50 con 0x55f4f75a9c70 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe735ce5640 1 -- 10.20.193.28:0/2710447766 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe75c0d1ee0 con 0x55f4f75a9c70 2026-02-20T13:20:47.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2710447766 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 msgr2=0x55f4f75ee5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f75ee5e0 secure :-1 s=READY pgs=246 gs=2 cs=0 l=1 c_cookie=3385345815037058191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75c032040 tx=0x7fe75c038de0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2710447766 shutdown_connections 2026-02-20T13:20:47.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 0x55f4f760ef00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f75ee5e0 unknown :-1 s=CLOSED pgs=246 gs=2 cs=0 l=1 c_cookie=3385345815037058191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2710447766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f75a9730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2710447766 >> 10.20.193.28:0/2710447766 conn(0x55f4f7587860 msgr2=0x55f4f75a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2710447766 shutdown_connections 2026-02-20T13:20:47.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.248+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2710447766 wait complete. 2026-02-20T13:20:47.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe7718f5e00 1 -- start start 2026-02-20T13:20:47.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe7718f5e00 1 Processor -- start 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 0x55f4f7606bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f7608940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f4f7608eb0 con 0x55f4f75a9360 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f4f7609020 con 0x55f4f75eeb20 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f4f76091e0 con 0x55f4f75a9c70 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe76d670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe76de71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f7608940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe76ce6f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 0x55f4f7606bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe76de71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f7608940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52264/0 (socket says 10.20.193.28:52264) 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.250+0000 7fe76de71640 1 -- 10.20.193.28:0/2120867946 learned_addr learned my addr 10.20.193.28:0/2120867946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe76de71640 1 -- 10.20.193.28:0/2120867946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 msgr2=0x55f4f7606bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe76de71640 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 0x55f4f7606bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe76de71640 1 -- 10.20.193.28:0/2120867946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 msgr2=0x55f4f7606670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe76de71640 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe76de71640 1 -- 10.20.193.28:0/2120867946 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f74393c0 con 0x55f4f75eeb20 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe76de71640 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f7608940 secure :-1 s=READY pgs=247 gs=2 cs=0 l=1 c_cookie=11500694458699424233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76400a770 tx=0x7fe764013b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f9aacad491521e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe722ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe722ffd640 1 -- 10.20.193.28:0/2120867946 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7640052e0 con 0x55f4f75eeb20 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe722ffd640 1 -- 10.20.193.28:0/2120867946 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe764011db0 con 0x55f4f75eeb20 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe722ffd640 1 -- 10.20.193.28:0/2120867946 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe76401c440 con 0x55f4f75eeb20 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe768168f10 con 0x55f4f75eeb20 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe722ffd640 1 -- 10.20.193.28:0/2120867946 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe76401c5d0 con 0x55f4f75eeb20 2026-02-20T13:20:47.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe7718f5e00 10 client.26630 _ll_register_callbacks cb 0x55f4f7436a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.251+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f4f714b6f0 con 0x55f4f75eeb20 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe722ffd640 1 -- 10.20.193.28:0/2120867946 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe764003780 con 0x55f4f75eeb20 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe7718f5e00 10 client.26630 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f4f744b0e0 con 0x55f4f75eeb20 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe722ffd640 1 -- 10.20.193.28:0/2120867946 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe764013d20 con 0x55f4f75eeb20 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe7718f5e00 10 client.26630 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe7718f5e00 10 client.26630 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe7718f5e00 20 client.26630 populate_metadata read hostname 'trial028' 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55f4f760eb80 0x55f4f75ec8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe7718f5e00 4 client.26630 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4f7457f80 con 0x55f4f760eb80 2026-02-20T13:20:47.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.252+0000 7fe76d670640 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55f4f760eb80 0x55f4f75ec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe76d670640 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55f4f760eb80 0x55f4f75ec8a0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=2208604286407208852 s_cookie=3548090179034294270 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ea689e594b4ef94 server_cookie=313d5938206427fe in_seq=0 out_seq=0 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe722ffd640 10 client.26630 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe722ffd640 1 -- 10.20.193.28:0/2120867946 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f4f7457f80 con 0x55f4f760eb80 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe722ffd640 10 client.26630 handle_command_reply: tid=0 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 client.26630 shutdown 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 msgr2=0x55f4f7608940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f7608940 secure :-1 s=READY pgs=247 gs=2 cs=0 l=1 c_cookie=11500694458699424233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76400a770 tx=0x7fe764013b80 comp rx=0 tx=0).stop 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 shutdown_connections 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55f4f760eb80 0x55f4f75ec8a0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=2208604286407208852 s_cookie=3548090179034294270 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f7608940 unknown :-1 s=CLOSED pgs=247 gs=2 cs=0 l=1 c_cookie=11500694458699424233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 0x55f4f7606bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2120867946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe722ffd640 0 client.26630 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:20:47.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.253+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 >> 10.20.193.28:0/2120867946 conn(0x55f4f7587860 msgr2=0x55f4f75a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.254+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 shutdown_connections 2026-02-20T13:20:47.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.254+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2120867946 wait complete. 2026-02-20T13:20:47.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.254+0000 7fe7718f5e00 20 client.26630 trim_cache size 0 max 16384 2026-02-20T13:20:47.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe7718f5e00 1 Processor -- start 2026-02-20T13:20:47.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe7718f5e00 1 -- start start 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f760b4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 0x55f4f76088d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f76037e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f4f74b3080 con 0x55f4f75a9360 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f4f7173700 con 0x55f4f75eeb20 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f4f75ff4e0 con 0x55f4f75a9c70 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe76d670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f760b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe76ce6f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 0x55f4f76088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe76de71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f76037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe76d670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f760b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54214/0 (socket says 10.20.193.28:54214) 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.261+0000 7fe76d670640 1 -- 10.20.193.28:0/2531387841 learned_addr learned my addr 10.20.193.28:0/2531387841 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe76d670640 1 -- 10.20.193.28:0/2531387841 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 msgr2=0x55f4f76088d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe76d670640 1 --2- 10.20.193.28:0/2531387841 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 0x55f4f76088d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe76d670640 1 -- 10.20.193.28:0/2531387841 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 msgr2=0x55f4f76037e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe76d670640 1 --2- 10.20.193.28:0/2531387841 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f76037e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe76d670640 1 -- 10.20.193.28:0/2531387841 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f7445b60 con 0x55f4f75a9360 2026-02-20T13:20:47.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe76d670640 1 --2- 10.20.193.28:0/2531387841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f760b4b0 secure :-1 s=READY pgs=592 gs=1 cs=0 l=1 c_cookie=4298430133771654035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55f4f760f360 tx=0x7fe758014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba7176ebf4b5393 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7354e4640 1 -- 10.20.193.28:0/2531387841 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe758020040 con 0x55f4f75a9360 2026-02-20T13:20:47.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7354e4640 1 -- 10.20.193.28:0/2531387841 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe758021040 con 0x55f4f75a9360 2026-02-20T13:20:47.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7354e4640 1 -- 10.20.193.28:0/2531387841 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7580052a0 con 0x55f4f75a9360 2026-02-20T13:20:47.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2531387841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 msgr2=0x55f4f760b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2531387841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f760b4b0 secure :-1 s=READY pgs=592 gs=1 cs=0 l=1 c_cookie=4298430133771654035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55f4f760f360 tx=0x7fe758014000 comp rx=0 tx=0).stop 2026-02-20T13:20:47.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2531387841 shutdown_connections 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2531387841 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75eeb20 0x55f4f76037e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2531387841 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75a9c70 0x55f4f76088d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/2531387841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f760b4b0 unknown :-1 s=CLOSED pgs=592 gs=1 cs=0 l=1 c_cookie=4298430133771654035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2531387841 >> 10.20.193.28:0/2531387841 conn(0x55f4f7587860 msgr2=0x55f4f760a140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.262+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2531387841 shutdown_connections 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.263+0000 7fe7718f5e00 1 -- 10.20.193.28:0/2531387841 wait complete. 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.263+0000 7fe7718f5e00 1 -- start start 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.263+0000 7fe7718f5e00 1 Processor -- start 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f7604b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe7718f5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 0x55f4f76050a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f4f75fdfe0 con 0x55f4f75a9360 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f4f74bf780 con 0x55f4f75a9c70 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe7718f5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f4f76055e0 con 0x55f4f75eeb20 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76d670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76d670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54228/0 (socket says 10.20.193.28:54228) 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76d670640 1 -- 10.20.193.28:0/4053882196 learned_addr learned my addr 10.20.193.28:0/4053882196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f7604b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76de71640 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 0x55f4f76050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76ce6f640 1 -- 10.20.193.28:0/4053882196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 msgr2=0x55f4f76050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 0x55f4f76050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76ce6f640 1 -- 10.20.193.28:0/4053882196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 msgr2=0x55f4f7606670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76ce6f640 1 -- 10.20.193.28:0/4053882196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f74396f0 con 0x55f4f75a9c70 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe76ce6f640 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f7604b60 secure :-1 s=READY pgs=248 gs=2 cs=0 l=1 c_cookie=17411979755055229238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75c032040 tx=0x7fe75c0d2110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1a3c755a85c2936 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe722ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe722ffd640 1 -- 10.20.193.28:0/4053882196 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe75c0966a0 con 0x55f4f75a9c70 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe722ffd640 1 -- 10.20.193.28:0/4053882196 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe75c091070 con 0x55f4f75a9c70 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.264+0000 7fe722ffd640 1 -- 10.20.193.28:0/4053882196 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe75c0cf4b0 con 0x55f4f75a9c70 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe758003f40 con 0x55f4f75a9c70 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe722ffd640 1 -- 10.20.193.28:0/4053882196 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe75c0d2c40 con 0x55f4f75a9c70 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe722ffd640 10 client.26636 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 10 client.26636 _ll_register_callbacks cb 0x55f4f7436a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75c0d0a50 con 0x55f4f75a9c70 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe722ffd640 1 -- 10.20.193.28:0/4053882196 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe75c0d6f70 con 0x55f4f75a9c70 2026-02-20T13:20:47.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 10 client.26636 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f4f744b340 con 0x55f4f75a9c70 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe722ffd640 1 -- 10.20.193.28:0/4053882196 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe75c02f9f0 con 0x55f4f75a9c70 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 10 client.26636 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 10 client.26636 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 20 client.26636 populate_metadata read hostname 'trial028' 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55f4f758cf40 0x55f4f758d3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 4 client.26636 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4f7148f40 con 0x55f4f758cf40 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.265+0000 7fe76d670640 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55f4f758cf40 0x55f4f758d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe76d670640 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55f4f758cf40 0x55f4f758d3e0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=9092607564553055166 s_cookie=13972022470914941116 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7e2f6e67bf36ebbe server_cookie=c1e698690ca920bc in_seq=0 out_seq=0 2026-02-20T13:20:47.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe722ffd640 10 client.26636 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:20:47.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe722ffd640 1 -- 10.20.193.28:0/4053882196 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4f7148f40 con 0x55f4f758cf40 2026-02-20T13:20:47.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe722ffd640 10 client.26636 handle_command_reply: tid=0 2026-02-20T13:20:47.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 client.26636 shutdown 2026-02-20T13:20:47.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 msgr2=0x55f4f7604b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f7604b60 secure :-1 s=READY pgs=248 gs=2 cs=0 l=1 c_cookie=17411979755055229238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75c032040 tx=0x7fe75c0d2110 comp rx=0 tx=0).stop 2026-02-20T13:20:47.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 shutdown_connections 2026-02-20T13:20:47.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55f4f758cf40 0x55f4f758d3e0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=9092607564553055166 s_cookie=13972022470914941116 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f4f75eeb20 0x55f4f76050a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f4f75a9c70 0x55f4f7604b60 unknown :-1 s=CLOSED pgs=248 gs=2 cs=0 l=1 c_cookie=17411979755055229238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 --2- 10.20.193.28:0/4053882196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4f75a9360 0x55f4f7606670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe722ffd640 0 client.26636 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:20:47.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 >> 10.20.193.28:0/4053882196 conn(0x55f4f7587860 msgr2=0x55f4f75a8050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 shutdown_connections 2026-02-20T13:20:47.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 1 -- 10.20.193.28:0/4053882196 wait complete. 2026-02-20T13:20:47.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.266+0000 7fe7718f5e00 20 client.26636 trim_cache size 0 max 16384 2026-02-20T13:20:47.276 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 -- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7440b5760 msgr2=0x7fe7440d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7440b5760 0x7fe7440d5c10 secure :-1 s=READY pgs=338 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7580095d0 tx=0x7fe758005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 -- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810c320 msgr2=0x7fe768122810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810c320 0x7fe768122810 secure :-1 s=READY pgs=591 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75c0098a0 tx=0x7fe75c004290 comp rx=0 tx=0).stop 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 -- 10.20.193.28:0/201217505 shutdown_connections 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe7440b5760 0x7fe7440d5c10 unknown :-1 s=CLOSED pgs=338 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810c320 0x7fe768122810 unknown :-1 s=CLOSED pgs=591 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe768110f10 0x7fe768127be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 --2- 10.20.193.28:0/201217505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe76810b930 0x7fe7681222d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 -- 10.20.193.28:0/201217505 >> 10.20.193.28:0/201217505 conn(0x7fe7680e95c0 msgr2=0x7fe7681099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 -- 10.20.193.28:0/201217505 shutdown_connections 2026-02-20T13:20:47.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.267+0000 7fe76e672640 1 -- 10.20.193.28:0/201217505 wait complete. 2026-02-20T13:20:47.367 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:20:47.555 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:47.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/3587179163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b6410f5f0 msgr2=0x7f3b6410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/3587179163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b6410f5f0 0x7f3b6410f9c0 secure :-1 s=READY pgs=593 gs=1 cs=0 l=1 c_cookie=17150808650599553319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b50009890 tx=0x7f3b5002f120 comp rx=0 tx=0).stop 2026-02-20T13:20:47.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/3587179163 shutdown_connections 2026-02-20T13:20:47.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/3587179163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b641157e0 0x7f3b641761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/3587179163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b6410ffe0 0x7f3b64115030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/3587179163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b6410f5f0 0x7f3b6410f9c0 unknown :-1 s=CLOSED pgs=593 gs=1 cs=0 l=1 c_cookie=17150808650599553319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/3587179163 >> 10.20.193.28:0/3587179163 conn(0x7f3b640ecea0 msgr2=0x7f3b6410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/3587179163 shutdown_connections 2026-02-20T13:20:47.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.724+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/3587179163 wait complete. 2026-02-20T13:20:47.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.725+0000 7f3b6a3e1640 1 Processor -- start 2026-02-20T13:20:47.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.725+0000 7f3b6a3e1640 1 -- start start 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.725+0000 7f3b6a3e1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b6410f5f0 0x7f3b6411d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.725+0000 7f3b6a3e1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b6410ffe0 0x7f3b6411da30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.725+0000 7f3b6a3e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b641157e0 0x7f3b64122e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.725+0000 7f3b6a3e1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64123420 con 0x7f3b641157e0 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.725+0000 7f3b6a3e1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64123590 con 0x7f3b6410ffe0 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.725+0000 7f3b6a3e1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64123750 con 0x7f3b6410f5f0 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b637fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b6410ffe0 0x7f3b6411da30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b63fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b6410f5f0 0x7f3b6411d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b68957640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b641157e0 0x7f3b64122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b63fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b6410f5f0 0x7f3b6411d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56190/0 (socket says 10.20.193.28:56190) 2026-02-20T13:20:47.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b637fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b6410ffe0 0x7f3b6411da30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52280/0 (socket says 10.20.193.28:52280) 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b63fff640 1 -- 10.20.193.28:0/1971961373 learned_addr learned my addr 10.20.193.28:0/1971961373 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b63fff640 1 -- 10.20.193.28:0/1971961373 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b6410ffe0 msgr2=0x7f3b6411da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b63fff640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b6410ffe0 0x7f3b6411da30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b63fff640 1 -- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b641157e0 msgr2=0x7f3b64122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b63fff640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b641157e0 0x7f3b64122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b63fff640 1 -- 10.20.193.28:0/1971961373 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b500094b0 con 0x7f3b6410f5f0 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.726+0000 7f3b68957640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b641157e0 0x7f3b64122e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.727+0000 7f3b63fff640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b6410f5f0 0x7f3b6411d4f0 secure :-1 s=READY pgs=206 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b500023b0 tx=0x7f3b500028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.727+0000 7f3b617fa640 1 -- 10.20.193.28:0/1971961373 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b5003d070 con 0x7f3b6410f5f0 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.727+0000 7f3b617fa640 1 -- 10.20.193.28:0/1971961373 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b5002fcb0 con 0x7f3b6410f5f0 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.727+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/1971961373 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b641239d0 con 0x7f3b6410f5f0 2026-02-20T13:20:47.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.727+0000 7f3b617fa640 1 -- 10.20.193.28:0/1971961373 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b50041ae0 con 0x7f3b6410f5f0 2026-02-20T13:20:47.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.727+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/1971961373 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b64164130 con 0x7f3b6410f5f0 2026-02-20T13:20:47.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.730+0000 7f3b617fa640 1 -- 10.20.193.28:0/1971961373 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3b500386b0 con 0x7f3b6410f5f0 2026-02-20T13:20:47.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.731+0000 7f3b617fa640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b380b56e0 0x7f3b380d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.732+0000 7f3b617fa640 1 -- 10.20.193.28:0/1971961373 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3b5010b4e0 con 0x7f3b6410f5f0 2026-02-20T13:20:47.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.732+0000 7f3b637fe640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b380b56e0 0x7f3b380d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.732+0000 7f3b637fe640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b380b56e0 0x7f3b380d5b90 secure :-1 s=READY pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b64123e90 tx=0x7f3b54009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b6c3dbe00 1 Processor -- start 2026-02-20T13:20:47.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b6c3dbe00 1 -- start start 2026-02-20T13:20:47.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83360 0x55cd74d83730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74dc85e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74de8f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd74c99780 con 0x55cd74d83c70 2026-02-20T13:20:47.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cd74c954b0 con 0x55cd74dc8b20 2026-02-20T13:20:47.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cd74c8f450 con 0x55cd74d83360 2026-02-20T13:20:47.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b68957640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74de8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b68957640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74de8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52292/0 (socket says 10.20.193.28:52292) 2026-02-20T13:20:47.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b68957640 1 -- 10.20.193.28:0/3056360595 learned_addr learned my addr 10.20.193.28:0/3056360595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b63fff640 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83360 0x55cd74d83730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b637fe640 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74dc85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b68957640 1 -- 10.20.193.28:0/3056360595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83360 msgr2=0x55cd74d83730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b68957640 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83360 0x55cd74d83730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b68957640 1 -- 10.20.193.28:0/3056360595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 msgr2=0x55cd74dc85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b68957640 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74dc85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b68957640 1 -- 10.20.193.28:0/3056360595 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd74c3ad10 con 0x55cd74dc8b20 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.733+0000 7f3b637fe640 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74dc85e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b68957640 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74de8f00 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=907591025460488443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b58003f00 tx=0x7f3b580117a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98693aa1e7a8fb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b34ce3640 1 -- 10.20.193.28:0/3056360595 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b58005b50 con 0x55cd74dc8b20 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b34ce3640 1 -- 10.20.193.28:0/3056360595 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b58005cb0 con 0x55cd74dc8b20 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b34ce3640 1 -- 10.20.193.28:0/3056360595 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b58012b30 con 0x55cd74dc8b20 2026-02-20T13:20:47.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3056360595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 msgr2=0x55cd74de8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74de8f00 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=907591025460488443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b58003f00 tx=0x7f3b580117a0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3056360595 shutdown_connections 2026-02-20T13:20:47.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74dc85e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74de8f00 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=907591025460488443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3056360595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83360 0x55cd74d83730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3056360595 >> 10.20.193.28:0/3056360595 conn(0x55cd74d61860 msgr2=0x55cd74d81c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3056360595 shutdown_connections 2026-02-20T13:20:47.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.734+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3056360595 wait complete. 2026-02-20T13:20:47.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.736+0000 7f3b6c3dbe00 1 -- start start 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.736+0000 7f3b6c3dbe00 1 Processor -- start 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.736+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74de06f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.736+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74de0c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.736+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74dc8b20 0x55cd74de29c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.736+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd74de2f30 con 0x55cd74d83c70 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.736+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cd74de30a0 con 0x55cd74d83360 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.736+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cd74de3260 con 0x55cd74dc8b20 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b63fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74de06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b68957640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74dc8b20 0x55cd74de29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74de0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b63fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74de06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52302/0 (socket says 10.20.193.28:52302) 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b68957640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74dc8b20 0x55cd74de29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56204/0 (socket says 10.20.193.28:56204) 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b63fff640 1 -- 10.20.193.28:0/1327075786 learned_addr learned my addr 10.20.193.28:0/1327075786 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b637fe640 1 -- 10.20.193.28:0/1327075786 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74dc8b20 msgr2=0x55cd74de29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b637fe640 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74dc8b20 0x55cd74de29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b637fe640 1 -- 10.20.193.28:0/1327075786 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 msgr2=0x55cd74de06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b637fe640 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74de06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b637fe640 1 -- 10.20.193.28:0/1327075786 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd74c133c0 con 0x55cd74d83c70 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b637fe640 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74de0c30 secure :-1 s=READY pgs=594 gs=3 cs=0 l=1 c_cookie=3510641211427414360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b54005e70 tx=0x7f3b540047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b84d94e4fa6158 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.737+0000 7f3b25ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b25ffb640 1 -- 10.20.193.28:0/1327075786 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b54003e70 con 0x55cd74d83c70 2026-02-20T13:20:47.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b25ffb640 1 -- 10.20.193.28:0/1327075786 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b54011e30 con 0x55cd74d83c70 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b25ffb640 1 -- 10.20.193.28:0/1327075786 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b54026910 con 0x55cd74d83c70 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b58003b20 con 0x55cd74d83c70 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b25ffb640 1 -- 10.20.193.28:0/1327075786 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3b54026aa0 con 0x55cd74d83c70 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b25ffb640 10 client.16656 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b6c3dbe00 10 client.16656 _ll_register_callbacks cb 0x55cd74c10a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd749256f0 con 0x55cd74d83c70 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b25ffb640 1 -- 10.20.193.28:0/1327075786 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b54026440 con 0x55cd74d83c70 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b6c3dbe00 10 client.16656 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cd74c250e0 con 0x55cd74d83c70 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.738+0000 7f3b25ffb640 1 -- 10.20.193.28:0/1327075786 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b54026c60 con 0x55cd74d83c70 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b6c3dbe00 10 client.16656 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b6c3dbe00 10 client.16656 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:20:47.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b6c3dbe00 20 client.16656 populate_metadata read hostname 'trial028' 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55cd74de8c20 0x55cd74dc68a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b6c3dbe00 4 client.16656 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd74c31f80 con 0x55cd74de8c20 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b63fff640 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55cd74de8c20 0x55cd74dc68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b63fff640 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55cd74de8c20 0x55cd74dc68a0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=5802371220254497414 s_cookie=5290075031347870504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=508629e1ee381a86 server_cookie=496a1f3686a73b28 in_seq=0 out_seq=0 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.739+0000 7f3b25ffb640 10 client.16656 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b25ffb640 1 -- 10.20.193.28:0/1327075786 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cd74c31f80 con 0x55cd74de8c20 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b25ffb640 10 client.16656 handle_command_reply: tid=0 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 client.16656 shutdown 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 msgr2=0x55cd74de0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74de0c30 secure :-1 s=READY pgs=594 gs=3 cs=0 l=1 c_cookie=3510641211427414360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b54005e70 tx=0x7f3b540047e0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 shutdown_connections 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55cd74de8c20 0x55cd74dc68a0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=5802371220254497414 s_cookie=5290075031347870504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83c70 0x55cd74de0c30 unknown :-1 s=CLOSED pgs=594 gs=3 cs=0 l=1 c_cookie=3510641211427414360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74dc8b20 0x55cd74de29c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/1327075786 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74de06f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 >> 10.20.193.28:0/1327075786 conn(0x55cd74d61860 msgr2=0x55cd74d81c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b25ffb640 0 client.16656 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 shutdown_connections 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/1327075786 wait complete. 2026-02-20T13:20:47.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.740+0000 7f3b6c3dbe00 20 client.16656 trim_cache size 0 max 16384 2026-02-20T13:20:47.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.747+0000 7f3b6c3dbe00 1 Processor -- start 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.747+0000 7f3b6c3dbe00 1 -- start start 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83360 0x55cd74de2950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74ddd880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74ddddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd74c8d080 con 0x55cd74d83360 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cd7494d700 con 0x55cd74dc8b20 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cd74d612a0 con 0x55cd74d83c70 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83360 0x55cd74de2950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83360 0x55cd74de2950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54288/0 (socket says 10.20.193.28:54288) 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 -- 10.20.193.28:0/3368370433 learned_addr learned my addr 10.20.193.28:0/3368370433 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b68957640 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74ddddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b637fe640 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74ddd880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 -- 10.20.193.28:0/3368370433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 msgr2=0x55cd74ddd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74ddd880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 -- 10.20.193.28:0/3368370433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 msgr2=0x55cd74ddddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74ddddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 -- 10.20.193.28:0/3368370433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd74c1fb60 con 0x55cd74d83360 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b63fff640 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83360 0x55cd74de2950 secure :-1 s=READY pgs=595 gs=1 cs=0 l=1 c_cookie=2699498086362842636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b50108fb0 tx=0x7f3b5003a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25768b34fd81060c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b27fff640 1 -- 10.20.193.28:0/3368370433 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b500d12d0 con 0x55cd74d83360 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b27fff640 1 -- 10.20.193.28:0/3368370433 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b500d10f0 con 0x55cd74d83360 2026-02-20T13:20:47.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.748+0000 7f3b27fff640 1 -- 10.20.193.28:0/3368370433 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b500d3700 con 0x55cd74d83360 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3368370433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83360 msgr2=0x55cd74de2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83360 0x55cd74de2950 secure :-1 s=READY pgs=595 gs=1 cs=0 l=1 c_cookie=2699498086362842636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b50108fb0 tx=0x7f3b5003a040 comp rx=0 tx=0).stop 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3368370433 shutdown_connections 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74dc8b20 0x55cd74ddddc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74ddd880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3368370433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74d83360 0x55cd74de2950 unknown :-1 s=CLOSED pgs=595 gs=1 cs=0 l=1 c_cookie=2699498086362842636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3368370433 >> 10.20.193.28:0/3368370433 conn(0x55cd74d61860 msgr2=0x55cd74de5250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3368370433 shutdown_connections 2026-02-20T13:20:47.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3368370433 wait complete. 2026-02-20T13:20:47.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 -- start start 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.749+0000 7f3b6c3dbe00 1 Processor -- start 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74ddd6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74dddc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b6c3dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74dc8b20 0x55cd74dc2770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd74dde160 con 0x55cd74dc8b20 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cd74dde2d0 con 0x55cd74d83360 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b6c3dbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cd74dde490 con 0x55cd74d83c70 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b63fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74ddd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b637fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74dddc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74dc8b20 0x55cd74dc2770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74dc8b20 0x55cd74dc2770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54298/0 (socket says 10.20.193.28:54298) 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b63fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74ddd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52328/0 (socket says 10.20.193.28:52328) 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 -- 10.20.193.28:0/3791504035 learned_addr learned my addr 10.20.193.28:0/3791504035 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 -- 10.20.193.28:0/3791504035 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 msgr2=0x55cd74dddc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74dddc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 -- 10.20.193.28:0/3791504035 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 msgr2=0x55cd74ddd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74ddd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 -- 10.20.193.28:0/3791504035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd74c136f0 con 0x55cd74dc8b20 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b637fe640 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74dddc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b68957640 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74dc8b20 0x55cd74dc2770 secure :-1 s=READY pgs=596 gs=2 cs=0 l=1 c_cookie=4955283541845475336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b58003e50 tx=0x7f3b580125e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c4b420890a0008 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.750+0000 7f3b25ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b25ffb640 1 -- 10.20.193.28:0/3791504035 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b58012910 con 0x55cd74dc8b20 2026-02-20T13:20:47.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b25ffb640 1 -- 10.20.193.28:0/3791504035 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b58005b10 con 0x55cd74dc8b20 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b25ffb640 1 -- 10.20.193.28:0/3791504035 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b58027850 con 0x55cd74dc8b20 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b64164130 con 0x55cd74dc8b20 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b25ffb640 1 -- 10.20.193.28:0/3791504035 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3b58005e20 con 0x55cd74dc8b20 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 10 client.16662 _ll_register_callbacks cb 0x55cd74c10a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b58005cb0 con 0x55cd74dc8b20 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b25ffb640 1 -- 10.20.193.28:0/3791504035 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b58012a70 con 0x55cd74dc8b20 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 10 client.16662 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cd74c25340 con 0x55cd74dc8b20 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b25ffb640 1 -- 10.20.193.28:0/3791504035 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b58005fe0 con 0x55cd74dc8b20 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 10 client.16662 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 10 client.16662 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 20 client.16662 populate_metadata read hostname 'trial028' 2026-02-20T13:20:47.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55cd74d66bc0 0x55cd74d67060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 4 client.16662 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.751+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd74922f40 con 0x55cd74d66bc0 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.752+0000 7f3b63fff640 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55cd74d66bc0 0x55cd74d67060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.752+0000 7f3b63fff640 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55cd74d66bc0 0x55cd74d67060 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=7683332517882656809 s_cookie=4668787129903542340 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6aa0ae378b9a7829 server_cookie=40cadd2889d0f044 in_seq=0 out_seq=0 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.752+0000 7f3b25ffb640 10 client.16662 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.752+0000 7f3b25ffb640 1 -- 10.20.193.28:0/3791504035 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd74922f40 con 0x55cd74d66bc0 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.752+0000 7f3b25ffb640 10 client.16662 handle_command_reply: tid=0 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.752+0000 7f3b6c3dbe00 1 client.16662 shutdown 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.752+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74dc8b20 msgr2=0x55cd74dc2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.752+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74dc8b20 0x55cd74dc2770 secure :-1 s=READY pgs=596 gs=2 cs=0 l=1 c_cookie=4955283541845475336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b58003e50 tx=0x7f3b580125e0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 shutdown_connections 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55cd74d66bc0 0x55cd74d67060 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=7683332517882656809 s_cookie=4668787129903542340 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd74dc8b20 0x55cd74dc2770 unknown :-1 s=CLOSED pgs=596 gs=2 cs=0 l=1 c_cookie=4955283541845475336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cd74d83c70 0x55cd74dddc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 1 --2- 10.20.193.28:0/3791504035 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cd74d83360 0x55cd74ddd6e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b25ffb640 0 client.16662 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 >> 10.20.193.28:0/3791504035 conn(0x55cd74d61860 msgr2=0x55cd74de3750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 shutdown_connections 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 1 -- 10.20.193.28:0/3791504035 wait complete. 2026-02-20T13:20:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6c3dbe00 20 client.16662 trim_cache size 0 max 16384 2026-02-20T13:20:47.763 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:47.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b380b56e0 msgr2=0x7f3b380d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b380b56e0 0x7f3b380d5b90 secure :-1 s=READY pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b64123e90 tx=0x7f3b54009310 comp rx=0 tx=0).stop 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/1971961373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b6410f5f0 msgr2=0x7f3b6411d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b6410f5f0 0x7f3b6411d4f0 secure :-1 s=READY pgs=206 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b500023b0 tx=0x7f3b500028d0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/1971961373 shutdown_connections 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b380b56e0 0x7f3b380d5b90 unknown :-1 s=CLOSED pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b641157e0 0x7f3b64122e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b6410ffe0 0x7f3b6411da30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 --2- 10.20.193.28:0/1971961373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b6410f5f0 0x7f3b6411d4f0 unknown :-1 s=CLOSED pgs=206 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/1971961373 >> 10.20.193.28:0/1971961373 conn(0x7f3b640ecea0 msgr2=0x7f3b6410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/1971961373 shutdown_connections 2026-02-20T13:20:47.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:47.753+0000 7f3b6a3e1640 1 -- 10.20.193.28:0/1971961373 wait complete. 2026-02-20T13:20:47.853 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:20:48.038 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:48.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 -- 10.20.193.28:0/1245738706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b241157e0 msgr2=0x7f1b241761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/1245738706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b241157e0 0x7f1b241761b0 secure :-1 s=READY pgs=597 gs=1 cs=0 l=1 c_cookie=13742717331108080470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b1800aa30 tx=0x7f1b18030290 comp rx=0 tx=0).stop 2026-02-20T13:20:48.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 -- 10.20.193.28:0/1245738706 shutdown_connections 2026-02-20T13:20:48.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/1245738706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b241157e0 0x7f1b241761b0 unknown :-1 s=CLOSED pgs=597 gs=1 cs=0 l=1 c_cookie=13742717331108080470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/1245738706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b2410ffe0 0x7f1b24115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/1245738706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b2410f5f0 0x7f1b2410f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 -- 10.20.193.28:0/1245738706 >> 10.20.193.28:0/1245738706 conn(0x7f1b240ecea0 msgr2=0x7f1b2410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:48.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 -- 10.20.193.28:0/1245738706 shutdown_connections 2026-02-20T13:20:48.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 -- 10.20.193.28:0/1245738706 wait complete. 2026-02-20T13:20:48.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.217+0000 7f1b29d8f640 1 Processor -- start 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b29d8f640 1 -- start start 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b29d8f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b2410f5f0 0x7f1b2411d510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b29d8f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b2410ffe0 0x7f1b2411da50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b29d8f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b241157e0 0x7f1b24122e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b29d8f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b24123440 con 0x7f1b2410ffe0 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b29d8f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1b241235b0 con 0x7f1b2410f5f0 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b29d8f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1b24123770 con 0x7f1b241157e0 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b2410ffe0 0x7f1b2411da50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b2410ffe0 0x7f1b2411da50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54312/0 (socket says 10.20.193.28:54312) 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b22ffd640 1 -- 10.20.193.28:0/2161002549 learned_addr learned my addr 10.20.193.28:0/2161002549 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b2410f5f0 0x7f1b2411d510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b23fff640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b241157e0 0x7f1b24122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b22ffd640 1 -- 10.20.193.28:0/2161002549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b241157e0 msgr2=0x7f1b24122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b241157e0 0x7f1b24122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b22ffd640 1 -- 10.20.193.28:0/2161002549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b2410f5f0 msgr2=0x7f1b2411d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b2410f5f0 0x7f1b2411d510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.218+0000 7f1b22ffd640 1 -- 10.20.193.28:0/2161002549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1800a650 con 0x7f1b2410ffe0 2026-02-20T13:20:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.219+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b2410ffe0 0x7f1b2411da50 secure :-1 s=READY pgs=598 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b14009480 tx=0x7f1b1400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.219+0000 7f1b20ff9640 1 -- 10.20.193.28:0/2161002549 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b1400ccc0 con 0x7f1b2410ffe0 2026-02-20T13:20:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.219+0000 7f1b20ff9640 1 -- 10.20.193.28:0/2161002549 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b1400ce20 con 0x7f1b2410ffe0 2026-02-20T13:20:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.219+0000 7f1b20ff9640 1 -- 10.20.193.28:0/2161002549 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b140106b0 con 0x7f1b2410ffe0 2026-02-20T13:20:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.219+0000 7f1b29d8f640 1 -- 10.20.193.28:0/2161002549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b24123a50 con 0x7f1b2410ffe0 2026-02-20T13:20:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.219+0000 7f1b29d8f640 1 -- 10.20.193.28:0/2161002549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b24164150 con 0x7f1b2410ffe0 2026-02-20T13:20:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.222+0000 7f1b20ff9640 1 -- 10.20.193.28:0/2161002549 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1b1401f060 con 0x7f1b2410ffe0 2026-02-20T13:20:48.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.224+0000 7f1b20ff9640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1af80b56e0 0x7f1af80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.224+0000 7f1b20ff9640 1 -- 10.20.193.28:0/2161002549 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1b14014070 con 0x7f1b2410ffe0 2026-02-20T13:20:48.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.224+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1af80b56e0 0x7f1af80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b2bd89e00 1 Processor -- start 2026-02-20T13:20:48.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1af80b56e0 0x7f1af80d5b90 secure :-1 s=READY pgs=340 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b10004740 tx=0x7f1b10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:48.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b2bd89e00 1 -- start start 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8360 0x5557f67f8730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8c70 0x5557f683d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f683db20 0x5557f685df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5557f670e780 con 0x5557f67f8c70 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5557f670a4b0 con 0x5557f67f8360 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5557f6704450 con 0x5557f683db20 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8360 0x5557f67f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8c70 0x5557f683d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8360 0x5557f67f8730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52350/0 (socket says 10.20.193.28:52350) 2026-02-20T13:20:48.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b237fe640 1 -- 10.20.193.28:0/3579702469 learned_addr learned my addr 10.20.193.28:0/3579702469 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b23fff640 1 --2- 10.20.193.28:0/3579702469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f683db20 0x5557f685df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b22ffd640 1 -- 10.20.193.28:0/3579702469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f683db20 msgr2=0x5557f685df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/3579702469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f683db20 0x5557f685df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b22ffd640 1 -- 10.20.193.28:0/3579702469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8360 msgr2=0x5557f67f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/3579702469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8360 0x5557f67f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.225+0000 7f1b22ffd640 1 -- 10.20.193.28:0/3579702469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f66afd10 con 0x5557f67f8c70 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/3579702469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8c70 0x5557f683d5e0 secure :-1 s=READY pgs=599 gs=2 cs=0 l=1 c_cookie=15546763282204303785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b140e46b0 tx=0x7f1b140a8de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c132d5badfa1a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1ae7fff640 1 -- 10.20.193.28:0/3579702469 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b140ac740 con 0x5557f67f8c70 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1ae7fff640 1 -- 10.20.193.28:0/3579702469 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b140ad940 con 0x5557f67f8c70 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1ae7fff640 1 -- 10.20.193.28:0/3579702469 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b140b7bf0 con 0x5557f67f8c70 2026-02-20T13:20:48.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/3579702469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8c70 msgr2=0x5557f683d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/3579702469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8c70 0x5557f683d5e0 secure :-1 s=READY pgs=599 gs=2 cs=0 l=1 c_cookie=15546763282204303785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b140e46b0 tx=0x7f1b140a8de0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/3579702469 shutdown_connections 2026-02-20T13:20:48.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/3579702469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8c70 0x5557f683d5e0 unknown :-1 s=CLOSED pgs=599 gs=2 cs=0 l=1 c_cookie=15546763282204303785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/3579702469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f683db20 0x5557f685df00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/3579702469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8360 0x5557f67f8730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/3579702469 >> 10.20.193.28:0/3579702469 conn(0x5557f67d6860 msgr2=0x5557f67f6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:48.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/3579702469 shutdown_connections 2026-02-20T13:20:48.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.226+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/3579702469 wait complete. 2026-02-20T13:20:48.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.227+0000 7f1b2bd89e00 1 -- start start 2026-02-20T13:20:48.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b2bd89e00 1 Processor -- start 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 0x5557f68557c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f6855d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f6857a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5557f6858000 con 0x5557f67f8360 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5557f6858170 con 0x5557f683db20 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5557f6858330 con 0x5557f67f8c70 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b22ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f6855d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b23fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f6857a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b22ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f6855d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56254/0 (socket says 10.20.193.28:56254) 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b22ffd640 1 -- 10.20.193.28:0/824283860 learned_addr learned my addr 10.20.193.28:0/824283860 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:48.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b23fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f6857a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52366/0 (socket says 10.20.193.28:52366) 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b237fe640 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 0x5557f68557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b22ffd640 1 -- 10.20.193.28:0/824283860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 msgr2=0x5557f6857a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f6857a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b22ffd640 1 -- 10.20.193.28:0/824283860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 msgr2=0x5557f68557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 0x5557f68557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.228+0000 7f1b22ffd640 1 -- 10.20.193.28:0/824283860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f66883c0 con 0x5557f67f8c70 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f6855d00 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=2926787852829423305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b140aced0 tx=0x7f1b140a9470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=289e0a0b9cd376c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1ae57fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1ae57fa640 1 -- 10.20.193.28:0/824283860 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b140a91b0 con 0x5557f67f8c70 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1ae57fa640 1 -- 10.20.193.28:0/824283860 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b140b8080 con 0x5557f67f8c70 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b24164150 con 0x5557f67f8c70 2026-02-20T13:20:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1ae57fa640 1 -- 10.20.193.28:0/824283860 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b140aaf20 con 0x5557f67f8c70 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1ae57fa640 1 -- 10.20.193.28:0/824283860 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1b1406de40 con 0x5557f67f8c70 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1ae57fa640 10 client.26602 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1b2bd89e00 10 client.26602 _ll_register_callbacks cb 0x5557f6685a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557f639a6f0 con 0x5557f67f8c70 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1ae57fa640 1 -- 10.20.193.28:0/824283860 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b140b5240 con 0x5557f67f8c70 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1b2bd89e00 10 client.26602 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.229+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5557f669a0e0 con 0x5557f67f8c70 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1ae57fa640 1 -- 10.20.193.28:0/824283860 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1b140ae930 con 0x5557f67f8c70 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1b2bd89e00 10 client.26602 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1b2bd89e00 10 client.26602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1b2bd89e00 20 client.26602 populate_metadata read hostname 'trial028' 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5557f683ade0 0x5557f683b280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1b2bd89e00 4 client.26602 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557f66a6f80 con 0x5557f683ade0 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1b237fe640 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5557f683ade0 0x5557f683b280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1b237fe640 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5557f683ade0 0x5557f683b280 crc :-1 s=READY pgs=122 gs=4 cs=0 l=0 c_cookie=10227588479393761303 s_cookie=9000992895249476799 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8defb188af248817 server_cookie=7ce9f3595328ecbf in_seq=0 out_seq=0 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.230+0000 7f1ae57fa640 10 client.26602 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1ae57fa640 1 -- 10.20.193.28:0/824283860 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5557f66a6f80 con 0x5557f683ade0 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1ae57fa640 10 client.26602 handle_command_reply: tid=0 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 client.26602 shutdown 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 msgr2=0x5557f6855d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f6855d00 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=2926787852829423305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b140aced0 tx=0x7f1b140a9470 comp rx=0 tx=0).stop 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 shutdown_connections 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5557f683ade0 0x5557f683b280 crc :-1 s=READY pgs=122 gs=4 cs=0 l=0 c_cookie=10227588479393761303 s_cookie=9000992895249476799 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f6857a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1ae57fa640 0 client.26602 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:48.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f6855d00 unknown :-1 s=CLOSED pgs=207 gs=2 cs=0 l=1 c_cookie=2926787852829423305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/824283860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 0x5557f68557c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 >> 10.20.193.28:0/824283860 conn(0x5557f67d6860 msgr2=0x5557f67f6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:48.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 shutdown_connections 2026-02-20T13:20:48.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.231+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/824283860 wait complete. 2026-02-20T13:20:48.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.232+0000 7f1b2bd89e00 20 client.26602 trim_cache size 0 max 16384 2026-02-20T13:20:48.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b2bd89e00 1 Processor -- start 2026-02-20T13:20:48.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b2bd89e00 1 -- start start 2026-02-20T13:20:48.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8360 0x5557f6859100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8c70 0x5557f6852950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f683db20 0x5557f6852e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5557f6702080 con 0x5557f683db20 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5557f63c2700 con 0x5557f67f8c70 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5557f67d32e0 con 0x5557f67f8360 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b237fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8360 0x5557f6859100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b23fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f683db20 0x5557f6852e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b237fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8360 0x5557f6859100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56264/0 (socket says 10.20.193.28:56264) 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b237fe640 1 -- 10.20.193.28:0/2751755119 learned_addr learned my addr 10.20.193.28:0/2751755119 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8c70 0x5557f6852950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.239+0000 7f1b237fe640 1 -- 10.20.193.28:0/2751755119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8c70 msgr2=0x5557f6852950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8c70 0x5557f6852950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b237fe640 1 -- 10.20.193.28:0/2751755119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f683db20 msgr2=0x5557f6852e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:48.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f683db20 0x5557f6852e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b237fe640 1 -- 10.20.193.28:0/2751755119 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f6847a60 con 0x5557f67f8360 2026-02-20T13:20:48.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8c70 0x5557f6852950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8360 0x5557f6859100 secure :-1 s=READY pgs=208 gs=2 cs=0 l=1 c_cookie=11011290130698068031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b10009df0 tx=0x7f1b10014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98cff6089705e03f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1ae77fe640 1 -- 10.20.193.28:0/2751755119 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b10021030 con 0x5557f67f8360 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1ae77fe640 1 -- 10.20.193.28:0/2751755119 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b10022040 con 0x5557f67f8360 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1ae77fe640 1 -- 10.20.193.28:0/2751755119 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b1001bac0 con 0x5557f67f8360 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2751755119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8360 msgr2=0x5557f6859100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8360 0x5557f6859100 secure :-1 s=READY pgs=208 gs=2 cs=0 l=1 c_cookie=11011290130698068031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b10009df0 tx=0x7f1b10014000 comp rx=0 tx=0).stop 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2751755119 shutdown_connections 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f683db20 0x5557f6852e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f67f8c70 0x5557f6852950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2751755119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8360 0x5557f6859100 unknown :-1 s=CLOSED pgs=208 gs=2 cs=0 l=1 c_cookie=11011290130698068031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2751755119 >> 10.20.193.28:0/2751755119 conn(0x5557f67d6860 msgr2=0x5557f68589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2751755119 shutdown_connections 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.240+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2751755119 wait complete. 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b2bd89e00 1 -- start start 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b2bd89e00 1 Processor -- start 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 0x5557f683baf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f683c030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b2bd89e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f67d9c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5557f67da1a0 con 0x5557f67f8360 2026-02-20T13:20:48.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5557f67da2e0 con 0x5557f683db20 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b2bd89e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5557f67da4a0 con 0x5557f67f8c70 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b23fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f67d9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b22ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f683c030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b23fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f67d9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52384/0 (socket says 10.20.193.28:52384) 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b23fff640 1 -- 10.20.193.28:0/2157340054 learned_addr learned my addr 10.20.193.28:0/2157340054 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.241+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 0x5557f683baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b22ffd640 1 -- 10.20.193.28:0/2157340054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 msgr2=0x5557f67d9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f67d9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b22ffd640 1 -- 10.20.193.28:0/2157340054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 msgr2=0x5557f683baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 0x5557f683baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b22ffd640 1 -- 10.20.193.28:0/2157340054 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f6694b60 con 0x5557f67f8c70 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b22ffd640 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f683c030 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=16639047496398304994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b140b2cb0 tx=0x7f1b140054d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e9c58a5fac76e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1ae57fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1ae57fa640 1 -- 10.20.193.28:0/2157340054 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b14004110 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b10009a60 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b2bd89e00 10 client.26608 _ll_register_callbacks cb 0x5557f6685a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1ae57fa640 1 -- 10.20.193.28:0/2157340054 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5557f639a6f0 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1ae57fa640 1 -- 10.20.193.28:0/2157340054 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b140ad220 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b140ad940 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1ae57fa640 1 -- 10.20.193.28:0/2157340054 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1b140b2820 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1ae57fa640 1 -- 10.20.193.28:0/2157340054 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b140b29e0 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b2bd89e00 10 client.26608 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.242+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5557f66886f0 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1ae57fa640 1 -- 10.20.193.28:0/2157340054 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1b14094020 con 0x5557f67f8c70 2026-02-20T13:20:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1b2bd89e00 10 client.26608 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1b2bd89e00 10 client.26608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1b2bd89e00 20 client.26608 populate_metadata read hostname 'trial028' 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5557f67db710 0x5557f67dbbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1b2bd89e00 4 client.26608 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557f6397f40 con 0x5557f67db710 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5557f67db710 0x5557f67dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1b237fe640 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5557f67db710 0x5557f67dbbb0 crc :-1 s=READY pgs=123 gs=4 cs=0 l=0 c_cookie=17759299912526231192 s_cookie=7419626125932011902 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f675b52d79c07698 server_cookie=66f7cea69262a17e in_seq=0 out_seq=0 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.243+0000 7f1ae57fa640 10 client.26608 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1ae57fa640 1 -- 10.20.193.28:0/2157340054 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557f6397f40 con 0x5557f67db710 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1ae57fa640 10 client.26608 handle_command_reply: tid=0 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 client.26608 shutdown 2026-02-20T13:20:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 msgr2=0x5557f683c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f683c030 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=16639047496398304994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b140b2cb0 tx=0x7f1b140054d0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 shutdown_connections 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5557f67db710 0x5557f67dbbb0 crc :-1 s=READY pgs=123 gs=4 cs=0 l=0 c_cookie=17759299912526231192 s_cookie=7419626125932011902 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557f683db20 0x5557f67d9c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557f67f8c70 0x5557f683c030 unknown :-1 s=CLOSED pgs=209 gs=2 cs=0 l=1 c_cookie=16639047496398304994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 --2- 10.20.193.28:0/2157340054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557f67f8360 0x5557f683baf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1ae57fa640 0 client.26608 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 >> 10.20.193.28:0/2157340054 conn(0x5557f67d6860 msgr2=0x5557f68591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 shutdown_connections 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 1 -- 10.20.193.28:0/2157340054 wait complete. 2026-02-20T13:20:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b2bd89e00 20 client.26608 trim_cache size 0 max 16384 2026-02-20T13:20:48.254 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b29d8f640 1 -- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1af80b56e0 msgr2=0x7f1af80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1af80b56e0 0x7f1af80d5b90 secure :-1 s=READY pgs=340 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b10004740 tx=0x7f1b10005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b29d8f640 1 -- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b2410ffe0 msgr2=0x7f1b2411da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.244+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b2410ffe0 0x7f1b2411da50 secure :-1 s=READY pgs=598 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b14009480 tx=0x7f1b1400ee60 comp rx=0 tx=0).stop 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.245+0000 7f1b29d8f640 1 -- 10.20.193.28:0/2161002549 shutdown_connections 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.245+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1af80b56e0 0x7f1af80d5b90 unknown :-1 s=CLOSED pgs=340 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.245+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b2410ffe0 0x7f1b2411da50 unknown :-1 s=CLOSED pgs=598 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.245+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1b241157e0 0x7f1b24122e20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.245+0000 7f1b29d8f640 1 --2- 10.20.193.28:0/2161002549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1b2410f5f0 0x7f1b2411d510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:48.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.245+0000 7f1b29d8f640 1 -- 10.20.193.28:0/2161002549 >> 10.20.193.28:0/2161002549 conn(0x7f1b240ecea0 msgr2=0x7f1b2410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:48.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.245+0000 7f1b29d8f640 1 -- 10.20.193.28:0/2161002549 shutdown_connections 2026-02-20T13:20:48.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:48.245+0000 7f1b29d8f640 1 -- 10.20.193.28:0/2161002549 wait complete. 2026-02-20T13:20:48.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:48 trial034 ceph-mon[43332]: pgmap v285: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 13 op/s 2026-02-20T13:20:48.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:48 trial028 ceph-mon[37442]: pgmap v285: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 13 op/s 2026-02-20T13:20:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:48 trial127 ceph-mon[43817]: pgmap v285: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 13 op/s 2026-02-20T13:20:49.346 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:20:49.347 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:20:49.533 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:49.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.702+0000 7f8ea802c640 1 -- 10.20.193.28:0/2017581759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 msgr2=0x7f8ea0173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.702+0000 7f8ea802c640 1 --2- 10.20.193.28:0/2017581759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 0x7f8ea0173f90 secure :-1 s=READY pgs=600 gs=1 cs=0 l=1 c_cookie=14231601010509592735 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e9c00aa30 tx=0x7f8e9c030270 comp rx=0 tx=0).stop 2026-02-20T13:20:49.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.702+0000 7f8ea802c640 1 -- 10.20.193.28:0/2017581759 shutdown_connections 2026-02-20T13:20:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.702+0000 7f8ea802c640 1 --2- 10.20.193.28:0/2017581759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 0x7f8ea0173f90 unknown :-1 s=CLOSED pgs=600 gs=1 cs=0 l=1 c_cookie=14231601010509592735 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.702+0000 7f8ea802c640 1 --2- 10.20.193.28:0/2017581759 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ea010ddc0 0x7f8ea0112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.702+0000 7f8ea802c640 1 --2- 10.20.193.28:0/2017581759 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ea010d3d0 0x7f8ea010d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.702+0000 7f8ea802c640 1 -- 10.20.193.28:0/2017581759 >> 10.20.193.28:0/2017581759 conn(0x7f8ea00eacc0 msgr2=0x7f8ea010b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.702+0000 7f8ea802c640 1 -- 10.20.193.28:0/2017581759 shutdown_connections 2026-02-20T13:20:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.703+0000 7f8ea802c640 1 -- 10.20.193.28:0/2017581759 wait complete. 2026-02-20T13:20:49.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.703+0000 7f8ea802c640 1 Processor -- start 2026-02-20T13:20:49.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.703+0000 7f8ea802c640 1 -- start start 2026-02-20T13:20:49.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.703+0000 7f8ea802c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ea010d3d0 0x7f8ea00f5930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.703+0000 7f8ea802c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ea010ddc0 0x7f8ea0173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.703+0000 7f8ea802c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 0x7f8ea00f6030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.703+0000 7f8ea802c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00fb240 con 0x7f8ea01135c0 2026-02-20T13:20:49.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.703+0000 7f8ea802c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00fb3b0 con 0x7f8ea010ddc0 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea802c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00fb570 con 0x7f8ea010d3d0 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 0x7f8ea00f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 0x7f8ea00f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54380/0 (socket says 10.20.193.28:54380) 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 -- 10.20.193.28:0/1711975930 learned_addr learned my addr 10.20.193.28:0/1711975930 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea5da1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ea010d3d0 0x7f8ea00f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ea010ddc0 0x7f8ea0173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 -- 10.20.193.28:0/1711975930 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ea010d3d0 msgr2=0x7f8ea00f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ea010d3d0 0x7f8ea00f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 -- 10.20.193.28:0/1711975930 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ea010ddc0 msgr2=0x7f8ea0173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ea010ddc0 0x7f8ea0173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 -- 10.20.193.28:0/1711975930 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9c00a650 con 0x7f8ea01135c0 2026-02-20T13:20:49.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea65a2640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 0x7f8ea00f6030 secure :-1 s=READY pgs=601 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e9c006a50 tx=0x7f8e9c006fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:49.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8e8effd640 1 -- 10.20.193.28:0/1711975930 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e9c03e070 con 0x7f8ea01135c0 2026-02-20T13:20:49.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8e8effd640 1 -- 10.20.193.28:0/1711975930 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e9c039e00 con 0x7f8ea01135c0 2026-02-20T13:20:49.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8e8effd640 1 -- 10.20.193.28:0/1711975930 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e9c0428c0 con 0x7f8ea01135c0 2026-02-20T13:20:49.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.704+0000 7f8ea802c640 1 -- 10.20.193.28:0/1711975930 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea00fb7f0 con 0x7f8ea01135c0 2026-02-20T13:20:49.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.705+0000 7f8ea802c640 1 -- 10.20.193.28:0/1711975930 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea00fbc60 con 0x7f8ea01135c0 2026-02-20T13:20:49.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.707+0000 7f8e8effd640 1 -- 10.20.193.28:0/1711975930 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8e9c039920 con 0x7f8ea01135c0 2026-02-20T13:20:49.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.709+0000 7f8e8effd640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e7c0b5750 0x7f8e7c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.709+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e7c0b5750 0x7f8e7c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.709+0000 7f8e8effd640 1 -- 10.20.193.28:0/1711975930 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8e9c0d8370 con 0x7f8ea01135c0 2026-02-20T13:20:49.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.710+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e7c0b5750 0x7f8e7c0d5c00 secure :-1 s=READY pgs=341 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e90004740 tx=0x7f8e90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:49.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.710+0000 7f8eaa026e00 1 Processor -- start 2026-02-20T13:20:49.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.710+0000 7f8eaa026e00 1 -- start start 2026-02-20T13:20:49.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b949957e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b949da480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b949fada0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557b948aba20 con 0x557b94995d20 2026-02-20T13:20:49.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557b948a7750 con 0x557b94995410 2026-02-20T13:20:49.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557b948a16f0 con 0x557b949da9c0 2026-02-20T13:20:49.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b949957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b949957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52414/0 (socket says 10.20.193.28:52414) 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 -- 10.20.193.28:0/2164153448 learned_addr learned my addr 10.20.193.28:0/2164153448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea65a2640 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b949fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b949da480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 -- 10.20.193.28:0/2164153448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 msgr2=0x557b949fada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b949fada0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 -- 10.20.193.28:0/2164153448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 msgr2=0x557b949da480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b949da480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 -- 10.20.193.28:0/2164153448 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9484d120 con 0x557b94995410 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.711+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b949957e0 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=3416892562333553633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e90004220 tx=0x7f8e90014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f6b3dae9590d3e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8e6e4e6640 1 -- 10.20.193.28:0/2164153448 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e90011e60 con 0x557b94995410 2026-02-20T13:20:49.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8e6e4e6640 1 -- 10.20.193.28:0/2164153448 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e90009da0 con 0x557b94995410 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8e6e4e6640 1 -- 10.20.193.28:0/2164153448 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e9001a6e0 con 0x557b94995410 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 -- 10.20.193.28:0/2164153448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 msgr2=0x557b949957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b949957e0 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=3416892562333553633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e90004220 tx=0x7f8e90014000 comp rx=0 tx=0).stop 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 -- 10.20.193.28:0/2164153448 shutdown_connections 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b949da480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b949fada0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/2164153448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b949957e0 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=3416892562333553633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 -- 10.20.193.28:0/2164153448 >> 10.20.193.28:0/2164153448 conn(0x557b94973910 msgr2=0x557b94993cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 -- 10.20.193.28:0/2164153448 shutdown_connections 2026-02-20T13:20:49.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.712+0000 7f8eaa026e00 1 -- 10.20.193.28:0/2164153448 wait complete. 2026-02-20T13:20:49.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.713+0000 7f8eaa026e00 1 -- start start 2026-02-20T13:20:49.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8eaa026e00 1 Processor -- start 2026-02-20T13:20:49.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949f2690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b94995d20 0x557b949f2bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b949da9c0 0x557b949f7bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557b949f8100 con 0x557b94995410 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557b949f8270 con 0x557b949da9c0 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557b949f8430 con 0x557b94995d20 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8ea5da1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8ea65a2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b949da9c0 0x557b949f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8ea5da1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949f2690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54392/0 (socket says 10.20.193.28:54392) 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8ea5da1640 1 -- 10.20.193.28:0/790787867 learned_addr learned my addr 10.20.193.28:0/790787867 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.714+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b94995d20 0x557b949f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8ea5da1640 1 -- 10.20.193.28:0/790787867 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b94995d20 msgr2=0x557b949f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b94995d20 0x557b949f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8ea5da1640 1 -- 10.20.193.28:0/790787867 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b949da9c0 msgr2=0x557b949f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b949da9c0 0x557b949f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8ea5da1640 1 -- 10.20.193.28:0/790787867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b94825810 con 0x557b94995410 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949f2690 secure :-1 s=READY pgs=602 gs=1 cs=0 l=1 c_cookie=6107099487985920365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e90005460 tx=0x7f8e90005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c0c6a0a55ee96d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8e5b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/790787867 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e90031070 con 0x557b94995410 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/790787867 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e9001ad50 con 0x557b94995410 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/790787867 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e9002d430 con 0x557b94995410 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e90009970 con 0x557b94995410 2026-02-20T13:20:49.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/790787867 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8e9001a870 con 0x557b94995410 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8eaa026e00 10 client.16692 _ll_register_callbacks cb 0x557b94858b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557b945379d0 con 0x557b94995410 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/790787867 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8e9003b050 con 0x557b94995410 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8eaa026e00 10 client.16692 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.715+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557b948374f0 con 0x557b94995410 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.716+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/790787867 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8e9001a520 con 0x557b94995410 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.716+0000 7f8eaa026e00 10 client.16692 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.716+0000 7f8eaa026e00 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.716+0000 7f8eaa026e00 20 client.16692 populate_metadata read hostname 'trial028' 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.716+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557b949fab40 0x557b949d85d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.716+0000 7f8eaa026e00 4 client.16692 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.716+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b948aedf0 con 0x557b949fab40 2026-02-20T13:20:49.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.716+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557b949fab40 0x557b949d85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8e5b7fe640 10 client.16692 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557b949fab40 0x557b949d85d0 crc :-1 s=READY pgs=124 gs=4 cs=0 l=0 c_cookie=5813109950890411964 s_cookie=17259013740163771614 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50ac50b37f1c87bc server_cookie=ef84558df40c2cde in_seq=0 out_seq=0 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/790787867 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557b948aedf0 con 0x557b949fab40 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8e5b7fe640 10 client.16692 handle_command_reply: tid=0 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 client.16692 shutdown 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 msgr2=0x557b949f2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949f2690 secure :-1 s=READY pgs=602 gs=1 cs=0 l=1 c_cookie=6107099487985920365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e90005460 tx=0x7f8e90005310 comp rx=0 tx=0).stop 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 shutdown_connections 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557b949fab40 0x557b949d85d0 crc :-1 s=READY pgs=124 gs=4 cs=0 l=0 c_cookie=5813109950890411964 s_cookie=17259013740163771614 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b949da9c0 0x557b949f7bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b94995d20 0x557b949f2bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/790787867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949f2690 unknown :-1 s=CLOSED pgs=602 gs=1 cs=0 l=1 c_cookie=6107099487985920365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8e5b7fe640 0 client.16692 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:49.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.717+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 >> 10.20.193.28:0/790787867 conn(0x557b94973910 msgr2=0x557b94993cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:49.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.718+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 shutdown_connections 2026-02-20T13:20:49.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.718+0000 7f8eaa026e00 1 -- 10.20.193.28:0/790787867 wait complete. 2026-02-20T13:20:49.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.718+0000 7f8eaa026e00 20 client.16692 trim_cache size 0 max 16384 2026-02-20T13:20:49.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8eaa026e00 1 Processor -- start 2026-02-20T13:20:49.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8eaa026e00 1 -- start start 2026-02-20T13:20:49.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949d9be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995d20 0x557b949da120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b949d5470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557b9489f320 con 0x557b94995410 2026-02-20T13:20:49.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557b9455f790 con 0x557b94995d20 2026-02-20T13:20:49.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557b949f3730 con 0x557b949da9c0 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8ea5da1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949d9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8ea55a0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995d20 0x557b949da120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8ea5da1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949d9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54408/0 (socket says 10.20.193.28:54408) 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8ea5da1640 1 -- 10.20.193.28:0/3190616876 learned_addr learned my addr 10.20.193.28:0/3190616876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.727+0000 7f8ea65a2640 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b949d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8ea5da1640 1 -- 10.20.193.28:0/3190616876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 msgr2=0x557b949d5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b949d5470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8ea5da1640 1 -- 10.20.193.28:0/3190616876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995d20 msgr2=0x557b949da120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995d20 0x557b949da120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8ea5da1640 1 -- 10.20.193.28:0/3190616876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b94831f70 con 0x557b94995410 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995d20 0x557b949da120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:49.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949d9be0 secure :-1 s=READY pgs=603 gs=1 cs=0 l=1 c_cookie=11395928591110887110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e900046c0 tx=0x7f8e90035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2678ace6e1d6c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:49.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8e6dce5640 1 -- 10.20.193.28:0/3190616876 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e90031040 con 0x557b94995410 2026-02-20T13:20:49.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8e6dce5640 1 -- 10.20.193.28:0/3190616876 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557b945379d0 con 0x557b94995410 2026-02-20T13:20:49.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8e6dce5640 1 -- 10.20.193.28:0/3190616876 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e90004b30 con 0x557b94995410 2026-02-20T13:20:49.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8eaa026e00 1 -- 10.20.193.28:0/3190616876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 msgr2=0x557b949d9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949d9be0 secure :-1 s=READY pgs=603 gs=1 cs=0 l=1 c_cookie=11395928591110887110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e900046c0 tx=0x7f8e90035000 comp rx=0 tx=0).stop 2026-02-20T13:20:49.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8eaa026e00 1 -- 10.20.193.28:0/3190616876 shutdown_connections 2026-02-20T13:20:49.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b949d5470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995d20 0x557b949da120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/3190616876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995410 0x557b949d9be0 unknown :-1 s=CLOSED pgs=603 gs=1 cs=0 l=1 c_cookie=11395928591110887110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.728+0000 7f8eaa026e00 1 -- 10.20.193.28:0/3190616876 >> 10.20.193.28:0/3190616876 conn(0x557b94973910 msgr2=0x557b949f7210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.729+0000 7f8eaa026e00 1 -- 10.20.193.28:0/3190616876 shutdown_connections 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.729+0000 7f8eaa026e00 1 -- 10.20.193.28:0/3190616876 wait complete. 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.729+0000 7f8eaa026e00 1 -- start start 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.729+0000 7f8eaa026e00 1 Processor -- start 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b94979800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b94973d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8eaa026e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b94974270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557b949f9650 con 0x557b94995d20 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557b949747b0 con 0x557b94995410 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8eaa026e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557b94974970 con 0x557b949da9c0 2026-02-20T13:20:49.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea5da1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b94979800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b94973d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b94973d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54420/0 (socket says 10.20.193.28:54420) 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 -- 10.20.193.28:0/147884261 learned_addr learned my addr 10.20.193.28:0/147884261 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea65a2640 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b94974270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 -- 10.20.193.28:0/147884261 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 msgr2=0x557b94974270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b94974270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 -- 10.20.193.28:0/147884261 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 msgr2=0x557b94979800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b94979800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 -- 10.20.193.28:0/147884261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b948374f0 con 0x557b94995d20 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b94979800 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8ea55a0640 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b94973d30 secure :-1 s=READY pgs=604 gs=2 cs=0 l=1 c_cookie=2959243383662670611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e940047b0 tx=0x7f8e94009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2911582dbf237313 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:49.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8e5b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/147884261 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e94022070 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/147884261 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e94017040 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.730+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e94009800 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 10 client.16698 _ll_register_callbacks cb 0x557b94858b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557b945f9530 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/147884261 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e9401e8a0 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/147884261 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8e9401ea30 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/147884261 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8e9401ec10 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 10 client.16698 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557b94825b40 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/147884261 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8e9401c050 con 0x557b94995d20 2026-02-20T13:20:49.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 10 client.16698 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 20 client.16698 populate_metadata read hostname 'trial028' 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557b94a9a620 0x557b94abaad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 4 client.16698 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f8e90009da0 con 0x557b94a9a620 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.731+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557b94a9a620 0x557b94abaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.732+0000 7f8ea5da1640 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557b94a9a620 0x557b94abaad0 crc :-1 s=READY pgs=125 gs=4 cs=0 l=0 c_cookie=10763091481622129513 s_cookie=7068143251435162205 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=955e2ead5f1eab69 server_cookie=621716d6ab5e0a5d in_seq=0 out_seq=0 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.732+0000 7f8e5b7fe640 10 client.16698 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8e5b7fe640 1 -- 10.20.193.28:0/147884261 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f8e90009da0 con 0x557b94a9a620 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8e5b7fe640 10 client.16698 handle_command_reply: tid=0 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 client.16698 shutdown 2026-02-20T13:20:49.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 msgr2=0x557b94973d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b94973d30 secure :-1 s=READY pgs=604 gs=2 cs=0 l=1 c_cookie=2959243383662670611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e940047b0 tx=0x7f8e94009e00 comp rx=0 tx=0).stop 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 shutdown_connections 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557b94a9a620 0x557b94abaad0 crc :-1 s=READY pgs=125 gs=4 cs=0 l=0 c_cookie=10763091481622129513 s_cookie=7068143251435162205 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557b94995d20 0x557b94973d30 unknown :-1 s=CLOSED pgs=604 gs=2 cs=0 l=1 c_cookie=2959243383662670611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557b949da9c0 0x557b94974270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 --2- 10.20.193.28:0/147884261 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557b94995410 0x557b94979800 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8e5b7fe640 0 client.16698 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 >> 10.20.193.28:0/147884261 conn(0x557b94973910 msgr2=0x557b949f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:49.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 shutdown_connections 2026-02-20T13:20:49.742 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:20:49.742 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:20:49.742 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7", 2026-02-20T13:20:49.742 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:20:49.742 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:20:49.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 1 -- 10.20.193.28:0/147884261 wait complete. 2026-02-20T13:20:49.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.733+0000 7f8eaa026e00 20 client.16698 trim_cache size 0 max 16384 2026-02-20T13:20:49.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 -- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e7c0b5750 msgr2=0x7f8e7c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e7c0b5750 0x7f8e7c0d5c00 secure :-1 s=READY pgs=341 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e90004740 tx=0x7f8e90005f90 comp rx=0 tx=0).stop 2026-02-20T13:20:49.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 -- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 msgr2=0x7f8ea00f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:49.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 0x7f8ea00f6030 secure :-1 s=READY pgs=601 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e9c006a50 tx=0x7f8e9c006fb0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 -- 10.20.193.28:0/1711975930 shutdown_connections 2026-02-20T13:20:49.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e7c0b5750 0x7f8e7c0d5c00 unknown :-1 s=CLOSED pgs=341 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea01135c0 0x7f8ea00f6030 unknown :-1 s=CLOSED pgs=601 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8ea010ddc0 0x7f8ea0173e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 --2- 10.20.193.28:0/1711975930 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ea010d3d0 0x7f8ea00f5930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:49.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 -- 10.20.193.28:0/1711975930 >> 10.20.193.28:0/1711975930 conn(0x7f8ea00eacc0 msgr2=0x7f8ea0110480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:49.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 -- 10.20.193.28:0/1711975930 shutdown_connections 2026-02-20T13:20:49.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:49.734+0000 7f8ea802c640 1 -- 10.20.193.28:0/1711975930 wait complete. 2026-02-20T13:20:49.838 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:20:50.025 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:50.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 -- 10.20.193.28:0/1601371610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe230060f30 msgr2=0x7fe230061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 --2- 10.20.193.28:0/1601371610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe230060f30 0x7fe230061300 secure :-1 s=READY pgs=605 gs=1 cs=0 l=1 c_cookie=6746037437954493559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c009890 tx=0x7fe21c02f120 comp rx=0 tx=0).stop 2026-02-20T13:20:50.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 -- 10.20.193.28:0/1601371610 shutdown_connections 2026-02-20T13:20:50.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 --2- 10.20.193.28:0/1601371610 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe230155980 0x7fe230175d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 --2- 10.20.193.28:0/1601371610 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe230061840 0x7fe230155440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 --2- 10.20.193.28:0/1601371610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe230060f30 0x7fe230061300 unknown :-1 s=CLOSED pgs=605 gs=1 cs=0 l=1 c_cookie=6746037437954493559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 -- 10.20.193.28:0/1601371610 >> 10.20.193.28:0/1601371610 conn(0x7fe2300eaad0 msgr2=0x7fe23010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:50.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 -- 10.20.193.28:0/1601371610 shutdown_connections 2026-02-20T13:20:50.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.197+0000 7fe2355eb640 1 -- 10.20.193.28:0/1601371610 wait complete. 2026-02-20T13:20:50.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe2355eb640 1 Processor -- start 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe2355eb640 1 -- start start 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe2355eb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe230060f30 0x7fe2301620f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe2355eb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe230061840 0x7fe230162630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe2355eb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe230155980 0x7fe230167a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe2355eb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe230168020 con 0x7fe230060f30 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe2355eb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe230168190 con 0x7fe230155980 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe2355eb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe230168350 con 0x7fe230061840 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe230061840 0x7fe230162630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe230061840 0x7fe230162630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52838/0 (socket says 10.20.193.28:52838) 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22f7fe640 1 -- 10.20.193.28:0/2182639143 learned_addr learned my addr 10.20.193.28:0/2182639143 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe234dea640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe230155980 0x7fe230167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22ffff640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe230060f30 0x7fe2301620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22f7fe640 1 -- 10.20.193.28:0/2182639143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe230155980 msgr2=0x7fe230167a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe230155980 0x7fe230167a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22f7fe640 1 -- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe230060f30 msgr2=0x7fe2301620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe230060f30 0x7fe2301620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.198+0000 7fe22f7fe640 1 -- 10.20.193.28:0/2182639143 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0094b0 con 0x7fe230061840 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.199+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe230061840 0x7fe230162630 secure :-1 s=READY pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe22000e9c0 tx=0x7fe22000ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.199+0000 7fe22d7fa640 1 -- 10.20.193.28:0/2182639143 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe22000ccb0 con 0x7fe230061840 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.199+0000 7fe22d7fa640 1 -- 10.20.193.28:0/2182639143 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe22000ce10 con 0x7fe230061840 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.199+0000 7fe2355eb640 1 -- 10.20.193.28:0/2182639143 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe230168630 con 0x7fe230061840 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.199+0000 7fe22d7fa640 1 -- 10.20.193.28:0/2182639143 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe220018a10 con 0x7fe230061840 2026-02-20T13:20:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.199+0000 7fe2355eb640 1 -- 10.20.193.28:0/2182639143 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2301515a0 con 0x7fe230061840 2026-02-20T13:20:50.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.201+0000 7fe22d7fa640 1 -- 10.20.193.28:0/2182639143 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe220010bc0 con 0x7fe230061840 2026-02-20T13:20:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.203+0000 7fe22d7fa640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2040b56e0 0x7fe2040d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.203+0000 7fe22d7fa640 1 -- 10.20.193.28:0/2182639143 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe220014070 con 0x7fe230061840 2026-02-20T13:20:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.203+0000 7fe22ffff640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2040b56e0 0x7fe2040d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.204+0000 7fe22ffff640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2040b56e0 0x7fe2040d5b90 secure :-1 s=READY pgs=342 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c0097e0 tx=0x7fe21c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.205+0000 7fe23886ee00 1 Processor -- start 2026-02-20T13:20:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.205+0000 7fe23886ee00 1 -- start start 2026-02-20T13:20:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.205+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d98b90 0x560256d98f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.205+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d994a0 0x560256ddde10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.205+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfe730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.205+0000 7fe23886ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560256ca67d0 con 0x560256d994a0 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.205+0000 7fe23886ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560256ca2500 con 0x560256d98b90 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.205+0000 7fe23886ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560256c9c4a0 con 0x560256dde350 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d98b90 0x560256d98f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d994a0 0x560256ddde10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe234dea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfe730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d98b90 0x560256d98f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33766/0 (socket says 10.20.193.28:33766) 2026-02-20T13:20:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 -- 10.20.193.28:0/1345546201 learned_addr learned my addr 10.20.193.28:0/1345546201 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:50.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 -- 10.20.193.28:0/1345546201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 msgr2=0x560256dfe730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 --2- 10.20.193.28:0/1345546201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfe730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 -- 10.20.193.28:0/1345546201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d994a0 msgr2=0x560256ddde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 --2- 10.20.193.28:0/1345546201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d994a0 0x560256ddde10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 -- 10.20.193.28:0/1345546201 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560256c47d80 con 0x560256d98b90 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/1345546201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d994a0 0x560256ddde10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe22ffff640 1 --2- 10.20.193.28:0/1345546201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d98b90 0x560256d98f60 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=13872717905286263054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c032010 tx=0x7fe21c040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c085cb6f1dc9f10e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe200ce3640 1 -- 10.20.193.28:0/1345546201 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe21c0042e0 con 0x560256d98b90 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe200ce3640 1 -- 10.20.193.28:0/1345546201 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe21c03e040 con 0x560256d98b90 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.206+0000 7fe200ce3640 1 -- 10.20.193.28:0/1345546201 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe21c04e800 con 0x560256d98b90 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 -- 10.20.193.28:0/1345546201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d98b90 msgr2=0x560256d98f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1345546201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d98b90 0x560256d98f60 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=13872717905286263054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c032010 tx=0x7fe21c040000 comp rx=0 tx=0).stop 2026-02-20T13:20:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 -- 10.20.193.28:0/1345546201 shutdown_connections 2026-02-20T13:20:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1345546201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d994a0 0x560256ddde10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1345546201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfe730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1345546201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d98b90 0x560256d98f60 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=13872717905286263054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 -- 10.20.193.28:0/1345546201 >> 10.20.193.28:0/1345546201 conn(0x560256d6e680 msgr2=0x560256d8ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 -- 10.20.193.28:0/1345546201 shutdown_connections 2026-02-20T13:20:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.207+0000 7fe23886ee00 1 -- 10.20.193.28:0/1345546201 wait complete. 2026-02-20T13:20:50.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.208+0000 7fe23886ee00 1 -- start start 2026-02-20T13:20:50.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.208+0000 7fe23886ee00 1 Processor -- start 2026-02-20T13:20:50.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256df5a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df5fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfafb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe23886ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560256dfb4f0 con 0x560256d98b90 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe23886ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560256dfb660 con 0x560256d994a0 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe23886ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560256dfb820 con 0x560256dde350 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe234dea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe22f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe234dea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52856/0 (socket says 10.20.193.28:52856) 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe234dea640 1 -- 10.20.193.28:0/1005219863 learned_addr learned my addr 10.20.193.28:0/1005219863 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe22ffff640 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256df5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe234dea640 1 -- 10.20.193.28:0/1005219863 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 msgr2=0x560256df5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe234dea640 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe234dea640 1 -- 10.20.193.28:0/1005219863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 msgr2=0x560256df5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe234dea640 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256df5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe234dea640 1 -- 10.20.193.28:0/1005219863 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2301768f0 con 0x560256dde350 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df5fc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.209+0000 7fe22ffff640 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256df5a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe234dea640 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfafb0 secure :-1 s=READY pgs=211 gs=2 cs=0 l=1 c_cookie=14278265755118546890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe224012490 tx=0x7fe224012960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c626970e06772fca server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe1f1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/1005219863 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe224017070 con 0x560256dde350 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/1005219863 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe224005500 con 0x560256dde350 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/1005219863 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe224011e30 con 0x560256dde350 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2301515a0 con 0x560256dde350 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/1005219863 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe22401c420 con 0x560256dde350 2026-02-20T13:20:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe1f1ffb640 10 client.26638 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe23886ee00 10 client.26638 _ll_register_callbacks cb 0x560256c1d9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5602569326f0 con 0x560256dde350 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/1005219863 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2240114f0 con 0x560256dde350 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe23886ee00 10 client.26638 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.210+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560256c20350 con 0x560256dde350 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/1005219863 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe224011690 con 0x560256dde350 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe23886ee00 10 client.26638 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe23886ee00 10 client.26638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe23886ee00 20 client.26638 populate_metadata read hostname 'trial028' 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560256ddb4c0 0x560256ddb960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe23886ee00 4 client.26638 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560256ca9d60 con 0x560256ddb4c0 2026-02-20T13:20:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe22ffff640 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560256ddb4c0 0x560256ddb960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe22ffff640 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560256ddb4c0 0x560256ddb960 crc :-1 s=READY pgs=126 gs=4 cs=0 l=0 c_cookie=12852521454458050964 s_cookie=2893910804164726188 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25d542ad10f1994 server_cookie=28293c8b35e74dac in_seq=0 out_seq=0 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.211+0000 7fe1f1ffb640 10 client.26638 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/1005219863 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560256ca9d60 con 0x560256ddb4c0 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe1f1ffb640 10 client.26638 handle_command_reply: tid=0 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 client.26638 shutdown 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 msgr2=0x560256dfafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfafb0 secure :-1 s=READY pgs=211 gs=2 cs=0 l=1 c_cookie=14278265755118546890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe224012490 tx=0x7fe224012960 comp rx=0 tx=0).stop 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 shutdown_connections 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560256ddb4c0 0x560256ddb960 crc :-1 s=READY pgs=126 gs=4 cs=0 l=0 c_cookie=12852521454458050964 s_cookie=2893910804164726188 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256dfafb0 unknown :-1 s=CLOSED pgs=211 gs=2 cs=0 l=1 c_cookie=14278265755118546890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df5fc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 --2- 10.20.193.28:0/1005219863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256df5a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 >> 10.20.193.28:0/1005219863 conn(0x560256d6e680 msgr2=0x560256d8ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe1f1ffb640 0 client.26638 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 shutdown_connections 2026-02-20T13:20:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 1 -- 10.20.193.28:0/1005219863 wait complete. 2026-02-20T13:20:50.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.212+0000 7fe23886ee00 20 client.26638 trim_cache size 0 max 16384 2026-02-20T13:20:50.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe23886ee00 1 Processor -- start 2026-02-20T13:20:50.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe23886ee00 1 -- start start 2026-02-20T13:20:50.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256ddb4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df2d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256df32b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe23886ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560256c9a0d0 con 0x560256d98b90 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe23886ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56025695a700 con 0x560256d994a0 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe23886ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560256df5ee0 con 0x560256dde350 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe234dea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256df32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33784/0 (socket says 10.20.193.28:33784) 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 -- 10.20.193.28:0/3609781607 learned_addr learned my addr 10.20.193.28:0/3609781607 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22ffff640 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256ddb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 -- 10.20.193.28:0/3609781607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 msgr2=0x560256df32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256df32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 -- 10.20.193.28:0/3609781607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 msgr2=0x560256ddb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256ddb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 -- 10.20.193.28:0/3609781607 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560256c32150 con 0x560256d994a0 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22ffff640 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256ddb4c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.223+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df2d70 secure :-1 s=READY pgs=252 gs=2 cs=0 l=1 c_cookie=5302556220228945107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2200aa510 tx=0x7fe2200184c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=499676c9c448c4d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe1f3fff640 1 -- 10.20.193.28:0/3609781607 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe220018b70 con 0x560256d994a0 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe1f3fff640 1 -- 10.20.193.28:0/3609781607 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe2200adca0 con 0x560256d994a0 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 -- 10.20.193.28:0/3609781607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 msgr2=0x560256df2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df2d70 secure :-1 s=READY pgs=252 gs=2 cs=0 l=1 c_cookie=5302556220228945107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2200aa510 tx=0x7fe2200184c0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 -- 10.20.193.28:0/3609781607 shutdown_connections 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256df32b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256df2d70 unknown :-1 s=CLOSED pgs=252 gs=2 cs=0 l=1 c_cookie=5302556220228945107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 --2- 10.20.193.28:0/3609781607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256ddb4c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 -- 10.20.193.28:0/3609781607 >> 10.20.193.28:0/3609781607 conn(0x560256d6e680 msgr2=0x560256df2660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:50.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 -- 10.20.193.28:0/3609781607 shutdown_connections 2026-02-20T13:20:50.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.224+0000 7fe23886ee00 1 -- 10.20.193.28:0/3609781607 wait complete. 2026-02-20T13:20:50.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe23886ee00 1 -- start start 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe23886ee00 1 Processor -- start 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256d747a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256d6fd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe23886ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256d70470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe23886ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560256d70b70 con 0x560256d98b90 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe23886ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560256e43de0 con 0x560256d994a0 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe23886ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560256e43fa0 con 0x560256dde350 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe234dea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256d70470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe22f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256d6fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe234dea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256d70470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52868/0 (socket says 10.20.193.28:52868) 2026-02-20T13:20:50.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe234dea640 1 -- 10.20.193.28:0/404840447 learned_addr learned my addr 10.20.193.28:0/404840447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.225+0000 7fe22ffff640 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256d747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe22f7fe640 1 -- 10.20.193.28:0/404840447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 msgr2=0x560256d70470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256d70470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe22f7fe640 1 -- 10.20.193.28:0/404840447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 msgr2=0x560256d747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256d747a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe22f7fe640 1 -- 10.20.193.28:0/404840447 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560256c2cbd0 con 0x560256d994a0 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe22f7fe640 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256d6fd80 secure :-1 s=READY pgs=253 gs=3 cs=0 l=1 c_cookie=13373426757931230560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2200094a0 tx=0x7fe2200b84f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b997f4c7e831e560 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe1f1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/404840447 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2200ad0f0 con 0x560256d994a0 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/404840447 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe2200b2fc0 con 0x560256d994a0 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe230168630 con 0x560256d994a0 2026-02-20T13:20:50.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/404840447 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2200ab500 con 0x560256d994a0 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/404840447 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe2200aec90 con 0x560256d994a0 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe23886ee00 10 client.26708 _ll_register_callbacks cb 0x560256c1d9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c03e040 con 0x560256d994a0 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/404840447 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2200b55a0 con 0x560256d994a0 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe23886ee00 10 client.26708 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.226+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560256c20680 con 0x560256d994a0 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/404840447 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe2200ac590 con 0x560256d994a0 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe23886ee00 10 client.26708 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe23886ee00 10 client.26708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe23886ee00 20 client.26708 populate_metadata read hostname 'trial028' 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe23886ee00 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560256e9d090 0x560256ebd540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe23886ee00 4 client.26708 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:20:50.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56025692ff40 con 0x560256e9d090 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe22ffff640 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560256e9d090 0x560256ebd540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe22ffff640 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560256e9d090 0x560256ebd540 crc :-1 s=READY pgs=127 gs=4 cs=0 l=0 c_cookie=9410329713276268712 s_cookie=2742394498109158398 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=829835042322b0a8 server_cookie=260ef14425c833fe in_seq=0 out_seq=0 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.227+0000 7fe1f1ffb640 10 client.26708 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe1f1ffb640 1 -- 10.20.193.28:0/404840447 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x56025692ff40 con 0x560256e9d090 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe1f1ffb640 10 client.26708 handle_command_reply: tid=0 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 client.26708 shutdown 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 msgr2=0x560256d6fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256d6fd80 secure :-1 s=READY pgs=253 gs=3 cs=0 l=1 c_cookie=13373426757931230560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2200094a0 tx=0x7fe2200b84f0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 shutdown_connections 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560256e9d090 0x560256ebd540 crc :-1 s=READY pgs=127 gs=4 cs=0 l=0 c_cookie=9410329713276268712 s_cookie=2742394498109158398 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560256dde350 0x560256d70470 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560256d994a0 0x560256d6fd80 unknown :-1 s=CLOSED pgs=253 gs=3 cs=0 l=1 c_cookie=13373426757931230560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 --2- 10.20.193.28:0/404840447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560256d98b90 0x560256d747a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe1f1ffb640 0 client.26708 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:50.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 >> 10.20.193.28:0/404840447 conn(0x560256d6e680 msgr2=0x560256df2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:50.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 shutdown_connections 2026-02-20T13:20:50.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 1 -- 10.20.193.28:0/404840447 wait complete. 2026-02-20T13:20:50.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe23886ee00 20 client.26708 trim_cache size 0 max 16384 2026-02-20T13:20:50.237 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7", 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:20:50.238 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:50.239 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:50.240 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:50.241 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:50.242 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:20:50.243 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:20:50.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe2355eb640 1 -- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2040b56e0 msgr2=0x7fe2040d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe2355eb640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2040b56e0 0x7fe2040d5b90 secure :-1 s=READY pgs=342 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c0097e0 tx=0x7fe21c03a040 comp rx=0 tx=0).stop 2026-02-20T13:20:50.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe2355eb640 1 -- 10.20.193.28:0/2182639143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe230061840 msgr2=0x7fe230162630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.228+0000 7fe2355eb640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe230061840 0x7fe230162630 secure :-1 s=READY pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe22000e9c0 tx=0x7fe22000ee90 comp rx=0 tx=0).stop 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.230+0000 7fe2355eb640 1 -- 10.20.193.28:0/2182639143 shutdown_connections 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.230+0000 7fe2355eb640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2040b56e0 0x7fe2040d5b90 unknown :-1 s=CLOSED pgs=342 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.230+0000 7fe2355eb640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe230155980 0x7fe230167a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.230+0000 7fe2355eb640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe230061840 0x7fe230162630 unknown :-1 s=CLOSED pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.230+0000 7fe2355eb640 1 --2- 10.20.193.28:0/2182639143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe230060f30 0x7fe2301620f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.230+0000 7fe2355eb640 1 -- 10.20.193.28:0/2182639143 >> 10.20.193.28:0/2182639143 conn(0x7fe2300eaad0 msgr2=0x7fe23010aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.230+0000 7fe2355eb640 1 -- 10.20.193.28:0/2182639143 shutdown_connections 2026-02-20T13:20:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:50.230+0000 7fe2355eb640 1 -- 10.20.193.28:0/2182639143 wait complete. 2026-02-20T13:20:50.332 INFO:tasks.cephfs.filesystem:scrub status for tag:6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7 - {'path': '/', 'tag': '6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7', 'options': 'recursive,force'} 2026-02-20T13:20:50.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:50 trial028 ceph-mon[37442]: pgmap v286: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2026-02-20T13:20:50.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:50 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:20:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:50 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:20:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:50 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:50 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:20:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:50 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:50 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:50.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:50 trial034 ceph-mon[43332]: pgmap v286: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2026-02-20T13:20:50.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:50 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:20:50.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:50 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:20:50.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:50 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:50.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:50 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:20:50.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:50 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:50.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:50 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:50 trial127 ceph-mon[43817]: pgmap v286: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2026-02-20T13:20:50.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:50 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:20:50.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:50 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:20:50.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:50 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:50.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:50 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:20:50.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:50 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:50.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:50 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:20:52.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:52 trial034 ceph-mon[43332]: pgmap v287: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2026-02-20T13:20:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:52 trial028 ceph-mon[37442]: pgmap v287: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2026-02-20T13:20:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:52 trial127 ceph-mon[43817]: pgmap v287: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2026-02-20T13:20:54.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:54 trial034 ceph-mon[43332]: pgmap v288: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2026-02-20T13:20:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:54 trial028 ceph-mon[37442]: pgmap v288: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2026-02-20T13:20:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:54 trial127 ceph-mon[43817]: pgmap v288: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2026-02-20T13:20:56.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:56 trial034 ceph-mon[43332]: pgmap v289: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2026-02-20T13:20:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:56 trial028 ceph-mon[37442]: pgmap v289: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2026-02-20T13:20:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:56 trial127 ceph-mon[43817]: pgmap v289: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2026-02-20T13:20:58.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 -- 10.20.193.28:0/1971245905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810dd00 msgr2=0x7f923810aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 --2- 10.20.193.28:0/1971245905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810dd00 0x7f923810aec0 secure :-1 s=READY pgs=606 gs=1 cs=0 l=1 c_cookie=16422945281719848128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9220009950 tx=0x7f922002f190 comp rx=0 tx=0).stop 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 -- 10.20.193.28:0/1971245905 shutdown_connections 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 --2- 10.20.193.28:0/1971245905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810dd00 0x7f923810aec0 unknown :-1 s=CLOSED pgs=606 gs=1 cs=0 l=1 c_cookie=16422945281719848128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 --2- 10.20.193.28:0/1971245905 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f923810b510 0x7f923810b9b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 --2- 10.20.193.28:0/1971245905 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f923810d340 0x7f923810d730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 -- 10.20.193.28:0/1971245905 >> 10.20.193.28:0/1971245905 conn(0x7f92380e8a80 msgr2=0x7f9238108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 -- 10.20.193.28:0/1971245905 shutdown_connections 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.065+0000 7f923d883640 1 -- 10.20.193.28:0/1971245905 wait complete. 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d883640 1 Processor -- start 2026-02-20T13:20:58.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d883640 1 -- start start 2026-02-20T13:20:58.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d883640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810b510 0x7f923810e680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d883640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f923810d340 0x7f923810ecd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d883640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f923810dd00 0x7f923810f8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d883640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9238110010 con 0x7f923810b510 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d883640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9238110180 con 0x7f923810d340 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d883640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9238110340 con 0x7f923810dd00 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923c881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810b510 0x7f923810e680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f922ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f923810d340 0x7f923810ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923c881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810b510 0x7f923810e680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44592/0 (socket says 10.20.193.28:44592) 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923c881640 1 -- 10.20.193.28:0/1373386505 learned_addr learned my addr 10.20.193.28:0/1373386505 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923d082640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f923810dd00 0x7f923810f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923c881640 1 -- 10.20.193.28:0/1373386505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f923810dd00 msgr2=0x7f923810f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923c881640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f923810dd00 0x7f923810f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923c881640 1 -- 10.20.193.28:0/1373386505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f923810d340 msgr2=0x7f923810ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923c881640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f923810d340 0x7f923810ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.066+0000 7f923c881640 1 -- 10.20.193.28:0/1373386505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220009570 con 0x7f923810b510 2026-02-20T13:20:58.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.067+0000 7f923c881640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810b510 0x7f923810e680 secure :-1 s=READY pgs=607 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9228009480 tx=0x7f922800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:58.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.067+0000 7f922dffb640 1 -- 10.20.193.28:0/1373386505 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f922800cd40 con 0x7f923810b510 2026-02-20T13:20:58.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.067+0000 7f922dffb640 1 -- 10.20.193.28:0/1373386505 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9228004d30 con 0x7f923810b510 2026-02-20T13:20:58.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.067+0000 7f922dffb640 1 -- 10.20.193.28:0/1373386505 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92280106b0 con 0x7f923810b510 2026-02-20T13:20:58.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.067+0000 7f923d883640 1 -- 10.20.193.28:0/1373386505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9238110620 con 0x7f923810b510 2026-02-20T13:20:58.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.067+0000 7f923d883640 1 -- 10.20.193.28:0/1373386505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9238110b40 con 0x7f923810b510 2026-02-20T13:20:58.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.069+0000 7f922dffb640 1 -- 10.20.193.28:0/1373386505 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f922801f060 con 0x7f923810b510 2026-02-20T13:20:58.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.071+0000 7f922dffb640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f92140b5760 0x7f92140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.071+0000 7f922dffb640 1 -- 10.20.193.28:0/1373386505 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9228014070 con 0x7f923810b510 2026-02-20T13:20:58.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.071+0000 7f922ffff640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f92140b5760 0x7f92140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f922ffff640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f92140b5760 0x7f92140d5c10 secure :-1 s=READY pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9220002d80 tx=0x7f922003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f9241224e00 1 Processor -- start 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f9241224e00 1 -- start start 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f9241224e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed88a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f9241224e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ef91c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f9241224e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 0x55e9d5f19ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f9241224e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5dcdfd0 con 0x55e9d5eb84c0 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f9241224e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5dc9d00 con 0x55e9d5ed8de0 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f9241224e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5dc3ca0 con 0x55e9d5ef9700 2026-02-20T13:20:58.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f923c881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f922ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ef91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f923c881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44606/0 (socket says 10.20.193.28:44606) 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.072+0000 7f923c881640 1 -- 10.20.193.28:0/3232075555 learned_addr learned my addr 10.20.193.28:0/3232075555 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f923d082640 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 0x55e9d5f19ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f922ffff640 1 -- 10.20.193.28:0/3232075555 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 msgr2=0x55e9d5f19ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f922ffff640 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 0x55e9d5f19ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f922ffff640 1 -- 10.20.193.28:0/3232075555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 msgr2=0x55e9d5ed88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f922ffff640 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f922ffff640 1 -- 10.20.193.28:0/3232075555 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9d5d668b0 con 0x55e9d5ed8de0 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f923c881640 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed88a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f922ffff640 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ef91c0 secure :-1 s=READY pgs=254 gs=2 cs=0 l=1 c_cookie=18408921960719194616 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92200098a0 tx=0x7f9220040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff79a0fd168e19f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:58.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9204ffe640 1 -- 10.20.193.28:0/3232075555 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9220002a00 con 0x55e9d5ed8de0 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9204ffe640 1 -- 10.20.193.28:0/3232075555 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f922003e040 con 0x55e9d5ed8de0 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9204ffe640 1 -- 10.20.193.28:0/3232075555 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f922004f8f0 con 0x55e9d5ed8de0 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9241224e00 1 -- 10.20.193.28:0/3232075555 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 msgr2=0x55e9d5ef91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9241224e00 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ef91c0 secure :-1 s=READY pgs=254 gs=2 cs=0 l=1 c_cookie=18408921960719194616 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92200098a0 tx=0x7f9220040000 comp rx=0 tx=0).stop 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9241224e00 1 -- 10.20.193.28:0/3232075555 shutdown_connections 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9241224e00 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 0x55e9d5f19ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9241224e00 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ef91c0 unknown :-1 s=CLOSED pgs=254 gs=2 cs=0 l=1 c_cookie=18408921960719194616 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9241224e00 1 --2- 10.20.193.28:0/3232075555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed88a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.073+0000 7f9241224e00 1 -- 10.20.193.28:0/3232075555 >> 10.20.193.28:0/3232075555 conn(0x55e9d5dd71c0 msgr2=0x55e9d5eb6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.074+0000 7f9241224e00 1 -- 10.20.193.28:0/3232075555 shutdown_connections 2026-02-20T13:20:58.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.074+0000 7f9241224e00 1 -- 10.20.193.28:0/3232075555 wait complete. 2026-02-20T13:20:58.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.075+0000 7f9241224e00 1 -- start start 2026-02-20T13:20:58.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.075+0000 7f9241224e00 1 Processor -- start 2026-02-20T13:20:58.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.075+0000 7f9241224e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed1b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.075+0000 7f9241224e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ed2180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.075+0000 7f9241224e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 0x55e9d5ed2be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.075+0000 7f9241224e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5ed3240 con 0x55e9d5eb84c0 2026-02-20T13:20:58.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.075+0000 7f9241224e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5ed33b0 con 0x55e9d5ed8de0 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.075+0000 7f9241224e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5ed3570 con 0x55e9d5ef9700 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f923c881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f922ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ed2180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f923c881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44612/0 (socket says 10.20.193.28:44612) 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f923c881640 1 -- 10.20.193.28:0/1188084682 learned_addr learned my addr 10.20.193.28:0/1188084682 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f922ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ed2180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33810/0 (socket says 10.20.193.28:33810) 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f923d082640 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 0x55e9d5ed2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f922ffff640 1 -- 10.20.193.28:0/1188084682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 msgr2=0x55e9d5ed2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f922ffff640 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 0x55e9d5ed2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f922ffff640 1 -- 10.20.193.28:0/1188084682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 msgr2=0x55e9d5ed1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:58.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f922ffff640 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f922ffff640 1 -- 10.20.193.28:0/1188084682 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9d5d6f400 con 0x55e9d5ed8de0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f922ffff640 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ed2180 secure :-1 s=READY pgs=255 gs=2 cs=0 l=1 c_cookie=4068078345193959832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9220004820 tx=0x7f92200059b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3874b7b38bbeb198 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f91fdffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f91fdffb640 1 -- 10.20.193.28:0/1188084682 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f922002fc10 con 0x55e9d5ed8de0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f91fdffb640 1 -- 10.20.193.28:0/1188084682 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f922003e040 con 0x55e9d5ed8de0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f91fdffb640 1 -- 10.20.193.28:0/1188084682 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9220058b00 con 0x55e9d5ed8de0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923810c630 con 0x55e9d5ed8de0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f9241224e00 10 client.26720 _ll_register_callbacks cb 0x55e9d5d4ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.076+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9d5a63520 con 0x55e9d5ed8de0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f91fdffb640 1 -- 10.20.193.28:0/1188084682 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9220062440 con 0x55e9d5ed8de0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f91fdffb640 1 -- 10.20.193.28:0/1188084682 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9220062620 con 0x55e9d5ed8de0 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f9241224e00 10 client.26720 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:58.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e9d5d47da0 con 0x55e9d5ed8de0 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f91fdffb640 1 -- 10.20.193.28:0/1188084682 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9220038920 con 0x55e9d5ed8de0 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f9241224e00 10 client.26720 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f9241224e00 10 client.26720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f9241224e00 20 client.26720 populate_metadata read hostname 'trial028' 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f9241224e00 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9d5ed5f50 0x55e9d5ed63c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f9241224e00 4 client.26720 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9d5df5630 con 0x55e9d5ed5f50 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.077+0000 7f923c881640 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9d5ed5f50 0x55e9d5ed63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.078+0000 7f923c881640 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9d5ed5f50 0x55e9d5ed63c0 crc :-1 s=READY pgs=128 gs=4 cs=0 l=0 c_cookie=3179739294073232153 s_cookie=18199946103886912579 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c20b40a7d961b19 server_cookie=fc93328dd56f1c43 in_seq=0 out_seq=0 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.078+0000 7f91fdffb640 10 client.26720 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.078+0000 7f91fdffb640 1 -- 10.20.193.28:0/1188084682 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e9d5df5630 con 0x55e9d5ed5f50 2026-02-20T13:20:58.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.078+0000 7f91fdffb640 10 client.26720 handle_command_reply: tid=0 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.078+0000 7f9241224e00 1 client.26720 shutdown 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.078+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 msgr2=0x55e9d5ed2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.078+0000 7f9241224e00 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ed2180 secure :-1 s=READY pgs=255 gs=2 cs=0 l=1 c_cookie=4068078345193959832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9220004820 tx=0x7f92200059b0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 shutdown_connections 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9d5ed5f50 0x55e9d5ed63c0 crc :-1 s=READY pgs=128 gs=4 cs=0 l=0 c_cookie=3179739294073232153 s_cookie=18199946103886912579 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ef9700 0x55e9d5ed2be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ed2180 unknown :-1 s=CLOSED pgs=255 gs=2 cs=0 l=1 c_cookie=4068078345193959832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 1 --2- 10.20.193.28:0/1188084682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed1b30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 >> 10.20.193.28:0/1188084682 conn(0x55e9d5dd71c0 msgr2=0x55e9d5eb9790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f91fdffb640 0 client.26720 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 shutdown_connections 2026-02-20T13:20:58.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 1 -- 10.20.193.28:0/1188084682 wait complete. 2026-02-20T13:20:58.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.079+0000 7f9241224e00 20 client.26720 trim_cache size 0 max 16384 2026-02-20T13:20:58.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.086+0000 7f9241224e00 1 Processor -- start 2026-02-20T13:20:58.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.086+0000 7f9241224e00 1 -- start start 2026-02-20T13:20:58.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.086+0000 7f9241224e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed20b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f9241224e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ebc8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f9241224e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5ef9700 0x55e9d5ecee50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f9241224e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5dc18d0 con 0x55e9d5ef9700 2026-02-20T13:20:58.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f9241224e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5b02f10 con 0x55e9d5ed8de0 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f9241224e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5e27490 con 0x55e9d5eb84c0 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923c881640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5ef9700 0x55e9d5ecee50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5ef9700 0x55e9d5ecee50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44616/0 (socket says 10.20.193.28:44616) 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 -- 10.20.193.28:0/771202372 learned_addr learned my addr 10.20.193.28:0/771202372 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923c881640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52908/0 (socket says 10.20.193.28:52908) 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f922ffff640 1 --2- 10.20.193.28:0/771202372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ebc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 -- 10.20.193.28:0/771202372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5eb84c0 msgr2=0x55e9d5ed20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 --2- 10.20.193.28:0/771202372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 -- 10.20.193.28:0/771202372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 msgr2=0x55e9d5ebc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 --2- 10.20.193.28:0/771202372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ebc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 -- 10.20.193.28:0/771202372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9d5d59670 con 0x55e9d5ef9700 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f923d082640 1 --2- 10.20.193.28:0/771202372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5ef9700 0x55e9d5ecee50 secure :-1 s=READY pgs=608 gs=2 cs=0 l=1 c_cookie=13841726125794367749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9234005770 tx=0x7f923400a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c017b09326379905 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.087+0000 7f91fffff640 1 -- 10.20.193.28:0/771202372 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9234018070 con 0x55e9d5ef9700 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f91fffff640 1 -- 10.20.193.28:0/771202372 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9234019040 con 0x55e9d5ef9700 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f91fffff640 1 -- 10.20.193.28:0/771202372 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92340118e0 con 0x55e9d5ef9700 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 -- 10.20.193.28:0/771202372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5ef9700 msgr2=0x55e9d5ecee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 --2- 10.20.193.28:0/771202372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5ef9700 0x55e9d5ecee50 secure :-1 s=READY pgs=608 gs=2 cs=0 l=1 c_cookie=13841726125794367749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9234005770 tx=0x7f923400a310 comp rx=0 tx=0).stop 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 -- 10.20.193.28:0/771202372 shutdown_connections 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 --2- 10.20.193.28:0/771202372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5ef9700 0x55e9d5ecee50 unknown :-1 s=CLOSED pgs=608 gs=2 cs=0 l=1 c_cookie=13841726125794367749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 --2- 10.20.193.28:0/771202372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ed8de0 0x55e9d5ebc8b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 --2- 10.20.193.28:0/771202372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ed20b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 -- 10.20.193.28:0/771202372 >> 10.20.193.28:0/771202372 conn(0x55e9d5dd71c0 msgr2=0x55e9d5ed19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:58.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 -- 10.20.193.28:0/771202372 shutdown_connections 2026-02-20T13:20:58.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 -- 10.20.193.28:0/771202372 wait complete. 2026-02-20T13:20:58.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 -- start start 2026-02-20T13:20:58.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.088+0000 7f9241224e00 1 Processor -- start 2026-02-20T13:20:58.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f9241224e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ede780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f9241224e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ed8de0 0x55e9d5edecc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f9241224e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ef9700 0x55e9d5edd4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f9241224e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5edda20 con 0x55e9d5eb84c0 2026-02-20T13:20:58.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f9241224e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5eddb60 con 0x55e9d5ef9700 2026-02-20T13:20:58.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f9241224e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5eddd20 con 0x55e9d5ed8de0 2026-02-20T13:20:58.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ede780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ede780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44624/0 (socket says 10.20.193.28:44624) 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 -- 10.20.193.28:0/2052600820 learned_addr learned my addr 10.20.193.28:0/2052600820 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f922ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ed8de0 0x55e9d5edecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923d082640 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ef9700 0x55e9d5edd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 -- 10.20.193.28:0/2052600820 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ed8de0 msgr2=0x55e9d5edecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ed8de0 0x55e9d5edecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 -- 10.20.193.28:0/2052600820 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ef9700 msgr2=0x55e9d5edd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ef9700 0x55e9d5edd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 -- 10.20.193.28:0/2052600820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9d5d540f0 con 0x55e9d5eb84c0 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f923c881640 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ede780 secure :-1 s=READY pgs=609 gs=1 cs=0 l=1 c_cookie=11221573847518817893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92280ad1f0 tx=0x7f9228004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbb09f5ba2c2e65 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:58.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.089+0000 7f91fdffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f91fdffb640 1 -- 10.20.193.28:0/2052600820 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92280ad980 con 0x55e9d5eb84c0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f91fdffb640 1 -- 10.20.193.28:0/2052600820 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f92280b2ca0 con 0x55e9d5eb84c0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f91fdffb640 1 -- 10.20.193.28:0/2052600820 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92280acda0 con 0x55e9d5eb84c0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92340053e0 con 0x55e9d5eb84c0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f91fdffb640 1 -- 10.20.193.28:0/2052600820 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f92280c8070 con 0x55e9d5eb84c0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f91fdffb640 10 client.16734 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 10 client.16734 _ll_register_callbacks cb 0x55e9d5d4ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9d5e73ca0 con 0x55e9d5eb84c0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f91fdffb640 1 -- 10.20.193.28:0/2052600820 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f92280b5280 con 0x55e9d5eb84c0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 10 client.16734 fetch_fsmap learned FSMap version 28 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e9d5d480d0 con 0x55e9d5eb84c0 2026-02-20T13:20:58.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f91fdffb640 1 -- 10.20.193.28:0/2052600820 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f92280b7c30 con 0x55e9d5eb84c0 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 10 client.16734 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 10 client.16734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 20 client.16734 populate_metadata read hostname 'trial028' 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9d5fa6860 0x55e9d5fc6d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 4 client.16734 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.090+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e9d5aa7640 con 0x55e9d5fa6860 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.091+0000 7f922ffff640 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9d5fa6860 0x55e9d5fc6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.091+0000 7f922ffff640 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9d5fa6860 0x55e9d5fc6d10 crc :-1 s=READY pgs=129 gs=4 cs=0 l=0 c_cookie=11088123421237711788 s_cookie=3821953522273097885 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99e0ed81149013ac server_cookie=350a4e7a9b24189d in_seq=0 out_seq=0 2026-02-20T13:20:58.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.091+0000 7f91fdffb640 10 client.16734 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:58.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f91fdffb640 1 -- 10.20.193.28:0/2052600820 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e9d5aa7640 con 0x55e9d5fa6860 2026-02-20T13:20:58.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f91fdffb640 10 client.16734 handle_command_reply: tid=0 2026-02-20T13:20:58.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 client.16734 shutdown 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 msgr2=0x55e9d5ede780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ede780 secure :-1 s=READY pgs=609 gs=1 cs=0 l=1 c_cookie=11221573847518817893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92280ad1f0 tx=0x7f9228004040 comp rx=0 tx=0).stop 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 shutdown_connections 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9d5fa6860 0x55e9d5fc6d10 crc :-1 s=READY pgs=129 gs=4 cs=0 l=0 c_cookie=11088123421237711788 s_cookie=3821953522273097885 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9d5ef9700 0x55e9d5edd4e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9d5ed8de0 0x55e9d5edecc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 --2- 10.20.193.28:0/2052600820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9d5eb84c0 0x55e9d5ede780 unknown :-1 s=CLOSED pgs=609 gs=1 cs=0 l=1 c_cookie=11221573847518817893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 >> 10.20.193.28:0/2052600820 conn(0x55e9d5dd71c0 msgr2=0x55e9d5ed2040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.095+0000 7f91fdffb640 0 client.16734 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 shutdown_connections 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f9241224e00 1 -- 10.20.193.28:0/2052600820 wait complete. 2026-02-20T13:20:58.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f9241224e00 20 client.16734 trim_cache size 0 max 16384 2026-02-20T13:20:58.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:20:58.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:20:58.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:20:58.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:20:58.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 -- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f92140b5760 msgr2=0x7f92140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f92140b5760 0x7f92140d5c10 secure :-1 s=READY pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9220002d80 tx=0x7f922003a040 comp rx=0 tx=0).stop 2026-02-20T13:20:58.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 -- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810b510 msgr2=0x7f923810e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:58.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810b510 0x7f923810e680 secure :-1 s=READY pgs=607 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9228009480 tx=0x7f922800ee60 comp rx=0 tx=0).stop 2026-02-20T13:20:58.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 -- 10.20.193.28:0/1373386505 shutdown_connections 2026-02-20T13:20:58.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f92140b5760 0x7f92140d5c10 unknown :-1 s=CLOSED pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f923810dd00 0x7f923810f8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f923810d340 0x7f923810ecd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 --2- 10.20.193.28:0/1373386505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f923810b510 0x7f923810e680 unknown :-1 s=CLOSED pgs=607 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:58.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 -- 10.20.193.28:0/1373386505 >> 10.20.193.28:0/1373386505 conn(0x7f92380e8a80 msgr2=0x7f92380ea730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:58.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 -- 10.20.193.28:0/1373386505 shutdown_connections 2026-02-20T13:20:58.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:20:58.096+0000 7f923d883640 1 -- 10.20.193.28:0/1373386505 wait complete. 2026-02-20T13:20:58.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:20:58 trial034 ceph-mon[43332]: pgmap v290: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2026-02-20T13:20:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:20:58 trial028 ceph-mon[37442]: pgmap v290: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2026-02-20T13:20:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:20:58 trial127 ceph-mon[43817]: pgmap v290: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2026-02-20T13:20:59.534 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:20:59.720 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:20:59.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.894+0000 7fe1e6c29640 1 -- 10.20.193.28:0/1047032606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e010ddc0 msgr2=0x7fe1e0112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:59.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.894+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/1047032606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e010ddc0 0x7fe1e0112e10 secure :-1 s=READY pgs=610 gs=2 cs=0 l=1 c_cookie=11647914260598422833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1c8009950 tx=0x7fe1c802f190 comp rx=0 tx=0).stop 2026-02-20T13:20:59.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.895+0000 7fe1e6c29640 1 -- 10.20.193.28:0/1047032606 shutdown_connections 2026-02-20T13:20:59.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.895+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/1047032606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e010ddc0 0x7fe1e0112e10 unknown :-1 s=CLOSED pgs=610 gs=2 cs=0 l=1 c_cookie=11647914260598422833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:59.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.895+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/1047032606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe1e01135c0 0x7fe1e0173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:59.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.895+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/1047032606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe1e010d3d0 0x7fe1e010d7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:59.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.895+0000 7fe1e6c29640 1 -- 10.20.193.28:0/1047032606 >> 10.20.193.28:0/1047032606 conn(0x7fe1e00eacc0 msgr2=0x7fe1e010b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:20:59.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.895+0000 7fe1e6c29640 1 -- 10.20.193.28:0/1047032606 shutdown_connections 2026-02-20T13:20:59.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.895+0000 7fe1e6c29640 1 -- 10.20.193.28:0/1047032606 wait complete. 2026-02-20T13:20:59.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e6c29640 1 Processor -- start 2026-02-20T13:20:59.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e6c29640 1 -- start start 2026-02-20T13:20:59.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e6c29640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe1e010d3d0 0x7fe1e011abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:59.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e6c29640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe1e010ddc0 0x7fe1e011b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:59.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e6c29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e01135c0 0x7fe1e01204d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e6c29640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0120af0 con 0x7fe1e01135c0 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e6c29640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0120c60 con 0x7fe1e010ddc0 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e6c29640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0120e20 con 0x7fe1e010d3d0 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e499e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe1e010d3d0 0x7fe1e011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1d7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe1e010ddc0 0x7fe1e011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e499e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe1e010d3d0 0x7fe1e011abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52916/0 (socket says 10.20.193.28:52916) 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e499e640 1 -- 10.20.193.28:0/2965207894 learned_addr learned my addr 10.20.193.28:0/2965207894 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.896+0000 7fe1e519f640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e01135c0 0x7fe1e01204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e499e640 1 -- 10.20.193.28:0/2965207894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe1e010ddc0 msgr2=0x7fe1e011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e499e640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe1e010ddc0 0x7fe1e011b100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:59.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e499e640 1 -- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e01135c0 msgr2=0x7fe1e01204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e499e640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e01135c0 0x7fe1e01204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e499e640 1 -- 10.20.193.28:0/2965207894 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c8009570 con 0x7fe1e010d3d0 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1d7fff640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe1e010ddc0 0x7fe1e011b100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e519f640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e01135c0 0x7fe1e01204d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e499e640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe1e010d3d0 0x7fe1e011abc0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1d0009480 tx=0x7fe1d000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1d5ffb640 1 -- 10.20.193.28:0/2965207894 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1d000cd40 con 0x7fe1e010d3d0 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1d5ffb640 1 -- 10.20.193.28:0/2965207894 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe1d0004d30 con 0x7fe1e010d3d0 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e0121100 con 0x7fe1e010d3d0 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1d5ffb640 1 -- 10.20.193.28:0/2965207894 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1d0018650 con 0x7fe1e010d3d0 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.897+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e0161800 con 0x7fe1e010d3d0 2026-02-20T13:20:59.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.898+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e010e6b0 con 0x7fe1e010d3d0 2026-02-20T13:20:59.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.900+0000 7fe1d5ffb640 1 -- 10.20.193.28:0/2965207894 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe1d001f060 con 0x7fe1e010d3d0 2026-02-20T13:20:59.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.902+0000 7fe1d5ffb640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1bc0b56e0 0x7fe1bc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:20:59.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.902+0000 7fe1d5ffb640 1 -- 10.20.193.28:0/2965207894 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe1d0014070 con 0x7fe1e010d3d0 2026-02-20T13:20:59.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.902+0000 7fe1d7fff640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1bc0b56e0 0x7fe1bc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:20:59.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.902+0000 7fe1d5ffb640 1 -- 10.20.193.28:0/2965207894 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe1d00e73d0 con 0x7fe1e010d3d0 2026-02-20T13:20:59.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:20:59.902+0000 7fe1d7fff640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1bc0b56e0 0x7fe1bc0d5b90 secure :-1 s=READY pgs=344 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1c8038820 tx=0x7fe1c803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.044+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1e010d7a0 con 0x7fe1e010d3d0 2026-02-20T13:21:00.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.045+0000 7fe1d5ffb640 1 -- 10.20.193.28:0/2965207894 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fe1d00a9a90 con 0x7fe1e010d3d0 2026-02-20T13:21:00.049 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:21:00.049 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1bc0b56e0 msgr2=0x7fe1bc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1bc0b56e0 0x7fe1bc0d5b90 secure :-1 s=READY pgs=344 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1c8038820 tx=0x7fe1c803a040 comp rx=0 tx=0).stop 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe1e010d3d0 msgr2=0x7fe1e011abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe1e010d3d0 0x7fe1e011abc0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1d0009480 tx=0x7fe1d000ee60 comp rx=0 tx=0).stop 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 shutdown_connections 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe1bc0b56e0 0x7fe1bc0d5b90 unknown :-1 s=CLOSED pgs=344 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e01135c0 0x7fe1e01204d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe1e010ddc0 0x7fe1e011b100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 --2- 10.20.193.28:0/2965207894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe1e010d3d0 0x7fe1e011abc0 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 >> 10.20.193.28:0/2965207894 conn(0x7fe1e00eacc0 msgr2=0x7fe1e010b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 shutdown_connections 2026-02-20T13:21:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.046+0000 7fe1e6c29640 1 -- 10.20.193.28:0/2965207894 wait complete. 2026-02-20T13:21:00.187 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id f92cbbdf --release --await' 2026-02-20T13:21:00.187 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id f92cbbdf --release --await 2026-02-20T13:21:00.373 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:00.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.541+0000 7f477668f640 1 -- 10.20.193.28:0/1359587185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770119ba0 msgr2=0x7f477017a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.541+0000 7f477668f640 1 --2- 10.20.193.28:0/1359587185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770119ba0 0x7f477017a570 secure :-1 s=READY pgs=611 gs=1 cs=0 l=1 c_cookie=3144406168467791759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f476c00aa30 tx=0x7f476c030270 comp rx=0 tx=0).stop 2026-02-20T13:21:00.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.542+0000 7f477668f640 1 -- 10.20.193.28:0/1359587185 shutdown_connections 2026-02-20T13:21:00.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.542+0000 7f477668f640 1 --2- 10.20.193.28:0/1359587185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770119ba0 0x7f477017a570 unknown :-1 s=CLOSED pgs=611 gs=1 cs=0 l=1 c_cookie=3144406168467791759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.542+0000 7f477668f640 1 --2- 10.20.193.28:0/1359587185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4770114990 0x7f47701193f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.542+0000 7f477668f640 1 --2- 10.20.193.28:0/1359587185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4770113fa0 0x7f4770114370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.542+0000 7f477668f640 1 -- 10.20.193.28:0/1359587185 >> 10.20.193.28:0/1359587185 conn(0x7f4770064a90 msgr2=0x7f4770064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:00.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.542+0000 7f477668f640 1 -- 10.20.193.28:0/1359587185 shutdown_connections 2026-02-20T13:21:00.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.542+0000 7f477668f640 1 -- 10.20.193.28:0/1359587185 wait complete. 2026-02-20T13:21:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477668f640 1 Processor -- start 2026-02-20T13:21:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477668f640 1 -- start start 2026-02-20T13:21:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477668f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770113fa0 0x7f4770122300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477668f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4770114990 0x7f4770122840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477668f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4770119ba0 0x7f4770127bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477668f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47701281e0 con 0x7f4770113fa0 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477668f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4770128350 con 0x7f4770114990 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477668f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4770128510 con 0x7f4770119ba0 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477568d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770113fa0 0x7f4770122300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477568d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770113fa0 0x7f4770122300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52482/0 (socket says 10.20.193.28:52482) 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f477568d640 1 -- 10.20.193.28:0/946033801 learned_addr learned my addr 10.20.193.28:0/946033801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f4774e8c640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4770114990 0x7f4770122840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.543+0000 7f4775e8e640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4770119ba0 0x7f4770127bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f477568d640 1 -- 10.20.193.28:0/946033801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4770119ba0 msgr2=0x7f4770127bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f477568d640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4770119ba0 0x7f4770127bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f477568d640 1 -- 10.20.193.28:0/946033801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4770114990 msgr2=0x7f4770122840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f477568d640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4770114990 0x7f4770122840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f477568d640 1 -- 10.20.193.28:0/946033801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c00a650 con 0x7f4770113fa0 2026-02-20T13:21:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f477568d640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770113fa0 0x7f4770122300 secure :-1 s=READY pgs=612 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4760009480 tx=0x7f476000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f475e7fc640 1 -- 10.20.193.28:0/946033801 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f476000ccc0 con 0x7f4770113fa0 2026-02-20T13:21:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f475e7fc640 1 -- 10.20.193.28:0/946033801 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f476000ce20 con 0x7f4770113fa0 2026-02-20T13:21:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f475e7fc640 1 -- 10.20.193.28:0/946033801 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47600106b0 con 0x7f4770113fa0 2026-02-20T13:21:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f477668f640 1 -- 10.20.193.28:0/946033801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47701287f0 con 0x7f4770113fa0 2026-02-20T13:21:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.544+0000 7f477668f640 1 -- 10.20.193.28:0/946033801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4770168ef0 con 0x7f4770113fa0 2026-02-20T13:21:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.547+0000 7f475e7fc640 1 -- 10.20.193.28:0/946033801 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f476001f060 con 0x7f4770113fa0 2026-02-20T13:21:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.548+0000 7f475e7fc640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f474c0b5760 0x7f474c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.548+0000 7f475e7fc640 1 -- 10.20.193.28:0/946033801 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4760014070 con 0x7f4770113fa0 2026-02-20T13:21:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.549+0000 7f4774e8c640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f474c0b5760 0x7f474c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.549+0000 7f4774e8c640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f474c0b5760 0x7f474c0d5c10 secure :-1 s=READY pgs=345 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4770128c50 tx=0x7f4764005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.549+0000 7f4779912e00 1 Processor -- start 2026-02-20T13:21:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.549+0000 7f4779912e00 1 -- start start 2026-02-20T13:21:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4779912e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6dc8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4779912e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d721590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4779912e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 0x56313d741eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4779912e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56313d5f1c70 con 0x56313d6dce30 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4779912e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56313d5ed9a0 con 0x56313d721ad0 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4779912e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56313d5e7b00 con 0x56313d6dc520 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d721590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f477568d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4775e8e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 0x56313d741eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d721590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52490/0 (socket says 10.20.193.28:52490) 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 -- 10.20.193.28:0/3209464967 learned_addr learned my addr 10.20.193.28:0/3209464967 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f477568d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6dc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40740/0 (socket says 10.20.193.28:40740) 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 -- 10.20.193.28:0/3209464967 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 msgr2=0x56313d6dc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 --2- 10.20.193.28:0/3209464967 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6dc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 -- 10.20.193.28:0/3209464967 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 msgr2=0x56313d741eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 --2- 10.20.193.28:0/3209464967 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 0x56313d741eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 -- 10.20.193.28:0/3209464967 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313d592f80 con 0x56313d6dce30 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f4774e8c640 1 --2- 10.20.193.28:0/3209464967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d721590 secure :-1 s=READY pgs=613 gs=1 cs=0 l=1 c_cookie=13828449824870485865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4764009ca0 tx=0x7f4764014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe885d975b7cf69 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f473dce5640 1 -- 10.20.193.28:0/3209464967 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4764011e60 con 0x56313d6dce30 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f473dce5640 1 -- 10.20.193.28:0/3209464967 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4764009da0 con 0x56313d6dce30 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.550+0000 7f473dce5640 1 -- 10.20.193.28:0/3209464967 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4764025990 con 0x56313d6dce30 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 -- 10.20.193.28:0/3209464967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 msgr2=0x56313d721590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 --2- 10.20.193.28:0/3209464967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d721590 secure :-1 s=READY pgs=613 gs=1 cs=0 l=1 c_cookie=13828449824870485865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4764009ca0 tx=0x7f4764014000 comp rx=0 tx=0).stop 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 -- 10.20.193.28:0/3209464967 shutdown_connections 2026-02-20T13:21:00.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 --2- 10.20.193.28:0/3209464967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d721590 unknown :-1 s=CLOSED pgs=613 gs=1 cs=0 l=1 c_cookie=13828449824870485865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 --2- 10.20.193.28:0/3209464967 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 0x56313d741eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 --2- 10.20.193.28:0/3209464967 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6dc8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 -- 10.20.193.28:0/3209464967 >> 10.20.193.28:0/3209464967 conn(0x56313d5faa60 msgr2=0x56313d6dae00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:00.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 -- 10.20.193.28:0/3209464967 shutdown_connections 2026-02-20T13:21:00.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.551+0000 7f4779912e00 1 -- 10.20.193.28:0/3209464967 wait complete. 2026-02-20T13:21:00.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.552+0000 7f4779912e00 1 -- start start 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.552+0000 7f4779912e00 1 Processor -- start 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.552+0000 7f4779912e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 0x56313d6f4670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.552+0000 7f4779912e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6f4bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.552+0000 7f4779912e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6f9ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.552+0000 7f4779912e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56313d6fa0e0 con 0x56313d6dce30 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.552+0000 7f4779912e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56313d6fa250 con 0x56313d6dc520 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4779912e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56313d6fa410 con 0x56313d721ad0 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4775e8e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6f9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f477568d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 0x56313d6f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4775e8e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6f9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40748/0 (socket says 10.20.193.28:40748) 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4775e8e640 1 -- 10.20.193.28:0/2950688770 learned_addr learned my addr 10.20.193.28:0/2950688770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4774e8c640 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4774e8c640 1 -- 10.20.193.28:0/2950688770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 msgr2=0x56313d6f9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4774e8c640 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6f9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4774e8c640 1 -- 10.20.193.28:0/2950688770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 msgr2=0x56313d6f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4774e8c640 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 0x56313d6f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4774e8c640 1 -- 10.20.193.28:0/2950688770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313d56b710 con 0x56313d6dce30 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f4774e8c640 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6f4bb0 secure :-1 s=READY pgs=614 gs=1 cs=0 l=1 c_cookie=3953413069604107738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4764004370 tx=0x7f47640257b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36dd583da023b5da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f472affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.553+0000 7f472affd640 1 -- 10.20.193.28:0/2950688770 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4764029040 con 0x56313d6dce30 2026-02-20T13:21:00.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f472affd640 1 -- 10.20.193.28:0/2950688770 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f476401ae90 con 0x56313d6dce30 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f472affd640 1 -- 10.20.193.28:0/2950688770 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f476401a9b0 con 0x56313d6dce30 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4764009940 con 0x56313d6dce30 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f472affd640 1 -- 10.20.193.28:0/2950688770 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f476401ab40 con 0x56313d6dce30 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f472affd640 10 client.16752 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 10 client.16752 _ll_register_callbacks cb 0x56313d568d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56313d27dba0 con 0x56313d6dce30 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f472affd640 1 -- 10.20.193.28:0/2950688770 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4764005240 con 0x56313d6dce30 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 10 client.16752 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56313d57d350 con 0x56313d6dce30 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f472affd640 1 -- 10.20.193.28:0/2950688770 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f47640053a0 con 0x56313d6dce30 2026-02-20T13:21:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 10 client.16752 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 10 client.16752 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 20 client.16752 populate_metadata read hostname 'trial028' 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56313d71ee10 0x56313d71f2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 4 client.16752 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.554+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56313d5ba410 con 0x56313d71ee10 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.555+0000 7f477568d640 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56313d71ee10 0x56313d71f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.555+0000 7f477568d640 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56313d71ee10 0x56313d71f2b0 crc :-1 s=READY pgs=130 gs=4 cs=0 l=0 c_cookie=6562181798020189387 s_cookie=13029995515473319755 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b118d93ce870ccb server_cookie=b4d3d7e2acb8574b in_seq=0 out_seq=0 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.555+0000 7f472affd640 10 client.16752 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f472affd640 1 -- 10.20.193.28:0/2950688770 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56313d5ba410 con 0x56313d71ee10 2026-02-20T13:21:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f472affd640 10 client.16752 handle_command_reply: tid=0 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 client.16752 shutdown 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 msgr2=0x56313d6f4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6f4bb0 secure :-1 s=READY pgs=614 gs=1 cs=0 l=1 c_cookie=3953413069604107738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4764004370 tx=0x7f47640257b0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 shutdown_connections 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56313d71ee10 0x56313d71f2b0 crc :-1 s=READY pgs=130 gs=4 cs=0 l=0 c_cookie=6562181798020189387 s_cookie=13029995515473319755 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6f4bb0 unknown :-1 s=CLOSED pgs=614 gs=1 cs=0 l=1 c_cookie=3953413069604107738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6f9ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 --2- 10.20.193.28:0/2950688770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 0x56313d6f4670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 >> 10.20.193.28:0/2950688770 conn(0x56313d5faa60 msgr2=0x56313d6db510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f472affd640 0 client.16752 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 shutdown_connections 2026-02-20T13:21:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 1 -- 10.20.193.28:0/2950688770 wait complete. 2026-02-20T13:21:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.556+0000 7f4779912e00 20 client.16752 trim_cache size 0 max 16384 2026-02-20T13:21:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4779912e00 1 Processor -- start 2026-02-20T13:21:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4779912e00 1 -- start start 2026-02-20T13:21:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4779912e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 0x56313d6f1b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4779912e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6db710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4779912e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6dbc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4779912e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56313d5e5730 con 0x56313d6dce30 2026-02-20T13:21:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4779912e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56313d2a5960 con 0x56313d6dc520 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4779912e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56313d64a180 con 0x56313d721ad0 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4774e8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6db710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4774e8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6db710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52500/0 (socket says 10.20.193.28:52500) 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4774e8c640 1 -- 10.20.193.28:0/2618822724 learned_addr learned my addr 10.20.193.28:0/2618822724 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.565+0000 7f4775e8e640 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6dbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f477568d640 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 0x56313d6f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4774e8c640 1 -- 10.20.193.28:0/2618822724 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 msgr2=0x56313d6dbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4774e8c640 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6dbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4774e8c640 1 -- 10.20.193.28:0/2618822724 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 msgr2=0x56313d6f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4774e8c640 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 0x56313d6f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4774e8c640 1 -- 10.20.193.28:0/2618822724 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313d577dd0 con 0x56313d6dce30 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4774e8c640 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6db710 secure :-1 s=READY pgs=615 gs=1 cs=0 l=1 c_cookie=855442127339354854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4764009ca0 tx=0x7f4764038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf24151df77ae6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f473d4e4640 1 -- 10.20.193.28:0/2618822724 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4764029040 con 0x56313d6dce30 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f473d4e4640 1 -- 10.20.193.28:0/2618822724 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f476403b030 con 0x56313d6dce30 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f473d4e4640 1 -- 10.20.193.28:0/2618822724 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f476401b640 con 0x56313d6dce30 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 -- 10.20.193.28:0/2618822724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 msgr2=0x56313d6db710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6db710 secure :-1 s=READY pgs=615 gs=1 cs=0 l=1 c_cookie=855442127339354854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4764009ca0 tx=0x7f4764038000 comp rx=0 tx=0).stop 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 -- 10.20.193.28:0/2618822724 shutdown_connections 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6db710 unknown :-1 s=CLOSED pgs=615 gs=1 cs=0 l=1 c_cookie=855442127339354854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d721ad0 0x56313d6dbc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 --2- 10.20.193.28:0/2618822724 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d6dc520 0x56313d6f1b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 -- 10.20.193.28:0/2618822724 >> 10.20.193.28:0/2618822724 conn(0x56313d5faa60 msgr2=0x56313d6f1420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 -- 10.20.193.28:0/2618822724 shutdown_connections 2026-02-20T13:21:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.566+0000 7f4779912e00 1 -- 10.20.193.28:0/2618822724 wait complete. 2026-02-20T13:21:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.567+0000 7f4779912e00 1 -- start start 2026-02-20T13:21:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.567+0000 7f4779912e00 1 Processor -- start 2026-02-20T13:21:00.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.567+0000 7f4779912e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6fab00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4779912e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6fb040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4779912e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 0x56313d6ffb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4779912e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56313d6fb880 con 0x56313d6dce30 2026-02-20T13:21:00.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4779912e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56313d700090 con 0x56313d721ad0 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4779912e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56313d700250 con 0x56313d6dc520 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4775e8e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 0x56313d6ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f477568d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f477568d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6fab00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40770/0 (socket says 10.20.193.28:40770) 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f477568d640 1 -- 10.20.193.28:0/1874492545 learned_addr learned my addr 10.20.193.28:0/1874492545 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4774e8c640 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4774e8c640 1 -- 10.20.193.28:0/1874492545 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 msgr2=0x56313d6fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4774e8c640 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6fab00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4774e8c640 1 -- 10.20.193.28:0/1874492545 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 msgr2=0x56313d6ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:00.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4774e8c640 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 0x56313d6ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4774e8c640 1 -- 10.20.193.28:0/1874492545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313d56ba40 con 0x56313d6dce30 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f4774e8c640 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6fb040 secure :-1 s=READY pgs=616 gs=2 cs=0 l=1 c_cookie=2879270441018054629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f476400ee40 tx=0x7f476400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f539360929d7e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.568+0000 7f472affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f472affd640 1 -- 10.20.193.28:0/1874492545 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4764029040 con 0x56313d6dce30 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f472affd640 1 -- 10.20.193.28:0/1874492545 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f476403b040 con 0x56313d6dce30 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f472affd640 1 -- 10.20.193.28:0/1874492545 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47640054c0 con 0x56313d6dce30 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56313d57d350 con 0x56313d6dce30 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f4779912e00 10 client.16758 _ll_register_callbacks cb 0x56313d568d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f472affd640 1 -- 10.20.193.28:0/1874492545 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f47640377c0 con 0x56313d6dce30 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56313d33f700 con 0x56313d6dce30 2026-02-20T13:21:00.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f472affd640 1 -- 10.20.193.28:0/1874492545 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f476401b9e0 con 0x56313d6dce30 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f4779912e00 10 client.16758 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56313d57d5b0 con 0x56313d6dce30 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.569+0000 7f472affd640 1 -- 10.20.193.28:0/1874492545 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f476402d820 con 0x56313d6dce30 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f4779912e00 10 client.16758 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f4779912e00 10 client.16758 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f4779912e00 20 client.16758 populate_metadata read hostname 'trial028' 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f4779912e00 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56313d7e0640 0x56313d800af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f4779912e00 4 client.16758 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f92cbbdf", "release": true, "await": true}] 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f92cbbdf", "release": true, "await": true}) -- 0x7f4764009da0 con 0x56313d7e0640 2026-02-20T13:21:00.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f477568d640 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56313d7e0640 0x56313d800af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f477568d640 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56313d7e0640 0x56313d800af0 crc :-1 s=READY pgs=131 gs=4 cs=0 l=0 c_cookie=9396057433854758612 s_cookie=15165743454545028116 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=826580742214ced4 server_cookie=d2778b5202dca414 in_seq=0 out_seq=0 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.570+0000 7f472affd640 10 client.16758 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f472affd640 1 -- 10.20.193.28:0/1874492545 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f4764009da0 con 0x56313d7e0640 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f472affd640 10 client.16758 handle_command_reply: tid=0 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 client.16758 shutdown 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 msgr2=0x56313d6fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6fb040 secure :-1 s=READY pgs=616 gs=2 cs=0 l=1 c_cookie=2879270441018054629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f476400ee40 tx=0x7f476400f3c0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 shutdown_connections 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56313d7e0640 0x56313d800af0 crc :-1 s=READY pgs=131 gs=4 cs=0 l=0 c_cookie=9396057433854758612 s_cookie=15165743454545028116 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56313d6dce30 0x56313d6fb040 unknown :-1 s=CLOSED pgs=616 gs=2 cs=0 l=1 c_cookie=2879270441018054629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56313d721ad0 0x56313d6ffb50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 --2- 10.20.193.28:0/1874492545 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56313d6dc520 0x56313d6fab00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f472affd640 0 client.16758 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:00.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 >> 10.20.193.28:0/1874492545 conn(0x56313d5faa60 msgr2=0x56313d6f1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:00.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 shutdown_connections 2026-02-20T13:21:00.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.572+0000 7f4779912e00 1 -- 10.20.193.28:0/1874492545 wait complete. 2026-02-20T13:21:00.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f4779912e00 20 client.16758 trim_cache size 0 max 16384 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 12, 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "f92cbbdf": { 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "version": 12, 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:21:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 148.1, 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:21:00.583 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:00.584 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:00.584 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:00.584 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:00.584 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:00.584 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:21:00.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 -- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f474c0b5760 msgr2=0x7f474c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f474c0b5760 0x7f474c0d5c10 secure :-1 s=READY pgs=345 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4770128c50 tx=0x7f4764005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:00.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 -- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770113fa0 msgr2=0x7f4770122300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:00.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770113fa0 0x7f4770122300 secure :-1 s=READY pgs=612 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4760009480 tx=0x7f476000ee60 comp rx=0 tx=0).stop 2026-02-20T13:21:00.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 -- 10.20.193.28:0/946033801 shutdown_connections 2026-02-20T13:21:00.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f474c0b5760 0x7f474c0d5c10 unknown :-1 s=CLOSED pgs=345 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4770119ba0 0x7f4770127bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4770114990 0x7f4770122840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 --2- 10.20.193.28:0/946033801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4770113fa0 0x7f4770122300 unknown :-1 s=CLOSED pgs=612 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:00.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.573+0000 7f477668f640 1 -- 10.20.193.28:0/946033801 >> 10.20.193.28:0/946033801 conn(0x7f4770064a90 msgr2=0x7f47701175e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:00.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.574+0000 7f477668f640 1 -- 10.20.193.28:0/946033801 shutdown_connections 2026-02-20T13:21:00.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:00.574+0000 7f477668f640 1 -- 10.20.193.28:0/946033801 wait complete. 2026-02-20T13:21:00.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:00 trial028 ceph-mon[37442]: pgmap v291: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2026-02-20T13:21:00.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:00 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2965207894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:00.683 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f92cbbdf', total seconds elapsed: 29.3 2026-02-20T13:21:00.683 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.1 2026-02-20T13:21:00.683 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:21:00.875 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:00 trial127 ceph-mon[43817]: pgmap v291: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2026-02-20T13:21:00.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:00 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2965207894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:00 trial034 ceph-mon[43332]: pgmap v291: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2026-02-20T13:21:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:00 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2965207894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/992261295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2f810fc20 msgr2=0x7fb2f8114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/992261295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2f810fc20 0x7fb2f8114c70 secure :-1 s=READY pgs=617 gs=1 cs=0 l=1 c_cookie=14391025076811233876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2e8009950 tx=0x7fb2e802f190 comp rx=0 tx=0).stop 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/992261295 shutdown_connections 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/992261295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2f810fc20 0x7fb2f8114c70 unknown :-1 s=CLOSED pgs=617 gs=1 cs=0 l=1 c_cookie=14391025076811233876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/992261295 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2f8115420 0x7fb2f8175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/992261295 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2f810f230 0x7fb2f810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/992261295 >> 10.20.193.28:0/992261295 conn(0x7fb2f805f830 msgr2=0x7fb2f810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/992261295 shutdown_connections 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/992261295 wait complete. 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.049+0000 7fb2fe2dc640 1 Processor -- start 2026-02-20T13:21:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2fe2dc640 1 -- start start 2026-02-20T13:21:01.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2fe2dc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2f810f230 0x7fb2f80f5560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2fe2dc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2f810fc20 0x7fb2f8175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2fe2dc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2f8115420 0x7fb2f80f5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2fe2dc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f80fae70 con 0x7fb2f8115420 2026-02-20T13:21:01.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2fe2dc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f80fafe0 con 0x7fb2f810fc20 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2fe2dc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f80fb1a0 con 0x7fb2f810f230 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2f7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2f810f230 0x7fb2f80f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2f77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2f810fc20 0x7fb2f8175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2f77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2f810fc20 0x7fb2f8175cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46522/0 (socket says 10.20.193.28:46522) 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2f7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2f810f230 0x7fb2f80f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40788/0 (socket says 10.20.193.28:40788) 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2f77fe640 1 -- 10.20.193.28:0/3437045659 learned_addr learned my addr 10.20.193.28:0/3437045659 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.050+0000 7fb2fc852640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2f8115420 0x7fb2f80f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f77fe640 1 -- 10.20.193.28:0/3437045659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2f810f230 msgr2=0x7fb2f80f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f77fe640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2f810f230 0x7fb2f80f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f77fe640 1 -- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2f8115420 msgr2=0x7fb2f80f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f77fe640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2f8115420 0x7fb2f80f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f77fe640 1 -- 10.20.193.28:0/3437045659 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e8009570 con 0x7fb2f810fc20 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f7fff640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2f810f230 0x7fb2f80f5560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f77fe640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2f810fc20 0x7fb2f8175cf0 secure :-1 s=READY pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2e8005b30 tx=0x7fb2e8004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f57fa640 1 -- 10.20.193.28:0/3437045659 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2e803d070 con 0x7fb2f810fc20 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f57fa640 1 -- 10.20.193.28:0/3437045659 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2e8038920 con 0x7fb2f810fc20 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f80fb420 con 0x7fb2f810fc20 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2f57fa640 1 -- 10.20.193.28:0/3437045659 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2e80418a0 con 0x7fb2f810fc20 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.051+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f80fb890 con 0x7fb2f810fc20 2026-02-20T13:21:01.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.052+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f8110510 con 0x7fb2f810fc20 2026-02-20T13:21:01.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.054+0000 7fb2f57fa640 1 -- 10.20.193.28:0/3437045659 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb2e8048020 con 0x7fb2f810fc20 2026-02-20T13:21:01.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.055+0000 7fb2f57fa640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2cc0b56d0 0x7fb2cc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.055+0000 7fb2f57fa640 1 -- 10.20.193.28:0/3437045659 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb2e810af30 con 0x7fb2f810fc20 2026-02-20T13:21:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.056+0000 7fb2f57fa640 1 -- 10.20.193.28:0/3437045659 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fb2e80d0d20 con 0x7fb2f810fc20 2026-02-20T13:21:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.056+0000 7fb2f7fff640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2cc0b56d0 0x7fb2cc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.056+0000 7fb2f7fff640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2cc0b56d0 0x7fb2cc0d5b80 secure :-1 s=READY pgs=346 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2e4004740 tx=0x7fb2e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:01.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.196+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2f80f66c0 con 0x7fb2f810fc20 2026-02-20T13:21:01.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.196+0000 7fb2f57fa640 1 -- 10.20.193.28:0/3437045659 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fb2e80d0f10 con 0x7fb2f810fc20 2026-02-20T13:21:01.200 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:21:01.200 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:21:01.201 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:21:01.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2cc0b56d0 msgr2=0x7fb2cc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2cc0b56d0 0x7fb2cc0d5b80 secure :-1 s=READY pgs=346 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2e4004740 tx=0x7fb2e4005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:01.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2f810fc20 msgr2=0x7fb2f8175cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2f810fc20 0x7fb2f8175cf0 secure :-1 s=READY pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2e8005b30 tx=0x7fb2e8004340 comp rx=0 tx=0).stop 2026-02-20T13:21:01.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 shutdown_connections 2026-02-20T13:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2cc0b56d0 0x7fb2cc0d5b80 unknown :-1 s=CLOSED pgs=346 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2f8115420 0x7fb2f80f5c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2f810fc20 0x7fb2f8175cf0 unknown :-1 s=CLOSED pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 --2- 10.20.193.28:0/3437045659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2f810f230 0x7fb2f80f5560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 >> 10.20.193.28:0/3437045659 conn(0x7fb2f805f830 msgr2=0x7fb2f8111a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 shutdown_connections 2026-02-20T13:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.198+0000 7fb2fe2dc640 1 -- 10.20.193.28:0/3437045659 wait complete. 2026-02-20T13:21:01.300 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 148.1 --await-for 45.0' 2026-02-20T13:21:01.301 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 148.1 --await-for 45.0 2026-02-20T13:21:01.487 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:01.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 -- 10.20.193.28:0/3752812049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa4115420 msgr2=0x7f6aa4175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 --2- 10.20.193.28:0/3752812049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa4115420 0x7f6aa4175df0 secure :-1 s=READY pgs=257 gs=3 cs=0 l=1 c_cookie=6515582831350110622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a9800aa30 tx=0x7f6a98030290 comp rx=0 tx=0).stop 2026-02-20T13:21:01.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 -- 10.20.193.28:0/3752812049 shutdown_connections 2026-02-20T13:21:01.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 --2- 10.20.193.28:0/3752812049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa4115420 0x7f6aa4175df0 unknown :-1 s=CLOSED pgs=257 gs=3 cs=0 l=1 c_cookie=6515582831350110622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 --2- 10.20.193.28:0/3752812049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6aa410fc20 0x7f6aa4114c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 --2- 10.20.193.28:0/3752812049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa410f230 0x7f6aa410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 -- 10.20.193.28:0/3752812049 >> 10.20.193.28:0/3752812049 conn(0x7f6aa405f830 msgr2=0x7f6aa410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:01.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 -- 10.20.193.28:0/3752812049 shutdown_connections 2026-02-20T13:21:01.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.673+0000 7f6aaa850640 1 -- 10.20.193.28:0/3752812049 wait complete. 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aaa850640 1 Processor -- start 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aaa850640 1 -- start start 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aaa850640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa410f230 0x7f6aa417ff80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aaa850640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa410fc20 0x7f6aa417d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aaa850640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6aa4115420 0x7f6aa417da10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aaa850640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa4158d10 con 0x7f6aa410fc20 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aaa850640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa4158e80 con 0x7f6aa410f230 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aaa850640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa4159040 con 0x7f6aa4115420 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aa3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa410f230 0x7f6aa417ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.674+0000 7f6aa8dc6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6aa4115420 0x7f6aa417da10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa8dc6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6aa4115420 0x7f6aa417da10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40796/0 (socket says 10.20.193.28:40796) 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/4040111818 learned_addr learned my addr 10.20.193.28:0/4040111818 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa410fc20 0x7f6aa417d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/4040111818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa410f230 msgr2=0x7f6aa417ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa410f230 0x7f6aa417ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa410fc20 msgr2=0x7f6aa417d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa410fc20 0x7f6aa417d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/4040111818 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9800a650 con 0x7f6aa4115420 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa410f230 0x7f6aa417ff80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa410fc20 0x7f6aa417d250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.675+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6aa4115420 0x7f6aa417da10 secure :-1 s=READY pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a98039820 tx=0x7f6a980039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.676+0000 7f6aa17fa640 1 -- 10.20.193.28:0/4040111818 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a9803e070 con 0x7f6aa4115420 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.676+0000 7f6aa17fa640 1 -- 10.20.193.28:0/4040111818 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6a980055a0 con 0x7f6aa4115420 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.676+0000 7f6aaa850640 1 -- 10.20.193.28:0/4040111818 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa41592c0 con 0x7f6aa4115420 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.676+0000 7f6aa17fa640 1 -- 10.20.193.28:0/4040111818 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a98042a00 con 0x7f6aa4115420 2026-02-20T13:21:01.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.676+0000 7f6aaa850640 1 -- 10.20.193.28:0/4040111818 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa4159730 con 0x7f6aa4115420 2026-02-20T13:21:01.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.679+0000 7f6aa17fa640 1 -- 10.20.193.28:0/4040111818 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6a98039b80 con 0x7f6aa4115420 2026-02-20T13:21:01.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.680+0000 7f6aa17fa640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a780b5760 0x7f6a780d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.680+0000 7f6aa17fa640 1 -- 10.20.193.28:0/4040111818 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6a9810c460 con 0x7f6aa4115420 2026-02-20T13:21:01.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.680+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a780b5760 0x7f6a780d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.681+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a780b5760 0x7f6a780d5c10 secure :-1 s=READY pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a90004740 tx=0x7f6a90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:01.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aac84ae00 1 Processor -- start 2026-02-20T13:21:01.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aac84ae00 1 -- start start 2026-02-20T13:21:01.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfce5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfd2a8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd4b1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfbfa780 con 0x55b3dfce6160 2026-02-20T13:21:01.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfbf64b0 con 0x55b3dfce5850 2026-02-20T13:21:01.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfbf0610 con 0x55b3dfd2ae00 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfd2a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfd2a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52540/0 (socket says 10.20.193.28:52540) 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa37fe640 1 -- 10.20.193.28:0/359043643 learned_addr learned my addr 10.20.193.28:0/359043643 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfce5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd4b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa37fe640 1 -- 10.20.193.28:0/359043643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 msgr2=0x55b3dfd4b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd4b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa37fe640 1 -- 10.20.193.28:0/359043643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 msgr2=0x55b3dfce5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfce5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa37fe640 1 -- 10.20.193.28:0/359043643 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3dfb9bc50 con 0x55b3dfce6160 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd4b1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.682+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfce5c20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfd2a8c0 secure :-1 s=READY pgs=618 gs=2 cs=0 l=1 c_cookie=14913778441864366606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a940041a0 tx=0x7f6a94004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef86279ee344a0e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6a74ce3640 1 -- 10.20.193.28:0/359043643 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a94002e10 con 0x55b3dfce6160 2026-02-20T13:21:01.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6a74ce3640 1 -- 10.20.193.28:0/359043643 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6a9401a920 con 0x55b3dfce6160 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6a74ce3640 1 -- 10.20.193.28:0/359043643 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a94010ba0 con 0x55b3dfce6160 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aac84ae00 1 -- 10.20.193.28:0/359043643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 msgr2=0x55b3dfd2a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfd2a8c0 secure :-1 s=READY pgs=618 gs=2 cs=0 l=1 c_cookie=14913778441864366606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a940041a0 tx=0x7f6a94004670 comp rx=0 tx=0).stop 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aac84ae00 1 -- 10.20.193.28:0/359043643 shutdown_connections 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfd2a8c0 unknown :-1 s=CLOSED pgs=618 gs=2 cs=0 l=1 c_cookie=14913778441864366606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd4b1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/359043643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfce5c20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aac84ae00 1 -- 10.20.193.28:0/359043643 >> 10.20.193.28:0/359043643 conn(0x55b3dfc03110 msgr2=0x55b3dfce4130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.683+0000 7f6aac84ae00 1 -- 10.20.193.28:0/359043643 shutdown_connections 2026-02-20T13:21:01.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.684+0000 7f6aac84ae00 1 -- 10.20.193.28:0/359043643 wait complete. 2026-02-20T13:21:01.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aac84ae00 1 -- start start 2026-02-20T13:21:01.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aac84ae00 1 Processor -- start 2026-02-20T13:21:01.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfcfd5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfcfdb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd02b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfd03050 con 0x55b3dfce6160 2026-02-20T13:21:01.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfd031c0 con 0x55b3dfce5850 2026-02-20T13:21:01.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfd03380 con 0x55b3dfd2ae00 2026-02-20T13:21:01.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.685+0000 7f6aa3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfcfd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd02b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd02b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40818/0 (socket says 10.20.193.28:40818) 2026-02-20T13:21:01.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/2882226608 learned_addr learned my addr 10.20.193.28:0/2882226608 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:01.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfcfdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/2882226608 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 msgr2=0x55b3dfcfd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:01.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfcfd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/2882226608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 msgr2=0x55b3dfcfdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:01.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfcfdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/2882226608 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3dfb73e60 con 0x55b3dfd2ae00 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfcfdb20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd02b10 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=13758309228083038570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a980ce920 tx=0x7f6a98003f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beef555929de496a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6a65ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6a65ffb640 1 -- 10.20.193.28:0/2882226608 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a980daac0 con 0x55b3dfd2ae00 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6a65ffb640 1 -- 10.20.193.28:0/2882226608 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6a980dd900 con 0x55b3dfd2ae00 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.686+0000 7f6a65ffb640 1 -- 10.20.193.28:0/2882226608 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a980d0850 con 0x55b3dfd2ae00 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a94009d70 con 0x55b3dfd2ae00 2026-02-20T13:21:01.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 10 client.26701 _ll_register_callbacks cb 0x55b3dfb71320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3df886eb0 con 0x55b3dfd2ae00 2026-02-20T13:21:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6a65ffb640 1 -- 10.20.193.28:0/2882226608 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6a98041370 con 0x55b3dfd2ae00 2026-02-20T13:21:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6a65ffb640 1 -- 10.20.193.28:0/2882226608 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a98005040 con 0x55b3dfd2ae00 2026-02-20T13:21:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 10 client.26701 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b3dfb85d80 con 0x55b3dfd2ae00 2026-02-20T13:21:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6a65ffb640 1 -- 10.20.193.28:0/2882226608 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6a980d09b0 con 0x55b3dfd2ae00 2026-02-20T13:21:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 10 client.26701 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 10 client.26701 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 20 client.26701 populate_metadata read hostname 'trial028' 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b3dfd27ab0 0x55b3dfd27f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 4 client.26701 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.687+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3dfbc2700 con 0x55b3dfd27ab0 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.688+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b3dfd27ab0 0x55b3dfd27f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.688+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b3dfd27ab0 0x55b3dfd27f50 crc :-1 s=READY pgs=132 gs=4 cs=0 l=0 c_cookie=18100125088021759388 s_cookie=17348307167637549215 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb308fde75ac459c server_cookie=f0c191742566309f in_seq=0 out_seq=0 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.688+0000 7f6a65ffb640 10 client.26701 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6a65ffb640 1 -- 10.20.193.28:0/2882226608 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b3dfbc2700 con 0x55b3dfd27ab0 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6a65ffb640 10 client.26701 handle_command_reply: tid=0 2026-02-20T13:21:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 client.26701 shutdown 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 msgr2=0x55b3dfd02b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd02b10 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=13758309228083038570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a980ce920 tx=0x7f6a98003f50 comp rx=0 tx=0).stop 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 shutdown_connections 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b3dfd27ab0 0x55b3dfd27f50 crc :-1 s=READY pgs=132 gs=4 cs=0 l=0 c_cookie=18100125088021759388 s_cookie=17348307167637549215 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce6160 0x55b3dfcfdb20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd02b10 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=13758309228083038570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/2882226608 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce5850 0x55b3dfcfd5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6a65ffb640 0 client.26701 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 >> 10.20.193.28:0/2882226608 conn(0x55b3dfc03110 msgr2=0x55b3dfce4840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 shutdown_connections 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 1 -- 10.20.193.28:0/2882226608 wait complete. 2026-02-20T13:21:01.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.689+0000 7f6aac84ae00 20 client.26701 trim_cache size 0 max 16384 2026-02-20T13:21:01.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aac84ae00 1 Processor -- start 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aac84ae00 1 -- start start 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfce5850 0x55b3dfce4a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 0x55b3dfce4f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfd2ae00 0x55b3dfcf9bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfbee240 con 0x55b3dfd2ae00 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3df8aeec0 con 0x55b3dfce6160 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfcf6b40 con 0x55b3dfce5850 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.698+0000 7f6aa3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfce5850 0x55b3dfce4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfce5850 0x55b3dfce4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40820/0 (socket says 10.20.193.28:40820) 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa3fff640 1 -- 10.20.193.28:0/3242961804 learned_addr learned my addr 10.20.193.28:0/3242961804 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfd2ae00 0x55b3dfcf9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 0x55b3dfce4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/3242961804 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfce5850 msgr2=0x55b3dfce4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfce5850 0x55b3dfce4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/3242961804 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 msgr2=0x55b3dfce4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 0x55b3dfce4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa8dc6640 1 -- 10.20.193.28:0/3242961804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3dfb80800 con 0x55b3dfd2ae00 2026-02-20T13:21:01.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfd2ae00 0x55b3dfcf9bb0 secure :-1 s=READY pgs=619 gs=3 cs=0 l=1 c_cookie=11361425472283097987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a980cee40 tx=0x7f6a9803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dabe44589823b83 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6a67fff640 1 -- 10.20.193.28:0/3242961804 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a980dcbf0 con 0x55b3dfd2ae00 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6a67fff640 1 -- 10.20.193.28:0/3242961804 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55b3df886eb0 con 0x55b3dfd2ae00 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6a67fff640 1 -- 10.20.193.28:0/3242961804 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a980d41b0 con 0x55b3dfd2ae00 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aac84ae00 1 -- 10.20.193.28:0/3242961804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfd2ae00 msgr2=0x55b3dfcf9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.699+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfd2ae00 0x55b3dfcf9bb0 secure :-1 s=READY pgs=619 gs=3 cs=0 l=1 c_cookie=11361425472283097987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a980cee40 tx=0x7f6a9803b000 comp rx=0 tx=0).stop 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 -- 10.20.193.28:0/3242961804 shutdown_connections 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfd2ae00 0x55b3dfcf9bb0 unknown :-1 s=CLOSED pgs=619 gs=3 cs=0 l=1 c_cookie=11361425472283097987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 0x55b3dfce4f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/3242961804 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfce5850 0x55b3dfce4a40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 -- 10.20.193.28:0/3242961804 >> 10.20.193.28:0/3242961804 conn(0x55b3dfc03110 msgr2=0x55b3dfd29020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 -- 10.20.193.28:0/3242961804 shutdown_connections 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 -- 10.20.193.28:0/3242961804 wait complete. 2026-02-20T13:21:01.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 -- start start 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 Processor -- start 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce5850 0x55b3dfd06b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 0x55b3dfd07060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.700+0000 7f6aac84ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd90660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfcfe680 con 0x55b3dfce5850 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfc54120 con 0x55b3dfce6160 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aac84ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3dfd90ca0 con 0x55b3dfd2ae00 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce5850 0x55b3dfd06b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce5850 0x55b3dfd06b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52568/0 (socket says 10.20.193.28:52568) 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 -- 10.20.193.28:0/523930746 learned_addr learned my addr 10.20.193.28:0/523930746 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa8dc6640 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd90660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 0x55b3dfd07060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 -- 10.20.193.28:0/523930746 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 msgr2=0x55b3dfd90660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd90660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 -- 10.20.193.28:0/523930746 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 msgr2=0x55b3dfd07060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 0x55b3dfd07060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 -- 10.20.193.28:0/523930746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3dfb74190 con 0x55b3dfce5850 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aa3fff640 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce5850 0x55b3dfd06b00 secure :-1 s=READY pgs=620 gs=1 cs=0 l=1 c_cookie=13848111752751757035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a90002c60 tx=0x7f6a900047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02e6044c8ae36eb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6a65ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6a65ffb640 1 -- 10.20.193.28:0/523930746 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a90004a70 con 0x55b3dfce5850 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6a65ffb640 1 -- 10.20.193.28:0/523930746 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6a90022040 con 0x55b3dfce5850 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6a65ffb640 1 -- 10.20.193.28:0/523930746 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a90005610 con 0x55b3dfce5850 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.701+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a98095020 con 0x55b3dfce5850 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6a65ffb640 1 -- 10.20.193.28:0/523930746 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6a9001a440 con 0x55b3dfce5850 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 10 client.16782 _ll_register_callbacks cb 0x55b3dfb71320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3df884700 con 0x55b3dfce5850 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6a65ffb640 1 -- 10.20.193.28:0/523930746 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a90004bd0 con 0x55b3dfce5850 2026-02-20T13:21:01.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 10 client.16782 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b3dfb85fe0 con 0x55b3dfce5850 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6a65ffb640 1 -- 10.20.193.28:0/523930746 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6a90002d20 con 0x55b3dfce5850 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 10 client.16782 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 10 client.16782 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 20 client.16782 populate_metadata read hostname 'trial028' 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b3dfdd7d70 0x55b3dfdf81d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 4 client.16782 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.1, "await_for": 45.0}] 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.1, "await_for": 45.0}) -- 0x7f6a9401a920 con 0x55b3dfdd7d70 2026-02-20T13:21:01.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.702+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b3dfdd7d70 0x55b3dfdf81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:01.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.703+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b3dfdd7d70 0x55b3dfdf81d0 crc :-1 s=READY pgs=133 gs=4 cs=0 l=0 c_cookie=3692813745734078493 s_cookie=7320347143476230429 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=333f82895028d01d server_cookie=659718f12f72391d in_seq=0 out_seq=0 2026-02-20T13:21:01.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.703+0000 7f6a65ffb640 10 client.16782 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:01.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6a65ffb640 1 -- 10.20.193.28:0/523930746 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f6a9401a920 con 0x55b3dfdd7d70 2026-02-20T13:21:01.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6a65ffb640 10 client.16782 handle_command_reply: tid=0 2026-02-20T13:21:01.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 client.16782 shutdown 2026-02-20T13:21:01.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce5850 msgr2=0x55b3dfd06b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce5850 0x55b3dfd06b00 secure :-1 s=READY pgs=620 gs=1 cs=0 l=1 c_cookie=13848111752751757035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a90002c60 tx=0x7f6a900047e0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 shutdown_connections 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b3dfdd7d70 0x55b3dfdf81d0 crc :-1 s=READY pgs=133 gs=4 cs=0 l=0 c_cookie=3692813745734078493 s_cookie=7320347143476230429 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3dfd2ae00 0x55b3dfd90660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6a65ffb640 0 client.16782 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3dfce6160 0x55b3dfd07060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 --2- 10.20.193.28:0/523930746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3dfce5850 0x55b3dfd06b00 unknown :-1 s=CLOSED pgs=620 gs=1 cs=0 l=1 c_cookie=13848111752751757035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 >> 10.20.193.28:0/523930746 conn(0x55b3dfc03110 msgr2=0x55b3dfce3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 shutdown_connections 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 1 -- 10.20.193.28:0/523930746 wait complete. 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.710+0000 7f6aac84ae00 20 client.16782 trim_cache size 0 max 16384 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 14, 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "7c533819": { 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "version": 14, 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 148.1, 2026-02-20T13:21:01.713 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 -- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a780b5760 msgr2=0x7f6a780d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a780b5760 0x7f6a780d5c10 secure :-1 s=READY pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a90004740 tx=0x7f6a90005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 -- 10.20.193.28:0/4040111818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6aa4115420 msgr2=0x7f6aa417da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6aa4115420 0x7f6aa417da10 secure :-1 s=READY pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a98039820 tx=0x7f6a980039b0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 -- 10.20.193.28:0/4040111818 shutdown_connections 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6a780b5760 0x7f6a780d5c10 unknown :-1 s=CLOSED pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa410fc20 0x7f6aa417d250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6aa4115420 0x7f6aa417da10 unknown :-1 s=CLOSED pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 --2- 10.20.193.28:0/4040111818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6aa410f230 0x7f6aa417ff80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 -- 10.20.193.28:0/4040111818 >> 10.20.193.28:0/4040111818 conn(0x7f6aa405f830 msgr2=0x7f6aa410cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 -- 10.20.193.28:0/4040111818 shutdown_connections 2026-02-20T13:21:01.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:01.711+0000 7f6aaa850640 1 -- 10.20.193.28:0/4040111818 wait complete. 2026-02-20T13:21:01.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:01 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3437045659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:01.812 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7c533819', quiesce took 1.1 seconds. Will release after: 27.0 2026-02-20T13:21:01.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:01 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3437045659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:01.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:01 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3437045659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:02 trial028 ceph-mon[37442]: pgmap v292: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2026-02-20T13:21:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:02 trial127 ceph-mon[43817]: pgmap v292: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2026-02-20T13:21:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:02 trial034 ceph-mon[43332]: pgmap v292: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2026-02-20T13:21:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:04 trial028 ceph-mon[37442]: pgmap v293: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2026-02-20T13:21:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:04 trial127 ceph-mon[43817]: pgmap v293: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2026-02-20T13:21:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:04 trial034 ceph-mon[43332]: pgmap v293: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2026-02-20T13:21:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:06 trial028 ceph-mon[37442]: pgmap v294: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2026-02-20T13:21:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:06 trial127 ceph-mon[43817]: pgmap v294: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2026-02-20T13:21:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:06 trial034 ceph-mon[43332]: pgmap v294: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2026-02-20T13:21:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:08 trial028 ceph-mon[37442]: pgmap v295: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2026-02-20T13:21:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:21:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:21:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:08 trial127 ceph-mon[43817]: pgmap v295: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2026-02-20T13:21:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:21:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:21:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:08 trial034 ceph-mon[43332]: pgmap v295: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2026-02-20T13:21:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:21:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:21:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:10 trial028 ceph-mon[37442]: pgmap v296: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2026-02-20T13:21:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:10 trial127 ceph-mon[43817]: pgmap v296: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2026-02-20T13:21:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:10 trial034 ceph-mon[43332]: pgmap v296: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2026-02-20T13:21:11.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 -- 10.20.193.28:0/3500170339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 msgr2=0x7efe841104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/3500170339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 0x7efe841104a0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=18123754568087676048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe74009950 tx=0x7efe7402f190 comp rx=0 tx=0).stop 2026-02-20T13:21:11.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 -- 10.20.193.28:0/3500170339 shutdown_connections 2026-02-20T13:21:11.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/3500170339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe8410e940 0x7efe8410edb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/3500170339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe8410f2f0 0x7efe84171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/3500170339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 0x7efe841104a0 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=18123754568087676048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 -- 10.20.193.28:0/3500170339 >> 10.20.193.28:0/3500170339 conn(0x7efe840ec320 msgr2=0x7efe8410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:11.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 -- 10.20.193.28:0/3500170339 shutdown_connections 2026-02-20T13:21:11.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 -- 10.20.193.28:0/3500170339 wait complete. 2026-02-20T13:21:11.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 Processor -- start 2026-02-20T13:21:11.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.170+0000 7efe8b3d2640 1 -- start start 2026-02-20T13:21:11.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8b3d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe8410e940 0x7efe840f81e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8b3d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe8410f2f0 0x7efe84171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8b3d2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 0x7efe840f8a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8b3d2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe840f9630 con 0x7efe8410f2f0 2026-02-20T13:21:11.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8b3d2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7efe840f97a0 con 0x7efe841100b0 2026-02-20T13:21:11.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8b3d2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7efe840f9960 con 0x7efe8410e940 2026-02-20T13:21:11.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe8410e940 0x7efe840f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe89bcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe8410f2f0 0x7efe84171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe8410e940 0x7efe840f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36576/0 (socket says 10.20.193.28:36576) 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 -- 10.20.193.28:0/1391372961 learned_addr learned my addr 10.20.193.28:0/1391372961 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8abd1640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 0x7efe840f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 -- 10.20.193.28:0/1391372961 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 msgr2=0x7efe840f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 0x7efe840f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 -- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe8410f2f0 msgr2=0x7efe84171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe8410f2f0 0x7efe84171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 -- 10.20.193.28:0/1391372961 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe74009570 con 0x7efe8410e940 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8abd1640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 0x7efe840f8a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe89bcf640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe8410f2f0 0x7efe84171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.171+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe8410e940 0x7efe840f81e0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe74038820 tx=0x7efe740028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:11.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.172+0000 7efe6b7fe640 1 -- 10.20.193.28:0/1391372961 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe7403d070 con 0x7efe8410e940 2026-02-20T13:21:11.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.172+0000 7efe6b7fe640 1 -- 10.20.193.28:0/1391372961 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efe7402fe20 con 0x7efe8410e940 2026-02-20T13:21:11.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.172+0000 7efe8b3d2640 1 -- 10.20.193.28:0/1391372961 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe840f9be0 con 0x7efe8410e940 2026-02-20T13:21:11.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.172+0000 7efe6b7fe640 1 -- 10.20.193.28:0/1391372961 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe74041a10 con 0x7efe8410e940 2026-02-20T13:21:11.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.172+0000 7efe8b3d2640 1 -- 10.20.193.28:0/1391372961 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe840fa050 con 0x7efe8410e940 2026-02-20T13:21:11.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.174+0000 7efe6b7fe640 1 -- 10.20.193.28:0/1391372961 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7efe74038920 con 0x7efe8410e940 2026-02-20T13:21:11.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.175+0000 7efe6b7fe640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe600b56e0 0x7efe600d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.176+0000 7efe6b7fe640 1 -- 10.20.193.28:0/1391372961 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efe7410b170 con 0x7efe8410e940 2026-02-20T13:21:11.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.176+0000 7efe89bcf640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe600b56e0 0x7efe600d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.176+0000 7efe89bcf640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe600b56e0 0x7efe600d5b90 secure :-1 s=READY pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe78004740 tx=0x7efe78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.177+0000 7efe8ec76e00 1 Processor -- start 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.177+0000 7efe8ec76e00 1 -- start start 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.177+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff94c4c0 0x5625ff96c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.177+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.177+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff98d700 0x5625ff9adae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.177+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5625ff861fd0 con 0x5625ff96cde0 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.177+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5625ff85dd00 con 0x5625ff98d700 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.177+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5625ff857ca0 con 0x5625ff94c4c0 2026-02-20T13:21:11.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe8a3d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff94c4c0 0x5625ff96c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe89bcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe8a3d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff94c4c0 0x5625ff96c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36578/0 (socket says 10.20.193.28:36578) 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe8a3d0640 1 -- 10.20.193.28:0/2955039947 learned_addr learned my addr 10.20.193.28:0/2955039947 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe8abd1640 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff98d700 0x5625ff9adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe89bcf640 1 -- 10.20.193.28:0/2955039947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff94c4c0 msgr2=0x5625ff96c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe89bcf640 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff94c4c0 0x5625ff96c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe89bcf640 1 -- 10.20.193.28:0/2955039947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff98d700 msgr2=0x5625ff9adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe89bcf640 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff98d700 0x5625ff9adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe89bcf640 1 -- 10.20.193.28:0/2955039947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625ff7fa8b0 con 0x5625ff96cde0 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff94c4c0 0x5625ff96c8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:11.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe89bcf640 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98d1c0 secure :-1 s=READY pgs=621 gs=2 cs=0 l=1 c_cookie=11634816567287250572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe78002a70 tx=0x7efe78014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1772c0627fc7e8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe523ff640 1 -- 10.20.193.28:0/2955039947 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe78004850 con 0x5625ff96cde0 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe523ff640 1 -- 10.20.193.28:0/2955039947 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efe78004e90 con 0x5625ff96cde0 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe523ff640 1 -- 10.20.193.28:0/2955039947 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe7801a910 con 0x5625ff96cde0 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe8ec76e00 1 -- 10.20.193.28:0/2955039947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 msgr2=0x5625ff98d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.178+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98d1c0 secure :-1 s=READY pgs=621 gs=2 cs=0 l=1 c_cookie=11634816567287250572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe78002a70 tx=0x7efe78014000 comp rx=0 tx=0).stop 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.179+0000 7efe8ec76e00 1 -- 10.20.193.28:0/2955039947 shutdown_connections 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.179+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98d1c0 unknown :-1 s=CLOSED pgs=621 gs=2 cs=0 l=1 c_cookie=11634816567287250572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.179+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff98d700 0x5625ff9adae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.179+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/2955039947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff94c4c0 0x5625ff96c8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.179+0000 7efe8ec76e00 1 -- 10.20.193.28:0/2955039947 >> 10.20.193.28:0/2955039947 conn(0x5625ff86b1c0 msgr2=0x5625ff94ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.179+0000 7efe8ec76e00 1 -- 10.20.193.28:0/2955039947 shutdown_connections 2026-02-20T13:21:11.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.179+0000 7efe8ec76e00 1 -- 10.20.193.28:0/2955039947 wait complete. 2026-02-20T13:21:11.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.180+0000 7efe8ec76e00 1 -- start start 2026-02-20T13:21:11.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.180+0000 7efe8ec76e00 1 Processor -- start 2026-02-20T13:21:11.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff965b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff966150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff966bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5625ff967210 con 0x5625ff98d700 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5625ff967380 con 0x5625ff94c4c0 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5625ff967540 con 0x5625ff96cde0 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff965b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8abd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff966bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff965b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35702/0 (socket says 10.20.193.28:35702) 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 -- 10.20.193.28:0/4215277744 learned_addr learned my addr 10.20.193.28:0/4215277744 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe89bcf640 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff966150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 -- 10.20.193.28:0/4215277744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 msgr2=0x5625ff966150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:11.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff966150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 -- 10.20.193.28:0/4215277744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 msgr2=0x5625ff966bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff966bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 -- 10.20.193.28:0/4215277744 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625ff803400 con 0x5625ff94c4c0 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff965b00 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=8611371357605210388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe74108c10 tx=0x7efe740cdbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7781bc9fef082914 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe3f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe3f7fe640 1 -- 10.20.193.28:0/4215277744 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe740d0f60 con 0x5625ff94c4c0 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe3f7fe640 1 -- 10.20.193.28:0/4215277744 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efe740d0d80 con 0x5625ff94c4c0 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe3f7fe640 1 -- 10.20.193.28:0/4215277744 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe740d2ec0 con 0x5625ff94c4c0 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.181+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe78003d30 con 0x5625ff94c4c0 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe3f7fe640 1 -- 10.20.193.28:0/4215277744 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efe740f6040 con 0x5625ff94c4c0 2026-02-20T13:21:11.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe3f7fe640 10 client.26783 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 10 client.26783 _ll_register_callbacks cb 0x5625ff7e2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625ff4f7520 con 0x5625ff94c4c0 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe3f7fe640 1 -- 10.20.193.28:0/4215277744 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efe740d71f0 con 0x5625ff94c4c0 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 10 client.26783 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5625ff7dbda0 con 0x5625ff94c4c0 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe3f7fe640 1 -- 10.20.193.28:0/4215277744 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efe740d3020 con 0x5625ff94c4c0 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 10 client.26783 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 10 client.26783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 20 client.26783 populate_metadata read hostname 'trial028' 2026-02-20T13:21:11.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5625ff969f20 0x5625ff96a3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 4 client.26783 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625ff889630 con 0x5625ff969f20 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.182+0000 7efe89bcf640 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5625ff969f20 0x5625ff96a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.183+0000 7efe89bcf640 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5625ff969f20 0x5625ff96a3a0 crc :-1 s=READY pgs=134 gs=4 cs=0 l=0 c_cookie=11831416911588232877 s_cookie=9069436981711456429 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a431a2fedcc40ead server_cookie=7ddd1ce207b3c8ad in_seq=0 out_seq=0 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.183+0000 7efe3f7fe640 10 client.26783 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.183+0000 7efe3f7fe640 1 -- 10.20.193.28:0/4215277744 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5625ff889630 con 0x5625ff969f20 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.183+0000 7efe3f7fe640 10 client.26783 handle_command_reply: tid=0 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.183+0000 7efe8ec76e00 1 client.26783 shutdown 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 msgr2=0x5625ff965b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff965b00 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=8611371357605210388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe74108c10 tx=0x7efe740cdbd0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 shutdown_connections 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5625ff969f20 0x5625ff96a3a0 crc :-1 s=READY pgs=134 gs=4 cs=0 l=0 c_cookie=11831416911588232877 s_cookie=9069436981711456429 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff966bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff966150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/4215277744 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff965b00 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=8611371357605210388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe3f7fe640 0 client.26783 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 >> 10.20.193.28:0/4215277744 conn(0x5625ff86b1c0 msgr2=0x5625ff94d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 shutdown_connections 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 1 -- 10.20.193.28:0/4215277744 wait complete. 2026-02-20T13:21:11.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.184+0000 7efe8ec76e00 20 client.26783 trim_cache size 0 max 16384 2026-02-20T13:21:11.198 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.191+0000 7efe8ec76e00 1 Processor -- start 2026-02-20T13:21:11.198 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8ec76e00 1 -- start start 2026-02-20T13:21:11.198 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff950d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98b5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff98d700 0x5625ff98bb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5625ff8558d0 con 0x5625ff96cde0 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5625ff596f10 con 0x5625ff94c4c0 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5625ff8bb490 con 0x5625ff98d700 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52320/0 (socket says 10.20.193.28:52320) 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 -- 10.20.193.28:0/3928625763 learned_addr learned my addr 10.20.193.28:0/3928625763 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff950d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8abd1640 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff98d700 0x5625ff98bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 -- 10.20.193.28:0/3928625763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff98d700 msgr2=0x5625ff98bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff98d700 0x5625ff98bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 -- 10.20.193.28:0/3928625763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 msgr2=0x5625ff950d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff950d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 -- 10.20.193.28:0/3928625763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625ff958160 con 0x5625ff96cde0 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe8abd1640 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff98d700 0x5625ff98bb00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe89bcf640 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98b5c0 secure :-1 s=READY pgs=622 gs=1 cs=0 l=1 c_cookie=5159473238647848329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe78004710 tx=0x7efe780054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479a219311bd3d89 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe51bfe640 1 -- 10.20.193.28:0/3928625763 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe7801a4d0 con 0x5625ff96cde0 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe51bfe640 1 -- 10.20.193.28:0/3928625763 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efe78009e00 con 0x5625ff96cde0 2026-02-20T13:21:11.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.192+0000 7efe51bfe640 1 -- 10.20.193.28:0/3928625763 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe7802faf0 con 0x5625ff96cde0 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 -- 10.20.193.28:0/3928625763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 msgr2=0x5625ff98b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98b5c0 secure :-1 s=READY pgs=622 gs=1 cs=0 l=1 c_cookie=5159473238647848329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe78004710 tx=0x7efe780054a0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 -- 10.20.193.28:0/3928625763 shutdown_connections 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff96cde0 0x5625ff98b5c0 unknown :-1 s=CLOSED pgs=622 gs=1 cs=0 l=1 c_cookie=5159473238647848329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff98d700 0x5625ff98bb00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/3928625763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff950d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 -- 10.20.193.28:0/3928625763 >> 10.20.193.28:0/3928625763 conn(0x5625ff86b1c0 msgr2=0x5625ff961e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 -- 10.20.193.28:0/3928625763 shutdown_connections 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 -- 10.20.193.28:0/3928625763 wait complete. 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 -- start start 2026-02-20T13:21:11.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.193+0000 7efe8ec76e00 1 Processor -- start 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff9705f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff970b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8ec76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff971880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5625ff971dc0 con 0x5625ff98d700 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5625ff971f30 con 0x5625ff94c4c0 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8ec76e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5625ff9720f0 con 0x5625ff96cde0 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe89bcf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff970b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8a3d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff9705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8abd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff971880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe89bcf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff970b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36602/0 (socket says 10.20.193.28:36602) 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe89bcf640 1 -- 10.20.193.28:0/119206082 learned_addr learned my addr 10.20.193.28:0/119206082 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8abd1640 1 -- 10.20.193.28:0/119206082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 msgr2=0x5625ff970b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8abd1640 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff970b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8abd1640 1 -- 10.20.193.28:0/119206082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 msgr2=0x5625ff9705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8abd1640 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff9705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8abd1640 1 -- 10.20.193.28:0/119206082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625ff7ed670 con 0x5625ff98d700 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe8abd1640 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff971880 secure :-1 s=READY pgs=623 gs=3 cs=0 l=1 c_cookie=5719929646381473111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5625ff8bcaa0 tx=0x7efe80003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6145b538cb1d57 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe3f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.194+0000 7efe3f7fe640 1 -- 10.20.193.28:0/119206082 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe80018050 con 0x5625ff98d700 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe3f7fe640 1 -- 10.20.193.28:0/119206082 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efe80019040 con 0x5625ff98d700 2026-02-20T13:21:11.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe3f7fe640 1 -- 10.20.193.28:0/119206082 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe800107d0 con 0x5625ff98d700 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625ff7fa8b0 con 0x5625ff98d700 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 10 client.16800 _ll_register_callbacks cb 0x5625ff7e2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625ff907ca0 con 0x5625ff98d700 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe3f7fe640 1 -- 10.20.193.28:0/119206082 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efe80010930 con 0x5625ff98d700 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe3f7fe640 1 -- 10.20.193.28:0/119206082 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efe80010af0 con 0x5625ff98d700 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 10 client.16800 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5625ff7e80f0 con 0x5625ff98d700 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe3f7fe640 1 -- 10.20.193.28:0/119206082 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efe80024020 con 0x5625ff98d700 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 10 client.16800 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 10 client.16800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:11.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 20 client.16800 populate_metadata read hostname 'trial028' 2026-02-20T13:21:11.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5625ffa3aa40 0x5625ffa5aef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:11.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 4 client.16800 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:21:11.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.195+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625ff53b640 con 0x5625ffa3aa40 2026-02-20T13:21:11.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.196+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5625ffa3aa40 0x5625ffa5aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:11.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.196+0000 7efe8a3d0640 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5625ffa3aa40 0x5625ffa5aef0 crc :-1 s=READY pgs=135 gs=4 cs=0 l=0 c_cookie=6497671797095812502 s_cookie=8523332152001069225 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2c5e12c4f84d96 server_cookie=7648f56f06b080a9 in_seq=0 out_seq=0 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.196+0000 7efe3f7fe640 10 client.16800 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe3f7fe640 1 -- 10.20.193.28:0/119206082 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625ff53b640 con 0x5625ffa3aa40 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe3f7fe640 10 client.16800 handle_command_reply: tid=0 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 client.16800 shutdown 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 msgr2=0x5625ff971880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff971880 secure :-1 s=READY pgs=623 gs=3 cs=0 l=1 c_cookie=5719929646381473111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5625ff8bcaa0 tx=0x7efe80003ea0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 shutdown_connections 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5625ffa3aa40 0x5625ffa5aef0 crc :-1 s=READY pgs=135 gs=4 cs=0 l=0 c_cookie=6497671797095812502 s_cookie=8523332152001069225 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625ff98d700 0x5625ff971880 unknown :-1 s=CLOSED pgs=623 gs=3 cs=0 l=1 c_cookie=5719929646381473111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5625ff96cde0 0x5625ff970b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 --2- 10.20.193.28:0/119206082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5625ff94c4c0 0x5625ff9705f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 >> 10.20.193.28:0/119206082 conn(0x5625ff86b1c0 msgr2=0x5625ff962600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:11.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.200+0000 7efe3f7fe640 0 client.16800 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:11.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 shutdown_connections 2026-02-20T13:21:11.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8ec76e00 1 -- 10.20.193.28:0/119206082 wait complete. 2026-02-20T13:21:11.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8ec76e00 20 client.16800 trim_cache size 0 max 16384 2026-02-20T13:21:11.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:21:11.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:21:11.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:21:11.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 -- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe600b56e0 msgr2=0x7efe600d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe600b56e0 0x7efe600d5b90 secure :-1 s=READY pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe78004740 tx=0x7efe78005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 -- 10.20.193.28:0/1391372961 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe8410e940 msgr2=0x7efe840f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe8410e940 0x7efe840f81e0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe74038820 tx=0x7efe740028d0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 -- 10.20.193.28:0/1391372961 shutdown_connections 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efe600b56e0 0x7efe600d5b90 unknown :-1 s=CLOSED pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe8410f2f0 0x7efe84171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efe841100b0 0x7efe840f8a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 --2- 10.20.193.28:0/1391372961 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efe8410e940 0x7efe840f81e0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 -- 10.20.193.28:0/1391372961 >> 10.20.193.28:0/1391372961 conn(0x7efe840ec320 msgr2=0x7efe840ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:11.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 -- 10.20.193.28:0/1391372961 shutdown_connections 2026-02-20T13:21:11.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:11.201+0000 7efe8b3d2640 1 -- 10.20.193.28:0/1391372961 wait complete. 2026-02-20T13:21:12.779 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:12 trial127 ceph-mon[43817]: pgmap v297: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2026-02-20T13:21:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:12 trial028 ceph-mon[37442]: pgmap v297: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2026-02-20T13:21:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:12 trial034 ceph-mon[43332]: pgmap v297: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2026-02-20T13:21:14.792 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:14 trial034 ceph-mon[43332]: pgmap v298: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2026-02-20T13:21:14.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:14 trial028 ceph-mon[37442]: pgmap v298: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2026-02-20T13:21:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:14 trial127 ceph-mon[43817]: pgmap v298: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2026-02-20T13:21:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:16 trial028 ceph-mon[37442]: pgmap v299: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:21:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:16 trial127 ceph-mon[43817]: pgmap v299: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:21:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:16 trial034 ceph-mon[43332]: pgmap v299: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:21:18.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:18 trial028 ceph-mon[37442]: pgmap v300: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2026-02-20T13:21:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:18 trial127 ceph-mon[43817]: pgmap v300: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2026-02-20T13:21:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:18 trial034 ceph-mon[43332]: pgmap v300: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2026-02-20T13:21:20.333 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:21:20.524 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:20.656 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:20 trial028 ceph-mon[37442]: pgmap v301: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2026-02-20T13:21:20.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3545118114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 msgr2=0x7fbcd810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3545118114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 0x7fbcd810f880 secure :-1 s=READY pgs=624 gs=1 cs=0 l=1 c_cookie=6123314690524910774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc4009950 tx=0x7fbcc402f190 comp rx=0 tx=0).stop 2026-02-20T13:21:20.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3545118114 shutdown_connections 2026-02-20T13:21:20.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3545118114 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbcd81156a0 0x7fbcd8176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3545118114 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbcd810fea0 0x7fbcd8114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3545118114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 0x7fbcd810f880 unknown :-1 s=CLOSED pgs=624 gs=1 cs=0 l=1 c_cookie=6123314690524910774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3545118114 >> 10.20.193.28:0/3545118114 conn(0x7fbcd80ecda0 msgr2=0x7fbcd810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:20.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3545118114 shutdown_connections 2026-02-20T13:21:20.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.698+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3545118114 wait complete. 2026-02-20T13:21:20.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.699+0000 7fbcdc95c640 1 Processor -- start 2026-02-20T13:21:20.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.699+0000 7fbcdc95c640 1 -- start start 2026-02-20T13:21:20.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.699+0000 7fbcdc95c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 0x7fbcd811dde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.699+0000 7fbcdc95c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbcd810fea0 0x7fbcd811e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcdc95c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbcd81156a0 0x7fbcd81236a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcdc95c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8123c30 con 0x7fbcd810f4b0 2026-02-20T13:21:20.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcdc95c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8123da0 con 0x7fbcd81156a0 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcdc95c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8123f60 con 0x7fbcd810fea0 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 0x7fbcd811dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 0x7fbcd811dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37692/0 (socket says 10.20.193.28:37692) 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 -- 10.20.193.28:0/3610252173 learned_addr learned my addr 10.20.193.28:0/3610252173 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbcd810fea0 0x7fbcd811e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd7fff640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbcd81156a0 0x7fbcd81236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 -- 10.20.193.28:0/3610252173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbcd810fea0 msgr2=0x7fbcd811e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbcd810fea0 0x7fbcd811e320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 -- 10.20.193.28:0/3610252173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbcd81156a0 msgr2=0x7fbcd81236a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbcd81156a0 0x7fbcd81236a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 -- 10.20.193.28:0/3610252173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4009570 con 0x7fbcd810f4b0 2026-02-20T13:21:20.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 0x7fbcd811dde0 secure :-1 s=READY pgs=625 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc4004820 tx=0x7fbcc40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:20.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd4ff9640 1 -- 10.20.193.28:0/3610252173 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc403d070 con 0x7fbcd810f4b0 2026-02-20T13:21:20.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd4ff9640 1 -- 10.20.193.28:0/3610252173 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbcc4002e80 con 0x7fbcd810f4b0 2026-02-20T13:21:20.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcd4ff9640 1 -- 10.20.193.28:0/3610252173 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc4041a00 con 0x7fbcd810f4b0 2026-02-20T13:21:20.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3610252173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd81241e0 con 0x7fbcd810f4b0 2026-02-20T13:21:20.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.700+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3610252173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd8164830 con 0x7fbcd810f4b0 2026-02-20T13:21:20.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.703+0000 7fbcd4ff9640 1 -- 10.20.193.28:0/3610252173 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbcc4041bd0 con 0x7fbcd810f4b0 2026-02-20T13:21:20.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.705+0000 7fbcd4ff9640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbcac0b5760 0x7fbcac0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.705+0000 7fbcd4ff9640 1 -- 10.20.193.28:0/3610252173 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbcc410b340 con 0x7fbcd810f4b0 2026-02-20T13:21:20.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.705+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbcac0b5760 0x7fbcac0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.705+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbcac0b5760 0x7fbcac0d5c10 secure :-1 s=READY pgs=349 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcd8124730 tx=0x7fbcc8005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:20.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.706+0000 7fbcdfbdfe00 1 Processor -- start 2026-02-20T13:21:20.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.706+0000 7fbcdfbdfe00 1 -- start start 2026-02-20T13:21:20.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6180 0x561c56cd6550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6a90 0x561c56d1b400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56d3bd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c56bec7d0 con 0x561c56cd6180 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561c56be8500 con 0x561c56d1b940 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561c56be24a0 con 0x561c56cd6a90 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6180 0x561c56cd6550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6180 0x561c56cd6550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37694/0 (socket says 10.20.193.28:37694) 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 -- 10.20.193.28:0/1241354650 learned_addr learned my addr 10.20.193.28:0/1241354650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd7fff640 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56d3bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6a90 0x561c56d1b400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 -- 10.20.193.28:0/1241354650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6a90 msgr2=0x561c56d1b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6a90 0x561c56d1b400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 -- 10.20.193.28:0/1241354650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 msgr2=0x561c56d3bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56d3bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 -- 10.20.193.28:0/1241354650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c56b8dd80 con 0x561c56cd6180 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6180 0x561c56cd6550 secure :-1 s=READY pgs=626 gs=1 cs=0 l=1 c_cookie=4368924868416337813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc4009480 tx=0x7fbcc40414b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca18a0530537795 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbc9bfff640 1 -- 10.20.193.28:0/1241354650 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc40d0ea0 con 0x561c56cd6180 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbc9bfff640 1 -- 10.20.193.28:0/1241354650 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbcc402fe20 con 0x561c56cd6180 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.707+0000 7fbc9bfff640 1 -- 10.20.193.28:0/1241354650 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc40dc7e0 con 0x561c56cd6180 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1241354650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6180 msgr2=0x561c56cd6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6180 0x561c56cd6550 secure :-1 s=READY pgs=626 gs=1 cs=0 l=1 c_cookie=4368924868416337813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc4009480 tx=0x7fbcc40414b0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1241354650 shutdown_connections 2026-02-20T13:21:20.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56d3bd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6a90 0x561c56d1b400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1241354650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6180 0x561c56cd6550 unknown :-1 s=CLOSED pgs=626 gs=1 cs=0 l=1 c_cookie=4368924868416337813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1241354650 >> 10.20.193.28:0/1241354650 conn(0x561c56cb4680 msgr2=0x561c56cd4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:20.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1241354650 shutdown_connections 2026-02-20T13:21:20.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.708+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1241354650 wait complete. 2026-02-20T13:21:20.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.709+0000 7fbcdfbdfe00 1 -- start start 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcdfbdfe00 1 Processor -- start 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 0x561c56cee630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56ceeb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56cf3b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c56cf40a0 con 0x561c56cd6a90 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561c56cf4210 con 0x561c56d1b940 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561c56cf43d0 con 0x561c56cd6180 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcd6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56ceeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcd6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56ceeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37708/0 (socket says 10.20.193.28:37708) 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcd6ffd640 1 -- 10.20.193.28:0/1488374099 learned_addr learned my addr 10.20.193.28:0/1488374099 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:20.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcd7fff640 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56cf3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 0x561c56cee630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcd6ffd640 1 -- 10.20.193.28:0/1488374099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 msgr2=0x561c56cee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.710+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 0x561c56cee630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbcd6ffd640 1 -- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 msgr2=0x561c56cf3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56cf3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbcd6ffd640 1 -- 10.20.193.28:0/1488374099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c56b66350 con 0x561c56cd6a90 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbcd7fff640 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56cf3b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56ceeb70 secure :-1 s=READY pgs=627 gs=1 cs=0 l=1 c_cookie=13064453727919136195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc800a3a0 tx=0x7fbcc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54e43727525ddc3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbc997fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbc997fa640 1 -- 10.20.193.28:0/1488374099 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc8010960 con 0x561c56cd6a90 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbc997fa640 1 -- 10.20.193.28:0/1488374099 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbcc801d430 con 0x561c56cd6a90 2026-02-20T13:21:20.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbc997fa640 1 -- 10.20.193.28:0/1488374099 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc8019790 con 0x561c56cd6a90 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd8164830 con 0x561c56cd6a90 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbcdfbdfe00 10 client.16812 _ll_register_callbacks cb 0x561c56b639a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.711+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c568786f0 con 0x561c56cd6a90 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbc997fa640 1 -- 10.20.193.28:0/1488374099 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbcc8010ac0 con 0x561c56cd6a90 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbc997fa640 1 -- 10.20.193.28:0/1488374099 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbcc8010c80 con 0x561c56cd6a90 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbcdfbdfe00 10 client.16812 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561c56b78150 con 0x561c56cd6a90 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbc997fa640 1 -- 10.20.193.28:0/1488374099 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbcc8018070 con 0x561c56cd6a90 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbcdfbdfe00 10 client.16812 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbcdfbdfe00 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbcdfbdfe00 20 client.16812 populate_metadata read hostname 'trial028' 2026-02-20T13:21:20.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561c56d18e40 0x561c56d192e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbcdfbdfe00 4 client.16812 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.712+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c56befd60 con 0x561c56d18e40 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.713+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561c56d18e40 0x561c56d192e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.713+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561c56d18e40 0x561c56d192e0 crc :-1 s=READY pgs=136 gs=4 cs=0 l=0 c_cookie=14501198127200697201 s_cookie=1747108623037201861 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c93e9addb55b7b71 server_cookie=183efa093c277dc5 in_seq=0 out_seq=0 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.713+0000 7fbc997fa640 10 client.16812 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbc997fa640 1 -- 10.20.193.28:0/1488374099 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561c56befd60 con 0x561c56d18e40 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbc997fa640 10 client.16812 handle_command_reply: tid=0 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 client.16812 shutdown 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 msgr2=0x561c56ceeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56ceeb70 secure :-1 s=READY pgs=627 gs=1 cs=0 l=1 c_cookie=13064453727919136195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc800a3a0 tx=0x7fbcc8004770 comp rx=0 tx=0).stop 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 shutdown_connections 2026-02-20T13:21:20.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561c56d18e40 0x561c56d192e0 crc :-1 s=READY pgs=136 gs=4 cs=0 l=0 c_cookie=14501198127200697201 s_cookie=1747108623037201861 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56ceeb70 unknown :-1 s=CLOSED pgs=627 gs=1 cs=0 l=1 c_cookie=13064453727919136195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56d1b940 0x561c56cf3b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/1488374099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 0x561c56cee630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 >> 10.20.193.28:0/1488374099 conn(0x561c56cb4680 msgr2=0x561c56cd5250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:20.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbc997fa640 0 client.16812 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:20.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 shutdown_connections 2026-02-20T13:21:20.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/1488374099 wait complete. 2026-02-20T13:21:20.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.714+0000 7fbcdfbdfe00 20 client.16812 trim_cache size 0 max 16384 2026-02-20T13:21:20.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcdfbdfe00 1 Processor -- start 2026-02-20T13:21:20.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcdfbdfe00 1 -- start start 2026-02-20T13:21:20.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6180 0x561c56d13d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56d14280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56d1b940 0x561c56d199a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c56be00d0 con 0x561c56cd6a90 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561c568a0700 con 0x561c56cd6180 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561c56be8500 con 0x561c56d1b940 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcd77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6180 0x561c56d13d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcd77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6180 0x561c56d13d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42674/0 (socket says 10.20.193.28:42674) 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcd77fe640 1 -- 10.20.193.28:0/2240175007 learned_addr learned my addr 10.20.193.28:0/2240175007 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56d14280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcd7fff640 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56d1b940 0x561c56d199a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcd6ffd640 1 -- 10.20.193.28:0/2240175007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56d1b940 msgr2=0x561c56d199a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.724+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56d1b940 0x561c56d199a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcd6ffd640 1 -- 10.20.193.28:0/2240175007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6180 msgr2=0x561c56d13d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6180 0x561c56d13d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcd6ffd640 1 -- 10.20.193.28:0/2240175007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c56ce0e00 con 0x561c56cd6a90 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56d14280 secure :-1 s=READY pgs=628 gs=1 cs=0 l=1 c_cookie=4400423535325191038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc8019b50 tx=0x7fbcc8029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1171e414539b7e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbc9b7fe640 1 -- 10.20.193.28:0/2240175007 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc8026eb0 con 0x561c56cd6a90 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbc9b7fe640 1 -- 10.20.193.28:0/2240175007 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x561c568786f0 con 0x561c56cd6a90 2026-02-20T13:21:20.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbc9b7fe640 1 -- 10.20.193.28:0/2240175007 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc800fa80 con 0x561c56cd6a90 2026-02-20T13:21:20.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/2240175007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 msgr2=0x561c56d14280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56d14280 secure :-1 s=READY pgs=628 gs=1 cs=0 l=1 c_cookie=4400423535325191038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc8019b50 tx=0x7fbcc8029000 comp rx=0 tx=0).stop 2026-02-20T13:21:20.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/2240175007 shutdown_connections 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56cd6a90 0x561c56d14280 unknown :-1 s=CLOSED pgs=628 gs=1 cs=0 l=1 c_cookie=4400423535325191038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56d1b940 0x561c56d199a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/2240175007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6180 0x561c56d13d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.725+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/2240175007 >> 10.20.193.28:0/2240175007 conn(0x561c56cb4680 msgr2=0x561c56ceaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.726+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/2240175007 shutdown_connections 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.726+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/2240175007 wait complete. 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.726+0000 7fbcdfbdfe00 1 -- start start 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.726+0000 7fbcdfbdfe00 1 Processor -- start 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 0x561c56cf7400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6a90 0x561c56cf7940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcdfbdfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56d1b940 0x561c56cf7e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c56c45550 con 0x561c56d1b940 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561c56d81000 con 0x561c56cd6a90 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcdfbdfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561c56d811c0 con 0x561c56cd6180 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56d1b940 0x561c56cf7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56d1b940 0x561c56cf7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37718/0 (socket says 10.20.193.28:37718) 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd7fff640 1 -- 10.20.193.28:0/3443309617 learned_addr learned my addr 10.20.193.28:0/3443309617 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd6ffd640 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6a90 0x561c56cf7940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 0x561c56cf7400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd7fff640 1 -- 10.20.193.28:0/3443309617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 msgr2=0x561c56cf7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd7fff640 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 0x561c56cf7400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd7fff640 1 -- 10.20.193.28:0/3443309617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6a90 msgr2=0x561c56cf7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:20.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd7fff640 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6a90 0x561c56cf7940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.727+0000 7fbcd7fff640 1 -- 10.20.193.28:0/3443309617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c56b72bd0 con 0x561c56d1b940 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbcd7fff640 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56d1b940 0x561c56cf7e80 secure :-1 s=READY pgs=629 gs=1 cs=0 l=1 c_cookie=15680272038892697470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbccc010790 tx=0x7fbccc010890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99b84577bb0777e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbc997fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbc997fa640 1 -- 10.20.193.28:0/3443309617 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbccc015070 con 0x561c56d1b940 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbc997fa640 1 -- 10.20.193.28:0/3443309617 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbccc005540 con 0x561c56d1b940 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c56b78150 con 0x561c56d1b940 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbcdfbdfe00 10 client.16818 _ll_register_callbacks cb 0x561c56b639a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbc997fa640 1 -- 10.20.193.28:0/3443309617 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbccc01acc0 con 0x561c56d1b940 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbc997fa640 1 -- 10.20.193.28:0/3443309617 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbccc00d450 con 0x561c56d1b940 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc402fe20 con 0x561c56d1b940 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbc997fa640 1 -- 10.20.193.28:0/3443309617 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbccc01ae50 con 0x561c56d1b940 2026-02-20T13:21:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbcdfbdfe00 10 client.16818 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.728+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561c56b66680 con 0x561c56d1b940 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbc997fa640 1 -- 10.20.193.28:0/3443309617 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbccc01a420 con 0x561c56d1b940 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbcdfbdfe00 10 client.16818 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbcdfbdfe00 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbcdfbdfe00 20 client.16818 populate_metadata read hostname 'trial028' 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561c56dc8f70 0x561c56de9420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbcdfbdfe00 4 client.16818 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561c56875f40 con 0x561c56dc8f70 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561c56dc8f70 0x561c56de9420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbcd77fe640 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561c56dc8f70 0x561c56de9420 crc :-1 s=READY pgs=137 gs=4 cs=0 l=0 c_cookie=15865436805840736737 s_cookie=2705817604666286770 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc2d5ab75a8b91e1 server_cookie=258cfec68121e2b2 in_seq=0 out_seq=0 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.729+0000 7fbc997fa640 10 client.16818 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbc997fa640 1 -- 10.20.193.28:0/3443309617 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x561c56875f40 con 0x561c56dc8f70 2026-02-20T13:21:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbc997fa640 10 client.16818 handle_command_reply: tid=0 2026-02-20T13:21:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 client.16818 shutdown 2026-02-20T13:21:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56d1b940 msgr2=0x561c56cf7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56d1b940 0x561c56cf7e80 secure :-1 s=READY pgs=629 gs=1 cs=0 l=1 c_cookie=15680272038892697470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbccc010790 tx=0x7fbccc010890 comp rx=0 tx=0).stop 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 shutdown_connections 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561c56dc8f70 0x561c56de9420 crc :-1 s=READY pgs=137 gs=4 cs=0 l=0 c_cookie=15865436805840736737 s_cookie=2705817604666286770 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c56d1b940 0x561c56cf7e80 unknown :-1 s=CLOSED pgs=629 gs=1 cs=0 l=1 c_cookie=15680272038892697470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561c56cd6a90 0x561c56cf7940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 --2- 10.20.193.28:0/3443309617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561c56cd6180 0x561c56cf7400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbc997fa640 0 client.16818 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 >> 10.20.193.28:0/3443309617 conn(0x561c56cb4680 msgr2=0x561c56ceb210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 shutdown_connections 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 1 -- 10.20.193.28:0/3443309617 wait complete. 2026-02-20T13:21:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdfbdfe00 20 client.16818 trim_cache size 0 max 16384 2026-02-20T13:21:20.739 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:21:20.739 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:21:20.739 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:21:20.739 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:21:20.739 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:21:20.739 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:21:20.739 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:20.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:20.741 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:20.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:21:20.744 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:20.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:20.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:20.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:20.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:20.744 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:20.744 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:20.744 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:21:20.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbcac0b5760 msgr2=0x7fbcac0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbcac0b5760 0x7fbcac0d5c10 secure :-1 s=READY pgs=349 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcd8124730 tx=0x7fbcc8005f70 comp rx=0 tx=0).stop 2026-02-20T13:21:20.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 msgr2=0x7fbcd811dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:20.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.730+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 0x7fbcd811dde0 secure :-1 s=READY pgs=625 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc4004820 tx=0x7fbcc40028d0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.731+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3610252173 shutdown_connections 2026-02-20T13:21:20.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.731+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbcac0b5760 0x7fbcac0d5c10 unknown :-1 s=CLOSED pgs=349 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.731+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbcd81156a0 0x7fbcd81236a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.731+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbcd810fea0 0x7fbcd811e320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.731+0000 7fbcdc95c640 1 --2- 10.20.193.28:0/3610252173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcd810f4b0 0x7fbcd811dde0 unknown :-1 s=CLOSED pgs=625 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:20.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.731+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3610252173 >> 10.20.193.28:0/3610252173 conn(0x7fbcd80ecda0 msgr2=0x7fbcd810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:20.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.731+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3610252173 shutdown_connections 2026-02-20T13:21:20.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:20.731+0000 7fbcdc95c640 1 -- 10.20.193.28:0/3610252173 wait complete. 2026-02-20T13:21:20.834 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:21:20.834 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:21:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:20 trial127 ceph-mon[43817]: pgmap v301: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2026-02-20T13:21:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:20 trial034 ceph-mon[43332]: pgmap v301: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2026-02-20T13:21:21.020 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.191+0000 7fb5e185d640 1 -- 10.20.193.28:0/1339296268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc0614f0 msgr2=0x7fb5dc061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.191+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1339296268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc0614f0 0x7fb5dc061920 secure :-1 s=READY pgs=630 gs=1 cs=0 l=1 c_cookie=15683669968729685164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5c4009950 tx=0x7fb5c402f190 comp rx=0 tx=0).stop 2026-02-20T13:21:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.191+0000 7fb5e185d640 1 -- 10.20.193.28:0/1339296268 shutdown_connections 2026-02-20T13:21:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.191+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1339296268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc0614f0 0x7fb5dc061920 unknown :-1 s=CLOSED pgs=630 gs=1 cs=0 l=1 c_cookie=15683669968729685164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.191+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1339296268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5dc159af0 0x7fb5dc179ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.191+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1339296268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5dc062ae0 0x7fb5dc060fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.191+0000 7fb5e185d640 1 -- 10.20.193.28:0/1339296268 >> 10.20.193.28:0/1339296268 conn(0x7fb5dc05f830 msgr2=0x7fb5dc10ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.192+0000 7fb5e185d640 1 -- 10.20.193.28:0/1339296268 shutdown_connections 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.192+0000 7fb5e185d640 1 -- 10.20.193.28:0/1339296268 wait complete. 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.192+0000 7fb5e185d640 1 Processor -- start 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.192+0000 7fb5e185d640 1 -- start start 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5e185d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5dc0614f0 0x7fb5dc0f2c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5e185d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5dc062ae0 0x7fb5dc0f3180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5e185d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc159af0 0x7fb5dc0f8550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5e185d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc0f8b70 con 0x7fb5dc159af0 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5e185d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc0f8ce0 con 0x7fb5dc0614f0 2026-02-20T13:21:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5e185d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc0f8ea0 con 0x7fb5dc062ae0 2026-02-20T13:21:21.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc159af0 0x7fb5dc0f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5da7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5dc062ae0 0x7fb5dc0f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc159af0 0x7fb5dc0f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37736/0 (socket says 10.20.193.28:37736) 2026-02-20T13:21:21.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 -- 10.20.193.28:0/1685961563 learned_addr learned my addr 10.20.193.28:0/1685961563 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:21.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5daffd640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5dc0614f0 0x7fb5dc0f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 -- 10.20.193.28:0/1685961563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5dc062ae0 msgr2=0x7fb5dc0f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5dc062ae0 0x7fb5dc0f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 -- 10.20.193.28:0/1685961563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5dc0614f0 msgr2=0x7fb5dc0f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5dc0614f0 0x7fb5dc0f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 -- 10.20.193.28:0/1685961563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c4009570 con 0x7fb5dc159af0 2026-02-20T13:21:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.193+0000 7fb5db7fe640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc159af0 0x7fb5dc0f8550 secure :-1 s=READY pgs=631 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5cc00f8d0 tx=0x7fb5cc00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.194+0000 7fb5e085b640 1 -- 10.20.193.28:0/1685961563 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5cc00dce0 con 0x7fb5dc159af0 2026-02-20T13:21:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.194+0000 7fb5e085b640 1 -- 10.20.193.28:0/1685961563 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5cc00de40 con 0x7fb5dc159af0 2026-02-20T13:21:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.194+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc0f9180 con 0x7fb5dc159af0 2026-02-20T13:21:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.194+0000 7fb5e085b640 1 -- 10.20.193.28:0/1685961563 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5cc0116b0 con 0x7fb5dc159af0 2026-02-20T13:21:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.194+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc10ac70 con 0x7fb5dc159af0 2026-02-20T13:21:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.195+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5dc0624c0 con 0x7fb5dc159af0 2026-02-20T13:21:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.196+0000 7fb5e085b640 1 -- 10.20.193.28:0/1685961563 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb5cc020060 con 0x7fb5dc159af0 2026-02-20T13:21:21.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.198+0000 7fb5e085b640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5b00b5760 0x7fb5b00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.198+0000 7fb5e085b640 1 -- 10.20.193.28:0/1685961563 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5cc015070 con 0x7fb5dc159af0 2026-02-20T13:21:21.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.198+0000 7fb5daffd640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5b00b5760 0x7fb5b00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.199+0000 7fb5daffd640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5b00b5760 0x7fb5b00d5c10 secure :-1 s=READY pgs=350 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d0004740 tx=0x7fb5d0004340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:21.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.199+0000 7fb5e085b640 1 -- 10.20.193.28:0/1685961563 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fb5cc0aa620 con 0x7fb5dc159af0 2026-02-20T13:21:21.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.341+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5dc0f3da0 con 0x7fb5dc159af0 2026-02-20T13:21:21.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.341+0000 7fb5e085b640 1 -- 10.20.193.28:0/1685961563 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fb5cc0ad7d0 con 0x7fb5dc159af0 2026-02-20T13:21:21.345 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:21:21.345 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:21:21.346 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:21:21.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.342+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5b00b5760 msgr2=0x7fb5b00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.342+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5b00b5760 0x7fb5b00d5c10 secure :-1 s=READY pgs=350 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d0004740 tx=0x7fb5d0004340 comp rx=0 tx=0).stop 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.342+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc159af0 msgr2=0x7fb5dc0f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.342+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc159af0 0x7fb5dc0f8550 secure :-1 s=READY pgs=631 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5cc00f8d0 tx=0x7fb5cc00fda0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.343+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 shutdown_connections 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.343+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5b00b5760 0x7fb5b00d5c10 unknown :-1 s=CLOSED pgs=350 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.343+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5dc159af0 0x7fb5dc0f8550 unknown :-1 s=CLOSED pgs=631 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.343+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5dc062ae0 0x7fb5dc0f3180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.343+0000 7fb5e185d640 1 --2- 10.20.193.28:0/1685961563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5dc0614f0 0x7fb5dc0f2c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.343+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 >> 10.20.193.28:0/1685961563 conn(0x7fb5dc05f830 msgr2=0x7fb5dc10e210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.343+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 shutdown_connections 2026-02-20T13:21:21.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.343+0000 7fb5e185d640 1 -- 10.20.193.28:0/1685961563 wait complete. 2026-02-20T13:21:21.445 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:21:21.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:21 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1685961563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:21.629 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2260750534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4db41156a0 msgr2=0x7f4db4176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2260750534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4db41156a0 0x7f4db4176070 secure :-1 s=READY pgs=216 gs=3 cs=0 l=1 c_cookie=3872622416769451169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db000a970 tx=0x7f4db00301b0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2260750534 shutdown_connections 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2260750534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4db410fea0 0x7f4db4114ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2260750534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4db41156a0 0x7f4db4176070 unknown :-1 s=CLOSED pgs=216 gs=3 cs=0 l=1 c_cookie=3872622416769451169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2260750534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4db410f4b0 0x7f4db410f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2260750534 >> 10.20.193.28:0/2260750534 conn(0x7f4db40ecda0 msgr2=0x7f4db410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2260750534 shutdown_connections 2026-02-20T13:21:21.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.808+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2260750534 wait complete. 2026-02-20T13:21:21.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.809+0000 7f4dbaa86640 1 Processor -- start 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.809+0000 7f4dbaa86640 1 -- start start 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.809+0000 7f4dbaa86640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4db410f4b0 0x7f4db411de00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.809+0000 7f4dbaa86640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4db410fea0 0x7f4db411e340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.809+0000 7f4dbaa86640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4db41156a0 0x7f4db4123710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4dbaa86640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4123d30 con 0x7f4db410f4b0 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4dbaa86640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4123ea0 con 0x7f4db410fea0 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4dbaa86640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4124060 con 0x7f4db41156a0 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9283640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4db410fea0 0x7f4db411e340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9a84640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4db410f4b0 0x7f4db411de00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9283640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4db410fea0 0x7f4db411e340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42726/0 (socket says 10.20.193.28:42726) 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4dba285640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4db41156a0 0x7f4db4123710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9283640 1 -- 10.20.193.28:0/2291770746 learned_addr learned my addr 10.20.193.28:0/2291770746 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9a84640 1 -- 10.20.193.28:0/2291770746 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4db41156a0 msgr2=0x7f4db4123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9a84640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4db41156a0 0x7f4db4123710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9a84640 1 -- 10.20.193.28:0/2291770746 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4db410fea0 msgr2=0x7f4db411e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9a84640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4db410fea0 0x7f4db411e340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9a84640 1 -- 10.20.193.28:0/2291770746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db000a590 con 0x7f4db410f4b0 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4db9a84640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4db410f4b0 0x7f4db411de00 secure :-1 s=READY pgs=632 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da400e7b0 tx=0x7f4da400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4da2ffd640 1 -- 10.20.193.28:0/2291770746 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da400cce0 con 0x7f4db410f4b0 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2291770746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db4124340 con 0x7f4db410f4b0 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2291770746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db4063220 con 0x7f4db410f4b0 2026-02-20T13:21:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4da2ffd640 1 -- 10.20.193.28:0/2291770746 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da400ce40 con 0x7f4db410f4b0 2026-02-20T13:21:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.810+0000 7f4da2ffd640 1 -- 10.20.193.28:0/2291770746 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da40052a0 con 0x7f4db410f4b0 2026-02-20T13:21:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.813+0000 7f4da2ffd640 1 -- 10.20.193.28:0/2291770746 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f4da4004770 con 0x7f4db410f4b0 2026-02-20T13:21:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.815+0000 7f4da2ffd640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.815+0000 7f4da2ffd640 1 -- 10.20.193.28:0/2291770746 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4da4014070 con 0x7f4db410f4b0 2026-02-20T13:21:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.815+0000 7f4db9283640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dbdd09e00 1 Processor -- start 2026-02-20T13:21:21.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dbdd09e00 1 -- start start 2026-02-20T13:21:21.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9283640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 secure :-1 s=READY pgs=351 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db41247a0 tx=0x7f4da8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:21.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd230c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd23515e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 0x561bd2371f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561bd2222780 con 0x561bd230c360 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561bd221e4b0 con 0x561bd230cc70 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561bd2218450 con 0x561bd2351b20 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9a84640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd230c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9a84640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd230c730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37756/0 (socket says 10.20.193.28:37756) 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9a84640 1 -- 10.20.193.28:0/1325867110 learned_addr learned my addr 10.20.193.28:0/1325867110 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9283640 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd23515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4dba285640 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 0x561bd2371f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9a84640 1 -- 10.20.193.28:0/1325867110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 msgr2=0x561bd2371f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:21.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9a84640 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 0x561bd2371f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9a84640 1 -- 10.20.193.28:0/1325867110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 msgr2=0x561bd23515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.816+0000 7f4db9a84640 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd23515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4db9a84640 1 -- 10.20.193.28:0/1325867110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd21c3d10 con 0x561bd230c360 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4db9283640 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd23515e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4db9a84640 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd230c730 secure :-1 s=READY pgs=633 gs=1 cs=0 l=1 c_cookie=15151929664322766675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40a9300 tx=0x7f4da40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24677c057a98753 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4d824e6640 1 -- 10.20.193.28:0/1325867110 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da40d20d0 con 0x561bd230c360 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4d824e6640 1 -- 10.20.193.28:0/1325867110 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da40b2a50 con 0x561bd230c360 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4d824e6640 1 -- 10.20.193.28:0/1325867110 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da40b79e0 con 0x561bd230c360 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1325867110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 msgr2=0x561bd230c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd230c730 secure :-1 s=READY pgs=633 gs=1 cs=0 l=1 c_cookie=15151929664322766675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40a9300 tx=0x7f4da40046b0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1325867110 shutdown_connections 2026-02-20T13:21:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 0x561bd2371f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd23515e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1325867110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd230c730 unknown :-1 s=CLOSED pgs=633 gs=1 cs=0 l=1 c_cookie=15151929664322766675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1325867110 >> 10.20.193.28:0/1325867110 conn(0x561bd22ea860 msgr2=0x561bd230ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1325867110 shutdown_connections 2026-02-20T13:21:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.817+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1325867110 wait complete. 2026-02-20T13:21:21.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4dbdd09e00 1 -- start start 2026-02-20T13:21:21.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4dbdd09e00 1 Processor -- start 2026-02-20T13:21:21.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd2369780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd2369cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 0x561bd236ba50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561bd236bfc0 con 0x561bd230c360 2026-02-20T13:21:21.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561bd236c130 con 0x561bd230cc70 2026-02-20T13:21:21.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561bd236c2f0 con 0x561bd2351b20 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.819+0000 7f4db9a84640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd2369780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9283640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd2369cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9283640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd2369cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42744/0 (socket says 10.20.193.28:42744) 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9283640 1 -- 10.20.193.28:0/2755853610 learned_addr learned my addr 10.20.193.28:0/2755853610 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4dba285640 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 0x561bd236ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9a84640 1 -- 10.20.193.28:0/2755853610 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 msgr2=0x561bd236ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9a84640 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 0x561bd236ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9a84640 1 -- 10.20.193.28:0/2755853610 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 msgr2=0x561bd2369cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9a84640 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd2369cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9a84640 1 -- 10.20.193.28:0/2755853610 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db4063220 con 0x561bd230c360 2026-02-20T13:21:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4db9a84640 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd2369780 secure :-1 s=READY pgs=634 gs=1 cs=0 l=1 c_cookie=2849620134191717505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40acd10 tx=0x7f4da40acde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278be26a034c5c81 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4d6f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/2755853610 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da40b79e0 con 0x561bd230c360 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/2755853610 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da40b2040 con 0x561bd230c360 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da8003d00 con 0x561bd230c360 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/2755853610 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da40adc40 con 0x561bd230c360 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4dbdd09e00 10 client.16836 _ll_register_callbacks cb 0x561bd2199a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.820+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561bd1eae6f0 con 0x561bd230c360 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/2755853610 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4da40aad10 con 0x561bd230c360 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/2755853610 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4da40aaf30 con 0x561bd230c360 2026-02-20T13:21:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4dbdd09e00 10 client.16836 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561bd219c3c0 con 0x561bd230c360 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/2755853610 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4da40ae720 con 0x561bd230c360 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4dbdd09e00 10 client.16836 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4dbdd09e00 10 client.16836 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4dbdd09e00 20 client.16836 populate_metadata read hostname 'trial028' 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x561bd234ec60 0x561bd234f100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4dbdd09e00 4 client.16836 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bd21baf80 con 0x561bd234ec60 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.821+0000 7f4db9283640 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x561bd234ec60 0x561bd234f100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4db9283640 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x561bd234ec60 0x561bd234f100 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=1443088104882607279 s_cookie=2595609223599353883 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1406e0fc4f1e94af server_cookie=240574d6345df01b in_seq=0 out_seq=0 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4d6f7fe640 10 client.16836 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:21:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/2755853610 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561bd21baf80 con 0x561bd234ec60 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4d6f7fe640 10 client.16836 handle_command_reply: tid=0 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4dbdd09e00 1 client.16836 shutdown 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 msgr2=0x561bd2369780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd2369780 secure :-1 s=READY pgs=634 gs=1 cs=0 l=1 c_cookie=2849620134191717505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40acd10 tx=0x7f4da40acde0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 shutdown_connections 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.822+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x561bd234ec60 0x561bd234f100 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=1443088104882607279 s_cookie=2595609223599353883 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.823+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd2351b20 0x561bd236ba50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.823+0000 7f4d6f7fe640 0 client.16836 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.823+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd230cc70 0x561bd2369cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.823+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/2755853610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230c360 0x561bd2369780 unknown :-1 s=CLOSED pgs=634 gs=1 cs=0 l=1 c_cookie=2849620134191717505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.823+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 >> 10.20.193.28:0/2755853610 conn(0x561bd22ea860 msgr2=0x561bd230ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.823+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 shutdown_connections 2026-02-20T13:21:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.823+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/2755853610 wait complete. 2026-02-20T13:21:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.823+0000 7f4dbdd09e00 20 client.16836 trim_cache size 0 max 16384 2026-02-20T13:21:21.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.830+0000 7f4dbdd09e00 1 Processor -- start 2026-02-20T13:21:21.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.830+0000 7f4dbdd09e00 1 -- start start 2026-02-20T13:21:21.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236b9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236e200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd2366910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561bd2216080 con 0x561bd230cc70 2026-02-20T13:21:21.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561bd1ed6700 con 0x561bd2351b20 2026-02-20T13:21:21.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561bd236fb80 con 0x561bd230c360 2026-02-20T13:21:21.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9283640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236e200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4dba285640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd2366910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57300/0 (socket says 10.20.193.28:57300) 2026-02-20T13:21:21.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 -- 10.20.193.28:0/848652899 learned_addr learned my addr 10.20.193.28:0/848652899 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:21.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 -- 10.20.193.28:0/848652899 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 msgr2=0x561bd2366910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:21.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 --2- 10.20.193.28:0/848652899 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd2366910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 -- 10.20.193.28:0/848652899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 msgr2=0x561bd236e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 --2- 10.20.193.28:0/848652899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236e200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 -- 10.20.193.28:0/848652899 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd21ae0e0 con 0x561bd230c360 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9283640 1 --2- 10.20.193.28:0/848652899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236e200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.831+0000 7f4db9a84640 1 --2- 10.20.193.28:0/848652899 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236b9e0 secure :-1 s=READY pgs=217 gs=2 cs=0 l=1 c_cookie=14934702996932030449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40e4500 tx=0x7f4da40ca000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf42b93f8e186ff1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4d81ce5640 1 -- 10.20.193.28:0/848652899 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da40b79e0 con 0x561bd230c360 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4d81ce5640 1 -- 10.20.193.28:0/848652899 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da40b2040 con 0x561bd230c360 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4d81ce5640 1 -- 10.20.193.28:0/848652899 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da40d09f0 con 0x561bd230c360 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/848652899 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 msgr2=0x561bd236b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/848652899 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236b9e0 secure :-1 s=READY pgs=217 gs=2 cs=0 l=1 c_cookie=14934702996932030449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40e4500 tx=0x7f4da40ca000 comp rx=0 tx=0).stop 2026-02-20T13:21:21.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/848652899 shutdown_connections 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/848652899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236e200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/848652899 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd2366910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/848652899 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236b9e0 unknown :-1 s=CLOSED pgs=217 gs=2 cs=0 l=1 c_cookie=14934702996932030449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/848652899 >> 10.20.193.28:0/848652899 conn(0x561bd22ea860 msgr2=0x561bd236daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/848652899 shutdown_connections 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.832+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/848652899 wait complete. 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.833+0000 7f4dbdd09e00 1 -- start start 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.833+0000 7f4dbdd09e00 1 Processor -- start 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.833+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236f750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.833+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236cdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.833+0000 7f4dbdd09e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd236d550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.833+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561bd236dc50 con 0x561bd230cc70 2026-02-20T13:21:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.833+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561bd22edc60 con 0x561bd2351b20 2026-02-20T13:21:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.833+0000 7f4dbdd09e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561bd22ede20 con 0x561bd230c360 2026-02-20T13:21:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4dba285640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd236d550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4db9283640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4db9a84640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236f750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4dba285640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd236d550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42760/0 (socket says 10.20.193.28:42760) 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4dba285640 1 -- 10.20.193.28:0/1389447825 learned_addr learned my addr 10.20.193.28:0/1389447825 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4db9283640 1 -- 10.20.193.28:0/1389447825 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 msgr2=0x561bd236f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4db9283640 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236f750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4db9283640 1 -- 10.20.193.28:0/1389447825 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 msgr2=0x561bd236d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4db9283640 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd236d550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4db9283640 1 -- 10.20.193.28:0/1389447825 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da40abe50 con 0x561bd230cc70 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4db9283640 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236cdc0 secure :-1 s=READY pgs=635 gs=1 cs=0 l=1 c_cookie=15914877544827935291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x561bd234f980 tx=0x7f4da80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdd00ce6f4f5a3b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4d6f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/1389447825 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da8021030 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/1389447825 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da8022040 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/1389447825 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da801c7b0 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da802c650 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/1389447825 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4da801c910 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4dbdd09e00 10 client.16842 _ll_register_callbacks cb 0x561bd2199a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.834+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da40b2a50 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/1389447825 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4da8011bb0 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4dbdd09e00 10 client.16842 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561bd21a8b60 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/1389447825 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4da8011d10 con 0x561bd230cc70 2026-02-20T13:21:21.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4dbdd09e00 10 client.16842 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4dbdd09e00 10 client.16842 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4dbdd09e00 20 client.16842 populate_metadata read hostname 'trial028' 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x561bd22efab0 0x561bd22eff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4dbdd09e00 4 client.16842 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561bd1eabf40 con 0x561bd22efab0 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4db9a84640 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x561bd22efab0 0x561bd22eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4db9a84640 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x561bd22efab0 0x561bd22eff50 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=9705657948466750018 s_cookie=3749605475409870194 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=86b16c7b39cea242 server_cookie=3409465049aa3d72 in_seq=0 out_seq=0 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.835+0000 7f4d6f7fe640 10 client.16842 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4d6f7fe640 1 -- 10.20.193.28:0/1389447825 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561bd1eabf40 con 0x561bd22efab0 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4d6f7fe640 10 client.16842 handle_command_reply: tid=0 2026-02-20T13:21:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 client.16842 shutdown 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 msgr2=0x561bd236cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236cdc0 secure :-1 s=READY pgs=635 gs=1 cs=0 l=1 c_cookie=15914877544827935291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x561bd234f980 tx=0x7f4da80047e0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 shutdown_connections 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x561bd22efab0 0x561bd22eff50 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=9705657948466750018 s_cookie=3749605475409870194 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561bd230cc70 0x561bd236cdc0 unknown :-1 s=CLOSED pgs=635 gs=1 cs=0 l=1 c_cookie=15914877544827935291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561bd2351b20 0x561bd236d550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 --2- 10.20.193.28:0/1389447825 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561bd230c360 0x561bd236f750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 >> 10.20.193.28:0/1389447825 conn(0x561bd22ea860 msgr2=0x561bd236b150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4d6f7fe640 0 client.16842 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 shutdown_connections 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 1 -- 10.20.193.28:0/1389447825 wait complete. 2026-02-20T13:21:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbdd09e00 20 client.16842 trim_cache size 0 max 16384 2026-02-20T13:21:21.846 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 msgr2=0x7f4d900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 secure :-1 s=READY pgs=351 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db41247a0 tx=0x7f4da8009310 comp rx=0 tx=0).stop 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4db410f4b0 msgr2=0x7f4db411de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.836+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4db410f4b0 0x7f4db411de00 secure :-1 s=READY pgs=632 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da400e7b0 tx=0x7f4da400ec80 comp rx=0 tx=0).stop 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.837+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2291770746 shutdown_connections 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.837+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 unknown :-1 s=CLOSED pgs=351 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.837+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4db41156a0 0x7f4db4123710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.837+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4db410fea0 0x7f4db411e340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.837+0000 7f4dbaa86640 1 --2- 10.20.193.28:0/2291770746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4db410f4b0 0x7f4db411de00 unknown :-1 s=CLOSED pgs=632 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.837+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2291770746 >> 10.20.193.28:0/2291770746 conn(0x7f4db40ecda0 msgr2=0x7f4db410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.837+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2291770746 shutdown_connections 2026-02-20T13:21:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:21.837+0000 7f4dbaa86640 1 -- 10.20.193.28:0/2291770746 wait complete. 2026-02-20T13:21:21.972 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:21:21.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:21 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1685961563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:21.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:21 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1685961563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:22.156 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:22.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.331+0000 7fd6ff652640 1 -- 10.20.193.28:0/2675627043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6f810f4b0 msgr2=0x7fd6f810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.331+0000 7fd6ff652640 1 --2- 10.20.193.28:0/2675627043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6f810f4b0 0x7fd6f810f880 secure :-1 s=READY pgs=636 gs=2 cs=0 l=1 c_cookie=2864360792052045523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f0009950 tx=0x7fd6f002f190 comp rx=0 tx=0).stop 2026-02-20T13:21:22.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.332+0000 7fd6ff652640 1 -- 10.20.193.28:0/2675627043 shutdown_connections 2026-02-20T13:21:22.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.332+0000 7fd6ff652640 1 --2- 10.20.193.28:0/2675627043 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6f81156a0 0x7fd6f8176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.332+0000 7fd6ff652640 1 --2- 10.20.193.28:0/2675627043 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6f810fea0 0x7fd6f8114ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.332+0000 7fd6ff652640 1 --2- 10.20.193.28:0/2675627043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6f810f4b0 0x7fd6f810f880 unknown :-1 s=CLOSED pgs=636 gs=2 cs=0 l=1 c_cookie=2864360792052045523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.332+0000 7fd6ff652640 1 -- 10.20.193.28:0/2675627043 >> 10.20.193.28:0/2675627043 conn(0x7fd6f80ecda0 msgr2=0x7fd6f810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.332+0000 7fd6ff652640 1 -- 10.20.193.28:0/2675627043 shutdown_connections 2026-02-20T13:21:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.332+0000 7fd6ff652640 1 -- 10.20.193.28:0/2675627043 wait complete. 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6ff652640 1 Processor -- start 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6ff652640 1 -- start start 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6ff652640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6f810f4b0 0x7fd6f811de40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6ff652640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6f810fea0 0x7fd6f811e380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6ff652640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6f81156a0 0x7fd6f8123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6ff652640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8123d20 con 0x7fd6f81156a0 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6ff652640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8123e90 con 0x7fd6f810f4b0 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6ff652640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8124050 con 0x7fd6f810fea0 2026-02-20T13:21:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6fe650640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6f810f4b0 0x7fd6f811de40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6fee51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6f81156a0 0x7fd6f8123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6fe650640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6f810f4b0 0x7fd6f811de40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42778/0 (socket says 10.20.193.28:42778) 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6fe650640 1 -- 10.20.193.28:0/1835919097 learned_addr learned my addr 10.20.193.28:0/1835919097 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.333+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6f810fea0 0x7fd6f811e380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6fe650640 1 -- 10.20.193.28:0/1835919097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6f810fea0 msgr2=0x7fd6f811e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6fe650640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6f810fea0 0x7fd6f811e380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6fe650640 1 -- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6f81156a0 msgr2=0x7fd6f8123700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6fe650640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6f81156a0 0x7fd6f8123700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6fe650640 1 -- 10.20.193.28:0/1835919097 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f0009570 con 0x7fd6f810f4b0 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6fe650640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6f810f4b0 0x7fd6f811de40 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f0038820 tx=0x7fd6f0004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6e37fe640 1 -- 10.20.193.28:0/1835919097 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f003d070 con 0x7fd6f810f4b0 2026-02-20T13:21:22.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6e37fe640 1 -- 10.20.193.28:0/1835919097 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6f0002ad0 con 0x7fd6f810f4b0 2026-02-20T13:21:22.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6ff652640 1 -- 10.20.193.28:0/1835919097 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f81242d0 con 0x7fd6f810f4b0 2026-02-20T13:21:22.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6e37fe640 1 -- 10.20.193.28:0/1835919097 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f0041930 con 0x7fd6f810f4b0 2026-02-20T13:21:22.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.334+0000 7fd6ff652640 1 -- 10.20.193.28:0/1835919097 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f8164a30 con 0x7fd6f810f4b0 2026-02-20T13:21:22.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.337+0000 7fd6e37fe640 1 -- 10.20.193.28:0/1835919097 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd6f002f9f0 con 0x7fd6f810f4b0 2026-02-20T13:21:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.339+0000 7fd6e37fe640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6d40b56e0 0x7fd6d40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.339+0000 7fd6e37fe640 1 -- 10.20.193.28:0/1835919097 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6f010aff0 con 0x7fd6f810f4b0 2026-02-20T13:21:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.339+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6d40b56e0 0x7fd6d40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.339+0000 7fd7028d5e00 1 Processor -- start 2026-02-20T13:21:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.339+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6d40b56e0 0x7fd6d40d5b90 secure :-1 s=READY pgs=352 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f8124790 tx=0x7fd6e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd7028d5e00 1 -- start start 2026-02-20T13:21:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d38730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38c70 0x556077d7d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d9df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556077c4e780 con 0x556077d38c70 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556077c4a4b0 con 0x556077d7db20 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556077c44450 con 0x556077d38360 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fe650640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d38730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fde4f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38c70 0x556077d7d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fee51640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d9df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fee51640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d9df00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42784/0 (socket says 10.20.193.28:42784) 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fee51640 1 -- 10.20.193.28:0/3063391874 learned_addr learned my addr 10.20.193.28:0/3063391874 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fde4f640 1 -- 10.20.193.28:0/3063391874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 msgr2=0x556077d38730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d38730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fde4f640 1 -- 10.20.193.28:0/3063391874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 msgr2=0x556077d9df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d9df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fde4f640 1 -- 10.20.193.28:0/3063391874 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556077befd10 con 0x556077d38c70 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.340+0000 7fd6fee51640 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d9df00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd6fe650640 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d38730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38c70 0x556077d7d5e0 secure :-1 s=READY pgs=637 gs=1 cs=0 l=1 c_cookie=13339042808198579313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6e4009c30 tx=0x7fd6e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91dccc2c267c471 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd6e0cf3640 1 -- 10.20.193.28:0/3063391874 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6e4011e60 con 0x556077d38c70 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd6e0cf3640 1 -- 10.20.193.28:0/3063391874 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6e40198e0 con 0x556077d38c70 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd6e0cf3640 1 -- 10.20.193.28:0/3063391874 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6e401ba70 con 0x556077d38c70 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 -- 10.20.193.28:0/3063391874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38c70 msgr2=0x556077d7d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38c70 0x556077d7d5e0 secure :-1 s=READY pgs=637 gs=1 cs=0 l=1 c_cookie=13339042808198579313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6e4009c30 tx=0x7fd6e4014000 comp rx=0 tx=0).stop 2026-02-20T13:21:22.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 -- 10.20.193.28:0/3063391874 shutdown_connections 2026-02-20T13:21:22.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38c70 0x556077d7d5e0 unknown :-1 s=CLOSED pgs=637 gs=1 cs=0 l=1 c_cookie=13339042808198579313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d9df00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/3063391874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d38730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 -- 10.20.193.28:0/3063391874 >> 10.20.193.28:0/3063391874 conn(0x556077d16860 msgr2=0x556077d36c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 -- 10.20.193.28:0/3063391874 shutdown_connections 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.341+0000 7fd7028d5e00 1 -- 10.20.193.28:0/3063391874 wait complete. 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.343+0000 7fd7028d5e00 1 -- start start 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.343+0000 7fd7028d5e00 1 Processor -- start 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d95740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d95c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d7db20 0x556077d97a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556077d97f80 con 0x556077d38360 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556077d980f0 con 0x556077d38c70 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556077d982b0 con 0x556077d7db20 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fee51640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d7db20 0x556077d97a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fe650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d95740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fde4f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d95c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fe650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d95740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37816/0 (socket says 10.20.193.28:37816) 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fde4f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d95c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42792/0 (socket says 10.20.193.28:42792) 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fe650640 1 -- 10.20.193.28:0/4071957067 learned_addr learned my addr 10.20.193.28:0/4071957067 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fee51640 1 -- 10.20.193.28:0/4071957067 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 msgr2=0x556077d95c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fee51640 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d95c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fee51640 1 -- 10.20.193.28:0/4071957067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 msgr2=0x556077d95740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fee51640 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d95740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fee51640 1 -- 10.20.193.28:0/4071957067 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e40098d0 con 0x556077d7db20 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fe650640 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d95740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6fee51640 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d7db20 0x556077d97a10 secure :-1 s=READY pgs=218 gs=3 cs=0 l=1 c_cookie=12039911736909011114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6ec0050f0 tx=0x7fd6ec00aad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7165bef3d8498aa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.344+0000 7fd6abfff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd6abfff640 1 -- 10.20.193.28:0/4071957067 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6ec018070 con 0x556077d7db20 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ec0052d0 con 0x556077d7db20 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 10 client.26770 _ll_register_callbacks cb 0x556077bc5a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5560778da6f0 con 0x556077d7db20 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd6abfff640 1 -- 10.20.193.28:0/4071957067 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6ec013cf0 con 0x556077d7db20 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd6abfff640 1 -- 10.20.193.28:0/4071957067 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6ec01c3c0 con 0x556077d7db20 2026-02-20T13:21:22.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd6abfff640 1 -- 10.20.193.28:0/4071957067 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6ec013810 con 0x556077d7db20 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd6abfff640 1 -- 10.20.193.28:0/4071957067 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6ec013a10 con 0x556077d7db20 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 10 client.26770 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556077bc83c0 con 0x556077d7db20 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd6abfff640 1 -- 10.20.193.28:0/4071957067 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd6ec011430 con 0x556077d7db20 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 10 client.26770 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 10 client.26770 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 20 client.26770 populate_metadata read hostname 'trial028' 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x556077d9dce0 0x556077d7b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 4 client.26770 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.345+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556077be6f80 con 0x556077d9dce0 2026-02-20T13:21:22.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.346+0000 7fd6fe650640 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x556077d9dce0 0x556077d7b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.346+0000 7fd6fe650640 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x556077d9dce0 0x556077d7b8a0 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=2132255033879686289 s_cookie=6215245188425127751 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1d974aa7f8efec91 server_cookie=5640fc91b0091747 in_seq=0 out_seq=0 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.346+0000 7fd6abfff640 10 client.26770 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd6abfff640 1 -- 10.20.193.28:0/4071957067 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556077be6f80 con 0x556077d9dce0 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd6abfff640 10 client.26770 handle_command_reply: tid=0 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 client.26770 shutdown 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d7db20 msgr2=0x556077d97a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d7db20 0x556077d97a10 secure :-1 s=READY pgs=218 gs=3 cs=0 l=1 c_cookie=12039911736909011114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6ec0050f0 tx=0x7fd6ec00aad0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 shutdown_connections 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x556077d9dce0 0x556077d7b8a0 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=2132255033879686289 s_cookie=6215245188425127751 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d7db20 0x556077d97a10 unknown :-1 s=CLOSED pgs=218 gs=3 cs=0 l=1 c_cookie=12039911736909011114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d95c80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/4071957067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d95740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd6abfff640 0 client.26770 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:21:22.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 >> 10.20.193.28:0/4071957067 conn(0x556077d16860 msgr2=0x556077d36c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 shutdown_connections 2026-02-20T13:21:22.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 1 -- 10.20.193.28:0/4071957067 wait complete. 2026-02-20T13:21:22.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.347+0000 7fd7028d5e00 20 client.26770 trim_cache size 0 max 16384 2026-02-20T13:21:22.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.354+0000 7fd7028d5e00 1 Processor -- start 2026-02-20T13:21:22.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.354+0000 7fd7028d5e00 1 -- start start 2026-02-20T13:21:22.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.354+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d979a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.354+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d928d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.354+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d7db20 0x556077d92e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.354+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556077c42080 con 0x556077d7db20 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.354+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556077902700 con 0x556077d38c70 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.354+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556077d9e300 con 0x556077d38360 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d928d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42798/0 (socket says 10.20.193.28:42798) 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 -- 10.20.193.28:0/1090091995 learned_addr learned my addr 10.20.193.28:0/1090091995 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fe650640 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fee51640 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d7db20 0x556077d92e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 -- 10.20.193.28:0/1090091995 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 msgr2=0x556077d979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 -- 10.20.193.28:0/1090091995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d7db20 msgr2=0x556077d92e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d7db20 0x556077d92e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 -- 10.20.193.28:0/1090091995 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556077bda0e0 con 0x556077d38c70 2026-02-20T13:21:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d928d0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=17108093962489070870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6e4011cb0 tx=0x7fd6e401b590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed6c28d0fa2a8516 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6c64e6640 1 -- 10.20.193.28:0/1090091995 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6e4019400 con 0x556077d38c70 2026-02-20T13:21:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6c64e6640 1 -- 10.20.193.28:0/1090091995 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6e4019560 con 0x556077d38c70 2026-02-20T13:21:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.355+0000 7fd6c64e6640 1 -- 10.20.193.28:0/1090091995 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6e4005050 con 0x556077d38c70 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1090091995 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 msgr2=0x556077d928d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d928d0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=17108093962489070870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6e4011cb0 tx=0x7fd6e401b590 comp rx=0 tx=0).stop 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1090091995 shutdown_connections 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d7db20 0x556077d92e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d38c70 0x556077d928d0 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=17108093962489070870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1090091995 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38360 0x556077d979a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1090091995 >> 10.20.193.28:0/1090091995 conn(0x556077d16860 msgr2=0x556077d9a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1090091995 shutdown_connections 2026-02-20T13:21:22.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1090091995 wait complete. 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 -- start start 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.356+0000 7fd7028d5e00 1 Processor -- start 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d93960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38c70 0x556077d93ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd7028d5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d19c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556077d94810 con 0x556077d38360 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556077d1a1a0 con 0x556077d7db20 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd7028d5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556077d1a360 con 0x556077d38c70 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38c70 0x556077d93ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fe650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d93960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38c70 0x556077d93ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57362/0 (socket says 10.20.193.28:57362) 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 -- 10.20.193.28:0/1128990230 learned_addr learned my addr 10.20.193.28:0/1128990230 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fee51640 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d19c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 -- 10.20.193.28:0/1128990230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 msgr2=0x556077d19c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d19c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 -- 10.20.193.28:0/1128990230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 msgr2=0x556077d93960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d93960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 -- 10.20.193.28:0/1128990230 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556077bd4b60 con 0x556077d38c70 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6fde4f640 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38c70 0x556077d93ec0 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=17746980088976695462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6e4005ca0 tx=0x7fd6e401b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f649f05d0762e0a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.357+0000 7fd6abfff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:22.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd6abfff640 1 -- 10.20.193.28:0/1128990230 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6e403b070 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd6abfff640 1 -- 10.20.193.28:0/1128990230 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6e4004420 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556077befd10 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 10 client.26776 _ll_register_callbacks cb 0x556077bc5a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6e40198e0 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd6abfff640 1 -- 10.20.193.28:0/1128990230 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6e4004c10 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd6abfff640 1 -- 10.20.193.28:0/1128990230 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6e4004e00 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd6abfff640 1 -- 10.20.193.28:0/1128990230 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6e402f420 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 10 client.26776 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556077bc86f0 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd6abfff640 1 -- 10.20.193.28:0/1128990230 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd6e4005050 con 0x556077d38c70 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 10 client.26776 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:22.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 10 client.26776 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 20 client.26776 populate_metadata read hostname 'trial028' 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x556077d1bb30 0x556077d1bfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 4 client.26776 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560778d7f40 con 0x556077d1bb30 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.358+0000 7fd6fe650640 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x556077d1bb30 0x556077d1bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd6abfff640 10 client.26776 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd6fe650640 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x556077d1bb30 0x556077d1bfd0 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=10545415896441680455 s_cookie=10791201132968375447 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9258d7e2c429f247 server_cookie=95c20c41965f7497 in_seq=0 out_seq=0 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd6abfff640 1 -- 10.20.193.28:0/1128990230 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560778d7f40 con 0x556077d1bb30 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd6abfff640 10 client.26776 handle_command_reply: tid=0 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 client.26776 shutdown 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38c70 msgr2=0x556077d93ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38c70 0x556077d93ec0 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=17746980088976695462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6e4005ca0 tx=0x7fd6e401b8f0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 shutdown_connections 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x556077d1bb30 0x556077d1bfd0 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=10545415896441680455 s_cookie=10791201132968375447 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077d7db20 0x556077d19c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077d38c70 0x556077d93ec0 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=17746980088976695462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 --2- 10.20.193.28:0/1128990230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077d38360 0x556077d93960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 >> 10.20.193.28:0/1128990230 conn(0x556077d16860 msgr2=0x556077d98a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.359+0000 7fd6abfff640 0 client.26776 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 shutdown_connections 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd7028d5e00 1 -- 10.20.193.28:0/1128990230 wait complete. 2026-02-20T13:21:22.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd7028d5e00 20 client.26776 trim_cache size 0 max 16384 2026-02-20T13:21:22.370 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:22.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 -- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6d40b56e0 msgr2=0x7fd6d40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6d40b56e0 0x7fd6d40d5b90 secure :-1 s=READY pgs=352 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f8124790 tx=0x7fd6e4005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:22.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 -- 10.20.193.28:0/1835919097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6f810f4b0 msgr2=0x7fd6f811de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6f810f4b0 0x7fd6f811de40 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f0038820 tx=0x7fd6f0004300 comp rx=0 tx=0).stop 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 -- 10.20.193.28:0/1835919097 shutdown_connections 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6d40b56e0 0x7fd6d40d5b90 unknown :-1 s=CLOSED pgs=352 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6f81156a0 0x7fd6f8123700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6f810fea0 0x7fd6f811e380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 --2- 10.20.193.28:0/1835919097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6f810f4b0 0x7fd6f811de40 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 -- 10.20.193.28:0/1835919097 >> 10.20.193.28:0/1835919097 conn(0x7fd6f80ecda0 msgr2=0x7fd6f810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 -- 10.20.193.28:0/1835919097 shutdown_connections 2026-02-20T13:21:22.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.360+0000 7fd6ff652640 1 -- 10.20.193.28:0/1835919097 wait complete. 2026-02-20T13:21:22.460 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:21:22.648 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:22.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:22 trial028 ceph-mon[37442]: pgmap v302: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:21:22.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.823+0000 7f4dbbfff640 1 -- 10.20.193.28:0/542576184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 msgr2=0x7f4dbc10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.823+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/542576184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 0x7f4dbc10f880 secure :-1 s=READY pgs=638 gs=1 cs=0 l=1 c_cookie=16803859482421825733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db0009950 tx=0x7f4db002f190 comp rx=0 tx=0).stop 2026-02-20T13:21:22.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 -- 10.20.193.28:0/542576184 shutdown_connections 2026-02-20T13:21:22.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/542576184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4dbc1156a0 0x7f4dbc176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/542576184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4dbc10fea0 0x7f4dbc114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/542576184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 0x7f4dbc10f880 unknown :-1 s=CLOSED pgs=638 gs=1 cs=0 l=1 c_cookie=16803859482421825733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 -- 10.20.193.28:0/542576184 >> 10.20.193.28:0/542576184 conn(0x7f4dbc0ecda0 msgr2=0x7f4dbc10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 -- 10.20.193.28:0/542576184 shutdown_connections 2026-02-20T13:21:22.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 -- 10.20.193.28:0/542576184 wait complete. 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 Processor -- start 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.824+0000 7f4dbbfff640 1 -- start start 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 0x7f4dbc11ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4dbc10fea0 0x7f4dbc11e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4dbc1156a0 0x7f4dbc1236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc123d00 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbbfff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc123e70 con 0x7f4dbc10fea0 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbbfff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc124030 con 0x7f4dbc1156a0 2026-02-20T13:21:22.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 0x7f4dbc11ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dba7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4dbc10fea0 0x7f4dbc11e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dba7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4dbc10fea0 0x7f4dbc11e310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42822/0 (socket says 10.20.193.28:42822) 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dba7fc640 1 -- 10.20.193.28:0/3373839211 learned_addr learned my addr 10.20.193.28:0/3373839211 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 0x7f4dbc11ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37844/0 (socket says 10.20.193.28:37844) 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4dbc1156a0 0x7f4dbc1236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbaffd640 1 -- 10.20.193.28:0/3373839211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4dbc1156a0 msgr2=0x7f4dbc1236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4dbc1156a0 0x7f4dbc1236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbaffd640 1 -- 10.20.193.28:0/3373839211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4dbc10fea0 msgr2=0x7f4dbc11e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4dbc10fea0 0x7f4dbc11e310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbaffd640 1 -- 10.20.193.28:0/3373839211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db0009570 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.825+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 0x7f4dbc11ddd0 secure :-1 s=READY pgs=639 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db002f6a0 tx=0x7f4db0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.826+0000 7f4d9bfff640 1 -- 10.20.193.28:0/3373839211 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4db003d070 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.826+0000 7f4dbbfff640 1 -- 10.20.193.28:0/3373839211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dbc1242b0 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.826+0000 7f4d9bfff640 1 -- 10.20.193.28:0/3373839211 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4db0002ad0 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.826+0000 7f4d9bfff640 1 -- 10.20.193.28:0/3373839211 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4db0041930 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.826+0000 7f4dbbfff640 1 -- 10.20.193.28:0/3373839211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dbc164a10 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.830+0000 7f4d9bfff640 1 -- 10.20.193.28:0/3373839211 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f4db0041ac0 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4dc331fe00 1 Processor -- start 2026-02-20T13:21:22.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4dc331fe00 1 -- start start 2026-02-20T13:21:22.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22e9a8730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22e9ed5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9edb20 0x55c22ea0df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c22e8be780 con 0x55c22e9a8360 2026-02-20T13:21:22.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c22e8ba4b0 con 0x55c22e9edb20 2026-02-20T13:21:22.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c22e8b4450 con 0x55c22e9a8c70 2026-02-20T13:21:22.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4d9bfff640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.831+0000 7f4d9bfff640 1 -- 10.20.193.28:0/3373839211 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4db010b070 con 0x7f4dbc10f4b0 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22e9ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22e9ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57388/0 (socket says 10.20.193.28:57388) 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 -- 10.20.193.28:0/1214719806 learned_addr learned my addr 10.20.193.28:0/1214719806 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dba7fc640 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9edb20 0x55c22ea0df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22e9a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 -- 10.20.193.28:0/1214719806 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9edb20 msgr2=0x55c22ea0df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9edb20 0x55c22ea0df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 -- 10.20.193.28:0/1214719806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 msgr2=0x55c22e9a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22e9a8730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 -- 10.20.193.28:0/1214719806 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22e85fd10 con 0x55c22e9a8c70 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22e9ed5e0 secure :-1 s=READY pgs=220 gs=2 cs=0 l=1 c_cookie=3487034241461246046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db00d1460 tx=0x7f4db0041410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30646f2ae1ebd85e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4d877fe640 1 -- 10.20.193.28:0/1214719806 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4db0041da0 con 0x55c22e9a8c70 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4d877fe640 1 -- 10.20.193.28:0/1214719806 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4db00d70f0 con 0x55c22e9a8c70 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.832+0000 7f4d877fe640 1 -- 10.20.193.28:0/1214719806 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4db00dc080 con 0x55c22e9a8c70 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1214719806 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 msgr2=0x55c22e9ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22e9ed5e0 secure :-1 s=READY pgs=220 gs=2 cs=0 l=1 c_cookie=3487034241461246046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db00d1460 tx=0x7f4db0041410 comp rx=0 tx=0).stop 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 secure :-1 s=READY pgs=353 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac006e90 tx=0x7f4dac0083d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1214719806 shutdown_connections 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9edb20 0x55c22ea0df00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22e9ed5e0 unknown :-1 s=CLOSED pgs=220 gs=2 cs=0 l=1 c_cookie=3487034241461246046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1214719806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22e9a8730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1214719806 >> 10.20.193.28:0/1214719806 conn(0x55c22e986860 msgr2=0x55c22e9a6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1214719806 shutdown_connections 2026-02-20T13:21:22.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.833+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1214719806 wait complete. 2026-02-20T13:21:22.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.834+0000 7f4dc331fe00 1 -- start start 2026-02-20T13:21:22.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.834+0000 7f4dc331fe00 1 Processor -- start 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.834+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8360 0x55c22ea056e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.834+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22ea05c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.834+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22ea079b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.834+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c22ea07f20 con 0x55c22e9edb20 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.834+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c22ea08090 con 0x55c22e9a8360 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c22ea08250 con 0x55c22e9a8c70 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22ea079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22ea05c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22ea05c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57392/0 (socket says 10.20.193.28:57392) 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 -- 10.20.193.28:0/1885721751 learned_addr learned my addr 10.20.193.28:0/1885721751 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22ea079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37850/0 (socket says 10.20.193.28:37850) 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8360 0x55c22ea056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 -- 10.20.193.28:0/1885721751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8360 msgr2=0x55c22ea056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8360 0x55c22ea056e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 -- 10.20.193.28:0/1885721751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 msgr2=0x55c22ea079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22ea079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 -- 10.20.193.28:0/1885721751 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22e8383c0 con 0x55c22e9a8c70 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22ea079b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4dba7fc640 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22ea05c20 secure :-1 s=READY pgs=221 gs=3 cs=0 l=1 c_cookie=7467311291888783932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40116c0 tx=0x7f4da4011b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a1380e744b523c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.835+0000 7f4d84ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4d84ff9640 1 -- 10.20.193.28:0/1885721751 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da4016070 con 0x55c22e9a8c70 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4d84ff9640 1 -- 10.20.193.28:0/1885721751 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da40045c0 con 0x55c22e9a8c70 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4d84ff9640 1 -- 10.20.193.28:0/1885721751 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da401b6e0 con 0x55c22e9a8c70 2026-02-20T13:21:22.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dbc164a10 con 0x55c22e9a8c70 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4d84ff9640 1 -- 10.20.193.28:0/1885721751 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4da4002e20 con 0x55c22e9a8c70 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4d84ff9640 10 client.26788 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 10 client.26788 _ll_register_callbacks cb 0x55c22e835a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c22e54a6f0 con 0x55c22e9a8c70 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4d84ff9640 1 -- 10.20.193.28:0/1885721751 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4da40026a0 con 0x55c22e9a8c70 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 10 client.26788 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c22e84a0e0 con 0x55c22e9a8c70 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4d84ff9640 1 -- 10.20.193.28:0/1885721751 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4da4002800 con 0x55c22e9a8c70 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 10 client.26788 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 10 client.26788 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 20 client.26788 populate_metadata read hostname 'trial028' 2026-02-20T13:21:22.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c22ea0dbf0 0x55c22e9eb8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 4 client.26788 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.836+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c22e856f80 con 0x55c22ea0dbf0 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.837+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c22ea0dbf0 0x55c22e9eb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.837+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c22ea0dbf0 0x55c22e9eb8a0 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=14610488728851480607 s_cookie=15277983514923146996 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cac2e216d60a801f server_cookie=d4064d0f83449ef4 in_seq=0 out_seq=0 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.837+0000 7f4d84ff9640 10 client.26788 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4d84ff9640 1 -- 10.20.193.28:0/1885721751 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c22e856f80 con 0x55c22ea0dbf0 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4d84ff9640 10 client.26788 handle_command_reply: tid=0 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 client.26788 shutdown 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 msgr2=0x55c22ea05c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22ea05c20 secure :-1 s=READY pgs=221 gs=3 cs=0 l=1 c_cookie=7467311291888783932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40116c0 tx=0x7f4da4011b90 comp rx=0 tx=0).stop 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 shutdown_connections 2026-02-20T13:21:22.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c22ea0dbf0 0x55c22e9eb8a0 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=14610488728851480607 s_cookie=15277983514923146996 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22ea079b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8c70 0x55c22ea05c20 unknown :-1 s=CLOSED pgs=221 gs=3 cs=0 l=1 c_cookie=7467311291888783932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1885721751 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8360 0x55c22ea056e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 >> 10.20.193.28:0/1885721751 conn(0x55c22e986860 msgr2=0x55c22e9a6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4d84ff9640 0 client.26788 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:21:22.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 shutdown_connections 2026-02-20T13:21:22.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1885721751 wait complete. 2026-02-20T13:21:22.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.838+0000 7f4dc331fe00 20 client.26788 trim_cache size 0 max 16384 2026-02-20T13:21:22.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.845+0000 7f4dc331fe00 1 Processor -- start 2026-02-20T13:21:22.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.845+0000 7f4dc331fe00 1 -- start start 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.845+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22ea07940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22ea02870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9edb20 0x55c22ea02db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c22e8b2080 con 0x55c22e9a8360 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c22e572700 con 0x55c22e9a8c70 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c22ea06780 con 0x55c22e9edb20 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dba7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22ea02870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22ea07940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dba7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22ea02870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42856/0 (socket says 10.20.193.28:42856) 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dba7fc640 1 -- 10.20.193.28:0/1933717530 learned_addr learned my addr 10.20.193.28:0/1933717530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22ea07940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37858/0 (socket says 10.20.193.28:37858) 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9edb20 0x55c22ea02db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbaffd640 1 -- 10.20.193.28:0/1933717530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9edb20 msgr2=0x55c22ea02db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9edb20 0x55c22ea02db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbaffd640 1 -- 10.20.193.28:0/1933717530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 msgr2=0x55c22ea02870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22ea02870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbaffd640 1 -- 10.20.193.28:0/1933717530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22e844b60 con 0x55c22e9a8360 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dba7fc640 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22ea02870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:22.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9edb20 0x55c22ea02db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22ea07940 secure :-1 s=READY pgs=640 gs=1 cs=0 l=1 c_cookie=16562545092728493089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db00d16f0 tx=0x7f4db004c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d9fb027c789421 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4d86ffd640 1 -- 10.20.193.28:0/1933717530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4db00d96d0 con 0x55c22e9a8360 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4d86ffd640 1 -- 10.20.193.28:0/1933717530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4db00dc510 con 0x55c22e9a8360 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.846+0000 7f4d86ffd640 1 -- 10.20.193.28:0/1933717530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4db00cf460 con 0x55c22e9a8360 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1933717530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 msgr2=0x55c22ea07940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22ea07940 secure :-1 s=READY pgs=640 gs=1 cs=0 l=1 c_cookie=16562545092728493089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db00d16f0 tx=0x7f4db004c040 comp rx=0 tx=0).stop 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1933717530 shutdown_connections 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9edb20 0x55c22ea02db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22ea02870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/1933717530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9a8360 0x55c22ea07940 unknown :-1 s=CLOSED pgs=640 gs=1 cs=0 l=1 c_cookie=16562545092728493089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1933717530 >> 10.20.193.28:0/1933717530 conn(0x55c22e986860 msgr2=0x55c22ea0a240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1933717530 shutdown_connections 2026-02-20T13:21:22.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 -- 10.20.193.28:0/1933717530 wait complete. 2026-02-20T13:21:22.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.847+0000 7f4dc331fe00 1 -- start start 2026-02-20T13:21:22.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dc331fe00 1 Processor -- start 2026-02-20T13:21:22.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8360 0x55c22e9e7770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22e9e7cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dc331fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22e9e8210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c22e91b8f0 con 0x55c22e9edb20 2026-02-20T13:21:22.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c22ea0d4b0 con 0x55c22e9a8c70 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dc331fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c22e8be780 con 0x55c22e9a8360 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dbaffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8360 0x55c22e9e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dbaffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8360 0x55c22e9e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57416/0 (socket says 10.20.193.28:57416) 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dbaffd640 1 -- 10.20.193.28:0/863449271 learned_addr learned my addr 10.20.193.28:0/863449271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dba7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22e9e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22e9e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dbaffd640 1 -- 10.20.193.28:0/863449271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 msgr2=0x55c22e9e7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22e9e7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dbaffd640 1 -- 10.20.193.28:0/863449271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 msgr2=0x55c22e9e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.848+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22e9e8210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4dbaffd640 1 -- 10.20.193.28:0/863449271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22e85fd10 con 0x55c22e9a8360 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4dbb7fe640 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22e9e8210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4dbaffd640 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8360 0x55c22e9e7770 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=3059017049290335605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db0004010 tx=0x7f4db0038f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a73cfcc88d06575 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4d84ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4d84ff9640 1 -- 10.20.193.28:0/863449271 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4db00d0e60 con 0x55c22e9a8360 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4d84ff9640 1 -- 10.20.193.28:0/863449271 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4db00cd6f0 con 0x55c22e9a8360 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c22e84a0e0 con 0x55c22e9a8360 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4d84ff9640 1 -- 10.20.193.28:0/863449271 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4db00d3040 con 0x55c22e9a8360 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4d84ff9640 1 -- 10.20.193.28:0/863449271 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4db00f0110 con 0x55c22e9a8360 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4dc331fe00 10 client.26794 _ll_register_callbacks cb 0x55c22e835a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4db00d70f0 con 0x55c22e9a8360 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.849+0000 7f4d84ff9640 1 -- 10.20.193.28:0/863449271 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4db00cf460 con 0x55c22e9a8360 2026-02-20T13:21:22.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dc331fe00 10 client.26794 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c22e8386f0 con 0x55c22e9a8360 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4d84ff9640 1 -- 10.20.193.28:0/863449271 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4db00dc0f0 con 0x55c22e9a8360 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dc331fe00 10 client.26794 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dc331fe00 10 client.26794 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dc331fe00 20 client.26794 populate_metadata read hostname 'trial028' 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c22e98b6c0 0x55c22e98bb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dc331fe00 4 client.26794 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c22e547f40 con 0x55c22e98b6c0 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.850+0000 7f4dba7fc640 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c22e98b6c0 0x55c22e98bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dba7fc640 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c22e98b6c0 0x55c22e98bb60 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=12467370514537094353 s_cookie=11456477396451942578 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad04ff6d92299cd1 server_cookie=9efd957e38cf60b2 in_seq=0 out_seq=0 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4d84ff9640 10 client.26794 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:21:22.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4d84ff9640 1 -- 10.20.193.28:0/863449271 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c22e547f40 con 0x55c22e98b6c0 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4d84ff9640 10 client.26794 handle_command_reply: tid=0 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 client.26794 shutdown 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8360 msgr2=0x55c22e9e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8360 0x55c22e9e7770 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=3059017049290335605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db0004010 tx=0x7f4db0038f30 comp rx=0 tx=0).stop 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 shutdown_connections 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c22e98b6c0 0x55c22e98bb60 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=12467370514537094353 s_cookie=11456477396451942578 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c22e9edb20 0x55c22e9e8210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c22e9a8c70 0x55c22e9e7cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4d84ff9640 0 client.26794 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 --2- 10.20.193.28:0/863449271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c22e9a8360 0x55c22e9e7770 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=3059017049290335605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 >> 10.20.193.28:0/863449271 conn(0x55c22e986860 msgr2=0x55c22ea08930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 shutdown_connections 2026-02-20T13:21:22.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 1 -- 10.20.193.28:0/863449271 wait complete. 2026-02-20T13:21:22.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.851+0000 7f4dc331fe00 20 client.26794 trim_cache size 0 max 16384 2026-02-20T13:21:22.861 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 -- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 msgr2=0x7f4d900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 secure :-1 s=READY pgs=353 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac006e90 tx=0x7f4dac0083d0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 -- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 msgr2=0x7f4dbc11ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 0x7f4dbc11ddd0 secure :-1 s=READY pgs=639 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4db002f6a0 tx=0x7f4db0004290 comp rx=0 tx=0).stop 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 -- 10.20.193.28:0/3373839211 shutdown_connections 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4d900b5760 0x7f4d900d5c10 unknown :-1 s=CLOSED pgs=353 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4dbc1156a0 0x7f4dbc1236e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4dbc10fea0 0x7f4dbc11e310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 --2- 10.20.193.28:0/3373839211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dbc10f4b0 0x7f4dbc11ddd0 unknown :-1 s=CLOSED pgs=639 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:22.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 -- 10.20.193.28:0/3373839211 >> 10.20.193.28:0/3373839211 conn(0x7f4dbc0ecda0 msgr2=0x7f4dbc10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:22.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 -- 10.20.193.28:0/3373839211 shutdown_connections 2026-02-20T13:21:22.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:22.852+0000 7f4dbbfff640 1 -- 10.20.193.28:0/3373839211 wait complete. 2026-02-20T13:21:22.953 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:21:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:22 trial127 ceph-mon[43817]: pgmap v302: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:21:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:22 trial034 ceph-mon[43332]: pgmap v302: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:21:23.138 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:23.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 -- 10.20.193.28:0/2632952689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faccc10b930 msgr2=0x7faccc10bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 --2- 10.20.193.28:0/2632952689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faccc10b930 0x7faccc10bd00 secure :-1 s=READY pgs=641 gs=2 cs=0 l=1 c_cookie=13546494983394350672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facb8009980 tx=0x7facb802f190 comp rx=0 tx=0).stop 2026-02-20T13:21:23.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 -- 10.20.193.28:0/2632952689 shutdown_connections 2026-02-20T13:21:23.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 --2- 10.20.193.28:0/2632952689 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faccc110f10 0x7faccc1113b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 --2- 10.20.193.28:0/2632952689 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faccc10c320 0x7faccc1108f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 --2- 10.20.193.28:0/2632952689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faccc10b930 0x7faccc10bd00 unknown :-1 s=CLOSED pgs=641 gs=2 cs=0 l=1 c_cookie=13546494983394350672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 -- 10.20.193.28:0/2632952689 >> 10.20.193.28:0/2632952689 conn(0x7faccc0e95c0 msgr2=0x7faccc1099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 -- 10.20.193.28:0/2632952689 shutdown_connections 2026-02-20T13:21:23.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.306+0000 7facd123a640 1 -- 10.20.193.28:0/2632952689 wait complete. 2026-02-20T13:21:23.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.307+0000 7facd123a640 1 Processor -- start 2026-02-20T13:21:23.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.307+0000 7facd123a640 1 -- start start 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.307+0000 7facd123a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faccc10b930 0x7faccc122310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.307+0000 7facd123a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faccc10c320 0x7faccc122850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.307+0000 7facd123a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faccc110f10 0x7faccc127c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.307+0000 7facd123a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faccc128240 con 0x7faccc10c320 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.307+0000 7facd123a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7faccc1283b0 con 0x7faccc10b930 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.307+0000 7facd123a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7faccc128570 con 0x7faccc110f10 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faccc10b930 0x7faccc122310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faccc10b930 0x7faccc122310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42892/0 (socket says 10.20.193.28:42892) 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 -- 10.20.193.28:0/1351428975 learned_addr learned my addr 10.20.193.28:0/1351428975 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7facd0a39640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faccc110f10 0x7faccc127c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccb7fe640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faccc10c320 0x7faccc122850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 -- 10.20.193.28:0/1351428975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faccc110f10 msgr2=0x7faccc127c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faccc110f10 0x7faccc127c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 -- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faccc10c320 msgr2=0x7faccc122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faccc10c320 0x7faccc122850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 -- 10.20.193.28:0/1351428975 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb8009570 con 0x7faccc10b930 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7faccbfff640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faccc10b930 0x7faccc122310 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facb8038820 tx=0x7facb8004290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7facc97fa640 1 -- 10.20.193.28:0/1351428975 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facb803d070 con 0x7faccc10b930 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7facc97fa640 1 -- 10.20.193.28:0/1351428975 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7facb8002ad0 con 0x7faccc10b930 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7facc97fa640 1 -- 10.20.193.28:0/1351428975 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facb8041960 con 0x7faccc10b930 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.308+0000 7facd123a640 1 -- 10.20.193.28:0/1351428975 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faccc128850 con 0x7faccc10b930 2026-02-20T13:21:23.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.309+0000 7facd123a640 1 -- 10.20.193.28:0/1351428975 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faccc168f50 con 0x7faccc10b930 2026-02-20T13:21:23.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.311+0000 7facc97fa640 1 -- 10.20.193.28:0/1351428975 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7facb802f9f0 con 0x7faccc10b930 2026-02-20T13:21:23.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.313+0000 7facc97fa640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faca00b5760 0x7faca00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.313+0000 7facc97fa640 1 -- 10.20.193.28:0/1351428975 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7facb810af70 con 0x7faccc10b930 2026-02-20T13:21:23.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.313+0000 7faccb7fe640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faca00b5760 0x7faca00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7faccb7fe640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faca00b5760 0x7faca00d5c10 secure :-1 s=READY pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faccc128cb0 tx=0x7facbc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7facd44bde00 1 Processor -- start 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7facd44bde00 1 -- start start 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7facd44bde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7c66730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7facd44bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7cab5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7facd44bde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 0x55f9d7ccbf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7facd44bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7b7c780 con 0x55f9d7c66c70 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7facd44bde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7b784b0 con 0x55f9d7cabb20 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.314+0000 7facd44bde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7b72450 con 0x55f9d7c66360 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7cab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7c66730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7c66730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57442/0 (socket says 10.20.193.28:57442) 2026-02-20T13:21:23.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccbfff640 1 -- 10.20.193.28:0/1531957326 learned_addr learned my addr 10.20.193.28:0/1531957326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7facd0a39640 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 0x55f9d7ccbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccb7fe640 1 -- 10.20.193.28:0/1531957326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 msgr2=0x55f9d7c66730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccb7fe640 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7c66730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccb7fe640 1 -- 10.20.193.28:0/1531957326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 msgr2=0x55f9d7ccbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccb7fe640 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 0x55f9d7ccbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccb7fe640 1 -- 10.20.193.28:0/1531957326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d7b1dd10 con 0x55f9d7c66c70 2026-02-20T13:21:23.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccbfff640 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7c66730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:23.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7faccb7fe640 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7cab5e0 secure :-1 s=READY pgs=642 gs=3 cs=0 l=1 c_cookie=951815825152102257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facbc009bb0 tx=0x7facbc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35877335c94f71 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7fac9cce3640 1 -- 10.20.193.28:0/1531957326 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facbc011e60 con 0x55f9d7c66c70 2026-02-20T13:21:23.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7fac9cce3640 1 -- 10.20.193.28:0/1531957326 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7facbc0198e0 con 0x55f9d7c66c70 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.315+0000 7fac9cce3640 1 -- 10.20.193.28:0/1531957326 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facbc01ba50 con 0x55f9d7c66c70 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 -- 10.20.193.28:0/1531957326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 msgr2=0x55f9d7cab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7cab5e0 secure :-1 s=READY pgs=642 gs=3 cs=0 l=1 c_cookie=951815825152102257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facbc009bb0 tx=0x7facbc014000 comp rx=0 tx=0).stop 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 -- 10.20.193.28:0/1531957326 shutdown_connections 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7cab5e0 unknown :-1 s=CLOSED pgs=642 gs=3 cs=0 l=1 c_cookie=951815825152102257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 0x55f9d7ccbf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 --2- 10.20.193.28:0/1531957326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7c66730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 -- 10.20.193.28:0/1531957326 >> 10.20.193.28:0/1531957326 conn(0x55f9d7c44860 msgr2=0x55f9d7c64c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 -- 10.20.193.28:0/1531957326 shutdown_connections 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.316+0000 7facd44bde00 1 -- 10.20.193.28:0/1531957326 wait complete. 2026-02-20T13:21:23.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.317+0000 7facd44bde00 1 -- start start 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.317+0000 7facd44bde00 1 Processor -- start 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.317+0000 7facd44bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc3750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.317+0000 7facd44bde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc3c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.317+0000 7facd44bde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 0x55f9d7cc5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.317+0000 7facd44bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7cc5f90 con 0x55f9d7c66360 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.317+0000 7facd44bde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7cc6100 con 0x55f9d7c66c70 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.317+0000 7facd44bde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7cc62c0 con 0x55f9d7cabb20 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc3750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc3750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37888/0 (socket says 10.20.193.28:37888) 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 -- 10.20.193.28:0/2460299503 learned_addr learned my addr 10.20.193.28:0/2460299503 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7facd0a39640 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 0x55f9d7cc5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccb7fe640 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 -- 10.20.193.28:0/2460299503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 msgr2=0x55f9d7cc5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 0x55f9d7cc5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 -- 10.20.193.28:0/2460299503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 msgr2=0x55f9d7cc3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 -- 10.20.193.28:0/2460299503 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facbc0098a0 con 0x55f9d7c66360 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7faccbfff640 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc3750 secure :-1 s=READY pgs=643 gs=1 cs=0 l=1 c_cookie=11047738966541426816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facb80ce5f0 tx=0x7facb8038f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9951740e7ff16080 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7fac8dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7fac8dffb640 1 -- 10.20.193.28:0/2460299503 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facb80dc1a0 con 0x55f9d7c66360 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faccc168f50 con 0x55f9d7c66360 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7facd44bde00 10 client.16887 _ll_register_callbacks cb 0x55f9d7af3a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:23.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9d78086f0 con 0x55f9d7c66360 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7fac8dffb640 1 -- 10.20.193.28:0/2460299503 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7facb80d95d0 con 0x55f9d7c66360 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7fac8dffb640 1 -- 10.20.193.28:0/2460299503 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facb80d2cc0 con 0x55f9d7c66360 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.318+0000 7fac8dffb640 1 -- 10.20.193.28:0/2460299503 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7facb80d2e50 con 0x55f9d7c66360 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7fac8dffb640 1 -- 10.20.193.28:0/2460299503 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7facb80ea060 con 0x55f9d7c66360 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7facd44bde00 10 client.16887 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f9d7af63c0 con 0x55f9d7c66360 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7fac8dffb640 1 -- 10.20.193.28:0/2460299503 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7facb80cbb70 con 0x55f9d7c66360 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7facd44bde00 10 client.16887 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7facd44bde00 10 client.16887 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7facd44bde00 20 client.16887 populate_metadata read hostname 'trial028' 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7facd44bde00 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55f9d7ccba80 0x55f9d7ca98a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7facd44bde00 4 client.16887 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9d7b14f80 con 0x55f9d7ccba80 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.319+0000 7faccb7fe640 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55f9d7ccba80 0x55f9d7ca98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7faccb7fe640 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55f9d7ccba80 0x55f9d7ca98a0 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=1651981978737578782 s_cookie=3667238978152699577 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=16ed04db6a00131e server_cookie=32e4a66bb74216b9 in_seq=0 out_seq=0 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7fac8dffb640 10 client.16887 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7fac8dffb640 1 -- 10.20.193.28:0/2460299503 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f9d7b14f80 con 0x55f9d7ccba80 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7fac8dffb640 10 client.16887 handle_command_reply: tid=0 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 client.16887 shutdown 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 msgr2=0x55f9d7cc3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc3750 secure :-1 s=READY pgs=643 gs=1 cs=0 l=1 c_cookie=11047738966541426816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facb80ce5f0 tx=0x7facb8038f10 comp rx=0 tx=0).stop 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 shutdown_connections 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55f9d7ccba80 0x55f9d7ca98a0 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=1651981978737578782 s_cookie=3667238978152699577 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 0x55f9d7cc5a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc3c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 --2- 10.20.193.28:0/2460299503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc3750 unknown :-1 s=CLOSED pgs=643 gs=1 cs=0 l=1 c_cookie=11047738966541426816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 >> 10.20.193.28:0/2460299503 conn(0x55f9d7c44860 msgr2=0x55f9d7c64c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7fac8dffb640 0 client.16887 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:21:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 shutdown_connections 2026-02-20T13:21:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 1 -- 10.20.193.28:0/2460299503 wait complete. 2026-02-20T13:21:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.320+0000 7facd44bde00 20 client.16887 trim_cache size 0 max 16384 2026-02-20T13:21:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.327+0000 7facd44bde00 1 Processor -- start 2026-02-20T13:21:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.327+0000 7facd44bde00 1 -- start start 2026-02-20T13:21:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.327+0000 7facd44bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc8590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.327+0000 7facd44bde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc59b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7facd44bde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 0x55f9d7cc08e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7facd44bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7b70080 con 0x55f9d7c66360 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7facd44bde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7830700 con 0x55f9d7c66c70 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7facd44bde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7cb0bf0 con 0x55f9d7cabb20 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42934/0 (socket says 10.20.193.28:42934) 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 -- 10.20.193.28:0/797484950 learned_addr learned my addr 10.20.193.28:0/797484950 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccbfff640 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc8590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7facd0a39640 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 0x55f9d7cc08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 -- 10.20.193.28:0/797484950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 msgr2=0x55f9d7cc08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 0x55f9d7cc08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 -- 10.20.193.28:0/797484950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 msgr2=0x55f9d7cc8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc8590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 -- 10.20.193.28:0/797484950 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d7b080e0 con 0x55f9d7c66c70 2026-02-20T13:21:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.328+0000 7faccb7fe640 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc59b0 secure :-1 s=READY pgs=263 gs=2 cs=0 l=1 c_cookie=7256094348681126160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facbc011cb0 tx=0x7facbc00e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64b2d35d9ddba110 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7fac8ffff640 1 -- 10.20.193.28:0/797484950 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facbc0196a0 con 0x55f9d7c66c70 2026-02-20T13:21:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7fac8ffff640 1 -- 10.20.193.28:0/797484950 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7facbc02d040 con 0x55f9d7c66c70 2026-02-20T13:21:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7fac8ffff640 1 -- 10.20.193.28:0/797484950 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facbc004720 con 0x55f9d7c66c70 2026-02-20T13:21:23.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 -- 10.20.193.28:0/797484950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 msgr2=0x55f9d7cc59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc59b0 secure :-1 s=READY pgs=263 gs=2 cs=0 l=1 c_cookie=7256094348681126160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facbc011cb0 tx=0x7facbc00e000 comp rx=0 tx=0).stop 2026-02-20T13:21:23.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 -- 10.20.193.28:0/797484950 shutdown_connections 2026-02-20T13:21:23.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7cabb20 0x55f9d7cc08e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7c66c70 0x55f9d7cc59b0 unknown :-1 s=CLOSED pgs=263 gs=2 cs=0 l=1 c_cookie=7256094348681126160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 --2- 10.20.193.28:0/797484950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66360 0x55f9d7cc8590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 -- 10.20.193.28:0/797484950 >> 10.20.193.28:0/797484950 conn(0x55f9d7c44860 msgr2=0x55f9d7cc71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 -- 10.20.193.28:0/797484950 shutdown_connections 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.329+0000 7facd44bde00 1 -- 10.20.193.28:0/797484950 wait complete. 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd44bde00 1 -- start start 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd44bde00 1 Processor -- start 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd44bde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7ca5920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd44bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7ca5e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd44bde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 0x55f9d7ca65f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd44bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7ca6cf0 con 0x55f9d7c66c70 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd44bde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7ca6e60 con 0x55f9d7cabb20 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd44bde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f9d7ca7020 con 0x55f9d7c66360 2026-02-20T13:21:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7faccb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7ca5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7faccb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7ca5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37902/0 (socket says 10.20.193.28:37902) 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7faccb7fe640 1 -- 10.20.193.28:0/3795829336 learned_addr learned my addr 10.20.193.28:0/3795829336 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7facd0a39640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 0x55f9d7ca65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.330+0000 7faccbfff640 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7ca5920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7faccb7fe640 1 -- 10.20.193.28:0/3795829336 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 msgr2=0x55f9d7ca5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7faccb7fe640 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7ca5920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7faccb7fe640 1 -- 10.20.193.28:0/3795829336 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 msgr2=0x55f9d7ca65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7faccb7fe640 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 0x55f9d7ca65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7faccb7fe640 1 -- 10.20.193.28:0/3795829336 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d7b02b60 con 0x55f9d7c66c70 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7faccb7fe640 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7ca5e60 secure :-1 s=READY pgs=644 gs=1 cs=0 l=1 c_cookie=13691336179431447970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facbc0092b0 tx=0x7facbc005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0165b723771da2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7fac8dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:23.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7fac8dffb640 1 -- 10.20.193.28:0/3795829336 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facbc004720 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7fac8dffb640 1 -- 10.20.193.28:0/3795829336 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7facbc009ed0 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7fac8dffb640 1 -- 10.20.193.28:0/3795829336 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facbc01b500 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d7b1dd10 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7fac8dffb640 1 -- 10.20.193.28:0/3795829336 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7facbc01b6d0 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7facd44bde00 10 client.16893 _ll_register_callbacks cb 0x55f9d7af3a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.331+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facbc0198e0 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7fac8dffb640 1 -- 10.20.193.28:0/3795829336 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7facbc019620 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7facd44bde00 10 client.16893 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f9d7af66f0 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7fac8dffb640 1 -- 10.20.193.28:0/3795829336 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7facbc0048b0 con 0x55f9d7c66c70 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7facd44bde00 10 client.16893 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:23.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7facd44bde00 10 client.16893 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7facd44bde00 20 client.16893 populate_metadata read hostname 'trial028' 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7facd44bde00 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55f9d7c49d60 0x55f9d7c4a200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7facd44bde00 4 client.16893 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f9d7805f40 con 0x55f9d7c49d60 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7faccbfff640 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55f9d7c49d60 0x55f9d7c4a200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7fac8dffb640 10 client.16893 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.332+0000 7faccbfff640 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55f9d7c49d60 0x55f9d7c4a200 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=3881172623251077612 s_cookie=13979686509187086238 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35dcb1f000d9f9ec server_cookie=c201d2d0036ab79e in_seq=0 out_seq=0 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7fac8dffb640 1 -- 10.20.193.28:0/3795829336 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9d7805f40 con 0x55f9d7c49d60 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7fac8dffb640 10 client.16893 handle_command_reply: tid=0 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 client.16893 shutdown 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 msgr2=0x55f9d7ca5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7ca5e60 secure :-1 s=READY pgs=644 gs=1 cs=0 l=1 c_cookie=13691336179431447970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facbc0092b0 tx=0x7facbc005410 comp rx=0 tx=0).stop 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 shutdown_connections 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55f9d7c49d60 0x55f9d7c4a200 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=3881172623251077612 s_cookie=13979686509187086238 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9d7c66c70 0x55f9d7ca5e60 unknown :-1 s=CLOSED pgs=644 gs=1 cs=0 l=1 c_cookie=13691336179431447970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f9d7cabb20 0x55f9d7ca65f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 --2- 10.20.193.28:0/3795829336 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f9d7c66360 0x55f9d7ca5920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7fac8dffb640 0 client.16893 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 >> 10.20.193.28:0/3795829336 conn(0x55f9d7c44860 msgr2=0x55f9d7cc69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 shutdown_connections 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 1 -- 10.20.193.28:0/3795829336 wait complete. 2026-02-20T13:21:23.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.333+0000 7facd44bde00 20 client.16893 trim_cache size 0 max 16384 2026-02-20T13:21:23.343 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:23.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 -- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faca00b5760 msgr2=0x7faca00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faca00b5760 0x7faca00d5c10 secure :-1 s=READY pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faccc128cb0 tx=0x7facbc005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 -- 10.20.193.28:0/1351428975 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faccc10b930 msgr2=0x7faccc122310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faccc10b930 0x7faccc122310 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facb8038820 tx=0x7facb8004290 comp rx=0 tx=0).stop 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 -- 10.20.193.28:0/1351428975 shutdown_connections 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faca00b5760 0x7faca00d5c10 unknown :-1 s=CLOSED pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faccc10c320 0x7faccc122850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faccc110f10 0x7faccc127c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 --2- 10.20.193.28:0/1351428975 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faccc10b930 0x7faccc122310 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 -- 10.20.193.28:0/1351428975 >> 10.20.193.28:0/1351428975 conn(0x7faccc0e95c0 msgr2=0x7faccc1099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 -- 10.20.193.28:0/1351428975 shutdown_connections 2026-02-20T13:21:23.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.334+0000 7facd123a640 1 -- 10.20.193.28:0/1351428975 wait complete. 2026-02-20T13:21:23.434 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:21:23.619 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 -- 10.20.193.28:0/1236274609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c1157e0 msgr2=0x7ff07c1761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 --2- 10.20.193.28:0/1236274609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c1157e0 0x7ff07c1761b0 secure :-1 s=READY pgs=645 gs=1 cs=0 l=1 c_cookie=5639008354651759193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff07800aa30 tx=0x7ff078030270 comp rx=0 tx=0).stop 2026-02-20T13:21:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 -- 10.20.193.28:0/1236274609 shutdown_connections 2026-02-20T13:21:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 --2- 10.20.193.28:0/1236274609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c1157e0 0x7ff07c1761b0 unknown :-1 s=CLOSED pgs=645 gs=1 cs=0 l=1 c_cookie=5639008354651759193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 --2- 10.20.193.28:0/1236274609 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff07c10ffe0 0x7ff07c115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 --2- 10.20.193.28:0/1236274609 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff07c10f5f0 0x7ff07c10f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 -- 10.20.193.28:0/1236274609 >> 10.20.193.28:0/1236274609 conn(0x7ff07c0ecea0 msgr2=0x7ff07c10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 -- 10.20.193.28:0/1236274609 shutdown_connections 2026-02-20T13:21:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.786+0000 7ff0831eb640 1 -- 10.20.193.28:0/1236274609 wait complete. 2026-02-20T13:21:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.787+0000 7ff0831eb640 1 Processor -- start 2026-02-20T13:21:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.787+0000 7ff0831eb640 1 -- start start 2026-02-20T13:21:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff0831eb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff07c10f5f0 0x7ff07c11d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff0831eb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c10ffe0 0x7ff07c11da10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff0831eb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff07c1157e0 0x7ff07c122de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff0831eb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c123400 con 0x7ff07c10ffe0 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff0831eb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c123570 con 0x7ff07c1157e0 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff0831eb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c123730 con 0x7ff07c10f5f0 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c10ffe0 0x7ff07c11da10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff080f60640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff07c10f5f0 0x7ff07c11d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c10ffe0 0x7ff07c11da10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37922/0 (socket says 10.20.193.28:37922) 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 -- 10.20.193.28:0/3600276132 learned_addr learned my addr 10.20.193.28:0/3600276132 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff081761640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff07c1157e0 0x7ff07c122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 -- 10.20.193.28:0/3600276132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff07c10f5f0 msgr2=0x7ff07c11d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff07c10f5f0 0x7ff07c11d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 -- 10.20.193.28:0/3600276132 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff07c1157e0 msgr2=0x7ff07c122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff07c1157e0 0x7ff07c122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 -- 10.20.193.28:0/3600276132 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07800a650 con 0x7ff07c10ffe0 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff073fff640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c10ffe0 0x7ff07c11da10 secure :-1 s=READY pgs=646 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff064005db0 tx=0x7ff06400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.788+0000 7ff071ffb640 1 -- 10.20.193.28:0/3600276132 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff064004500 con 0x7ff07c10ffe0 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.789+0000 7ff071ffb640 1 -- 10.20.193.28:0/3600276132 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff064004d30 con 0x7ff07c10ffe0 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.789+0000 7ff071ffb640 1 -- 10.20.193.28:0/3600276132 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0640053c0 con 0x7ff07c10ffe0 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.789+0000 7ff0831eb640 1 -- 10.20.193.28:0/3600276132 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07c123a10 con 0x7ff07c10ffe0 2026-02-20T13:21:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.789+0000 7ff0831eb640 1 -- 10.20.193.28:0/3600276132 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07c164110 con 0x7ff07c10ffe0 2026-02-20T13:21:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.791+0000 7ff071ffb640 1 -- 10.20.193.28:0/3600276132 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff064009940 con 0x7ff07c10ffe0 2026-02-20T13:21:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.793+0000 7ff071ffb640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0580b5760 0x7ff0580d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.793+0000 7ff071ffb640 1 -- 10.20.193.28:0/3600276132 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff0640e67f0 con 0x7ff07c10ffe0 2026-02-20T13:21:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.794+0000 7ff080f60640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0580b5760 0x7ff0580d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.794+0000 7ff080f60640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0580b5760 0x7ff0580d5c10 secure :-1 s=READY pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c004740 tx=0x7ff06c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.794+0000 7ff0851e5e00 1 Processor -- start 2026-02-20T13:21:23.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.794+0000 7ff0851e5e00 1 -- start start 2026-02-20T13:21:23.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae9595730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae9595c70 0x564ae95da5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae95dab20 0x564ae95faf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ae94ab780 con 0x564ae9595360 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564ae94a74b0 con 0x564ae95dab20 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564ae94a1450 con 0x564ae9595c70 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff080f60640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae9595730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff080f60640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae9595730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37936/0 (socket says 10.20.193.28:37936) 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff080f60640 1 -- 10.20.193.28:0/146131649 learned_addr learned my addr 10.20.193.28:0/146131649 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff073fff640 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae9595c70 0x564ae95da5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff081761640 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae95dab20 0x564ae95faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff080f60640 1 -- 10.20.193.28:0/146131649 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae9595c70 msgr2=0x564ae95da5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff080f60640 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae9595c70 0x564ae95da5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff080f60640 1 -- 10.20.193.28:0/146131649 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae95dab20 msgr2=0x564ae95faf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff080f60640 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae95dab20 0x564ae95faf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.795+0000 7ff080f60640 1 -- 10.20.193.28:0/146131649 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae944cd10 con 0x564ae9595360 2026-02-20T13:21:23.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff080f60640 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae9595730 secure :-1 s=READY pgs=647 gs=1 cs=0 l=1 c_cookie=4496149048781158127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c005db0 tx=0x7ff06c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6587bcfdcfb6ef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0494e4640 1 -- 10.20.193.28:0/146131649 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c01e640 con 0x564ae9595360 2026-02-20T13:21:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0494e4640 1 -- 10.20.193.28:0/146131649 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff06c015070 con 0x564ae9595360 2026-02-20T13:21:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0494e4640 1 -- 10.20.193.28:0/146131649 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c026d50 con 0x564ae9595360 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 -- 10.20.193.28:0/146131649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 msgr2=0x564ae9595730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae9595730 secure :-1 s=READY pgs=647 gs=1 cs=0 l=1 c_cookie=4496149048781158127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c005db0 tx=0x7ff06c013000 comp rx=0 tx=0).stop 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 -- 10.20.193.28:0/146131649 shutdown_connections 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae95dab20 0x564ae95faf00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae9595c70 0x564ae95da5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/146131649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae9595730 unknown :-1 s=CLOSED pgs=647 gs=1 cs=0 l=1 c_cookie=4496149048781158127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 -- 10.20.193.28:0/146131649 >> 10.20.193.28:0/146131649 conn(0x564ae9573860 msgr2=0x564ae9593c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 -- 10.20.193.28:0/146131649 shutdown_connections 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.796+0000 7ff0851e5e00 1 -- 10.20.193.28:0/146131649 wait complete. 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff0851e5e00 1 -- start start 2026-02-20T13:21:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff0851e5e00 1 Processor -- start 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f2770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95f2cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae95f4a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ae95f4fb0 con 0x564ae9595360 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564ae95f5120 con 0x564ae9595c70 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564ae95f52e0 con 0x564ae95dab20 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.798+0000 7ff080f60640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff080f60640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37950/0 (socket says 10.20.193.28:37950) 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff080f60640 1 -- 10.20.193.28:0/4134096306 learned_addr learned my addr 10.20.193.28:0/4134096306 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff081761640 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae95f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff073fff640 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff080f60640 1 -- 10.20.193.28:0/4134096306 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 msgr2=0x564ae95f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff080f60640 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae95f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff080f60640 1 -- 10.20.193.28:0/4134096306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 msgr2=0x564ae95f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff080f60640 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95f2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff080f60640 1 -- 10.20.193.28:0/4134096306 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae94253c0 con 0x564ae9595360 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff080f60640 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f2770 secure :-1 s=READY pgs=648 gs=1 cs=0 l=1 c_cookie=8721050832933040746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c011010 tx=0x7ff06c026660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79076586c519326a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff03a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff03a7fc640 1 -- 10.20.193.28:0/4134096306 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c005040 con 0x564ae9595360 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff03a7fc640 1 -- 10.20.193.28:0/4134096306 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff06c02b050 con 0x564ae9595360 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.799+0000 7ff03a7fc640 1 -- 10.20.193.28:0/4134096306 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c01e420 con 0x564ae9595360 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c00bd10 con 0x564ae9595360 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 10 client.16905 _ll_register_callbacks cb 0x564ae9422a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:23.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564ae91376f0 con 0x564ae9595360 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff03a7fc640 1 -- 10.20.193.28:0/4134096306 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff06c017070 con 0x564ae9595360 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff03a7fc640 1 -- 10.20.193.28:0/4134096306 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff06c004890 con 0x564ae9595360 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 10 client.16905 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564ae94370e0 con 0x564ae9595360 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff03a7fc640 1 -- 10.20.193.28:0/4134096306 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff06c024020 con 0x564ae9595360 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 10 client.16905 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 20 client.16905 populate_metadata read hostname 'trial028' 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564ae95fabd0 0x564ae95d88a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 4 client.16905 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.800+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ae9443f80 con 0x564ae95fabd0 2026-02-20T13:21:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.801+0000 7ff073fff640 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564ae95fabd0 0x564ae95d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.801+0000 7ff073fff640 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564ae95fabd0 0x564ae95d88a0 crc :-1 s=READY pgs=138 gs=4 cs=0 l=0 c_cookie=5309097648344216349 s_cookie=2066627185954440278 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49adb42eaf6b331d server_cookie=1cae2279e5fac456 in_seq=0 out_seq=0 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.801+0000 7ff03a7fc640 10 client.16905 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff03a7fc640 1 -- 10.20.193.28:0/4134096306 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564ae9443f80 con 0x564ae95fabd0 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff03a7fc640 10 client.16905 handle_command_reply: tid=0 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 client.16905 shutdown 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 msgr2=0x564ae95f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f2770 secure :-1 s=READY pgs=648 gs=1 cs=0 l=1 c_cookie=8721050832933040746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c011010 tx=0x7ff06c026660 comp rx=0 tx=0).stop 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 shutdown_connections 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564ae95fabd0 0x564ae95d88a0 crc :-1 s=READY pgs=138 gs=4 cs=0 l=0 c_cookie=5309097648344216349 s_cookie=2066627185954440278 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae95f4a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95f2cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4134096306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f2770 unknown :-1 s=CLOSED pgs=648 gs=1 cs=0 l=1 c_cookie=8721050832933040746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff03a7fc640 0 client.16905 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:23.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 >> 10.20.193.28:0/4134096306 conn(0x564ae9573860 msgr2=0x564ae9593c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 shutdown_connections 2026-02-20T13:21:23.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4134096306 wait complete. 2026-02-20T13:21:23.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.802+0000 7ff0851e5e00 20 client.16905 trim_cache size 0 max 16384 2026-02-20T13:21:23.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff0851e5e00 1 Processor -- start 2026-02-20T13:21:23.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff0851e5e00 1 -- start start 2026-02-20T13:21:23.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95ef900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae95efe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ae949f080 con 0x564ae9595360 2026-02-20T13:21:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564ae915f700 con 0x564ae9595c70 2026-02-20T13:21:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564ae95f8cd0 con 0x564ae95dab20 2026-02-20T13:21:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff073fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff080f60640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.810+0000 7ff073fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95ef900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42984/0 (socket says 10.20.193.28:42984) 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff073fff640 1 -- 10.20.193.28:0/4276046727 learned_addr learned my addr 10.20.193.28:0/4276046727 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff081761640 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae95efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff080f60640 1 -- 10.20.193.28:0/4276046727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 msgr2=0x564ae95efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff080f60640 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae95efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff080f60640 1 -- 10.20.193.28:0/4276046727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 msgr2=0x564ae95ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff080f60640 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff080f60640 1 -- 10.20.193.28:0/4276046727 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9431b60 con 0x564ae9595360 2026-02-20T13:21:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff073fff640 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95ef900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff080f60640 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f49d0 secure :-1 s=READY pgs=649 gs=1 cs=0 l=1 c_cookie=17226722454460170654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c0047c0 tx=0x7ff06c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef119ccd1e58019e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff048ce3640 1 -- 10.20.193.28:0/4276046727 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c026b50 con 0x564ae9595360 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff048ce3640 1 -- 10.20.193.28:0/4276046727 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff06c02b070 con 0x564ae9595360 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff048ce3640 1 -- 10.20.193.28:0/4276046727 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c01de70 con 0x564ae9595360 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4276046727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 msgr2=0x564ae95f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f49d0 secure :-1 s=READY pgs=649 gs=1 cs=0 l=1 c_cookie=17226722454460170654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c0047c0 tx=0x7ff06c013000 comp rx=0 tx=0).stop 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4276046727 shutdown_connections 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae95efe40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595c70 0x564ae95ef900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/4276046727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595360 0x564ae95f49d0 unknown :-1 s=CLOSED pgs=649 gs=1 cs=0 l=1 c_cookie=17226722454460170654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4276046727 >> 10.20.193.28:0/4276046727 conn(0x564ae9573860 msgr2=0x564ae95f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.811+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4276046727 shutdown_connections 2026-02-20T13:21:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.812+0000 7ff0851e5e00 1 -- 10.20.193.28:0/4276046727 wait complete. 2026-02-20T13:21:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.812+0000 7ff0851e5e00 1 -- start start 2026-02-20T13:21:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.812+0000 7ff0851e5e00 1 Processor -- start 2026-02-20T13:21:23.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595360 0x564ae9578ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595c70 0x564ae95793e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff0851e5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae9577c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ae949f080 con 0x564ae9595c70 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564ae95799a0 con 0x564ae9595360 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff0851e5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564ae9579b60 con 0x564ae95dab20 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff080f60640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595360 0x564ae9578ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff080f60640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595360 0x564ae9578ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42994/0 (socket says 10.20.193.28:42994) 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff080f60640 1 -- 10.20.193.28:0/3932063416 learned_addr learned my addr 10.20.193.28:0/3932063416 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff073fff640 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595c70 0x564ae95793e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff081761640 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae9577c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff080f60640 1 -- 10.20.193.28:0/3932063416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 msgr2=0x564ae9577c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff080f60640 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae9577c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff080f60640 1 -- 10.20.193.28:0/3932063416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595c70 msgr2=0x564ae95793e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff080f60640 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595c70 0x564ae95793e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff080f60640 1 -- 10.20.193.28:0/3932063416 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae94370e0 con 0x564ae9595360 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.813+0000 7ff081761640 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae9577c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff080f60640 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595360 0x564ae9578ea0 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=17047652008180571676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c005d80 tx=0x7ff06c026800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec956d2dda13de1c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff03a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff03a7fc640 1 -- 10.20.193.28:0/3932063416 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c039400 con 0x564ae9595360 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff03a7fc640 1 -- 10.20.193.28:0/3932063416 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff06c03d030 con 0x564ae9595360 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff03a7fc640 1 -- 10.20.193.28:0/3932063416 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c0383a0 con 0x564ae9595360 2026-02-20T13:21:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07c164110 con 0x564ae9595360 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff03a7fc640 1 -- 10.20.193.28:0/3932063416 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff06c017070 con 0x564ae9595360 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff03a7fc640 10 client.26894 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff0851e5e00 10 client.26894 _ll_register_callbacks cb 0x564ae9422a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff06c015070 con 0x564ae9595360 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff03a7fc640 1 -- 10.20.193.28:0/3932063416 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff06c039560 con 0x564ae9595360 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff0851e5e00 10 client.26894 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.814+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564ae94256f0 con 0x564ae9595360 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff03a7fc640 1 -- 10.20.193.28:0/3932063416 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff06c024050 con 0x564ae9595360 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff0851e5e00 10 client.26894 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff0851e5e00 10 client.26894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff0851e5e00 20 client.26894 populate_metadata read hostname 'trial028' 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564ae9688920 0x564ae96a8dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff0851e5e00 4 client.26894 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ae9134f40 con 0x564ae9688920 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff073fff640 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564ae9688920 0x564ae96a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff073fff640 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564ae9688920 0x564ae96a8dd0 crc :-1 s=READY pgs=139 gs=4 cs=0 l=0 c_cookie=12943697402304050537 s_cookie=18015182850803603428 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3a14035707ab569 server_cookie=fa02c95ab1db97e4 in_seq=0 out_seq=0 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.815+0000 7ff03a7fc640 10 client.26894 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff03a7fc640 1 -- 10.20.193.28:0/3932063416 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ae9134f40 con 0x564ae9688920 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff03a7fc640 10 client.26894 handle_command_reply: tid=0 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 client.26894 shutdown 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595360 msgr2=0x564ae9578ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595360 0x564ae9578ea0 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=17047652008180571676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c005d80 tx=0x7ff06c026800 comp rx=0 tx=0).stop 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 shutdown_connections 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564ae9688920 0x564ae96a8dd0 crc :-1 s=READY pgs=139 gs=4 cs=0 l=0 c_cookie=12943697402304050537 s_cookie=18015182850803603428 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ae9595c70 0x564ae95793e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ae95dab20 0x564ae9577c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 --2- 10.20.193.28:0/3932063416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ae9595360 0x564ae9578ea0 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=17047652008180571676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff03a7fc640 0 client.26894 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 >> 10.20.193.28:0/3932063416 conn(0x564ae9573860 msgr2=0x564ae9594050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 shutdown_connections 2026-02-20T13:21:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 1 -- 10.20.193.28:0/3932063416 wait complete. 2026-02-20T13:21:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0851e5e00 20 client.26894 trim_cache size 0 max 16384 2026-02-20T13:21:23.826 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:23.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0831eb640 1 -- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0580b5760 msgr2=0x7ff0580d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0831eb640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0580b5760 0x7ff0580d5c10 secure :-1 s=READY pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c004740 tx=0x7ff06c00b410 comp rx=0 tx=0).stop 2026-02-20T13:21:23.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0831eb640 1 -- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c10ffe0 msgr2=0x7ff07c11da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.816+0000 7ff0831eb640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c10ffe0 0x7ff07c11da10 secure :-1 s=READY pgs=646 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff064005db0 tx=0x7ff06400ddf0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.817+0000 7ff0831eb640 1 -- 10.20.193.28:0/3600276132 shutdown_connections 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.817+0000 7ff0831eb640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0580b5760 0x7ff0580d5c10 unknown :-1 s=CLOSED pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.817+0000 7ff0831eb640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff07c10ffe0 0x7ff07c11da10 unknown :-1 s=CLOSED pgs=646 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.817+0000 7ff0831eb640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff07c1157e0 0x7ff07c122de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.817+0000 7ff0831eb640 1 --2- 10.20.193.28:0/3600276132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff07c10f5f0 0x7ff07c11d4d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.817+0000 7ff0831eb640 1 -- 10.20.193.28:0/3600276132 >> 10.20.193.28:0/3600276132 conn(0x7ff07c0ecea0 msgr2=0x7ff07c10d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.817+0000 7ff0831eb640 1 -- 10.20.193.28:0/3600276132 shutdown_connections 2026-02-20T13:21:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:23.817+0000 7ff0831eb640 1 -- 10.20.193.28:0/3600276132 wait complete. 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 -- 10.20.193.28:0/2148226810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47a010f2f0 msgr2=0x7f47a0171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/2148226810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47a010f2f0 0x7f47a0171080 secure :-1 s=READY pgs=650 gs=1 cs=0 l=1 c_cookie=11706605338459969408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479c00aa60 tx=0x7f479c0302b0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 -- 10.20.193.28:0/2148226810 shutdown_connections 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/2148226810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47a010f2f0 0x7f47a0171080 unknown :-1 s=CLOSED pgs=650 gs=1 cs=0 l=1 c_cookie=11706605338459969408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/2148226810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47a010e940 0x7f47a010edb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/2148226810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f47a01100b0 0x7f47a01104a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 -- 10.20.193.28:0/2148226810 >> 10.20.193.28:0/2148226810 conn(0x7f47a00ec320 msgr2=0x7f47a010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 -- 10.20.193.28:0/2148226810 shutdown_connections 2026-02-20T13:21:24.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 -- 10.20.193.28:0/2148226810 wait complete. 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.276+0000 7f47a5ec3640 1 Processor -- start 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a5ec3640 1 -- start start 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a5ec3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f47a010e940 0x7f47a00f81e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a5ec3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47a010f2f0 0x7f47a0171060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a5ec3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47a01100b0 0x7f47a00f8a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a5ec3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00f9680 con 0x7f47a010f2f0 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a5ec3640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00f97f0 con 0x7f47a01100b0 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a5ec3640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00f99b0 con 0x7f47a010e940 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f4797fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47a010f2f0 0x7f47a0171060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f47a010e940 0x7f47a00f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a56c2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47a01100b0 0x7f47a00f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f47a010e940 0x7f47a00f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57546/0 (socket says 10.20.193.28:57546) 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a4ec1640 1 -- 10.20.193.28:0/825549612 learned_addr learned my addr 10.20.193.28:0/825549612 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a56c2640 1 -- 10.20.193.28:0/825549612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f47a010e940 msgr2=0x7f47a00f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a56c2640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f47a010e940 0x7f47a00f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a56c2640 1 -- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47a010f2f0 msgr2=0x7f47a0171060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a56c2640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47a010f2f0 0x7f47a0171060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.277+0000 7f47a56c2640 1 -- 10.20.193.28:0/825549612 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c00a650 con 0x7f47a01100b0 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.278+0000 7f47a56c2640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47a01100b0 0x7f47a00f8a20 secure :-1 s=READY pgs=265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479c00a230 tx=0x7f479c0039b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.278+0000 7f4795ffb640 1 -- 10.20.193.28:0/825549612 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f479c03e070 con 0x7f47a01100b0 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.278+0000 7f4795ffb640 1 -- 10.20.193.28:0/825549612 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f479c006eb0 con 0x7f47a01100b0 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.278+0000 7f47a5ec3640 1 -- 10.20.193.28:0/825549612 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a00f9c30 con 0x7f47a01100b0 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.278+0000 7f4795ffb640 1 -- 10.20.193.28:0/825549612 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f479c042960 con 0x7f47a01100b0 2026-02-20T13:21:24.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.278+0000 7f47a5ec3640 1 -- 10.20.193.28:0/825549612 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a00fa050 con 0x7f47a01100b0 2026-02-20T13:21:24.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.280+0000 7f4795ffb640 1 -- 10.20.193.28:0/825549612 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f479c0050c0 con 0x7f47a01100b0 2026-02-20T13:21:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.282+0000 7f4795ffb640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f477c0b56e0 0x7f477c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.282+0000 7f4795ffb640 1 -- 10.20.193.28:0/825549612 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f479c10c480 con 0x7f47a01100b0 2026-02-20T13:21:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.282+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f477c0b56e0 0x7f477c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.283+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f477c0b56e0 0x7f477c0d5b90 secure :-1 s=READY pgs=356 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47900095b0 tx=0x7f4790005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.283+0000 7f47a9841e00 1 Processor -- start 2026-02-20T13:21:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.283+0000 7f47a9841e00 1 -- start start 2026-02-20T13:21:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012b34c0 0x5608012d38a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012d3de0 0x5608012f41c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x560801314ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a9841e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5608011c8fd0 con 0x5608012f4700 2026-02-20T13:21:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a9841e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5608011c4d00 con 0x5608012d3de0 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a9841e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5608011beca0 con 0x5608012b34c0 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012b34c0 0x5608012d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012b34c0 0x5608012d38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57550/0 (socket says 10.20.193.28:57550) 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 -- 10.20.193.28:0/3051523001 learned_addr learned my addr 10.20.193.28:0/3051523001 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f4797fff640 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012d3de0 0x5608012f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a56c2640 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x560801314ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 -- 10.20.193.28:0/3051523001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012d3de0 msgr2=0x5608012f41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012d3de0 0x5608012f41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 -- 10.20.193.28:0/3051523001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 msgr2=0x560801314ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x560801314ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 -- 10.20.193.28:0/3051523001 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608011618b0 con 0x5608012b34c0 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012b34c0 0x5608012d38a0 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=3439226721666164341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4790009dc0 tx=0x7f4790014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fba967b46f16675 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f476d3fe640 1 -- 10.20.193.28:0/3051523001 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4790011a80 con 0x5608012b34c0 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f476d3fe640 1 -- 10.20.193.28:0/3051523001 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4790011be0 con 0x5608012b34c0 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.284+0000 7f476d3fe640 1 -- 10.20.193.28:0/3051523001 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4790019710 con 0x5608012b34c0 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 -- 10.20.193.28:0/3051523001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012b34c0 msgr2=0x5608012d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012b34c0 0x5608012d38a0 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=3439226721666164341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4790009dc0 tx=0x7f4790014000 comp rx=0 tx=0).stop 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 -- 10.20.193.28:0/3051523001 shutdown_connections 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x560801314ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012d3de0 0x5608012f41c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 --2- 10.20.193.28:0/3051523001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012b34c0 0x5608012d38a0 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=3439226721666164341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 -- 10.20.193.28:0/3051523001 >> 10.20.193.28:0/3051523001 conn(0x5608011d21c0 msgr2=0x5608012b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:24.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 -- 10.20.193.28:0/3051523001 shutdown_connections 2026-02-20T13:21:24.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.285+0000 7f47a9841e00 1 -- 10.20.193.28:0/3051523001 wait complete. 2026-02-20T13:21:24.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.286+0000 7f47a9841e00 1 -- start start 2026-02-20T13:21:24.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a9841e00 1 Processor -- start 2026-02-20T13:21:24.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012b34c0 0x5608012ccaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 0x5608012cd140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012f4700 0x5608012cdba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a9841e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5608012ce200 con 0x5608012b34c0 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a9841e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5608012ce370 con 0x5608012f4700 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a9841e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5608012ce530 con 0x5608012d3de0 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012b34c0 0x5608012ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a56c2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012f4700 0x5608012cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012b34c0 0x5608012ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38002/0 (socket says 10.20.193.28:38002) 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a4ec1640 1 -- 10.20.193.28:0/1168575534 learned_addr learned my addr 10.20.193.28:0/1168575534 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f4797fff640 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 0x5608012cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a4ec1640 1 -- 10.20.193.28:0/1168575534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 msgr2=0x5608012cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 0x5608012cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a4ec1640 1 -- 10.20.193.28:0/1168575534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012f4700 msgr2=0x5608012cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012f4700 0x5608012cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a4ec1640 1 -- 10.20.193.28:0/1168575534 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56080116a400 con 0x5608012b34c0 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.287+0000 7f47a56c2640 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012f4700 0x5608012cdba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012b34c0 0x5608012ccaf0 secure :-1 s=READY pgs=651 gs=1 cs=0 l=1 c_cookie=6722173848126676298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479001cd40 tx=0x7f4790009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d49f57fd002dd4a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f475e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f475e7fc640 1 -- 10.20.193.28:0/1168575534 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f479002a070 con 0x5608012b34c0 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f475e7fc640 1 -- 10.20.193.28:0/1168575534 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f479001c410 con 0x5608012b34c0 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f475e7fc640 1 -- 10.20.193.28:0/1168575534 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4790019d30 con 0x5608012b34c0 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4790003de0 con 0x5608012b34c0 2026-02-20T13:21:24.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f475e7fc640 1 -- 10.20.193.28:0/1168575534 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4790025420 con 0x5608012b34c0 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f475e7fc640 10 client.16923 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f47a9841e00 10 client.16923 _ll_register_callbacks cb 0x560801149a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560800e5e520 con 0x5608012b34c0 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f475e7fc640 1 -- 10.20.193.28:0/1168575534 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4790019ec0 con 0x5608012b34c0 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f47a9841e00 10 client.16923 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.288+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560801142da0 con 0x5608012b34c0 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.289+0000 7f475e7fc640 1 -- 10.20.193.28:0/1168575534 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4790036060 con 0x5608012b34c0 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.289+0000 7f47a9841e00 10 client.16923 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.289+0000 7f47a9841e00 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.289+0000 7f47a9841e00 20 client.16923 populate_metadata read hostname 'trial028' 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.289+0000 7f47a9841e00 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5608012d1140 0x5608012d15c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.289+0000 7f47a9841e00 4 client.16923 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.289+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608011f0630 con 0x5608012d1140 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.289+0000 7f4797fff640 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5608012d1140 0x5608012d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f4797fff640 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5608012d1140 0x5608012d15c0 crc :-1 s=READY pgs=140 gs=4 cs=0 l=0 c_cookie=5654184617946508702 s_cookie=7352501296243387362 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e77b2f3ef2ded9e server_cookie=660954f9452fabe2 in_seq=0 out_seq=0 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f475e7fc640 10 client.16923 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f475e7fc640 1 -- 10.20.193.28:0/1168575534 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5608011f0630 con 0x5608012d1140 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f475e7fc640 10 client.16923 handle_command_reply: tid=0 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 client.16923 shutdown 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012b34c0 msgr2=0x5608012ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012b34c0 0x5608012ccaf0 secure :-1 s=READY pgs=651 gs=1 cs=0 l=1 c_cookie=6722173848126676298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479001cd40 tx=0x7f4790009f90 comp rx=0 tx=0).stop 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 shutdown_connections 2026-02-20T13:21:24.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5608012d1140 0x5608012d15c0 crc :-1 s=READY pgs=140 gs=4 cs=0 l=0 c_cookie=5654184617946508702 s_cookie=7352501296243387362 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012f4700 0x5608012cdba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 0x5608012cd140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 --2- 10.20.193.28:0/1168575534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012b34c0 0x5608012ccaf0 unknown :-1 s=CLOSED pgs=651 gs=1 cs=0 l=1 c_cookie=6722173848126676298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 >> 10.20.193.28:0/1168575534 conn(0x5608011d21c0 msgr2=0x5608012b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:24.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f475e7fc640 0 client.16923 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:24.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 shutdown_connections 2026-02-20T13:21:24.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.290+0000 7f47a9841e00 1 -- 10.20.193.28:0/1168575534 wait complete. 2026-02-20T13:21:24.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.291+0000 7f47a9841e00 20 client.16923 trim_cache size 0 max 16384 2026-02-20T13:21:24.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a9841e00 1 Processor -- start 2026-02-20T13:21:24.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a9841e00 1 -- start start 2026-02-20T13:21:24.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012c9e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 0x5608012ca360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x5608012f25c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a9841e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5608011bc8d0 con 0x5608012f4700 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a9841e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560800efdf10 con 0x5608012b34c0 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a9841e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5608012cd5a0 con 0x5608012d3de0 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a56c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x5608012f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43030/0 (socket says 10.20.193.28:43030) 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f47a4ec1640 1 -- 10.20.193.28:0/116895741 learned_addr learned my addr 10.20.193.28:0/116895741 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.298+0000 7f4797fff640 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 0x5608012ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a4ec1640 1 -- 10.20.193.28:0/116895741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 msgr2=0x5608012ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 0x5608012ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a4ec1640 1 -- 10.20.193.28:0/116895741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 msgr2=0x5608012f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x5608012f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a4ec1640 1 -- 10.20.193.28:0/116895741 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560801154670 con 0x5608012b34c0 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a56c2640 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x5608012f25c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012c9e20 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=17187330849353387490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4790009480 tx=0x7f4790027030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee85aa5858d24de2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f476cbfd640 1 -- 10.20.193.28:0/116895741 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f479002a070 con 0x5608012b34c0 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f476cbfd640 1 -- 10.20.193.28:0/116895741 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560800e5e520 con 0x5608012b34c0 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f476cbfd640 1 -- 10.20.193.28:0/116895741 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4790011a80 con 0x5608012b34c0 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 -- 10.20.193.28:0/116895741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 msgr2=0x5608012c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012c9e20 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=17187330849353387490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4790009480 tx=0x7f4790027030 comp rx=0 tx=0).stop 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 -- 10.20.193.28:0/116895741 shutdown_connections 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012f4700 0x5608012f25c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012d3de0 0x5608012ca360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 --2- 10.20.193.28:0/116895741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012c9e20 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=17187330849353387490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 -- 10.20.193.28:0/116895741 >> 10.20.193.28:0/116895741 conn(0x5608011d21c0 msgr2=0x5608012cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:24.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 -- 10.20.193.28:0/116895741 shutdown_connections 2026-02-20T13:21:24.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.299+0000 7f47a9841e00 1 -- 10.20.193.28:0/116895741 wait complete. 2026-02-20T13:21:24.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a9841e00 1 -- start start 2026-02-20T13:21:24.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a9841e00 1 Processor -- start 2026-02-20T13:21:24.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012b05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012d3de0 0x5608012b0b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a9841e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012f4700 0x5608012d41b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a9841e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5608012d46f0 con 0x5608012d3de0 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a9841e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5608012d4860 con 0x5608012b34c0 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a9841e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5608012d4a20 con 0x5608012f4700 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a4ec1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43044/0 (socket says 10.20.193.28:43044) 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f4797fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012d3de0 0x5608012b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a4ec1640 1 -- 10.20.193.28:0/2665208146 learned_addr learned my addr 10.20.193.28:0/2665208146 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:24.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.300+0000 7f47a56c2640 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012f4700 0x5608012d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a4ec1640 1 -- 10.20.193.28:0/2665208146 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012f4700 msgr2=0x5608012d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012f4700 0x5608012d41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a4ec1640 1 -- 10.20.193.28:0/2665208146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012d3de0 msgr2=0x5608012b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012d3de0 0x5608012b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a4ec1640 1 -- 10.20.193.28:0/2665208146 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560801142da0 con 0x5608012b34c0 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f4797fff640 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012d3de0 0x5608012b0b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a56c2640 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012f4700 0x5608012d41b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a4ec1640 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012b05e0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=9946091942431819005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479001e010 tx=0x7f4790009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a079deccc0604fd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f475e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f475e7fc640 1 -- 10.20.193.28:0/2665208146 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f479002a070 con 0x5608012b34c0 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f475e7fc640 1 -- 10.20.193.28:0/2665208146 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f479001cd10 con 0x5608012b34c0 2026-02-20T13:21:24.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f475e7fc640 1 -- 10.20.193.28:0/2665208146 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f479002ecc0 con 0x5608012b34c0 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a00fa050 con 0x5608012b34c0 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f475e7fc640 1 -- 10.20.193.28:0/2665208146 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f47900243d0 con 0x5608012b34c0 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a9841e00 10 client.26912 _ll_register_callbacks cb 0x560801149a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56080126eca0 con 0x5608012b34c0 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f475e7fc640 1 -- 10.20.193.28:0/2665208146 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f479002e450 con 0x5608012b34c0 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a9841e00 10 client.26912 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.301+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56080114f0f0 con 0x5608012b34c0 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f475e7fc640 1 -- 10.20.193.28:0/2665208146 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4790048020 con 0x5608012b34c0 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f47a9841e00 10 client.26912 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:24.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f47a9841e00 10 client.26912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:24.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f47a9841e00 20 client.26912 populate_metadata read hostname 'trial028' 2026-02-20T13:21:24.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f47a9841e00 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5608012d6170 0x5608012d65e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:24.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f47a9841e00 4 client.26912 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:21:24.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560800ea2640 con 0x5608012d6170 2026-02-20T13:21:24.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f4797fff640 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5608012d6170 0x5608012d65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:24.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f4797fff640 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5608012d6170 0x5608012d65e0 crc :-1 s=READY pgs=141 gs=4 cs=0 l=0 c_cookie=4508101778603241231 s_cookie=14194509513680618752 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e8ffeaec4f3ef0f server_cookie=c4fd07326bd60500 in_seq=0 out_seq=0 2026-02-20T13:21:24.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.302+0000 7f475e7fc640 10 client.26912 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:24.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f475e7fc640 1 -- 10.20.193.28:0/2665208146 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560800ea2640 con 0x5608012d6170 2026-02-20T13:21:24.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f475e7fc640 10 client.26912 handle_command_reply: tid=0 2026-02-20T13:21:24.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 client.26912 shutdown 2026-02-20T13:21:24.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 msgr2=0x5608012b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012b05e0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=9946091942431819005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479001e010 tx=0x7f4790009f90 comp rx=0 tx=0).stop 2026-02-20T13:21:24.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 shutdown_connections 2026-02-20T13:21:24.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5608012d6170 0x5608012d65e0 crc :-1 s=READY pgs=141 gs=4 cs=0 l=0 c_cookie=4508101778603241231 s_cookie=14194509513680618752 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608012d3de0 0x5608012b0b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5608012f4700 0x5608012d41b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 --2- 10.20.193.28:0/2665208146 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5608012b34c0 0x5608012b05e0 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=9946091942431819005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 >> 10.20.193.28:0/2665208146 conn(0x5608011d21c0 msgr2=0x5608012c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:24.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f475e7fc640 0 client.26912 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:24.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 shutdown_connections 2026-02-20T13:21:24.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 1 -- 10.20.193.28:0/2665208146 wait complete. 2026-02-20T13:21:24.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.305+0000 7f47a9841e00 20 client.26912 trim_cache size 0 max 16384 2026-02-20T13:21:24.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:21:24.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:21:24.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:21:24.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 -- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f477c0b56e0 msgr2=0x7f477c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f477c0b56e0 0x7f477c0d5b90 secure :-1 s=READY pgs=356 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47900095b0 tx=0x7f4790005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 -- 10.20.193.28:0/825549612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47a01100b0 msgr2=0x7f47a00f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47a01100b0 0x7f47a00f8a20 secure :-1 s=READY pgs=265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479c00a230 tx=0x7f479c0039b0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 -- 10.20.193.28:0/825549612 shutdown_connections 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f477c0b56e0 0x7f477c0d5b90 unknown :-1 s=CLOSED pgs=356 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47a010f2f0 0x7f47a0171060 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f47a01100b0 0x7f47a00f8a20 unknown :-1 s=CLOSED pgs=265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 --2- 10.20.193.28:0/825549612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f47a010e940 0x7f47a00f81e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:24.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 -- 10.20.193.28:0/825549612 >> 10.20.193.28:0/825549612 conn(0x7f47a00ec320 msgr2=0x7f47a00ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:24.319 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 -- 10.20.193.28:0/825549612 shutdown_connections 2026-02-20T13:21:24.319 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:24.306+0000 7f47a5ec3640 1 -- 10.20.193.28:0/825549612 wait complete. 2026-02-20T13:21:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:24 trial028 ceph-mon[37442]: pgmap v303: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:21:24.918 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:21:24.919 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:21:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:24 trial127 ceph-mon[43817]: pgmap v303: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:21:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:24 trial034 ceph-mon[43332]: pgmap v303: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:21:25.102 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:25.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 -- 10.20.193.28:0/2906452313 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 msgr2=0x7f186c060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 --2- 10.20.193.28:0/2906452313 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 0x7f186c060fb0 secure :-1 s=READY pgs=268 gs=2 cs=0 l=1 c_cookie=3432788622682689647 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1858009950 tx=0x7f185802f190 comp rx=0 tx=0).stop 2026-02-20T13:21:25.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 -- 10.20.193.28:0/2906452313 shutdown_connections 2026-02-20T13:21:25.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 --2- 10.20.193.28:0/2906452313 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186c0614f0 0x7f186c061920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 --2- 10.20.193.28:0/2906452313 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f186c159d80 0x7f186c17a160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 --2- 10.20.193.28:0/2906452313 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 0x7f186c060fb0 unknown :-1 s=CLOSED pgs=268 gs=2 cs=0 l=1 c_cookie=3432788622682689647 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 -- 10.20.193.28:0/2906452313 >> 10.20.193.28:0/2906452313 conn(0x7f186c0eab00 msgr2=0x7f186c10af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 -- 10.20.193.28:0/2906452313 shutdown_connections 2026-02-20T13:21:25.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.281+0000 7f18714bd640 1 -- 10.20.193.28:0/2906452313 wait complete. 2026-02-20T13:21:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.282+0000 7f18714bd640 1 Processor -- start 2026-02-20T13:21:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.282+0000 7f18714bd640 1 -- start start 2026-02-20T13:21:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.282+0000 7f18714bd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f186c0614f0 0x7f186c0f2e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.282+0000 7f18714bd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 0x7f186c0f33b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f18714bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186c159d80 0x7f186c0f8780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f18714bd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f186c0f8da0 con 0x7f186c159d80 2026-02-20T13:21:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f18714bd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f186c0f8f10 con 0x7f186c062ae0 2026-02-20T13:21:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f18714bd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f186c0f90d0 con 0x7f186c0614f0 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f186c0614f0 0x7f186c0f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 0x7f186c0f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f186c0614f0 0x7f186c0f2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57600/0 (socket says 10.20.193.28:57600) 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 0x7f186c0f33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43072/0 (socket says 10.20.193.28:43072) 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 -- 10.20.193.28:0/685432556 learned_addr learned my addr 10.20.193.28:0/685432556 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f1870cbc640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186c159d80 0x7f186c0f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 -- 10.20.193.28:0/685432556 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 msgr2=0x7f186c0f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 0x7f186c0f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 -- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186c159d80 msgr2=0x7f186c0f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186c159d80 0x7f186c0f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 -- 10.20.193.28:0/685432556 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185c0094b0 con 0x7f186c0614f0 2026-02-20T13:21:25.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.283+0000 7f186bfff640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f186c0614f0 0x7f186c0f2e70 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18580023d0 tx=0x7f1858004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.284+0000 7f18697fa640 1 -- 10.20.193.28:0/685432556 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f185803d070 con 0x7f186c0614f0 2026-02-20T13:21:25.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.284+0000 7f18697fa640 1 -- 10.20.193.28:0/685432556 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1858002ad0 con 0x7f186c0614f0 2026-02-20T13:21:25.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.284+0000 7f18714bd640 1 -- 10.20.193.28:0/685432556 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1858009570 con 0x7f186c0614f0 2026-02-20T13:21:25.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.284+0000 7f18697fa640 1 -- 10.20.193.28:0/685432556 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18580418a0 con 0x7f186c0614f0 2026-02-20T13:21:25.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.284+0000 7f18714bd640 1 -- 10.20.193.28:0/685432556 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c0f98f0 con 0x7f186c0614f0 2026-02-20T13:21:25.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.287+0000 7f18697fa640 1 -- 10.20.193.28:0/685432556 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1858041a30 con 0x7f186c0614f0 2026-02-20T13:21:25.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.288+0000 7f18697fa640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18400b56e0 0x7f18400d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.289+0000 7f18697fa640 1 -- 10.20.193.28:0/685432556 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f185810aff0 con 0x7f186c0614f0 2026-02-20T13:21:25.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.289+0000 7f186b7fe640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18400b56e0 0x7f18400d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.289+0000 7f186b7fe640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18400b56e0 0x7f18400d5b90 secure :-1 s=READY pgs=357 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f186c0f9810 tx=0x7f185c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.289+0000 7f1874740e00 1 Processor -- start 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1874740e00 1 -- start start 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1874740e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58410 0x5598e3f587e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1874740e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58d20 0x5598e3f9d480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1874740e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3fbdda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1874740e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5598e3e6ea20 con 0x5598e3f9d9c0 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1874740e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5598e3e6a750 con 0x5598e3f58d20 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1874740e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5598e3e646f0 con 0x5598e3f58410 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58d20 0x5598e3f9d480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58410 0x5598e3f587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58410 0x5598e3f587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57606/0 (socket says 10.20.193.28:57606) 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186bfff640 1 -- 10.20.193.28:0/4106144637 learned_addr learned my addr 10.20.193.28:0/4106144637 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1870cbc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3fbdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186bfff640 1 -- 10.20.193.28:0/4106144637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58d20 msgr2=0x5598e3f9d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186bfff640 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58d20 0x5598e3f9d480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186bfff640 1 -- 10.20.193.28:0/4106144637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 msgr2=0x5598e3fbdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186bfff640 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3fbdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186bfff640 1 -- 10.20.193.28:0/4106144637 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e3e10120 con 0x5598e3f58410 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f186b7fe640 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58d20 0x5598e3f9d480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.290+0000 7f1870cbc640 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3fbdda0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f186bfff640 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58410 0x5598e3f587e0 secure :-1 s=READY pgs=225 gs=2 cs=0 l=1 c_cookie=967747772381308354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1858108ae0 tx=0x7f1858038ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e2178bcf6a5c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f183cce3640 1 -- 10.20.193.28:0/4106144637 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18580d0c20 con 0x5598e3f58410 2026-02-20T13:21:25.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f183cce3640 1 -- 10.20.193.28:0/4106144637 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1858041d10 con 0x5598e3f58410 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f183cce3640 1 -- 10.20.193.28:0/4106144637 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18580cf400 con 0x5598e3f58410 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 -- 10.20.193.28:0/4106144637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58410 msgr2=0x5598e3f587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58410 0x5598e3f587e0 secure :-1 s=READY pgs=225 gs=2 cs=0 l=1 c_cookie=967747772381308354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1858108ae0 tx=0x7f1858038ef0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 -- 10.20.193.28:0/4106144637 shutdown_connections 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3fbdda0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58d20 0x5598e3f9d480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 --2- 10.20.193.28:0/4106144637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58410 0x5598e3f587e0 unknown :-1 s=CLOSED pgs=225 gs=2 cs=0 l=1 c_cookie=967747772381308354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 -- 10.20.193.28:0/4106144637 >> 10.20.193.28:0/4106144637 conn(0x5598e3f36910 msgr2=0x5598e3f56cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 -- 10.20.193.28:0/4106144637 shutdown_connections 2026-02-20T13:21:25.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.291+0000 7f1874740e00 1 -- 10.20.193.28:0/4106144637 wait complete. 2026-02-20T13:21:25.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1874740e00 1 -- start start 2026-02-20T13:21:25.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1874740e00 1 Processor -- start 2026-02-20T13:21:25.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1874740e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f70a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1874740e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f70fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1874740e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f75fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1874740e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5598e3f764e0 con 0x5598e3f9d9c0 2026-02-20T13:21:25.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1874740e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5598e3f76650 con 0x5598e3f58410 2026-02-20T13:21:25.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1874740e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5598e3f76810 con 0x5598e3f58d20 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f186bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f70a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f1870cbc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f75fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f186b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f70fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f186bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f70a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43090/0 (socket says 10.20.193.28:43090) 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.293+0000 7f186bfff640 1 -- 10.20.193.28:0/232216453 learned_addr learned my addr 10.20.193.28:0/232216453 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f186bfff640 1 -- 10.20.193.28:0/232216453 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 msgr2=0x5598e3f70fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f186bfff640 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f70fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f186bfff640 1 -- 10.20.193.28:0/232216453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 msgr2=0x5598e3f75fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f186bfff640 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f75fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f186bfff640 1 -- 10.20.193.28:0/232216453 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c0f98f0 con 0x5598e3f58410 2026-02-20T13:21:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f1870cbc640 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f75fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f186bfff640 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f70a70 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=10255259250367411727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1858005b30 tx=0x7f1858005d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e51fff419b0360f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f182dffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f182dffb640 1 -- 10.20.193.28:0/232216453 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18580d0c20 con 0x5598e3f58410 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f182dffb640 1 -- 10.20.193.28:0/232216453 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18580dc4b0 con 0x5598e3f58410 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f182dffb640 1 -- 10.20.193.28:0/232216453 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18580d0990 con 0x5598e3f58410 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18600051e0 con 0x5598e3f58410 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f182dffb640 1 -- 10.20.193.28:0/232216453 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f18580ccd70 con 0x5598e3f58410 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f1874740e00 10 client.26924 _ll_register_callbacks cb 0x5598e3e1bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.294+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5598e3afa9d0 con 0x5598e3f58410 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f182dffb640 1 -- 10.20.193.28:0/232216453 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18580d9670 con 0x5598e3f58410 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f1874740e00 10 client.26924 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:25.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5598e3de8810 con 0x5598e3f58410 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f182dffb640 1 -- 10.20.193.28:0/232216453 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18580ccf70 con 0x5598e3f58410 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f1874740e00 10 client.26924 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f1874740e00 10 client.26924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f1874740e00 20 client.26924 populate_metadata read hostname 'trial028' 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f1874740e00 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5598e3f9ae50 0x5598e3f9b2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f1874740e00 4 client.26924 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598e3e71df0 con 0x5598e3f9ae50 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.295+0000 7f186b7fe640 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5598e3f9ae50 0x5598e3f9b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.296+0000 7f186b7fe640 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5598e3f9ae50 0x5598e3f9b2c0 crc :-1 s=READY pgs=142 gs=4 cs=0 l=0 c_cookie=3164404429280009976 s_cookie=6376396446391208568 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bea39100ce85ef8 server_cookie=587d82c8ce360a78 in_seq=0 out_seq=0 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.296+0000 7f182dffb640 10 client.26924 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:25.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f182dffb640 1 -- 10.20.193.28:0/232216453 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5598e3e71df0 con 0x5598e3f9ae50 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f182dffb640 10 client.26924 handle_command_reply: tid=0 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 client.26924 shutdown 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 msgr2=0x5598e3f70a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f70a70 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=10255259250367411727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1858005b30 tx=0x7f1858005d10 comp rx=0 tx=0).stop 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 shutdown_connections 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5598e3f9ae50 0x5598e3f9b2c0 crc :-1 s=READY pgs=142 gs=4 cs=0 l=0 c_cookie=3164404429280009976 s_cookie=6376396446391208568 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f75fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f70fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 --2- 10.20.193.28:0/232216453 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f70a70 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=10255259250367411727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 >> 10.20.193.28:0/232216453 conn(0x5598e3f36910 msgr2=0x5598e3f574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f182dffb640 0 client.26924 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 shutdown_connections 2026-02-20T13:21:25.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 1 -- 10.20.193.28:0/232216453 wait complete. 2026-02-20T13:21:25.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.297+0000 7f1874740e00 20 client.26924 trim_cache size 0 max 16384 2026-02-20T13:21:25.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1874740e00 1 Processor -- start 2026-02-20T13:21:25.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1874740e00 1 -- start start 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1874740e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f58410 0x5598e3f75510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1874740e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f9cb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1874740e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f9d9c0 0x5598e3f9d070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1874740e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5598e3f9b3b0 con 0x5598e3f58410 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1874740e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5598e3e62320 con 0x5598e3f9d9c0 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1874740e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5598e3b22790 con 0x5598e3f58d20 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f186bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f58410 0x5598e3f75510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f186b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f9cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f186bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f58410 0x5598e3f75510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38056/0 (socket says 10.20.193.28:38056) 2026-02-20T13:21:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f186bfff640 1 -- 10.20.193.28:0/2693848288 learned_addr learned my addr 10.20.193.28:0/2693848288 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.307+0000 7f1870cbc640 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f9d9c0 0x5598e3f9d070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1870cbc640 1 -- 10.20.193.28:0/2693848288 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 msgr2=0x5598e3f9cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1870cbc640 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f9cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1870cbc640 1 -- 10.20.193.28:0/2693848288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f58410 msgr2=0x5598e3f75510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1870cbc640 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f58410 0x5598e3f75510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1870cbc640 1 -- 10.20.193.28:0/2693848288 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e3dfa4f0 con 0x5598e3f9d9c0 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f186bfff640 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f58410 0x5598e3f75510 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1870cbc640 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f9d9c0 0x5598e3f9d070 secure :-1 s=READY pgs=270 gs=3 cs=0 l=1 c_cookie=18016366606740875577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1860004cd0 tx=0x7f186000a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa06fdf959ffe939 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f182ffff640 1 -- 10.20.193.28:0/2693848288 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1860018070 con 0x5598e3f9d9c0 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f182ffff640 1 -- 10.20.193.28:0/2693848288 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1860019040 con 0x5598e3f9d9c0 2026-02-20T13:21:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f182ffff640 1 -- 10.20.193.28:0/2693848288 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f186001ed70 con 0x5598e3f9d9c0 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1874740e00 1 -- 10.20.193.28:0/2693848288 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f9d9c0 msgr2=0x5598e3f9d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1874740e00 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f9d9c0 0x5598e3f9d070 secure :-1 s=READY pgs=270 gs=3 cs=0 l=1 c_cookie=18016366606740875577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1860004cd0 tx=0x7f186000a310 comp rx=0 tx=0).stop 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1874740e00 1 -- 10.20.193.28:0/2693848288 shutdown_connections 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1874740e00 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f9d9c0 0x5598e3f9d070 unknown :-1 s=CLOSED pgs=270 gs=3 cs=0 l=1 c_cookie=18016366606740875577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1874740e00 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f9cb30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.308+0000 7f1874740e00 1 --2- 10.20.193.28:0/2693848288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f58410 0x5598e3f75510 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.309+0000 7f1874740e00 1 -- 10.20.193.28:0/2693848288 >> 10.20.193.28:0/2693848288 conn(0x5598e3f36910 msgr2=0x5598e3f74e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.309+0000 7f1874740e00 1 -- 10.20.193.28:0/2693848288 shutdown_connections 2026-02-20T13:21:25.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.309+0000 7f1874740e00 1 -- 10.20.193.28:0/2693848288 wait complete. 2026-02-20T13:21:25.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.309+0000 7f1874740e00 1 -- start start 2026-02-20T13:21:25.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.309+0000 7f1874740e00 1 Processor -- start 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f1874740e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f96f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f1874740e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f77060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f1874740e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f775a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f1874740e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5598e3f627d0 con 0x5598e3f9d9c0 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f1874740e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5598e3f77c10 con 0x5598e3f58410 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f1874740e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5598e3f77dd0 con 0x5598e3f58d20 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f96f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f96f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43118/0 (socket says 10.20.193.28:43118) 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 -- 10.20.193.28:0/616585757 learned_addr learned my addr 10.20.193.28:0/616585757 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f1870cbc640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186b7fe640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f77060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 -- 10.20.193.28:0/616585757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 msgr2=0x5598e3f77060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f77060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 -- 10.20.193.28:0/616585757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 msgr2=0x5598e3f775a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f775a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 -- 10.20.193.28:0/616585757 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1860004940 con 0x5598e3f58410 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f1870cbc640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f775a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186b7fe640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f77060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f186bfff640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f96f60 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=5408940214376415395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1858041a00 tx=0x7f185810a020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b106a77993b40a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.310+0000 7f182dffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f182dffb640 1 -- 10.20.193.28:0/616585757 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18580d9670 con 0x5598e3f58410 2026-02-20T13:21:25.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f182dffb640 1 -- 10.20.193.28:0/616585757 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18580b1060 con 0x5598e3f58410 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f182dffb640 1 -- 10.20.193.28:0/616585757 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18580dbb70 con 0x5598e3f58410 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e3de8810 con 0x5598e3f58410 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f182dffb640 1 -- 10.20.193.28:0/616585757 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f18580dbcd0 con 0x5598e3f58410 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f182dffb640 10 client.26930 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 10 client.26930 _ll_register_callbacks cb 0x5598e3e1bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1858041d10 con 0x5598e3f58410 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f182dffb640 1 -- 10.20.193.28:0/616585757 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18580dc4b0 con 0x5598e3f58410 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 10 client.26930 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5598e3df4f70 con 0x5598e3f58410 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f182dffb640 1 -- 10.20.193.28:0/616585757 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18580e4070 con 0x5598e3f58410 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 10 client.26930 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 10 client.26930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:25.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 20 client.26930 populate_metadata read hostname 'trial028' 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5598e404a6a0 0x5598e406ab20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 4 client.26930 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.311+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5598e3af8220 con 0x5598e404a6a0 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.312+0000 7f186b7fe640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5598e404a6a0 0x5598e406ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.312+0000 7f182dffb640 10 client.26930 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.312+0000 7f186b7fe640 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5598e404a6a0 0x5598e406ab20 crc :-1 s=READY pgs=143 gs=4 cs=0 l=0 c_cookie=4582594918571595557 s_cookie=8664467288393681030 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f98a5cc7ef85725 server_cookie=783e5f17acb28886 in_seq=0 out_seq=0 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f182dffb640 1 -- 10.20.193.28:0/616585757 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5598e3af8220 con 0x5598e404a6a0 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f182dffb640 10 client.26930 handle_command_reply: tid=0 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 client.26930 shutdown 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 msgr2=0x5598e3f96f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f96f60 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=5408940214376415395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1858041a00 tx=0x7f185810a020 comp rx=0 tx=0).stop 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 shutdown_connections 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5598e404a6a0 0x5598e406ab20 crc :-1 s=READY pgs=143 gs=4 cs=0 l=0 c_cookie=4582594918571595557 s_cookie=8664467288393681030 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5598e3f9d9c0 0x5598e3f775a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5598e3f58d20 0x5598e3f77060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 --2- 10.20.193.28:0/616585757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5598e3f58410 0x5598e3f96f60 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=5408940214376415395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 >> 10.20.193.28:0/616585757 conn(0x5598e3f36910 msgr2=0x5598e3f755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f182dffb640 0 client.26930 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.313+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 shutdown_connections 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f1874740e00 1 -- 10.20.193.28:0/616585757 wait complete. 2026-02-20T13:21:25.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f1874740e00 20 client.26930 trim_cache size 0 max 16384 2026-02-20T13:21:25.324 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:21:25.324 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:21:25.324 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "7491cd79-13ba-483a-af06-a396aac7fb2a", 2026-02-20T13:21:25.324 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:21:25.324 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:21:25.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 -- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18400b56e0 msgr2=0x7f18400d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18400b56e0 0x7f18400d5b90 secure :-1 s=READY pgs=357 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f186c0f9810 tx=0x7f185c005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:25.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 -- 10.20.193.28:0/685432556 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f186c0614f0 msgr2=0x7f186c0f2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f186c0614f0 0x7f186c0f2e70 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18580023d0 tx=0x7f1858004290 comp rx=0 tx=0).stop 2026-02-20T13:21:25.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 -- 10.20.193.28:0/685432556 shutdown_connections 2026-02-20T13:21:25.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18400b56e0 0x7f18400d5b90 unknown :-1 s=CLOSED pgs=357 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186c159d80 0x7f186c0f8780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186c062ae0 0x7f186c0f33b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 --2- 10.20.193.28:0/685432556 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f186c0614f0 0x7f186c0f2e70 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 -- 10.20.193.28:0/685432556 >> 10.20.193.28:0/685432556 conn(0x7f186c0eab00 msgr2=0x7f186c10fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 -- 10.20.193.28:0/685432556 shutdown_connections 2026-02-20T13:21:25.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.314+0000 7f18714bd640 1 -- 10.20.193.28:0/685432556 wait complete. 2026-02-20T13:21:25.415 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:21:25.600 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:25.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.778+0000 7ff263579640 1 -- 10.20.193.28:0/563608929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c10c040 msgr2=0x7ff25c10f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.778+0000 7ff263579640 1 --2- 10.20.193.28:0/563608929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c10c040 0x7ff25c10f990 secure :-1 s=READY pgs=652 gs=1 cs=0 l=1 c_cookie=5089653109058001318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248009950 tx=0x7ff24802f190 comp rx=0 tx=0).stop 2026-02-20T13:21:25.785 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:25 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:21:25.785 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:25 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:21:25.785 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:25 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:25.785 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:25 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:21:25.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:25 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:25.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:25 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:25.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.778+0000 7ff263579640 1 -- 10.20.193.28:0/563608929 shutdown_connections 2026-02-20T13:21:25.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.778+0000 7ff263579640 1 --2- 10.20.193.28:0/563608929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c10c040 0x7ff25c10f990 unknown :-1 s=CLOSED pgs=652 gs=1 cs=0 l=1 c_cookie=5089653109058001318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.779+0000 7ff263579640 1 --2- 10.20.193.28:0/563608929 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff25c110140 0x7ff25c173d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.779+0000 7ff263579640 1 --2- 10.20.193.28:0/563608929 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff25c10b650 0x7ff25c10ba20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.779+0000 7ff263579640 1 -- 10.20.193.28:0/563608929 >> 10.20.193.28:0/563608929 conn(0x7ff25c0e9080 msgr2=0x7ff25c109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.779+0000 7ff263579640 1 -- 10.20.193.28:0/563608929 shutdown_connections 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.779+0000 7ff263579640 1 -- 10.20.193.28:0/563608929 wait complete. 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.779+0000 7ff263579640 1 Processor -- start 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.779+0000 7ff263579640 1 -- start start 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff263579640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff25c10b650 0x7ff25c0f3d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff263579640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff25c10c040 0x7ff25c173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff263579640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c110140 0x7ff25c0f4410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff263579640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0f9620 con 0x7ff25c110140 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff263579640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0f9790 con 0x7ff25c10b650 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff263579640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0f9950 con 0x7ff25c10c040 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c110140 0x7ff25c0f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c110140 0x7ff25c0f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38062/0 (socket says 10.20.193.28:38062) 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 -- 10.20.193.28:0/1740681741 learned_addr learned my addr 10.20.193.28:0/1740681741 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262577640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff25c10b650 0x7ff25c0f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff261d76640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff25c10c040 0x7ff25c173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 -- 10.20.193.28:0/1740681741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff25c10c040 msgr2=0x7ff25c173c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff25c10c040 0x7ff25c173c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 -- 10.20.193.28:0/1740681741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff25c10b650 msgr2=0x7ff25c0f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff25c10b650 0x7ff25c0f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 -- 10.20.193.28:0/1740681741 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff248009570 con 0x7ff25c110140 2026-02-20T13:21:25.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff262d78640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c110140 0x7ff25c0f4410 secure :-1 s=READY pgs=653 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff25000f8d0 tx=0x7ff25000fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.780+0000 7ff2477fe640 1 -- 10.20.193.28:0/1740681741 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff25000dce0 con 0x7ff25c110140 2026-02-20T13:21:25.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.781+0000 7ff2477fe640 1 -- 10.20.193.28:0/1740681741 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff25000de40 con 0x7ff25c110140 2026-02-20T13:21:25.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.781+0000 7ff2477fe640 1 -- 10.20.193.28:0/1740681741 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2500116b0 con 0x7ff25c110140 2026-02-20T13:21:25.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.781+0000 7ff263579640 1 -- 10.20.193.28:0/1740681741 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c0f9c30 con 0x7ff25c110140 2026-02-20T13:21:25.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.781+0000 7ff263579640 1 -- 10.20.193.28:0/1740681741 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c0fa0b0 con 0x7ff25c110140 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.784+0000 7ff2477fe640 1 -- 10.20.193.28:0/1740681741 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff250020060 con 0x7ff25c110140 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.785+0000 7ff2477fe640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2380b5750 0x7ff2380d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2477fe640 1 -- 10.20.193.28:0/1740681741 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff250015070 con 0x7ff25c110140 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff262577640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2380b5750 0x7ff2380d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2667fce00 1 Processor -- start 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2667fce00 1 -- start start 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff262577640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2380b5750 0x7ff2380d5c00 secure :-1 s=READY pgs=358 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff254004740 tx=0x7ff25400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8cc4550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d09400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8d09940 0x557fb8d29d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2667fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557fb8bda7d0 con 0x557fb8cc4a90 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2667fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557fb8bd6500 con 0x557fb8d09940 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.786+0000 7ff2667fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557fb8bd04a0 con 0x557fb8cc4180 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d09400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d09400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38078/0 (socket says 10.20.193.28:38078) 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 -- 10.20.193.28:0/3330988586 learned_addr learned my addr 10.20.193.28:0/3330988586 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff262d78640 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8d09940 0x557fb8d29d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff262577640 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8cc4550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 -- 10.20.193.28:0/3330988586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 msgr2=0x557fb8cc4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8cc4550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 -- 10.20.193.28:0/3330988586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8d09940 msgr2=0x557fb8d29d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8d09940 0x557fb8d29d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 -- 10.20.193.28:0/3330988586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb8b7bd80 con 0x557fb8cc4a90 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff261d76640 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d09400 secure :-1 s=READY pgs=654 gs=1 cs=0 l=1 c_cookie=7383438774038828109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248005ad0 tx=0x7ff248002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66773e72236e144d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff244cf3640 1 -- 10.20.193.28:0/3330988586 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24803d070 con 0x557fb8cc4a90 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff244cf3640 1 -- 10.20.193.28:0/3330988586 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff24803e040 con 0x557fb8cc4a90 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.787+0000 7ff244cf3640 1 -- 10.20.193.28:0/3330988586 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24802fc70 con 0x557fb8cc4a90 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 -- 10.20.193.28:0/3330988586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 msgr2=0x557fb8d09400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d09400 secure :-1 s=READY pgs=654 gs=1 cs=0 l=1 c_cookie=7383438774038828109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248005ad0 tx=0x7ff248002390 comp rx=0 tx=0).stop 2026-02-20T13:21:25.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 -- 10.20.193.28:0/3330988586 shutdown_connections 2026-02-20T13:21:25.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d09400 unknown :-1 s=CLOSED pgs=654 gs=1 cs=0 l=1 c_cookie=7383438774038828109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8d09940 0x557fb8d29d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 --2- 10.20.193.28:0/3330988586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8cc4550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 -- 10.20.193.28:0/3330988586 >> 10.20.193.28:0/3330988586 conn(0x557fb8ca2680 msgr2=0x557fb8cc2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 -- 10.20.193.28:0/3330988586 shutdown_connections 2026-02-20T13:21:25.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.788+0000 7ff2667fce00 1 -- 10.20.193.28:0/3330988586 wait complete. 2026-02-20T13:21:25.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.789+0000 7ff2667fce00 1 -- start start 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.789+0000 7ff2667fce00 1 Processor -- start 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4180 0x557fb8d210c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d21600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8d265f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff2667fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557fb8d26b30 con 0x557fb8cc4a90 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff2667fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557fb8d26ca0 con 0x557fb8cc4180 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff2667fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557fb8d26e60 con 0x557fb8d09940 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d21600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d21600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38090/0 (socket says 10.20.193.28:38090) 2026-02-20T13:21:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 -- 10.20.193.28:0/994866675 learned_addr learned my addr 10.20.193.28:0/994866675 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff262d78640 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8d265f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 -- 10.20.193.28:0/994866675 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 msgr2=0x557fb8d265f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8d265f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 -- 10.20.193.28:0/994866675 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4180 msgr2=0x557fb8d210c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4180 0x557fb8d210c0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 -- 10.20.193.28:0/994866675 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb8b54350 con 0x557fb8cc4a90 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff261d76640 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d21600 secure :-1 s=READY pgs=655 gs=1 cs=0 l=1 c_cookie=11782140527253220578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248004520 tx=0x7ff248005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a382926294a96ce2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff20ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff20ffff640 1 -- 10.20.193.28:0/994866675 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24803d050 con 0x557fb8cc4a90 2026-02-20T13:21:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff20ffff640 1 -- 10.20.193.28:0/994866675 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff248038680 con 0x557fb8cc4a90 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff20ffff640 1 -- 10.20.193.28:0/994866675 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2480428b0 con 0x557fb8cc4a90 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.790+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c1745c0 con 0x557fb8cc4a90 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff20ffff640 1 -- 10.20.193.28:0/994866675 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff248042a40 con 0x557fb8cc4a90 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 10 client.16959 _ll_register_callbacks cb 0x557fb8b519a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557fb88666f0 con 0x557fb8cc4a90 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff20ffff640 1 -- 10.20.193.28:0/994866675 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff24802fbf0 con 0x557fb8cc4a90 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 10 client.16959 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557fb8b66150 con 0x557fb8cc4a90 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff20ffff640 1 -- 10.20.193.28:0/994866675 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff2480028c0 con 0x557fb8cc4a90 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 10 client.16959 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 20 client.16959 populate_metadata read hostname 'trial028' 2026-02-20T13:21:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557fb8d06700 0x557fb8d06ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 4 client.16959 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fb8bddd60 con 0x557fb8d06700 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.791+0000 7ff262577640 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557fb8d06700 0x557fb8d06ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.792+0000 7ff262577640 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557fb8d06700 0x557fb8d06ba0 crc :-1 s=READY pgs=144 gs=3 cs=0 l=0 c_cookie=11025698795725864514 s_cookie=1986437448844076234 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=990326a357b13e42 server_cookie=1b913e55cae264ca in_seq=0 out_seq=0 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.792+0000 7ff20ffff640 10 client.16959 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff20ffff640 1 -- 10.20.193.28:0/994866675 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557fb8bddd60 con 0x557fb8d06700 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff20ffff640 10 client.16959 handle_command_reply: tid=0 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 client.16959 shutdown 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 msgr2=0x557fb8d21600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d21600 secure :-1 s=READY pgs=655 gs=1 cs=0 l=1 c_cookie=11782140527253220578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248004520 tx=0x7ff248005900 comp rx=0 tx=0).stop 2026-02-20T13:21:25.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 shutdown_connections 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557fb8d06700 0x557fb8d06ba0 crc :-1 s=READY pgs=144 gs=3 cs=0 l=0 c_cookie=11025698795725864514 s_cookie=1986437448844076234 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4a90 0x557fb8d21600 unknown :-1 s=CLOSED pgs=655 gs=1 cs=0 l=1 c_cookie=11782140527253220578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8d265f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 --2- 10.20.193.28:0/994866675 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4180 0x557fb8d210c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 >> 10.20.193.28:0/994866675 conn(0x557fb8ca2680 msgr2=0x557fb8cc2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff20ffff640 0 client.16959 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 shutdown_connections 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 1 -- 10.20.193.28:0/994866675 wait complete. 2026-02-20T13:21:25.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.793+0000 7ff2667fce00 20 client.16959 trim_cache size 0 max 16384 2026-02-20T13:21:25.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff2667fce00 1 Processor -- start 2026-02-20T13:21:25.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff2667fce00 1 -- start start 2026-02-20T13:21:25.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8d130c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8d045a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8d09940 0x557fb8d04ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff2667fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557fb8bce0d0 con 0x557fb8d09940 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff2667fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557fb888e700 con 0x557fb8cc4a90 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff2667fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557fb8d22160 con 0x557fb8cc4180 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff262577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8d130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff262577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8d130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57686/0 (socket says 10.20.193.28:57686) 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff262577640 1 -- 10.20.193.28:0/1233598526 learned_addr learned my addr 10.20.193.28:0/1233598526 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff262d78640 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8d09940 0x557fb8d04ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.803+0000 7ff261d76640 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8d045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff261d76640 1 -- 10.20.193.28:0/1233598526 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 msgr2=0x557fb8d130c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff261d76640 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8d130c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff261d76640 1 -- 10.20.193.28:0/1233598526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8d09940 msgr2=0x557fb8d04ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff261d76640 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8d09940 0x557fb8d04ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff261d76640 1 -- 10.20.193.28:0/1233598526 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb8d13890 con 0x557fb8cc4a90 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff262d78640 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8d09940 0x557fb8d04ae0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff261d76640 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8d045a0 secure :-1 s=READY pgs=272 gs=2 cs=0 l=1 c_cookie=16601300560956054075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248036620 tx=0x7ff24803a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e663aae719475a3b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff22a4e6640 1 -- 10.20.193.28:0/1233598526 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24803d040 con 0x557fb8cc4a90 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff22a4e6640 1 -- 10.20.193.28:0/1233598526 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557fb88666f0 con 0x557fb8cc4a90 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff22a4e6640 1 -- 10.20.193.28:0/1233598526 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff248042d20 con 0x557fb8cc4a90 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff2667fce00 1 -- 10.20.193.28:0/1233598526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 msgr2=0x557fb8d045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff2667fce00 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8d045a0 secure :-1 s=READY pgs=272 gs=2 cs=0 l=1 c_cookie=16601300560956054075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248036620 tx=0x7ff24803a050 comp rx=0 tx=0).stop 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff2667fce00 1 -- 10.20.193.28:0/1233598526 shutdown_connections 2026-02-20T13:21:25.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff2667fce00 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8d09940 0x557fb8d04ae0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff2667fce00 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8d045a0 unknown :-1 s=CLOSED pgs=272 gs=2 cs=0 l=1 c_cookie=16601300560956054075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff2667fce00 1 --2- 10.20.193.28:0/1233598526 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8cc4180 0x557fb8d130c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff2667fce00 1 -- 10.20.193.28:0/1233598526 >> 10.20.193.28:0/1233598526 conn(0x557fb8ca2680 msgr2=0x557fb8d07c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.804+0000 7ff2667fce00 1 -- 10.20.193.28:0/1233598526 shutdown_connections 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.805+0000 7ff2667fce00 1 -- 10.20.193.28:0/1233598526 wait complete. 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.805+0000 7ff2667fce00 1 -- start start 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.805+0000 7ff2667fce00 1 Processor -- start 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4180 0x557fb8ca80b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8ca85f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff2667fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8ca3d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff2667fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557fb8d27960 con 0x557fb8cc4180 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff2667fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557fb8ca4490 con 0x557fb8cc4a90 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff2667fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557fb8ca4650 con 0x557fb8d09940 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4180 0x557fb8ca80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4180 0x557fb8ca80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38110/0 (socket says 10.20.193.28:38110) 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262577640 1 -- 10.20.193.28:0/2451341538 learned_addr learned my addr 10.20.193.28:0/2451341538 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262d78640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8ca3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff261d76640 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8ca85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262d78640 1 -- 10.20.193.28:0/2451341538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 msgr2=0x557fb8ca85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262d78640 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8ca85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262d78640 1 -- 10.20.193.28:0/2451341538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4180 msgr2=0x557fb8ca80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262d78640 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4180 0x557fb8ca80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262d78640 1 -- 10.20.193.28:0/2451341538 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb8b66150 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.806+0000 7ff262577640 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4180 0x557fb8ca80b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff262d78640 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8ca3d80 secure :-1 s=READY pgs=226 gs=3 cs=0 l=1 c_cookie=18082430927690726091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2500adef0 tx=0x7ff250003470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf1b31fb88afacb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff20ffff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff20ffff640 1 -- 10.20.193.28:0/2451341538 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2500d32c0 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c0fa0b0 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 10 client.26878 _ll_register_callbacks cb 0x557fb8b519a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557fb89284a0 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff20ffff640 1 -- 10.20.193.28:0/2451341538 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2500b3c30 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff20ffff640 1 -- 10.20.193.28:0/2451341538 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2500d1e50 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff20ffff640 1 -- 10.20.193.28:0/2451341538 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff2500aeba0 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff20ffff640 1 -- 10.20.193.28:0/2451341538 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff2500aed80 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 10 client.26878 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557fb8b60bd0 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff20ffff640 1 -- 10.20.193.28:0/2451341538 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff250079070 con 0x557fb8d09940 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 10 client.26878 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 10 client.26878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 20 client.26878 populate_metadata read hostname 'trial028' 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557fb8db6e40 0x557fb8dd7220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 4 client.26878 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.807+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff24803e040 con 0x557fb8db6e40 2026-02-20T13:21:25.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.808+0000 7ff262577640 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557fb8db6e40 0x557fb8dd7220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:25.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff262577640 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557fb8db6e40 0x557fb8dd7220 crc :-1 s=READY pgs=145 gs=4 cs=0 l=0 c_cookie=1324508161454248466 s_cookie=9847669172701716762 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12619927c1961212 server_cookie=88a9f2eff873611a in_seq=0 out_seq=0 2026-02-20T13:21:25.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff20ffff640 10 client.26878 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:25.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff20ffff640 1 -- 10.20.193.28:0/2451341538 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x7ff24803e040 con 0x557fb8db6e40 2026-02-20T13:21:25.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff20ffff640 10 client.26878 handle_command_reply: tid=0 2026-02-20T13:21:25.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 client.26878 shutdown 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 msgr2=0x557fb8ca3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8ca3d80 secure :-1 s=READY pgs=226 gs=3 cs=0 l=1 c_cookie=18082430927690726091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2500adef0 tx=0x7ff250003470 comp rx=0 tx=0).stop 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 shutdown_connections 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557fb8db6e40 0x557fb8dd7220 crc :-1 s=READY pgs=145 gs=4 cs=0 l=0 c_cookie=1324508161454248466 s_cookie=9847669172701716762 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557fb8d09940 0x557fb8ca3d80 unknown :-1 s=CLOSED pgs=226 gs=3 cs=0 l=1 c_cookie=18082430927690726091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557fb8cc4a90 0x557fb8ca85f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 --2- 10.20.193.28:0/2451341538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557fb8cc4180 0x557fb8ca80b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff20ffff640 0 client.26878 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 >> 10.20.193.28:0/2451341538 conn(0x557fb8ca2680 msgr2=0x557fb8cc2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 shutdown_connections 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 1 -- 10.20.193.28:0/2451341538 wait complete. 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.809+0000 7ff2667fce00 20 client.26878 trim_cache size 0 max 16384 2026-02-20T13:21:25.813 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "7491cd79-13ba-483a-af06-a396aac7fb2a", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:25.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:21:25.815 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 -- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2380b5750 msgr2=0x7ff2380d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2380b5750 0x7ff2380d5c00 secure :-1 s=READY pgs=358 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff254004740 tx=0x7ff25400b410 comp rx=0 tx=0).stop 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 -- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c110140 msgr2=0x7ff25c0f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c110140 0x7ff25c0f4410 secure :-1 s=READY pgs=653 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff25000f8d0 tx=0x7ff25000fda0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 -- 10.20.193.28:0/1740681741 shutdown_connections 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2380b5750 0x7ff2380d5c00 unknown :-1 s=CLOSED pgs=358 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff25c110140 0x7ff25c0f4410 unknown :-1 s=CLOSED pgs=653 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff25c10c040 0x7ff25c173c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 --2- 10.20.193.28:0/1740681741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff25c10b650 0x7ff25c0f3d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 -- 10.20.193.28:0/1740681741 >> 10.20.193.28:0/1740681741 conn(0x7ff25c0e9080 msgr2=0x7ff25c10ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 -- 10.20.193.28:0/1740681741 shutdown_connections 2026-02-20T13:21:25.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:25.810+0000 7ff263579640 1 -- 10.20.193.28:0/1740681741 wait complete. 2026-02-20T13:21:25.949 INFO:tasks.cephfs.filesystem:scrub status for tag:7491cd79-13ba-483a-af06-a396aac7fb2a - {'path': '/', 'tag': '7491cd79-13ba-483a-af06-a396aac7fb2a', 'options': 'recursive,force'} 2026-02-20T13:21:25.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:25 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:21:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:25 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:21:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:25 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:25 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:21:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:25 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:25.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:25 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:25.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:25 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:21:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:25 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:21:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:25 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:25 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:21:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:25 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:25.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:25 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:21:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:26 trial028 ceph-mon[37442]: pgmap v304: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:21:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:26 trial127 ceph-mon[43817]: pgmap v304: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:21:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:26 trial034 ceph-mon[43332]: pgmap v304: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:21:28.813 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:21:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:28 trial028 ceph-mon[37442]: pgmap v305: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:21:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:28 trial127 ceph-mon[43817]: pgmap v305: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:21:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:28 trial034 ceph-mon[43332]: pgmap v305: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:21:28.999 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:29.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1130215909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1d78112100 msgr2=0x7f1d78172ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1130215909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1d78112100 0x7f1d78172ad0 secure :-1 s=READY pgs=656 gs=1 cs=0 l=1 c_cookie=10447443820484165675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d6c00aa30 tx=0x7f1d6c030270 comp rx=0 tx=0).stop 2026-02-20T13:21:29.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1130215909 shutdown_connections 2026-02-20T13:21:29.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1130215909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1d78112100 0x7f1d78172ad0 unknown :-1 s=CLOSED pgs=656 gs=1 cs=0 l=1 c_cookie=10447443820484165675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1130215909 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1d7810c900 0x7f1d78111950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1130215909 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1d7810bf10 0x7f1d7810c2e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1130215909 >> 10.20.193.28:0/1130215909 conn(0x7f1d780e97e0 msgr2=0x7f1d78109bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:29.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1130215909 shutdown_connections 2026-02-20T13:21:29.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.187+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1130215909 wait complete. 2026-02-20T13:21:29.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d7dedd640 1 Processor -- start 2026-02-20T13:21:29.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d7dedd640 1 -- start start 2026-02-20T13:21:29.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d7dedd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1d7810bf10 0x7f1d780f43f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d7dedd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1d7810c900 0x7f1d781729d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d7dedd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1d78112100 0x7f1d780f4af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d7dedd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1d780f9d00 con 0x7f1d7810bf10 2026-02-20T13:21:29.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d7dedd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1d780f9e70 con 0x7f1d7810c900 2026-02-20T13:21:29.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d7dedd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1d780fa030 con 0x7f1d78112100 2026-02-20T13:21:29.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d76ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1d7810c900 0x7f1d781729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1d7810bf10 0x7f1d780f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d76ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1d7810c900 0x7f1d781729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43176/0 (socket says 10.20.193.28:43176) 2026-02-20T13:21:29.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d76ffd640 1 -- 10.20.193.28:0/1151621233 learned_addr learned my addr 10.20.193.28:0/1151621233 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:29.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.188+0000 7f1d77fff640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1d78112100 0x7f1d780f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d76ffd640 1 -- 10.20.193.28:0/1151621233 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1d78112100 msgr2=0x7f1d780f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d76ffd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1d78112100 0x7f1d780f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d76ffd640 1 -- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1d7810bf10 msgr2=0x7f1d780f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d76ffd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1d7810bf10 0x7f1d780f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d76ffd640 1 -- 10.20.193.28:0/1151621233 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c00a650 con 0x7f1d7810c900 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d76ffd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1d7810c900 0x7f1d781729d0 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d68009480 tx=0x7f1d6800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d74ff9640 1 -- 10.20.193.28:0/1151621233 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d6800cd40 con 0x7f1d7810c900 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d780fa310 con 0x7f1d7810c900 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d74ff9640 1 -- 10.20.193.28:0/1151621233 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1d68004d30 con 0x7f1d7810c900 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d74ff9640 1 -- 10.20.193.28:0/1151621233 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d68010740 con 0x7f1d7810c900 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.189+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d780fa7e0 con 0x7f1d7810c900 2026-02-20T13:21:29.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.190+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7810d1f0 con 0x7f1d7810c900 2026-02-20T13:21:29.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.192+0000 7f1d74ff9640 1 -- 10.20.193.28:0/1151621233 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1d6801f060 con 0x7f1d7810c900 2026-02-20T13:21:29.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.194+0000 7f1d74ff9640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1d4c0b5750 0x7f1d4c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.194+0000 7f1d74ff9640 1 -- 10.20.193.28:0/1151621233 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1d68014070 con 0x7f1d7810c900 2026-02-20T13:21:29.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.194+0000 7f1d777fe640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1d4c0b5750 0x7f1d4c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.194+0000 7f1d74ff9640 1 -- 10.20.193.28:0/1151621233 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f1d680e7270 con 0x7f1d7810c900 2026-02-20T13:21:29.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.194+0000 7f1d777fe640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1d4c0b5750 0x7f1d4c0d5c00 secure :-1 s=READY pgs=359 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d64004740 tx=0x7f1d6400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:29.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.335+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d7810c2e0 con 0x7f1d7810c900 2026-02-20T13:21:29.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.335+0000 7f1d74ff9640 1 -- 10.20.193.28:0/1151621233 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f1d68076ef0 con 0x7f1d7810c900 2026-02-20T13:21:29.339 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:21:29.339 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1d4c0b5750 msgr2=0x7f1d4c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1d4c0b5750 0x7f1d4c0d5c00 secure :-1 s=READY pgs=359 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d64004740 tx=0x7f1d6400b410 comp rx=0 tx=0).stop 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1d7810c900 msgr2=0x7f1d781729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1d7810c900 0x7f1d781729d0 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d68009480 tx=0x7f1d6800ee60 comp rx=0 tx=0).stop 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 shutdown_connections 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1d4c0b5750 0x7f1d4c0d5c00 unknown :-1 s=CLOSED pgs=359 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1d78112100 0x7f1d780f4af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1d7810c900 0x7f1d781729d0 unknown :-1 s=CLOSED pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 --2- 10.20.193.28:0/1151621233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1d7810bf10 0x7f1d780f43f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 >> 10.20.193.28:0/1151621233 conn(0x7f1d780e97e0 msgr2=0x7f1d7810a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:29.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 shutdown_connections 2026-02-20T13:21:29.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.336+0000 7f1d7dedd640 1 -- 10.20.193.28:0/1151621233 wait complete. 2026-02-20T13:21:29.478 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id 7c533819 --release --await' 2026-02-20T13:21:29.478 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id 7c533819 --release --await 2026-02-20T13:21:29.702 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:29.746 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:29 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1151621233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:29.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 -- 10.20.193.28:0/1347909284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa33011e0a0 msgr2=0x7fa33017ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 --2- 10.20.193.28:0/1347909284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa33011e0a0 0x7fa33017ea70 secure :-1 s=READY pgs=657 gs=1 cs=0 l=1 c_cookie=1255832340365852447 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa32000aa30 tx=0x7fa320030270 comp rx=0 tx=0).stop 2026-02-20T13:21:29.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 -- 10.20.193.28:0/1347909284 shutdown_connections 2026-02-20T13:21:29.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 --2- 10.20.193.28:0/1347909284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa33011e0a0 0x7fa33017ea70 unknown :-1 s=CLOSED pgs=657 gs=1 cs=0 l=1 c_cookie=1255832340365852447 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 --2- 10.20.193.28:0/1347909284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3301188a0 0x7fa33011d8f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 --2- 10.20.193.28:0/1347909284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa330117eb0 0x7fa330118280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 -- 10.20.193.28:0/1347909284 >> 10.20.193.28:0/1347909284 conn(0x7fa3300f5780 msgr2=0x7fa330115b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:29.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 -- 10.20.193.28:0/1347909284 shutdown_connections 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.879+0000 7fa32f577640 1 -- 10.20.193.28:0/1347909284 wait complete. 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.880+0000 7fa32f577640 1 Processor -- start 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.880+0000 7fa32f577640 1 -- start start 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.880+0000 7fa32f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa330117eb0 0x7fa330126800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32f577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3301188a0 0x7fa330126d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa33011e0a0 0x7fa33012c110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa33012c730 con 0x7fa33011e0a0 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32f577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa33012c8a0 con 0x7fa3301188a0 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32f577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa33012ca60 con 0x7fa330117eb0 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3301188a0 0x7fa330126d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3301188a0 0x7fa330126d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43186/0 (socket says 10.20.193.28:43186) 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 -- 10.20.193.28:0/104088398 learned_addr learned my addr 10.20.193.28:0/104088398 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32e575640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa330117eb0 0x7fa330126800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32ed76640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa33011e0a0 0x7fa33012c110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 -- 10.20.193.28:0/104088398 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa330117eb0 msgr2=0x7fa330126800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa330117eb0 0x7fa330126800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 -- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa33011e0a0 msgr2=0x7fa33012c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa33011e0a0 0x7fa33012c110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 -- 10.20.193.28:0/104088398 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32000a650 con 0x7fa3301188a0 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.881+0000 7fa32dd74640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3301188a0 0x7fa330126d40 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa318009480 tx=0x7fa31800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.882+0000 7fa3177fe640 1 -- 10.20.193.28:0/104088398 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa31800cd40 con 0x7fa3301188a0 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.882+0000 7fa3177fe640 1 -- 10.20.193.28:0/104088398 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa318004d30 con 0x7fa3301188a0 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.882+0000 7fa3177fe640 1 -- 10.20.193.28:0/104088398 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3180106b0 con 0x7fa3301188a0 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.882+0000 7fa32f577640 1 -- 10.20.193.28:0/104088398 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33012cd40 con 0x7fa3301188a0 2026-02-20T13:21:29.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.882+0000 7fa32f577640 1 -- 10.20.193.28:0/104088398 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33016d440 con 0x7fa3301188a0 2026-02-20T13:21:29.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.885+0000 7fa3177fe640 1 -- 10.20.193.28:0/104088398 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa31801f060 con 0x7fa3301188a0 2026-02-20T13:21:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.886+0000 7fa3177fe640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3080b5830 0x7fa3080d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.886+0000 7fa3177fe640 1 -- 10.20.193.28:0/104088398 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa318014070 con 0x7fa3301188a0 2026-02-20T13:21:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.886+0000 7fa32e575640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3080b5830 0x7fa3080d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa32e575640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3080b5830 0x7fa3080d5ce0 secure :-1 s=READY pgs=360 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa324004740 tx=0x7fa3240073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa336ca3e00 1 Processor -- start 2026-02-20T13:21:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa336ca3e00 1 -- start start 2026-02-20T13:21:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f1058f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f14a590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f14aad0 0x559b2f16aeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b2f01ac70 con 0x559b2f14aad0 2026-02-20T13:21:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b2f0169a0 con 0x559b2f105e30 2026-02-20T13:21:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.887+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b2f010b00 con 0x559b2f105520 2026-02-20T13:21:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f14aad0 0x559b2f16aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f14aad0 0x559b2f16aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38148/0 (socket says 10.20.193.28:38148) 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 -- 10.20.193.28:0/1426862190 learned_addr learned my addr 10.20.193.28:0/1426862190 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32e575640 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f1058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32dd74640 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 -- 10.20.193.28:0/1426862190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 msgr2=0x559b2f1058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f1058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 -- 10.20.193.28:0/1426862190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 msgr2=0x559b2f14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 -- 10.20.193.28:0/1426862190 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2efbbf80 con 0x559b2f14aad0 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32dd74640 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f14a590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa32ed76640 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f14aad0 0x559b2f16aeb0 secure :-1 s=READY pgs=658 gs=1 cs=0 l=1 c_cookie=4914054462335955522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa320006d20 tx=0x7fa320006d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44323a7f6a753242 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa314ff9640 1 -- 10.20.193.28:0/1426862190 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa32003e040 con 0x559b2f14aad0 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa314ff9640 1 -- 10.20.193.28:0/1426862190 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa320003e50 con 0x559b2f14aad0 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.888+0000 7fa314ff9640 1 -- 10.20.193.28:0/1426862190 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3200050c0 con 0x559b2f14aad0 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1426862190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f14aad0 msgr2=0x559b2f16aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f14aad0 0x559b2f16aeb0 secure :-1 s=READY pgs=658 gs=1 cs=0 l=1 c_cookie=4914054462335955522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa320006d20 tx=0x7fa320006d50 comp rx=0 tx=0).stop 2026-02-20T13:21:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1426862190 shutdown_connections 2026-02-20T13:21:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f14aad0 0x559b2f16aeb0 unknown :-1 s=CLOSED pgs=658 gs=1 cs=0 l=1 c_cookie=4914054462335955522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f14a590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1426862190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f1058f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1426862190 >> 10.20.193.28:0/1426862190 conn(0x559b2f023a60 msgr2=0x559b2f103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1426862190 shutdown_connections 2026-02-20T13:21:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.889+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1426862190 wait complete. 2026-02-20T13:21:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.890+0000 7fa336ca3e00 1 -- start start 2026-02-20T13:21:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.890+0000 7fa336ca3e00 1 Processor -- start 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.890+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f12b610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.890+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105e30 0x559b2f12bb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.890+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f14aad0 0x559b2f12a3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.890+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b2f12a8e0 con 0x559b2f105e30 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.890+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b2f12aa50 con 0x559b2f14aad0 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.890+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b2f12ac10 con 0x559b2f105520 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f12b610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105e30 0x559b2f12bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32ed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f14aad0 0x559b2f12a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f12b610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57770/0 (socket says 10.20.193.28:57770) 2026-02-20T13:21:29.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32e575640 1 -- 10.20.193.28:0/1054848641 learned_addr learned my addr 10.20.193.28:0/1054848641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32dd74640 1 -- 10.20.193.28:0/1054848641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 msgr2=0x559b2f12b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32dd74640 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f12b610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32dd74640 1 -- 10.20.193.28:0/1054848641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f14aad0 msgr2=0x559b2f12a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32dd74640 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f14aad0 0x559b2f12a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32dd74640 1 -- 10.20.193.28:0/1054848641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2ef94710 con 0x559b2f105e30 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa32dd74640 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105e30 0x559b2f12bb50 secure :-1 s=READY pgs=659 gs=1 cs=0 l=1 c_cookie=3216223735474101678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa318009230 tx=0x7fa3180a8e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca25272771d1dae server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa2dffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa2dffff640 1 -- 10.20.193.28:0/1054848641 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3180ad900 con 0x559b2f105e30 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33017f2e0 con 0x559b2f105e30 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa336ca3e00 10 client.16983 _ll_register_callbacks cb 0x559b2ef91d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559b2eca6ba0 con 0x559b2f105e30 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa2dffff640 1 -- 10.20.193.28:0/1054848641 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa3180b2c20 con 0x559b2f105e30 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa2dffff640 1 -- 10.20.193.28:0/1054848641 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3180b7e30 con 0x559b2f105e30 2026-02-20T13:21:29.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.891+0000 7fa2dffff640 1 -- 10.20.193.28:0/1054848641 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa3180ade00 con 0x559b2f105e30 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa2dffff640 1 -- 10.20.193.28:0/1054848641 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa318072090 con 0x559b2f105e30 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa336ca3e00 10 client.16983 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559b2efa6350 con 0x559b2f105e30 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa2dffff640 1 -- 10.20.193.28:0/1054848641 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa31808c070 con 0x559b2f105e30 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa336ca3e00 10 client.16983 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa336ca3e00 10 client.16983 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa336ca3e00 20 client.16983 populate_metadata read hostname 'trial028' 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b2f1306e0 0x559b2f130b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa336ca3e00 4 client.16983 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b2efe3410 con 0x559b2f1306e0 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.892+0000 7fa32e575640 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b2f1306e0 0x559b2f130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.893+0000 7fa32e575640 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b2f1306e0 0x559b2f130b80 crc :-1 s=READY pgs=146 gs=4 cs=0 l=0 c_cookie=15339189146162788844 s_cookie=3071063669979724322 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4dfbf42078f79ec server_cookie=2a9e9c22fbbfba22 in_seq=0 out_seq=0 2026-02-20T13:21:29.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.893+0000 7fa2dffff640 10 client.16983 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:29.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa2dffff640 1 -- 10.20.193.28:0/1054848641 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559b2efe3410 con 0x559b2f1306e0 2026-02-20T13:21:29.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa2dffff640 10 client.16983 handle_command_reply: tid=0 2026-02-20T13:21:29.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 client.16983 shutdown 2026-02-20T13:21:29.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105e30 msgr2=0x559b2f12bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105e30 0x559b2f12bb50 secure :-1 s=READY pgs=659 gs=1 cs=0 l=1 c_cookie=3216223735474101678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa318009230 tx=0x7fa3180a8e70 comp rx=0 tx=0).stop 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 shutdown_connections 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b2f1306e0 0x559b2f130b80 crc :-1 s=READY pgs=146 gs=4 cs=0 l=0 c_cookie=15339189146162788844 s_cookie=3071063669979724322 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105e30 0x559b2f12bb50 unknown :-1 s=CLOSED pgs=659 gs=1 cs=0 l=1 c_cookie=3216223735474101678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f14aad0 0x559b2f12a3a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1054848641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f105520 0x559b2f12b610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 >> 10.20.193.28:0/1054848641 conn(0x559b2f023a60 msgr2=0x559b2f0ecf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa2dffff640 0 client.16983 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 shutdown_connections 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1054848641 wait complete. 2026-02-20T13:21:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.894+0000 7fa336ca3e00 20 client.16983 trim_cache size 0 max 16384 2026-02-20T13:21:29.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa336ca3e00 1 Processor -- start 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa336ca3e00 1 -- start start 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f12b890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f0eff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f0f0470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b2f00e730 con 0x559b2f105520 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b2ecce960 con 0x559b2f105e30 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b2f0fe510 con 0x559b2f023a60 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.903+0000 7fa32dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f0eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f12b890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32ed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f0f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f12b890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57772/0 (socket says 10.20.193.28:57772) 2026-02-20T13:21:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32e575640 1 -- 10.20.193.28:0/1537954788 learned_addr learned my addr 10.20.193.28:0/1537954788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32dd74640 1 -- 10.20.193.28:0/1537954788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 msgr2=0x559b2f12b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32dd74640 1 --2- 10.20.193.28:0/1537954788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f12b890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32dd74640 1 -- 10.20.193.28:0/1537954788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 msgr2=0x559b2f0f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32dd74640 1 --2- 10.20.193.28:0/1537954788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f0f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32dd74640 1 -- 10.20.193.28:0/1537954788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2efa0dd0 con 0x559b2f105520 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32ed76640 1 --2- 10.20.193.28:0/1537954788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f0f0470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa32dd74640 1 --2- 10.20.193.28:0/1537954788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f0eff30 secure :-1 s=READY pgs=660 gs=1 cs=0 l=1 c_cookie=12347030840517415202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3180e46d0 tx=0x7fa31808c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab597721cfd55122 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa2fa4e6640 1 -- 10.20.193.28:0/1537954788 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3180ad900 con 0x559b2f105520 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa2fa4e6640 1 -- 10.20.193.28:0/1537954788 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559b2eca6ba0 con 0x559b2f105520 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.904+0000 7fa2fa4e6640 1 -- 10.20.193.28:0/1537954788 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa318004800 con 0x559b2f105520 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1537954788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 msgr2=0x559b2f0eff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1537954788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f0eff30 secure :-1 s=READY pgs=660 gs=1 cs=0 l=1 c_cookie=12347030840517415202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3180e46d0 tx=0x7fa31808c000 comp rx=0 tx=0).stop 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1537954788 shutdown_connections 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1537954788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f0eff30 unknown :-1 s=CLOSED pgs=660 gs=1 cs=0 l=1 c_cookie=12347030840517415202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1537954788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f0f0470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/1537954788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f12b890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1537954788 >> 10.20.193.28:0/1537954788 conn(0x559b2f104cf0 msgr2=0x559b2f12b180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1537954788 shutdown_connections 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 -- 10.20.193.28:0/1537954788 wait complete. 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 -- start start 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.905+0000 7fa336ca3e00 1 Processor -- start 2026-02-20T13:21:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f1437a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f13fd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa336ca3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f140400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b2f105b30 con 0x559b2f105520 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b2f12c150 con 0x559b2f105e30 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa336ca3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b2f140bb0 con 0x559b2f023a60 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f1437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f1437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57774/0 (socket says 10.20.193.28:57774) 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32e575640 1 -- 10.20.193.28:0/3906051077 learned_addr learned my addr 10.20.193.28:0/3906051077 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32dd74640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f13fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32ed76640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f140400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32e575640 1 -- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 msgr2=0x559b2f140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32e575640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f140400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32e575640 1 -- 10.20.193.28:0/3906051077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 msgr2=0x559b2f13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32e575640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f13fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.906+0000 7fa32e575640 1 -- 10.20.193.28:0/3906051077 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33017f2e0 con 0x559b2f023a60 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa32ed76640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f140400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa32dd74640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f13fd80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa32e575640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f1437a0 secure :-1 s=READY pgs=227 gs=2 cs=0 l=1 c_cookie=6280539722805046826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa324007e00 tx=0x7fa3240047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5728f59a27866e2a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa2dffff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa2dffff640 1 -- 10.20.193.28:0/3906051077 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa324022040 con 0x559b2f023a60 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2efbbf80 con 0x559b2f023a60 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa2dffff640 1 -- 10.20.193.28:0/3906051077 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa324015070 con 0x559b2f023a60 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa336ca3e00 10 client.26899 _ll_register_callbacks cb 0x559b2ef91d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559b2ed68700 con 0x559b2f023a60 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa2dffff640 1 -- 10.20.193.28:0/3906051077 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa324022040 con 0x559b2f023a60 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.907+0000 7fa2dffff640 1 -- 10.20.193.28:0/3906051077 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa32401c720 con 0x559b2f023a60 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa2dffff640 1 -- 10.20.193.28:0/3906051077 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa324022040 con 0x559b2f023a60 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa336ca3e00 10 client.26899 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559b2ef94a40 con 0x559b2f023a60 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa2dffff640 1 -- 10.20.193.28:0/3906051077 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa3240297d0 con 0x559b2f023a60 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa336ca3e00 10 client.26899 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa336ca3e00 10 client.26899 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa336ca3e00 20 client.26899 populate_metadata read hostname 'trial028' 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b2f14aad0 0x559b2f220dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa336ca3e00 4 client.26899 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7c533819", "release": true, "await": true}] 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7c533819", "release": true, "await": true}) -- 0x7fa320003e50 con 0x559b2f14aad0 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.908+0000 7fa32dd74640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b2f14aad0 0x559b2f220dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.909+0000 7fa32dd74640 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b2f14aad0 0x559b2f220dc0 crc :-1 s=READY pgs=147 gs=4 cs=0 l=0 c_cookie=6323268743333535791 s_cookie=12631092729980668488 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57c0c36b81b9e02f server_cookie=af4aa7ea5f844a48 in_seq=0 out_seq=0 2026-02-20T13:21:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.909+0000 7fa2dffff640 10 client.26899 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:29.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa2dffff640 1 -- 10.20.193.28:0/3906051077 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fa320003e50 con 0x559b2f14aad0 2026-02-20T13:21:29.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa2dffff640 10 client.26899 handle_command_reply: tid=0 2026-02-20T13:21:29.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 client.26899 shutdown 2026-02-20T13:21:29.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 msgr2=0x559b2f1437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f1437a0 secure :-1 s=READY pgs=227 gs=2 cs=0 l=1 c_cookie=6280539722805046826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa324007e00 tx=0x7fa3240047e0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 shutdown_connections 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b2f14aad0 0x559b2f220dc0 crc :-1 s=READY pgs=147 gs=4 cs=0 l=0 c_cookie=6323268743333535791 s_cookie=12631092729980668488 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b2f105520 0x559b2f13fd80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b2f105e30 0x559b2f140400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 --2- 10.20.193.28:0/3906051077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b2f023a60 0x559b2f1437a0 unknown :-1 s=CLOSED pgs=227 gs=2 cs=0 l=1 c_cookie=6280539722805046826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 >> 10.20.193.28:0/3906051077 conn(0x559b2f104cf0 msgr2=0x559b2f12b970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa2dffff640 0 client.26899 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 shutdown_connections 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 1 -- 10.20.193.28:0/3906051077 wait complete. 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.911+0000 7fa336ca3e00 20 client.26899 trim_cache size 0 max 16384 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:21:29.914 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 16, 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "7c533819": { 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "version": 16, 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 148.1, 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:29.915 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 -- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3080b5830 msgr2=0x7fa3080d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3080b5830 0x7fa3080d5ce0 secure :-1 s=READY pgs=360 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa324004740 tx=0x7fa3240073d0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 -- 10.20.193.28:0/104088398 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3301188a0 msgr2=0x7fa330126d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3301188a0 0x7fa330126d40 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa318009480 tx=0x7fa31800ee60 comp rx=0 tx=0).stop 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 -- 10.20.193.28:0/104088398 shutdown_connections 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3080b5830 0x7fa3080d5ce0 unknown :-1 s=CLOSED pgs=360 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa33011e0a0 0x7fa33012c110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3301188a0 0x7fa330126d40 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 --2- 10.20.193.28:0/104088398 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa330117eb0 0x7fa330126800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 -- 10.20.193.28:0/104088398 >> 10.20.193.28:0/104088398 conn(0x7fa3300f5780 msgr2=0x7fa330115b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 -- 10.20.193.28:0/104088398 shutdown_connections 2026-02-20T13:21:29.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:29.912+0000 7fa32f577640 1 -- 10.20.193.28:0/104088398 wait complete. 2026-02-20T13:21:29.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:29 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1151621233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:29.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:29 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1151621233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:30.012 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7c533819', total seconds elapsed: 29.3 2026-02-20T13:21:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:30 trial028 ceph-mon[37442]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-20T13:21:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:30 trial127 ceph-mon[43817]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-20T13:21:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:30 trial034 ceph-mon[43332]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-20T13:21:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:32 trial028 ceph-mon[37442]: pgmap v307: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:21:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:32 trial127 ceph-mon[43817]: pgmap v307: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:21:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:32 trial034 ceph-mon[43332]: pgmap v307: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:21:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:34 trial028 ceph-mon[37442]: pgmap v308: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-20T13:21:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:34 trial127 ceph-mon[43817]: pgmap v308: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-20T13:21:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:34 trial034 ceph-mon[43332]: pgmap v308: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-20T13:21:36.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:36 trial028 ceph-mon[37442]: pgmap v309: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:21:36.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:36 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:21:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:36 trial127 ceph-mon[43817]: pgmap v309: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:21:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:36 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:21:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:36 trial034 ceph-mon[43332]: pgmap v309: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:21:36.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:36 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:21:37.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.377+0000 7ffa81e83640 1 -- 10.20.193.28:0/4040788086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c10e940 msgr2=0x7ffa7c10edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.377+0000 7ffa81e83640 1 --2- 10.20.193.28:0/4040788086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c10e940 0x7ffa7c10edb0 secure :-1 s=READY pgs=661 gs=1 cs=0 l=1 c_cookie=8971642531958927444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa64009980 tx=0x7ffa6402f1d0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 -- 10.20.193.28:0/4040788086 shutdown_connections 2026-02-20T13:21:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 --2- 10.20.193.28:0/4040788086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c10e940 0x7ffa7c10edb0 unknown :-1 s=CLOSED pgs=661 gs=1 cs=0 l=1 c_cookie=8971642531958927444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 --2- 10.20.193.28:0/4040788086 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa7c10f2f0 0x7ffa7c171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 --2- 10.20.193.28:0/4040788086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa7c1100b0 0x7ffa7c1104a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 -- 10.20.193.28:0/4040788086 >> 10.20.193.28:0/4040788086 conn(0x7ffa7c0ec320 msgr2=0x7ffa7c10c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 -- 10.20.193.28:0/4040788086 shutdown_connections 2026-02-20T13:21:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 -- 10.20.193.28:0/4040788086 wait complete. 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 Processor -- start 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.378+0000 7ffa81e83640 1 -- start start 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81e83640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa7c10e940 0x7ffa7c0f8240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81e83640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa7c10f2f0 0x7ffa7c171060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81e83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c1100b0 0x7ffa7c0f8a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81e83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c0f96e0 con 0x7ffa7c1100b0 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81e83640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c0f9850 con 0x7ffa7c10f2f0 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81e83640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c0f9a10 con 0x7ffa7c10e940 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c1100b0 0x7ffa7c0f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c1100b0 0x7ffa7c0f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52990/0 (socket says 10.20.193.28:52990) 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 -- 10.20.193.28:0/3433910237 learned_addr learned my addr 10.20.193.28:0/3433910237 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:37.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 -- 10.20.193.28:0/3433910237 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa7c10e940 msgr2=0x7ffa7c0f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa7c10e940 0x7ffa7c0f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 -- 10.20.193.28:0/3433910237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa7c10f2f0 msgr2=0x7ffa7c171060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa73fff640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa7c10f2f0 0x7ffa7c171060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa7c10f2f0 0x7ffa7c171060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 -- 10.20.193.28:0/3433910237 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa64009570 con 0x7ffa7c1100b0 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa73fff640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa7c10f2f0 0x7ffa7c171060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81682640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c1100b0 0x7ffa7c0f8a80 secure :-1 s=READY pgs=662 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa78006e90 tx=0x7ffa7800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa71ffb640 1 -- 10.20.193.28:0/3433910237 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa78005500 con 0x7ffa7c1100b0 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa71ffb640 1 -- 10.20.193.28:0/3433910237 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa78005e10 con 0x7ffa7c1100b0 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa71ffb640 1 -- 10.20.193.28:0/3433910237 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa78003a90 con 0x7ffa7c1100b0 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.379+0000 7ffa81e83640 1 -- 10.20.193.28:0/3433910237 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7c0f9cf0 con 0x7ffa7c1100b0 2026-02-20T13:21:37.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.380+0000 7ffa81e83640 1 -- 10.20.193.28:0/3433910237 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7c0fa170 con 0x7ffa7c1100b0 2026-02-20T13:21:37.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.382+0000 7ffa71ffb640 1 -- 10.20.193.28:0/3433910237 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ffa7800c840 con 0x7ffa7c1100b0 2026-02-20T13:21:37.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.384+0000 7ffa71ffb640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffa580b56e0 0x7ffa580d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.384+0000 7ffa71ffb640 1 -- 10.20.193.28:0/3433910237 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ffa780e7950 con 0x7ffa7c1100b0 2026-02-20T13:21:37.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.384+0000 7ffa80e81640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffa580b56e0 0x7ffa580d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.384+0000 7ffa80e81640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffa580b56e0 0x7ffa580d5b90 secure :-1 s=READY pgs=361 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa6c005970 tx=0x7ffa6c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa857e1e00 1 Processor -- start 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa857e1e00 1 -- start start 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b388a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b38de0 0x5627f1b591c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b79ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5627f1a2dfd0 con 0x5627f1b59700 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5627f1a29d00 con 0x5627f1b38de0 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5627f1a23ca0 con 0x5627f1b184c0 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa81682640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b79ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa81682640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b79ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52994/0 (socket says 10.20.193.28:52994) 2026-02-20T13:21:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa81682640 1 -- 10.20.193.28:0/3455858205 learned_addr learned my addr 10.20.193.28:0/3455858205 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa80e81640 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa73fff640 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b38de0 0x5627f1b591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa81682640 1 -- 10.20.193.28:0/3455858205 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 msgr2=0x5627f1b388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa81682640 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa81682640 1 -- 10.20.193.28:0/3455858205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b38de0 msgr2=0x5627f1b591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa81682640 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b38de0 0x5627f1b591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.385+0000 7ffa81682640 1 -- 10.20.193.28:0/3455858205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f19c68b0 con 0x5627f1b59700 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa81682640 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b79ae0 secure :-1 s=READY pgs=663 gs=3 cs=0 l=1 c_cookie=3777632381416161585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa780e5420 tx=0x7ffa780aa3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346cd8a2da52c131 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa493fe640 1 -- 10.20.193.28:0/3455858205 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa780ad4b0 con 0x5627f1b59700 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa493fe640 1 -- 10.20.193.28:0/3455858205 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa780ae6b0 con 0x5627f1b59700 2026-02-20T13:21:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa493fe640 1 -- 10.20.193.28:0/3455858205 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa780ad850 con 0x5627f1b59700 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3455858205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 msgr2=0x5627f1b79ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b79ae0 secure :-1 s=READY pgs=663 gs=3 cs=0 l=1 c_cookie=3777632381416161585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa780e5420 tx=0x7ffa780aa3d0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3455858205 shutdown_connections 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b79ae0 unknown :-1 s=CLOSED pgs=663 gs=3 cs=0 l=1 c_cookie=3777632381416161585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b38de0 0x5627f1b591c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/3455858205 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b388a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3455858205 >> 10.20.193.28:0/3455858205 conn(0x5627f1a371c0 msgr2=0x5627f1b16da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3455858205 shutdown_connections 2026-02-20T13:21:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.386+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3455858205 wait complete. 2026-02-20T13:21:37.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa857e1e00 1 -- start start 2026-02-20T13:21:37.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa857e1e00 1 Processor -- start 2026-02-20T13:21:37.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b31b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b321a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b59700 0x5627f1b32c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5627f1b33260 con 0x5627f1b38de0 2026-02-20T13:21:37.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5627f1b333d0 con 0x5627f1b184c0 2026-02-20T13:21:37.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5627f1b33590 con 0x5627f1b59700 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa80e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b31b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa73fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b321a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa80e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b31b50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54476/0 (socket says 10.20.193.28:54476) 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa80e81640 1 -- 10.20.193.28:0/4017726479 learned_addr learned my addr 10.20.193.28:0/4017726479 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa81682640 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b59700 0x5627f1b32c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa73fff640 1 -- 10.20.193.28:0/4017726479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b59700 msgr2=0x5627f1b32c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.388+0000 7ffa73fff640 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b59700 0x5627f1b32c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa73fff640 1 -- 10.20.193.28:0/4017726479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 msgr2=0x5627f1b31b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa73fff640 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b31b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa73fff640 1 -- 10.20.193.28:0/4017726479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f19cf400 con 0x5627f1b38de0 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa80e81640 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b31b50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:37.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa73fff640 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b321a0 secure :-1 s=READY pgs=664 gs=2 cs=0 l=1 c_cookie=7951897530823495886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5627f1adc450 tx=0x7ffa64004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5ad0ac5f0a50ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa3a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/4017726479 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa640043e0 con 0x5627f1b38de0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/4017726479 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa64040040 con 0x5627f1b38de0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/4017726479 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa64044670 con 0x5627f1b38de0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7c0fa170 con 0x5627f1b38de0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa857e1e00 10 client.17001 _ll_register_callbacks cb 0x5627f19aea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5627f16c3520 con 0x5627f1b38de0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/4017726479 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ffa64002e20 con 0x5627f1b38de0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/4017726479 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa64038920 con 0x5627f1b38de0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa857e1e00 10 client.17001 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.389+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5627f19a7da0 con 0x5627f1b38de0 2026-02-20T13:21:37.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.390+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/4017726479 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffa6402f9f0 con 0x5627f1b38de0 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.390+0000 7ffa857e1e00 10 client.17001 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.390+0000 7ffa857e1e00 10 client.17001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.390+0000 7ffa857e1e00 20 client.17001 populate_metadata read hostname 'trial028' 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.390+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5627f1b36300 0x5627f1b367a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.390+0000 7ffa857e1e00 4 client.17001 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.390+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627f1a55630 con 0x5627f1b36300 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.390+0000 7ffa80e81640 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5627f1b36300 0x5627f1b367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.391+0000 7ffa80e81640 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5627f1b36300 0x5627f1b367a0 crc :-1 s=READY pgs=148 gs=4 cs=0 l=0 c_cookie=12013432592461809890 s_cookie=9155147942486836399 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b8494afec948e2 server_cookie=7f0d9e8c321384af in_seq=0 out_seq=0 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.391+0000 7ffa3a7fc640 10 client.17001 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.391+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/4017726479 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5627f1a55630 con 0x5627f1b36300 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.391+0000 7ffa3a7fc640 10 client.17001 handle_command_reply: tid=0 2026-02-20T13:21:37.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.391+0000 7ffa857e1e00 1 client.17001 shutdown 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.391+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 msgr2=0x5627f1b321a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.391+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b321a0 secure :-1 s=READY pgs=664 gs=2 cs=0 l=1 c_cookie=7951897530823495886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5627f1adc450 tx=0x7ffa64004270 comp rx=0 tx=0).stop 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 shutdown_connections 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5627f1b36300 0x5627f1b367a0 crc :-1 s=READY pgs=148 gs=4 cs=0 l=0 c_cookie=12013432592461809890 s_cookie=9155147942486836399 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b321a0 unknown :-1 s=CLOSED pgs=664 gs=2 cs=0 l=1 c_cookie=7951897530823495886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b59700 0x5627f1b32c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/4017726479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b31b50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 >> 10.20.193.28:0/4017726479 conn(0x5627f1a371c0 msgr2=0x5627f1b19790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa3a7fc640 0 client.17001 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 shutdown_connections 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 1 -- 10.20.193.28:0/4017726479 wait complete. 2026-02-20T13:21:37.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.392+0000 7ffa857e1e00 20 client.17001 trim_cache size 0 max 16384 2026-02-20T13:21:37.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa857e1e00 1 Processor -- start 2026-02-20T13:21:37.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa857e1e00 1 -- start start 2026-02-20T13:21:37.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b32260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b2ee80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b59700 0x5627f1b2f3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5627f1a218d0 con 0x5627f1b38de0 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5627f1762f10 con 0x5627f1b59700 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5627f1b336d0 con 0x5627f1b184c0 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa73fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b2ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.399+0000 7ffa80e81640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b32260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa80e81640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b32260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48054/0 (socket says 10.20.193.28:48054) 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa80e81640 1 -- 10.20.193.28:0/3364304243 learned_addr learned my addr 10.20.193.28:0/3364304243 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa81682640 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b59700 0x5627f1b2f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa73fff640 1 -- 10.20.193.28:0/3364304243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 msgr2=0x5627f1b32260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:37.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa73fff640 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b32260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa73fff640 1 -- 10.20.193.28:0/3364304243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b59700 msgr2=0x5627f1b2f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa73fff640 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b59700 0x5627f1b2f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa73fff640 1 -- 10.20.193.28:0/3364304243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f19b9670 con 0x5627f1b38de0 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa81682640 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b59700 0x5627f1b2f3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa73fff640 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b2ee80 secure :-1 s=READY pgs=665 gs=2 cs=0 l=1 c_cookie=12460287239844990804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa6402ff60 tx=0x7ffa6404b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acebd53a2a4b0f54 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa48bfd640 1 -- 10.20.193.28:0/3364304243 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa6404b310 con 0x5627f1b38de0 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa48bfd640 1 -- 10.20.193.28:0/3364304243 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa64040040 con 0x5627f1b38de0 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa48bfd640 1 -- 10.20.193.28:0/3364304243 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa64038d70 con 0x5627f1b38de0 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3364304243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 msgr2=0x5627f1b2ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b2ee80 secure :-1 s=READY pgs=665 gs=2 cs=0 l=1 c_cookie=12460287239844990804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa6402ff60 tx=0x7ffa6404b000 comp rx=0 tx=0).stop 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3364304243 shutdown_connections 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b38de0 0x5627f1b2ee80 unknown :-1 s=CLOSED pgs=665 gs=2 cs=0 l=1 c_cookie=12460287239844990804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b59700 0x5627f1b2f3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/3364304243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b184c0 0x5627f1b32260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3364304243 >> 10.20.193.28:0/3364304243 conn(0x5627f1a371c0 msgr2=0x5627f1b31b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3364304243 shutdown_connections 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.400+0000 7ffa857e1e00 1 -- 10.20.193.28:0/3364304243 wait complete. 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa857e1e00 1 -- start start 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa857e1e00 1 Processor -- start 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b37dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b38de0 0x5627f1b38440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa857e1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b391b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5627f1b1f250 con 0x5627f1b59700 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5627f1b396f0 con 0x5627f1b184c0 2026-02-20T13:21:37.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa857e1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5627f1b398b0 con 0x5627f1b38de0 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa80e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b37dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa73fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b38de0 0x5627f1b38440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa80e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b37dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54494/0 (socket says 10.20.193.28:54494) 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa80e81640 1 -- 10.20.193.28:0/488158239 learned_addr learned my addr 10.20.193.28:0/488158239 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.401+0000 7ffa81682640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa80e81640 1 -- 10.20.193.28:0/488158239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b38de0 msgr2=0x5627f1b38440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa80e81640 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b38de0 0x5627f1b38440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa80e81640 1 -- 10.20.193.28:0/488158239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 msgr2=0x5627f1b391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa80e81640 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b391b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa80e81640 1 -- 10.20.193.28:0/488158239 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f19b40f0 con 0x5627f1b184c0 2026-02-20T13:21:37.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa81682640 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b391b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:37.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa80e81640 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b37dc0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=6101367469971455671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa6c0096a0 tx=0x7ffa6c005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ac696333c5beb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:37.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa3a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:21:37.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/488158239 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa6c015040 con 0x5627f1b184c0 2026-02-20T13:21:37.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f19a7da0 con 0x5627f1b184c0 2026-02-20T13:21:37.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa857e1e00 10 client.26984 _ll_register_callbacks cb 0x5627f19aea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/488158239 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa6c027040 con 0x5627f1b184c0 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/488158239 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa6c01f6d0 con 0x5627f1b184c0 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5627f1ad3ca0 con 0x5627f1b184c0 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.402+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/488158239 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ffa6c01f830 con 0x5627f1b184c0 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/488158239 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa6c01fa40 con 0x5627f1b184c0 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa857e1e00 10 client.26984 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5627f19a80d0 con 0x5627f1b184c0 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/488158239 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffa6c01b040 con 0x5627f1b184c0 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa857e1e00 10 client.26984 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa857e1e00 10 client.26984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa857e1e00 20 client.26984 populate_metadata read hostname 'trial028' 2026-02-20T13:21:37.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5627f1b3b910 0x5627f1b3bdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa857e1e00 4 client.26984 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5627f1707640 con 0x5627f1b3b910 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.403+0000 7ffa73fff640 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5627f1b3b910 0x5627f1b3bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.404+0000 7ffa73fff640 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5627f1b3b910 0x5627f1b3bdb0 crc :-1 s=READY pgs=149 gs=4 cs=0 l=0 c_cookie=1812203738377538097 s_cookie=8806299121178289613 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19263db2d6a0ca31 server_cookie=7a36426497aaa5cd in_seq=0 out_seq=0 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.404+0000 7ffa3a7fc640 10 client.26984 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa3a7fc640 1 -- 10.20.193.28:0/488158239 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5627f1707640 con 0x5627f1b3b910 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa3a7fc640 10 client.26984 handle_command_reply: tid=0 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 client.26984 shutdown 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 msgr2=0x5627f1b37dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b37dc0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=6101367469971455671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa6c0096a0 tx=0x7ffa6c005d40 comp rx=0 tx=0).stop 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 shutdown_connections 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5627f1b3b910 0x5627f1b3bdb0 crc :-1 s=READY pgs=149 gs=4 cs=0 l=0 c_cookie=1812203738377538097 s_cookie=8806299121178289613 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627f1b59700 0x5627f1b391b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5627f1b38de0 0x5627f1b38440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 --2- 10.20.193.28:0/488158239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5627f1b184c0 0x5627f1b37dc0 unknown :-1 s=CLOSED pgs=275 gs=1 cs=0 l=1 c_cookie=6101367469971455671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa3a7fc640 0 client.26984 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:37.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 >> 10.20.193.28:0/488158239 conn(0x5627f1a371c0 msgr2=0x5627f1b2de70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:37.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 shutdown_connections 2026-02-20T13:21:37.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 1 -- 10.20.193.28:0/488158239 wait complete. 2026-02-20T13:21:37.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa857e1e00 20 client.26984 trim_cache size 0 max 16384 2026-02-20T13:21:37.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:21:37.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:21:37.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:21:37.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:21:37.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 -- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffa580b56e0 msgr2=0x7ffa580d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffa580b56e0 0x7ffa580d5b90 secure :-1 s=READY pgs=361 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa6c005970 tx=0x7ffa6c005900 comp rx=0 tx=0).stop 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 -- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c1100b0 msgr2=0x7ffa7c0f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c1100b0 0x7ffa7c0f8a80 secure :-1 s=READY pgs=662 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa78006e90 tx=0x7ffa7800edf0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 -- 10.20.193.28:0/3433910237 shutdown_connections 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ffa580b56e0 0x7ffa580d5b90 unknown :-1 s=CLOSED pgs=361 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa7c1100b0 0x7ffa7c0f8a80 unknown :-1 s=CLOSED pgs=662 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ffa7c10f2f0 0x7ffa7c171060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 --2- 10.20.193.28:0/3433910237 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa7c10e940 0x7ffa7c0f8240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 -- 10.20.193.28:0/3433910237 >> 10.20.193.28:0/3433910237 conn(0x7ffa7c0ec320 msgr2=0x7ffa7c0ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 -- 10.20.193.28:0/3433910237 shutdown_connections 2026-02-20T13:21:37.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:37.408+0000 7ffa81e83640 1 -- 10.20.193.28:0/3433910237 wait complete. 2026-02-20T13:21:37.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:21:37.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:21:37.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:21:37.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:21:37.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:21:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:21:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:21:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:21:37.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:21:37.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:21:37.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:21:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:21:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:38 trial028 ceph-mon[37442]: pgmap v310: 97 pgs: 97 active+clean; 2.3 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 7.8 KiB/s wr, 14 op/s 2026-02-20T13:21:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:38 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:21:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:38 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:21:38.945 INFO:tasks.workunit.client.0.trial028.stdout:64/600: open fd = 3 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:65/600: open fd = 3 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:66/600: open fd = 3 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.946 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:67/600: open fd = 3 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:68/600: open fd = 3 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:69/600: open fd = 3 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.947 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:70/600: open fd = 3 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:71/600: open fd = 3 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:72/600: open fd = 3 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.948 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:73/600: open fd = 3 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:74/600: open fd = 3 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:75/600: open fd = 3 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.949 INFO:tasks.workunit.client.0.trial028.stdout:76/600: open fd = 3 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:77/600: open fd = 3 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:78/600: open fd = 3 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:79/600: open fd = 3 2026-02-20T13:21:38.950 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:80/600: open fd = 3 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:81/600: open fd = 3 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:82/600: open fd = 3 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.951 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:83/600: open fd = 3 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:84/600: open fd = 3 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:85/600: open fd = 3 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.952 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:86/600: open fd = 3 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:87/600: open fd = 3 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:88/600: open fd = 3 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.953 INFO:tasks.workunit.client.0.trial028.stdout:89/600: open fd = 3 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:90/600: open fd = 3 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:91/600: open fd = 3 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:92/600: open fd = 3 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.954 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:93/600: open fd = 3 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:94/600: open fd = 3 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:95/600: open fd = 3 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.955 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:96/600: open fd = 3 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:97/600: open fd = 3 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:98/600: open fd = 3 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.956 INFO:tasks.workunit.client.0.trial028.stdout:99/600: open fd = 3 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:100/600: open fd = 3 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:101/600: open fd = 3 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:102/600: open fd = 3 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.957 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:103/600: open fd = 3 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:104/600: open fd = 3 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:105/600: open fd = 3 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.958 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:106/600: open fd = 3 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:107/600: open fd = 3 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:108/600: open fd = 3 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:109/600: open fd = 3 2026-02-20T13:21:38.959 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:110/600: open fd = 3 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:111/600: open fd = 3 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:112/600: open fd = 3 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.960 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:113/600: open fd = 3 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:114/600: open fd = 3 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:115/600: open fd = 3 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.961 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:116/600: open fd = 3 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:117/600: open fd = 3 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:118/600: open fd = 3 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:119/600: open fd = 3 2026-02-20T13:21:38.962 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:120/600: open fd = 3 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:121/600: open fd = 3 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:122/600: open fd = 3 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.963 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:123/600: open fd = 3 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:124/600: open fd = 3 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:125/600: open fd = 3 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:21:38.964 INFO:tasks.workunit.client.0.trial028.stdout:126/600: open fd = 3 2026-02-20T13:21:38.965 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:21:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:38 trial127 ceph-mon[43817]: pgmap v310: 97 pgs: 97 active+clean; 2.3 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 7.8 KiB/s wr, 14 op/s 2026-02-20T13:21:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:38 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:21:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:38 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:21:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:38 trial034 ceph-mon[43332]: pgmap v310: 97 pgs: 97 active+clean; 2.3 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 7.8 KiB/s wr, 14 op/s 2026-02-20T13:21:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:38 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:21:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:38 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:21:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:40 trial028 ceph-mon[37442]: pgmap v311: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2026-02-20T13:21:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:40 trial127 ceph-mon[43817]: pgmap v311: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2026-02-20T13:21:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:40 trial034 ceph-mon[43332]: pgmap v311: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2026-02-20T13:21:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:42 trial028 ceph-mon[37442]: pgmap v312: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2026-02-20T13:21:42.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:42 trial127 ceph-mon[43817]: pgmap v312: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2026-02-20T13:21:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:42 trial034 ceph-mon[43332]: pgmap v312: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2026-02-20T13:21:44.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:44 trial028 ceph-mon[37442]: pgmap v313: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:21:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:44 trial127 ceph-mon[43817]: pgmap v313: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:21:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:44 trial034 ceph-mon[43332]: pgmap v313: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:21:46.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:46 trial028 ceph-mon[37442]: pgmap v314: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:21:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:46 trial127 ceph-mon[43817]: pgmap v314: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:21:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:46 trial034 ceph-mon[43332]: pgmap v314: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:21:48.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:48 trial028 ceph-mon[37442]: pgmap v315: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:21:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:48 trial127 ceph-mon[43817]: pgmap v315: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:21:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:48 trial034 ceph-mon[43332]: pgmap v315: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:21:50.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 -- 10.20.193.28:0/441941473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95601100b0 msgr2=0x7f95601104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 --2- 10.20.193.28:0/441941473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95601100b0 0x7f95601104a0 secure :-1 s=READY pgs=666 gs=1 cs=0 l=1 c_cookie=7571861737264362460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9554009980 tx=0x7f955402f190 comp rx=0 tx=0).stop 2026-02-20T13:21:50.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 -- 10.20.193.28:0/441941473 shutdown_connections 2026-02-20T13:21:50.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 --2- 10.20.193.28:0/441941473 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f956010f2f0 0x7f9560171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 --2- 10.20.193.28:0/441941473 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f956010e940 0x7f956010edb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 --2- 10.20.193.28:0/441941473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95601100b0 0x7f95601104a0 unknown :-1 s=CLOSED pgs=666 gs=1 cs=0 l=1 c_cookie=7571861737264362460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 -- 10.20.193.28:0/441941473 >> 10.20.193.28:0/441941473 conn(0x7f95600ec320 msgr2=0x7f956010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 -- 10.20.193.28:0/441941473 shutdown_connections 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.481+0000 7f955f577640 1 -- 10.20.193.28:0/441941473 wait complete. 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955f577640 1 Processor -- start 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955f577640 1 -- start start 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955f577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f956010e940 0x7f95600f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f956010f2f0 0x7f9560171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95601100b0 0x7f95600f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f95600f96a0 con 0x7f956010f2f0 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955f577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f95600f9810 con 0x7f956010e940 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955f577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f95600f99d0 con 0x7f95601100b0 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f956010f2f0 0x7f9560171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f956010e940 0x7f95600f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f956010f2f0 0x7f9560171080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53562/0 (socket says 10.20.193.28:53562) 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955dd74640 1 -- 10.20.193.28:0/734240253 learned_addr learned my addr 10.20.193.28:0/734240253 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955ed76640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95601100b0 0x7f95600f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955dd74640 1 -- 10.20.193.28:0/734240253 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95601100b0 msgr2=0x7f95600f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955dd74640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95601100b0 0x7f95600f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955dd74640 1 -- 10.20.193.28:0/734240253 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f956010e940 msgr2=0x7f95600f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955dd74640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f956010e940 0x7f95600f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955dd74640 1 -- 10.20.193.28:0/734240253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9554009570 con 0x7f956010f2f0 2026-02-20T13:21:50.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.482+0000 7f955ed76640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95601100b0 0x7f95600f8ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:50.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.483+0000 7f955dd74640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f956010f2f0 0x7f9560171080 secure :-1 s=READY pgs=667 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9548005db0 tx=0x7f954800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:50.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.483+0000 7f95477fe640 1 -- 10.20.193.28:0/734240253 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9548004500 con 0x7f956010f2f0 2026-02-20T13:21:50.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.483+0000 7f95477fe640 1 -- 10.20.193.28:0/734240253 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9548004d30 con 0x7f956010f2f0 2026-02-20T13:21:50.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.483+0000 7f95477fe640 1 -- 10.20.193.28:0/734240253 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95480053c0 con 0x7f956010f2f0 2026-02-20T13:21:50.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.483+0000 7f955f577640 1 -- 10.20.193.28:0/734240253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95600f9cb0 con 0x7f956010f2f0 2026-02-20T13:21:50.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.483+0000 7f955f577640 1 -- 10.20.193.28:0/734240253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95600fa130 con 0x7f956010f2f0 2026-02-20T13:21:50.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.486+0000 7f95477fe640 1 -- 10.20.193.28:0/734240253 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9548020020 con 0x7f956010f2f0 2026-02-20T13:21:50.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.487+0000 7f95477fe640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95380b5760 0x7f95380d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.487+0000 7f95477fe640 1 -- 10.20.193.28:0/734240253 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f95480e6590 con 0x7f956010f2f0 2026-02-20T13:21:50.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.487+0000 7f955e575640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95380b5760 0x7f95380d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f955e575640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95380b5760 0x7f95380d5c10 secure :-1 s=READY pgs=362 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9554002d80 tx=0x7f955403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f956705ae00 1 Processor -- start 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f956705ae00 1 -- start start 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f956705ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f956705ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b6d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f956705ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 0x55a3c6b8dae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f956705ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6a41fd0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f956705ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6a3dd00 con 0x55a3c6b4cde0 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.488+0000 7f956705ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6a37ca0 con 0x55a3c6b6d700 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53568/0 (socket says 10.20.193.28:53568) 2026-02-20T13:21:50.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 -- 10.20.193.28:0/4255055552 learned_addr learned my addr 10.20.193.28:0/4255055552 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955dd74640 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b6d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955ed76640 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 0x55a3c6b8dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 -- 10.20.193.28:0/4255055552 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 msgr2=0x55a3c6b8dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 0x55a3c6b8dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 -- 10.20.193.28:0/4255055552 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 msgr2=0x55a3c6b6d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b6d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 -- 10.20.193.28:0/4255055552 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c69da8b0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f955e575640 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4c8a0 secure :-1 s=READY pgs=668 gs=1 cs=0 l=1 c_cookie=3797247448690014229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f955402f6a0 tx=0x7f9554040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b2886f976d3815 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f9544bfe640 1 -- 10.20.193.28:0/4255055552 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f955402fc10 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f9544bfe640 1 -- 10.20.193.28:0/4255055552 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f955403e040 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f9544bfe640 1 -- 10.20.193.28:0/4255055552 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f955404fa30 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f956705ae00 1 -- 10.20.193.28:0/4255055552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 msgr2=0x55a3c6b4c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.489+0000 7f956705ae00 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4c8a0 secure :-1 s=READY pgs=668 gs=1 cs=0 l=1 c_cookie=3797247448690014229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f955402f6a0 tx=0x7f9554040000 comp rx=0 tx=0).stop 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.490+0000 7f956705ae00 1 -- 10.20.193.28:0/4255055552 shutdown_connections 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.490+0000 7f956705ae00 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 0x55a3c6b8dae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.490+0000 7f956705ae00 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b6d1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.490+0000 7f956705ae00 1 --2- 10.20.193.28:0/4255055552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4c8a0 unknown :-1 s=CLOSED pgs=668 gs=1 cs=0 l=1 c_cookie=3797247448690014229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.490+0000 7f956705ae00 1 -- 10.20.193.28:0/4255055552 >> 10.20.193.28:0/4255055552 conn(0x55a3c6a4b1c0 msgr2=0x55a3c6b2ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.490+0000 7f956705ae00 1 -- 10.20.193.28:0/4255055552 shutdown_connections 2026-02-20T13:21:50.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.490+0000 7f956705ae00 1 -- 10.20.193.28:0/4255055552 wait complete. 2026-02-20T13:21:50.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.491+0000 7f956705ae00 1 -- start start 2026-02-20T13:21:50.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.491+0000 7f956705ae00 1 Processor -- start 2026-02-20T13:21:50.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b45a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b460b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 0x55a3c6b46b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6b47170 con 0x55a3c6b4cde0 2026-02-20T13:21:50.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6b472e0 con 0x55a3c6b6d700 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6b474a0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53578/0 (socket says 10.20.193.28:53578) 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 -- 10.20.193.28:0/2704672105 learned_addr learned my addr 10.20.193.28:0/2704672105 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955e575640 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b45a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955ed76640 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 0x55a3c6b46b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 -- 10.20.193.28:0/2704672105 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b2c4c0 msgr2=0x55a3c6b45a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b45a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 -- 10.20.193.28:0/2704672105 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 msgr2=0x55a3c6b46b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 0x55a3c6b46b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 -- 10.20.193.28:0/2704672105 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c69e3400 con 0x55a3c6b4cde0 2026-02-20T13:21:50.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f955dd74640 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b460b0 secure :-1 s=READY pgs=669 gs=1 cs=0 l=1 c_cookie=13965562336429318189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95480ac8d0 tx=0x7f95480acaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cfa4f3c771a02d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f950ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f950ffff640 1 -- 10.20.193.28:0/2704672105 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9548009740 con 0x55a3c6b4cde0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9560171ae0 con 0x55a3c6b4cde0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f950ffff640 1 -- 10.20.193.28:0/2704672105 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f95480b2610 con 0x55a3c6b4cde0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f950ffff640 1 -- 10.20.193.28:0/2704672105 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95480ad800 con 0x55a3c6b4cde0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 10 client.17019 _ll_register_callbacks cb 0x55a3c69c2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.492+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3c66d7520 con 0x55a3c6b4cde0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f950ffff640 1 -- 10.20.193.28:0/2704672105 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f95480b7a30 con 0x55a3c6b4cde0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f950ffff640 1 -- 10.20.193.28:0/2704672105 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95480b2440 con 0x55a3c6b4cde0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f956705ae00 10 client.17019 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a3c69bbda0 con 0x55a3c6b4cde0 2026-02-20T13:21:50.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f950ffff640 1 -- 10.20.193.28:0/2704672105 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f95480b75a0 con 0x55a3c6b4cde0 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f956705ae00 10 client.17019 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f956705ae00 10 client.17019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f956705ae00 20 client.17019 populate_metadata read hostname 'trial028' 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f956705ae00 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3c6b4a030 0x55a3c6b4a4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f956705ae00 4 client.17019 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.493+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3c6a69630 con 0x55a3c6b4a030 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.494+0000 7f955e575640 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3c6b4a030 0x55a3c6b4a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f955e575640 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3c6b4a030 0x55a3c6b4a4d0 crc :-1 s=READY pgs=150 gs=4 cs=0 l=0 c_cookie=18392210571758020392 s_cookie=12749800632223519306 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff3e4211a3d22728 server_cookie=b0f0641fa8bbd24a in_seq=0 out_seq=0 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f950ffff640 10 client.17019 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f950ffff640 1 -- 10.20.193.28:0/2704672105 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a3c6a69630 con 0x55a3c6b4a030 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f950ffff640 10 client.17019 handle_command_reply: tid=0 2026-02-20T13:21:50.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 client.17019 shutdown 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b4cde0 msgr2=0x55a3c6b460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b460b0 secure :-1 s=READY pgs=669 gs=1 cs=0 l=1 c_cookie=13965562336429318189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95480ac8d0 tx=0x7f95480acaa0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 shutdown_connections 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3c6b4a030 0x55a3c6b4a4d0 crc :-1 s=READY pgs=150 gs=4 cs=0 l=0 c_cookie=18392210571758020392 s_cookie=12749800632223519306 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b460b0 unknown :-1 s=CLOSED pgs=669 gs=1 cs=0 l=1 c_cookie=13965562336429318189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 0x55a3c6b46b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 --2- 10.20.193.28:0/2704672105 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b45a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 >> 10.20.193.28:0/2704672105 conn(0x55a3c6a4b1c0 msgr2=0x55a3c6b2d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f950ffff640 0 client.17019 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.495+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 shutdown_connections 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.496+0000 7f956705ae00 1 -- 10.20.193.28:0/2704672105 wait complete. 2026-02-20T13:21:50.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.496+0000 7f956705ae00 20 client.17019 trim_cache size 0 max 16384 2026-02-20T13:21:50.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.503+0000 7f956705ae00 1 Processor -- start 2026-02-20T13:21:50.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.503+0000 7f956705ae00 1 -- start start 2026-02-20T13:21:50.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.503+0000 7f956705ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b37990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.503+0000 7f956705ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b28690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.503+0000 7f956705ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 0x55a3c6b28bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.503+0000 7f956705ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6a358d0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.503+0000 7f956705ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6776f10 con 0x55a3c6b6d700 2026-02-20T13:21:50.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.503+0000 7f956705ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6b3eb40 con 0x55a3c6b4cde0 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b37990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955dd74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b28690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b37990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53590/0 (socket says 10.20.193.28:53590) 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 -- 10.20.193.28:0/3906773337 learned_addr learned my addr 10.20.193.28:0/3906773337 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955ed76640 1 --2- 10.20.193.28:0/3906773337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 0x55a3c6b28bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 -- 10.20.193.28:0/3906773337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b4cde0 msgr2=0x55a3c6b28690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 --2- 10.20.193.28:0/3906773337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b28690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 -- 10.20.193.28:0/3906773337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 msgr2=0x55a3c6b28bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 --2- 10.20.193.28:0/3906773337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 0x55a3c6b28bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 -- 10.20.193.28:0/3906773337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c69cd670 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f955e575640 1 --2- 10.20.193.28:0/3906773337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b37990 secure :-1 s=READY pgs=670 gs=1 cs=0 l=1 c_cookie=2406176228633210077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f955404f550 tx=0x7f9554002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216474880eabecdd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:50.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f952a3ff640 1 -- 10.20.193.28:0/3906773337 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f955402f9f0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f952a3ff640 1 -- 10.20.193.28:0/3906773337 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f955403e040 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.504+0000 7f952a3ff640 1 -- 10.20.193.28:0/3906773337 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f955404fb40 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 -- 10.20.193.28:0/3906773337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 msgr2=0x55a3c6b37990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 --2- 10.20.193.28:0/3906773337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b37990 secure :-1 s=READY pgs=670 gs=1 cs=0 l=1 c_cookie=2406176228633210077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f955404f550 tx=0x7f9554002390 comp rx=0 tx=0).stop 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 -- 10.20.193.28:0/3906773337 shutdown_connections 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 --2- 10.20.193.28:0/3906773337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b6d700 0x55a3c6b28bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 --2- 10.20.193.28:0/3906773337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b28690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 --2- 10.20.193.28:0/3906773337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b37990 unknown :-1 s=CLOSED pgs=670 gs=1 cs=0 l=1 c_cookie=2406176228633210077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 -- 10.20.193.28:0/3906773337 >> 10.20.193.28:0/3906773337 conn(0x55a3c6a4b1c0 msgr2=0x55a3c6b6b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 -- 10.20.193.28:0/3906773337 shutdown_connections 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 -- 10.20.193.28:0/3906773337 wait complete. 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 -- start start 2026-02-20T13:21:50.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.505+0000 7f956705ae00 1 Processor -- start 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f956705ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4e4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f956705ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b4ea20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f956705ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 0x55a3c6b4f080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f956705ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6b4f780 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f956705ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6b4f8f0 con 0x55a3c6b4cde0 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f956705ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3c6b4fab0 con 0x55a3c6b6d700 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53594/0 (socket says 10.20.193.28:53594) 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 -- 10.20.193.28:0/3059596821 learned_addr learned my addr 10.20.193.28:0/3059596821 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955dd74640 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b4ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955ed76640 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 0x55a3c6b4f080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 -- 10.20.193.28:0/3059596821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 msgr2=0x55a3c6b4f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 0x55a3c6b4f080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 -- 10.20.193.28:0/3059596821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 msgr2=0x55a3c6b4ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b4ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 -- 10.20.193.28:0/3059596821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c69c80f0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f955e575640 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4e4e0 secure :-1 s=READY pgs=671 gs=1 cs=0 l=1 c_cookie=2323145258228323141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9554009980 tx=0x7f9554009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203d784dc6551345 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f950ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.506+0000 7f950ffff640 1 -- 10.20.193.28:0/3059596821 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f955404f8a0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f950ffff640 1 -- 10.20.193.28:0/3059596821 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9554038e00 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3c69da8b0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f950ffff640 1 -- 10.20.193.28:0/3059596821 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f955405a480 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 10 client.17025 _ll_register_callbacks cb 0x55a3c69c2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:50.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3c6ae7ca0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f950ffff640 1 -- 10.20.193.28:0/3059596821 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f955405a620 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f950ffff640 1 -- 10.20.193.28:0/3059596821 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f955405a820 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 10 client.17025 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a3c69bc0d0 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f950ffff640 1 -- 10.20.193.28:0/3059596821 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f955405d640 con 0x55a3c6b2c4c0 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 10 client.17025 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 10 client.17025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 20 client.17025 populate_metadata read hostname 'trial028' 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3c6b514f0 0x55a3c6b51990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 4 client.17025 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3c671b640 con 0x55a3c6b514f0 2026-02-20T13:21:50.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.507+0000 7f955dd74640 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3c6b514f0 0x55a3c6b51990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:50.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.508+0000 7f955dd74640 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3c6b514f0 0x55a3c6b51990 crc :-1 s=READY pgs=151 gs=4 cs=0 l=0 c_cookie=8284173839877680311 s_cookie=7646951424941087909 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72f74c37477e2cb7 server_cookie=6a1f6dce4247dca5 in_seq=0 out_seq=0 2026-02-20T13:21:50.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.508+0000 7f950ffff640 10 client.17025 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f950ffff640 1 -- 10.20.193.28:0/3059596821 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3c671b640 con 0x55a3c6b514f0 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f950ffff640 10 client.17025 handle_command_reply: tid=0 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 client.17025 shutdown 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 msgr2=0x55a3c6b4e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4e4e0 secure :-1 s=READY pgs=671 gs=1 cs=0 l=1 c_cookie=2323145258228323141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9554009980 tx=0x7f9554009310 comp rx=0 tx=0).stop 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 shutdown_connections 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a3c6b514f0 0x55a3c6b51990 crc :-1 s=READY pgs=151 gs=4 cs=0 l=0 c_cookie=8284173839877680311 s_cookie=7646951424941087909 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3c6b6d700 0x55a3c6b4f080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3c6b4cde0 0x55a3c6b4ea20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 --2- 10.20.193.28:0/3059596821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3c6b2c4c0 0x55a3c6b4e4e0 unknown :-1 s=CLOSED pgs=671 gs=1 cs=0 l=1 c_cookie=2323145258228323141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f950ffff640 0 client.17025 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:50.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 >> 10.20.193.28:0/3059596821 conn(0x55a3c6a4b1c0 msgr2=0x55a3c6b6bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:50.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 shutdown_connections 2026-02-20T13:21:50.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 1 -- 10.20.193.28:0/3059596821 wait complete. 2026-02-20T13:21:50.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f956705ae00 20 client.17025 trim_cache size 0 max 16384 2026-02-20T13:21:50.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:21:50.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:21:50.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:21:50.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:21:50.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 -- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95380b5760 msgr2=0x7f95380d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95380b5760 0x7f95380d5c10 secure :-1 s=READY pgs=362 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9554002d80 tx=0x7f955403a040 comp rx=0 tx=0).stop 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 -- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f956010f2f0 msgr2=0x7f9560171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f956010f2f0 0x7f9560171080 secure :-1 s=READY pgs=667 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9548005db0 tx=0x7f954800ddf0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 -- 10.20.193.28:0/734240253 shutdown_connections 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95380b5760 0x7f95380d5c10 unknown :-1 s=CLOSED pgs=362 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f956010f2f0 0x7f9560171080 unknown :-1 s=CLOSED pgs=667 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95601100b0 0x7f95600f8ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 --2- 10.20.193.28:0/734240253 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f956010e940 0x7f95600f8250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 -- 10.20.193.28:0/734240253 >> 10.20.193.28:0/734240253 conn(0x7f95600ec320 msgr2=0x7f95600ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.513+0000 7f955f577640 1 -- 10.20.193.28:0/734240253 shutdown_connections 2026-02-20T13:21:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:21:50.514+0000 7f955f577640 1 -- 10.20.193.28:0/734240253 wait complete. 2026-02-20T13:21:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:50 trial028 ceph-mon[37442]: pgmap v316: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:21:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:50 trial127 ceph-mon[43817]: pgmap v316: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:21:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:50 trial034 ceph-mon[43332]: pgmap v316: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:21:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:52 trial028 ceph-mon[37442]: pgmap v317: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:21:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:52 trial127 ceph-mon[43817]: pgmap v317: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:21:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:52 trial034 ceph-mon[43332]: pgmap v317: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:21:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:54 trial028 ceph-mon[37442]: pgmap v318: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:21:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:54 trial127 ceph-mon[43817]: pgmap v318: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:21:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:54 trial034 ceph-mon[43332]: pgmap v318: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:21:55.951 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:21:56.140 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:56.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 -- 10.20.193.28:0/1792409000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc701156a0 msgr2=0x7fbc70176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 --2- 10.20.193.28:0/1792409000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc701156a0 0x7fbc70176070 secure :-1 s=READY pgs=672 gs=1 cs=0 l=1 c_cookie=776269757831164519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc6000aa30 tx=0x7fbc60030270 comp rx=0 tx=0).stop 2026-02-20T13:21:56.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 -- 10.20.193.28:0/1792409000 shutdown_connections 2026-02-20T13:21:56.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 --2- 10.20.193.28:0/1792409000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc701156a0 0x7fbc70176070 unknown :-1 s=CLOSED pgs=672 gs=1 cs=0 l=1 c_cookie=776269757831164519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 --2- 10.20.193.28:0/1792409000 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc7010fea0 0x7fbc70114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 --2- 10.20.193.28:0/1792409000 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc7010f4b0 0x7fbc7010f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 -- 10.20.193.28:0/1792409000 >> 10.20.193.28:0/1792409000 conn(0x7fbc700ecda0 msgr2=0x7fbc7010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:56.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 -- 10.20.193.28:0/1792409000 shutdown_connections 2026-02-20T13:21:56.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.315+0000 7fbc6f577640 1 -- 10.20.193.28:0/1792409000 wait complete. 2026-02-20T13:21:56.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.316+0000 7fbc6f577640 1 Processor -- start 2026-02-20T13:21:56.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.316+0000 7fbc6f577640 1 -- start start 2026-02-20T13:21:56.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc7010f4b0 0x7fbc7011ddf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc7010fea0 0x7fbc7011e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6f577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc701156a0 0x7fbc70123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70123d20 con 0x7fbc7010fea0 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6f577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70123e90 con 0x7fbc701156a0 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6f577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70124050 con 0x7fbc7010f4b0 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc7010fea0 0x7fbc7011e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc7010fea0 0x7fbc7011e330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53626/0 (socket says 10.20.193.28:53626) 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 -- 10.20.193.28:0/2102486385 learned_addr learned my addr 10.20.193.28:0/2102486385 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6ed76640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc701156a0 0x7fbc70123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6e575640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc7010f4b0 0x7fbc7011ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 -- 10.20.193.28:0/2102486385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc7010f4b0 msgr2=0x7fbc7011ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc7010f4b0 0x7fbc7011ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 -- 10.20.193.28:0/2102486385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc701156a0 msgr2=0x7fbc70123700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc701156a0 0x7fbc70123700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 -- 10.20.193.28:0/2102486385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6000a650 con 0x7fbc7010fea0 2026-02-20T13:21:56.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.317+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc7010fea0 0x7fbc7011e330 secure :-1 s=READY pgs=673 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc580072a0 tx=0x7fbc5800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:56.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.318+0000 7fbc577fe640 1 -- 10.20.193.28:0/2102486385 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc58004500 con 0x7fbc7010fea0 2026-02-20T13:21:56.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.318+0000 7fbc577fe640 1 -- 10.20.193.28:0/2102486385 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbc5800bca0 con 0x7fbc7010fea0 2026-02-20T13:21:56.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.318+0000 7fbc577fe640 1 -- 10.20.193.28:0/2102486385 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc580106e0 con 0x7fbc7010fea0 2026-02-20T13:21:56.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.318+0000 7fbc6f577640 1 -- 10.20.193.28:0/2102486385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc70124330 con 0x7fbc7010fea0 2026-02-20T13:21:56.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.318+0000 7fbc6f577640 1 -- 10.20.193.28:0/2102486385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc70164a30 con 0x7fbc7010fea0 2026-02-20T13:21:56.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.321+0000 7fbc577fe640 1 -- 10.20.193.28:0/2102486385 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbc5800b7c0 con 0x7fbc7010fea0 2026-02-20T13:21:56.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc577fe640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc480b5760 0x7fbc480d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc577fe640 1 -- 10.20.193.28:0/2102486385 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbc580e6440 con 0x7fbc7010fea0 2026-02-20T13:21:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc6e575640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc480b5760 0x7fbc480d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc76ce2e00 1 Processor -- start 2026-02-20T13:21:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc6e575640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc480b5760 0x7fbc480d5c10 secure :-1 s=READY pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc64004740 tx=0x7fbc64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc76ce2e00 1 -- start start 2026-02-20T13:21:56.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 0x55b985df0550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0a90 0x55b985e35400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985e35940 0x55b985e55d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b985d067d0 con 0x55b985df0a90 2026-02-20T13:21:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b985d02500 con 0x55b985df0180 2026-02-20T13:21:56.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.323+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b985cfc4a0 con 0x55b985e35940 2026-02-20T13:21:56.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 0x55b985df0550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0a90 0x55b985e35400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6ed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985e35940 0x55b985e55d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6ed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985e35940 0x55b985e55d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39848/0 (socket says 10.20.193.28:39848) 2026-02-20T13:21:56.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6ed76640 1 -- 10.20.193.28:0/3037731339 learned_addr learned my addr 10.20.193.28:0/3037731339 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6dd74640 1 -- 10.20.193.28:0/3037731339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985e35940 msgr2=0x55b985e55d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3037731339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985e35940 0x55b985e55d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6dd74640 1 -- 10.20.193.28:0/3037731339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 msgr2=0x55b985df0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3037731339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 0x55b985df0550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6dd74640 1 -- 10.20.193.28:0/3037731339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b985ca7d80 con 0x55b985df0a90 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3037731339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0a90 0x55b985e35400 secure :-1 s=READY pgs=674 gs=2 cs=0 l=1 c_cookie=15951191526232847488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc580e3f10 tx=0x7fbc580026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5e042e19547480 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc54ff9640 1 -- 10.20.193.28:0/3037731339 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc580abfa0 con 0x55b985df0a90 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc54ff9640 1 -- 10.20.193.28:0/3037731339 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbc58009e20 con 0x55b985df0a90 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.324+0000 7fbc54ff9640 1 -- 10.20.193.28:0/3037731339 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc5800baa0 con 0x55b985df0a90 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3037731339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0a90 msgr2=0x55b985e35400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3037731339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0a90 0x55b985e35400 secure :-1 s=READY pgs=674 gs=2 cs=0 l=1 c_cookie=15951191526232847488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc580e3f10 tx=0x7fbc580026a0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3037731339 shutdown_connections 2026-02-20T13:21:56.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3037731339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0a90 0x55b985e35400 unknown :-1 s=CLOSED pgs=674 gs=2 cs=0 l=1 c_cookie=15951191526232847488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3037731339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985e35940 0x55b985e55d20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3037731339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 0x55b985df0550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3037731339 >> 10.20.193.28:0/3037731339 conn(0x55b985dce680 msgr2=0x55b985deea60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:56.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3037731339 shutdown_connections 2026-02-20T13:21:56.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.325+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3037731339 wait complete. 2026-02-20T13:21:56.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.326+0000 7fbc76ce2e00 1 -- start start 2026-02-20T13:21:56.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.326+0000 7fbc76ce2e00 1 Processor -- start 2026-02-20T13:21:56.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985df1550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df1a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985e16400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b985e16940 con 0x55b985df0180 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b985e16ab0 con 0x55b985e35940 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b985e16c70 con 0x55b985df0a90 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985df1550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6dd74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985df1550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53640/0 (socket says 10.20.193.28:53640) 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 -- 10.20.193.28:0/3989611127 learned_addr learned my addr 10.20.193.28:0/3989611127 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6ed76640 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985e16400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 -- 10.20.193.28:0/3989611127 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 msgr2=0x55b985df1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 -- 10.20.193.28:0/3989611127 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 msgr2=0x55b985e16400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985e16400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 -- 10.20.193.28:0/3989611127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b985c80350 con 0x55b985df0180 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc6e575640 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985df1550 secure :-1 s=READY pgs=675 gs=1 cs=0 l=1 c_cookie=4308377156153012922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc64011790 tx=0x7fbc64013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bca6e325ee872ba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc1ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.327+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3989611127 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc64021040 con 0x55b985df0180 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3989611127 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbc64019400 con 0x55b985df0180 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc70164a30 con 0x55b985df0180 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 10 client.17037 _ll_register_callbacks cb 0x55b985c7d9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9859926f0 con 0x55b985df0180 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3989611127 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc64025660 con 0x55b985df0180 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3989611127 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbc640257f0 con 0x55b985df0180 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3989611127 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbc64025a30 con 0x55b985df0180 2026-02-20T13:21:56.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 10 client.17037 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b985c92150 con 0x55b985df0180 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3989611127 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbc64025c50 con 0x55b985df0180 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 10 client.17037 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 20 client.17037 populate_metadata read hostname 'trial028' 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b985e1b670 0x55b985e1bb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 4 client.17037 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.328+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b985d09d60 con 0x55b985e1b670 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.329+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b985e1b670 0x55b985e1bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.329+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b985e1b670 0x55b985e1bb10 crc :-1 s=READY pgs=152 gs=4 cs=0 l=0 c_cookie=7833042788942153481 s_cookie=15179248747737197489 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cb48eea51550709 server_cookie=d2a786501e2b2bb1 in_seq=0 out_seq=0 2026-02-20T13:21:56.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.329+0000 7fbc1ffff640 10 client.17037 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3989611127 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b985d09d60 con 0x55b985e1b670 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc1ffff640 10 client.17037 handle_command_reply: tid=0 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 client.17037 shutdown 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 msgr2=0x55b985df1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985df1550 secure :-1 s=READY pgs=675 gs=1 cs=0 l=1 c_cookie=4308377156153012922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc64011790 tx=0x7fbc64013040 comp rx=0 tx=0).stop 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 shutdown_connections 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b985e1b670 0x55b985e1bb10 crc :-1 s=READY pgs=152 gs=4 cs=0 l=0 c_cookie=7833042788942153481 s_cookie=15179248747737197489 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985e16400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df1a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3989611127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985df1550 unknown :-1 s=CLOSED pgs=675 gs=1 cs=0 l=1 c_cookie=4308377156153012922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 >> 10.20.193.28:0/3989611127 conn(0x55b985dce680 msgr2=0x55b985deea60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc1ffff640 0 client.17037 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:56.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 shutdown_connections 2026-02-20T13:21:56.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3989611127 wait complete. 2026-02-20T13:21:56.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.330+0000 7fbc76ce2e00 20 client.17037 trim_cache size 0 max 16384 2026-02-20T13:21:56.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc76ce2e00 1 Processor -- start 2026-02-20T13:21:56.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc76ce2e00 1 -- start start 2026-02-20T13:21:56.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 0x55b985e4c610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df13a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985e35940 0x55b985df18e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b985cfa0d0 con 0x55b985e35940 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b9859ba700 con 0x55b985df0180 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b985df2070 con 0x55b985df0a90 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6dd74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 0x55b985e4c610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6dd74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39870/0 (socket says 10.20.193.28:39870) 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6dd74640 1 -- 10.20.193.28:0/1584984846 learned_addr learned my addr 10.20.193.28:0/1584984846 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6ed76640 1 --2- 10.20.193.28:0/1584984846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985e35940 0x55b985df18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6dd74640 1 -- 10.20.193.28:0/1584984846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 msgr2=0x55b985e4c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/1584984846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 0x55b985e4c610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6dd74640 1 -- 10.20.193.28:0/1584984846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985e35940 msgr2=0x55b985df18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/1584984846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985e35940 0x55b985df18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.340+0000 7fbc6dd74640 1 -- 10.20.193.28:0/1584984846 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b985e3f960 con 0x55b985df0a90 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/1584984846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df13a0 secure :-1 s=READY pgs=228 gs=3 cs=0 l=1 c_cookie=5485609392931424086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc580a87b0 tx=0x7fbc580b79f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c20ccadca394756 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc3a4e6640 1 -- 10.20.193.28:0/1584984846 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc580abfa0 con 0x55b985df0a90 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc3a4e6640 1 -- 10.20.193.28:0/1584984846 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbc580ad1a0 con 0x55b985df0a90 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc3a4e6640 1 -- 10.20.193.28:0/1584984846 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc58002730 con 0x55b985df0a90 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/1584984846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 msgr2=0x55b985df13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/1584984846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df13a0 secure :-1 s=READY pgs=228 gs=3 cs=0 l=1 c_cookie=5485609392931424086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc580a87b0 tx=0x7fbc580b79f0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/1584984846 shutdown_connections 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/1584984846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985e35940 0x55b985df18e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/1584984846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985df13a0 unknown :-1 s=CLOSED pgs=228 gs=3 cs=0 l=1 c_cookie=5485609392931424086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/1584984846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985df0180 0x55b985e4c610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/1584984846 >> 10.20.193.28:0/1584984846 conn(0x55b985dce680 msgr2=0x55b985e1b670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:56.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/1584984846 shutdown_connections 2026-02-20T13:21:56.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.341+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/1584984846 wait complete. 2026-02-20T13:21:56.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.342+0000 7fbc76ce2e00 1 -- start start 2026-02-20T13:21:56.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.342+0000 7fbc76ce2e00 1 Processor -- start 2026-02-20T13:21:56.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.342+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985e1dcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.342+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985e1e210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc76ce2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985ee93d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b985e1e9e0 con 0x55b985df0180 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b985ee9940 con 0x55b985e35940 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc76ce2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b985ee9b00 con 0x55b985df0a90 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985e1dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985e1dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53668/0 (socket says 10.20.193.28:53668) 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985e1e210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6e575640 1 -- 10.20.193.28:0/3704118272 learned_addr learned my addr 10.20.193.28:0/3704118272 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6ed76640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985ee93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6e575640 1 -- 10.20.193.28:0/3704118272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 msgr2=0x55b985e1e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:56.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6e575640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985e1e210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6e575640 1 -- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 msgr2=0x55b985ee93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6e575640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985ee93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6e575640 1 -- 10.20.193.28:0/3704118272 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b985c8cbd0 con 0x55b985df0180 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6ed76640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985ee93d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.343+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985e1e210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc6e575640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985e1dcd0 secure :-1 s=READY pgs=676 gs=1 cs=0 l=1 c_cookie=15887308393575737633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc64016040 tx=0x7fbc6402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7b0ecf3429e921 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc1ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3704118272 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc64021030 con 0x55b985df0180 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3704118272 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55b9859926f0 con 0x55b985df0180 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3704118272 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc64036040 con 0x55b985df0180 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b985ca7d80 con 0x55b985df0180 2026-02-20T13:21:56.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3704118272 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbc64026d70 con 0x55b985df0180 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc76ce2e00 10 client.17043 _ll_register_callbacks cb 0x55b985c7d9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc58009e20 con 0x55b985df0180 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3704118272 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbc6401bdd0 con 0x55b985df0180 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc76ce2e00 10 client.17043 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.344+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b985c80680 con 0x55b985df0180 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3704118272 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbc6402fcb0 con 0x55b985df0180 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc76ce2e00 10 client.17043 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc76ce2e00 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc76ce2e00 20 client.17043 populate_metadata read hostname 'trial028' 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b985eeb850 0x55b985f0bd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc76ce2e00 4 client.17043 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:21:56.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b98598ff40 con 0x55b985eeb850 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b985eeb850 0x55b985f0bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc6dd74640 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b985eeb850 0x55b985f0bd00 crc :-1 s=READY pgs=153 gs=4 cs=0 l=0 c_cookie=8172067137130192278 s_cookie=3790003014826415295 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=716903c38549dd96 server_cookie=3498cba9646354bf in_seq=0 out_seq=0 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.345+0000 7fbc1ffff640 10 client.17043 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc1ffff640 1 -- 10.20.193.28:0/3704118272 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55b98598ff40 con 0x55b985eeb850 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc1ffff640 10 client.17043 handle_command_reply: tid=0 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 client.17043 shutdown 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 msgr2=0x55b985e1dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985e1dcd0 secure :-1 s=READY pgs=676 gs=1 cs=0 l=1 c_cookie=15887308393575737633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc64016040 tx=0x7fbc6402d000 comp rx=0 tx=0).stop 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 shutdown_connections 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b985eeb850 0x55b985f0bd00 crc :-1 s=READY pgs=153 gs=4 cs=0 l=0 c_cookie=8172067137130192278 s_cookie=3790003014826415295 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b985e35940 0x55b985ee93d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b985df0a90 0x55b985e1e210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 --2- 10.20.193.28:0/3704118272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b985df0180 0x55b985e1dcd0 unknown :-1 s=CLOSED pgs=676 gs=1 cs=0 l=1 c_cookie=15887308393575737633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc1ffff640 0 client.17043 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:56.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 >> 10.20.193.28:0/3704118272 conn(0x55b985dce680 msgr2=0x55b985df13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:56.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 shutdown_connections 2026-02-20T13:21:56.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 1 -- 10.20.193.28:0/3704118272 wait complete. 2026-02-20T13:21:56.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.346+0000 7fbc76ce2e00 20 client.17043 trim_cache size 0 max 16384 2026-02-20T13:21:56.355 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:21:56.355 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:56.356 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:56.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:21:56.358 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:56.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:21:56.360 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:21:56.361 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:21:56.361 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:21:56.361 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:21:56.361 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:21:56.361 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:56.361 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:21:56.361 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:21:56.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 -- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc480b5760 msgr2=0x7fbc480d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc480b5760 0x7fbc480d5c10 secure :-1 s=READY pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc64004740 tx=0x7fbc64005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:56.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 -- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc7010fea0 msgr2=0x7fbc7011e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc7010fea0 0x7fbc7011e330 secure :-1 s=READY pgs=673 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc580072a0 tx=0x7fbc5800ddf0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 -- 10.20.193.28:0/2102486385 shutdown_connections 2026-02-20T13:21:56.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbc480b5760 0x7fbc480d5c10 unknown :-1 s=CLOSED pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc7010fea0 0x7fbc7011e330 unknown :-1 s=CLOSED pgs=673 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc701156a0 0x7fbc70123700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 --2- 10.20.193.28:0/2102486385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc7010f4b0 0x7fbc7011ddf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 -- 10.20.193.28:0/2102486385 >> 10.20.193.28:0/2102486385 conn(0x7fbc700ecda0 msgr2=0x7fbc7010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:56.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 -- 10.20.193.28:0/2102486385 shutdown_connections 2026-02-20T13:21:56.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.347+0000 7fbc6f577640 1 -- 10.20.193.28:0/2102486385 wait complete. 2026-02-20T13:21:56.450 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:21:56.451 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:21:56.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:56 trial028 ceph-mon[37442]: pgmap v319: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:21:56.636 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.820+0000 7f1c97302640 1 -- 10.20.193.28:0/1483361569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010bad0 msgr2=0x7f1c9010bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.820+0000 7f1c97302640 1 --2- 10.20.193.28:0/1483361569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010bad0 0x7f1c9010bea0 secure :-1 s=READY pgs=677 gs=2 cs=0 l=1 c_cookie=8272932778820769107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c80009980 tx=0x7f1c8002f190 comp rx=0 tx=0).stop 2026-02-20T13:21:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.820+0000 7f1c97302640 1 -- 10.20.193.28:0/1483361569 shutdown_connections 2026-02-20T13:21:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.820+0000 7f1c97302640 1 --2- 10.20.193.28:0/1483361569 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c901110b0 0x7f1c90111550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.820+0000 7f1c97302640 1 --2- 10.20.193.28:0/1483361569 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c9010c4c0 0x7f1c90110a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.820+0000 7f1c97302640 1 --2- 10.20.193.28:0/1483361569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010bad0 0x7f1c9010bea0 unknown :-1 s=CLOSED pgs=677 gs=2 cs=0 l=1 c_cookie=8272932778820769107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.820+0000 7f1c97302640 1 -- 10.20.193.28:0/1483361569 >> 10.20.193.28:0/1483361569 conn(0x7f1c900e9780 msgr2=0x7f1c90109b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.820+0000 7f1c97302640 1 -- 10.20.193.28:0/1483361569 shutdown_connections 2026-02-20T13:21:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.821+0000 7f1c97302640 1 -- 10.20.193.28:0/1483361569 wait complete. 2026-02-20T13:21:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.821+0000 7f1c97302640 1 Processor -- start 2026-02-20T13:21:56.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.821+0000 7f1c97302640 1 -- start start 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c97302640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9010bad0 0x7f1c90122450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c97302640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010c4c0 0x7f1c90122990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c97302640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c901110b0 0x7f1c90127d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c97302640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90128380 con 0x7f1c9010c4c0 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c97302640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1c901284f0 con 0x7f1c901110b0 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c97302640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1c901286b0 con 0x7f1c9010bad0 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95878640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c901110b0 0x7f1c90127d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95077640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9010bad0 0x7f1c90122450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95878640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c901110b0 0x7f1c90127d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50352/0 (socket says 10.20.193.28:50352) 2026-02-20T13:21:56.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95878640 1 -- 10.20.193.28:0/2435195700 learned_addr learned my addr 10.20.193.28:0/2435195700 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95878640 1 -- 10.20.193.28:0/2435195700 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9010bad0 msgr2=0x7f1c90122450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c94876640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010c4c0 0x7f1c90122990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95878640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9010bad0 0x7f1c90122450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95878640 1 -- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010c4c0 msgr2=0x7f1c90122990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95878640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010c4c0 0x7f1c90122990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95878640 1 -- 10.20.193.28:0/2435195700 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c80009570 con 0x7f1c901110b0 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c95077640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9010bad0 0x7f1c90122450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.822+0000 7f1c94876640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010c4c0 0x7f1c90122990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.823+0000 7f1c95878640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c901110b0 0x7f1c90127d60 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c8c00f8d0 tx=0x7f1c8c00fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.823+0000 7f1c7e7fc640 1 -- 10.20.193.28:0/2435195700 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c8c00dce0 con 0x7f1c901110b0 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.823+0000 7f1c7e7fc640 1 -- 10.20.193.28:0/2435195700 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c8c00de40 con 0x7f1c901110b0 2026-02-20T13:21:56.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.823+0000 7f1c7e7fc640 1 -- 10.20.193.28:0/2435195700 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c8c0116b0 con 0x7f1c901110b0 2026-02-20T13:21:56.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.823+0000 7f1c97302640 1 -- 10.20.193.28:0/2435195700 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c90128990 con 0x7f1c901110b0 2026-02-20T13:21:56.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.823+0000 7f1c97302640 1 -- 10.20.193.28:0/2435195700 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c90169090 con 0x7f1c901110b0 2026-02-20T13:21:56.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.824+0000 7f1c5ffff640 1 -- 10.20.193.28:0/2435195700 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c58005300 con 0x7f1c901110b0 2026-02-20T13:21:56.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.826+0000 7f1c7e7fc640 1 -- 10.20.193.28:0/2435195700 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1c8c020060 con 0x7f1c901110b0 2026-02-20T13:21:56.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.827+0000 7f1c7e7fc640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c6c0b5760 0x7f1c6c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:56.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.827+0000 7f1c7e7fc640 1 -- 10.20.193.28:0/2435195700 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c8c015070 con 0x7f1c901110b0 2026-02-20T13:21:56.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.827+0000 7f1c7e7fc640 1 -- 10.20.193.28:0/2435195700 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f1c8c120730 con 0x7f1c901110b0 2026-02-20T13:21:56.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.827+0000 7f1c95077640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c6c0b5760 0x7f1c6c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:56.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.828+0000 7f1c95077640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c6c0b5760 0x7f1c6c0d5c10 secure :-1 s=READY pgs=364 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c80038820 tx=0x7f1c8003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:56.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.971+0000 7f1c5ffff640 1 -- 10.20.193.28:0/2435195700 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c58005950 con 0x7f1c901110b0 2026-02-20T13:21:56.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.971+0000 7f1c7e7fc640 1 -- 10.20.193.28:0/2435195700 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f1c8c0aa690 con 0x7f1c901110b0 2026-02-20T13:21:56.975 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:21:56.975 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 -- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c6c0b5760 msgr2=0x7f1c6c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c6c0b5760 0x7f1c6c0d5c10 secure :-1 s=READY pgs=364 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c80038820 tx=0x7f1c8003a040 comp rx=0 tx=0).stop 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 -- 10.20.193.28:0/2435195700 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c901110b0 msgr2=0x7f1c90127d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c901110b0 0x7f1c90127d60 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c8c00f8d0 tx=0x7f1c8c00fda0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 -- 10.20.193.28:0/2435195700 shutdown_connections 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c6c0b5760 0x7f1c6c0d5c10 unknown :-1 s=CLOSED pgs=364 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9010c4c0 0x7f1c90122990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c901110b0 0x7f1c90127d60 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 --2- 10.20.193.28:0/2435195700 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9010bad0 0x7f1c90122450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:56.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 -- 10.20.193.28:0/2435195700 >> 10.20.193.28:0/2435195700 conn(0x7f1c900e9780 msgr2=0x7f1c90109b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:56.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 -- 10.20.193.28:0/2435195700 shutdown_connections 2026-02-20T13:21:56.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:56.972+0000 7f1c5ffff640 1 -- 10.20.193.28:0/2435195700 wait complete. 2026-02-20T13:21:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:56 trial127 ceph-mon[43817]: pgmap v319: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:21:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:56 trial034 ceph-mon[43332]: pgmap v319: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:21:57.116 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:21:57.304 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:57.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.484+0000 7f38f4f49640 1 -- 10.20.193.28:0/1113436479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 msgr2=0x7f38f0175d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.484+0000 7f38f4f49640 1 --2- 10.20.193.28:0/1113436479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 0x7f38f0175d10 secure :-1 s=READY pgs=678 gs=1 cs=0 l=1 c_cookie=3731364078275850754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e400aa30 tx=0x7f38e4030300 comp rx=0 tx=0).stop 2026-02-20T13:21:57.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.484+0000 7f38f4f49640 1 -- 10.20.193.28:0/1113436479 shutdown_connections 2026-02-20T13:21:57.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.484+0000 7f38f4f49640 1 --2- 10.20.193.28:0/1113436479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 0x7f38f0175d10 unknown :-1 s=CLOSED pgs=678 gs=1 cs=0 l=1 c_cookie=3731364078275850754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.484+0000 7f38f4f49640 1 --2- 10.20.193.28:0/1113436479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f38f010b3c0 0x7f38f010b7d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.484+0000 7f38f4f49640 1 --2- 10.20.193.28:0/1113436479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38f010dcd0 0x7f38f010e0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.485+0000 7f38f4f49640 1 -- 10.20.193.28:0/1113436479 >> 10.20.193.28:0/1113436479 conn(0x7f38f00e9080 msgr2=0x7f38f0109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.485+0000 7f38f4f49640 1 -- 10.20.193.28:0/1113436479 shutdown_connections 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.485+0000 7f38f4f49640 1 -- 10.20.193.28:0/1113436479 wait complete. 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38f4f49640 1 Processor -- start 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38f4f49640 1 -- start start 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38f4f49640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38f010b3c0 0x7f38f00f49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38f4f49640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 0x7f38f00f4f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38f4f49640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f38f010dcd0 0x7f38f00fa300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38f4f49640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00fa920 con 0x7f38f010be20 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38f4f49640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00faa90 con 0x7f38f010dcd0 2026-02-20T13:21:57.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38f4f49640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00fac50 con 0x7f38f010b3c0 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38eeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 0x7f38f00f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38eeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 0x7f38f00f4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53692/0 (socket says 10.20.193.28:53692) 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38eeffd640 1 -- 10.20.193.28:0/2559118429 learned_addr learned my addr 10.20.193.28:0/2559118429 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38f010b3c0 0x7f38f00f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.486+0000 7f38effff640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f38f010dcd0 0x7f38f00fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38eeffd640 1 -- 10.20.193.28:0/2559118429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38f010b3c0 msgr2=0x7f38f00f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38eeffd640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38f010b3c0 0x7f38f00f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38eeffd640 1 -- 10.20.193.28:0/2559118429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f38f010dcd0 msgr2=0x7f38f00fa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38eeffd640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f38f010dcd0 0x7f38f00fa300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38eeffd640 1 -- 10.20.193.28:0/2559118429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e400a650 con 0x7f38f010be20 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38eeffd640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 0x7f38f00f4f30 secure :-1 s=READY pgs=679 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e000d950 tx=0x7f38e000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38ecff9640 1 -- 10.20.193.28:0/2559118429 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e0004540 con 0x7f38f010be20 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38ecff9640 1 -- 10.20.193.28:0/2559118429 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38e0009d00 con 0x7f38f010be20 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38ecff9640 1 -- 10.20.193.28:0/2559118429 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e00106e0 con 0x7f38f010be20 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38f4f49640 1 -- 10.20.193.28:0/2559118429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f00faf30 con 0x7f38f010be20 2026-02-20T13:21:57.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.487+0000 7f38f4f49640 1 -- 10.20.193.28:0/2559118429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f0172e80 con 0x7f38f010be20 2026-02-20T13:21:57.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.490+0000 7f38ecff9640 1 -- 10.20.193.28:0/2559118429 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f38e00097c0 con 0x7f38f010be20 2026-02-20T13:21:57.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.491+0000 7f38ecff9640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f38c40b5760 0x7f38c40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.492+0000 7f38ecff9640 1 -- 10.20.193.28:0/2559118429 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f38e00e61b0 con 0x7f38f010be20 2026-02-20T13:21:57.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.492+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f38c40b5760 0x7f38c40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.492+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f38c40b5760 0x7f38c40d5c10 secure :-1 s=READY pgs=365 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38dc004740 tx=0x7f38dc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38f81cce00 1 Processor -- start 2026-02-20T13:21:57.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38f81cce00 1 -- start start 2026-02-20T13:21:57.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6360 0x558a072d6730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6c70 0x558a0731b5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a0733bf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38f81cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558a071ec780 con 0x558a072d6c70 2026-02-20T13:21:57.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38f81cce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558a071e84b0 con 0x558a0731bb20 2026-02-20T13:21:57.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38f81cce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558a071e2450 con 0x558a072d6360 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38ef7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6360 0x558a072d6730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38eeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6c70 0x558a0731b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38ef7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6360 0x558a072d6730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39918/0 (socket says 10.20.193.28:39918) 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38ef7fe640 1 -- 10.20.193.28:0/1130832369 learned_addr learned my addr 10.20.193.28:0/1130832369 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38effff640 1 --2- 10.20.193.28:0/1130832369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a0733bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38eeffd640 1 -- 10.20.193.28:0/1130832369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6360 msgr2=0x558a072d6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38eeffd640 1 --2- 10.20.193.28:0/1130832369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6360 0x558a072d6730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38eeffd640 1 -- 10.20.193.28:0/1130832369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 msgr2=0x558a0733bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.493+0000 7f38eeffd640 1 --2- 10.20.193.28:0/1130832369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a0733bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38eeffd640 1 -- 10.20.193.28:0/1130832369 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a0718dd10 con 0x558a072d6c70 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38eeffd640 1 --2- 10.20.193.28:0/1130832369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6c70 0x558a0731b5e0 secure :-1 s=READY pgs=680 gs=2 cs=0 l=1 c_cookie=12103509992893511448 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e00e3c80 tx=0x7f38e0002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f84e361dcef718 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38b3fff640 1 -- 10.20.193.28:0/1130832369 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e00abef0 con 0x558a072d6c70 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38b3fff640 1 -- 10.20.193.28:0/1130832369 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38e00abd10 con 0x558a072d6c70 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38b3fff640 1 -- 10.20.193.28:0/1130832369 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e00ad1a0 con 0x558a072d6c70 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 -- 10.20.193.28:0/1130832369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6c70 msgr2=0x558a0731b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 --2- 10.20.193.28:0/1130832369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6c70 0x558a0731b5e0 secure :-1 s=READY pgs=680 gs=2 cs=0 l=1 c_cookie=12103509992893511448 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e00e3c80 tx=0x7f38e0002390 comp rx=0 tx=0).stop 2026-02-20T13:21:57.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 -- 10.20.193.28:0/1130832369 shutdown_connections 2026-02-20T13:21:57.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 --2- 10.20.193.28:0/1130832369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6c70 0x558a0731b5e0 unknown :-1 s=CLOSED pgs=680 gs=2 cs=0 l=1 c_cookie=12103509992893511448 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 --2- 10.20.193.28:0/1130832369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a0733bf00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 --2- 10.20.193.28:0/1130832369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6360 0x558a072d6730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 -- 10.20.193.28:0/1130832369 >> 10.20.193.28:0/1130832369 conn(0x558a072b4860 msgr2=0x558a072d4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 -- 10.20.193.28:0/1130832369 shutdown_connections 2026-02-20T13:21:57.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.494+0000 7f38f81cce00 1 -- 10.20.193.28:0/1130832369 wait complete. 2026-02-20T13:21:57.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38f81cce00 1 -- start start 2026-02-20T13:21:57.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38f81cce00 1 Processor -- start 2026-02-20T13:21:57.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a073337c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a07333d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a07335a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38f81cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558a07336000 con 0x558a072d6360 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38f81cce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558a07336170 con 0x558a0731bb20 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38f81cce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558a07336330 con 0x558a072d6c70 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a073337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a073337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53700/0 (socket says 10.20.193.28:53700) 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.496+0000 7f38ef7fe640 1 -- 10.20.193.28:0/3598369802 learned_addr learned my addr 10.20.193.28:0/3598369802 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38effff640 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a07335a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38eeffd640 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a07333d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38ef7fe640 1 -- 10.20.193.28:0/3598369802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 msgr2=0x558a07333d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a07333d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38ef7fe640 1 -- 10.20.193.28:0/3598369802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 msgr2=0x558a07335a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a07335a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38ef7fe640 1 -- 10.20.193.28:0/3598369802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a071663c0 con 0x558a072d6360 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a073337c0 secure :-1 s=READY pgs=681 gs=1 cs=0 l=1 c_cookie=2197998065139246214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38dc0028d0 tx=0x7f38dc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e80db98419ee486 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38b17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38b17fa640 1 -- 10.20.193.28:0/3598369802 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38dc023070 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38b17fa640 1 -- 10.20.193.28:0/3598369802 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38dc01ee10 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38b17fa640 1 -- 10.20.193.28:0/3598369802 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38dc028650 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f0172e80 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.497+0000 7f38f81cce00 10 client.17058 _ll_register_callbacks cb 0x558a07163a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a06e786f0 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38b17fa640 1 -- 10.20.193.28:0/3598369802 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f38dc01de70 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38b17fa640 1 -- 10.20.193.28:0/3598369802 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38dc01e930 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 10 client.17058 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558a071780e0 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38b17fa640 1 -- 10.20.193.28:0/3598369802 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f38dc019040 con 0x558a072d6360 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 10 client.17058 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:57.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 10 client.17058 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:21:57.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 20 client.17058 populate_metadata read hostname 'trial028' 2026-02-20T13:21:57.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558a0733bd50 0x558a073198a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 4 client.17058 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:57.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a07184f80 con 0x558a0733bd50 2026-02-20T13:21:57.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.498+0000 7f38eeffd640 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558a0733bd50 0x558a073198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38eeffd640 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558a0733bd50 0x558a073198a0 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=10017988473029785734 s_cookie=15555076286523377307 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8b070b704ae5f886 server_cookie=d7debb77e054069b in_seq=0 out_seq=0 2026-02-20T13:21:57.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38b17fa640 10 client.17058 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38b17fa640 1 -- 10.20.193.28:0/3598369802 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558a07184f80 con 0x558a0733bd50 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38b17fa640 10 client.17058 handle_command_reply: tid=0 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38f81cce00 1 client.17058 shutdown 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 msgr2=0x558a073337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38f81cce00 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a073337c0 secure :-1 s=READY pgs=681 gs=1 cs=0 l=1 c_cookie=2197998065139246214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38dc0028d0 tx=0x7f38dc0047e0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 shutdown_connections 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38f81cce00 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558a0733bd50 0x558a073198a0 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=10017988473029785734 s_cookie=15555076286523377307 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.499+0000 7f38f81cce00 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a07335a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.500+0000 7f38f81cce00 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a07333d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.500+0000 7f38f81cce00 1 --2- 10.20.193.28:0/3598369802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a073337c0 unknown :-1 s=CLOSED pgs=681 gs=1 cs=0 l=1 c_cookie=2197998065139246214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.500+0000 7f38b17fa640 0 client.17058 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.500+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 >> 10.20.193.28:0/3598369802 conn(0x558a072b4860 msgr2=0x558a072d4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.500+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 shutdown_connections 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.500+0000 7f38f81cce00 1 -- 10.20.193.28:0/3598369802 wait complete. 2026-02-20T13:21:57.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.500+0000 7f38f81cce00 20 client.17058 trim_cache size 0 max 16384 2026-02-20T13:21:57.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38f81cce00 1 Processor -- start 2026-02-20T13:21:57.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38f81cce00 1 -- start start 2026-02-20T13:21:57.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a07335a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a07330950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a07330e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38f81cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558a071e0080 con 0x558a072d6360 2026-02-20T13:21:57.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38f81cce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558a06ea0700 con 0x558a0731bb20 2026-02-20T13:21:57.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38f81cce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558a07339d20 con 0x558a072d6c70 2026-02-20T13:21:57.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a07335a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a07335a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53714/0 (socket says 10.20.193.28:53714) 2026-02-20T13:21:57.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38ef7fe640 1 -- 10.20.193.28:0/2851537590 learned_addr learned my addr 10.20.193.28:0/2851537590 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38effff640 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a07330e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.507+0000 7f38eeffd640 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a07330950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38ef7fe640 1 -- 10.20.193.28:0/2851537590 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 msgr2=0x558a07330950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a07330950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38ef7fe640 1 -- 10.20.193.28:0/2851537590 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 msgr2=0x558a07330e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a07330e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38ef7fe640 1 -- 10.20.193.28:0/2851537590 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a07172b60 con 0x558a072d6360 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a07335a20 secure :-1 s=READY pgs=682 gs=1 cs=0 l=1 c_cookie=8642315030939458040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38dc01e800 tx=0x7f38dc02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77efabbb502a59f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38b37fe640 1 -- 10.20.193.28:0/2851537590 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38dc023030 con 0x558a072d6360 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38b37fe640 1 -- 10.20.193.28:0/2851537590 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x558a06e786f0 con 0x558a072d6360 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38b37fe640 1 -- 10.20.193.28:0/2851537590 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38dc0283d0 con 0x558a072d6360 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38f81cce00 1 -- 10.20.193.28:0/2851537590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 msgr2=0x558a07335a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38f81cce00 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a07335a20 secure :-1 s=READY pgs=682 gs=1 cs=0 l=1 c_cookie=8642315030939458040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38dc01e800 tx=0x7f38dc02a000 comp rx=0 tx=0).stop 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38f81cce00 1 -- 10.20.193.28:0/2851537590 shutdown_connections 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38f81cce00 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a0731bb20 0x558a07330e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38f81cce00 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a07330950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38f81cce00 1 --2- 10.20.193.28:0/2851537590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a072d6360 0x558a07335a20 unknown :-1 s=CLOSED pgs=682 gs=1 cs=0 l=1 c_cookie=8642315030939458040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38f81cce00 1 -- 10.20.193.28:0/2851537590 >> 10.20.193.28:0/2851537590 conn(0x558a072b4860 msgr2=0x558a073393a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.508+0000 7f38f81cce00 1 -- 10.20.193.28:0/2851537590 shutdown_connections 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.509+0000 7f38f81cce00 1 -- 10.20.193.28:0/2851537590 wait complete. 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.509+0000 7f38f81cce00 1 -- start start 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.509+0000 7f38f81cce00 1 Processor -- start 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a072d6360 0x558a072ba5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a072b4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38f81cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a0731bb20 0x558a072b5170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38f81cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558a0732b130 con 0x558a0731bb20 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38f81cce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558a072bac30 con 0x558a072d6360 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38f81cce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558a072badf0 con 0x558a072d6c70 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a072b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a072b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39952/0 (socket says 10.20.193.28:39952) 2026-02-20T13:21:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 -- 10.20.193.28:0/150723095 learned_addr learned my addr 10.20.193.28:0/150723095 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38effff640 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a0731bb20 0x558a072b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a072d6360 0x558a072ba5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 -- 10.20.193.28:0/150723095 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a072d6360 msgr2=0x558a072ba5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a072d6360 0x558a072ba5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 -- 10.20.193.28:0/150723095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a0731bb20 msgr2=0x558a072b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a0731bb20 0x558a072b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 -- 10.20.193.28:0/150723095 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a071666f0 con 0x558a072d6c70 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38eeffd640 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a072b4c30 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=2479031150028392970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e0005aa0 tx=0x7f38e0002cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226749b24c920a0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.510+0000 7f38b17fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38b17fa640 1 -- 10.20.193.28:0/150723095 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e00cd040 con 0x558a072d6c70 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a071780e0 con 0x558a072d6c70 2026-02-20T13:21:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38b17fa640 1 -- 10.20.193.28:0/150723095 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38e00acf10 con 0x558a072d6c70 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38b17fa640 1 -- 10.20.193.28:0/150723095 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e00b7440 con 0x558a072d6c70 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 10 client.26974 _ll_register_callbacks cb 0x558a07163a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38e00abd10 con 0x558a072d6c70 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38b17fa640 1 -- 10.20.193.28:0/150723095 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f38e00ad1a0 con 0x558a072d6c70 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38b17fa640 1 -- 10.20.193.28:0/150723095 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38e00ad360 con 0x558a072d6c70 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 10 client.26974 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558a07178340 con 0x558a072d6c70 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38b17fa640 1 -- 10.20.193.28:0/150723095 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f38e00716a0 con 0x558a072d6c70 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 10 client.26974 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 10 client.26974 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 20 client.26974 populate_metadata read hostname 'trial028' 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558a073ca370 0x558a073ea820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 4 client.26974 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.511+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a06e75f40 con 0x558a073ca370 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.512+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558a073ca370 0x558a073ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.512+0000 7f38ef7fe640 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558a073ca370 0x558a073ea820 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=6455946256284050889 s_cookie=7727255028967988178 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=599820ea3ed2e5c9 server_cookie=6b3cb982127cdbd2 in_seq=0 out_seq=0 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.512+0000 7f38b17fa640 10 client.26974 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.512+0000 7f38b17fa640 1 -- 10.20.193.28:0/150723095 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a06e75f40 con 0x558a073ca370 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.512+0000 7f38b17fa640 10 client.26974 handle_command_reply: tid=0 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.512+0000 7f38f81cce00 1 client.26974 shutdown 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 msgr2=0x558a072b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a072b4c30 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=2479031150028392970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e0005aa0 tx=0x7f38e0002cc0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 shutdown_connections 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558a073ca370 0x558a073ea820 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=6455946256284050889 s_cookie=7727255028967988178 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a0731bb20 0x558a072b5170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558a072d6c70 0x558a072b4c30 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=2479031150028392970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 --2- 10.20.193.28:0/150723095 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558a072d6360 0x558a072ba5f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 >> 10.20.193.28:0/150723095 conn(0x558a072b4860 msgr2=0x558a073319e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38b17fa640 0 client.26974 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 shutdown_connections 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 1 -- 10.20.193.28:0/150723095 wait complete. 2026-02-20T13:21:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f81cce00 20 client.26974 trim_cache size 0 max 16384 2026-02-20T13:21:57.522 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:57.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 -- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f38c40b5760 msgr2=0x7f38c40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f38c40b5760 0x7f38c40d5c10 secure :-1 s=READY pgs=365 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38dc004740 tx=0x7f38dc005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:57.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 -- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 msgr2=0x7f38f00f4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 0x7f38f00f4f30 secure :-1 s=READY pgs=679 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e000d950 tx=0x7f38e000de20 comp rx=0 tx=0).stop 2026-02-20T13:21:57.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 -- 10.20.193.28:0/2559118429 shutdown_connections 2026-02-20T13:21:57.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f38c40b5760 0x7f38c40d5c10 unknown :-1 s=CLOSED pgs=365 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f010be20 0x7f38f00f4f30 unknown :-1 s=CLOSED pgs=679 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f38f010dcd0 0x7f38f00fa300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 --2- 10.20.193.28:0/2559118429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38f010b3c0 0x7f38f00f49f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.513+0000 7f38f4f49640 1 -- 10.20.193.28:0/2559118429 >> 10.20.193.28:0/2559118429 conn(0x7f38f00e9080 msgr2=0x7f38f00eaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.514+0000 7f38f4f49640 1 -- 10.20.193.28:0/2559118429 shutdown_connections 2026-02-20T13:21:57.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.514+0000 7f38f4f49640 1 -- 10.20.193.28:0/2559118429 wait complete. 2026-02-20T13:21:57.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:57 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2435195700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:57.614 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:21:57.798 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.971+0000 7f6e935b1640 1 -- 10.20.193.28:0/3928550663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 msgr2=0x7f6e8c113d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.971+0000 7f6e935b1640 1 --2- 10.20.193.28:0/3928550663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 0x7f6e8c113d50 secure :-1 s=READY pgs=683 gs=1 cs=0 l=1 c_cookie=1591001680425486124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e78009950 tx=0x7f6e7802f190 comp rx=0 tx=0).stop 2026-02-20T13:21:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 -- 10.20.193.28:0/3928550663 shutdown_connections 2026-02-20T13:21:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 --2- 10.20.193.28:0/3928550663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 0x7f6e8c113d50 unknown :-1 s=CLOSED pgs=683 gs=1 cs=0 l=1 c_cookie=1591001680425486124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 --2- 10.20.193.28:0/3928550663 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e8c1144d0 0x7f6e8c176000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 --2- 10.20.193.28:0/3928550663 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6e8c10b610 0x7f6e8c10b9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 -- 10.20.193.28:0/3928550663 >> 10.20.193.28:0/3928550663 conn(0x7f6e8c0e9080 msgr2=0x7f6e8c109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 -- 10.20.193.28:0/3928550663 shutdown_connections 2026-02-20T13:21:57.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 -- 10.20.193.28:0/3928550663 wait complete. 2026-02-20T13:21:57.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 Processor -- start 2026-02-20T13:21:57.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.972+0000 7f6e935b1640 1 -- start start 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e935b1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6e8c10b610 0x7f6e8c11de00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e935b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 0x7f6e8c11e340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e935b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e8c1144d0 0x7f6e8c123710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e935b1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c123d30 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e935b1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c123ea0 con 0x7f6e8c10b610 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e935b1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c124060 con 0x7f6e8c1144d0 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 0x7f6e8c11e340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 0x7f6e8c11e340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53742/0 (socket says 10.20.193.28:53742) 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 -- 10.20.193.28:0/2499601939 learned_addr learned my addr 10.20.193.28:0/2499601939 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e92db0640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e8c1144d0 0x7f6e8c123710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e925af640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6e8c10b610 0x7f6e8c11de00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 -- 10.20.193.28:0/2499601939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e8c1144d0 msgr2=0x7f6e8c123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e8c1144d0 0x7f6e8c123710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 -- 10.20.193.28:0/2499601939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6e8c10b610 msgr2=0x7f6e8c11de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6e8c10b610 0x7f6e8c11de00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 -- 10.20.193.28:0/2499601939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e78009570 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.973+0000 7f6e91dae640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 0x7f6e8c11e340 secure :-1 s=READY pgs=684 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e78004820 tx=0x7f6e780043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.974+0000 7f6e777fe640 1 -- 10.20.193.28:0/2499601939 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e7803d070 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.974+0000 7f6e777fe640 1 -- 10.20.193.28:0/2499601939 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6e78002ad0 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.974+0000 7f6e777fe640 1 -- 10.20.193.28:0/2499601939 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e78041a00 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.974+0000 7f6e935b1640 1 -- 10.20.193.28:0/2499601939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8c1242e0 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.974+0000 7f6e935b1640 1 -- 10.20.193.28:0/2499601939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8c1648a0 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.980 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:57 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2435195700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:57.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.977+0000 7f6e777fe640 1 -- 10.20.193.28:0/2499601939 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6e78038c20 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.978+0000 7f6e777fe640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6e680b5760 0x7f6e680d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.978+0000 7f6e777fe640 1 -- 10.20.193.28:0/2499601939 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6e7810b190 con 0x7f6e8c10bfb0 2026-02-20T13:21:57.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.979+0000 7f6e925af640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6e680b5760 0x7f6e680d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.979+0000 7f6e925af640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6e680b5760 0x7f6e680d5c10 secure :-1 s=READY pgs=366 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e84004740 tx=0x7f6e84004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.979+0000 7f6e96834e00 1 Processor -- start 2026-02-20T13:21:57.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.979+0000 7f6e96834e00 1 -- start start 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd606730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606c70 0x55f3cd64b5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd64bb20 0x55f3cd66bf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e96834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd51c780 con 0x55f3cd64bb20 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e96834e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd5184b0 con 0x55f3cd606360 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e96834e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd512450 con 0x55f3cd606c70 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e92db0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd64bb20 0x55f3cd66bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e925af640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd606730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e92db0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd64bb20 0x55f3cd66bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53758/0 (socket says 10.20.193.28:53758) 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e92db0640 1 -- 10.20.193.28:0/1263463694 learned_addr learned my addr 10.20.193.28:0/1263463694 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e91dae640 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606c70 0x55f3cd64b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e92db0640 1 -- 10.20.193.28:0/1263463694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606c70 msgr2=0x55f3cd64b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e92db0640 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606c70 0x55f3cd64b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e92db0640 1 -- 10.20.193.28:0/1263463694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 msgr2=0x55f3cd606730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.980+0000 7f6e92db0640 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd606730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e92db0640 1 -- 10.20.193.28:0/1263463694 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cd4bdd10 con 0x55f3cd64bb20 2026-02-20T13:21:57.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e925af640 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd606730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:57.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e92db0640 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd64bb20 0x55f3cd66bf00 secure :-1 s=READY pgs=685 gs=1 cs=0 l=1 c_cookie=15393121206252685454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e80003a20 tx=0x7f6e80003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59f5a2e4b39488e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e74cf3640 1 -- 10.20.193.28:0/1263463694 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e80011d00 con 0x55f3cd64bb20 2026-02-20T13:21:57.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e74cf3640 1 -- 10.20.193.28:0/1263463694 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6e80011e60 con 0x55f3cd64bb20 2026-02-20T13:21:57.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e74cf3640 1 -- 10.20.193.28:0/1263463694 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e800136d0 con 0x55f3cd64bb20 2026-02-20T13:21:57.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e96834e00 1 -- 10.20.193.28:0/1263463694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd64bb20 msgr2=0x55f3cd66bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e96834e00 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd64bb20 0x55f3cd66bf00 secure :-1 s=READY pgs=685 gs=1 cs=0 l=1 c_cookie=15393121206252685454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e80003a20 tx=0x7f6e80003ef0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e96834e00 1 -- 10.20.193.28:0/1263463694 shutdown_connections 2026-02-20T13:21:57.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e96834e00 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd64bb20 0x55f3cd66bf00 unknown :-1 s=CLOSED pgs=685 gs=1 cs=0 l=1 c_cookie=15393121206252685454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e96834e00 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606c70 0x55f3cd64b5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e96834e00 1 --2- 10.20.193.28:0/1263463694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd606730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.981+0000 7f6e96834e00 1 -- 10.20.193.28:0/1263463694 >> 10.20.193.28:0/1263463694 conn(0x55f3cd5e4860 msgr2=0x55f3cd604c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.982+0000 7f6e96834e00 1 -- 10.20.193.28:0/1263463694 shutdown_connections 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.982+0000 7f6e96834e00 1 -- 10.20.193.28:0/1263463694 wait complete. 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.983+0000 7f6e96834e00 1 -- start start 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.983+0000 7f6e96834e00 1 Processor -- start 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 0x55f3cd60a880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd60adc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 0x55f3cd60c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e96834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd60ce30 con 0x55f3cd606c70 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e96834e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd60cfa0 con 0x55f3cd64bb20 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e96834e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd60d160 con 0x55f3cd606360 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e91dae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd60adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e91dae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd60adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53768/0 (socket says 10.20.193.28:53768) 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e91dae640 1 -- 10.20.193.28:0/2207718824 learned_addr learned my addr 10.20.193.28:0/2207718824 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e92db0640 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 0x55f3cd60c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e925af640 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 0x55f3cd60a880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e91dae640 1 -- 10.20.193.28:0/2207718824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 msgr2=0x55f3cd60a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e91dae640 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 0x55f3cd60a880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e91dae640 1 -- 10.20.193.28:0/2207718824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 msgr2=0x55f3cd60c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e91dae640 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 0x55f3cd60c730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.984+0000 7f6e91dae640 1 -- 10.20.193.28:0/2207718824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cd4963c0 con 0x55f3cd606c70 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e91dae640 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd60adc0 secure :-1 s=READY pgs=686 gs=1 cs=0 l=1 c_cookie=7602232354397677550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e780ce7f0 tx=0x7f6e780414b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69808e0c47dae7ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e3ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e3ffff640 1 -- 10.20.193.28:0/2207718824 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e7807dea0 con 0x55f3cd606c70 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e3ffff640 1 -- 10.20.193.28:0/2207718824 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6e780d7210 con 0x55f3cd606c70 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e3ffff640 1 -- 10.20.193.28:0/2207718824 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e780d2ee0 con 0x55f3cd606c70 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e800055d0 con 0x55f3cd606c70 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e3ffff640 1 -- 10.20.193.28:0/2207718824 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6e780d3070 con 0x55f3cd606c70 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e3ffff640 10 client.17076 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e96834e00 10 client.17076 _ll_register_callbacks cb 0x55f3cd493a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3cd1a86f0 con 0x55f3cd606c70 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e3ffff640 1 -- 10.20.193.28:0/2207718824 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6e780d97f0 con 0x55f3cd606c70 2026-02-20T13:21:57.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e96834e00 10 client.17076 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.985+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f3cd4a80e0 con 0x55f3cd606c70 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.986+0000 7f6e3ffff640 1 -- 10.20.193.28:0/2207718824 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6e780dc1a0 con 0x55f3cd606c70 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.986+0000 7f6e96834e00 10 client.17076 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.986+0000 7f6e96834e00 10 client.17076 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.986+0000 7f6e96834e00 20 client.17076 populate_metadata read hostname 'trial028' 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.986+0000 7f6e96834e00 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f3cd631770 0x55f3cd631c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.986+0000 7f6e96834e00 4 client.17076 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.986+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3cd4b4f80 con 0x55f3cd631770 2026-02-20T13:21:57.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.986+0000 7f6e925af640 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f3cd631770 0x55f3cd631c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:57 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2435195700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:21:57.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.987+0000 7f6e925af640 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f3cd631770 0x55f3cd631c10 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=10581957040444510992 s_cookie=7509243677796678052 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=92daa9dcd8239310 server_cookie=68363156daeb39a4 in_seq=0 out_seq=0 2026-02-20T13:21:57.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.987+0000 7f6e3ffff640 10 client.17076 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.987+0000 7f6e3ffff640 1 -- 10.20.193.28:0/2207718824 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f3cd4b4f80 con 0x55f3cd631770 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.987+0000 7f6e3ffff640 10 client.17076 handle_command_reply: tid=0 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.987+0000 7f6e96834e00 1 client.17076 shutdown 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 msgr2=0x55f3cd60adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd60adc0 secure :-1 s=READY pgs=686 gs=1 cs=0 l=1 c_cookie=7602232354397677550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e780ce7f0 tx=0x7f6e780414b0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 shutdown_connections 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f3cd631770 0x55f3cd631c10 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=10581957040444510992 s_cookie=7509243677796678052 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd60adc0 unknown :-1 s=CLOSED pgs=686 gs=1 cs=0 l=1 c_cookie=7602232354397677550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 0x55f3cd60c730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 --2- 10.20.193.28:0/2207718824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 0x55f3cd60a880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 >> 10.20.193.28:0/2207718824 conn(0x55f3cd5e4860 msgr2=0x55f3cd604c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e3ffff640 0 client.17076 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:21:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 shutdown_connections 2026-02-20T13:21:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 1 -- 10.20.193.28:0/2207718824 wait complete. 2026-02-20T13:21:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.988+0000 7f6e96834e00 20 client.17076 trim_cache size 0 max 16384 2026-02-20T13:21:57.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e96834e00 1 Processor -- start 2026-02-20T13:21:57.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e96834e00 1 -- start start 2026-02-20T13:21:57.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 0x55f3cd60c5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd6689b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 0x55f3cd668ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:57.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e96834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd510080 con 0x55f3cd606c70 2026-02-20T13:21:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e96834e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd1d0700 con 0x55f3cd64bb20 2026-02-20T13:21:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e96834e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd5e12e0 con 0x55f3cd606360 2026-02-20T13:21:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e91dae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd6689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e925af640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 0x55f3cd60c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e91dae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd6689b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53782/0 (socket says 10.20.193.28:53782) 2026-02-20T13:21:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.995+0000 7f6e91dae640 1 -- 10.20.193.28:0/1698504780 learned_addr learned my addr 10.20.193.28:0/1698504780 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e92db0640 1 --2- 10.20.193.28:0/1698504780 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 0x55f3cd668ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e91dae640 1 -- 10.20.193.28:0/1698504780 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 msgr2=0x55f3cd60c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e91dae640 1 --2- 10.20.193.28:0/1698504780 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 0x55f3cd60c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e91dae640 1 -- 10.20.193.28:0/1698504780 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 msgr2=0x55f3cd668ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e91dae640 1 --2- 10.20.193.28:0/1698504780 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 0x55f3cd668ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e91dae640 1 -- 10.20.193.28:0/1698504780 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cd65e3c0 con 0x55f3cd606c70 2026-02-20T13:21:58.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e91dae640 1 --2- 10.20.193.28:0/1698504780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd6689b0 secure :-1 s=READY pgs=687 gs=1 cs=0 l=1 c_cookie=12379621659584217408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e78096240 tx=0x7f6e7803a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcd404f313fc140 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e5a4e6640 1 -- 10.20.193.28:0/1698504780 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e780d2ee0 con 0x55f3cd606c70 2026-02-20T13:21:58.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e5a4e6640 1 -- 10.20.193.28:0/1698504780 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f3cd1a86f0 con 0x55f3cd606c70 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e5a4e6640 1 -- 10.20.193.28:0/1698504780 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e7807dea0 con 0x55f3cd606c70 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e96834e00 1 -- 10.20.193.28:0/1698504780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 msgr2=0x55f3cd6689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e96834e00 1 --2- 10.20.193.28:0/1698504780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd6689b0 secure :-1 s=READY pgs=687 gs=1 cs=0 l=1 c_cookie=12379621659584217408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e78096240 tx=0x7f6e7803a030 comp rx=0 tx=0).stop 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e96834e00 1 -- 10.20.193.28:0/1698504780 shutdown_connections 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e96834e00 1 --2- 10.20.193.28:0/1698504780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd6689b0 unknown :-1 s=CLOSED pgs=687 gs=1 cs=0 l=1 c_cookie=12379621659584217408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e96834e00 1 --2- 10.20.193.28:0/1698504780 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd64bb20 0x55f3cd668ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e96834e00 1 --2- 10.20.193.28:0/1698504780 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd606360 0x55f3cd60c5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e96834e00 1 -- 10.20.193.28:0/1698504780 >> 10.20.193.28:0/1698504780 conn(0x55f3cd5e4860 msgr2=0x55f3cd6682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.996+0000 7f6e96834e00 1 -- 10.20.193.28:0/1698504780 shutdown_connections 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.997+0000 7f6e96834e00 1 -- 10.20.193.28:0/1698504780 wait complete. 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.997+0000 7f6e96834e00 1 -- start start 2026-02-20T13:21:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.997+0000 7f6e96834e00 1 Processor -- start 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd644450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd62c6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e96834e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd64bb20 0x55f3cd62cc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e96834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd510080 con 0x55f3cd606c70 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e96834e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd1d0700 con 0x55f3cd606360 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e96834e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd62d170 con 0x55f3cd64bb20 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e91dae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd62c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e925af640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd644450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e925af640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd644450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50456/0 (socket says 10.20.193.28:50456) 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e925af640 1 -- 10.20.193.28:0/65484057 learned_addr learned my addr 10.20.193.28:0/65484057 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e92db0640 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd64bb20 0x55f3cd62cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e91dae640 1 -- 10.20.193.28:0/65484057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd64bb20 msgr2=0x55f3cd62cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e91dae640 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd64bb20 0x55f3cd62cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e91dae640 1 -- 10.20.193.28:0/65484057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 msgr2=0x55f3cd644450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e91dae640 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd644450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e91dae640 1 -- 10.20.193.28:0/65484057 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cd4a2b60 con 0x55f3cd606c70 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e91dae640 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd62c6f0 secure :-1 s=READY pgs=688 gs=2 cs=0 l=1 c_cookie=18208343734756354278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e780ce7f0 tx=0x7f6e780d1650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb10827a25ca8e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.998+0000 7f6e3ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e3ffff640 1 -- 10.20.193.28:0/65484057 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e780d97f0 con 0x55f3cd606c70 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e3ffff640 1 -- 10.20.193.28:0/65484057 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6e780d7210 con 0x55f3cd606c70 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cd4a80e0 con 0x55f3cd606c70 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 10 client.17082 _ll_register_callbacks cb 0x55f3cd493a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e80011e60 con 0x55f3cd606c70 2026-02-20T13:21:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e3ffff640 1 -- 10.20.193.28:0/65484057 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e7802f9f0 con 0x55f3cd606c70 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e3ffff640 1 -- 10.20.193.28:0/65484057 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6e7802fb50 con 0x55f3cd606c70 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e3ffff640 1 -- 10.20.193.28:0/65484057 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6e780d07e0 con 0x55f3cd606c70 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 10 client.17082 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f3cd4966f0 con 0x55f3cd606c70 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e3ffff640 1 -- 10.20.193.28:0/65484057 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6e780dc1a0 con 0x55f3cd606c70 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 10 client.17082 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 10 client.17082 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 20 client.17082 populate_metadata read hostname 'trial028' 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f3cd701760 0x55f3cd721c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 4 client.17082 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:57.999+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3cd1a5f40 con 0x55f3cd701760 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.000+0000 7f6e925af640 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f3cd701760 0x55f3cd721c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e925af640 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f3cd701760 0x55f3cd721c10 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=6406536273798340201 s_cookie=3779874303169213537 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=58e896cc38679e69 server_cookie=3474cfa6f0073461 in_seq=0 out_seq=0 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e3ffff640 10 client.17082 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e3ffff640 1 -- 10.20.193.28:0/65484057 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3cd1a5f40 con 0x55f3cd701760 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e3ffff640 10 client.17082 handle_command_reply: tid=0 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 client.17082 shutdown 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 msgr2=0x55f3cd62c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd62c6f0 secure :-1 s=READY pgs=688 gs=2 cs=0 l=1 c_cookie=18208343734756354278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e780ce7f0 tx=0x7f6e780d1650 comp rx=0 tx=0).stop 2026-02-20T13:21:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 shutdown_connections 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f3cd701760 0x55f3cd721c10 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=6406536273798340201 s_cookie=3779874303169213537 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3cd606c70 0x55f3cd62c6f0 unknown :-1 s=CLOSED pgs=688 gs=2 cs=0 l=1 c_cookie=18208343734756354278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3cd64bb20 0x55f3cd62cc30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 --2- 10.20.193.28:0/65484057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3cd606360 0x55f3cd644450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 >> 10.20.193.28:0/65484057 conn(0x55f3cd5e4860 msgr2=0x55f3cd668a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e3ffff640 0 client.17082 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 shutdown_connections 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 1 -- 10.20.193.28:0/65484057 wait complete. 2026-02-20T13:21:58.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.001+0000 7f6e96834e00 20 client.17082 trim_cache size 0 max 16384 2026-02-20T13:21:58.010 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:58.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 -- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6e680b5760 msgr2=0x7f6e680d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6e680b5760 0x7f6e680d5c10 secure :-1 s=READY pgs=366 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e84004740 tx=0x7f6e84004420 comp rx=0 tx=0).stop 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 -- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 msgr2=0x7f6e8c11e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 0x7f6e8c11e340 secure :-1 s=READY pgs=684 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e78004820 tx=0x7f6e780043d0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 -- 10.20.193.28:0/2499601939 shutdown_connections 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6e680b5760 0x7f6e680d5c10 unknown :-1 s=CLOSED pgs=366 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e8c10bfb0 0x7f6e8c11e340 unknown :-1 s=CLOSED pgs=684 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e8c1144d0 0x7f6e8c123710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 --2- 10.20.193.28:0/2499601939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6e8c10b610 0x7f6e8c11de00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 -- 10.20.193.28:0/2499601939 >> 10.20.193.28:0/2499601939 conn(0x7f6e8c0e9080 msgr2=0x7f6e8c109460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 -- 10.20.193.28:0/2499601939 shutdown_connections 2026-02-20T13:21:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.002+0000 7f6e935b1640 1 -- 10.20.193.28:0/2499601939 wait complete. 2026-02-20T13:21:58.104 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:21:58.289 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:58.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 -- 10.20.193.28:0/1921103679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 msgr2=0x7f42e817a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/1921103679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 0x7f42e817a570 secure :-1 s=READY pgs=689 gs=1 cs=0 l=1 c_cookie=13543731680743783503 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42e400aa30 tx=0x7f42e4030270 comp rx=0 tx=0).stop 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 -- 10.20.193.28:0/1921103679 shutdown_connections 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/1921103679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 0x7f42e817a570 unknown :-1 s=CLOSED pgs=689 gs=1 cs=0 l=1 c_cookie=13543731680743783503 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/1921103679 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f42e8114990 0x7f42e81193f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/1921103679 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f42e8113fa0 0x7f42e8114370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 -- 10.20.193.28:0/1921103679 >> 10.20.193.28:0/1921103679 conn(0x7f42e8064a90 msgr2=0x7f42e8064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 -- 10.20.193.28:0/1921103679 shutdown_connections 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.475+0000 7f42ee7f9640 1 -- 10.20.193.28:0/1921103679 wait complete. 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ee7f9640 1 Processor -- start 2026-02-20T13:21:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ee7f9640 1 -- start start 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ee7f9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f42e8113fa0 0x7f42e8122280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ee7f9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f42e8114990 0x7f42e81227c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ee7f9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 0x7f42e8127b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ee7f9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f42e8128160 con 0x7f42e8119ba0 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ee7f9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f42e81282d0 con 0x7f42e8113fa0 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ee7f9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f42e8128490 con 0x7f42e8114990 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42edff8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 0x7f42e8127b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42edff8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 0x7f42e8127b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53810/0 (socket says 10.20.193.28:53810) 2026-02-20T13:21:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42edff8640 1 -- 10.20.193.28:0/2391897506 learned_addr learned my addr 10.20.193.28:0/2391897506 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f42e8113fa0 0x7f42e8122280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42ecff6640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f42e8114990 0x7f42e81227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42edff8640 1 -- 10.20.193.28:0/2391897506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f42e8114990 msgr2=0x7f42e81227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42edff8640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f42e8114990 0x7f42e81227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42edff8640 1 -- 10.20.193.28:0/2391897506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f42e8113fa0 msgr2=0x7f42e8122280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42edff8640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f42e8113fa0 0x7f42e8122280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.476+0000 7f42edff8640 1 -- 10.20.193.28:0/2391897506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e400a650 con 0x7f42e8119ba0 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.477+0000 7f42edff8640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 0x7f42e8127b40 secure :-1 s=READY pgs=690 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42e4032fe0 tx=0x7f42e40039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.477+0000 7f42d67fc640 1 -- 10.20.193.28:0/2391897506 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42e403e070 con 0x7f42e8119ba0 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.477+0000 7f42d67fc640 1 -- 10.20.193.28:0/2391897506 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f42e40055a0 con 0x7f42e8119ba0 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.477+0000 7f42ee7f9640 1 -- 10.20.193.28:0/2391897506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e8128710 con 0x7f42e8119ba0 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.477+0000 7f42d67fc640 1 -- 10.20.193.28:0/2391897506 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42e4042a90 con 0x7f42e8119ba0 2026-02-20T13:21:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.477+0000 7f42ee7f9640 1 -- 10.20.193.28:0/2391897506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e8168e70 con 0x7f42e8119ba0 2026-02-20T13:21:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.480+0000 7f42d67fc640 1 -- 10.20.193.28:0/2391897506 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f42e40050c0 con 0x7f42e8119ba0 2026-02-20T13:21:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.482+0000 7f42d67fc640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42c40b5760 0x7f42c40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.482+0000 7f42d67fc640 1 -- 10.20.193.28:0/2391897506 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f42e410cb70 con 0x7f42e8119ba0 2026-02-20T13:21:58.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.482+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42c40b5760 0x7f42c40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.482+0000 7f42f1a7ce00 1 Processor -- start 2026-02-20T13:21:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.482+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42c40b5760 0x7f42c40d5c10 secure :-1 s=READY pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42d8004740 tx=0x7f42d8004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42f1a7ce00 1 -- start start 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6360 0x55ceb82c6730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb830b5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb832bf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ceb81dc780 con 0x55ceb82c6c70 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ceb81d84b0 con 0x55ceb82c6360 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ceb81d2450 con 0x55ceb830bb20 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb830b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb830b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53812/0 (socket says 10.20.193.28:53812) 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 -- 10.20.193.28:0/2178362156 learned_addr learned my addr 10.20.193.28:0/2178362156 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6360 0x55ceb82c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42edff8640 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb832bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 -- 10.20.193.28:0/2178362156 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 msgr2=0x55ceb832bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb832bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 -- 10.20.193.28:0/2178362156 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6360 msgr2=0x55ceb82c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6360 0x55ceb82c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 -- 10.20.193.28:0/2178362156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb817dd10 con 0x55ceb82c6c70 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42edff8640 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb832bf00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.483+0000 7f42ecff6640 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb830b5e0 secure :-1 s=READY pgs=691 gs=1 cs=0 l=1 c_cookie=2312374922828241790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42dc002b60 tx=0x7f42dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201734bda6b2db7e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42b5ce5640 1 -- 10.20.193.28:0/2178362156 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42dc002e80 con 0x55ceb82c6c70 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42b5ce5640 1 -- 10.20.193.28:0/2178362156 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f42dc00fe50 con 0x55ceb82c6c70 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42b5ce5640 1 -- 10.20.193.28:0/2178362156 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42dc0109a0 con 0x55ceb82c6c70 2026-02-20T13:21:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/2178362156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 msgr2=0x55ceb830b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb830b5e0 secure :-1 s=READY pgs=691 gs=1 cs=0 l=1 c_cookie=2312374922828241790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42dc002b60 tx=0x7f42dc00f730 comp rx=0 tx=0).stop 2026-02-20T13:21:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/2178362156 shutdown_connections 2026-02-20T13:21:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb830b5e0 unknown :-1 s=CLOSED pgs=691 gs=1 cs=0 l=1 c_cookie=2312374922828241790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb832bf00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/2178362156 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6360 0x55ceb82c6730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/2178362156 >> 10.20.193.28:0/2178362156 conn(0x55ceb82a4860 msgr2=0x55ceb82c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/2178362156 shutdown_connections 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.484+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/2178362156 wait complete. 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.485+0000 7f42f1a7ce00 1 -- start start 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42f1a7ce00 1 Processor -- start 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb83236c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb8323c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb830bb20 0x55ceb8328bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ceb8329130 con 0x55ceb830bb20 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ceb83292a0 con 0x55ceb82c6c70 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ceb8329460 con 0x55ceb82c6360 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42edff8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb830bb20 0x55ceb8328bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42edff8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb830bb20 0x55ceb8328bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53824/0 (socket says 10.20.193.28:53824) 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42edff8640 1 -- 10.20.193.28:0/3119456185 learned_addr learned my addr 10.20.193.28:0/3119456185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42ecff6640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb8323c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.486+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb83236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42edff8640 1 -- 10.20.193.28:0/3119456185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 msgr2=0x55ceb83236c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42edff8640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb83236c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42edff8640 1 -- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 msgr2=0x55ceb8323c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42edff8640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb8323c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42edff8640 1 -- 10.20.193.28:0/3119456185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb81563c0 con 0x55ceb830bb20 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb83236c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42ecff6640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb8323c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42edff8640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb830bb20 0x55ceb8328bf0 secure :-1 s=READY pgs=692 gs=1 cs=0 l=1 c_cookie=14407642551282580698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42e4039820 tx=0x7f42e4030270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f23a90c0003cda server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42a2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42a2ffd640 1 -- 10.20.193.28:0/3119456185 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42e40d38d0 con 0x55ceb830bb20 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc002780 con 0x55ceb830bb20 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42f1a7ce00 10 client.17094 _ll_register_callbacks cb 0x55ceb8153a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ceb7e686f0 con 0x55ceb830bb20 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42a2ffd640 1 -- 10.20.193.28:0/3119456185 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f42e40d8bf0 con 0x55ceb830bb20 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42a2ffd640 1 -- 10.20.193.28:0/3119456185 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42e40d3de0 con 0x55ceb830bb20 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42a2ffd640 1 -- 10.20.193.28:0/3119456185 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f42e40f81f0 con 0x55ceb830bb20 2026-02-20T13:21:58.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42a2ffd640 1 -- 10.20.193.28:0/3119456185 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42e40ddb80 con 0x55ceb830bb20 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42f1a7ce00 10 client.17094 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.487+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ceb81680e0 con 0x55ceb830bb20 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.488+0000 7f42a2ffd640 1 -- 10.20.193.28:0/3119456185 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f42e4036320 con 0x55ceb830bb20 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.488+0000 7f42f1a7ce00 10 client.17094 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.488+0000 7f42f1a7ce00 10 client.17094 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.488+0000 7f42f1a7ce00 20 client.17094 populate_metadata read hostname 'trial028' 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.488+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55ceb8308dd0 0x55ceb8309270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.488+0000 7f42f1a7ce00 4 client.17094 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.488+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ceb8174f80 con 0x55ceb8308dd0 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.488+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55ceb8308dd0 0x55ceb8309270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.489+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55ceb8308dd0 0x55ceb8309270 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=75055604697052693 s_cookie=9040809739805994823 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10aa6acc05eb615 server_cookie=7d77688edf072f47 in_seq=0 out_seq=0 2026-02-20T13:21:58.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.489+0000 7f42a2ffd640 10 client.17094 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.489+0000 7f42a2ffd640 1 -- 10.20.193.28:0/3119456185 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ceb8174f80 con 0x55ceb8308dd0 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.489+0000 7f42a2ffd640 10 client.17094 handle_command_reply: tid=0 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.489+0000 7f42f1a7ce00 1 client.17094 shutdown 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb830bb20 msgr2=0x55ceb8328bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb830bb20 0x55ceb8328bf0 secure :-1 s=READY pgs=692 gs=1 cs=0 l=1 c_cookie=14407642551282580698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42e4039820 tx=0x7f42e4030270 comp rx=0 tx=0).stop 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 shutdown_connections 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55ceb8308dd0 0x55ceb8309270 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=75055604697052693 s_cookie=9040809739805994823 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb830bb20 0x55ceb8328bf0 unknown :-1 s=CLOSED pgs=692 gs=1 cs=0 l=1 c_cookie=14407642551282580698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb8323c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42a2ffd640 0 client.17094 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:21:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3119456185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb83236c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 >> 10.20.193.28:0/3119456185 conn(0x55ceb82a4860 msgr2=0x55ceb82c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 shutdown_connections 2026-02-20T13:21:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3119456185 wait complete. 2026-02-20T13:21:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.490+0000 7f42f1a7ce00 20 client.17094 trim_cache size 0 max 16384 2026-02-20T13:21:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42f1a7ce00 1 Processor -- start 2026-02-20T13:21:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42f1a7ce00 1 -- start start 2026-02-20T13:21:58.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb8320760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb8320ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb830bb20 0x55ceb8306780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ceb81d0080 con 0x55ceb82c6c70 2026-02-20T13:21:58.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ceb7e90700 con 0x55ceb830bb20 2026-02-20T13:21:58.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ceb831c550 con 0x55ceb82c6360 2026-02-20T13:21:58.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb8320ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb8320ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53834/0 (socket says 10.20.193.28:53834) 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 -- 10.20.193.28:0/3592633445 learned_addr learned my addr 10.20.193.28:0/3592633445 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/3592633445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb8320760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 -- 10.20.193.28:0/3592633445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 msgr2=0x55ceb8320760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 --2- 10.20.193.28:0/3592633445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb8320760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 -- 10.20.193.28:0/3592633445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb830bb20 msgr2=0x55ceb8306780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 --2- 10.20.193.28:0/3592633445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb830bb20 0x55ceb8306780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 -- 10.20.193.28:0/3592633445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb8162b60 con 0x55ceb82c6c70 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.498+0000 7f42ecff6640 1 --2- 10.20.193.28:0/3592633445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb8320ca0 secure :-1 s=READY pgs=693 gs=1 cs=0 l=1 c_cookie=16938753918072619410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42dc005db0 tx=0x7f42dc004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb128af170798192 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42b54e4640 1 -- 10.20.193.28:0/3592633445 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42dc026690 con 0x55ceb82c6c70 2026-02-20T13:21:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42b54e4640 1 -- 10.20.193.28:0/3592633445 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f42dc020070 con 0x55ceb82c6c70 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42b54e4640 1 -- 10.20.193.28:0/3592633445 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42dc01ac50 con 0x55ceb82c6c70 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3592633445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 msgr2=0x55ceb8320ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3592633445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb8320ca0 secure :-1 s=READY pgs=693 gs=1 cs=0 l=1 c_cookie=16938753918072619410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42dc005db0 tx=0x7f42dc004050 comp rx=0 tx=0).stop 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3592633445 shutdown_connections 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3592633445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6c70 0x55ceb8320ca0 unknown :-1 s=CLOSED pgs=693 gs=1 cs=0 l=1 c_cookie=16938753918072619410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3592633445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb830bb20 0x55ceb8306780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/3592633445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb82c6360 0x55ceb8320760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3592633445 >> 10.20.193.28:0/3592633445 conn(0x55ceb82a4860 msgr2=0x55ceb8320050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3592633445 shutdown_connections 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.499+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/3592633445 wait complete. 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42f1a7ce00 1 -- start start 2026-02-20T13:21:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42f1a7ce00 1 Processor -- start 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6360 0x55ceb82a66e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb82a6c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42f1a7ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb8371950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ceb82a73c0 con 0x55ceb82c6360 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ceb8371e90 con 0x55ceb82c6c70 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42f1a7ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ceb8372050 con 0x55ceb830bb20 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42ed7f7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6360 0x55ceb82a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42ed7f7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6360 0x55ceb82a66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53848/0 (socket says 10.20.193.28:53848) 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.500+0000 7f42ed7f7640 1 -- 10.20.193.28:0/915297568 learned_addr learned my addr 10.20.193.28:0/915297568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42edff8640 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb8371950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42ecff6640 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb82a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42ed7f7640 1 -- 10.20.193.28:0/915297568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 msgr2=0x55ceb8371950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb8371950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42ed7f7640 1 -- 10.20.193.28:0/915297568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 msgr2=0x55ceb82a6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb82a6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42ed7f7640 1 -- 10.20.193.28:0/915297568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb81566f0 con 0x55ceb82c6360 2026-02-20T13:21:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42ed7f7640 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6360 0x55ceb82a66e0 secure :-1 s=READY pgs=694 gs=1 cs=0 l=1 c_cookie=3929931513664411430 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42d8010010 tx=0x7f42d8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3689ebe3d7949726 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42a2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:21:58.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42a2ffd640 1 -- 10.20.193.28:0/915297568 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42d8011660 con 0x55ceb82c6360 2026-02-20T13:21:58.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42a2ffd640 1 -- 10.20.193.28:0/915297568 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f42d8026030 con 0x55ceb82c6360 2026-02-20T13:21:58.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42a2ffd640 1 -- 10.20.193.28:0/915297568 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42d801fe00 con 0x55ceb82c6360 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceb817dd10 con 0x55ceb82c6360 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42a2ffd640 1 -- 10.20.193.28:0/915297568 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f42d8033410 con 0x55ceb82c6360 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42f1a7ce00 10 client.17100 _ll_register_callbacks cb 0x55ceb8153a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.501+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ceb7f2a4a0 con 0x55ceb82c6360 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42a2ffd640 1 -- 10.20.193.28:0/915297568 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42d801f450 con 0x55ceb82c6360 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42f1a7ce00 10 client.17100 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ceb8168340 con 0x55ceb82c6360 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42a2ffd640 1 -- 10.20.193.28:0/915297568 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f42d8019070 con 0x55ceb82c6360 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42f1a7ce00 10 client.17100 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42f1a7ce00 10 client.17100 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42f1a7ce00 20 client.17100 populate_metadata read hostname 'trial028' 2026-02-20T13:21:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55ceb83ba200 0x55ceb83da6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42f1a7ce00 4 client.17100 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f42dc00fe50 con 0x55ceb83ba200 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.502+0000 7f42ecff6640 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55ceb83ba200 0x55ceb83da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42ecff6640 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55ceb83ba200 0x55ceb83da6b0 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=6000283837657378459 s_cookie=9157163309384581404 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=53454a5c0715ee9b server_cookie=7f14c7835e1bc11c in_seq=0 out_seq=0 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42a2ffd640 10 client.17100 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42a2ffd640 1 -- 10.20.193.28:0/915297568 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f42dc00fe50 con 0x55ceb83ba200 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42a2ffd640 10 client.17100 handle_command_reply: tid=0 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 client.17100 shutdown 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6360 msgr2=0x55ceb82a66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6360 0x55ceb82a66e0 secure :-1 s=READY pgs=694 gs=1 cs=0 l=1 c_cookie=3929931513664411430 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42d8010010 tx=0x7f42d8012000 comp rx=0 tx=0).stop 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 shutdown_connections 2026-02-20T13:21:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55ceb83ba200 0x55ceb83da6b0 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=6000283837657378459 s_cookie=9157163309384581404 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ceb830bb20 0x55ceb8371950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ceb82c6c70 0x55ceb82a6c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 --2- 10.20.193.28:0/915297568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ceb82c6360 0x55ceb82a66e0 unknown :-1 s=CLOSED pgs=694 gs=1 cs=0 l=1 c_cookie=3929931513664411430 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 >> 10.20.193.28:0/915297568 conn(0x55ceb82a4860 msgr2=0x55ceb8320760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42a2ffd640 0 client.17100 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.503+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 shutdown_connections 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42f1a7ce00 1 -- 10.20.193.28:0/915297568 wait complete. 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42f1a7ce00 20 client.17100 trim_cache size 0 max 16384 2026-02-20T13:21:58.512 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 -- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42c40b5760 msgr2=0x7f42c40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42c40b5760 0x7f42c40d5c10 secure :-1 s=READY pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42d8004740 tx=0x7f42d8004420 comp rx=0 tx=0).stop 2026-02-20T13:21:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 -- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 msgr2=0x7f42e8127b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 0x7f42e8127b40 secure :-1 s=READY pgs=690 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42e4032fe0 tx=0x7f42e40039b0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 -- 10.20.193.28:0/2391897506 shutdown_connections 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42c40b5760 0x7f42c40d5c10 unknown :-1 s=CLOSED pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42e8119ba0 0x7f42e8127b40 unknown :-1 s=CLOSED pgs=690 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f42e8114990 0x7f42e81227c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 --2- 10.20.193.28:0/2391897506 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f42e8113fa0 0x7f42e8122280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 -- 10.20.193.28:0/2391897506 >> 10.20.193.28:0/2391897506 conn(0x7f42e8064a90 msgr2=0x7f42e8117fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 -- 10.20.193.28:0/2391897506 shutdown_connections 2026-02-20T13:21:58.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.504+0000 7f42ee7f9640 1 -- 10.20.193.28:0/2391897506 wait complete. 2026-02-20T13:21:58.603 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:21:58.787 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:58.831 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:21:58 trial028 ceph-mon[37442]: pgmap v320: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.972+0000 7fc3289c4640 1 -- 10.20.193.28:0/3110444466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc32410b3c0 msgr2=0x7fc32410b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.972+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3110444466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc32410b3c0 0x7fc32410b7d0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=10992441338830906171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc314009890 tx=0x7fc31402f170 comp rx=0 tx=0).stop 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.972+0000 7fc3289c4640 1 -- 10.20.193.28:0/3110444466 shutdown_connections 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.972+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3110444466 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc32410be20 0x7fc324175d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.972+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3110444466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc32410b3c0 0x7fc32410b7d0 unknown :-1 s=CLOSED pgs=277 gs=2 cs=0 l=1 c_cookie=10992441338830906171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.972+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3110444466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc32410dcd0 0x7fc32410e0a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.972+0000 7fc3289c4640 1 -- 10.20.193.28:0/3110444466 >> 10.20.193.28:0/3110444466 conn(0x7fc3240e9080 msgr2=0x7fc324109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.972+0000 7fc3289c4640 1 -- 10.20.193.28:0/3110444466 shutdown_connections 2026-02-20T13:21:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.973+0000 7fc3289c4640 1 -- 10.20.193.28:0/3110444466 wait complete. 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.973+0000 7fc3289c4640 1 Processor -- start 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.973+0000 7fc3289c4640 1 -- start start 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc3289c4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc32410b3c0 0x7fc3240f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc3289c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc32410be20 0x7fc3240f4f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc3289c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc32410dcd0 0x7fc3240fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc3289c4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240fa8f0 con 0x7fc32410dcd0 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc3289c4640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240faa60 con 0x7fc32410b3c0 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc3289c4640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240fac20 con 0x7fc32410be20 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc32410dcd0 0x7fc3240fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc32410dcd0 0x7fc3240fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53868/0 (socket says 10.20.193.28:53868) 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 -- 10.20.193.28:0/3366413078 learned_addr learned my addr 10.20.193.28:0/3366413078 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc3237fe640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc32410b3c0 0x7fc3240f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc322ffd640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc32410be20 0x7fc3240f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 -- 10.20.193.28:0/3366413078 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc32410be20 msgr2=0x7fc3240f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc32410be20 0x7fc3240f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 -- 10.20.193.28:0/3366413078 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc32410b3c0 msgr2=0x7fc3240f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc32410b3c0 0x7fc3240f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 -- 10.20.193.28:0/3366413078 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc310009570 con 0x7fc32410dcd0 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.974+0000 7fc323fff640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc32410dcd0 0x7fc3240fa2d0 secure :-1 s=READY pgs=695 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc31800f8d0 tx=0x7fc31800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:21:58 trial127 ceph-mon[43817]: pgmap v320: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.975+0000 7fc320ff9640 1 -- 10.20.193.28:0/3366413078 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc31800dce0 con 0x7fc32410dcd0 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.975+0000 7fc320ff9640 1 -- 10.20.193.28:0/3366413078 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc31800de40 con 0x7fc32410dcd0 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.975+0000 7fc3289c4640 1 -- 10.20.193.28:0/3366413078 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3140094b0 con 0x7fc32410dcd0 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.975+0000 7fc320ff9640 1 -- 10.20.193.28:0/3366413078 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3180116b0 con 0x7fc32410dcd0 2026-02-20T13:21:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.975+0000 7fc3289c4640 1 -- 10.20.193.28:0/3366413078 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc324172ce0 con 0x7fc32410dcd0 2026-02-20T13:21:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.978+0000 7fc320ff9640 1 -- 10.20.193.28:0/3366413078 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fc318020060 con 0x7fc32410dcd0 2026-02-20T13:21:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.979+0000 7fc320ff9640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2f80b5760 0x7fc2f80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.980+0000 7fc320ff9640 1 -- 10.20.193.28:0/3366413078 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc318015070 con 0x7fc32410dcd0 2026-02-20T13:21:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.980+0000 7fc3237fe640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2f80b5760 0x7fc2f80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.980+0000 7fc32bc47e00 1 Processor -- start 2026-02-20T13:21:58.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.980+0000 7fc3237fe640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2f80b5760 0x7fc2f80d5c10 secure :-1 s=READY pgs=368 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc310005b30 tx=0x7fc310009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.980+0000 7fc32bc47e00 1 -- start start 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.980+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4360 0x55b6284c4730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.980+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4c70 0x55b6285095e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.980+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 0x55b628529f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6283da780 con 0x55b628509b20 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b6283d64b0 con 0x55b6284c4360 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b6283d0450 con 0x55b6284c4c70 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc3237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4360 0x55b6284c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc3237fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4360 0x55b6284c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50546/0 (socket says 10.20.193.28:50546) 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc3237fe640 1 -- 10.20.193.28:0/775520102 learned_addr learned my addr 10.20.193.28:0/775520102 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc322ffd640 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4c70 0x55b6285095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc323fff640 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 0x55b628529f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc3237fe640 1 -- 10.20.193.28:0/775520102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4c70 msgr2=0x55b6285095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc3237fe640 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4c70 0x55b6285095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc3237fe640 1 -- 10.20.193.28:0/775520102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 msgr2=0x55b628529f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc3237fe640 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 0x55b628529f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.981+0000 7fc3237fe640 1 -- 10.20.193.28:0/775520102 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b62837bd10 con 0x55b6284c4360 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc3237fe640 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4360 0x55b6284c4730 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=1809935093128849013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3100043e0 tx=0x7fc310014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=191e2e60b4756675 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc2e7fff640 1 -- 10.20.193.28:0/775520102 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc310025480 con 0x55b6284c4360 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc2e7fff640 1 -- 10.20.193.28:0/775520102 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc310025ac0 con 0x55b6284c4360 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc2e7fff640 1 -- 10.20.193.28:0/775520102 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc31001acd0 con 0x55b6284c4360 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 -- 10.20.193.28:0/775520102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4360 msgr2=0x55b6284c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4360 0x55b6284c4730 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=1809935093128849013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3100043e0 tx=0x7fc310014000 comp rx=0 tx=0).stop 2026-02-20T13:21:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 -- 10.20.193.28:0/775520102 shutdown_connections 2026-02-20T13:21:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 0x55b628529f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4c70 0x55b6285095e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/775520102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4360 0x55b6284c4730 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=1809935093128849013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 -- 10.20.193.28:0/775520102 >> 10.20.193.28:0/775520102 conn(0x55b6284a2860 msgr2=0x55b6284c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 -- 10.20.193.28:0/775520102 shutdown_connections 2026-02-20T13:21:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.982+0000 7fc32bc47e00 1 -- 10.20.193.28:0/775520102 wait complete. 2026-02-20T13:21:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.984+0000 7fc32bc47e00 1 -- start start 2026-02-20T13:21:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.984+0000 7fc32bc47e00 1 Processor -- start 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.984+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c97b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.984+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284c9cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.984+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6284c85b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.984+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6284c8af0 con 0x55b6284c4c70 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.984+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b6284c8c60 con 0x55b628509b20 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.984+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b6284c8e20 con 0x55b6284c4360 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc322ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc322ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53884/0 (socket says 10.20.193.28:53884) 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40092/0 (socket says 10.20.193.28:40092) 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 -- 10.20.193.28:0/587592482 learned_addr learned my addr 10.20.193.28:0/587592482 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc323fff640 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6284c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 -- 10.20.193.28:0/587592482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 msgr2=0x55b6284c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6284c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 -- 10.20.193.28:0/587592482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 msgr2=0x55b6284c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 -- 10.20.193.28:0/587592482 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6283660e0 con 0x55b6284c4360 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc3237fe640 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c97b0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=15626423782860495538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc31001aaf0 tx=0x7fc31001ab20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8dc35a35f1d9ab2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.985+0000 7fc2e57fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc2e57fa640 1 -- 10.20.193.28:0/587592482 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc310029040 con 0x55b6284c4360 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc2e57fa640 1 -- 10.20.193.28:0/587592482 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc31001a5e0 con 0x55b6284c4360 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc2e57fa640 1 -- 10.20.193.28:0/587592482 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc310004a80 con 0x55b6284c4360 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6283543c0 con 0x55b6284c4360 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 10 client.27013 _ll_register_callbacks cb 0x55b628351a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6280666f0 con 0x55b6284c4360 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc2e57fa640 1 -- 10.20.193.28:0/587592482 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc310004c10 con 0x55b6284c4360 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc2e57fa640 1 -- 10.20.193.28:0/587592482 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc310004df0 con 0x55b6284c4360 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 10 client.27013 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b628360b60 con 0x55b6284c4360 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc2e57fa640 1 -- 10.20.193.28:0/587592482 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc310025690 con 0x55b6284c4360 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 10 client.27013 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 10 client.27013 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 20 client.27013 populate_metadata read hostname 'trial028' 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55b6284ef970 0x55b6284efde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 4 client.27013 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.986+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b628372f80 con 0x55b6284ef970 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.987+0000 7fc322ffd640 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55b6284ef970 0x55b6284efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.987+0000 7fc322ffd640 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55b6284ef970 0x55b6284efde0 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=12385415227109182341 s_cookie=7549341389642476652 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=abe1d5873f8e8b85 server_cookie=68c4a5fee9cb2c6c in_seq=0 out_seq=0 2026-02-20T13:21:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.987+0000 7fc2e57fa640 10 client.27013 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:21:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc2e57fa640 1 -- 10.20.193.28:0/587592482 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b628372f80 con 0x55b6284ef970 2026-02-20T13:21:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc2e57fa640 10 client.27013 handle_command_reply: tid=0 2026-02-20T13:21:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:21:58 trial034 ceph-mon[43332]: pgmap v320: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:21:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 client.27013 shutdown 2026-02-20T13:21:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 msgr2=0x55b6284c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c97b0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=15626423782860495538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc31001aaf0 tx=0x7fc31001ab20 comp rx=0 tx=0).stop 2026-02-20T13:21:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 shutdown_connections 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55b6284ef970 0x55b6284efde0 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=12385415227109182341 s_cookie=7549341389642476652 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284c9cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6284c85b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/587592482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c97b0 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=15626423782860495538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 >> 10.20.193.28:0/587592482 conn(0x55b6284a2860 msgr2=0x55b6284c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc2e57fa640 0 client.27013 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 shutdown_connections 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 1 -- 10.20.193.28:0/587592482 wait complete. 2026-02-20T13:21:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.988+0000 7fc32bc47e00 20 client.27013 trim_cache size 0 max 16384 2026-02-20T13:21:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.995+0000 7fc32bc47e00 1 Processor -- start 2026-02-20T13:21:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.995+0000 7fc32bc47e00 1 -- start start 2026-02-20T13:21:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.995+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c3d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.995+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4c70 0x55b628527340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.995+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 0x55b628527880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.995+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6283ce080 con 0x55b628509b20 2026-02-20T13:21:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.995+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b62808e700 con 0x55b6284c4c70 2026-02-20T13:21:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.995+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b62851eac0 con 0x55b6284c4360 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4c70 0x55b628527340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4c70 0x55b628527340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50562/0 (socket says 10.20.193.28:50562) 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 -- 10.20.193.28:0/1842798836 learned_addr learned my addr 10.20.193.28:0/1842798836 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc3237fe640 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc323fff640 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 0x55b628527880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 -- 10.20.193.28:0/1842798836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 msgr2=0x55b6284c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 -- 10.20.193.28:0/1842798836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 msgr2=0x55b628527880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 0x55b628527880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 -- 10.20.193.28:0/1842798836 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6283546f0 con 0x55b6284c4c70 2026-02-20T13:21:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc322ffd640 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4c70 0x55b628527340 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=12910638879113572655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc31402f680 tx=0x7fc31403a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32bcda834e9712f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc2e77fe640 1 -- 10.20.193.28:0/1842798836 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc31404b070 con 0x55b6284c4c70 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc2e77fe640 1 -- 10.20.193.28:0/1842798836 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc31403e040 con 0x55b6284c4c70 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc2e77fe640 1 -- 10.20.193.28:0/1842798836 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc314038880 con 0x55b6284c4c70 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1842798836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4c70 msgr2=0x55b628527340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.996+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4c70 0x55b628527340 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=12910638879113572655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc31402f680 tx=0x7fc31403a040 comp rx=0 tx=0).stop 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1842798836 shutdown_connections 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b628509b20 0x55b628527880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6284c4c70 0x55b628527340 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=12910638879113572655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1842798836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284c3d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1842798836 >> 10.20.193.28:0/1842798836 conn(0x55b6284a2860 msgr2=0x55b62851bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1842798836 shutdown_connections 2026-02-20T13:21:59.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1842798836 wait complete. 2026-02-20T13:21:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 -- start start 2026-02-20T13:21:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.997+0000 7fc32bc47e00 1 Processor -- start 2026-02-20T13:21:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284f0fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284f14f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc32bc47e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6285be9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b62852a360 con 0x55b6284c4c70 2026-02-20T13:21:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b628432ae0 con 0x55b628509b20 2026-02-20T13:21:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc32bc47e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b6285beef0 con 0x55b6284c4360 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc323fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6285be9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc322ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc322ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53890/0 (socket says 10.20.193.28:53890) 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc323fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6285be9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50568/0 (socket says 10.20.193.28:50568) 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc322ffd640 1 -- 10.20.193.28:0/1942943687 learned_addr learned my addr 10.20.193.28:0/1942943687 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc3237fe640 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc323fff640 1 -- 10.20.193.28:0/1942943687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 msgr2=0x55b6284f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc323fff640 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc323fff640 1 -- 10.20.193.28:0/1942943687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 msgr2=0x55b6284f14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc323fff640 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284f14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.998+0000 7fc323fff640 1 -- 10.20.193.28:0/1942943687 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b628366340 con 0x55b628509b20 2026-02-20T13:21:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc323fff640 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6285be9b0 secure :-1 s=READY pgs=280 gs=3 cs=0 l=1 c_cookie=10004032249839979068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3180aa560 tx=0x7fc318006400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ad57653dd438a3c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc2e57fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc2e57fa640 1 -- 10.20.193.28:0/1942943687 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3180add50 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc2e57fa640 1 -- 10.20.193.28:0/1942943687 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc3180b3cb0 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc324176850 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc2e57fa640 1 -- 10.20.193.28:0/1942943687 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3180aeea0 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc2e57fa640 1 -- 10.20.193.28:0/1942943687 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc3180b8c40 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc2e57fa640 10 client.27092 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc32bc47e00 10 client.27092 _ll_register_callbacks cb 0x55b628351a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc310025ac0 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc2e57fa640 1 -- 10.20.193.28:0/1942943687 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc3180b6290 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc32bc47e00 10 client.27092 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b6285c0690 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:58.999+0000 7fc2e57fa640 1 -- 10.20.193.28:0/1942943687 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc3180b1040 con 0x55b628509b20 2026-02-20T13:21:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 10 client.27092 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 10 client.27092 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 20 client.27092 populate_metadata read hostname 'trial028' 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55b6285c0e00 0x55b6285e1280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 4 client.27092 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b628063f40 con 0x55b6285c0e00 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc3237fe640 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55b6285c0e00 0x55b6285e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc3237fe640 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55b6285c0e00 0x55b6285e1280 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=5529699911567212263 s_cookie=13291824959815418225 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4cbd70c59f78fee7 server_cookie=b8760c60ba780171 in_seq=0 out_seq=0 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc2e57fa640 10 client.27092 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc2e57fa640 1 -- 10.20.193.28:0/1942943687 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b628063f40 con 0x55b6285c0e00 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc2e57fa640 10 client.27092 handle_command_reply: tid=0 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 1 client.27092 shutdown 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 msgr2=0x55b6285be9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.000+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6285be9b0 secure :-1 s=READY pgs=280 gs=3 cs=0 l=1 c_cookie=10004032249839979068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3180aa560 tx=0x7fc318006400 comp rx=0 tx=0).stop 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 shutdown_connections 2026-02-20T13:21:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55b6285c0e00 0x55b6285e1280 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=5529699911567212263 s_cookie=13291824959815418225 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6284c4c70 0x55b6284f14f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b628509b20 0x55b6285be9b0 unknown :-1 s=CLOSED pgs=280 gs=3 cs=0 l=1 c_cookie=10004032249839979068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc2e57fa640 0 client.27092 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 1 --2- 10.20.193.28:0/1942943687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6284c4360 0x55b6284f0fb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 >> 10.20.193.28:0/1942943687 conn(0x55b6284a2860 msgr2=0x55b628508c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 shutdown_connections 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 1 -- 10.20.193.28:0/1942943687 wait complete. 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc32bc47e00 20 client.27092 trim_cache size 0 max 16384 2026-02-20T13:21:59.010 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc3289c4640 1 -- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2f80b5760 msgr2=0x7fc2f80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2f80b5760 0x7fc2f80d5c10 secure :-1 s=READY pgs=368 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc310005b30 tx=0x7fc310009310 comp rx=0 tx=0).stop 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc3289c4640 1 -- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc32410dcd0 msgr2=0x7fc3240fa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.001+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc32410dcd0 0x7fc3240fa2d0 secure :-1 s=READY pgs=695 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc31800f8d0 tx=0x7fc31800fda0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.002+0000 7fc3289c4640 1 -- 10.20.193.28:0/3366413078 shutdown_connections 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.002+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2f80b5760 0x7fc2f80d5c10 unknown :-1 s=CLOSED pgs=368 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.002+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc32410dcd0 0x7fc3240fa2d0 unknown :-1 s=CLOSED pgs=695 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.002+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc32410be20 0x7fc3240f4f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.002+0000 7fc3289c4640 1 --2- 10.20.193.28:0/3366413078 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc32410b3c0 0x7fc3240f49c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.002+0000 7fc3289c4640 1 -- 10.20.193.28:0/3366413078 >> 10.20.193.28:0/3366413078 conn(0x7fc3240e9080 msgr2=0x7fc3240eaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.002+0000 7fc3289c4640 1 -- 10.20.193.28:0/3366413078 shutdown_connections 2026-02-20T13:21:59.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.002+0000 7fc3289c4640 1 -- 10.20.193.28:0/3366413078 wait complete. 2026-02-20T13:21:59.100 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:21:59.283 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:21:59.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 -- 10.20.193.28:0/1788773906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8061840 msgr2=0x7fccf8155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 --2- 10.20.193.28:0/1788773906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8061840 0x7fccf8155440 secure :-1 s=READY pgs=696 gs=1 cs=0 l=1 c_cookie=13844392956282084799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce0009890 tx=0x7fcce002f140 comp rx=0 tx=0).stop 2026-02-20T13:21:59.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 -- 10.20.193.28:0/1788773906 shutdown_connections 2026-02-20T13:21:59.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 --2- 10.20.193.28:0/1788773906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8061840 0x7fccf8155440 unknown :-1 s=CLOSED pgs=696 gs=1 cs=0 l=1 c_cookie=13844392956282084799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 --2- 10.20.193.28:0/1788773906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccf8155980 0x7fccf8175d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 --2- 10.20.193.28:0/1788773906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccf8060f30 0x7fccf8061300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 -- 10.20.193.28:0/1788773906 >> 10.20.193.28:0/1788773906 conn(0x7fccf80eaad0 msgr2=0x7fccf810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 -- 10.20.193.28:0/1788773906 shutdown_connections 2026-02-20T13:21:59.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.453+0000 7fccf7fff640 1 -- 10.20.193.28:0/1788773906 wait complete. 2026-02-20T13:21:59.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf7fff640 1 Processor -- start 2026-02-20T13:21:59.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf7fff640 1 -- start start 2026-02-20T13:21:59.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8060f30 0x7fccf8162110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccf8061840 0x7fccf8162650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccf8155980 0x7fccf8167a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8168040 con 0x7fccf8060f30 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf7fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81681b0 con 0x7fccf8155980 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf7fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8168370 con 0x7fccf8061840 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccf8155980 0x7fccf8167a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.454+0000 7fccf6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8060f30 0x7fccf8162110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccf8155980 0x7fccf8167a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50594/0 (socket says 10.20.193.28:50594) 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf77fe640 1 -- 10.20.193.28:0/2814024175 learned_addr learned my addr 10.20.193.28:0/2814024175 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf67fc640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccf8061840 0x7fccf8162650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf77fe640 1 -- 10.20.193.28:0/2814024175 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccf8061840 msgr2=0x7fccf8162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf77fe640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccf8061840 0x7fccf8162650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf77fe640 1 -- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8060f30 msgr2=0x7fccf8162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf77fe640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8060f30 0x7fccf8162110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf77fe640 1 -- 10.20.193.28:0/2814024175 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce00094b0 con 0x7fccf8155980 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8060f30 0x7fccf8162110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf77fe640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccf8155980 0x7fccf8167a20 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce8006a20 tx=0x7fcce800fdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccfc834640 1 -- 10.20.193.28:0/2814024175 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcce800dd70 con 0x7fccf8155980 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccfc834640 1 -- 10.20.193.28:0/2814024175 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcce8005e10 con 0x7fccf8155980 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf7fff640 1 -- 10.20.193.28:0/2814024175 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf8168650 con 0x7fccf8155980 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccfc834640 1 -- 10.20.193.28:0/2814024175 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcce8004bc0 con 0x7fccf8155980 2026-02-20T13:21:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.455+0000 7fccf7fff640 1 -- 10.20.193.28:0/2814024175 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81515a0 con 0x7fccf8155980 2026-02-20T13:21:59.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.458+0000 7fccfc834640 1 -- 10.20.193.28:0/2814024175 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcce8005820 con 0x7fccf8155980 2026-02-20T13:21:59.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.460+0000 7fccfc834640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcccc0b56e0 0x7fcccc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.460+0000 7fccfc834640 1 -- 10.20.193.28:0/2814024175 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcce8015070 con 0x7fccf8155980 2026-02-20T13:21:59.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.460+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcccc0b56e0 0x7fcccc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.460+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcccc0b56e0 0x7fcccc0d5b90 secure :-1 s=READY pgs=369 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccec004740 tx=0x7fccec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccff830e00 1 Processor -- start 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccff830e00 1 -- start start 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccff830e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361360 0x564c49361730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccff830e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a65e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccff830e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493c6f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccff830e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c49277780 con 0x564c493a6b20 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccff830e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564c492734b0 con 0x564c49361c70 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccff830e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564c4926d450 con 0x564c49361360 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf67fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53910/0 (socket says 10.20.193.28:53910) 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf77fe640 1 -- 10.20.193.28:0/664074584 learned_addr learned my addr 10.20.193.28:0/664074584 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf67fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50596/0 (socket says 10.20.193.28:50596) 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361360 0x564c49361730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf77fe640 1 -- 10.20.193.28:0/664074584 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361360 msgr2=0x564c49361730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf77fe640 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361360 0x564c49361730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf77fe640 1 -- 10.20.193.28:0/664074584 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 msgr2=0x564c493a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf77fe640 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf77fe640 1 -- 10.20.193.28:0/664074584 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c49218d10 con 0x564c493a6b20 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.461+0000 7fccf67fc640 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a65e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccf77fe640 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493c6f00 secure :-1 s=READY pgs=697 gs=2 cs=0 l=1 c_cookie=16959915887905381021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce80b8260 tx=0x7fcce80adf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5db9a47f1a9a9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccbbfff640 1 -- 10.20.193.28:0/664074584 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcce80051d0 con 0x564c493a6b20 2026-02-20T13:21:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccbbfff640 1 -- 10.20.193.28:0/664074584 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcce800a480 con 0x564c493a6b20 2026-02-20T13:21:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccbbfff640 1 -- 10.20.193.28:0/664074584 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcce80d30d0 con 0x564c493a6b20 2026-02-20T13:21:59.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 -- 10.20.193.28:0/664074584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 msgr2=0x564c493c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493c6f00 secure :-1 s=READY pgs=697 gs=2 cs=0 l=1 c_cookie=16959915887905381021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce80b8260 tx=0x7fcce80adf80 comp rx=0 tx=0).stop 2026-02-20T13:21:59.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 -- 10.20.193.28:0/664074584 shutdown_connections 2026-02-20T13:21:59.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493c6f00 unknown :-1 s=CLOSED pgs=697 gs=2 cs=0 l=1 c_cookie=16959915887905381021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a65e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 --2- 10.20.193.28:0/664074584 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361360 0x564c49361730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 -- 10.20.193.28:0/664074584 >> 10.20.193.28:0/664074584 conn(0x564c4933f860 msgr2=0x564c4935fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 -- 10.20.193.28:0/664074584 shutdown_connections 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.462+0000 7fccff830e00 1 -- 10.20.193.28:0/664074584 wait complete. 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccff830e00 1 -- start start 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccff830e00 1 Processor -- start 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccff830e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c493be450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccff830e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361c70 0x564c493be990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccff830e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493c39f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccff830e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c493c3f30 con 0x564c49361c70 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccff830e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564c493c40a0 con 0x564c49361360 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccff830e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564c493c4260 con 0x564c493a6b20 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccf67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361c70 0x564c493be990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccf77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccf67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361c70 0x564c493be990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53926/0 (socket says 10.20.193.28:53926) 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccf77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40160/0 (socket says 10.20.193.28:40160) 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccf67fc640 1 -- 10.20.193.28:0/487105231 learned_addr learned my addr 10.20.193.28:0/487105231 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.464+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c493be450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccf77fe640 1 -- 10.20.193.28:0/487105231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 msgr2=0x564c493be450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccf77fe640 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c493be450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccf77fe640 1 -- 10.20.193.28:0/487105231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361c70 msgr2=0x564c493be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccf77fe640 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361c70 0x564c493be990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccf77fe640 1 -- 10.20.193.28:0/487105231 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf81515a0 con 0x564c493a6b20 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccf77fe640 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493c39f0 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=1512711111110838902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce80ade60 tx=0x7fcce80aa350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14fe3abda98c4a76 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccb97fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:21:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccb97fa640 1 -- 10.20.193.28:0/487105231 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcce80d30d0 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81768f0 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccb97fa640 1 -- 10.20.193.28:0/487105231 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcce80b9010 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccb97fa640 1 -- 10.20.193.28:0/487105231 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcce80051d0 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccff830e00 10 client.27031 _ll_register_callbacks cb 0x564c491eea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccb97fa640 1 -- 10.20.193.28:0/487105231 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcce8073060 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c48f036f0 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccb97fa640 1 -- 10.20.193.28:0/487105231 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcce80b8e30 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccff830e00 10 client.27031 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.465+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564c491f13c0 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.466+0000 7fccb97fa640 1 -- 10.20.193.28:0/487105231 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcce80abeb0 con 0x564c493a6b20 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.466+0000 7fccff830e00 10 client.27031 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.466+0000 7fccff830e00 10 client.27031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.466+0000 7fccff830e00 20 client.27031 populate_metadata read hostname 'trial028' 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.466+0000 7fccff830e00 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c493a3a40 0x564c493a3eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.466+0000 7fccff830e00 4 client.27031 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.466+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c4920ff80 con 0x564c493a3a40 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.466+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c493a3a40 0x564c493a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.467+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c493a3a40 0x564c493a3eb0 crc :-1 s=READY pgs=154 gs=4 cs=0 l=0 c_cookie=4943650274190797318 s_cookie=7852804116029375402 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=449b5fbb56e7aa06 server_cookie=6cfac3bcd2a803aa in_seq=0 out_seq=0 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.467+0000 7fccb97fa640 10 client.27031 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.467+0000 7fccb97fa640 1 -- 10.20.193.28:0/487105231 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564c4920ff80 con 0x564c493a3a40 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.467+0000 7fccb97fa640 10 client.27031 handle_command_reply: tid=0 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.467+0000 7fccff830e00 1 client.27031 shutdown 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.467+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 msgr2=0x564c493c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.467+0000 7fccff830e00 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493c39f0 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=1512711111110838902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce80ade60 tx=0x7fcce80aa350 comp rx=0 tx=0).stop 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 shutdown_connections 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c493a3a40 0x564c493a3eb0 crc :-1 s=READY pgs=154 gs=4 cs=0 l=0 c_cookie=4943650274190797318 s_cookie=7852804116029375402 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361c70 0x564c493be990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493c39f0 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=1512711111110838902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 1 --2- 10.20.193.28:0/487105231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c493be450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 >> 10.20.193.28:0/487105231 conn(0x564c4933f860 msgr2=0x564c4935fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccb97fa640 0 client.27031 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 shutdown_connections 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 1 -- 10.20.193.28:0/487105231 wait complete. 2026-02-20T13:21:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.468+0000 7fccff830e00 20 client.27031 trim_cache size 0 max 16384 2026-02-20T13:21:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccff830e00 1 Processor -- start 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccff830e00 1 -- start start 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccff830e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361360 0x564c493a8f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccff830e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a9440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccff830e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493bb6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccff830e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c4926b080 con 0x564c49361360 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccff830e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564c48f2b700 con 0x564c49361c70 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccff830e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564c493c50f0 con 0x564c493a6b20 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccf67fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccf67fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a9440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50606/0 (socket says 10.20.193.28:50606) 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccf67fc640 1 -- 10.20.193.28:0/1028664326 learned_addr learned my addr 10.20.193.28:0/1028664326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361360 0x564c493a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.476+0000 7fccf77fe640 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccf67fc640 1 -- 10.20.193.28:0/1028664326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 msgr2=0x564c493bb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccf67fc640 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493bb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccf67fc640 1 -- 10.20.193.28:0/1028664326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361360 msgr2=0x564c493a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccf67fc640 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361360 0x564c493a8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccf67fc640 1 -- 10.20.193.28:0/1028664326 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c492030e0 con 0x564c49361c70 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccf77fe640 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493bb6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361360 0x564c493a8f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:21:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccf67fc640 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a9440 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=6277030528822088749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce0009230 tx=0x7fcce0002390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=571c7e0242b9142d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccbb7fe640 1 -- 10.20.193.28:0/1028664326 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcce003d040 con 0x564c49361c70 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccbb7fe640 1 -- 10.20.193.28:0/1028664326 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcce0002e40 con 0x564c49361c70 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccbb7fe640 1 -- 10.20.193.28:0/1028664326 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcce0038950 con 0x564c49361c70 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 -- 10.20.193.28:0/1028664326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 msgr2=0x564c493a9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a9440 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=6277030528822088749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce0009230 tx=0x7fcce0002390 comp rx=0 tx=0).stop 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 -- 10.20.193.28:0/1028664326 shutdown_connections 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c493a6b20 0x564c493bb6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361c70 0x564c493a9440 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=6277030528822088749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 --2- 10.20.193.28:0/1028664326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c49361360 0x564c493a8f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 -- 10.20.193.28:0/1028664326 >> 10.20.193.28:0/1028664326 conn(0x564c4933f860 msgr2=0x564c493b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 -- 10.20.193.28:0/1028664326 shutdown_connections 2026-02-20T13:21:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.477+0000 7fccff830e00 1 -- 10.20.193.28:0/1028664326 wait complete. 2026-02-20T13:21:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.478+0000 7fccff830e00 1 -- start start 2026-02-20T13:21:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.478+0000 7fccff830e00 1 Processor -- start 2026-02-20T13:21:59.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.478+0000 7fccff830e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c49340700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.478+0000 7fccff830e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361c70 0x564c49340c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.478+0000 7fccff830e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493f4340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.478+0000 7fccff830e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c493f4880 con 0x564c493a6b20 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.478+0000 7fccff830e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564c493f49f0 con 0x564c49361360 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.478+0000 7fccff830e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564c493f4bb0 con 0x564c49361c70 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c49340700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf67fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361c70 0x564c49340c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c49340700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50610/0 (socket says 10.20.193.28:50610) 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 -- 10.20.193.28:0/1550829750 learned_addr learned my addr 10.20.193.28:0/1550829750 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf77fe640 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 -- 10.20.193.28:0/1550829750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361c70 msgr2=0x564c49340c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361c70 0x564c49340c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 -- 10.20.193.28:0/1550829750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 msgr2=0x564c493f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 -- 10.20.193.28:0/1550829750 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce0038470 con 0x564c49361360 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf77fe640 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493f4340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccf6ffd640 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c49340700 secure :-1 s=READY pgs=283 gs=3 cs=0 l=1 c_cookie=5206018320236560418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x564c493a4760 tx=0x7fccec0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483f7e145fe04022 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccb97fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccb97fa640 1 -- 10.20.193.28:0/1550829750 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fccec030070 con 0x564c49361360 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccb97fa640 1 -- 10.20.193.28:0/1550829750 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fccec022040 con 0x564c49361360 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.479+0000 7fccb97fa640 1 -- 10.20.193.28:0/1550829750 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fccec021040 con 0x564c49361360 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccec003e30 con 0x564c49361360 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 10 client.27110 _ll_register_callbacks cb 0x564c491eea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce800a480 con 0x564c49361360 2026-02-20T13:21:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccb97fa640 1 -- 10.20.193.28:0/1550829750 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fccec028600 con 0x564c49361360 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccb97fa640 1 -- 10.20.193.28:0/1550829750 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fccec0287c0 con 0x564c49361360 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 10 client.27110 fetch_fsmap learned FSMap version 28 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564c491fdb60 con 0x564c49361360 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccb97fa640 1 -- 10.20.193.28:0/1550829750 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fccec0289a0 con 0x564c49361360 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 10 client.27110 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 10 client.27110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 20 client.27110 populate_metadata read hostname 'trial028' 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c493f69a0 0x564c493f6e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 4 client.27110 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564c48f00f40 con 0x564c493f69a0 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.480+0000 7fccf67fc640 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c493f69a0 0x564c493f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:21:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccf67fc640 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c493f69a0 0x564c493f6e10 crc :-1 s=READY pgs=155 gs=4 cs=0 l=0 c_cookie=10862733200526944475 s_cookie=7805173346259077862 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96c02e4aeb4028db server_cookie=6c518bce0a1e8ae6 in_seq=0 out_seq=0 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccb97fa640 10 client.27110 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccb97fa640 1 -- 10.20.193.28:0/1550829750 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564c48f00f40 con 0x564c493f69a0 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccb97fa640 10 client.27110 handle_command_reply: tid=0 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 client.27110 shutdown 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 msgr2=0x564c49340700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c49340700 secure :-1 s=READY pgs=283 gs=3 cs=0 l=1 c_cookie=5206018320236560418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x564c493a4760 tx=0x7fccec0047e0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 shutdown_connections 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c493f69a0 0x564c493f6e10 crc :-1 s=READY pgs=155 gs=4 cs=0 l=0 c_cookie=10862733200526944475 s_cookie=7805173346259077862 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c493a6b20 0x564c493f4340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c49361c70 0x564c49340c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 --2- 10.20.193.28:0/1550829750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c49361360 0x564c49340700 unknown :-1 s=CLOSED pgs=283 gs=3 cs=0 l=1 c_cookie=5206018320236560418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccb97fa640 0 client.27110 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:21:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 >> 10.20.193.28:0/1550829750 conn(0x564c4933f860 msgr2=0x564c493a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 shutdown_connections 2026-02-20T13:21:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 1 -- 10.20.193.28:0/1550829750 wait complete. 2026-02-20T13:21:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.481+0000 7fccff830e00 20 client.27110 trim_cache size 0 max 16384 2026-02-20T13:21:59.492 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:21:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 -- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcccc0b56e0 msgr2=0x7fcccc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcccc0b56e0 0x7fcccc0d5b90 secure :-1 s=READY pgs=369 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccec004740 tx=0x7fccec005f90 comp rx=0 tx=0).stop 2026-02-20T13:21:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 -- 10.20.193.28:0/2814024175 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccf8155980 msgr2=0x7fccf8167a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:21:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccf8155980 0x7fccf8167a20 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcce8006a20 tx=0x7fcce800fdc0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 -- 10.20.193.28:0/2814024175 shutdown_connections 2026-02-20T13:21:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcccc0b56e0 0x7fcccc0d5b90 unknown :-1 s=CLOSED pgs=369 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccf8155980 0x7fccf8167a20 unknown :-1 s=CLOSED pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccf8061840 0x7fccf8162650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 --2- 10.20.193.28:0/2814024175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccf8060f30 0x7fccf8162110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:21:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 -- 10.20.193.28:0/2814024175 >> 10.20.193.28:0/2814024175 conn(0x7fccf80eaad0 msgr2=0x7fccf810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:21:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 -- 10.20.193.28:0/2814024175 shutdown_connections 2026-02-20T13:21:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:21:59.482+0000 7fccf7fff640 1 -- 10.20.193.28:0/2814024175 wait complete. 2026-02-20T13:22:00.585 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:22:00.586 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:22:00.769 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:00.847 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:00 trial028 ceph-mon[37442]: pgmap v321: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:00.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.947+0000 7fb9eef52640 1 -- 10.20.193.28:0/551512609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e80614f0 msgr2=0x7fb9e8061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.947+0000 7fb9eef52640 1 --2- 10.20.193.28:0/551512609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e80614f0 0x7fb9e8061920 secure :-1 s=READY pgs=698 gs=1 cs=0 l=1 c_cookie=3674815366193838698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc009950 tx=0x7fb9dc02f190 comp rx=0 tx=0).stop 2026-02-20T13:22:00.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.947+0000 7fb9eef52640 1 -- 10.20.193.28:0/551512609 shutdown_connections 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.947+0000 7fb9eef52640 1 --2- 10.20.193.28:0/551512609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e80614f0 0x7fb9e8061920 unknown :-1 s=CLOSED pgs=698 gs=1 cs=0 l=1 c_cookie=3674815366193838698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.947+0000 7fb9eef52640 1 --2- 10.20.193.28:0/551512609 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb9e8159d80 0x7fb9e817a160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.947+0000 7fb9eef52640 1 --2- 10.20.193.28:0/551512609 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb9e8062ae0 0x7fb9e8060fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.947+0000 7fb9eef52640 1 -- 10.20.193.28:0/551512609 >> 10.20.193.28:0/551512609 conn(0x7fb9e80eab00 msgr2=0x7fb9e810af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.948+0000 7fb9eef52640 1 -- 10.20.193.28:0/551512609 shutdown_connections 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.948+0000 7fb9eef52640 1 -- 10.20.193.28:0/551512609 wait complete. 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.948+0000 7fb9eef52640 1 Processor -- start 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.948+0000 7fb9eef52640 1 -- start start 2026-02-20T13:22:00.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.948+0000 7fb9eef52640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb9e80614f0 0x7fb9e80f2ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9eef52640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb9e8062ae0 0x7fb9e80f3410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9eef52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e8159d80 0x7fb9e80f87e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9eef52640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e80f8e00 con 0x7fb9e8159d80 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9eef52640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e80f8f70 con 0x7fb9e80614f0 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9eef52640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e80f9130 con 0x7fb9e8062ae0 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e8159d80 0x7fb9e80f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e8159d80 0x7fb9e80f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37622/0 (socket says 10.20.193.28:37622) 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 -- 10.20.193.28:0/85027200 learned_addr learned my addr 10.20.193.28:0/85027200 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb9e8062ae0 0x7fb9e80f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9edf50640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb9e80614f0 0x7fb9e80f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 -- 10.20.193.28:0/85027200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb9e8062ae0 msgr2=0x7fb9e80f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb9e8062ae0 0x7fb9e80f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 -- 10.20.193.28:0/85027200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb9e80614f0 msgr2=0x7fb9e80f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb9e80614f0 0x7fb9e80f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 -- 10.20.193.28:0/85027200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc009570 con 0x7fb9e8159d80 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9ee751640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e8159d80 0x7fb9e80f87e0 secure :-1 s=READY pgs=699 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9e400f8d0 tx=0x7fb9e400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9d6ffd640 1 -- 10.20.193.28:0/85027200 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9e400dce0 con 0x7fb9e8159d80 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9eef52640 1 -- 10.20.193.28:0/85027200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e80f9410 con 0x7fb9e8159d80 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.949+0000 7fb9d6ffd640 1 -- 10.20.193.28:0/85027200 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9e400de40 con 0x7fb9e8159d80 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.950+0000 7fb9eef52640 1 -- 10.20.193.28:0/85027200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e80f9af0 con 0x7fb9e8159d80 2026-02-20T13:22:00.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.950+0000 7fb9d6ffd640 1 -- 10.20.193.28:0/85027200 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9e400dce0 con 0x7fb9e8159d80 2026-02-20T13:22:00.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.953+0000 7fb9d6ffd640 1 -- 10.20.193.28:0/85027200 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb9e4020060 con 0x7fb9e8159d80 2026-02-20T13:22:00.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.954+0000 7fb9d6ffd640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9c40b5740 0x7fb9c40d5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.954+0000 7fb9d6ffd640 1 -- 10.20.193.28:0/85027200 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb9e4015070 con 0x7fb9e8159d80 2026-02-20T13:22:00.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.954+0000 7fb9edf50640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9c40b5740 0x7fb9c40d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9f21d5e00 1 Processor -- start 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9f21d5e00 1 -- start start 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1410 0x563f7ffb17e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1d20 0x563f7fff6480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f80016da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f7fec7a20 con 0x563f7ffb1410 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563f7fec3750 con 0x563f7fff69c0 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563f7febd6f0 con 0x563f7ffb1d20 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1d20 0x563f7fff6480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9edf50640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9c40b5740 0x7fb9c40d5bf0 secure :-1 s=READY pgs=370 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9d8004740 tx=0x7fb9d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:00.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1d20 0x563f7fff6480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39840/0 (socket says 10.20.193.28:39840) 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ed74f640 1 -- 10.20.193.28:0/133742494 learned_addr learned my addr 10.20.193.28:0/133742494 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ee751640 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f80016da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9edf50640 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1410 0x563f7ffb17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ed74f640 1 -- 10.20.193.28:0/133742494 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 msgr2=0x563f80016da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f80016da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ed74f640 1 -- 10.20.193.28:0/133742494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1410 msgr2=0x563f7ffb17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1410 0x563f7ffb17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.955+0000 7fb9ed74f640 1 -- 10.20.193.28:0/133742494 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f7fe69120 con 0x563f7ffb1d20 2026-02-20T13:22:00.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1d20 0x563f7fff6480 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=15385436004363576017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc005ad0 tx=0x7fb9dc002390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5840c87ca98a2d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:00.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9b64e6640 1 -- 10.20.193.28:0/133742494 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9dc03d070 con 0x563f7ffb1d20 2026-02-20T13:22:00.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9b64e6640 1 -- 10.20.193.28:0/133742494 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9dc03e040 con 0x563f7ffb1d20 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9b64e6640 1 -- 10.20.193.28:0/133742494 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9dc02fc70 con 0x563f7ffb1d20 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/133742494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1d20 msgr2=0x563f7fff6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1d20 0x563f7fff6480 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=15385436004363576017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc005ad0 tx=0x7fb9dc002390 comp rx=0 tx=0).stop 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/133742494 shutdown_connections 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f80016da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1d20 0x563f7fff6480 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=15385436004363576017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/133742494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1410 0x563f7ffb17e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/133742494 >> 10.20.193.28:0/133742494 conn(0x563f7ff8f910 msgr2=0x563f7ffafcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.956+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/133742494 shutdown_connections 2026-02-20T13:22:00.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.957+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/133742494 wait complete. 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9f21d5e00 1 -- start start 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9f21d5e00 1 Processor -- start 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1410 0x563f7ffc9c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffca1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f7ffcf1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f7ffcf700 con 0x563f7ffb1d20 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563f7ffcf870 con 0x563f7fff69c0 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563f7ffcfa30 con 0x563f7ffb1410 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9ee751640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f7ffcf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9edf50640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1410 0x563f7ffc9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9edf50640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1410 0x563f7ffc9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39850/0 (socket says 10.20.193.28:39850) 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9edf50640 1 -- 10.20.193.28:0/3680752782 learned_addr learned my addr 10.20.193.28:0/3680752782 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.958+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37644/0 (socket says 10.20.193.28:37644) 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9ed74f640 1 -- 10.20.193.28:0/3680752782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1410 msgr2=0x563f7ffc9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1410 0x563f7ffc9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9ed74f640 1 -- 10.20.193.28:0/3680752782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 msgr2=0x563f7ffcf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f7ffcf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9ed74f640 1 -- 10.20.193.28:0/3680752782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f7fe41810 con 0x563f7ffb1d20 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9ee751640 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f7ffcf1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9edf50640 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1410 0x563f7ffc9c90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffca1d0 secure :-1 s=READY pgs=700 gs=2 cs=0 l=1 c_cookie=12098975397509184989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc009950 tx=0x7fb9dc005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e832055ab9bddd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9a37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:00.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9a37fe640 1 -- 10.20.193.28:0/3680752782 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9dc03d030 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9a37fe640 1 -- 10.20.193.28:0/3680752782 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9dc002ad0 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9a37fe640 1 -- 10.20.193.28:0/3680752782 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9dc043970 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e817adc0 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.959+0000 7fb9f21d5e00 10 client.17148 _ll_register_callbacks cb 0x563f7fe74b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f7fb539d0 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9a37fe640 1 -- 10.20.193.28:0/3680752782 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb9dc0059a0 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9a37fe640 1 -- 10.20.193.28:0/3680752782 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9dc043460 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 10 client.17148 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563f7fe534f0 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9a37fe640 1 -- 10.20.193.28:0/3680752782 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb9dc043b00 con 0x563f7ffb1d20 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 10 client.17148 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 10 client.17148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:00.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 20 client.17148 populate_metadata read hostname 'trial028' 2026-02-20T13:22:00.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f7fff41b0 0x563f7fff4650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 4 client.17148 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:00.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f7fecadf0 con 0x563f7fff41b0 2026-02-20T13:22:00.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.960+0000 7fb9edf50640 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f7fff41b0 0x563f7fff4650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.961+0000 7fb9edf50640 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f7fff41b0 0x563f7fff4650 crc :-1 s=READY pgs=156 gs=4 cs=0 l=0 c_cookie=6816688246489600018 s_cookie=14912457877263218833 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e99bdd80497d012 server_cookie=cef3b16e063ff891 in_seq=0 out_seq=0 2026-02-20T13:22:00.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.961+0000 7fb9a37fe640 10 client.17148 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:00.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9a37fe640 1 -- 10.20.193.28:0/3680752782 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563f7fecadf0 con 0x563f7fff41b0 2026-02-20T13:22:00.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9a37fe640 10 client.17148 handle_command_reply: tid=0 2026-02-20T13:22:00.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 client.17148 shutdown 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 msgr2=0x563f7ffca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffca1d0 secure :-1 s=READY pgs=700 gs=2 cs=0 l=1 c_cookie=12098975397509184989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc009950 tx=0x7fb9dc005900 comp rx=0 tx=0).stop 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 shutdown_connections 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f7fff41b0 0x563f7fff4650 crc :-1 s=READY pgs=156 gs=4 cs=0 l=0 c_cookie=6816688246489600018 s_cookie=14912457877263218833 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffca1d0 unknown :-1 s=CLOSED pgs=700 gs=2 cs=0 l=1 c_cookie=12098975397509184989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7fff69c0 0x563f7ffcf1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3680752782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7ffb1410 0x563f7ffc9c90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 >> 10.20.193.28:0/3680752782 conn(0x563f7ff8f910 msgr2=0x563f7ffb04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9a37fe640 0 client.17148 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 shutdown_connections 2026-02-20T13:22:00.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3680752782 wait complete. 2026-02-20T13:22:00.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.962+0000 7fb9f21d5e00 20 client.17148 trim_cache size 0 max 16384 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.971+0000 7fb9f21d5e00 1 Processor -- start 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.971+0000 7fb9f21d5e00 1 -- start start 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.971+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7fff4f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.971+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7fff5470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 0x563f7fff59b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f7ffbbdd0 con 0x563f7ffb1d20 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563f7febb320 con 0x563f7ffb1410 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563f7fb7b790 con 0x563f7fff69c0 2026-02-20T13:22:00.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7fff5470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7fff5470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37648/0 (socket says 10.20.193.28:37648) 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 -- 10.20.193.28:0/3165686492 learned_addr learned my addr 10.20.193.28:0/3165686492 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9edf50640 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7fff4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ee751640 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 0x563f7fff59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 -- 10.20.193.28:0/3165686492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 msgr2=0x563f7fff59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 0x563f7fff59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 -- 10.20.193.28:0/3165686492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 msgr2=0x563f7fff4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7fff4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 -- 10.20.193.28:0/3165686492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f7ffbc000 con 0x563f7ffb1d20 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9edf50640 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7fff4f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:00.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7fff5470 secure :-1 s=READY pgs=701 gs=1 cs=0 l=1 c_cookie=8429764159235333476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc002890 tx=0x7fb9dc031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fc89d70b8a9d64 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9b5ce5640 1 -- 10.20.193.28:0/3165686492 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9dc03d070 con 0x563f7ffb1d20 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9b5ce5640 1 -- 10.20.193.28:0/3165686492 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x563f7fb539d0 con 0x563f7ffb1d20 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.972+0000 7fb9b5ce5640 1 -- 10.20.193.28:0/3165686492 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9dc002930 con 0x563f7ffb1d20 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3165686492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 msgr2=0x563f7fff5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7fff5470 secure :-1 s=READY pgs=701 gs=1 cs=0 l=1 c_cookie=8429764159235333476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc002890 tx=0x7fb9dc031000 comp rx=0 tx=0).stop 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3165686492 shutdown_connections 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7fff5470 unknown :-1 s=CLOSED pgs=701 gs=1 cs=0 l=1 c_cookie=8429764159235333476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 0x563f7fff59b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/3165686492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7fff4f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3165686492 >> 10.20.193.28:0/3165686492 conn(0x563f7ff8f910 msgr2=0x563f7ffc60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3165686492 shutdown_connections 2026-02-20T13:22:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/3165686492 wait complete. 2026-02-20T13:22:00.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:00 trial127 ceph-mon[43817]: pgmap v321: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.973+0000 7fb9f21d5e00 1 -- start start 2026-02-20T13:22:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9f21d5e00 1 Processor -- start 2026-02-20T13:22:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7ffd5e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffd3460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9f21d5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 0x563f7ffd3a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f7fb7b790 con 0x563f7ffb1d20 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563f7ffd41c0 con 0x563f7ffb1410 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9f21d5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563f8005bef0 con 0x563f7fff69c0 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffd3460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ed74f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffd3460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37650/0 (socket says 10.20.193.28:37650) 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ed74f640 1 -- 10.20.193.28:0/993542533 learned_addr learned my addr 10.20.193.28:0/993542533 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9edf50640 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7ffd5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ee751640 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 0x563f7ffd3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ed74f640 1 -- 10.20.193.28:0/993542533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 msgr2=0x563f7ffd3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:00.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 0x563f7ffd3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ed74f640 1 -- 10.20.193.28:0/993542533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 msgr2=0x563f7ffd5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7ffd5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.974+0000 7fb9ed74f640 1 -- 10.20.193.28:0/993542533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f7fe4df70 con 0x563f7ffb1d20 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9ed74f640 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffd3460 secure :-1 s=READY pgs=702 gs=1 cs=0 l=1 c_cookie=6721202510049228997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc005d80 tx=0x7fb9dc02f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4682128af2b8c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9a37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9a37fe640 1 -- 10.20.193.28:0/993542533 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9dc03d070 con 0x563f7ffb1d20 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f7fe534f0 con 0x563f7ffb1d20 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 10 client.17154 _ll_register_callbacks cb 0x563f7fe74b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9dc03e040 con 0x563f7ffb1d20 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9a37fe640 1 -- 10.20.193.28:0/993542533 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9dc038920 con 0x563f7ffb1d20 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9a37fe640 1 -- 10.20.193.28:0/993542533 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9dc03d070 con 0x563f7ffb1d20 2026-02-20T13:22:00.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9a37fe640 1 -- 10.20.193.28:0/993542533 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb9dc037c60 con 0x563f7ffb1d20 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9a37fe640 1 -- 10.20.193.28:0/993542533 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9dc037e60 con 0x563f7ffb1d20 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 10 client.17154 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563f7fe41b40 con 0x563f7ffb1d20 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9a37fe640 1 -- 10.20.193.28:0/993542533 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb9dc041bc0 con 0x563f7ffb1d20 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 10 client.17154 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 10 client.17154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 20 client.17154 populate_metadata read hostname 'trial028' 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f800a3980 0x563f800c3e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 4 client.17154 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.975+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563f7fb51220 con 0x563f800a3980 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.976+0000 7fb9edf50640 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f800a3980 0x563f800c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:00.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.976+0000 7fb9edf50640 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f800a3980 0x563f800c3e30 crc :-1 s=READY pgs=157 gs=4 cs=0 l=0 c_cookie=12941841991977547237 s_cookie=18257429511246159203 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b39aa8b90f0e35e5 server_cookie=fd5f6b68918f9d63 in_seq=0 out_seq=0 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.976+0000 7fb9a37fe640 10 client.17154 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.977+0000 7fb9a37fe640 1 -- 10.20.193.28:0/993542533 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563f7fb51220 con 0x563f800a3980 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.977+0000 7fb9a37fe640 10 client.17154 handle_command_reply: tid=0 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.977+0000 7fb9f21d5e00 1 client.17154 shutdown 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 msgr2=0x563f7ffd3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffd3460 secure :-1 s=READY pgs=702 gs=1 cs=0 l=1 c_cookie=6721202510049228997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9dc005d80 tx=0x7fb9dc02f190 comp rx=0 tx=0).stop 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 shutdown_connections 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563f800a3980 0x563f800c3e30 crc :-1 s=READY pgs=157 gs=4 cs=0 l=0 c_cookie=12941841991977547237 s_cookie=18257429511246159203 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f7ffb1d20 0x563f7ffd3460 unknown :-1 s=CLOSED pgs=702 gs=1 cs=0 l=1 c_cookie=6721202510049228997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563f7fff69c0 0x563f7ffd3a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 --2- 10.20.193.28:0/993542533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563f7ffb1410 0x563f7ffd5e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 >> 10.20.193.28:0/993542533 conn(0x563f7ff8f910 msgr2=0x563f7fff5720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:00.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9a37fe640 0 client.17154 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:00.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 shutdown_connections 2026-02-20T13:22:00.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 1 -- 10.20.193.28:0/993542533 wait complete. 2026-02-20T13:22:00.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.978+0000 7fb9f21d5e00 20 client.17154 trim_cache size 0 max 16384 2026-02-20T13:22:00.987 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:22:00.987 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:22:00.987 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "1131643e-ece2-4683-8f9e-ca44912d2c8c", 2026-02-20T13:22:00.987 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:22:00.988 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:22:00.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 -- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9c40b5740 msgr2=0x7fb9c40d5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9c40b5740 0x7fb9c40d5bf0 secure :-1 s=READY pgs=370 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9d8004740 tx=0x7fb9d8005f90 comp rx=0 tx=0).stop 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 -- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e8159d80 msgr2=0x7fb9e80f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e8159d80 0x7fb9e80f87e0 secure :-1 s=READY pgs=699 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9e400f8d0 tx=0x7fb9e400fda0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 -- 10.20.193.28:0/85027200 shutdown_connections 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9c40b5740 0x7fb9c40d5bf0 unknown :-1 s=CLOSED pgs=370 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9e8159d80 0x7fb9e80f87e0 unknown :-1 s=CLOSED pgs=699 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb9e8062ae0 0x7fb9e80f3410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 --2- 10.20.193.28:0/85027200 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb9e80614f0 0x7fb9e80f2ed0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 -- 10.20.193.28:0/85027200 >> 10.20.193.28:0/85027200 conn(0x7fb9e80eab00 msgr2=0x7fb9e810fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 -- 10.20.193.28:0/85027200 shutdown_connections 2026-02-20T13:22:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:00.979+0000 7fb9eef52640 1 -- 10.20.193.28:0/85027200 wait complete. 2026-02-20T13:22:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:00 trial034 ceph-mon[43332]: pgmap v321: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:01.115 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:22:01.299 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.478+0000 7f249e20c640 1 -- 10.20.193.28:0/2642434952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24981157e0 msgr2=0x7f24981761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.478+0000 7f249e20c640 1 --2- 10.20.193.28:0/2642434952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24981157e0 0x7f24981761b0 secure :-1 s=READY pgs=703 gs=1 cs=0 l=1 c_cookie=16832409090038410936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f248c00aa30 tx=0x7f248c030270 comp rx=0 tx=0).stop 2026-02-20T13:22:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.478+0000 7f249e20c640 1 -- 10.20.193.28:0/2642434952 shutdown_connections 2026-02-20T13:22:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.478+0000 7f249e20c640 1 --2- 10.20.193.28:0/2642434952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24981157e0 0x7f24981761b0 unknown :-1 s=CLOSED pgs=703 gs=1 cs=0 l=1 c_cookie=16832409090038410936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.478+0000 7f249e20c640 1 --2- 10.20.193.28:0/2642434952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f249810ffe0 0x7f2498115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.478+0000 7f249e20c640 1 --2- 10.20.193.28:0/2642434952 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f249810f5f0 0x7f249810f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.478+0000 7f249e20c640 1 -- 10.20.193.28:0/2642434952 >> 10.20.193.28:0/2642434952 conn(0x7f24980ecea0 msgr2=0x7f249810d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.478+0000 7f249e20c640 1 -- 10.20.193.28:0/2642434952 shutdown_connections 2026-02-20T13:22:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.479+0000 7f249e20c640 1 -- 10.20.193.28:0/2642434952 wait complete. 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.479+0000 7f249e20c640 1 Processor -- start 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f249e20c640 1 -- start start 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f249e20c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f249810f5f0 0x7f249811d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f249e20c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f249810ffe0 0x7f249811da10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f249e20c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24981157e0 0x7f2498122de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f249e20c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2498123400 con 0x7f249810f5f0 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f249e20c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2498123570 con 0x7f249810ffe0 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f249e20c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2498123730 con 0x7f24981157e0 2026-02-20T13:22:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f24977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f249810f5f0 0x7f249811d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f2496ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f249810ffe0 0x7f249811da10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f2496ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f249810ffe0 0x7f249811da10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42052/0 (socket says 10.20.193.28:42052) 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f2496ffd640 1 -- 10.20.193.28:0/3809993594 learned_addr learned my addr 10.20.193.28:0/3809993594 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f2497fff640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24981157e0 0x7f2498122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f24977fe640 1 -- 10.20.193.28:0/3809993594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24981157e0 msgr2=0x7f2498122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f24977fe640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24981157e0 0x7f2498122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f24977fe640 1 -- 10.20.193.28:0/3809993594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f249810ffe0 msgr2=0x7f249811da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f24977fe640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f249810ffe0 0x7f249811da10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.480+0000 7f24977fe640 1 -- 10.20.193.28:0/3809993594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c00a650 con 0x7f249810f5f0 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.481+0000 7f24977fe640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f249810f5f0 0x7f249811d4d0 secure :-1 s=READY pgs=704 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f248400d720 tx=0x7f248400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.481+0000 7f2494ff9640 1 -- 10.20.193.28:0/3809993594 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2484004500 con 0x7f249810f5f0 2026-02-20T13:22:01.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.481+0000 7f249e20c640 1 -- 10.20.193.28:0/3809993594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2498123a10 con 0x7f249810f5f0 2026-02-20T13:22:01.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.481+0000 7f249e20c640 1 -- 10.20.193.28:0/3809993594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2498164110 con 0x7f249810f5f0 2026-02-20T13:22:01.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.481+0000 7f2494ff9640 1 -- 10.20.193.28:0/3809993594 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2484004d30 con 0x7f249810f5f0 2026-02-20T13:22:01.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.481+0000 7f2494ff9640 1 -- 10.20.193.28:0/3809993594 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840052a0 con 0x7f249810f5f0 2026-02-20T13:22:01.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.484+0000 7f2494ff9640 1 -- 10.20.193.28:0/3809993594 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2484005430 con 0x7f249810f5f0 2026-02-20T13:22:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.486+0000 7f2494ff9640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f246c0b5760 0x7f246c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.486+0000 7f2494ff9640 1 -- 10.20.193.28:0/3809993594 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f24840e6460 con 0x7f249810f5f0 2026-02-20T13:22:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.486+0000 7f2496ffd640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f246c0b5760 0x7f246c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.486+0000 7f24a0206e00 1 Processor -- start 2026-02-20T13:22:01.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.486+0000 7f24a0206e00 1 -- start start 2026-02-20T13:22:01.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f2496ffd640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f246c0b5760 0x7f246c0d5c10 secure :-1 s=READY pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2498123e70 tx=0x7f248800b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:01.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b203de550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 0x562b20423400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b20423940 0x562b20443d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24a0206e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b202f47d0 con 0x562b20423940 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24a0206e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562b202f0500 con 0x562b203dea90 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24a0206e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562b202ea4a0 con 0x562b203de180 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24977fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b203de550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24977fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b203de550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39904/0 (socket says 10.20.193.28:39904) 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24977fe640 1 -- 10.20.193.28:0/868708560 learned_addr learned my addr 10.20.193.28:0/868708560 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f2496ffd640 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 0x562b20423400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f2497fff640 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b20423940 0x562b20443d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24977fe640 1 -- 10.20.193.28:0/868708560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 msgr2=0x562b20423400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24977fe640 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 0x562b20423400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24977fe640 1 -- 10.20.193.28:0/868708560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b20423940 msgr2=0x562b20443d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24977fe640 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b20423940 0x562b20443d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.487+0000 7f24977fe640 1 -- 10.20.193.28:0/868708560 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b20295d80 con 0x562b203de180 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24977fe640 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b203de550 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=18201656639537838787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24840e3f00 tx=0x7f2484009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc994646f3487ac3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f245bfff640 1 -- 10.20.193.28:0/868708560 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840ac070 con 0x562b203de180 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f245bfff640 1 -- 10.20.193.28:0/868708560 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f24840b24e0 con 0x562b203de180 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f245bfff640 1 -- 10.20.193.28:0/868708560 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840b76f0 con 0x562b203de180 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 -- 10.20.193.28:0/868708560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 msgr2=0x562b203de550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b203de550 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=18201656639537838787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24840e3f00 tx=0x7f2484009ba0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 -- 10.20.193.28:0/868708560 shutdown_connections 2026-02-20T13:22:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b20423940 0x562b20443d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 0x562b20423400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 --2- 10.20.193.28:0/868708560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b203de550 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=18201656639537838787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 -- 10.20.193.28:0/868708560 >> 10.20.193.28:0/868708560 conn(0x562b203bc680 msgr2=0x562b203dca60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 -- 10.20.193.28:0/868708560 shutdown_connections 2026-02-20T13:22:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.488+0000 7f24a0206e00 1 -- 10.20.193.28:0/868708560 wait complete. 2026-02-20T13:22:01.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.489+0000 7f24a0206e00 1 -- start start 2026-02-20T13:22:01.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24a0206e00 1 Processor -- start 2026-02-20T13:22:01.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203de180 0x562b20404710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 0x562b20404c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b204023e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24a0206e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b20402920 con 0x562b203de180 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24a0206e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562b20402a90 con 0x562b203dea90 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24a0206e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562b20402c50 con 0x562b20423940 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203de180 0x562b20404710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203de180 0x562b20404710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37696/0 (socket says 10.20.193.28:37696) 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f24977fe640 1 -- 10.20.193.28:0/3996837973 learned_addr learned my addr 10.20.193.28:0/3996837973 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.490+0000 7f2497fff640 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b204023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f2496ffd640 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 0x562b20404c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24977fe640 1 -- 10.20.193.28:0/3996837973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 msgr2=0x562b204023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24977fe640 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b204023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24977fe640 1 -- 10.20.193.28:0/3996837973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 msgr2=0x562b20404c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:01.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24977fe640 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 0x562b20404c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24977fe640 1 -- 10.20.193.28:0/3996837973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2026e350 con 0x562b203de180 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f2497fff640 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b204023e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24977fe640 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203de180 0x562b20404710 secure :-1 s=READY pgs=705 gs=1 cs=0 l=1 c_cookie=9544791786218324928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24840a9ae0 tx=0x7f2484004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8475e98f209c03c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24597fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24597fa640 1 -- 10.20.193.28:0/3996837973 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840b7900 con 0x562b203de180 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24597fa640 1 -- 10.20.193.28:0/3996837973 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f24840a8ae0 con 0x562b203de180 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24597fa640 1 -- 10.20.193.28:0/3996837973 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840b7740 con 0x562b203de180 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2498164110 con 0x562b203de180 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24597fa640 1 -- 10.20.193.28:0/3996837973 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f24840aa850 con 0x562b203de180 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24597fa640 10 client.17166 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:22:01.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24a0206e00 10 client.17166 _ll_register_callbacks cb 0x562b2026b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.491+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b1ff806f0 con 0x562b203de180 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24597fa640 1 -- 10.20.193.28:0/3996837973 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24840205b0 con 0x562b203de180 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24a0206e00 10 client.17166 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562b20280150 con 0x562b203de180 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24597fa640 1 -- 10.20.193.28:0/3996837973 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24840ae1b0 con 0x562b203de180 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24a0206e00 10 client.17166 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24a0206e00 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24a0206e00 20 client.17166 populate_metadata read hostname 'trial028' 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24a0206e00 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562b20409420 0x562b204098c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24a0206e00 4 client.17166 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b202f7d60 con 0x562b20409420 2026-02-20T13:22:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.492+0000 7f2496ffd640 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562b20409420 0x562b204098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.493+0000 7f2496ffd640 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562b20409420 0x562b204098c0 crc :-1 s=READY pgs=158 gs=4 cs=0 l=0 c_cookie=15613546341490800669 s_cookie=3615803084542002848 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ae75ac68a8b81d server_cookie=322de9bf7fe346a0 in_seq=0 out_seq=0 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.493+0000 7f24597fa640 10 client.17166 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.493+0000 7f24597fa640 1 -- 10.20.193.28:0/3996837973 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562b202f7d60 con 0x562b20409420 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.493+0000 7f24597fa640 10 client.17166 handle_command_reply: tid=0 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.493+0000 7f24a0206e00 1 client.17166 shutdown 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.493+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203de180 msgr2=0x562b20404710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.493+0000 7f24a0206e00 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203de180 0x562b20404710 secure :-1 s=READY pgs=705 gs=1 cs=0 l=1 c_cookie=9544791786218324928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24840a9ae0 tx=0x7f2484004ea0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 shutdown_connections 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562b20409420 0x562b204098c0 crc :-1 s=READY pgs=158 gs=4 cs=0 l=0 c_cookie=15613546341490800669 s_cookie=3615803084542002848 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b204023e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203dea90 0x562b20404c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 1 --2- 10.20.193.28:0/3996837973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203de180 0x562b20404710 unknown :-1 s=CLOSED pgs=705 gs=1 cs=0 l=1 c_cookie=9544791786218324928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24597fa640 0 client.17166 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 >> 10.20.193.28:0/3996837973 conn(0x562b203bc680 msgr2=0x562b203c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 shutdown_connections 2026-02-20T13:22:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 1 -- 10.20.193.28:0/3996837973 wait complete. 2026-02-20T13:22:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.494+0000 7f24a0206e00 20 client.17166 trim_cache size 0 max 16384 2026-02-20T13:22:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24a0206e00 1 Processor -- start 2026-02-20T13:22:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24a0206e00 1 -- start start 2026-02-20T13:22:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b20404be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b203db230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b20423940 0x562b203c8c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24a0206e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b202e80d0 con 0x562b203dea90 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24a0206e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562b1ffa8700 con 0x562b20423940 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24a0206e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562b203de790 con 0x562b203de180 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24977fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b20404be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24977fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b20404be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39914/0 (socket says 10.20.193.28:39914) 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24977fe640 1 -- 10.20.193.28:0/2181690241 learned_addr learned my addr 10.20.193.28:0/2181690241 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f2497fff640 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b20423940 0x562b203c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f2496ffd640 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b203db230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24977fe640 1 -- 10.20.193.28:0/2181690241 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b20423940 msgr2=0x562b203c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24977fe640 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b20423940 0x562b203c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.504+0000 7f24977fe640 1 -- 10.20.193.28:0/2181690241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 msgr2=0x562b203db230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24977fe640 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b203db230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24977fe640 1 -- 10.20.193.28:0/2181690241 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2027abd0 con 0x562b203de180 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f2496ffd640 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b203db230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24977fe640 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b20404be0 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=15216717622673293515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2484009610 tx=0x7f24840c9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d32ca40e62de40cb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f245b7fe640 1 -- 10.20.193.28:0/2181690241 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840b7900 con 0x562b203de180 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f245b7fe640 1 -- 10.20.193.28:0/2181690241 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x562b1ff806f0 con 0x562b203de180 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f245b7fe640 1 -- 10.20.193.28:0/2181690241 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840a81c0 con 0x562b203de180 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 -- 10.20.193.28:0/2181690241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 msgr2=0x562b20404be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b20404be0 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=15216717622673293515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2484009610 tx=0x7f24840c9000 comp rx=0 tx=0).stop 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 -- 10.20.193.28:0/2181690241 shutdown_connections 2026-02-20T13:22:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b203db230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b20423940 0x562b203c8c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2181690241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b203de180 0x562b20404be0 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=15216717622673293515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 -- 10.20.193.28:0/2181690241 >> 10.20.193.28:0/2181690241 conn(0x562b203bc680 msgr2=0x562b204044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 -- 10.20.193.28:0/2181690241 shutdown_connections 2026-02-20T13:22:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.505+0000 7f24a0206e00 1 -- 10.20.193.28:0/2181690241 wait complete. 2026-02-20T13:22:01.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24a0206e00 1 -- start start 2026-02-20T13:22:01.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24a0206e00 1 Processor -- start 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203de180 0x562b2041c1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b20416800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24a0206e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b20416d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24a0206e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b203bc0c0 con 0x562b203dea90 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24a0206e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562b2034d550 con 0x562b203de180 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24a0206e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562b20417280 con 0x562b20423940 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.506+0000 7f24977fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203de180 0x562b2041c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24977fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203de180 0x562b2041c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:42090/0 (socket says 10.20.193.28:42090) 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24977fe640 1 -- 10.20.193.28:0/2510206837 learned_addr learned my addr 10.20.193.28:0/2510206837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f2496ffd640 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b20416800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f2497fff640 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b20416d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24977fe640 1 -- 10.20.193.28:0/2510206837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 msgr2=0x562b20416d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24977fe640 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b20416d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24977fe640 1 -- 10.20.193.28:0/2510206837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 msgr2=0x562b20416800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24977fe640 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b20416800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24977fe640 1 -- 10.20.193.28:0/2510206837 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24840ab990 con 0x562b203de180 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f2496ffd640 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b20416800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24977fe640 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203de180 0x562b2041c1b0 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=16666376514149848192 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2484004790 tx=0x7f2484009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74add232ad09480 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24597fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24597fa640 1 -- 10.20.193.28:0/2510206837 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840b7900 con 0x562b203de180 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24880215f0 con 0x562b203de180 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24597fa640 1 -- 10.20.193.28:0/2510206837 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f24840ad270 con 0x562b203de180 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24597fa640 1 -- 10.20.193.28:0/2510206837 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840ad080 con 0x562b203de180 2026-02-20T13:22:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24a0206e00 10 client.27146 _ll_register_callbacks cb 0x562b2026b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24840b24e0 con 0x562b203de180 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24597fa640 1 -- 10.20.193.28:0/2510206837 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f24840a8ae0 con 0x562b203de180 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.507+0000 7f24597fa640 1 -- 10.20.193.28:0/2510206837 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24840aa850 con 0x562b203de180 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24a0206e00 10 client.27146 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562b2026e680 con 0x562b203de180 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24597fa640 1 -- 10.20.193.28:0/2510206837 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2484020c80 con 0x562b203de180 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24a0206e00 10 client.27146 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24a0206e00 10 client.27146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24a0206e00 20 client.27146 populate_metadata read hostname 'trial028' 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562b204d9050 0x562b204f94d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24a0206e00 4 client.27146 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:22:01.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b1ff7df40 con 0x562b204d9050 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.508+0000 7f2496ffd640 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562b204d9050 0x562b204f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f2496ffd640 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562b204d9050 0x562b204f94d0 crc :-1 s=READY pgs=159 gs=4 cs=0 l=0 c_cookie=12979336669131586058 s_cookie=10411876896504390365 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b41fddeedfca3a0a server_cookie=907e6adf753da2dd in_seq=0 out_seq=0 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24597fa640 10 client.27146 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24597fa640 1 -- 10.20.193.28:0/2510206837 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x562b1ff7df40 con 0x562b204d9050 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24597fa640 10 client.27146 handle_command_reply: tid=0 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 client.27146 shutdown 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203de180 msgr2=0x562b2041c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203de180 0x562b2041c1b0 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=16666376514149848192 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2484004790 tx=0x7f2484009c40 comp rx=0 tx=0).stop 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 shutdown_connections 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562b204d9050 0x562b204f94d0 crc :-1 s=READY pgs=159 gs=4 cs=0 l=0 c_cookie=12979336669131586058 s_cookie=10411876896504390365 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b203dea90 0x562b20416800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562b20423940 0x562b20416d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24597fa640 0 client.27146 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:01.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 --2- 10.20.193.28:0/2510206837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562b203de180 0x562b2041c1b0 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=16666376514149848192 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 >> 10.20.193.28:0/2510206837 conn(0x562b203bc680 msgr2=0x562b204014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:01.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 shutdown_connections 2026-02-20T13:22:01.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 1 -- 10.20.193.28:0/2510206837 wait complete. 2026-02-20T13:22:01.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.509+0000 7f24a0206e00 20 client.27146 trim_cache size 0 max 16384 2026-02-20T13:22:01.519 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "1131643e-ece2-4683-8f9e-ca44912d2c8c", 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:22:01.520 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.521 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.522 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.523 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:22:01.524 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.525 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:22:01.526 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 -- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f246c0b5760 msgr2=0x7f246c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f246c0b5760 0x7f246c0d5c10 secure :-1 s=READY pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2498123e70 tx=0x7f248800b480 comp rx=0 tx=0).stop 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 -- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f249810f5f0 msgr2=0x7f249811d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f249810f5f0 0x7f249811d4d0 secure :-1 s=READY pgs=704 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f248400d720 tx=0x7f248400dbf0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 -- 10.20.193.28:0/3809993594 shutdown_connections 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f246c0b5760 0x7f246c0d5c10 unknown :-1 s=CLOSED pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24981157e0 0x7f2498122de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f249810ffe0 0x7f249811da10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 --2- 10.20.193.28:0/3809993594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f249810f5f0 0x7f249811d4d0 unknown :-1 s=CLOSED pgs=704 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:01.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 -- 10.20.193.28:0/3809993594 >> 10.20.193.28:0/3809993594 conn(0x7f24980ecea0 msgr2=0x7f249810d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:01.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 -- 10.20.193.28:0/3809993594 shutdown_connections 2026-02-20T13:22:01.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:01.510+0000 7f249e20c640 1 -- 10.20.193.28:0/3809993594 wait complete. 2026-02-20T13:22:01.611 INFO:tasks.cephfs.filesystem:scrub status for tag:1131643e-ece2-4683-8f9e-ca44912d2c8c - {'path': '/', 'tag': '1131643e-ece2-4683-8f9e-ca44912d2c8c', 'options': 'recursive,force'} 2026-02-20T13:22:01.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:01 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:22:01.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:01 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:22:01.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:01 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:01.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:01 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:22:01.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:01 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:01.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:01 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:01.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:01 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:22:01.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:01 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:22:01.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:01 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:01.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:01 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:22:01.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:01 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:01.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:01 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:01.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:01 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:22:01.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:01 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:22:01.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:01 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:01.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:01 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:22:01.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:01 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:01.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:01 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:02 trial028 ceph-mon[37442]: pgmap v322: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:22:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:02 trial127 ceph-mon[43817]: pgmap v322: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:22:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:02 trial034 ceph-mon[43332]: pgmap v322: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:22:03.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 -- 10.20.193.28:0/3533637830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010f2f0 msgr2=0x7f5cd0171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 --2- 10.20.193.28:0/3533637830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010f2f0 0x7f5cd0171080 secure :-1 s=READY pgs=706 gs=2 cs=0 l=1 c_cookie=15243014712769591664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc000aa60 tx=0x7f5cc00302b0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 -- 10.20.193.28:0/3533637830 shutdown_connections 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 --2- 10.20.193.28:0/3533637830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010f2f0 0x7f5cd0171080 unknown :-1 s=CLOSED pgs=706 gs=2 cs=0 l=1 c_cookie=15243014712769591664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 --2- 10.20.193.28:0/3533637830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cd010e940 0x7f5cd010edb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 --2- 10.20.193.28:0/3533637830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cd01100b0 0x7f5cd01104a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 -- 10.20.193.28:0/3533637830 >> 10.20.193.28:0/3533637830 conn(0x7f5cd00ec320 msgr2=0x7f5cd010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 -- 10.20.193.28:0/3533637830 shutdown_connections 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.586+0000 7f5cd481a640 1 -- 10.20.193.28:0/3533637830 wait complete. 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cd481a640 1 Processor -- start 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cd481a640 1 -- start start 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cd481a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010e940 0x7f5cd00f81f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cd481a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cd010f2f0 0x7f5cd0171060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cd481a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cd01100b0 0x7f5cd00f8a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cd481a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00f9690 con 0x7f5cd010e940 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cd481a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00f9800 con 0x7f5cd01100b0 2026-02-20T13:22:03.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cd481a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00f99c0 con 0x7f5cd010f2f0 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cced76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010e940 0x7f5cd00f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cced76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010e940 0x7f5cd00f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37726/0 (socket says 10.20.193.28:37726) 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cced76640 1 -- 10.20.193.28:0/1125444897 learned_addr learned my addr 10.20.193.28:0/1125444897 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5ccf577640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cd01100b0 0x7f5cd00f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cce575640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cd010f2f0 0x7f5cd0171060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cced76640 1 -- 10.20.193.28:0/1125444897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cd010f2f0 msgr2=0x7f5cd0171060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cced76640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cd010f2f0 0x7f5cd0171060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cced76640 1 -- 10.20.193.28:0/1125444897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cd01100b0 msgr2=0x7f5cd00f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cced76640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cd01100b0 0x7f5cd00f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.587+0000 7f5cced76640 1 -- 10.20.193.28:0/1125444897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc000a650 con 0x7f5cd010e940 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.588+0000 7f5cced76640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010e940 0x7f5cd00f81f0 secure :-1 s=READY pgs=707 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc4009480 tx=0x7f5cc400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.588+0000 7f5caffff640 1 -- 10.20.193.28:0/1125444897 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cc400ccc0 con 0x7f5cd010e940 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.588+0000 7f5caffff640 1 -- 10.20.193.28:0/1125444897 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5cc400ce20 con 0x7f5cd010e940 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.588+0000 7f5caffff640 1 -- 10.20.193.28:0/1125444897 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cc40106b0 con 0x7f5cd010e940 2026-02-20T13:22:03.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.588+0000 7f5cd481a640 1 -- 10.20.193.28:0/1125444897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd00f9ca0 con 0x7f5cd010e940 2026-02-20T13:22:03.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.588+0000 7f5cd481a640 1 -- 10.20.193.28:0/1125444897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd00fa120 con 0x7f5cd010e940 2026-02-20T13:22:03.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.591+0000 7f5caffff640 1 -- 10.20.193.28:0/1125444897 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5cc401f060 con 0x7f5cd010e940 2026-02-20T13:22:03.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.592+0000 7f5caffff640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ca40b5760 0x7f5ca40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.592+0000 7f5caffff640 1 -- 10.20.193.28:0/1125444897 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5cc4014070 con 0x7f5cd010e940 2026-02-20T13:22:03.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.592+0000 7f5cce575640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ca40b5760 0x7f5ca40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cce575640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ca40b5760 0x7f5ca40d5c10 secure :-1 s=READY pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8004740 tx=0x7f5cb8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:03.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cd760ce00 1 Processor -- start 2026-02-20T13:22:03.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cd760ce00 1 -- start start 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be378a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 0x55ca6be581c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be58700 0x55ca6be78ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca6bd2cfd0 con 0x55ca6be58700 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ca6bd28d00 con 0x55ca6be37de0 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.593+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ca6bd22ca0 con 0x55ca6be174c0 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be58700 0x55ca6be78ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be58700 0x55ca6be78ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37730/0 (socket says 10.20.193.28:37730) 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 -- 10.20.193.28:0/3132993446 learned_addr learned my addr 10.20.193.28:0/3132993446 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cced76640 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cce575640 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 0x55ca6be581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 -- 10.20.193.28:0/3132993446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 msgr2=0x55ca6be378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 -- 10.20.193.28:0/3132993446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 msgr2=0x55ca6be581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 0x55ca6be581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 -- 10.20.193.28:0/3132993446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6bcc58b0 con 0x55ca6be58700 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5ccf577640 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be58700 0x55ca6be78ae0 secure :-1 s=READY pgs=708 gs=1 cs=0 l=1 c_cookie=171066254673200922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc0003e60 tx=0x7f5cc0006bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fbfda2eda471a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cad3fe640 1 -- 10.20.193.28:0/3132993446 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cc003e050 con 0x55ca6be58700 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cad3fe640 1 -- 10.20.193.28:0/3132993446 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5cc003f040 con 0x55ca6be58700 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cad3fe640 1 -- 10.20.193.28:0/3132993446 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cc00050c0 con 0x55ca6be58700 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3132993446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be58700 msgr2=0x55ca6be78ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be58700 0x55ca6be78ae0 secure :-1 s=READY pgs=708 gs=1 cs=0 l=1 c_cookie=171066254673200922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc0003e60 tx=0x7f5cc0006bd0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3132993446 shutdown_connections 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be58700 0x55ca6be78ae0 unknown :-1 s=CLOSED pgs=708 gs=1 cs=0 l=1 c_cookie=171066254673200922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 0x55ca6be581c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3132993446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be378a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.594+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3132993446 >> 10.20.193.28:0/3132993446 conn(0x55ca6bd361c0 msgr2=0x55ca6be15da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.595+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3132993446 shutdown_connections 2026-02-20T13:22:03.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.595+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3132993446 wait complete. 2026-02-20T13:22:03.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.596+0000 7f5cd760ce00 1 -- start start 2026-02-20T13:22:03.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.596+0000 7f5cd760ce00 1 Processor -- start 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.596+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be309d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.596+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be31020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.596+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 0x55ca6be31a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.596+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca6be320e0 con 0x55ca6be37de0 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.596+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ca6be32250 con 0x55ca6be58700 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.596+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ca6be32410 con 0x55ca6be174c0 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be31020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be31020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37738/0 (socket says 10.20.193.28:37738) 2026-02-20T13:22:03.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 -- 10.20.193.28:0/3529827924 learned_addr learned my addr 10.20.193.28:0/3529827924 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cced76640 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5ccf577640 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 0x55ca6be31a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 -- 10.20.193.28:0/3529827924 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 msgr2=0x55ca6be309d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be309d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 -- 10.20.193.28:0/3529827924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 msgr2=0x55ca6be31a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 0x55ca6be31a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 -- 10.20.193.28:0/3529827924 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6bcce400 con 0x55ca6be37de0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cce575640 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be31020 secure :-1 s=READY pgs=709 gs=1 cs=0 l=1 c_cookie=5535540910934682607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8009eb0 tx=0x7f5cb80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd2312143e76bef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5c98bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3529827924 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cb8022070 con 0x55ca6be37de0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3529827924 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5cb801dd90 con 0x55ca6be37de0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3529827924 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cb801ae70 con 0x55ca6be37de0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd0171ae0 con 0x55ca6be37de0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3529827924 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5cb801c3e0 con 0x55ca6be37de0 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5c98bfc640 10 client.17181 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:22:03.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cd760ce00 10 client.17181 _ll_register_callbacks cb 0x55ca6bcada40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.597+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca6b9c2520 con 0x55ca6be37de0 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3529827924 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5cb801d8b0 con 0x55ca6be37de0 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cd760ce00 10 client.17181 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ca6bca6da0 con 0x55ca6be37de0 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3529827924 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5cb801a3f0 con 0x55ca6be37de0 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cd760ce00 10 client.17181 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cd760ce00 10 client.17181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cd760ce00 20 client.17181 populate_metadata read hostname 'trial028' 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca6be35180 0x55ca6be35620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cd760ce00 4 client.17181 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca6bd54630 con 0x55ca6be35180 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.598+0000 7f5cced76640 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca6be35180 0x55ca6be35620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.599+0000 7f5cced76640 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca6be35180 0x55ca6be35620 crc :-1 s=READY pgs=160 gs=4 cs=0 l=0 c_cookie=4452157424688747859 s_cookie=2336319756893196947 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc93d96d6b0d553 server_cookie=206c4670c7589293 in_seq=0 out_seq=0 2026-02-20T13:22:03.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.599+0000 7f5c98bfc640 10 client.17181 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3529827924 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ca6bd54630 con 0x55ca6be35180 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5c98bfc640 10 client.17181 handle_command_reply: tid=0 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 client.17181 shutdown 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 msgr2=0x55ca6be31020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be31020 secure :-1 s=READY pgs=709 gs=1 cs=0 l=1 c_cookie=5535540910934682607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8009eb0 tx=0x7f5cb80047e0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 shutdown_connections 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca6be35180 0x55ca6be35620 crc :-1 s=READY pgs=160 gs=4 cs=0 l=0 c_cookie=4452157424688747859 s_cookie=2336319756893196947 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be31020 unknown :-1 s=CLOSED pgs=709 gs=1 cs=0 l=1 c_cookie=5535540910934682607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 0x55ca6be31a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3529827924 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be309d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 >> 10.20.193.28:0/3529827924 conn(0x55ca6bd361c0 msgr2=0x55ca6be18790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:03.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5c98bfc640 0 client.17181 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:03.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 shutdown_connections 2026-02-20T13:22:03.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3529827924 wait complete. 2026-02-20T13:22:03.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.600+0000 7f5cd760ce00 20 client.17181 trim_cache size 0 max 16384 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cd760ce00 1 Processor -- start 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cd760ce00 1 -- start start 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be30f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be575d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 0x55ca6be57b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca6bd208d0 con 0x55ca6be37de0 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ca6ba61f10 con 0x55ca6be58700 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ca6be29aa0 con 0x55ca6be174c0 2026-02-20T13:22:03.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37744/0 (socket says 10.20.193.28:37744) 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 -- 10.20.193.28:0/1111984234 learned_addr learned my addr 10.20.193.28:0/1111984234 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 -- 10.20.193.28:0/1111984234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 msgr2=0x55ca6be30f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 --2- 10.20.193.28:0/1111984234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be30f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 -- 10.20.193.28:0/1111984234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 msgr2=0x55ca6be57b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 --2- 10.20.193.28:0/1111984234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 0x55ca6be57b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 -- 10.20.193.28:0/1111984234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6bcb8670 con 0x55ca6be37de0 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cce575640 1 --2- 10.20.193.28:0/1111984234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be575d0 secure :-1 s=READY pgs=710 gs=1 cs=0 l=1 c_cookie=3114007251573490229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8011cb0 tx=0x7f5cb802b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b372d18ba074235 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cacbfd640 1 -- 10.20.193.28:0/1111984234 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cb8022040 con 0x55ca6be37de0 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.608+0000 7f5cacbfd640 1 -- 10.20.193.28:0/1111984234 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ca6b9c2520 con 0x55ca6be37de0 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cacbfd640 1 -- 10.20.193.28:0/1111984234 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cb801a4f0 con 0x55ca6be37de0 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 -- 10.20.193.28:0/1111984234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 msgr2=0x55ca6be575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/1111984234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be575d0 secure :-1 s=READY pgs=710 gs=1 cs=0 l=1 c_cookie=3114007251573490229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8011cb0 tx=0x7f5cb802b000 comp rx=0 tx=0).stop 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 -- 10.20.193.28:0/1111984234 shutdown_connections 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/1111984234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be37de0 0x55ca6be575d0 unknown :-1 s=CLOSED pgs=710 gs=1 cs=0 l=1 c_cookie=3114007251573490229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/1111984234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be58700 0x55ca6be57b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/1111984234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be174c0 0x55ca6be30f50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 -- 10.20.193.28:0/1111984234 >> 10.20.193.28:0/1111984234 conn(0x55ca6bd361c0 msgr2=0x55ca6be30840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 -- 10.20.193.28:0/1111984234 shutdown_connections 2026-02-20T13:22:03.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 -- 10.20.193.28:0/1111984234 wait complete. 2026-02-20T13:22:03.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 -- start start 2026-02-20T13:22:03.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.609+0000 7f5cd760ce00 1 Processor -- start 2026-02-20T13:22:03.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be174c0 0x55ca6be39730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 0x55ca6be39dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cd760ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be58700 0x55ca6be3a770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca6be3ae20 con 0x55ca6be174c0 2026-02-20T13:22:03.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ca6be3af90 con 0x55ca6be37de0 2026-02-20T13:22:03.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cd760ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ca6be3b150 con 0x55ca6be58700 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be174c0 0x55ca6be39730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be174c0 0x55ca6be39730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37760/0 (socket says 10.20.193.28:37760) 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 -- 10.20.193.28:0/3402683630 learned_addr learned my addr 10.20.193.28:0/3402683630 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5ccf577640 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be58700 0x55ca6be3a770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cce575640 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 0x55ca6be39dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 -- 10.20.193.28:0/3402683630 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be58700 msgr2=0x55ca6be3a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be58700 0x55ca6be3a770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 -- 10.20.193.28:0/3402683630 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 msgr2=0x55ca6be39dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 0x55ca6be39dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 -- 10.20.193.28:0/3402683630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6bcb30f0 con 0x55ca6be174c0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cced76640 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be174c0 0x55ca6be39730 secure :-1 s=READY pgs=711 gs=1 cs=0 l=1 c_cookie=198971210571267802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc40e47f0 tx=0x7f5cc400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2e34306a13eda server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5c98bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3402683630 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cc40ada20 con 0x55ca6be174c0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3402683630 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5cc406f070 con 0x55ca6be174c0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3402683630 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cc40ace40 con 0x55ca6be174c0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.610+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6bca6da0 con 0x55ca6be174c0 2026-02-20T13:22:03.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3402683630 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5cc40adcb0 con 0x55ca6be174c0 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5c98bfc640 10 client.17187 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 10 client.17187 _ll_register_callbacks cb 0x55ca6bcada40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca6bdd2ca0 con 0x55ca6be174c0 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3402683630 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5cc40b8160 con 0x55ca6be174c0 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 10 client.17187 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ca6bca70d0 con 0x55ca6be174c0 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3402683630 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5cc40cb020 con 0x55ca6be174c0 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 10 client.17187 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 10 client.17187 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 20 client.17187 populate_metadata read hostname 'trial028' 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca6be3cf70 0x55ca6be3d410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 4 client.17187 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca6ba06640 con 0x55ca6be3cf70 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.611+0000 7f5cce575640 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca6be3cf70 0x55ca6be3d410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.612+0000 7f5cce575640 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca6be3cf70 0x55ca6be3d410 crc :-1 s=READY pgs=161 gs=4 cs=0 l=0 c_cookie=2446652712313907911 s_cookie=9132793841465019133 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f441adce376ac7 server_cookie=7ebe339c7765cafd in_seq=0 out_seq=0 2026-02-20T13:22:03.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.612+0000 7f5c98bfc640 10 client.17187 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:03.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5c98bfc640 1 -- 10.20.193.28:0/3402683630 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca6ba06640 con 0x55ca6be3cf70 2026-02-20T13:22:03.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5c98bfc640 10 client.17187 handle_command_reply: tid=0 2026-02-20T13:22:03.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 client.17187 shutdown 2026-02-20T13:22:03.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be174c0 msgr2=0x55ca6be39730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be174c0 0x55ca6be39730 secure :-1 s=READY pgs=711 gs=1 cs=0 l=1 c_cookie=198971210571267802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc40e47f0 tx=0x7f5cc400cf90 comp rx=0 tx=0).stop 2026-02-20T13:22:03.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 shutdown_connections 2026-02-20T13:22:03.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca6be3cf70 0x55ca6be3d410 crc :-1 s=READY pgs=161 gs=4 cs=0 l=0 c_cookie=2446652712313907911 s_cookie=9132793841465019133 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca6be58700 0x55ca6be3a770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca6be37de0 0x55ca6be39dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 --2- 10.20.193.28:0/3402683630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca6be174c0 0x55ca6be39730 unknown :-1 s=CLOSED pgs=711 gs=1 cs=0 l=1 c_cookie=198971210571267802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5c98bfc640 0 client.17187 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 >> 10.20.193.28:0/3402683630 conn(0x55ca6bd361c0 msgr2=0x55ca6be30ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 shutdown_connections 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 1 -- 10.20.193.28:0/3402683630 wait complete. 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd760ce00 20 client.17187 trim_cache size 0 max 16384 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 -- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ca40b5760 msgr2=0x7f5ca40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ca40b5760 0x7f5ca40d5c10 secure :-1 s=READY pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8004740 tx=0x7f5cb8005f90 comp rx=0 tx=0).stop 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 -- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010e940 msgr2=0x7f5cd00f81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010e940 0x7f5cd00f81f0 secure :-1 s=READY pgs=707 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc4009480 tx=0x7f5cc400ee60 comp rx=0 tx=0).stop 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 -- 10.20.193.28:0/1125444897 shutdown_connections 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5ca40b5760 0x7f5ca40d5c10 unknown :-1 s=CLOSED pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5cd01100b0 0x7f5cd00f8a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5cd010f2f0 0x7f5cd0171060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 --2- 10.20.193.28:0/1125444897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5cd010e940 0x7f5cd00f81f0 unknown :-1 s=CLOSED pgs=707 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:03.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.617+0000 7f5cd481a640 1 -- 10.20.193.28:0/1125444897 >> 10.20.193.28:0/1125444897 conn(0x7f5cd00ec320 msgr2=0x7f5cd00ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:03.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.618+0000 7f5cd481a640 1 -- 10.20.193.28:0/1125444897 shutdown_connections 2026-02-20T13:22:03.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:03.618+0000 7f5cd481a640 1 -- 10.20.193.28:0/1125444897 wait complete. 2026-02-20T13:22:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:04 trial028 ceph-mon[37442]: pgmap v323: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2026-02-20T13:22:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:04 trial127 ceph-mon[43817]: pgmap v323: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2026-02-20T13:22:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:04 trial034 ceph-mon[43332]: pgmap v323: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2026-02-20T13:22:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:06 trial028 ceph-mon[37442]: pgmap v324: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:22:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:06 trial127 ceph-mon[43817]: pgmap v324: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:22:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:06 trial034 ceph-mon[43332]: pgmap v324: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:22:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:08 trial028 ceph-mon[37442]: pgmap v325: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:22:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:22:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:22:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:08 trial127 ceph-mon[43817]: pgmap v325: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:22:08.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:22:08.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:22:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:08 trial034 ceph-mon[43332]: pgmap v325: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:22:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:22:08.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:22:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:10 trial028 ceph-mon[37442]: pgmap v326: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:10 trial127 ceph-mon[43817]: pgmap v326: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:10 trial034 ceph-mon[43332]: pgmap v326: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:12 trial028 ceph-mon[37442]: pgmap v327: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2026-02-20T13:22:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:12 trial127 ceph-mon[43817]: pgmap v327: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2026-02-20T13:22:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:12 trial034 ceph-mon[43332]: pgmap v327: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2026-02-20T13:22:14.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:14 trial028 ceph-mon[37442]: pgmap v328: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:14 trial127 ceph-mon[43817]: pgmap v328: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:14 trial034 ceph-mon[43332]: pgmap v328: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:16.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 -- 10.20.193.28:0/2749605181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 msgr2=0x7f954c1104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 --2- 10.20.193.28:0/2749605181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 0x7f954c1104a0 secure :-1 s=READY pgs=712 gs=1 cs=0 l=1 c_cookie=16394378487657137566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f953c0098c0 tx=0x7f953c02f0c0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 -- 10.20.193.28:0/2749605181 shutdown_connections 2026-02-20T13:22:16.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 --2- 10.20.193.28:0/2749605181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f954c10f2f0 0x7f954c171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 --2- 10.20.193.28:0/2749605181 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f954c10e940 0x7f954c10edb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 --2- 10.20.193.28:0/2749605181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 0x7f954c1104a0 unknown :-1 s=CLOSED pgs=712 gs=1 cs=0 l=1 c_cookie=16394378487657137566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 -- 10.20.193.28:0/2749605181 >> 10.20.193.28:0/2749605181 conn(0x7f954c0ec320 msgr2=0x7f954c10c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:16.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 -- 10.20.193.28:0/2749605181 shutdown_connections 2026-02-20T13:22:16.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.690+0000 7f9552c83640 1 -- 10.20.193.28:0/2749605181 wait complete. 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552c83640 1 Processor -- start 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552c83640 1 -- start start 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552c83640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f954c10e940 0x7f954c0f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552c83640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f954c10f2f0 0x7f954c171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552c83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 0x7f954c0f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552c83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0f96a0 con 0x7f954c1100b0 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552c83640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0f9810 con 0x7f954c10f2f0 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552c83640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0f99d0 con 0x7f954c10e940 2026-02-20T13:22:16.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9551480640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f954c10f2f0 0x7f954c171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552482640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 0x7f954c0f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9551480640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f954c10f2f0 0x7f954c171080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:48338/0 (socket says 10.20.193.28:48338) 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9551480640 1 -- 10.20.193.28:0/354347097 learned_addr learned my addr 10.20.193.28:0/354347097 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9551c81640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f954c10e940 0x7f954c0f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552482640 1 -- 10.20.193.28:0/354347097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f954c10e940 msgr2=0x7f954c0f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552482640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f954c10e940 0x7f954c0f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552482640 1 -- 10.20.193.28:0/354347097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f954c10f2f0 msgr2=0x7f954c171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552482640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f954c10f2f0 0x7f954c171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.691+0000 7f9552482640 1 -- 10.20.193.28:0/354347097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c0094b0 con 0x7f954c1100b0 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.692+0000 7f9552482640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 0x7f954c0f8ab0 secure :-1 s=READY pgs=713 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954800e720 tx=0x7f954800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.692+0000 7f953affd640 1 -- 10.20.193.28:0/354347097 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9548005500 con 0x7f954c1100b0 2026-02-20T13:22:16.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.692+0000 7f953affd640 1 -- 10.20.193.28:0/354347097 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9548005660 con 0x7f954c1100b0 2026-02-20T13:22:16.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.692+0000 7f9552c83640 1 -- 10.20.193.28:0/354347097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c0f9cb0 con 0x7f954c1100b0 2026-02-20T13:22:16.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.692+0000 7f953affd640 1 -- 10.20.193.28:0/354347097 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9548011460 con 0x7f954c1100b0 2026-02-20T13:22:16.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.692+0000 7f9552c83640 1 -- 10.20.193.28:0/354347097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c0fa1d0 con 0x7f954c1100b0 2026-02-20T13:22:16.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.695+0000 7f953affd640 1 -- 10.20.193.28:0/354347097 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f954800c7e0 con 0x7f954c1100b0 2026-02-20T13:22:16.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.696+0000 7f953affd640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95280b5760 0x7f95280d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.696+0000 7f953affd640 1 -- 10.20.193.28:0/354347097 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f95480e79d0 con 0x7f954c1100b0 2026-02-20T13:22:16.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.696+0000 7f9551c81640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95280b5760 0x7f95280d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.697+0000 7f9551c81640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95280b5760 0x7f95280d5c10 secure :-1 s=READY pgs=373 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f953c002c60 tx=0x7f953c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:16.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.697+0000 7f9556636e00 1 Processor -- start 2026-02-20T13:22:16.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.697+0000 7f9556636e00 1 -- start start 2026-02-20T13:22:16.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9556636e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ec14c0 0x557729ee18a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9556636e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729f021c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9556636e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729f02700 0x557729f22ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9556636e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557729dd6fd0 con 0x557729ec14c0 2026-02-20T13:22:16.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9556636e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557729dd2d00 con 0x557729f02700 2026-02-20T13:22:16.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9556636e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557729dccca0 con 0x557729ee1de0 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551c81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ec14c0 0x557729ee18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551480640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729f021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551c81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ec14c0 0x557729ee18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56810/0 (socket says 10.20.193.28:56810) 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551c81640 1 -- 10.20.193.28:0/3038381204 learned_addr learned my addr 10.20.193.28:0/3038381204 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551480640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729f021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:47014/0 (socket says 10.20.193.28:47014) 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9552482640 1 --2- 10.20.193.28:0/3038381204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729f02700 0x557729f22ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551480640 1 -- 10.20.193.28:0/3038381204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729f02700 msgr2=0x557729f22ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551480640 1 --2- 10.20.193.28:0/3038381204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729f02700 0x557729f22ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551480640 1 -- 10.20.193.28:0/3038381204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ec14c0 msgr2=0x557729ee18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551480640 1 --2- 10.20.193.28:0/3038381204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ec14c0 0x557729ee18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551480640 1 -- 10.20.193.28:0/3038381204 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557729d6f8b0 con 0x557729ee1de0 2026-02-20T13:22:16.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.698+0000 7f9551480640 1 --2- 10.20.193.28:0/3038381204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729f021c0 secure :-1 s=READY pgs=235 gs=2 cs=0 l=1 c_cookie=4293335826754226762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9540004490 tx=0x7f9540009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b94fe2ff724ca4a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9519bfe640 1 -- 10.20.193.28:0/3038381204 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9540009ea0 con 0x557729ee1de0 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9519bfe640 1 -- 10.20.193.28:0/3038381204 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9540010b30 con 0x557729ee1de0 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 -- 10.20.193.28:0/3038381204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 msgr2=0x557729f021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 --2- 10.20.193.28:0/3038381204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729f021c0 secure :-1 s=READY pgs=235 gs=2 cs=0 l=1 c_cookie=4293335826754226762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9540004490 tx=0x7f9540009ca0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 -- 10.20.193.28:0/3038381204 shutdown_connections 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 --2- 10.20.193.28:0/3038381204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729f02700 0x557729f22ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 --2- 10.20.193.28:0/3038381204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729f021c0 unknown :-1 s=CLOSED pgs=235 gs=2 cs=0 l=1 c_cookie=4293335826754226762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 --2- 10.20.193.28:0/3038381204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ec14c0 0x557729ee18a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 -- 10.20.193.28:0/3038381204 >> 10.20.193.28:0/3038381204 conn(0x557729de01c0 msgr2=0x557729ebfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 -- 10.20.193.28:0/3038381204 shutdown_connections 2026-02-20T13:22:16.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.699+0000 7f9556636e00 1 -- 10.20.193.28:0/3038381204 wait complete. 2026-02-20T13:22:16.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.700+0000 7f9556636e00 1 -- start start 2026-02-20T13:22:16.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.700+0000 7f9556636e00 1 Processor -- start 2026-02-20T13:22:16.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9556636e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729eda990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9556636e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ee1de0 0x557729edafe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9556636e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729f02700 0x557729edba40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9556636e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557729edc0a0 con 0x557729ee1de0 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9556636e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557729edc210 con 0x557729ec14c0 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9556636e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557729edc3d0 con 0x557729f02700 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ee1de0 0x557729edafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ee1de0 0x557729edafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56812/0 (socket says 10.20.193.28:56812) 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 -- 10.20.193.28:0/2193178818 learned_addr learned my addr 10.20.193.28:0/2193178818 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551c81640 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729eda990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9552482640 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729f02700 0x557729edba40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 -- 10.20.193.28:0/2193178818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729f02700 msgr2=0x557729edba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:16.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729f02700 0x557729edba40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 -- 10.20.193.28:0/2193178818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 msgr2=0x557729eda990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729eda990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 -- 10.20.193.28:0/2193178818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557729d78400 con 0x557729ee1de0 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9551480640 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ee1de0 0x557729edafe0 secure :-1 s=READY pgs=714 gs=1 cs=0 l=1 c_cookie=5408287359206166612 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954001da90 tx=0x7f954001dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0e18b2e8b81054 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.701+0000 7f9506ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9506ffd640 1 -- 10.20.193.28:0/2193178818 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9540022070 con 0x557729ee1de0 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9506ffd640 1 -- 10.20.193.28:0/2193178818 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f954000e710 con 0x557729ee1de0 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9506ffd640 1 -- 10.20.193.28:0/2193178818 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9540004770 con 0x557729ee1de0 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9540004100 con 0x557729ee1de0 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9506ffd640 1 -- 10.20.193.28:0/2193178818 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9540004900 con 0x557729ee1de0 2026-02-20T13:22:16.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9506ffd640 10 client.17199 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 10 client.17199 _ll_register_callbacks cb 0x557729d57a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557729a6c520 con 0x557729ee1de0 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9506ffd640 1 -- 10.20.193.28:0/2193178818 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9540004b00 con 0x557729ee1de0 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 10 client.17199 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557729d50da0 con 0x557729ee1de0 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9506ffd640 1 -- 10.20.193.28:0/2193178818 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9540019030 con 0x557729ee1de0 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 10 client.17199 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 10 client.17199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 20 client.17199 populate_metadata read hostname 'trial028' 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.702+0000 7f9556636e00 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557729edef40 0x557729edf3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.703+0000 7f9556636e00 4 client.17199 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:16.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.703+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557729dfe630 con 0x557729edef40 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.703+0000 7f9551c81640 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557729edef40 0x557729edf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.703+0000 7f9551c81640 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557729edef40 0x557729edf3e0 crc :-1 s=READY pgs=162 gs=4 cs=0 l=0 c_cookie=17010693342844634361 s_cookie=6941766182689067695 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec121f78035b44f9 server_cookie=60561b90690052af in_seq=0 out_seq=0 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.703+0000 7f9506ffd640 10 client.17199 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9506ffd640 1 -- 10.20.193.28:0/2193178818 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557729dfe630 con 0x557729edef40 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9506ffd640 10 client.17199 handle_command_reply: tid=0 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 client.17199 shutdown 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ee1de0 msgr2=0x557729edafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ee1de0 0x557729edafe0 secure :-1 s=READY pgs=714 gs=1 cs=0 l=1 c_cookie=5408287359206166612 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954001da90 tx=0x7f954001dac0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 shutdown_connections 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557729edef40 0x557729edf3e0 crc :-1 s=READY pgs=162 gs=4 cs=0 l=0 c_cookie=17010693342844634361 s_cookie=6941766182689067695 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729ee1de0 0x557729edafe0 unknown :-1 s=CLOSED pgs=714 gs=1 cs=0 l=1 c_cookie=5408287359206166612 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729f02700 0x557729edba40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 --2- 10.20.193.28:0/2193178818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729eda990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 >> 10.20.193.28:0/2193178818 conn(0x557729de01c0 msgr2=0x557729ec2790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:16.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9506ffd640 0 client.17199 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:16.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 shutdown_connections 2026-02-20T13:22:16.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 1 -- 10.20.193.28:0/2193178818 wait complete. 2026-02-20T13:22:16.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.704+0000 7f9556636e00 20 client.17199 trim_cache size 0 max 16384 2026-02-20T13:22:16.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9556636e00 1 Processor -- start 2026-02-20T13:22:16.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9556636e00 1 -- start start 2026-02-20T13:22:16.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9556636e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729edb0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9556636e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ecc9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9556636e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ed7d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9556636e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557729dca8d0 con 0x557729f02700 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9556636e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557729b0bf10 con 0x557729ec14c0 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9556636e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557729ec0010 con 0x557729ee1de0 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9552482640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ed7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9552482640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ed7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56826/0 (socket says 10.20.193.28:56826) 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9552482640 1 -- 10.20.193.28:0/2398685303 learned_addr learned my addr 10.20.193.28:0/2398685303 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9551c81640 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729edb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.712+0000 7f9551480640 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ecc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9552482640 1 -- 10.20.193.28:0/2398685303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 msgr2=0x557729ecc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9552482640 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ecc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9552482640 1 -- 10.20.193.28:0/2398685303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 msgr2=0x557729edb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9552482640 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729edb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9552482640 1 -- 10.20.193.28:0/2398685303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557729ecd1b0 con 0x557729f02700 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9551c81640 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729edb0a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9552482640 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ed7d10 secure :-1 s=READY pgs=715 gs=2 cs=0 l=1 c_cookie=10072387756203273354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95480034b0 tx=0x7f95480ade90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc84f4c687d6c8a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f95193fd640 1 -- 10.20.193.28:0/2398685303 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f954800cac0 con 0x557729f02700 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f95193fd640 1 -- 10.20.193.28:0/2398685303 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f95480b3070 con 0x557729f02700 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f95193fd640 1 -- 10.20.193.28:0/2398685303 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f954800ce70 con 0x557729f02700 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 -- 10.20.193.28:0/2398685303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 msgr2=0x557729ed7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ed7d10 secure :-1 s=READY pgs=715 gs=2 cs=0 l=1 c_cookie=10072387756203273354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95480034b0 tx=0x7f95480ade90 comp rx=0 tx=0).stop 2026-02-20T13:22:16.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 -- 10.20.193.28:0/2398685303 shutdown_connections 2026-02-20T13:22:16.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ed7d10 unknown :-1 s=CLOSED pgs=715 gs=2 cs=0 l=1 c_cookie=10072387756203273354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ecc9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 --2- 10.20.193.28:0/2398685303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729edb0a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 -- 10.20.193.28:0/2398685303 >> 10.20.193.28:0/2398685303 conn(0x557729de01c0 msgr2=0x557729eda990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:16.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 -- 10.20.193.28:0/2398685303 shutdown_connections 2026-02-20T13:22:16.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.713+0000 7f9556636e00 1 -- 10.20.193.28:0/2398685303 wait complete. 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.714+0000 7f9556636e00 1 -- start start 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.714+0000 7f9556636e00 1 Processor -- start 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.714+0000 7f9556636e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729ee34e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.714+0000 7f9556636e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ee3ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.714+0000 7f9556636e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ee41b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.714+0000 7f9556636e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557729ee48b0 con 0x557729f02700 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.714+0000 7f9556636e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557729ee4a20 con 0x557729ec14c0 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.714+0000 7f9556636e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557729ee4be0 con 0x557729ee1de0 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9552482640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ee41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9551c81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729ee34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9551c81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729ee34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:48368/0 (socket says 10.20.193.28:48368) 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9551c81640 1 -- 10.20.193.28:0/4141569638 learned_addr learned my addr 10.20.193.28:0/4141569638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9551480640 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ee3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9552482640 1 -- 10.20.193.28:0/4141569638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 msgr2=0x557729ee3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9552482640 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ee3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9552482640 1 -- 10.20.193.28:0/4141569638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 msgr2=0x557729ee34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9552482640 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729ee34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9552482640 1 -- 10.20.193.28:0/4141569638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557729d62670 con 0x557729f02700 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9551480640 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ee3ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9552482640 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ee41b0 secure :-1 s=READY pgs=716 gs=2 cs=0 l=1 c_cookie=9404470554644967800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954800ef90 tx=0x7f95480aa280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82836424763bf178 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9506ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9506ffd640 1 -- 10.20.193.28:0/4141569638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95480b6030 con 0x557729f02700 2026-02-20T13:22:16.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9506ffd640 1 -- 10.20.193.28:0/4141569638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f954800ce50 con 0x557729f02700 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9506ffd640 1 -- 10.20.193.28:0/4141569638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95480af9a0 con 0x557729f02700 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c0fa1d0 con 0x557729f02700 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9556636e00 10 client.17205 _ll_register_callbacks cb 0x557729d57a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.715+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557729e7cca0 con 0x557729f02700 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9506ffd640 1 -- 10.20.193.28:0/4141569638 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f95480b3a50 con 0x557729f02700 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9506ffd640 1 -- 10.20.193.28:0/4141569638 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9548003780 con 0x557729f02700 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9556636e00 10 client.17205 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557729d5d0f0 con 0x557729f02700 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9506ffd640 1 -- 10.20.193.28:0/4141569638 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f95480c5b90 con 0x557729f02700 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9556636e00 10 client.17205 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9556636e00 10 client.17205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:16.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9556636e00 20 client.17205 populate_metadata read hostname 'trial028' 2026-02-20T13:22:16.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9556636e00 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557729ee66b0 0x557729ee6b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:16.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9556636e00 4 client.17205 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:22:16.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557729ab0640 con 0x557729ee66b0 2026-02-20T13:22:16.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.716+0000 7f9551c81640 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557729ee66b0 0x557729ee6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:16.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.717+0000 7f9551c81640 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557729ee66b0 0x557729ee6b50 crc :-1 s=READY pgs=163 gs=4 cs=0 l=0 c_cookie=10203990921922078488 s_cookie=15982540155875034609 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d9bdbae3079e718 server_cookie=ddcd6397b75905f1 in_seq=0 out_seq=0 2026-02-20T13:22:16.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.717+0000 7f9506ffd640 10 client.17205 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:16.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9506ffd640 1 -- 10.20.193.28:0/4141569638 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557729ab0640 con 0x557729ee66b0 2026-02-20T13:22:16.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9506ffd640 10 client.17205 handle_command_reply: tid=0 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 client.17205 shutdown 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 msgr2=0x557729ee41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ee41b0 secure :-1 s=READY pgs=716 gs=2 cs=0 l=1 c_cookie=9404470554644967800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954800ef90 tx=0x7f95480aa280 comp rx=0 tx=0).stop 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 shutdown_connections 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557729ee66b0 0x557729ee6b50 crc :-1 s=READY pgs=163 gs=4 cs=0 l=0 c_cookie=10203990921922078488 s_cookie=15982540155875034609 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557729f02700 0x557729ee41b0 unknown :-1 s=CLOSED pgs=716 gs=2 cs=0 l=1 c_cookie=9404470554644967800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9506ffd640 0 client.17205 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557729ee1de0 0x557729ee3ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 --2- 10.20.193.28:0/4141569638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557729ec14c0 0x557729ee34e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 >> 10.20.193.28:0/4141569638 conn(0x557729de01c0 msgr2=0x557729ed6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:16.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 shutdown_connections 2026-02-20T13:22:16.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 1 -- 10.20.193.28:0/4141569638 wait complete. 2026-02-20T13:22:16.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.722+0000 7f9556636e00 20 client.17205 trim_cache size 0 max 16384 2026-02-20T13:22:16.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:22:16.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:22:16.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:22:16.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:22:16.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 -- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95280b5760 msgr2=0x7f95280d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95280b5760 0x7f95280d5c10 secure :-1 s=READY pgs=373 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f953c002c60 tx=0x7f953c03a040 comp rx=0 tx=0).stop 2026-02-20T13:22:16.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 -- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 msgr2=0x7f954c0f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:16.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 0x7f954c0f8ab0 secure :-1 s=READY pgs=713 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954800e720 tx=0x7f954800ebf0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 -- 10.20.193.28:0/354347097 shutdown_connections 2026-02-20T13:22:16.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95280b5760 0x7f95280d5c10 unknown :-1 s=CLOSED pgs=373 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f954c1100b0 0x7f954c0f8ab0 unknown :-1 s=CLOSED pgs=713 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f954c10f2f0 0x7f954c171080 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 --2- 10.20.193.28:0/354347097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f954c10e940 0x7f954c0f8250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:16.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 -- 10.20.193.28:0/354347097 >> 10.20.193.28:0/354347097 conn(0x7f954c0ec320 msgr2=0x7f954c0ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:16.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 -- 10.20.193.28:0/354347097 shutdown_connections 2026-02-20T13:22:16.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:16.723+0000 7f9552c83640 1 -- 10.20.193.28:0/354347097 wait complete. 2026-02-20T13:22:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:16 trial028 ceph-mon[37442]: pgmap v329: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:16 trial127 ceph-mon[43817]: pgmap v329: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:16 trial034 ceph-mon[43332]: pgmap v329: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:18 trial028 ceph-mon[37442]: pgmap v330: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:22:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:18 trial127 ceph-mon[43817]: pgmap v330: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:22:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:18 trial034 ceph-mon[43332]: pgmap v330: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:22:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:20 trial028 ceph-mon[37442]: pgmap v331: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2026-02-20T13:22:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:20 trial127 ceph-mon[43817]: pgmap v331: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2026-02-20T13:22:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:20 trial034 ceph-mon[43332]: pgmap v331: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2026-02-20T13:22:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:22 trial028 ceph-mon[37442]: pgmap v332: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:22:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:22 trial127 ceph-mon[43817]: pgmap v332: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:22:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:22 trial034 ceph-mon[43332]: pgmap v332: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:22:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:24 trial028 ceph-mon[37442]: pgmap v333: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:22:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:24 trial127 ceph-mon[43817]: pgmap v333: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:22:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:24 trial034 ceph-mon[43332]: pgmap v333: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:22:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:26 trial028 ceph-mon[37442]: pgmap v334: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:26 trial127 ceph-mon[43817]: pgmap v334: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:26 trial034 ceph-mon[43332]: pgmap v334: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:28 trial028 ceph-mon[37442]: pgmap v335: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:22:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:28 trial127 ceph-mon[43817]: pgmap v335: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:22:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:28 trial034 ceph-mon[43332]: pgmap v335: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:22:29.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.797+0000 7f382750b640 1 -- 10.20.193.28:0/861021323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 msgr2=0x7f3820061980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.797+0000 7f382750b640 1 --2- 10.20.193.28:0/861021323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 0x7f3820061980 secure :-1 s=READY pgs=717 gs=2 cs=0 l=1 c_cookie=14619842968092762480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3814009950 tx=0x7f381402f190 comp rx=0 tx=0).stop 2026-02-20T13:22:29.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 -- 10.20.193.28:0/861021323 shutdown_connections 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 --2- 10.20.193.28:0/861021323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 0x7f3820061980 unknown :-1 s=CLOSED pgs=717 gs=2 cs=0 l=1 c_cookie=14619842968092762480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 --2- 10.20.193.28:0/861021323 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3820150e50 0x7f3820171290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 --2- 10.20.193.28:0/861021323 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3820062a40 0x7f3820060fd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 -- 10.20.193.28:0/861021323 >> 10.20.193.28:0/861021323 conn(0x7f38200ea4c0 msgr2=0x7f382010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 -- 10.20.193.28:0/861021323 shutdown_connections 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 -- 10.20.193.28:0/861021323 wait complete. 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 Processor -- start 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.798+0000 7f382750b640 1 -- start start 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f382750b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 0x7f3820165060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f382750b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3820062a40 0x7f38201656b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f382750b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3820150e50 0x7f38201662b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f382750b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38201669f0 con 0x7f3820061510 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f382750b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3820166b60 con 0x7f3820150e50 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f382750b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3820166d20 con 0x7f3820062a40 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 0x7f3820165060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 0x7f3820165060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41018/0 (socket says 10.20.193.28:41018) 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 -- 10.20.193.28:0/1463954542 learned_addr learned my addr 10.20.193.28:0/1463954542 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3825d08640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3820062a40 0x7f38201656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826d0a640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3820150e50 0x7f38201662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 -- 10.20.193.28:0/1463954542 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3820062a40 msgr2=0x7f38201656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3820062a40 0x7f38201656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 -- 10.20.193.28:0/1463954542 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3820150e50 msgr2=0x7f38201662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3820150e50 0x7f38201662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 -- 10.20.193.28:0/1463954542 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3814009570 con 0x7f3820061510 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f3826509640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 0x7f3820165060 secure :-1 s=READY pgs=718 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3810009480 tx=0x7f381000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f38077fe640 1 -- 10.20.193.28:0/1463954542 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f381000cd40 con 0x7f3820061510 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f38077fe640 1 -- 10.20.193.28:0/1463954542 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3810004d30 con 0x7f3820061510 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f38077fe640 1 -- 10.20.193.28:0/1463954542 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38100106b0 con 0x7f3820061510 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.799+0000 7f382750b640 1 -- 10.20.193.28:0/1463954542 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3820167000 con 0x7f3820061510 2026-02-20T13:22:29.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.800+0000 7f382750b640 1 -- 10.20.193.28:0/1463954542 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382014cb40 con 0x7f3820061510 2026-02-20T13:22:29.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.802+0000 7f38077fe640 1 -- 10.20.193.28:0/1463954542 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f381001f060 con 0x7f3820061510 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.804+0000 7f38077fe640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37fc0b5760 0x7f37fc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.804+0000 7f38077fe640 1 -- 10.20.193.28:0/1463954542 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3810014070 con 0x7f3820061510 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.804+0000 7f3825d08640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37fc0b5760 0x7f37fc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f3825d08640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37fc0b5760 0x7f37fc0d5c10 secure :-1 s=READY pgs=374 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38140098a0 tx=0x7f381403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f382ae58e00 1 Processor -- start 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f382ae58e00 1 -- start start 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe09c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 0x55f3fe0bd1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0ddae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f382ae58e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3fdf91fd0 con 0x55f3fe0bd700 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f382ae58e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3fdf8dd00 con 0x55f3fe07c4c0 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f382ae58e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3fdf87ca0 con 0x55f3fe09cde0 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f3826509640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe09c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f3826509640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe09c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52994/0 (socket says 10.20.193.28:52994) 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f3826509640 1 -- 10.20.193.28:0/2580280058 learned_addr learned my addr 10.20.193.28:0/2580280058 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f3826d0a640 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0ddae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.805+0000 7f3825d08640 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 0x55f3fe0bd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3826509640 1 -- 10.20.193.28:0/2580280058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 msgr2=0x55f3fe0bd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:29.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3826509640 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 0x55f3fe0bd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3826509640 1 -- 10.20.193.28:0/2580280058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 msgr2=0x55f3fe0ddae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3826509640 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0ddae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3826509640 1 -- 10.20.193.28:0/2580280058 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3fdf2a8b0 con 0x55f3fe07c4c0 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3826d0a640 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0ddae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3826509640 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe09c8a0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=18203612443363019384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3810005000 tx=0x7f3810009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca0391203888a78 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3804bfe640 1 -- 10.20.193.28:0/2580280058 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38100ac7b0 con 0x55f3fe07c4c0 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3804bfe640 1 -- 10.20.193.28:0/2580280058 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38100ad9b0 con 0x55f3fe07c4c0 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f3804bfe640 1 -- 10.20.193.28:0/2580280058 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38100b7c60 con 0x55f3fe07c4c0 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 -- 10.20.193.28:0/2580280058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 msgr2=0x55f3fe09c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe09c8a0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=18203612443363019384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3810005000 tx=0x7f3810009380 comp rx=0 tx=0).stop 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 -- 10.20.193.28:0/2580280058 shutdown_connections 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0ddae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 0x55f3fe0bd1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2580280058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe09c8a0 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=18203612443363019384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 -- 10.20.193.28:0/2580280058 >> 10.20.193.28:0/2580280058 conn(0x55f3fdf9b1c0 msgr2=0x55f3fe07ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 -- 10.20.193.28:0/2580280058 shutdown_connections 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.806+0000 7f382ae58e00 1 -- 10.20.193.28:0/2580280058 wait complete. 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f382ae58e00 1 -- start start 2026-02-20T13:22:29.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f382ae58e00 1 Processor -- start 2026-02-20T13:22:29.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 0x55f3fe095ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe0961f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe096c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f382ae58e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3fe0972b0 con 0x55f3fe0bd700 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f382ae58e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3fe097420 con 0x55f3fe09cde0 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f382ae58e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3fe0975e0 con 0x55f3fe07c4c0 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f3825d08640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe0961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f3826509640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 0x55f3fe095ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f3825d08640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe0961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:53008/0 (socket says 10.20.193.28:53008) 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f3825d08640 1 -- 10.20.193.28:0/2243856477 learned_addr learned my addr 10.20.193.28:0/2243856477 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.808+0000 7f3826d0a640 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe096c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f3825d08640 1 -- 10.20.193.28:0/2243856477 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 msgr2=0x55f3fe095ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f3825d08640 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 0x55f3fe095ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f3825d08640 1 -- 10.20.193.28:0/2243856477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 msgr2=0x55f3fe096c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f3825d08640 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe096c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f3825d08640 1 -- 10.20.193.28:0/2243856477 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3fdf33400 con 0x55f3fe09cde0 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f3825d08640 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe0961f0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=17063276194972341084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f381402f6a0 tx=0x7f3814009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecccef4b51b4935c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f37d3fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f37d3fff640 1 -- 10.20.193.28:0/2243856477 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3814038d50 con 0x55f3fe09cde0 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f37d3fff640 1 -- 10.20.193.28:0/2243856477 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f381403e040 con 0x55f3fe09cde0 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382014cb40 con 0x55f3fe09cde0 2026-02-20T13:22:29.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f37d3fff640 1 -- 10.20.193.28:0/2243856477 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3814050800 con 0x55f3fe09cde0 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f382ae58e00 10 client.27191 _ll_register_callbacks cb 0x55f3fdf12a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f37d3fff640 1 -- 10.20.193.28:0/2243856477 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3814044410 con 0x55f3fe09cde0 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.809+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3fdc27520 con 0x55f3fe09cde0 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f37d3fff640 1 -- 10.20.193.28:0/2243856477 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3814050990 con 0x55f3fe09cde0 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f382ae58e00 10 client.27191 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f3fdf0bda0 con 0x55f3fe09cde0 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f37d3fff640 1 -- 10.20.193.28:0/2243856477 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f381404f070 con 0x55f3fe09cde0 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f382ae58e00 10 client.27191 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f382ae58e00 10 client.27191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f382ae58e00 20 client.27191 populate_metadata read hostname 'trial028' 2026-02-20T13:22:29.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3fe09a2b0 0x55f3fe09a750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f382ae58e00 4 client.27191 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:29.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3fdfb9630 con 0x55f3fe09a2b0 2026-02-20T13:22:29.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.810+0000 7f3826509640 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3fe09a2b0 0x55f3fe09a750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.811+0000 7f3826509640 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3fe09a2b0 0x55f3fe09a750 crc :-1 s=READY pgs=164 gs=4 cs=0 l=0 c_cookie=3289933570357172930 s_cookie=4529000488502953219 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da83126c3c59ac2 server_cookie=3eda3df2d8ca0503 in_seq=0 out_seq=0 2026-02-20T13:22:29.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.811+0000 7f37d3fff640 10 client.27191 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:29.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.811+0000 7f37d3fff640 1 -- 10.20.193.28:0/2243856477 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f3fdfb9630 con 0x55f3fe09a2b0 2026-02-20T13:22:29.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.811+0000 7f37d3fff640 10 client.27191 handle_command_reply: tid=0 2026-02-20T13:22:29.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 client.27191 shutdown 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 msgr2=0x55f3fe0961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe0961f0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=17063276194972341084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f381402f6a0 tx=0x7f3814009310 comp rx=0 tx=0).stop 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 shutdown_connections 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3fe09a2b0 0x55f3fe09a750 crc :-1 s=READY pgs=164 gs=4 cs=0 l=0 c_cookie=3289933570357172930 s_cookie=4529000488502953219 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe096c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe0961f0 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=17063276194972341084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 --2- 10.20.193.28:0/2243856477 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 0x55f3fe095ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f37d3fff640 0 client.27191 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 >> 10.20.193.28:0/2243856477 conn(0x55f3fdf9b1c0 msgr2=0x55f3fe07d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:29.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 shutdown_connections 2026-02-20T13:22:29.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 1 -- 10.20.193.28:0/2243856477 wait complete. 2026-02-20T13:22:29.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.812+0000 7f382ae58e00 20 client.27191 trim_cache size 0 max 16384 2026-02-20T13:22:29.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.819+0000 7f382ae58e00 1 Processor -- start 2026-02-20T13:22:29.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f382ae58e00 1 -- start start 2026-02-20T13:22:29.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe087a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 0x55f3fe0bb5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0bbb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f382ae58e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3fdf858d0 con 0x55f3fe0bd700 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f382ae58e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3fdcc6f10 con 0x55f3fe07c4c0 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f382ae58e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3fe095450 con 0x55f3fe09cde0 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe087a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe087a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:53018/0 (socket says 10.20.193.28:53018) 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 -- 10.20.193.28:0/3617484858 learned_addr learned my addr 10.20.193.28:0/3617484858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826d0a640 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3825d08640 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 0x55f3fe0bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 -- 10.20.193.28:0/3617484858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 msgr2=0x55f3fe0bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:29.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 0x55f3fe0bb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 -- 10.20.193.28:0/3617484858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 msgr2=0x55f3fe0bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:29.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0bbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 -- 10.20.193.28:0/3617484858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3fe088200 con 0x55f3fe07c4c0 2026-02-20T13:22:29.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826d0a640 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0bbb00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:29.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f3826509640 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe087a30 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=16730387189006362170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38100a9580 tx=0x7f38100a9330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e82e4681cb78663a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:29.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.820+0000 7f37ee3ff640 1 -- 10.20.193.28:0/3617484858 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f381006bea0 con 0x55f3fe07c4c0 2026-02-20T13:22:29.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f37ee3ff640 1 -- 10.20.193.28:0/3617484858 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38100ac7b0 con 0x55f3fe07c4c0 2026-02-20T13:22:29.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f37ee3ff640 1 -- 10.20.193.28:0/3617484858 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38100b80f0 con 0x55f3fe07c4c0 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 -- 10.20.193.28:0/3617484858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 msgr2=0x55f3fe087a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe087a30 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=16730387189006362170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38100a9580 tx=0x7f38100a9330 comp rx=0 tx=0).stop 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 -- 10.20.193.28:0/3617484858 shutdown_connections 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe0bbb00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe09cde0 0x55f3fe0bb5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 --2- 10.20.193.28:0/3617484858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe07c4c0 0x55f3fe087a30 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=16730387189006362170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 -- 10.20.193.28:0/3617484858 >> 10.20.193.28:0/3617484858 conn(0x55f3fdf9b1c0 msgr2=0x55f3fe091eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 -- 10.20.193.28:0/3617484858 shutdown_connections 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 -- 10.20.193.28:0/3617484858 wait complete. 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.821+0000 7f382ae58e00 1 -- start start 2026-02-20T13:22:29.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f382ae58e00 1 Processor -- start 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 0x55f3fe079c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe09d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f382ae58e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe09d6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f382ae58e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3fdcc6f10 con 0x55f3fe0bd700 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f382ae58e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3fe09dd60 con 0x55f3fe09cde0 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f382ae58e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3fe09df20 con 0x55f3fe07c4c0 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3826509640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 0x55f3fe079c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3825d08640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe09d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3825d08640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe09d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:53022/0 (socket says 10.20.193.28:53022) 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3825d08640 1 -- 10.20.193.28:0/806394655 learned_addr learned my addr 10.20.193.28:0/806394655 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3826d0a640 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3825d08640 1 -- 10.20.193.28:0/806394655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 msgr2=0x55f3fe079c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3825d08640 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 0x55f3fe079c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3825d08640 1 -- 10.20.193.28:0/806394655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 msgr2=0x55f3fe09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3825d08640 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.822+0000 7f3825d08640 1 -- 10.20.193.28:0/806394655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3fdf2a8b0 con 0x55f3fe09cde0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f3825d08640 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe09d1b0 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=6508007645909225181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f381402f6a0 tx=0x7f3814038780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a51167919f20edd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f37d3fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f37d3fff640 1 -- 10.20.193.28:0/806394655 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3814042e40 con 0x55f3fe09cde0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f37d3fff640 1 -- 10.20.193.28:0/806394655 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f381403e040 con 0x55f3fe09cde0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c0089e0 con 0x55f3fe09cde0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f37d3fff640 1 -- 10.20.193.28:0/806394655 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3814042990 con 0x55f3fe09cde0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f382ae58e00 10 client.27197 _ll_register_callbacks cb 0x55f3fdf12a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3fe037ca0 con 0x55f3fe09cde0 2026-02-20T13:22:29.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f37d3fff640 1 -- 10.20.193.28:0/806394655 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3814038d40 con 0x55f3fe09cde0 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f37d3fff640 1 -- 10.20.193.28:0/806394655 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3814042b20 con 0x55f3fe09cde0 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f382ae58e00 10 client.27197 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.823+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f3fdf1d670 con 0x55f3fe09cde0 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f37d3fff640 1 -- 10.20.193.28:0/806394655 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f381404f040 con 0x55f3fe09cde0 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f382ae58e00 10 client.27197 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f382ae58e00 10 client.27197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f382ae58e00 20 client.27197 populate_metadata read hostname 'trial028' 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f382ae58e00 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3fe09fa00 0x55f3fe09fea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f382ae58e00 4 client.27197 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f3fdc6b640 con 0x55f3fe09fa00 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f3826509640 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3fe09fa00 0x55f3fe09fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f3826509640 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3fe09fa00 0x55f3fe09fea0 crc :-1 s=READY pgs=165 gs=4 cs=0 l=0 c_cookie=7653478235020775580 s_cookie=16251330690723445934 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a369de7a698d09c server_cookie=e1885328f3f97cae in_seq=0 out_seq=0 2026-02-20T13:22:29.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.824+0000 7f37d3fff640 10 client.27197 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f37d3fff640 1 -- 10.20.193.28:0/806394655 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f3fdc6b640 con 0x55f3fe09fa00 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f37d3fff640 10 client.27197 handle_command_reply: tid=0 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 client.27197 shutdown 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 msgr2=0x55f3fe09d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe09d1b0 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=6508007645909225181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f381402f6a0 tx=0x7f3814038780 comp rx=0 tx=0).stop 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 shutdown_connections 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3fe09fa00 0x55f3fe09fea0 crc :-1 s=READY pgs=165 gs=4 cs=0 l=0 c_cookie=7653478235020775580 s_cookie=16251330690723445934 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3fe0bd700 0x55f3fe09d6f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3fe09cde0 0x55f3fe09d1b0 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=6508007645909225181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 --2- 10.20.193.28:0/806394655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3fe07c4c0 0x55f3fe079c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f37d3fff640 0 client.27197 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:29.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 >> 10.20.193.28:0/806394655 conn(0x55f3fdf9b1c0 msgr2=0x55f3fe096100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:29.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 shutdown_connections 2026-02-20T13:22:29.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.829+0000 7f382ae58e00 1 -- 10.20.193.28:0/806394655 wait complete. 2026-02-20T13:22:29.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382ae58e00 20 client.27197 trim_cache size 0 max 16384 2026-02-20T13:22:29.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:22:29.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:22:29.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:22:29.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 -- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37fc0b5760 msgr2=0x7f37fc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37fc0b5760 0x7f37fc0d5c10 secure :-1 s=READY pgs=374 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38140098a0 tx=0x7f381403a040 comp rx=0 tx=0).stop 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 -- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 msgr2=0x7f3820165060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 0x7f3820165060 secure :-1 s=READY pgs=718 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3810009480 tx=0x7f381000ee60 comp rx=0 tx=0).stop 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 -- 10.20.193.28:0/1463954542 shutdown_connections 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f37fc0b5760 0x7f37fc0d5c10 unknown :-1 s=CLOSED pgs=374 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3820150e50 0x7f38201662b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3820062a40 0x7f38201656b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 --2- 10.20.193.28:0/1463954542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3820061510 0x7f3820165060 unknown :-1 s=CLOSED pgs=718 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:29.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 -- 10.20.193.28:0/1463954542 >> 10.20.193.28:0/1463954542 conn(0x7f38200ea4c0 msgr2=0x7f382010a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:29.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 -- 10.20.193.28:0/1463954542 shutdown_connections 2026-02-20T13:22:29.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:29.830+0000 7f382750b640 1 -- 10.20.193.28:0/1463954542 wait complete. 2026-02-20T13:22:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:30 trial127 ceph-mon[43817]: pgmap v336: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:30 trial034 ceph-mon[43332]: pgmap v336: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:31.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:30 trial028 ceph-mon[37442]: pgmap v336: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:31.612 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:22:31.798 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:31.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 -- 10.20.193.28:0/1669138931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 msgr2=0x7f14ec115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:31.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 --2- 10.20.193.28:0/1669138931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 0x7f14ec115030 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=4564916323323845604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14d4009890 tx=0x7f14d402f0e0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 -- 10.20.193.28:0/1669138931 shutdown_connections 2026-02-20T13:22:31.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 --2- 10.20.193.28:0/1669138931 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec1157e0 0x7f14ec1761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 --2- 10.20.193.28:0/1669138931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 0x7f14ec115030 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=4564916323323845604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 --2- 10.20.193.28:0/1669138931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec10f5f0 0x7f14ec10f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 -- 10.20.193.28:0/1669138931 >> 10.20.193.28:0/1669138931 conn(0x7f14ec0ecea0 msgr2=0x7f14ec10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:31.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 -- 10.20.193.28:0/1669138931 shutdown_connections 2026-02-20T13:22:31.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.982+0000 7f14f11ce640 1 -- 10.20.193.28:0/1669138931 wait complete. 2026-02-20T13:22:31.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14f11ce640 1 Processor -- start 2026-02-20T13:22:31.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14f11ce640 1 -- start start 2026-02-20T13:22:31.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14f11ce640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f5f0 0x7f14ec0f4f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:31.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14f11ce640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 0x7f14ec1760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:31.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14f11ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec1157e0 0x7f14ec0f5650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:31.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14f11ce640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0fa810 con 0x7f14ec1157e0 2026-02-20T13:22:31.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14f11ce640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0fa980 con 0x7f14ec10f5f0 2026-02-20T13:22:31.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14f11ce640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0fab40 con 0x7f14ec10ffe0 2026-02-20T13:22:31.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14ea575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 0x7f14ec1760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:31.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14eb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec1157e0 0x7f14ec0f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14ead76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f5f0 0x7f14ec0f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14ea575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 0x7f14ec1760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54224/0 (socket says 10.20.193.28:54224) 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14ea575640 1 -- 10.20.193.28:0/2652824550 learned_addr learned my addr 10.20.193.28:0/2652824550 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14eb577640 1 -- 10.20.193.28:0/2652824550 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 msgr2=0x7f14ec1760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14eb577640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 0x7f14ec1760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14eb577640 1 -- 10.20.193.28:0/2652824550 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f5f0 msgr2=0x7f14ec0f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14eb577640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f5f0 0x7f14ec0f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.983+0000 7f14eb577640 1 -- 10.20.193.28:0/2652824550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e0009570 con 0x7f14ec1157e0 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.984+0000 7f14eb577640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec1157e0 0x7f14ec0f5650 secure :-1 s=READY pgs=719 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc00f940 tx=0x7f14dc00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.984+0000 7f14cbfff640 1 -- 10.20.193.28:0/2652824550 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14dc00dce0 con 0x7f14ec1157e0 2026-02-20T13:22:31.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.984+0000 7f14cbfff640 1 -- 10.20.193.28:0/2652824550 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14dc00de40 con 0x7f14ec1157e0 2026-02-20T13:22:31.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.984+0000 7f14cbfff640 1 -- 10.20.193.28:0/2652824550 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14dc0116b0 con 0x7f14ec1157e0 2026-02-20T13:22:31.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.984+0000 7f14f11ce640 1 -- 10.20.193.28:0/2652824550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d40094b0 con 0x7f14ec1157e0 2026-02-20T13:22:31.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.984+0000 7f14f11ce640 1 -- 10.20.193.28:0/2652824550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec0fb110 con 0x7f14ec1157e0 2026-02-20T13:22:31.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.987+0000 7f14cbfff640 1 -- 10.20.193.28:0/2652824550 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f14dc020060 con 0x7f14ec1157e0 2026-02-20T13:22:31.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14cbfff640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c00b5750 0x7f14c00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:31.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14cbfff640 1 -- 10.20.193.28:0/2652824550 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f14dc015070 con 0x7f14ec1157e0 2026-02-20T13:22:31.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14ead76640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c00b5750 0x7f14c00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:31.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14f31c8e00 1 Processor -- start 2026-02-20T13:22:31.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14f31c8e00 1 -- start start 2026-02-20T13:22:31.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7d2f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:31.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f817e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:31.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 0x55e51f838730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:31.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e51f6e07d0 con 0x55e51f7d2b90 2026-02-20T13:22:31.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e51f6dc500 con 0x55e51f7d34a0 2026-02-20T13:22:31.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.989+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e51f6d64a0 con 0x55e51f818350 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f817e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f817e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50416/0 (socket says 10.20.193.28:50416) 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 -- 10.20.193.28:0/764250784 learned_addr learned my addr 10.20.193.28:0/764250784 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14eb577640 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 0x55e51f838730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ead76640 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 -- 10.20.193.28:0/764250784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 msgr2=0x55e51f838730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 0x55e51f838730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 -- 10.20.193.28:0/764250784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 msgr2=0x55e51f7d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 -- 10.20.193.28:0/764250784 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51f681d80 con 0x55e51f7d34a0 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ead76640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c00b5750 0x7f14c00d5c00 secure :-1 s=READY pgs=375 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e00046d0 tx=0x7f14e0002a70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:31.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.990+0000 7f14ea575640 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f817e10 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=13926296538341573124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14d4038580 tx=0x7f14d4005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c14424eabc9a0204 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14b77fe640 1 -- 10.20.193.28:0/764250784 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14d403d050 con 0x55e51f7d34a0 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14b77fe640 1 -- 10.20.193.28:0/764250784 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14d403e040 con 0x55e51f7d34a0 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14b77fe640 1 -- 10.20.193.28:0/764250784 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14d40046b0 con 0x55e51f7d34a0 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 -- 10.20.193.28:0/764250784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 msgr2=0x55e51f817e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f817e10 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=13926296538341573124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14d4038580 tx=0x7f14d4005900 comp rx=0 tx=0).stop 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 -- 10.20.193.28:0/764250784 shutdown_connections 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 0x55e51f838730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f817e10 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=13926296538341573124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/764250784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7d2f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 -- 10.20.193.28:0/764250784 >> 10.20.193.28:0/764250784 conn(0x55e51f7b1090 msgr2=0x55e51f7d1470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 -- 10.20.193.28:0/764250784 shutdown_connections 2026-02-20T13:22:31.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.991+0000 7f14f31c8e00 1 -- 10.20.193.28:0/764250784 wait complete. 2026-02-20T13:22:32.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.992+0000 7f14f31c8e00 1 -- start start 2026-02-20T13:22:32.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.992+0000 7f14f31c8e00 1 Processor -- start 2026-02-20T13:22:32.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7eb060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f7eb5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 0x55e51f7f0590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e51f7f0ad0 con 0x55e51f7d2b90 2026-02-20T13:22:32.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e51f7f0c40 con 0x55e51f7d34a0 2026-02-20T13:22:32.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e51f7f0e00 con 0x55e51f818350 2026-02-20T13:22:32.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ea575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f7eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7eb060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40794/0 (socket says 10.20.193.28:40794) 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 -- 10.20.193.28:0/2944019910 learned_addr learned my addr 10.20.193.28:0/2944019910 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14eb577640 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 0x55e51f7f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 -- 10.20.193.28:0/2944019910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 msgr2=0x55e51f7f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 0x55e51f7f0590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 -- 10.20.193.28:0/2944019910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 msgr2=0x55e51f7eb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f7eb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 -- 10.20.193.28:0/2944019910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51f65a350 con 0x55e51f7d2b90 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ea575640 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f7eb5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14ead76640 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7eb060 secure :-1 s=READY pgs=720 gs=1 cs=0 l=1 c_cookie=7772919762073429770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e00041f0 tx=0x7f14e00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdef5574600270a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14b4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14b4ff9640 1 -- 10.20.193.28:0/2944019910 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14e001dc70 con 0x55e51f7d2b90 2026-02-20T13:22:32.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14b4ff9640 1 -- 10.20.193.28:0/2944019910 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14e001ddd0 con 0x55e51f7d2b90 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14b4ff9640 1 -- 10.20.193.28:0/2944019910 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14e0020440 con 0x55e51f7d2b90 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.993+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec176a20 con 0x55e51f7d2b90 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14b4ff9640 1 -- 10.20.193.28:0/2944019910 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f14e00205d0 con 0x55e51f7d2b90 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14b4ff9640 10 client.17235 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 10 client.17235 _ll_register_callbacks cb 0x55e51f6579a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e51f36c6f0 con 0x55e51f7d2b90 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14b4ff9640 1 -- 10.20.193.28:0/2944019910 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f14e0005000 con 0x55e51f7d2b90 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 10 client.17235 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e51f66c150 con 0x55e51f7d2b90 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14b4ff9640 1 -- 10.20.193.28:0/2944019910 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f14e0004850 con 0x55e51f7d2b90 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 10 client.17235 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:32.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 20 client.17235 populate_metadata read hostname 'trial028' 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e51f815910 0x55e51f815db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 4 client.17235 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.994+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e51f6e3d60 con 0x55e51f815910 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.995+0000 7f14ea575640 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e51f815910 0x55e51f815db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.995+0000 7f14ea575640 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e51f815910 0x55e51f815db0 crc :-1 s=READY pgs=166 gs=4 cs=0 l=0 c_cookie=7264632879202789642 s_cookie=1632032676640688059 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d1291d2c81690a server_cookie=16a6251290ff87bb in_seq=0 out_seq=0 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.995+0000 7f14b4ff9640 10 client.17235 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14b4ff9640 1 -- 10.20.193.28:0/2944019910 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e51f6e3d60 con 0x55e51f815910 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14b4ff9640 10 client.17235 handle_command_reply: tid=0 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 client.17235 shutdown 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 msgr2=0x55e51f7eb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7eb060 secure :-1 s=READY pgs=720 gs=1 cs=0 l=1 c_cookie=7772919762073429770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e00041f0 tx=0x7f14e00047e0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 shutdown_connections 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e51f815910 0x55e51f815db0 crc :-1 s=READY pgs=166 gs=4 cs=0 l=0 c_cookie=7264632879202789642 s_cookie=1632032676640688059 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f818350 0x55e51f7f0590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d34a0 0x55e51f7eb5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2944019910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f7d2b90 0x55e51f7eb060 unknown :-1 s=CLOSED pgs=720 gs=1 cs=0 l=1 c_cookie=7772919762073429770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14b4ff9640 0 client.17235 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 >> 10.20.193.28:0/2944019910 conn(0x55e51f7b1090 msgr2=0x55e51f7d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 shutdown_connections 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2944019910 wait complete. 2026-02-20T13:22:32.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:31.996+0000 7f14f31c8e00 20 client.17235 trim_cache size 0 max 16384 2026-02-20T13:22:32.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14f31c8e00 1 Processor -- start 2026-02-20T13:22:32.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14f31c8e00 1 -- start start 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 0x55e51f7d5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7efb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f8109c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e51f6d40d0 con 0x55e51f818350 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e51f394700 con 0x55e51f7d2b90 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e51f7e2ee0 con 0x55e51f7d34a0 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14ead76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 0x55e51f7d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14eb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f8109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14eb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f8109c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40808/0 (socket says 10.20.193.28:40808) 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14eb577640 1 -- 10.20.193.28:0/2957786690 learned_addr learned my addr 10.20.193.28:0/2957786690 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:32.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14ea575640 1 --2- 10.20.193.28:0/2957786690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14eb577640 1 -- 10.20.193.28:0/2957786690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 msgr2=0x55e51f7efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14eb577640 1 --2- 10.20.193.28:0/2957786690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7efb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14eb577640 1 -- 10.20.193.28:0/2957786690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 msgr2=0x55e51f7d5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14eb577640 1 --2- 10.20.193.28:0/2957786690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 0x55e51f7d5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.006+0000 7f14eb577640 1 -- 10.20.193.28:0/2957786690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51f666bd0 con 0x55e51f818350 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14eb577640 1 --2- 10.20.193.28:0/2957786690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f8109c0 secure :-1 s=READY pgs=721 gs=2 cs=0 l=1 c_cookie=4277823569833584973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc0064a0 tx=0x7f14dc006590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5de1df33b9694d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14b6ffd640 1 -- 10.20.193.28:0/2957786690 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14dc0b3ba0 con 0x55e51f818350 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14b6ffd640 1 -- 10.20.193.28:0/2957786690 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14dc0b6180 con 0x55e51f818350 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14b6ffd640 1 -- 10.20.193.28:0/2957786690 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14dc0adca0 con 0x55e51f818350 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2957786690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 msgr2=0x55e51f8109c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2957786690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f8109c0 secure :-1 s=READY pgs=721 gs=2 cs=0 l=1 c_cookie=4277823569833584973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc0064a0 tx=0x7f14dc006590 comp rx=0 tx=0).stop 2026-02-20T13:22:32.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2957786690 shutdown_connections 2026-02-20T13:22:32.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2957786690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f8109c0 unknown :-1 s=CLOSED pgs=721 gs=2 cs=0 l=1 c_cookie=4277823569833584973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2957786690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7efb00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/2957786690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 0x55e51f7d5dc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2957786690 >> 10.20.193.28:0/2957786690 conn(0x55e51f7b1090 msgr2=0x55e51f7ef3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:32.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2957786690 shutdown_connections 2026-02-20T13:22:32.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.007+0000 7f14f31c8e00 1 -- 10.20.193.28:0/2957786690 wait complete. 2026-02-20T13:22:32.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14f31c8e00 1 -- start start 2026-02-20T13:22:32.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14f31c8e00 1 Processor -- start 2026-02-20T13:22:32.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 0x55e51f7f6e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7f7370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14f31c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f7f1580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e51f7f1c80 con 0x55e51f818350 2026-02-20T13:22:32.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e51f7f1df0 con 0x55e51f7d2b90 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14f31c8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e51f7f1fb0 con 0x55e51f7d34a0 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14eb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f7f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14ea575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14ead76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 0x55e51f7f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14ea575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54256/0 (socket says 10.20.193.28:54256) 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.008+0000 7f14ea575640 1 -- 10.20.193.28:0/3395764394 learned_addr learned my addr 10.20.193.28:0/3395764394 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14ea575640 1 -- 10.20.193.28:0/3395764394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 msgr2=0x55e51f7f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14ea575640 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 0x55e51f7f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14ea575640 1 -- 10.20.193.28:0/3395764394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 msgr2=0x55e51f7f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14ea575640 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f7f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14ea575640 1 -- 10.20.193.28:0/3395764394 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51f65a680 con 0x55e51f7d34a0 2026-02-20T13:22:32.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14ea575640 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7f7370 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=3147204342230714742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14d4005c70 tx=0x7f14d4004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bad1dacb63a8976 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14b4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14b4ff9640 1 -- 10.20.193.28:0/3395764394 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14d4050070 con 0x55e51f7d34a0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14b4ff9640 1 -- 10.20.193.28:0/3395764394 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f14d4004610 con 0x55e51f7d34a0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14b4ff9640 1 -- 10.20.193.28:0/3395764394 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14d403d040 con 0x55e51f7d34a0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec0fb110 con 0x55e51f7d34a0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14b4ff9640 1 -- 10.20.193.28:0/3395764394 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f14d4054400 con 0x55e51f7d34a0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14f31c8e00 10 client.27133 _ll_register_callbacks cb 0x55e51f6579a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.009+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14d403e040 con 0x55e51f7d34a0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14b4ff9640 1 -- 10.20.193.28:0/3395764394 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f14d402fbf0 con 0x55e51f7d34a0 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14f31c8e00 10 client.27133 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:32.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e51f66c3b0 con 0x55e51f7d34a0 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14b4ff9640 1 -- 10.20.193.28:0/3395764394 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f14d4066070 con 0x55e51f7d34a0 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14f31c8e00 10 client.27133 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14f31c8e00 10 client.27133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14f31c8e00 20 client.27133 populate_metadata read hostname 'trial028' 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e51f8c60a0 0x55e51f8e6520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14f31c8e00 4 client.27133 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e51f369f40 con 0x55e51f8c60a0 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.010+0000 7f14ead76640 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e51f8c60a0 0x55e51f8e6520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14ead76640 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e51f8c60a0 0x55e51f8e6520 crc :-1 s=READY pgs=167 gs=4 cs=0 l=0 c_cookie=16762647230725872433 s_cookie=14226955891866952178 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a0e2d81299db31 server_cookie=c5704d0189e161f2 in_seq=0 out_seq=0 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14b4ff9640 10 client.27133 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14b4ff9640 1 -- 10.20.193.28:0/3395764394 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55e51f369f40 con 0x55e51f8c60a0 2026-02-20T13:22:32.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14b4ff9640 10 client.27133 handle_command_reply: tid=0 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 client.27133 shutdown 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 msgr2=0x55e51f7f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7f7370 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=3147204342230714742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14d4005c70 tx=0x7f14d4004040 comp rx=0 tx=0).stop 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 shutdown_connections 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e51f8c60a0 0x55e51f8e6520 crc :-1 s=READY pgs=167 gs=4 cs=0 l=0 c_cookie=16762647230725872433 s_cookie=14226955891866952178 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e51f818350 0x55e51f7f1580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14b4ff9640 0 client.27133 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e51f7d34a0 0x55e51f7f7370 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=3147204342230714742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 --2- 10.20.193.28:0/3395764394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e51f7d2b90 0x55e51f7f6e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 >> 10.20.193.28:0/3395764394 conn(0x55e51f7b1090 msgr2=0x55e51f7efbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 shutdown_connections 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 1 -- 10.20.193.28:0/3395764394 wait complete. 2026-02-20T13:22:32.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.011+0000 7f14f31c8e00 20 client.27133 trim_cache size 0 max 16384 2026-02-20T13:22:32.021 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:22:32.021 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:22:32.021 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:22:32.021 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:22:32.021 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:22:32.021 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:22:32.021 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.022 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:22:32.023 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.024 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.025 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:22:32.027 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:22:32.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.012+0000 7f14f11ce640 1 -- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c00b5750 msgr2=0x7f14c00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.012+0000 7f14f11ce640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c00b5750 0x7f14c00d5c00 secure :-1 s=READY pgs=375 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14e00046d0 tx=0x7f14e0002a70 comp rx=0 tx=0).stop 2026-02-20T13:22:32.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.012+0000 7f14f11ce640 1 -- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec1157e0 msgr2=0x7f14ec0f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.012+0000 7f14f11ce640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec1157e0 0x7f14ec0f5650 secure :-1 s=READY pgs=719 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14dc00f940 tx=0x7f14dc00fe10 comp rx=0 tx=0).stop 2026-02-20T13:22:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.013+0000 7f14f11ce640 1 -- 10.20.193.28:0/2652824550 shutdown_connections 2026-02-20T13:22:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.013+0000 7f14f11ce640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f14c00b5750 0x7f14c00d5c00 unknown :-1 s=CLOSED pgs=375 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.013+0000 7f14f11ce640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f14ec1157e0 0x7f14ec0f5650 unknown :-1 s=CLOSED pgs=719 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.013+0000 7f14f11ce640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f14ec10ffe0 0x7f14ec1760b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.013+0000 7f14f11ce640 1 --2- 10.20.193.28:0/2652824550 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f14ec10f5f0 0x7f14ec0f4f50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.013+0000 7f14f11ce640 1 -- 10.20.193.28:0/2652824550 >> 10.20.193.28:0/2652824550 conn(0x7f14ec0ecea0 msgr2=0x7f14ec114030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.013+0000 7f14f11ce640 1 -- 10.20.193.28:0/2652824550 shutdown_connections 2026-02-20T13:22:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.013+0000 7f14f11ce640 1 -- 10.20.193.28:0/2652824550 wait complete. 2026-02-20T13:22:32.114 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:22:32.115 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:22:32.303 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 -- 10.20.193.28:0/2382847641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f010f230 msgr2=0x7f97f010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 --2- 10.20.193.28:0/2382847641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f010f230 0x7f97f010f600 secure :-1 s=READY pgs=722 gs=1 cs=0 l=1 c_cookie=11398964198966411938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e0009950 tx=0x7f97e002f190 comp rx=0 tx=0).stop 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 -- 10.20.193.28:0/2382847641 shutdown_connections 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 --2- 10.20.193.28:0/2382847641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97f0115420 0x7f97f0175df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 --2- 10.20.193.28:0/2382847641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97f010fc20 0x7f97f0114c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 --2- 10.20.193.28:0/2382847641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f010f230 0x7f97f010f600 unknown :-1 s=CLOSED pgs=722 gs=1 cs=0 l=1 c_cookie=11398964198966411938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 -- 10.20.193.28:0/2382847641 >> 10.20.193.28:0/2382847641 conn(0x7f97f005f830 msgr2=0x7f97f010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 -- 10.20.193.28:0/2382847641 shutdown_connections 2026-02-20T13:22:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.473+0000 7f97f85a1640 1 -- 10.20.193.28:0/2382847641 wait complete. 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.474+0000 7f97f85a1640 1 Processor -- start 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.474+0000 7f97f85a1640 1 -- start start 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.474+0000 7f97f85a1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97f010f230 0x7f97f00f9a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.474+0000 7f97f85a1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97f010fc20 0x7f97f0175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.474+0000 7f97f85a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f0115420 0x7f97f00fa120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.474+0000 7f97f85a1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f97f00ff330 con 0x7f97f0115420 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.474+0000 7f97f85a1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f97f00ff4a0 con 0x7f97f010fc20 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.474+0000 7f97f85a1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f97f00ff660 con 0x7f97f010f230 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f0115420 0x7f97f00fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f0115420 0x7f97f00fa120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40832/0 (socket says 10.20.193.28:40832) 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 -- 10.20.193.28:0/2165241682 learned_addr learned my addr 10.20.193.28:0/2165241682 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f5b15640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97f010fc20 0x7f97f0175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6316640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97f010f230 0x7f97f00f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 -- 10.20.193.28:0/2165241682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97f010f230 msgr2=0x7f97f00f9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97f010f230 0x7f97f00f9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 -- 10.20.193.28:0/2165241682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97f010fc20 msgr2=0x7f97f0175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97f010fc20 0x7f97f0175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 -- 10.20.193.28:0/2165241682 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e0009570 con 0x7f97f0115420 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6316640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97f010f230 0x7f97f00f9a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f6b17640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f0115420 0x7f97f00fa120 secure :-1 s=READY pgs=723 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97ec00f8d0 tx=0x7f97ec00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97d77fe640 1 -- 10.20.193.28:0/2165241682 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97ec00dce0 con 0x7f97f0115420 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97d77fe640 1 -- 10.20.193.28:0/2165241682 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97ec00de40 con 0x7f97f0115420 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97d77fe640 1 -- 10.20.193.28:0/2165241682 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97ec0116b0 con 0x7f97f0115420 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f85a1640 1 -- 10.20.193.28:0/2165241682 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f00ff940 con 0x7f97f0115420 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.475+0000 7f97f85a1640 1 -- 10.20.193.28:0/2165241682 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f00ffdc0 con 0x7f97f0115420 2026-02-20T13:22:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.476+0000 7f97d57fa640 1 -- 10.20.193.28:0/2165241682 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f0110510 con 0x7f97f0115420 2026-02-20T13:22:32.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.478+0000 7f97d77fe640 1 -- 10.20.193.28:0/2165241682 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f97ec020060 con 0x7f97f0115420 2026-02-20T13:22:32.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.480+0000 7f97d77fe640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97cc0b5750 0x7f97cc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:32.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.480+0000 7f97d77fe640 1 -- 10.20.193.28:0/2165241682 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97ec015070 con 0x7f97f0115420 2026-02-20T13:22:32.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.480+0000 7f97f6316640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97cc0b5750 0x7f97cc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:32.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.480+0000 7f97d77fe640 1 -- 10.20.193.28:0/2165241682 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f97ec0e80d0 con 0x7f97f0115420 2026-02-20T13:22:32.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.480+0000 7f97f6316640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97cc0b5750 0x7f97cc0d5c00 secure :-1 s=READY pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e00023d0 tx=0x7f97e0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.622+0000 7f97d57fa640 1 -- 10.20.193.28:0/2165241682 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97f0100040 con 0x7f97f0115420 2026-02-20T13:22:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.623+0000 7f97d77fe640 1 -- 10.20.193.28:0/2165241682 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f97ec0aa7c0 con 0x7f97f0115420 2026-02-20T13:22:32.626 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:22:32.626 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:22:32.627 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:22:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 -- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97cc0b5750 msgr2=0x7f97cc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97cc0b5750 0x7f97cc0d5c00 secure :-1 s=READY pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e00023d0 tx=0x7f97e0031040 comp rx=0 tx=0).stop 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 -- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f0115420 msgr2=0x7f97f00fa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f0115420 0x7f97f00fa120 secure :-1 s=READY pgs=723 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97ec00f8d0 tx=0x7f97ec00fda0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 -- 10.20.193.28:0/2165241682 shutdown_connections 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97cc0b5750 0x7f97cc0d5c00 unknown :-1 s=CLOSED pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97f0115420 0x7f97f00fa120 unknown :-1 s=CLOSED pgs=723 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f97f010fc20 0x7f97f0175cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 --2- 10.20.193.28:0/2165241682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f97f010f230 0x7f97f00f9a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 -- 10.20.193.28:0/2165241682 >> 10.20.193.28:0/2165241682 conn(0x7f97f005f830 msgr2=0x7f97f01116d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 -- 10.20.193.28:0/2165241682 shutdown_connections 2026-02-20T13:22:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:32.624+0000 7f97d57fa640 1 -- 10.20.193.28:0/2165241682 wait complete. 2026-02-20T13:22:32.704 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:32 trial028 ceph-mon[37442]: pgmap v337: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-20T13:22:32.730 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:22:32.915 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:32 trial127 ceph-mon[43817]: pgmap v337: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-20T13:22:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:32 trial034 ceph-mon[43332]: pgmap v337: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-20T13:22:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.093+0000 7fef3bfff640 1 -- 10.20.193.28:0/2120183641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c062ae0 msgr2=0x7fef3c060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.093+0000 7fef3bfff640 1 --2- 10.20.193.28:0/2120183641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c062ae0 0x7fef3c060fb0 secure :-1 s=READY pgs=724 gs=1 cs=0 l=1 c_cookie=1265275202655845530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef30009950 tx=0x7fef3002f190 comp rx=0 tx=0).stop 2026-02-20T13:22:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.093+0000 7fef3bfff640 1 -- 10.20.193.28:0/2120183641 shutdown_connections 2026-02-20T13:22:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.093+0000 7fef3bfff640 1 --2- 10.20.193.28:0/2120183641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef3c159d80 0x7fef3c17a160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.093+0000 7fef3bfff640 1 --2- 10.20.193.28:0/2120183641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef3c0614f0 0x7fef3c061920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.093+0000 7fef3bfff640 1 --2- 10.20.193.28:0/2120183641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c062ae0 0x7fef3c060fb0 unknown :-1 s=CLOSED pgs=724 gs=1 cs=0 l=1 c_cookie=1265275202655845530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.093+0000 7fef3bfff640 1 -- 10.20.193.28:0/2120183641 >> 10.20.193.28:0/2120183641 conn(0x7fef3c0eab00 msgr2=0x7fef3c10af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.093+0000 7fef3bfff640 1 -- 10.20.193.28:0/2120183641 shutdown_connections 2026-02-20T13:22:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.094+0000 7fef3bfff640 1 -- 10.20.193.28:0/2120183641 wait complete. 2026-02-20T13:22:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.094+0000 7fef3bfff640 1 Processor -- start 2026-02-20T13:22:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.094+0000 7fef3bfff640 1 -- start start 2026-02-20T13:22:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef3c0614f0 0x7fef3c0f2e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef3c062ae0 0x7fef3c0f3390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c159d80 0x7fef3c0f8760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0f8d80 con 0x7fef3c159d80 2026-02-20T13:22:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3bfff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0f8ef0 con 0x7fef3c0614f0 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3bfff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0f90b0 con 0x7fef3c062ae0 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c159d80 0x7fef3c0f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c159d80 0x7fef3c0f8760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40854/0 (socket says 10.20.193.28:40854) 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 -- 10.20.193.28:0/4088009352 learned_addr learned my addr 10.20.193.28:0/4088009352 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3affd640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef3c0614f0 0x7fef3c0f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3a7fc640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef3c062ae0 0x7fef3c0f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 -- 10.20.193.28:0/4088009352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef3c062ae0 msgr2=0x7fef3c0f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef3c062ae0 0x7fef3c0f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 -- 10.20.193.28:0/4088009352 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef3c0614f0 msgr2=0x7fef3c0f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef3c0614f0 0x7fef3c0f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 -- 10.20.193.28:0/4088009352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef30009570 con 0x7fef3c159d80 2026-02-20T13:22:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c159d80 0x7fef3c0f8760 secure :-1 s=READY pgs=725 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef2c00f8d0 tx=0x7fef2c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef409c1640 1 -- 10.20.193.28:0/4088009352 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef2c00dce0 con 0x7fef3c159d80 2026-02-20T13:22:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef409c1640 1 -- 10.20.193.28:0/4088009352 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef2c00de40 con 0x7fef3c159d80 2026-02-20T13:22:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.095+0000 7fef409c1640 1 -- 10.20.193.28:0/4088009352 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef2c0116b0 con 0x7fef3c159d80 2026-02-20T13:22:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.096+0000 7fef3bfff640 1 -- 10.20.193.28:0/4088009352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c0f9390 con 0x7fef3c159d80 2026-02-20T13:22:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.096+0000 7fef3bfff640 1 -- 10.20.193.28:0/4088009352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c0f9a70 con 0x7fef3c159d80 2026-02-20T13:22:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.099+0000 7fef409c1640 1 -- 10.20.193.28:0/4088009352 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fef2c020060 con 0x7fef3c159d80 2026-02-20T13:22:33.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.100+0000 7fef409c1640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef100b5760 0x7fef100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.100+0000 7fef409c1640 1 -- 10.20.193.28:0/4088009352 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fef2c015070 con 0x7fef3c159d80 2026-02-20T13:22:33.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.100+0000 7fef3affd640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef100b5760 0x7fef100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef439bde00 1 Processor -- start 2026-02-20T13:22:33.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef3affd640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef100b5760 0x7fef100d5c10 secure :-1 s=READY pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef300098a0 tx=0x7fef3003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef439bde00 1 -- start start 2026-02-20T13:22:33.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef439bde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835afbc730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef439bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbcc70 0x55835b0015e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef439bde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 0x55835b021f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef439bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55835aed2780 con 0x55835afbcc70 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef439bde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55835aece4b0 con 0x55835afbc360 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef439bde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55835aec8450 con 0x55835b001b20 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef3affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835afbc730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef3affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835afbc730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50492/0 (socket says 10.20.193.28:50492) 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef3affd640 1 -- 10.20.193.28:0/1633938965 learned_addr learned my addr 10.20.193.28:0/1633938965 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.101+0000 7fef3a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbcc70 0x55835b0015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 0x55835b021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7fef3affd640 1 -- 10.20.193.28:0/1633938965 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 msgr2=0x55835b021f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7fef3affd640 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 0x55835b021f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7fef3affd640 1 -- 10.20.193.28:0/1633938965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbcc70 msgr2=0x55835b0015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7fef3affd640 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbcc70 0x55835b0015e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7fef3affd640 1 -- 10.20.193.28:0/1633938965 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835ae73d10 con 0x55835afbc360 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7fef3a7fc640 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbcc70 0x55835b0015e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7fef3affd640 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835afbc730 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=3223972396001597265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef30002d30 tx=0x7fef30040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cbdd9d015571751 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7feefffff640 1 -- 10.20.193.28:0/1633938965 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef30002980 con 0x55835afbc360 2026-02-20T13:22:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7feefffff640 1 -- 10.20.193.28:0/1633938965 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef3003e040 con 0x55835afbc360 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.102+0000 7feefffff640 1 -- 10.20.193.28:0/1633938965 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef3004f7e0 con 0x55835afbc360 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 -- 10.20.193.28:0/1633938965 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 msgr2=0x55835afbc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835afbc730 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=3223972396001597265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef30002d30 tx=0x7fef30040000 comp rx=0 tx=0).stop 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 -- 10.20.193.28:0/1633938965 shutdown_connections 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbcc70 0x55835b0015e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 0x55835b021f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 --2- 10.20.193.28:0/1633938965 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835afbc730 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=3223972396001597265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 -- 10.20.193.28:0/1633938965 >> 10.20.193.28:0/1633938965 conn(0x55835af9a860 msgr2=0x55835afbac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 -- 10.20.193.28:0/1633938965 shutdown_connections 2026-02-20T13:22:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.103+0000 7fef439bde00 1 -- 10.20.193.28:0/1633938965 wait complete. 2026-02-20T13:22:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.104+0000 7fef439bde00 1 -- start start 2026-02-20T13:22:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.104+0000 7fef439bde00 1 Processor -- start 2026-02-20T13:22:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef439bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbc360 0x55835b019700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef439bde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b019c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef439bde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 0x55835b01ec30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef439bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55835b01f170 con 0x55835afbc360 2026-02-20T13:22:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef439bde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55835b01f2e0 con 0x55835afbcc70 2026-02-20T13:22:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef439bde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55835b01f4a0 con 0x55835b001b20 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbc360 0x55835b019700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b019c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 0x55835b01ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b019c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50506/0 (socket says 10.20.193.28:50506) 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3a7fc640 1 -- 10.20.193.28:0/730657263 learned_addr learned my addr 10.20.193.28:0/730657263 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3affd640 1 -- 10.20.193.28:0/730657263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 msgr2=0x55835b01ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3affd640 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 0x55835b01ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3affd640 1 -- 10.20.193.28:0/730657263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 msgr2=0x55835b019c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3affd640 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b019c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3affd640 1 -- 10.20.193.28:0/730657263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c17adc0 con 0x55835afbc360 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7fef3affd640 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbc360 0x55835b019700 secure :-1 s=READY pgs=726 gs=1 cs=0 l=1 c_cookie=14355115059569068668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3002f6a0 tx=0x7fef30038e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7379d170b798a7c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.105+0000 7feefd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7feefd7fa640 1 -- 10.20.193.28:0/730657263 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef3004f770 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7feefd7fa640 1 -- 10.20.193.28:0/730657263 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef3002f9f0 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7feefd7fa640 1 -- 10.20.193.28:0/730657263 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef30044720 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef24009850 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7fef439bde00 10 client.17259 _ll_register_callbacks cb 0x55835ae49a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55835ab5e6f0 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7feefd7fa640 1 -- 10.20.193.28:0/730657263 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fef3002fb60 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7feefd7fa640 1 -- 10.20.193.28:0/730657263 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef3002fd20 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7fef439bde00 10 client.17259 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.106+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55835ae4c3c0 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7feefd7fa640 1 -- 10.20.193.28:0/730657263 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fef30062020 con 0x55835afbc360 2026-02-20T13:22:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7fef439bde00 10 client.17259 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7fef439bde00 10 client.17259 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7fef439bde00 20 client.17259 populate_metadata read hostname 'trial028' 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7fef439bde00 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55835affed00 0x55835afff1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7fef439bde00 4 client.17259 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55835ae6af80 con 0x55835affed00 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7fef3a7fc640 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55835affed00 0x55835afff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7fef3a7fc640 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55835affed00 0x55835afff1a0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=3828307621776353484 s_cookie=10510614350213406575 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3520e17faee668cc server_cookie=91dd34105b97df6f in_seq=0 out_seq=0 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.107+0000 7feefd7fa640 10 client.17259 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7feefd7fa640 1 -- 10.20.193.28:0/730657263 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55835ae6af80 con 0x55835affed00 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7feefd7fa640 10 client.17259 handle_command_reply: tid=0 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 client.17259 shutdown 2026-02-20T13:22:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbc360 msgr2=0x55835b019700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbc360 0x55835b019700 secure :-1 s=READY pgs=726 gs=1 cs=0 l=1 c_cookie=14355115059569068668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3002f6a0 tx=0x7fef30038e20 comp rx=0 tx=0).stop 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 shutdown_connections 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55835affed00 0x55835afff1a0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=3828307621776353484 s_cookie=10510614350213406575 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835b001b20 0x55835b01ec30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b019c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 --2- 10.20.193.28:0/730657263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835afbc360 0x55835b019700 unknown :-1 s=CLOSED pgs=726 gs=1 cs=0 l=1 c_cookie=14355115059569068668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7feefd7fa640 0 client.17259 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 >> 10.20.193.28:0/730657263 conn(0x55835af9a860 msgr2=0x55835afbac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 shutdown_connections 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 1 -- 10.20.193.28:0/730657263 wait complete. 2026-02-20T13:22:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.108+0000 7fef439bde00 20 client.17259 trim_cache size 0 max 16384 2026-02-20T13:22:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.115+0000 7fef439bde00 1 Processor -- start 2026-02-20T13:22:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.115+0000 7fef439bde00 1 -- start start 2026-02-20T13:22:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.115+0000 7fef439bde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbc360 0x55835b01e1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.115+0000 7fef439bde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b016920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.115+0000 7fef439bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835b016e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.115+0000 7fef439bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55835aec6080 con 0x55835affed00 2026-02-20T13:22:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.115+0000 7fef439bde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55835ab86700 con 0x55835afbcc70 2026-02-20T13:22:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.115+0000 7fef439bde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55835af2aae0 con 0x55835afbc360 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b016920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b016920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50514/0 (socket says 10.20.193.28:50514) 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3a7fc640 1 -- 10.20.193.28:0/144317159 learned_addr learned my addr 10.20.193.28:0/144317159 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3affd640 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbc360 0x55835b01e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835b016e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3affd640 1 -- 10.20.193.28:0/144317159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 msgr2=0x55835b016920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3affd640 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b016920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3affd640 1 -- 10.20.193.28:0/144317159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 msgr2=0x55835b016e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3affd640 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835b016e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3affd640 1 -- 10.20.193.28:0/144317159 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835ae5e0e0 con 0x55835afbc360 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3a7fc640 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b016920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.116+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835b016e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef3affd640 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbc360 0x55835b01e1a0 secure :-1 s=READY pgs=238 gs=2 cs=0 l=1 c_cookie=7603038624852805006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3002ff90 tx=0x7fef30050000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69836b58bfed058e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7feeff7fe640 1 -- 10.20.193.28:0/144317159 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef300373d0 con 0x55835afbc360 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7feeff7fe640 1 -- 10.20.193.28:0/144317159 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55835ab5e6f0 con 0x55835afbc360 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7feeff7fe640 1 -- 10.20.193.28:0/144317159 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef3004fb60 con 0x55835afbc360 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 -- 10.20.193.28:0/144317159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbc360 msgr2=0x55835b01e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbc360 0x55835b01e1a0 secure :-1 s=READY pgs=238 gs=2 cs=0 l=1 c_cookie=7603038624852805006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3002ff90 tx=0x7fef30050000 comp rx=0 tx=0).stop 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 -- 10.20.193.28:0/144317159 shutdown_connections 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835b016e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbcc70 0x55835b016920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 --2- 10.20.193.28:0/144317159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbc360 0x55835b01e1a0 unknown :-1 s=CLOSED pgs=238 gs=2 cs=0 l=1 c_cookie=7603038624852805006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 -- 10.20.193.28:0/144317159 >> 10.20.193.28:0/144317159 conn(0x55835af9a860 msgr2=0x55835b01da90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 -- 10.20.193.28:0/144317159 shutdown_connections 2026-02-20T13:22:33.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.117+0000 7fef439bde00 1 -- 10.20.193.28:0/144317159 wait complete. 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.118+0000 7fef439bde00 1 -- start start 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.118+0000 7fef439bde00 1 Processor -- start 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.118+0000 7fef439bde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835b016920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.118+0000 7fef439bde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbcc70 0x55835b016e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.118+0000 7fef439bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835af9ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.118+0000 7fef439bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55835aec6080 con 0x55835affed00 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.118+0000 7fef439bde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55835b017420 con 0x55835afbc360 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.118+0000 7fef439bde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55835b0175e0 con 0x55835afbcc70 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbcc70 0x55835b016e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbcc70 0x55835b016e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54312/0 (socket says 10.20.193.28:54312) 2026-02-20T13:22:33.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835af9ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3a7fc640 1 -- 10.20.193.28:0/398634580 learned_addr learned my addr 10.20.193.28:0/398634580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3affd640 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835b016920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3b7fe640 1 -- 10.20.193.28:0/398634580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbcc70 msgr2=0x55835b016e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbcc70 0x55835b016e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3b7fe640 1 -- 10.20.193.28:0/398634580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 msgr2=0x55835b016920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835b016920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3b7fe640 1 -- 10.20.193.28:0/398634580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c0f9a70 con 0x55835affed00 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3affd640 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835b016920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3a7fc640 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbcc70 0x55835b016e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef3b7fe640 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835af9ac30 secure :-1 s=READY pgs=727 gs=3 cs=0 l=1 c_cookie=14783723282519686475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef2c0ade90 tx=0x7fef2c006640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2a55ff7841fd4b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7feefd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:33.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7feefd7fa640 1 -- 10.20.193.28:0/398634580 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef2c073310 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7feefd7fa640 1 -- 10.20.193.28:0/398634580 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef2c0b61b0 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7feefd7fa640 1 -- 10.20.193.28:0/398634580 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef2c0aeb40 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef240042b0 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7feefd7fa640 1 -- 10.20.193.28:0/398634580 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fef2c0aeca0 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7feefd7fa640 10 client.17265 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef439bde00 10 client.17265 _ll_register_callbacks cb 0x55835ae49a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.119+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef3003e040 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7feefd7fa640 1 -- 10.20.193.28:0/398634580 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef2c0b8ff0 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef439bde00 10 client.17265 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55835ae4c3c0 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7feefd7fa640 1 -- 10.20.193.28:0/398634580 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fef2c0b3070 con 0x55835affed00 2026-02-20T13:22:33.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef439bde00 10 client.17265 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef439bde00 10 client.17265 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef439bde00 20 client.17265 populate_metadata read hostname 'trial028' 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef439bde00 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55835b001b20 0x55835b0cefc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef439bde00 4 client.17265 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55835ab5bf40 con 0x55835b001b20 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.120+0000 7fef3affd640 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55835b001b20 0x55835b0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef3affd640 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55835b001b20 0x55835b0cefc0 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=7660091917936288460 s_cookie=3171039069652443683 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a4e1d03b36ee2cc server_cookie=2c01cb3ba384e223 in_seq=0 out_seq=0 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7feefd7fa640 10 client.17265 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7feefd7fa640 1 -- 10.20.193.28:0/398634580 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55835ab5bf40 con 0x55835b001b20 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7feefd7fa640 10 client.17265 handle_command_reply: tid=0 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 client.17265 shutdown 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 msgr2=0x55835af9ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835af9ac30 secure :-1 s=READY pgs=727 gs=3 cs=0 l=1 c_cookie=14783723282519686475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef2c0ade90 tx=0x7fef2c006640 comp rx=0 tx=0).stop 2026-02-20T13:22:33.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 shutdown_connections 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55835b001b20 0x55835b0cefc0 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=7660091917936288460 s_cookie=3171039069652443683 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55835affed00 0x55835af9ac30 unknown :-1 s=CLOSED pgs=727 gs=3 cs=0 l=1 c_cookie=14783723282519686475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55835afbcc70 0x55835b016e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 --2- 10.20.193.28:0/398634580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55835afbc360 0x55835b016920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7feefd7fa640 0 client.17265 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 >> 10.20.193.28:0/398634580 conn(0x55835af9a860 msgr2=0x55835affbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 shutdown_connections 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 1 -- 10.20.193.28:0/398634580 wait complete. 2026-02-20T13:22:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.121+0000 7fef439bde00 20 client.17265 trim_cache size 0 max 16384 2026-02-20T13:22:33.132 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:22:33.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 -- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef100b5760 msgr2=0x7fef100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef100b5760 0x7fef100d5c10 secure :-1 s=READY pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef300098a0 tx=0x7fef3003a040 comp rx=0 tx=0).stop 2026-02-20T13:22:33.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 -- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c159d80 msgr2=0x7fef3c0f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c159d80 0x7fef3c0f8760 secure :-1 s=READY pgs=725 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef2c00f8d0 tx=0x7fef2c00fda0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 -- 10.20.193.28:0/4088009352 shutdown_connections 2026-02-20T13:22:33.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef100b5760 0x7fef100d5c10 unknown :-1 s=CLOSED pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef3c159d80 0x7fef3c0f8760 unknown :-1 s=CLOSED pgs=725 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef3c062ae0 0x7fef3c0f3390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 --2- 10.20.193.28:0/4088009352 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef3c0614f0 0x7fef3c0f2e50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 -- 10.20.193.28:0/4088009352 >> 10.20.193.28:0/4088009352 conn(0x7fef3c0eab00 msgr2=0x7fef3c10fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 -- 10.20.193.28:0/4088009352 shutdown_connections 2026-02-20T13:22:33.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.122+0000 7fef3bfff640 1 -- 10.20.193.28:0/4088009352 wait complete. 2026-02-20T13:22:33.222 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:22:33.408 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:33.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 -- 10.20.193.28:0/472142912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3948061840 msgr2=0x7f3948155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 --2- 10.20.193.28:0/472142912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3948061840 0x7f3948155520 secure :-1 s=READY pgs=728 gs=1 cs=0 l=1 c_cookie=2194948870048355255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3938009950 tx=0x7f393802f190 comp rx=0 tx=0).stop 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 -- 10.20.193.28:0/472142912 shutdown_connections 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 --2- 10.20.193.28:0/472142912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3948061840 0x7f3948155520 unknown :-1 s=CLOSED pgs=728 gs=1 cs=0 l=1 c_cookie=2194948870048355255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 --2- 10.20.193.28:0/472142912 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3948155a60 0x7f3948175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 --2- 10.20.193.28:0/472142912 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3948060f30 0x7f3948061300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 -- 10.20.193.28:0/472142912 >> 10.20.193.28:0/472142912 conn(0x7f39480eabb0 msgr2=0x7f394810afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 -- 10.20.193.28:0/472142912 shutdown_connections 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.585+0000 7f394dbdd640 1 -- 10.20.193.28:0/472142912 wait complete. 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f394dbdd640 1 Processor -- start 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f394dbdd640 1 -- start start 2026-02-20T13:22:33.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f394dbdd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3948060f30 0x7f3948161800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f394dbdd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3948061840 0x7f3948161d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f394dbdd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3948155a60 0x7f3948167110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f394dbdd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3948167730 con 0x7f3948061840 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f394dbdd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f39481678a0 con 0x7f3948060f30 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f394dbdd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3948167a60 con 0x7f3948155a60 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f39477fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3948060f30 0x7f3948161800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f3946ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3948061840 0x7f3948161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f39477fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3948060f30 0x7f3948161800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50538/0 (socket says 10.20.193.28:50538) 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f39477fe640 1 -- 10.20.193.28:0/1489008245 learned_addr learned my addr 10.20.193.28:0/1489008245 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f3947fff640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3948155a60 0x7f3948167110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f39477fe640 1 -- 10.20.193.28:0/1489008245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3948155a60 msgr2=0x7f3948167110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f39477fe640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3948155a60 0x7f3948167110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f39477fe640 1 -- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3948061840 msgr2=0x7f3948161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f39477fe640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3948061840 0x7f3948161d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.586+0000 7f39477fe640 1 -- 10.20.193.28:0/1489008245 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3938009570 con 0x7f3948060f30 2026-02-20T13:22:33.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.587+0000 7f39477fe640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3948060f30 0x7f3948161800 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39340072a0 tx=0x7f393400ddf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.587+0000 7f3944ff9640 1 -- 10.20.193.28:0/1489008245 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3934004500 con 0x7f3948060f30 2026-02-20T13:22:33.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.587+0000 7f3944ff9640 1 -- 10.20.193.28:0/1489008245 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f393400bd20 con 0x7f3948060f30 2026-02-20T13:22:33.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.587+0000 7f3944ff9640 1 -- 10.20.193.28:0/1489008245 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3934002ea0 con 0x7f3948060f30 2026-02-20T13:22:33.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.587+0000 7f394dbdd640 1 -- 10.20.193.28:0/1489008245 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3948167d40 con 0x7f3948060f30 2026-02-20T13:22:33.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.587+0000 7f394dbdd640 1 -- 10.20.193.28:0/1489008245 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3948151680 con 0x7f3948060f30 2026-02-20T13:22:33.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.590+0000 7f3944ff9640 1 -- 10.20.193.28:0/1489008245 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f393400b840 con 0x7f3948060f30 2026-02-20T13:22:33.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.591+0000 7f3944ff9640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f391c0b5760 0x7f391c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.591+0000 7f3944ff9640 1 -- 10.20.193.28:0/1489008245 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f39340e6ba0 con 0x7f3948060f30 2026-02-20T13:22:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f3946ffd640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f391c0b5760 0x7f391c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f3946ffd640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f391c0b5760 0x7f391c0d5c10 secure :-1 s=READY pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39481681a0 tx=0x7f393803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f394fbd7e00 1 Processor -- start 2026-02-20T13:22:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f394fbd7e00 1 -- start start 2026-02-20T13:22:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21360 0x55c294b21730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21c70 0x55c294b665e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b66b20 0x55c294b86f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c294a37780 con 0x55c294b66b20 2026-02-20T13:22:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c294a334b0 con 0x55c294b21360 2026-02-20T13:22:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.592+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c294a2d450 con 0x55c294b21c70 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f39477fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21360 0x55c294b21730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f39477fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21360 0x55c294b21730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50552/0 (socket says 10.20.193.28:50552) 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f39477fe640 1 -- 10.20.193.28:0/4072320926 learned_addr learned my addr 10.20.193.28:0/4072320926 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f3947fff640 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b66b20 0x55c294b86f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f3946ffd640 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21c70 0x55c294b665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f3947fff640 1 -- 10.20.193.28:0/4072320926 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21c70 msgr2=0x55c294b665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f3947fff640 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21c70 0x55c294b665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f3947fff640 1 -- 10.20.193.28:0/4072320926 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21360 msgr2=0x55c294b21730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f3947fff640 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21360 0x55c294b21730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f3947fff640 1 -- 10.20.193.28:0/4072320926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2949d8d10 con 0x55c294b66b20 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f39477fe640 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21360 0x55c294b21730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f3947fff640 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b66b20 0x55c294b86f00 secure :-1 s=READY pgs=729 gs=1 cs=0 l=1 c_cookie=10309123241135432790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f393c005540 tx=0x7f393c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f115cf7bd99e456 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f390bfff640 1 -- 10.20.193.28:0/4072320926 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393c00ac10 con 0x55c294b66b20 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f390bfff640 1 -- 10.20.193.28:0/4072320926 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f393c00ad70 con 0x55c294b66b20 2026-02-20T13:22:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.593+0000 7f390bfff640 1 -- 10.20.193.28:0/4072320926 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393c0128f0 con 0x55c294b66b20 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4072320926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b66b20 msgr2=0x55c294b86f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b66b20 0x55c294b86f00 secure :-1 s=READY pgs=729 gs=1 cs=0 l=1 c_cookie=10309123241135432790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f393c005540 tx=0x7f393c003c30 comp rx=0 tx=0).stop 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4072320926 shutdown_connections 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b66b20 0x55c294b86f00 unknown :-1 s=CLOSED pgs=729 gs=1 cs=0 l=1 c_cookie=10309123241135432790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21c70 0x55c294b665e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/4072320926 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21360 0x55c294b21730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4072320926 >> 10.20.193.28:0/4072320926 conn(0x55c294aff860 msgr2=0x55c294b1fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4072320926 shutdown_connections 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.594+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4072320926 wait complete. 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.595+0000 7f394fbd7e00 1 -- start start 2026-02-20T13:22:33.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.595+0000 7f394fbd7e00 1 Processor -- start 2026-02-20T13:22:33.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b7e730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 0x55c294b7ec70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 0x55c294b80a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c294b80f70 con 0x55c294b21360 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c294b810e0 con 0x55c294b21c70 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c294b812a0 con 0x55c294b66b20 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b7e730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f3946ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 0x55c294b7ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b7e730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40914/0 (socket says 10.20.193.28:40914) 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 -- 10.20.193.28:0/2849632403 learned_addr learned my addr 10.20.193.28:0/2849632403 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f3947fff640 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 0x55c294b80a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 -- 10.20.193.28:0/2849632403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 msgr2=0x55c294b80a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 0x55c294b80a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 -- 10.20.193.28:0/2849632403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 msgr2=0x55c294b7ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 0x55c294b7ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 -- 10.20.193.28:0/2849632403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393c0051e0 con 0x55c294b21360 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39477fe640 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b7e730 secure :-1 s=READY pgs=730 gs=1 cs=0 l=1 c_cookie=13732083046304198028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39340acee0 tx=0x7f39340a8e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9228c661202d8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39097fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39097fa640 1 -- 10.20.193.28:0/2849632403 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39340ac700 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39097fa640 1 -- 10.20.193.28:0/2849632403 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f39340ad900 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f39097fa640 1 -- 10.20.193.28:0/2849632403 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39340b7e30 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.596+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3948151680 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f39097fa640 1 -- 10.20.193.28:0/2849632403 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f393400bb20 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 10 client.17277 _ll_register_callbacks cb 0x55c2949aea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2946c36f0 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f39097fa640 1 -- 10.20.193.28:0/2849632403 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39340b8040 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 10 client.17277 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c2949b13c0 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f39097fa640 1 -- 10.20.193.28:0/2849632403 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39340adb90 con 0x55c294b21360 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 10 client.17277 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 10 client.17277 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 20 client.17277 populate_metadata read hostname 'trial028' 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55c294b86c30 0x55c294b648a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 4 client.17277 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2949cff80 con 0x55c294b86c30 2026-02-20T13:22:33.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.597+0000 7f3946ffd640 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55c294b86c30 0x55c294b648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.598+0000 7f3946ffd640 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55c294b86c30 0x55c294b648a0 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=16898857646064329922 s_cookie=6835612707682740592 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ea84cd7ebf8ee4c2 server_cookie=5edcf98a7f936970 in_seq=0 out_seq=0 2026-02-20T13:22:33.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.598+0000 7f39097fa640 10 client.17277 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:22:33.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.598+0000 7f39097fa640 1 -- 10.20.193.28:0/2849632403 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c2949cff80 con 0x55c294b86c30 2026-02-20T13:22:33.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.598+0000 7f39097fa640 10 client.17277 handle_command_reply: tid=0 2026-02-20T13:22:33.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 client.17277 shutdown 2026-02-20T13:22:33.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 msgr2=0x55c294b7e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b7e730 secure :-1 s=READY pgs=730 gs=1 cs=0 l=1 c_cookie=13732083046304198028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39340acee0 tx=0x7f39340a8e70 comp rx=0 tx=0).stop 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 shutdown_connections 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55c294b86c30 0x55c294b648a0 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=16898857646064329922 s_cookie=6835612707682740592 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 0x55c294b80a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 0x55c294b7ec70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/2849632403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b7e730 unknown :-1 s=CLOSED pgs=730 gs=1 cs=0 l=1 c_cookie=13732083046304198028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f39097fa640 0 client.17277 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 >> 10.20.193.28:0/2849632403 conn(0x55c294aff860 msgr2=0x55c294b1fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 shutdown_connections 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 1 -- 10.20.193.28:0/2849632403 wait complete. 2026-02-20T13:22:33.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.599+0000 7f394fbd7e00 20 client.17277 trim_cache size 0 max 16384 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.606+0000 7f394fbd7e00 1 Processor -- start 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.606+0000 7f394fbd7e00 1 -- start start 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b83570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 0x55c294b80990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 0x55c294b7b8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c294a2b080 con 0x55c294b21360 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c2946eb700 con 0x55c294b21c70 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f394fbd7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c294b84c90 con 0x55c294b66b20 2026-02-20T13:22:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b83570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f3946ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 0x55c294b80990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b83570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40920/0 (socket says 10.20.193.28:40920) 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 -- 10.20.193.28:0/4284235716 learned_addr learned my addr 10.20.193.28:0/4284235716 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f3947fff640 1 --2- 10.20.193.28:0/4284235716 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 0x55c294b7b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 -- 10.20.193.28:0/4284235716 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 msgr2=0x55c294b7b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 --2- 10.20.193.28:0/4284235716 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 0x55c294b7b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 -- 10.20.193.28:0/4284235716 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 msgr2=0x55c294b80990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 --2- 10.20.193.28:0/4284235716 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 0x55c294b80990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 -- 10.20.193.28:0/4284235716 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c294b709d0 con 0x55c294b21360 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f39477fe640 1 --2- 10.20.193.28:0/4284235716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b83570 secure :-1 s=READY pgs=731 gs=1 cs=0 l=1 c_cookie=18300178254418808520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39340af190 tx=0x7f39340d2020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf74b29f4f60ec8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.607+0000 7f390b7fe640 1 -- 10.20.193.28:0/4284235716 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39340ac700 con 0x55c294b21360 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f390b7fe640 1 -- 10.20.193.28:0/4284235716 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f39340ca020 con 0x55c294b21360 2026-02-20T13:22:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f390b7fe640 1 -- 10.20.193.28:0/4284235716 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39340ae180 con 0x55c294b21360 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4284235716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 msgr2=0x55c294b83570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/4284235716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b83570 secure :-1 s=READY pgs=731 gs=1 cs=0 l=1 c_cookie=18300178254418808520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39340af190 tx=0x7f39340d2020 comp rx=0 tx=0).stop 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4284235716 shutdown_connections 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/4284235716 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b66b20 0x55c294b7b8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/4284235716 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b21c70 0x55c294b80990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/4284235716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21360 0x55c294b83570 unknown :-1 s=CLOSED pgs=731 gs=1 cs=0 l=1 c_cookie=18300178254418808520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4284235716 >> 10.20.193.28:0/4284235716 conn(0x55c294aff860 msgr2=0x55c294b82200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4284235716 shutdown_connections 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.608+0000 7f394fbd7e00 1 -- 10.20.193.28:0/4284235716 wait complete. 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.609+0000 7f394fbd7e00 1 -- start start 2026-02-20T13:22:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.609+0000 7f394fbd7e00 1 Processor -- start 2026-02-20T13:22:33.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21360 0x55c294b61bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21c70 0x55c294b60770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f394fbd7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b66b20 0x55c294b60cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f39477fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21360 0x55c294b61bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f39477fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21360 0x55c294b61bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54376/0 (socket says 10.20.193.28:54376) 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f3946ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21c70 0x55c294b60770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f3946ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21c70 0x55c294b60770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40934/0 (socket says 10.20.193.28:40934) 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c294b760a0 con 0x55c294b21c70 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f39477fe640 1 -- 10.20.193.28:0/554934729 learned_addr learned my addr 10.20.193.28:0/554934729 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c294b611f0 con 0x55c294b66b20 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c294b61360 con 0x55c294b21360 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f3947fff640 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b66b20 0x55c294b60cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f39477fe640 1 -- 10.20.193.28:0/554934729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b66b20 msgr2=0x55c294b60cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f39477fe640 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b66b20 0x55c294b60cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f39477fe640 1 -- 10.20.193.28:0/554934729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21c70 msgr2=0x55c294b60770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f39477fe640 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21c70 0x55c294b60770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f39477fe640 1 -- 10.20.193.28:0/554934729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2949c30e0 con 0x55c294b21360 2026-02-20T13:22:33.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.610+0000 7f3946ffd640 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21c70 0x55c294b60770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f39477fe640 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21360 0x55c294b61bb0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=3166560755960006254 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39340040a0 tx=0x7f39340a8e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bf1e23afab0466e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f39097fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f39097fa640 1 -- 10.20.193.28:0/554934729 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393409a070 con 0x55c294b21360 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f39097fa640 1 -- 10.20.193.28:0/554934729 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c2946c36f0 con 0x55c294b21360 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2949b13c0 con 0x55c294b21360 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f39097fa640 1 -- 10.20.193.28:0/554934729 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39340b80b0 con 0x55c294b21360 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f39097fa640 1 -- 10.20.193.28:0/554934729 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f39340cb060 con 0x55c294b21360 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f39097fa640 10 client.27175 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f394fbd7e00 10 client.27175 _ll_register_callbacks cb 0x55c2949aea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:33.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f393c00ad70 con 0x55c294b21360 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f39097fa640 1 -- 10.20.193.28:0/554934729 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39340b2c20 con 0x55c294b21360 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f394fbd7e00 10 client.27175 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.611+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c2949bdb60 con 0x55c294b21360 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f39097fa640 1 -- 10.20.193.28:0/554934729 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3934005600 con 0x55c294b21360 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f394fbd7e00 10 client.27175 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f394fbd7e00 10 client.27175 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f394fbd7e00 20 client.27175 populate_metadata read hostname 'trial028' 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55c294b04c40 0x55c294b050e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f394fbd7e00 4 client.27175 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2946c0f40 con 0x55c294b04c40 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f3946ffd640 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55c294b04c40 0x55c294b050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:33.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f3946ffd640 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55c294b04c40 0x55c294b050e0 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=14066029307545764674 s_cookie=8941696147097617951 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c3349321547fc342 server_cookie=7c174945493b861f in_seq=0 out_seq=0 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f39097fa640 10 client.27175 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f39097fa640 1 -- 10.20.193.28:0/554934729 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2946c0f40 con 0x55c294b04c40 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f39097fa640 10 client.27175 handle_command_reply: tid=0 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.612+0000 7f394fbd7e00 1 client.27175 shutdown 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21360 msgr2=0x55c294b61bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21360 0x55c294b61bb0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=3166560755960006254 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39340040a0 tx=0x7f39340a8e70 comp rx=0 tx=0).stop 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 shutdown_connections 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55c294b04c40 0x55c294b050e0 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=14066029307545764674 s_cookie=8941696147097617951 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c294b21c70 0x55c294b60770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c294b66b20 0x55c294b60cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 --2- 10.20.193.28:0/554934729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c294b21360 0x55c294b61bb0 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=3166560755960006254 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f39097fa640 0 client.27175 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 >> 10.20.193.28:0/554934729 conn(0x55c294aff860 msgr2=0x55c294b7de00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 shutdown_connections 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 1 -- 10.20.193.28:0/554934729 wait complete. 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394fbd7e00 20 client.27175 trim_cache size 0 max 16384 2026-02-20T13:22:33.616 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394dbdd640 1 -- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f391c0b5760 msgr2=0x7f391c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394dbdd640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f391c0b5760 0x7f391c0d5c10 secure :-1 s=READY pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39481681a0 tx=0x7f393803a040 comp rx=0 tx=0).stop 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394dbdd640 1 -- 10.20.193.28:0/1489008245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3948060f30 msgr2=0x7f3948161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.613+0000 7f394dbdd640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3948060f30 0x7f3948161800 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39340072a0 tx=0x7f393400ddf0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.614+0000 7f394dbdd640 1 -- 10.20.193.28:0/1489008245 shutdown_connections 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.614+0000 7f394dbdd640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f391c0b5760 0x7f391c0d5c10 unknown :-1 s=CLOSED pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.614+0000 7f394dbdd640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3948061840 0x7f3948161d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.614+0000 7f394dbdd640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3948155a60 0x7f3948167110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.614+0000 7f394dbdd640 1 --2- 10.20.193.28:0/1489008245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3948060f30 0x7f3948161800 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.614+0000 7f394dbdd640 1 -- 10.20.193.28:0/1489008245 >> 10.20.193.28:0/1489008245 conn(0x7f39480eabb0 msgr2=0x7f394810af90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.614+0000 7f394dbdd640 1 -- 10.20.193.28:0/1489008245 shutdown_connections 2026-02-20T13:22:33.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:33.614+0000 7f394dbdd640 1 -- 10.20.193.28:0/1489008245 wait complete. 2026-02-20T13:22:33.715 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:22:33.764 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:33 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2165241682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:22:33.898 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:33 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2165241682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:22:33.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:33 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2165241682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:22:34.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.069+0000 7f66de0be640 1 -- 10.20.193.28:0/987516937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 msgr2=0x7f66d8176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.069+0000 7f66de0be640 1 --2- 10.20.193.28:0/987516937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 0x7f66d8176070 secure :-1 s=READY pgs=732 gs=2 cs=0 l=1 c_cookie=9750483294512595247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66d400aa30 tx=0x7f66d4030270 comp rx=0 tx=0).stop 2026-02-20T13:22:34.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.070+0000 7f66de0be640 1 -- 10.20.193.28:0/987516937 shutdown_connections 2026-02-20T13:22:34.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.070+0000 7f66de0be640 1 --2- 10.20.193.28:0/987516937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 0x7f66d8176070 unknown :-1 s=CLOSED pgs=732 gs=2 cs=0 l=1 c_cookie=9750483294512595247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.070+0000 7f66de0be640 1 --2- 10.20.193.28:0/987516937 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66d810fea0 0x7f66d8114ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.070+0000 7f66de0be640 1 --2- 10.20.193.28:0/987516937 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f66d810f4b0 0x7f66d810f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.070+0000 7f66de0be640 1 -- 10.20.193.28:0/987516937 >> 10.20.193.28:0/987516937 conn(0x7f66d80ecda0 msgr2=0x7f66d810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.070+0000 7f66de0be640 1 -- 10.20.193.28:0/987516937 shutdown_connections 2026-02-20T13:22:34.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.070+0000 7f66de0be640 1 -- 10.20.193.28:0/987516937 wait complete. 2026-02-20T13:22:34.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66de0be640 1 Processor -- start 2026-02-20T13:22:34.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66de0be640 1 -- start start 2026-02-20T13:22:34.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66de0be640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66d810f4b0 0x7f66d811de60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66de0be640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f66d810fea0 0x7f66d811e3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66de0be640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 0x7f66d8123770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66de0be640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f66d8123d90 con 0x7f66d81156a0 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66de0be640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f66d8123f00 con 0x7f66d810fea0 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66de0be640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f66d81240c0 con 0x7f66d810f4b0 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd8bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 0x7f66d8123770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd8bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 0x7f66d8123770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40944/0 (socket says 10.20.193.28:40944) 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd8bd640 1 -- 10.20.193.28:0/153001326 learned_addr learned my addr 10.20.193.28:0/153001326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66d810f4b0 0x7f66d811de60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dc8bb640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f66d810fea0 0x7f66d811e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd8bd640 1 -- 10.20.193.28:0/153001326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66d810f4b0 msgr2=0x7f66d811de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66d810f4b0 0x7f66d811de60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd8bd640 1 -- 10.20.193.28:0/153001326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f66d810fea0 msgr2=0x7f66d811e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f66d810fea0 0x7f66d811e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.071+0000 7f66dd8bd640 1 -- 10.20.193.28:0/153001326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc0094b0 con 0x7f66d81156a0 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.072+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66d810f4b0 0x7f66d811de60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.072+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 0x7f66d8123770 secure :-1 s=READY pgs=733 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66d4006a50 tx=0x7f66d4006fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.072+0000 7f66c67fc640 1 -- 10.20.193.28:0/153001326 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66d403e070 con 0x7f66d81156a0 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.072+0000 7f66c67fc640 1 -- 10.20.193.28:0/153001326 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66d4039e00 con 0x7f66d81156a0 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.072+0000 7f66c67fc640 1 -- 10.20.193.28:0/153001326 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66d40428c0 con 0x7f66d81156a0 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.072+0000 7f66de0be640 1 -- 10.20.193.28:0/153001326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d400a650 con 0x7f66d81156a0 2026-02-20T13:22:34.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.072+0000 7f66de0be640 1 -- 10.20.193.28:0/153001326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d81245d0 con 0x7f66d81156a0 2026-02-20T13:22:34.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.075+0000 7f66c67fc640 1 -- 10.20.193.28:0/153001326 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f66d4039920 con 0x7f66d81156a0 2026-02-20T13:22:34.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.077+0000 7f66c67fc640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66b40b5760 0x7f66b40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.077+0000 7f66c67fc640 1 -- 10.20.193.28:0/153001326 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f66d410c380 con 0x7f66d81156a0 2026-02-20T13:22:34.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.077+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66b40b5760 0x7f66b40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.077+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66b40b5760 0x7f66b40d5c10 secure :-1 s=READY pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c8004740 tx=0x7f66c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66e1341e00 1 Processor -- start 2026-02-20T13:22:34.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66e1341e00 1 -- start start 2026-02-20T13:22:34.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71f360 0x55e37e71f730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 0x55e37e7645e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e764b20 0x55e37e784f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66e1341e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e37e635780 con 0x55e37e764b20 2026-02-20T13:22:34.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66e1341e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e37e6314b0 con 0x55e37e71f360 2026-02-20T13:22:34.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66e1341e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e37e62b450 con 0x55e37e71fc70 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd0bc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71f360 0x55e37e71f730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd8bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e764b20 0x55e37e784f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dc8bb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 0x55e37e7645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd0bc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71f360 0x55e37e71f730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50608/0 (socket says 10.20.193.28:50608) 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd0bc640 1 -- 10.20.193.28:0/1100919811 learned_addr learned my addr 10.20.193.28:0/1100919811 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd8bd640 1 -- 10.20.193.28:0/1100919811 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 msgr2=0x55e37e7645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/1100919811 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 0x55e37e7645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd8bd640 1 -- 10.20.193.28:0/1100919811 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71f360 msgr2=0x55e37e71f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/1100919811 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71f360 0x55e37e71f730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.078+0000 7f66dd8bd640 1 -- 10.20.193.28:0/1100919811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37e5d6d10 con 0x55e37e764b20 2026-02-20T13:22:34.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/1100919811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e764b20 0x55e37e784f00 secure :-1 s=READY pgs=734 gs=2 cs=0 l=1 c_cookie=18226719973443817588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66d4109f40 tx=0x7f66d4003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf2513f1da2d074 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66a5ce5640 1 -- 10.20.193.28:0/1100919811 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66d40d8440 con 0x55e37e764b20 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66a5ce5640 1 -- 10.20.193.28:0/1100919811 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66d40daa20 con 0x55e37e764b20 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66a5ce5640 1 -- 10.20.193.28:0/1100919811 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66d4005370 con 0x55e37e764b20 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 -- 10.20.193.28:0/1100919811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e764b20 msgr2=0x55e37e784f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1100919811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e764b20 0x55e37e784f00 secure :-1 s=READY pgs=734 gs=2 cs=0 l=1 c_cookie=18226719973443817588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66d4109f40 tx=0x7f66d4003cf0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 -- 10.20.193.28:0/1100919811 shutdown_connections 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1100919811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e764b20 0x55e37e784f00 unknown :-1 s=CLOSED pgs=734 gs=2 cs=0 l=1 c_cookie=18226719973443817588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1100919811 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 0x55e37e7645e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1100919811 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71f360 0x55e37e71f730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 -- 10.20.193.28:0/1100919811 >> 10.20.193.28:0/1100919811 conn(0x55e37e6fd860 msgr2=0x55e37e71dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 -- 10.20.193.28:0/1100919811 shutdown_connections 2026-02-20T13:22:34.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.079+0000 7f66e1341e00 1 -- 10.20.193.28:0/1100919811 wait complete. 2026-02-20T13:22:34.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.080+0000 7f66e1341e00 1 -- start start 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66e1341e00 1 Processor -- start 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e724790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 0x55e37e724cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7235b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66e1341e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e37e723b20 con 0x55e37e71f360 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66e1341e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e37e723c90 con 0x55e37e764b20 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66e1341e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e37e723e50 con 0x55e37e71fc70 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd0bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e724790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd0bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e724790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40950/0 (socket says 10.20.193.28:40950) 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd0bc640 1 -- 10.20.193.28:0/1927002300 learned_addr learned my addr 10.20.193.28:0/1927002300 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd0bc640 1 -- 10.20.193.28:0/1927002300 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 msgr2=0x55e37e724cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dc8bb640 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 0x55e37e724cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 0x55e37e724cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd0bc640 1 -- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 msgr2=0x55e37e7235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd0bc640 1 -- 10.20.193.28:0/1927002300 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37e5af3c0 con 0x55e37e71f360 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.081+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7235b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e724790 secure :-1 s=READY pgs=735 gs=1 cs=0 l=1 c_cookie=9696623096230357376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c8011010 tx=0x7f66c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86915354c3a8a980 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f6692ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f6692ffd640 1 -- 10.20.193.28:0/1927002300 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66c8018040 con 0x55e37e71f360 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f6692ffd640 1 -- 10.20.193.28:0/1927002300 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66c8012b50 con 0x55e37e71f360 2026-02-20T13:22:34.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d81245d0 con 0x55e37e71f360 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f6692ffd640 1 -- 10.20.193.28:0/1927002300 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66c8021d90 con 0x55e37e71f360 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f66e1341e00 10 client.17295 _ll_register_callbacks cb 0x55e37e5aca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e37e2c16f0 con 0x55e37e71f360 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f6692ffd640 1 -- 10.20.193.28:0/1927002300 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f66c8012cc0 con 0x55e37e71f360 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f6692ffd640 1 -- 10.20.193.28:0/1927002300 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66c8012e80 con 0x55e37e71f360 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f66e1341e00 10 client.17295 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.082+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e37e5c10e0 con 0x55e37e71f360 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.083+0000 7f6692ffd640 1 -- 10.20.193.28:0/1927002300 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f66c801e040 con 0x55e37e71f360 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.083+0000 7f66e1341e00 10 client.17295 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.083+0000 7f66e1341e00 10 client.17295 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.083+0000 7f66e1341e00 20 client.17295 populate_metadata read hostname 'trial028' 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.083+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e37e74abd0 0x55e37e74b070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.083+0000 7f66e1341e00 4 client.17295 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.083+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e37e5cdf80 con 0x55e37e74abd0 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.083+0000 7f66dc8bb640 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e37e74abd0 0x55e37e74b070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.084+0000 7f66dc8bb640 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e37e74abd0 0x55e37e74b070 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=4856801754507906941 s_cookie=8033042435332896141 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4366d37699f00f7d server_cookie=6f7b1988b7a7f58d in_seq=0 out_seq=0 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.084+0000 7f6692ffd640 10 client.17295 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.084+0000 7f6692ffd640 1 -- 10.20.193.28:0/1927002300 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e37e5cdf80 con 0x55e37e74abd0 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.084+0000 7f6692ffd640 10 client.17295 handle_command_reply: tid=0 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 client.17295 shutdown 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 msgr2=0x55e37e724790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e724790 secure :-1 s=READY pgs=735 gs=1 cs=0 l=1 c_cookie=9696623096230357376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c8011010 tx=0x7f66c8004770 comp rx=0 tx=0).stop 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 shutdown_connections 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e37e74abd0 0x55e37e74b070 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=4856801754507906941 s_cookie=8033042435332896141 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7235b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71fc70 0x55e37e724cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 --2- 10.20.193.28:0/1927002300 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e724790 unknown :-1 s=CLOSED pgs=735 gs=1 cs=0 l=1 c_cookie=9696623096230357376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f6692ffd640 0 client.17295 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:22:34.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 >> 10.20.193.28:0/1927002300 conn(0x55e37e6fd860 msgr2=0x55e37e71dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 shutdown_connections 2026-02-20T13:22:34.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 1 -- 10.20.193.28:0/1927002300 wait complete. 2026-02-20T13:22:34.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.085+0000 7f66e1341e00 20 client.17295 trim_cache size 0 max 16384 2026-02-20T13:22:34.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66e1341e00 1 Processor -- start 2026-02-20T13:22:34.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66e1341e00 1 -- start start 2026-02-20T13:22:34.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e7235a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71fc70 0x55e37e764ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e764b20 0x55e37e782330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66e1341e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e37e629080 con 0x55e37e71f360 2026-02-20T13:22:34.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66e1341e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e37e2e9700 con 0x55e37e71fc70 2026-02-20T13:22:34.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66e1341e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e37e6314b0 con 0x55e37e764b20 2026-02-20T13:22:34.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66dd0bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e7235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66dd0bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e7235a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40966/0 (socket says 10.20.193.28:40966) 2026-02-20T13:22:34.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66dd0bc640 1 -- 10.20.193.28:0/3162884408 learned_addr learned my addr 10.20.193.28:0/3162884408 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e764b20 0x55e37e782330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.092+0000 7f66dc8bb640 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71fc70 0x55e37e764ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66dd0bc640 1 -- 10.20.193.28:0/3162884408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e764b20 msgr2=0x55e37e782330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e764b20 0x55e37e782330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66dd0bc640 1 -- 10.20.193.28:0/3162884408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71fc70 msgr2=0x55e37e764ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71fc70 0x55e37e764ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66dd0bc640 1 -- 10.20.193.28:0/3162884408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37e5bbb60 con 0x55e37e71f360 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e7235a0 secure :-1 s=READY pgs=736 gs=2 cs=0 l=1 c_cookie=6055384137993774293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c8028aa0 tx=0x7f66c802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54090bca6ba764d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66a54e4640 1 -- 10.20.193.28:0/3162884408 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66c80128b0 con 0x55e37e71f360 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66a54e4640 1 -- 10.20.193.28:0/3162884408 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66c8038070 con 0x55e37e71f360 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66a54e4640 1 -- 10.20.193.28:0/3162884408 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66c8020c30 con 0x55e37e71f360 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66e1341e00 1 -- 10.20.193.28:0/3162884408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 msgr2=0x55e37e7235a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66e1341e00 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e7235a0 secure :-1 s=READY pgs=736 gs=2 cs=0 l=1 c_cookie=6055384137993774293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c8028aa0 tx=0x7f66c802d000 comp rx=0 tx=0).stop 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66e1341e00 1 -- 10.20.193.28:0/3162884408 shutdown_connections 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66e1341e00 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e764b20 0x55e37e782330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.093+0000 7f66e1341e00 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e71fc70 0x55e37e764ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.094+0000 7f66e1341e00 1 --2- 10.20.193.28:0/3162884408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71f360 0x55e37e7235a0 unknown :-1 s=CLOSED pgs=736 gs=2 cs=0 l=1 c_cookie=6055384137993774293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.094+0000 7f66e1341e00 1 -- 10.20.193.28:0/3162884408 >> 10.20.193.28:0/3162884408 conn(0x55e37e6fd860 msgr2=0x55e37e7245e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.094+0000 7f66e1341e00 1 -- 10.20.193.28:0/3162884408 shutdown_connections 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.094+0000 7f66e1341e00 1 -- 10.20.193.28:0/3162884408 wait complete. 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.094+0000 7f66e1341e00 1 -- start start 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.094+0000 7f66e1341e00 1 Processor -- start 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71f360 0x55e37e744a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71fc70 0x55e37e744f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66e1341e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7454a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66e1341e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e37e765490 con 0x55e37e71fc70 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66e1341e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e37e724210 con 0x55e37e764b20 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66e1341e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e37e75c0a0 con 0x55e37e71f360 2026-02-20T13:22:34.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71fc70 0x55e37e744f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71fc70 0x55e37e744f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40970/0 (socket says 10.20.193.28:40970) 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 -- 10.20.193.28:0/2421597807 learned_addr learned my addr 10.20.193.28:0/2421597807 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71f360 0x55e37e744a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dd8bd640 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 -- 10.20.193.28:0/2421597807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71f360 msgr2=0x55e37e744a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71f360 0x55e37e744a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 -- 10.20.193.28:0/2421597807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 msgr2=0x55e37e7454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 -- 10.20.193.28:0/2421597807 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37e5af6f0 con 0x55e37e71fc70 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66dc8bb640 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71fc70 0x55e37e744f60 secure :-1 s=READY pgs=737 gs=1 cs=0 l=1 c_cookie=12249489065668203003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66d8124800 tx=0x7f66cc0099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9feed67972f51fb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f6692ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:34.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f6692ffd640 1 -- 10.20.193.28:0/2421597807 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66cc018040 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f6692ffd640 1 -- 10.20.193.28:0/2421597807 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66cc002bf0 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f6692ffd640 1 -- 10.20.193.28:0/2421597807 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66cc01c810 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.095+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e37e5c10e0 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f6692ffd640 1 -- 10.20.193.28:0/2421597807 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f66cc01c9a0 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 10 client.17301 _ll_register_callbacks cb 0x55e37e5aca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66d40daa20 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f6692ffd640 1 -- 10.20.193.28:0/2421597807 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66cc002d60 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 10 client.17301 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e37e5c1340 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f6692ffd640 1 -- 10.20.193.28:0/2421597807 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f66cc02d070 con 0x55e37e71fc70 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 10 client.17301 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:34.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 10 client.17301 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:22:34.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 20 client.17301 populate_metadata read hostname 'trial028' 2026-02-20T13:22:34.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e37e75dea0 0x55e37e83b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 4 client.17301 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:22:34.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.096+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e37e2bef40 con 0x55e37e75dea0 2026-02-20T13:22:34.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.097+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e37e75dea0 0x55e37e83b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.097+0000 7f66dd0bc640 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e37e75dea0 0x55e37e83b7f0 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=10542600600657628897 s_cookie=16941229520087481363 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=924ed763a3048ee1 server_cookie=eb1b567d732cfc13 in_seq=0 out_seq=0 2026-02-20T13:22:34.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.097+0000 7f6692ffd640 10 client.17301 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:22:34.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f6692ffd640 1 -- 10.20.193.28:0/2421597807 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e37e2bef40 con 0x55e37e75dea0 2026-02-20T13:22:34.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f6692ffd640 10 client.17301 handle_command_reply: tid=0 2026-02-20T13:22:34.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 client.17301 shutdown 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71fc70 msgr2=0x55e37e744f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71fc70 0x55e37e744f60 secure :-1 s=READY pgs=737 gs=1 cs=0 l=1 c_cookie=12249489065668203003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66d8124800 tx=0x7f66cc0099a0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 shutdown_connections 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e37e75dea0 0x55e37e83b7f0 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=10542600600657628897 s_cookie=16941229520087481363 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e37e71fc70 0x55e37e744f60 unknown :-1 s=CLOSED pgs=737 gs=1 cs=0 l=1 c_cookie=12249489065668203003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e37e764b20 0x55e37e7454a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 --2- 10.20.193.28:0/2421597807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e37e71f360 0x55e37e744a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 >> 10.20.193.28:0/2421597807 conn(0x55e37e6fd860 msgr2=0x55e37e722590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f6692ffd640 0 client.17301 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 shutdown_connections 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 1 -- 10.20.193.28:0/2421597807 wait complete. 2026-02-20T13:22:34.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66e1341e00 20 client.17301 trim_cache size 0 max 16384 2026-02-20T13:22:34.107 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66de0be640 1 -- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66b40b5760 msgr2=0x7f66b40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66de0be640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66b40b5760 0x7f66b40d5c10 secure :-1 s=READY pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c8004740 tx=0x7f66c8005f90 comp rx=0 tx=0).stop 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66de0be640 1 -- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 msgr2=0x7f66d8123770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.098+0000 7f66de0be640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 0x7f66d8123770 secure :-1 s=READY pgs=733 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66d4006a50 tx=0x7f66d4006fb0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.099+0000 7f66de0be640 1 -- 10.20.193.28:0/153001326 shutdown_connections 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.099+0000 7f66de0be640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66b40b5760 0x7f66b40d5c10 unknown :-1 s=CLOSED pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.099+0000 7f66de0be640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66d81156a0 0x7f66d8123770 unknown :-1 s=CLOSED pgs=733 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.099+0000 7f66de0be640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f66d810fea0 0x7f66d811e3a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.099+0000 7f66de0be640 1 --2- 10.20.193.28:0/153001326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66d810f4b0 0x7f66d811de60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.099+0000 7f66de0be640 1 -- 10.20.193.28:0/153001326 >> 10.20.193.28:0/153001326 conn(0x7f66d80ecda0 msgr2=0x7f66d810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.099+0000 7f66de0be640 1 -- 10.20.193.28:0/153001326 shutdown_connections 2026-02-20T13:22:34.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.099+0000 7f66de0be640 1 -- 10.20.193.28:0/153001326 wait complete. 2026-02-20T13:22:34.201 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:22:34.386 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:34.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3790065734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 msgr2=0x7f5ea4060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3790065734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 0x7f5ea4060fb0 secure :-1 s=READY pgs=738 gs=1 cs=0 l=1 c_cookie=5468465125861420487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e94009950 tx=0x7f5e9402f190 comp rx=0 tx=0).stop 2026-02-20T13:22:34.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3790065734 shutdown_connections 2026-02-20T13:22:34.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3790065734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ea4159d80 0x7f5ea417a160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3790065734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ea40614f0 0x7f5ea4061920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3790065734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 0x7f5ea4060fb0 unknown :-1 s=CLOSED pgs=738 gs=1 cs=0 l=1 c_cookie=5468465125861420487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3790065734 >> 10.20.193.28:0/3790065734 conn(0x7f5ea40eab00 msgr2=0x7f5ea410af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3790065734 shutdown_connections 2026-02-20T13:22:34.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.563+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3790065734 wait complete. 2026-02-20T13:22:34.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.564+0000 7f5ea98cf640 1 Processor -- start 2026-02-20T13:22:34.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.564+0000 7f5ea98cf640 1 -- start start 2026-02-20T13:22:34.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.564+0000 7f5ea98cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ea40614f0 0x7f5ea40f2e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.564+0000 7f5ea98cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 0x7f5ea40f3390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea98cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ea4159d80 0x7f5ea40f8760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea98cf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40f8d80 con 0x7f5ea4062ae0 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea98cf640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40f8ef0 con 0x7f5ea40614f0 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea98cf640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40f90b0 con 0x7f5ea4159d80 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea88cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ea40614f0 0x7f5ea40f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e9bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 0x7f5ea40f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea88cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ea40614f0 0x7f5ea40f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50644/0 (socket says 10.20.193.28:50644) 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea88cd640 1 -- 10.20.193.28:0/3698389554 learned_addr learned my addr 10.20.193.28:0/3698389554 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ea4159d80 0x7f5ea40f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e9bfff640 1 -- 10.20.193.28:0/3698389554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ea4159d80 msgr2=0x7f5ea40f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e9bfff640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ea4159d80 0x7f5ea40f8760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e9bfff640 1 -- 10.20.193.28:0/3698389554 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ea40614f0 msgr2=0x7f5ea40f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e9bfff640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ea40614f0 0x7f5ea40f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e9bfff640 1 -- 10.20.193.28:0/3698389554 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e94009570 con 0x7f5ea4062ae0 2026-02-20T13:22:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ea40614f0 0x7f5ea40f2e50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e9bfff640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 0x7f5ea40f3390 secure :-1 s=READY pgs=739 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e8c00e9c0 tx=0x7f5e8c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e99ffb640 1 -- 10.20.193.28:0/3698389554 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e8c00ccb0 con 0x7f5ea4062ae0 2026-02-20T13:22:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3698389554 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea40f9390 con 0x7f5ea4062ae0 2026-02-20T13:22:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e99ffb640 1 -- 10.20.193.28:0/3698389554 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e8c00ce10 con 0x7f5ea4062ae0 2026-02-20T13:22:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5e99ffb640 1 -- 10.20.193.28:0/3698389554 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e8c0106b0 con 0x7f5ea4062ae0 2026-02-20T13:22:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.565+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3698389554 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea40f9a70 con 0x7f5ea4062ae0 2026-02-20T13:22:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.568+0000 7f5e99ffb640 1 -- 10.20.193.28:0/3698389554 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5e8c01f060 con 0x7f5ea4062ae0 2026-02-20T13:22:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.570+0000 7f5e99ffb640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e800b5760 0x7f5e800d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.570+0000 7f5e99ffb640 1 -- 10.20.193.28:0/3698389554 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5e8c014070 con 0x7f5ea4062ae0 2026-02-20T13:22:34.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.570+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e800b5760 0x7f5e800d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e800b5760 0x7f5e800d5c10 secure :-1 s=READY pgs=380 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e94038820 tx=0x7f5e9403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5eacb52e00 1 Processor -- start 2026-02-20T13:22:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5eacb52e00 1 -- start start 2026-02-20T13:22:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7343360 0x55bab7343730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73885e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7388b20 0x55bab73a8f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bab7259780 con 0x55bab7343360 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bab72554b0 con 0x55bab7388b20 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bab724f450 con 0x55bab7343c70 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5ea88cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7343360 0x55bab7343730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5ea88cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7343360 0x55bab7343730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40994/0 (socket says 10.20.193.28:40994) 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5ea88cd640 1 -- 10.20.193.28:0/1890338414 learned_addr learned my addr 10.20.193.28:0/1890338414 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7388b20 0x55bab73a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.571+0000 7f5e9bfff640 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73885e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5ea88cd640 1 -- 10.20.193.28:0/1890338414 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 msgr2=0x55bab73885e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73885e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5ea88cd640 1 -- 10.20.193.28:0/1890338414 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7388b20 msgr2=0x55bab73a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7388b20 0x55bab73a8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5ea88cd640 1 -- 10.20.193.28:0/1890338414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab71fad10 con 0x55bab7343360 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7343360 0x55bab7343730 secure :-1 s=READY pgs=740 gs=1 cs=0 l=1 c_cookie=15441194971006446452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e94005c90 tx=0x7f5e94040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64a2503e2632b74 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5e714e4640 1 -- 10.20.193.28:0/1890338414 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e9402fc10 con 0x55bab7343360 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5e714e4640 1 -- 10.20.193.28:0/1890338414 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e9403e040 con 0x55bab7343360 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5e714e4640 1 -- 10.20.193.28:0/1890338414 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e94044ae0 con 0x55bab7343360 2026-02-20T13:22:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1890338414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7343360 msgr2=0x55bab7343730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7343360 0x55bab7343730 secure :-1 s=READY pgs=740 gs=1 cs=0 l=1 c_cookie=15441194971006446452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e94005c90 tx=0x7f5e94040000 comp rx=0 tx=0).stop 2026-02-20T13:22:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1890338414 shutdown_connections 2026-02-20T13:22:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7388b20 0x55bab73a8f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73885e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/1890338414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7343360 0x55bab7343730 unknown :-1 s=CLOSED pgs=740 gs=1 cs=0 l=1 c_cookie=15441194971006446452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1890338414 >> 10.20.193.28:0/1890338414 conn(0x55bab7321860 msgr2=0x55bab7341c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1890338414 shutdown_connections 2026-02-20T13:22:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.572+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1890338414 wait complete. 2026-02-20T13:22:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.574+0000 7f5eacb52e00 1 -- start start 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.574+0000 7f5eacb52e00 1 Processor -- start 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.574+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73a0700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.574+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73a0c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.574+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73a5c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.574+0000 7f5ea88cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea88cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50662/0 (socket says 10.20.193.28:50662) 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea88cd640 1 -- 10.20.193.28:0/3414695498 learned_addr learned my addr 10.20.193.28:0/3414695498 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bab73a6170 con 0x55bab7388b20 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bab73a62e0 con 0x55bab7343360 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bab73a64a0 con 0x55bab7343c70 2026-02-20T13:22:34.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5e9bfff640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea90ce640 1 -- 10.20.193.28:0/3414695498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 msgr2=0x55bab73a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea90ce640 1 -- 10.20.193.28:0/3414695498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 msgr2=0x55bab73a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea90ce640 1 -- 10.20.193.28:0/3414695498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab71d33c0 con 0x55bab7388b20 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73a0700 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5e9bfff640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73a0c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73a5c30 secure :-1 s=READY pgs=741 gs=2 cs=0 l=1 c_cookie=9866606924775160953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea0005820 tx=0x7f5ea000aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ed3ab8f9a1fc79 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5e627fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5e627fc640 1 -- 10.20.193.28:0/3414695498 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea0018070 con 0x55bab7388b20 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea417adc0 con 0x55bab7388b20 2026-02-20T13:22:34.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5eacb52e00 10 client.17313 _ll_register_callbacks cb 0x55bab71d0a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bab6ee56f0 con 0x55bab7388b20 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5e627fc640 1 -- 10.20.193.28:0/3414695498 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ea0011e00 con 0x55bab7388b20 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5e627fc640 1 -- 10.20.193.28:0/3414695498 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea0018070 con 0x55bab7388b20 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.575+0000 7f5e627fc640 1 -- 10.20.193.28:0/3414695498 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5ea001c3c0 con 0x55bab7388b20 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5e627fc640 1 -- 10.20.193.28:0/3414695498 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ea001c5c0 con 0x55bab7388b20 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5eacb52e00 10 client.17313 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bab71e50e0 con 0x55bab7388b20 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5e627fc640 1 -- 10.20.193.28:0/3414695498 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ea0011920 con 0x55bab7388b20 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5eacb52e00 10 client.17313 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5eacb52e00 10 client.17313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5eacb52e00 20 client.17313 populate_metadata read hostname 'trial028' 2026-02-20T13:22:34.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bab73a8d40 0x55bab73868a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5eacb52e00 4 client.17313 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bab71f1f80 con 0x55bab73a8d40 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.576+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bab73a8d40 0x55bab73868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.577+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bab73a8d40 0x55bab73868a0 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=17394118003788827015 s_cookie=17579969092554191423 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f164522a9d0f4987 server_cookie=f3f898bf3c09f23f in_seq=0 out_seq=0 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.577+0000 7f5e627fc640 10 client.17313 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.577+0000 7f5e627fc640 1 -- 10.20.193.28:0/3414695498 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bab71f1f80 con 0x55bab73a8d40 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.577+0000 7f5e627fc640 10 client.17313 handle_command_reply: tid=0 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.577+0000 7f5eacb52e00 1 client.17313 shutdown 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.577+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 msgr2=0x55bab73a5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.577+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73a5c30 secure :-1 s=READY pgs=741 gs=2 cs=0 l=1 c_cookie=9866606924775160953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea0005820 tx=0x7f5ea000aab0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 shutdown_connections 2026-02-20T13:22:34.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bab73a8d40 0x55bab73868a0 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=17394118003788827015 s_cookie=17579969092554191423 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73a5c30 unknown :-1 s=CLOSED pgs=741 gs=2 cs=0 l=1 c_cookie=9866606924775160953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73a0c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/3414695498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73a0700 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5e627fc640 0 client.17313 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:22:34.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 >> 10.20.193.28:0/3414695498 conn(0x55bab7321860 msgr2=0x55bab7341c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 shutdown_connections 2026-02-20T13:22:34.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 1 -- 10.20.193.28:0/3414695498 wait complete. 2026-02-20T13:22:34.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.578+0000 7f5eacb52e00 20 client.17313 trim_cache size 0 max 16384 2026-02-20T13:22:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5eacb52e00 1 Processor -- start 2026-02-20T13:22:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5eacb52e00 1 -- start start 2026-02-20T13:22:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab739e030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73878b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab7387df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bab724d080 con 0x55bab7388b20 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bab6f0d700 con 0x55bab7343360 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bab72b1ae0 con 0x55bab7343c70 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.585+0000 7f5ea88cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab739e030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea88cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab739e030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50664/0 (socket says 10.20.193.28:50664) 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea88cd640 1 -- 10.20.193.28:0/1974346778 learned_addr learned my addr 10.20.193.28:0/1974346778 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5e9bfff640 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab7387df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea88cd640 1 -- 10.20.193.28:0/1974346778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 msgr2=0x55bab73878b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73878b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea88cd640 1 -- 10.20.193.28:0/1974346778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 msgr2=0x55bab7387df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab7387df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea88cd640 1 -- 10.20.193.28:0/1974346778 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab7392a30 con 0x55bab7343360 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab739e030 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=2762946025905617976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e940023d0 tx=0x7f5e94044630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2657f4c597ae7c38 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5e70ce3640 1 -- 10.20.193.28:0/1974346778 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e9402fe30 con 0x55bab7343360 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5e70ce3640 1 -- 10.20.193.28:0/1974346778 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e94048040 con 0x55bab7343360 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.586+0000 7f5e70ce3640 1 -- 10.20.193.28:0/1974346778 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e94044e80 con 0x55bab7343360 2026-02-20T13:22:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1974346778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 msgr2=0x55bab739e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab739e030 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=2762946025905617976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e940023d0 tx=0x7f5e94044630 comp rx=0 tx=0).stop 2026-02-20T13:22:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1974346778 shutdown_connections 2026-02-20T13:22:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab7387df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab73878b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/1974346778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab739e030 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=2762946025905617976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1974346778 >> 10.20.193.28:0/1974346778 conn(0x55bab7321860 msgr2=0x55bab739c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1974346778 shutdown_connections 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 -- 10.20.193.28:0/1974346778 wait complete. 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 -- start start 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.587+0000 7f5eacb52e00 1 Processor -- start 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73275a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab7322f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5eacb52e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73234a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bab73215d0 con 0x55bab7388b20 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bab73239e0 con 0x55bab7343360 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5eacb52e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bab7323ba0 con 0x55bab7343c70 2026-02-20T13:22:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41020/0 (socket says 10.20.193.28:41020) 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 -- 10.20.193.28:0/2251850876 learned_addr learned my addr 10.20.193.28:0/2251850876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73275a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 -- 10.20.193.28:0/2251850876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 msgr2=0x55bab7322f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab7322f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 -- 10.20.193.28:0/2251850876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 msgr2=0x55bab73275a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73275a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 -- 10.20.193.28:0/2251850876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab71dfb60 con 0x55bab7388b20 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5ea90ce640 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73234a0 secure :-1 s=READY pgs=742 gs=1 cs=0 l=1 c_cookie=11898480432286424720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea0005020 tx=0x7f5ea000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51fe4e98d5e5e90 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.588+0000 7f5e627fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5e627fc640 1 -- 10.20.193.28:0/2251850876 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea0018070 con 0x55bab7388b20 2026-02-20T13:22:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5e627fc640 1 -- 10.20.193.28:0/2251850876 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55bab6ee56f0 con 0x55bab7388b20 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5e627fc640 1 -- 10.20.193.28:0/2251850876 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea0010b20 con 0x55bab7388b20 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab71fad10 con 0x55bab7388b20 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5e627fc640 1 -- 10.20.193.28:0/2251850876 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5ea002c040 con 0x55bab7388b20 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 10 client.17319 _ll_register_callbacks cb 0x55bab71d0a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e9403e040 con 0x55bab7388b20 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5e627fc640 1 -- 10.20.193.28:0/2251850876 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ea0026790 con 0x55bab7388b20 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 10 client.17319 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bab71d36f0 con 0x55bab7388b20 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5e627fc640 1 -- 10.20.193.28:0/2251850876 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ea000f980 con 0x55bab7388b20 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 10 client.17319 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 10 client.17319 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 20 client.17319 populate_metadata read hostname 'trial028' 2026-02-20T13:22:34.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bab74364d0 0x55bab7456980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 4 client.17319 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.589+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bab6ee2f40 con 0x55bab74364d0 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.590+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bab74364d0 0x55bab7456980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.590+0000 7f5e627fc640 10 client.17319 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.590+0000 7f5ea88cd640 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bab74364d0 0x55bab7456980 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=6909180829010935180 s_cookie=11639945122641902289 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5fe2575b8a22bd8c server_cookie=a189646b001c7ad1 in_seq=0 out_seq=0 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.590+0000 7f5e627fc640 1 -- 10.20.193.28:0/2251850876 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bab6ee2f40 con 0x55bab74364d0 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.590+0000 7f5e627fc640 10 client.17319 handle_command_reply: tid=0 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.590+0000 7f5eacb52e00 1 client.17319 shutdown 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.590+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 msgr2=0x55bab73234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.590+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73234a0 secure :-1 s=READY pgs=742 gs=1 cs=0 l=1 c_cookie=11898480432286424720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea0005020 tx=0x7f5ea000ff70 comp rx=0 tx=0).stop 2026-02-20T13:22:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 shutdown_connections 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55bab74364d0 0x55bab7456980 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=6909180829010935180 s_cookie=11639945122641902289 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bab7388b20 0x55bab73234a0 unknown :-1 s=CLOSED pgs=742 gs=1 cs=0 l=1 c_cookie=11898480432286424720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bab7343c70 0x55bab7322f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 1 --2- 10.20.193.28:0/2251850876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bab7343360 0x55bab73275a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5e627fc640 0 client.17319 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 >> 10.20.193.28:0/2251850876 conn(0x55bab7321860 msgr2=0x55bab739d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 shutdown_connections 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 1 -- 10.20.193.28:0/2251850876 wait complete. 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5eacb52e00 20 client.17319 trim_cache size 0 max 16384 2026-02-20T13:22:34.600 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:22:34.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e800b5760 msgr2=0x7f5e800d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e800b5760 0x7f5e800d5c10 secure :-1 s=READY pgs=380 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e94038820 tx=0x7f5e9403a040 comp rx=0 tx=0).stop 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 msgr2=0x7f5ea40f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.591+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 0x7f5ea40f3390 secure :-1 s=READY pgs=739 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e8c00e9c0 tx=0x7f5e8c00ee90 comp rx=0 tx=0).stop 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.592+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3698389554 shutdown_connections 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.592+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e800b5760 0x7f5e800d5c10 unknown :-1 s=CLOSED pgs=380 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.592+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea4062ae0 0x7f5ea40f3390 unknown :-1 s=CLOSED pgs=739 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.592+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ea4159d80 0x7f5ea40f8760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.592+0000 7f5ea98cf640 1 --2- 10.20.193.28:0/3698389554 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ea40614f0 0x7f5ea40f2e50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.592+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3698389554 >> 10.20.193.28:0/3698389554 conn(0x7f5ea40eab00 msgr2=0x7f5ea410fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.592+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3698389554 shutdown_connections 2026-02-20T13:22:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:34.592+0000 7f5ea98cf640 1 -- 10.20.193.28:0/3698389554 wait complete. 2026-02-20T13:22:34.689 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:34 trial028 ceph-mon[37442]: pgmap v338: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:34.691 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:22:34.875 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:34 trial127 ceph-mon[43817]: pgmap v338: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:34 trial034 ceph-mon[43332]: pgmap v338: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:22:35.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/2584389510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 msgr2=0x7f4ea0173e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/2584389510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 0x7f4ea0173e00 secure :-1 s=READY pgs=743 gs=3 cs=0 l=1 c_cookie=2116067083121461256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e9c00a970 tx=0x7f4e9c0301b0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/2584389510 shutdown_connections 2026-02-20T13:22:35.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/2584389510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 0x7f4ea0173e00 unknown :-1 s=CLOSED pgs=743 gs=3 cs=0 l=1 c_cookie=2116067083121461256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/2584389510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea010dc30 0x7f4ea0112c80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/2584389510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea010d240 0x7f4ea010d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/2584389510 >> 10.20.193.28:0/2584389510 conn(0x7f4ea00eaad0 msgr2=0x7f4ea010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:35.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/2584389510 shutdown_connections 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.057+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/2584389510 wait complete. 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea5b2f640 1 Processor -- start 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea5b2f640 1 -- start start 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea5b2f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea010d240 0x7f4ea00f56d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea5b2f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea010dc30 0x7f4ea0173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea5b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 0x7f4ea00f5dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea5b2f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea00fafe0 con 0x7f4ea0113430 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea5b2f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea00fb150 con 0x7f4ea010dc30 2026-02-20T13:22:35.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea5b2f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea00fb310 con 0x7f4ea010d240 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea532e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 0x7f4ea00f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea532e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 0x7f4ea00f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41048/0 (socket says 10.20.193.28:41048) 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea532e640 1 -- 10.20.193.28:0/100790457 learned_addr learned my addr 10.20.193.28:0/100790457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4e97fff640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea010dc30 0x7f4ea0173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.058+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea010d240 0x7f4ea00f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4ea532e640 1 -- 10.20.193.28:0/100790457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea010d240 msgr2=0x7f4ea00f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4ea532e640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea010d240 0x7f4ea00f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4ea532e640 1 -- 10.20.193.28:0/100790457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea010dc30 msgr2=0x7f4ea0173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4ea532e640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea010dc30 0x7f4ea0173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4ea532e640 1 -- 10.20.193.28:0/100790457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e88009570 con 0x7f4ea0113430 2026-02-20T13:22:35.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4ea532e640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 0x7f4ea00f5dd0 secure :-1 s=READY pgs=744 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e9c00a8c0 tx=0x7f4e9c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:35.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4e95ffb640 1 -- 10.20.193.28:0/100790457 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e9c03e070 con 0x7f4ea0113430 2026-02-20T13:22:35.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4e95ffb640 1 -- 10.20.193.28:0/100790457 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4e9c003e10 con 0x7f4ea0113430 2026-02-20T13:22:35.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/100790457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c00a590 con 0x7f4ea0113430 2026-02-20T13:22:35.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4e95ffb640 1 -- 10.20.193.28:0/100790457 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e9c0429b0 con 0x7f4ea0113430 2026-02-20T13:22:35.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.059+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/100790457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea00fb870 con 0x7f4ea0113430 2026-02-20T13:22:35.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.062+0000 7f4e95ffb640 1 -- 10.20.193.28:0/100790457 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f4e9c04a060 con 0x7f4ea0113430 2026-02-20T13:22:35.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.063+0000 7f4e95ffb640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e7c0b5750 0x7f4e7c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.064+0000 7f4e95ffb640 1 -- 10.20.193.28:0/100790457 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4e9c10c6c0 con 0x7f4ea0113430 2026-02-20T13:22:35.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.064+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e7c0b5750 0x7f4e7c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.064+0000 7f4ea8db2e00 1 Processor -- start 2026-02-20T13:22:35.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.064+0000 7f4ea8db2e00 1 -- start start 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.064+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e7c0b5750 0x7f4e7c0d5c00 secure :-1 s=READY pgs=381 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e90005e30 tx=0x7f4e90005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.064+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c39730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c7e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c9ef00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b84b4f780 con 0x559b84c39c70 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b84b4b4b0 con 0x559b84c39360 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b84b45450 con 0x559b84c7eb20 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c39730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c39730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50682/0 (socket says 10.20.193.28:50682) 2026-02-20T13:22:35.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 -- 10.20.193.28:0/4060247474 learned_addr learned my addr 10.20.193.28:0/4060247474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4e97fff640 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c7e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea532e640 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c9ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 -- 10.20.193.28:0/4060247474 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 msgr2=0x559b84c9ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c9ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 -- 10.20.193.28:0/4060247474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 msgr2=0x559b84c7e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c7e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 -- 10.20.193.28:0/4060247474 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b84af0d10 con 0x559b84c39360 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea532e640 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c9ef00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4e97fff640 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c7e5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.065+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c39730 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=8682170556274135500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e900041d0 tx=0x7f4e90012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=787d441eee1351cc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:35.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4e6d4e4640 1 -- 10.20.193.28:0/4060247474 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e90011e60 con 0x559b84c39360 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4e6d4e4640 1 -- 10.20.193.28:0/4060247474 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4e9001e940 con 0x559b84c39360 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4e6d4e4640 1 -- 10.20.193.28:0/4060247474 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e90010b40 con 0x559b84c39360 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/4060247474 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 msgr2=0x559b84c39730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c39730 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=8682170556274135500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e900041d0 tx=0x7f4e90012000 comp rx=0 tx=0).stop 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/4060247474 shutdown_connections 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c7e5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c9ef00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/4060247474 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c39730 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=8682170556274135500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/4060247474 >> 10.20.193.28:0/4060247474 conn(0x559b84c17860 msgr2=0x559b84c37c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/4060247474 shutdown_connections 2026-02-20T13:22:35.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.066+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/4060247474 wait complete. 2026-02-20T13:22:35.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.067+0000 7f4ea8db2e00 1 -- start start 2026-02-20T13:22:35.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.067+0000 7f4ea8db2e00 1 Processor -- start 2026-02-20T13:22:35.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c3f810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c3fd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c3e5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b84c3eb00 con 0x559b84c39c70 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b84c3ec70 con 0x559b84c39360 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b84c3ee30 con 0x559b84c7eb20 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4ea532e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c3e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4e97fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c3fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4e97fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c3fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41062/0 (socket says 10.20.193.28:41062) 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4e97fff640 1 -- 10.20.193.28:0/1634060061 learned_addr learned my addr 10.20.193.28:0/1634060061 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c3f810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4e97fff640 1 -- 10.20.193.28:0/1634060061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 msgr2=0x559b84c3e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4e97fff640 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c3e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4e97fff640 1 -- 10.20.193.28:0/1634060061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 msgr2=0x559b84c3f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4e97fff640 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c3f810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.068+0000 7f4e97fff640 1 -- 10.20.193.28:0/1634060061 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9000f9b0 con 0x559b84c39c70 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4e97fff640 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c3fd50 secure :-1 s=READY pgs=745 gs=1 cs=0 l=1 c_cookie=1647919966597974021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e88009e70 tx=0x7f4e88002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16de967a83588805 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4e5e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/1634060061 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e88017070 con 0x559b84c39c70 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/1634060061 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4e88012b40 con 0x559b84c39c70 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e88004260 con 0x559b84c39c70 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/1634060061 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e8801c6a0 con 0x559b84c39c70 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 10 client.17331 _ll_register_callbacks cb 0x559b84ac6a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559b847db6f0 con 0x559b84c39c70 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/1634060061 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4e8801c830 con 0x559b84c39c70 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/1634060061 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e8801ca30 con 0x559b84c39c70 2026-02-20T13:22:35.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 10 client.17331 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559b84ac93c0 con 0x559b84c39c70 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/1634060061 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4e8801cc50 con 0x559b84c39c70 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 10 client.17331 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 20 client.17331 populate_metadata read hostname 'trial028' 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b84c9a6c0 0x559b84c9ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 4 client.17331 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.069+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b84ae7f80 con 0x559b84c9a6c0 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.070+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b84c9a6c0 0x559b84c9ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.070+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b84c9a6c0 0x559b84c9ab60 crc :-1 s=READY pgs=168 gs=4 cs=0 l=0 c_cookie=16929764665860845770 s_cookie=16971142013096641610 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaf29b440f9870ca server_cookie=eb859bbe7355444a in_seq=0 out_seq=0 2026-02-20T13:22:35.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.070+0000 7f4e5e7fc640 10 client.17331 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/1634060061 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559b84ae7f80 con 0x559b84c9a6c0 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4e5e7fc640 10 client.17331 handle_command_reply: tid=0 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 client.17331 shutdown 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 msgr2=0x559b84c3fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c3fd50 secure :-1 s=READY pgs=745 gs=1 cs=0 l=1 c_cookie=1647919966597974021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e88009e70 tx=0x7f4e88002a70 comp rx=0 tx=0).stop 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 shutdown_connections 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b84c9a6c0 0x559b84c9ab60 crc :-1 s=READY pgs=168 gs=4 cs=0 l=0 c_cookie=16929764665860845770 s_cookie=16971142013096641610 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c3fd50 unknown :-1 s=CLOSED pgs=745 gs=1 cs=0 l=1 c_cookie=1647919966597974021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c3e5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/1634060061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c3f810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4e5e7fc640 0 client.17331 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:35.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 >> 10.20.193.28:0/1634060061 conn(0x559b84c17860 msgr2=0x559b84c37c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:35.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 shutdown_connections 2026-02-20T13:22:35.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/1634060061 wait complete. 2026-02-20T13:22:35.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.071+0000 7f4ea8db2e00 20 client.17331 trim_cache size 0 max 16384 2026-02-20T13:22:35.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.079+0000 7f4ea8db2e00 1 Processor -- start 2026-02-20T13:22:35.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.079+0000 7f4ea8db2e00 1 -- start start 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c3fce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c95b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c93810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b84b43080 con 0x559b84c39c70 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b84803700 con 0x559b84c39360 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b84c40330 con 0x559b84c7eb20 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c95b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c95b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41078/0 (socket says 10.20.193.28:41078) 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4ea4b2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c3fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 -- 10.20.193.28:0/691247992 learned_addr learned my addr 10.20.193.28:0/691247992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4ea532e640 1 --2- 10.20.193.28:0/691247992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c93810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 -- 10.20.193.28:0/691247992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 msgr2=0x559b84c93810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 --2- 10.20.193.28:0/691247992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c93810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 -- 10.20.193.28:0/691247992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 msgr2=0x559b84c3fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 --2- 10.20.193.28:0/691247992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c3fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 -- 10.20.193.28:0/691247992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b84adb0e0 con 0x559b84c39c70 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e97fff640 1 --2- 10.20.193.28:0/691247992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c95b00 secure :-1 s=READY pgs=746 gs=2 cs=0 l=1 c_cookie=4934094545719495914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e8801ab00 tx=0x7f4e88020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44796cd8edcd8cea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e6cce3640 1 -- 10.20.193.28:0/691247992 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e88017040 con 0x559b84c39c70 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e6cce3640 1 -- 10.20.193.28:0/691247992 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559b847db6f0 con 0x559b84c39c70 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.080+0000 7f4e6cce3640 1 -- 10.20.193.28:0/691247992 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e88010c60 con 0x559b84c39c70 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/691247992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 msgr2=0x559b84c95b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/691247992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c95b00 secure :-1 s=READY pgs=746 gs=2 cs=0 l=1 c_cookie=4934094545719495914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e8801ab00 tx=0x7f4e88020000 comp rx=0 tx=0).stop 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/691247992 shutdown_connections 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/691247992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c39c70 0x559b84c95b00 unknown :-1 s=CLOSED pgs=746 gs=2 cs=0 l=1 c_cookie=4934094545719495914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/691247992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c7eb20 0x559b84c93810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/691247992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c3fce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/691247992 >> 10.20.193.28:0/691247992 conn(0x559b84c17860 msgr2=0x559b84c3f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/691247992 shutdown_connections 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/691247992 wait complete. 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.081+0000 7f4ea8db2e00 1 -- start start 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea8db2e00 1 Processor -- start 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c5fce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c39c70 0x559b84c60220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea8db2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c7eb20 0x559b84c405a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b84c40b60 con 0x559b84c7eb20 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b84c40cd0 con 0x559b84c39360 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea8db2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b84c40e90 con 0x559b84c39c70 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea4b2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c5fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4e97fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c39c70 0x559b84c60220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea4b2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c5fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50722/0 (socket says 10.20.193.28:50722) 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea4b2d640 1 -- 10.20.193.28:0/2530160549 learned_addr learned my addr 10.20.193.28:0/2530160549 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea532e640 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c7eb20 0x559b84c405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea4b2d640 1 -- 10.20.193.28:0/2530160549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c39c70 msgr2=0x559b84c60220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c39c70 0x559b84c60220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea4b2d640 1 -- 10.20.193.28:0/2530160549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c7eb20 msgr2=0x559b84c405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:35.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.082+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c7eb20 0x559b84c405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4ea4b2d640 1 -- 10.20.193.28:0/2530160549 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b84ad5b60 con 0x559b84c39360 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4ea532e640 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c7eb20 0x559b84c405a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4ea4b2d640 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c5fce0 secure :-1 s=READY pgs=294 gs=3 cs=0 l=1 c_cookie=2848339964074090662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e90010660 tx=0x7f4e90010690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2787561b2e2f60a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4e5e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/2530160549 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e90030040 con 0x559b84c39360 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b84ac93c0 con 0x559b84c39360 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4ea8db2e00 10 client.27308 _ll_register_callbacks cb 0x559b84ac6a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e9001e940 con 0x559b84c39360 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/2530160549 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4e9001e680 con 0x559b84c39360 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/2530160549 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e90036320 con 0x559b84c39360 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/2530160549 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4e90036480 con 0x559b84c39360 2026-02-20T13:22:35.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/2530160549 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e90036680 con 0x559b84c39360 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4ea8db2e00 10 client.27308 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.083+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559b84ac96f0 con 0x559b84c39360 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/2530160549 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4e9001eab0 con 0x559b84c39360 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4ea8db2e00 10 client.27308 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4ea8db2e00 10 client.27308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4ea8db2e00 20 client.27308 populate_metadata read hostname 'trial028' 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b84d3dfb0 0x559b84d5e430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4ea8db2e00 4 client.27308 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b847d8f40 con 0x559b84d3dfb0 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4e97fff640 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b84d3dfb0 0x559b84d5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4e97fff640 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b84d3dfb0 0x559b84d5e430 crc :-1 s=READY pgs=169 gs=4 cs=0 l=0 c_cookie=7470440696121594441 s_cookie=8357243865655754755 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67ac563ba7f31249 server_cookie=73fae50469b94003 in_seq=0 out_seq=0 2026-02-20T13:22:35.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.084+0000 7f4e5e7fc640 10 client.27308 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4e5e7fc640 1 -- 10.20.193.28:0/2530160549 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b847d8f40 con 0x559b84d3dfb0 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4e5e7fc640 10 client.27308 handle_command_reply: tid=0 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 client.27308 shutdown 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 msgr2=0x559b84c5fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c5fce0 secure :-1 s=READY pgs=294 gs=3 cs=0 l=1 c_cookie=2848339964074090662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e90010660 tx=0x7f4e90010690 comp rx=0 tx=0).stop 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 shutdown_connections 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b84d3dfb0 0x559b84d5e430 crc :-1 s=READY pgs=169 gs=4 cs=0 l=0 c_cookie=7470440696121594441 s_cookie=8357243865655754755 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b84c7eb20 0x559b84c405a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b84c39c70 0x559b84c60220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 --2- 10.20.193.28:0/2530160549 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b84c39360 0x559b84c5fce0 unknown :-1 s=CLOSED pgs=294 gs=3 cs=0 l=1 c_cookie=2848339964074090662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4e5e7fc640 0 client.27308 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:35.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 >> 10.20.193.28:0/2530160549 conn(0x559b84c17860 msgr2=0x559b84c94af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:35.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 shutdown_connections 2026-02-20T13:22:35.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 1 -- 10.20.193.28:0/2530160549 wait complete. 2026-02-20T13:22:35.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea8db2e00 20 client.27308 trim_cache size 0 max 16384 2026-02-20T13:22:35.096 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:22:35.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e7c0b5750 msgr2=0x7f4e7c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e7c0b5750 0x7f4e7c0d5c00 secure :-1 s=READY pgs=381 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e90005e30 tx=0x7f4e90005d00 comp rx=0 tx=0).stop 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 msgr2=0x7f4ea00f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.085+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 0x7f4ea00f5dd0 secure :-1 s=READY pgs=744 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e9c00a8c0 tx=0x7f4e9c0039b0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.086+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/100790457 shutdown_connections 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.086+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e7c0b5750 0x7f4e7c0d5c00 unknown :-1 s=CLOSED pgs=381 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.086+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ea0113430 0x7f4ea00f5dd0 unknown :-1 s=CLOSED pgs=744 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.086+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4ea010dc30 0x7f4ea0173d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.086+0000 7f4ea5b2f640 1 --2- 10.20.193.28:0/100790457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4ea010d240 0x7f4ea00f56d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.086+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/100790457 >> 10.20.193.28:0/100790457 conn(0x7f4ea00eaad0 msgr2=0x7f4ea01102d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:35.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.086+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/100790457 shutdown_connections 2026-02-20T13:22:35.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:35.086+0000 7f4ea5b2f640 1 -- 10.20.193.28:0/100790457 wait complete. 2026-02-20T13:22:36.187 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:22:36.187 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:22:36.374 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:36.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 -- 10.20.193.28:0/897810764 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f052c10d240 msgr2=0x7f052c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 --2- 10.20.193.28:0/897810764 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f052c10d240 0x7f052c10d610 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=55775289793830495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0520009950 tx=0x7f052002f190 comp rx=0 tx=0).stop 2026-02-20T13:22:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 -- 10.20.193.28:0/897810764 shutdown_connections 2026-02-20T13:22:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 --2- 10.20.193.28:0/897810764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f052c10dc30 0x7f052c112c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 --2- 10.20.193.28:0/897810764 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f052c113430 0x7f052c173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 --2- 10.20.193.28:0/897810764 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f052c10d240 0x7f052c10d610 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=55775289793830495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 -- 10.20.193.28:0/897810764 >> 10.20.193.28:0/897810764 conn(0x7f052c0eaad0 msgr2=0x7f052c10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 -- 10.20.193.28:0/897810764 shutdown_connections 2026-02-20T13:22:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.557+0000 7f052b577640 1 -- 10.20.193.28:0/897810764 wait complete. 2026-02-20T13:22:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.558+0000 7f052b577640 1 Processor -- start 2026-02-20T13:22:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.558+0000 7f052b577640 1 -- start start 2026-02-20T13:22:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052b577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f052c10d240 0x7f052c11b540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052b577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f052c10dc30 0x7f052c11ba80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f052c113430 0x7f052c120e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f052c121470 con 0x7f052c113430 2026-02-20T13:22:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052b577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1215e0 con 0x7f052c10dc30 2026-02-20T13:22:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052b577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1217a0 con 0x7f052c10d240 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f052c113430 0x7f052c120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f052c113430 0x7f052c120e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41102/0 (socket says 10.20.193.28:41102) 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 -- 10.20.193.28:0/51355852 learned_addr learned my addr 10.20.193.28:0/51355852 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052a575640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f052c10d240 0x7f052c11b540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f0529d74640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f052c10dc30 0x7f052c11ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 -- 10.20.193.28:0/51355852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f052c10d240 msgr2=0x7f052c11b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f052c10d240 0x7f052c11b540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 -- 10.20.193.28:0/51355852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f052c10dc30 msgr2=0x7f052c11ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f052c10dc30 0x7f052c11ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 -- 10.20.193.28:0/51355852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05140094b0 con 0x7f052c113430 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052ad76640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f052c113430 0x7f052c120e50 secure :-1 s=READY pgs=747 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f051c006e90 tx=0x7f051c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f05137fe640 1 -- 10.20.193.28:0/51355852 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f051c005500 con 0x7f052c113430 2026-02-20T13:22:36.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.559+0000 7f052b577640 1 -- 10.20.193.28:0/51355852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0520009570 con 0x7f052c113430 2026-02-20T13:22:36.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.560+0000 7f05137fe640 1 -- 10.20.193.28:0/51355852 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f051c005e10 con 0x7f052c113430 2026-02-20T13:22:36.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.560+0000 7f05137fe640 1 -- 10.20.193.28:0/51355852 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f051c003a90 con 0x7f052c113430 2026-02-20T13:22:36.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.560+0000 7f052b577640 1 -- 10.20.193.28:0/51355852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c161fe0 con 0x7f052c113430 2026-02-20T13:22:36.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.562+0000 7f05137fe640 1 -- 10.20.193.28:0/51355852 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f051c00c840 con 0x7f052c113430 2026-02-20T13:22:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.564+0000 7f05137fe640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f05040b5760 0x7f05040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.564+0000 7f05137fe640 1 -- 10.20.193.28:0/51355852 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f051c0e7880 con 0x7f052c113430 2026-02-20T13:22:36.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.564+0000 7f052a575640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f05040b5760 0x7f05040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f052a575640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f05040b5760 0x7f05040d5c10 secure :-1 s=READY pgs=382 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0520005b30 tx=0x7f052003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f0532f2ce00 1 Processor -- start 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f0532f2ce00 1 -- start start 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e037e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e48480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e489c0 0x562fc3e68da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fc3d19a20 con 0x562fc3e489c0 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fc3d15750 con 0x562fc3e03d20 2026-02-20T13:22:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fc3d0f6f0 con 0x562fc3e03410 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.565+0000 7f052a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e037e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54536/0 (socket says 10.20.193.28:54536) 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052a575640 1 -- 10.20.193.28:0/625838761 learned_addr learned my addr 10.20.193.28:0/625838761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052ad76640 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e489c0 0x562fc3e68da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f0529d74640 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e48480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052a575640 1 -- 10.20.193.28:0/625838761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 msgr2=0x562fc3e48480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052a575640 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e48480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052a575640 1 -- 10.20.193.28:0/625838761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e489c0 msgr2=0x562fc3e68da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052a575640 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e489c0 0x562fc3e68da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052a575640 1 -- 10.20.193.28:0/625838761 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc3cbb120 con 0x562fc3e03410 2026-02-20T13:22:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f052a575640 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e037e0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=260030657160056228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0520002e20 tx=0x7f0520040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bd08146bc8da4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f0510ff9640 1 -- 10.20.193.28:0/625838761 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0520002940 con 0x562fc3e03410 2026-02-20T13:22:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f0510ff9640 1 -- 10.20.193.28:0/625838761 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f052003e040 con 0x562fc3e03410 2026-02-20T13:22:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.566+0000 7f0510ff9640 1 -- 10.20.193.28:0/625838761 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f052004f7e0 con 0x562fc3e03410 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 -- 10.20.193.28:0/625838761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 msgr2=0x562fc3e037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e037e0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=260030657160056228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0520002e20 tx=0x7f0520040000 comp rx=0 tx=0).stop 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 -- 10.20.193.28:0/625838761 shutdown_connections 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e489c0 0x562fc3e68da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e48480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/625838761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e037e0 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=260030657160056228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 -- 10.20.193.28:0/625838761 >> 10.20.193.28:0/625838761 conn(0x562fc3de1910 msgr2=0x562fc3e01cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 -- 10.20.193.28:0/625838761 shutdown_connections 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.567+0000 7f0532f2ce00 1 -- 10.20.193.28:0/625838761 wait complete. 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.568+0000 7f0532f2ce00 1 -- start start 2026-02-20T13:22:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.568+0000 7f0532f2ce00 1 Processor -- start 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.568+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e1bcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.568+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03d20 0x562fc3e1c210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e21200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fc3e21740 con 0x562fc3e03d20 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fc3e218b0 con 0x562fc3e489c0 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fc3e21a70 con 0x562fc3e03410 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03d20 0x562fc3e1c210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f052a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e1bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03d20 0x562fc3e1c210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41120/0 (socket says 10.20.193.28:41120) 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 -- 10.20.193.28:0/2343961595 learned_addr learned my addr 10.20.193.28:0/2343961595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f052ad76640 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e21200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 -- 10.20.193.28:0/2343961595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 msgr2=0x562fc3e1bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e1bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 -- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 msgr2=0x562fc3e21200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e21200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 -- 10.20.193.28:0/2343961595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc3c93810 con 0x562fc3e03d20 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f052ad76640 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e21200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f0529d74640 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03d20 0x562fc3e1c210 secure :-1 s=READY pgs=748 gs=1 cs=0 l=1 c_cookie=14450255361971572827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05140044d0 tx=0x7f0514002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8899eb0e3ffd05b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.569+0000 7f04dbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f04dbfff640 1 -- 10.20.193.28:0/2343961595 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0514016070 con 0x562fc3e03d20 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f04dbfff640 1 -- 10.20.193.28:0/2343961595 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0514005020 con 0x562fc3e03d20 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f04dbfff640 1 -- 10.20.193.28:0/2343961595 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0514011d40 con 0x562fc3e03d20 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c174670 con 0x562fc3e03d20 2026-02-20T13:22:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f04dbfff640 1 -- 10.20.193.28:0/2343961595 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0514010430 con 0x562fc3e03d20 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 10 client.17349 _ll_register_callbacks cb 0x562fc3cc6b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562fc39a59d0 con 0x562fc3e03d20 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f04dbfff640 1 -- 10.20.193.28:0/2343961595 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0514011770 con 0x562fc3e03d20 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 10 client.17349 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562fc3ca54f0 con 0x562fc3e03d20 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f04dbfff640 1 -- 10.20.193.28:0/2343961595 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0514004a70 con 0x562fc3e03d20 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 10 client.17349 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 20 client.17349 populate_metadata read hostname 'trial028' 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fc3e46590 0x562fc3e46a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 4 client.17349 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.570+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fc3d1cdf0 con 0x562fc3e46590 2026-02-20T13:22:36.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.571+0000 7f052a575640 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fc3e46590 0x562fc3e46a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.571+0000 7f052a575640 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fc3e46590 0x562fc3e46a30 crc :-1 s=READY pgs=170 gs=4 cs=0 l=0 c_cookie=1088871930464019276 s_cookie=3405183711252931827 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1c73406d33a34c server_cookie=2f41a48b402d64f3 in_seq=0 out_seq=0 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.571+0000 7f04dbfff640 10 client.17349 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f04dbfff640 1 -- 10.20.193.28:0/2343961595 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562fc3d1cdf0 con 0x562fc3e46590 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f04dbfff640 10 client.17349 handle_command_reply: tid=0 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 client.17349 shutdown 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03d20 msgr2=0x562fc3e1c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03d20 0x562fc3e1c210 secure :-1 s=READY pgs=748 gs=1 cs=0 l=1 c_cookie=14450255361971572827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05140044d0 tx=0x7f0514002a70 comp rx=0 tx=0).stop 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 shutdown_connections 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fc3e46590 0x562fc3e46a30 crc :-1 s=READY pgs=170 gs=4 cs=0 l=0 c_cookie=1088871930464019276 s_cookie=3405183711252931827 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03d20 0x562fc3e1c210 unknown :-1 s=CLOSED pgs=748 gs=1 cs=0 l=1 c_cookie=14450255361971572827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e21200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2343961595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03410 0x562fc3e1bcd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f04dbfff640 0 client.17349 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 >> 10.20.193.28:0/2343961595 conn(0x562fc3de1910 msgr2=0x562fc3e024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 shutdown_connections 2026-02-20T13:22:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2343961595 wait complete. 2026-02-20T13:22:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.572+0000 7f0532f2ce00 20 client.17349 trim_cache size 0 max 16384 2026-02-20T13:22:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.581+0000 7f0532f2ce00 1 Processor -- start 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.581+0000 7f0532f2ce00 1 -- start start 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.581+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e47ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.581+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e19090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.581+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e489c0 0x562fc3e195d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.581+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fc3d0d320 con 0x562fc3e03410 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.581+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fc39cd790 con 0x562fc3e03d20 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.581+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fc3e42db0 con 0x562fc3e489c0 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e19090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e19090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50780/0 (socket says 10.20.193.28:50780) 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 -- 10.20.193.28:0/1079835022 learned_addr learned my addr 10.20.193.28:0/1079835022 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f052a575640 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e47ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f052ad76640 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e489c0 0x562fc3e195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 -- 10.20.193.28:0/1079835022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e489c0 msgr2=0x562fc3e195d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e489c0 0x562fc3e195d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 -- 10.20.193.28:0/1079835022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 msgr2=0x562fc3e47ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e47ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 -- 10.20.193.28:0/1079835022 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc3e0dfd0 con 0x562fc3e03d20 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f052a575640 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e47ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f052ad76640 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e489c0 0x562fc3e195d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f0529d74640 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e19090 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=12166423928531108837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f051400fbd0 tx=0x7f051401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8d7d21a3ee8c3e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f04f64e6640 1 -- 10.20.193.28:0/1079835022 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0514034070 con 0x562fc3e03d20 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f04f64e6640 1 -- 10.20.193.28:0/1079835022 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x562fc39a59d0 con 0x562fc3e03d20 2026-02-20T13:22:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.582+0000 7f04f64e6640 1 -- 10.20.193.28:0/1079835022 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0514016070 con 0x562fc3e03d20 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 -- 10.20.193.28:0/1079835022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 msgr2=0x562fc3e19090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e19090 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=12166423928531108837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f051400fbd0 tx=0x7f051401f000 comp rx=0 tx=0).stop 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 -- 10.20.193.28:0/1079835022 shutdown_connections 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e489c0 0x562fc3e195d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e03d20 0x562fc3e19090 unknown :-1 s=CLOSED pgs=295 gs=1 cs=0 l=1 c_cookie=12166423928531108837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/1079835022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e47ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 -- 10.20.193.28:0/1079835022 >> 10.20.193.28:0/1079835022 conn(0x562fc3de1910 msgr2=0x562fc3e478e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 -- 10.20.193.28:0/1079835022 shutdown_connections 2026-02-20T13:22:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 -- 10.20.193.28:0/1079835022 wait complete. 2026-02-20T13:22:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.583+0000 7f0532f2ce00 1 -- start start 2026-02-20T13:22:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f0532f2ce00 1 Processor -- start 2026-02-20T13:22:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e22450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03d20 0x562fc3e22990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f0532f2ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e22ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fc3dde390 con 0x562fc3e03410 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fc3e280d0 con 0x562fc3e489c0 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f0532f2ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fc3ef5440 con 0x562fc3e03d20 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052ad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e22ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e22450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052ad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e22ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50796/0 (socket says 10.20.193.28:50796) 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052ad76640 1 -- 10.20.193.28:0/2538666836 learned_addr learned my addr 10.20.193.28:0/2538666836 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f0529d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03d20 0x562fc3e22990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052a575640 1 -- 10.20.193.28:0/2538666836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03d20 msgr2=0x562fc3e22990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052a575640 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03d20 0x562fc3e22990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052a575640 1 -- 10.20.193.28:0/2538666836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 msgr2=0x562fc3e22ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052a575640 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e22ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052a575640 1 -- 10.20.193.28:0/2538666836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051402b040 con 0x562fc3e03410 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052ad76640 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e22ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f052a575640 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e22450 secure :-1 s=READY pgs=749 gs=1 cs=0 l=1 c_cookie=8913914053995484913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05200098a0 tx=0x7f0520002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb4959aaac356f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.584+0000 7f04dbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f04dbfff640 1 -- 10.20.193.28:0/2538666836 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05200028c0 con 0x562fc3e03410 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f04dbfff640 1 -- 10.20.193.28:0/2538666836 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f052002fed0 con 0x562fc3e03410 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f04dbfff640 1 -- 10.20.193.28:0/2538666836 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f052004f460 con 0x562fc3e03410 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fc3cbb120 con 0x562fc3e03410 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f04dbfff640 1 -- 10.20.193.28:0/2538666836 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f052004f5f0 con 0x562fc3e03410 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 10 client.17355 _ll_register_callbacks cb 0x562fc3cc6b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f052003e040 con 0x562fc3e03410 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f04dbfff640 1 -- 10.20.193.28:0/2538666836 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0520002a20 con 0x562fc3e03410 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 10 client.17355 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562fc3c9ff70 con 0x562fc3e03410 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f04dbfff640 1 -- 10.20.193.28:0/2538666836 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f052002f9f0 con 0x562fc3e03410 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 10 client.17355 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 10 client.17355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 20 client.17355 populate_metadata read hostname 'trial028' 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fc3ef6c80 0x562fc3f17130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 4 client.17355 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.585+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562fc39a3220 con 0x562fc3ef6c80 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.586+0000 7f0529d74640 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fc3ef6c80 0x562fc3f17130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.586+0000 7f0529d74640 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fc3ef6c80 0x562fc3f17130 crc :-1 s=READY pgs=171 gs=4 cs=0 l=0 c_cookie=1385888846193316609 s_cookie=17076407028510487235 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133baa9017875301 server_cookie=ecfb95b7be59f2c3 in_seq=0 out_seq=0 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.586+0000 7f04dbfff640 10 client.17355 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f04dbfff640 1 -- 10.20.193.28:0/2538666836 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562fc39a3220 con 0x562fc3ef6c80 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f04dbfff640 10 client.17355 handle_command_reply: tid=0 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 client.17355 shutdown 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 msgr2=0x562fc3e22450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e22450 secure :-1 s=READY pgs=749 gs=1 cs=0 l=1 c_cookie=8913914053995484913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05200098a0 tx=0x7f0520002390 comp rx=0 tx=0).stop 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 shutdown_connections 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fc3ef6c80 0x562fc3f17130 crc :-1 s=READY pgs=171 gs=4 cs=0 l=0 c_cookie=1385888846193316609 s_cookie=17076407028510487235 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fc3e489c0 0x562fc3e22ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fc3e03d20 0x562fc3e22990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 --2- 10.20.193.28:0/2538666836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fc3e03410 0x562fc3e22450 unknown :-1 s=CLOSED pgs=749 gs=1 cs=0 l=1 c_cookie=8913914053995484913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f04dbfff640 0 client.17355 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 >> 10.20.193.28:0/2538666836 conn(0x562fc3de1910 msgr2=0x562fc3e47ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 shutdown_connections 2026-02-20T13:22:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 1 -- 10.20.193.28:0/2538666836 wait complete. 2026-02-20T13:22:36.596 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:22:36.596 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:22:36.597 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "ff70215d-9f90-4c31-8b7a-465fc8887428", 2026-02-20T13:22:36.597 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:22:36.597 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:22:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.587+0000 7f0532f2ce00 20 client.17355 trim_cache size 0 max 16384 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 -- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f05040b5760 msgr2=0x7f05040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f05040b5760 0x7f05040d5c10 secure :-1 s=READY pgs=382 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0520005b30 tx=0x7f052003a040 comp rx=0 tx=0).stop 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 -- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f052c113430 msgr2=0x7f052c120e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f052c113430 0x7f052c120e50 secure :-1 s=READY pgs=747 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f051c006e90 tx=0x7f051c00edf0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 -- 10.20.193.28:0/51355852 shutdown_connections 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f05040b5760 0x7f05040d5c10 unknown :-1 s=CLOSED pgs=382 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f052c113430 0x7f052c120e50 unknown :-1 s=CLOSED pgs=747 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f052c10dc30 0x7f052c11ba80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 --2- 10.20.193.28:0/51355852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f052c10d240 0x7f052c11b540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 -- 10.20.193.28:0/51355852 >> 10.20.193.28:0/51355852 conn(0x7f052c0eaad0 msgr2=0x7f052c10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 -- 10.20.193.28:0/51355852 shutdown_connections 2026-02-20T13:22:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:36.588+0000 7f052b577640 1 -- 10.20.193.28:0/51355852 wait complete. 2026-02-20T13:22:36.727 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:22:36.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:36 trial028 ceph-mon[37442]: pgmap v339: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:36.913 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:22:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:36 trial127 ceph-mon[43817]: pgmap v339: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:36 trial034 ceph-mon[43332]: pgmap v339: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:37.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.094+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3007978867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10fea0 msgr2=0x7f57dc114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.094+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3007978867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10fea0 0x7f57dc114ef0 secure :-1 s=READY pgs=750 gs=1 cs=0 l=1 c_cookie=10238353781052797628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57cc009950 tx=0x7f57cc02f190 comp rx=0 tx=0).stop 2026-02-20T13:22:37.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.094+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3007978867 shutdown_connections 2026-02-20T13:22:37.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.094+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3007978867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10fea0 0x7f57dc114ef0 unknown :-1 s=CLOSED pgs=750 gs=1 cs=0 l=1 c_cookie=10238353781052797628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.094+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3007978867 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f57dc1156a0 0x7f57dc176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.094+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3007978867 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f57dc10f4b0 0x7f57dc10f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.094+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3007978867 >> 10.20.193.28:0/3007978867 conn(0x7f57dc0ecd60 msgr2=0x7f57dc10d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:37.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.095+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3007978867 shutdown_connections 2026-02-20T13:22:37.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.095+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3007978867 wait complete. 2026-02-20T13:22:37.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.095+0000 7f57e0a7f640 1 Processor -- start 2026-02-20T13:22:37.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.095+0000 7f57e0a7f640 1 -- start start 2026-02-20T13:22:37.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57e0a7f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f57dc10f4b0 0x7f57dc0f5780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57e0a7f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f57dc10fea0 0x7f57dc175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57e0a7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc1156a0 0x7f57dc0f5e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57e0a7f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc0fb090 con 0x7f57dc1156a0 2026-02-20T13:22:37.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57e0a7f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc0fb200 con 0x7f57dc10f4b0 2026-02-20T13:22:37.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57e0a7f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc0fb3c0 con 0x7f57dc10fea0 2026-02-20T13:22:37.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57daffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f57dc10fea0 0x7f57dc175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57daffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f57dc10fea0 0x7f57dc175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54594/0 (socket says 10.20.193.28:54594) 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57daffd640 1 -- 10.20.193.28:0/3053193611 learned_addr learned my addr 10.20.193.28:0/3053193611 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57db7fe640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f57dc10f4b0 0x7f57dc0f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57dbfff640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc1156a0 0x7f57dc0f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57daffd640 1 -- 10.20.193.28:0/3053193611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f57dc10f4b0 msgr2=0x7f57dc0f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57daffd640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f57dc10f4b0 0x7f57dc0f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57daffd640 1 -- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc1156a0 msgr2=0x7f57dc0f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57daffd640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc1156a0 0x7f57dc0f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.096+0000 7f57daffd640 1 -- 10.20.193.28:0/3053193611 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57cc009570 con 0x7f57dc10fea0 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.097+0000 7f57daffd640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f57dc10fea0 0x7f57dc175f70 secure :-1 s=READY pgs=242 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57cc005b30 tx=0x7f57cc004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.097+0000 7f57d8ff9640 1 -- 10.20.193.28:0/3053193611 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57cc03d070 con 0x7f57dc10fea0 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.097+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3053193611 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc0fb640 con 0x7f57dc10fea0 2026-02-20T13:22:37.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.097+0000 7f57d8ff9640 1 -- 10.20.193.28:0/3053193611 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f57cc038920 con 0x7f57dc10fea0 2026-02-20T13:22:37.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.097+0000 7f57d8ff9640 1 -- 10.20.193.28:0/3053193611 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57cc0418a0 con 0x7f57dc10fea0 2026-02-20T13:22:37.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.097+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3053193611 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc0fbb00 con 0x7f57dc10fea0 2026-02-20T13:22:37.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.100+0000 7f57d8ff9640 1 -- 10.20.193.28:0/3053193611 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f57cc048020 con 0x7f57dc10fea0 2026-02-20T13:22:37.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.102+0000 7f57d8ff9640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57b00b5750 0x7f57b00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.102+0000 7f57d8ff9640 1 -- 10.20.193.28:0/3053193611 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f57cc10aef0 con 0x7f57dc10fea0 2026-02-20T13:22:37.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.102+0000 7f57db7fe640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57b00b5750 0x7f57b00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57db7fe640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57b00b5750 0x7f57b00d5c00 secure :-1 s=READY pgs=383 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8004740 tx=0x7f57c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:37.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57e3d02e00 1 Processor -- start 2026-02-20T13:22:37.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57e3d02e00 1 -- start start 2026-02-20T13:22:37.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8eeb90 0x5604af8eef60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af933e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af954730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604af7fc7d0 con 0x5604af8ef4a0 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5604af7f8500 con 0x5604af8eeb90 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5604af7f24a0 con 0x5604af934350 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57db7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8eeb90 0x5604af8eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57db7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8eeb90 0x5604af8eef60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50818/0 (socket says 10.20.193.28:50818) 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57db7fe640 1 -- 10.20.193.28:0/2080799777 learned_addr learned my addr 10.20.193.28:0/2080799777 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.103+0000 7f57daffd640 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af933e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f57dbfff640 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af954730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f57db7fe640 1 -- 10.20.193.28:0/2080799777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 msgr2=0x5604af954730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f57db7fe640 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af954730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f57db7fe640 1 -- 10.20.193.28:0/2080799777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 msgr2=0x5604af933e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:37.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f57db7fe640 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af933e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f57db7fe640 1 -- 10.20.193.28:0/2080799777 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604af79dd80 con 0x5604af8eeb90 2026-02-20T13:22:37.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f57daffd640 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af933e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:37.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f57db7fe640 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8eeb90 0x5604af8eef60 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=13334023850529563257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009cc0 tx=0x7f57c8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b90bf80b9d66a279 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:37.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f579ffff640 1 -- 10.20.193.28:0/2080799777 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57c8009dc0 con 0x5604af8eeb90 2026-02-20T13:22:37.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f579ffff640 1 -- 10.20.193.28:0/2080799777 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f57c80198e0 con 0x5604af8eeb90 2026-02-20T13:22:37.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.104+0000 7f579ffff640 1 -- 10.20.193.28:0/2080799777 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57c801bae0 con 0x5604af8eeb90 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 -- 10.20.193.28:0/2080799777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8eeb90 msgr2=0x5604af8eef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8eeb90 0x5604af8eef60 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=13334023850529563257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009cc0 tx=0x7f57c8014000 comp rx=0 tx=0).stop 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 -- 10.20.193.28:0/2080799777 shutdown_connections 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af933e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af954730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/2080799777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8eeb90 0x5604af8eef60 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=13334023850529563257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 -- 10.20.193.28:0/2080799777 >> 10.20.193.28:0/2080799777 conn(0x5604af8cd090 msgr2=0x5604af8ed470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 -- 10.20.193.28:0/2080799777 shutdown_connections 2026-02-20T13:22:37.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.105+0000 7f57e3d02e00 1 -- 10.20.193.28:0/2080799777 wait complete. 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.106+0000 7f57e3d02e00 1 -- start start 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.106+0000 7f57e3d02e00 1 Processor -- start 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af94bb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af94c070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af951060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604af9515a0 con 0x5604af8ef4a0 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5604af951710 con 0x5604af934350 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5604af9518d0 con 0x5604af8eeb90 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57db7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af94bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57db7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af94bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54600/0 (socket says 10.20.193.28:54600) 2026-02-20T13:22:37.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57db7fe640 1 -- 10.20.193.28:0/885252128 learned_addr learned my addr 10.20.193.28:0/885252128 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57daffd640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af94c070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57dbfff640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af951060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57db7fe640 1 -- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 msgr2=0x5604af951060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57db7fe640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af951060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57db7fe640 1 -- 10.20.193.28:0/885252128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 msgr2=0x5604af94c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57db7fe640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af94c070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57db7fe640 1 -- 10.20.193.28:0/885252128 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604af776350 con 0x5604af8eeb90 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57dbfff640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af951060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.107+0000 7f57daffd640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af94c070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:37.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f57db7fe640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af94bb30 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=13509659337621880268 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009450 tx=0x7f57c8009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb7bf3971f7dbdcc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f579d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f579d7fa640 1 -- 10.20.193.28:0/885252128 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57c8019610 con 0x5604af8eeb90 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f579d7fa640 1 -- 10.20.193.28:0/885252128 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f57c8019770 con 0x5604af8eeb90 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f579d7fa640 1 -- 10.20.193.28:0/885252128 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57c80054a0 con 0x5604af8eeb90 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c8009960 con 0x5604af8eeb90 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f579d7fa640 1 -- 10.20.193.28:0/885252128 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f57c8005630 con 0x5604af8eeb90 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f57e3d02e00 10 client.27241 _ll_register_callbacks cb 0x5604af7739a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604af4886f0 con 0x5604af8eeb90 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f579d7fa640 1 -- 10.20.193.28:0/885252128 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57c8005040 con 0x5604af8eeb90 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f57e3d02e00 10 client.27241 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:37.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.108+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5604af788150 con 0x5604af8eeb90 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.109+0000 7f579d7fa640 1 -- 10.20.193.28:0/885252128 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57c8036060 con 0x5604af8eeb90 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.109+0000 7f57e3d02e00 10 client.27241 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.109+0000 7f57e3d02e00 10 client.27241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.109+0000 7f57e3d02e00 20 client.27241 populate_metadata read hostname 'trial028' 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.109+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604af931320 0x5604af9317c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.109+0000 7f57e3d02e00 4 client.27241 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.109+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604af4886f0 con 0x5604af931320 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.109+0000 7f57daffd640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604af931320 0x5604af9317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.110+0000 7f57daffd640 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604af931320 0x5604af9317c0 crc :-1 s=READY pgs=172 gs=4 cs=0 l=0 c_cookie=16161044246155131191 s_cookie=809197223363996717 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e047901df3727937 server_cookie=b3ad8965bd7ec2d in_seq=0 out_seq=0 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.110+0000 7f579d7fa640 10 client.27241 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:37.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.110+0000 7f579d7fa640 1 -- 10.20.193.28:0/885252128 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5604af4886f0 con 0x5604af931320 2026-02-20T13:22:37.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.110+0000 7f579d7fa640 10 client.27241 handle_command_reply: tid=0 2026-02-20T13:22:37.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.110+0000 7f57e3d02e00 1 client.27241 shutdown 2026-02-20T13:22:37.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.110+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 msgr2=0x5604af94bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.110+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af94bb30 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=13509659337621880268 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009450 tx=0x7f57c8009f00 comp rx=0 tx=0).stop 2026-02-20T13:22:37.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 shutdown_connections 2026-02-20T13:22:37.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604af931320 0x5604af9317c0 crc :-1 s=READY pgs=172 gs=4 cs=0 l=0 c_cookie=16161044246155131191 s_cookie=809197223363996717 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af94c070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af951060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/885252128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af94bb30 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=13509659337621880268 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 >> 10.20.193.28:0/885252128 conn(0x5604af8cd090 msgr2=0x5604af8ed470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:37.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f579d7fa640 0 client.27241 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:37.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 shutdown_connections 2026-02-20T13:22:37.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 1 -- 10.20.193.28:0/885252128 wait complete. 2026-02-20T13:22:37.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.111+0000 7f57e3d02e00 20 client.27241 trim_cache size 0 max 16384 2026-02-20T13:22:37.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.121+0000 7f57e3d02e00 1 Processor -- start 2026-02-20T13:22:37.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.121+0000 7f57e3d02e00 1 -- start start 2026-02-20T13:22:37.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.121+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af9505d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.121+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af948f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.121+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af949440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.121+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604af7f00d0 con 0x5604af8ef4a0 2026-02-20T13:22:37.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.121+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5604af4b0700 con 0x5604af934350 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.121+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5604af94c650 con 0x5604af8eeb90 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af9505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57daffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af948f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af9505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54608/0 (socket says 10.20.193.28:54608) 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 -- 10.20.193.28:0/3534056888 learned_addr learned my addr 10.20.193.28:0/3534056888 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57dbfff640 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af949440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 -- 10.20.193.28:0/3534056888 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 msgr2=0x5604af949440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af949440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 -- 10.20.193.28:0/3534056888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 msgr2=0x5604af948f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af948f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 -- 10.20.193.28:0/3534056888 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604af782bd0 con 0x5604af8eeb90 2026-02-20T13:22:37.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57daffd640 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af948f00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:37.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f57db7fe640 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af9505d0 secure :-1 s=READY pgs=244 gs=2 cs=0 l=1 c_cookie=12032180063110098757 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8004350 tx=0x7f57c803d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6fae404a736ef45 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:37.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f579f7fe640 1 -- 10.20.193.28:0/3534056888 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57c801bbb0 con 0x5604af8eeb90 2026-02-20T13:22:37.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.122+0000 7f579f7fe640 1 -- 10.20.193.28:0/3534056888 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f57c803e020 con 0x5604af8eeb90 2026-02-20T13:22:37.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f579f7fe640 1 -- 10.20.193.28:0/3534056888 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57c802ebd0 con 0x5604af8eeb90 2026-02-20T13:22:37.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3534056888 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 msgr2=0x5604af9505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af9505d0 secure :-1 s=READY pgs=244 gs=2 cs=0 l=1 c_cookie=12032180063110098757 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8004350 tx=0x7f57c803d000 comp rx=0 tx=0).stop 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3534056888 shutdown_connections 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8ef4a0 0x5604af948f00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af934350 0x5604af949440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3534056888 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af8eeb90 0x5604af9505d0 unknown :-1 s=CLOSED pgs=244 gs=2 cs=0 l=1 c_cookie=12032180063110098757 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3534056888 >> 10.20.193.28:0/3534056888 conn(0x5604af8cd090 msgr2=0x5604af94fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3534056888 shutdown_connections 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3534056888 wait complete. 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.123+0000 7f57e3d02e00 1 -- start start 2026-02-20T13:22:37.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57e3d02e00 1 Processor -- start 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8eeb90 0x5604af950490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8ef4a0 0x5604af9509d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57e3d02e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af8cd460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604af9439a0 con 0x5604af8eeb90 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5604af944be0 con 0x5604af8ef4a0 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57e3d02e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5604af8cd9a0 con 0x5604af934350 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8eeb90 0x5604af950490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57daffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8ef4a0 0x5604af9509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57dbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af8cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57dbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af8cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54616/0 (socket says 10.20.193.28:54616) 2026-02-20T13:22:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57dbfff640 1 -- 10.20.193.28:0/3334896359 learned_addr learned my addr 10.20.193.28:0/3334896359 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.124+0000 7f57db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8eeb90 0x5604af950490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41200/0 (socket says 10.20.193.28:41200) 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57dbfff640 1 -- 10.20.193.28:0/3334896359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8ef4a0 msgr2=0x5604af9509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57dbfff640 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8ef4a0 0x5604af9509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57dbfff640 1 -- 10.20.193.28:0/3334896359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8eeb90 msgr2=0x5604af950490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57dbfff640 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8eeb90 0x5604af950490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57dbfff640 1 -- 10.20.193.28:0/3334896359 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604af788150 con 0x5604af934350 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57dbfff640 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af8cd460 secure :-1 s=READY pgs=245 gs=3 cs=0 l=1 c_cookie=18238338356772839057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57d0004a90 tx=0x7f57d0004f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd1b981ac8d39e91 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f579d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f579d7fa640 1 -- 10.20.193.28:0/3334896359 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57d0018070 con 0x5604af934350 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f579d7fa640 1 -- 10.20.193.28:0/3334896359 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f57d0008df0 con 0x5604af934350 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc0fbb00 con 0x5604af934350 2026-02-20T13:22:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57e3d02e00 10 client.27247 _ll_register_callbacks cb 0x5604af7739a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57c80198e0 con 0x5604af934350 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.125+0000 7f579d7fa640 1 -- 10.20.193.28:0/3334896359 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57d0011c50 con 0x5604af934350 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f579d7fa640 1 -- 10.20.193.28:0/3334896359 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f57d0011db0 con 0x5604af934350 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f579d7fa640 1 -- 10.20.193.28:0/3334896359 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57d0015eb0 con 0x5604af934350 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57e3d02e00 10 client.27247 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5604af776680 con 0x5604af934350 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f579d7fa640 1 -- 10.20.193.28:0/3334896359 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57d00136a0 con 0x5604af934350 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57e3d02e00 10 client.27247 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57e3d02e00 10 client.27247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57e3d02e00 20 client.27247 populate_metadata read hostname 'trial028' 2026-02-20T13:22:37.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604af9e1760 0x5604afa01be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57e3d02e00 4 client.27247 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:22:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5604af7ffd60 con 0x5604af9e1760 2026-02-20T13:22:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.126+0000 7f57db7fe640 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604af9e1760 0x5604afa01be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.127+0000 7f57db7fe640 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604af9e1760 0x5604afa01be0 crc :-1 s=READY pgs=173 gs=4 cs=0 l=0 c_cookie=9580342423554647880 s_cookie=14615389934775640961 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84f436ace6946748 server_cookie=cad44bb5c41f2381 in_seq=0 out_seq=0 2026-02-20T13:22:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.127+0000 7f579d7fa640 10 client.27247 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.127+0000 7f579d7fa640 1 -- 10.20.193.28:0/3334896359 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x5604af7ffd60 con 0x5604af9e1760 2026-02-20T13:22:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.127+0000 7f579d7fa640 10 client.27247 handle_command_reply: tid=0 2026-02-20T13:22:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.127+0000 7f57e3d02e00 1 client.27247 shutdown 2026-02-20T13:22:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 msgr2=0x5604af8cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af8cd460 secure :-1 s=READY pgs=245 gs=3 cs=0 l=1 c_cookie=18238338356772839057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57d0004a90 tx=0x7f57d0004f60 comp rx=0 tx=0).stop 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 shutdown_connections 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5604af9e1760 0x5604afa01be0 crc :-1 s=READY pgs=173 gs=4 cs=0 l=0 c_cookie=9580342423554647880 s_cookie=14615389934775640961 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5604af934350 0x5604af8cd460 unknown :-1 s=CLOSED pgs=245 gs=3 cs=0 l=1 c_cookie=18238338356772839057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5604af8ef4a0 0x5604af9509d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 --2- 10.20.193.28:0/3334896359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604af8eeb90 0x5604af950490 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f579d7fa640 0 client.27247 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 >> 10.20.193.28:0/3334896359 conn(0x5604af8cd090 msgr2=0x5604af932670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 shutdown_connections 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 1 -- 10.20.193.28:0/3334896359 wait complete. 2026-02-20T13:22:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e3d02e00 20 client.27247 trim_cache size 0 max 16384 2026-02-20T13:22:37.137 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:22:37.137 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:22:37.137 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:22:37.137 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:22:37.137 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.137 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "ff70215d-9f90-4c31-8b7a-465fc8887428", 2026-02-20T13:22:37.137 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:22:37.137 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:22:37.138 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.139 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:22:37.140 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.141 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.142 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:22:37.143 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57b00b5750 msgr2=0x7f57b00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57b00b5750 0x7f57b00d5c00 secure :-1 s=READY pgs=383 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8004740 tx=0x7f57c8005f90 comp rx=0 tx=0).stop 2026-02-20T13:22:37.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3053193611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f57dc10fea0 msgr2=0x7f57dc175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.128+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f57dc10fea0 0x7f57dc175f70 secure :-1 s=READY pgs=242 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57cc005b30 tx=0x7f57cc004340 comp rx=0 tx=0).stop 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.129+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3053193611 shutdown_connections 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.129+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f57b00b5750 0x7f57b00d5c00 unknown :-1 s=CLOSED pgs=383 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.129+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc1156a0 0x7f57dc0f5e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.129+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f57dc10fea0 0x7f57dc175f70 unknown :-1 s=CLOSED pgs=242 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.129+0000 7f57e0a7f640 1 --2- 10.20.193.28:0/3053193611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f57dc10f4b0 0x7f57dc0f5780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.129+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3053193611 >> 10.20.193.28:0/3053193611 conn(0x7f57dc0ecd60 msgr2=0x7f57dc111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.129+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3053193611 shutdown_connections 2026-02-20T13:22:37.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:22:37.129+0000 7f57e0a7f640 1 -- 10.20.193.28:0/3053193611 wait complete. 2026-02-20T13:22:37.230 INFO:tasks.cephfs.filesystem:scrub status for tag:ff70215d-9f90-4c31-8b7a-465fc8887428 - {'path': '/', 'tag': 'ff70215d-9f90-4c31-8b7a-465fc8887428', 'options': 'recursive,force'} 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:22:37.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:22:37.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:22:37.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:37 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:22:37.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:22:37.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:37 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:22:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:22:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:22:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:22:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:22:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:22:38.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:22:38.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:22:38.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:22:38.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:37 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:22:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:38 trial127 ceph-mon[43817]: pgmap v340: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:22:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:38 trial034 ceph-mon[43332]: pgmap v340: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:22:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:38 trial028 ceph-mon[37442]: pgmap v340: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:22:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:40 trial127 ceph-mon[43817]: pgmap v341: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:22:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:40 trial034 ceph-mon[43332]: pgmap v341: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:22:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:40 trial028 ceph-mon[37442]: pgmap v341: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:22:41.169 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.169 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.169 INFO:tasks.workunit.client.0.trial028.stdout:127/600: open fd = 3 2026-02-20T13:22:41.169 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.169 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.169 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.169 INFO:tasks.workunit.client.0.trial028.stdout:128/600: open fd = 3 2026-02-20T13:22:41.169 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:129/600: open fd = 3 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:130/600: open fd = 3 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:131/600: open fd = 3 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.170 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:132/600: open fd = 3 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:133/600: open fd = 3 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:134/600: open fd = 3 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.171 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:135/600: open fd = 3 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:136/600: open fd = 3 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:137/600: open fd = 3 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:138/600: open fd = 3 2026-02-20T13:22:41.172 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:139/600: open fd = 3 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:140/600: open fd = 3 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:141/600: open fd = 3 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.173 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:142/600: open fd = 3 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:143/600: open fd = 3 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:144/600: open fd = 3 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.174 INFO:tasks.workunit.client.0.trial028.stdout:145/600: open fd = 3 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:146/600: open fd = 3 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:147/600: open fd = 3 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:148/600: open fd = 3 2026-02-20T13:22:41.175 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:149/600: open fd = 3 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:150/600: open fd = 3 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:151/600: open fd = 3 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.176 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:152/600: open fd = 3 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:153/600: open fd = 3 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:154/600: open fd = 3 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:155/600: open fd = 3 2026-02-20T13:22:41.177 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:156/600: open fd = 3 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:157/600: open fd = 3 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:158/600: open fd = 3 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.178 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:159/600: open fd = 3 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:160/600: open fd = 3 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:161/600: open fd = 3 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.179 INFO:tasks.workunit.client.0.trial028.stdout:162/600: open fd = 3 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:163/600: open fd = 3 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:164/600: open fd = 3 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:165/600: open fd = 3 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.180 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:166/600: open fd = 3 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:167/600: open fd = 3 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:168/600: open fd = 3 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.181 INFO:tasks.workunit.client.0.trial028.stdout:169/600: open fd = 3 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:170/600: open fd = 3 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:171/600: open fd = 3 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:172/600: open fd = 3 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.182 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:173/600: open fd = 3 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:174/600: open fd = 3 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:175/600: open fd = 3 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.183 INFO:tasks.workunit.client.0.trial028.stdout:176/600: open fd = 3 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:177/600: open fd = 3 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:178/600: open fd = 3 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:179/600: open fd = 3 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.184 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:180/600: open fd = 3 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:181/600: open fd = 3 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:182/600: open fd = 3 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.185 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:183/600: open fd = 3 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:184/600: open fd = 3 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:185/600: open fd = 3 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:186/600: open fd = 3 2026-02-20T13:22:41.186 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:187/600: open fd = 3 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:188/600: open fd = 3 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:41.187 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:22:42.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 -- 10.20.193.28:0/1058514645 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9418155330 msgr2=0x7f94181757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 --2- 10.20.193.28:0/1058514645 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9418155330 0x7f94181757e0 secure :-1 s=READY pgs=246 gs=2 cs=0 l=1 c_cookie=17890021707551583813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940800aa30 tx=0x7f9408030270 comp rx=0 tx=0).stop 2026-02-20T13:22:42.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 -- 10.20.193.28:0/1058514645 shutdown_connections 2026-02-20T13:22:42.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 --2- 10.20.193.28:0/1058514645 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9418155330 0x7f94181757e0 unknown :-1 s=CLOSED pgs=246 gs=2 cs=0 l=1 c_cookie=17890021707551583813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 --2- 10.20.193.28:0/1058514645 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9418134720 0x7f9418154ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 --2- 10.20.193.28:0/1058514645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9418113d70 0x7f9418134150 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 -- 10.20.193.28:0/1058514645 >> 10.20.193.28:0/1058514645 conn(0x7f9418064440 msgr2=0x7f9418064860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 -- 10.20.193.28:0/1058514645 shutdown_connections 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.903+0000 7f9417fff640 1 -- 10.20.193.28:0/1058514645 wait complete. 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9417fff640 1 Processor -- start 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9417fff640 1 -- start start 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9417fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9418113d70 0x7f9418154b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9417fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9418134720 0x7f9418175710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9417fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9418155330 0x7f94180ff970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9417fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9418100100 con 0x7f9418134720 2026-02-20T13:22:42.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9417fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9418100270 con 0x7f9418113d70 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9417fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9418100980 con 0x7f9418155330 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94177fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9418155330 0x7f94180ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9418134720 0x7f9418175710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9418134720 0x7f9418175710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40432/0 (socket says 10.20.193.28:40432) 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94167fc640 1 -- 10.20.193.28:0/1251850510 learned_addr learned my addr 10.20.193.28:0/1251850510 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f9416ffd640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9418113d70 0x7f9418154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94167fc640 1 -- 10.20.193.28:0/1251850510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9418155330 msgr2=0x7f94180ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94167fc640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9418155330 0x7f94180ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94167fc640 1 -- 10.20.193.28:0/1251850510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9418113d70 msgr2=0x7f9418154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94167fc640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9418113d70 0x7f9418154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.904+0000 7f94167fc640 1 -- 10.20.193.28:0/1251850510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c0094b0 con 0x7f9418134720 2026-02-20T13:22:42.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.905+0000 7f94167fc640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9418134720 0x7f9418175710 secure :-1 s=READY pgs=751 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9400009480 tx=0x7f940000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:42.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.905+0000 7f941c94a640 1 -- 10.20.193.28:0/1251850510 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f940000ccc0 con 0x7f9418134720 2026-02-20T13:22:42.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.905+0000 7f941c94a640 1 -- 10.20.193.28:0/1251850510 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f940000ce20 con 0x7f9418134720 2026-02-20T13:22:42.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.905+0000 7f9417fff640 1 -- 10.20.193.28:0/1251850510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940800a650 con 0x7f9418134720 2026-02-20T13:22:42.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.905+0000 7f941c94a640 1 -- 10.20.193.28:0/1251850510 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94000106b0 con 0x7f9418134720 2026-02-20T13:22:42.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.905+0000 7f9417fff640 1 -- 10.20.193.28:0/1251850510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9418100fa0 con 0x7f9418134720 2026-02-20T13:22:42.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.908+0000 7f941c94a640 1 -- 10.20.193.28:0/1251850510 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f940001f060 con 0x7f9418134720 2026-02-20T13:22:42.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.909+0000 7f941c94a640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93ec0b5760 0x7f93ec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.909+0000 7f941c94a640 1 -- 10.20.193.28:0/1251850510 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9400014070 con 0x7f9418134720 2026-02-20T13:22:42.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.909+0000 7f9416ffd640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93ec0b5760 0x7f93ec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f9416ffd640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93ec0b5760 0x7f93ec0d5c10 secure :-1 s=READY pgs=384 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94181550b0 tx=0x7f940c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:42.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f942003ae00 1 Processor -- start 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f942003ae00 1 -- start start 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f942003ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a7b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f942003ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 0x55cad4a9c1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f942003ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4abcae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f942003ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cad4970fd0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f942003ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cad496cd00 con 0x55cad4a7bde0 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.910+0000 7f942003ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cad4966ca0 con 0x55cad4a9c700 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a7b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a7b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40442/0 (socket says 10.20.193.28:40442) 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 -- 10.20.193.28:0/1856969485 learned_addr learned my addr 10.20.193.28:0/1856969485 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f94177fe640 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4abcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f94167fc640 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 0x55cad4a9c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 -- 10.20.193.28:0/1856969485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 msgr2=0x55cad4abcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4abcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 -- 10.20.193.28:0/1856969485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 msgr2=0x55cad4a9c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 0x55cad4a9c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 -- 10.20.193.28:0/1856969485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad49098b0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f9416ffd640 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a7b8a0 secure :-1 s=READY pgs=752 gs=1 cs=0 l=1 c_cookie=3122599776699060296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940c009e20 tx=0x7f940c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b55b3f3e1dc9048 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:42.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f93e37fe640 1 -- 10.20.193.28:0/1856969485 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f940c012b70 con 0x55cad4a5b4c0 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f93e37fe640 1 -- 10.20.193.28:0/1856969485 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f940c016070 con 0x55cad4a5b4c0 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f93e37fe640 1 -- 10.20.193.28:0/1856969485 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f940c01e720 con 0x55cad4a5b4c0 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f942003ae00 1 -- 10.20.193.28:0/1856969485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 msgr2=0x55cad4a7b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.911+0000 7f942003ae00 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a7b8a0 secure :-1 s=READY pgs=752 gs=1 cs=0 l=1 c_cookie=3122599776699060296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940c009e20 tx=0x7f940c014000 comp rx=0 tx=0).stop 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.912+0000 7f942003ae00 1 -- 10.20.193.28:0/1856969485 shutdown_connections 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.912+0000 7f942003ae00 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4abcae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.912+0000 7f942003ae00 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 0x55cad4a9c1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.912+0000 7f942003ae00 1 --2- 10.20.193.28:0/1856969485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a7b8a0 unknown :-1 s=CLOSED pgs=752 gs=1 cs=0 l=1 c_cookie=3122599776699060296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.912+0000 7f942003ae00 1 -- 10.20.193.28:0/1856969485 >> 10.20.193.28:0/1856969485 conn(0x55cad497a1c0 msgr2=0x55cad4a59da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.912+0000 7f942003ae00 1 -- 10.20.193.28:0/1856969485 shutdown_connections 2026-02-20T13:22:42.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.912+0000 7f942003ae00 1 -- 10.20.193.28:0/1856969485 wait complete. 2026-02-20T13:22:42.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.913+0000 7f942003ae00 1 -- start start 2026-02-20T13:22:42.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.913+0000 7f942003ae00 1 Processor -- start 2026-02-20T13:22:42.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f942003ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4abcae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f942003ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a7bde0 0x55cad4a95500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f942003ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 0x55cad4a95bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f942003ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cad4a965c0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f942003ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cad4a96730 con 0x55cad4a9c700 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f942003ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cad4a968f0 con 0x55cad4a7bde0 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f9416ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4abcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f9416ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4abcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40444/0 (socket says 10.20.193.28:40444) 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f94167fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a7bde0 0x55cad4a95500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f9416ffd640 1 -- 10.20.193.28:0/3095158337 learned_addr learned my addr 10.20.193.28:0/3095158337 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f94177fe640 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 0x55cad4a95bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f9416ffd640 1 -- 10.20.193.28:0/3095158337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a7bde0 msgr2=0x55cad4a95500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f9416ffd640 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a7bde0 0x55cad4a95500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f9416ffd640 1 -- 10.20.193.28:0/3095158337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 msgr2=0x55cad4a95bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f9416ffd640 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 0x55cad4a95bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.914+0000 7f9416ffd640 1 -- 10.20.193.28:0/3095158337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad4912400 con 0x55cad4a5b4c0 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f9416ffd640 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4abcae0 secure :-1 s=READY pgs=753 gs=1 cs=0 l=1 c_cookie=12101253216879826095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940c01e010 tx=0x7f940c002c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f049af812cd4af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f93e0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3095158337 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f940c02c070 con 0x55cad4a5b4c0 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c002df0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f942003ae00 10 client.17382 _ll_register_callbacks cb 0x55cad48f1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cad4606520 con 0x55cad4a5b4c0 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3095158337 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f940c016050 con 0x55cad4a5b4c0 2026-02-20T13:22:42.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3095158337 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f940c027460 con 0x55cad4a5b4c0 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3095158337 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f940c0275f0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3095158337 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f940c0277b0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f942003ae00 10 client.17382 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cad48eada0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3095158337 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f940c038060 con 0x55cad4a5b4c0 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f942003ae00 10 client.17382 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.915+0000 7f942003ae00 10 client.17382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.916+0000 7f942003ae00 20 client.17382 populate_metadata read hostname 'trial028' 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.916+0000 7f942003ae00 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cad4a99810 0x55cad4a99cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.916+0000 7f942003ae00 4 client.17382 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.916+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cad4998630 con 0x55cad4a99810 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.916+0000 7f94167fc640 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cad4a99810 0x55cad4a99cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f94167fc640 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cad4a99810 0x55cad4a99cb0 crc :-1 s=READY pgs=174 gs=4 cs=0 l=0 c_cookie=2637806419935641498 s_cookie=13576458724354321311 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=249b5ef696823f9a server_cookie=bc69454754e46b9f in_seq=0 out_seq=0 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f93e0ff9640 10 client.17382 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3095158337 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cad4998630 con 0x55cad4a99810 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f93e0ff9640 10 client.17382 handle_command_reply: tid=0 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 client.17382 shutdown 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 msgr2=0x55cad4abcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4abcae0 secure :-1 s=READY pgs=753 gs=1 cs=0 l=1 c_cookie=12101253216879826095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940c01e010 tx=0x7f940c002c10 comp rx=0 tx=0).stop 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 shutdown_connections 2026-02-20T13:22:42.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cad4a99810 0x55cad4a99cb0 crc :-1 s=READY pgs=174 gs=4 cs=0 l=0 c_cookie=2637806419935641498 s_cookie=13576458724354321311 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 0x55cad4a95bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a7bde0 0x55cad4a95500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 --2- 10.20.193.28:0/3095158337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4abcae0 unknown :-1 s=CLOSED pgs=753 gs=1 cs=0 l=1 c_cookie=12101253216879826095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.917+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 >> 10.20.193.28:0/3095158337 conn(0x55cad497a1c0 msgr2=0x55cad4a7d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:42.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.918+0000 7f93e0ff9640 0 client.17382 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:42.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.918+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 shutdown_connections 2026-02-20T13:22:42.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.918+0000 7f942003ae00 1 -- 10.20.193.28:0/3095158337 wait complete. 2026-02-20T13:22:42.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.918+0000 7f942003ae00 20 client.17382 trim_cache size 0 max 16384 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.925+0000 7f942003ae00 1 Processor -- start 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.925+0000 7f942003ae00 1 -- start start 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.925+0000 7f942003ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a5b4c0 0x55cad4a9bf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.925+0000 7f942003ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a7bde0 0x55cad4a92720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.925+0000 7f942003ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 0x55cad4a92c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.925+0000 7f942003ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cad49648d0 con 0x55cad4a7bde0 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.925+0000 7f942003ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cad46a5f10 con 0x55cad4a9c700 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.925+0000 7f942003ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cad49cc4f0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f94167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a7bde0 0x55cad4a92720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f9416ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a5b4c0 0x55cad4a9bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f9416ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a5b4c0 0x55cad4a9bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:59148/0 (socket says 10.20.193.28:59148) 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f9416ffd640 1 -- 10.20.193.28:0/3019929741 learned_addr learned my addr 10.20.193.28:0/3019929741 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f94177fe640 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 0x55cad4a92c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f94167fc640 1 -- 10.20.193.28:0/3019929741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a5b4c0 msgr2=0x55cad4a9bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f94167fc640 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a5b4c0 0x55cad4a9bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f94167fc640 1 -- 10.20.193.28:0/3019929741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 msgr2=0x55cad4a92c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f94167fc640 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 0x55cad4a92c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f94167fc640 1 -- 10.20.193.28:0/3019929741 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad48fc670 con 0x55cad4a7bde0 2026-02-20T13:22:42.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f9416ffd640 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a5b4c0 0x55cad4a9bf30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f94167fc640 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a7bde0 0x55cad4a92720 secure :-1 s=READY pgs=754 gs=2 cs=0 l=1 c_cookie=18163552712210249348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94000e4770 tx=0x7f9400004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc11e6f5065ff684 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f93e2ffd640 1 -- 10.20.193.28:0/3019929741 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9400096040 con 0x55cad4a7bde0 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f93e2ffd640 1 -- 10.20.193.28:0/3019929741 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f94000b2d20 con 0x55cad4a7bde0 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f93e2ffd640 1 -- 10.20.193.28:0/3019929741 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94000a9270 con 0x55cad4a7bde0 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 -- 10.20.193.28:0/3019929741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a7bde0 msgr2=0x55cad4a92720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a7bde0 0x55cad4a92720 secure :-1 s=READY pgs=754 gs=2 cs=0 l=1 c_cookie=18163552712210249348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94000e4770 tx=0x7f9400004040 comp rx=0 tx=0).stop 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 -- 10.20.193.28:0/3019929741 shutdown_connections 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a7bde0 0x55cad4a92720 unknown :-1 s=CLOSED pgs=754 gs=2 cs=0 l=1 c_cookie=18163552712210249348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a9c700 0x55cad4a92c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 --2- 10.20.193.28:0/3019929741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a5b4c0 0x55cad4a9bf30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 -- 10.20.193.28:0/3019929741 >> 10.20.193.28:0/3019929741 conn(0x55cad497a1c0 msgr2=0x55cad4a9b820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 -- 10.20.193.28:0/3019929741 shutdown_connections 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.926+0000 7f942003ae00 1 -- 10.20.193.28:0/3019929741 wait complete. 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.927+0000 7f942003ae00 1 -- start start 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.927+0000 7f942003ae00 1 Processor -- start 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.927+0000 7f942003ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a60e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.927+0000 7f942003ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 0x55cad4a613a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.927+0000 7f942003ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4a5fbc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.927+0000 7f942003ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cad4a94cc0 con 0x55cad4a5b4c0 2026-02-20T13:22:42.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.927+0000 7f942003ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cad4a60100 con 0x55cad4a7bde0 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.927+0000 7f942003ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cad4a602c0 con 0x55cad4a9c700 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4a5fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4a5fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:59156/0 (socket says 10.20.193.28:59156) 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 -- 10.20.193.28:0/3003502893 learned_addr learned my addr 10.20.193.28:0/3003502893 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f9416ffd640 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a60e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94167fc640 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 0x55cad4a613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 -- 10.20.193.28:0/3003502893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 msgr2=0x55cad4a613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 0x55cad4a613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 -- 10.20.193.28:0/3003502893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 msgr2=0x55cad4a60e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a60e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 -- 10.20.193.28:0/3003502893 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad48f70f0 con 0x55cad4a9c700 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f9416ffd640 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a60e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f94177fe640 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4a5fbc0 secure :-1 s=READY pgs=247 gs=2 cs=0 l=1 c_cookie=2148599722105990786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9408003e60 tx=0x7f94080039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dd15c1040a16e82 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.928+0000 7f93e0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3003502893 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f940803e040 con 0x55cad4a9c700 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3003502893 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f940803f040 con 0x55cad4a9c700 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3003502893 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94080478c0 con 0x55cad4a9c700 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9418100fa0 con 0x55cad4a9c700 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3003502893 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f94080050c0 con 0x55cad4a9c700 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 10 client.27265 _ll_register_callbacks cb 0x55cad48f1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:42.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cad4a16ca0 con 0x55cad4a9c700 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3003502893 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9408005280 con 0x55cad4a9c700 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 10 client.27265 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cad48eb0d0 con 0x55cad4a9c700 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3003502893 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f94080054a0 con 0x55cad4a9c700 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 10 client.27265 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 10 client.27265 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 20 client.27265 populate_metadata read hostname 'trial028' 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cad4b5afd0 0x55cad4b7b430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 4 client.27265 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.929+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cad464a640 con 0x55cad4b5afd0 2026-02-20T13:22:42.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.930+0000 7f9416ffd640 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cad4b5afd0 0x55cad4b7b430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:42.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.930+0000 7f9416ffd640 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cad4b5afd0 0x55cad4b7b430 crc :-1 s=READY pgs=175 gs=4 cs=0 l=0 c_cookie=18416311887738501106 s_cookie=2581341114623723509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff93e2168d74f7f2 server_cookie=23d2c411354207f5 in_seq=0 out_seq=0 2026-02-20T13:22:42.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.930+0000 7f93e0ff9640 10 client.27265 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:42.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.935+0000 7f93e0ff9640 1 -- 10.20.193.28:0/3003502893 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cad464a640 con 0x55cad4b5afd0 2026-02-20T13:22:42.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.935+0000 7f93e0ff9640 10 client.27265 handle_command_reply: tid=0 2026-02-20T13:22:42.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.935+0000 7f942003ae00 1 client.27265 shutdown 2026-02-20T13:22:42.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.935+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 msgr2=0x55cad4a5fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.935+0000 7f942003ae00 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4a5fbc0 secure :-1 s=READY pgs=247 gs=2 cs=0 l=1 c_cookie=2148599722105990786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9408003e60 tx=0x7f94080039b0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 shutdown_connections 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55cad4b5afd0 0x55cad4b7b430 crc :-1 s=READY pgs=175 gs=4 cs=0 l=0 c_cookie=18416311887738501106 s_cookie=2581341114623723509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cad4a9c700 0x55cad4a5fbc0 unknown :-1 s=CLOSED pgs=247 gs=2 cs=0 l=1 c_cookie=2148599722105990786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cad4a7bde0 0x55cad4a613a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 1 --2- 10.20.193.28:0/3003502893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad4a5b4c0 0x55cad4a60e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f93e0ff9640 0 client.27265 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 >> 10.20.193.28:0/3003502893 conn(0x55cad497a1c0 msgr2=0x55cad4a91710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 shutdown_connections 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 1 -- 10.20.193.28:0/3003502893 wait complete. 2026-02-20T13:22:42.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f942003ae00 20 client.27265 trim_cache size 0 max 16384 2026-02-20T13:22:42.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:22:42.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:22:42.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:22:42.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 -- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93ec0b5760 msgr2=0x7f93ec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93ec0b5760 0x7f93ec0d5c10 secure :-1 s=READY pgs=384 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94181550b0 tx=0x7f940c005f90 comp rx=0 tx=0).stop 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 -- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9418134720 msgr2=0x7f9418175710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9418134720 0x7f9418175710 secure :-1 s=READY pgs=751 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9400009480 tx=0x7f940000ee60 comp rx=0 tx=0).stop 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 -- 10.20.193.28:0/1251850510 shutdown_connections 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93ec0b5760 0x7f93ec0d5c10 unknown :-1 s=CLOSED pgs=384 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9418134720 0x7f9418175710 unknown :-1 s=CLOSED pgs=751 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9418155330 0x7f94180ff970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 --2- 10.20.193.28:0/1251850510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9418113d70 0x7f9418154b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:42.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 -- 10.20.193.28:0/1251850510 >> 10.20.193.28:0/1251850510 conn(0x7f9418064440 msgr2=0x7f94180f6200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:42.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 -- 10.20.193.28:0/1251850510 shutdown_connections 2026-02-20T13:22:42.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:42.936+0000 7f9417fff640 1 -- 10.20.193.28:0/1251850510 wait complete. 2026-02-20T13:22:42.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:42 trial127 ceph-mon[43817]: pgmap v342: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:22:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:42 trial034 ceph-mon[43332]: pgmap v342: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:22:43.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:42 trial028 ceph-mon[37442]: pgmap v342: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:22:43.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:43 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:22:43.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:43 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:22:43.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:43 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:22:43.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:43 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:22:44.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:43 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:22:44.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:43 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:22:44.891 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:44 trial034 ceph-mon[43332]: pgmap v343: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:22:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:44 trial127 ceph-mon[43817]: pgmap v343: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:22:45.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:44 trial028 ceph-mon[37442]: pgmap v343: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:22:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:46 trial127 ceph-mon[43817]: pgmap v344: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2026-02-20T13:22:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:46 trial034 ceph-mon[43332]: pgmap v344: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2026-02-20T13:22:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:46 trial028 ceph-mon[37442]: pgmap v344: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2026-02-20T13:22:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:48 trial127 ceph-mon[43817]: pgmap v345: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:22:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:48 trial034 ceph-mon[43332]: pgmap v345: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:22:49.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:48 trial028 ceph-mon[37442]: pgmap v345: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:22:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:50 trial127 ceph-mon[43817]: pgmap v346: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:50 trial034 ceph-mon[43332]: pgmap v346: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:51.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:50 trial028 ceph-mon[37442]: pgmap v346: 97 pgs: 97 active+clean; 3.1 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:22:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:52 trial127 ceph-mon[43817]: pgmap v347: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:22:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:52 trial034 ceph-mon[43332]: pgmap v347: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:22:53.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:52 trial028 ceph-mon[37442]: pgmap v347: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:22:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:54 trial127 ceph-mon[43817]: pgmap v348: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:22:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:54 trial034 ceph-mon[43332]: pgmap v348: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:22:55.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:54 trial028 ceph-mon[37442]: pgmap v348: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:22:56.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 -- 10.20.193.28:0/1089682545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 msgr2=0x7f494010cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 --2- 10.20.193.28:0/1089682545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 0x7f494010cf70 secure :-1 s=READY pgs=755 gs=1 cs=0 l=1 c_cookie=10960032666457543325 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4930009980 tx=0x7f493002f190 comp rx=0 tx=0).stop 2026-02-20T13:22:56.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 -- 10.20.193.28:0/1089682545 shutdown_connections 2026-02-20T13:22:56.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 --2- 10.20.193.28:0/1089682545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 0x7f494010cf70 unknown :-1 s=CLOSED pgs=755 gs=1 cs=0 l=1 c_cookie=10960032666457543325 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 --2- 10.20.193.28:0/1089682545 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f494010d4b0 0x7f494016f240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 --2- 10.20.193.28:0/1089682545 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f494010e270 0x7f494010e660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 -- 10.20.193.28:0/1089682545 >> 10.20.193.28:0/1089682545 conn(0x7f49400ea4c0 msgr2=0x7f494010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:56.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 -- 10.20.193.28:0/1089682545 shutdown_connections 2026-02-20T13:22:56.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.009+0000 7f4944964640 1 -- 10.20.193.28:0/1089682545 wait complete. 2026-02-20T13:22:56.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f4944964640 1 Processor -- start 2026-02-20T13:22:56.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f4944964640 1 -- start start 2026-02-20T13:22:56.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f4944964640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 0x7f49400f9150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f4944964640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f494010d4b0 0x7f494016f240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f4944964640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f494010e270 0x7f49400f99b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f4944964640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49400fa5a0 con 0x7f494010cb00 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f4944964640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f49400fa710 con 0x7f494010e270 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f4944964640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f49400fa8d0 con 0x7f494010d4b0 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 0x7f49400f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 0x7f49400f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54464/0 (socket says 10.20.193.28:54464) 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f493f7fe640 1 -- 10.20.193.28:0/4233542527 learned_addr learned my addr 10.20.193.28:0/4233542527 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.010+0000 7f493effd640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f494010d4b0 0x7f494016f240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493ffff640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f494010e270 0x7f49400f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493f7fe640 1 -- 10.20.193.28:0/4233542527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f494010d4b0 msgr2=0x7f494016f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493f7fe640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f494010d4b0 0x7f494016f240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493f7fe640 1 -- 10.20.193.28:0/4233542527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f494010e270 msgr2=0x7f49400f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493f7fe640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f494010e270 0x7f49400f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493f7fe640 1 -- 10.20.193.28:0/4233542527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4930009570 con 0x7f494010cb00 2026-02-20T13:22:56.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493f7fe640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 0x7f49400f9150 secure :-1 s=READY pgs=756 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f492c009480 tx=0x7f492c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:56.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493cff9640 1 -- 10.20.193.28:0/4233542527 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f492c00cd40 con 0x7f494010cb00 2026-02-20T13:22:56.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493cff9640 1 -- 10.20.193.28:0/4233542527 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f492c004d30 con 0x7f494010cb00 2026-02-20T13:22:56.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f493cff9640 1 -- 10.20.193.28:0/4233542527 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f492c0106b0 con 0x7f494010cb00 2026-02-20T13:22:56.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f4944964640 1 -- 10.20.193.28:0/4233542527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49400fabb0 con 0x7f494010cb00 2026-02-20T13:22:56.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.011+0000 7f4944964640 1 -- 10.20.193.28:0/4233542527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49400fb030 con 0x7f494010cb00 2026-02-20T13:22:56.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.014+0000 7f493cff9640 1 -- 10.20.193.28:0/4233542527 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f492c01f060 con 0x7f494010cb00 2026-02-20T13:22:56.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.015+0000 7f493cff9640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49140b56e0 0x7f49140d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.015+0000 7f493cff9640 1 -- 10.20.193.28:0/4233542527 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f492c014070 con 0x7f494010cb00 2026-02-20T13:22:56.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.015+0000 7f493effd640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49140b56e0 0x7f49140d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f493effd640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49140b56e0 0x7f49140d5b90 secure :-1 s=READY pgs=385 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49300098a0 tx=0x7f4930031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:56.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f49481d6e00 1 Processor -- start 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f49481d6e00 1 -- start start 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f8394c0 0x55be3f8598a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f859de0 0x55be3f87a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f87a700 0x55be3f89aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f49481d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55be3f74efd0 con 0x55be3f87a700 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f49481d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55be3f74ad00 con 0x55be3f859de0 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.016+0000 7f49481d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55be3f744ca0 con 0x55be3f8394c0 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f87a700 0x55be3f89aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f8394c0 0x55be3f8598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f8394c0 0x55be3f8598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37720/0 (socket says 10.20.193.28:37720) 2026-02-20T13:22:56.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493f7fe640 1 -- 10.20.193.28:0/3818826356 learned_addr learned my addr 10.20.193.28:0/3818826356 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493effd640 1 --2- 10.20.193.28:0/3818826356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f859de0 0x55be3f87a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493ffff640 1 -- 10.20.193.28:0/3818826356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f8394c0 msgr2=0x55be3f8598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493ffff640 1 --2- 10.20.193.28:0/3818826356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f8394c0 0x55be3f8598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493ffff640 1 -- 10.20.193.28:0/3818826356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f859de0 msgr2=0x55be3f87a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493ffff640 1 --2- 10.20.193.28:0/3818826356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f859de0 0x55be3f87a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493ffff640 1 -- 10.20.193.28:0/3818826356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be3f6e78b0 con 0x55be3f87a700 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f493ffff640 1 --2- 10.20.193.28:0/3818826356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f87a700 0x55be3f89aae0 secure :-1 s=READY pgs=757 gs=2 cs=0 l=1 c_cookie=15589752425167680540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4934005770 tx=0x7f4934003dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d859ed3b8e67741c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f490b7fe640 1 -- 10.20.193.28:0/3818826356 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4934010c20 con 0x55be3f87a700 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f490b7fe640 1 -- 10.20.193.28:0/3818826356 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4934010d80 con 0x55be3f87a700 2026-02-20T13:22:56.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f490b7fe640 1 -- 10.20.193.28:0/3818826356 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49340117e0 con 0x55be3f87a700 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f49481d6e00 1 -- 10.20.193.28:0/3818826356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f87a700 msgr2=0x55be3f89aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3818826356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f87a700 0x55be3f89aae0 secure :-1 s=READY pgs=757 gs=2 cs=0 l=1 c_cookie=15589752425167680540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4934005770 tx=0x7f4934003dd0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f49481d6e00 1 -- 10.20.193.28:0/3818826356 shutdown_connections 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3818826356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f87a700 0x55be3f89aae0 unknown :-1 s=CLOSED pgs=757 gs=2 cs=0 l=1 c_cookie=15589752425167680540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3818826356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f859de0 0x55be3f87a1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3818826356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f8394c0 0x55be3f8598a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.017+0000 7f49481d6e00 1 -- 10.20.193.28:0/3818826356 >> 10.20.193.28:0/3818826356 conn(0x55be3f7581c0 msgr2=0x55be3f837da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.018+0000 7f49481d6e00 1 -- 10.20.193.28:0/3818826356 shutdown_connections 2026-02-20T13:22:56.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.018+0000 7f49481d6e00 1 -- 10.20.193.28:0/3818826356 wait complete. 2026-02-20T13:22:56.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f49481d6e00 1 -- start start 2026-02-20T13:22:56.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f49481d6e00 1 Processor -- start 2026-02-20T13:22:56.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f852ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f853110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f853b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f49481d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55be3f8541d0 con 0x55be3f859de0 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f49481d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55be3f854340 con 0x55be3f8394c0 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f49481d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55be3f854500 con 0x55be3f87a700 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f493effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f853110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f852ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f852ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55044/0 (socket says 10.20.193.28:55044) 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f493f7fe640 1 -- 10.20.193.28:0/3433037645 learned_addr learned my addr 10.20.193.28:0/3433037645 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.019+0000 7f493ffff640 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f853b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f493effd640 1 -- 10.20.193.28:0/3433037645 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 msgr2=0x55be3f853b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f493effd640 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f853b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f493effd640 1 -- 10.20.193.28:0/3433037645 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 msgr2=0x55be3f852ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f493effd640 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f852ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f493effd640 1 -- 10.20.193.28:0/3433037645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be3f6f0400 con 0x55be3f859de0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f493effd640 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f853110 secure :-1 s=READY pgs=758 gs=1 cs=0 l=1 c_cookie=16639219942832198153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49300023d0 tx=0x7f493002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ea6261301bd209 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f4908ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f4908ff9640 1 -- 10.20.193.28:0/3433037645 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4930038d50 con 0x55be3f859de0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f4908ff9640 1 -- 10.20.193.28:0/3433037645 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4930004350 con 0x55be3f859de0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f4908ff9640 1 -- 10.20.193.28:0/3433037645 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4930043710 con 0x55be3f859de0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4934005460 con 0x55be3f859de0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f4908ff9640 1 -- 10.20.193.28:0/3433037645 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f49300438a0 con 0x55be3f859de0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f49481d6e00 10 client.17400 _ll_register_callbacks cb 0x55be3f6cfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:56.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be3f3e4520 con 0x55be3f859de0 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f4908ff9640 1 -- 10.20.193.28:0/3433037645 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4930043a60 con 0x55be3f859de0 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.020+0000 7f49481d6e00 10 client.17400 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55be3f6c8da0 con 0x55be3f859de0 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f4908ff9640 1 -- 10.20.193.28:0/3433037645 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4930043c00 con 0x55be3f859de0 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f49481d6e00 10 client.17400 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f49481d6e00 10 client.17400 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f49481d6e00 20 client.17400 populate_metadata read hostname 'trial028' 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55be3f857180 0x55be3f857620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f49481d6e00 4 client.17400 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be3f776630 con 0x55be3f857180 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.021+0000 7f493f7fe640 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55be3f857180 0x55be3f857620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.022+0000 7f493f7fe640 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55be3f857180 0x55be3f857620 crc :-1 s=READY pgs=176 gs=4 cs=0 l=0 c_cookie=6547254573910489735 s_cookie=4419093371684603502 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5adc85589bfc7a87 server_cookie=3d53c602188b466e in_seq=0 out_seq=0 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.022+0000 7f4908ff9640 10 client.17400 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.022+0000 7f4908ff9640 1 -- 10.20.193.28:0/3433037645 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55be3f776630 con 0x55be3f857180 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.022+0000 7f4908ff9640 10 client.17400 handle_command_reply: tid=0 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.022+0000 7f49481d6e00 1 client.17400 shutdown 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.022+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 msgr2=0x55be3f853110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.022+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f853110 secure :-1 s=READY pgs=758 gs=1 cs=0 l=1 c_cookie=16639219942832198153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49300023d0 tx=0x7f493002f190 comp rx=0 tx=0).stop 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 shutdown_connections 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55be3f857180 0x55be3f857620 crc :-1 s=READY pgs=176 gs=4 cs=0 l=0 c_cookie=6547254573910489735 s_cookie=4419093371684603502 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f853110 unknown :-1 s=CLOSED pgs=758 gs=1 cs=0 l=1 c_cookie=16639219942832198153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f853b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 1 --2- 10.20.193.28:0/3433037645 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f852ac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f4908ff9640 0 client.17400 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:56.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 >> 10.20.193.28:0/3433037645 conn(0x55be3f7581c0 msgr2=0x55be3f83a790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:56.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 shutdown_connections 2026-02-20T13:22:56.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 1 -- 10.20.193.28:0/3433037645 wait complete. 2026-02-20T13:22:56.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.023+0000 7f49481d6e00 20 client.17400 trim_cache size 0 max 16384 2026-02-20T13:22:56.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.030+0000 7f49481d6e00 1 Processor -- start 2026-02-20T13:22:56.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.030+0000 7f49481d6e00 1 -- start start 2026-02-20T13:22:56.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f853040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f84fde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f850320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f49481d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55be3f7428d0 con 0x55be3f859de0 2026-02-20T13:22:56.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f49481d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55be3f483f10 con 0x55be3f8394c0 2026-02-20T13:22:56.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f49481d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55be3f814810 con 0x55be3f87a700 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f853040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f84fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f853040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55060/0 (socket says 10.20.193.28:55060) 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493f7fe640 1 -- 10.20.193.28:0/2843850688 learned_addr learned my addr 10.20.193.28:0/2843850688 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493ffff640 1 --2- 10.20.193.28:0/2843850688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f850320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493effd640 1 -- 10.20.193.28:0/2843850688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 msgr2=0x55be3f850320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493effd640 1 --2- 10.20.193.28:0/2843850688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f850320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493effd640 1 -- 10.20.193.28:0/2843850688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 msgr2=0x55be3f853040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493effd640 1 --2- 10.20.193.28:0/2843850688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f853040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493effd640 1 -- 10.20.193.28:0/2843850688 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be3f6da670 con 0x55be3f859de0 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f493effd640 1 --2- 10.20.193.28:0/2843850688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f84fde0 secure :-1 s=READY pgs=759 gs=2 cs=0 l=1 c_cookie=13105136549885876434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4930038fd0 tx=0x7f4930051f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5decc4214ef98d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:56.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f490affd640 1 -- 10.20.193.28:0/2843850688 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4930050f10 con 0x55be3f859de0 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f490affd640 1 -- 10.20.193.28:0/2843850688 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55be3f3e4520 con 0x55be3f859de0 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.031+0000 7f490affd640 1 -- 10.20.193.28:0/2843850688 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4930038b30 con 0x55be3f859de0 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 -- 10.20.193.28:0/2843850688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 msgr2=0x55be3f84fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 --2- 10.20.193.28:0/2843850688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f84fde0 secure :-1 s=READY pgs=759 gs=2 cs=0 l=1 c_cookie=13105136549885876434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4930038fd0 tx=0x7f4930051f90 comp rx=0 tx=0).stop 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 -- 10.20.193.28:0/2843850688 shutdown_connections 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 --2- 10.20.193.28:0/2843850688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f84fde0 unknown :-1 s=CLOSED pgs=759 gs=2 cs=0 l=1 c_cookie=13105136549885876434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 --2- 10.20.193.28:0/2843850688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f850320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 --2- 10.20.193.28:0/2843850688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f853040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 -- 10.20.193.28:0/2843850688 >> 10.20.193.28:0/2843850688 conn(0x55be3f7581c0 msgr2=0x55be3f852930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 -- 10.20.193.28:0/2843850688 shutdown_connections 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 -- 10.20.193.28:0/2843850688 wait complete. 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 -- start start 2026-02-20T13:22:56.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.032+0000 7f49481d6e00 1 Processor -- start 2026-02-20T13:22:56.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f85b7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f85bdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f49481d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f85ca70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f49481d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55be3f85d000 con 0x55be3f859de0 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f49481d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55be3f85d170 con 0x55be3f8394c0 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f49481d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55be3f85d330 con 0x55be3f87a700 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f85b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f85b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55068/0 (socket says 10.20.193.28:55068) 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 -- 10.20.193.28:0/1713728816 learned_addr learned my addr 10.20.193.28:0/1713728816 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493effd640 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f85bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493ffff640 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f85ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 -- 10.20.193.28:0/1713728816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 msgr2=0x55be3f85ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:56.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f85ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 -- 10.20.193.28:0/1713728816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 msgr2=0x55be3f85bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f85bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 -- 10.20.193.28:0/1713728816 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be3f6d50f0 con 0x55be3f8394c0 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493ffff640 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f85ca70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f493f7fe640 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f85b7c0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=6739922252171668728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f492c0ad130 tx=0x7f492c0b1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d89039426716cf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.033+0000 7f4908ff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f4908ff9640 1 -- 10.20.193.28:0/1713728816 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f492c0b2e70 con 0x55be3f8394c0 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f4908ff9640 1 -- 10.20.193.28:0/1713728816 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f492c0b5450 con 0x55be3f8394c0 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be3f6c8da0 con 0x55be3f8394c0 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f4908ff9640 1 -- 10.20.193.28:0/1713728816 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f492c0adde0 con 0x55be3f8394c0 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f4908ff9640 1 -- 10.20.193.28:0/1713728816 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f492c0adf40 con 0x55be3f8394c0 2026-02-20T13:22:56.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 10 client.27377 _ll_register_callbacks cb 0x55be3f6cfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be3f7f4ca0 con 0x55be3f8394c0 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f4908ff9640 1 -- 10.20.193.28:0/1713728816 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f492c0b8290 con 0x55be3f8394c0 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 10 client.27377 fetch_fsmap learned FSMap version 28 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55be3f6c90d0 con 0x55be3f8394c0 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f4908ff9640 1 -- 10.20.193.28:0/1713728816 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f492c0a93c0 con 0x55be3f8394c0 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 10 client.27377 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 10 client.27377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 20 client.27377 populate_metadata read hostname 'trial028' 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55be3f85f310 0x55be3f85f7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 4 client.27377 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:22:56.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.034+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55be3f428640 con 0x55be3f85f310 2026-02-20T13:22:56.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.035+0000 7f493effd640 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55be3f85f310 0x55be3f85f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:22:56.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.035+0000 7f493effd640 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55be3f85f310 0x55be3f85f7b0 crc :-1 s=READY pgs=177 gs=4 cs=0 l=0 c_cookie=16823667710918941174 s_cookie=13578037802912517577 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e979aca5c08859f6 server_cookie=bc6ee171356d0dc9 in_seq=0 out_seq=0 2026-02-20T13:22:56.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.035+0000 7f4908ff9640 10 client.27377 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:56.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f4908ff9640 1 -- 10.20.193.28:0/1713728816 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55be3f428640 con 0x55be3f85f310 2026-02-20T13:22:56.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f4908ff9640 10 client.27377 handle_command_reply: tid=0 2026-02-20T13:22:56.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 client.27377 shutdown 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 msgr2=0x55be3f85b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f85b7c0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=6739922252171668728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f492c0ad130 tx=0x7f492c0b1040 comp rx=0 tx=0).stop 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 shutdown_connections 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55be3f85f310 0x55be3f85f7b0 crc :-1 s=READY pgs=177 gs=4 cs=0 l=0 c_cookie=16823667710918941174 s_cookie=13578037802912517577 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55be3f859de0 0x55be3f85bdc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55be3f87a700 0x55be3f85ca70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 --2- 10.20.193.28:0/1713728816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55be3f8394c0 0x55be3f85b7c0 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=6739922252171668728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f4908ff9640 0 client.27377 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 >> 10.20.193.28:0/1713728816 conn(0x55be3f7581c0 msgr2=0x55be3f852f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 shutdown_connections 2026-02-20T13:22:56.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 1 -- 10.20.193.28:0/1713728816 wait complete. 2026-02-20T13:22:56.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f49481d6e00 20 client.27377 trim_cache size 0 max 16384 2026-02-20T13:22:56.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:22:56.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:22:56.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:22:56.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:22:56.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f4944964640 1 -- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49140b56e0 msgr2=0x7f49140d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f4944964640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49140b56e0 0x7f49140d5b90 secure :-1 s=READY pgs=385 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49300098a0 tx=0x7f4930031040 comp rx=0 tx=0).stop 2026-02-20T13:22:56.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f4944964640 1 -- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 msgr2=0x7f49400f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:22:56.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.041+0000 7f4944964640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 0x7f49400f9150 secure :-1 s=READY pgs=756 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f492c009480 tx=0x7f492c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:22:56.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.042+0000 7f4944964640 1 -- 10.20.193.28:0/4233542527 shutdown_connections 2026-02-20T13:22:56.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.042+0000 7f4944964640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f49140b56e0 0x7f49140d5b90 unknown :-1 s=CLOSED pgs=385 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.042+0000 7f4944964640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f494010e270 0x7f49400f99b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.042+0000 7f4944964640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f494010d4b0 0x7f494016f240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.042+0000 7f4944964640 1 --2- 10.20.193.28:0/4233542527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f494010cb00 0x7f49400f9150 unknown :-1 s=CLOSED pgs=756 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:22:56.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.042+0000 7f4944964640 1 -- 10.20.193.28:0/4233542527 >> 10.20.193.28:0/4233542527 conn(0x7f49400ea4c0 msgr2=0x7f49400eca10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:22:56.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.042+0000 7f4944964640 1 -- 10.20.193.28:0/4233542527 shutdown_connections 2026-02-20T13:22:56.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:22:56.042+0000 7f4944964640 1 -- 10.20.193.28:0/4233542527 wait complete. 2026-02-20T13:22:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:56 trial127 ceph-mon[43817]: pgmap v349: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:56 trial034 ceph-mon[43332]: pgmap v349: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:57.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:56 trial028 ceph-mon[37442]: pgmap v349: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:22:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:22:58 trial127 ceph-mon[43817]: pgmap v350: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:22:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:22:58 trial034 ceph-mon[43332]: pgmap v350: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:22:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:22:58 trial028 ceph-mon[37442]: pgmap v350: 97 pgs: 97 active+clean; 3.2 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:23:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:00 trial127 ceph-mon[43817]: pgmap v351: 97 pgs: 97 active+clean; 3.2 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:23:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:00 trial034 ceph-mon[43332]: pgmap v351: 97 pgs: 97 active+clean; 3.2 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:23:01.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:00 trial028 ceph-mon[37442]: pgmap v351: 97 pgs: 97 active+clean; 3.2 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:23:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:02 trial127 ceph-mon[43817]: pgmap v352: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:23:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:02 trial034 ceph-mon[43332]: pgmap v352: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:23:03.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:02 trial028 ceph-mon[37442]: pgmap v352: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:23:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:04 trial127 ceph-mon[43817]: pgmap v353: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:23:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:04 trial034 ceph-mon[43332]: pgmap v353: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:23:05.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:04 trial028 ceph-mon[37442]: pgmap v353: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:23:05.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:05 trial127 ceph-mon[43817]: pgmap v354: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:23:05.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:05 trial034 ceph-mon[43332]: pgmap v354: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:23:06.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:05 trial028 ceph-mon[37442]: pgmap v354: 97 pgs: 97 active+clean; 3.3 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:23:07.231 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:23:07.418 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 -- 10.20.193.28:0/3835269243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 msgr2=0x7f6604175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3835269243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 0x7f6604175ce0 secure :-1 s=READY pgs=760 gs=1 cs=0 l=1 c_cookie=17822265209932179788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f660000aa30 tx=0x7f6600030270 comp rx=0 tx=0).stop 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 -- 10.20.193.28:0/3835269243 shutdown_connections 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3835269243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 0x7f6604175ce0 unknown :-1 s=CLOSED pgs=760 gs=1 cs=0 l=1 c_cookie=17822265209932179788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3835269243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f660410bb40 0x7f66041551e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3835269243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f660410b230 0x7f660410b600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 -- 10.20.193.28:0/3835269243 >> 10.20.193.28:0/3835269243 conn(0x7f66040e8ce0 msgr2=0x7f66041090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 -- 10.20.193.28:0/3835269243 shutdown_connections 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.589+0000 7f6609c9c640 1 -- 10.20.193.28:0/3835269243 wait complete. 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.590+0000 7f6609c9c640 1 Processor -- start 2026-02-20T13:23:07.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.590+0000 7f6609c9c640 1 -- start start 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.590+0000 7f6609c9c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f660410b230 0x7f66041600a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.590+0000 7f6609c9c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f660410bb40 0x7f66041605e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f6609c9c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 0x7f66041659b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f6609c9c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6604165fd0 con 0x7f6604155850 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f6609c9c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6604166140 con 0x7f660410bb40 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f6609c9c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6604166300 con 0x7f660410b230 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f65fbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f660410bb40 0x7f66041605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f660410b230 0x7f66041600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f65fbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f660410bb40 0x7f66041605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35400/0 (socket says 10.20.193.28:35400) 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f65fbfff640 1 -- 10.20.193.28:0/3806369521 learned_addr learned my addr 10.20.193.28:0/3806369521 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f660949b640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 0x7f66041659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f660949b640 1 -- 10.20.193.28:0/3806369521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f660410b230 msgr2=0x7f66041600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f660949b640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f660410b230 0x7f66041600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f660949b640 1 -- 10.20.193.28:0/3806369521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f660410bb40 msgr2=0x7f66041605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f660949b640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f660410bb40 0x7f66041605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f660949b640 1 -- 10.20.193.28:0/3806369521 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660000a650 con 0x7f6604155850 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.591+0000 7f660949b640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 0x7f66041659b0 secure :-1 s=READY pgs=761 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6600006ad0 tx=0x7f66000039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.592+0000 7f65f9ffb640 1 -- 10.20.193.28:0/3806369521 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f660003e070 con 0x7f6604155850 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.592+0000 7f65f9ffb640 1 -- 10.20.193.28:0/3806369521 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66000055a0 con 0x7f6604155850 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.592+0000 7f65f9ffb640 1 -- 10.20.193.28:0/3806369521 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6600042a90 con 0x7f6604155850 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.592+0000 7f6609c9c640 1 -- 10.20.193.28:0/3806369521 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6604166580 con 0x7f6604155850 2026-02-20T13:23:07.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.592+0000 7f6609c9c640 1 -- 10.20.193.28:0/3806369521 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66041531c0 con 0x7f6604155850 2026-02-20T13:23:07.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.595+0000 7f65f9ffb640 1 -- 10.20.193.28:0/3806369521 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6600039cf0 con 0x7f6604155850 2026-02-20T13:23:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.596+0000 7f65f9ffb640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65e00b5760 0x7f65e00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.596+0000 7f65f9ffb640 1 -- 10.20.193.28:0/3806369521 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f660010c910 con 0x7f6604155850 2026-02-20T13:23:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f6608c9a640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65e00b5760 0x7f65e00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660cf1fe00 1 Processor -- start 2026-02-20T13:23:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660cf1fe00 1 -- start start 2026-02-20T13:23:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b034550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b079400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b099d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55841af4a7d0 con 0x55841b034180 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55841af46500 con 0x55841b034a90 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55841af404a0 con 0x55841b079940 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b034550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b034550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46826/0 (socket says 10.20.193.28:46826) 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f6608c9a640 1 -- 10.20.193.28:0/3031554562 learned_addr learned my addr 10.20.193.28:0/3031554562 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f660949b640 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b099d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f6608c9a640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65e00b5760 0x7f65e00d5c10 secure :-1 s=READY pgs=386 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65f4004740 tx=0x7f65f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.597+0000 7f65fbfff640 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b079400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f6608c9a640 1 -- 10.20.193.28:0/3031554562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 msgr2=0x55841b099d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f6608c9a640 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b099d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f6608c9a640 1 -- 10.20.193.28:0/3031554562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 msgr2=0x55841b079400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f6608c9a640 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b079400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f6608c9a640 1 -- 10.20.193.28:0/3031554562 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841aeebd80 con 0x55841b034180 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f6608c9a640 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b034550 secure :-1 s=READY pgs=762 gs=1 cs=0 l=1 c_cookie=6540164747194504083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65f40114b0 tx=0x7f65f4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac3552fb10f9393 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f65d14e4640 1 -- 10.20.193.28:0/3031554562 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65f401e640 con 0x55841b034180 2026-02-20T13:23:07.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f65d14e4640 1 -- 10.20.193.28:0/3031554562 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f65f4015070 con 0x55841b034180 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f65d14e4640 1 -- 10.20.193.28:0/3031554562 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65f4026da0 con 0x55841b034180 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3031554562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 msgr2=0x55841b034550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b034550 secure :-1 s=READY pgs=762 gs=1 cs=0 l=1 c_cookie=6540164747194504083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65f40114b0 tx=0x7f65f4013000 comp rx=0 tx=0).stop 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3031554562 shutdown_connections 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b099d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b079400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3031554562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b034550 unknown :-1 s=CLOSED pgs=762 gs=1 cs=0 l=1 c_cookie=6540164747194504083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.598+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3031554562 >> 10.20.193.28:0/3031554562 conn(0x55841b012680 msgr2=0x55841b032a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.599+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3031554562 shutdown_connections 2026-02-20T13:23:07.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.599+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3031554562 wait complete. 2026-02-20T13:23:07.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.600+0000 7f660cf1fe00 1 -- start start 2026-02-20T13:23:07.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.600+0000 7f660cf1fe00 1 Processor -- start 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.600+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b091140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.600+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034a90 0x55841b091680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.600+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b079940 0x55841b096670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.600+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55841b096bb0 con 0x55841b034180 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.600+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55841b096d20 con 0x55841b079940 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.600+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55841b096ee0 con 0x55841b034a90 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b091140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b091140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46830/0 (socket says 10.20.193.28:46830) 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 -- 10.20.193.28:0/558720033 learned_addr learned my addr 10.20.193.28:0/558720033 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f65fbfff640 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034a90 0x55841b091680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f660949b640 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b079940 0x55841b096670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 -- 10.20.193.28:0/558720033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034a90 msgr2=0x55841b091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034a90 0x55841b091680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 -- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b079940 msgr2=0x55841b096670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b079940 0x55841b096670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 -- 10.20.193.28:0/558720033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841aec4350 con 0x55841b034180 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f660949b640 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b079940 0x55841b096670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:07.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f6608c9a640 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b091140 secure :-1 s=READY pgs=763 gs=1 cs=0 l=1 c_cookie=734854185087305279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65f4026920 tx=0x7f65f40266d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32b9fce7d6863f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f65c27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f65c27fc640 1 -- 10.20.193.28:0/558720033 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65f402a070 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f65c27fc640 1 -- 10.20.193.28:0/558720033 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f65f402b040 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f65c27fc640 1 -- 10.20.193.28:0/558720033 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65f401e6a0 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.601+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f400bd10 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f65c27fc640 1 -- 10.20.193.28:0/558720033 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f65f4017070 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 10 client.17418 _ll_register_callbacks cb 0x55841aec19a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55841abd66f0 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f65c27fc640 1 -- 10.20.193.28:0/558720033 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65f4004770 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 10 client.17418 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55841aed6150 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f65c27fc640 1 -- 10.20.193.28:0/558720033 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f65f4024020 con 0x55841b034180 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 10 client.17418 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:07.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 10 client.17418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:07.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 20 client.17418 populate_metadata read hostname 'trial028' 2026-02-20T13:23:07.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55841b076a00 0x55841b076ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 4 client.17418 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:07.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.602+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55841af4dd60 con 0x55841b076a00 2026-02-20T13:23:07.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.603+0000 7f65fbfff640 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55841b076a00 0x55841b076ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.603+0000 7f65fbfff640 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55841b076a00 0x55841b076ea0 crc :-1 s=READY pgs=178 gs=4 cs=0 l=0 c_cookie=4177785972105228567 s_cookie=14040003343676675487 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39fa7a34eef13117 server_cookie=c2d81ca76925159f in_seq=0 out_seq=0 2026-02-20T13:23:07.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.603+0000 7f65c27fc640 10 client.17418 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:07.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f65c27fc640 1 -- 10.20.193.28:0/558720033 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55841af4dd60 con 0x55841b076a00 2026-02-20T13:23:07.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f65c27fc640 10 client.17418 handle_command_reply: tid=0 2026-02-20T13:23:07.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 client.17418 shutdown 2026-02-20T13:23:07.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 msgr2=0x55841b091140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b091140 secure :-1 s=READY pgs=763 gs=1 cs=0 l=1 c_cookie=734854185087305279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65f4026920 tx=0x7f65f40266d0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 shutdown_connections 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55841b076a00 0x55841b076ea0 crc :-1 s=READY pgs=178 gs=4 cs=0 l=0 c_cookie=4177785972105228567 s_cookie=14040003343676675487 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b079940 0x55841b096670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034a90 0x55841b091680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/558720033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034180 0x55841b091140 unknown :-1 s=CLOSED pgs=763 gs=1 cs=0 l=1 c_cookie=734854185087305279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f65c27fc640 0 client.17418 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 >> 10.20.193.28:0/558720033 conn(0x55841b012680 msgr2=0x55841b032a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 shutdown_connections 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 1 -- 10.20.193.28:0/558720033 wait complete. 2026-02-20T13:23:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.604+0000 7f660cf1fe00 20 client.17418 trim_cache size 0 max 16384 2026-02-20T13:23:07.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.613+0000 7f660cf1fe00 1 Processor -- start 2026-02-20T13:23:07.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.613+0000 7f660cf1fe00 1 -- start start 2026-02-20T13:23:07.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034180 0x55841b095b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034a90 0x55841b08e530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b08ea70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55841af3e0d0 con 0x55841b034a90 2026-02-20T13:23:07.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55841abfe700 con 0x55841b034180 2026-02-20T13:23:07.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55841b098040 con 0x55841b079940 2026-02-20T13:23:07.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034180 0x55841b095b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f65fbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034a90 0x55841b08e530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034180 0x55841b095b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35428/0 (socket says 10.20.193.28:35428) 2026-02-20T13:23:07.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f6608c9a640 1 -- 10.20.193.28:0/3857265636 learned_addr learned my addr 10.20.193.28:0/3857265636 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f660949b640 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b08ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f65fbfff640 1 -- 10.20.193.28:0/3857265636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 msgr2=0x55841b08ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f65fbfff640 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b08ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f65fbfff640 1 -- 10.20.193.28:0/3857265636 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034180 msgr2=0x55841b095b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f65fbfff640 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034180 0x55841b095b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f65fbfff640 1 -- 10.20.193.28:0/3857265636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841aed0bd0 con 0x55841b034a90 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.614+0000 7f660949b640 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b08ea70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f65fbfff640 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034a90 0x55841b08e530 secure :-1 s=READY pgs=764 gs=1 cs=0 l=1 c_cookie=12229344182115055758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55841b077720 tx=0x7f65ec00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b75bbd62f5388e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f65d0ce3640 1 -- 10.20.193.28:0/3857265636 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65ec017040 con 0x55841b034a90 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f65d0ce3640 1 -- 10.20.193.28:0/3857265636 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f65ec00be20 con 0x55841b034a90 2026-02-20T13:23:07.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f65d0ce3640 1 -- 10.20.193.28:0/3857265636 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65ec01d320 con 0x55841b034a90 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3857265636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034a90 msgr2=0x55841b08e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034a90 0x55841b08e530 secure :-1 s=READY pgs=764 gs=1 cs=0 l=1 c_cookie=12229344182115055758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55841b077720 tx=0x7f65ec00b4a0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3857265636 shutdown_connections 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b034a90 0x55841b08e530 unknown :-1 s=CLOSED pgs=764 gs=1 cs=0 l=1 c_cookie=12229344182115055758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b079940 0x55841b08ea70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3857265636 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034180 0x55841b095b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3857265636 >> 10.20.193.28:0/3857265636 conn(0x55841b012680 msgr2=0x55841b094b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3857265636 shutdown_connections 2026-02-20T13:23:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.615+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3857265636 wait complete. 2026-02-20T13:23:07.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.616+0000 7f660cf1fe00 1 -- start start 2026-02-20T13:23:07.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.616+0000 7f660cf1fe00 1 Processor -- start 2026-02-20T13:23:07.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034180 0x55841b018710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b012d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f660cf1fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b079940 0x55841b0133b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55841b013ab0 con 0x55841b079940 2026-02-20T13:23:07.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55841b0c8d40 con 0x55841b034a90 2026-02-20T13:23:07.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f660cf1fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55841b0c8f00 con 0x55841b034180 2026-02-20T13:23:07.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034180 0x55841b018710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f6608c9a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034180 0x55841b018710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54842/0 (socket says 10.20.193.28:54842) 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f6608c9a640 1 -- 10.20.193.28:0/3418632065 learned_addr learned my addr 10.20.193.28:0/3418632065 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f660949b640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b079940 0x55841b0133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f65fbfff640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b012d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f6608c9a640 1 -- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 msgr2=0x55841b012d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f6608c9a640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b012d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f6608c9a640 1 -- 10.20.193.28:0/3418632065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b079940 msgr2=0x55841b0133b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f6608c9a640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b079940 0x55841b0133b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f6608c9a640 1 -- 10.20.193.28:0/3418632065 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841aec4680 con 0x55841b034180 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f660949b640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b079940 0x55841b0133b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.617+0000 7f65fbfff640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b012d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f6608c9a640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034180 0x55841b018710 secure :-1 s=READY pgs=248 gs=2 cs=0 l=1 c_cookie=12808002672691890103 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65f4011fd0 tx=0x7f65f4004810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1bf2a92340dc7b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f65c27fc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f65c27fc640 1 -- 10.20.193.28:0/3418632065 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65f402a070 con 0x55841b034180 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f65c27fc640 1 -- 10.20.193.28:0/3418632065 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55841abd66f0 con 0x55841b034180 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f65c27fc640 1 -- 10.20.193.28:0/3418632065 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65f401d680 con 0x55841b034180 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ec00b8a0 con 0x55841b034180 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f660cf1fe00 10 client.27298 _ll_register_callbacks cb 0x55841aec19a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f4015070 con 0x55841b034180 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f65c27fc640 1 -- 10.20.193.28:0/3418632065 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f65f4017040 con 0x55841b034180 2026-02-20T13:23:07.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f65c27fc640 1 -- 10.20.193.28:0/3418632065 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65f401dd90 con 0x55841b034180 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f660cf1fe00 10 client.27298 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.618+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55841aed63b0 con 0x55841b034180 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.619+0000 7f65c27fc640 1 -- 10.20.193.28:0/3418632065 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f65f4024070 con 0x55841b034180 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.619+0000 7f660cf1fe00 10 client.27298 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.619+0000 7f660cf1fe00 10 client.27298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.619+0000 7f660cf1fe00 20 client.27298 populate_metadata read hostname 'trial028' 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.619+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55841b0ca1a0 0x55841b0ca610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.619+0000 7f660cf1fe00 4 client.27298 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.619+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55841abd3f40 con 0x55841b0ca1a0 2026-02-20T13:23:07.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.619+0000 7f65fbfff640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55841b0ca1a0 0x55841b0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f65fbfff640 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55841b0ca1a0 0x55841b0ca610 crc :-1 s=READY pgs=179 gs=4 cs=0 l=0 c_cookie=17699805295830116571 s_cookie=14048979723770733845 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5a25723938828db server_cookie=c2f8009fc4052515 in_seq=0 out_seq=0 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f65c27fc640 10 client.27298 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f65c27fc640 1 -- 10.20.193.28:0/3418632065 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55841abd3f40 con 0x55841b0ca1a0 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f65c27fc640 10 client.27298 handle_command_reply: tid=0 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 client.27298 shutdown 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034180 msgr2=0x55841b018710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034180 0x55841b018710 secure :-1 s=READY pgs=248 gs=2 cs=0 l=1 c_cookie=12808002672691890103 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65f4011fd0 tx=0x7f65f4004810 comp rx=0 tx=0).stop 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 shutdown_connections 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55841b0ca1a0 0x55841b0ca610 crc :-1 s=READY pgs=179 gs=4 cs=0 l=0 c_cookie=17699805295830116571 s_cookie=14048979723770733845 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55841b079940 0x55841b0133b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55841b034a90 0x55841b012d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 --2- 10.20.193.28:0/3418632065 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55841b034180 0x55841b018710 unknown :-1 s=CLOSED pgs=248 gs=2 cs=0 l=1 c_cookie=12808002672691890103 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 >> 10.20.193.28:0/3418632065 conn(0x55841b012680 msgr2=0x55841b08d520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f65c27fc640 0 client.27298 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 shutdown_connections 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.620+0000 7f660cf1fe00 1 -- 10.20.193.28:0/3418632065 wait complete. 2026-02-20T13:23:07.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f660cf1fe00 20 client.27298 trim_cache size 0 max 16384 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:23:07.625 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.626 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.627 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:07.628 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 -- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65e00b5760 msgr2=0x7f65e00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65e00b5760 0x7f65e00d5c10 secure :-1 s=READY pgs=386 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65f4004740 tx=0x7f65f400b410 comp rx=0 tx=0).stop 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 -- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 msgr2=0x7f66041659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 0x7f66041659b0 secure :-1 s=READY pgs=761 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6600006ad0 tx=0x7f66000039b0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 -- 10.20.193.28:0/3806369521 shutdown_connections 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65e00b5760 0x7f65e00d5c10 unknown :-1 s=CLOSED pgs=386 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6604155850 0x7f66041659b0 unknown :-1 s=CLOSED pgs=761 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f660410bb40 0x7f66041605e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 --2- 10.20.193.28:0/3806369521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f660410b230 0x7f66041600a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 -- 10.20.193.28:0/3806369521 >> 10.20.193.28:0/3806369521 conn(0x7f66040e8ce0 msgr2=0x7f66041090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 -- 10.20.193.28:0/3806369521 shutdown_connections 2026-02-20T13:23:07.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:07.621+0000 7f6609c9c640 1 -- 10.20.193.28:0/3806369521 wait complete. 2026-02-20T13:23:07.722 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:23:07.723 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:23:07.908 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:08.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 -- 10.20.193.28:0/2946179640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 msgr2=0x7fc5e0112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 --2- 10.20.193.28:0/2946179640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 0x7fc5e0112c80 secure :-1 s=READY pgs=765 gs=1 cs=0 l=1 c_cookie=7300368805025714693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5cc009950 tx=0x7fc5cc02f190 comp rx=0 tx=0).stop 2026-02-20T13:23:08.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 -- 10.20.193.28:0/2946179640 shutdown_connections 2026-02-20T13:23:08.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 --2- 10.20.193.28:0/2946179640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 0x7fc5e0112c80 unknown :-1 s=CLOSED pgs=765 gs=1 cs=0 l=1 c_cookie=7300368805025714693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 --2- 10.20.193.28:0/2946179640 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc5e0113430 0x7fc5e0173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 --2- 10.20.193.28:0/2946179640 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5e010d240 0x7fc5e010d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 -- 10.20.193.28:0/2946179640 >> 10.20.193.28:0/2946179640 conn(0x7fc5e00eaad0 msgr2=0x7fc5e010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:08.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 -- 10.20.193.28:0/2946179640 shutdown_connections 2026-02-20T13:23:08.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.088+0000 7fc5e770c640 1 -- 10.20.193.28:0/2946179640 wait complete. 2026-02-20T13:23:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e770c640 1 Processor -- start 2026-02-20T13:23:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e770c640 1 -- start start 2026-02-20T13:23:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e770c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5e010d240 0x7fc5e00f5760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e770c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 0x7fc5e0173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e770c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc5e0113430 0x7fc5e00f5e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e770c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e00fb070 con 0x7fc5e010dc30 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e770c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e00fb1e0 con 0x7fc5e0113430 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e770c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e00fb3a0 con 0x7fc5e010d240 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e5f09640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 0x7fc5e0173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e5f09640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 0x7fc5e0173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46880/0 (socket says 10.20.193.28:46880) 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e5f09640 1 -- 10.20.193.28:0/3849508692 learned_addr learned my addr 10.20.193.28:0/3849508692 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.089+0000 7fc5e670a640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5e010d240 0x7fc5e00f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e6f0b640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc5e0113430 0x7fc5e00f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e5f09640 1 -- 10.20.193.28:0/3849508692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5e010d240 msgr2=0x7fc5e00f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e5f09640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5e010d240 0x7fc5e00f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e5f09640 1 -- 10.20.193.28:0/3849508692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc5e0113430 msgr2=0x7fc5e00f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e5f09640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc5e0113430 0x7fc5e00f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e5f09640 1 -- 10.20.193.28:0/3849508692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc009570 con 0x7fc5e010dc30 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e5f09640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 0x7fc5e0173d00 secure :-1 s=READY pgs=766 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5cc005b30 tx=0x7fc5cc004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5cb7fe640 1 -- 10.20.193.28:0/3849508692 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc5cc03d070 con 0x7fc5e010dc30 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e00fb620 con 0x7fc5e010dc30 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5cb7fe640 1 -- 10.20.193.28:0/3849508692 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc5cc038920 con 0x7fc5e010dc30 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5cb7fe640 1 -- 10.20.193.28:0/3849508692 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc5cc0418a0 con 0x7fc5e010dc30 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.090+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e00fbae0 con 0x7fc5e010dc30 2026-02-20T13:23:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.091+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e010e520 con 0x7fc5e010dc30 2026-02-20T13:23:08.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.093+0000 7fc5cb7fe640 1 -- 10.20.193.28:0/3849508692 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fc5cc048020 con 0x7fc5e010dc30 2026-02-20T13:23:08.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.095+0000 7fc5cb7fe640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc5bc0b5750 0x7fc5bc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.095+0000 7fc5cb7fe640 1 -- 10.20.193.28:0/3849508692 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc5cc10b1b0 con 0x7fc5e010dc30 2026-02-20T13:23:08.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.095+0000 7fc5e670a640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc5bc0b5750 0x7fc5bc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.095+0000 7fc5cb7fe640 1 -- 10.20.193.28:0/3849508692 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fc5cc10b630 con 0x7fc5e010dc30 2026-02-20T13:23:08.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.095+0000 7fc5e670a640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc5bc0b5750 0x7fc5bc0d5c00 secure :-1 s=READY pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5d8004740 tx=0x7fc5d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:08.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.235+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5e00f68c0 con 0x7fc5e010dc30 2026-02-20T13:23:08.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.236+0000 7fc5cb7fe640 1 -- 10.20.193.28:0/3849508692 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fc5cc0cdc10 con 0x7fc5e010dc30 2026-02-20T13:23:08.239 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:23:08.239 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:23:08.240 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc5bc0b5750 msgr2=0x7fc5bc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc5bc0b5750 0x7fc5bc0d5c00 secure :-1 s=READY pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5d8004740 tx=0x7fc5d8005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 msgr2=0x7fc5e0173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 0x7fc5e0173d00 secure :-1 s=READY pgs=766 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5cc005b30 tx=0x7fc5cc004340 comp rx=0 tx=0).stop 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 shutdown_connections 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc5bc0b5750 0x7fc5bc0d5c00 unknown :-1 s=CLOSED pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5e010dc30 0x7fc5e0173d00 unknown :-1 s=CLOSED pgs=766 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc5e0113430 0x7fc5e00f5e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 --2- 10.20.193.28:0/3849508692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5e010d240 0x7fc5e00f5760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 >> 10.20.193.28:0/3849508692 conn(0x7fc5e00eaad0 msgr2=0x7fc5e0110a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:08.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 shutdown_connections 2026-02-20T13:23:08.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.237+0000 7fc5e770c640 1 -- 10.20.193.28:0/3849508692 wait complete. 2026-02-20T13:23:08.374 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:23:08.558 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:08.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:08 trial028 ceph-mon[37442]: pgmap v355: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:23:08.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:08 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3849508692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:08.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:08 trial127 ceph-mon[43817]: pgmap v355: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:23:08.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:08 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3849508692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:08.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:08 trial034 ceph-mon[43332]: pgmap v355: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:23:08.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:08 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3849508692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:08.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 -- 10.20.193.28:0/4140452275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e810fea0 msgr2=0x7f45e8114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/4140452275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e810fea0 0x7f45e8114ef0 secure :-1 s=READY pgs=767 gs=1 cs=0 l=1 c_cookie=7223616251913118730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d8009950 tx=0x7f45d802f190 comp rx=0 tx=0).stop 2026-02-20T13:23:08.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 -- 10.20.193.28:0/4140452275 shutdown_connections 2026-02-20T13:23:08.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/4140452275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e810fea0 0x7f45e8114ef0 unknown :-1 s=CLOSED pgs=767 gs=1 cs=0 l=1 c_cookie=7223616251913118730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/4140452275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f45e81156a0 0x7f45e8176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/4140452275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45e810f4b0 0x7f45e810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 -- 10.20.193.28:0/4140452275 >> 10.20.193.28:0/4140452275 conn(0x7f45e80ecda0 msgr2=0x7f45e810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:08.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 -- 10.20.193.28:0/4140452275 shutdown_connections 2026-02-20T13:23:08.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.747+0000 7f45ecfeb640 1 -- 10.20.193.28:0/4140452275 wait complete. 2026-02-20T13:23:08.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45ecfeb640 1 Processor -- start 2026-02-20T13:23:08.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45ecfeb640 1 -- start start 2026-02-20T13:23:08.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45ecfeb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f45e810f4b0 0x7f45e80f5880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45ecfeb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45e810fea0 0x7f45e8175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45ecfeb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e81156a0 0x7f45e80f5f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45ecfeb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80fb190 con 0x7f45e81156a0 2026-02-20T13:23:08.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45ecfeb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80fb300 con 0x7f45e810f4b0 2026-02-20T13:23:08.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45ecfeb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80fb4c0 con 0x7f45e810fea0 2026-02-20T13:23:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e81156a0 0x7f45e80f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f45e810f4b0 0x7f45e80f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f45e810f4b0 0x7f45e80f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35472/0 (socket says 10.20.193.28:35472) 2026-02-20T13:23:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e77fe640 1 -- 10.20.193.28:0/93614197 learned_addr learned my addr 10.20.193.28:0/93614197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e81156a0 0x7f45e80f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46900/0 (socket says 10.20.193.28:46900) 2026-02-20T13:23:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e6ffd640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45e810fea0 0x7f45e8175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e7fff640 1 -- 10.20.193.28:0/93614197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45e810fea0 msgr2=0x7f45e8175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e7fff640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45e810fea0 0x7f45e8175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e7fff640 1 -- 10.20.193.28:0/93614197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f45e810f4b0 msgr2=0x7f45e80f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e7fff640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f45e810f4b0 0x7f45e80f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.748+0000 7f45e7fff640 1 -- 10.20.193.28:0/93614197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d8009570 con 0x7f45e81156a0 2026-02-20T13:23:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.749+0000 7f45e7fff640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e81156a0 0x7f45e80f5f80 secure :-1 s=READY pgs=768 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45dc00e720 tx=0x7f45dc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.749+0000 7f45e4ff9640 1 -- 10.20.193.28:0/93614197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45dc005500 con 0x7f45e81156a0 2026-02-20T13:23:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.749+0000 7f45e4ff9640 1 -- 10.20.193.28:0/93614197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f45dc005660 con 0x7f45e81156a0 2026-02-20T13:23:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.749+0000 7f45e4ff9640 1 -- 10.20.193.28:0/93614197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45dc011460 con 0x7f45e81156a0 2026-02-20T13:23:08.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.749+0000 7f45ecfeb640 1 -- 10.20.193.28:0/93614197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e80fb7a0 con 0x7f45e81156a0 2026-02-20T13:23:08.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.749+0000 7f45ecfeb640 1 -- 10.20.193.28:0/93614197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e80fbcc0 con 0x7f45e81156a0 2026-02-20T13:23:08.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.752+0000 7f45e4ff9640 1 -- 10.20.193.28:0/93614197 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f45dc00c7e0 con 0x7f45e81156a0 2026-02-20T13:23:08.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.753+0000 7f45e4ff9640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f45bc0b5750 0x7f45bc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.753+0000 7f45e4ff9640 1 -- 10.20.193.28:0/93614197 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f45dc0e79c0 con 0x7f45e81156a0 2026-02-20T13:23:08.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45e77fe640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f45bc0b5750 0x7f45bc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45f026ee00 1 Processor -- start 2026-02-20T13:23:08.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45e77fe640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f45bc0b5750 0x7f45bc0d5c00 secure :-1 s=READY pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d400b2a0 tx=0x7f45d400b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:08.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45f026ee00 1 -- start start 2026-02-20T13:23:08.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e83311730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e833565e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e83376f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45f026ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563e83227780 con 0x563e83311c70 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45f026ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563e832234b0 con 0x563e83356b20 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.754+0000 7f45f026ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563e8321d450 con 0x563e83311360 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e83311730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e83311730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54890/0 (socket says 10.20.193.28:54890) 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e77fe640 1 -- 10.20.193.28:0/2976782091 learned_addr learned my addr 10.20.193.28:0/2976782091 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e6ffd640 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e833565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e7fff640 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e83376f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e77fe640 1 -- 10.20.193.28:0/2976782091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 msgr2=0x563e83376f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e77fe640 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e83376f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e77fe640 1 -- 10.20.193.28:0/2976782091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 msgr2=0x563e833565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e77fe640 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e833565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e77fe640 1 -- 10.20.193.28:0/2976782091 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e831c8d10 con 0x563e83311360 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.755+0000 7f45e6ffd640 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e833565e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45e77fe640 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e83311730 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=9852271437972800898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d4011560 tx=0x7f45d4013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ba4cac5b188582 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45abfff640 1 -- 10.20.193.28:0/2976782091 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45d4004a70 con 0x563e83311360 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45abfff640 1 -- 10.20.193.28:0/2976782091 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f45d4015070 con 0x563e83311360 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45abfff640 1 -- 10.20.193.28:0/2976782091 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45d401e970 con 0x563e83311360 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 -- 10.20.193.28:0/2976782091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 msgr2=0x563e83311730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e83311730 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=9852271437972800898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d4011560 tx=0x7f45d4013000 comp rx=0 tx=0).stop 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 -- 10.20.193.28:0/2976782091 shutdown_connections 2026-02-20T13:23:08.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e833565e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e83376f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2976782091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e83311730 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=9852271437972800898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 -- 10.20.193.28:0/2976782091 >> 10.20.193.28:0/2976782091 conn(0x563e832ef860 msgr2=0x563e8330fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 -- 10.20.193.28:0/2976782091 shutdown_connections 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.756+0000 7f45f026ee00 1 -- 10.20.193.28:0/2976782091 wait complete. 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45f026ee00 1 -- start start 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45f026ee00 1 Processor -- start 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336e750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336ec90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e83373c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45f026ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563e833741c0 con 0x563e83311c70 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45f026ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563e83374330 con 0x563e83356b20 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45f026ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563e833744f0 con 0x563e83311360 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45e6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45e77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336e750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45e6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46922/0 (socket says 10.20.193.28:46922) 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45e6ffd640 1 -- 10.20.193.28:0/2728850128 learned_addr learned my addr 10.20.193.28:0/2728850128 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45e77fe640 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336e750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54902/0 (socket says 10.20.193.28:54902) 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.758+0000 7f45e7fff640 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e83373c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45e6ffd640 1 -- 10.20.193.28:0/2728850128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 msgr2=0x563e8336e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45e6ffd640 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336e750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45e6ffd640 1 -- 10.20.193.28:0/2728850128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 msgr2=0x563e83373c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:08.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45e6ffd640 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e83373c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45e6ffd640 1 -- 10.20.193.28:0/2728850128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d400bd80 con 0x563e83311c70 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45e77fe640 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336e750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45e6ffd640 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336ec90 secure :-1 s=READY pgs=769 gs=2 cs=0 l=1 c_cookie=10322735134102605436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d8009950 tx=0x7f45d80387e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f41b8e98aa14e7c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45a97fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45a97fa640 1 -- 10.20.193.28:0/2728850128 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45d803d040 con 0x563e83311c70 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45a97fa640 1 -- 10.20.193.28:0/2728850128 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f45d803e040 con 0x563e83311c70 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45a97fa640 1 -- 10.20.193.28:0/2728850128 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45d8044450 con 0x563e83311c70 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e81768e0 con 0x563e83311c70 2026-02-20T13:23:08.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45a97fa640 1 -- 10.20.193.28:0/2728850128 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f45d80445e0 con 0x563e83311c70 2026-02-20T13:23:08.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45a97fa640 10 client.17442 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:23:08.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45f026ee00 10 client.17442 _ll_register_callbacks cb 0x563e8319ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:08.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e82eb36f0 con 0x563e83311c70 2026-02-20T13:23:08.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45a97fa640 1 -- 10.20.193.28:0/2728850128 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f45d8004370 con 0x563e83311c70 2026-02-20T13:23:08.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45f026ee00 10 client.17442 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:08.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.759+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563e831a13c0 con 0x563e83311c70 2026-02-20T13:23:08.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.760+0000 7f45a97fa640 1 -- 10.20.193.28:0/2728850128 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f45d80028c0 con 0x563e83311c70 2026-02-20T13:23:08.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.760+0000 7f45f026ee00 10 client.17442 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.760+0000 7f45f026ee00 10 client.17442 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.760+0000 7f45f026ee00 20 client.17442 populate_metadata read hostname 'trial028' 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.760+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x563e83376be0 0x563e833548a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.760+0000 7f45f026ee00 4 client.17442 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.760+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e831bff80 con 0x563e83376be0 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.760+0000 7f45e77fe640 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x563e83376be0 0x563e833548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.761+0000 7f45e77fe640 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x563e83376be0 0x563e833548a0 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=6500197573311258347 s_cookie=1986626963611569837 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5a355740df12deeb server_cookie=1b91eab2a347cead in_seq=0 out_seq=0 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.761+0000 7f45a97fa640 10 client.17442 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:23:08.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.761+0000 7f45a97fa640 1 -- 10.20.193.28:0/2728850128 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563e831bff80 con 0x563e83376be0 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.761+0000 7f45a97fa640 10 client.17442 handle_command_reply: tid=0 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.761+0000 7f45f026ee00 1 client.17442 shutdown 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.761+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 msgr2=0x563e8336ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.761+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336ec90 secure :-1 s=READY pgs=769 gs=2 cs=0 l=1 c_cookie=10322735134102605436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d8009950 tx=0x7f45d80387e0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 shutdown_connections 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x563e83376be0 0x563e833548a0 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=6500197573311258347 s_cookie=1986626963611569837 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336ec90 unknown :-1 s=CLOSED pgs=769 gs=2 cs=0 l=1 c_cookie=10322735134102605436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e83373c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 1 --2- 10.20.193.28:0/2728850128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336e750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45a97fa640 0 client.17442 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:23:08.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 >> 10.20.193.28:0/2728850128 conn(0x563e832ef860 msgr2=0x563e8330fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:08.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 shutdown_connections 2026-02-20T13:23:08.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 1 -- 10.20.193.28:0/2728850128 wait complete. 2026-02-20T13:23:08.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.762+0000 7f45f026ee00 20 client.17442 trim_cache size 0 max 16384 2026-02-20T13:23:08.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45f026ee00 1 Processor -- start 2026-02-20T13:23:08.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45f026ee00 1 -- start start 2026-02-20T13:23:08.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336b920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336be60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e833558b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45f026ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563e8321b080 con 0x563e83311c70 2026-02-20T13:23:08.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45f026ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563e82edb700 con 0x563e83356b20 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45f026ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563e83363080 con 0x563e83311360 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45e77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336b920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45e7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e833558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45e6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336be60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45e77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336b920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54904/0 (socket says 10.20.193.28:54904) 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45e77fe640 1 -- 10.20.193.28:0/1457565869 learned_addr learned my addr 10.20.193.28:0/1457565869 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.769+0000 7f45e7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e833558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35496/0 (socket says 10.20.193.28:35496) 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45e77fe640 1 -- 10.20.193.28:0/1457565869 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 msgr2=0x563e833558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45e77fe640 1 --2- 10.20.193.28:0/1457565869 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e833558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45e77fe640 1 -- 10.20.193.28:0/1457565869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 msgr2=0x563e8336be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45e77fe640 1 --2- 10.20.193.28:0/1457565869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336be60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45e77fe640 1 -- 10.20.193.28:0/1457565869 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e831b30e0 con 0x563e83311360 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45e77fe640 1 --2- 10.20.193.28:0/1457565869 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336b920 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=11046690082222604879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d4011560 tx=0x7f45d400b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=994dba1a16b5824f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45ab7fe640 1 -- 10.20.193.28:0/1457565869 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45d4004990 con 0x563e83311360 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45ab7fe640 1 -- 10.20.193.28:0/1457565869 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f45d4004af0 con 0x563e83311360 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45ab7fe640 1 -- 10.20.193.28:0/1457565869 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45d4038bc0 con 0x563e83311360 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45f026ee00 1 -- 10.20.193.28:0/1457565869 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 msgr2=0x563e8336b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45f026ee00 1 --2- 10.20.193.28:0/1457565869 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336b920 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=11046690082222604879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d4011560 tx=0x7f45d400b6e0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45f026ee00 1 -- 10.20.193.28:0/1457565869 shutdown_connections 2026-02-20T13:23:08.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.770+0000 7f45f026ee00 1 --2- 10.20.193.28:0/1457565869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83311c70 0x563e8336be60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.771+0000 7f45f026ee00 1 --2- 10.20.193.28:0/1457565869 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83356b20 0x563e833558b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.771+0000 7f45f026ee00 1 --2- 10.20.193.28:0/1457565869 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e8336b920 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=11046690082222604879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.771+0000 7f45f026ee00 1 -- 10.20.193.28:0/1457565869 >> 10.20.193.28:0/1457565869 conn(0x563e832ef860 msgr2=0x563e83358f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.771+0000 7f45f026ee00 1 -- 10.20.193.28:0/1457565869 shutdown_connections 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.771+0000 7f45f026ee00 1 -- 10.20.193.28:0/1457565869 wait complete. 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.771+0000 7f45f026ee00 1 -- start start 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.771+0000 7f45f026ee00 1 Processor -- start 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e832f1210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83311c70 0x563e832f1750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45f026ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83356b20 0x563e833bc920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45f026ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563e8327fae0 con 0x563e83356b20 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45f026ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563e832f1f70 con 0x563e83311c70 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45f026ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563e833bce60 con 0x563e83311360 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83311c70 0x563e832f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83311c70 0x563e832f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35498/0 (socket says 10.20.193.28:35498) 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e6ffd640 1 -- 10.20.193.28:0/3719761151 learned_addr learned my addr 10.20.193.28:0/3719761151 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:08.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e7fff640 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83356b20 0x563e833bc920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e77fe640 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e832f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e7fff640 1 -- 10.20.193.28:0/3719761151 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 msgr2=0x563e832f1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e7fff640 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e832f1210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e7fff640 1 -- 10.20.193.28:0/3719761151 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83311c70 msgr2=0x563e832f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.772+0000 7f45e7fff640 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83311c70 0x563e832f1750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45e7fff640 1 -- 10.20.193.28:0/3719761151 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e831adb60 con 0x563e83356b20 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45e7fff640 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83356b20 0x563e833bc920 secure :-1 s=READY pgs=770 gs=2 cs=0 l=1 c_cookie=12085303172664302567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45dc0ae040 tx=0x7f45dc0e53f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b79f34718e9be7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45a97fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45a97fa640 1 -- 10.20.193.28:0/3719761151 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45dc003780 con 0x563e83356b20 2026-02-20T13:23:08.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d402e040 con 0x563e83356b20 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45f026ee00 10 client.17448 _ll_register_callbacks cb 0x563e8319ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45d4015070 con 0x563e83356b20 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45a97fa640 1 -- 10.20.193.28:0/3719761151 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f45dc0b3a40 con 0x563e83356b20 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45a97fa640 1 -- 10.20.193.28:0/3719761151 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45dc0abdb0 con 0x563e83356b20 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45a97fa640 1 -- 10.20.193.28:0/3719761151 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f45dc0abf10 con 0x563e83356b20 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45a97fa640 1 -- 10.20.193.28:0/3719761151 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f45dc079260 con 0x563e83356b20 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45f026ee00 10 client.17448 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.773+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563e831a16f0 con 0x563e83356b20 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45a97fa640 1 -- 10.20.193.28:0/3719761151 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f45dc0af710 con 0x563e83356b20 2026-02-20T13:23:08.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45f026ee00 10 client.17448 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45f026ee00 10 client.17448 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45f026ee00 20 client.17448 populate_metadata read hostname 'trial028' 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45f026ee00 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x563e83404d80 0x563e83425230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45f026ee00 4 client.17448 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563e82eb0f40 con 0x563e83404d80 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45e77fe640 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x563e83404d80 0x563e83425230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45e77fe640 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x563e83404d80 0x563e83425230 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=18076143462979043435 s_cookie=15241883181895836022 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fadb5cb543dd806b server_cookie=d3860bffbce6e176 in_seq=0 out_seq=0 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45a97fa640 10 client.17448 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:23:08.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45a97fa640 1 -- 10.20.193.28:0/3719761151 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563e82eb0f40 con 0x563e83404d80 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45a97fa640 10 client.17448 handle_command_reply: tid=0 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.774+0000 7f45f026ee00 1 client.17448 shutdown 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83356b20 msgr2=0x563e833bc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83356b20 0x563e833bc920 secure :-1 s=READY pgs=770 gs=2 cs=0 l=1 c_cookie=12085303172664302567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45dc0ae040 tx=0x7f45dc0e53f0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 shutdown_connections 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x563e83404d80 0x563e83425230 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=18076143462979043435 s_cookie=15241883181895836022 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e83356b20 0x563e833bc920 unknown :-1 s=CLOSED pgs=770 gs=2 cs=0 l=1 c_cookie=12085303172664302567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563e83311c70 0x563e832f1750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 --2- 10.20.193.28:0/3719761151 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563e83311360 0x563e832f1210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45a97fa640 0 client.17448 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:23:08.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 >> 10.20.193.28:0/3719761151 conn(0x563e832ef860 msgr2=0x563e8336a910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:08.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 shutdown_connections 2026-02-20T13:23:08.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 1 -- 10.20.193.28:0/3719761151 wait complete. 2026-02-20T13:23:08.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45f026ee00 20 client.17448 trim_cache size 0 max 16384 2026-02-20T13:23:08.787 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:08.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45ecfeb640 1 -- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f45bc0b5750 msgr2=0x7f45bc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f45bc0b5750 0x7f45bc0d5c00 secure :-1 s=READY pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45d400b2a0 tx=0x7f45d400b480 comp rx=0 tx=0).stop 2026-02-20T13:23:08.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45ecfeb640 1 -- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e81156a0 msgr2=0x7f45e80f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:08.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.775+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e81156a0 0x7f45e80f5f80 secure :-1 s=READY pgs=768 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45dc00e720 tx=0x7f45dc00ebf0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.776+0000 7f45ecfeb640 1 -- 10.20.193.28:0/93614197 shutdown_connections 2026-02-20T13:23:08.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.776+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f45bc0b5750 0x7f45bc0d5c00 unknown :-1 s=CLOSED pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.776+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45e81156a0 0x7f45e80f5f80 unknown :-1 s=CLOSED pgs=768 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.776+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45e810fea0 0x7f45e8175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.776+0000 7f45ecfeb640 1 --2- 10.20.193.28:0/93614197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f45e810f4b0 0x7f45e80f5880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:08.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.776+0000 7f45ecfeb640 1 -- 10.20.193.28:0/93614197 >> 10.20.193.28:0/93614197 conn(0x7f45e80ecda0 msgr2=0x7f45e8111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:08.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.776+0000 7f45ecfeb640 1 -- 10.20.193.28:0/93614197 shutdown_connections 2026-02-20T13:23:08.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:08.776+0000 7f45ecfeb640 1 -- 10.20.193.28:0/93614197 wait complete. 2026-02-20T13:23:08.914 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:23:09.102 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:09.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/3044133322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc10b8a0 msgr2=0x7f8fdc10bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/3044133322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc10b8a0 0x7f8fdc10bd10 secure :-1 s=READY pgs=771 gs=2 cs=0 l=1 c_cookie=1715703462593073162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fd0009890 tx=0x7f8fd002f120 comp rx=0 tx=0).stop 2026-02-20T13:23:09.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/3044133322 shutdown_connections 2026-02-20T13:23:09.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/3044133322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc10b8a0 0x7f8fdc10bd10 unknown :-1 s=CLOSED pgs=771 gs=2 cs=0 l=1 c_cookie=1715703462593073162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/3044133322 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fdc10c250 0x7f8fdc10c6a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/3044133322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fdc060710 0x7f8fdc10b360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/3044133322 >> 10.20.193.28:0/3044133322 conn(0x7f8fdc0e8f40 msgr2=0x7f8fdc109350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/3044133322 shutdown_connections 2026-02-20T13:23:09.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.113+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/3044133322 wait complete. 2026-02-20T13:23:09.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe2bd2640 1 Processor -- start 2026-02-20T13:23:09.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe2bd2640 1 -- start start 2026-02-20T13:23:09.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe2bd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc060710 0x7f8fdc0f48d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe2bd2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fdc10b8a0 0x7f8fdc0f4f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe2bd2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fdc10c250 0x7f8fdc0f5b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe2bd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0f6260 con 0x7f8fdc060710 2026-02-20T13:23:09.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe2bd2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0f63d0 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe2bd2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0f6590 con 0x7f8fdc10c250 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc060710 0x7f8fdc0f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe13cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fdc10b8a0 0x7f8fdc0f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe23d1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fdc10c250 0x7f8fdc0f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe13cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fdc10b8a0 0x7f8fdc0f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35528/0 (socket says 10.20.193.28:35528) 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe13cf640 1 -- 10.20.193.28:0/2808115906 learned_addr learned my addr 10.20.193.28:0/2808115906 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.114+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc060710 0x7f8fdc0f48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46968/0 (socket says 10.20.193.28:46968) 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fe13cf640 1 -- 10.20.193.28:0/2808115906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fdc10c250 msgr2=0x7f8fdc0f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fdc10c250 0x7f8fdc0f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fe13cf640 1 -- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc060710 msgr2=0x7f8fdc0f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc060710 0x7f8fdc0f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fe13cf640 1 -- 10.20.193.28:0/2808115906 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd00094b0 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fdc10b8a0 0x7f8fdc0f4f20 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fd002fb70 tx=0x7f8fd002fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fcaffd640 1 -- 10.20.193.28:0/2808115906 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fd003d070 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fcaffd640 1 -- 10.20.193.28:0/2808115906 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8fd00044f0 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fcaffd640 1 -- 10.20.193.28:0/2808115906 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fd0041a90 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/2808115906 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc0f6810 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.115+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/2808115906 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc0f6d30 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.118+0000 7f8fcaffd640 1 -- 10.20.193.28:0/2808115906 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8fd0048020 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.120+0000 7f8fcaffd640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fb80b56e0 0x7f8fb80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.120+0000 7f8fcaffd640 1 -- 10.20.193.28:0/2808115906 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8fd010b2a0 con 0x7f8fdc10b8a0 2026-02-20T13:23:09.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.120+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fb80b56e0 0x7f8fb80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.120+0000 7f8fe6488e00 1 Processor -- start 2026-02-20T13:23:09.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.120+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fb80b56e0 0x7f8fb80d5b90 secure :-1 s=READY pgs=389 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc004740 tx=0x7f8fcc009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe6488e00 1 -- start start 2026-02-20T13:23:09.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771a8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c773b1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c775bae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561c760ffd0 con 0x5561c76fa4c0 2026-02-20T13:23:09.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5561c760bd00 con 0x5561c773b700 2026-02-20T13:23:09.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5561c7605ca0 con 0x5561c771ade0 2026-02-20T13:23:09.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c773b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c773b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54938/0 (socket says 10.20.193.28:54938) 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 -- 10.20.193.28:0/2960917073 learned_addr learned my addr 10.20.193.28:0/2960917073 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe23d1640 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c775bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 -- 10.20.193.28:0/2960917073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 msgr2=0x5561c775bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c775bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 -- 10.20.193.28:0/2960917073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 msgr2=0x5561c771a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 -- 10.20.193.28:0/2960917073 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c75a88b0 con 0x5561c771ade0 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771a8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.121+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c773b1c0 secure :-1 s=READY pgs=251 gs=2 cs=0 l=1 c_cookie=18134169391230247802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fd00cdc80 tx=0x7f8fd0041540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fba982fb7d0a637a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fa9bfe640 1 -- 10.20.193.28:0/2960917073 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fd00cbea0 con 0x5561c771ade0 2026-02-20T13:23:09.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fa9bfe640 1 -- 10.20.193.28:0/2960917073 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8fd00d0eb0 con 0x5561c771ade0 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fa9bfe640 1 -- 10.20.193.28:0/2960917073 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fd00cf690 con 0x5561c771ade0 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 -- 10.20.193.28:0/2960917073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 msgr2=0x5561c773b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c773b1c0 secure :-1 s=READY pgs=251 gs=2 cs=0 l=1 c_cookie=18134169391230247802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fd00cdc80 tx=0x7f8fd0041540 comp rx=0 tx=0).stop 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 -- 10.20.193.28:0/2960917073 shutdown_connections 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c775bae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c773b1c0 unknown :-1 s=CLOSED pgs=251 gs=2 cs=0 l=1 c_cookie=18134169391230247802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/2960917073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771a8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 -- 10.20.193.28:0/2960917073 >> 10.20.193.28:0/2960917073 conn(0x5561c76191c0 msgr2=0x5561c76f8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 -- 10.20.193.28:0/2960917073 shutdown_connections 2026-02-20T13:23:09.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.122+0000 7f8fe6488e00 1 -- 10.20.193.28:0/2960917073 wait complete. 2026-02-20T13:23:09.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe6488e00 1 -- start start 2026-02-20T13:23:09.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe6488e00 1 Processor -- start 2026-02-20T13:23:09.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c76fa4c0 0x5561c77139a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c771ade0 0x5561c7713ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c77149b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561c7715010 con 0x5561c771ade0 2026-02-20T13:23:09.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5561c7715180 con 0x5561c773b700 2026-02-20T13:23:09.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5561c7715340 con 0x5561c76fa4c0 2026-02-20T13:23:09.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c76fa4c0 0x5561c77139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c76fa4c0 0x5561c77139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54942/0 (socket says 10.20.193.28:54942) 2026-02-20T13:23:09.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/3061729874 learned_addr learned my addr 10.20.193.28:0/3061729874 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c771ade0 0x5561c7713ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.124+0000 7f8fe23d1640 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c77149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/3061729874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 msgr2=0x5561c77149b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c77149b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/3061729874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c771ade0 msgr2=0x5561c7713ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c771ade0 0x5561c7713ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/3061729874 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c75b1400 con 0x5561c76fa4c0 2026-02-20T13:23:09.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c771ade0 0x5561c7713ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:09.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c76fa4c0 0x5561c77139a0 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=1623833723923172914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc0043f0 tx=0x7f8fcc013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1689042b20bd8e32 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8f96ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:23:09.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8f96ffd640 1 -- 10.20.193.28:0/3061729874 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc021040 con 0x5561c76fa4c0 2026-02-20T13:23:09.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8f96ffd640 1 -- 10.20.193.28:0/3061729874 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8fcc002dd0 con 0x5561c76fa4c0 2026-02-20T13:23:09.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8f96ffd640 1 -- 10.20.193.28:0/3061729874 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc01bcf0 con 0x5561c76fa4c0 2026-02-20T13:23:09.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc0f6d30 con 0x5561c76fa4c0 2026-02-20T13:23:09.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.125+0000 7f8f96ffd640 1 -- 10.20.193.28:0/3061729874 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8fcc019400 con 0x5561c76fa4c0 2026-02-20T13:23:09.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 10 client.27334 _ll_register_callbacks cb 0x5561c7590a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:09.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561c72a5520 con 0x5561c76fa4c0 2026-02-20T13:23:09.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8f96ffd640 1 -- 10.20.193.28:0/3061729874 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fcc01be80 con 0x5561c76fa4c0 2026-02-20T13:23:09.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 10 client.27334 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:09.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5561c7589da0 con 0x5561c76fa4c0 2026-02-20T13:23:09.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8f96ffd640 1 -- 10.20.193.28:0/3061729874 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8fcc01b4f0 con 0x5561c76fa4c0 2026-02-20T13:23:09.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 10 client.27334 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:09.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 10 client.27334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:09.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 20 client.27334 populate_metadata read hostname 'trial028' 2026-02-20T13:23:09.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5561c7718030 0x5561c77184d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 4 client.27334 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:09.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.126+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561c7637630 con 0x5561c7718030 2026-02-20T13:23:09.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.127+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5561c7718030 0x5561c77184d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.127+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5561c7718030 0x5561c77184d0 crc :-1 s=READY pgs=180 gs=4 cs=0 l=0 c_cookie=4220992467884487970 s_cookie=15965357156486843896 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a93fa4927dab522 server_cookie=dd9057bee8a38df8 in_seq=0 out_seq=0 2026-02-20T13:23:09.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.127+0000 7f8f96ffd640 10 client.27334 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:09.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.127+0000 7f8f96ffd640 1 -- 10.20.193.28:0/3061729874 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5561c7637630 con 0x5561c7718030 2026-02-20T13:23:09.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.127+0000 7f8f96ffd640 10 client.27334 handle_command_reply: tid=0 2026-02-20T13:23:09.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 client.27334 shutdown 2026-02-20T13:23:09.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c76fa4c0 msgr2=0x5561c77139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c76fa4c0 0x5561c77139a0 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=1623833723923172914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc0043f0 tx=0x7f8fcc013040 comp rx=0 tx=0).stop 2026-02-20T13:23:09.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 shutdown_connections 2026-02-20T13:23:09.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5561c7718030 0x5561c77184d0 crc :-1 s=READY pgs=180 gs=4 cs=0 l=0 c_cookie=4220992467884487970 s_cookie=15965357156486843896 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c771ade0 0x5561c7713ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c77149b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/3061729874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c76fa4c0 0x5561c77139a0 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=1623833723923172914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 >> 10.20.193.28:0/3061729874 conn(0x5561c76191c0 msgr2=0x5561c76fb790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8f96ffd640 0 client.27334 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:09.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 shutdown_connections 2026-02-20T13:23:09.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 1 -- 10.20.193.28:0/3061729874 wait complete. 2026-02-20T13:23:09.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.128+0000 7f8fe6488e00 20 client.27334 trim_cache size 0 max 16384 2026-02-20T13:23:09.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe6488e00 1 Processor -- start 2026-02-20T13:23:09.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe6488e00 1 -- start start 2026-02-20T13:23:09.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c76fed10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c77395c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c7739b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561c76038d0 con 0x5561c76fa4c0 2026-02-20T13:23:09.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5561c7344f10 con 0x5561c773b700 2026-02-20T13:23:09.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5561c760ffd0 con 0x5561c771ade0 2026-02-20T13:23:09.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c76fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c76fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46990/0 (socket says 10.20.193.28:46990) 2026-02-20T13:23:09.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/161033889 learned_addr learned my addr 10.20.193.28:0/161033889 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c77395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.136+0000 7f8fe23d1640 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c7739b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/161033889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 msgr2=0x5561c77395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c77395c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/161033889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 msgr2=0x5561c7739b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c7739b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/161033889 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c7706060 con 0x5561c76fa4c0 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c76fed10 secure :-1 s=READY pgs=772 gs=1 cs=0 l=1 c_cookie=16480132555209093799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc004420 tx=0x7f8fcc02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b5313e5496b2a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fa93fd640 1 -- 10.20.193.28:0/161033889 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc021070 con 0x5561c76fa4c0 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fa93fd640 1 -- 10.20.193.28:0/161033889 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8fcc01ce90 con 0x5561c76fa4c0 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fa93fd640 1 -- 10.20.193.28:0/161033889 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc00e660 con 0x5561c76fa4c0 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe6488e00 1 -- 10.20.193.28:0/161033889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 msgr2=0x5561c76fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c76fed10 secure :-1 s=READY pgs=772 gs=1 cs=0 l=1 c_cookie=16480132555209093799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc004420 tx=0x7f8fcc02a000 comp rx=0 tx=0).stop 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe6488e00 1 -- 10.20.193.28:0/161033889 shutdown_connections 2026-02-20T13:23:09.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c7739b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c77395c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/161033889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c76fed10 unknown :-1 s=CLOSED pgs=772 gs=1 cs=0 l=1 c_cookie=16480132555209093799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.137+0000 7f8fe6488e00 1 -- 10.20.193.28:0/161033889 >> 10.20.193.28:0/161033889 conn(0x5561c76191c0 msgr2=0x5561c770fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.138+0000 7f8fe6488e00 1 -- 10.20.193.28:0/161033889 shutdown_connections 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.138+0000 7f8fe6488e00 1 -- 10.20.193.28:0/161033889 wait complete. 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.138+0000 7f8fe6488e00 1 -- start start 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.138+0000 7f8fe6488e00 1 Processor -- start 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.138+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771c7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c771ce40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe6488e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c771d990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561c7713da0 con 0x5561c76fa4c0 2026-02-20T13:23:09.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5561c771e070 con 0x5561c773b700 2026-02-20T13:23:09.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe6488e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5561c771e230 con 0x5561c771ade0 2026-02-20T13:23:09.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46996/0 (socket says 10.20.193.28:46996) 2026-02-20T13:23:09.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/7923589 learned_addr learned my addr 10.20.193.28:0/7923589 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c771ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe23d1640 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c771d990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/7923589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 msgr2=0x5561c771ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c771ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/7923589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 msgr2=0x5561c771d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c771d990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 -- 10.20.193.28:0/7923589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c759b670 con 0x5561c76fa4c0 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c771ce40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe1bd0640 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771c7a0 secure :-1 s=READY pgs=773 gs=1 cs=0 l=1 c_cookie=7216661702693168907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc005550 tx=0x7f8fcc0058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6426bb954531270b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8f96ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8f96ffd640 1 -- 10.20.193.28:0/7923589 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc021040 con 0x5561c76fa4c0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc0056d0 con 0x5561c76fa4c0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8f96ffd640 1 -- 10.20.193.28:0/7923589 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5561c72a5520 con 0x5561c76fa4c0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe6488e00 10 client.17466 _ll_register_callbacks cb 0x5561c7590a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561c76b5ca0 con 0x5561c76fa4c0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.139+0000 7f8f96ffd640 1 -- 10.20.193.28:0/7923589 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc021040 con 0x5561c76fa4c0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8f96ffd640 1 -- 10.20.193.28:0/7923589 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8fcc0317e0 con 0x5561c76fa4c0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8f96ffd640 1 -- 10.20.193.28:0/7923589 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fcc0319e0 con 0x5561c76fa4c0 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe6488e00 10 client.17466 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:09.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5561c75960f0 con 0x5561c76fa4c0 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8f96ffd640 1 -- 10.20.193.28:0/7923589 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8fcc041070 con 0x5561c76fa4c0 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe6488e00 10 client.17466 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe6488e00 10 client.17466 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe6488e00 20 client.17466 populate_metadata read hostname 'trial028' 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5561c771fb90 0x5561c7720030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe6488e00 4 client.17466 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561c72e9640 con 0x5561c771fb90 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.140+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5561c771fb90 0x5561c7720030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.141+0000 7f8fe13cf640 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5561c771fb90 0x5561c7720030 crc :-1 s=READY pgs=181 gs=4 cs=0 l=0 c_cookie=6291947597402146164 s_cookie=3375525462969919509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57517d00f0870574 server_cookie=2ed84686369ba815 in_seq=0 out_seq=0 2026-02-20T13:23:09.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.141+0000 7f8f96ffd640 10 client.17466 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:09.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8f96ffd640 1 -- 10.20.193.28:0/7923589 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561c72e9640 con 0x5561c771fb90 2026-02-20T13:23:09.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8f96ffd640 10 client.17466 handle_command_reply: tid=0 2026-02-20T13:23:09.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 client.17466 shutdown 2026-02-20T13:23:09.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 msgr2=0x5561c771c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771c7a0 secure :-1 s=READY pgs=773 gs=1 cs=0 l=1 c_cookie=7216661702693168907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc005550 tx=0x7f8fcc0058f0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 shutdown_connections 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5561c771fb90 0x5561c7720030 crc :-1 s=READY pgs=181 gs=4 cs=0 l=0 c_cookie=6291947597402146164 s_cookie=3375525462969919509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5561c773b700 0x5561c771d990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5561c771ade0 0x5561c771ce40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 --2- 10.20.193.28:0/7923589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561c76fa4c0 0x5561c771c7a0 unknown :-1 s=CLOSED pgs=773 gs=1 cs=0 l=1 c_cookie=7216661702693168907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 >> 10.20.193.28:0/7923589 conn(0x5561c76191c0 msgr2=0x5561c7710500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8f96ffd640 0 client.17466 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.146+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 shutdown_connections 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe6488e00 1 -- 10.20.193.28:0/7923589 wait complete. 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe6488e00 20 client.17466 trim_cache size 0 max 16384 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:23:09.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:23:09.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:23:09.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:23:09.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fb80b56e0 msgr2=0x7f8fb80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fb80b56e0 0x7f8fb80d5b90 secure :-1 s=READY pgs=389 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc004740 tx=0x7f8fcc009310 comp rx=0 tx=0).stop 2026-02-20T13:23:09.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/2808115906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fdc10b8a0 msgr2=0x7f8fdc0f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fdc10b8a0 0x7f8fdc0f4f20 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fd002fb70 tx=0x7f8fd002fba0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/2808115906 shutdown_connections 2026-02-20T13:23:09.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8fb80b56e0 0x7f8fb80d5b90 unknown :-1 s=CLOSED pgs=389 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8fdc10c250 0x7f8fdc0f5b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8fdc10b8a0 0x7f8fdc0f4f20 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 --2- 10.20.193.28:0/2808115906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fdc060710 0x7f8fdc0f48d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.147+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/2808115906 >> 10.20.193.28:0/2808115906 conn(0x7f8fdc0e8f40 msgr2=0x7f8fdc0eabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.148+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/2808115906 shutdown_connections 2026-02-20T13:23:09.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:09.148+0000 7f8fe2bd2640 1 -- 10.20.193.28:0/2808115906 wait complete. 2026-02-20T13:23:09.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 -- 10.20.193.28:0/3089704454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc111060 msgr2=0x7f67cc111500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 --2- 10.20.193.28:0/3089704454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc111060 0x7f67cc111500 secure :-1 s=READY pgs=774 gs=2 cs=0 l=1 c_cookie=14900859347575885349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67c000aa60 tx=0x7f67c00302b0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 -- 10.20.193.28:0/3089704454 shutdown_connections 2026-02-20T13:23:09.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 --2- 10.20.193.28:0/3089704454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc111060 0x7f67cc111500 unknown :-1 s=CLOSED pgs=774 gs=2 cs=0 l=1 c_cookie=14900859347575885349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 --2- 10.20.193.28:0/3089704454 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f67cc10c470 0x7f67cc110a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 --2- 10.20.193.28:0/3089704454 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f67cc10ba80 0x7f67cc10be50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 -- 10.20.193.28:0/3089704454 >> 10.20.193.28:0/3089704454 conn(0x7f67cc0e96b0 msgr2=0x7f67cc109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 -- 10.20.193.28:0/3089704454 shutdown_connections 2026-02-20T13:23:09.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 -- 10.20.193.28:0/3089704454 wait complete. 2026-02-20T13:23:09.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.284+0000 7f67d21cc640 1 Processor -- start 2026-02-20T13:23:09.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67d21cc640 1 -- start start 2026-02-20T13:23:09.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67d21cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc10ba80 0x7f67cc121a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67d21cc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f67cc10c470 0x7f67cc121f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67d21cc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f67cc111060 0x7f67cc127340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67d21cc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f67cc127960 con 0x7f67cc10ba80 2026-02-20T13:23:09.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67d21cc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f67cc127ad0 con 0x7f67cc10c470 2026-02-20T13:23:09.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67d21cc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f67cc127c90 con 0x7f67cc111060 2026-02-20T13:23:09.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc10ba80 0x7f67cc121a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67caffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f67cc10c470 0x7f67cc121f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc10ba80 0x7f67cc121a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47014/0 (socket says 10.20.193.28:47014) 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67caffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f67cc10c470 0x7f67cc121f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35580/0 (socket says 10.20.193.28:35580) 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cb7fe640 1 -- 10.20.193.28:0/826427641 learned_addr learned my addr 10.20.193.28:0/826427641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cbfff640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f67cc111060 0x7f67cc127340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cb7fe640 1 -- 10.20.193.28:0/826427641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f67cc111060 msgr2=0x7f67cc127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f67cc111060 0x7f67cc127340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cb7fe640 1 -- 10.20.193.28:0/826427641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f67cc10c470 msgr2=0x7f67cc121f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f67cc10c470 0x7f67cc121f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.285+0000 7f67cb7fe640 1 -- 10.20.193.28:0/826427641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c000a650 con 0x7f67cc10ba80 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.286+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc10ba80 0x7f67cc121a30 secure :-1 s=READY pgs=775 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67b800d950 tx=0x7f67b800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.286+0000 7f67c8ff9640 1 -- 10.20.193.28:0/826427641 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67b8004540 con 0x7f67cc10ba80 2026-02-20T13:23:09.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.286+0000 7f67c8ff9640 1 -- 10.20.193.28:0/826427641 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f67b8009c80 con 0x7f67cc10ba80 2026-02-20T13:23:09.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.286+0000 7f67d21cc640 1 -- 10.20.193.28:0/826427641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67cc127f70 con 0x7f67cc10ba80 2026-02-20T13:23:09.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.286+0000 7f67c8ff9640 1 -- 10.20.193.28:0/826427641 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67b80106e0 con 0x7f67cc10ba80 2026-02-20T13:23:09.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.286+0000 7f67d21cc640 1 -- 10.20.193.28:0/826427641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67cc168670 con 0x7f67cc10ba80 2026-02-20T13:23:09.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.289+0000 7f67c8ff9640 1 -- 10.20.193.28:0/826427641 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f67b8009740 con 0x7f67cc10ba80 2026-02-20T13:23:09.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.290+0000 7f67c8ff9640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f67a00b56e0 0x7f67a00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.290+0000 7f67c8ff9640 1 -- 10.20.193.28:0/826427641 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f67b80e6c60 con 0x7f67cc10ba80 2026-02-20T13:23:09.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.291+0000 7f67caffd640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f67a00b56e0 0x7f67a00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.291+0000 7f67caffd640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f67a00b56e0 0x7f67a00d5b90 secure :-1 s=READY pgs=390 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67cc1283d0 tx=0x7f67bc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.292+0000 7f67d41c6e00 1 Processor -- start 2026-02-20T13:23:09.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.292+0000 7f67d41c6e00 1 -- start start 2026-02-20T13:23:09.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.292+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750222e730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.292+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 0x5575022735e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.292+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502293f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.292+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557502144780 con 0x55750222ec70 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.292+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5575021404b0 con 0x557502273b20 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.292+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55750213a450 con 0x55750222e360 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750222e730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750222e730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54970/0 (socket says 10.20.193.28:54970) 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 -- 10.20.193.28:0/3371063422 learned_addr learned my addr 10.20.193.28:0/3371063422 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cbfff640 1 --2- 10.20.193.28:0/3371063422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502293f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 -- 10.20.193.28:0/3371063422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 msgr2=0x557502293f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/3371063422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502293f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 -- 10.20.193.28:0/3371063422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 msgr2=0x5575022735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/3371063422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 0x5575022735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 -- 10.20.193.28:0/3371063422 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575020e5d10 con 0x55750222e360 2026-02-20T13:23:09.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/3371063422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750222e730 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=10338290532159864348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67b80a9590 tx=0x7f67b8002bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f78fc76e22c3e1c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f678ffff640 1 -- 10.20.193.28:0/3371063422 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67b80ac7c0 con 0x55750222e360 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f678ffff640 1 -- 10.20.193.28:0/3371063422 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f67b80ad9c0 con 0x55750222e360 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f678ffff640 1 -- 10.20.193.28:0/3371063422 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67b80d20d0 con 0x55750222e360 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67d41c6e00 1 -- 10.20.193.28:0/3371063422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 msgr2=0x55750222e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/3371063422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750222e730 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=10338290532159864348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67b80a9590 tx=0x7f67b8002bc0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67d41c6e00 1 -- 10.20.193.28:0/3371063422 shutdown_connections 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/3371063422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 0x5575022735e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/3371063422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502293f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/3371063422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750222e730 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=10338290532159864348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.293+0000 7f67d41c6e00 1 -- 10.20.193.28:0/3371063422 >> 10.20.193.28:0/3371063422 conn(0x55750220c860 msgr2=0x55750222cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.294+0000 7f67d41c6e00 1 -- 10.20.193.28:0/3371063422 shutdown_connections 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.294+0000 7f67d41c6e00 1 -- 10.20.193.28:0/3371063422 wait complete. 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.295+0000 7f67d41c6e00 1 -- start start 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.295+0000 7f67d41c6e00 1 Processor -- start 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.295+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222e360 0x55750228b770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.295+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222ec70 0x55750228bcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557502273b20 0x55750228da40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55750228dfb0 con 0x55750222e360 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55750228e120 con 0x55750222ec70 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55750228e2e0 con 0x557502273b20 2026-02-20T13:23:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67cbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557502273b20 0x55750228da40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67caffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222ec70 0x55750228bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222e360 0x55750228b770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67caffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222ec70 0x55750228bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35598/0 (socket says 10.20.193.28:35598) 2026-02-20T13:23:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67caffd640 1 -- 10.20.193.28:0/113682193 learned_addr learned my addr 10.20.193.28:0/113682193 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67cb7fe640 1 -- 10.20.193.28:0/113682193 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557502273b20 msgr2=0x55750228da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557502273b20 0x55750228da40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67cb7fe640 1 -- 10.20.193.28:0/113682193 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222ec70 msgr2=0x55750228bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222ec70 0x55750228bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67cb7fe640 1 -- 10.20.193.28:0/113682193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575020be3c0 con 0x55750222e360 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f678d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.296+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222e360 0x55750228b770 secure :-1 s=READY pgs=776 gs=3 cs=0 l=1 c_cookie=994933592655128253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67b80a9590 tx=0x7f67b80027c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dceb6d4c54fe6bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f678d7fa640 1 -- 10.20.193.28:0/113682193 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67b80ac7c0 con 0x55750222e360 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f678d7fa640 1 -- 10.20.193.28:0/113682193 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f67b80b52c0 con 0x55750222e360 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f678d7fa640 1 -- 10.20.193.28:0/113682193 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67b80a9410 con 0x55750222e360 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67cc168670 con 0x55750222e360 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f678d7fa640 1 -- 10.20.193.28:0/113682193 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f67b80e4bd0 con 0x55750222e360 2026-02-20T13:23:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 10 client.17475 _ll_register_callbacks cb 0x5575020bba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557501dd06f0 con 0x55750222e360 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f678d7fa640 1 -- 10.20.193.28:0/113682193 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67b80b7ef0 con 0x55750222e360 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 10 client.17475 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5575020d00e0 con 0x55750222e360 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f678d7fa640 1 -- 10.20.193.28:0/113682193 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67b80adc50 con 0x55750222e360 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 10 client.17475 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 10 client.17475 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 20 client.17475 populate_metadata read hostname 'trial028' 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557502270d00 0x5575022711a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 4 client.17475 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.297+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575020dcf80 con 0x557502270d00 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.298+0000 7f67caffd640 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557502270d00 0x5575022711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.298+0000 7f67caffd640 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557502270d00 0x5575022711a0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=17700231632652582914 s_cookie=15363192113065023517 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f5a3dae3da63c002 server_cookie=d53505d44352d81d in_seq=0 out_seq=0 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.298+0000 7f678d7fa640 10 client.17475 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f678d7fa640 1 -- 10.20.193.28:0/113682193 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5575020dcf80 con 0x557502270d00 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f678d7fa640 10 client.17475 handle_command_reply: tid=0 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 client.17475 shutdown 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222e360 msgr2=0x55750228b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222e360 0x55750228b770 secure :-1 s=READY pgs=776 gs=3 cs=0 l=1 c_cookie=994933592655128253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67b80a9590 tx=0x7f67b80027c0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 shutdown_connections 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557502270d00 0x5575022711a0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=17700231632652582914 s_cookie=15363192113065023517 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557502273b20 0x55750228da40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222ec70 0x55750228bcb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/113682193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222e360 0x55750228b770 unknown :-1 s=CLOSED pgs=776 gs=3 cs=0 l=1 c_cookie=994933592655128253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.299+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 >> 10.20.193.28:0/113682193 conn(0x55750220c860 msgr2=0x55750222cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.300+0000 7f678d7fa640 0 client.17475 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:23:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.300+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 shutdown_connections 2026-02-20T13:23:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.300+0000 7f67d41c6e00 1 -- 10.20.193.28:0/113682193 wait complete. 2026-02-20T13:23:09.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.300+0000 7f67d41c6e00 20 client.17475 trim_cache size 0 max 16384 2026-02-20T13:23:09.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67d41c6e00 1 Processor -- start 2026-02-20T13:23:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67d41c6e00 1 -- start start 2026-02-20T13:23:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750228d9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 0x557502288900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502288e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557502138080 con 0x55750222ec70 2026-02-20T13:23:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557501df8700 con 0x557502273b20 2026-02-20T13:23:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557502291b70 con 0x55750222e360 2026-02-20T13:23:09.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67cb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750228d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67caffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 0x557502288900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67cbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502288e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67cbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502288e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35606/0 (socket says 10.20.193.28:35606) 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67cbfff640 1 -- 10.20.193.28:0/804876453 learned_addr learned my addr 10.20.193.28:0/804876453 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67caffd640 1 -- 10.20.193.28:0/804876453 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 msgr2=0x55750228d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.307+0000 7f67caffd640 1 --2- 10.20.193.28:0/804876453 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750228d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67caffd640 1 -- 10.20.193.28:0/804876453 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 msgr2=0x557502288e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67caffd640 1 --2- 10.20.193.28:0/804876453 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502288e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67caffd640 1 -- 10.20.193.28:0/804876453 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575020cab60 con 0x55750222ec70 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67caffd640 1 --2- 10.20.193.28:0/804876453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 0x557502288900 secure :-1 s=READY pgs=777 gs=1 cs=0 l=1 c_cookie=5886166050128048703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55750228c770 tx=0x7f67bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51afdcd61ad8b23f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f678f7fe640 1 -- 10.20.193.28:0/804876453 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67bc024040 con 0x55750222ec70 2026-02-20T13:23:09.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f678f7fe640 1 -- 10.20.193.28:0/804876453 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f67bc015070 con 0x55750222ec70 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f678f7fe640 1 -- 10.20.193.28:0/804876453 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67bc0288b0 con 0x55750222ec70 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 -- 10.20.193.28:0/804876453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 msgr2=0x557502288900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/804876453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 0x557502288900 secure :-1 s=READY pgs=777 gs=1 cs=0 l=1 c_cookie=5886166050128048703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55750228c770 tx=0x7f67bc013000 comp rx=0 tx=0).stop 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 -- 10.20.193.28:0/804876453 shutdown_connections 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/804876453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55750222ec70 0x557502288900 unknown :-1 s=CLOSED pgs=777 gs=1 cs=0 l=1 c_cookie=5886166050128048703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/804876453 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557502273b20 0x557502288e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/804876453 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222e360 0x55750228d9d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 -- 10.20.193.28:0/804876453 >> 10.20.193.28:0/804876453 conn(0x55750220c860 msgr2=0x5575022902d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 -- 10.20.193.28:0/804876453 shutdown_connections 2026-02-20T13:23:09.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.308+0000 7f67d41c6e00 1 -- 10.20.193.28:0/804876453 wait complete. 2026-02-20T13:23:09.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.309+0000 7f67d41c6e00 1 -- start start 2026-02-20T13:23:09.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.309+0000 7f67d41c6e00 1 Processor -- start 2026-02-20T13:23:09.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.309+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222e360 0x55750228e900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.309+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222ec70 0x55750228ee40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.309+0000 7f67d41c6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557502273b20 0x55750220dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.309+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55750228f790 con 0x557502273b20 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.309+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55750220e180 con 0x55750222e360 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.309+0000 7f67d41c6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55750220e340 con 0x55750222ec70 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67caffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222ec70 0x55750228ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222e360 0x55750228e900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557502273b20 0x55750220dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557502273b20 0x55750220dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47056/0 (socket says 10.20.193.28:47056) 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 -- 10.20.193.28:0/182643214 learned_addr learned my addr 10.20.193.28:0/182643214 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67caffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222ec70 0x55750228ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54988/0 (socket says 10.20.193.28:54988) 2026-02-20T13:23:09.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 -- 10.20.193.28:0/182643214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222ec70 msgr2=0x55750228ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222ec70 0x55750228ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 -- 10.20.193.28:0/182643214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222e360 msgr2=0x55750228e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222e360 0x55750228e900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 -- 10.20.193.28:0/182643214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575020be6f0 con 0x557502273b20 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67cbfff640 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557502273b20 0x55750220dc40 secure :-1 s=READY pgs=778 gs=2 cs=0 l=1 c_cookie=660844894151032283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67c0031fd0 tx=0x7f67c00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bcaee0f80bddb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f678d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f678d7fa640 1 -- 10.20.193.28:0/182643214 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67c003e050 con 0x557502273b20 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f678d7fa640 1 -- 10.20.193.28:0/182643214 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f67c003f040 con 0x557502273b20 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f678d7fa640 1 -- 10.20.193.28:0/182643214 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67c00468b0 con 0x557502273b20 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc00be70 con 0x557502273b20 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.310+0000 7f678d7fa640 1 -- 10.20.193.28:0/182643214 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f67c0046a40 con 0x557502273b20 2026-02-20T13:23:09.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f678d7fa640 10 client.17481 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 10 client.17481 _ll_register_callbacks cb 0x5575020bba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67b80ad9c0 con 0x557502273b20 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f678d7fa640 1 -- 10.20.193.28:0/182643214 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67c0039b80 con 0x557502273b20 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 10 client.17481 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5575020d0340 con 0x557502273b20 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f678d7fa640 1 -- 10.20.193.28:0/182643214 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67c0044040 con 0x557502273b20 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 10 client.17481 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 10 client.17481 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 20 client.17481 populate_metadata read hostname 'trial028' 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557502210160 0x557502210600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 4 client.17481 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.311+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557501dcdf40 con 0x557502210160 2026-02-20T13:23:09.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557502210160 0x557502210600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67cb7fe640 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557502210160 0x557502210600 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=8062736836786051520 s_cookie=8751705141318732107 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6fe4986f5216d9c0 server_cookie=79744d751f43494b in_seq=0 out_seq=0 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f678d7fa640 10 client.17481 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f678d7fa640 1 -- 10.20.193.28:0/182643214 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557501dcdf40 con 0x557502210160 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f678d7fa640 10 client.17481 handle_command_reply: tid=0 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 client.17481 shutdown 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557502273b20 msgr2=0x55750220dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557502273b20 0x55750220dc40 secure :-1 s=READY pgs=778 gs=2 cs=0 l=1 c_cookie=660844894151032283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67c0031fd0 tx=0x7f67c00039b0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 shutdown_connections 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557502210160 0x557502210600 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=8062736836786051520 s_cookie=8751705141318732107 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557502273b20 0x55750220dc40 unknown :-1 s=CLOSED pgs=778 gs=2 cs=0 l=1 c_cookie=660844894151032283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55750222ec70 0x55750228ee40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f678d7fa640 0 client.17481 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:23:09.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 --2- 10.20.193.28:0/182643214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55750222e360 0x55750228e900 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 >> 10.20.193.28:0/182643214 conn(0x55750220c860 msgr2=0x557502289990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 shutdown_connections 2026-02-20T13:23:09.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.312+0000 7f67d41c6e00 1 -- 10.20.193.28:0/182643214 wait complete. 2026-02-20T13:23:09.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d41c6e00 20 client.17481 trim_cache size 0 max 16384 2026-02-20T13:23:09.321 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:09.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 -- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f67a00b56e0 msgr2=0x7f67a00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f67a00b56e0 0x7f67a00d5b90 secure :-1 s=READY pgs=390 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67cc1283d0 tx=0x7f67bc00b410 comp rx=0 tx=0).stop 2026-02-20T13:23:09.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 -- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc10ba80 msgr2=0x7f67cc121a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc10ba80 0x7f67cc121a30 secure :-1 s=READY pgs=775 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67b800d950 tx=0x7f67b800de20 comp rx=0 tx=0).stop 2026-02-20T13:23:09.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 -- 10.20.193.28:0/826427641 shutdown_connections 2026-02-20T13:23:09.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f67a00b56e0 0x7f67a00d5b90 unknown :-1 s=CLOSED pgs=390 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f67cc111060 0x7f67cc127340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f67cc10c470 0x7f67cc121f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 --2- 10.20.193.28:0/826427641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67cc10ba80 0x7f67cc121a30 unknown :-1 s=CLOSED pgs=775 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 -- 10.20.193.28:0/826427641 >> 10.20.193.28:0/826427641 conn(0x7f67cc0e96b0 msgr2=0x7f67cc109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 -- 10.20.193.28:0/826427641 shutdown_connections 2026-02-20T13:23:09.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.313+0000 7f67d21cc640 1 -- 10.20.193.28:0/826427641 wait complete. 2026-02-20T13:23:09.412 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:23:09.596 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:09.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.773+0000 7fb91094b640 1 -- 10.20.193.28:0/1210985655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060a00 msgr2=0x7fb908112960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.773+0000 7fb91094b640 1 --2- 10.20.193.28:0/1210985655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060a00 0x7fb908112960 secure :-1 s=READY pgs=779 gs=3 cs=0 l=1 c_cookie=16382161301744252518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8f4009890 tx=0x7fb8f402f0e0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.773+0000 7fb91094b640 1 -- 10.20.193.28:0/1210985655 shutdown_connections 2026-02-20T13:23:09.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.773+0000 7fb91094b640 1 --2- 10.20.193.28:0/1210985655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060a00 0x7fb908112960 unknown :-1 s=CLOSED pgs=779 gs=3 cs=0 l=1 c_cookie=16382161301744252518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.774+0000 7fb91094b640 1 --2- 10.20.193.28:0/1210985655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb908113110 0x7fb908173ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.774+0000 7fb91094b640 1 --2- 10.20.193.28:0/1210985655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb908060010 0x7fb9080603e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.774+0000 7fb91094b640 1 -- 10.20.193.28:0/1210985655 >> 10.20.193.28:0/1210985655 conn(0x7fb9080e9670 msgr2=0x7fb908109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.774+0000 7fb91094b640 1 -- 10.20.193.28:0/1210985655 shutdown_connections 2026-02-20T13:23:09.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.774+0000 7fb91094b640 1 -- 10.20.193.28:0/1210985655 wait complete. 2026-02-20T13:23:09.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.774+0000 7fb91094b640 1 Processor -- start 2026-02-20T13:23:09.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.774+0000 7fb91094b640 1 -- start start 2026-02-20T13:23:09.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb91094b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060010 0x7fb9080f3890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb91094b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb908060a00 0x7fb9081739e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb91094b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb908113110 0x7fb9080f3f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb91094b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb9080f91a0 con 0x7fb908060010 2026-02-20T13:23:09.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb91094b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb9080f9310 con 0x7fb908113110 2026-02-20T13:23:09.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb91094b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb9080f94d0 con 0x7fb908060a00 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90e6c0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060010 0x7fb9080f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90debf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb908060a00 0x7fb9081739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90e6c0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060010 0x7fb9080f3890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47086/0 (socket says 10.20.193.28:47086) 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90e6c0640 1 -- 10.20.193.28:0/3239753334 learned_addr learned my addr 10.20.193.28:0/3239753334 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90eec1640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb908113110 0x7fb9080f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90debf640 1 -- 10.20.193.28:0/3239753334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb908113110 msgr2=0x7fb9080f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90debf640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb908113110 0x7fb9080f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90debf640 1 -- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060010 msgr2=0x7fb9080f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90debf640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060010 0x7fb9080f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90debf640 1 -- 10.20.193.28:0/3239753334 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f40094b0 con 0x7fb908060a00 2026-02-20T13:23:09.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060010 0x7fb9080f3890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:09.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.775+0000 7fb90debf640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb908060a00 0x7fb9081739e0 secure :-1 s=READY pgs=254 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8f4009230 tx=0x7fb8f40028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.776+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3239753334 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8f403d070 con 0x7fb908060a00 2026-02-20T13:23:09.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.776+0000 7fb91094b640 1 -- 10.20.193.28:0/3239753334 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9080f9750 con 0x7fb908060a00 2026-02-20T13:23:09.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.776+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3239753334 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8f402fcb0 con 0x7fb908060a00 2026-02-20T13:23:09.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.776+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3239753334 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8f4041800 con 0x7fb908060a00 2026-02-20T13:23:09.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.776+0000 7fb91094b640 1 -- 10.20.193.28:0/3239753334 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9080f9c10 con 0x7fb908060a00 2026-02-20T13:23:09.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.778+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3239753334 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb8f404b440 con 0x7fb908060a00 2026-02-20T13:23:09.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.780+0000 7fb8f37fe640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8e40b5750 0x7fb8e40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.780+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3239753334 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb8f410b370 con 0x7fb908060a00 2026-02-20T13:23:09.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.780+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8e40b5750 0x7fb8e40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8e40b5750 0x7fb8e40d5c00 secure :-1 s=READY pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9000095d0 tx=0x7fb900005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb912945e00 1 Processor -- start 2026-02-20T13:23:09.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb912945e00 1 -- start start 2026-02-20T13:23:09.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb912945e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2bc730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb912945e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3015e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb912945e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 0x55591a321f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb912945e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55591a1d2780 con 0x55591a2bc360 2026-02-20T13:23:09.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb912945e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55591a1ce4b0 con 0x55591a2bcc70 2026-02-20T13:23:09.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.781+0000 7fb912945e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55591a1c8450 con 0x55591a301b20 2026-02-20T13:23:09.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2bc730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90eec1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 0x55591a321f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2bc730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47096/0 (socket says 10.20.193.28:47096) 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 -- 10.20.193.28:0/1878934799 learned_addr learned my addr 10.20.193.28:0/1878934799 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90debf640 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 -- 10.20.193.28:0/1878934799 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 msgr2=0x55591a321f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 0x55591a321f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 -- 10.20.193.28:0/1878934799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 msgr2=0x55591a3015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3015e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 -- 10.20.193.28:0/1878934799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55591a173d10 con 0x55591a2bc360 2026-02-20T13:23:09.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90debf640 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3015e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2bc730 secure :-1 s=READY pgs=780 gs=1 cs=0 l=1 c_cookie=1311473222401313771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb900009ee0 tx=0x7fb900014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123349f281aacbeb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb8f0cf3640 1 -- 10.20.193.28:0/1878934799 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb900004a70 con 0x55591a2bc360 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb8f0cf3640 1 -- 10.20.193.28:0/1878934799 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb900005500 con 0x55591a2bc360 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.782+0000 7fb8f0cf3640 1 -- 10.20.193.28:0/1878934799 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb90001cc40 con 0x55591a2bc360 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 -- 10.20.193.28:0/1878934799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 msgr2=0x55591a2bc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2bc730 secure :-1 s=READY pgs=780 gs=1 cs=0 l=1 c_cookie=1311473222401313771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb900009ee0 tx=0x7fb900014000 comp rx=0 tx=0).stop 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 -- 10.20.193.28:0/1878934799 shutdown_connections 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 0x55591a321f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3015e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 --2- 10.20.193.28:0/1878934799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2bc730 unknown :-1 s=CLOSED pgs=780 gs=1 cs=0 l=1 c_cookie=1311473222401313771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 -- 10.20.193.28:0/1878934799 >> 10.20.193.28:0/1878934799 conn(0x55591a29a860 msgr2=0x55591a2bac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 -- 10.20.193.28:0/1878934799 shutdown_connections 2026-02-20T13:23:09.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.783+0000 7fb912945e00 1 -- 10.20.193.28:0/1878934799 wait complete. 2026-02-20T13:23:09.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.784+0000 7fb912945e00 1 -- start start 2026-02-20T13:23:09.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.784+0000 7fb912945e00 1 Processor -- start 2026-02-20T13:23:09.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb912945e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a319770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb912945e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bcc70 0x55591a319cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb912945e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a301b20 0x55591a31ba40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb912945e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55591a31bfb0 con 0x55591a2bc360 2026-02-20T13:23:09.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb912945e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55591a31c120 con 0x55591a301b20 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb912945e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55591a31c2e0 con 0x55591a2bcc70 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90eec1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a301b20 0x55591a31ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90eec1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a301b20 0x55591a31ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35656/0 (socket says 10.20.193.28:35656) 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90eec1640 1 -- 10.20.193.28:0/1820583311 learned_addr learned my addr 10.20.193.28:0/1820583311 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90e6c0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a319770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90debf640 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bcc70 0x55591a319cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90eec1640 1 -- 10.20.193.28:0/1820583311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bcc70 msgr2=0x55591a319cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90eec1640 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bcc70 0x55591a319cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90eec1640 1 -- 10.20.193.28:0/1820583311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 msgr2=0x55591a319770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90eec1640 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a319770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90eec1640 1 -- 10.20.193.28:0/1820583311 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55591a14c3c0 con 0x55591a301b20 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.785+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a319770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb90eec1640 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a301b20 0x55591a31ba40 secure :-1 s=READY pgs=299 gs=2 cs=0 l=1 c_cookie=3440757305369114155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc00a5b0 tx=0x7fb8fc00aac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc0068a10db362b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb8bbfff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb8bbfff640 1 -- 10.20.193.28:0/1820583311 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8fc017070 con 0x55591a301b20 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb8bbfff640 1 -- 10.20.193.28:0/1820583311 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8fc012d50 con 0x55591a301b20 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb8bbfff640 1 -- 10.20.193.28:0/1820583311 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8fc011440 con 0x55591a301b20 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb900003ea0 con 0x55591a301b20 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb8bbfff640 1 -- 10.20.193.28:0/1820583311 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb8fc0115a0 con 0x55591a301b20 2026-02-20T13:23:09.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb912945e00 10 client.27467 _ll_register_callbacks cb 0x55591a149a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555919e5e6f0 con 0x55591a301b20 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb8bbfff640 1 -- 10.20.193.28:0/1820583311 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb8fc012870 con 0x55591a301b20 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb912945e00 10 client.27467 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.786+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55591a15e0e0 con 0x55591a301b20 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb8bbfff640 1 -- 10.20.193.28:0/1820583311 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb8fc012a10 con 0x55591a301b20 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb912945e00 10 client.27467 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb912945e00 10 client.27467 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb912945e00 20 client.27467 populate_metadata read hostname 'trial028' 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb912945e00 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55591a321c80 0x55591a2ff8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb912945e00 4 client.27467 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:09.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55591a16af80 con 0x55591a321c80 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55591a321c80 0x55591a2ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55591a321c80 0x55591a2ff8a0 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=13310641049545681801 s_cookie=15102601967611913588 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b8b8e58302e72b89 server_cookie=d1973878f79fa574 in_seq=0 out_seq=0 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.787+0000 7fb8bbfff640 10 client.27467 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb8bbfff640 1 -- 10.20.193.28:0/1820583311 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55591a16af80 con 0x55591a321c80 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb8bbfff640 10 client.27467 handle_command_reply: tid=0 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 client.27467 shutdown 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a301b20 msgr2=0x55591a31ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a301b20 0x55591a31ba40 secure :-1 s=READY pgs=299 gs=2 cs=0 l=1 c_cookie=3440757305369114155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc00a5b0 tx=0x7fb8fc00aac0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 shutdown_connections 2026-02-20T13:23:09.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55591a321c80 0x55591a2ff8a0 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=13310641049545681801 s_cookie=15102601967611913588 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a301b20 0x55591a31ba40 unknown :-1 s=CLOSED pgs=299 gs=2 cs=0 l=1 c_cookie=3440757305369114155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bcc70 0x55591a319cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 --2- 10.20.193.28:0/1820583311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a319770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 >> 10.20.193.28:0/1820583311 conn(0x55591a29a860 msgr2=0x55591a2bac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb8bbfff640 0 client.27467 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:23:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 shutdown_connections 2026-02-20T13:23:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 1 -- 10.20.193.28:0/1820583311 wait complete. 2026-02-20T13:23:09.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.788+0000 7fb912945e00 20 client.27467 trim_cache size 0 max 16384 2026-02-20T13:23:09.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.795+0000 7fb912945e00 1 Processor -- start 2026-02-20T13:23:09.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.795+0000 7fb912945e00 1 -- start start 2026-02-20T13:23:09.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb912945e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bc360 0x55591a300e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb912945e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3013c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb912945e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a301b20 0x55591a316900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb912945e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55591a1c6080 con 0x55591a301b20 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb912945e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555919e86700 con 0x55591a2bcc70 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb912945e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55591a2bd040 con 0x55591a2bc360 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a301b20 0x55591a316900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a301b20 0x55591a316900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47114/0 (socket says 10.20.193.28:47114) 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90debf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 -- 10.20.193.28:0/1005422197 learned_addr learned my addr 10.20.193.28:0/1005422197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/1005422197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bc360 0x55591a300e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 -- 10.20.193.28:0/1005422197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bc360 msgr2=0x55591a300e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 --2- 10.20.193.28:0/1005422197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bc360 0x55591a300e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 -- 10.20.193.28:0/1005422197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 msgr2=0x55591a3013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 --2- 10.20.193.28:0/1005422197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 -- 10.20.193.28:0/1005422197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55591a158b60 con 0x55591a301b20 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.796+0000 7fb90eec1640 1 --2- 10.20.193.28:0/1005422197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a301b20 0x55591a316900 secure :-1 s=READY pgs=781 gs=1 cs=0 l=1 c_cookie=4129249603541350962 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc003490 tx=0x7fb8fc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394e0aa300013a32 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb8d64e6640 1 -- 10.20.193.28:0/1005422197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8fc017070 con 0x55591a301b20 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb8d64e6640 1 -- 10.20.193.28:0/1005422197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555919e5e6f0 con 0x55591a301b20 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb8d64e6640 1 -- 10.20.193.28:0/1005422197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8fc003aa0 con 0x55591a301b20 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 -- 10.20.193.28:0/1005422197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a301b20 msgr2=0x55591a316900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 --2- 10.20.193.28:0/1005422197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a301b20 0x55591a316900 secure :-1 s=READY pgs=781 gs=1 cs=0 l=1 c_cookie=4129249603541350962 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc003490 tx=0x7fb8fc020000 comp rx=0 tx=0).stop 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 -- 10.20.193.28:0/1005422197 shutdown_connections 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 --2- 10.20.193.28:0/1005422197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a301b20 0x55591a316900 unknown :-1 s=CLOSED pgs=781 gs=1 cs=0 l=1 c_cookie=4129249603541350962 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 --2- 10.20.193.28:0/1005422197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a3013c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 --2- 10.20.193.28:0/1005422197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a2bc360 0x55591a300e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 -- 10.20.193.28:0/1005422197 >> 10.20.193.28:0/1005422197 conn(0x55591a29a860 msgr2=0x55591a303f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 -- 10.20.193.28:0/1005422197 shutdown_connections 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 -- 10.20.193.28:0/1005422197 wait complete. 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.797+0000 7fb912945e00 1 -- start start 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb912945e00 1 Processor -- start 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb912945e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2fcee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb912945e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a2bb110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb912945e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 0x55591a2bb6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb912945e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55591a2bbd10 con 0x55591a2bc360 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb912945e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55591a2bbe80 con 0x55591a2bcc70 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb912945e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55591a29dc60 con 0x55591a301b20 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90debf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a2bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90debf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a2bb110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35678/0 (socket says 10.20.193.28:35678) 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90debf640 1 -- 10.20.193.28:0/3377113979 learned_addr learned my addr 10.20.193.28:0/3377113979 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90eec1640 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 0x55591a2bb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90debf640 1 -- 10.20.193.28:0/3377113979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 msgr2=0x55591a2bb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90debf640 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 0x55591a2bb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90debf640 1 -- 10.20.193.28:0/3377113979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 msgr2=0x55591a2fcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90debf640 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2fcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90debf640 1 -- 10.20.193.28:0/3377113979 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55591a14c6f0 con 0x55591a2bcc70 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.798+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2fcee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb90debf640 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a2bb110 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=7336795130769325132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8f402f5f0 tx=0x7fb8f403d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d1884ca7523c4c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb8bbfff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb8bbfff640 1 -- 10.20.193.28:0/3377113979 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8f40d2850 con 0x55591a2bcc70 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb8bbfff640 1 -- 10.20.193.28:0/3377113979 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8f40d2180 con 0x55591a2bcc70 2026-02-20T13:23:09.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb8bbfff640 1 -- 10.20.193.28:0/3377113979 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8f40d0a00 con 0x55591a2bcc70 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55591a15e0e0 con 0x55591a2bcc70 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 10 client.27473 _ll_register_callbacks cb 0x55591a149a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb900005500 con 0x55591a2bcc70 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb8bbfff640 1 -- 10.20.193.28:0/3377113979 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb8f40d8250 con 0x55591a2bcc70 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb8bbfff640 1 -- 10.20.193.28:0/3377113979 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb8f40d4190 con 0x55591a2bcc70 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 10 client.27473 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55591a15e340 con 0x55591a2bcc70 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb8bbfff640 1 -- 10.20.193.28:0/3377113979 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb8f40d1a90 con 0x55591a2bcc70 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 10 client.27473 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 10 client.27473 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 20 client.27473 populate_metadata read hostname 'trial028' 2026-02-20T13:23:09.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55591a29f710 0x55591a29fbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 4 client.27473 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.799+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555919e5bf40 con 0x55591a29f710 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.800+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55591a29f710 0x55591a29fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.800+0000 7fb90e6c0640 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55591a29f710 0x55591a29fbb0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=15097365631357026254 s_cookie=257750155561366131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1849e0d6d39ffce server_cookie=393b6669f097273 in_seq=0 out_seq=0 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.800+0000 7fb8bbfff640 10 client.27473 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.800+0000 7fb8bbfff640 1 -- 10.20.193.28:0/3377113979 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555919e5bf40 con 0x55591a29f710 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.800+0000 7fb8bbfff640 10 client.27473 handle_command_reply: tid=0 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.800+0000 7fb912945e00 1 client.27473 shutdown 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 msgr2=0x55591a2bb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a2bb110 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=7336795130769325132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8f402f5f0 tx=0x7fb8f403d000 comp rx=0 tx=0).stop 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 shutdown_connections 2026-02-20T13:23:09.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55591a29f710 0x55591a29fbb0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=15097365631357026254 s_cookie=257750155561366131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55591a301b20 0x55591a2bb6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55591a2bcc70 0x55591a2bb110 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=7336795130769325132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 --2- 10.20.193.28:0/3377113979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55591a2bc360 0x55591a2fcee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 >> 10.20.193.28:0/3377113979 conn(0x55591a29a860 msgr2=0x55591a31dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb8bbfff640 0 client.27473 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 shutdown_connections 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 1 -- 10.20.193.28:0/3377113979 wait complete. 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb912945e00 20 client.27473 trim_cache size 0 max 16384 2026-02-20T13:23:09.812 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 -- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8e40b5750 msgr2=0x7fb8e40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8e40b5750 0x7fb8e40d5c00 secure :-1 s=READY pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9000095d0 tx=0x7fb900005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 -- 10.20.193.28:0/3239753334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb908060a00 msgr2=0x7fb9081739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb908060a00 0x7fb9081739e0 secure :-1 s=READY pgs=254 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8f4009230 tx=0x7fb8f40028d0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 -- 10.20.193.28:0/3239753334 shutdown_connections 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8e40b5750 0x7fb8e40d5c00 unknown :-1 s=CLOSED pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb908113110 0x7fb9080f3f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb908060a00 0x7fb9081739e0 unknown :-1 s=CLOSED pgs=254 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 --2- 10.20.193.28:0/3239753334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb908060010 0x7fb9080f3890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 -- 10.20.193.28:0/3239753334 >> 10.20.193.28:0/3239753334 conn(0x7fb9080e9670 msgr2=0x7fb9081117c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 -- 10.20.193.28:0/3239753334 shutdown_connections 2026-02-20T13:23:09.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:09.801+0000 7fb91094b640 1 -- 10.20.193.28:0/3239753334 wait complete. 2026-02-20T13:23:09.900 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:23:10.082 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 -- 10.20.193.28:0/1019715778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb0010f4b0 msgr2=0x7fcb0010f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 --2- 10.20.193.28:0/1019715778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb0010f4b0 0x7fcb0010f880 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=6068878721601184555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf0009950 tx=0x7fcaf002f1d0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 -- 10.20.193.28:0/1019715778 shutdown_connections 2026-02-20T13:23:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 --2- 10.20.193.28:0/1019715778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb0010fea0 0x7fcb00114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 --2- 10.20.193.28:0/1019715778 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb001156a0 0x7fcb00176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 --2- 10.20.193.28:0/1019715778 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb0010f4b0 0x7fcb0010f880 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=6068878721601184555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 -- 10.20.193.28:0/1019715778 >> 10.20.193.28:0/1019715778 conn(0x7fcb000ecda0 msgr2=0x7fcb0010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 -- 10.20.193.28:0/1019715778 shutdown_connections 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.260+0000 7fcb05d73640 1 -- 10.20.193.28:0/1019715778 wait complete. 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.261+0000 7fcb05d73640 1 Processor -- start 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.261+0000 7fcb05d73640 1 -- start start 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.261+0000 7fcb05d73640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb0010f4b0 0x7fcb0011dda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.261+0000 7fcb05d73640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb0010fea0 0x7fcb0011e2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.261+0000 7fcb05d73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb001156a0 0x7fcb001236b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.261+0000 7fcb05d73640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00123cd0 con 0x7fcb001156a0 2026-02-20T13:23:10.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.261+0000 7fcb05d73640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00123e40 con 0x7fcb0010fea0 2026-02-20T13:23:10.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.261+0000 7fcb05d73640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00124000 con 0x7fcb0010f4b0 2026-02-20T13:23:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb0010f4b0 0x7fcb0011dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05572640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb001156a0 0x7fcb001236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb0010f4b0 0x7fcb0011dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58040/0 (socket says 10.20.193.28:58040) 2026-02-20T13:23:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb04d71640 1 -- 10.20.193.28:0/343983479 learned_addr learned my addr 10.20.193.28:0/343983479 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcaf7fff640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb0010fea0 0x7fcb0011e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05572640 1 -- 10.20.193.28:0/343983479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb0010f4b0 msgr2=0x7fcb0011dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05572640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb0010f4b0 0x7fcb0011dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05572640 1 -- 10.20.193.28:0/343983479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb0010fea0 msgr2=0x7fcb0011e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05572640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb0010fea0 0x7fcb0011e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05572640 1 -- 10.20.193.28:0/343983479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf0009570 con 0x7fcb001156a0 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb04d71640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb0010f4b0 0x7fcb0011dda0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05572640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb001156a0 0x7fcb001236b0 secure :-1 s=READY pgs=782 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcafc00f940 tx=0x7fcafc00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcaf5ffb640 1 -- 10.20.193.28:0/343983479 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcafc00dce0 con 0x7fcb001156a0 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcaf5ffb640 1 -- 10.20.193.28:0/343983479 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcafc00de40 con 0x7fcb001156a0 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05d73640 1 -- 10.20.193.28:0/343983479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb001242e0 con 0x7fcb001156a0 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcaf5ffb640 1 -- 10.20.193.28:0/343983479 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcafc0116b0 con 0x7fcb001156a0 2026-02-20T13:23:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.262+0000 7fcb05d73640 1 -- 10.20.193.28:0/343983479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb001649e0 con 0x7fcb001156a0 2026-02-20T13:23:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.266+0000 7fcaf5ffb640 1 -- 10.20.193.28:0/343983479 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcafc020060 con 0x7fcb001156a0 2026-02-20T13:23:10.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.267+0000 7fcaf5ffb640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcadc0b57e0 0x7fcadc0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.267+0000 7fcaf5ffb640 1 -- 10.20.193.28:0/343983479 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcafc015070 con 0x7fcb001156a0 2026-02-20T13:23:10.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.267+0000 7fcb04d71640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcadc0b57e0 0x7fcadc0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb08ff6e00 1 Processor -- start 2026-02-20T13:23:10.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb04d71640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcadc0b57e0 0x7fcadc0d5c90 secure :-1 s=READY pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf0038820 tx=0x7fcaf003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb08ff6e00 1 -- start start 2026-02-20T13:23:10.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de64730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 0x55dc5dea95e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5dec9f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc5dd7a780 con 0x55dc5de64360 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dc5dd764b0 con 0x55dc5de64c70 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dc5dd70450 con 0x55dc5dea9b20 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcaf7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 0x55dc5dea95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de64730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de64730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55382/0 (socket says 10.20.193.28:55382) 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb04d71640 1 -- 10.20.193.28:0/598707683 learned_addr learned my addr 10.20.193.28:0/598707683 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.268+0000 7fcb05572640 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5dec9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcb05572640 1 -- 10.20.193.28:0/598707683 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 msgr2=0x55dc5dea95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcb05572640 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 0x55dc5dea95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcb05572640 1 -- 10.20.193.28:0/598707683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 msgr2=0x55dc5de64730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcb05572640 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de64730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcb05572640 1 -- 10.20.193.28:0/598707683 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc5dd1bd10 con 0x55dc5dea9b20 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcb04d71640 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de64730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcb05572640 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5dec9f00 secure :-1 s=READY pgs=255 gs=3 cs=0 l=1 c_cookie=9898085439539746420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcafc00ffd0 tx=0x7fcafc0ae0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=895d1043d43b9674 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcacd4e4640 1 -- 10.20.193.28:0/598707683 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcafc0b3c50 con 0x55dc5dea9b20 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcacd4e4640 1 -- 10.20.193.28:0/598707683 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcafc0b6230 con 0x55dc5dea9b20 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.269+0000 7fcacd4e4640 1 -- 10.20.193.28:0/598707683 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcafc0adad0 con 0x55dc5dea9b20 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/598707683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 msgr2=0x55dc5dec9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5dec9f00 secure :-1 s=READY pgs=255 gs=3 cs=0 l=1 c_cookie=9898085439539746420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcafc00ffd0 tx=0x7fcafc0ae0b0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/598707683 shutdown_connections 2026-02-20T13:23:10.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5dec9f00 unknown :-1 s=CLOSED pgs=255 gs=3 cs=0 l=1 c_cookie=9898085439539746420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 0x55dc5dea95e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/598707683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de64730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/598707683 >> 10.20.193.28:0/598707683 conn(0x55dc5de42860 msgr2=0x55dc5de62c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/598707683 shutdown_connections 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.270+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/598707683 wait complete. 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.271+0000 7fcb08ff6e00 1 -- start start 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.271+0000 7fcb08ff6e00 1 Processor -- start 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.271+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec1710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dec1c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 0x55dc5dec6c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc5dec7180 con 0x55dc5de64360 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dc5dec72f0 con 0x55dc5dea9b20 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dc5dec74b0 con 0x55dc5de64c70 2026-02-20T13:23:10.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcaf7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dec1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcaf7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dec1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58050/0 (socket says 10.20.193.28:58050) 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcaf7fff640 1 -- 10.20.193.28:0/435179357 learned_addr learned my addr 10.20.193.28:0/435179357 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec1710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.272+0000 7fcb05572640 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 0x55dc5dec6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.273+0000 7fcb04d71640 1 -- 10.20.193.28:0/435179357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 msgr2=0x55dc5dec1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.273+0000 7fcb04d71640 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dec1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.273+0000 7fcb04d71640 1 -- 10.20.193.28:0/435179357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 msgr2=0x55dc5dec6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.273+0000 7fcb04d71640 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 0x55dc5dec6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.273+0000 7fcb04d71640 1 -- 10.20.193.28:0/435179357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb001649e0 con 0x55dc5de64360 2026-02-20T13:23:10.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.273+0000 7fcaf7fff640 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dec1c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.273+0000 7fcb04d71640 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec1710 secure :-1 s=READY pgs=783 gs=2 cs=0 l=1 c_cookie=15217360910729024183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf00023d0 tx=0x7fcaf0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32eed1f8eeb12b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.273+0000 7fcabe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcabe7fc640 1 -- 10.20.193.28:0/435179357 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaf0044630 con 0x55dc5de64360 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcabe7fc640 1 -- 10.20.193.28:0/435179357 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcaf003e040 con 0x55dc5de64360 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcabe7fc640 1 -- 10.20.193.28:0/435179357 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaf00509a0 con 0x55dc5de64360 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb001768e0 con 0x55dc5de64360 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcabe7fc640 1 -- 10.20.193.28:0/435179357 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcaf0044790 con 0x55dc5de64360 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 10 client.17511 _ll_register_callbacks cb 0x55dc5dcf1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc5da066f0 con 0x55dc5de64360 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcabe7fc640 1 -- 10.20.193.28:0/435179357 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcaf002fe90 con 0x55dc5de64360 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 10 client.17511 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dc5dcf43c0 con 0x55dc5de64360 2026-02-20T13:23:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcabe7fc640 1 -- 10.20.193.28:0/435179357 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcaf004f070 con 0x55dc5de64360 2026-02-20T13:23:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 10 client.17511 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 10 client.17511 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:23:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 20 client.17511 populate_metadata read hostname 'trial028' 2026-02-20T13:23:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55dc5dec9bd0 0x55dc5dea78a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 4 client.17511 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.274+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc5dd12f80 con 0x55dc5dec9bd0 2026-02-20T13:23:10.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.275+0000 7fcaf7fff640 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55dc5dec9bd0 0x55dc5dea78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.275+0000 7fcabe7fc640 10 client.17511 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.275+0000 7fcaf7fff640 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55dc5dec9bd0 0x55dc5dea78a0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=10562722050685849812 s_cookie=16309942130678210263 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=929653bdcc50d0d4 server_cookie=e2588df43e409ed7 in_seq=0 out_seq=0 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcabe7fc640 1 -- 10.20.193.28:0/435179357 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dc5dd12f80 con 0x55dc5dec9bd0 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcabe7fc640 10 client.17511 handle_command_reply: tid=0 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 client.17511 shutdown 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 msgr2=0x55dc5dec1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec1710 secure :-1 s=READY pgs=783 gs=2 cs=0 l=1 c_cookie=15217360910729024183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf00023d0 tx=0x7fcaf0009310 comp rx=0 tx=0).stop 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 shutdown_connections 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55dc5dec9bd0 0x55dc5dea78a0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=10562722050685849812 s_cookie=16309942130678210263 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 0x55dc5dec6c40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dec1c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcabe7fc640 0 client.17511 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:23:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/435179357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec1710 unknown :-1 s=CLOSED pgs=783 gs=2 cs=0 l=1 c_cookie=15217360910729024183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 >> 10.20.193.28:0/435179357 conn(0x55dc5de42860 msgr2=0x55dc5de62c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 shutdown_connections 2026-02-20T13:23:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.276+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/435179357 wait complete. 2026-02-20T13:23:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.277+0000 7fcb08ff6e00 20 client.17511 trim_cache size 0 max 16384 2026-02-20T13:23:10.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.284+0000 7fcb08ff6e00 1 Processor -- start 2026-02-20T13:23:10.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.284+0000 7fcb08ff6e00 1 -- start start 2026-02-20T13:23:10.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.284+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec61b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.284+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dea4780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.284+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 0x55dc5dea4cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc5dd6e080 con 0x55dc5de64360 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dc5da2e700 con 0x55dc5dea9b20 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dc5dec2230 con 0x55dc5de64c70 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55404/0 (socket says 10.20.193.28:55404) 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 -- 10.20.193.28:0/3608068620 learned_addr learned my addr 10.20.193.28:0/3608068620 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb05572640 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 0x55dc5dea4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcaf7fff640 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dea4780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 -- 10.20.193.28:0/3608068620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 msgr2=0x55dc5dea4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dea4780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 -- 10.20.193.28:0/3608068620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 msgr2=0x55dc5dea4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 0x55dc5dea4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 -- 10.20.193.28:0/3608068620 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc5deb3a60 con 0x55dc5de64360 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcaf7fff640 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dea4780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcb04d71640 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec61b0 secure :-1 s=READY pgs=784 gs=1 cs=0 l=1 c_cookie=7904640374592026280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf0037650 tx=0x7fcaf005b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db2ec8a44c4b6a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcaccce3640 1 -- 10.20.193.28:0/3608068620 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaf002fe90 con 0x55dc5de64360 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcaccce3640 1 -- 10.20.193.28:0/3608068620 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcaf0048070 con 0x55dc5de64360 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.285+0000 7fcaccce3640 1 -- 10.20.193.28:0/3608068620 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaf0037f00 con 0x55dc5de64360 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3608068620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 msgr2=0x55dc5dec61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec61b0 secure :-1 s=READY pgs=784 gs=1 cs=0 l=1 c_cookie=7904640374592026280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf0037650 tx=0x7fcaf005b000 comp rx=0 tx=0).stop 2026-02-20T13:23:10.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3608068620 shutdown_connections 2026-02-20T13:23:10.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5dea9b20 0x55dc5dea4cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5de64c70 0x55dc5dea4780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3608068620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5dec61b0 unknown :-1 s=CLOSED pgs=784 gs=1 cs=0 l=1 c_cookie=7904640374592026280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3608068620 >> 10.20.193.28:0/3608068620 conn(0x55dc5de42860 msgr2=0x55dc5dec5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3608068620 shutdown_connections 2026-02-20T13:23:10.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3608068620 wait complete. 2026-02-20T13:23:10.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 -- start start 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.286+0000 7fcb08ff6e00 1 Processor -- start 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de42de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 0x55dc5de43320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb08ff6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5de47d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc5de43860 con 0x55dc5de64360 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dc5de439d0 con 0x55dc5de64c70 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb08ff6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dc5de482a0 con 0x55dc5dea9b20 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de42de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcaf7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 0x55dc5de43320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de42de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55420/0 (socket says 10.20.193.28:55420) 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 -- 10.20.193.28:0/3162461861 learned_addr learned my addr 10.20.193.28:0/3162461861 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb05572640 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5de47d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 -- 10.20.193.28:0/3162461861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 msgr2=0x55dc5de47d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5de47d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 -- 10.20.193.28:0/3162461861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 msgr2=0x55dc5de43320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 0x55dc5de43320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 -- 10.20.193.28:0/3162461861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc5dd060e0 con 0x55dc5de64360 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcb04d71640 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de42de0 secure :-1 s=READY pgs=785 gs=1 cs=0 l=1 c_cookie=15170505498144833164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf0063fd0 tx=0x7fcaf0009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d288765fb0087e8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.287+0000 7fcabe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcabe7fc640 1 -- 10.20.193.28:0/3162461861 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaf002fe90 con 0x55dc5de64360 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcabe7fc640 1 -- 10.20.193.28:0/3162461861 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcaf003e040 con 0x55dc5de64360 2026-02-20T13:23:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcabe7fc640 1 -- 10.20.193.28:0/3162461861 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaf0063870 con 0x55dc5de64360 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc5dcf43c0 con 0x55dc5de64360 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcabe7fc640 1 -- 10.20.193.28:0/3162461861 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcaf0074020 con 0x55dc5de64360 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 10 client.17517 _ll_register_callbacks cb 0x55dc5dcf1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcafc0b6230 con 0x55dc5de64360 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcabe7fc640 1 -- 10.20.193.28:0/3162461861 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcaf0037680 con 0x55dc5de64360 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 10 client.17517 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dc5dd00b60 con 0x55dc5de64360 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcabe7fc640 1 -- 10.20.193.28:0/3162461861 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcaf004f040 con 0x55dc5de64360 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 10 client.17517 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 10 client.17517 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 20 client.17517 populate_metadata read hostname 'trial028' 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55dc5df57b60 0x55dc5df77ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 4 client.17517 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.288+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc5da03f40 con 0x55dc5df57b60 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.289+0000 7fcaf7fff640 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55dc5df57b60 0x55dc5df77ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.289+0000 7fcaf7fff640 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55dc5df57b60 0x55dc5df77ff0 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=771158038880064322 s_cookie=1501300917213250324 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab3b4268d221342 server_cookie=14d5b13adf76c314 in_seq=0 out_seq=0 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.289+0000 7fcabe7fc640 10 client.17517 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.289+0000 7fcabe7fc640 1 -- 10.20.193.28:0/3162461861 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc5da03f40 con 0x55dc5df57b60 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.289+0000 7fcabe7fc640 10 client.17517 handle_command_reply: tid=0 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.289+0000 7fcb08ff6e00 1 client.17517 shutdown 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.289+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 msgr2=0x55dc5de42de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.289+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de42de0 secure :-1 s=READY pgs=785 gs=1 cs=0 l=1 c_cookie=15170505498144833164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf0063fd0 tx=0x7fcaf0009420 comp rx=0 tx=0).stop 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 shutdown_connections 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55dc5df57b60 0x55dc5df77ff0 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=771158038880064322 s_cookie=1501300917213250324 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc5dea9b20 0x55dc5de47d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc5de64c70 0x55dc5de43320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 1 --2- 10.20.193.28:0/3162461861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc5de64360 0x55dc5de42de0 unknown :-1 s=CLOSED pgs=785 gs=1 cs=0 l=1 c_cookie=15170505498144833164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcabe7fc640 0 client.17517 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:23:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 >> 10.20.193.28:0/3162461861 conn(0x55dc5de42860 msgr2=0x55dc5debe110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 shutdown_connections 2026-02-20T13:23:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 1 -- 10.20.193.28:0/3162461861 wait complete. 2026-02-20T13:23:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb08ff6e00 20 client.17517 trim_cache size 0 max 16384 2026-02-20T13:23:10.299 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb05d73640 1 -- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcadc0b57e0 msgr2=0x7fcadc0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb05d73640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcadc0b57e0 0x7fcadc0d5c90 secure :-1 s=READY pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf0038820 tx=0x7fcaf003a040 comp rx=0 tx=0).stop 2026-02-20T13:23:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb05d73640 1 -- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb001156a0 msgr2=0x7fcb001236b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.290+0000 7fcb05d73640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb001156a0 0x7fcb001236b0 secure :-1 s=READY pgs=782 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcafc00f940 tx=0x7fcafc00fe10 comp rx=0 tx=0).stop 2026-02-20T13:23:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.291+0000 7fcb05d73640 1 -- 10.20.193.28:0/343983479 shutdown_connections 2026-02-20T13:23:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.291+0000 7fcb05d73640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcadc0b57e0 0x7fcadc0d5c90 unknown :-1 s=CLOSED pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.291+0000 7fcb05d73640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb001156a0 0x7fcb001236b0 unknown :-1 s=CLOSED pgs=782 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.291+0000 7fcb05d73640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb0010fea0 0x7fcb0011e2e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.291+0000 7fcb05d73640 1 --2- 10.20.193.28:0/343983479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb0010f4b0 0x7fcb0011dda0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.291+0000 7fcb05d73640 1 -- 10.20.193.28:0/343983479 >> 10.20.193.28:0/343983479 conn(0x7fcb000ecda0 msgr2=0x7fcb0010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.291+0000 7fcb05d73640 1 -- 10.20.193.28:0/343983479 shutdown_connections 2026-02-20T13:23:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.291+0000 7fcb05d73640 1 -- 10.20.193.28:0/343983479 wait complete. 2026-02-20T13:23:10.392 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:23:10.575 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:10.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:10 trial127 ceph-mon[43817]: pgmap v356: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:23:10.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:10 trial034 ceph-mon[43332]: pgmap v356: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:23:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 -- 10.20.193.28:0/1529689783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010ffe0 msgr2=0x7f3fa0115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/1529689783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010ffe0 0x7f3fa0115030 secure :-1 s=READY pgs=786 gs=1 cs=0 l=1 c_cookie=8568046777218541874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f94009950 tx=0x7f3f9402f190 comp rx=0 tx=0).stop 2026-02-20T13:23:10.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:10 trial028 ceph-mon[37442]: pgmap v356: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:23:10.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 -- 10.20.193.28:0/1529689783 shutdown_connections 2026-02-20T13:23:10.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/1529689783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010ffe0 0x7f3fa0115030 unknown :-1 s=CLOSED pgs=786 gs=1 cs=0 l=1 c_cookie=8568046777218541874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/1529689783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3fa01157e0 0x7f3fa01761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/1529689783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3fa010f5f0 0x7f3fa010f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 -- 10.20.193.28:0/1529689783 >> 10.20.193.28:0/1529689783 conn(0x7f3fa00ecea0 msgr2=0x7f3fa010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 -- 10.20.193.28:0/1529689783 shutdown_connections 2026-02-20T13:23:10.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.758+0000 7f3fa85dc640 1 -- 10.20.193.28:0/1529689783 wait complete. 2026-02-20T13:23:10.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.759+0000 7f3fa85dc640 1 Processor -- start 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.759+0000 7f3fa85dc640 1 -- start start 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.759+0000 7f3fa85dc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010f5f0 0x7f3fa00f4e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.759+0000 7f3fa85dc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3fa010ffe0 0x7f3fa01760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.759+0000 7f3fa85dc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3fa01157e0 0x7f3fa00f5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.759+0000 7f3fa85dc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa00fa750 con 0x7f3fa010f5f0 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.759+0000 7f3fa85dc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa00fa8c0 con 0x7f3fa010ffe0 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.759+0000 7f3fa85dc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa00faa80 con 0x7f3fa01157e0 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010f5f0 0x7f3fa00f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010f5f0 0x7f3fa00f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55434/0 (socket says 10.20.193.28:55434) 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 -- 10.20.193.28:0/3883796183 learned_addr learned my addr 10.20.193.28:0/3883796183 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6b52640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3fa01157e0 0x7f3fa00f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3fa010ffe0 0x7f3fa01760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 -- 10.20.193.28:0/3883796183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3fa01157e0 msgr2=0x7f3fa00f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3fa01157e0 0x7f3fa00f5590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 -- 10.20.193.28:0/3883796183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3fa010ffe0 msgr2=0x7f3fa01760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3fa010ffe0 0x7f3fa01760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 -- 10.20.193.28:0/3883796183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f94009570 con 0x7f3fa010f5f0 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3fa6351640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010f5f0 0x7f3fa00f4e90 secure :-1 s=READY pgs=787 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f90005db0 tx=0x7f3f9000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3f877fe640 1 -- 10.20.193.28:0/3883796183 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f90004500 con 0x7f3fa010f5f0 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.760+0000 7f3f877fe640 1 -- 10.20.193.28:0/3883796183 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f90004d30 con 0x7f3fa010f5f0 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.761+0000 7f3fa85dc640 1 -- 10.20.193.28:0/3883796183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa00fad60 con 0x7f3fa010f5f0 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.761+0000 7f3fa85dc640 1 -- 10.20.193.28:0/3883796183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa00fb230 con 0x7f3fa010f5f0 2026-02-20T13:23:10.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.761+0000 7f3f877fe640 1 -- 10.20.193.28:0/3883796183 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f900053c0 con 0x7f3fa010f5f0 2026-02-20T13:23:10.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.763+0000 7f3f877fe640 1 -- 10.20.193.28:0/3883796183 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3f90009940 con 0x7f3fa010f5f0 2026-02-20T13:23:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.765+0000 7f3f877fe640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f7c0b5750 0x7f3f7c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.765+0000 7f3f877fe640 1 -- 10.20.193.28:0/3883796183 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3f900e6cb0 con 0x7f3fa010f5f0 2026-02-20T13:23:10.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.765+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f7c0b5750 0x7f3f7c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f7c0b5750 0x7f3f7c0d5c00 secure :-1 s=READY pgs=393 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f940023d0 tx=0x7f3f94031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3faa5d6e00 1 Processor -- start 2026-02-20T13:23:10.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3faa5d6e00 1 -- start start 2026-02-20T13:23:10.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd5551730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55965e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55b6f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffd5467780 con 0x55ffd5551c70 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffd54634b0 con 0x55ffd5551360 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffd545d450 con 0x55ffd5596b20 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3fa5b50640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.766+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd5551730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd5551730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38630/0 (socket says 10.20.193.28:38630) 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa6351640 1 -- 10.20.193.28:0/2088809408 learned_addr learned my addr 10.20.193.28:0/2088809408 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa6b52640 1 --2- 10.20.193.28:0/2088809408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa5b50640 1 -- 10.20.193.28:0/2088809408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 msgr2=0x55ffd55b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/2088809408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa5b50640 1 -- 10.20.193.28:0/2088809408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 msgr2=0x55ffd5551730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/2088809408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd5551730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa5b50640 1 -- 10.20.193.28:0/2088809408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd5408d10 con 0x55ffd5551c70 2026-02-20T13:23:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/2088809408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55965e0 secure :-1 s=READY pgs=788 gs=1 cs=0 l=1 c_cookie=13561456105798700929 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f94005b30 tx=0x7f3f94040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc33f879ff2f0f81 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3f84b0a640 1 -- 10.20.193.28:0/2088809408 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f94002a00 con 0x55ffd5551c70 2026-02-20T13:23:10.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3f84b0a640 1 -- 10.20.193.28:0/2088809408 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f94038920 con 0x55ffd5551c70 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.767+0000 7f3f84b0a640 1 -- 10.20.193.28:0/2088809408 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f94043710 con 0x55ffd5551c70 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2088809408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 msgr2=0x55ffd55965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/2088809408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55965e0 secure :-1 s=READY pgs=788 gs=1 cs=0 l=1 c_cookie=13561456105798700929 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f94005b30 tx=0x7f3f94040000 comp rx=0 tx=0).stop 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2088809408 shutdown_connections 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/2088809408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55965e0 unknown :-1 s=CLOSED pgs=788 gs=1 cs=0 l=1 c_cookie=13561456105798700929 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/2088809408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55b6f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/2088809408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd5551730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2088809408 >> 10.20.193.28:0/2088809408 conn(0x55ffd552f860 msgr2=0x55ffd554fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2088809408 shutdown_connections 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.768+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2088809408 wait complete. 2026-02-20T13:23:10.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.769+0000 7f3faa5d6e00 1 -- start start 2026-02-20T13:23:10.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.769+0000 7f3faa5d6e00 1 Processor -- start 2026-02-20T13:23:10.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551360 0x55ffd55ae7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551c70 0x55ffd55aed10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55b0aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffd55b1010 con 0x55ffd5551360 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffd55b1180 con 0x55ffd5551c70 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffd55b1340 con 0x55ffd5596b20 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551360 0x55ffd55ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551360 0x55ffd55ae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55452/0 (socket says 10.20.193.28:55452) 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6351640 1 -- 10.20.193.28:0/862809073 learned_addr learned my addr 10.20.193.28:0/862809073 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6b52640 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551c70 0x55ffd55aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6351640 1 -- 10.20.193.28:0/862809073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 msgr2=0x55ffd55b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6351640 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6351640 1 -- 10.20.193.28:0/862809073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551c70 msgr2=0x55ffd55aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6351640 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551c70 0x55ffd55aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.770+0000 7f3fa6351640 1 -- 10.20.193.28:0/862809073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd53e13c0 con 0x55ffd5551360 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3fa6351640 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551360 0x55ffd55ae7d0 secure :-1 s=READY pgs=789 gs=1 cs=0 l=1 c_cookie=17246102563709460568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f900e4790 tx=0x7f3f900a8ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5676e86ddb2058 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3f53fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3f53fff640 1 -- 10.20.193.28:0/862809073 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f900ac850 con 0x55ffd5551360 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa0176a20 con 0x55ffd5551360 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3f53fff640 1 -- 10.20.193.28:0/862809073 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f90005520 con 0x55ffd5551360 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3f53fff640 1 -- 10.20.193.28:0/862809073 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f900b7f80 con 0x55ffd5551360 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 10 client.17529 _ll_register_callbacks cb 0x55ffd53dea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ffd50f36f0 con 0x55ffd5551360 2026-02-20T13:23:10.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3f53fff640 1 -- 10.20.193.28:0/862809073 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3f90072150 con 0x55ffd5551360 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3f53fff640 1 -- 10.20.193.28:0/862809073 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f90072310 con 0x55ffd5551360 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 10 client.17529 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ffd53f30e0 con 0x55ffd5551360 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3f53fff640 1 -- 10.20.193.28:0/862809073 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3f900ab030 con 0x55ffd5551360 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 10 client.17529 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 10 client.17529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 20 client.17529 populate_metadata read hostname 'trial028' 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffd55b6b70 0x55ffd55948a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 4 client.17529 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.771+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffd53fff80 con 0x55ffd55b6b70 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.772+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffd55b6b70 0x55ffd55948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.772+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffd55b6b70 0x55ffd55948a0 crc :-1 s=READY pgs=182 gs=4 cs=0 l=0 c_cookie=11766029624516248279 s_cookie=3647046851737069979 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a349559aba0382d7 server_cookie=329ce9c9ecfea99b in_seq=0 out_seq=0 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.772+0000 7f3f53fff640 10 client.17529 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3f53fff640 1 -- 10.20.193.28:0/862809073 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ffd53fff80 con 0x55ffd55b6b70 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3f53fff640 10 client.17529 handle_command_reply: tid=0 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 client.17529 shutdown 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551360 msgr2=0x55ffd55ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551360 0x55ffd55ae7d0 secure :-1 s=READY pgs=789 gs=1 cs=0 l=1 c_cookie=17246102563709460568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f900e4790 tx=0x7f3f900a8ef0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 shutdown_connections 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffd55b6b70 0x55ffd55948a0 crc :-1 s=READY pgs=182 gs=4 cs=0 l=0 c_cookie=11766029624516248279 s_cookie=3647046851737069979 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55b0aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551c70 0x55ffd55aed10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/862809073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551360 0x55ffd55ae7d0 unknown :-1 s=CLOSED pgs=789 gs=1 cs=0 l=1 c_cookie=17246102563709460568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3f53fff640 0 client.17529 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:10.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 >> 10.20.193.28:0/862809073 conn(0x55ffd552f860 msgr2=0x55ffd554fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 shutdown_connections 2026-02-20T13:23:10.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.773+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/862809073 wait complete. 2026-02-20T13:23:10.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.774+0000 7f3faa5d6e00 20 client.17529 trim_cache size 0 max 16384 2026-02-20T13:23:10.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.781+0000 7f3faa5d6e00 1 Processor -- start 2026-02-20T13:23:10.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.781+0000 7f3faa5d6e00 1 -- start start 2026-02-20T13:23:10.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.781+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd55b0a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.781+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55b42d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.781+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55ab960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.781+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffd545b080 con 0x55ffd5551c70 2026-02-20T13:23:10.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.781+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffd511b700 con 0x55ffd5551360 2026-02-20T13:23:10.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.781+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffd55b4d30 con 0x55ffd5596b20 2026-02-20T13:23:10.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa5b50640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd55b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd55b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38652/0 (socket says 10.20.193.28:38652) 2026-02-20T13:23:10.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6351640 1 -- 10.20.193.28:0/2331635310 learned_addr learned my addr 10.20.193.28:0/2331635310 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6b52640 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6351640 1 -- 10.20.193.28:0/2331635310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 msgr2=0x55ffd55ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6351640 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6351640 1 -- 10.20.193.28:0/2331635310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 msgr2=0x55ffd55b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6351640 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa6351640 1 -- 10.20.193.28:0/2331635310 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd53edb60 con 0x55ffd5551360 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.782+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55b42d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3fa6351640 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd55b0a30 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=7119998682881874273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f900ad2c0 tx=0x7f3f90078000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62cf5114266c5961 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3f6e4e6640 1 -- 10.20.193.28:0/2331635310 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f900b3f20 con 0x55ffd5551360 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3f6e4e6640 1 -- 10.20.193.28:0/2331635310 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ffd50f36f0 con 0x55ffd5551360 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3f6e4e6640 1 -- 10.20.193.28:0/2331635310 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f900ada50 con 0x55ffd5551360 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2331635310 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 msgr2=0x55ffd55b0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd55b0a30 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=7119998682881874273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f900ad2c0 tx=0x7f3f90078000 comp rx=0 tx=0).stop 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2331635310 shutdown_connections 2026-02-20T13:23:10.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55b42d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5596b20 0x55ffd55ab960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/2331635310 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5551360 0x55ffd55b0a30 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=7119998682881874273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2331635310 >> 10.20.193.28:0/2331635310 conn(0x55ffd552f860 msgr2=0x55ffd55b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2331635310 shutdown_connections 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.783+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/2331635310 wait complete. 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.784+0000 7f3faa5d6e00 1 -- start start 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.784+0000 7f3faa5d6e00 1 Processor -- start 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.784+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5551360 0x55ffd5535650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.784+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55ae1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.784+0000 7f3faa5d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5596b20 0x55ffd55ae730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.784+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ffd5535c90 con 0x55ffd5551c70 2026-02-20T13:23:10.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.784+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ffd5535e00 con 0x55ffd5596b20 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.784+0000 7f3faa5d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ffd55aecf0 con 0x55ffd5551360 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa6351640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5551360 0x55ffd5535650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55468/0 (socket says 10.20.193.28:55468) 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 -- 10.20.193.28:0/1494288499 learned_addr learned my addr 10.20.193.28:0/1494288499 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa6b52640 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5596b20 0x55ffd55ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 -- 10.20.193.28:0/1494288499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5551360 msgr2=0x55ffd5535650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5551360 0x55ffd5535650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 -- 10.20.193.28:0/1494288499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5596b20 msgr2=0x55ffd55ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5596b20 0x55ffd55ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 -- 10.20.193.28:0/1494288499 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f90070070 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3fa5b50640 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55ae1f0 secure :-1 s=READY pgs=790 gs=2 cs=0 l=1 c_cookie=11981968648487781222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f94004520 tx=0x7f3f94002940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6488100aafb4366 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.785+0000 7f3f53fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3f53fff640 1 -- 10.20.193.28:0/1494288499 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f94038cb0 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffd5408d10 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 10 client.17535 _ll_register_callbacks cb 0x55ffd53dea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f94038920 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3f53fff640 1 -- 10.20.193.28:0/1494288499 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f94048040 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3f53fff640 1 -- 10.20.193.28:0/1494288499 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f9405ee50 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3f53fff640 1 -- 10.20.193.28:0/1494288499 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3f94043580 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3f53fff640 1 -- 10.20.193.28:0/1494288499 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f94043760 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 10 client.17535 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ffd53e16f0 con 0x55ffd5551c70 2026-02-20T13:23:10.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3f53fff640 1 -- 10.20.193.28:0/1494288499 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3f94057040 con 0x55ffd5551c70 2026-02-20T13:23:10.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 10 client.17535 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:10.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:10.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 20 client.17535 populate_metadata read hostname 'trial028' 2026-02-20T13:23:10.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffd5644190 0x55ffd5664640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:10.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 4 client.17535 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:10.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.786+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ffd50f0f40 con 0x55ffd5644190 2026-02-20T13:23:10.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.787+0000 7f3fa6351640 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffd5644190 0x55ffd5664640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:10.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3fa6351640 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffd5644190 0x55ffd5664640 crc :-1 s=READY pgs=183 gs=4 cs=0 l=0 c_cookie=17082153020310416406 s_cookie=8823080632471755646 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed0fffaab677ec16 server_cookie=7a71e116ab1b9b7e in_seq=0 out_seq=0 2026-02-20T13:23:10.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3f53fff640 10 client.17535 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:10.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3f53fff640 1 -- 10.20.193.28:0/1494288499 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ffd50f0f40 con 0x55ffd5644190 2026-02-20T13:23:10.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3f53fff640 10 client.17535 handle_command_reply: tid=0 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 client.17535 shutdown 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 msgr2=0x55ffd55ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55ae1f0 secure :-1 s=READY pgs=790 gs=2 cs=0 l=1 c_cookie=11981968648487781222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f94004520 tx=0x7f3f94002940 comp rx=0 tx=0).stop 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 shutdown_connections 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ffd5644190 0x55ffd5664640 crc :-1 s=READY pgs=183 gs=4 cs=0 l=0 c_cookie=17082153020310416406 s_cookie=8823080632471755646 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ffd5551c70 0x55ffd55ae1f0 unknown :-1 s=CLOSED pgs=790 gs=2 cs=0 l=1 c_cookie=11981968648487781222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ffd5596b20 0x55ffd55ae730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 --2- 10.20.193.28:0/1494288499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ffd5551360 0x55ffd5535650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3f53fff640 0 client.17535 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:10.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 >> 10.20.193.28:0/1494288499 conn(0x55ffd552f860 msgr2=0x55ffd55b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 shutdown_connections 2026-02-20T13:23:10.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 1 -- 10.20.193.28:0/1494288499 wait complete. 2026-02-20T13:23:10.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3faa5d6e00 20 client.17535 trim_cache size 0 max 16384 2026-02-20T13:23:10.798 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:10.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3fa85dc640 1 -- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f7c0b5750 msgr2=0x7f3f7c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f7c0b5750 0x7f3f7c0d5c00 secure :-1 s=READY pgs=393 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f940023d0 tx=0x7f3f94031040 comp rx=0 tx=0).stop 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3fa85dc640 1 -- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010f5f0 msgr2=0x7f3fa00f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.788+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010f5f0 0x7f3fa00f4e90 secure :-1 s=READY pgs=787 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f90005db0 tx=0x7f3f9000ddf0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.789+0000 7f3fa85dc640 1 -- 10.20.193.28:0/3883796183 shutdown_connections 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.789+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3f7c0b5750 0x7f3f7c0d5c00 unknown :-1 s=CLOSED pgs=393 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.789+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3fa01157e0 0x7f3fa00f5590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.789+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3fa010ffe0 0x7f3fa01760b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.789+0000 7f3fa85dc640 1 --2- 10.20.193.28:0/3883796183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3fa010f5f0 0x7f3fa00f4e90 unknown :-1 s=CLOSED pgs=787 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.789+0000 7f3fa85dc640 1 -- 10.20.193.28:0/3883796183 >> 10.20.193.28:0/3883796183 conn(0x7f3fa00ecea0 msgr2=0x7f3fa010db00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.789+0000 7f3fa85dc640 1 -- 10.20.193.28:0/3883796183 shutdown_connections 2026-02-20T13:23:10.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:10.789+0000 7f3fa85dc640 1 -- 10.20.193.28:0/3883796183 wait complete. 2026-02-20T13:23:11.888 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:23:11.888 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:23:12.074 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 -- 10.20.193.28:0/3096001289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 msgr2=0x7f3cd8179ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 --2- 10.20.193.28:0/3096001289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 0x7f3cd8179ed0 secure :-1 s=READY pgs=791 gs=1 cs=0 l=1 c_cookie=4363130665231238792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cd400aa30 tx=0x7f3cd4030270 comp rx=0 tx=0).stop 2026-02-20T13:23:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 -- 10.20.193.28:0/3096001289 shutdown_connections 2026-02-20T13:23:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 --2- 10.20.193.28:0/3096001289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 0x7f3cd8179ed0 unknown :-1 s=CLOSED pgs=791 gs=1 cs=0 l=1 c_cookie=4363130665231238792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 --2- 10.20.193.28:0/3096001289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3cd80614f0 0x7f3cd8061920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 --2- 10.20.193.28:0/3096001289 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3cd8062ae0 0x7f3cd8060fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 -- 10.20.193.28:0/3096001289 >> 10.20.193.28:0/3096001289 conn(0x7f3cd805f830 msgr2=0x7f3cd810ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 -- 10.20.193.28:0/3096001289 shutdown_connections 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.255+0000 7f3ce031d640 1 -- 10.20.193.28:0/3096001289 wait complete. 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.256+0000 7f3ce031d640 1 Processor -- start 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.256+0000 7f3ce031d640 1 -- start start 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.256+0000 7f3ce031d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3cd80614f0 0x7f3cd80f2c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.256+0000 7f3ce031d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3cd8062ae0 0x7f3cd80f3140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.256+0000 7f3ce031d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 0x7f3cd80f8510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.256+0000 7f3ce031d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd80f8b30 con 0x7f3cd8159af0 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.256+0000 7f3ce031d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd80f8ca0 con 0x7f3cd8062ae0 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.256+0000 7f3ce031d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd80f8e60 con 0x7f3cd80614f0 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3cd8062ae0 0x7f3cd80f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde092640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3cd80614f0 0x7f3cd80f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde092640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3cd80614f0 0x7f3cd80f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58114/0 (socket says 10.20.193.28:58114) 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde092640 1 -- 10.20.193.28:0/4251743906 learned_addr learned my addr 10.20.193.28:0/4251743906 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde893640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 0x7f3cd80f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde893640 1 -- 10.20.193.28:0/4251743906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3cd80614f0 msgr2=0x7f3cd80f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde893640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3cd80614f0 0x7f3cd80f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde893640 1 -- 10.20.193.28:0/4251743906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3cd8062ae0 msgr2=0x7f3cd80f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde893640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3cd8062ae0 0x7f3cd80f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde893640 1 -- 10.20.193.28:0/4251743906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd400a650 con 0x7f3cd8159af0 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cde893640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 0x7f3cd80f8510 secure :-1 s=READY pgs=792 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cd4033040 tx=0x7f3cd40039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cbf7fe640 1 -- 10.20.193.28:0/4251743906 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cd403e070 con 0x7f3cd8159af0 2026-02-20T13:23:12.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3ce031d640 1 -- 10.20.193.28:0/4251743906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd80f90e0 con 0x7f3cd8159af0 2026-02-20T13:23:12.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3ce031d640 1 -- 10.20.193.28:0/4251743906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd80f9820 con 0x7f3cd8159af0 2026-02-20T13:23:12.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cbf7fe640 1 -- 10.20.193.28:0/4251743906 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3cd40055a0 con 0x7f3cd8159af0 2026-02-20T13:23:12.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.257+0000 7f3cbf7fe640 1 -- 10.20.193.28:0/4251743906 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cd403e070 con 0x7f3cd8159af0 2026-02-20T13:23:12.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.261+0000 7f3cbf7fe640 1 -- 10.20.193.28:0/4251743906 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3cd4039b40 con 0x7f3cd8159af0 2026-02-20T13:23:12.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.262+0000 7f3cbf7fe640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3cb40b57c0 0x7f3cb40d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.262+0000 7f3cbf7fe640 1 -- 10.20.193.28:0/4251743906 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3cd410c080 con 0x7f3cd8159af0 2026-02-20T13:23:12.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.262+0000 7f3cde092640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3cb40b57c0 0x7f3cb40d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3cde092640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3cb40b57c0 0x7f3cb40d5c70 secure :-1 s=READY pgs=394 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cc800b2c0 tx=0x7f3cc800b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3ce2317e00 1 Processor -- start 2026-02-20T13:23:12.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3ce2317e00 1 -- start start 2026-02-20T13:23:12.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 0x55a905e277e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e6c480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e8cda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a905d3da20 con 0x55a905e27d20 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a905d39750 con 0x55a905e6c9c0 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a905d336f0 con 0x55a905e27410 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e6c480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e6c480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55486/0 (socket says 10.20.193.28:55486) 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3cdd891640 1 -- 10.20.193.28:0/2587810360 learned_addr learned my addr 10.20.193.28:0/2587810360 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.263+0000 7f3cde092640 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 0x55a905e277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cde893640 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e8cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cdd891640 1 -- 10.20.193.28:0/2587810360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 msgr2=0x55a905e277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cdd891640 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 0x55a905e277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cdd891640 1 -- 10.20.193.28:0/2587810360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 msgr2=0x55a905e8cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cdd891640 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e8cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cdd891640 1 -- 10.20.193.28:0/2587810360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a905cdf120 con 0x55a905e27d20 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cdd891640 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e6c480 secure :-1 s=READY pgs=793 gs=1 cs=0 l=1 c_cookie=12518460037799693100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ccc002b60 tx=0x7f3ccc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adba811427f94b2c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cbc884640 1 -- 10.20.193.28:0/2587810360 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ccc002e80 con 0x55a905e27d20 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cbc884640 1 -- 10.20.193.28:0/2587810360 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3ccc00fe50 con 0x55a905e27d20 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3cbc884640 1 -- 10.20.193.28:0/2587810360 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ccc010920 con 0x55a905e27d20 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3ce2317e00 1 -- 10.20.193.28:0/2587810360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 msgr2=0x55a905e6c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e6c480 secure :-1 s=READY pgs=793 gs=1 cs=0 l=1 c_cookie=12518460037799693100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ccc002b60 tx=0x7f3ccc00f730 comp rx=0 tx=0).stop 2026-02-20T13:23:12.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3ce2317e00 1 -- 10.20.193.28:0/2587810360 shutdown_connections 2026-02-20T13:23:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e6c480 unknown :-1 s=CLOSED pgs=793 gs=1 cs=0 l=1 c_cookie=12518460037799693100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e8cda0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/2587810360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 0x55a905e277e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3ce2317e00 1 -- 10.20.193.28:0/2587810360 >> 10.20.193.28:0/2587810360 conn(0x55a905e05910 msgr2=0x55a905e25cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.264+0000 7f3ce2317e00 1 -- 10.20.193.28:0/2587810360 shutdown_connections 2026-02-20T13:23:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.265+0000 7f3ce2317e00 1 -- 10.20.193.28:0/2587810360 wait complete. 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.266+0000 7f3ce2317e00 1 -- start start 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.266+0000 7f3ce2317e00 1 Processor -- start 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 0x55a905e3fb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e400d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e450c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a905e45600 con 0x55a905e27d20 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a905e45770 con 0x55a905e6c9c0 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a905e45930 con 0x55a905e27410 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55498/0 (socket says 10.20.193.28:55498) 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cdd891640 1 -- 10.20.193.28:0/1198741858 learned_addr learned my addr 10.20.193.28:0/1198741858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cde893640 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cde092640 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 0x55a905e3fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cdd891640 1 -- 10.20.193.28:0/1198741858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 msgr2=0x55a905e3fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cdd891640 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 0x55a905e3fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cdd891640 1 -- 10.20.193.28:0/1198741858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 msgr2=0x55a905e450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cdd891640 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.267+0000 7f3cdd891640 1 -- 10.20.193.28:0/1198741858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a905cb7810 con 0x55a905e27d20 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3cdd891640 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e400d0 secure :-1 s=READY pgs=794 gs=1 cs=0 l=1 c_cookie=17149172744884369767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ccc010490 tx=0x7f3ccc0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfe19c052a4b967 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3c8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1198741858 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ccc021070 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1198741858 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3ccc005040 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1198741858 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ccc004c60 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ccc002780 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3ce2317e00 10 client.17547 _ll_register_callbacks cb 0x55a905ceab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a9059c99d0 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1198741858 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3ccc004700 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1198741858 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ccc004df0 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3ce2317e00 10 client.17547 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.268+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a905cc94f0 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.269+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1198741858 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3ccc02c020 con 0x55a905e27d20 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.269+0000 7f3ce2317e00 10 client.17547 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.269+0000 7f3ce2317e00 10 client.17547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:12.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.269+0000 7f3ce2317e00 20 client.17547 populate_metadata read hostname 'trial028' 2026-02-20T13:23:12.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.269+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a905e6a2e0 0x55a905e6a780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.269+0000 7f3ce2317e00 4 client.17547 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:12.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.269+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a905d40df0 con 0x55a905e6a2e0 2026-02-20T13:23:12.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.269+0000 7f3cde092640 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a905e6a2e0 0x55a905e6a780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.270+0000 7f3cde092640 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a905e6a2e0 0x55a905e6a780 crc :-1 s=READY pgs=184 gs=4 cs=0 l=0 c_cookie=11369016347362293046 s_cookie=11782698194465890136 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dc6dc21de237536 server_cookie=a3848d9498c69f58 in_seq=0 out_seq=0 2026-02-20T13:23:12.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.270+0000 7f3c8bfff640 10 client.17547 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:12.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.270+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1198741858 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a905d40df0 con 0x55a905e6a2e0 2026-02-20T13:23:12.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.270+0000 7f3c8bfff640 10 client.17547 handle_command_reply: tid=0 2026-02-20T13:23:12.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.270+0000 7f3ce2317e00 1 client.17547 shutdown 2026-02-20T13:23:12.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 msgr2=0x55a905e400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e400d0 secure :-1 s=READY pgs=794 gs=1 cs=0 l=1 c_cookie=17149172744884369767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ccc010490 tx=0x7f3ccc0040e0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 shutdown_connections 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a905e6a2e0 0x55a905e6a780 crc :-1 s=READY pgs=184 gs=4 cs=0 l=0 c_cookie=11369016347362293046 s_cookie=11782698194465890136 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e400d0 unknown :-1 s=CLOSED pgs=794 gs=1 cs=0 l=1 c_cookie=17149172744884369767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e450c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1198741858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27410 0x55a905e3fb90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 >> 10.20.193.28:0/1198741858 conn(0x55a905e05910 msgr2=0x55a905e264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3c8bfff640 0 client.17547 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 shutdown_connections 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1198741858 wait complete. 2026-02-20T13:23:12.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.271+0000 7f3ce2317e00 20 client.17547 trim_cache size 0 max 16384 2026-02-20T13:23:12.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3ce2317e00 1 Processor -- start 2026-02-20T13:23:12.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3ce2317e00 1 -- start start 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e27410 0x55a905e6bf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e3cfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e6c9c0 0x55a905e3dfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a905d31320 con 0x55a905e27d20 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a9059f1790 con 0x55a905e27410 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a905d9ba80 con 0x55a905e6c9c0 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e3cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e3cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55506/0 (socket says 10.20.193.28:55506) 2026-02-20T13:23:12.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3cdd891640 1 -- 10.20.193.28:0/567554718 learned_addr learned my addr 10.20.193.28:0/567554718 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3cde893640 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e6c9c0 0x55a905e3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.280+0000 7f3cde092640 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e27410 0x55a905e6bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3cdd891640 1 -- 10.20.193.28:0/567554718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e6c9c0 msgr2=0x55a905e3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3cdd891640 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e6c9c0 0x55a905e3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3cdd891640 1 -- 10.20.193.28:0/567554718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e27410 msgr2=0x55a905e6bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3cdd891640 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e27410 0x55a905e6bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3cdd891640 1 -- 10.20.193.28:0/567554718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a905e31f20 con 0x55a905e27d20 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3cdd891640 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e3cfc0 secure :-1 s=READY pgs=795 gs=1 cs=0 l=1 c_cookie=519905195332163455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ccc0104e0 tx=0x7f3ccc005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737130544a7577f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ca64e6640 1 -- 10.20.193.28:0/567554718 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ccc021070 con 0x55a905e27d20 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ca64e6640 1 -- 10.20.193.28:0/567554718 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3ccc032030 con 0x55a905e27d20 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ca64e6640 1 -- 10.20.193.28:0/567554718 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ccc010820 con 0x55a905e27d20 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 -- 10.20.193.28:0/567554718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 msgr2=0x55a905e3cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e3cfc0 secure :-1 s=READY pgs=795 gs=1 cs=0 l=1 c_cookie=519905195332163455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ccc0104e0 tx=0x7f3ccc005900 comp rx=0 tx=0).stop 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 -- 10.20.193.28:0/567554718 shutdown_connections 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27d20 0x55a905e3cfc0 unknown :-1 s=CLOSED pgs=795 gs=1 cs=0 l=1 c_cookie=519905195332163455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e6c9c0 0x55a905e3dfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/567554718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e27410 0x55a905e6bf60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 -- 10.20.193.28:0/567554718 >> 10.20.193.28:0/567554718 conn(0x55a905e05910 msgr2=0x55a905e6b850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 -- 10.20.193.28:0/567554718 shutdown_connections 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.281+0000 7f3ce2317e00 1 -- 10.20.193.28:0/567554718 wait complete. 2026-02-20T13:23:12.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.282+0000 7f3ce2317e00 1 -- start start 2026-02-20T13:23:12.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.282+0000 7f3ce2317e00 1 Processor -- start 2026-02-20T13:23:12.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27410 0x55a905e482a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27d20 0x55a905e487e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3ce2317e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e48d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a905e02390 con 0x55a905e27410 2026-02-20T13:23:12.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a905e66c40 con 0x55a905e6c9c0 2026-02-20T13:23:12.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3ce2317e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a905e45a70 con 0x55a905e27d20 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27d20 0x55a905e487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cdd891640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27d20 0x55a905e487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58146/0 (socket says 10.20.193.28:58146) 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cdd891640 1 -- 10.20.193.28:0/1128001364 learned_addr learned my addr 10.20.193.28:0/1128001364 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cde092640 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27410 0x55a905e482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cde092640 1 -- 10.20.193.28:0/1128001364 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27d20 msgr2=0x55a905e487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cde092640 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27d20 0x55a905e487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cde092640 1 -- 10.20.193.28:0/1128001364 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 msgr2=0x55a905e48d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cde092640 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e48d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cde092640 1 -- 10.20.193.28:0/1128001364 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a905cc3f70 con 0x55a905e27410 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3cde092640 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27410 0x55a905e482a0 secure :-1 s=READY pgs=796 gs=2 cs=0 l=1 c_cookie=13453145646977255736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a905e6ad80 tx=0x7f3cc80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab32cb027ac0938 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.283+0000 7f3c8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1128001364 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cc802e070 con 0x55a905e27410 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1128001364 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3cc8027040 con 0x55a905e27410 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1128001364 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cc802adf0 con 0x55a905e27410 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a905cc94f0 con 0x55a905e27410 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1128001364 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3cc8017070 con 0x55a905e27410 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3c8bfff640 10 client.17553 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 10 client.17553 _ll_register_callbacks cb 0x55a905ceab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a905a8b530 con 0x55a905e27410 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1128001364 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3cc802a430 con 0x55a905e27410 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 10 client.17553 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a905cb7b40 con 0x55a905e27410 2026-02-20T13:23:12.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1128001364 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3cc8011870 con 0x55a905e27410 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 10 client.17553 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 10 client.17553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 20 client.17553 populate_metadata read hostname 'trial028' 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a905f1af90 0x55a905f3b440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 4 client.17553 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.284+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f3ccc00fe50 con 0x55a905f1af90 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.285+0000 7f3cdd891640 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a905f1af90 0x55a905f3b440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.285+0000 7f3cdd891640 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a905f1af90 0x55a905f3b440 crc :-1 s=READY pgs=185 gs=4 cs=0 l=0 c_cookie=15487591426236290058 s_cookie=14848379805252471097 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6eefa586b33140a server_cookie=ce100ac346284939 in_seq=0 out_seq=0 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.285+0000 7f3c8bfff640 10 client.17553 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.286+0000 7f3c8bfff640 1 -- 10.20.193.28:0/1128001364 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f3ccc00fe50 con 0x55a905f1af90 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.286+0000 7f3c8bfff640 10 client.17553 handle_command_reply: tid=0 2026-02-20T13:23:12.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.286+0000 7f3ce2317e00 1 client.17553 shutdown 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.286+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27410 msgr2=0x55a905e482a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.286+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27410 0x55a905e482a0 secure :-1 s=READY pgs=796 gs=2 cs=0 l=1 c_cookie=13453145646977255736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a905e6ad80 tx=0x7f3cc80047e0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 shutdown_connections 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a905f1af90 0x55a905f3b440 crc :-1 s=READY pgs=185 gs=4 cs=0 l=0 c_cookie=15487591426236290058 s_cookie=14848379805252471097 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a905e6c9c0 0x55a905e48d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a905e27d20 0x55a905e487e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 1 --2- 10.20.193.28:0/1128001364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a905e27410 0x55a905e482a0 unknown :-1 s=CLOSED pgs=796 gs=2 cs=0 l=1 c_cookie=13453145646977255736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3c8bfff640 0 client.17553 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 >> 10.20.193.28:0/1128001364 conn(0x55a905e05910 msgr2=0x55a905e6bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 shutdown_connections 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 1 -- 10.20.193.28:0/1128001364 wait complete. 2026-02-20T13:23:12.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.287+0000 7f3ce2317e00 20 client.17553 trim_cache size 0 max 16384 2026-02-20T13:23:12.296 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:12.296 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:23:12.296 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "48221fde-7a9b-4975-8c4e-b3d11867b75c", 2026-02-20T13:23:12.296 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:23:12.296 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:12.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 -- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3cb40b57c0 msgr2=0x7f3cb40d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3cb40b57c0 0x7f3cb40d5c70 secure :-1 s=READY pgs=394 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cc800b2c0 tx=0x7f3cc800b4a0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 -- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 msgr2=0x7f3cd80f8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 0x7f3cd80f8510 secure :-1 s=READY pgs=792 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cd4033040 tx=0x7f3cd40039b0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 -- 10.20.193.28:0/4251743906 shutdown_connections 2026-02-20T13:23:12.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3cb40b57c0 0x7f3cb40d5c70 unknown :-1 s=CLOSED pgs=394 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cd8159af0 0x7f3cd80f8510 unknown :-1 s=CLOSED pgs=792 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3cd8062ae0 0x7f3cd80f3140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 --2- 10.20.193.28:0/4251743906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3cd80614f0 0x7f3cd80f2c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 -- 10.20.193.28:0/4251743906 >> 10.20.193.28:0/4251743906 conn(0x7f3cd805f830 msgr2=0x7f3cd810ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 -- 10.20.193.28:0/4251743906 shutdown_connections 2026-02-20T13:23:12.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.288+0000 7f3ce031d640 1 -- 10.20.193.28:0/4251743906 wait complete. 2026-02-20T13:23:12.388 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:23:12.575 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:12 trial127 ceph-mon[43817]: pgmap v357: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-20T13:23:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:12 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:23:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:12 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:12 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:23:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:12 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:23:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:12 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:12 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:12 trial034 ceph-mon[43332]: pgmap v357: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-20T13:23:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:12 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:23:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:12 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:12 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:23:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:12 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:23:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:12 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:12 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 -- 10.20.193.28:0/2811018438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10ffe0 msgr2=0x7f716c115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 --2- 10.20.193.28:0/2811018438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10ffe0 0x7f716c115030 secure :-1 s=READY pgs=797 gs=1 cs=0 l=1 c_cookie=10586233366686823794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7160009950 tx=0x7f716002f190 comp rx=0 tx=0).stop 2026-02-20T13:23:12.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 -- 10.20.193.28:0/2811018438 shutdown_connections 2026-02-20T13:23:12.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 --2- 10.20.193.28:0/2811018438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10ffe0 0x7f716c115030 unknown :-1 s=CLOSED pgs=797 gs=1 cs=0 l=1 c_cookie=10586233366686823794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 --2- 10.20.193.28:0/2811018438 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f716c1157e0 0x7f716c1761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 --2- 10.20.193.28:0/2811018438 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f716c10f5f0 0x7f716c10f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 -- 10.20.193.28:0/2811018438 >> 10.20.193.28:0/2811018438 conn(0x7f716c0ecea0 msgr2=0x7f716c10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 -- 10.20.193.28:0/2811018438 shutdown_connections 2026-02-20T13:23:12.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.755+0000 7f7173beb640 1 -- 10.20.193.28:0/2811018438 wait complete. 2026-02-20T13:23:12.759 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:12 trial028 ceph-mon[37442]: pgmap v357: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-20T13:23:12.759 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:12 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:23:12.759 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:12 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.759 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:12 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:23:12.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:12 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:23:12.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:12 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:12 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7173beb640 1 Processor -- start 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7173beb640 1 -- start start 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7173beb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10f5f0 0x7f716c0f4e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7173beb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f716c10ffe0 0x7f716c1760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7173beb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f716c1157e0 0x7f716c0f5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7173beb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f716c0fa750 con 0x7f716c10f5f0 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7173beb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f716c0fa8c0 con 0x7f716c10ffe0 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7173beb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f716c0faa80 con 0x7f716c1157e0 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7171960640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10f5f0 0x7f716c0f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f717115f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f716c10ffe0 0x7f716c1760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f7172161640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f716c1157e0 0x7f716c0f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f717115f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f716c10ffe0 0x7f716c1760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38742/0 (socket says 10.20.193.28:38742) 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.756+0000 7f717115f640 1 -- 10.20.193.28:0/4263003747 learned_addr learned my addr 10.20.193.28:0/4263003747 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7171960640 1 -- 10.20.193.28:0/4263003747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f716c1157e0 msgr2=0x7f716c0f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7171960640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f716c1157e0 0x7f716c0f5590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7171960640 1 -- 10.20.193.28:0/4263003747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f716c10ffe0 msgr2=0x7f716c1760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7171960640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f716c10ffe0 0x7f716c1760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7171960640 1 -- 10.20.193.28:0/4263003747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7160009570 con 0x7f716c10f5f0 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f717115f640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f716c10ffe0 0x7f716c1760b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7172161640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f716c1157e0 0x7f716c0f5590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7171960640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10f5f0 0x7f716c0f4e90 secure :-1 s=READY pgs=798 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c00d700 tx=0x7f715c00dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f715affd640 1 -- 10.20.193.28:0/4263003747 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c004500 con 0x7f716c10f5f0 2026-02-20T13:23:12.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f715affd640 1 -- 10.20.193.28:0/4263003747 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f715c00de30 con 0x7f716c10f5f0 2026-02-20T13:23:12.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f715affd640 1 -- 10.20.193.28:0/4263003747 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c0052a0 con 0x7f716c10f5f0 2026-02-20T13:23:12.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7173beb640 1 -- 10.20.193.28:0/4263003747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716c0fad60 con 0x7f716c10f5f0 2026-02-20T13:23:12.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.757+0000 7f7173beb640 1 -- 10.20.193.28:0/4263003747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716c0fb1e0 con 0x7f716c10f5f0 2026-02-20T13:23:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.760+0000 7f715affd640 1 -- 10.20.193.28:0/4263003747 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f715c005430 con 0x7f716c10f5f0 2026-02-20T13:23:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.762+0000 7f715affd640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71480b5750 0x7f71480d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.762+0000 7f715affd640 1 -- 10.20.193.28:0/4263003747 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f715c0e61d0 con 0x7f716c10f5f0 2026-02-20T13:23:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.762+0000 7f717115f640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71480b5750 0x7f71480d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.762+0000 7f717115f640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71480b5750 0x7f71480d5c00 secure :-1 s=READY pgs=395 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7160038820 tx=0x7f716003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.762+0000 7f7175be5e00 1 Processor -- start 2026-02-20T13:23:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7175be5e00 1 -- start start 2026-02-20T13:23:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412180 0x55fc3e412550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e457400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e477d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7175be5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e3287d0 con 0x55fc3e457940 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7175be5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e324500 con 0x55fc3e412180 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7175be5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e31e4a0 con 0x55fc3e412a90 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7171960640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412180 0x55fc3e412550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f717115f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e457400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7171960640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412180 0x55fc3e412550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38756/0 (socket says 10.20.193.28:38756) 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7171960640 1 -- 10.20.193.28:0/264321537 learned_addr learned my addr 10.20.193.28:0/264321537 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7172161640 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e477d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7171960640 1 -- 10.20.193.28:0/264321537 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 msgr2=0x55fc3e457400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7171960640 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e457400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.763+0000 7f7171960640 1 -- 10.20.193.28:0/264321537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 msgr2=0x55fc3e477d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7171960640 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e477d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7171960640 1 -- 10.20.193.28:0/264321537 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc3e2c9d80 con 0x55fc3e412180 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7172161640 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e477d20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7171960640 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412180 0x55fc3e412550 secure :-1 s=READY pgs=303 gs=2 cs=0 l=1 c_cookie=15924502068476248550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c0a8b00 tx=0x7f715c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcff3242788001e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f713a4e6640 1 -- 10.20.193.28:0/264321537 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c0b2250 con 0x55fc3e412180 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f713a4e6640 1 -- 10.20.193.28:0/264321537 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f715c0e5030 con 0x55fc3e412180 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f713a4e6640 1 -- 10.20.193.28:0/264321537 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c0b71e0 con 0x55fc3e412180 2026-02-20T13:23:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7175be5e00 1 -- 10.20.193.28:0/264321537 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412180 msgr2=0x55fc3e412550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7175be5e00 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412180 0x55fc3e412550 secure :-1 s=READY pgs=303 gs=2 cs=0 l=1 c_cookie=15924502068476248550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c0a8b00 tx=0x7f715c009c20 comp rx=0 tx=0).stop 2026-02-20T13:23:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7175be5e00 1 -- 10.20.193.28:0/264321537 shutdown_connections 2026-02-20T13:23:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7175be5e00 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e477d20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7175be5e00 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e457400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7175be5e00 1 --2- 10.20.193.28:0/264321537 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412180 0x55fc3e412550 unknown :-1 s=CLOSED pgs=303 gs=2 cs=0 l=1 c_cookie=15924502068476248550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7175be5e00 1 -- 10.20.193.28:0/264321537 >> 10.20.193.28:0/264321537 conn(0x55fc3e3f0680 msgr2=0x55fc3e410a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.764+0000 7f7175be5e00 1 -- 10.20.193.28:0/264321537 shutdown_connections 2026-02-20T13:23:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.765+0000 7f7175be5e00 1 -- 10.20.193.28:0/264321537 wait complete. 2026-02-20T13:23:12.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7175be5e00 1 -- start start 2026-02-20T13:23:12.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7175be5e00 1 Processor -- start 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e42a760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e42aca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e42fc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7175be5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e4301d0 con 0x55fc3e457940 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7175be5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e430340 con 0x55fc3e412a90 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7175be5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e430500 con 0x55fc3e412180 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7171960640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e42a760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7171960640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e42a760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58180/0 (socket says 10.20.193.28:58180) 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.766+0000 7f7171960640 1 -- 10.20.193.28:0/1704869165 learned_addr learned my addr 10.20.193.28:0/1704869165 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f717115f640 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e42aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7171960640 1 -- 10.20.193.28:0/1704869165 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 msgr2=0x55fc3e42aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7171960640 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e42aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7172161640 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e42fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7171960640 1 -- 10.20.193.28:0/1704869165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 msgr2=0x55fc3e42fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7171960640 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e42fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7171960640 1 -- 10.20.193.28:0/1704869165 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c0e1e70 con 0x55fc3e412180 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7172161640 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e42fc90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7171960640 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e42a760 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=3920854776579183476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c0ac750 tx=0x7f715c005cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3669aca54de55374 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f71277fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f71277fe640 1 -- 10.20.193.28:0/1704869165 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c0b7670 con 0x55fc3e412180 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7168005280 con 0x55fc3e412180 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f71277fe640 1 -- 10.20.193.28:0/1704869165 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f715c0b2250 con 0x55fc3e412180 2026-02-20T13:23:12.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f71277fe640 1 -- 10.20.193.28:0/1704869165 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c0aa510 con 0x55fc3e412180 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7175be5e00 10 client.27439 _ll_register_callbacks cb 0x55fc3e29f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fc3dfb46f0 con 0x55fc3e412180 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.767+0000 7f71277fe640 1 -- 10.20.193.28:0/1704869165 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f715c0aa6a0 con 0x55fc3e412180 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f71277fe640 1 -- 10.20.193.28:0/1704869165 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f715c0adf20 con 0x55fc3e412180 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f7175be5e00 10 client.27439 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55fc3e2a2350 con 0x55fc3e412180 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f71277fe640 1 -- 10.20.193.28:0/1704869165 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f715c009740 con 0x55fc3e412180 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f7175be5e00 10 client.27439 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f7175be5e00 10 client.27439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f7175be5e00 20 client.27439 populate_metadata read hostname 'trial028' 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f7175be5e00 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fc3e454a70 0x55fc3e454f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f7175be5e00 4 client.27439 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:12.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc3e32bd60 con 0x55fc3e454a70 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.768+0000 7f717115f640 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fc3e454a70 0x55fc3e454f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.769+0000 7f717115f640 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fc3e454a70 0x55fc3e454f10 crc :-1 s=READY pgs=186 gs=4 cs=0 l=0 c_cookie=3950785808959754472 s_cookie=13396802435656092609 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d402c2d6b350e8 server_cookie=b9eb00d5ff5e8bc1 in_seq=0 out_seq=0 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.769+0000 7f71277fe640 10 client.27439 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.769+0000 7f71277fe640 1 -- 10.20.193.28:0/1704869165 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fc3e32bd60 con 0x55fc3e454a70 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.769+0000 7f71277fe640 10 client.27439 handle_command_reply: tid=0 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.769+0000 7f7175be5e00 1 client.27439 shutdown 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.769+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 msgr2=0x55fc3e42a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.769+0000 7f7175be5e00 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e42a760 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=3920854776579183476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c0ac750 tx=0x7f715c005cc0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 shutdown_connections 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fc3e454a70 0x55fc3e454f10 crc :-1 s=READY pgs=186 gs=4 cs=0 l=0 c_cookie=3950785808959754472 s_cookie=13396802435656092609 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e457940 0x55fc3e42fc90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f71277fe640 0 client.27439 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:12.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e42aca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 1 --2- 10.20.193.28:0/1704869165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e42a760 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=3920854776579183476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 >> 10.20.193.28:0/1704869165 conn(0x55fc3e3f0680 msgr2=0x55fc3e411250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 shutdown_connections 2026-02-20T13:23:12.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 1 -- 10.20.193.28:0/1704869165 wait complete. 2026-02-20T13:23:12.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.770+0000 7f7175be5e00 20 client.27439 trim_cache size 0 max 16384 2026-02-20T13:23:12.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7175be5e00 1 Processor -- start 2026-02-20T13:23:12.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7175be5e00 1 -- start start 2026-02-20T13:23:12.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e427bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e428100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e454a70 0x55fc3e4565e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7175be5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e31c0d0 con 0x55fc3e454a70 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7175be5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fc3dfdc700 con 0x55fc3e412a90 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7175be5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e39d9b0 con 0x55fc3e412180 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7171960640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e427bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7171960640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e427bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58184/0 (socket says 10.20.193.28:58184) 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7171960640 1 -- 10.20.193.28:0/2183389666 learned_addr learned my addr 10.20.193.28:0/2183389666 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f7172161640 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e454a70 0x55fc3e4565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.779+0000 7f717115f640 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e428100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7171960640 1 -- 10.20.193.28:0/2183389666 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 msgr2=0x55fc3e428100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7171960640 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e428100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7171960640 1 -- 10.20.193.28:0/2183389666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e454a70 msgr2=0x55fc3e4565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7171960640 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e454a70 0x55fc3e4565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7171960640 1 -- 10.20.193.28:0/2183389666 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc3e2b4150 con 0x55fc3e412180 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f717115f640 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e428100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7171960640 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e427bc0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=5577060298145457579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c009bd0 tx=0x7f715c009cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d65b2cae9e4e5ab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7139ce5640 1 -- 10.20.193.28:0/2183389666 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c0aa510 con 0x55fc3e412180 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7139ce5640 1 -- 10.20.193.28:0/2183389666 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55fc3dfb46f0 con 0x55fc3e412180 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7139ce5640 1 -- 10.20.193.28:0/2183389666 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c0b2250 con 0x55fc3e412180 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7175be5e00 1 -- 10.20.193.28:0/2183389666 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 msgr2=0x55fc3e427bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7175be5e00 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e427bc0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=5577060298145457579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c009bd0 tx=0x7f715c009cc0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7175be5e00 1 -- 10.20.193.28:0/2183389666 shutdown_connections 2026-02-20T13:23:12.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7175be5e00 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e454a70 0x55fc3e4565e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7175be5e00 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e412a90 0x55fc3e428100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7175be5e00 1 --2- 10.20.193.28:0/2183389666 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412180 0x55fc3e427bc0 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=5577060298145457579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7175be5e00 1 -- 10.20.193.28:0/2183389666 >> 10.20.193.28:0/2183389666 conn(0x55fc3e3f0680 msgr2=0x55fc3e4153b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.780+0000 7f7175be5e00 1 -- 10.20.193.28:0/2183389666 shutdown_connections 2026-02-20T13:23:12.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.781+0000 7f7175be5e00 1 -- 10.20.193.28:0/2183389666 wait complete. 2026-02-20T13:23:12.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.781+0000 7f7175be5e00 1 -- start start 2026-02-20T13:23:12.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.781+0000 7f7175be5e00 1 Processor -- start 2026-02-20T13:23:12.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e412180 0x55fc3e435ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e436430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e454a70 0x55fc3e431eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e436d80 con 0x55fc3e412180 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e4323f0 con 0x55fc3e454a70 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fc3e4325b0 con 0x55fc3e412a90 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e412180 0x55fc3e435ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e412180 0x55fc3e435ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55570/0 (socket says 10.20.193.28:55570) 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 -- 10.20.193.28:0/3744304048 learned_addr learned my addr 10.20.193.28:0/3744304048 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7172161640 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e454a70 0x55fc3e431eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f717115f640 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e436430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 -- 10.20.193.28:0/3744304048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 msgr2=0x55fc3e436430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e436430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 -- 10.20.193.28:0/3744304048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e454a70 msgr2=0x55fc3e431eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e454a70 0x55fc3e431eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 -- 10.20.193.28:0/3744304048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc3e2aebd0 con 0x55fc3e412180 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f717115f640 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e436430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7171960640 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e412180 0x55fc3e435ef0 secure :-1 s=READY pgs=799 gs=1 cs=0 l=1 c_cookie=7362252069295848844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c0040a0 tx=0x7f715c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662bf94009437d8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f71277fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f71277fe640 1 -- 10.20.193.28:0/3744304048 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c0a8810 con 0x55fc3e412180 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f71277fe640 1 -- 10.20.193.28:0/3744304048 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f715c071b90 con 0x55fc3e412180 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7168005280 con 0x55fc3e412180 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f71277fe640 1 -- 10.20.193.28:0/3744304048 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f715c009900 con 0x55fc3e412180 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 10 client.17568 _ll_register_callbacks cb 0x55fc3e418520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.782+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f715c0e5030 con 0x55fc3e412180 2026-02-20T13:23:12.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f71277fe640 1 -- 10.20.193.28:0/3744304048 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f715c0b6d80 con 0x55fc3e412180 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f71277fe640 1 -- 10.20.193.28:0/3744304048 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f715c0b6f60 con 0x55fc3e412180 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f7175be5e00 10 client.17568 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55fc3e2a2680 con 0x55fc3e412180 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f71277fe640 1 -- 10.20.193.28:0/3744304048 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f715c08f020 con 0x55fc3e412180 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f7175be5e00 10 client.17568 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f7175be5e00 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f7175be5e00 20 client.17568 populate_metadata read hostname 'trial028' 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f7175be5e00 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fc3e457940 0x55fc3e4bdae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f7175be5e00 4 client.17568 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fc3dfb1f40 con 0x55fc3e457940 2026-02-20T13:23:12.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.783+0000 7f717115f640 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fc3e457940 0x55fc3e4bdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.784+0000 7f717115f640 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fc3e457940 0x55fc3e4bdae0 crc :-1 s=READY pgs=187 gs=4 cs=0 l=0 c_cookie=11123170622190321597 s_cookie=16507727218766689903 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a5d70bf6fb6ffbd server_cookie=e5173a719ba2b66f in_seq=0 out_seq=0 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.784+0000 7f71277fe640 10 client.17568 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.784+0000 7f71277fe640 1 -- 10.20.193.28:0/3744304048 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55fc3dfb1f40 con 0x55fc3e457940 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.784+0000 7f71277fe640 10 client.17568 handle_command_reply: tid=0 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.784+0000 7f7175be5e00 1 client.17568 shutdown 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e412180 msgr2=0x55fc3e435ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e412180 0x55fc3e435ef0 secure :-1 s=READY pgs=799 gs=1 cs=0 l=1 c_cookie=7362252069295848844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c0040a0 tx=0x7f715c009f90 comp rx=0 tx=0).stop 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 shutdown_connections 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fc3e457940 0x55fc3e4bdae0 crc :-1 s=READY pgs=187 gs=4 cs=0 l=0 c_cookie=11123170622190321597 s_cookie=16507727218766689903 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fc3e454a70 0x55fc3e431eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fc3e412a90 0x55fc3e436430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 --2- 10.20.193.28:0/3744304048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc3e412180 0x55fc3e435ef0 unknown :-1 s=CLOSED pgs=799 gs=1 cs=0 l=1 c_cookie=7362252069295848844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f71277fe640 0 client.17568 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:12.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 >> 10.20.193.28:0/3744304048 conn(0x55fc3e3f0680 msgr2=0x55fc3e426b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 shutdown_connections 2026-02-20T13:23:12.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 1 -- 10.20.193.28:0/3744304048 wait complete. 2026-02-20T13:23:12.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7175be5e00 20 client.17568 trim_cache size 0 max 16384 2026-02-20T13:23:12.794 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "48221fde-7a9b-4975-8c4e-b3d11867b75c", 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:23:12.795 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.796 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:23:12.797 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.798 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.799 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.800 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.801 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:12.802 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7173beb640 1 -- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71480b5750 msgr2=0x7f71480d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7173beb640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71480b5750 0x7f71480d5c00 secure :-1 s=READY pgs=395 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7160038820 tx=0x7f716003a040 comp rx=0 tx=0).stop 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7173beb640 1 -- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10f5f0 msgr2=0x7f716c0f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.785+0000 7f7173beb640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10f5f0 0x7f716c0f4e90 secure :-1 s=READY pgs=798 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f715c00d700 tx=0x7f715c00dbd0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.786+0000 7f7173beb640 1 -- 10.20.193.28:0/4263003747 shutdown_connections 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.786+0000 7f7173beb640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71480b5750 0x7f71480d5c00 unknown :-1 s=CLOSED pgs=395 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.786+0000 7f7173beb640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f716c1157e0 0x7f716c0f5590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.786+0000 7f7173beb640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f716c10ffe0 0x7f716c1760b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.786+0000 7f7173beb640 1 --2- 10.20.193.28:0/4263003747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f716c10f5f0 0x7f716c0f4e90 unknown :-1 s=CLOSED pgs=798 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:12.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.786+0000 7f7173beb640 1 -- 10.20.193.28:0/4263003747 >> 10.20.193.28:0/4263003747 conn(0x7f716c0ecea0 msgr2=0x7f716c10db00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:12.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.786+0000 7f7173beb640 1 -- 10.20.193.28:0/4263003747 shutdown_connections 2026-02-20T13:23:12.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:12.786+0000 7f7173beb640 1 -- 10.20.193.28:0/4263003747 wait complete. 2026-02-20T13:23:12.885 INFO:tasks.cephfs.filesystem:scrub status for tag:48221fde-7a9b-4975-8c4e-b3d11867b75c - {'path': '/', 'tag': '48221fde-7a9b-4975-8c4e-b3d11867b75c', 'options': 'recursive,force'} 2026-02-20T13:23:14.385 INFO:tasks.quiescer.fs.[cephfs]:Total duration (46.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-20T13:23:14.385 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.25 2026-02-20T13:23:14.386 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:23:14.571 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:14.706 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:14 trial028 ceph-mon[37442]: pgmap v358: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:23:14.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:14 trial127 ceph-mon[43817]: pgmap v358: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:23:14.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:14 trial034 ceph-mon[43332]: pgmap v358: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:23:14.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 -- 10.20.193.28:0/1030686464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010b930 msgr2=0x7f7f7010bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:14.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 --2- 10.20.193.28:0/1030686464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010b930 0x7f7f7010bd00 secure :-1 s=READY pgs=800 gs=1 cs=0 l=1 c_cookie=11822464753151800712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f600098c0 tx=0x7f7f6002f0c0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 -- 10.20.193.28:0/1030686464 shutdown_connections 2026-02-20T13:23:14.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 --2- 10.20.193.28:0/1030686464 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f70110f10 0x7f7f701113b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 --2- 10.20.193.28:0/1030686464 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f7010c320 0x7f7f701108f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 --2- 10.20.193.28:0/1030686464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010b930 0x7f7f7010bd00 unknown :-1 s=CLOSED pgs=800 gs=1 cs=0 l=1 c_cookie=11822464753151800712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 -- 10.20.193.28:0/1030686464 >> 10.20.193.28:0/1030686464 conn(0x7f7f700e95c0 msgr2=0x7f7f701099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:14.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 -- 10.20.193.28:0/1030686464 shutdown_connections 2026-02-20T13:23:14.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.746+0000 7f7f77310640 1 -- 10.20.193.28:0/1030686464 wait complete. 2026-02-20T13:23:14.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f77310640 1 Processor -- start 2026-02-20T13:23:14.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f77310640 1 -- start start 2026-02-20T13:23:14.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f77310640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f7010b930 0x7f7f701099d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:14.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f77310640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010c320 0x7f7f70102c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f77310640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f70110f10 0x7f7f70103290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f77310640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70103a20 con 0x7f7f7010c320 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f77310640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70108670 con 0x7f7f70110f10 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f77310640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70108830 con 0x7f7f7010b930 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f7630e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f7010b930 0x7f7f701099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f7630e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f7010b930 0x7f7f701099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58218/0 (socket says 10.20.193.28:58218) 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f7630e640 1 -- 10.20.193.28:0/2960735029 learned_addr learned my addr 10.20.193.28:0/2960735029 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.747+0000 7f7f75b0d640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010c320 0x7f7f70102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f76b0f640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f70110f10 0x7f7f70103290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f75b0d640 1 -- 10.20.193.28:0/2960735029 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f7010b930 msgr2=0x7f7f701099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:14.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f75b0d640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f7010b930 0x7f7f701099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f75b0d640 1 -- 10.20.193.28:0/2960735029 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f70110f10 msgr2=0x7f7f70103290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f75b0d640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f70110f10 0x7f7f70103290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f75b0d640 1 -- 10.20.193.28:0/2960735029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f600094b0 con 0x7f7f7010c320 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f75b0d640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010c320 0x7f7f70102c30 secure :-1 s=READY pgs=801 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f64004740 tx=0x7f7f6400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f577fe640 1 -- 10.20.193.28:0/2960735029 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f6400cd40 con 0x7f7f7010c320 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f70108b10 con 0x7f7f7010c320 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f577fe640 1 -- 10.20.193.28:0/2960735029 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7f64004d30 con 0x7f7f7010c320 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f577fe640 1 -- 10.20.193.28:0/2960735029 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f640106b0 con 0x7f7f7010c320 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.748+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f70109030 con 0x7f7f7010c320 2026-02-20T13:23:14.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.749+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f700603a0 con 0x7f7f7010c320 2026-02-20T13:23:14.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.751+0000 7f7f577fe640 1 -- 10.20.193.28:0/2960735029 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7f6401f060 con 0x7f7f7010c320 2026-02-20T13:23:14.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.753+0000 7f7f577fe640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f4c0b5760 0x7f7f4c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:14.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.753+0000 7f7f577fe640 1 -- 10.20.193.28:0/2960735029 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7f64014070 con 0x7f7f7010c320 2026-02-20T13:23:14.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.753+0000 7f7f577fe640 1 -- 10.20.193.28:0/2960735029 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f7f6411f730 con 0x7f7f7010c320 2026-02-20T13:23:14.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.753+0000 7f7f7630e640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f4c0b5760 0x7f7f4c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:14.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.753+0000 7f7f7630e640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f4c0b5760 0x7f7f4c0d5c10 secure :-1 s=READY pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f600097e0 tx=0x7f7f6003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:14.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.895+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f70103f30 con 0x7f7f7010c320 2026-02-20T13:23:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.895+0000 7f7f577fe640 1 -- 10.20.193.28:0/2960735029 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f7f640a96b0 con 0x7f7f7010c320 2026-02-20T13:23:14.899 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:23:14.899 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f4c0b5760 msgr2=0x7f7f4c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f4c0b5760 0x7f7f4c0d5c10 secure :-1 s=READY pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f600097e0 tx=0x7f7f6003a040 comp rx=0 tx=0).stop 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010c320 msgr2=0x7f7f70102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010c320 0x7f7f70102c30 secure :-1 s=READY pgs=801 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f64004740 tx=0x7f7f6400ee60 comp rx=0 tx=0).stop 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 shutdown_connections 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7f4c0b5760 0x7f7f4c0d5c10 unknown :-1 s=CLOSED pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f7010c320 0x7f7f70102c30 unknown :-1 s=CLOSED pgs=801 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7f70110f10 0x7f7f70103290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 --2- 10.20.193.28:0/2960735029 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f7010b930 0x7f7f701099d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 >> 10.20.193.28:0/2960735029 conn(0x7f7f700e95c0 msgr2=0x7f7f7010e120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:14.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 shutdown_connections 2026-02-20T13:23:14.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:14.896+0000 7f7f77310640 1 -- 10.20.193.28:0/2960735029 wait complete. 2026-02-20T13:23:14.997 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 143.25 --await-for 45.0' 2026-02-20T13:23:14.997 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 143.25 --await-for 45.0 2026-02-20T13:23:15.183 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 -- 10.20.193.28:0/3910987554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 msgr2=0x7efd68114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 --2- 10.20.193.28:0/3910987554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 0x7efd68114ef0 secure :-1 s=READY pgs=802 gs=2 cs=0 l=1 c_cookie=4932346950653252285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd58009950 tx=0x7efd5802f1d0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 -- 10.20.193.28:0/3910987554 shutdown_connections 2026-02-20T13:23:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 --2- 10.20.193.28:0/3910987554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 0x7efd68114ef0 unknown :-1 s=CLOSED pgs=802 gs=2 cs=0 l=1 c_cookie=4932346950653252285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 --2- 10.20.193.28:0/3910987554 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efd681156a0 0x7efd68176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 --2- 10.20.193.28:0/3910987554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efd6810f4b0 0x7efd6810f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 -- 10.20.193.28:0/3910987554 >> 10.20.193.28:0/3910987554 conn(0x7efd680ecda0 msgr2=0x7efd6810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 -- 10.20.193.28:0/3910987554 shutdown_connections 2026-02-20T13:23:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.360+0000 7efd6cdad640 1 -- 10.20.193.28:0/3910987554 wait complete. 2026-02-20T13:23:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd6cdad640 1 Processor -- start 2026-02-20T13:23:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd6cdad640 1 -- start start 2026-02-20T13:23:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd6cdad640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efd6810f4b0 0x7efd680f5880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd6cdad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 0x7efd68175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd6cdad640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efd681156a0 0x7efd680f5f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd6cdad640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efd680fb190 con 0x7efd6810fea0 2026-02-20T13:23:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd6cdad640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7efd680fb300 con 0x7efd6810f4b0 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd6cdad640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7efd680fb4c0 con 0x7efd681156a0 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd66ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 0x7efd68175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd66ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 0x7efd68175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55614/0 (socket says 10.20.193.28:55614) 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd66ffd640 1 -- 10.20.193.28:0/1186197608 learned_addr learned my addr 10.20.193.28:0/1186197608 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd677fe640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efd6810f4b0 0x7efd680f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd66ffd640 1 -- 10.20.193.28:0/1186197608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efd681156a0 msgr2=0x7efd680f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.361+0000 7efd67fff640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efd681156a0 0x7efd680f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd66ffd640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efd681156a0 0x7efd680f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd66ffd640 1 -- 10.20.193.28:0/1186197608 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efd6810f4b0 msgr2=0x7efd680f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd66ffd640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efd6810f4b0 0x7efd680f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd66ffd640 1 -- 10.20.193.28:0/1186197608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd58009570 con 0x7efd6810fea0 2026-02-20T13:23:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd67fff640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efd681156a0 0x7efd680f5f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:23:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd66ffd640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 0x7efd68175f70 secure :-1 s=READY pgs=803 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd58038820 tx=0x7efd58004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd64ff9640 1 -- 10.20.193.28:0/1186197608 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd5803d070 con 0x7efd6810fea0 2026-02-20T13:23:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd64ff9640 1 -- 10.20.193.28:0/1186197608 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd58002ad0 con 0x7efd6810fea0 2026-02-20T13:23:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd6cdad640 1 -- 10.20.193.28:0/1186197608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd680fb740 con 0x7efd6810fea0 2026-02-20T13:23:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd64ff9640 1 -- 10.20.193.28:0/1186197608 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd58041930 con 0x7efd6810fea0 2026-02-20T13:23:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.362+0000 7efd6cdad640 1 -- 10.20.193.28:0/1186197608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd680fbbb0 con 0x7efd6810fea0 2026-02-20T13:23:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.365+0000 7efd64ff9640 1 -- 10.20.193.28:0/1186197608 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7efd5802f9f0 con 0x7efd6810fea0 2026-02-20T13:23:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.366+0000 7efd64ff9640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efd3c0b56d0 0x7efd3c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.367+0000 7efd64ff9640 1 -- 10.20.193.28:0/1186197608 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efd5810b180 con 0x7efd6810fea0 2026-02-20T13:23:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.367+0000 7efd677fe640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efd3c0b56d0 0x7efd3c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.367+0000 7efd70030e00 1 Processor -- start 2026-02-20T13:23:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.367+0000 7efd677fe640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efd3c0b56d0 0x7efd3c0d5b80 secure :-1 s=READY pgs=397 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd54004740 tx=0x7efd54005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.367+0000 7efd70030e00 1 -- start start 2026-02-20T13:23:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd70030e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b2d30 0x5645c58b3100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd70030e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 0x5645c58f7fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd70030e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 0x5645c59188d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd70030e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5645c57c91a0 con 0x5645c58b2d30 2026-02-20T13:23:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd70030e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5645c57c4ed0 con 0x5645c58b3640 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd70030e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5645c57bf030 con 0x5645c58f84f0 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b2d30 0x5645c58b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b2d30 0x5645c58b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55630/0 (socket says 10.20.193.28:55630) 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 -- 10.20.193.28:0/96151055 learned_addr learned my addr 10.20.193.28:0/96151055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 -- 10.20.193.28:0/96151055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 msgr2=0x5645c59188d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 --2- 10.20.193.28:0/96151055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 0x5645c59188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 -- 10.20.193.28:0/96151055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 msgr2=0x5645c58f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 --2- 10.20.193.28:0/96151055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 0x5645c58f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 -- 10.20.193.28:0/96151055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645c576a4c0 con 0x5645c58b2d30 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd677fe640 1 --2- 10.20.193.28:0/96151055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b2d30 0x5645c58b3100 secure :-1 s=READY pgs=804 gs=1 cs=0 l=1 c_cookie=9076203089914139149 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd54009cc0 tx=0x7efd54014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df5269f5ba2920d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd2bfff640 1 -- 10.20.193.28:0/96151055 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd54009dc0 con 0x5645c58b2d30 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd2bfff640 1 -- 10.20.193.28:0/96151055 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd5401a940 con 0x5645c58b2d30 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.368+0000 7efd2bfff640 1 -- 10.20.193.28:0/96151055 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd5401b940 con 0x5645c58b2d30 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 -- 10.20.193.28:0/96151055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b2d30 msgr2=0x5645c58b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 --2- 10.20.193.28:0/96151055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b2d30 0x5645c58b3100 secure :-1 s=READY pgs=804 gs=1 cs=0 l=1 c_cookie=9076203089914139149 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd54009cc0 tx=0x7efd54014000 comp rx=0 tx=0).stop 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 -- 10.20.193.28:0/96151055 shutdown_connections 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 --2- 10.20.193.28:0/96151055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 0x5645c59188d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 --2- 10.20.193.28:0/96151055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 0x5645c58f7fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 --2- 10.20.193.28:0/96151055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b2d30 0x5645c58b3100 unknown :-1 s=CLOSED pgs=804 gs=1 cs=0 l=1 c_cookie=9076203089914139149 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 -- 10.20.193.28:0/96151055 >> 10.20.193.28:0/96151055 conn(0x5645c57d1d60 msgr2=0x5645c58b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:15.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 -- 10.20.193.28:0/96151055 shutdown_connections 2026-02-20T13:23:15.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.369+0000 7efd70030e00 1 -- 10.20.193.28:0/96151055 wait complete. 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.370+0000 7efd70030e00 1 -- start start 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.370+0000 7efd70030e00 1 Processor -- start 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd70030e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 0x5645c58cb240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd70030e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b3640 0x5645c58cb780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd70030e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58d0770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd70030e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5645c58d0cb0 con 0x5645c58f84f0 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd70030e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5645c58d0e20 con 0x5645c58b2d30 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd70030e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5645c58d0fe0 con 0x5645c58b3640 2026-02-20T13:23:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55636/0 (socket says 10.20.193.28:55636) 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 -- 10.20.193.28:0/2918506362 learned_addr learned my addr 10.20.193.28:0/2918506362 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd66ffd640 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b3640 0x5645c58cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd677fe640 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 0x5645c58cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 -- 10.20.193.28:0/2918506362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b3640 msgr2=0x5645c58cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b3640 0x5645c58cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 -- 10.20.193.28:0/2918506362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 msgr2=0x5645c58cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 0x5645c58cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 -- 10.20.193.28:0/2918506362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645c5742c20 con 0x5645c58f84f0 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd67fff640 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58d0770 secure :-1 s=READY pgs=805 gs=1 cs=0 l=1 c_cookie=10000852117351450987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd5c005070 tx=0x7efd5c003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aca2a0391f2496b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.371+0000 7efd297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd297fa640 1 -- 10.20.193.28:0/2918506362 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd5c012440 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd297fa640 1 -- 10.20.193.28:0/2918506362 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd5c012a80 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd297fa640 1 -- 10.20.193.28:0/2918506362 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd5c01ad80 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd54009960 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd297fa640 1 -- 10.20.193.28:0/2918506362 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efd5c0113d0 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd70030e00 10 client.17586 _ll_register_callbacks cb 0x5645c5749dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5645c549da60 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd297fa640 1 -- 10.20.193.28:0/2918506362 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd5c01a400 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd70030e00 10 client.17586 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.372+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5645c57545f0 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.373+0000 7efd297fa640 1 -- 10.20.193.28:0/2918506362 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd5c018020 con 0x5645c58f84f0 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.373+0000 7efd70030e00 10 client.17586 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.373+0000 7efd70030e00 10 client.17586 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.373+0000 7efd70030e00 20 client.17586 populate_metadata read hostname 'trial028' 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.373+0000 7efd70030e00 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5645c58f5950 0x5645c58f5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.373+0000 7efd70030e00 4 client.17586 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.373+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645c57915d0 con 0x5645c58f5950 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.373+0000 7efd677fe640 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5645c58f5950 0x5645c58f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.374+0000 7efd677fe640 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5645c58f5950 0x5645c58f5df0 crc :-1 s=READY pgs=188 gs=4 cs=0 l=0 c_cookie=13239794395411746295 s_cookie=11827485362248665125 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7bd32daedb98df7 server_cookie=a423ab45b2f6c825 in_seq=0 out_seq=0 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.374+0000 7efd297fa640 10 client.17586 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.374+0000 7efd297fa640 1 -- 10.20.193.28:0/2918506362 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5645c57915d0 con 0x5645c58f5950 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.374+0000 7efd297fa640 10 client.17586 handle_command_reply: tid=0 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.374+0000 7efd70030e00 1 client.17586 shutdown 2026-02-20T13:23:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.374+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 msgr2=0x5645c58d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.374+0000 7efd70030e00 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58d0770 secure :-1 s=READY pgs=805 gs=1 cs=0 l=1 c_cookie=10000852117351450987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd5c005070 tx=0x7efd5c003ea0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 shutdown_connections 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5645c58f5950 0x5645c58f5df0 crc :-1 s=READY pgs=188 gs=4 cs=0 l=0 c_cookie=13239794395411746295 s_cookie=11827485362248665125 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58d0770 unknown :-1 s=CLOSED pgs=805 gs=1 cs=0 l=1 c_cookie=10000852117351450987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b3640 0x5645c58cb780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 1 --2- 10.20.193.28:0/2918506362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 0x5645c58cb240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd297fa640 0 client.17586 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 >> 10.20.193.28:0/2918506362 conn(0x5645c57d1d60 msgr2=0x5645c58b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 shutdown_connections 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 1 -- 10.20.193.28:0/2918506362 wait complete. 2026-02-20T13:23:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.375+0000 7efd70030e00 20 client.17586 trim_cache size 0 max 16384 2026-02-20T13:23:15.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd70030e00 1 Processor -- start 2026-02-20T13:23:15.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd70030e00 1 -- start start 2026-02-20T13:23:15.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd70030e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b2d30 0x5645c58f76e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd70030e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 0x5645c58f7c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd70030e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58b1e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd70030e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5645c57bcc60 con 0x5645c58f84f0 2026-02-20T13:23:15.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd70030e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5645c547cef0 con 0x5645c58b3640 2026-02-20T13:23:15.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd70030e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5645c58b88d0 con 0x5645c58b2d30 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55650/0 (socket says 10.20.193.28:55650) 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd67fff640 1 -- 10.20.193.28:0/3121651694 learned_addr learned my addr 10.20.193.28:0/3121651694 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd66ffd640 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 0x5645c58f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd677fe640 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b2d30 0x5645c58f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd67fff640 1 -- 10.20.193.28:0/3121651694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b2d30 msgr2=0x5645c58f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd67fff640 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b2d30 0x5645c58f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd67fff640 1 -- 10.20.193.28:0/3121651694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 msgr2=0x5645c58f7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd67fff640 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 0x5645c58f7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.384+0000 7efd67fff640 1 -- 10.20.193.28:0/3121651694 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645c574f150 con 0x5645c58f84f0 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd67fff640 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58b1e10 secure :-1 s=READY pgs=806 gs=1 cs=0 l=1 c_cookie=17602445953291903981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd5c00fbb0 tx=0x7efd5c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44873552ff9e3ed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd2b7fe640 1 -- 10.20.193.28:0/3121651694 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd5c031070 con 0x5645c58f84f0 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd2b7fe640 1 -- 10.20.193.28:0/3121651694 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5645c549da60 con 0x5645c58f84f0 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd2b7fe640 1 -- 10.20.193.28:0/3121651694 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd5c010c60 con 0x5645c58f84f0 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 -- 10.20.193.28:0/3121651694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 msgr2=0x5645c58b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58b1e10 secure :-1 s=READY pgs=806 gs=1 cs=0 l=1 c_cookie=17602445953291903981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd5c00fbb0 tx=0x7efd5c01e000 comp rx=0 tx=0).stop 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 -- 10.20.193.28:0/3121651694 shutdown_connections 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58f84f0 0x5645c58b1e10 unknown :-1 s=CLOSED pgs=806 gs=1 cs=0 l=1 c_cookie=17602445953291903981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b3640 0x5645c58f7c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 --2- 10.20.193.28:0/3121651694 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58b2d30 0x5645c58f76e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 -- 10.20.193.28:0/3121651694 >> 10.20.193.28:0/3121651694 conn(0x5645c57d1d60 msgr2=0x5645c58b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:15.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 -- 10.20.193.28:0/3121651694 shutdown_connections 2026-02-20T13:23:15.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.385+0000 7efd70030e00 1 -- 10.20.193.28:0/3121651694 wait complete. 2026-02-20T13:23:15.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd70030e00 1 -- start start 2026-02-20T13:23:15.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd70030e00 1 Processor -- start 2026-02-20T13:23:15.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd70030e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 0x5645c58d3500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd70030e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b3640 0x5645c58d3a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd70030e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 0x5645c593da00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd70030e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5645c593df40 con 0x5645c58b3640 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd70030e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5645c593e0b0 con 0x5645c58b2d30 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd70030e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5645c593e270 con 0x5645c58f84f0 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd66ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b3640 0x5645c58d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd66ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b3640 0x5645c58d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55656/0 (socket says 10.20.193.28:55656) 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd66ffd640 1 -- 10.20.193.28:0/2154183774 learned_addr learned my addr 10.20.193.28:0/2154183774 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.386+0000 7efd67fff640 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 0x5645c593da00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd677fe640 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 0x5645c58d3500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd66ffd640 1 -- 10.20.193.28:0/2154183774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 msgr2=0x5645c593da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:15.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd66ffd640 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 0x5645c593da00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd66ffd640 1 -- 10.20.193.28:0/2154183774 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 msgr2=0x5645c58d3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd66ffd640 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 0x5645c58d3500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd66ffd640 1 -- 10.20.193.28:0/2154183774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645c5742f50 con 0x5645c58b3640 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd66ffd640 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b3640 0x5645c58d3a40 secure :-1 s=READY pgs=807 gs=1 cs=0 l=1 c_cookie=5183591859186979317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd58032040 tx=0x7efd580d0f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47efd155037251f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd297fa640 1 -- 10.20.193.28:0/2154183774 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd580d97e0 con 0x5645c58b3640 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd297fa640 1 -- 10.20.193.28:0/2154183774 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd580dc620 con 0x5645c58b3640 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd297fa640 1 -- 10.20.193.28:0/2154183774 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd580cf4c0 con 0x5645c58b3640 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645c57545f0 con 0x5645c58b3640 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd297fa640 1 -- 10.20.193.28:0/2154183774 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efd580cf650 con 0x5645c58b3640 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd297fa640 10 client.17592 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:23:15.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd70030e00 10 client.17592 _ll_register_callbacks cb 0x5645c5749dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.387+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5645c5516aa0 con 0x5645c58b3640 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd297fa640 1 -- 10.20.193.28:0/2154183774 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd58035320 con 0x5645c58b3640 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd70030e00 10 client.17592 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5645c5754850 con 0x5645c58b3640 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd297fa640 1 -- 10.20.193.28:0/2154183774 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd580d2ed0 con 0x5645c58b3640 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd70030e00 10 client.17592 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd70030e00 10 client.17592 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd70030e00 20 client.17592 populate_metadata read hostname 'trial028' 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd70030e00 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5645c59a61a0 0x5645c59c6650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd70030e00 4 client.17592 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.25, "await_for": 45.0}] 2026-02-20T13:23:15.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.25, "await_for": 45.0}) -- 0x5645c57cc050 con 0x5645c59a61a0 2026-02-20T13:23:15.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.388+0000 7efd677fe640 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5645c59a61a0 0x5645c59c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:15.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.389+0000 7efd677fe640 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5645c59a61a0 0x5645c59c6650 crc :-1 s=READY pgs=189 gs=4 cs=0 l=0 c_cookie=11947066601385807395 s_cookie=13840328863214541081 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5cc81c69388ce23 server_cookie=c012b9c59a7d1919 in_seq=0 out_seq=0 2026-02-20T13:23:15.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.389+0000 7efd297fa640 10 client.17592 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:15.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.394+0000 7efd297fa640 1 -- 10.20.193.28:0/2154183774 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5645c57cc050 con 0x5645c59a61a0 2026-02-20T13:23:15.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.394+0000 7efd297fa640 10 client.17592 handle_command_reply: tid=0 2026-02-20T13:23:15.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.394+0000 7efd70030e00 1 client.17592 shutdown 2026-02-20T13:23:15.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b3640 msgr2=0x5645c58d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b3640 0x5645c58d3a40 secure :-1 s=READY pgs=807 gs=1 cs=0 l=1 c_cookie=5183591859186979317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd58032040 tx=0x7efd580d0f90 comp rx=0 tx=0).stop 2026-02-20T13:23:15.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 shutdown_connections 2026-02-20T13:23:15.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5645c59a61a0 0x5645c59c6650 crc :-1 s=READY pgs=189 gs=4 cs=0 l=0 c_cookie=11947066601385807395 s_cookie=13840328863214541081 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645c58b3640 0x5645c58d3a40 unknown :-1 s=CLOSED pgs=807 gs=1 cs=0 l=1 c_cookie=5183591859186979317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645c58f84f0 0x5645c593da00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 --2- 10.20.193.28:0/2154183774 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5645c58b2d30 0x5645c58d3500 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd297fa640 0 client.17592 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 >> 10.20.193.28:0/2154183774 conn(0x5645c57d1d60 msgr2=0x5645c58b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 shutdown_connections 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 1 -- 10.20.193.28:0/2154183774 wait complete. 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd70030e00 20 client.17592 trim_cache size 0 max 16384 2026-02-20T13:23:15.400 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 18, 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "2ff5bc11": { 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "version": 18, 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:23:15.401 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 143.2, 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:15.402 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:15.403 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:15.403 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:15.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd6cdad640 1 -- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efd3c0b56d0 msgr2=0x7efd3c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd6cdad640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efd3c0b56d0 0x7efd3c0d5b80 secure :-1 s=READY pgs=397 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd54004740 tx=0x7efd54005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:15.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd6cdad640 1 -- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 msgr2=0x7efd68175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.395+0000 7efd6cdad640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 0x7efd68175f70 secure :-1 s=READY pgs=803 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd58038820 tx=0x7efd58004300 comp rx=0 tx=0).stop 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.396+0000 7efd6cdad640 1 -- 10.20.193.28:0/1186197608 shutdown_connections 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.396+0000 7efd6cdad640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efd3c0b56d0 0x7efd3c0d5b80 unknown :-1 s=CLOSED pgs=397 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.396+0000 7efd6cdad640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd6810fea0 0x7efd68175f70 unknown :-1 s=CLOSED pgs=803 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.396+0000 7efd6cdad640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efd681156a0 0x7efd680f5f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.396+0000 7efd6cdad640 1 --2- 10.20.193.28:0/1186197608 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efd6810f4b0 0x7efd680f5880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.396+0000 7efd6cdad640 1 -- 10.20.193.28:0/1186197608 >> 10.20.193.28:0/1186197608 conn(0x7efd680ecda0 msgr2=0x7efd68111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.396+0000 7efd6cdad640 1 -- 10.20.193.28:0/1186197608 shutdown_connections 2026-02-20T13:23:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:15.396+0000 7efd6cdad640 1 -- 10.20.193.28:0/1186197608 wait complete. 2026-02-20T13:23:15.495 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:15 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2960735029' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:15.498 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2ff5bc11', quiesce took 1.1 seconds. Will release after: 22.15 2026-02-20T13:23:15.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:15 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2960735029' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:15.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:15 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2960735029' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:16.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:16 trial127 ceph-mon[43817]: pgmap v359: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:23:16.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:16 trial034 ceph-mon[43332]: pgmap v359: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:23:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:16 trial028 ceph-mon[37442]: pgmap v359: 97 pgs: 97 active+clean; 3.4 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:23:18.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:18 trial127 ceph-mon[43817]: pgmap v360: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:23:18.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:18 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:23:18.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:18 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:23:18.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:18 trial034 ceph-mon[43332]: pgmap v360: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:23:18.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:18 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:23:18.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:18 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:23:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:18 trial028 ceph-mon[37442]: pgmap v360: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:23:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:18 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:23:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:18 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:23:20.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:20 trial034 ceph-mon[43332]: pgmap v361: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:23:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:20 trial028 ceph-mon[37442]: pgmap v361: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:23:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:20 trial127 ceph-mon[43817]: pgmap v361: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:23:22.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3431222205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410b510 msgr2=0x7fd4b410b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3431222205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410b510 0x7fd4b410b9b0 secure :-1 s=READY pgs=808 gs=1 cs=0 l=1 c_cookie=4185201669129971057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b000aa30 tx=0x7fd4b0030270 comp rx=0 tx=0).stop 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3431222205 shutdown_connections 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3431222205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410b510 0x7fd4b410b9b0 unknown :-1 s=CLOSED pgs=808 gs=1 cs=0 l=1 c_cookie=4185201669129971057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3431222205 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4b410dd00 0x7fd4b410aec0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3431222205 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4b410d340 0x7fd4b410d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3431222205 >> 10.20.193.28:0/3431222205 conn(0x7fd4b40e8a80 msgr2=0x7fd4b4108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3431222205 shutdown_connections 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.222+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3431222205 wait complete. 2026-02-20T13:23:22.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b9f4b640 1 Processor -- start 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b9f4b640 1 -- start start 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b9f4b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4b410b510 0x7fd4b40f4430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b9f4b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4b410d340 0x7fd4b40f4a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b9f4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410dd00 0x7fd4b40f5680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b9f4b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40f5dc0 con 0x7fd4b410dd00 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b9f4b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40f5f30 con 0x7fd4b410d340 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b9f4b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40f60f0 con 0x7fd4b410b510 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b974a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410dd00 0x7fd4b40f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b8f49640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4b410b510 0x7fd4b40f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4abfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4b410d340 0x7fd4b40f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b974a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410dd00 0x7fd4b40f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42078/0 (socket says 10.20.193.28:42078) 2026-02-20T13:23:22.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.223+0000 7fd4b974a640 1 -- 10.20.193.28:0/3145980617 learned_addr learned my addr 10.20.193.28:0/3145980617 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4b974a640 1 -- 10.20.193.28:0/3145980617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4b410b510 msgr2=0x7fd4b40f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4b974a640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4b410b510 0x7fd4b40f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4b974a640 1 -- 10.20.193.28:0/3145980617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4b410d340 msgr2=0x7fd4b40f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4b974a640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4b410d340 0x7fd4b40f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4b974a640 1 -- 10.20.193.28:0/3145980617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b000a650 con 0x7fd4b410dd00 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4b974a640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410dd00 0x7fd4b40f5680 secure :-1 s=READY pgs=809 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b0003e00 tx=0x7fd4b00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4a9ffb640 1 -- 10.20.193.28:0/3145980617 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4b003e070 con 0x7fd4b410dd00 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4a9ffb640 1 -- 10.20.193.28:0/3145980617 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4b00055a0 con 0x7fd4b410dd00 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4a9ffb640 1 -- 10.20.193.28:0/3145980617 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4b0042a90 con 0x7fd4b410dd00 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3145980617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b40f6370 con 0x7fd4b410dd00 2026-02-20T13:23:22.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.224+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3145980617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b40f6890 con 0x7fd4b410dd00 2026-02-20T13:23:22.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.227+0000 7fd4a9ffb640 1 -- 10.20.193.28:0/3145980617 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd4b0039cf0 con 0x7fd4b410dd00 2026-02-20T13:23:22.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.228+0000 7fd4a9ffb640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4900b5760 0x7fd4900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.228+0000 7fd4a9ffb640 1 -- 10.20.193.28:0/3145980617 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd4b010c920 con 0x7fd4b410dd00 2026-02-20T13:23:22.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.228+0000 7fd4b8f49640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4900b5760 0x7fd4900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.229+0000 7fd4b8f49640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4900b5760 0x7fd4900d5c10 secure :-1 s=READY pgs=398 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a4004740 tx=0x7fd4a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:22.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4bd7c1e00 1 Processor -- start 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4bd7c1e00 1 -- start start 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf7f1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf9fae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558f9be53fd0 con 0x558f9bf7f700 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558f9be4fd00 con 0x558f9bf5ede0 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558f9be49ca0 con 0x558f9bf3e4c0 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4b8f49640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4b974a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf9fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4abfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf7f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4b8f49640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:46064/0 (socket says 10.20.193.28:46064) 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.230+0000 7fd4b8f49640 1 -- 10.20.193.28:0/3584001939 learned_addr learned my addr 10.20.193.28:0/3584001939 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4abfff640 1 -- 10.20.193.28:0/3584001939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 msgr2=0x558f9bf5e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4abfff640 1 --2- 10.20.193.28:0/3584001939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4abfff640 1 -- 10.20.193.28:0/3584001939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 msgr2=0x558f9bf9fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4abfff640 1 --2- 10.20.193.28:0/3584001939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf9fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4abfff640 1 -- 10.20.193.28:0/3584001939 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f9bdec8b0 con 0x558f9bf5ede0 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4abfff640 1 --2- 10.20.193.28:0/3584001939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf7f1c0 secure :-1 s=READY pgs=304 gs=3 cs=0 l=1 c_cookie=11581756935698936989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd49c004630 tx=0x7fd49c002b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0baaa91fb40749d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:22.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4813fe640 1 -- 10.20.193.28:0/3584001939 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd49c009e40 con 0x558f9bf5ede0 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4813fe640 1 -- 10.20.193.28:0/3584001939 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd49c010910 con 0x558f9bf5ede0 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4813fe640 1 -- 10.20.193.28:0/3584001939 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd49c019ba0 con 0x558f9bf5ede0 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/3584001939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 msgr2=0x558f9bf7f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/3584001939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf7f1c0 secure :-1 s=READY pgs=304 gs=3 cs=0 l=1 c_cookie=11581756935698936989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd49c004630 tx=0x7fd49c002b50 comp rx=0 tx=0).stop 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/3584001939 shutdown_connections 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/3584001939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf9fae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/3584001939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf7f1c0 unknown :-1 s=CLOSED pgs=304 gs=3 cs=0 l=1 c_cookie=11581756935698936989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/3584001939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5e8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/3584001939 >> 10.20.193.28:0/3584001939 conn(0x558f9be5d1c0 msgr2=0x558f9bf3cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/3584001939 shutdown_connections 2026-02-20T13:23:22.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.231+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/3584001939 wait complete. 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4bd7c1e00 1 -- start start 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4bd7c1e00 1 Processor -- start 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf5ede0 0x558f9bf58100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf58b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558f9bf591c0 con 0x558f9bf7f700 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558f9bf59330 con 0x558f9bf3e4c0 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558f9bf594f0 con 0x558f9bf5ede0 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4b8f49640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4b8f49640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55002/0 (socket says 10.20.193.28:55002) 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4b8f49640 1 -- 10.20.193.28:0/1189835389 learned_addr learned my addr 10.20.193.28:0/1189835389 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4abfff640 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf5ede0 0x558f9bf58100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.233+0000 7fd4b974a640 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf58b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4b8f49640 1 -- 10.20.193.28:0/1189835389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf5ede0 msgr2=0x558f9bf58100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4b8f49640 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf5ede0 0x558f9bf58100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4b8f49640 1 -- 10.20.193.28:0/1189835389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 msgr2=0x558f9bf58b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4b8f49640 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf58b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4b8f49640 1 -- 10.20.193.28:0/1189835389 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f9bdf5400 con 0x558f9bf3e4c0 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4b8f49640 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57ab0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=8650650345640737779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a4011740 tx=0x7fd4a4013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=780d48a80006bbf3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:22.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4727fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4727fc640 1 -- 10.20.193.28:0/1189835389 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a4021040 con 0x558f9bf3e4c0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4727fc640 1 -- 10.20.193.28:0/1189835389 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4a401bb90 con 0x558f9bf3e4c0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49c004220 con 0x558f9bf3e4c0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4727fc640 1 -- 10.20.193.28:0/1189835389 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a4025770 con 0x558f9bf3e4c0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4bd7c1e00 10 client.27566 _ll_register_callbacks cb 0x558f9bdd4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558f9bae9520 con 0x558f9bf3e4c0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4727fc640 1 -- 10.20.193.28:0/1189835389 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd4a4025900 con 0x558f9bf3e4c0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4727fc640 1 -- 10.20.193.28:0/1189835389 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4a4025ae0 con 0x558f9bf3e4c0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4bd7c1e00 10 client.27566 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.234+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558f9bdcdda0 con 0x558f9bf3e4c0 2026-02-20T13:23:22.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.235+0000 7fd4727fc640 1 -- 10.20.193.28:0/1189835389 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4a402d060 con 0x558f9bf3e4c0 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.235+0000 7fd4bd7c1e00 10 client.27566 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.235+0000 7fd4bd7c1e00 10 client.27566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.235+0000 7fd4bd7c1e00 20 client.27566 populate_metadata read hostname 'trial028' 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.235+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558f9bf5c320 0x558f9bf5c7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.235+0000 7fd4bd7c1e00 4 client.27566 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.235+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f9be7b630 con 0x558f9bf5c320 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.235+0000 7fd4abfff640 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558f9bf5c320 0x558f9bf5c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.236+0000 7fd4abfff640 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558f9bf5c320 0x558f9bf5c7c0 crc :-1 s=READY pgs=190 gs=4 cs=0 l=0 c_cookie=273317242463590722 s_cookie=13084843810926523333 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb04957c081942 server_cookie=b596b41e9bbe73c5 in_seq=0 out_seq=0 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.236+0000 7fd4727fc640 10 client.27566 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.236+0000 7fd4727fc640 1 -- 10.20.193.28:0/1189835389 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558f9be7b630 con 0x558f9bf5c320 2026-02-20T13:23:22.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.236+0000 7fd4727fc640 10 client.27566 handle_command_reply: tid=0 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.236+0000 7fd4bd7c1e00 1 client.27566 shutdown 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf3e4c0 msgr2=0x558f9bf57ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57ab0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=8650650345640737779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a4011740 tx=0x7fd4a4013040 comp rx=0 tx=0).stop 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 shutdown_connections 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558f9bf5c320 0x558f9bf5c7c0 crc :-1 s=READY pgs=190 gs=4 cs=0 l=0 c_cookie=273317242463590722 s_cookie=13084843810926523333 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf58b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf5ede0 0x558f9bf58100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/1189835389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57ab0 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=8650650345640737779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 >> 10.20.193.28:0/1189835389 conn(0x558f9be5d1c0 msgr2=0x558f9bf3f790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4727fc640 0 client.27566 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 shutdown_connections 2026-02-20T13:23:22.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/1189835389 wait complete. 2026-02-20T13:23:22.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.237+0000 7fd4bd7c1e00 20 client.27566 trim_cache size 0 max 16384 2026-02-20T13:23:22.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4bd7c1e00 1 Processor -- start 2026-02-20T13:23:22.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4bd7c1e00 1 -- start start 2026-02-20T13:23:22.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf5ede0 0x558f9bf49950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf7f700 0x558f9bf7d5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558f9be478d0 con 0x558f9bf5ede0 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558f9bb88f10 con 0x558f9bf7f700 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558f9beaf4f0 con 0x558f9bf3e4c0 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.244+0000 7fd4abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf5ede0 0x558f9bf49950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4b8f49640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf5ede0 0x558f9bf49950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42116/0 (socket says 10.20.193.28:42116) 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4abfff640 1 -- 10.20.193.28:0/4194437263 learned_addr learned my addr 10.20.193.28:0/4194437263 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4b974a640 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf7f700 0x558f9bf7d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4abfff640 1 -- 10.20.193.28:0/4194437263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 msgr2=0x558f9bf57940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4abfff640 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4abfff640 1 -- 10.20.193.28:0/4194437263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf7f700 msgr2=0x558f9bf7d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4abfff640 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf7f700 0x558f9bf7d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4abfff640 1 -- 10.20.193.28:0/4194437263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f9bf4a120 con 0x558f9bf5ede0 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4b8f49640 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4abfff640 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf5ede0 0x558f9bf49950 secure :-1 s=READY pgs=810 gs=1 cs=0 l=1 c_cookie=2079517542391859489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd49c004600 tx=0x7fd49c002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdbee2fe275c921 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd480bfd640 1 -- 10.20.193.28:0/4194437263 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd49c021070 con 0x558f9bf5ede0 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd480bfd640 1 -- 10.20.193.28:0/4194437263 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd49c022040 con 0x558f9bf5ede0 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd480bfd640 1 -- 10.20.193.28:0/4194437263 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd49c010820 con 0x558f9bf5ede0 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/4194437263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf5ede0 msgr2=0x558f9bf49950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf5ede0 0x558f9bf49950 secure :-1 s=READY pgs=810 gs=1 cs=0 l=1 c_cookie=2079517542391859489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd49c004600 tx=0x7fd49c002390 comp rx=0 tx=0).stop 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/4194437263 shutdown_connections 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf5ede0 0x558f9bf49950 unknown :-1 s=CLOSED pgs=810 gs=1 cs=0 l=1 c_cookie=2079517542391859489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf7f700 0x558f9bf7d5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/4194437263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf57940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/4194437263 >> 10.20.193.28:0/4194437263 conn(0x558f9be5d1c0 msgr2=0x558f9bf53dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/4194437263 shutdown_connections 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.245+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/4194437263 wait complete. 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.246+0000 7fd4bd7c1e00 1 -- start start 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.246+0000 7fd4bd7c1e00 1 Processor -- start 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.246+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5f1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.246+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf5f6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.246+0000 7fd4bd7c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf5fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.246+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558f9bf60470 con 0x558f9bf7f700 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.246+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558f9bf605e0 con 0x558f9bf5ede0 2026-02-20T13:23:22.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.246+0000 7fd4bd7c1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558f9bf607a0 con 0x558f9bf3e4c0 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4abfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf5f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4b974a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf5fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4b8f49640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4abfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf5f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55032/0 (socket says 10.20.193.28:55032) 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4abfff640 1 -- 10.20.193.28:0/2581035890 learned_addr learned my addr 10.20.193.28:0/2581035890 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4b974a640 1 -- 10.20.193.28:0/2581035890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 msgr2=0x558f9bf5f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4b974a640 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4b974a640 1 -- 10.20.193.28:0/2581035890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 msgr2=0x558f9bf5f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4b974a640 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf5f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4b974a640 1 -- 10.20.193.28:0/2581035890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f9bf3cd20 con 0x558f9bf7f700 2026-02-20T13:23:22.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4abfff640 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf5f6f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4b974a640 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf5fd70 secure :-1 s=READY pgs=811 gs=2 cs=0 l=1 c_cookie=6112165669189914697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b00cf300 tx=0x7fd4b00424a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d2c64ae0671049 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4727fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4727fc640 1 -- 10.20.193.28:0/2581035890 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4b00d2710 con 0x558f9bf7f700 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4727fc640 1 -- 10.20.193.28:0/2581035890 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4b00d2530 con 0x558f9bf7f700 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f9bdec8b0 con 0x558f9bf7f700 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4727fc640 1 -- 10.20.193.28:0/2581035890 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4b00d0f50 con 0x558f9bf7f700 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4bd7c1e00 10 client.17610 _ll_register_callbacks cb 0x558f9bdd4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558f9bef9ca0 con 0x558f9bf7f700 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4727fc640 1 -- 10.20.193.28:0/2581035890 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd4b00d4670 con 0x558f9bf7f700 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4727fc640 1 -- 10.20.193.28:0/2581035890 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4b00d4830 con 0x558f9bf7f700 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4bd7c1e00 10 client.17610 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:22.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.247+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558f9bddf670 con 0x558f9bf7f700 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.248+0000 7fd4727fc640 1 -- 10.20.193.28:0/2581035890 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4b00d2020 con 0x558f9bf7f700 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.248+0000 7fd4bd7c1e00 10 client.17610 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.248+0000 7fd4bd7c1e00 10 client.17610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.248+0000 7fd4bd7c1e00 20 client.17610 populate_metadata read hostname 'trial028' 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.248+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558f9bf624a0 0x558f9bf62940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.248+0000 7fd4bd7c1e00 4 client.17610 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.248+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558f9bb2d640 con 0x558f9bf624a0 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.248+0000 7fd4b8f49640 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558f9bf624a0 0x558f9bf62940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.249+0000 7fd4b8f49640 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558f9bf624a0 0x558f9bf62940 crc :-1 s=READY pgs=191 gs=4 cs=0 l=0 c_cookie=7908415083383509630 s_cookie=16979970265051936581 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc0559e256a527e server_cookie=eba4f8fe091db745 in_seq=0 out_seq=0 2026-02-20T13:23:22.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.249+0000 7fd4727fc640 10 client.17610 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4727fc640 1 -- 10.20.193.28:0/2581035890 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558f9bb2d640 con 0x558f9bf624a0 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4727fc640 10 client.17610 handle_command_reply: tid=0 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 client.17610 shutdown 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 msgr2=0x558f9bf5fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf5fd70 secure :-1 s=READY pgs=811 gs=2 cs=0 l=1 c_cookie=6112165669189914697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b00cf300 tx=0x7fd4b00424a0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 shutdown_connections 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558f9bf624a0 0x558f9bf62940 crc :-1 s=READY pgs=191 gs=4 cs=0 l=0 c_cookie=7908415083383509630 s_cookie=16979970265051936581 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558f9bf7f700 0x558f9bf5fd70 unknown :-1 s=CLOSED pgs=811 gs=2 cs=0 l=1 c_cookie=6112165669189914697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558f9bf5ede0 0x558f9bf5f6f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 --2- 10.20.193.28:0/2581035890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558f9bf3e4c0 0x558f9bf5f1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 >> 10.20.193.28:0/2581035890 conn(0x558f9be5d1c0 msgr2=0x558f9bf53dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:22.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4727fc640 0 client.17610 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:22.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.254+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 shutdown_connections 2026-02-20T13:23:22.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4bd7c1e00 1 -- 10.20.193.28:0/2581035890 wait complete. 2026-02-20T13:23:22.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4bd7c1e00 20 client.17610 trim_cache size 0 max 16384 2026-02-20T13:23:22.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:23:22.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:23:22.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:23:22.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:23:22.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4900b5760 msgr2=0x7fd4900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4900b5760 0x7fd4900d5c10 secure :-1 s=READY pgs=398 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a4004740 tx=0x7fd4a4005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:22.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410dd00 msgr2=0x7fd4b40f5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410dd00 0x7fd4b40f5680 secure :-1 s=READY pgs=809 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b0003e00 tx=0x7fd4b00039b0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3145980617 shutdown_connections 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd4900b5760 0x7fd4900d5c10 unknown :-1 s=CLOSED pgs=398 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4b410dd00 0x7fd4b40f5680 unknown :-1 s=CLOSED pgs=809 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd4b410d340 0x7fd4b40f4a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 --2- 10.20.193.28:0/3145980617 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd4b410b510 0x7fd4b40f4430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3145980617 >> 10.20.193.28:0/3145980617 conn(0x7fd4b40e8a80 msgr2=0x7fd4b40ea730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3145980617 shutdown_connections 2026-02-20T13:23:22.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:22.255+0000 7fd4b9f4b640 1 -- 10.20.193.28:0/3145980617 wait complete. 2026-02-20T13:23:22.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:22 trial034 ceph-mon[43332]: pgmap v362: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 19 op/s 2026-02-20T13:23:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:22 trial028 ceph-mon[37442]: pgmap v362: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 19 op/s 2026-02-20T13:23:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:22 trial127 ceph-mon[43817]: pgmap v362: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 19 op/s 2026-02-20T13:23:24.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:24 trial034 ceph-mon[43332]: pgmap v363: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2026-02-20T13:23:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:24 trial028 ceph-mon[37442]: pgmap v363: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2026-02-20T13:23:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:24 trial127 ceph-mon[43817]: pgmap v363: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2026-02-20T13:23:26.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:26 trial034 ceph-mon[43332]: pgmap v364: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2026-02-20T13:23:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:26 trial028 ceph-mon[37442]: pgmap v364: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2026-02-20T13:23:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:26 trial127 ceph-mon[43817]: pgmap v364: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2026-02-20T13:23:28.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:28 trial034 ceph-mon[43332]: pgmap v365: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:23:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:28 trial028 ceph-mon[37442]: pgmap v365: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:23:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:28 trial127 ceph-mon[43817]: pgmap v365: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:23:30.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:30 trial034 ceph-mon[43332]: pgmap v366: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2026-02-20T13:23:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:30 trial028 ceph-mon[37442]: pgmap v366: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2026-02-20T13:23:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:30 trial127 ceph-mon[43817]: pgmap v366: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2026-02-20T13:23:32.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:32 trial034 ceph-mon[43332]: pgmap v367: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2026-02-20T13:23:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:32 trial028 ceph-mon[37442]: pgmap v367: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2026-02-20T13:23:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:32 trial127 ceph-mon[43817]: pgmap v367: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2026-02-20T13:23:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:34 trial028 ceph-mon[37442]: pgmap v368: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:23:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:34 trial127 ceph-mon[43817]: pgmap v368: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:23:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:34 trial034 ceph-mon[43332]: pgmap v368: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:23:35.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 -- 10.20.193.28:0/3351087913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810d4b0 msgr2=0x7ff48816f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 --2- 10.20.193.28:0/3351087913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810d4b0 0x7ff48816f240 secure :-1 s=READY pgs=812 gs=1 cs=0 l=1 c_cookie=3782158595106203179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c00aa60 tx=0x7ff47c030270 comp rx=0 tx=0).stop 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 -- 10.20.193.28:0/3351087913 shutdown_connections 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 --2- 10.20.193.28:0/3351087913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810d4b0 0x7ff48816f240 unknown :-1 s=CLOSED pgs=812 gs=1 cs=0 l=1 c_cookie=3782158595106203179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 --2- 10.20.193.28:0/3351087913 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff48810cb00 0x7ff48810cf70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 --2- 10.20.193.28:0/3351087913 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff48810e270 0x7ff48810e660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 -- 10.20.193.28:0/3351087913 >> 10.20.193.28:0/3351087913 conn(0x7ff4880ea4c0 msgr2=0x7ff48810a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 -- 10.20.193.28:0/3351087913 shutdown_connections 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.328+0000 7ff48c94b640 1 -- 10.20.193.28:0/3351087913 wait complete. 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff48c94b640 1 Processor -- start 2026-02-20T13:23:35.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff48c94b640 1 -- start start 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff48c94b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff48810cb00 0x7ff4880626a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff48c94b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff48810d4b0 0x7ff48816f240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff48c94b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810e270 0x7ff488060fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff48c94b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff488061600 con 0x7ff48810e270 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff48c94b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff488061770 con 0x7ff48810d4b0 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff48c94b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff488061930 con 0x7ff48810cb00 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff487fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810e270 0x7ff488060fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff487fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810e270 0x7ff488060fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44924/0 (socket says 10.20.193.28:44924) 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff487fff640 1 -- 10.20.193.28:0/1348130044 learned_addr learned my addr 10.20.193.28:0/1348130044 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff4877fe640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff48810cb00 0x7ff4880626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff486ffd640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff48810d4b0 0x7ff48816f240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff487fff640 1 -- 10.20.193.28:0/1348130044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff48810cb00 msgr2=0x7ff4880626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff487fff640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff48810cb00 0x7ff4880626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff487fff640 1 -- 10.20.193.28:0/1348130044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff48810d4b0 msgr2=0x7ff48816f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff487fff640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff48810d4b0 0x7ff48816f240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.329+0000 7ff487fff640 1 -- 10.20.193.28:0/1348130044 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47c00a650 con 0x7ff48810e270 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.330+0000 7ff487fff640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810e270 0x7ff488060fb0 secure :-1 s=READY pgs=813 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c00a330 tx=0x7ff47c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.330+0000 7ff484ff9640 1 -- 10.20.193.28:0/1348130044 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47c03e070 con 0x7ff48810e270 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.330+0000 7ff484ff9640 1 -- 10.20.193.28:0/1348130044 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff47c0055a0 con 0x7ff48810e270 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.330+0000 7ff484ff9640 1 -- 10.20.193.28:0/1348130044 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47c042be0 con 0x7ff48810e270 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.330+0000 7ff48c94b640 1 -- 10.20.193.28:0/1348130044 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff488061bb0 con 0x7ff48810e270 2026-02-20T13:23:35.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.330+0000 7ff48c94b640 1 -- 10.20.193.28:0/1348130044 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff488061e30 con 0x7ff48810e270 2026-02-20T13:23:35.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.333+0000 7ff484ff9640 1 -- 10.20.193.28:0/1348130044 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff47c0050c0 con 0x7ff48810e270 2026-02-20T13:23:35.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.334+0000 7ff484ff9640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff45c0b5760 0x7ff45c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.334+0000 7ff484ff9640 1 -- 10.20.193.28:0/1348130044 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff47c10cba0 con 0x7ff48810e270 2026-02-20T13:23:35.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4877fe640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff45c0b5760 0x7ff45c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4901c0e00 1 Processor -- start 2026-02-20T13:23:35.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4877fe640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff45c0b5760 0x7ff45c0d5c10 secure :-1 s=READY pgs=399 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff474004740 tx=0x7ff474004340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:35.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4901c0e00 1 -- start start 2026-02-20T13:23:35.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d038a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d03de0 0x55b6d1d241c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 0x55b6d1d44ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1bf8fd0 con 0x55b6d1d03de0 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1bf4d00 con 0x55b6d1d24700 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1beeca0 con 0x55b6d1ce34c0 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.335+0000 7ff486ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d03de0 0x55b6d1d241c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff4877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff487fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 0x55b6d1d44ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff4877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d038a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:59902/0 (socket says 10.20.193.28:59902) 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff4877fe640 1 -- 10.20.193.28:0/2205276535 learned_addr learned my addr 10.20.193.28:0/2205276535 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:35.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff486ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d03de0 0x55b6d1d241c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44930/0 (socket says 10.20.193.28:44930) 2026-02-20T13:23:35.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff486ffd640 1 -- 10.20.193.28:0/2205276535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 msgr2=0x55b6d1d038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:35.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff486ffd640 1 --2- 10.20.193.28:0/2205276535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff486ffd640 1 -- 10.20.193.28:0/2205276535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 msgr2=0x55b6d1d44ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff486ffd640 1 --2- 10.20.193.28:0/2205276535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 0x55b6d1d44ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff486ffd640 1 -- 10.20.193.28:0/2205276535 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1b918b0 con 0x55b6d1d03de0 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff486ffd640 1 --2- 10.20.193.28:0/2205276535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d03de0 0x55b6d1d241c0 secure :-1 s=READY pgs=814 gs=2 cs=0 l=1 c_cookie=2895436117901581146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff478002980 tx=0x7ff478002e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282ea7cefd5c1b5a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff4537fe640 1 -- 10.20.193.28:0/2205276535 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47800fc20 con 0x55b6d1d03de0 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff4537fe640 1 -- 10.20.193.28:0/2205276535 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff47800fd80 con 0x55b6d1d03de0 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.336+0000 7ff4537fe640 1 -- 10.20.193.28:0/2205276535 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff478019950 con 0x55b6d1d03de0 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2205276535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d03de0 msgr2=0x55b6d1d241c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/2205276535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d03de0 0x55b6d1d241c0 secure :-1 s=READY pgs=814 gs=2 cs=0 l=1 c_cookie=2895436117901581146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff478002980 tx=0x7ff478002e50 comp rx=0 tx=0).stop 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2205276535 shutdown_connections 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/2205276535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d03de0 0x55b6d1d241c0 unknown :-1 s=CLOSED pgs=814 gs=2 cs=0 l=1 c_cookie=2895436117901581146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/2205276535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 0x55b6d1d44ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/2205276535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d038a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2205276535 >> 10.20.193.28:0/2205276535 conn(0x55b6d1c021c0 msgr2=0x55b6d1ce1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:35.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2205276535 shutdown_connections 2026-02-20T13:23:35.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.337+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2205276535 wait complete. 2026-02-20T13:23:35.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.338+0000 7ff4901c0e00 1 -- start start 2026-02-20T13:23:35.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.338+0000 7ff4901c0e00 1 Processor -- start 2026-02-20T13:23:35.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfcae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 0x55b6d1cfd130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 0x55b6d1cfdb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1cfe1f0 con 0x55b6d1ce34c0 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1cfe360 con 0x55b6d1d24700 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1cfe520 con 0x55b6d1d03de0 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44946/0 (socket says 10.20.193.28:44946) 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff4877fe640 1 -- 10.20.193.28:0/3333882997 learned_addr learned my addr 10.20.193.28:0/3333882997 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff487fff640 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 0x55b6d1cfdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.339+0000 7ff486ffd640 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 0x55b6d1cfd130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4877fe640 1 -- 10.20.193.28:0/3333882997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 msgr2=0x55b6d1cfd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4877fe640 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 0x55b6d1cfd130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4877fe640 1 -- 10.20.193.28:0/3333882997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 msgr2=0x55b6d1cfdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4877fe640 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 0x55b6d1cfdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4877fe640 1 -- 10.20.193.28:0/3333882997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1b9a400 con 0x55b6d1ce34c0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4877fe640 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfcae0 secure :-1 s=READY pgs=815 gs=1 cs=0 l=1 c_cookie=16188015621328715416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47400ffe0 tx=0x7ff474004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a7627097c5be98 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff450ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff450ff9640 1 -- 10.20.193.28:0/3333882997 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47401f650 con 0x55b6d1ce34c0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4780044e0 con 0x55b6d1ce34c0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4901c0e00 10 client.17622 _ll_register_callbacks cb 0x55b6d1b79a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6d188e520 con 0x55b6d1ce34c0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff450ff9640 1 -- 10.20.193.28:0/3333882997 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff474023070 con 0x55b6d1ce34c0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff450ff9640 1 -- 10.20.193.28:0/3333882997 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47401ecc0 con 0x55b6d1ce34c0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff450ff9640 1 -- 10.20.193.28:0/3333882997 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff47401ee50 con 0x55b6d1ce34c0 2026-02-20T13:23:35.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff450ff9640 1 -- 10.20.193.28:0/3333882997 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4740103d0 con 0x55b6d1ce34c0 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4901c0e00 10 client.17622 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b6d1b72da0 con 0x55b6d1ce34c0 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff450ff9640 1 -- 10.20.193.28:0/3333882997 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff47401e440 con 0x55b6d1ce34c0 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4901c0e00 10 client.17622 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4901c0e00 10 client.17622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.340+0000 7ff4901c0e00 20 client.17622 populate_metadata read hostname 'trial028' 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.341+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b6d1d01320 0x55b6d1d017c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.341+0000 7ff4901c0e00 4 client.17622 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.341+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6d1c20630 con 0x55b6d1d01320 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.341+0000 7ff486ffd640 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b6d1d01320 0x55b6d1d017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.341+0000 7ff486ffd640 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b6d1d01320 0x55b6d1d017c0 crc :-1 s=READY pgs=192 gs=4 cs=0 l=0 c_cookie=18183466131722070894 s_cookie=17077262238353454914 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc58a61b4ea3eb6e server_cookie=ecfe9f86cd3ff742 in_seq=0 out_seq=0 2026-02-20T13:23:35.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.341+0000 7ff450ff9640 10 client.17622 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff450ff9640 1 -- 10.20.193.28:0/3333882997 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b6d1c20630 con 0x55b6d1d01320 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff450ff9640 10 client.17622 handle_command_reply: tid=0 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 client.17622 shutdown 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1ce34c0 msgr2=0x55b6d1cfcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfcae0 secure :-1 s=READY pgs=815 gs=1 cs=0 l=1 c_cookie=16188015621328715416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47400ffe0 tx=0x7ff474004770 comp rx=0 tx=0).stop 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 shutdown_connections 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b6d1d01320 0x55b6d1d017c0 crc :-1 s=READY pgs=192 gs=4 cs=0 l=0 c_cookie=18183466131722070894 s_cookie=17077262238353454914 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d24700 0x55b6d1cfdb90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 0x55b6d1cfd130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/3333882997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfcae0 unknown :-1 s=CLOSED pgs=815 gs=1 cs=0 l=1 c_cookie=16188015621328715416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 >> 10.20.193.28:0/3333882997 conn(0x55b6d1c021c0 msgr2=0x55b6d1ce4790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff450ff9640 0 client.17622 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 shutdown_connections 2026-02-20T13:23:35.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 1 -- 10.20.193.28:0/3333882997 wait complete. 2026-02-20T13:23:35.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.342+0000 7ff4901c0e00 20 client.17622 trim_cache size 0 max 16384 2026-02-20T13:23:35.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.350+0000 7ff4901c0e00 1 Processor -- start 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.350+0000 7ff4901c0e00 1 -- start start 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.350+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfc950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.350+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d03de0 0x55b6d1cee970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.350+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d225c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.350+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1bec8d0 con 0x55b6d1d24700 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.350+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b6d192df10 con 0x55b6d1d03de0 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.350+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1cfeac0 con 0x55b6d1ce34c0 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff487fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff4877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfc950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff4877fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfc950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:59922/0 (socket says 10.20.193.28:59922) 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff4877fe640 1 -- 10.20.193.28:0/2806017314 learned_addr learned my addr 10.20.193.28:0/2806017314 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff486ffd640 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d03de0 0x55b6d1cee970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff487fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d225c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44956/0 (socket says 10.20.193.28:44956) 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff487fff640 1 -- 10.20.193.28:0/2806017314 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 msgr2=0x55b6d1cfc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff487fff640 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfc950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff487fff640 1 -- 10.20.193.28:0/2806017314 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d03de0 msgr2=0x55b6d1cee970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff487fff640 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d03de0 0x55b6d1cee970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff487fff640 1 -- 10.20.193.28:0/2806017314 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1cef140 con 0x55b6d1d24700 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff4877fe640 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfc950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff487fff640 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d225c0 secure :-1 s=READY pgs=816 gs=3 cs=0 l=1 c_cookie=11536845893647531601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c0cf4d0 tx=0x7ff47c10a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01b1c372748fe51 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff452ffd640 1 -- 10.20.193.28:0/2806017314 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47c042410 con 0x55b6d1d24700 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff452ffd640 1 -- 10.20.193.28:0/2806017314 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff47c0d3900 con 0x55b6d1d24700 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff452ffd640 1 -- 10.20.193.28:0/2806017314 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47c0f8040 con 0x55b6d1d24700 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2806017314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 msgr2=0x55b6d1d225c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.351+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d225c0 secure :-1 s=READY pgs=816 gs=3 cs=0 l=1 c_cookie=11536845893647531601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c0cf4d0 tx=0x7ff47c10a040 comp rx=0 tx=0).stop 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2806017314 shutdown_connections 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d225c0 unknown :-1 s=CLOSED pgs=816 gs=3 cs=0 l=1 c_cookie=11536845893647531601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1d03de0 0x55b6d1cee970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/2806017314 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1ce34c0 0x55b6d1cfc950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2806017314 >> 10.20.193.28:0/2806017314 conn(0x55b6d1c021c0 msgr2=0x55b6d1cf8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2806017314 shutdown_connections 2026-02-20T13:23:35.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 -- 10.20.193.28:0/2806017314 wait complete. 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 -- start start 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 Processor -- start 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d041b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 0x55b6d1d046f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d04d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1bec8d0 con 0x55b6d1d24700 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1d05420 con 0x55b6d1ce34c0 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.352+0000 7ff4901c0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1d055e0 con 0x55b6d1d03de0 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d04d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d04d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44968/0 (socket says 10.20.193.28:44968) 2026-02-20T13:23:35.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 -- 10.20.193.28:0/779527455 learned_addr learned my addr 10.20.193.28:0/779527455 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:35.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff486ffd640 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 0x55b6d1d046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff4877fe640 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 -- 10.20.193.28:0/779527455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 msgr2=0x55b6d1d046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:35.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 0x55b6d1d046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 -- 10.20.193.28:0/779527455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1ce34c0 msgr2=0x55b6d1d041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 -- 10.20.193.28:0/779527455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff488061e30 con 0x55b6d1d24700 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff487fff640 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d04d20 secure :-1 s=READY pgs=817 gs=1 cs=0 l=1 c_cookie=5646328109946246649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c0d2e90 tx=0x7ff47c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5bc9801ea615f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff450ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff450ff9640 1 -- 10.20.193.28:0/779527455 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47c0f8260 con 0x55b6d1d24700 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff450ff9640 1 -- 10.20.193.28:0/779527455 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff47c042410 con 0x55b6d1d24700 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff450ff9640 1 -- 10.20.193.28:0/779527455 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47c0d3e60 con 0x55b6d1d24700 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.353+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d1b72da0 con 0x55b6d1d24700 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 10 client.17628 _ll_register_callbacks cb 0x55b6d1b79a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:35.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6d1c9eca0 con 0x55b6d1d24700 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff450ff9640 1 -- 10.20.193.28:0/779527455 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff47c0db200 con 0x55b6d1d24700 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff450ff9640 1 -- 10.20.193.28:0/779527455 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff47c0dde40 con 0x55b6d1d24700 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 10 client.17628 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b6d1b84670 con 0x55b6d1d24700 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff450ff9640 1 -- 10.20.193.28:0/779527455 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff47c098090 con 0x55b6d1d24700 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 10 client.17628 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 10 client.17628 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 20 client.17628 populate_metadata read hostname 'trial028' 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b6d1d07130 0x55b6d1d075d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 4 client.17628 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b6d18d2640 con 0x55b6d1d07130 2026-02-20T13:23:35.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.354+0000 7ff4877fe640 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b6d1d07130 0x55b6d1d075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.355+0000 7ff4877fe640 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b6d1d07130 0x55b6d1d075d0 crc :-1 s=READY pgs=193 gs=4 cs=0 l=0 c_cookie=17559596034930378863 s_cookie=7460828303703340179 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3b0378f1d62086f server_cookie=678a2fd0246af493 in_seq=0 out_seq=0 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.355+0000 7ff450ff9640 10 client.17628 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.359+0000 7ff450ff9640 1 -- 10.20.193.28:0/779527455 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b6d18d2640 con 0x55b6d1d07130 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.359+0000 7ff450ff9640 10 client.17628 handle_command_reply: tid=0 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.359+0000 7ff4901c0e00 1 client.17628 shutdown 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.359+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 msgr2=0x55b6d1d04d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.359+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d04d20 secure :-1 s=READY pgs=817 gs=1 cs=0 l=1 c_cookie=5646328109946246649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c0d2e90 tx=0x7ff47c005710 comp rx=0 tx=0).stop 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 shutdown_connections 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b6d1d07130 0x55b6d1d075d0 crc :-1 s=READY pgs=193 gs=4 cs=0 l=0 c_cookie=17559596034930378863 s_cookie=7460828303703340179 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6d1d24700 0x55b6d1d04d20 unknown :-1 s=CLOSED pgs=817 gs=1 cs=0 l=1 c_cookie=5646328109946246649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b6d1d03de0 0x55b6d1d046f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 1 --2- 10.20.193.28:0/779527455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b6d1ce34c0 0x55b6d1d041b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff450ff9640 0 client.17628 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:35.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 >> 10.20.193.28:0/779527455 conn(0x55b6d1c021c0 msgr2=0x55b6d1cf8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:35.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 shutdown_connections 2026-02-20T13:23:35.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 1 -- 10.20.193.28:0/779527455 wait complete. 2026-02-20T13:23:35.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff4901c0e00 20 client.17628 trim_cache size 0 max 16384 2026-02-20T13:23:35.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:23:35.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:23:35.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:23:35.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:23:35.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 -- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff45c0b5760 msgr2=0x7ff45c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff45c0b5760 0x7ff45c0d5c10 secure :-1 s=READY pgs=399 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff474004740 tx=0x7ff474004340 comp rx=0 tx=0).stop 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 -- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810e270 msgr2=0x7ff488060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810e270 0x7ff488060fb0 secure :-1 s=READY pgs=813 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c00a330 tx=0x7ff47c0039b0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 -- 10.20.193.28:0/1348130044 shutdown_connections 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff45c0b5760 0x7ff45c0d5c10 unknown :-1 s=CLOSED pgs=399 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff48810e270 0x7ff488060fb0 unknown :-1 s=CLOSED pgs=813 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff48810d4b0 0x7ff48816f240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 --2- 10.20.193.28:0/1348130044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff48810cb00 0x7ff4880626a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 -- 10.20.193.28:0/1348130044 >> 10.20.193.28:0/1348130044 conn(0x7ff4880ea4c0 msgr2=0x7ff4880ed4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 -- 10.20.193.28:0/1348130044 shutdown_connections 2026-02-20T13:23:35.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:35.360+0000 7ff48c94b640 1 -- 10.20.193.28:0/1348130044 wait complete. 2026-02-20T13:23:36.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:36 trial028 ceph-mon[37442]: pgmap v369: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:23:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:36 trial127 ceph-mon[43817]: pgmap v369: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:23:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:36 trial034 ceph-mon[43332]: pgmap v369: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:23:37.649 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:23:37.842 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:38.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.019+0000 7f9a055df640 1 -- 10.20.193.28:0/2435362705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a0010f4b0 msgr2=0x7f9a0010f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.019+0000 7f9a055df640 1 --2- 10.20.193.28:0/2435362705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a0010f4b0 0x7f9a0010f880 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=982669352859834328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99ec009950 tx=0x7f99ec02f190 comp rx=0 tx=0).stop 2026-02-20T13:23:38.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.020+0000 7f9a055df640 1 -- 10.20.193.28:0/2435362705 shutdown_connections 2026-02-20T13:23:38.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.020+0000 7f9a055df640 1 --2- 10.20.193.28:0/2435362705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a001156a0 0x7f9a00176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.020+0000 7f9a055df640 1 --2- 10.20.193.28:0/2435362705 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a0010fea0 0x7f9a00114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.020+0000 7f9a055df640 1 --2- 10.20.193.28:0/2435362705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a0010f4b0 0x7f9a0010f880 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=982669352859834328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.020+0000 7f9a055df640 1 -- 10.20.193.28:0/2435362705 >> 10.20.193.28:0/2435362705 conn(0x7f9a000ecda0 msgr2=0x7f9a0010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:38.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.020+0000 7f9a055df640 1 -- 10.20.193.28:0/2435362705 shutdown_connections 2026-02-20T13:23:38.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.020+0000 7f9a055df640 1 -- 10.20.193.28:0/2435362705 wait complete. 2026-02-20T13:23:38.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.020+0000 7f9a055df640 1 Processor -- start 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a055df640 1 -- start start 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a055df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a0010f4b0 0x7f9a0011ddf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a055df640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a0010fea0 0x7f9a0011e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a055df640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a001156a0 0x7f9a00123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a055df640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00123d20 con 0x7f9a0010f4b0 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a055df640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00123e90 con 0x7f9a0010fea0 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a055df640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00124050 con 0x7f9a001156a0 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a04dde640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a001156a0 0x7f9a00123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a04dde640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a001156a0 0x7f9a00123700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:59960/0 (socket says 10.20.193.28:59960) 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a04dde640 1 -- 10.20.193.28:0/1803157678 learned_addr learned my addr 10.20.193.28:0/1803157678 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f99fffff640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a0010f4b0 0x7f9a0011ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a04dde640 1 -- 10.20.193.28:0/1803157678 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a0010fea0 msgr2=0x7f9a0011e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a04dde640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a0010fea0 0x7f9a0011e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a04dde640 1 -- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a0010f4b0 msgr2=0x7f9a0011ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a04dde640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a0010f4b0 0x7f9a0011ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.021+0000 7f9a04dde640 1 -- 10.20.193.28:0/1803157678 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f400a590 con 0x7f9a001156a0 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.022+0000 7f99fffff640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a0010f4b0 0x7f9a0011ddf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.022+0000 7f9a04dde640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a001156a0 0x7f9a00123700 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99f4005790 tx=0x7f99f4003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.022+0000 7f99fd7fa640 1 -- 10.20.193.28:0/1803157678 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99f400fd60 con 0x7f9a001156a0 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.022+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ec009570 con 0x7f9a001156a0 2026-02-20T13:23:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.022+0000 7f99fd7fa640 1 -- 10.20.193.28:0/1803157678 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f99f4003e80 con 0x7f9a001156a0 2026-02-20T13:23:38.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.022+0000 7f99fd7fa640 1 -- 10.20.193.28:0/1803157678 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99f4019a20 con 0x7f9a001156a0 2026-02-20T13:23:38.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.022+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a00164890 con 0x7f9a001156a0 2026-02-20T13:23:38.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.023+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c4005300 con 0x7f9a001156a0 2026-02-20T13:23:38.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.025+0000 7f99fd7fa640 1 -- 10.20.193.28:0/1803157678 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f99f4017020 con 0x7f9a001156a0 2026-02-20T13:23:38.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.027+0000 7f99fd7fa640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f99d40b56e0 0x7f99d40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.027+0000 7f99fd7fa640 1 -- 10.20.193.28:0/1803157678 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f99f40e7f60 con 0x7f9a001156a0 2026-02-20T13:23:38.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.027+0000 7f99fd7fa640 1 -- 10.20.193.28:0/1803157678 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f99f40e83e0 con 0x7f9a001156a0 2026-02-20T13:23:38.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.027+0000 7f99fffff640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f99d40b56e0 0x7f99d40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.028+0000 7f99fffff640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f99d40b56e0 0x7f99d40d5b90 secure :-1 s=READY pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99ec0023d0 tx=0x7f99ec031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:38.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.167+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99c4005950 con 0x7f9a001156a0 2026-02-20T13:23:38.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.168+0000 7f99fd7fa640 1 -- 10.20.193.28:0/1803157678 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f99f40aa9a0 con 0x7f9a001156a0 2026-02-20T13:23:38.171 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:23:38.171 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:23:38.172 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:23:38.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f99d40b56e0 msgr2=0x7f99d40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f99d40b56e0 0x7f99d40d5b90 secure :-1 s=READY pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99ec0023d0 tx=0x7f99ec031040 comp rx=0 tx=0).stop 2026-02-20T13:23:38.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a001156a0 msgr2=0x7f9a00123700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a001156a0 0x7f9a00123700 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99f4005790 tx=0x7f99f4003c20 comp rx=0 tx=0).stop 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 shutdown_connections 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f99d40b56e0 0x7f99d40d5b90 unknown :-1 s=CLOSED pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a001156a0 0x7f9a00123700 unknown :-1 s=CLOSED pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a0010fea0 0x7f9a0011e330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 --2- 10.20.193.28:0/1803157678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a0010f4b0 0x7f9a0011ddf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 >> 10.20.193.28:0/1803157678 conn(0x7f9a000ecda0 msgr2=0x7f9a0010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 shutdown_connections 2026-02-20T13:23:38.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.169+0000 7f9a055df640 1 -- 10.20.193.28:0/1803157678 wait complete. 2026-02-20T13:23:38.277 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id 2ff5bc11 --release --await' 2026-02-20T13:23:38.277 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id 2ff5bc11 --release --await 2026-02-20T13:23:38.462 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 -- 10.20.193.28:0/2522282932 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ad41156a0 msgr2=0x7f0ad4176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/2522282932 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ad41156a0 0x7f0ad4176070 secure :-1 s=READY pgs=307 gs=2 cs=0 l=1 c_cookie=15740740572814320251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ad000aa30 tx=0x7f0ad0030290 comp rx=0 tx=0).stop 2026-02-20T13:23:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 -- 10.20.193.28:0/2522282932 shutdown_connections 2026-02-20T13:23:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/2522282932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ad410fea0 0x7f0ad4114ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/2522282932 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ad41156a0 0x7f0ad4176070 unknown :-1 s=CLOSED pgs=307 gs=2 cs=0 l=1 c_cookie=15740740572814320251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/2522282932 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410f4b0 0x7f0ad410f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 -- 10.20.193.28:0/2522282932 >> 10.20.193.28:0/2522282932 conn(0x7f0ad40ecda0 msgr2=0x7f0ad410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 -- 10.20.193.28:0/2522282932 shutdown_connections 2026-02-20T13:23:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.659+0000 7f0adaf3f640 1 -- 10.20.193.28:0/2522282932 wait complete. 2026-02-20T13:23:38.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0adaf3f640 1 Processor -- start 2026-02-20T13:23:38.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0adaf3f640 1 -- start start 2026-02-20T13:23:38.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0adaf3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ad410f4b0 0x7f0ad40f9c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0adaf3f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410fea0 0x7f0ad4175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0adaf3f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ad41156a0 0x7f0ad40fa320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0adaf3f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40ff530 con 0x7f0ad410f4b0 2026-02-20T13:23:38.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0adaf3f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40ff6a0 con 0x7f0ad41156a0 2026-02-20T13:23:38.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0adaf3f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40ff860 con 0x7f0ad410fea0 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ad410f4b0 0x7f0ad40f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ad410f4b0 0x7f0ad40f9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44998/0 (socket says 10.20.193.28:44998) 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/699722986 learned_addr learned my addr 10.20.193.28:0/699722986 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0ad973c640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410fea0 0x7f0ad4175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.660+0000 7f0ada73e640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ad41156a0 0x7f0ad40fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/699722986 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410fea0 msgr2=0x7f0ad4175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410fea0 0x7f0ad4175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/699722986 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ad41156a0 msgr2=0x7f0ad40fa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ad41156a0 0x7f0ad40fa320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/699722986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad000a650 con 0x7f0ad410f4b0 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ad410f4b0 0x7f0ad40f9c20 secure :-1 s=READY pgs=818 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac400d950 tx=0x7f0ac400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:38.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ac2ffd640 1 -- 10.20.193.28:0/699722986 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac4004540 con 0x7f0ad410f4b0 2026-02-20T13:23:38.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0adaf3f640 1 -- 10.20.193.28:0/699722986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad40ffb40 con 0x7f0ad410f4b0 2026-02-20T13:23:38.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ac2ffd640 1 -- 10.20.193.28:0/699722986 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ac4009d00 con 0x7f0ad410f4b0 2026-02-20T13:23:38.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0ac2ffd640 1 -- 10.20.193.28:0/699722986 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac40106e0 con 0x7f0ad410f4b0 2026-02-20T13:23:38.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.661+0000 7f0adaf3f640 1 -- 10.20.193.28:0/699722986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad4100060 con 0x7f0ad410f4b0 2026-02-20T13:23:38.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.664+0000 7f0ac2ffd640 1 -- 10.20.193.28:0/699722986 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0ac40027c0 con 0x7f0ad410f4b0 2026-02-20T13:23:38.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.666+0000 7f0ac2ffd640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ab00b5750 0x7f0ab00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.666+0000 7f0ac2ffd640 1 -- 10.20.193.28:0/699722986 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0ac40e6d00 con 0x7f0ad410f4b0 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.666+0000 7f0ad973c640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ab00b5750 0x7f0ab00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.666+0000 7f0ade1c2e00 1 Processor -- start 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad973c640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ab00b5750 0x7f0ab00d5c00 secure :-1 s=READY pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ad41005c0 tx=0x7f0ac8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ade1c2e00 1 -- start start 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60b58f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60b5e30 0x5606a60fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60faad0 0x5606a611aeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5606a5fcac70 con 0x5606a60b5520 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5606a5fc69a0 con 0x5606a60faad0 2026-02-20T13:23:38.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5606a5fc0b00 con 0x5606a60b5e30 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45002/0 (socket says 10.20.193.28:45002) 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/2171633470 learned_addr learned my addr 10.20.193.28:0/2171633470 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad973c640 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60b5e30 0x5606a60fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ada73e640 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60faad0 0x5606a611aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/2171633470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60b5e30 msgr2=0x5606a60fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60b5e30 0x5606a60fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/2171633470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60faad0 msgr2=0x5606a611aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60faad0 0x5606a611aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/2171633470 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a5f6bf80 con 0x5606a60b5520 2026-02-20T13:23:38.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.667+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60b58f0 secure :-1 s=READY pgs=819 gs=1 cs=0 l=1 c_cookie=17530186340497314024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40ad2d0 tx=0x7f0ac4002bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f347bb9907bf50e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0aa24e6640 1 -- 10.20.193.28:0/2171633470 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac40aca40 con 0x5606a60b5520 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0aa24e6640 1 -- 10.20.193.28:0/2171633470 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ac40ac860 con 0x5606a60b5520 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0aa24e6640 1 -- 10.20.193.28:0/2171633470 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac40b7d10 con 0x5606a60b5520 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/2171633470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 msgr2=0x5606a60b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60b58f0 secure :-1 s=READY pgs=819 gs=1 cs=0 l=1 c_cookie=17530186340497314024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40ad2d0 tx=0x7f0ac4002bf0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/2171633470 shutdown_connections 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60faad0 0x5606a611aeb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60b5e30 0x5606a60fa590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/2171633470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60b58f0 unknown :-1 s=CLOSED pgs=819 gs=1 cs=0 l=1 c_cookie=17530186340497314024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/2171633470 >> 10.20.193.28:0/2171633470 conn(0x5606a5fd3a60 msgr2=0x5606a60b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:38.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/2171633470 shutdown_connections 2026-02-20T13:23:38.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.668+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/2171633470 wait complete. 2026-02-20T13:23:38.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.669+0000 7f0ade1c2e00 1 -- start start 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.669+0000 7f0ade1c2e00 1 Processor -- start 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5520 0x5606a60cd680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5e30 0x5606a60cdbc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60faad0 0x5606a60d2bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5606a60d30f0 con 0x5606a60b5e30 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5606a60d3260 con 0x5606a60b5520 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5606a60d3420 con 0x5606a60faad0 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5520 0x5606a60cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad973c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5e30 0x5606a60cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5520 0x5606a60cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59244/0 (socket says 10.20.193.28:59244) 2026-02-20T13:23:38.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/3268581915 learned_addr learned my addr 10.20.193.28:0/3268581915 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ada73e640 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60faad0 0x5606a60d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/3268581915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60faad0 msgr2=0x5606a60d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60faad0 0x5606a60d2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/3268581915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5e30 msgr2=0x5606a60cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5e30 0x5606a60cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/3268581915 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a5f44710 con 0x5606a60b5520 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.670+0000 7f0ad973c640 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5e30 0x5606a60cdbc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5520 0x5606a60cd680 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=6254168423683078003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40a9820 tx=0x7f0ac40a9500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56cb450b9b183773 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0a8f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/3268581915 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac40b7f30 con 0x5606a60b5520 2026-02-20T13:23:38.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/3268581915 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ac40099d0 con 0x5606a60b5520 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/3268581915 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac40adf30 con 0x5606a60b5520 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad4100060 con 0x5606a60b5520 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0ade1c2e00 10 client.27605 _ll_register_callbacks cb 0x5606a5f41d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606a5c56ba0 con 0x5606a60b5520 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/3268581915 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0ac4096040 con 0x5606a60b5520 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/3268581915 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0ac40b2d80 con 0x5606a60b5520 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0ade1c2e00 10 client.27605 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.671+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5606a5f56350 con 0x5606a60b5520 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.672+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/3268581915 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0ac40d0d20 con 0x5606a60b5520 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.672+0000 7f0ade1c2e00 10 client.27605 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.672+0000 7f0ade1c2e00 10 client.27605 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:23:38.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.672+0000 7f0ade1c2e00 20 client.27605 populate_metadata read hostname 'trial028' 2026-02-20T13:23:38.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.672+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5606a60f7af0 0x5606a60f7f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.672+0000 7f0ade1c2e00 4 client.27605 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:38.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.672+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606a5f93410 con 0x5606a60f7af0 2026-02-20T13:23:38.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.672+0000 7f0ad973c640 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5606a60f7af0 0x5606a60f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ad973c640 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5606a60f7af0 0x5606a60f7f90 crc :-1 s=READY pgs=194 gs=4 cs=0 l=0 c_cookie=7093147453916150845 s_cookie=16487646474609572409 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=626fec073a237c3d server_cookie=e4cfe31d05533a39 in_seq=0 out_seq=0 2026-02-20T13:23:38.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0a8f7fe640 10 client.27605 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:38.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/3268581915 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5606a5f93410 con 0x5606a60f7af0 2026-02-20T13:23:38.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0a8f7fe640 10 client.27605 handle_command_reply: tid=0 2026-02-20T13:23:38.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 client.27605 shutdown 2026-02-20T13:23:38.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5520 msgr2=0x5606a60cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5520 0x5606a60cd680 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=6254168423683078003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40a9820 tx=0x7f0ac40a9500 comp rx=0 tx=0).stop 2026-02-20T13:23:38.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 shutdown_connections 2026-02-20T13:23:38.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5606a60f7af0 0x5606a60f7f90 crc :-1 s=READY pgs=194 gs=4 cs=0 l=0 c_cookie=7093147453916150845 s_cookie=16487646474609572409 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5e30 0x5606a60cdbc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0a8f7fe640 0 client.27605 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:38.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a60faad0 0x5606a60d2bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/3268581915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5520 0x5606a60cd680 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=6254168423683078003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.673+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 >> 10.20.193.28:0/3268581915 conn(0x5606a5fd3a60 msgr2=0x5606a60b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:38.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.674+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 shutdown_connections 2026-02-20T13:23:38.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.674+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/3268581915 wait complete. 2026-02-20T13:23:38.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.674+0000 7f0ade1c2e00 20 client.27605 trim_cache size 0 max 16384 2026-02-20T13:23:38.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.683+0000 7f0ade1c2e00 1 Processor -- start 2026-02-20T13:23:38.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.683+0000 7f0ade1c2e00 1 -- start start 2026-02-20T13:23:38.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.683+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60f9880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.683+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60f9dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.683+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60fa300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.683+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5606a5fbe730 con 0x5606a60b5520 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.683+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5606a5c7e960 con 0x5606a60b5e30 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.683+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5606a607e8c0 con 0x5606a5fd3a60 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60f9880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60006/0 (socket says 10.20.193.28:60006) 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/4160040562 learned_addr learned my addr 10.20.193.28:0/4160040562 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad973c640 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ada73e640 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/4160040562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 msgr2=0x5606a60fa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:38.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60fa300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/4160040562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 msgr2=0x5606a60f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 -- 10.20.193.28:0/4160040562 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a60bff90 con 0x5606a5fd3a60 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ada73e640 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60fa300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad973c640 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60f9dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60f9880 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=10587274994601615044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40ad040 tx=0x7f0ac4072000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92ed8e83889adec4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0aa1ce5640 1 -- 10.20.193.28:0/4160040562 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac40099d0 con 0x5606a5fd3a60 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0aa1ce5640 1 -- 10.20.193.28:0/4160040562 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5606a5c56ba0 con 0x5606a5fd3a60 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.684+0000 7f0aa1ce5640 1 -- 10.20.193.28:0/4160040562 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac40b81a0 con 0x5606a5fd3a60 2026-02-20T13:23:38.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/4160040562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 msgr2=0x5606a60f9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60f9880 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=10587274994601615044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40ad040 tx=0x7f0ac4072000 comp rx=0 tx=0).stop 2026-02-20T13:23:38.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/4160040562 shutdown_connections 2026-02-20T13:23:38.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60f9dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60fa300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/4160040562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60f9880 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=10587274994601615044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/4160040562 >> 10.20.193.28:0/4160040562 conn(0x5606a60cb1d0 msgr2=0x5606a60d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/4160040562 shutdown_connections 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.685+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/4160040562 wait complete. 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ade1c2e00 1 -- start start 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ade1c2e00 1 Processor -- start 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60d6480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60d69c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ade1c2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60d6f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5606a615fff0 con 0x5606a60b5520 2026-02-20T13:23:38.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5606a6160160 con 0x5606a60b5e30 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ade1c2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5606a6160320 con 0x5606a5fd3a60 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ad973c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60d69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ada73e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60d6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ad9f3d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.686+0000 7f0ada73e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60d6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59260/0 (socket says 10.20.193.28:59260) 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ada73e640 1 -- 10.20.193.28:0/1992008280 learned_addr learned my addr 10.20.193.28:0/1992008280 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ad973c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60d69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45028/0 (socket says 10.20.193.28:45028) 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ad973c640 1 -- 10.20.193.28:0/1992008280 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 msgr2=0x5606a60d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ad973c640 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60d6480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ad973c640 1 -- 10.20.193.28:0/1992008280 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 msgr2=0x5606a60d6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ad973c640 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60d6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ad973c640 1 -- 10.20.193.28:0/1992008280 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a5f56350 con 0x5606a60b5520 2026-02-20T13:23:38.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60d6480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ad973c640 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60d69c0 secure :-1 s=READY pgs=820 gs=2 cs=0 l=1 c_cookie=12974170386488976037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5606a60f8810 tx=0x7f0ac80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40d8339f61162a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0a8f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/1992008280 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac8021040 con 0x5606a60b5520 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/1992008280 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ac8022040 con 0x5606a60b5520 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/1992008280 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac801b3f0 con 0x5606a60b5520 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac802b5e0 con 0x5606a60b5520 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/1992008280 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0ac802b990 con 0x5606a60b5520 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ade1c2e00 10 client.17652 _ll_register_callbacks cb 0x5606a5f41d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606a5d18700 con 0x5606a60b5520 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/1992008280 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0ac802bb90 con 0x5606a60b5520 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ade1c2e00 10 client.17652 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:38.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.687+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5606a5f50dd0 con 0x5606a60b5520 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/1992008280 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0ac8011650 con 0x5606a60b5520 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0ade1c2e00 10 client.17652 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0ade1c2e00 10 client.17652 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0ade1c2e00 20 client.17652 populate_metadata read hostname 'trial028' 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5606a60f7af0 0x5606a61c8380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0ade1c2e00 4 client.17652 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2ff5bc11", "release": true, "await": true}] 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2ff5bc11", "release": true, "await": true}) -- 0x7f0ac40ac860 con 0x5606a60f7af0 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5606a60f7af0 0x5606a61c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0ad9f3d640 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5606a60f7af0 0x5606a61c8380 crc :-1 s=READY pgs=195 gs=4 cs=0 l=0 c_cookie=1776253743266939841 s_cookie=11196079269751854450 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18a6855e566243c1 server_cookie=9b6076c6c6ac9572 in_seq=0 out_seq=0 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.688+0000 7f0a8f7fe640 10 client.17652 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0a8f7fe640 1 -- 10.20.193.28:0/1992008280 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f0ac40ac860 con 0x5606a60f7af0 2026-02-20T13:23:38.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0a8f7fe640 10 client.17652 handle_command_reply: tid=0 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 client.17652 shutdown 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 msgr2=0x5606a60d69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60d69c0 secure :-1 s=READY pgs=820 gs=2 cs=0 l=1 c_cookie=12974170386488976037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5606a60f8810 tx=0x7f0ac80047e0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 shutdown_connections 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5606a60f7af0 0x5606a61c8380 crc :-1 s=READY pgs=195 gs=4 cs=0 l=0 c_cookie=1776253743266939841 s_cookie=11196079269751854450 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5606a60b5520 0x5606a60d69c0 unknown :-1 s=CLOSED pgs=820 gs=2 cs=0 l=1 c_cookie=12974170386488976037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5606a60b5e30 0x5606a60d6f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 --2- 10.20.193.28:0/1992008280 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5606a5fd3a60 0x5606a60d6480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0a8f7fe640 0 client.17652 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 >> 10.20.193.28:0/1992008280 conn(0x5606a60cb1d0 msgr2=0x5606a60d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 shutdown_connections 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.690+0000 7f0ade1c2e00 1 -- 10.20.193.28:0/1992008280 wait complete. 2026-02-20T13:23:38.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0ade1c2e00 20 client.17652 trim_cache size 0 max 16384 2026-02-20T13:23:38.699 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:38.699 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:23:38.699 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:23:38.699 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 20, 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "2ff5bc11": { 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "version": 20, 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 143.2, 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:23:38.700 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:38.701 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:38.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 -- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ab00b5750 msgr2=0x7f0ab00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ab00b5750 0x7f0ab00d5c00 secure :-1 s=READY pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ad41005c0 tx=0x7f0ac8005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:38.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 -- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ad410f4b0 msgr2=0x7f0ad40f9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:38.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ad410f4b0 0x7f0ad40f9c20 secure :-1 s=READY pgs=818 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac400d950 tx=0x7f0ac400de20 comp rx=0 tx=0).stop 2026-02-20T13:23:38.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 -- 10.20.193.28:0/699722986 shutdown_connections 2026-02-20T13:23:38.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ab00b5750 0x7f0ab00d5c00 unknown :-1 s=CLOSED pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ad41156a0 0x7f0ad40fa320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410fea0 0x7f0ad4175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 --2- 10.20.193.28:0/699722986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ad410f4b0 0x7f0ad40f9c20 unknown :-1 s=CLOSED pgs=818 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:38.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 -- 10.20.193.28:0/699722986 >> 10.20.193.28:0/699722986 conn(0x7f0ad40ecda0 msgr2=0x7f0ad410d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:38.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 -- 10.20.193.28:0/699722986 shutdown_connections 2026-02-20T13:23:38.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:38.691+0000 7f0adaf3f640 1 -- 10.20.193.28:0/699722986 wait complete. 2026-02-20T13:23:38.748 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:38 trial028 ceph-mon[37442]: pgmap v370: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2026-02-20T13:23:38.748 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:23:38.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:38 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1803157678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:38.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:23:38.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:23:38.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:23:38.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:23:38.790 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2ff5bc11', total seconds elapsed: 24.4 2026-02-20T13:23:38.790 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.25 2026-02-20T13:23:38.791 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:23:38.975 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:38 trial127 ceph-mon[43817]: pgmap v370: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2026-02-20T13:23:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:23:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:38 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1803157678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:23:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:23:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:23:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:23:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:38 trial034 ceph-mon[43332]: pgmap v370: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2026-02-20T13:23:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:23:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:38 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1803157678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:23:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:23:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:23:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:23:39.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 -- 10.20.193.28:0/3351190795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010b6a0 msgr2=0x7f386010bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 --2- 10.20.193.28:0/3351190795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010b6a0 0x7f386010bab0 secure :-1 s=READY pgs=821 gs=2 cs=0 l=1 c_cookie=2629391147349978404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3854009950 tx=0x7f385402f220 comp rx=0 tx=0).stop 2026-02-20T13:23:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 -- 10.20.193.28:0/3351190795 shutdown_connections 2026-02-20T13:23:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 --2- 10.20.193.28:0/3351190795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010b6a0 0x7f386010bab0 unknown :-1 s=CLOSED pgs=821 gs=2 cs=0 l=1 c_cookie=2629391147349978404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 --2- 10.20.193.28:0/3351190795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f386010c100 0x7f3860175ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 --2- 10.20.193.28:0/3351190795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f386010dfb0 0x7f386010e380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 -- 10.20.193.28:0/3351190795 >> 10.20.193.28:0/3351190795 conn(0x7f38600e9360 msgr2=0x7f3860109770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 -- 10.20.193.28:0/3351190795 shutdown_connections 2026-02-20T13:23:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.149+0000 7f3867741640 1 -- 10.20.193.28:0/3351190795 wait complete. 2026-02-20T13:23:39.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3867741640 1 Processor -- start 2026-02-20T13:23:39.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3867741640 1 -- start start 2026-02-20T13:23:39.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3867741640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f386010b6a0 0x7f38600f4c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3867741640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f386010c100 0x7f38600f51b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3867741640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010dfb0 0x7f38600fa580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3867741640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38600faba0 con 0x7f386010dfb0 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3867741640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f38600fad10 con 0x7f386010b6a0 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3867741640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f38600faed0 con 0x7f386010c100 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f38654b6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f386010b6a0 0x7f38600f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f38654b6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f386010b6a0 0x7f38600f4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59286/0 (socket says 10.20.193.28:59286) 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f38654b6640 1 -- 10.20.193.28:0/2418471568 learned_addr learned my addr 10.20.193.28:0/2418471568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3865cb7640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010dfb0 0x7f38600fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.150+0000 7f3864cb5640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f386010c100 0x7f38600f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f38654b6640 1 -- 10.20.193.28:0/2418471568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f386010c100 msgr2=0x7f38600f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f38654b6640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f386010c100 0x7f38600f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f38654b6640 1 -- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010dfb0 msgr2=0x7f38600fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f38654b6640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010dfb0 0x7f38600fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f38654b6640 1 -- 10.20.193.28:0/2418471568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3854009570 con 0x7f386010b6a0 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f3865cb7640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010dfb0 0x7f38600fa580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f38654b6640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f386010b6a0 0x7f38600f4c70 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f385000d950 tx=0x7f385000de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f384e7fc640 1 -- 10.20.193.28:0/2418471568 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3850004540 con 0x7f386010b6a0 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f3867741640 1 -- 10.20.193.28:0/2418471568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38600fb1b0 con 0x7f386010b6a0 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f384e7fc640 1 -- 10.20.193.28:0/2418471568 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3850009d00 con 0x7f386010b6a0 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f384e7fc640 1 -- 10.20.193.28:0/2418471568 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38500106e0 con 0x7f386010b6a0 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.151+0000 7f3867741640 1 -- 10.20.193.28:0/2418471568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3860173160 con 0x7f386010b6a0 2026-02-20T13:23:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.152+0000 7f382ffff640 1 -- 10.20.193.28:0/2418471568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386010c6b0 con 0x7f386010b6a0 2026-02-20T13:23:39.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.153+0000 7f384e7fc640 1 -- 10.20.193.28:0/2418471568 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f38500097c0 con 0x7f386010b6a0 2026-02-20T13:23:39.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.155+0000 7f384e7fc640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f383c0b5760 0x7f383c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.155+0000 7f384e7fc640 1 -- 10.20.193.28:0/2418471568 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f38500e6ca0 con 0x7f386010b6a0 2026-02-20T13:23:39.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.155+0000 7f3864cb5640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f383c0b5760 0x7f383c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.156+0000 7f3864cb5640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f383c0b5760 0x7f383c0d5c10 secure :-1 s=READY pgs=402 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38600fb610 tx=0x7f385403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:39.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.156+0000 7f384e7fc640 1 -- 10.20.193.28:0/2418471568 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f38500a9650 con 0x7f386010b6a0 2026-02-20T13:23:39.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.296+0000 7f382ffff640 1 -- 10.20.193.28:0/2418471568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38600f5dd0 con 0x7f386010b6a0 2026-02-20T13:23:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.297+0000 7f384e7fc640 1 -- 10.20.193.28:0/2418471568 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f38500ac800 con 0x7f386010b6a0 2026-02-20T13:23:39.300 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:23:39.300 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:23:39.301 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 -- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f383c0b5760 msgr2=0x7f383c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f383c0b5760 0x7f383c0d5c10 secure :-1 s=READY pgs=402 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38600fb610 tx=0x7f385403a040 comp rx=0 tx=0).stop 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 -- 10.20.193.28:0/2418471568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f386010b6a0 msgr2=0x7f38600f4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f386010b6a0 0x7f38600f4c70 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f385000d950 tx=0x7f385000de20 comp rx=0 tx=0).stop 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 -- 10.20.193.28:0/2418471568 shutdown_connections 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f383c0b5760 0x7f383c0d5c10 unknown :-1 s=CLOSED pgs=402 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f386010dfb0 0x7f38600fa580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f386010c100 0x7f38600f51b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 --2- 10.20.193.28:0/2418471568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f386010b6a0 0x7f38600f4c70 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 -- 10.20.193.28:0/2418471568 >> 10.20.193.28:0/2418471568 conn(0x7f38600e9360 msgr2=0x7f38600eb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.298+0000 7f382ffff640 1 -- 10.20.193.28:0/2418471568 shutdown_connections 2026-02-20T13:23:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.299+0000 7f382ffff640 1 -- 10.20.193.28:0/2418471568 wait complete. 2026-02-20T13:23:39.438 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 143.25 --await-for 45.0' 2026-02-20T13:23:39.439 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 143.25 --await-for 45.0 2026-02-20T13:23:39.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:39 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2418471568' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:39.626 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:39.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.815+0000 7f920c0dc640 1 -- 10.20.193.28:0/655735493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410f230 msgr2=0x7f920410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.815+0000 7f920c0dc640 1 --2- 10.20.193.28:0/655735493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410f230 0x7f920410f600 secure :-1 s=READY pgs=822 gs=3 cs=0 l=1 c_cookie=9115655870866343730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f4009890 tx=0x7f91f402f0e0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.815+0000 7f920c0dc640 1 -- 10.20.193.28:0/655735493 shutdown_connections 2026-02-20T13:23:39.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.815+0000 7f920c0dc640 1 --2- 10.20.193.28:0/655735493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9204115420 0x7f9204175df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.815+0000 7f920c0dc640 1 --2- 10.20.193.28:0/655735493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f920410fc20 0x7f9204114c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.815+0000 7f920c0dc640 1 --2- 10.20.193.28:0/655735493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410f230 0x7f920410f600 unknown :-1 s=CLOSED pgs=822 gs=3 cs=0 l=1 c_cookie=9115655870866343730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.815+0000 7f920c0dc640 1 -- 10.20.193.28:0/655735493 >> 10.20.193.28:0/655735493 conn(0x7f920405f830 msgr2=0x7f920410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:39.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.816+0000 7f920c0dc640 1 -- 10.20.193.28:0/655735493 shutdown_connections 2026-02-20T13:23:39.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.816+0000 7f920c0dc640 1 -- 10.20.193.28:0/655735493 wait complete. 2026-02-20T13:23:39.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.816+0000 7f920c0dc640 1 Processor -- start 2026-02-20T13:23:39.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.816+0000 7f920c0dc640 1 -- start start 2026-02-20T13:23:39.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f920c0dc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f920410f230 0x7f920411db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f920c0dc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410fc20 0x7f920411e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f920c0dc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9204115420 0x7f9204123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f920c0dc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9204123a60 con 0x7f920410fc20 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f920c0dc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9204123bd0 con 0x7f9204115420 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f920c0dc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9204123d90 con 0x7f920410f230 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410fc20 0x7f920411e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410fc20 0x7f920411e070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45056/0 (socket says 10.20.193.28:45056) 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 -- 10.20.193.28:0/1899469578 learned_addr learned my addr 10.20.193.28:0/1899469578 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209e51640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f920410f230 0x7f920411db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f920a652640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9204115420 0x7f9204123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 -- 10.20.193.28:0/1899469578 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f920410f230 msgr2=0x7f920411db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f920410f230 0x7f920411db30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 -- 10.20.193.28:0/1899469578 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9204115420 msgr2=0x7f9204123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9204115420 0x7f9204123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 -- 10.20.193.28:0/1899469578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f8009570 con 0x7f920410fc20 2026-02-20T13:23:39.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.817+0000 7f9209650640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410fc20 0x7f920411e070 secure :-1 s=READY pgs=823 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f8005b30 tx=0x7f91f8002c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:39.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.818+0000 7f91f2ffd640 1 -- 10.20.193.28:0/1899469578 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f800ed60 con 0x7f920410fc20 2026-02-20T13:23:39.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.818+0000 7f91f2ffd640 1 -- 10.20.193.28:0/1899469578 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91f8002e70 con 0x7f920410fc20 2026-02-20T13:23:39.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.818+0000 7f920c0dc640 1 -- 10.20.193.28:0/1899469578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f40094b0 con 0x7f920410fc20 2026-02-20T13:23:39.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.818+0000 7f91f2ffd640 1 -- 10.20.193.28:0/1899469578 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f800f810 con 0x7f920410fc20 2026-02-20T13:23:39.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.818+0000 7f920c0dc640 1 -- 10.20.193.28:0/1899469578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9204063080 con 0x7f920410fc20 2026-02-20T13:23:39.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.820+0000 7f91f2ffd640 1 -- 10.20.193.28:0/1899469578 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f91f801f060 con 0x7f920410fc20 2026-02-20T13:23:39.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.822+0000 7f91f2ffd640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91e00be0f0 0x7f91e00de5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.822+0000 7f91f2ffd640 1 -- 10.20.193.28:0/1899469578 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f91f80e6fe0 con 0x7f920410fc20 2026-02-20T13:23:39.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.822+0000 7f9209e51640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91e00be0f0 0x7f91e00de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f9209e51640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91e00be0f0 0x7f91e00de5a0 secure :-1 s=READY pgs=403 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f40023d0 tx=0x7f91f403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f920e0d6e00 1 Processor -- start 2026-02-20T13:23:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f920e0d6e00 1 -- start start 2026-02-20T13:23:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff92d30 0x563d9ff93100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffd7fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9fff88d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563d9fea91a0 con 0x563d9ff93640 2026-02-20T13:23:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563d9fea4ed0 con 0x563d9ffd84f0 2026-02-20T13:23:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.823+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563d9fe9f030 con 0x563d9ff92d30 2026-02-20T13:23:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffd7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffd7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45062/0 (socket says 10.20.193.28:45062) 2026-02-20T13:23:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 -- 10.20.193.28:0/2610209580 learned_addr learned my addr 10.20.193.28:0/2610209580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209e51640 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff92d30 0x563d9ff93100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920a652640 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9fff88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 -- 10.20.193.28:0/2610209580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff92d30 msgr2=0x563d9ff93100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff92d30 0x563d9ff93100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 -- 10.20.193.28:0/2610209580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 msgr2=0x563d9fff88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9fff88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 -- 10.20.193.28:0/2610209580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d9fe4a4c0 con 0x563d9ff93640 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920a652640 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9fff88d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f9209650640 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffd7fb0 secure :-1 s=READY pgs=824 gs=1 cs=0 l=1 c_cookie=6599385456650323107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f8009480 tx=0x7f91f80a92d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b95ba1b978584a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f91d24e6640 1 -- 10.20.193.28:0/2610209580 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f80add60 con 0x563d9ff93640 2026-02-20T13:23:39.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f91d24e6640 1 -- 10.20.193.28:0/2610209580 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91f80b3080 con 0x563d9ff93640 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f91d24e6640 1 -- 10.20.193.28:0/2610209580 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f80af4a0 con 0x563d9ff93640 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920e0d6e00 1 -- 10.20.193.28:0/2610209580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 msgr2=0x563d9ffd7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffd7fb0 secure :-1 s=READY pgs=824 gs=1 cs=0 l=1 c_cookie=6599385456650323107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f8009480 tx=0x7f91f80a92d0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920e0d6e00 1 -- 10.20.193.28:0/2610209580 shutdown_connections 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffd7fb0 unknown :-1 s=CLOSED pgs=824 gs=1 cs=0 l=1 c_cookie=6599385456650323107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9fff88d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/2610209580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff92d30 0x563d9ff93100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.824+0000 7f920e0d6e00 1 -- 10.20.193.28:0/2610209580 >> 10.20.193.28:0/2610209580 conn(0x563d9feb1d60 msgr2=0x563d9ff91610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.825+0000 7f920e0d6e00 1 -- 10.20.193.28:0/2610209580 shutdown_connections 2026-02-20T13:23:39.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.825+0000 7f920e0d6e00 1 -- 10.20.193.28:0/2610209580 wait complete. 2026-02-20T13:23:39.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.826+0000 7f920e0d6e00 1 -- start start 2026-02-20T13:23:39.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.826+0000 7f920e0d6e00 1 Processor -- start 2026-02-20T13:23:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.826+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffaafe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.826+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff93640 0x563d9ffab520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.826+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9ffb0510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.826+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563d9ffb0a50 con 0x563d9ff92d30 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.826+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563d9ffb0bc0 con 0x563d9ffd84f0 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.826+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563d9ffb0d80 con 0x563d9ff93640 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffaafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffaafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45068/0 (socket says 10.20.193.28:45068) 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 -- 10.20.193.28:0/865919315 learned_addr learned my addr 10.20.193.28:0/865919315 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209650640 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff93640 0x563d9ffab520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f920a652640 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9ffb0510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 -- 10.20.193.28:0/865919315 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff93640 msgr2=0x563d9ffab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff93640 0x563d9ffab520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 -- 10.20.193.28:0/865919315 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 msgr2=0x563d9ffb0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9ffb0510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 -- 10.20.193.28:0/865919315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d9fe22c20 con 0x563d9ff92d30 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f9209e51640 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffaafe0 secure :-1 s=READY pgs=825 gs=1 cs=0 l=1 c_cookie=15697281795124326961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f4002f90 tx=0x7f91f402f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d7f29ff9977231 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f91bf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f91bf7fe640 1 -- 10.20.193.28:0/865919315 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f403d040 con 0x563d9ff92d30 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9204063080 con 0x563d9ff92d30 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f920e0d6e00 10 client.17670 _ll_register_callbacks cb 0x563d9fe29dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563d9fb7da60 con 0x563d9ff92d30 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f91bf7fe640 1 -- 10.20.193.28:0/865919315 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91f404b040 con 0x563d9ff92d30 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f91bf7fe640 1 -- 10.20.193.28:0/865919315 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f404f3f0 con 0x563d9ff92d30 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.827+0000 7f91bf7fe640 1 -- 10.20.193.28:0/865919315 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f91f404f580 con 0x563d9ff92d30 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f91bf7fe640 1 -- 10.20.193.28:0/865919315 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91f404f780 con 0x563d9ff92d30 2026-02-20T13:23:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f920e0d6e00 10 client.17670 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563d9fe345f0 con 0x563d9ff92d30 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f91bf7fe640 1 -- 10.20.193.28:0/865919315 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f91f404e070 con 0x563d9ff92d30 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f920e0d6e00 10 client.17670 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f920e0d6e00 10 client.17670 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f920e0d6e00 20 client.17670 populate_metadata read hostname 'trial028' 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563d9ffd5830 0x563d9ffd5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f920e0d6e00 4 client.17670 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d9fe715d0 con 0x563d9ffd5830 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.828+0000 7f9209650640 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563d9ffd5830 0x563d9ffd5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.829+0000 7f9209650640 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563d9ffd5830 0x563d9ffd5cd0 crc :-1 s=READY pgs=196 gs=4 cs=0 l=0 c_cookie=5059965375593769310 s_cookie=15329565333337125528 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46389bb3440ae95e server_cookie=d4bd8e737eb3b298 in_seq=0 out_seq=0 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.829+0000 7f91bf7fe640 10 client.17670 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:39.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.829+0000 7f91bf7fe640 1 -- 10.20.193.28:0/865919315 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563d9fe715d0 con 0x563d9ffd5830 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.829+0000 7f91bf7fe640 10 client.17670 handle_command_reply: tid=0 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 client.17670 shutdown 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 msgr2=0x563d9ffaafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffaafe0 secure :-1 s=READY pgs=825 gs=1 cs=0 l=1 c_cookie=15697281795124326961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f4002f90 tx=0x7f91f402f0e0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 shutdown_connections 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563d9ffd5830 0x563d9ffd5cd0 crc :-1 s=READY pgs=196 gs=4 cs=0 l=0 c_cookie=5059965375593769310 s_cookie=15329565333337125528 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ffd84f0 0x563d9ffb0510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ff93640 0x563d9ffab520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/865919315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffaafe0 unknown :-1 s=CLOSED pgs=825 gs=1 cs=0 l=1 c_cookie=15697281795124326961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f91bf7fe640 0 client.17670 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 >> 10.20.193.28:0/865919315 conn(0x563d9feb1d60 msgr2=0x563d9ff91d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:39.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 shutdown_connections 2026-02-20T13:23:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 1 -- 10.20.193.28:0/865919315 wait complete. 2026-02-20T13:23:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.830+0000 7f920e0d6e00 20 client.17670 trim_cache size 0 max 16384 2026-02-20T13:23:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920e0d6e00 1 Processor -- start 2026-02-20T13:23:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920e0d6e00 1 -- start start 2026-02-20T13:23:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff92d30 0x563d9ffa8320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffa8860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 0x563d9ffcf9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563d9ff92900 con 0x563d9ff93640 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563d9fe9cc60 con 0x563d9ff92d30 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563d9fb5cef0 con 0x563d9ffd84f0 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f9209650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffa8860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f9209e51640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff92d30 0x563d9ffa8320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f9209650640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffa8860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45078/0 (socket says 10.20.193.28:45078) 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f9209650640 1 -- 10.20.193.28:0/1592618350 learned_addr learned my addr 10.20.193.28:0/1592618350 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f9209650640 1 -- 10.20.193.28:0/1592618350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 msgr2=0x563d9ffcf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.839+0000 7f920a652640 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 0x563d9ffcf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f9209650640 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 0x563d9ffcf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f9209650640 1 -- 10.20.193.28:0/1592618350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff92d30 msgr2=0x563d9ffa8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f9209650640 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff92d30 0x563d9ffa8320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f9209650640 1 -- 10.20.193.28:0/1592618350 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d9fe2f150 con 0x563d9ff93640 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f9209650640 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffa8860 secure :-1 s=READY pgs=826 gs=1 cs=0 l=1 c_cookie=15163598086559843497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f8009480 tx=0x7f91f805b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26fec1e9a3144a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f91d1ce5640 1 -- 10.20.193.28:0/1592618350 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f80b3080 con 0x563d9ff93640 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f9209e51640 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff92d30 0x563d9ffa8320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f91d1ce5640 1 -- 10.20.193.28:0/1592618350 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91f80b84a0 con 0x563d9ff93640 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f91d1ce5640 1 -- 10.20.193.28:0/1592618350 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f80ad180 con 0x563d9ff93640 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1592618350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 msgr2=0x563d9ffa8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffa8860 secure :-1 s=READY pgs=826 gs=1 cs=0 l=1 c_cookie=15163598086559843497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f8009480 tx=0x7f91f805b040 comp rx=0 tx=0).stop 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1592618350 shutdown_connections 2026-02-20T13:23:39.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff93640 0x563d9ffa8860 unknown :-1 s=CLOSED pgs=826 gs=1 cs=0 l=1 c_cookie=15163598086559843497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 0x563d9ffcf9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1592618350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff92d30 0x563d9ffa8320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1592618350 >> 10.20.193.28:0/1592618350 conn(0x563d9feb1d60 msgr2=0x563d9ffafb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:39.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1592618350 shutdown_connections 2026-02-20T13:23:39.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.840+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1592618350 wait complete. 2026-02-20T13:23:39.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920e0d6e00 1 -- start start 2026-02-20T13:23:39.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920e0d6e00 1 Processor -- start 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffb15a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff93640 0x563d9ffb1ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920e0d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 0x563d9ffb2020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563d9fb5cef0 con 0x563d9ff92d30 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563d9ffb0ec0 con 0x563d9ff93640 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920e0d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563d9ffab400 con 0x563d9ffd84f0 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f9209650640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff93640 0x563d9ffb1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f9209e51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffb15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f9209650640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff93640 0x563d9ffb1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59346/0 (socket says 10.20.193.28:59346) 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f9209650640 1 -- 10.20.193.28:0/1995912055 learned_addr learned my addr 10.20.193.28:0/1995912055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:39.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.841+0000 7f920a652640 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 0x563d9ffb2020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f9209650640 1 -- 10.20.193.28:0/1995912055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 msgr2=0x563d9ffb2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f9209650640 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 0x563d9ffb2020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f9209650640 1 -- 10.20.193.28:0/1995912055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 msgr2=0x563d9ffb15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f9209650640 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffb15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f9209650640 1 -- 10.20.193.28:0/1995912055 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d9fe4a4c0 con 0x563d9ff93640 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f9209650640 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff93640 0x563d9ffb1ae0 secure :-1 s=READY pgs=310 gs=2 cs=0 l=1 c_cookie=14947296856571888956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f8010d90 tx=0x7f91f8010f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf6f774c0047c53c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f91bf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f91bf7fe640 1 -- 10.20.193.28:0/1995912055 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f80af430 con 0x563d9ff93640 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d9fe345f0 con 0x563d9ff93640 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f920e0d6e00 10 client.27632 _ll_register_callbacks cb 0x563d9fe29dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563d9fbf6aa0 con 0x563d9ff93640 2026-02-20T13:23:39.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f91bf7fe640 1 -- 10.20.193.28:0/1995912055 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91f80b3080 con 0x563d9ff93640 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f91bf7fe640 1 -- 10.20.193.28:0/1995912055 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f8016c00 con 0x563d9ff93640 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f91bf7fe640 1 -- 10.20.193.28:0/1995912055 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f91f8016d60 con 0x563d9ff93640 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f91bf7fe640 1 -- 10.20.193.28:0/1995912055 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91f80adff0 con 0x563d9ff93640 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f920e0d6e00 10 client.27632 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.842+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563d9fe22f50 con 0x563d9ff93640 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f91bf7fe640 1 -- 10.20.193.28:0/1995912055 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f91f8090060 con 0x563d9ff93640 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f920e0d6e00 10 client.27632 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f920e0d6e00 10 client.27632 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f920e0d6e00 20 client.27632 populate_metadata read hostname 'trial028' 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563da00969f0 0x563da00b6e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f920e0d6e00 4 client.27632 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.25, "await_for": 45.0}] 2026-02-20T13:23:39.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.25, "await_for": 45.0}) -- 0x563d9feac050 con 0x563da00969f0 2026-02-20T13:23:39.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f9209e51640 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563da00969f0 0x563da00b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:39.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f9209e51640 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563da00969f0 0x563da00b6e70 crc :-1 s=READY pgs=197 gs=4 cs=0 l=0 c_cookie=1812627886897042833 s_cookie=5355813670968987238 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1927bf759c771591 server_cookie=4a53ac284d498e66 in_seq=0 out_seq=0 2026-02-20T13:23:39.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.843+0000 7f91bf7fe640 10 client.27632 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f91bf7fe640 1 -- 10.20.193.28:0/1995912055 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563d9feac050 con 0x563da00969f0 2026-02-20T13:23:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f91bf7fe640 10 client.27632 handle_command_reply: tid=0 2026-02-20T13:23:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 client.27632 shutdown 2026-02-20T13:23:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff93640 msgr2=0x563d9ffb1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff93640 0x563d9ffb1ae0 secure :-1 s=READY pgs=310 gs=2 cs=0 l=1 c_cookie=14947296856571888956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f8010d90 tx=0x7f91f8010f90 comp rx=0 tx=0).stop 2026-02-20T13:23:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 shutdown_connections 2026-02-20T13:23:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563da00969f0 0x563da00b6e70 crc :-1 s=READY pgs=197 gs=4 cs=0 l=0 c_cookie=1812627886897042833 s_cookie=5355813670968987238 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563d9ffd84f0 0x563d9ffb2020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563d9ff93640 0x563d9ffb1ae0 unknown :-1 s=CLOSED pgs=310 gs=2 cs=0 l=1 c_cookie=14947296856571888956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 --2- 10.20.193.28:0/1995912055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563d9ff92d30 0x563d9ffb15a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f91bf7fe640 0 client.27632 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:39.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 >> 10.20.193.28:0/1995912055 conn(0x563d9feb1d60 msgr2=0x563d9ffae240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:39.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 shutdown_connections 2026-02-20T13:23:39.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 1 -- 10.20.193.28:0/1995912055 wait complete. 2026-02-20T13:23:39.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.849+0000 7f920e0d6e00 20 client.27632 trim_cache size 0 max 16384 2026-02-20T13:23:39.854 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 22, 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "6754165a": { 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "version": 22, 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:23:39.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 143.2, 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:39.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:39.857 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:39.857 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:39.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 -- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91e00be0f0 msgr2=0x7f91e00de5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91e00be0f0 0x7f91e00de5a0 secure :-1 s=READY pgs=403 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f40023d0 tx=0x7f91f403a040 comp rx=0 tx=0).stop 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 -- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410fc20 msgr2=0x7f920411e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410fc20 0x7f920411e070 secure :-1 s=READY pgs=823 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f8005b30 tx=0x7f91f8002c10 comp rx=0 tx=0).stop 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 -- 10.20.193.28:0/1899469578 shutdown_connections 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91e00be0f0 0x7f91e00de5a0 unknown :-1 s=CLOSED pgs=403 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f920410fc20 0x7f920411e070 unknown :-1 s=CLOSED pgs=823 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9204115420 0x7f9204123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 --2- 10.20.193.28:0/1899469578 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f920410f230 0x7f920411db30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 -- 10.20.193.28:0/1899469578 >> 10.20.193.28:0/1899469578 conn(0x7f920405f830 msgr2=0x7f920410cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 -- 10.20.193.28:0/1899469578 shutdown_connections 2026-02-20T13:23:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:39.850+0000 7f920c0dc640 1 -- 10.20.193.28:0/1899469578 wait complete. 2026-02-20T13:23:39.950 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6754165a', quiesce took 1.2 seconds. Will release after: 22.05 2026-02-20T13:23:39.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:39 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2418471568' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:39.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:39 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2418471568' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:40 trial028 ceph-mon[37442]: pgmap v371: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-20T13:23:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:40 trial127 ceph-mon[43817]: pgmap v371: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-20T13:23:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:40 trial034 ceph-mon[43332]: pgmap v371: 97 pgs: 97 active+clean; 3.5 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-20T13:23:42.779 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:42 trial127 ceph-mon[43817]: pgmap v372: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2026-02-20T13:23:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:42 trial028 ceph-mon[37442]: pgmap v372: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2026-02-20T13:23:42.887 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:23:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:42 trial034 ceph-mon[43332]: pgmap v372: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2026-02-20T13:23:43.074 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 -- 10.20.193.28:0/2563587023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 msgr2=0x7f17fc10f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 --2- 10.20.193.28:0/2563587023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 0x7f17fc10f9c0 secure :-1 s=READY pgs=827 gs=1 cs=0 l=1 c_cookie=774257086046471223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17f0009950 tx=0x7f17f002f190 comp rx=0 tx=0).stop 2026-02-20T13:23:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 -- 10.20.193.28:0/2563587023 shutdown_connections 2026-02-20T13:23:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 --2- 10.20.193.28:0/2563587023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17fc1157e0 0x7f17fc1761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 --2- 10.20.193.28:0/2563587023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f17fc10ffe0 0x7f17fc115030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 --2- 10.20.193.28:0/2563587023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 0x7f17fc10f9c0 unknown :-1 s=CLOSED pgs=827 gs=1 cs=0 l=1 c_cookie=774257086046471223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 -- 10.20.193.28:0/2563587023 >> 10.20.193.28:0/2563587023 conn(0x7f17fc0ecea0 msgr2=0x7f17fc10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 -- 10.20.193.28:0/2563587023 shutdown_connections 2026-02-20T13:23:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 -- 10.20.193.28:0/2563587023 wait complete. 2026-02-20T13:23:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 Processor -- start 2026-02-20T13:23:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.249+0000 7f180172a640 1 -- start start 2026-02-20T13:23:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f180172a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 0x7f17fc11d4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f180172a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f17fc10ffe0 0x7f17fc11da20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f180172a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17fc1157e0 0x7f17fc122df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f180172a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc123410 con 0x7f17fc10f5f0 2026-02-20T13:23:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f180172a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc123580 con 0x7f17fc1157e0 2026-02-20T13:23:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f180172a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc123740 con 0x7f17fc10ffe0 2026-02-20T13:23:43.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 0x7f17fc11d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 0x7f17fc11d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33996/0 (socket says 10.20.193.28:33996) 2026-02-20T13:23:43.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 -- 10.20.193.28:0/2051467777 learned_addr learned my addr 10.20.193.28:0/2051467777 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:43.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f17fc10ffe0 0x7f17fc11da20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17fb7fe640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17fc1157e0 0x7f17fc122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 -- 10.20.193.28:0/2051467777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f17fc10ffe0 msgr2=0x7f17fc11da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f17fc10ffe0 0x7f17fc11da20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 -- 10.20.193.28:0/2051467777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17fc1157e0 msgr2=0x7f17fc122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17fc1157e0 0x7f17fc122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 -- 10.20.193.28:0/2051467777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f0009570 con 0x7f17fc10f5f0 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.250+0000 7f17faffd640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 0x7f17fc11d4e0 secure :-1 s=READY pgs=828 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17f0038820 tx=0x7f17f00043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.251+0000 7f17dbfff640 1 -- 10.20.193.28:0/2051467777 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17f003d070 con 0x7f17fc10f5f0 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.251+0000 7f17dbfff640 1 -- 10.20.193.28:0/2051467777 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f17f0038920 con 0x7f17fc10f5f0 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.251+0000 7f17dbfff640 1 -- 10.20.193.28:0/2051467777 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17f0041960 con 0x7f17fc10f5f0 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.251+0000 7f180172a640 1 -- 10.20.193.28:0/2051467777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc1239c0 con 0x7f17fc10f5f0 2026-02-20T13:23:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.251+0000 7f180172a640 1 -- 10.20.193.28:0/2051467777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc163f80 con 0x7f17fc10f5f0 2026-02-20T13:23:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.254+0000 7f17dbfff640 1 -- 10.20.193.28:0/2051467777 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f17f0038a90 con 0x7f17fc10f5f0 2026-02-20T13:23:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.256+0000 7f17dbfff640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17d00b5760 0x7f17d00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.256+0000 7f17dbfff640 1 -- 10.20.193.28:0/2051467777 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f17f010b2b0 con 0x7f17fc10f5f0 2026-02-20T13:23:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.256+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17d00b5760 0x7f17d00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.256+0000 7f1803724e00 1 Processor -- start 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17d00b5760 0x7f17d00d5c10 secure :-1 s=READY pgs=404 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17e4005970 tx=0x7f17e4005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f1803724e00 1 -- start start 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f1803724e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443d180 0x55a2d443d550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f1803724e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d4482400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f1803724e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 0x55a2d44a2d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f1803724e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a2d43537d0 con 0x55a2d443da90 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f1803724e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a2d434f500 con 0x55a2d443d180 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f1803724e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a2d43494a0 con 0x55a2d4482940 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d4482400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d4482400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34010/0 (socket says 10.20.193.28:34010) 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 -- 10.20.193.28:0/2036125563 learned_addr learned my addr 10.20.193.28:0/2036125563 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fb7fe640 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 0x55a2d44a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17faffd640 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443d180 0x55a2d443d550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 -- 10.20.193.28:0/2036125563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 msgr2=0x55a2d44a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 0x55a2d44a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 -- 10.20.193.28:0/2036125563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443d180 msgr2=0x55a2d443d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443d180 0x55a2d443d550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 -- 10.20.193.28:0/2036125563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d42f4d80 con 0x55a2d443da90 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.257+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d4482400 secure :-1 s=READY pgs=829 gs=1 cs=0 l=1 c_cookie=5896292661529807427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17e400fd10 tx=0x7f17e4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d3d6ef8e3a0a43 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f17c77fe640 1 -- 10.20.193.28:0/2036125563 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17e401e460 con 0x55a2d443da90 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f17c77fe640 1 -- 10.20.193.28:0/2036125563 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f17e401eaa0 con 0x55a2d443da90 2026-02-20T13:23:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f17c77fe640 1 -- 10.20.193.28:0/2036125563 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17e4010be0 con 0x55a2d443da90 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 -- 10.20.193.28:0/2036125563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 msgr2=0x55a2d4482400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d4482400 secure :-1 s=READY pgs=829 gs=1 cs=0 l=1 c_cookie=5896292661529807427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17e400fd10 tx=0x7f17e4012000 comp rx=0 tx=0).stop 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 -- 10.20.193.28:0/2036125563 shutdown_connections 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d4482400 unknown :-1 s=CLOSED pgs=829 gs=1 cs=0 l=1 c_cookie=5896292661529807427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 0x55a2d44a2d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 --2- 10.20.193.28:0/2036125563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443d180 0x55a2d443d550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 -- 10.20.193.28:0/2036125563 >> 10.20.193.28:0/2036125563 conn(0x55a2d441b680 msgr2=0x55a2d443ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 -- 10.20.193.28:0/2036125563 shutdown_connections 2026-02-20T13:23:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.258+0000 7f1803724e00 1 -- 10.20.193.28:0/2036125563 wait complete. 2026-02-20T13:23:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.259+0000 7f1803724e00 1 -- start start 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.259+0000 7f1803724e00 1 Processor -- start 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f1803724e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 0x55a2d44557a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f1803724e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4455ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f1803724e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d4482940 0x55a2d445acd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f1803724e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a2d445b210 con 0x55a2d4482940 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f1803724e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a2d445b380 con 0x55a2d443da90 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f1803724e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a2d445b540 con 0x55a2d443d180 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d4482940 0x55a2d445acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17faffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 0x55a2d44557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fa7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4455ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d4482940 0x55a2d445acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34018/0 (socket says 10.20.193.28:34018) 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fb7fe640 1 -- 10.20.193.28:0/3754874908 learned_addr learned my addr 10.20.193.28:0/3754874908 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fb7fe640 1 -- 10.20.193.28:0/3754874908 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 msgr2=0x55a2d44557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fb7fe640 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 0x55a2d44557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fb7fe640 1 -- 10.20.193.28:0/3754874908 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 msgr2=0x55a2d4455ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fb7fe640 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4455ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.260+0000 7f17fb7fe640 1 -- 10.20.193.28:0/3754874908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d42cd350 con 0x55a2d4482940 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f17fb7fe640 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d4482940 0x55a2d445acd0 secure :-1 s=READY pgs=830 gs=1 cs=0 l=1 c_cookie=828745155478687675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17ec003ca0 tx=0x7f17ec0127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b804b53f9a20fbb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f17c4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f17c4ff9640 1 -- 10.20.193.28:0/3754874908 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17ec01c690 con 0x55a2d4482940 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f17c4ff9640 1 -- 10.20.193.28:0/3754874908 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f17ec01ccd0 con 0x55a2d4482940 2026-02-20T13:23:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e400f9b0 con 0x55a2d4482940 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f1803724e00 10 client.17688 _ll_register_callbacks cb 0x55a2d42ca9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a2d3fdf6f0 con 0x55a2d4482940 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f17c4ff9640 1 -- 10.20.193.28:0/3754874908 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17ec010650 con 0x55a2d4482940 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f17c4ff9640 1 -- 10.20.193.28:0/3754874908 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f17ec013e30 con 0x55a2d4482940 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f17c4ff9640 1 -- 10.20.193.28:0/3754874908 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f17ec0107e0 con 0x55a2d4482940 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f1803724e00 10 client.17688 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a2d42df150 con 0x55a2d4482940 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f17c4ff9640 1 -- 10.20.193.28:0/3754874908 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f17ec01c7f0 con 0x55a2d4482940 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f1803724e00 10 client.17688 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.261+0000 7f1803724e00 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.262+0000 7f1803724e00 20 client.17688 populate_metadata read hostname 'trial028' 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.262+0000 7f1803724e00 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2d44800d0 0x55a2d4480570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.262+0000 7f1803724e00 4 client.17688 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.262+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2d4356d60 con 0x55a2d44800d0 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.262+0000 7f17faffd640 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2d44800d0 0x55a2d4480570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.262+0000 7f17faffd640 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2d44800d0 0x55a2d4480570 crc :-1 s=READY pgs=198 gs=4 cs=0 l=0 c_cookie=15810492233647207457 s_cookie=200569305245958577 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db6a26eb3e9d3421 server_cookie=2c890b8700841b1 in_seq=0 out_seq=0 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.262+0000 7f17c4ff9640 10 client.17688 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f17c4ff9640 1 -- 10.20.193.28:0/3754874908 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a2d4356d60 con 0x55a2d44800d0 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f17c4ff9640 10 client.17688 handle_command_reply: tid=0 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 client.17688 shutdown 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d4482940 msgr2=0x55a2d445acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d4482940 0x55a2d445acd0 secure :-1 s=READY pgs=830 gs=1 cs=0 l=1 c_cookie=828745155478687675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17ec003ca0 tx=0x7f17ec0127b0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 shutdown_connections 2026-02-20T13:23:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2d44800d0 0x55a2d4480570 crc :-1 s=READY pgs=198 gs=4 cs=0 l=0 c_cookie=15810492233647207457 s_cookie=200569305245958577 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d4482940 0x55a2d445acd0 unknown :-1 s=CLOSED pgs=830 gs=1 cs=0 l=1 c_cookie=828745155478687675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4455ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 --2- 10.20.193.28:0/3754874908 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 0x55a2d44557a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f17c4ff9640 0 client.17688 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 >> 10.20.193.28:0/3754874908 conn(0x55a2d441b680 msgr2=0x55a2d443c250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.263+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 shutdown_connections 2026-02-20T13:23:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.264+0000 7f1803724e00 1 -- 10.20.193.28:0/3754874908 wait complete. 2026-02-20T13:23:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.264+0000 7f1803724e00 20 client.17688 trim_cache size 0 max 16384 2026-02-20T13:23:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f1803724e00 1 Processor -- start 2026-02-20T13:23:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f1803724e00 1 -- start start 2026-02-20T13:23:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f1803724e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443d180 0x55a2d4442d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f1803724e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4481c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f1803724e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 0x55a2d4482180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f1803724e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a2d43470d0 con 0x55a2d443d180 2026-02-20T13:23:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f1803724e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a2d4007700 con 0x55a2d443da90 2026-02-20T13:23:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f1803724e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a2d447c940 con 0x55a2d4482940 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17fa7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4481c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17faffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443d180 0x55a2d4442d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17fa7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4481c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39194/0 (socket says 10.20.193.28:39194) 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17fa7fc640 1 -- 10.20.193.28:0/274349240 learned_addr learned my addr 10.20.193.28:0/274349240 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17fb7fe640 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 0x55a2d4482180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17faffd640 1 -- 10.20.193.28:0/274349240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 msgr2=0x55a2d4482180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17faffd640 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 0x55a2d4482180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17faffd640 1 -- 10.20.193.28:0/274349240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 msgr2=0x55a2d4481c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17faffd640 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4481c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17faffd640 1 -- 10.20.193.28:0/274349240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d42d9bd0 con 0x55a2d443d180 2026-02-20T13:23:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.273+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4481c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f17faffd640 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443d180 0x55a2d4442d80 secure :-1 s=READY pgs=831 gs=1 cs=0 l=1 c_cookie=8630358579499089887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17f0108d50 tx=0x7f17f0002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c531670749bfdf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f17c6ffd640 1 -- 10.20.193.28:0/274349240 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17f00d7330 con 0x55a2d443d180 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f17c6ffd640 1 -- 10.20.193.28:0/274349240 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f17f00cbe90 con 0x55a2d443d180 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f17c6ffd640 1 -- 10.20.193.28:0/274349240 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17f00d11b0 con 0x55a2d443d180 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 -- 10.20.193.28:0/274349240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443d180 msgr2=0x55a2d4442d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443d180 0x55a2d4442d80 secure :-1 s=READY pgs=831 gs=1 cs=0 l=1 c_cookie=8630358579499089887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17f0108d50 tx=0x7f17f0002b90 comp rx=0 tx=0).stop 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 -- 10.20.193.28:0/274349240 shutdown_connections 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d4482940 0x55a2d4482180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d443da90 0x55a2d4481c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 --2- 10.20.193.28:0/274349240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443d180 0x55a2d4442d80 unknown :-1 s=CLOSED pgs=831 gs=1 cs=0 l=1 c_cookie=8630358579499089887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 -- 10.20.193.28:0/274349240 >> 10.20.193.28:0/274349240 conn(0x55a2d441b680 msgr2=0x55a2d4451b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 -- 10.20.193.28:0/274349240 shutdown_connections 2026-02-20T13:23:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.274+0000 7f1803724e00 1 -- 10.20.193.28:0/274349240 wait complete. 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f1803724e00 1 -- start start 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f1803724e00 1 Processor -- start 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f1803724e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 0x55a2d445dd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f1803724e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d445e240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f1803724e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d4482940 0x55a2d44c8050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f1803724e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a2d444d640 con 0x55a2d443da90 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f1803724e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a2d44c85f0 con 0x55a2d4482940 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f1803724e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a2d44c87b0 con 0x55a2d443d180 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f17fa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d445e240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f17fa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d445e240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34040/0 (socket says 10.20.193.28:34040) 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f17fa7fc640 1 -- 10.20.193.28:0/2246077456 learned_addr learned my addr 10.20.193.28:0/2246077456 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.275+0000 7f17fb7fe640 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d4482940 0x55a2d44c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17faffd640 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 0x55a2d445dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17fa7fc640 1 -- 10.20.193.28:0/2246077456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 msgr2=0x55a2d445dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 0x55a2d445dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17fa7fc640 1 -- 10.20.193.28:0/2246077456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d4482940 msgr2=0x55a2d44c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d4482940 0x55a2d44c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17fa7fc640 1 -- 10.20.193.28:0/2246077456 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc163f80 con 0x55a2d443da90 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17fa7fc640 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d445e240 secure :-1 s=READY pgs=832 gs=1 cs=0 l=1 c_cookie=15866637542064090757 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17e400fd10 tx=0x7f17e4002f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc319ec78a9b6e85 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17c4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17c4ff9640 1 -- 10.20.193.28:0/2246077456 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17e4032040 con 0x55a2d443da90 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17c4ff9640 1 -- 10.20.193.28:0/2246077456 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f17e4010590 con 0x55a2d443da90 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17c4ff9640 1 -- 10.20.193.28:0/2246077456 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17e40379c0 con 0x55a2d443da90 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d42f4d80 con 0x55a2d443da90 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17c4ff9640 1 -- 10.20.193.28:0/2246077456 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f17e4037b50 con 0x55a2d443da90 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f1803724e00 10 client.17694 _ll_register_callbacks cb 0x55a2d42ca9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e401eaa0 con 0x55a2d443da90 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f17c4ff9640 1 -- 10.20.193.28:0/2246077456 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f17e4037d10 con 0x55a2d443da90 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.276+0000 7f1803724e00 10 client.17694 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a2d42cd680 con 0x55a2d443da90 2026-02-20T13:23:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f17c4ff9640 1 -- 10.20.193.28:0/2246077456 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f17e40107a0 con 0x55a2d443da90 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f1803724e00 10 client.17694 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f1803724e00 10 client.17694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f1803724e00 20 client.17694 populate_metadata read hostname 'trial028' 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f1803724e00 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2d44ca660 0x55a2d44caad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f1803724e00 4 client.17694 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a2d3fdcf40 con 0x55a2d44ca660 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.277+0000 7f17faffd640 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2d44ca660 0x55a2d44caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f17faffd640 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2d44ca660 0x55a2d44caad0 crc :-1 s=READY pgs=199 gs=4 cs=0 l=0 c_cookie=9242520177400251211 s_cookie=4844902802392167863 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80440721e352834b server_cookie=433c8d6debe135b7 in_seq=0 out_seq=0 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f17c4ff9640 10 client.17694 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f17c4ff9640 1 -- 10.20.193.28:0/2246077456 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x55a2d3fdcf40 con 0x55a2d44ca660 2026-02-20T13:23:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f17c4ff9640 10 client.17694 handle_command_reply: tid=0 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 client.17694 shutdown 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 msgr2=0x55a2d445e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d445e240 secure :-1 s=READY pgs=832 gs=1 cs=0 l=1 c_cookie=15866637542064090757 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17e400fd10 tx=0x7f17e4002f80 comp rx=0 tx=0).stop 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 shutdown_connections 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2d44ca660 0x55a2d44caad0 crc :-1 s=READY pgs=199 gs=4 cs=0 l=0 c_cookie=9242520177400251211 s_cookie=4844902802392167863 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2d443da90 0x55a2d445e240 unknown :-1 s=CLOSED pgs=832 gs=1 cs=0 l=1 c_cookie=15866637542064090757 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f17c4ff9640 0 client.17694 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a2d4482940 0x55a2d44c8050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 --2- 10.20.193.28:0/2246077456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a2d443d180 0x55a2d445dd00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 >> 10.20.193.28:0/2246077456 conn(0x55a2d441b680 msgr2=0x55a2d4452380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 shutdown_connections 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 1 -- 10.20.193.28:0/2246077456 wait complete. 2026-02-20T13:23:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.278+0000 7f1803724e00 20 client.17694 trim_cache size 0 max 16384 2026-02-20T13:23:43.288 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:43.288 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:23:43.288 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:23:43.288 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:23:43.288 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:23:43.288 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:23:43.288 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:43.294 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 -- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17d00b5760 msgr2=0x7f17d00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17d00b5760 0x7f17d00d5c10 secure :-1 s=READY pgs=404 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17e4005970 tx=0x7f17e4005900 comp rx=0 tx=0).stop 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 -- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 msgr2=0x7f17fc11d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 0x7f17fc11d4e0 secure :-1 s=READY pgs=828 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17f0038820 tx=0x7f17f00043d0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 -- 10.20.193.28:0/2051467777 shutdown_connections 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f17d00b5760 0x7f17d00d5c10 unknown :-1 s=CLOSED pgs=404 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f17fc1157e0 0x7f17fc122df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f17fc10ffe0 0x7f17fc11da20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 --2- 10.20.193.28:0/2051467777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f17fc10f5f0 0x7f17fc11d4e0 unknown :-1 s=CLOSED pgs=828 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.279+0000 7f180172a640 1 -- 10.20.193.28:0/2051467777 >> 10.20.193.28:0/2051467777 conn(0x7f17fc0ecea0 msgr2=0x7f17fc10d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.280+0000 7f180172a640 1 -- 10.20.193.28:0/2051467777 shutdown_connections 2026-02-20T13:23:43.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.280+0000 7f180172a640 1 -- 10.20.193.28:0/2051467777 wait complete. 2026-02-20T13:23:43.383 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:23:43.383 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:23:43.568 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 -- 10.20.193.28:0/2147346262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 msgr2=0x7f062c176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 --2- 10.20.193.28:0/2147346262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 0x7f062c176070 secure :-1 s=READY pgs=833 gs=1 cs=0 l=1 c_cookie=18010016525210984347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f061c00aa30 tx=0x7f061c030270 comp rx=0 tx=0).stop 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 -- 10.20.193.28:0/2147346262 shutdown_connections 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 --2- 10.20.193.28:0/2147346262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 0x7f062c176070 unknown :-1 s=CLOSED pgs=833 gs=1 cs=0 l=1 c_cookie=18010016525210984347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 --2- 10.20.193.28:0/2147346262 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f062c10fea0 0x7f062c114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 --2- 10.20.193.28:0/2147346262 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f062c10f4b0 0x7f062c10f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 -- 10.20.193.28:0/2147346262 >> 10.20.193.28:0/2147346262 conn(0x7f062c0ecda0 msgr2=0x7f062c10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 -- 10.20.193.28:0/2147346262 shutdown_connections 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.738+0000 7f0630846640 1 -- 10.20.193.28:0/2147346262 wait complete. 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f0630846640 1 Processor -- start 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f0630846640 1 -- start start 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f0630846640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f062c10f4b0 0x7f062c0f5740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f0630846640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f062c10fea0 0x7f062c175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f0630846640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 0x7f062c0f5e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f0630846640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f062c0fb050 con 0x7f062c1156a0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f0630846640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f062c0fb1c0 con 0x7f062c10fea0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f0630846640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f062c0fb380 con 0x7f062c10f4b0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f062ad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f062c10f4b0 0x7f062c0f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f062a575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f062c10fea0 0x7f062c175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f062b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 0x7f062c0f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f062a575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f062c10fea0 0x7f062c175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39222/0 (socket says 10.20.193.28:39222) 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.739+0000 7f062a575640 1 -- 10.20.193.28:0/3975317988 learned_addr learned my addr 10.20.193.28:0/3975317988 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f062b577640 1 -- 10.20.193.28:0/3975317988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f062c10f4b0 msgr2=0x7f062c0f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f062b577640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f062c10f4b0 0x7f062c0f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f062b577640 1 -- 10.20.193.28:0/3975317988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f062c10fea0 msgr2=0x7f062c175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f062b577640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f062c10fea0 0x7f062c175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f062b577640 1 -- 10.20.193.28:0/3975317988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061c00a650 con 0x7f062c1156a0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f062b577640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 0x7f062c0f5e40 secure :-1 s=READY pgs=834 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f061c033040 tx=0x7f061c030dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f060bfff640 1 -- 10.20.193.28:0/3975317988 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f061c03e070 con 0x7f062c1156a0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f060bfff640 1 -- 10.20.193.28:0/3975317988 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f061c039e00 con 0x7f062c1156a0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062c0fb600 con 0x7f062c1156a0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f060bfff640 1 -- 10.20.193.28:0/3975317988 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f061c042820 con 0x7f062c1156a0 2026-02-20T13:23:43.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.740+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062c0fba20 con 0x7f062c1156a0 2026-02-20T13:23:43.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.741+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062c110790 con 0x7f062c1156a0 2026-02-20T13:23:43.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.743+0000 7f060bfff640 1 -- 10.20.193.28:0/3975317988 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f061c0052c0 con 0x7f062c1156a0 2026-02-20T13:23:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.744+0000 7f060bfff640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f06000b56d0 0x7f06000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.744+0000 7f060bfff640 1 -- 10.20.193.28:0/3975317988 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f061c10c620 con 0x7f062c1156a0 2026-02-20T13:23:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.744+0000 7f060bfff640 1 -- 10.20.193.28:0/3975317988 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f061c10caa0 con 0x7f062c1156a0 2026-02-20T13:23:43.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.744+0000 7f062ad76640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f06000b56d0 0x7f06000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:43.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.745+0000 7f062ad76640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f06000b56d0 0x7f06000d5b80 secure :-1 s=READY pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0620004740 tx=0x7f0620005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:43.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.886+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f062c0f68a0 con 0x7f062c1156a0 2026-02-20T13:23:43.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.887+0000 7f060bfff640 1 -- 10.20.193.28:0/3975317988 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f061c0cf080 con 0x7f062c1156a0 2026-02-20T13:23:43.890 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:23:43.890 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:23:43.891 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:23:43.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f06000b56d0 msgr2=0x7f06000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f06000b56d0 0x7f06000d5b80 secure :-1 s=READY pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0620004740 tx=0x7f0620005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:43.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 msgr2=0x7f062c0f5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 0x7f062c0f5e40 secure :-1 s=READY pgs=834 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f061c033040 tx=0x7f061c030dd0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 shutdown_connections 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f06000b56d0 0x7f06000d5b80 unknown :-1 s=CLOSED pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f062c1156a0 0x7f062c0f5e40 unknown :-1 s=CLOSED pgs=834 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f062c10fea0 0x7f062c175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 --2- 10.20.193.28:0/3975317988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f062c10f4b0 0x7f062c0f5740 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 >> 10.20.193.28:0/3975317988 conn(0x7f062c0ecda0 msgr2=0x7f062c10d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 shutdown_connections 2026-02-20T13:23:43.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:43.888+0000 7f0630846640 1 -- 10.20.193.28:0/3975317988 wait complete. 2026-02-20T13:23:43.988 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:23:44.177 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:44.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.349+0000 7f8a8d77b640 1 -- 10.20.193.28:0/3649984683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a88111ec0 msgr2=0x7f8a88172890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.349+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/3649984683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a88111ec0 0x7f8a88172890 secure :-1 s=READY pgs=835 gs=1 cs=0 l=1 c_cookie=7898754535415097296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a7c00a970 tx=0x7f8a7c0301b0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.349+0000 7f8a8d77b640 1 -- 10.20.193.28:0/3649984683 shutdown_connections 2026-02-20T13:23:44.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.349+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/3649984683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a88111ec0 0x7f8a88172890 unknown :-1 s=CLOSED pgs=835 gs=1 cs=0 l=1 c_cookie=7898754535415097296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.349+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/3649984683 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8a8810c6c0 0x7f8a88111710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.349+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/3649984683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8a8810bcd0 0x7f8a8810c0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.349+0000 7f8a8d77b640 1 -- 10.20.193.28:0/3649984683 >> 10.20.193.28:0/3649984683 conn(0x7f8a880e95c0 msgr2=0x7f8a881099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.350+0000 7f8a8d77b640 1 -- 10.20.193.28:0/3649984683 shutdown_connections 2026-02-20T13:23:44.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.350+0000 7f8a8d77b640 1 -- 10.20.193.28:0/3649984683 wait complete. 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.350+0000 7f8a8d77b640 1 Processor -- start 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.350+0000 7f8a8d77b640 1 -- start start 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.350+0000 7f8a8d77b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a8810bcd0 0x7f8a880f3fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a8d77b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8a8810c6c0 0x7f8a88172790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a8d77b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8a88111ec0 0x7f8a880f46b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a8d77b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880f9870 con 0x7f8a8810bcd0 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a8d77b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880f99e0 con 0x7f8a8810c6c0 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a8d77b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880f9ba0 con 0x7f8a88111ec0 2026-02-20T13:23:44.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a8810bcd0 0x7f8a880f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a8810bcd0 0x7f8a880f3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34084/0 (socket says 10.20.193.28:34084) 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 -- 10.20.193.28:0/4019057070 learned_addr learned my addr 10.20.193.28:0/4019057070 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a877fe640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8a8810c6c0 0x7f8a88172790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8a88111ec0 0x7f8a880f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 -- 10.20.193.28:0/4019057070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8a88111ec0 msgr2=0x7f8a880f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8a88111ec0 0x7f8a880f46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 -- 10.20.193.28:0/4019057070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8a8810c6c0 msgr2=0x7f8a88172790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8a8810c6c0 0x7f8a88172790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 -- 10.20.193.28:0/4019057070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c00a590 con 0x7f8a8810bcd0 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a877fe640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8a8810c6c0 0x7f8a88172790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:44.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a87fff640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a8810bcd0 0x7f8a880f3fb0 secure :-1 s=READY pgs=836 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a74009480 tx=0x7f8a7400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a857fa640 1 -- 10.20.193.28:0/4019057070 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a7400cd40 con 0x7f8a8810bcd0 2026-02-20T13:23:44.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a857fa640 1 -- 10.20.193.28:0/4019057070 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a74004d30 con 0x7f8a8810bcd0 2026-02-20T13:23:44.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a857fa640 1 -- 10.20.193.28:0/4019057070 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a74010740 con 0x7f8a8810bcd0 2026-02-20T13:23:44.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a8d77b640 1 -- 10.20.193.28:0/4019057070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a880f9e80 con 0x7f8a8810bcd0 2026-02-20T13:23:44.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.351+0000 7f8a8d77b640 1 -- 10.20.193.28:0/4019057070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a880fa350 con 0x7f8a8810bcd0 2026-02-20T13:23:44.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.355+0000 7f8a857fa640 1 -- 10.20.193.28:0/4019057070 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8a7401f060 con 0x7f8a8810bcd0 2026-02-20T13:23:44.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.356+0000 7f8a857fa640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8a5c0b5750 0x7f8a5c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.356+0000 7f8a857fa640 1 -- 10.20.193.28:0/4019057070 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8a74014070 con 0x7f8a8810bcd0 2026-02-20T13:23:44.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.356+0000 7f8a877fe640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8a5c0b5750 0x7f8a5c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.357+0000 7f8a877fe640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8a5c0b5750 0x7f8a5c0d5c00 secure :-1 s=READY pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a880fa900 tx=0x7f8a78009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.357+0000 7f8a909fee00 1 Processor -- start 2026-02-20T13:23:44.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.357+0000 7f8a909fee00 1 -- start start 2026-02-20T13:23:44.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c34730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c795e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a909fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572f4b4a780 con 0x5572f4c79b20 2026-02-20T13:23:44.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a909fee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5572f4b464b0 con 0x5572f4c34c70 2026-02-20T13:23:44.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a909fee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5572f4b40450 con 0x5572f4c34360 2026-02-20T13:23:44.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c34730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a877fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a8cf7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c34730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53580/0 (socket says 10.20.193.28:53580) 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a87fff640 1 -- 10.20.193.28:0/2776244025 learned_addr learned my addr 10.20.193.28:0/2776244025 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a8cf7a640 1 -- 10.20.193.28:0/2776244025 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 msgr2=0x5572f4c34730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/2776244025 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c34730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a8cf7a640 1 -- 10.20.193.28:0/2776244025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 msgr2=0x5572f4c795e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/2776244025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c795e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a8cf7a640 1 -- 10.20.193.28:0/2776244025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f4aebd10 con 0x5572f4c79b20 2026-02-20T13:23:44.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/2776244025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99f00 secure :-1 s=READY pgs=837 gs=2 cs=0 l=1 c_cookie=17166985872445515164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a7c00a8c0 tx=0x7f8a7c006c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3d62b24743a59c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.358+0000 7f8a58ce3640 1 -- 10.20.193.28:0/2776244025 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a7c040040 con 0x5572f4c79b20 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a58ce3640 1 -- 10.20.193.28:0/2776244025 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a7c006e20 con 0x5572f4c79b20 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a58ce3640 1 -- 10.20.193.28:0/2776244025 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a7c030cf0 con 0x5572f4c79b20 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 -- 10.20.193.28:0/2776244025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 msgr2=0x5572f4c99f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2776244025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99f00 secure :-1 s=READY pgs=837 gs=2 cs=0 l=1 c_cookie=17166985872445515164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a7c00a8c0 tx=0x7f8a7c006c80 comp rx=0 tx=0).stop 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 -- 10.20.193.28:0/2776244025 shutdown_connections 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2776244025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99f00 unknown :-1 s=CLOSED pgs=837 gs=2 cs=0 l=1 c_cookie=17166985872445515164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2776244025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c795e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2776244025 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c34730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 -- 10.20.193.28:0/2776244025 >> 10.20.193.28:0/2776244025 conn(0x5572f4c12860 msgr2=0x5572f4c32c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 -- 10.20.193.28:0/2776244025 shutdown_connections 2026-02-20T13:23:44.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.359+0000 7f8a909fee00 1 -- 10.20.193.28:0/2776244025 wait complete. 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.360+0000 7f8a909fee00 1 -- start start 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.360+0000 7f8a909fee00 1 Processor -- start 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c34360 0x5572f4c38780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c38cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c79b20 0x5572f4c375a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a909fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572f4c37ae0 con 0x5572f4c34360 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a909fee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5572f4c37c50 con 0x5572f4c34c70 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a909fee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5572f4c37e10 con 0x5572f4c79b20 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c34360 0x5572f4c38780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c34360 0x5572f4c38780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34100/0 (socket says 10.20.193.28:34100) 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a87fff640 1 -- 10.20.193.28:0/3630326135 learned_addr learned my addr 10.20.193.28:0/3630326135 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a877fe640 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c38cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c79b20 0x5572f4c375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a877fe640 1 -- 10.20.193.28:0/3630326135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c79b20 msgr2=0x5572f4c375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a877fe640 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c79b20 0x5572f4c375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a877fe640 1 -- 10.20.193.28:0/3630326135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c34360 msgr2=0x5572f4c38780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a877fe640 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c34360 0x5572f4c38780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.361+0000 7f8a877fe640 1 -- 10.20.193.28:0/3630326135 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f4ac43c0 con 0x5572f4c34c70 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a877fe640 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c38cc0 secure :-1 s=READY pgs=311 gs=2 cs=0 l=1 c_cookie=11609597024198320551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a780046d0 tx=0x7f8a78013070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a11d92fbb4c5e1a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a49ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a49ffb640 1 -- 10.20.193.28:0/3630326135 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a78022040 con 0x5572f4c34c70 2026-02-20T13:23:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a49ffb640 1 -- 10.20.193.28:0/3630326135 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a7801dd70 con 0x5572f4c34c70 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a88173100 con 0x5572f4c34c70 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a909fee00 10 client.27668 _ll_register_callbacks cb 0x5572f4ac1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5572f47d66f0 con 0x5572f4c34c70 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a49ffb640 1 -- 10.20.193.28:0/3630326135 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a78004850 con 0x5572f4c34c70 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a49ffb640 1 -- 10.20.193.28:0/3630326135 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8a780049b0 con 0x5572f4c34c70 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a49ffb640 1 -- 10.20.193.28:0/3630326135 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8a78004b70 con 0x5572f4c34c70 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a909fee00 10 client.27668 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.362+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5572f4ad60e0 con 0x5572f4c34c70 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a49ffb640 1 -- 10.20.193.28:0/3630326135 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8a78027a50 con 0x5572f4c34c70 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a909fee00 10 client.27668 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a909fee00 10 client.27668 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:23:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a909fee00 20 client.27668 populate_metadata read hostname 'trial028' 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a909fee00 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5572f4c5fb70 0x5572f4c60010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a909fee00 4 client.27668 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572f4ae2f80 con 0x5572f4c5fb70 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a87fff640 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5572f4c5fb70 0x5572f4c60010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a87fff640 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5572f4c5fb70 0x5572f4c60010 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=12059378113398998491 s_cookie=17857161795940501636 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a75b8480354485db server_cookie=f7d1620ac7b5c884 in_seq=0 out_seq=0 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.363+0000 7f8a49ffb640 10 client.27668 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a49ffb640 1 -- 10.20.193.28:0/3630326135 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5572f4ae2f80 con 0x5572f4c5fb70 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a49ffb640 10 client.27668 handle_command_reply: tid=0 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 client.27668 shutdown 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 msgr2=0x5572f4c38cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c38cc0 secure :-1 s=READY pgs=311 gs=2 cs=0 l=1 c_cookie=11609597024198320551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a780046d0 tx=0x7f8a78013070 comp rx=0 tx=0).stop 2026-02-20T13:23:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 shutdown_connections 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5572f4c5fb70 0x5572f4c60010 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=12059378113398998491 s_cookie=17857161795940501636 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c79b20 0x5572f4c375a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c38cc0 unknown :-1 s=CLOSED pgs=311 gs=2 cs=0 l=1 c_cookie=11609597024198320551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 --2- 10.20.193.28:0/3630326135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c34360 0x5572f4c38780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 >> 10.20.193.28:0/3630326135 conn(0x5572f4c12860 msgr2=0x5572f4c32c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a49ffb640 0 client.27668 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.364+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 shutdown_connections 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.365+0000 7f8a909fee00 1 -- 10.20.193.28:0/3630326135 wait complete. 2026-02-20T13:23:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.365+0000 7f8a909fee00 20 client.27668 trim_cache size 0 max 16384 2026-02-20T13:23:44.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a909fee00 1 Processor -- start 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a909fee00 1 -- start start 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34360 0x5572f4c389f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34c70 0x5572f4c99600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a909fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572f4b3e080 con 0x5572f4c79b20 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a909fee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5572f47fe700 con 0x5572f4c34360 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a909fee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5572f4ba2ae0 con 0x5572f4c34c70 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34360 0x5572f4c389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34360 0x5572f4c389f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39268/0 (socket says 10.20.193.28:39268) 2026-02-20T13:23:44.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a87fff640 1 -- 10.20.193.28:0/1119859719 learned_addr learned my addr 10.20.193.28:0/1119859719 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a877fe640 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34c70 0x5572f4c99600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a877fe640 1 -- 10.20.193.28:0/1119859719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34360 msgr2=0x5572f4c389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a877fe640 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34360 0x5572f4c389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a877fe640 1 -- 10.20.193.28:0/1119859719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 msgr2=0x5572f4c99b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a877fe640 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a877fe640 1 -- 10.20.193.28:0/1119859719 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f4ad0b60 con 0x5572f4c34c70 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.372+0000 7f8a87fff640 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34360 0x5572f4c389f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a877fe640 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34c70 0x5572f4c99600 secure :-1 s=READY pgs=260 gs=2 cs=0 l=1 c_cookie=1552760594391447222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a78010b70 tx=0x7f8a7802b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158c8388a1ed36b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a4bfff640 1 -- 10.20.193.28:0/1119859719 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a780275a0 con 0x5572f4c34c70 2026-02-20T13:23:44.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a4bfff640 1 -- 10.20.193.28:0/1119859719 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5572f47d66f0 con 0x5572f4c34c70 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a4bfff640 1 -- 10.20.193.28:0/1119859719 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a78011560 con 0x5572f4c34c70 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 -- 10.20.193.28:0/1119859719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34c70 msgr2=0x5572f4c99600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34c70 0x5572f4c99600 secure :-1 s=READY pgs=260 gs=2 cs=0 l=1 c_cookie=1552760594391447222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a78010b70 tx=0x7f8a7802b000 comp rx=0 tx=0).stop 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 -- 10.20.193.28:0/1119859719 shutdown_connections 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c99b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34c70 0x5572f4c99600 unknown :-1 s=CLOSED pgs=260 gs=2 cs=0 l=1 c_cookie=1552760594391447222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 --2- 10.20.193.28:0/1119859719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34360 0x5572f4c389f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 -- 10.20.193.28:0/1119859719 >> 10.20.193.28:0/1119859719 conn(0x5572f4c12860 msgr2=0x5572f4c382e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 -- 10.20.193.28:0/1119859719 shutdown_connections 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.373+0000 7f8a909fee00 1 -- 10.20.193.28:0/1119859719 wait complete. 2026-02-20T13:23:44.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.374+0000 7f8a909fee00 1 -- start start 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.374+0000 7f8a909fee00 1 Processor -- start 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.374+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c66540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.374+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c62a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.374+0000 7f8a909fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c63170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.374+0000 7f8a909fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572f4c63870 con 0x5572f4c79b20 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.374+0000 7f8a909fee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5572f4d2e990 con 0x5572f4c34c70 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.374+0000 7f8a909fee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5572f4d2eb00 con 0x5572f4c34360 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c63170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a87fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c66540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a877fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c62a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c63170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34120/0 (socket says 10.20.193.28:34120) 2026-02-20T13:23:44.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 -- 10.20.193.28:0/2121255308 learned_addr learned my addr 10.20.193.28:0/2121255308 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 -- 10.20.193.28:0/2121255308 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 msgr2=0x5572f4c66540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c66540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 -- 10.20.193.28:0/2121255308 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 msgr2=0x5572f4c62a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c62a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 -- 10.20.193.28:0/2121255308 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f4ad60e0 con 0x5572f4c79b20 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a8cf7a640 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c63170 secure :-1 s=READY pgs=838 gs=2 cs=0 l=1 c_cookie=409402041910550429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a7c0306c0 tx=0x7f8a7c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae7cfcee65df9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a49ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a49ffb640 1 -- 10.20.193.28:0/2121255308 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a7c0054e0 con 0x5572f4c79b20 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a49ffb640 1 -- 10.20.193.28:0/2121255308 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a7c003b20 con 0x5572f4c79b20 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a880fa350 con 0x5572f4c79b20 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a49ffb640 1 -- 10.20.193.28:0/2121255308 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a7c04f6d0 con 0x5572f4c79b20 2026-02-20T13:23:44.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a909fee00 10 client.17718 _ll_register_callbacks cb 0x5572f4ac1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a7c006e20 con 0x5572f4c79b20 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.375+0000 7f8a49ffb640 1 -- 10.20.193.28:0/2121255308 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8a7c04f860 con 0x5572f4c79b20 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a49ffb640 1 -- 10.20.193.28:0/2121255308 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8a7c04fa20 con 0x5572f4c79b20 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a909fee00 10 client.17718 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5572f4ac46f0 con 0x5572f4c79b20 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a49ffb640 1 -- 10.20.193.28:0/2121255308 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8a7c043070 con 0x5572f4c79b20 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a909fee00 10 client.17718 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a909fee00 10 client.17718 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a909fee00 20 client.17718 populate_metadata read hostname 'trial028' 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5572f4d30530 0x5572f4d509e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a909fee00 4 client.17718 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572f47d3f40 con 0x5572f4d30530 2026-02-20T13:23:44.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a87fff640 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5572f4d30530 0x5572f4d509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a87fff640 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5572f4d30530 0x5572f4d509e0 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=7873238944356201248 s_cookie=9469763272239486831 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6d435d1b0e1f7320 server_cookie=836b5b85ece0176f in_seq=0 out_seq=0 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a49ffb640 10 client.17718 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.376+0000 7f8a49ffb640 1 -- 10.20.193.28:0/2121255308 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572f47d3f40 con 0x5572f4d30530 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a49ffb640 10 client.17718 handle_command_reply: tid=0 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 client.17718 shutdown 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 msgr2=0x5572f4c63170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c63170 secure :-1 s=READY pgs=838 gs=2 cs=0 l=1 c_cookie=409402041910550429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a7c0306c0 tx=0x7f8a7c0039b0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 shutdown_connections 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5572f4d30530 0x5572f4d509e0 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=7873238944356201248 s_cookie=9469763272239486831 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572f4c79b20 0x5572f4c63170 unknown :-1 s=CLOSED pgs=838 gs=2 cs=0 l=1 c_cookie=409402041910550429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a49ffb640 0 client.17718 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:23:44.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572f4c34c70 0x5572f4c62a30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 --2- 10.20.193.28:0/2121255308 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572f4c34360 0x5572f4c66540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 >> 10.20.193.28:0/2121255308 conn(0x5572f4c12860 msgr2=0x5572f4c38ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 shutdown_connections 2026-02-20T13:23:44.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 1 -- 10.20.193.28:0/2121255308 wait complete. 2026-02-20T13:23:44.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a909fee00 20 client.17718 trim_cache size 0 max 16384 2026-02-20T13:23:44.386 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a8d77b640 1 -- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8a5c0b5750 msgr2=0x7f8a5c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8a5c0b5750 0x7f8a5c0d5c00 secure :-1 s=READY pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a880fa900 tx=0x7f8a78009310 comp rx=0 tx=0).stop 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a8d77b640 1 -- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a8810bcd0 msgr2=0x7f8a880f3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.377+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a8810bcd0 0x7f8a880f3fb0 secure :-1 s=READY pgs=836 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a74009480 tx=0x7f8a7400ee60 comp rx=0 tx=0).stop 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.378+0000 7f8a8d77b640 1 -- 10.20.193.28:0/4019057070 shutdown_connections 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.378+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8a5c0b5750 0x7f8a5c0d5c00 unknown :-1 s=CLOSED pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.378+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8a88111ec0 0x7f8a880f46b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.378+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8a8810c6c0 0x7f8a88172790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.378+0000 7f8a8d77b640 1 --2- 10.20.193.28:0/4019057070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a8810bcd0 0x7f8a880f3fb0 unknown :-1 s=CLOSED pgs=836 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.378+0000 7f8a8d77b640 1 -- 10.20.193.28:0/4019057070 >> 10.20.193.28:0/4019057070 conn(0x7f8a880e95c0 msgr2=0x7f8a8810fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.378+0000 7f8a8d77b640 1 -- 10.20.193.28:0/4019057070 shutdown_connections 2026-02-20T13:23:44.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.378+0000 7f8a8d77b640 1 -- 10.20.193.28:0/4019057070 wait complete. 2026-02-20T13:23:44.478 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:23:44.665 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:44.737 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:44 trial028 ceph-mon[37442]: pgmap v373: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:23:44.737 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:44 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3975317988' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:44.792 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:44 trial034 ceph-mon[43332]: pgmap v373: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:23:44.793 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:44 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3975317988' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 -- 10.20.193.28:0/1932397242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810f4b0 msgr2=0x7fddd810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 --2- 10.20.193.28:0/1932397242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810f4b0 0x7fddd810f880 secure :-1 s=READY pgs=839 gs=1 cs=0 l=1 c_cookie=18240822654017035207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddc8009950 tx=0x7fddc802f190 comp rx=0 tx=0).stop 2026-02-20T13:23:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 -- 10.20.193.28:0/1932397242 shutdown_connections 2026-02-20T13:23:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 --2- 10.20.193.28:0/1932397242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fddd81156a0 0x7fddd8176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 --2- 10.20.193.28:0/1932397242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddd810fea0 0x7fddd8114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 --2- 10.20.193.28:0/1932397242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810f4b0 0x7fddd810f880 unknown :-1 s=CLOSED pgs=839 gs=1 cs=0 l=1 c_cookie=18240822654017035207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 -- 10.20.193.28:0/1932397242 >> 10.20.193.28:0/1932397242 conn(0x7fddd80ecda0 msgr2=0x7fddd810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 -- 10.20.193.28:0/1932397242 shutdown_connections 2026-02-20T13:23:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.837+0000 7fdddf47a640 1 -- 10.20.193.28:0/1932397242 wait complete. 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fdddf47a640 1 Processor -- start 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fdddf47a640 1 -- start start 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fdddf47a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fddd810f4b0 0x7fddd811ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fdddf47a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810fea0 0x7fddd811e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fdddf47a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddd81156a0 0x7fddd81236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fdddf47a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8123d00 con 0x7fddd810fea0 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fdddf47a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8123e70 con 0x7fddd810f4b0 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fdddf47a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8124030 con 0x7fddd81156a0 2026-02-20T13:23:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.838+0000 7fddddc77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810fea0 0x7fddd811e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddddc77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810fea0 0x7fddd811e310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34138/0 (socket says 10.20.193.28:34138) 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddddc77640 1 -- 10.20.193.28:0/2826354267 learned_addr learned my addr 10.20.193.28:0/2826354267 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddde478640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fddd810f4b0 0x7fddd811ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fdddec79640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddd81156a0 0x7fddd81236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddddc77640 1 -- 10.20.193.28:0/2826354267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddd81156a0 msgr2=0x7fddd81236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddddc77640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddd81156a0 0x7fddd81236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddddc77640 1 -- 10.20.193.28:0/2826354267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fddd810f4b0 msgr2=0x7fddd811ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddddc77640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fddd810f4b0 0x7fddd811ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddddc77640 1 -- 10.20.193.28:0/2826354267 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc8009570 con 0x7fddd810fea0 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddddc77640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810fea0 0x7fddd811e310 secure :-1 s=READY pgs=840 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc009480 tx=0x7fddcc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddbf7fe640 1 -- 10.20.193.28:0/2826354267 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc00cd40 con 0x7fddd810fea0 2026-02-20T13:23:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddbf7fe640 1 -- 10.20.193.28:0/2826354267 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fddcc004d30 con 0x7fddd810fea0 2026-02-20T13:23:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fddbf7fe640 1 -- 10.20.193.28:0/2826354267 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc010740 con 0x7fddd810fea0 2026-02-20T13:23:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fdddf47a640 1 -- 10.20.193.28:0/2826354267 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd8124310 con 0x7fddd810fea0 2026-02-20T13:23:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.839+0000 7fdddf47a640 1 -- 10.20.193.28:0/2826354267 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd8164a10 con 0x7fddd810fea0 2026-02-20T13:23:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.842+0000 7fddbf7fe640 1 -- 10.20.193.28:0/2826354267 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fddcc01f060 con 0x7fddd810fea0 2026-02-20T13:23:44.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.844+0000 7fddbf7fe640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fddb40b5760 0x7fddb40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.844+0000 7fddbf7fe640 1 -- 10.20.193.28:0/2826354267 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fddcc014070 con 0x7fddd810fea0 2026-02-20T13:23:44.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.844+0000 7fddde478640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fddb40b5760 0x7fddb40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdde26fde00 1 Processor -- start 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdde26fde00 1 -- start start 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddde478640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fddb40b5760 0x7fddb40d5c10 secure :-1 s=READY pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddc80098a0 tx=0x7fddc803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab54d70 0x559f9ab55140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9ab99ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9abba910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdde26fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f9aa62780 con 0x559f9ab55680 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdde26fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f9aa5e4b0 con 0x559f9ab54d70 2026-02-20T13:23:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdde26fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f9aa58450 con 0x559f9ab9a530 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddde478640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab54d70 0x559f9ab55140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddde478640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab54d70 0x559f9ab55140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39312/0 (socket says 10.20.193.28:39312) 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fdddec79640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9abba910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddde478640 1 -- 10.20.193.28:0/2080819875 learned_addr learned my addr 10.20.193.28:0/2080819875 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddddc77640 1 --2- 10.20.193.28:0/2080819875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9ab99ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddddc77640 1 -- 10.20.193.28:0/2080819875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 msgr2=0x559f9abba910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddddc77640 1 --2- 10.20.193.28:0/2080819875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9abba910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddddc77640 1 -- 10.20.193.28:0/2080819875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab54d70 msgr2=0x559f9ab55140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddddc77640 1 --2- 10.20.193.28:0/2080819875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab54d70 0x559f9ab55140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.845+0000 7fddddc77640 1 -- 10.20.193.28:0/2080819875 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9aa03d10 con 0x559f9ab55680 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fddddc77640 1 --2- 10.20.193.28:0/2080819875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9ab99ff0 secure :-1 s=READY pgs=841 gs=1 cs=0 l=1 c_cookie=9186793904304260441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc0a9600 tx=0x7fddcc0a9680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7e0c61dac78559 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fddbccf3640 1 -- 10.20.193.28:0/2080819875 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc0ac830 con 0x559f9ab55680 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fddbccf3640 1 -- 10.20.193.28:0/2080819875 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fddcc0ada30 con 0x559f9ab55680 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fddbccf3640 1 -- 10.20.193.28:0/2080819875 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc0acbd0 con 0x559f9ab55680 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 -- 10.20.193.28:0/2080819875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 msgr2=0x559f9ab99ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 --2- 10.20.193.28:0/2080819875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9ab99ff0 secure :-1 s=READY pgs=841 gs=1 cs=0 l=1 c_cookie=9186793904304260441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc0a9600 tx=0x7fddcc0a9680 comp rx=0 tx=0).stop 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 -- 10.20.193.28:0/2080819875 shutdown_connections 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 --2- 10.20.193.28:0/2080819875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9ab99ff0 unknown :-1 s=CLOSED pgs=841 gs=1 cs=0 l=1 c_cookie=9186793904304260441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 --2- 10.20.193.28:0/2080819875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9abba910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 --2- 10.20.193.28:0/2080819875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab54d70 0x559f9ab55140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 -- 10.20.193.28:0/2080819875 >> 10.20.193.28:0/2080819875 conn(0x559f9ab2a860 msgr2=0x559f9ab4ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 -- 10.20.193.28:0/2080819875 shutdown_connections 2026-02-20T13:23:44.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.846+0000 7fdde26fde00 1 -- 10.20.193.28:0/2080819875 wait complete. 2026-02-20T13:23:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.847+0000 7fdde26fde00 1 -- start start 2026-02-20T13:23:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fdde26fde00 1 Processor -- start 2026-02-20T13:23:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9abb2670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab9a530 0x559f9abb7660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fdde26fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f9abb7ba0 con 0x559f9ab55680 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fdde26fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f9abb7d10 con 0x559f9ab9a530 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fdde26fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f9abb7ed0 con 0x559f9ab54d70 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddddc77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9abb2670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddde478640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddddc77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9abb2670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34156/0 (socket says 10.20.193.28:34156) 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddddc77640 1 -- 10.20.193.28:0/3222791540 learned_addr learned my addr 10.20.193.28:0/3222791540 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fdddec79640 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab9a530 0x559f9abb7660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddddc77640 1 -- 10.20.193.28:0/3222791540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 msgr2=0x559f9abb2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddddc77640 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddddc77640 1 -- 10.20.193.28:0/3222791540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab9a530 msgr2=0x559f9abb7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddddc77640 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab9a530 0x559f9abb7660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.848+0000 7fddddc77640 1 -- 10.20.193.28:0/3222791540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9a9dc3c0 con 0x559f9ab55680 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fddddc77640 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9abb2670 secure :-1 s=READY pgs=842 gs=1 cs=0 l=1 c_cookie=15369846570571637508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc0adbe0 tx=0x7fddcc0e6cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54caa05e32da304 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdd8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3222791540 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc0b8170 con 0x559f9ab55680 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3222791540 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fddcc0c4e90 con 0x559f9ab55680 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3222791540 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc0ace50 con 0x559f9ab55680 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddcc096040 con 0x559f9ab55680 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 10 client.17730 _ll_register_callbacks cb 0x559f9a9d9a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f9a6ee6f0 con 0x559f9ab55680 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3222791540 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fddcc0b7ce0 con 0x559f9ab55680 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3222791540 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddcc0b7ee0 con 0x559f9ab55680 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 10 client.17730 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559f9a9ee0e0 con 0x559f9ab55680 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3222791540 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fddcc0adcc0 con 0x559f9ab55680 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 10 client.17730 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 10 client.17730 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 20 client.17730 populate_metadata read hostname 'trial028' 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x559f9ab97590 0x559f9ab97a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 4 client.17730 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.849+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f9a9faf80 con 0x559f9ab97590 2026-02-20T13:23:44.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.850+0000 7fddde478640 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x559f9ab97590 0x559f9ab97a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.850+0000 7fdd8bfff640 10 client.17730 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.850+0000 7fddde478640 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x559f9ab97590 0x559f9ab97a30 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=6915029327449987400 s_cookie=1454606719635583274 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5ff71e8932109948 server_cookie=142fcd1acbc6712a in_seq=0 out_seq=0 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3222791540 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559f9a9faf80 con 0x559f9ab97590 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdd8bfff640 10 client.17730 handle_command_reply: tid=0 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 client.17730 shutdown 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 msgr2=0x559f9abb2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9abb2670 secure :-1 s=READY pgs=842 gs=1 cs=0 l=1 c_cookie=15369846570571637508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc0adbe0 tx=0x7fddcc0e6cd0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 shutdown_connections 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x559f9ab97590 0x559f9ab97a30 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=6915029327449987400 s_cookie=1454606719635583274 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab55680 0x559f9abb2670 unknown :-1 s=CLOSED pgs=842 gs=1 cs=0 l=1 c_cookie=15369846570571637508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab9a530 0x559f9abb7660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3222791540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 >> 10.20.193.28:0/3222791540 conn(0x559f9ab2a860 msgr2=0x559f9ab4ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdd8bfff640 0 client.17730 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:23:44.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 shutdown_connections 2026-02-20T13:23:44.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.851+0000 7fdde26fde00 1 -- 10.20.193.28:0/3222791540 wait complete. 2026-02-20T13:23:44.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.852+0000 7fdde26fde00 20 client.17730 trim_cache size 0 max 16384 2026-02-20T13:23:44.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.858+0000 7fdde26fde00 1 Processor -- start 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fdde26fde00 1 -- start start 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab98800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab9a530 0x559f9ab98d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fdde26fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f9aa56080 con 0x559f9ab9a530 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fdde26fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f9a716700 con 0x559f9ab55680 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fdde26fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f9abbad70 con 0x559f9ab54d70 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fdddec79640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab9a530 0x559f9ab98d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53664/0 (socket says 10.20.193.28:53664) 2026-02-20T13:23:44.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 -- 10.20.193.28:0/1417103122 learned_addr learned my addr 10.20.193.28:0/1417103122 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddddc77640 1 --2- 10.20.193.28:0/1417103122 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab98800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 -- 10.20.193.28:0/1417103122 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 msgr2=0x559f9ab98800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 --2- 10.20.193.28:0/1417103122 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab98800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 -- 10.20.193.28:0/1417103122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab9a530 msgr2=0x559f9ab98d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 --2- 10.20.193.28:0/1417103122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab9a530 0x559f9ab98d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 -- 10.20.193.28:0/1417103122 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9abb2a20 con 0x559f9ab54d70 2026-02-20T13:23:44.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.859+0000 7fddde478640 1 --2- 10.20.193.28:0/1417103122 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2340 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=15578643815496225823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddc8005b30 tx=0x7fddc8040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8327602d0fd141f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdda64e6640 1 -- 10.20.193.28:0/1417103122 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddc8057070 con 0x559f9ab54d70 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdda64e6640 1 -- 10.20.193.28:0/1417103122 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fddc803e040 con 0x559f9ab54d70 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdda64e6640 1 -- 10.20.193.28:0/1417103122 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddc8038c30 con 0x559f9ab54d70 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 -- 10.20.193.28:0/1417103122 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 msgr2=0x559f9abb2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 --2- 10.20.193.28:0/1417103122 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2340 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=15578643815496225823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddc8005b30 tx=0x7fddc8040000 comp rx=0 tx=0).stop 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 -- 10.20.193.28:0/1417103122 shutdown_connections 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 --2- 10.20.193.28:0/1417103122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab9a530 0x559f9ab98d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 --2- 10.20.193.28:0/1417103122 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab98800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 --2- 10.20.193.28:0/1417103122 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab54d70 0x559f9abb2340 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=15578643815496225823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 -- 10.20.193.28:0/1417103122 >> 10.20.193.28:0/1417103122 conn(0x559f9ab2a860 msgr2=0x559f9ab980f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 -- 10.20.193.28:0/1417103122 shutdown_connections 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.860+0000 7fdde26fde00 1 -- 10.20.193.28:0/1417103122 wait complete. 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdde26fde00 1 -- start start 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdde26fde00 1 Processor -- start 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab54d70 0x559f9ab2bf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab2c4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdde26fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9ab2c9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdde26fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f9ab2a2a0 con 0x559f9ab54d70 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdde26fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f9abb8f40 con 0x559f9ab55680 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdde26fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f9aba6a60 con 0x559f9ab9a530 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.861+0000 7fdddec79640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9ab2c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fddde478640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab54d70 0x559f9ab2bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fddddc77640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab2c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fdddec79640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9ab2c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53678/0 (socket says 10.20.193.28:53678) 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fdddec79640 1 -- 10.20.193.28:0/3802632918 learned_addr learned my addr 10.20.193.28:0/3802632918 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fddddc77640 1 -- 10.20.193.28:0/3802632918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 msgr2=0x559f9ab2c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fddddc77640 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9ab2c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fddddc77640 1 -- 10.20.193.28:0/3802632918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab54d70 msgr2=0x559f9ab2bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fddddc77640 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab54d70 0x559f9ab2bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fddddc77640 1 -- 10.20.193.28:0/3802632918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9a9e8b60 con 0x559f9ab55680 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fddddc77640 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab2c4a0 secure :-1 s=READY pgs=312 gs=3 cs=0 l=1 c_cookie=15104587610955888620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc005570 tx=0x7fddcc005610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19e466795cab7ec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fdd8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3802632918 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc0b8170 con 0x559f9ab55680 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3802632918 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fddcc0c4e90 con 0x559f9ab55680 2026-02-20T13:23:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3802632918 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc0b2de0 con 0x559f9ab55680 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd81768e0 con 0x559f9ab55680 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.862+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3802632918 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fddcc0acde0 con 0x559f9ab55680 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdd8bfff640 10 client.27692 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 10 client.27692 _ll_register_callbacks cb 0x559f9a9d9a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddcc0ada30 con 0x559f9ab55680 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3802632918 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddcc0b7ce0 con 0x559f9ab55680 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 10 client.27692 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559f9a9dc6f0 con 0x559f9ab55680 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3802632918 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fddcc0722f0 con 0x559f9ab55680 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 10 client.27692 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 10 client.27692 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 20 client.27692 populate_metadata read hostname 'trial028' 2026-02-20T13:23:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x559f9ac47a30 0x559f9ac67e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 4 client.27692 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f9a6ebf40 con 0x559f9ac47a30 2026-02-20T13:23:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.863+0000 7fddde478640 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x559f9ac47a30 0x559f9ac67e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.864+0000 7fddde478640 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x559f9ac47a30 0x559f9ac67e10 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=5230627829314257670 s_cookie=4052298191886790393 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4896ec4c368c8306 server_cookie=383ca7bc4b5eaef9 in_seq=0 out_seq=0 2026-02-20T13:23:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.864+0000 7fdd8bfff640 10 client.27692 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:23:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.864+0000 7fdd8bfff640 1 -- 10.20.193.28:0/3802632918 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f9a6ebf40 con 0x559f9ac47a30 2026-02-20T13:23:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.864+0000 7fdd8bfff640 10 client.27692 handle_command_reply: tid=0 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.864+0000 7fdde26fde00 1 client.27692 shutdown 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.864+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 msgr2=0x559f9ab2c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.864+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab2c4a0 secure :-1 s=READY pgs=312 gs=3 cs=0 l=1 c_cookie=15104587610955888620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc005570 tx=0x7fddcc005610 comp rx=0 tx=0).stop 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 shutdown_connections 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x559f9ac47a30 0x559f9ac67e10 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=5230627829314257670 s_cookie=4052298191886790393 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f9ab9a530 0x559f9ab2c9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f9ab55680 0x559f9ab2c4a0 unknown :-1 s=CLOSED pgs=312 gs=3 cs=0 l=1 c_cookie=15104587610955888620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 1 --2- 10.20.193.28:0/3802632918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f9ab54d70 0x559f9ab2bf60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdd8bfff640 0 client.27692 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 >> 10.20.193.28:0/3802632918 conn(0x559f9ab2a860 msgr2=0x559f9ab988e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 shutdown_connections 2026-02-20T13:23:44.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 1 -- 10.20.193.28:0/3802632918 wait complete. 2026-02-20T13:23:44.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdde26fde00 20 client.27692 trim_cache size 0 max 16384 2026-02-20T13:23:44.874 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:44.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 -- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fddb40b5760 msgr2=0x7fddb40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fddb40b5760 0x7fddb40d5c10 secure :-1 s=READY pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddc80098a0 tx=0x7fddc803a040 comp rx=0 tx=0).stop 2026-02-20T13:23:44.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 -- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810fea0 msgr2=0x7fddd811e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:44.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810fea0 0x7fddd811e310 secure :-1 s=READY pgs=840 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc009480 tx=0x7fddcc00ee60 comp rx=0 tx=0).stop 2026-02-20T13:23:44.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 -- 10.20.193.28:0/2826354267 shutdown_connections 2026-02-20T13:23:44.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fddb40b5760 0x7fddb40d5c10 unknown :-1 s=CLOSED pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fddd810fea0 0x7fddd811e310 unknown :-1 s=CLOSED pgs=840 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddd81156a0 0x7fddd81236e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 --2- 10.20.193.28:0/2826354267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fddd810f4b0 0x7fddd811ddd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:44.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 -- 10.20.193.28:0/2826354267 >> 10.20.193.28:0/2826354267 conn(0x7fddd80ecda0 msgr2=0x7fddd810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:44.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.865+0000 7fdddf47a640 1 -- 10.20.193.28:0/2826354267 shutdown_connections 2026-02-20T13:23:44.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:44.866+0000 7fdddf47a640 1 -- 10.20.193.28:0/2826354267 wait complete. 2026-02-20T13:23:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:44 trial127 ceph-mon[43817]: pgmap v373: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:23:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:44 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3975317988' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:23:45.000 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:23:45.183 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:45.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 -- 10.20.193.28:0/3690413437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb010fea0 msgr2=0x7f4eb0114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 --2- 10.20.193.28:0/3690413437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb010fea0 0x7f4eb0114ef0 secure :-1 s=READY pgs=843 gs=2 cs=0 l=1 c_cookie=16661845992573897880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea4009890 tx=0x7f4ea402f120 comp rx=0 tx=0).stop 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 -- 10.20.193.28:0/3690413437 shutdown_connections 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 --2- 10.20.193.28:0/3690413437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb010fea0 0x7f4eb0114ef0 unknown :-1 s=CLOSED pgs=843 gs=2 cs=0 l=1 c_cookie=16661845992573897880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 --2- 10.20.193.28:0/3690413437 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4eb01156a0 0x7f4eb0176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 --2- 10.20.193.28:0/3690413437 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4eb010f4b0 0x7f4eb010f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 -- 10.20.193.28:0/3690413437 >> 10.20.193.28:0/3690413437 conn(0x7f4eb00ecd60 msgr2=0x7f4eb010d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 -- 10.20.193.28:0/3690413437 shutdown_connections 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.364+0000 7f4eb6414640 1 -- 10.20.193.28:0/3690413437 wait complete. 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb6414640 1 Processor -- start 2026-02-20T13:23:45.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb6414640 1 -- start start 2026-02-20T13:23:45.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb6414640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4eb010f4b0 0x7f4eb00f5780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb6414640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4eb010fea0 0x7f4eb0175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb6414640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb01156a0 0x7f4eb00f5e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb6414640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00fb090 con 0x7f4eb01156a0 2026-02-20T13:23:45.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb6414640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00fb200 con 0x7f4eb010f4b0 2026-02-20T13:23:45.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb6414640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00fb3c0 con 0x7f4eb010fea0 2026-02-20T13:23:45.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb5c13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb01156a0 0x7f4eb00f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb5c13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb01156a0 0x7f4eb00f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34194/0 (socket says 10.20.193.28:34194) 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb5c13640 1 -- 10.20.193.28:0/1783375640 learned_addr learned my addr 10.20.193.28:0/1783375640 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb5412640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4eb010f4b0 0x7f4eb00f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.365+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4eb010fea0 0x7f4eb0175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4eb5c13640 1 -- 10.20.193.28:0/1783375640 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4eb010fea0 msgr2=0x7f4eb0175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4eb010fea0 0x7f4eb0175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4eb5c13640 1 -- 10.20.193.28:0/1783375640 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4eb010f4b0 msgr2=0x7f4eb00f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4eb010f4b0 0x7f4eb00f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4eb5c13640 1 -- 10.20.193.28:0/1783375640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea40094b0 con 0x7f4eb01156a0 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb01156a0 0x7f4eb00f5e80 secure :-1 s=READY pgs=844 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4eac00f8d0 tx=0x7f4eac00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4e9e7fc640 1 -- 10.20.193.28:0/1783375640 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4eac00dce0 con 0x7f4eb01156a0 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4e9e7fc640 1 -- 10.20.193.28:0/1783375640 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4eac00de40 con 0x7f4eb01156a0 2026-02-20T13:23:45.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4e9e7fc640 1 -- 10.20.193.28:0/1783375640 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4eac0116b0 con 0x7f4eb01156a0 2026-02-20T13:23:45.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4eb6414640 1 -- 10.20.193.28:0/1783375640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb00fb6a0 con 0x7f4eb01156a0 2026-02-20T13:23:45.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.366+0000 7f4eb6414640 1 -- 10.20.193.28:0/1783375640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb00fbb20 con 0x7f4eb01156a0 2026-02-20T13:23:45.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.369+0000 7f4e9e7fc640 1 -- 10.20.193.28:0/1783375640 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f4eac005850 con 0x7f4eb01156a0 2026-02-20T13:23:45.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.371+0000 7f4e9e7fc640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e8c0b5750 0x7f4e8c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.371+0000 7f4e9e7fc640 1 -- 10.20.193.28:0/1783375640 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4eac015070 con 0x7f4eb01156a0 2026-02-20T13:23:45.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.371+0000 7f4eb5412640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e8c0b5750 0x7f4e8c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.371+0000 7f4eb9697e00 1 Processor -- start 2026-02-20T13:23:45.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb9697e00 1 -- start start 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9ba4730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4c70 0x55dcd9be95e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9c09f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9aba780 con 0x55dcd9ba4360 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9ab64b0 con 0x55dcd9ba4c70 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9ab0450 con 0x55dcd9be9b20 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb4c11640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4c70 0x55dcd9be95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb4c11640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4c70 0x55dcd9be95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39386/0 (socket says 10.20.193.28:39386) 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb4c11640 1 -- 10.20.193.28:0/1648107497 learned_addr learned my addr 10.20.193.28:0/1648107497 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9c09f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb5412640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e8c0b5750 0x7f4e8c0d5c00 secure :-1 s=READY pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea0004740 tx=0x7f4ea0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb5412640 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9ba4730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb4c11640 1 -- 10.20.193.28:0/1648107497 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 msgr2=0x55dcd9c09f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9c09f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb4c11640 1 -- 10.20.193.28:0/1648107497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 msgr2=0x55dcd9ba4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9ba4730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb4c11640 1 -- 10.20.193.28:0/1648107497 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd9a5bd10 con 0x55dcd9ba4c70 2026-02-20T13:23:45.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.372+0000 7f4eb5412640 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9ba4730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:45.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4c70 0x55dcd9be95e0 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=3875062056741727184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea40384b0 tx=0x7f4ea4002390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c6fc68deaf6bd0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4e7dce5640 1 -- 10.20.193.28:0/1648107497 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ea403d050 con 0x55dcd9ba4c70 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4e7dce5640 1 -- 10.20.193.28:0/1648107497 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ea403e040 con 0x55dcd9ba4c70 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4e7dce5640 1 -- 10.20.193.28:0/1648107497 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ea40046b0 con 0x55dcd9ba4c70 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1648107497 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4c70 msgr2=0x55dcd9be95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4c70 0x55dcd9be95e0 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=3875062056741727184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea40384b0 tx=0x7f4ea4002390 comp rx=0 tx=0).stop 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1648107497 shutdown_connections 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9c09f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4c70 0x55dcd9be95e0 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=3875062056741727184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1648107497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9ba4730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1648107497 >> 10.20.193.28:0/1648107497 conn(0x55dcd9b82860 msgr2=0x55dcd9ba2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1648107497 shutdown_connections 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.373+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1648107497 wait complete. 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.374+0000 7f4eb9697e00 1 -- start start 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb9697e00 1 Processor -- start 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9c01750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c01c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9c071c0 con 0x55dcd9ba4c70 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9c07330 con 0x55dcd9ba4360 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9c074f0 con 0x55dcd9be9b20 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb4c11640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c01c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5412640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9c01750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5412640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9c01750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39398/0 (socket says 10.20.193.28:39398) 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb4c11640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c01c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34218/0 (socket says 10.20.193.28:34218) 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5412640 1 -- 10.20.193.28:0/3659871026 learned_addr learned my addr 10.20.193.28:0/3659871026 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5412640 1 -- 10.20.193.28:0/3659871026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 msgr2=0x55dcd9c06c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5412640 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5412640 1 -- 10.20.193.28:0/3659871026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 msgr2=0x55dcd9c01c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5412640 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c01c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb5412640 1 -- 10.20.193.28:0/3659871026 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd9a343c0 con 0x55dcd9ba4360 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.375+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c01c90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4eb5412640 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9c01750 secure :-1 s=READY pgs=314 gs=2 cs=0 l=1 c_cookie=17245296971864476260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea0009380 tx=0x7f4ea00047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef539a39f61a0a64 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4e6affd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4e6affd640 1 -- 10.20.193.28:0/3659871026 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ea0021070 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4e6affd640 1 -- 10.20.193.28:0/3659871026 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ea001a450 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb01768e0 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4e6affd640 1 -- 10.20.193.28:0/3659871026 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ea000e660 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4e6affd640 1 -- 10.20.193.28:0/3659871026 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4ea000e7f0 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4eb9697e00 10 client.27704 _ll_register_callbacks cb 0x55dcd9a31a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dcd97466f0 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.376+0000 7f4e6affd640 1 -- 10.20.193.28:0/3659871026 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ea001c9f0 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb9697e00 10 client.27704 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dcd9a460e0 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4e6affd640 1 -- 10.20.193.28:0/3659871026 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4ea002d060 con 0x55dcd9ba4360 2026-02-20T13:23:45.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb9697e00 10 client.27704 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:45.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb9697e00 10 client.27704 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:23:45.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb9697e00 20 client.27704 populate_metadata read hostname 'trial028' 2026-02-20T13:23:45.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55dcd9c09c70 0x55dcd9be78a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb9697e00 4 client.27704 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:45.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcd9a52f80 con 0x55dcd9c09c70 2026-02-20T13:23:45.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.377+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55dcd9c09c70 0x55dcd9be78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.378+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55dcd9c09c70 0x55dcd9be78a0 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=9559417157664334094 s_cookie=8071890746447558482 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84a9df41c65b610e server_cookie=70051dddffc4f752 in_seq=0 out_seq=0 2026-02-20T13:23:45.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.378+0000 7f4e6affd640 10 client.27704 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:23:45.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.378+0000 7f4e6affd640 1 -- 10.20.193.28:0/3659871026 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dcd9a52f80 con 0x55dcd9c09c70 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.378+0000 7f4e6affd640 10 client.27704 handle_command_reply: tid=0 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.378+0000 7f4eb9697e00 1 client.27704 shutdown 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.378+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 msgr2=0x55dcd9c01750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.378+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9c01750 secure :-1 s=READY pgs=314 gs=2 cs=0 l=1 c_cookie=17245296971864476260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea0009380 tx=0x7f4ea00047e0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 shutdown_connections 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55dcd9c09c70 0x55dcd9be78a0 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=9559417157664334094 s_cookie=8071890746447558482 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c01c90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3659871026 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9c01750 unknown :-1 s=CLOSED pgs=314 gs=2 cs=0 l=1 c_cookie=17245296971864476260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4e6affd640 0 client.27704 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 >> 10.20.193.28:0/3659871026 conn(0x55dcd9b82860 msgr2=0x55dcd9ba2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 shutdown_connections 2026-02-20T13:23:45.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3659871026 wait complete. 2026-02-20T13:23:45.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.379+0000 7f4eb9697e00 20 client.27704 trim_cache size 0 max 16384 2026-02-20T13:23:45.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb9697e00 1 Processor -- start 2026-02-20T13:23:45.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb9697e00 1 -- start start 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9bfe950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9bfee90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9be4780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9aae080 con 0x55dcd9ba4c70 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dcd976e700 con 0x55dcd9ba4360 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9b822a0 con 0x55dcd9be9b20 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb5412640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9bfe950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb5412640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9bfe950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39404/0 (socket says 10.20.193.28:39404) 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb5412640 1 -- 10.20.193.28:0/3133000406 learned_addr learned my addr 10.20.193.28:0/3133000406 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9bfee90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.387+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9be4780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb5412640 1 -- 10.20.193.28:0/3133000406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 msgr2=0x55dcd9be4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb5412640 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9be4780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb5412640 1 -- 10.20.193.28:0/3133000406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 msgr2=0x55dcd9bfee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb5412640 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9bfee90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb5412640 1 -- 10.20.193.28:0/3133000406 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd9a40b60 con 0x55dcd9ba4360 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9bfee90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb5412640 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9bfe950 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=17189869579291565831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea0025e00 tx=0x7f4ea002b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8eaf4e78f79f07 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4e7d4e4640 1 -- 10.20.193.28:0/3133000406 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ea0021040 con 0x55dcd9ba4360 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4e7d4e4640 1 -- 10.20.193.28:0/3133000406 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55dcd97466f0 con 0x55dcd9ba4360 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4e7d4e4640 1 -- 10.20.193.28:0/3133000406 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ea000e980 con 0x55dcd9ba4360 2026-02-20T13:23:45.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3133000406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 msgr2=0x55dcd9bfe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9bfe950 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=17189869579291565831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea0025e00 tx=0x7f4ea002b000 comp rx=0 tx=0).stop 2026-02-20T13:23:45.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3133000406 shutdown_connections 2026-02-20T13:23:45.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4c70 0x55dcd9bfee90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9be9b20 0x55dcd9be4780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/3133000406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9ba4360 0x55dcd9bfe950 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=17189869579291565831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.388+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3133000406 >> 10.20.193.28:0/3133000406 conn(0x55dcd9b82860 msgr2=0x55dcd9bebf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3133000406 shutdown_connections 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 -- 10.20.193.28:0/3133000406 wait complete. 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 -- start start 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 Processor -- start 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9b88710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c05b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9c61df0 con 0x55dcd9ba4360 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9c065a0 con 0x55dcd9be9b20 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.389+0000 7f4eb9697e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dcd9c06760 con 0x55dcd9ba4c70 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39418/0 (socket says 10.20.193.28:39418) 2026-02-20T13:23:45.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb4c11640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c05b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5412640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9b88710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 -- 10.20.193.28:0/1362203439 learned_addr learned my addr 10.20.193.28:0/1362203439 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 -- 10.20.193.28:0/1362203439 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9ba4c70 msgr2=0x55dcd9c05b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c05b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 -- 10.20.193.28:0/1362203439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 msgr2=0x55dcd9b88710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9b88710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 -- 10.20.193.28:0/1362203439 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd9a346f0 con 0x55dcd9be9b20 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb4c11640 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c05b20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5412640 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9b88710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb5c13640 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06060 secure :-1 s=READY pgs=316 gs=2 cs=0 l=1 c_cookie=6409571102111200590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4eac0e59c0 tx=0x7f4eac006640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58f35ef53ff2754e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4e6affd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:45.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4e6affd640 1 -- 10.20.193.28:0/1362203439 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4eac0b6580 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4e6affd640 1 -- 10.20.193.28:0/1362203439 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4eac06f070 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.390+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcd9a460e0 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4e6affd640 1 -- 10.20.193.28:0/1362203439 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4eac01f2e0 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4e6affd640 1 -- 10.20.193.28:0/1362203439 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4eac01f470 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 10 client.27710 _ll_register_callbacks cb 0x55dcd9a31a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ea403e040 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4e6affd640 1 -- 10.20.193.28:0/1362203439 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4eac0b93c0 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 10 client.27710 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dcd9a46340 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4e6affd640 1 -- 10.20.193.28:0/1362203439 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4eac0aef10 con 0x55dcd9be9b20 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 10 client.27710 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:45.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 10 client.27710 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 20 client.27710 populate_metadata read hostname 'trial028' 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55dcd9ca8c50 0x55dcd9cc9100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 4 client.27710 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dcd9743f40 con 0x55dcd9ca8c50 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.391+0000 7f4eb5412640 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55dcd9ca8c50 0x55dcd9cc9100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb5412640 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55dcd9ca8c50 0x55dcd9cc9100 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=2376350745899904031 s_cookie=14161918967346390883 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=20fa7e69b7192c1f server_cookie=c4893e448a8c6763 in_seq=0 out_seq=0 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4e6affd640 10 client.27710 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4e6affd640 1 -- 10.20.193.28:0/1362203439 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dcd9743f40 con 0x55dcd9ca8c50 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4e6affd640 10 client.27710 handle_command_reply: tid=0 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 client.27710 shutdown 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9be9b20 msgr2=0x55dcd9c06060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06060 secure :-1 s=READY pgs=316 gs=2 cs=0 l=1 c_cookie=6409571102111200590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4eac0e59c0 tx=0x7f4eac006640 comp rx=0 tx=0).stop 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 shutdown_connections 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55dcd9ca8c50 0x55dcd9cc9100 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=2376350745899904031 s_cookie=14161918967346390883 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dcd9be9b20 0x55dcd9c06060 unknown :-1 s=CLOSED pgs=316 gs=2 cs=0 l=1 c_cookie=6409571102111200590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dcd9ba4c70 0x55dcd9c05b20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 --2- 10.20.193.28:0/1362203439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dcd9ba4360 0x55dcd9b88710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4e6affd640 0 client.27710 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 >> 10.20.193.28:0/1362203439 conn(0x55dcd9b82860 msgr2=0x55dcd9bfd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 shutdown_connections 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 1 -- 10.20.193.28:0/1362203439 wait complete. 2026-02-20T13:23:45.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.392+0000 7f4eb9697e00 20 client.27710 trim_cache size 0 max 16384 2026-02-20T13:23:45.402 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:45.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 -- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e8c0b5750 msgr2=0x7f4e8c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e8c0b5750 0x7f4e8c0d5c00 secure :-1 s=READY pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ea0004740 tx=0x7f4ea0009310 comp rx=0 tx=0).stop 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 -- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb01156a0 msgr2=0x7f4eb00f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb01156a0 0x7f4eb00f5e80 secure :-1 s=READY pgs=844 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4eac00f8d0 tx=0x7f4eac00fda0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 -- 10.20.193.28:0/1783375640 shutdown_connections 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f4e8c0b5750 0x7f4e8c0d5c00 unknown :-1 s=CLOSED pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4eb01156a0 0x7f4eb00f5e80 unknown :-1 s=CLOSED pgs=844 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4eb010fea0 0x7f4eb0175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 --2- 10.20.193.28:0/1783375640 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4eb010f4b0 0x7f4eb00f5780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 -- 10.20.193.28:0/1783375640 >> 10.20.193.28:0/1783375640 conn(0x7f4eb00ecd60 msgr2=0x7f4eb0111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 -- 10.20.193.28:0/1783375640 shutdown_connections 2026-02-20T13:23:45.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.393+0000 7f4eb6414640 1 -- 10.20.193.28:0/1783375640 wait complete. 2026-02-20T13:23:45.529 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:23:45.716 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:45.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 -- 10.20.193.28:0/2613587169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a8010ffe0 msgr2=0x7f9a80115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2613587169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a8010ffe0 0x7f9a80115030 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=5474527687145644553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a74009950 tx=0x7f9a7402f190 comp rx=0 tx=0).stop 2026-02-20T13:23:45.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 -- 10.20.193.28:0/2613587169 shutdown_connections 2026-02-20T13:23:45.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2613587169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a801157e0 0x7f9a801761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2613587169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a8010ffe0 0x7f9a80115030 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=5474527687145644553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2613587169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a8010f5f0 0x7f9a8010f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 -- 10.20.193.28:0/2613587169 >> 10.20.193.28:0/2613587169 conn(0x7f9a800ecea0 msgr2=0x7f9a8010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 -- 10.20.193.28:0/2613587169 shutdown_connections 2026-02-20T13:23:45.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.887+0000 7f9a8878e640 1 -- 10.20.193.28:0/2613587169 wait complete. 2026-02-20T13:23:45.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a8878e640 1 Processor -- start 2026-02-20T13:23:45.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a8878e640 1 -- start start 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a8878e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a8010f5f0 0x7f9a800f4e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a8878e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a8010ffe0 0x7f9a801760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a8878e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a801157e0 0x7f9a800f5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a8878e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800fa750 con 0x7f9a801157e0 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a8878e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800fa8c0 con 0x7f9a8010ffe0 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a8878e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800faa80 con 0x7f9a8010f5f0 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a85d02640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a8010ffe0 0x7f9a801760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86d04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a801157e0 0x7f9a800f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86503640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a8010f5f0 0x7f9a800f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86d04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a801157e0 0x7f9a800f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34258/0 (socket says 10.20.193.28:34258) 2026-02-20T13:23:45.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86503640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a8010f5f0 0x7f9a800f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53752/0 (socket says 10.20.193.28:53752) 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86d04640 1 -- 10.20.193.28:0/2970867159 learned_addr learned my addr 10.20.193.28:0/2970867159 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86d04640 1 -- 10.20.193.28:0/2970867159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a8010f5f0 msgr2=0x7f9a800f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86d04640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a8010f5f0 0x7f9a800f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86d04640 1 -- 10.20.193.28:0/2970867159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a8010ffe0 msgr2=0x7f9a801760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86d04640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a8010ffe0 0x7f9a801760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.888+0000 7f9a86d04640 1 -- 10.20.193.28:0/2970867159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a74009570 con 0x7f9a801157e0 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.889+0000 7f9a86d04640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a801157e0 0x7f9a800f5590 secure :-1 s=READY pgs=845 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7c00f8d0 tx=0x7f9a7c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.889+0000 7f9a677fe640 1 -- 10.20.193.28:0/2970867159 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a7c00dce0 con 0x7f9a801157e0 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.889+0000 7f9a677fe640 1 -- 10.20.193.28:0/2970867159 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a7c00de40 con 0x7f9a801157e0 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.889+0000 7f9a677fe640 1 -- 10.20.193.28:0/2970867159 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a7c0116b0 con 0x7f9a801157e0 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.889+0000 7f9a8878e640 1 -- 10.20.193.28:0/2970867159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a800fad60 con 0x7f9a801157e0 2026-02-20T13:23:45.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.889+0000 7f9a8878e640 1 -- 10.20.193.28:0/2970867159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a800fb1e0 con 0x7f9a801157e0 2026-02-20T13:23:45.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.892+0000 7f9a677fe640 1 -- 10.20.193.28:0/2970867159 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9a7c020060 con 0x7f9a801157e0 2026-02-20T13:23:45.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.893+0000 7f9a677fe640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a5c0b5750 0x7f9a5c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.893+0000 7f9a677fe640 1 -- 10.20.193.28:0/2970867159 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9a7c015070 con 0x7f9a801157e0 2026-02-20T13:23:45.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a86503640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a5c0b5750 0x7f9a5c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a86503640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a5c0b5750 0x7f9a5c0d5c00 secure :-1 s=READY pgs=409 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a70004740 tx=0x7f9a70005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a8a788e00 1 Processor -- start 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a8a788e00 1 -- start start 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8419730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c845e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c847ef00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5643c832f780 con 0x5643c8419c70 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5643c832b4b0 con 0x5643c845eb20 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.894+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5643c8325450 con 0x5643c8419360 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8419730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8419730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53754/0 (socket says 10.20.193.28:53754) 2026-02-20T13:23:45.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 -- 10.20.193.28:0/797879210 learned_addr learned my addr 10.20.193.28:0/797879210 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a85d02640 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c845e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86d04640 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c847ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 -- 10.20.193.28:0/797879210 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 msgr2=0x5643c847ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c847ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 -- 10.20.193.28:0/797879210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 msgr2=0x5643c845e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c845e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 -- 10.20.193.28:0/797879210 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c82d0d10 con 0x5643c8419360 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.895+0000 7f9a86503640 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8419730 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=2340348961668381227 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a70009920 tx=0x7f9a70014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=207a96fb1eb2ba2b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a64cf3640 1 -- 10.20.193.28:0/797879210 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a70004250 con 0x5643c8419360 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a64cf3640 1 -- 10.20.193.28:0/797879210 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a700043b0 con 0x5643c8419360 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a64cf3640 1 -- 10.20.193.28:0/797879210 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a70025b30 con 0x5643c8419360 2026-02-20T13:23:45.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 -- 10.20.193.28:0/797879210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 msgr2=0x5643c8419730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8419730 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=2340348961668381227 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a70009920 tx=0x7f9a70014000 comp rx=0 tx=0).stop 2026-02-20T13:23:45.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 -- 10.20.193.28:0/797879210 shutdown_connections 2026-02-20T13:23:45.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c845e5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c847ef00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/797879210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8419730 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=2340348961668381227 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 -- 10.20.193.28:0/797879210 >> 10.20.193.28:0/797879210 conn(0x5643c83f7860 msgr2=0x5643c8417c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 -- 10.20.193.28:0/797879210 shutdown_connections 2026-02-20T13:23:45.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.896+0000 7f9a8a788e00 1 -- 10.20.193.28:0/797879210 wait complete. 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.897+0000 7f9a8a788e00 1 -- start start 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a8a788e00 1 Processor -- start 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8476740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c8476c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c8478a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5643c8478f80 con 0x5643c8419c70 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5643c84790f0 con 0x5643c845eb20 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5643c84792b0 con 0x5643c8419360 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86503640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8476740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86d04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c8478a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86d04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c8478a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39462/0 (socket says 10.20.193.28:39462) 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86d04640 1 -- 10.20.193.28:0/2075100721 learned_addr learned my addr 10.20.193.28:0/2075100721 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a85d02640 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c8476c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86d04640 1 -- 10.20.193.28:0/2075100721 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 msgr2=0x5643c8476740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86d04640 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8476740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86d04640 1 -- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 msgr2=0x5643c8476c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86d04640 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c8476c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86d04640 1 -- 10.20.193.28:0/2075100721 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c82a93c0 con 0x5643c845eb20 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.898+0000 7f9a86503640 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8476740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a85d02640 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c8476c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a86d04640 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c8478a10 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=15706704067179976680 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7c0ae1e0 tx=0x7f9a7c006400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9f96c21a47217e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a33fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a33fff640 1 -- 10.20.193.28:0/2075100721 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a7c0b0050 con 0x5643c845eb20 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a33fff640 1 -- 10.20.193.28:0/2075100721 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a7c0d32d0 con 0x5643c845eb20 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a33fff640 1 -- 10.20.193.28:0/2075100721 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a7c0b8c20 con 0x5643c845eb20 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a70009dc0 con 0x5643c845eb20 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a33fff640 1 -- 10.20.193.28:0/2075100721 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9a7c0b8db0 con 0x5643c845eb20 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a33fff640 10 client.27722 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a8a788e00 10 client.27722 _ll_register_callbacks cb 0x5643c82a6a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643c7fbb6f0 con 0x5643c845eb20 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a33fff640 1 -- 10.20.193.28:0/2075100721 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a7c0b6270 con 0x5643c845eb20 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a8a788e00 10 client.27722 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.899+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5643c82bb0e0 con 0x5643c845eb20 2026-02-20T13:23:45.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a33fff640 1 -- 10.20.193.28:0/2075100721 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a7c0aec00 con 0x5643c845eb20 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a8a788e00 10 client.27722 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a8a788e00 10 client.27722 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a8a788e00 20 client.27722 populate_metadata read hostname 'trial028' 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5643c847ed90 0x5643c845c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a8a788e00 4 client.27722 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643c82c7f80 con 0x5643c847ed90 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a86503640 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5643c847ed90 0x5643c845c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a33fff640 10 client.27722 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.900+0000 7f9a86503640 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5643c847ed90 0x5643c845c8a0 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=7784990881447986311 s_cookie=14807237420336272505 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6c09d7f5c45cc487 server_cookie=cd7ddffb5003d479 in_seq=0 out_seq=0 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a33fff640 1 -- 10.20.193.28:0/2075100721 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5643c82c7f80 con 0x5643c847ed90 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a33fff640 10 client.27722 handle_command_reply: tid=0 2026-02-20T13:23:45.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 client.27722 shutdown 2026-02-20T13:23:45.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 msgr2=0x5643c8478a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c8478a10 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=15706704067179976680 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7c0ae1e0 tx=0x7f9a7c006400 comp rx=0 tx=0).stop 2026-02-20T13:23:45.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 shutdown_connections 2026-02-20T13:23:45.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5643c847ed90 0x5643c845c8a0 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=7784990881447986311 s_cookie=14807237420336272505 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c8476c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c8478a10 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=15706704067179976680 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/2075100721 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c8476740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a33fff640 0 client.27722 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:23:45.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 >> 10.20.193.28:0/2075100721 conn(0x5643c83f7860 msgr2=0x5643c8417c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 shutdown_connections 2026-02-20T13:23:45.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.901+0000 7f9a8a788e00 1 -- 10.20.193.28:0/2075100721 wait complete. 2026-02-20T13:23:45.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.902+0000 7f9a8a788e00 20 client.27722 trim_cache size 0 max 16384 2026-02-20T13:23:45.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.909+0000 7f9a8a788e00 1 Processor -- start 2026-02-20T13:23:45.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.909+0000 7f9a8a788e00 1 -- start start 2026-02-20T13:23:45.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.909+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c84789a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.909+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c847a130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.909+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c84738d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.909+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5643c8323080 con 0x5643c8419c70 2026-02-20T13:23:45.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.909+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5643c7fe3700 con 0x5643c845eb20 2026-02-20T13:23:45.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.909+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5643c841a040 con 0x5643c8419360 2026-02-20T13:23:45.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86503640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c84789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86d04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c84738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a85d02640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c847a130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86d04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c84738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39464/0 (socket says 10.20.193.28:39464) 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86d04640 1 -- 10.20.193.28:0/3316296553 learned_addr learned my addr 10.20.193.28:0/3316296553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86503640 1 -- 10.20.193.28:0/3316296553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 msgr2=0x5643c84738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86503640 1 --2- 10.20.193.28:0/3316296553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c84738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86503640 1 -- 10.20.193.28:0/3316296553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 msgr2=0x5643c847a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86503640 1 --2- 10.20.193.28:0/3316296553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c847a130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86503640 1 -- 10.20.193.28:0/3316296553 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c82b5b60 con 0x5643c8419360 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.910+0000 7f9a86503640 1 --2- 10.20.193.28:0/3316296553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c84789a0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=5841690003620919348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a70003ea0 tx=0x7f9a7001cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5111da1b91c67834 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a4e4e6640 1 -- 10.20.193.28:0/3316296553 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a700040f0 con 0x5643c8419360 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a4e4e6640 1 -- 10.20.193.28:0/3316296553 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a70034110 con 0x5643c8419360 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a4e4e6640 1 -- 10.20.193.28:0/3316296553 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a70005040 con 0x5643c8419360 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 -- 10.20.193.28:0/3316296553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 msgr2=0x5643c84789a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/3316296553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c84789a0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=5841690003620919348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a70003ea0 tx=0x7f9a7001cf90 comp rx=0 tx=0).stop 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 -- 10.20.193.28:0/3316296553 shutdown_connections 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/3316296553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c8419c70 0x5643c847a130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/3316296553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c845eb20 0x5643c84738d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/3316296553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c84789a0 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=5841690003620919348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 -- 10.20.193.28:0/3316296553 >> 10.20.193.28:0/3316296553 conn(0x5643c83f7860 msgr2=0x5643c8479a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 -- 10.20.193.28:0/3316296553 shutdown_connections 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 -- 10.20.193.28:0/3316296553 wait complete. 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.911+0000 7f9a8a788e00 1 -- start start 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a8a788e00 1 Processor -- start 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c83f7c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c8419c70 0x5643c83f8170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a8a788e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c845eb20 0x5643c83f86b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5643c83fcc80 con 0x5643c845eb20 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5643c83fcdf0 con 0x5643c8419c70 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a8a788e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5643c83fcfb0 con 0x5643c8419360 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a85d02640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c8419c70 0x5643c83f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a85d02640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c8419c70 0x5643c83f8170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39468/0 (socket says 10.20.193.28:39468) 2026-02-20T13:23:45.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a85d02640 1 -- 10.20.193.28:0/289063823 learned_addr learned my addr 10.20.193.28:0/289063823 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a86503640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c83f7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.912+0000 7f9a86d04640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c845eb20 0x5643c83f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a86503640 1 -- 10.20.193.28:0/289063823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c8419c70 msgr2=0x5643c83f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a86503640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c8419c70 0x5643c83f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a86503640 1 -- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c845eb20 msgr2=0x5643c83f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a86503640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c845eb20 0x5643c83f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a86503640 1 -- 10.20.193.28:0/289063823 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c82a96f0 con 0x5643c8419360 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a86d04640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c845eb20 0x5643c83f86b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a85d02640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c8419c70 0x5643c83f8170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a86503640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c83f7c30 secure :-1 s=READY pgs=264 gs=3 cs=0 l=1 c_cookie=17447161707366280697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a70009ad0 tx=0x7f9a7001ce90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f220c522425d6df9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a33fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:23:45.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a33fff640 1 -- 10.20.193.28:0/289063823 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a700040f0 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a33fff640 1 -- 10.20.193.28:0/289063823 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a700056b0 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a33fff640 1 -- 10.20.193.28:0/289063823 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a700049f0 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c82d0d10 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a33fff640 1 -- 10.20.193.28:0/289063823 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9a70004b80 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a8a788e00 10 client.27637 _ll_register_callbacks cb 0x5643c82a6a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.913+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a700043b0 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a33fff640 1 -- 10.20.193.28:0/289063823 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a70004d40 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a8a788e00 10 client.27637 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5643c82bb340 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a33fff640 1 -- 10.20.193.28:0/289063823 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a70044020 con 0x5643c8419360 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a8a788e00 10 client.27637 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:45.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a8a788e00 10 client.27637 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:23:45.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a8a788e00 20 client.27637 populate_metadata read hostname 'trial028' 2026-02-20T13:23:45.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5643c84aedc0 0x5643c84af230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:45.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a8a788e00 4 client.27637 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:45.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643c7fb8f40 con 0x5643c84aedc0 2026-02-20T13:23:45.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a85d02640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5643c84aedc0 0x5643c84af230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:45.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a85d02640 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5643c84aedc0 0x5643c84af230 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=11992298662542463100 s_cookie=12525634113105950395 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a66d34187d3c507c server_cookie=add3fddcba31f6bb in_seq=0 out_seq=0 2026-02-20T13:23:45.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.914+0000 7f9a33fff640 10 client.27637 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:23:45.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a33fff640 1 -- 10.20.193.28:0/289063823 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643c7fb8f40 con 0x5643c84aedc0 2026-02-20T13:23:45.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a33fff640 10 client.27637 handle_command_reply: tid=0 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 client.27637 shutdown 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 msgr2=0x5643c83f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c83f7c30 secure :-1 s=READY pgs=264 gs=3 cs=0 l=1 c_cookie=17447161707366280697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a70009ad0 tx=0x7f9a7001ce90 comp rx=0 tx=0).stop 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 shutdown_connections 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5643c84aedc0 0x5643c84af230 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=11992298662542463100 s_cookie=12525634113105950395 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643c845eb20 0x5643c83f86b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5643c8419c70 0x5643c83f8170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 --2- 10.20.193.28:0/289063823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5643c8419360 0x5643c83f7c30 unknown :-1 s=CLOSED pgs=264 gs=3 cs=0 l=1 c_cookie=17447161707366280697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 >> 10.20.193.28:0/289063823 conn(0x5643c83f7860 msgr2=0x5643c8418840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a33fff640 0 client.27637 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 shutdown_connections 2026-02-20T13:23:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 1 -- 10.20.193.28:0/289063823 wait complete. 2026-02-20T13:23:45.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.915+0000 7f9a8a788e00 20 client.27637 trim_cache size 0 max 16384 2026-02-20T13:23:45.925 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 -- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a5c0b5750 msgr2=0x7f9a5c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a5c0b5750 0x7f9a5c0d5c00 secure :-1 s=READY pgs=409 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a70004740 tx=0x7f9a70005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 -- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a801157e0 msgr2=0x7f9a800f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a801157e0 0x7f9a800f5590 secure :-1 s=READY pgs=845 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7c00f8d0 tx=0x7f9a7c00fda0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 -- 10.20.193.28:0/2970867159 shutdown_connections 2026-02-20T13:23:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9a5c0b5750 0x7f9a5c0d5c00 unknown :-1 s=CLOSED pgs=409 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a801157e0 0x7f9a800f5590 unknown :-1 s=CLOSED pgs=845 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9a8010ffe0 0x7f9a801760b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 --2- 10.20.193.28:0/2970867159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9a8010f5f0 0x7f9a800f4e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:45.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 -- 10.20.193.28:0/2970867159 >> 10.20.193.28:0/2970867159 conn(0x7f9a800ecea0 msgr2=0x7f9a8010db00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:45.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 -- 10.20.193.28:0/2970867159 shutdown_connections 2026-02-20T13:23:45.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:45.916+0000 7f9a8878e640 1 -- 10.20.193.28:0/2970867159 wait complete. 2026-02-20T13:23:46.016 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:23:46.202 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:46.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f74a51640 1 -- 10.20.193.28:0/4007614636 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f600386f0 con 0x7f8f700671a0 2026-02-20T13:23:46.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 -- 10.20.193.28:0/4007614636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f700671a0 msgr2=0x7f8f700631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 --2- 10.20.193.28:0/4007614636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f700671a0 0x7f8f700631c0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=4974658653861194313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f60009950 tx=0x7f8f6002f190 comp rx=0 tx=0).stop 2026-02-20T13:23:46.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 -- 10.20.193.28:0/4007614636 shutdown_connections 2026-02-20T13:23:46.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 --2- 10.20.193.28:0/4007614636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f700637e0 0x7f8f70063bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 --2- 10.20.193.28:0/4007614636 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f70159e00 0x7f8f7017a290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 --2- 10.20.193.28:0/4007614636 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f700671a0 0x7f8f700631c0 unknown :-1 s=CLOSED pgs=265 gs=1 cs=0 l=1 c_cookie=4974658653861194313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 -- 10.20.193.28:0/4007614636 >> 10.20.193.28:0/4007614636 conn(0x7f8f700ecea0 msgr2=0x7f8f7010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:46.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 -- 10.20.193.28:0/4007614636 shutdown_connections 2026-02-20T13:23:46.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.378+0000 7f8f77cde640 1 -- 10.20.193.28:0/4007614636 wait complete. 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.379+0000 7f8f77cde640 1 Processor -- start 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.379+0000 7f8f77cde640 1 -- start start 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f77cde640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f700637e0 0x7f8f70163690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f77cde640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f700671a0 0x7f8f70163bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f77cde640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f70159e00 0x7f8f70168fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f77cde640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f701695c0 con 0x7f8f700637e0 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f77cde640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70169730 con 0x7f8f700671a0 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f77cde640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8f701698f0 con 0x7f8f70159e00 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f700637e0 0x7f8f70163690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f700637e0 0x7f8f70163690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34298/0 (socket says 10.20.193.28:34298) 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 -- 10.20.193.28:0/2531079326 learned_addr learned my addr 10.20.193.28:0/2531079326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75252640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f700671a0 0x7f8f70163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f76254640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f70159e00 0x7f8f70168fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 -- 10.20.193.28:0/2531079326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f70159e00 msgr2=0x7f8f70168fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f70159e00 0x7f8f70168fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 -- 10.20.193.28:0/2531079326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f700671a0 msgr2=0x7f8f70163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f700671a0 0x7f8f70163bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 -- 10.20.193.28:0/2531079326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f60009570 con 0x7f8f700637e0 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f75a53640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f700637e0 0x7f8f70163690 secure :-1 s=READY pgs=846 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f600023d0 tx=0x7f8f60004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f5effd640 1 -- 10.20.193.28:0/2531079326 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f6003d070 con 0x7f8f700637e0 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.380+0000 7f8f77cde640 1 -- 10.20.193.28:0/2531079326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f70169b70 con 0x7f8f700637e0 2026-02-20T13:23:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.381+0000 7f8f5effd640 1 -- 10.20.193.28:0/2531079326 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f60002ad0 con 0x7f8f700637e0 2026-02-20T13:23:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.381+0000 7f8f5effd640 1 -- 10.20.193.28:0/2531079326 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f600418a0 con 0x7f8f700637e0 2026-02-20T13:23:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.381+0000 7f8f77cde640 1 -- 10.20.193.28:0/2531079326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f70157e50 con 0x7f8f700637e0 2026-02-20T13:23:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.383+0000 7f8f5effd640 1 -- 10.20.193.28:0/2531079326 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8f6002f9f0 con 0x7f8f700637e0 2026-02-20T13:23:46.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.385+0000 7f8f5effd640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8f4c0b5760 0x7f8f4c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.385+0000 7f8f5effd640 1 -- 10.20.193.28:0/2531079326 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8f6010af50 con 0x7f8f700637e0 2026-02-20T13:23:46.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.385+0000 7f8f75252640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8f4c0b5760 0x7f8f4c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f79cd8e00 1 Processor -- start 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f75252640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8f4c0b5760 0x7f8f4c0d5c10 secure :-1 s=READY pgs=410 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f7016a030 tx=0x7f8f64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f79cd8e00 1 -- start start 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5360 0x55e2153b5730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5c70 0x55e2153fa5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153fab20 0x55e21541af00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e2152cb780 con 0x55e2153b5c70 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e2152c74b0 con 0x55e2153b5360 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.386+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e2152c1450 con 0x55e2153fab20 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f75a53640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5360 0x55e2153b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153fab20 0x55e21541af00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153fab20 0x55e21541af00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53804/0 (socket says 10.20.193.28:53804) 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 -- 10.20.193.28:0/2230104272 learned_addr learned my addr 10.20.193.28:0/2230104272 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f75252640 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5c70 0x55e2153fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f75a53640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5360 0x55e2153b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39500/0 (socket says 10.20.193.28:39500) 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 -- 10.20.193.28:0/2230104272 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5360 msgr2=0x55e2153b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5360 0x55e2153b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 -- 10.20.193.28:0/2230104272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5c70 msgr2=0x55e2153fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5c70 0x55e2153fa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 -- 10.20.193.28:0/2230104272 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21526cd10 con 0x55e2153fab20 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f75252640 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5c70 0x55e2153fa5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f76254640 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153fab20 0x55e21541af00 secure :-1 s=READY pgs=266 gs=3 cs=0 l=1 c_cookie=5784345369888462843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f6c005630 tx=0x7f8f6c003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50461f77966097fb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:46.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f3e4e6640 1 -- 10.20.193.28:0/2230104272 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f6c003e30 con 0x55e2153fab20 2026-02-20T13:23:46.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.387+0000 7f8f3e4e6640 1 -- 10.20.193.28:0/2230104272 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f6c011910 con 0x55e2153fab20 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2230104272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153fab20 msgr2=0x55e21541af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153fab20 0x55e21541af00 secure :-1 s=READY pgs=266 gs=3 cs=0 l=1 c_cookie=5784345369888462843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f6c005630 tx=0x7f8f6c003c30 comp rx=0 tx=0).stop 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2230104272 shutdown_connections 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5c70 0x55e2153fa5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153fab20 0x55e21541af00 unknown :-1 s=CLOSED pgs=266 gs=3 cs=0 l=1 c_cookie=5784345369888462843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2230104272 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5360 0x55e2153b5730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2230104272 >> 10.20.193.28:0/2230104272 conn(0x55e215393860 msgr2=0x55e2153b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2230104272 shutdown_connections 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.388+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2230104272 wait complete. 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.389+0000 7f8f79cd8e00 1 -- start start 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.389+0000 7f8f79cd8e00 1 Processor -- start 2026-02-20T13:23:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 0x55e215412710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215412c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215417c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e215418180 con 0x55e2153fab20 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e2154182f0 con 0x55e2153b5c70 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e2154184b0 con 0x55e2153b5360 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215412c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215412c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39512/0 (socket says 10.20.193.28:39512) 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 -- 10.20.193.28:0/2994892522 learned_addr learned my addr 10.20.193.28:0/2994892522 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75a53640 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 0x55e215412710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f76254640 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215417c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 -- 10.20.193.28:0/2994892522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 msgr2=0x55e215412710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 0x55e215412710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 -- 10.20.193.28:0/2994892522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 msgr2=0x55e215417c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215417c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 -- 10.20.193.28:0/2994892522 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c0052d0 con 0x55e2153b5c70 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f75252640 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215412c50 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=1062712905319344950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f64011880 tx=0x7f8f64013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf83c1c3c86b36 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.390+0000 7f8f2b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/2994892522 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f64021040 con 0x55e2153b5c70 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/2994892522 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f64011e20 con 0x55e2153b5c70 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f640098d0 con 0x55e2153b5c70 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/2994892522 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f64025680 con 0x55e2153b5c70 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/2994892522 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8f64025830 con 0x55e2153b5c70 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 10 client.27740 _ll_register_callbacks cb 0x55e215242a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e214f576f0 con 0x55e2153b5c70 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/2994892522 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f6401bda0 con 0x55e2153b5c70 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 10 client.27740 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e2152453c0 con 0x55e2153b5c70 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/2994892522 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f64025a30 con 0x55e2153b5c70 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 10 client.27740 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 10 client.27740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 20 client.27740 populate_metadata read hostname 'trial028' 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e21541ace0 0x55e2153f88a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 4 client.27740 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.391+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e215263f80 con 0x55e21541ace0 2026-02-20T13:23:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.392+0000 7f8f75a53640 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e21541ace0 0x55e2153f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f75a53640 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e21541ace0 0x55e2153f88a0 crc :-1 s=READY pgs=200 gs=4 cs=0 l=0 c_cookie=12191605183834462321 s_cookie=782837935212078329 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a931485220439871 server_cookie=add32f4550424f9 in_seq=0 out_seq=0 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f2b7fe640 10 client.27740 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/2994892522 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e215263f80 con 0x55e21541ace0 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f2b7fe640 10 client.27740 handle_command_reply: tid=0 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f79cd8e00 1 client.27740 shutdown 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 msgr2=0x55e215412c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215412c50 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=1062712905319344950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f64011880 tx=0x7f8f64013040 comp rx=0 tx=0).stop 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 shutdown_connections 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e21541ace0 0x55e2153f88a0 crc :-1 s=READY pgs=200 gs=4 cs=0 l=0 c_cookie=12191605183834462321 s_cookie=782837935212078329 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.393+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215417c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.394+0000 7f8f2b7fe640 0 client.27740 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.394+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215412c50 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=1062712905319344950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.394+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/2994892522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 0x55e215412710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.394+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 >> 10.20.193.28:0/2994892522 conn(0x55e215393860 msgr2=0x55e2153b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.394+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 shutdown_connections 2026-02-20T13:23:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.394+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/2994892522 wait complete. 2026-02-20T13:23:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.394+0000 7f8f79cd8e00 20 client.27740 trim_cache size 0 max 16384 2026-02-20T13:23:46.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f79cd8e00 1 Processor -- start 2026-02-20T13:23:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f79cd8e00 1 -- start start 2026-02-20T13:23:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5360 0x55e21540f8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5c70 0x55e21540fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153fab20 0x55e2153f98b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e2152bf080 con 0x55e2153b5360 2026-02-20T13:23:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e214f7f700 con 0x55e2153fab20 2026-02-20T13:23:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e215407040 con 0x55e2153b5c70 2026-02-20T13:23:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f75252640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5c70 0x55e21540fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f75252640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5c70 0x55e21540fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53834/0 (socket says 10.20.193.28:53834) 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f75252640 1 -- 10.20.193.28:0/1628844179 learned_addr learned my addr 10.20.193.28:0/1628844179 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f75a53640 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5360 0x55e21540f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.401+0000 7f8f76254640 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153fab20 0x55e2153f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f75a53640 1 -- 10.20.193.28:0/1628844179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5c70 msgr2=0x55e21540fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f75a53640 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5c70 0x55e21540fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f75a53640 1 -- 10.20.193.28:0/1628844179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153fab20 msgr2=0x55e2153f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f75a53640 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153fab20 0x55e2153f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f75a53640 1 -- 10.20.193.28:0/1628844179 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2152570e0 con 0x55e2153b5360 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f75252640 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5c70 0x55e21540fe20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f75a53640 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5360 0x55e21540f8e0 secure :-1 s=READY pgs=847 gs=2 cs=0 l=1 c_cookie=16512894966004608870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f60108a20 tx=0x7f8f600047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e529967b860a6f66 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f3dce5640 1 -- 10.20.193.28:0/1628844179 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f60038920 con 0x55e2153b5360 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f3dce5640 1 -- 10.20.193.28:0/1628844179 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f600d6fd0 con 0x55e2153b5360 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f3dce5640 1 -- 10.20.193.28:0/1628844179 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f6002fdd0 con 0x55e2153b5360 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/1628844179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5360 msgr2=0x55e21540f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5360 0x55e21540f8e0 secure :-1 s=READY pgs=847 gs=2 cs=0 l=1 c_cookie=16512894966004608870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f60108a20 tx=0x7f8f600047e0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/1628844179 shutdown_connections 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153fab20 0x55e2153f98b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5c70 0x55e21540fe20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/1628844179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153b5360 0x55e21540f8e0 unknown :-1 s=CLOSED pgs=847 gs=2 cs=0 l=1 c_cookie=16512894966004608870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/1628844179 >> 10.20.193.28:0/1628844179 conn(0x55e215393860 msgr2=0x55e2153fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/1628844179 shutdown_connections 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.402+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/1628844179 wait complete. 2026-02-20T13:23:46.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f79cd8e00 1 -- start start 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f79cd8e00 1 Processor -- start 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 0x55e215394a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215394f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f79cd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215396e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e2153973b0 con 0x55e2153fab20 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e215397520 con 0x55e2153b5c70 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f79cd8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e2153976e0 con 0x55e2153b5360 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.403+0000 7f8f76254640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215396e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f76254640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215396e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34342/0 (socket says 10.20.193.28:34342) 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f76254640 1 -- 10.20.193.28:0/215446011 learned_addr learned my addr 10.20.193.28:0/215446011 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f75252640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215394f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f75a53640 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 0x55e215394a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f76254640 1 -- 10.20.193.28:0/215446011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 msgr2=0x55e215394a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f76254640 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 0x55e215394a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f76254640 1 -- 10.20.193.28:0/215446011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 msgr2=0x55e215394f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f76254640 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215394f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f76254640 1 -- 10.20.193.28:0/215446011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f70157e50 con 0x55e2153fab20 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f76254640 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215396e20 secure :-1 s=READY pgs=848 gs=1 cs=0 l=1 c_cookie=10535326157622699741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f6c01b5c0 tx=0x7f8f6c00af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9234ff5261fb66dd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f2b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/215446011 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f6c021040 con 0x55e2153fab20 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2152453c0 con 0x55e2153fab20 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f79cd8e00 10 client.17790 _ll_register_callbacks cb 0x55e215242a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f6c011910 con 0x55e2153fab20 2026-02-20T13:23:46.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/215446011 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f6c022040 con 0x55e2153fab20 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/215446011 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f6c006580 con 0x55e2153fab20 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/215446011 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8f6c006710 con 0x55e2153fab20 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/215446011 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f6c01b660 con 0x55e2153fab20 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f79cd8e00 10 client.17790 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.404+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e215251b60 con 0x55e2153fab20 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.405+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/215446011 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f6c01a030 con 0x55e2153fab20 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.405+0000 7f8f79cd8e00 10 client.17790 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.405+0000 7f8f79cd8e00 10 client.17790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.405+0000 7f8f79cd8e00 20 client.17790 populate_metadata read hostname 'trial028' 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.405+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e2154a83d0 0x55e2154c8880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.405+0000 7f8f79cd8e00 4 client.17790 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:23:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.405+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e214f54f40 con 0x55e2154a83d0 2026-02-20T13:23:46.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.405+0000 7f8f75a53640 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e2154a83d0 0x55e2154c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f75a53640 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e2154a83d0 0x55e2154c8880 crc :-1 s=READY pgs=201 gs=4 cs=0 l=0 c_cookie=14401048511553711409 s_cookie=2960354579854636796 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7dacd523c53ad31 server_cookie=29154ace456fb6fc in_seq=0 out_seq=0 2026-02-20T13:23:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f2b7fe640 10 client.17790 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f2b7fe640 1 -- 10.20.193.28:0/215446011 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e214f54f40 con 0x55e2154a83d0 2026-02-20T13:23:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f2b7fe640 10 client.17790 handle_command_reply: tid=0 2026-02-20T13:23:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 client.17790 shutdown 2026-02-20T13:23:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 msgr2=0x55e215396e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215396e20 secure :-1 s=READY pgs=848 gs=1 cs=0 l=1 c_cookie=10535326157622699741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f6c01b5c0 tx=0x7f8f6c00af10 comp rx=0 tx=0).stop 2026-02-20T13:23:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 shutdown_connections 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e2154a83d0 0x55e2154c8880 crc :-1 s=READY pgs=201 gs=4 cs=0 l=0 c_cookie=14401048511553711409 s_cookie=2960354579854636796 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2153fab20 0x55e215396e20 unknown :-1 s=CLOSED pgs=848 gs=1 cs=0 l=1 c_cookie=10535326157622699741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e2153b5c70 0x55e215394f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 --2- 10.20.193.28:0/215446011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e2153b5360 0x55e215394a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 >> 10.20.193.28:0/215446011 conn(0x55e215393860 msgr2=0x55e21540e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f2b7fe640 0 client.17790 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 shutdown_connections 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 1 -- 10.20.193.28:0/215446011 wait complete. 2026-02-20T13:23:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.406+0000 7f8f79cd8e00 20 client.17790 trim_cache size 0 max 16384 2026-02-20T13:23:46.416 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:23:46.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 -- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8f4c0b5760 msgr2=0x7f8f4c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8f4c0b5760 0x7f8f4c0d5c10 secure :-1 s=READY pgs=410 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f7016a030 tx=0x7f8f64005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:46.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 -- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f700637e0 msgr2=0x7f8f70163690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f700637e0 0x7f8f70163690 secure :-1 s=READY pgs=846 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f600023d0 tx=0x7f8f60004290 comp rx=0 tx=0).stop 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 -- 10.20.193.28:0/2531079326 shutdown_connections 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8f4c0b5760 0x7f8f4c0d5c10 unknown :-1 s=CLOSED pgs=410 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f70159e00 0x7f8f70168fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f700671a0 0x7f8f70163bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 --2- 10.20.193.28:0/2531079326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f700637e0 0x7f8f70163690 unknown :-1 s=CLOSED pgs=846 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 -- 10.20.193.28:0/2531079326 >> 10.20.193.28:0/2531079326 conn(0x7f8f700ecea0 msgr2=0x7f8f7010d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 -- 10.20.193.28:0/2531079326 shutdown_connections 2026-02-20T13:23:46.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:46.407+0000 7f8f77cde640 1 -- 10.20.193.28:0/2531079326 wait complete. 2026-02-20T13:23:46.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:46 trial028 ceph-mon[37442]: pgmap v374: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:23:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:46 trial127 ceph-mon[43817]: pgmap v374: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:23:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:46 trial034 ceph-mon[43332]: pgmap v374: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:23:47.507 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:23:47.507 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:23:47.693 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:47.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 -- 10.20.193.28:0/131745004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc0614f0 msgr2=0x7efcbc061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 --2- 10.20.193.28:0/131745004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc0614f0 0x7efcbc061920 secure :-1 s=READY pgs=849 gs=1 cs=0 l=1 c_cookie=16354541314861331444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcac009950 tx=0x7efcac02f190 comp rx=0 tx=0).stop 2026-02-20T13:23:47.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 -- 10.20.193.28:0/131745004 shutdown_connections 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 --2- 10.20.193.28:0/131745004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc0614f0 0x7efcbc061920 unknown :-1 s=CLOSED pgs=849 gs=1 cs=0 l=1 c_cookie=16354541314861331444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 --2- 10.20.193.28:0/131745004 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efcbc159af0 0x7efcbc179ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 --2- 10.20.193.28:0/131745004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efcbc062ae0 0x7efcbc060fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 -- 10.20.193.28:0/131745004 >> 10.20.193.28:0/131745004 conn(0x7efcbc05f830 msgr2=0x7efcbc10ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 -- 10.20.193.28:0/131745004 shutdown_connections 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 -- 10.20.193.28:0/131745004 wait complete. 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.882+0000 7efcc246f640 1 Processor -- start 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcc246f640 1 -- start start 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcc246f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efcbc0614f0 0x7efcbc0f2c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcc246f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc062ae0 0x7efcbc0f3140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcc246f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efcbc159af0 0x7efcbc0f8510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcc246f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc0f8b30 con 0x7efcbc062ae0 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcc246f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc0f8ca0 con 0x7efcbc159af0 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcc246f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc0f8e60 con 0x7efcbc0614f0 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc062ae0 0x7efcbc0f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc062ae0 0x7efcbc0f3140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34364/0 (socket says 10.20.193.28:34364) 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbb7fe640 1 -- 10.20.193.28:0/3213199922 learned_addr learned my addr 10.20.193.28:0/3213199922 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efcbc0614f0 0x7efcbc0f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcc09e5640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efcbc159af0 0x7efcbc0f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbb7fe640 1 -- 10.20.193.28:0/3213199922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efcbc0614f0 msgr2=0x7efcbc0f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efcbc0614f0 0x7efcbc0f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbb7fe640 1 -- 10.20.193.28:0/3213199922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efcbc159af0 msgr2=0x7efcbc0f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efcbc159af0 0x7efcbc0f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.883+0000 7efcbb7fe640 1 -- 10.20.193.28:0/3213199922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac009570 con 0x7efcbc062ae0 2026-02-20T13:23:47.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.884+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc062ae0 0x7efcbc0f3140 secure :-1 s=READY pgs=850 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcac038820 tx=0x7efcac004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:47.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.884+0000 7efcb97fa640 1 -- 10.20.193.28:0/3213199922 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcac03d070 con 0x7efcbc062ae0 2026-02-20T13:23:47.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.884+0000 7efcb97fa640 1 -- 10.20.193.28:0/3213199922 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efcac002ad0 con 0x7efcbc062ae0 2026-02-20T13:23:47.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.884+0000 7efcb97fa640 1 -- 10.20.193.28:0/3213199922 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcac041940 con 0x7efcbc062ae0 2026-02-20T13:23:47.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.884+0000 7efcc246f640 1 -- 10.20.193.28:0/3213199922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcbc0f90e0 con 0x7efcbc062ae0 2026-02-20T13:23:47.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.884+0000 7efcc246f640 1 -- 10.20.193.28:0/3213199922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcbc0f9680 con 0x7efcbc062ae0 2026-02-20T13:23:47.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.887+0000 7efcb97fa640 1 -- 10.20.193.28:0/3213199922 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7efcac041ad0 con 0x7efcbc062ae0 2026-02-20T13:23:47.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.888+0000 7efcb97fa640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efc900b5760 0x7efc900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.888+0000 7efcb97fa640 1 -- 10.20.193.28:0/3213199922 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efcac10b080 con 0x7efcbc062ae0 2026-02-20T13:23:47.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.888+0000 7efcbbfff640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efc900b5760 0x7efc900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.889+0000 7efcbbfff640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efc900b5760 0x7efc900d5c10 secure :-1 s=READY pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca8004740 tx=0x7efca8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:47.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.889+0000 7efcc4469e00 1 Processor -- start 2026-02-20T13:23:47.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.889+0000 7efcc4469e00 1 -- start start 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.889+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb4677e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.889+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 0x55c7eb4ac480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.889+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4ccda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc4469e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb37da20 con 0x55c7eb4ac9c0 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc4469e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb379750 con 0x55c7eb467d20 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc4469e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb3736f0 con 0x55c7eb467410 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb4677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb4677e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53868/0 (socket says 10.20.193.28:53868) 2026-02-20T13:23:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcbbfff640 1 -- 10.20.193.28:0/4017510432 learned_addr learned my addr 10.20.193.28:0/4017510432 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc09e5640 1 --2- 10.20.193.28:0/4017510432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcbb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 0x55c7eb4ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc09e5640 1 -- 10.20.193.28:0/4017510432 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 msgr2=0x55c7eb4677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc09e5640 1 --2- 10.20.193.28:0/4017510432 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb4677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc09e5640 1 -- 10.20.193.28:0/4017510432 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 msgr2=0x55c7eb4ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc09e5640 1 --2- 10.20.193.28:0/4017510432 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 0x55c7eb4ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc09e5640 1 -- 10.20.193.28:0/4017510432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7eb31f120 con 0x55c7eb4ac9c0 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.890+0000 7efcc09e5640 1 --2- 10.20.193.28:0/4017510432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4ccda0 secure :-1 s=READY pgs=851 gs=3 cs=0 l=1 c_cookie=12215324989916932614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcb0008c20 tx=0x7efcb00117a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9858d5bd7f36a06 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efc8cce3640 1 -- 10.20.193.28:0/4017510432 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcb00050d0 con 0x55c7eb4ac9c0 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efc8cce3640 1 -- 10.20.193.28:0/4017510432 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efcb0003780 con 0x55c7eb4ac9c0 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efc8cce3640 1 -- 10.20.193.28:0/4017510432 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcb00128f0 con 0x55c7eb4ac9c0 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 -- 10.20.193.28:0/4017510432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 msgr2=0x55c7eb4ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 --2- 10.20.193.28:0/4017510432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4ccda0 secure :-1 s=READY pgs=851 gs=3 cs=0 l=1 c_cookie=12215324989916932614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcb0008c20 tx=0x7efcb00117a0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 -- 10.20.193.28:0/4017510432 shutdown_connections 2026-02-20T13:23:47.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 --2- 10.20.193.28:0/4017510432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4ccda0 unknown :-1 s=CLOSED pgs=851 gs=3 cs=0 l=1 c_cookie=12215324989916932614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 --2- 10.20.193.28:0/4017510432 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 0x55c7eb4ac480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 --2- 10.20.193.28:0/4017510432 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb4677e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 -- 10.20.193.28:0/4017510432 >> 10.20.193.28:0/4017510432 conn(0x55c7eb445910 msgr2=0x55c7eb465cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:47.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 -- 10.20.193.28:0/4017510432 shutdown_connections 2026-02-20T13:23:47.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.891+0000 7efcc4469e00 1 -- 10.20.193.28:0/4017510432 wait complete. 2026-02-20T13:23:47.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.892+0000 7efcc4469e00 1 -- start start 2026-02-20T13:23:47.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcc4469e00 1 Processor -- start 2026-02-20T13:23:47.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb47fba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 0x55c7eb4800e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4850d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcc4469e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb485610 con 0x55c7eb4ac9c0 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcc4469e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb485780 con 0x55c7eb467d20 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcc4469e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb485940 con 0x55c7eb467410 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb47fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcc09e5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4850d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb47fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53872/0 (socket says 10.20.193.28:53872) 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcbbfff640 1 -- 10.20.193.28:0/271551808 learned_addr learned my addr 10.20.193.28:0/271551808 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.893+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 0x55c7eb4800e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcbbfff640 1 -- 10.20.193.28:0/271551808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 msgr2=0x55c7eb4800e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcbbfff640 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 0x55c7eb4800e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcbbfff640 1 -- 10.20.193.28:0/271551808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 msgr2=0x55c7eb4850d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcbbfff640 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4850d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcbbfff640 1 -- 10.20.193.28:0/271551808 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7eb2f7810 con 0x55c7eb467410 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcc09e5640 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4850d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcbbfff640 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb47fba0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=7208123221564015844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca80098d0 tx=0x7efca8013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640865e1369144e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efc7dffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efc7dffb640 1 -- 10.20.193.28:0/271551808 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efca8021040 con 0x55c7eb467410 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efc7dffb640 1 -- 10.20.193.28:0/271551808 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efca801a460 con 0x55c7eb467410 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efc7dffb640 1 -- 10.20.193.28:0/271551808 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efca8025680 con 0x55c7eb467410 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb0008840 con 0x55c7eb467410 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efc7dffb640 1 -- 10.20.193.28:0/271551808 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efca801bae0 con 0x55c7eb467410 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcc4469e00 10 client.27667 _ll_register_callbacks cb 0x55c7eb32ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.894+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c7eb0099d0 con 0x55c7eb467410 2026-02-20T13:23:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efc7dffb640 1 -- 10.20.193.28:0/271551808 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efca801a5d0 con 0x55c7eb467410 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcc4469e00 10 client.27667 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c7eb3094f0 con 0x55c7eb467410 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efc7dffb640 1 -- 10.20.193.28:0/271551808 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efca801bca0 con 0x55c7eb467410 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcc4469e00 10 client.27667 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcc4469e00 10 client.27667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcc4469e00 20 client.27667 populate_metadata read hostname 'trial028' 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcc4469e00 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c7eb4aa480 0x55c7eb4aa920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcc4469e00 4 client.27667 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7eb380df0 con 0x55c7eb4aa480 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.895+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c7eb4aa480 0x55c7eb4aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c7eb4aa480 0x55c7eb4aa920 crc :-1 s=READY pgs=202 gs=4 cs=0 l=0 c_cookie=17773620701835474109 s_cookie=13316082946691447554 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a895dc116eb4bd server_cookie=b8cc3ae36d2e3b02 in_seq=0 out_seq=0 2026-02-20T13:23:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efc7dffb640 10 client.27667 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efc7dffb640 1 -- 10.20.193.28:0/271551808 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c7eb380df0 con 0x55c7eb4aa480 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efc7dffb640 10 client.27667 handle_command_reply: tid=0 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 client.27667 shutdown 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 msgr2=0x55c7eb47fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb47fba0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=7208123221564015844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca80098d0 tx=0x7efca8013040 comp rx=0 tx=0).stop 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 shutdown_connections 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c7eb4aa480 0x55c7eb4aa920 crc :-1 s=READY pgs=202 gs=4 cs=0 l=0 c_cookie=17773620701835474109 s_cookie=13316082946691447554 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4850d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb467d20 0x55c7eb4800e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 --2- 10.20.193.28:0/271551808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467410 0x55c7eb47fba0 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=7208123221564015844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efc7dffb640 0 client.27667 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 >> 10.20.193.28:0/271551808 conn(0x55c7eb445910 msgr2=0x55c7eb4664e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.896+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 shutdown_connections 2026-02-20T13:23:47.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.897+0000 7efcc4469e00 1 -- 10.20.193.28:0/271551808 wait complete. 2026-02-20T13:23:47.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.897+0000 7efcc4469e00 20 client.27667 trim_cache size 0 max 16384 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc4469e00 1 Processor -- start 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc4469e00 1 -- start start 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb484640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb47cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb47d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc4469e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb371320 con 0x55c7eb467410 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc4469e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb031790 con 0x55c7eb4ac9c0 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc4469e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb406ea0 con 0x55c7eb467d20 2026-02-20T13:23:47.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb484640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb47cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb484640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34398/0 (socket says 10.20.193.28:34398) 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbbfff640 1 -- 10.20.193.28:0/1285177045 learned_addr learned my addr 10.20.193.28:0/1285177045 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcc09e5640 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb47d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbbfff640 1 -- 10.20.193.28:0/1285177045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 msgr2=0x55c7eb47cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbbfff640 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb47cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbbfff640 1 -- 10.20.193.28:0/1285177045 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 msgr2=0x55c7eb47d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbbfff640 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb47d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbbfff640 1 -- 10.20.193.28:0/1285177045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7eb303f70 con 0x55c7eb467410 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.906+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb47cf60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcbbfff640 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb484640 secure :-1 s=READY pgs=852 gs=1 cs=0 l=1 c_cookie=16757760477479743963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca8016040 tx=0x7efca8035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88f865e2b42b1db server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:47.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efc7ffff640 1 -- 10.20.193.28:0/1285177045 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efca8009900 con 0x55c7eb467410 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efc7ffff640 1 -- 10.20.193.28:0/1285177045 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efca8035070 con 0x55c7eb467410 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efc7ffff640 1 -- 10.20.193.28:0/1285177045 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efca8019c60 con 0x55c7eb467410 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 -- 10.20.193.28:0/1285177045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 msgr2=0x55c7eb484640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb484640 secure :-1 s=READY pgs=852 gs=1 cs=0 l=1 c_cookie=16757760477479743963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca8016040 tx=0x7efca8035000 comp rx=0 tx=0).stop 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 -- 10.20.193.28:0/1285177045 shutdown_connections 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb47d4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb47cf60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1285177045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb484640 unknown :-1 s=CLOSED pgs=852 gs=1 cs=0 l=1 c_cookie=16757760477479743963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 -- 10.20.193.28:0/1285177045 >> 10.20.193.28:0/1285177045 conn(0x55c7eb445910 msgr2=0x55c7eb483f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 -- 10.20.193.28:0/1285177045 shutdown_connections 2026-02-20T13:23:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.907+0000 7efcc4469e00 1 -- 10.20.193.28:0/1285177045 wait complete. 2026-02-20T13:23:47.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc4469e00 1 -- start start 2026-02-20T13:23:47.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc4469e00 1 Processor -- start 2026-02-20T13:23:47.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb48bd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb486270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc4469e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4867b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc4469e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb442390 con 0x55c7eb467410 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc4469e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb486d20 con 0x55c7eb4ac9c0 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc4469e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c7eb486ee0 con 0x55c7eb467d20 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb48bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcbb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb486270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcbbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb48bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34402/0 (socket says 10.20.193.28:34402) 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcbbfff640 1 -- 10.20.193.28:0/1784142051 learned_addr learned my addr 10.20.193.28:0/1784142051 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcc09e5640 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4867b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcbbfff640 1 -- 10.20.193.28:0/1784142051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 msgr2=0x55c7eb486270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.908+0000 7efcbbfff640 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb486270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcbbfff640 1 -- 10.20.193.28:0/1784142051 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 msgr2=0x55c7eb4867b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcbbfff640 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4867b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcbbfff640 1 -- 10.20.193.28:0/1784142051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7eb2f7b40 con 0x55c7eb467410 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcbbfff640 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb48bd50 secure :-1 s=READY pgs=853 gs=1 cs=0 l=1 c_cookie=7192972466279647069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca80044a0 tx=0x7efca8019c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d292591bc3875d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efc7dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efc7dffb640 1 -- 10.20.193.28:0/1784142051 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efca80114f0 con 0x55c7eb467410 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7eb3094f0 con 0x55c7eb467410 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efc7dffb640 1 -- 10.20.193.28:0/1784142051 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c7eb0099d0 con 0x55c7eb467410 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcc4469e00 10 client.17808 _ll_register_callbacks cb 0x55c7eb32ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcb0003780 con 0x55c7eb467410 2026-02-20T13:23:47.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efc7dffb640 1 -- 10.20.193.28:0/1784142051 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efca80114f0 con 0x55c7eb467410 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efc7dffb640 1 -- 10.20.193.28:0/1784142051 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7efca801acc0 con 0x55c7eb467410 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efc7dffb640 1 -- 10.20.193.28:0/1784142051 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efca801ae80 con 0x55c7eb467410 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcc4469e00 10 client.17808 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.909+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c7eb309750 con 0x55c7eb467410 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efc7dffb640 1 -- 10.20.193.28:0/1784142051 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efca8019520 con 0x55c7eb467410 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efcc4469e00 10 client.17808 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efcc4469e00 10 client.17808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efcc4469e00 20 client.17808 populate_metadata read hostname 'trial028' 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c7eb55aa20 0x55c7eb57aed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efcc4469e00 4 client.17808 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c7eb007220 con 0x55c7eb55aa20 2026-02-20T13:23:47.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c7eb55aa20 0x55c7eb57aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efcbb7fe640 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c7eb55aa20 0x55c7eb57aed0 crc :-1 s=READY pgs=203 gs=4 cs=0 l=0 c_cookie=12007218312418065021 s_cookie=1427731178817231433 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a235702c3e7a7d server_cookie=13d051f154269a49 in_seq=0 out_seq=0 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.910+0000 7efc7dffb640 10 client.17808 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efc7dffb640 1 -- 10.20.193.28:0/1784142051 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c7eb007220 con 0x55c7eb55aa20 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efc7dffb640 10 client.17808 handle_command_reply: tid=0 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 client.17808 shutdown 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 msgr2=0x55c7eb48bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb48bd50 secure :-1 s=READY pgs=853 gs=1 cs=0 l=1 c_cookie=7192972466279647069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca80044a0 tx=0x7efca8019c60 comp rx=0 tx=0).stop 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 shutdown_connections 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c7eb55aa20 0x55c7eb57aed0 crc :-1 s=READY pgs=203 gs=4 cs=0 l=0 c_cookie=12007218312418065021 s_cookie=1427731178817231433 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c7eb4ac9c0 0x55c7eb4867b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c7eb467d20 0x55c7eb486270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 --2- 10.20.193.28:0/1784142051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7eb467410 0x55c7eb48bd50 unknown :-1 s=CLOSED pgs=853 gs=1 cs=0 l=1 c_cookie=7192972466279647069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efc7dffb640 0 client.17808 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:47.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.911+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 >> 10.20.193.28:0/1784142051 conn(0x55c7eb445910 msgr2=0x55c7eb4ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:47.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 shutdown_connections 2026-02-20T13:23:47.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc4469e00 1 -- 10.20.193.28:0/1784142051 wait complete. 2026-02-20T13:23:47.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc4469e00 20 client.17808 trim_cache size 0 max 16384 2026-02-20T13:23:47.920 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:47.920 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:23:47.921 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "3c6ee257-65e6-4778-8f07-47859e3b574b", 2026-02-20T13:23:47.921 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:23:47.921 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:47.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 -- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efc900b5760 msgr2=0x7efc900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efc900b5760 0x7efc900d5c10 secure :-1 s=READY pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca8004740 tx=0x7efca8005f90 comp rx=0 tx=0).stop 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 -- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc062ae0 msgr2=0x7efcbc0f3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc062ae0 0x7efcbc0f3140 secure :-1 s=READY pgs=850 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcac038820 tx=0x7efcac004300 comp rx=0 tx=0).stop 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 -- 10.20.193.28:0/3213199922 shutdown_connections 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7efc900b5760 0x7efc900d5c10 unknown :-1 s=CLOSED pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcbc062ae0 0x7efcbc0f3140 unknown :-1 s=CLOSED pgs=850 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7efcbc159af0 0x7efcbc0f8510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 --2- 10.20.193.28:0/3213199922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efcbc0614f0 0x7efcbc0f2c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 -- 10.20.193.28:0/3213199922 >> 10.20.193.28:0/3213199922 conn(0x7efcbc05f830 msgr2=0x7efcbc10e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:47.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.912+0000 7efcc246f640 1 -- 10.20.193.28:0/3213199922 shutdown_connections 2026-02-20T13:23:47.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:47.913+0000 7efcc246f640 1 -- 10.20.193.28:0/3213199922 wait complete. 2026-02-20T13:23:48.012 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:23:48.199 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 -- 10.20.193.28:0/2558298748 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c3410fea0 msgr2=0x7f7c34114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 --2- 10.20.193.28:0/2558298748 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c3410fea0 0x7f7c34114ef0 secure :-1 s=READY pgs=268 gs=3 cs=0 l=1 c_cookie=3250551669804936873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c1c009890 tx=0x7f7c1c02f120 comp rx=0 tx=0).stop 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 -- 10.20.193.28:0/2558298748 shutdown_connections 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 --2- 10.20.193.28:0/2558298748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c341156a0 0x7f7c34176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 --2- 10.20.193.28:0/2558298748 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c3410fea0 0x7f7c34114ef0 unknown :-1 s=CLOSED pgs=268 gs=3 cs=0 l=1 c_cookie=3250551669804936873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 --2- 10.20.193.28:0/2558298748 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c3410f4b0 0x7f7c3410f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 -- 10.20.193.28:0/2558298748 >> 10.20.193.28:0/2558298748 conn(0x7f7c340ecda0 msgr2=0x7f7c3410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 -- 10.20.193.28:0/2558298748 shutdown_connections 2026-02-20T13:23:48.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.386+0000 7f7c33577640 1 -- 10.20.193.28:0/2558298748 wait complete. 2026-02-20T13:23:48.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c33577640 1 Processor -- start 2026-02-20T13:23:48.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c33577640 1 -- start start 2026-02-20T13:23:48.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c33577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c3410f4b0 0x7f7c340f57a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c33577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c3410fea0 0x7f7c34175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c33577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c341156a0 0x7f7c340f5ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c33577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7c340fb0b0 con 0x7f7c3410fea0 2026-02-20T13:23:48.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c33577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7c340fb220 con 0x7f7c3410f4b0 2026-02-20T13:23:48.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c33577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7c340fb3e0 con 0x7f7c341156a0 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c32575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c3410f4b0 0x7f7c340f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c32d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c341156a0 0x7f7c340f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c32d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c341156a0 0x7f7c340f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53900/0 (socket says 10.20.193.28:53900) 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c32d76640 1 -- 10.20.193.28:0/949255580 learned_addr learned my addr 10.20.193.28:0/949255580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.387+0000 7f7c31d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c3410fea0 0x7f7c34175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c32d76640 1 -- 10.20.193.28:0/949255580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c3410f4b0 msgr2=0x7f7c340f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c32d76640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c3410f4b0 0x7f7c340f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c32d76640 1 -- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c3410fea0 msgr2=0x7f7c34175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c32d76640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c3410fea0 0x7f7c34175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c32d76640 1 -- 10.20.193.28:0/949255580 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2400a590 con 0x7f7c341156a0 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c32d76640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c341156a0 0x7f7c340f5ea0 secure :-1 s=READY pgs=269 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c24005790 tx=0x7f7c24003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c1b7fe640 1 -- 10.20.193.28:0/949255580 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c2400fd60 con 0x7f7c341156a0 2026-02-20T13:23:48.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c1b7fe640 1 -- 10.20.193.28:0/949255580 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c24003e80 con 0x7f7c341156a0 2026-02-20T13:23:48.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c33577640 1 -- 10.20.193.28:0/949255580 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1c0094b0 con 0x7f7c341156a0 2026-02-20T13:23:48.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c1b7fe640 1 -- 10.20.193.28:0/949255580 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c24019a80 con 0x7f7c341156a0 2026-02-20T13:23:48.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.388+0000 7f7c33577640 1 -- 10.20.193.28:0/949255580 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c340fba00 con 0x7f7c341156a0 2026-02-20T13:23:48.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.391+0000 7f7c1b7fe640 1 -- 10.20.193.28:0/949255580 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7c24017020 con 0x7f7c341156a0 2026-02-20T13:23:48.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.393+0000 7f7c1b7fe640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c0c0b56d0 0x7f7c0c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.393+0000 7f7c1b7fe640 1 -- 10.20.193.28:0/949255580 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7c240e7d60 con 0x7f7c341156a0 2026-02-20T13:23:48.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.393+0000 7f7c32575640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c0c0b56d0 0x7f7c0c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c32575640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c0c0b56d0 0x7f7c0c0d5b80 secure :-1 s=READY pgs=412 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c28004740 tx=0x7f7c28009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c3aa7de00 1 Processor -- start 2026-02-20T13:23:48.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c3aa7de00 1 -- start start 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x5617061cb550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cba90 0x561706210400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561706210940 0x561706230d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5617060e17d0 con 0x5617061cba90 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5617060dd500 con 0x561706210940 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5617060d74a0 con 0x5617061cb180 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c32575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x5617061cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c31d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cba90 0x561706210400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c31d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cba90 0x561706210400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34410/0 (socket says 10.20.193.28:34410) 2026-02-20T13:23:48.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c31d74640 1 -- 10.20.193.28:0/42119840 learned_addr learned my addr 10.20.193.28:0/42119840 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c32d76640 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561706210940 0x561706230d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c31d74640 1 -- 10.20.193.28:0/42119840 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 msgr2=0x5617061cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c31d74640 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x5617061cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c31d74640 1 -- 10.20.193.28:0/42119840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561706210940 msgr2=0x561706230d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c31d74640 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561706210940 0x561706230d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c31d74640 1 -- 10.20.193.28:0/42119840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561706082d80 con 0x5617061cba90 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.394+0000 7f7c32d76640 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561706210940 0x561706230d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c31d74640 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cba90 0x561706210400 secure :-1 s=READY pgs=854 gs=1 cs=0 l=1 c_cookie=3591794529843606275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c1c0384b0 tx=0x7f7c1c002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d89e184184f303 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c18ff9640 1 -- 10.20.193.28:0/42119840 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c1c03d050 con 0x5617061cba90 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c18ff9640 1 -- 10.20.193.28:0/42119840 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c1c03e040 con 0x5617061cba90 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c18ff9640 1 -- 10.20.193.28:0/42119840 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c1c0046b0 con 0x5617061cba90 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/42119840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cba90 msgr2=0x561706210400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cba90 0x561706210400 secure :-1 s=READY pgs=854 gs=1 cs=0 l=1 c_cookie=3591794529843606275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c1c0384b0 tx=0x7f7c1c002390 comp rx=0 tx=0).stop 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/42119840 shutdown_connections 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cba90 0x561706210400 unknown :-1 s=CLOSED pgs=854 gs=1 cs=0 l=1 c_cookie=3591794529843606275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561706210940 0x561706230d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/42119840 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x5617061cb550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/42119840 >> 10.20.193.28:0/42119840 conn(0x5617061a9680 msgr2=0x5617061c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.395+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/42119840 shutdown_connections 2026-02-20T13:23:48.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.396+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/42119840 wait complete. 2026-02-20T13:23:48.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.397+0000 7f7c3aa7de00 1 -- start start 2026-02-20T13:23:48.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.397+0000 7f7c3aa7de00 1 Processor -- start 2026-02-20T13:23:48.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.397+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x561706228100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.397+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706228640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.397+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x56170622d630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.397+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56170622db70 con 0x561706210940 2026-02-20T13:23:48.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.397+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56170622dce0 con 0x5617061cba90 2026-02-20T13:23:48.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.397+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56170622dea0 con 0x5617061cb180 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x561706228100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x56170622d630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x561706228100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53924/0 (socket says 10.20.193.28:53924) 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32575640 1 -- 10.20.193.28:0/2715010633 learned_addr learned my addr 10.20.193.28:0/2715010633 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x56170622d630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34424/0 (socket says 10.20.193.28:34424) 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c31d74640 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706228640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32d76640 1 -- 10.20.193.28:0/2715010633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 msgr2=0x561706228100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32d76640 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x561706228100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32d76640 1 -- 10.20.193.28:0/2715010633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 msgr2=0x561706228640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32d76640 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706228640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32d76640 1 -- 10.20.193.28:0/2715010633 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c341768e0 con 0x561706210940 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32575640 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x561706228100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c32d76640 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x56170622d630 secure :-1 s=READY pgs=855 gs=1 cs=0 l=1 c_cookie=11456855223386659298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c240e5830 tx=0x7f7c24003470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efeed1fe90a59e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7be3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7be3fff640 1 -- 10.20.193.28:0/2715010633 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c240aef50 con 0x561706210940 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7be3fff640 1 -- 10.20.193.28:0/2715010633 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c24079030 con 0x561706210940 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c340fba00 con 0x561706210940 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7be3fff640 1 -- 10.20.193.28:0/2715010633 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c240b4f40 con 0x561706210940 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c3aa7de00 10 client.17820 _ll_register_callbacks cb 0x5617060589a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:48.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.398+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561705d6d6f0 con 0x561706210940 2026-02-20T13:23:48.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7be3fff640 1 -- 10.20.193.28:0/2715010633 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7c24073020 con 0x561706210940 2026-02-20T13:23:48.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7be3fff640 1 -- 10.20.193.28:0/2715010633 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c240ba050 con 0x561706210940 2026-02-20T13:23:48.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c3aa7de00 10 client.17820 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:48.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56170605b350 con 0x561706210940 2026-02-20T13:23:48.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7be3fff640 1 -- 10.20.193.28:0/2715010633 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7c240ad170 con 0x561706210940 2026-02-20T13:23:48.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c3aa7de00 10 client.17820 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:48.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c3aa7de00 10 client.17820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:48.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c3aa7de00 20 client.17820 populate_metadata read hostname 'trial028' 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56170620db90 0x56170620e030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c3aa7de00 4 client.17820 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617060e4d60 con 0x56170620db90 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.399+0000 7f7c32575640 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56170620db90 0x56170620e030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.400+0000 7f7c32575640 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56170620db90 0x56170620e030 crc :-1 s=READY pgs=204 gs=4 cs=0 l=0 c_cookie=7809534161611729849 s_cookie=8952584932180202229 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c6109f17c252bb9 server_cookie=7c3df890201d92f5 in_seq=0 out_seq=0 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.400+0000 7f7be3fff640 10 client.17820 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.400+0000 7f7be3fff640 1 -- 10.20.193.28:0/2715010633 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5617060e4d60 con 0x56170620db90 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.400+0000 7f7be3fff640 10 client.17820 handle_command_reply: tid=0 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 client.17820 shutdown 2026-02-20T13:23:48.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 msgr2=0x56170622d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x56170622d630 secure :-1 s=READY pgs=855 gs=1 cs=0 l=1 c_cookie=11456855223386659298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c240e5830 tx=0x7f7c24003470 comp rx=0 tx=0).stop 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 shutdown_connections 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56170620db90 0x56170620e030 crc :-1 s=READY pgs=204 gs=4 cs=0 l=0 c_cookie=7809534161611729849 s_cookie=8952584932180202229 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x56170622d630 unknown :-1 s=CLOSED pgs=855 gs=1 cs=0 l=1 c_cookie=11456855223386659298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706228640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/2715010633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cb180 0x561706228100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 >> 10.20.193.28:0/2715010633 conn(0x5617061a9680 msgr2=0x5617061c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7be3fff640 0 client.17820 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 shutdown_connections 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/2715010633 wait complete. 2026-02-20T13:23:48.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.401+0000 7f7c3aa7de00 20 client.17820 trim_cache size 0 max 16384 2026-02-20T13:23:48.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.410+0000 7f7c3aa7de00 1 Processor -- start 2026-02-20T13:23:48.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.410+0000 7f7c3aa7de00 1 -- start start 2026-02-20T13:23:48.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cb180 0x561706225500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706225a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561706210940 0x56170620a590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5617060d50d0 con 0x5617061cb180 2026-02-20T13:23:48.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561705d95700 con 0x5617061cba90 2026-02-20T13:23:48.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56170613a550 con 0x561706210940 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c31d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706225a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c31d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706225a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39622/0 (socket says 10.20.193.28:39622) 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c31d74640 1 -- 10.20.193.28:0/1239686871 learned_addr learned my addr 10.20.193.28:0/1239686871 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c32d76640 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561706210940 0x56170620a590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c32575640 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cb180 0x561706225500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c32d76640 1 -- 10.20.193.28:0/1239686871 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 msgr2=0x561706225a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c32d76640 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706225a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c32d76640 1 -- 10.20.193.28:0/1239686871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cb180 msgr2=0x561706225500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c32d76640 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cb180 0x561706225500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c32d76640 1 -- 10.20.193.28:0/1239686871 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56170621a8d0 con 0x561706210940 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c31d74640 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706225a40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.411+0000 7f7c32d76640 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561706210940 0x56170620a590 secure :-1 s=READY pgs=270 gs=2 cs=0 l=1 c_cookie=8139922658852576110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c240b1420 tx=0x7f7c24072000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70f6d087f40f9b6e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7bfe4e6640 1 -- 10.20.193.28:0/1239686871 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c2400ce60 con 0x561706210940 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7bfe4e6640 1 -- 10.20.193.28:0/1239686871 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c24079030 con 0x561706210940 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/1239686871 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561706210940 msgr2=0x56170620a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561706210940 0x56170620a590 secure :-1 s=READY pgs=270 gs=2 cs=0 l=1 c_cookie=8139922658852576110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c240b1420 tx=0x7f7c24072000 comp rx=0 tx=0).stop 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/1239686871 shutdown_connections 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561706210940 0x56170620a590 unknown :-1 s=CLOSED pgs=270 gs=2 cs=0 l=1 c_cookie=8139922658852576110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cba90 0x561706225a40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/1239686871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617061cb180 0x561706225500 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/1239686871 >> 10.20.193.28:0/1239686871 conn(0x5617061a9680 msgr2=0x56170620db90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/1239686871 shutdown_connections 2026-02-20T13:23:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.412+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/1239686871 wait complete. 2026-02-20T13:23:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.413+0000 7f7c3aa7de00 1 -- start start 2026-02-20T13:23:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.413+0000 7f7c3aa7de00 1 Processor -- start 2026-02-20T13:23:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.413+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cb180 0x5617061af340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.413+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cba90 0x5617061aad80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.413+0000 7f7c3aa7de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x5617061ab2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.413+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56170622f230 con 0x561706210940 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.413+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5617061ab800 con 0x5617061cb180 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.413+0000 7f7c3aa7de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5617061ab9c0 con 0x5617061cba90 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x5617061ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x5617061ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34440/0 (socket says 10.20.193.28:34440) 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 -- 10.20.193.28:0/3420580916 learned_addr learned my addr 10.20.193.28:0/3420580916 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c31d74640 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cba90 0x5617061aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32575640 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cb180 0x5617061af340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 -- 10.20.193.28:0/3420580916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cba90 msgr2=0x5617061aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cba90 0x5617061aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 -- 10.20.193.28:0/3420580916 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cb180 msgr2=0x5617061af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cb180 0x5617061af340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 -- 10.20.193.28:0/3420580916 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56170605b350 con 0x561706210940 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c32d76640 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x5617061ab2c0 secure :-1 s=READY pgs=856 gs=2 cs=0 l=1 c_cookie=7047076134549909151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c2401b040 tx=0x7f7c24003470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cc3e6848faee9f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7be3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7be3fff640 1 -- 10.20.193.28:0/3420580916 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c2400ce60 con 0x561706210940 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7be3fff640 1 -- 10.20.193.28:0/3420580916 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x561705d6d6f0 con 0x561706210940 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7be3fff640 1 -- 10.20.193.28:0/3420580916 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c240ba050 con 0x561706210940 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561706082d80 con 0x561706210940 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.414+0000 7f7be3fff640 1 -- 10.20.193.28:0/3420580916 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7c24073070 con 0x561706210940 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7be3fff640 10 client.17826 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 10 client.17826 _ll_register_callbacks cb 0x5617060589a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c1c03e040 con 0x561706210940 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7be3fff640 1 -- 10.20.193.28:0/3420580916 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c240b7490 con 0x561706210940 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 10 client.17826 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56170606d150 con 0x561706210940 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7be3fff640 1 -- 10.20.193.28:0/3420580916 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7c24098750 con 0x561706210940 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 10 client.17826 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 10 client.17826 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 20 client.17826 populate_metadata read hostname 'trial028' 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5617062bd990 0x5617062ddd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 4 client.17826 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561705d6af40 con 0x5617062bd990 2026-02-20T13:23:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.415+0000 7f7c32575640 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5617062bd990 0x5617062ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c32575640 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5617062bd990 0x5617062ddd70 crc :-1 s=READY pgs=205 gs=4 cs=0 l=0 c_cookie=5889747984246350796 s_cookie=2486052312564894400 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51bc96962193a3cc server_cookie=22803b6817780ac0 in_seq=0 out_seq=0 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7be3fff640 10 client.17826 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7be3fff640 1 -- 10.20.193.28:0/3420580916 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x561705d6af40 con 0x5617062bd990 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7be3fff640 10 client.17826 handle_command_reply: tid=0 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 client.17826 shutdown 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 msgr2=0x5617061ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x5617061ab2c0 secure :-1 s=READY pgs=856 gs=2 cs=0 l=1 c_cookie=7047076134549909151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c2401b040 tx=0x7f7c24003470 comp rx=0 tx=0).stop 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 shutdown_connections 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5617062bd990 0x5617062ddd70 crc :-1 s=READY pgs=205 gs=4 cs=0 l=0 c_cookie=5889747984246350796 s_cookie=2486052312564894400 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561706210940 0x5617061ab2c0 unknown :-1 s=CLOSED pgs=856 gs=2 cs=0 l=1 c_cookie=7047076134549909151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5617061cba90 0x5617061aad80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 --2- 10.20.193.28:0/3420580916 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5617061cb180 0x5617061af340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7be3fff640 0 client.17826 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 >> 10.20.193.28:0/3420580916 conn(0x5617061a9680 msgr2=0x5617062244f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.416+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 shutdown_connections 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c3aa7de00 1 -- 10.20.193.28:0/3420580916 wait complete. 2026-02-20T13:23:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c3aa7de00 20 client.17826 trim_cache size 0 max 16384 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "3c6ee257-65e6-4778-8f07-47859e3b574b", 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.421 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.422 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.423 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.424 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 -- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c0c0b56d0 msgr2=0x7f7c0c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c0c0b56d0 0x7f7c0c0d5b80 secure :-1 s=READY pgs=412 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c28004740 tx=0x7f7c28009310 comp rx=0 tx=0).stop 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 -- 10.20.193.28:0/949255580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c341156a0 msgr2=0x7f7c340f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c341156a0 0x7f7c340f5ea0 secure :-1 s=READY pgs=269 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c24005790 tx=0x7f7c24003c20 comp rx=0 tx=0).stop 2026-02-20T13:23:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 -- 10.20.193.28:0/949255580 shutdown_connections 2026-02-20T13:23:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c0c0b56d0 0x7f7c0c0d5b80 unknown :-1 s=CLOSED pgs=412 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7c3410fea0 0x7f7c34175f70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7c341156a0 0x7f7c340f5ea0 unknown :-1 s=CLOSED pgs=269 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 --2- 10.20.193.28:0/949255580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7c3410f4b0 0x7f7c340f57a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 -- 10.20.193.28:0/949255580 >> 10.20.193.28:0/949255580 conn(0x7f7c340ecda0 msgr2=0x7f7c34111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 -- 10.20.193.28:0/949255580 shutdown_connections 2026-02-20T13:23:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:23:48.417+0000 7f7c33577640 1 -- 10.20.193.28:0/949255580 wait complete. 2026-02-20T13:23:48.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 -- 10.20.193.28:0/3936488658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e9010f1a0 msgr2=0x7f3e9010f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3936488658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e9010f1a0 0x7f3e9010f590 secure :-1 s=READY pgs=857 gs=1 cs=0 l=1 c_cookie=15500688284169786102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e7c009950 tx=0x7f3e7c02f1d0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 -- 10.20.193.28:0/3936488658 shutdown_connections 2026-02-20T13:23:48.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3936488658 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e90110ce0 0x7f3e90171670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3936488658 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e90110330 0x7f3e901107a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3936488658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e9010f1a0 0x7f3e9010f590 unknown :-1 s=CLOSED pgs=857 gs=1 cs=0 l=1 c_cookie=15500688284169786102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 -- 10.20.193.28:0/3936488658 >> 10.20.193.28:0/3936488658 conn(0x7f3e900ec8f0 msgr2=0x7f3e9010cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 -- 10.20.193.28:0/3936488658 shutdown_connections 2026-02-20T13:23:48.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 -- 10.20.193.28:0/3936488658 wait complete. 2026-02-20T13:23:48.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.434+0000 7f3e967d4640 1 Processor -- start 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e967d4640 1 -- start start 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e967d4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e9010f1a0 0x7f3e900f8850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e967d4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e90110330 0x7f3e90171670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e967d4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90110ce0 0x7f3e900f90b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e967d4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900f9ca0 con 0x7f3e90110ce0 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e967d4640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900f9e10 con 0x7f3e9010f1a0 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e967d4640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900f9fd0 con 0x7f3e90110330 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e9010f1a0 0x7f3e900f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e8f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e90110330 0x7f3e90171670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e94d4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90110ce0 0x7f3e900f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e9010f1a0 0x7f3e900f8850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39664/0 (socket says 10.20.193.28:39664) 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e8ffff640 1 -- 10.20.193.28:0/3174771111 learned_addr learned my addr 10.20.193.28:0/3174771111 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e94d4a640 1 -- 10.20.193.28:0/3174771111 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e90110330 msgr2=0x7f3e90171670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e90110330 0x7f3e90171670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e94d4a640 1 -- 10.20.193.28:0/3174771111 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e9010f1a0 msgr2=0x7f3e900f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e9010f1a0 0x7f3e900f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e94d4a640 1 -- 10.20.193.28:0/3174771111 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c009570 con 0x7f3e90110ce0 2026-02-20T13:23:48.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.435+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90110ce0 0x7f3e900f90b0 secure :-1 s=READY pgs=858 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e8400f940 tx=0x7f3e8400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.436+0000 7f3e8d7fa640 1 -- 10.20.193.28:0/3174771111 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e8400dce0 con 0x7f3e90110ce0 2026-02-20T13:23:48.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.436+0000 7f3e8d7fa640 1 -- 10.20.193.28:0/3174771111 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e8400de40 con 0x7f3e90110ce0 2026-02-20T13:23:48.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.436+0000 7f3e8d7fa640 1 -- 10.20.193.28:0/3174771111 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e840116b0 con 0x7f3e90110ce0 2026-02-20T13:23:48.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.436+0000 7f3e967d4640 1 -- 10.20.193.28:0/3174771111 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e900fa2b0 con 0x7f3e90110ce0 2026-02-20T13:23:48.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.436+0000 7f3e967d4640 1 -- 10.20.193.28:0/3174771111 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e900fa730 con 0x7f3e90110ce0 2026-02-20T13:23:48.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.439+0000 7f3e8d7fa640 1 -- 10.20.193.28:0/3174771111 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3e84020060 con 0x7f3e90110ce0 2026-02-20T13:23:48.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.440+0000 7f3e8d7fa640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e640b5760 0x7f3e640d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.440+0000 7f3e8d7fa640 1 -- 10.20.193.28:0/3174771111 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3e84015070 con 0x7f3e90110ce0 2026-02-20T13:23:48.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e640b5760 0x7f3e640d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e98dc3e00 1 Processor -- start 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e98dc3e00 1 -- start start 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da213748a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da213951c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da213b5ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55da21269fd0 con 0x55da213544c0 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55da21265d00 con 0x55da21374de0 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.441+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55da2125fca0 con 0x55da21395700 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e640b5760 0x7f3e640d5c10 secure :-1 s=READY pgs=413 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e7c0023d0 tx=0x7f3e7c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da213951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da213951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39672/0 (socket says 10.20.193.28:39672) 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/944671938 learned_addr learned my addr 10.20.193.28:0/944671938 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da213b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da213748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/944671938 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 msgr2=0x55da213b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da213b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/944671938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 msgr2=0x55da213748a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da213748a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/944671938 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da212028b0 con 0x55da21374de0 2026-02-20T13:23:48.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da213748a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.442+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da213951c0 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=8014325822118616431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e80009cb0 tx=0x7f3e800107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f389adf9d9edd6f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e60bfe640 1 -- 10.20.193.28:0/944671938 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e800040d0 con 0x55da21374de0 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e60bfe640 1 -- 10.20.193.28:0/944671938 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e80002b80 con 0x55da21374de0 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e60bfe640 1 -- 10.20.193.28:0/944671938 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e8001a920 con 0x55da21374de0 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/944671938 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 msgr2=0x55da213951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da213951c0 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=8014325822118616431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e80009cb0 tx=0x7f3e800107a0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/944671938 shutdown_connections 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da213b5ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da213951c0 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=8014325822118616431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/944671938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da213748a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/944671938 >> 10.20.193.28:0/944671938 conn(0x55da212731c0 msgr2=0x55da21352da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/944671938 shutdown_connections 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.443+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/944671938 wait complete. 2026-02-20T13:23:48.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.444+0000 7f3e98dc3e00 1 -- start start 2026-02-20T13:23:48.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e98dc3e00 1 Processor -- start 2026-02-20T13:23:48.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da2136d910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da2136df60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da2136e9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55da2136f020 con 0x55da213544c0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55da2136f190 con 0x55da21374de0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55da2136f350 con 0x55da21395700 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da2136d910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da2136d910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34478/0 (socket says 10.20.193.28:34478) 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e8ffff640 1 -- 10.20.193.28:0/3275005411 learned_addr learned my addr 10.20.193.28:0/3275005411 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e94d4a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da2136e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.445+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da2136df60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e8ffff640 1 -- 10.20.193.28:0/3275005411 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 msgr2=0x55da2136e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da2136e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e8ffff640 1 -- 10.20.193.28:0/3275005411 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 msgr2=0x55da2136df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da2136df60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e8ffff640 1 -- 10.20.193.28:0/3275005411 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2120b400 con 0x55da213544c0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da2136e9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da2136d910 secure :-1 s=READY pgs=859 gs=1 cs=0 l=1 c_cookie=5483183346637032367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e7c038820 tx=0x7f3e7c02f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c182e33dea34baf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e51ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e51ffb640 1 -- 10.20.193.28:0/3275005411 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e7c038d50 con 0x55da213544c0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e51ffb640 1 -- 10.20.193.28:0/3275005411 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e7c051960 con 0x55da213544c0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e51ffb640 1 -- 10.20.193.28:0/3275005411 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e7c043680 con 0x55da213544c0 2026-02-20T13:23:48.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e800098d0 con 0x55da213544c0 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e98dc3e00 10 client.17838 _ll_register_callbacks cb 0x55da211eaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.446+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55da20eff520 con 0x55da213544c0 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e51ffb640 1 -- 10.20.193.28:0/3275005411 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3e7c051480 con 0x55da213544c0 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e51ffb640 1 -- 10.20.193.28:0/3275005411 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3e7c051680 con 0x55da213544c0 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e98dc3e00 10 client.17838 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55da211e3da0 con 0x55da213544c0 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e51ffb640 1 -- 10.20.193.28:0/3275005411 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3e7c043810 con 0x55da213544c0 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e98dc3e00 10 client.17838 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e98dc3e00 10 client.17838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e98dc3e00 20 client.17838 populate_metadata read hostname 'trial028' 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55da21371fd0 0x55da21372450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e98dc3e00 4 client.17838 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:23:48.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da21291630 con 0x55da21371fd0 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.447+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55da21371fd0 0x55da21372450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55da21371fd0 0x55da21372450 crc :-1 s=READY pgs=206 gs=4 cs=0 l=0 c_cookie=9927001404291145676 s_cookie=1782746481104440214 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89c3cb2e8393dfcc server_cookie=18bd967aaacecb96 in_seq=0 out_seq=0 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e51ffb640 10 client.17838 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e51ffb640 1 -- 10.20.193.28:0/3275005411 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55da21291630 con 0x55da21371fd0 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e51ffb640 10 client.17838 handle_command_reply: tid=0 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 client.17838 shutdown 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 msgr2=0x55da2136d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da2136d910 secure :-1 s=READY pgs=859 gs=1 cs=0 l=1 c_cookie=5483183346637032367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e7c038820 tx=0x7f3e7c02f1d0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 shutdown_connections 2026-02-20T13:23:48.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55da21371fd0 0x55da21372450 crc :-1 s=READY pgs=206 gs=4 cs=0 l=0 c_cookie=9927001404291145676 s_cookie=1782746481104440214 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21395700 0x55da2136e9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da2136df60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/3275005411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da213544c0 0x55da2136d910 unknown :-1 s=CLOSED pgs=859 gs=1 cs=0 l=1 c_cookie=5483183346637032367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e51ffb640 0 client.17838 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:48.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 >> 10.20.193.28:0/3275005411 conn(0x55da212731c0 msgr2=0x55da21355790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 shutdown_connections 2026-02-20T13:23:48.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/3275005411 wait complete. 2026-02-20T13:23:48.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.448+0000 7f3e98dc3e00 20 client.17838 trim_cache size 0 max 16384 2026-02-20T13:23:48.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.456+0000 7f3e98dc3e00 1 Processor -- start 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.456+0000 7f3e98dc3e00 1 -- start start 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da213544c0 0x55da2136d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21374de0 0x55da213935c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21393b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55da2125d8d0 con 0x55da21395700 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55da20f9ef10 con 0x55da213544c0 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55da2136e0a0 con 0x55da21374de0 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21374de0 0x55da213935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21374de0 0x55da213935c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53984/0 (socket says 10.20.193.28:53984) 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/1507250814 learned_addr learned my addr 10.20.193.28:0/1507250814 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21393b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da213544c0 0x55da2136d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/1507250814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da213544c0 msgr2=0x55da2136d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da213544c0 0x55da2136d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/1507250814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 msgr2=0x55da21393b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21393b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/1507250814 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da211f5670 con 0x55da21374de0 2026-02-20T13:23:48.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21393b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:23:48.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21374de0 0x55da213935c0 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=13066499580733328794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e80004630 tx=0x7f3e8001a470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5558823af668d9a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.457+0000 7f3e53fff640 1 -- 10.20.193.28:0/1507250814 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e8001f040 con 0x55da21374de0 2026-02-20T13:23:48.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e53fff640 1 -- 10.20.193.28:0/1507250814 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e80020040 con 0x55da21374de0 2026-02-20T13:23:48.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e53fff640 1 -- 10.20.193.28:0/1507250814 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e800029b0 con 0x55da21374de0 2026-02-20T13:23:48.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/1507250814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21374de0 msgr2=0x55da213935c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21374de0 0x55da213935c0 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=13066499580733328794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e80004630 tx=0x7f3e8001a470 comp rx=0 tx=0).stop 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/1507250814 shutdown_connections 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21393b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da21374de0 0x55da213935c0 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=13066499580733328794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/1507250814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da213544c0 0x55da2136d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/1507250814 >> 10.20.193.28:0/1507250814 conn(0x55da212731c0 msgr2=0x55da21369c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/1507250814 shutdown_connections 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/1507250814 wait complete. 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.458+0000 7f3e98dc3e00 1 -- start start 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e98dc3e00 1 Processor -- start 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da213544c0 0x55da213766b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da21376d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e98dc3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21377440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55da21377b40 con 0x55da21395700 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55da21377cb0 con 0x55da21374de0 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e98dc3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55da21377e70 con 0x55da213544c0 2026-02-20T13:23:48.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da213544c0 0x55da213766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da213544c0 0x55da213766b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53994/0 (socket says 10.20.193.28:53994) 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8ffff640 1 -- 10.20.193.28:0/2974571686 learned_addr learned my addr 10.20.193.28:0/2974571686 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da21376d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8ffff640 1 -- 10.20.193.28:0/2974571686 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 msgr2=0x55da21376d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da21376d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21377440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8ffff640 1 -- 10.20.193.28:0/2974571686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 msgr2=0x55da21377440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21377440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.459+0000 7f3e8ffff640 1 -- 10.20.193.28:0/2974571686 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da211f00f0 con 0x55da213544c0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e94d4a640 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21377440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da213544c0 0x55da213766b0 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=1741612662567531833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e7c004500 tx=0x7f3e7c009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=182b737d38a8f539 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e51ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e51ffb640 1 -- 10.20.193.28:0/2974571686 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e7c037c60 con 0x55da213544c0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e51ffb640 1 -- 10.20.193.28:0/2974571686 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55da20eff520 con 0x55da213544c0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e51ffb640 1 -- 10.20.193.28:0/2974571686 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e7c037960 con 0x55da213544c0 2026-02-20T13:23:48.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da212028b0 con 0x55da213544c0 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e51ffb640 1 -- 10.20.193.28:0/2974571686 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3e7c050820 con 0x55da213544c0 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e51ffb640 10 client.27706 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e98dc3e00 10 client.27706 _ll_register_callbacks cb 0x55da211eaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55da2130fca0 con 0x55da213544c0 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e51ffb640 1 -- 10.20.193.28:0/2974571686 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3e7c059360 con 0x55da213544c0 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e98dc3e00 10 client.27706 fetch_fsmap learned FSMap version 28 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.460+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55da211e40d0 con 0x55da213544c0 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e51ffb640 1 -- 10.20.193.28:0/2974571686 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3e7c0509e0 con 0x55da213544c0 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e98dc3e00 10 client.27706 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e98dc3e00 10 client.27706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e98dc3e00 20 client.27706 populate_metadata read hostname 'trial028' 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55da213799c0 0x55da21379e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e98dc3e00 4 client.27706 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da20f43640 con 0x55da213799c0 2026-02-20T13:23:48.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55da213799c0 0x55da21379e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:23:48.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55da213799c0 0x55da21379e60 crc :-1 s=READY pgs=207 gs=4 cs=0 l=0 c_cookie=7172105921641720115 s_cookie=1065587302463363521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6388705616ee2933 server_cookie=ec9ba01807ed9c1 in_seq=0 out_seq=0 2026-02-20T13:23:48.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.461+0000 7f3e51ffb640 10 client.27706 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:48.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e51ffb640 1 -- 10.20.193.28:0/2974571686 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da20f43640 con 0x55da213799c0 2026-02-20T13:23:48.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e51ffb640 10 client.27706 handle_command_reply: tid=0 2026-02-20T13:23:48.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 client.27706 shutdown 2026-02-20T13:23:48.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da213544c0 msgr2=0x55da213766b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da213544c0 0x55da213766b0 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=1741612662567531833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e7c004500 tx=0x7f3e7c009360 comp rx=0 tx=0).stop 2026-02-20T13:23:48.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 shutdown_connections 2026-02-20T13:23:48.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55da213799c0 0x55da21379e60 crc :-1 s=READY pgs=207 gs=4 cs=0 l=0 c_cookie=7172105921641720115 s_cookie=1065587302463363521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da21395700 0x55da21377440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55da21374de0 0x55da21376d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e51ffb640 0 client.27706 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 --2- 10.20.193.28:0/2974571686 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55da213544c0 0x55da213766b0 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=1741612662567531833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 >> 10.20.193.28:0/2974571686 conn(0x55da212731c0 msgr2=0x55da21369c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 shutdown_connections 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 1 -- 10.20.193.28:0/2974571686 wait complete. 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.472+0000 7f3e98dc3e00 20 client.27706 trim_cache size 0 max 16384 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:23:48.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:23:48.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 -- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e640b5760 msgr2=0x7f3e640d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e640b5760 0x7f3e640d5c10 secure :-1 s=READY pgs=413 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e7c0023d0 tx=0x7f3e7c031040 comp rx=0 tx=0).stop 2026-02-20T13:23:48.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 -- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90110ce0 msgr2=0x7f3e900f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:23:48.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90110ce0 0x7f3e900f90b0 secure :-1 s=READY pgs=858 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e8400f940 tx=0x7f3e8400fe10 comp rx=0 tx=0).stop 2026-02-20T13:23:48.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 -- 10.20.193.28:0/3174771111 shutdown_connections 2026-02-20T13:23:48.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e640b5760 0x7f3e640d5c10 unknown :-1 s=CLOSED pgs=413 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90110ce0 0x7f3e900f90b0 unknown :-1 s=CLOSED pgs=858 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e90110330 0x7f3e90171670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 --2- 10.20.193.28:0/3174771111 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e9010f1a0 0x7f3e900f8850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:23:48.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 -- 10.20.193.28:0/3174771111 >> 10.20.193.28:0/3174771111 conn(0x7f3e900ec8f0 msgr2=0x7f3e900eee90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:23:48.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 -- 10.20.193.28:0/3174771111 shutdown_connections 2026-02-20T13:23:48.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:23:48.473+0000 7f3e967d4640 1 -- 10.20.193.28:0/3174771111 wait complete. 2026-02-20T13:23:48.523 INFO:tasks.cephfs.filesystem:scrub status for tag:3c6ee257-65e6-4778-8f07-47859e3b574b - {'path': '/', 'tag': '3c6ee257-65e6-4778-8f07-47859e3b574b', 'options': 'recursive,force'} 2026-02-20T13:23:48.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:48 trial028 ceph-mon[37442]: pgmap v375: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:23:48.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:48 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:23:48.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:48 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:23:48.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:48 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:48 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:23:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:48 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:48 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:48 trial127 ceph-mon[43817]: pgmap v375: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:23:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:48 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:23:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:48 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:23:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:48 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:48 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:23:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:48 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:48 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:48 trial034 ceph-mon[43332]: pgmap v375: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:23:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:48 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:23:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:48 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:23:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:48 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:48 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:23:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:48 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:48 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:23:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:50 trial028 ceph-mon[37442]: pgmap v376: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2026-02-20T13:23:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:50 trial127 ceph-mon[43817]: pgmap v376: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2026-02-20T13:23:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:50 trial034 ceph-mon[43332]: pgmap v376: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2026-02-20T13:23:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:52 trial028 ceph-mon[37442]: pgmap v377: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2026-02-20T13:23:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:52 trial127 ceph-mon[43817]: pgmap v377: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2026-02-20T13:23:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:52 trial034 ceph-mon[43332]: pgmap v377: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2026-02-20T13:23:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:54 trial028 ceph-mon[37442]: pgmap v378: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:23:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:54 trial127 ceph-mon[43817]: pgmap v378: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:23:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:54 trial034 ceph-mon[43332]: pgmap v378: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:23:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:56 trial028 ceph-mon[37442]: pgmap v379: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:23:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:56 trial127 ceph-mon[43817]: pgmap v379: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:23:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:56 trial034 ceph-mon[43332]: pgmap v379: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T13:23:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:23:58 trial028 ceph-mon[37442]: pgmap v380: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2026-02-20T13:23:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:23:58 trial127 ceph-mon[43817]: pgmap v380: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2026-02-20T13:23:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:23:58 trial034 ceph-mon[43332]: pgmap v380: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2026-02-20T13:24:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:00 trial028 ceph-mon[37442]: pgmap v381: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:24:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:00 trial127 ceph-mon[43817]: pgmap v381: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:24:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:00 trial034 ceph-mon[43332]: pgmap v381: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:24:01.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 -- 10.20.193.28:0/1283695078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810ca20 msgr2=0x7fb2d816e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 --2- 10.20.193.28:0/1283695078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810ca20 0x7fb2d816e0e0 secure :-1 s=READY pgs=860 gs=2 cs=0 l=1 c_cookie=16771024885546083520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2d400a9a0 tx=0x7fb2d40301b0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 -- 10.20.193.28:0/1283695078 shutdown_connections 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 --2- 10.20.193.28:0/1283695078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810ca20 0x7fb2d816e0e0 unknown :-1 s=CLOSED pgs=860 gs=2 cs=0 l=1 c_cookie=16771024885546083520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 --2- 10.20.193.28:0/1283695078 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2d810c070 0x7fb2d810c4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 --2- 10.20.193.28:0/1283695078 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2d810d3f0 0x7fb2d810d7e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 -- 10.20.193.28:0/1283695078 >> 10.20.193.28:0/1283695078 conn(0x7fb2d80e8a80 msgr2=0x7fb2d8108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 -- 10.20.193.28:0/1283695078 shutdown_connections 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 -- 10.20.193.28:0/1283695078 wait complete. 2026-02-20T13:24:01.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.546+0000 7fb2de764640 1 Processor -- start 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2de764640 1 -- start start 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2de764640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810c070 0x7fb2d80ec710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2de764640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2d810ca20 0x7fb2d816e0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2de764640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2d810d3f0 0x7fb2d80eb020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2de764640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d80eb560 con 0x7fb2d810c070 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2de764640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d80eb6d0 con 0x7fb2d810d3f0 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2de764640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d80eb890 con 0x7fb2d810ca20 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810c070 0x7fb2d80ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810c070 0x7fb2d80ec710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40358/0 (socket says 10.20.193.28:40358) 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 -- 10.20.193.28:0/979929195 learned_addr learned my addr 10.20.193.28:0/979929195 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:01.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2d810ca20 0x7fb2d816e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2ddf63640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2d810d3f0 0x7fb2d80eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 -- 10.20.193.28:0/979929195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2d810ca20 msgr2=0x7fb2d816e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2d810ca20 0x7fb2d816e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 -- 10.20.193.28:0/979929195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2d810d3f0 msgr2=0x7fb2d80eb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2d810d3f0 0x7fb2d80eb020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 -- 10.20.193.28:0/979929195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d400a590 con 0x7fb2d810c070 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2dd762640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810c070 0x7fb2d80ec710 secure :-1 s=READY pgs=861 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2c800e9c0 tx=0x7fb2c800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.547+0000 7fb2c67fc640 1 -- 10.20.193.28:0/979929195 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2c800cd70 con 0x7fb2d810c070 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.548+0000 7fb2c67fc640 1 -- 10.20.193.28:0/979929195 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2c8004d30 con 0x7fb2d810c070 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.548+0000 7fb2c67fc640 1 -- 10.20.193.28:0/979929195 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2c80106b0 con 0x7fb2d810c070 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.548+0000 7fb2de764640 1 -- 10.20.193.28:0/979929195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d80ebb70 con 0x7fb2d810c070 2026-02-20T13:24:01.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.548+0000 7fb2de764640 1 -- 10.20.193.28:0/979929195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d80f5910 con 0x7fb2d810c070 2026-02-20T13:24:01.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.552+0000 7fb2c67fc640 1 -- 10.20.193.28:0/979929195 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb2c801f060 con 0x7fb2d810c070 2026-02-20T13:24:01.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2c67fc640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2b40b5760 0x7fb2b40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2c67fc640 1 -- 10.20.193.28:0/979929195 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb2c8014070 con 0x7fb2d810c070 2026-02-20T13:24:01.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2e1fd8e00 1 Processor -- start 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2e1fd8e00 1 -- start start 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2b40b5760 0x7fb2b40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507aca8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507acade0 0x560507aeb1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507b0bae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5605079bffd0 con 0x560507aaa4c0 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5605079bbd00 con 0x560507aeb700 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.553+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5605079b5ca0 con 0x560507acade0 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2ddf63640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507b0bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507aca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2ddf63640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507b0bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34290/0 (socket says 10.20.193.28:34290) 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2ddf63640 1 -- 10.20.193.28:0/1357713096 learned_addr learned my addr 10.20.193.28:0/1357713096 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/1357713096 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507acade0 0x560507aeb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dd762640 1 -- 10.20.193.28:0/1357713096 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507acade0 msgr2=0x560507aeb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dd762640 1 --2- 10.20.193.28:0/1357713096 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507acade0 0x560507aeb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dd762640 1 -- 10.20.193.28:0/1357713096 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 msgr2=0x560507b0bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dd762640 1 --2- 10.20.193.28:0/1357713096 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507b0bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dd762640 1 -- 10.20.193.28:0/1357713096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605079588b0 con 0x560507aaa4c0 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2b40b5760 0x7fb2b40d5c10 secure :-1 s=READY pgs=414 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2cc004740 tx=0x7fb2cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2dd762640 1 --2- 10.20.193.28:0/1357713096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507aca8a0 secure :-1 s=READY pgs=862 gs=1 cs=0 l=1 c_cookie=10092013296836835279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2c80e47e0 tx=0x7fb2c80a9790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0e089faa7a77cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2a5bfe640 1 -- 10.20.193.28:0/1357713096 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2c80ac870 con 0x560507aaa4c0 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2a5bfe640 1 -- 10.20.193.28:0/1357713096 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2c800b2c0 con 0x560507aaa4c0 2026-02-20T13:24:01.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.554+0000 7fb2a5bfe640 1 -- 10.20.193.28:0/1357713096 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2c80b7d20 con 0x560507aaa4c0 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1357713096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 msgr2=0x560507aca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/1357713096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507aca8a0 secure :-1 s=READY pgs=862 gs=1 cs=0 l=1 c_cookie=10092013296836835279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2c80e47e0 tx=0x7fb2c80a9790 comp rx=0 tx=0).stop 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1357713096 shutdown_connections 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/1357713096 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507b0bae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/1357713096 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507acade0 0x560507aeb1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/1357713096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507aca8a0 unknown :-1 s=CLOSED pgs=862 gs=1 cs=0 l=1 c_cookie=10092013296836835279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1357713096 >> 10.20.193.28:0/1357713096 conn(0x5605079c91c0 msgr2=0x560507aa8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1357713096 shutdown_connections 2026-02-20T13:24:01.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.555+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1357713096 wait complete. 2026-02-20T13:24:01.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.556+0000 7fb2e1fd8e00 1 -- start start 2026-02-20T13:24:01.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.556+0000 7fb2e1fd8e00 1 Processor -- start 2026-02-20T13:24:01.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.556+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507ac3b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.556+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ac41a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.556+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aeb700 0x560507ac4c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.556+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560507ac5260 con 0x560507aaa4c0 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.556+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560507ac53d0 con 0x560507acade0 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.556+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560507ac5590 con 0x560507aeb700 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dcf61640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ac41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507ac3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507ac3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40378/0 (socket says 10.20.193.28:40378) 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dcf61640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ac41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34300/0 (socket says 10.20.193.28:34300) 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 -- 10.20.193.28:0/3427149310 learned_addr learned my addr 10.20.193.28:0/3427149310 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2ddf63640 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aeb700 0x560507ac4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 -- 10.20.193.28:0/3427149310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aeb700 msgr2=0x560507ac4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aeb700 0x560507ac4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 -- 10.20.193.28:0/3427149310 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 msgr2=0x560507ac41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ac41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 -- 10.20.193.28:0/3427149310 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560507961400 con 0x560507aaa4c0 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2dd762640 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507ac3b50 secure :-1 s=READY pgs=863 gs=2 cs=0 l=1 c_cookie=9569620630254806141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2c80a9640 tx=0x7fb2c80b81b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ce1f42dd96647d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb292ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb292ffd640 1 -- 10.20.193.28:0/3427149310 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2c80ac870 con 0x560507aaa4c0 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d80f5910 con 0x560507aaa4c0 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2e1fd8e00 10 client.17853 _ll_register_callbacks cb 0x560507940a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560507655520 con 0x560507aaa4c0 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb292ffd640 1 -- 10.20.193.28:0/3427149310 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2c80b2d90 con 0x560507aaa4c0 2026-02-20T13:24:01.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb292ffd640 1 -- 10.20.193.28:0/3427149310 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2c80aec80 con 0x560507aaa4c0 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb292ffd640 1 -- 10.20.193.28:0/3427149310 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb2c80ab280 con 0x560507aaa4c0 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb292ffd640 1 -- 10.20.193.28:0/3427149310 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2c80d2110 con 0x560507aaa4c0 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2e1fd8e00 10 client.17853 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.557+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560507939da0 con 0x560507aaa4c0 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.558+0000 7fb292ffd640 1 -- 10.20.193.28:0/3427149310 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb2c80d2270 con 0x560507aaa4c0 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.558+0000 7fb2e1fd8e00 10 client.17853 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.558+0000 7fb2e1fd8e00 10 client.17853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.558+0000 7fb2e1fd8e00 20 client.17853 populate_metadata read hostname 'trial028' 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.558+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560507ac7f70 0x560507ac8410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.558+0000 7fb2e1fd8e00 4 client.17853 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.558+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605079e7630 con 0x560507ac7f70 2026-02-20T13:24:01.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.558+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560507ac7f70 0x560507ac8410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb292ffd640 10 client.17853 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560507ac7f70 0x560507ac8410 crc :-1 s=READY pgs=208 gs=4 cs=0 l=0 c_cookie=5756117292482218965 s_cookie=11577290353801474299 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe1d62e27e2cbd5 server_cookie=a0aacc3cd7e4b0fb in_seq=0 out_seq=0 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb292ffd640 1 -- 10.20.193.28:0/3427149310 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5605079e7630 con 0x560507ac7f70 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb292ffd640 10 client.17853 handle_command_reply: tid=0 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 client.17853 shutdown 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 msgr2=0x560507ac3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507ac3b50 secure :-1 s=READY pgs=863 gs=2 cs=0 l=1 c_cookie=9569620630254806141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2c80a9640 tx=0x7fb2c80b81b0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 shutdown_connections 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560507ac7f70 0x560507ac8410 crc :-1 s=READY pgs=208 gs=4 cs=0 l=0 c_cookie=5756117292482218965 s_cookie=11577290353801474299 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aeb700 0x560507ac4c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ac41a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3427149310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aaa4c0 0x560507ac3b50 unknown :-1 s=CLOSED pgs=863 gs=2 cs=0 l=1 c_cookie=9569620630254806141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb292ffd640 0 client.17853 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:01.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 >> 10.20.193.28:0/3427149310 conn(0x5605079c91c0 msgr2=0x560507aab790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:01.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 shutdown_connections 2026-02-20T13:24:01.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.559+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3427149310 wait complete. 2026-02-20T13:24:01.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.560+0000 7fb2e1fd8e00 20 client.17853 trim_cache size 0 max 16384 2026-02-20T13:24:01.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2e1fd8e00 1 Processor -- start 2026-02-20T13:24:01.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2e1fd8e00 1 -- start start 2026-02-20T13:24:01.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ac39c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ae95c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aeb700 0x560507ae9b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5605079b38d0 con 0x560507aeb700 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5605076f4f10 con 0x560507acade0 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560507a194b0 con 0x560507aaa4c0 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ac39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2ddf63640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aeb700 0x560507ae9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2dcf61640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ae95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2ddf63640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aeb700 0x560507ae9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40390/0 (socket says 10.20.193.28:40390) 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2dcf61640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ae95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34302/0 (socket says 10.20.193.28:34302) 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2ddf63640 1 -- 10.20.193.28:0/1177236007 learned_addr learned my addr 10.20.193.28:0/1177236007 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.567+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ac39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33304/0 (socket says 10.20.193.28:33304) 2026-02-20T13:24:01.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2dcf61640 1 -- 10.20.193.28:0/1177236007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 msgr2=0x560507ac39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/1177236007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ac39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2dcf61640 1 -- 10.20.193.28:0/1177236007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aeb700 msgr2=0x560507ae9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/1177236007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aeb700 0x560507ae9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2dcf61640 1 -- 10.20.193.28:0/1177236007 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56050794b670 con 0x560507acade0 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2ddf63640 1 --2- 10.20.193.28:0/1177236007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aeb700 0x560507ae9b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/1177236007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ae95c0 secure :-1 s=READY pgs=321 gs=3 cs=0 l=1 c_cookie=2283463111342718636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560507ac8a10 tx=0x7fb2cc019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fb07d99f94a7eac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2a53fd640 1 -- 10.20.193.28:0/1177236007 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2cc020040 con 0x560507acade0 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2a53fd640 1 -- 10.20.193.28:0/1177236007 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2cc021040 con 0x560507acade0 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2a53fd640 1 -- 10.20.193.28:0/1177236007 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2cc029a20 con 0x560507acade0 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1177236007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 msgr2=0x560507ae95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.568+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/1177236007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ae95c0 secure :-1 s=READY pgs=321 gs=3 cs=0 l=1 c_cookie=2283463111342718636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560507ac8a10 tx=0x7fb2cc019000 comp rx=0 tx=0).stop 2026-02-20T13:24:01.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1177236007 shutdown_connections 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/1177236007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507aeb700 0x560507ae9b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/1177236007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507acade0 0x560507ae95c0 unknown :-1 s=CLOSED pgs=321 gs=3 cs=0 l=1 c_cookie=2283463111342718636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/1177236007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ac39c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1177236007 >> 10.20.193.28:0/1177236007 conn(0x5605079c91c0 msgr2=0x560507abfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1177236007 shutdown_connections 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/1177236007 wait complete. 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 -- start start 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 Processor -- start 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ad0e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507acade0 0x560507acfbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507ad0130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560507ad0830 con 0x560507acade0 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560507ad09a0 con 0x560507aeb700 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.569+0000 7fb2e1fd8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560507ace820 con 0x560507aaa4c0 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ad0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2ddf63640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507ad0130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ad0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33316/0 (socket says 10.20.193.28:33316) 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 -- 10.20.193.28:0/3416222969 learned_addr learned my addr 10.20.193.28:0/3416222969 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507acade0 0x560507acfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 -- 10.20.193.28:0/3416222969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 msgr2=0x560507ad0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507ad0130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 -- 10.20.193.28:0/3416222969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507acade0 msgr2=0x560507acfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507acade0 0x560507acfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 -- 10.20.193.28:0/3416222969 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc009c50 con 0x560507aaa4c0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507acade0 0x560507acfbf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb2dd762640 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ad0e90 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=12058624025057378482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2c80e4840 tx=0x7fb2c800efd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a758d6a9558940b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb292ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb292ffd640 1 -- 10.20.193.28:0/3416222969 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2c80ac870 con 0x560507aaa4c0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.570+0000 7fb292ffd640 1 -- 10.20.193.28:0/3416222969 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560507655520 con 0x560507aaa4c0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d816eb40 con 0x560507aaa4c0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb292ffd640 1 -- 10.20.193.28:0/3416222969 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2c80b5370 con 0x560507aaa4c0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb292ffd640 1 -- 10.20.193.28:0/3416222969 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb2c80ae720 con 0x560507aaa4c0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb292ffd640 10 client.27721 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 10 client.27721 _ll_register_callbacks cb 0x560507940a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560507a65ca0 con 0x560507aaa4c0 2026-02-20T13:24:01.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb292ffd640 1 -- 10.20.193.28:0/3416222969 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2c8096850 con 0x560507aaa4c0 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 10 client.27721 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5605079460f0 con 0x560507aaa4c0 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb292ffd640 1 -- 10.20.193.28:0/3416222969 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb2c80e2d20 con 0x560507aaa4c0 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 10 client.27721 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 10 client.27721 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 20 client.27721 populate_metadata read hostname 'trial028' 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560507b988a0 0x560507bb8d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 4 client.27721 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560507699640 con 0x560507b988a0 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.571+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560507b988a0 0x560507bb8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.572+0000 7fb2dcf61640 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560507b988a0 0x560507bb8d50 crc :-1 s=READY pgs=209 gs=4 cs=0 l=0 c_cookie=7412304495869612171 s_cookie=6738685768655757264 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66ddcbaabb56d08b server_cookie=5d849f00e5b4dfd0 in_seq=0 out_seq=0 2026-02-20T13:24:01.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.572+0000 7fb292ffd640 10 client.27721 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:01.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb292ffd640 1 -- 10.20.193.28:0/3416222969 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560507699640 con 0x560507b988a0 2026-02-20T13:24:01.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb292ffd640 10 client.27721 handle_command_reply: tid=0 2026-02-20T13:24:01.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 client.27721 shutdown 2026-02-20T13:24:01.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 msgr2=0x560507ad0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ad0e90 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=12058624025057378482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2c80e4840 tx=0x7fb2c800efd0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 shutdown_connections 2026-02-20T13:24:01.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560507b988a0 0x560507bb8d50 crc :-1 s=READY pgs=209 gs=4 cs=0 l=0 c_cookie=7412304495869612171 s_cookie=6738685768655757264 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560507acade0 0x560507acfbf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560507aeb700 0x560507ad0130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 --2- 10.20.193.28:0/3416222969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560507aaa4c0 0x560507ad0e90 unknown :-1 s=CLOSED pgs=273 gs=2 cs=0 l=1 c_cookie=12058624025057378482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb292ffd640 0 client.27721 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:01.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 >> 10.20.193.28:0/3416222969 conn(0x5605079c91c0 msgr2=0x560507abfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:01.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 shutdown_connections 2026-02-20T13:24:01.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 1 -- 10.20.193.28:0/3416222969 wait complete. 2026-02-20T13:24:01.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2e1fd8e00 20 client.27721 trim_cache size 0 max 16384 2026-02-20T13:24:01.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:24:01.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:24:01.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:24:01.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2de764640 1 -- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2b40b5760 msgr2=0x7fb2b40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2de764640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2b40b5760 0x7fb2b40d5c10 secure :-1 s=READY pgs=414 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2cc004740 tx=0x7fb2cc005f90 comp rx=0 tx=0).stop 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2de764640 1 -- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810c070 msgr2=0x7fb2d80ec710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.575+0000 7fb2de764640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810c070 0x7fb2d80ec710 secure :-1 s=READY pgs=861 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2c800e9c0 tx=0x7fb2c800ee90 comp rx=0 tx=0).stop 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.576+0000 7fb2de764640 1 -- 10.20.193.28:0/979929195 shutdown_connections 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.576+0000 7fb2de764640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb2b40b5760 0x7fb2b40d5c10 unknown :-1 s=CLOSED pgs=414 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.576+0000 7fb2de764640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb2d810d3f0 0x7fb2d80eb020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.576+0000 7fb2de764640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb2d810ca20 0x7fb2d816e0e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.576+0000 7fb2de764640 1 --2- 10.20.193.28:0/979929195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2d810c070 0x7fb2d80ec710 unknown :-1 s=CLOSED pgs=861 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.576+0000 7fb2de764640 1 -- 10.20.193.28:0/979929195 >> 10.20.193.28:0/979929195 conn(0x7fb2d80e8a80 msgr2=0x7fb2d810af20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:01.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.576+0000 7fb2de764640 1 -- 10.20.193.28:0/979929195 shutdown_connections 2026-02-20T13:24:01.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:01.576+0000 7fb2de764640 1 -- 10.20.193.28:0/979929195 wait complete. 2026-02-20T13:24:02.001 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:24:02.183 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 -- 10.20.193.28:0/9800534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a810fc20 msgr2=0x7fe5a8114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/9800534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a810fc20 0x7fe5a8114c70 secure :-1 s=READY pgs=864 gs=1 cs=0 l=1 c_cookie=625417540520715155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe590009890 tx=0x7fe59002f120 comp rx=0 tx=0).stop 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 -- 10.20.193.28:0/9800534 shutdown_connections 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/9800534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a810fc20 0x7fe5a8114c70 unknown :-1 s=CLOSED pgs=864 gs=1 cs=0 l=1 c_cookie=625417540520715155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/9800534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5a8115420 0x7fe5a8175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/9800534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5a810f230 0x7fe5a810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 -- 10.20.193.28:0/9800534 >> 10.20.193.28:0/9800534 conn(0x7fe5a805f830 msgr2=0x7fe5a810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 -- 10.20.193.28:0/9800534 shutdown_connections 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.352+0000 7fe5af1d1640 1 -- 10.20.193.28:0/9800534 wait complete. 2026-02-20T13:24:02.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5af1d1640 1 Processor -- start 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5af1d1640 1 -- start start 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5af1d1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5a810f230 0x7fe5a80f54e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5af1d1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5a810fc20 0x7fe5a8175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5af1d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a8115420 0x7fe5a80f5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5af1d1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a80fadf0 con 0x7fe5a8115420 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5af1d1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a80faf60 con 0x7fe5a810fc20 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5af1d1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a80fb120 con 0x7fe5a810f230 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5acf46640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5a810f230 0x7fe5a80f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5ad747640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a8115420 0x7fe5a80f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5ad747640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a8115420 0x7fe5a80f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40396/0 (socket says 10.20.193.28:40396) 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.353+0000 7fe5ad747640 1 -- 10.20.193.28:0/155217690 learned_addr learned my addr 10.20.193.28:0/155217690 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe59ffff640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5a810fc20 0x7fe5a8175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe5ad747640 1 -- 10.20.193.28:0/155217690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5a810f230 msgr2=0x7fe5a80f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe5ad747640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5a810f230 0x7fe5a80f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe5ad747640 1 -- 10.20.193.28:0/155217690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5a810fc20 msgr2=0x7fe5a8175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe5ad747640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5a810fc20 0x7fe5a8175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe5ad747640 1 -- 10.20.193.28:0/155217690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe598009570 con 0x7fe5a8115420 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe5ad747640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a8115420 0x7fe5a80f5be0 secure :-1 s=READY pgs=865 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5a400f8d0 tx=0x7fe5a400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe59dffb640 1 -- 10.20.193.28:0/155217690 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5a400dce0 con 0x7fe5a8115420 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe59dffb640 1 -- 10.20.193.28:0/155217690 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe5a400de40 con 0x7fe5a8115420 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe59dffb640 1 -- 10.20.193.28:0/155217690 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5a40116b0 con 0x7fe5a8115420 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5900094b0 con 0x7fe5a8115420 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.354+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a80fb6f0 con 0x7fe5a8115420 2026-02-20T13:24:02.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.355+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a8110510 con 0x7fe5a8115420 2026-02-20T13:24:02.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.357+0000 7fe59dffb640 1 -- 10.20.193.28:0/155217690 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe5a4020060 con 0x7fe5a8115420 2026-02-20T13:24:02.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.359+0000 7fe59dffb640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5840b5750 0x7fe5840d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.359+0000 7fe59dffb640 1 -- 10.20.193.28:0/155217690 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe5a4015070 con 0x7fe5a8115420 2026-02-20T13:24:02.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.359+0000 7fe5acf46640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5840b5750 0x7fe5840d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.359+0000 7fe59dffb640 1 -- 10.20.193.28:0/155217690 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe5a40e80d0 con 0x7fe5a8115420 2026-02-20T13:24:02.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.360+0000 7fe5acf46640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5840b5750 0x7fe5840d5c00 secure :-1 s=READY pgs=415 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe598005b30 tx=0x7fe598009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:02.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.500+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5a80fb9d0 con 0x7fe5a8115420 2026-02-20T13:24:02.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.500+0000 7fe59dffb640 1 -- 10.20.193.28:0/155217690 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fe5a40aa7c0 con 0x7fe5a8115420 2026-02-20T13:24:02.504 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:24:02.504 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:24:02.505 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:24:02.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5840b5750 msgr2=0x7fe5840d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5840b5750 0x7fe5840d5c00 secure :-1 s=READY pgs=415 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe598005b30 tx=0x7fe598009310 comp rx=0 tx=0).stop 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a8115420 msgr2=0x7fe5a80f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a8115420 0x7fe5a80f5be0 secure :-1 s=READY pgs=865 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5a400f8d0 tx=0x7fe5a400fda0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 shutdown_connections 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe5840b5750 0x7fe5840d5c00 unknown :-1 s=CLOSED pgs=415 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe5a8115420 0x7fe5a80f5be0 unknown :-1 s=CLOSED pgs=865 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe5a810fc20 0x7fe5a8175cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 --2- 10.20.193.28:0/155217690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe5a810f230 0x7fe5a80f54e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 >> 10.20.193.28:0/155217690 conn(0x7fe5a805f830 msgr2=0x7fe5a8111a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 shutdown_connections 2026-02-20T13:24:02.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.502+0000 7fe5af1d1640 1 -- 10.20.193.28:0/155217690 wait complete. 2026-02-20T13:24:02.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:02 trial028 ceph-mon[37442]: pgmap v382: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:24:02.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:02 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/155217690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:02.603 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id 6754165a --release --await' 2026-02-20T13:24:02.603 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id 6754165a --release --await 2026-02-20T13:24:02.789 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:02.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.958+0000 7f886cfed640 1 -- 10.20.193.28:0/4075282589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 msgr2=0x7f886810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.958+0000 7f886cfed640 1 --2- 10.20.193.28:0/4075282589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 0x7f886810f880 secure :-1 s=READY pgs=866 gs=1 cs=0 l=1 c_cookie=9113575226397312078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8854009950 tx=0x7f885402f190 comp rx=0 tx=0).stop 2026-02-20T13:24:02.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.959+0000 7f886cfed640 1 -- 10.20.193.28:0/4075282589 shutdown_connections 2026-02-20T13:24:02.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.959+0000 7f886cfed640 1 --2- 10.20.193.28:0/4075282589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f88681156a0 0x7f8868176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.959+0000 7f886cfed640 1 --2- 10.20.193.28:0/4075282589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f886810fea0 0x7f8868114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.959+0000 7f886cfed640 1 --2- 10.20.193.28:0/4075282589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 0x7f886810f880 unknown :-1 s=CLOSED pgs=866 gs=1 cs=0 l=1 c_cookie=9113575226397312078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.959+0000 7f886cfed640 1 -- 10.20.193.28:0/4075282589 >> 10.20.193.28:0/4075282589 conn(0x7f88680ecda0 msgr2=0x7f886810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:02.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.959+0000 7f886cfed640 1 -- 10.20.193.28:0/4075282589 shutdown_connections 2026-02-20T13:24:02.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.959+0000 7f886cfed640 1 -- 10.20.193.28:0/4075282589 wait complete. 2026-02-20T13:24:02.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f886cfed640 1 Processor -- start 2026-02-20T13:24:02.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f886cfed640 1 -- start start 2026-02-20T13:24:02.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f886cfed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 0x7f886811de30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f886cfed640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f886810fea0 0x7f886811e370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f886cfed640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88681156a0 0x7f88681236f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f886cfed640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8868123d10 con 0x7f886810f4b0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f886cfed640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8868123e80 con 0x7f886810fea0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f886cfed640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8868124040 con 0x7f88681156a0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f88677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 0x7f886811de30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f88677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 0x7f886811de30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40416/0 (socket says 10.20.193.28:40416) 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f88677fe640 1 -- 10.20.193.28:0/3023478564 learned_addr learned my addr 10.20.193.28:0/3023478564 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f8867fff640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88681156a0 0x7f88681236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f8866ffd640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f886810fea0 0x7f886811e370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f88677fe640 1 -- 10.20.193.28:0/3023478564 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88681156a0 msgr2=0x7f88681236f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f88677fe640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88681156a0 0x7f88681236f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f88677fe640 1 -- 10.20.193.28:0/3023478564 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f886810fea0 msgr2=0x7f886811e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f88677fe640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f886810fea0 0x7f886811e370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f88677fe640 1 -- 10.20.193.28:0/3023478564 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8854009570 con 0x7f886810f4b0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.960+0000 7f8867fff640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88681156a0 0x7f88681236f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.961+0000 7f88677fe640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 0x7f886811de30 secure :-1 s=READY pgs=867 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8854005b30 tx=0x7f8854004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.961+0000 7f8864ff9640 1 -- 10.20.193.28:0/3023478564 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f885403d070 con 0x7f886810f4b0 2026-02-20T13:24:02.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.961+0000 7f8864ff9640 1 -- 10.20.193.28:0/3023478564 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8854038920 con 0x7f886810f4b0 2026-02-20T13:24:02.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.961+0000 7f8864ff9640 1 -- 10.20.193.28:0/3023478564 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88540418a0 con 0x7f886810f4b0 2026-02-20T13:24:02.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.961+0000 7f886cfed640 1 -- 10.20.193.28:0/3023478564 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88681242c0 con 0x7f886810f4b0 2026-02-20T13:24:02.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.961+0000 7f886cfed640 1 -- 10.20.193.28:0/3023478564 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8868164a20 con 0x7f886810f4b0 2026-02-20T13:24:02.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.965+0000 7f8864ff9640 1 -- 10.20.193.28:0/3023478564 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8854048020 con 0x7f886810f4b0 2026-02-20T13:24:02.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.966+0000 7f8870270e00 1 Processor -- start 2026-02-20T13:24:02.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.966+0000 7f8864ff9640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f883c0b5760 0x7f883c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.966+0000 7f8870270e00 1 -- start start 2026-02-20T13:24:02.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8864ff9640 1 -- 10.20.193.28:0/3023478564 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f885410af30 con 0x7f886810f4b0 2026-02-20T13:24:02.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8870270e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3efec1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8870270e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff0e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8870270e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3eff17e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8870270e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560e3ef22c70 con 0x560e3efebdf0 2026-02-20T13:24:02.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8870270e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560e3ef1e9a0 con 0x560e3efec700 2026-02-20T13:24:02.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8870270e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560e3ef18b00 con 0x560e3eff1380 2026-02-20T13:24:02.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8867fff640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f883c0b5760 0x7f883c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3efec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3efec1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40428/0 (socket says 10.20.193.28:40428) 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 -- 10.20.193.28:0/2326338407 learned_addr learned my addr 10.20.193.28:0/2326338407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8867fff640 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3eff17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8866ffd640 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 -- 10.20.193.28:0/2326338407 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 msgr2=0x560e3eff17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3eff17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 -- 10.20.193.28:0/2326338407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 msgr2=0x560e3eff0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 -- 10.20.193.28:0/2326338407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3eec3f80 con 0x560e3efebdf0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8866ffd640 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff0e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f88677fe640 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3efec1c0 secure :-1 s=READY pgs=868 gs=1 cs=0 l=1 c_cookie=8691673260811751881 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8854032040 tx=0x7f885402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789f06c7be7211c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f8867fff640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f883c0b5760 0x7f883c0d5c10 secure :-1 s=READY pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885c00a2e0 tx=0x7f885c00a630 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.967+0000 7f882bfff640 1 -- 10.20.193.28:0/2326338407 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8854108ea0 con 0x560e3efebdf0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f882bfff640 1 -- 10.20.193.28:0/2326338407 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f88540d6fb0 con 0x560e3efebdf0 2026-02-20T13:24:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f882bfff640 1 -- 10.20.193.28:0/2326338407 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88540d21a0 con 0x560e3efebdf0 2026-02-20T13:24:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 -- 10.20.193.28:0/2326338407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 msgr2=0x560e3efec1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3efec1c0 secure :-1 s=READY pgs=868 gs=1 cs=0 l=1 c_cookie=8691673260811751881 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8854032040 tx=0x7f885402f190 comp rx=0 tx=0).stop 2026-02-20T13:24:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 -- 10.20.193.28:0/2326338407 shutdown_connections 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3eff17e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff0e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 --2- 10.20.193.28:0/2326338407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3efec1c0 unknown :-1 s=CLOSED pgs=868 gs=1 cs=0 l=1 c_cookie=8691673260811751881 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 -- 10.20.193.28:0/2326338407 >> 10.20.193.28:0/2326338407 conn(0x560e3ef2ba60 msgr2=0x560e3f014810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 -- 10.20.193.28:0/2326338407 shutdown_connections 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.968+0000 7f8870270e00 1 -- 10.20.193.28:0/2326338407 wait complete. 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.969+0000 7f8870270e00 1 -- start start 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.969+0000 7f8870270e00 1 Processor -- start 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8870270e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f036d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8870270e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3efec700 0x560e3f0372c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8870270e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3eff1380 0x560e3f03c2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8870270e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560e3f03c820 con 0x560e3eff1380 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8870270e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560e3f03c990 con 0x560e3efebdf0 2026-02-20T13:24:02.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8870270e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560e3f03cb50 con 0x560e3efec700 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3eff1380 0x560e3f03c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f88677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3eff1380 0x560e3f03c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40440/0 (socket says 10.20.193.28:40440) 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8867fff640 1 -- 10.20.193.28:0/682217064 learned_addr learned my addr 10.20.193.28:0/682217064 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8866ffd640 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3efec700 0x560e3f0372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f88677fe640 1 -- 10.20.193.28:0/682217064 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3efec700 msgr2=0x560e3f0372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f88677fe640 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3efec700 0x560e3f0372c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f88677fe640 1 -- 10.20.193.28:0/682217064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3eff1380 msgr2=0x560e3f03c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f88677fe640 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3eff1380 0x560e3f03c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f88677fe640 1 -- 10.20.193.28:0/682217064 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3ee9c710 con 0x560e3efebdf0 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.970+0000 7f8867fff640 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3eff1380 0x560e3f03c2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f88677fe640 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f036d80 secure :-1 s=READY pgs=322 gs=3 cs=0 l=1 c_cookie=12757864189332473707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8854004050 tx=0x7f8854002b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10d09e2d9d6c76b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:02.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f88297fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f88297fa640 1 -- 10.20.193.28:0/682217064 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8854108ea0 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8868164a20 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f88297fa640 1 -- 10.20.193.28:0/682217064 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f88540dc3d0 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f88297fa640 1 -- 10.20.193.28:0/682217064 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88540d2c80 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f88297fa640 1 -- 10.20.193.28:0/682217064 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f88540eb020 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f88297fa640 10 client.27833 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f8870270e00 10 client.27833 _ll_register_callbacks cb 0x560e3ee99d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.971+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560e3ebaeba0 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f88297fa640 1 -- 10.20.193.28:0/682217064 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88540d1060 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8870270e00 10 client.27833 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560e3eeae350 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f88297fa640 1 -- 10.20.193.28:0/682217064 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f88540d2de0 con 0x560e3efebdf0 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8870270e00 10 client.27833 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8870270e00 10 client.27833 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8870270e00 20 client.27833 populate_metadata read hostname 'trial028' 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8870270e00 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560e3f0a1180 0x560e3f0c1630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8870270e00 4 client.27833 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e3eeeb410 con 0x560e3f0a1180 2026-02-20T13:24:02.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.972+0000 7f8866ffd640 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560e3f0a1180 0x560e3f0c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8866ffd640 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560e3f0a1180 0x560e3f0c1630 crc :-1 s=READY pgs=210 gs=4 cs=0 l=0 c_cookie=11409746985574136589 s_cookie=8676655083615349514 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e57906e943afb0d server_cookie=7869abd3e17aeb0a in_seq=0 out_seq=0 2026-02-20T13:24:02.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f88297fa640 10 client.27833 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:02.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f88297fa640 1 -- 10.20.193.28:0/682217064 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560e3eeeb410 con 0x560e3f0a1180 2026-02-20T13:24:02.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f88297fa640 10 client.27833 handle_command_reply: tid=0 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 client.27833 shutdown 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 msgr2=0x560e3f036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f036d80 secure :-1 s=READY pgs=322 gs=3 cs=0 l=1 c_cookie=12757864189332473707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8854004050 tx=0x7f8854002b90 comp rx=0 tx=0).stop 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 shutdown_connections 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560e3f0a1180 0x560e3f0c1630 crc :-1 s=READY pgs=210 gs=4 cs=0 l=0 c_cookie=11409746985574136589 s_cookie=8676655083615349514 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3eff1380 0x560e3f03c2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3efec700 0x560e3f0372c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 --2- 10.20.193.28:0/682217064 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f036d80 unknown :-1 s=CLOSED pgs=322 gs=3 cs=0 l=1 c_cookie=12757864189332473707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 >> 10.20.193.28:0/682217064 conn(0x560e3ef2ba60 msgr2=0x560e3efed2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.973+0000 7f88297fa640 0 client.27833 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.974+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 shutdown_connections 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.974+0000 7f8870270e00 1 -- 10.20.193.28:0/682217064 wait complete. 2026-02-20T13:24:02.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.974+0000 7f8870270e00 20 client.27833 trim_cache size 0 max 16384 2026-02-20T13:24:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:02 trial127 ceph-mon[43817]: pgmap v382: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:24:02.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:02 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/155217690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:02.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.983+0000 7f8870270e00 1 Processor -- start 2026-02-20T13:24:02.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.983+0000 7f8870270e00 1 -- start start 2026-02-20T13:24:02.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.983+0000 7f8870270e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f03a6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.983+0000 7f8870270e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efec700 0x560e3f010b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.983+0000 7f8870270e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f0110b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.983+0000 7f8870270e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560e3ef16730 con 0x560e3efec700 2026-02-20T13:24:02.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.983+0000 7f8870270e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560e3ebd6960 con 0x560e3efebdf0 2026-02-20T13:24:02.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.983+0000 7f8870270e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560e3f02fde0 con 0x560e3eff1380 2026-02-20T13:24:02.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f88677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f03a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8866ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efec700 0x560e3f010b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8867fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f0110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8867fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f0110b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33392/0 (socket says 10.20.193.28:33392) 2026-02-20T13:24:02.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8867fff640 1 -- 10.20.193.28:0/3280178150 learned_addr learned my addr 10.20.193.28:0/3280178150 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8866ffd640 1 -- 10.20.193.28:0/3280178150 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 msgr2=0x560e3f0110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8866ffd640 1 --2- 10.20.193.28:0/3280178150 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f0110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8866ffd640 1 -- 10.20.193.28:0/3280178150 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 msgr2=0x560e3f03a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8866ffd640 1 --2- 10.20.193.28:0/3280178150 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f03a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8866ffd640 1 -- 10.20.193.28:0/3280178150 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3eea8dd0 con 0x560e3efec700 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8867fff640 1 --2- 10.20.193.28:0/3280178150 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f0110b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.984+0000 7f8866ffd640 1 --2- 10.20.193.28:0/3280178150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efec700 0x560e3f010b70 secure :-1 s=READY pgs=869 gs=3 cs=0 l=1 c_cookie=10431740573463202266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560e3f0c1eb0 tx=0x7f88580042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c4fcc8264dc9da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f882b7fe640 1 -- 10.20.193.28:0/3280178150 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8858018040 con 0x560e3efec700 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f882b7fe640 1 -- 10.20.193.28:0/3280178150 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8858013b70 con 0x560e3efec700 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f882b7fe640 1 -- 10.20.193.28:0/3280178150 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f885800e6c0 con 0x560e3efec700 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 -- 10.20.193.28:0/3280178150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efec700 msgr2=0x560e3f010b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 --2- 10.20.193.28:0/3280178150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efec700 0x560e3f010b70 secure :-1 s=READY pgs=869 gs=3 cs=0 l=1 c_cookie=10431740573463202266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560e3f0c1eb0 tx=0x7f88580042e0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 -- 10.20.193.28:0/3280178150 shutdown_connections 2026-02-20T13:24:02.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 --2- 10.20.193.28:0/3280178150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efec700 0x560e3f010b70 unknown :-1 s=CLOSED pgs=869 gs=3 cs=0 l=1 c_cookie=10431740573463202266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 --2- 10.20.193.28:0/3280178150 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f0110b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 --2- 10.20.193.28:0/3280178150 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efebdf0 0x560e3f03a6f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 -- 10.20.193.28:0/3280178150 >> 10.20.193.28:0/3280178150 conn(0x560e3ef2ba60 msgr2=0x560e3f039fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:02.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 -- 10.20.193.28:0/3280178150 shutdown_connections 2026-02-20T13:24:02.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.985+0000 7f8870270e00 1 -- 10.20.193.28:0/3280178150 wait complete. 2026-02-20T13:24:02.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.986+0000 7f8870270e00 1 -- start start 2026-02-20T13:24:02.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.986+0000 7f8870270e00 1 Processor -- start 2026-02-20T13:24:02.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.986+0000 7f8870270e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3eff32c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.986+0000 7f8870270e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff3800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.986+0000 7f8870270e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f07e2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.986+0000 7f8870270e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560e3ef7c340 con 0x560e3efebdf0 2026-02-20T13:24:02.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.986+0000 7f8870270e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560e3f07e890 con 0x560e3efec700 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.986+0000 7f8870270e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560e3f07ea50 con 0x560e3eff1380 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f88677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3eff32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff3800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff3800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34384/0 (socket says 10.20.193.28:34384) 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 -- 10.20.193.28:0/3861546851 learned_addr learned my addr 10.20.193.28:0/3861546851 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f88677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3eff32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40468/0 (socket says 10.20.193.28:40468) 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8867fff640 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f07e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 -- 10.20.193.28:0/3861546851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 msgr2=0x560e3f07e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f07e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 -- 10.20.193.28:0/3861546851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 msgr2=0x560e3eff32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3eff32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 -- 10.20.193.28:0/3861546851 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3ee9ca40 con 0x560e3efec700 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f88677fe640 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3eff32c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f8866ffd640 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff3800 secure :-1 s=READY pgs=323 gs=2 cs=0 l=1 c_cookie=7467709197952736202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8858004590 tx=0x7f88580045c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a2a1f32de3dbca server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.987+0000 7f88297fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f88297fa640 1 -- 10.20.193.28:0/3861546851 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f885800e660 con 0x560e3efec700 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f88297fa640 1 -- 10.20.193.28:0/3861546851 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f885800ed30 con 0x560e3efec700 2026-02-20T13:24:02.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f88297fa640 1 -- 10.20.193.28:0/3861546851 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f885802e6f0 con 0x560e3efec700 2026-02-20T13:24:02.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c0106d0 con 0x560e3efec700 2026-02-20T13:24:02.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:02 trial034 ceph-mon[43332]: pgmap v382: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2026-02-20T13:24:02.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:02 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/155217690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f8870270e00 10 client.27839 _ll_register_callbacks cb 0x560e3ee99d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88540d6fb0 con 0x560e3efec700 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f88297fa640 1 -- 10.20.193.28:0/3861546851 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f885800e850 con 0x560e3efec700 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f88297fa640 1 -- 10.20.193.28:0/3861546851 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f885801c810 con 0x560e3efec700 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f8870270e00 10 client.27839 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.988+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560e3eeae5b0 con 0x560e3efec700 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.989+0000 7f88297fa640 1 -- 10.20.193.28:0/3861546851 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f885801b070 con 0x560e3efec700 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.989+0000 7f8870270e00 10 client.27839 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.989+0000 7f8870270e00 10 client.27839 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.989+0000 7f8870270e00 20 client.27839 populate_metadata read hostname 'trial028' 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.989+0000 7f8870270e00 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560e3f080690 0x560e3f080b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:02.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.989+0000 7f8870270e00 4 client.27839 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6754165a", "release": true, "await": true}] 2026-02-20T13:24:02.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.989+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6754165a", "release": true, "await": true}) -- 0x560e3ebac3f0 con 0x560e3f080690 2026-02-20T13:24:02.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.989+0000 7f88677fe640 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560e3f080690 0x560e3f080b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:02.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.990+0000 7f88677fe640 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560e3f080690 0x560e3f080b30 crc :-1 s=READY pgs=211 gs=4 cs=0 l=0 c_cookie=8342112616118000579 s_cookie=17462797003177893474 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73c52339d8049bc3 server_cookie=f258515a3f2c9e62 in_seq=0 out_seq=0 2026-02-20T13:24:02.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.990+0000 7f88297fa640 10 client.27839 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.991+0000 7f88297fa640 1 -- 10.20.193.28:0/3861546851 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560e3ebac3f0 con 0x560e3f080690 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.991+0000 7f88297fa640 10 client.27839 handle_command_reply: tid=0 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.991+0000 7f8870270e00 1 client.27839 shutdown 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.991+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 msgr2=0x560e3eff3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.991+0000 7f8870270e00 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff3800 secure :-1 s=READY pgs=323 gs=2 cs=0 l=1 c_cookie=7467709197952736202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8858004590 tx=0x7f88580045c0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 shutdown_connections 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560e3f080690 0x560e3f080b30 crc :-1 s=READY pgs=211 gs=4 cs=0 l=0 c_cookie=8342112616118000579 s_cookie=17462797003177893474 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560e3eff1380 0x560e3f07e2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560e3efec700 0x560e3eff3800 unknown :-1 s=CLOSED pgs=323 gs=2 cs=0 l=1 c_cookie=7467709197952736202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 1 --2- 10.20.193.28:0/3861546851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560e3efebdf0 0x560e3eff32c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 >> 10.20.193.28:0/3861546851 conn(0x560e3ef2ba60 msgr2=0x560e3f03a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f88297fa640 0 client.27839 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 shutdown_connections 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 1 -- 10.20.193.28:0/3861546851 wait complete. 2026-02-20T13:24:02.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f8870270e00 20 client.27839 trim_cache size 0 max 16384 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 24, 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "6754165a": { 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "version": 24, 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 143.2, 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:24:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 -- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f883c0b5760 msgr2=0x7f883c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f883c0b5760 0x7f883c0d5c10 secure :-1 s=READY pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885c00a2e0 tx=0x7f885c00a630 comp rx=0 tx=0).stop 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 -- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 msgr2=0x7f886811de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 0x7f886811de30 secure :-1 s=READY pgs=867 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8854005b30 tx=0x7f8854004340 comp rx=0 tx=0).stop 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 -- 10.20.193.28:0/3023478564 shutdown_connections 2026-02-20T13:24:02.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f883c0b5760 0x7f883c0d5c10 unknown :-1 s=CLOSED pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88681156a0 0x7f88681236f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f886810fea0 0x7f886811e370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 --2- 10.20.193.28:0/3023478564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f886810f4b0 0x7f886811de30 unknown :-1 s=CLOSED pgs=867 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:02.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 -- 10.20.193.28:0/3023478564 >> 10.20.193.28:0/3023478564 conn(0x7f88680ecda0 msgr2=0x7f886810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:02.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.992+0000 7f886cfed640 1 -- 10.20.193.28:0/3023478564 shutdown_connections 2026-02-20T13:24:02.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:02.993+0000 7f886cfed640 1 -- 10.20.193.28:0/3023478564 wait complete. 2026-02-20T13:24:03.093 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6754165a', total seconds elapsed: 24.3 2026-02-20T13:24:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:04 trial028 ceph-mon[37442]: pgmap v383: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-20T13:24:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:04 trial127 ceph-mon[43817]: pgmap v383: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-20T13:24:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:04 trial034 ceph-mon[43332]: pgmap v383: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-20T13:24:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:06 trial028 ceph-mon[37442]: pgmap v384: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-20T13:24:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:06 trial127 ceph-mon[43817]: pgmap v384: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-20T13:24:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:06 trial034 ceph-mon[43332]: pgmap v384: 97 pgs: 97 active+clean; 3.6 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-20T13:24:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:08 trial028 ceph-mon[37442]: pgmap v385: 97 pgs: 97 active+clean; 3.6 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:24:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:24:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:24:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:08 trial127 ceph-mon[43817]: pgmap v385: 97 pgs: 97 active+clean; 3.6 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:24:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:24:08.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:24:08.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:08 trial034 ceph-mon[43332]: pgmap v385: 97 pgs: 97 active+clean; 3.6 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:24:08.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:24:08.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:24:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:10 trial028 ceph-mon[37442]: pgmap v386: 97 pgs: 97 active+clean; 3.6 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2026-02-20T13:24:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:10 trial127 ceph-mon[43817]: pgmap v386: 97 pgs: 97 active+clean; 3.6 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2026-02-20T13:24:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:10 trial034 ceph-mon[43332]: pgmap v386: 97 pgs: 97 active+clean; 3.6 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2026-02-20T13:24:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:12 trial028 ceph-mon[37442]: pgmap v387: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 15 op/s 2026-02-20T13:24:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:12 trial127 ceph-mon[43817]: pgmap v387: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 15 op/s 2026-02-20T13:24:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:12 trial034 ceph-mon[43332]: pgmap v387: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 15 op/s 2026-02-20T13:24:14.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.646+0000 7fe400904640 1 -- 10.20.193.28:0/1716422818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10d4b0 msgr2=0x7fe3fc16f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.646+0000 7fe400904640 1 --2- 10.20.193.28:0/1716422818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10d4b0 0x7fe3fc16f240 secure :-1 s=READY pgs=870 gs=2 cs=0 l=1 c_cookie=6292062052733806511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3f000a9a0 tx=0x7fe3f00301b0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.647+0000 7fe400904640 1 -- 10.20.193.28:0/1716422818 shutdown_connections 2026-02-20T13:24:14.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.647+0000 7fe400904640 1 --2- 10.20.193.28:0/1716422818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10d4b0 0x7fe3fc16f240 unknown :-1 s=CLOSED pgs=870 gs=2 cs=0 l=1 c_cookie=6292062052733806511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.647+0000 7fe400904640 1 --2- 10.20.193.28:0/1716422818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3fc10cb00 0x7fe3fc10cf70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.647+0000 7fe400904640 1 --2- 10.20.193.28:0/1716422818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3fc10e270 0x7fe3fc10e660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.647+0000 7fe400904640 1 -- 10.20.193.28:0/1716422818 >> 10.20.193.28:0/1716422818 conn(0x7fe3fc0ea4c0 msgr2=0x7fe3fc10a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:14.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.647+0000 7fe400904640 1 -- 10.20.193.28:0/1716422818 shutdown_connections 2026-02-20T13:24:14.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.647+0000 7fe400904640 1 -- 10.20.193.28:0/1716422818 wait complete. 2026-02-20T13:24:14.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.647+0000 7fe400904640 1 Processor -- start 2026-02-20T13:24:14.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe400904640 1 -- start start 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe400904640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10cb00 0x7fe3fc0f9140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe400904640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3fc10d4b0 0x7fe3fc16f240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe400904640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3fc10e270 0x7fe3fc0f99a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe400904640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc0fa590 con 0x7fe3fc10cb00 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe400904640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc0fa700 con 0x7fe3fc10d4b0 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe400904640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc0fa8c0 con 0x7fe3fc10e270 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10cb00 0x7fe3fc0f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3fc10e270 0x7fe3fc0f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10cb00 0x7fe3fc0f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37122/0 (socket says 10.20.193.28:37122) 2026-02-20T13:24:14.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/4094362761 learned_addr learned my addr 10.20.193.28:0/4094362761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3faffd640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3fc10d4b0 0x7fe3fc16f240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/4094362761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3fc10e270 msgr2=0x7fe3fc0f99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3fc10e270 0x7fe3fc0f99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/4094362761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3fc10d4b0 msgr2=0x7fe3fc16f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3fc10d4b0 0x7fe3fc16f240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/4094362761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f000a590 con 0x7fe3fc10cb00 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.648+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10cb00 0x7fe3fc0f9140 secure :-1 s=READY pgs=871 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e8009480 tx=0x7fe3e800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.649+0000 7fe3f8ff9640 1 -- 10.20.193.28:0/4094362761 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e800ccc0 con 0x7fe3fc10cb00 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.649+0000 7fe400904640 1 -- 10.20.193.28:0/4094362761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc0faba0 con 0x7fe3fc10cb00 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.649+0000 7fe400904640 1 -- 10.20.193.28:0/4094362761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc0fb0c0 con 0x7fe3fc10cb00 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.649+0000 7fe3f8ff9640 1 -- 10.20.193.28:0/4094362761 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e800ce20 con 0x7fe3fc10cb00 2026-02-20T13:24:14.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.649+0000 7fe3f8ff9640 1 -- 10.20.193.28:0/4094362761 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80106b0 con 0x7fe3fc10cb00 2026-02-20T13:24:14.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.651+0000 7fe3f8ff9640 1 -- 10.20.193.28:0/4094362761 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe3e801f060 con 0x7fe3fc10cb00 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.653+0000 7fe3f8ff9640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3d00b5760 0x7fe3d00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.653+0000 7fe3f8ff9640 1 -- 10.20.193.28:0/4094362761 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe3e8014070 con 0x7fe3fc10cb00 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.653+0000 7fe3faffd640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3d00b5760 0x7fe3d00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe40424ee00 1 Processor -- start 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe40424ee00 1 -- start start 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3faffd640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3d00b5760 0x7fe3d00d5c10 secure :-1 s=READY pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3ec004740 tx=0x7fe3ec009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b05a8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b07b1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b09bae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe40424ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55631af4ffd0 con 0x55631b03a4c0 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe40424ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55631af4bd00 con 0x55631b05ade0 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe40424ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55631af45ca0 con 0x55631b07b700 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3faffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b07b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3faffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b07b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52234/0 (socket says 10.20.193.28:52234) 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3faffd640 1 -- 10.20.193.28:0/681318324 learned_addr learned my addr 10.20.193.28:0/681318324 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b05a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3fbfff640 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b09bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/681318324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 msgr2=0x55631b09bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b09bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/681318324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 msgr2=0x55631b07b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:14.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b07b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/681318324 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55631aee88b0 con 0x55631b03a4c0 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.654+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b05a8a0 secure :-1 s=READY pgs=872 gs=2 cs=0 l=1 c_cookie=12286171929668445175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80a9550 tx=0x7fe3e80a8e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8140466d4363f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe3c77fe640 1 -- 10.20.193.28:0/681318324 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80ac780 con 0x55631b03a4c0 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe3c77fe640 1 -- 10.20.193.28:0/681318324 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e80ad980 con 0x55631b03a4c0 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe3c77fe640 1 -- 10.20.193.28:0/681318324 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80adc10 con 0x55631b03a4c0 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 -- 10.20.193.28:0/681318324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 msgr2=0x55631b05a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b05a8a0 secure :-1 s=READY pgs=872 gs=2 cs=0 l=1 c_cookie=12286171929668445175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80a9550 tx=0x7fe3e80a8e20 comp rx=0 tx=0).stop 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 -- 10.20.193.28:0/681318324 shutdown_connections 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b09bae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b07b1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 --2- 10.20.193.28:0/681318324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b05a8a0 unknown :-1 s=CLOSED pgs=872 gs=2 cs=0 l=1 c_cookie=12286171929668445175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 -- 10.20.193.28:0/681318324 >> 10.20.193.28:0/681318324 conn(0x55631af591c0 msgr2=0x55631b038da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:14.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 -- 10.20.193.28:0/681318324 shutdown_connections 2026-02-20T13:24:14.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.655+0000 7fe40424ee00 1 -- 10.20.193.28:0/681318324 wait complete. 2026-02-20T13:24:14.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.656+0000 7fe40424ee00 1 -- start start 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.656+0000 7fe40424ee00 1 Processor -- start 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b053b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0541b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b054c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe40424ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55631b055270 con 0x55631b03a4c0 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe40424ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55631b0553e0 con 0x55631b05ade0 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe40424ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55631b0555a0 con 0x55631b07b700 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3faffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3faffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52250/0 (socket says 10.20.193.28:52250) 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3faffd640 1 -- 10.20.193.28:0/2603156910 learned_addr learned my addr 10.20.193.28:0/2603156910 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:14.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3fb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b053b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3fbfff640 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b054c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/2603156910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 msgr2=0x55631b054c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b054c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/2603156910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 msgr2=0x55631b0541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/2603156910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55631aef1400 con 0x55631b03a4c0 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.657+0000 7fe3faffd640 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0541b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b053b60 secure :-1 s=READY pgs=873 gs=2 cs=0 l=1 c_cookie=15190099189199193452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80ad1f0 tx=0x7fe3e80a8780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ce12bb632ac56c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe3c4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/2603156910 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80b80c0 con 0x55631b03a4c0 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/2603156910 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e80ad980 con 0x55631b03a4c0 2026-02-20T13:24:14.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/2603156910 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e8072390 con 0x55631b03a4c0 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc0fb0c0 con 0x55631b03a4c0 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe40424ee00 10 client.17895 _ll_register_callbacks cb 0x55631aed0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55631abe5520 con 0x55631b03a4c0 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/2603156910 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe3e80b5280 con 0x55631b03a4c0 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/2603156910 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3e80b7eb0 con 0x55631b03a4c0 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe40424ee00 10 client.17895 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.658+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55631aec9da0 con 0x55631b03a4c0 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/2603156910 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe3e80aaf60 con 0x55631b03a4c0 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe40424ee00 10 client.17895 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe40424ee00 10 client.17895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe40424ee00 20 client.17895 populate_metadata read hostname 'trial028' 2026-02-20T13:24:14.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe40424ee00 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55631b057f80 0x55631b058420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe40424ee00 4 client.17895 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55631af77630 con 0x55631b057f80 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe3faffd640 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55631b057f80 0x55631b058420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe3faffd640 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55631b057f80 0x55631b058420 crc :-1 s=READY pgs=212 gs=4 cs=0 l=0 c_cookie=5195365446668756808 s_cookie=7369992270819060064 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4819a558f707a748 server_cookie=664778ec238b6960 in_seq=0 out_seq=0 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.659+0000 7fe3c4ff9640 10 client.17895 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/2603156910 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55631af77630 con 0x55631b057f80 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe3c4ff9640 10 client.17895 handle_command_reply: tid=0 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 client.17895 shutdown 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 msgr2=0x55631b053b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b053b60 secure :-1 s=READY pgs=873 gs=2 cs=0 l=1 c_cookie=15190099189199193452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80ad1f0 tx=0x7fe3e80a8780 comp rx=0 tx=0).stop 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 shutdown_connections 2026-02-20T13:24:14.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55631b057f80 0x55631b058420 crc :-1 s=READY pgs=212 gs=4 cs=0 l=0 c_cookie=5195365446668756808 s_cookie=7369992270819060064 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b054c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0541b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 --2- 10.20.193.28:0/2603156910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b053b60 unknown :-1 s=CLOSED pgs=873 gs=2 cs=0 l=1 c_cookie=15190099189199193452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe3c4ff9640 0 client.17895 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:14.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 >> 10.20.193.28:0/2603156910 conn(0x55631af591c0 msgr2=0x55631b03b790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:14.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 shutdown_connections 2026-02-20T13:24:14.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 1 -- 10.20.193.28:0/2603156910 wait complete. 2026-02-20T13:24:14.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.660+0000 7fe40424ee00 20 client.17895 trim_cache size 0 max 16384 2026-02-20T13:24:14.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.668+0000 7fe40424ee00 1 Processor -- start 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.668+0000 7fe40424ee00 1 -- start start 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.668+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b0539d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.668+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0795c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.668+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b079b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.668+0000 7fe40424ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55631af438d0 con 0x55631b03a4c0 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.668+0000 7fe40424ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55631ac84f10 con 0x55631b05ade0 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.668+0000 7fe40424ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55631b0399f0 con 0x55631b07b700 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0795c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0795c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52264/0 (socket says 10.20.193.28:52264) 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 -- 10.20.193.28:0/3039848698 learned_addr learned my addr 10.20.193.28:0/3039848698 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:14.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3fbfff640 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b079b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b0539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 -- 10.20.193.28:0/3039848698 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 msgr2=0x55631b079b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b079b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 -- 10.20.193.28:0/3039848698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 msgr2=0x55631b0539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b0539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 -- 10.20.193.28:0/3039848698 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55631aedb670 con 0x55631b05ade0 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3faffd640 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0795c0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=14899074894959350075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3ec009960 tx=0x7fe3ec013070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec425ada3fe113b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3c6ffd640 1 -- 10.20.193.28:0/3039848698 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3ec022030 con 0x55631b05ade0 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3c6ffd640 1 -- 10.20.193.28:0/3039848698 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3ec023040 con 0x55631b05ade0 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.669+0000 7fe3c6ffd640 1 -- 10.20.193.28:0/3039848698 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3ec011850 con 0x55631b05ade0 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- 10.20.193.28:0/3039848698 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 msgr2=0x55631b0795c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0795c0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=14899074894959350075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3ec009960 tx=0x7fe3ec013070 comp rx=0 tx=0).stop 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- 10.20.193.28:0/3039848698 shutdown_connections 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b079b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b05ade0 0x55631b0795c0 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=14899074894959350075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 --2- 10.20.193.28:0/3039848698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b03a4c0 0x55631b0539d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- 10.20.193.28:0/3039848698 >> 10.20.193.28:0/3039848698 conn(0x55631af591c0 msgr2=0x55631b04fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- 10.20.193.28:0/3039848698 shutdown_connections 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- 10.20.193.28:0/3039848698 wait complete. 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- start start 2026-02-20T13:24:14.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 Processor -- start 2026-02-20T13:24:14.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b03a4c0 0x55631b060820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b05ade0 0x55631b060d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b05f580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55631b015810 con 0x55631b05ade0 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55631b05fb70 con 0x55631b03a4c0 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.670+0000 7fe40424ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55631b05fd30 con 0x55631b07b700 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b03a4c0 0x55631b060820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b03a4c0 0x55631b060820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52272/0 (socket says 10.20.193.28:52272) 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/4120817166 learned_addr learned my addr 10.20.193.28:0/4120817166 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3faffd640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b05ade0 0x55631b060d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fbfff640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b05f580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/4120817166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 msgr2=0x55631b05f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b05f580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/4120817166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b05ade0 msgr2=0x55631b060d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b05ade0 0x55631b060d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 -- 10.20.193.28:0/4120817166 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55631aed60f0 con 0x55631b03a4c0 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3faffd640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b05ade0 0x55631b060d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fbfff640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b05f580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3fb7fe640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b03a4c0 0x55631b060820 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=18022906583145840591 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80aa1f0 tx=0x7fe3e80e3000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa1e3a0c4474ffcf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3c4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/4120817166 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80ad720 con 0x55631b03a4c0 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/4120817166 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55631abe5520 con 0x55631b03a4c0 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/4120817166 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80e4170 con 0x55631b03a4c0 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.671+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ec009b80 con 0x55631b03a4c0 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/4120817166 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe3e80ae680 con 0x55631b03a4c0 2026-02-20T13:24:14.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe3c4ff9640 10 client.27857 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 10 client.27857 _ll_register_callbacks cb 0x55631aed0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55631aff5ca0 con 0x55631b03a4c0 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/4120817166 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3e80b80c0 con 0x55631b03a4c0 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 10 client.27857 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55631aeca0d0 con 0x55631b03a4c0 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/4120817166 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe3e80adc90 con 0x55631b03a4c0 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 10 client.27857 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 10 client.27857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 20 client.27857 populate_metadata read hostname 'trial028' 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55631b128180 0x55631b148560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 4 client.27857 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55631ac29640 con 0x55631b128180 2026-02-20T13:24:14.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.672+0000 7fe3faffd640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55631b128180 0x55631b148560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:14.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.673+0000 7fe3c4ff9640 10 client.27857 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:14.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.673+0000 7fe3faffd640 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55631b128180 0x55631b148560 crc :-1 s=READY pgs=213 gs=4 cs=0 l=0 c_cookie=2795731846603554394 s_cookie=2854049787671390407 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26cc6f4d540d3e5a server_cookie=279b9f29156ea8c7 in_seq=0 out_seq=0 2026-02-20T13:24:14.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe3c4ff9640 1 -- 10.20.193.28:0/4120817166 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55631ac29640 con 0x55631b128180 2026-02-20T13:24:14.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe3c4ff9640 10 client.27857 handle_command_reply: tid=0 2026-02-20T13:24:14.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 client.27857 shutdown 2026-02-20T13:24:14.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b03a4c0 msgr2=0x55631b060820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b03a4c0 0x55631b060820 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=18022906583145840591 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80aa1f0 tx=0x7fe3e80e3000 comp rx=0 tx=0).stop 2026-02-20T13:24:14.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 shutdown_connections 2026-02-20T13:24:14.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55631b128180 0x55631b148560 crc :-1 s=READY pgs=213 gs=4 cs=0 l=0 c_cookie=2795731846603554394 s_cookie=2854049787671390407 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55631b05ade0 0x55631b060d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55631b07b700 0x55631b05f580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe3c4ff9640 0 client.27857 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:14.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 --2- 10.20.193.28:0/4120817166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55631b03a4c0 0x55631b060820 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=18022906583145840591 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 >> 10.20.193.28:0/4120817166 conn(0x55631af591c0 msgr2=0x55631b04fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:14.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 shutdown_connections 2026-02-20T13:24:14.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 1 -- 10.20.193.28:0/4120817166 wait complete. 2026-02-20T13:24:14.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.677+0000 7fe40424ee00 20 client.27857 trim_cache size 0 max 16384 2026-02-20T13:24:14.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:24:14.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:24:14.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:24:14.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:24:14.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 -- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3d00b5760 msgr2=0x7fe3d00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3d00b5760 0x7fe3d00d5c10 secure :-1 s=READY pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3ec004740 tx=0x7fe3ec009310 comp rx=0 tx=0).stop 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 -- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10cb00 msgr2=0x7fe3fc0f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10cb00 0x7fe3fc0f9140 secure :-1 s=READY pgs=871 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e8009480 tx=0x7fe3e800ee60 comp rx=0 tx=0).stop 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 -- 10.20.193.28:0/4094362761 shutdown_connections 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3d00b5760 0x7fe3d00d5c10 unknown :-1 s=CLOSED pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3fc10e270 0x7fe3fc0f99a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3fc10d4b0 0x7fe3fc16f240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 --2- 10.20.193.28:0/4094362761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3fc10cb00 0x7fe3fc0f9140 unknown :-1 s=CLOSED pgs=871 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 -- 10.20.193.28:0/4094362761 >> 10.20.193.28:0/4094362761 conn(0x7fe3fc0ea4c0 msgr2=0x7fe3fc060e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 -- 10.20.193.28:0/4094362761 shutdown_connections 2026-02-20T13:24:14.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:14.678+0000 7fe400904640 1 -- 10.20.193.28:0/4094362761 wait complete. 2026-02-20T13:24:14.792 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:14 trial034 ceph-mon[43332]: pgmap v388: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 13 op/s 2026-02-20T13:24:14.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:14 trial028 ceph-mon[37442]: pgmap v388: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 13 op/s 2026-02-20T13:24:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:14 trial127 ceph-mon[43817]: pgmap v388: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 13 op/s 2026-02-20T13:24:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:16 trial028 ceph-mon[37442]: pgmap v389: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 15 op/s 2026-02-20T13:24:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:16 trial127 ceph-mon[43817]: pgmap v389: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 15 op/s 2026-02-20T13:24:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:16 trial034 ceph-mon[43332]: pgmap v389: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 15 op/s 2026-02-20T13:24:18.524 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:24:18.710 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:18.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:18 trial028 ceph-mon[37442]: pgmap v390: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:24:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 -- 10.20.193.28:0/1978434840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f81156a0 msgr2=0x7fa7f8176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/1978434840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f81156a0 0x7fa7f8176070 secure :-1 s=READY pgs=874 gs=3 cs=0 l=1 c_cookie=8421488794156699685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7ec00a970 tx=0x7fa7ec0301b0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 -- 10.20.193.28:0/1978434840 shutdown_connections 2026-02-20T13:24:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/1978434840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f81156a0 0x7fa7f8176070 unknown :-1 s=CLOSED pgs=874 gs=3 cs=0 l=1 c_cookie=8421488794156699685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/1978434840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa7f810fea0 0x7fa7f8114ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/1978434840 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7f810f4b0 0x7fa7f810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 -- 10.20.193.28:0/1978434840 >> 10.20.193.28:0/1978434840 conn(0x7fa7f80ecda0 msgr2=0x7fa7f810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 -- 10.20.193.28:0/1978434840 shutdown_connections 2026-02-20T13:24:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.890+0000 7fa7fd56a640 1 -- 10.20.193.28:0/1978434840 wait complete. 2026-02-20T13:24:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fd56a640 1 Processor -- start 2026-02-20T13:24:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fd56a640 1 -- start start 2026-02-20T13:24:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fd56a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f810f4b0 0x7fa7f811de60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fd56a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7f810fea0 0x7fa7f811e3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fd56a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa7f81156a0 0x7fa7f8123770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fd56a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8123d90 con 0x7fa7f810f4b0 2026-02-20T13:24:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fd56a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8123f00 con 0x7fa7f81156a0 2026-02-20T13:24:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fd56a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f81240c0 con 0x7fa7f810fea0 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7f7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f810f4b0 0x7fa7f811de60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7f77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7f810fea0 0x7fa7f811e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7fcd69640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa7f81156a0 0x7fa7f8123770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7f77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7f810fea0 0x7fa7f811e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48242/0 (socket says 10.20.193.28:48242) 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7f7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f810f4b0 0x7fa7f811de60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37164/0 (socket says 10.20.193.28:37164) 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.891+0000 7fa7f77fe640 1 -- 10.20.193.28:0/448541408 learned_addr learned my addr 10.20.193.28:0/448541408 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f7fff640 1 -- 10.20.193.28:0/448541408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7f810fea0 msgr2=0x7fa7f811e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7f810fea0 0x7fa7f811e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f7fff640 1 -- 10.20.193.28:0/448541408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa7f81156a0 msgr2=0x7fa7f8123770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa7f81156a0 0x7fa7f8123770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f7fff640 1 -- 10.20.193.28:0/448541408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ec00a590 con 0x7fa7f810f4b0 2026-02-20T13:24:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa7f81156a0 0x7fa7f8123770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f810f4b0 0x7fa7f811de60 secure :-1 s=READY pgs=875 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7e400e9c0 tx=0x7fa7e400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f57fa640 1 -- 10.20.193.28:0/448541408 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7e400ccb0 con 0x7fa7f810f4b0 2026-02-20T13:24:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f57fa640 1 -- 10.20.193.28:0/448541408 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa7e400ce10 con 0x7fa7f810f4b0 2026-02-20T13:24:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7f57fa640 1 -- 10.20.193.28:0/448541408 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7e4010430 con 0x7fa7f810f4b0 2026-02-20T13:24:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7fd56a640 1 -- 10.20.193.28:0/448541408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f81243a0 con 0x7fa7f810f4b0 2026-02-20T13:24:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.892+0000 7fa7fd56a640 1 -- 10.20.193.28:0/448541408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f8164aa0 con 0x7fa7f810f4b0 2026-02-20T13:24:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.895+0000 7fa7f57fa640 1 -- 10.20.193.28:0/448541408 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa7e401f060 con 0x7fa7f810f4b0 2026-02-20T13:24:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.896+0000 7fa7f57fa640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7cc0b5760 0x7fa7cc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.896+0000 7fa7f57fa640 1 -- 10.20.193.28:0/448541408 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa7e4014070 con 0x7fa7f810f4b0 2026-02-20T13:24:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.896+0000 7fa7f77fe640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7cc0b5760 0x7fa7cc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.897+0000 7fa7f77fe640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7cc0b5760 0x7fa7cc0d5c10 secure :-1 s=READY pgs=418 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7f8124800 tx=0x7fa7e8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa8007ede00 1 Processor -- start 2026-02-20T13:24:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa8007ede00 1 -- start start 2026-02-20T13:24:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f2c550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 0x5646a2f71400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f91d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa8007ede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646a2e427d0 con 0x5646a2f71940 2026-02-20T13:24:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa8007ede00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646a2e3e500 con 0x5646a2f2ca90 2026-02-20T13:24:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa8007ede00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646a2e384a0 con 0x5646a2f2c180 2026-02-20T13:24:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7fcd69640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f91d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7f7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f2c550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7f7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f2c550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48258/0 (socket says 10.20.193.28:48258) 2026-02-20T13:24:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7fcd69640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f91d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37166/0 (socket says 10.20.193.28:37166) 2026-02-20T13:24:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7f7fff640 1 -- 10.20.193.28:0/16152142 learned_addr learned my addr 10.20.193.28:0/16152142 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7f77fe640 1 --2- 10.20.193.28:0/16152142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 0x5646a2f71400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7fcd69640 1 -- 10.20.193.28:0/16152142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 msgr2=0x5646a2f2c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/16152142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f2c550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7fcd69640 1 -- 10.20.193.28:0/16152142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 msgr2=0x5646a2f71400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/16152142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 0x5646a2f71400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.898+0000 7fa7fcd69640 1 -- 10.20.193.28:0/16152142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a2de3d80 con 0x5646a2f71940 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/16152142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f91d20 secure :-1 s=READY pgs=876 gs=3 cs=0 l=1 c_cookie=18044302233240412203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7ec00a970 tx=0x7fa7ec006e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6a3d474015202b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa7c8ce3640 1 -- 10.20.193.28:0/16152142 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7ec03e070 con 0x5646a2f71940 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa7c8ce3640 1 -- 10.20.193.28:0/16152142 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa7ec03f040 con 0x5646a2f71940 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa7c8ce3640 1 -- 10.20.193.28:0/16152142 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7ec0052b0 con 0x5646a2f71940 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 -- 10.20.193.28:0/16152142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 msgr2=0x5646a2f91d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 --2- 10.20.193.28:0/16152142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f91d20 secure :-1 s=READY pgs=876 gs=3 cs=0 l=1 c_cookie=18044302233240412203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7ec00a970 tx=0x7fa7ec006e60 comp rx=0 tx=0).stop 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 -- 10.20.193.28:0/16152142 shutdown_connections 2026-02-20T13:24:18.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 --2- 10.20.193.28:0/16152142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f91d20 unknown :-1 s=CLOSED pgs=876 gs=3 cs=0 l=1 c_cookie=18044302233240412203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 --2- 10.20.193.28:0/16152142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 0x5646a2f71400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 --2- 10.20.193.28:0/16152142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f2c550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 -- 10.20.193.28:0/16152142 >> 10.20.193.28:0/16152142 conn(0x5646a2f0a680 msgr2=0x5646a2f2aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 -- 10.20.193.28:0/16152142 shutdown_connections 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.899+0000 7fa8007ede00 1 -- 10.20.193.28:0/16152142 wait complete. 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.900+0000 7fa8007ede00 1 -- start start 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa8007ede00 1 Processor -- start 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f89120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 0x5646a2f89660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f8e650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa8007ede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646a2f8eb90 con 0x5646a2f71940 2026-02-20T13:24:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa8007ede00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646a2f8ed00 con 0x5646a2f2ca90 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa8007ede00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646a2f8eec0 con 0x5646a2f2c180 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7f7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f89120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7fcd69640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f8e650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7f7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f89120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48264/0 (socket says 10.20.193.28:48264) 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7f7fff640 1 -- 10.20.193.28:0/4136951157 learned_addr learned my addr 10.20.193.28:0/4136951157 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7f77fe640 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 0x5646a2f89660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7fcd69640 1 -- 10.20.193.28:0/4136951157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 msgr2=0x5646a2f89120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f89120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7fcd69640 1 -- 10.20.193.28:0/4136951157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 msgr2=0x5646a2f89660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 0x5646a2f89660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.901+0000 7fa7fcd69640 1 -- 10.20.193.28:0/4136951157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a2dbc350 con 0x5646a2f71940 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f8e650 secure :-1 s=READY pgs=877 gs=2 cs=0 l=1 c_cookie=1112668608472721963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7ec00a8c0 tx=0x7fa7ec006a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70fe3448beaa2b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa7b9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/4136951157 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7ec03e030 con 0x5646a2f71940 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/4136951157 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa7ec039ab0 con 0x5646a2f71940 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/4136951157 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7ec04de80 con 0x5646a2f71940 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f81768e0 con 0x5646a2f71940 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa8007ede00 10 client.17913 _ll_register_callbacks cb 0x5646a2db99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5646a2ace6f0 con 0x5646a2f71940 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/4136951157 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa7ec044460 con 0x5646a2f71940 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/4136951157 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa7ec003780 con 0x5646a2f71940 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa8007ede00 10 client.17913 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:18.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.902+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5646a2dce150 con 0x5646a2f71940 2026-02-20T13:24:18.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/4136951157 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa7ec04d890 con 0x5646a2f71940 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa8007ede00 10 client.17913 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa8007ede00 10 client.17913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa8007ede00 20 client.17913 populate_metadata read hostname 'trial028' 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa8007ede00 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646a2f6e860 0x5646a2f6ed00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa8007ede00 4 client.17913 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646a2e45d60 con 0x5646a2f6e860 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646a2f6e860 0x5646a2f6ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646a2f6e860 0x5646a2f6ed00 crc :-1 s=READY pgs=214 gs=4 cs=0 l=0 c_cookie=10590843558382096759 s_cookie=14984012759866600533 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92fa3c1a89195177 server_cookie=cff1e83765c4ec55 in_seq=0 out_seq=0 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.903+0000 7fa7b9ffb640 10 client.17913 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/4136951157 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5646a2e45d60 con 0x5646a2f6e860 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa7b9ffb640 10 client.17913 handle_command_reply: tid=0 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 client.17913 shutdown 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 msgr2=0x5646a2f8e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f8e650 secure :-1 s=READY pgs=877 gs=2 cs=0 l=1 c_cookie=1112668608472721963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7ec00a8c0 tx=0x7fa7ec006a40 comp rx=0 tx=0).stop 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 shutdown_connections 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646a2f6e860 0x5646a2f6ed00 crc :-1 s=READY pgs=214 gs=4 cs=0 l=0 c_cookie=10590843558382096759 s_cookie=14984012759866600533 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f8e650 unknown :-1 s=CLOSED pgs=877 gs=2 cs=0 l=1 c_cookie=1112668608472721963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2ca90 0x5646a2f89660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 --2- 10.20.193.28:0/4136951157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2c180 0x5646a2f89120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa7b9ffb640 0 client.17913 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 >> 10.20.193.28:0/4136951157 conn(0x5646a2f0a680 msgr2=0x5646a2f2aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:18.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 shutdown_connections 2026-02-20T13:24:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.904+0000 7fa8007ede00 1 -- 10.20.193.28:0/4136951157 wait complete. 2026-02-20T13:24:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.905+0000 7fa8007ede00 20 client.17913 trim_cache size 0 max 16384 2026-02-20T13:24:18.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.913+0000 7fa8007ede00 1 Processor -- start 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.913+0000 7fa8007ede00 1 -- start start 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.913+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f2c180 0x5646a2f86520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.913+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f86a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.913+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f71940 0x5646a2f703d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.913+0000 7fa8007ede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646a2e360d0 con 0x5646a2f2c180 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.913+0000 7fa8007ede00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646a2af6700 con 0x5646a2f71940 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.913+0000 7fa8007ede00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646a2f2c790 con 0x5646a2f2ca90 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f71940 0x5646a2f703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f71940 0x5646a2f703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52318/0 (socket says 10.20.193.28:52318) 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 -- 10.20.193.28:0/1194045267 learned_addr learned my addr 10.20.193.28:0/1194045267 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:18.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f2c180 0x5646a2f86520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7f77fe640 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f86a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 -- 10.20.193.28:0/1194045267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 msgr2=0x5646a2f86a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f86a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 -- 10.20.193.28:0/1194045267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f2c180 msgr2=0x5646a2f86520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f2c180 0x5646a2f86520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 -- 10.20.193.28:0/1194045267 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a2dc8bd0 con 0x5646a2f71940 2026-02-20T13:24:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7f77fe640 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f86a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.914+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f71940 0x5646a2f703d0 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=14479250608144679131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7ec0439b0 tx=0x7fa7ec056000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f0a1b6b85280db server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa7bbfff640 1 -- 10.20.193.28:0/1194045267 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7ec03e070 con 0x5646a2f71940 2026-02-20T13:24:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa7bbfff640 1 -- 10.20.193.28:0/1194045267 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa7ec05d020 con 0x5646a2f71940 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa7bbfff640 1 -- 10.20.193.28:0/1194045267 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7ec04cf10 con 0x5646a2f71940 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 -- 10.20.193.28:0/1194045267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f71940 msgr2=0x5646a2f703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f71940 0x5646a2f703d0 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=14479250608144679131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7ec0439b0 tx=0x7fa7ec056000 comp rx=0 tx=0).stop 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 -- 10.20.193.28:0/1194045267 shutdown_connections 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f71940 0x5646a2f703d0 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=14479250608144679131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f86a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 --2- 10.20.193.28:0/1194045267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f2c180 0x5646a2f86520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 -- 10.20.193.28:0/1194045267 >> 10.20.193.28:0/1194045267 conn(0x5646a2f0a680 msgr2=0x5646a2f7b120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:18.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 -- 10.20.193.28:0/1194045267 shutdown_connections 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.915+0000 7fa8007ede00 1 -- 10.20.193.28:0/1194045267 wait complete. 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa8007ede00 1 -- start start 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa8007ede00 1 Processor -- start 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2c180 0x5646a2f101f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f10750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa8007ede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f0be20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa8007ede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646a2e360d0 con 0x5646a2f71940 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa8007ede00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646a2f0c550 con 0x5646a2f2c180 2026-02-20T13:24:18.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa8007ede00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646a2f0c710 con 0x5646a2f2ca90 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa7fcd69640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f0be20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa7f7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2c180 0x5646a2f101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa7f77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f10750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa7fcd69640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f0be20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37198/0 (socket says 10.20.193.28:37198) 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa7fcd69640 1 -- 10.20.193.28:0/2752416916 learned_addr learned my addr 10.20.193.28:0/2752416916 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.916+0000 7fa7f7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2c180 0x5646a2f101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52332/0 (socket says 10.20.193.28:52332) 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7f7fff640 1 -- 10.20.193.28:0/2752416916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 msgr2=0x5646a2f10750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f10750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7f7fff640 1 -- 10.20.193.28:0/2752416916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 msgr2=0x5646a2f0be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f0be20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7f7fff640 1 -- 10.20.193.28:0/2752416916 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a2dbc680 con 0x5646a2f2c180 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7fcd69640 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f0be20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7f7fff640 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2c180 0x5646a2f101f0 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=12743106173225967284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7e4094fd0 tx=0x7fa7e40052a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0d89b8c76389eb4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7b9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/2752416916 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7e40b51a0 con 0x5646a2f2c180 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/2752416916 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa7e40b7fe0 con 0x5646a2f2c180 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646a2dce150 con 0x5646a2f2c180 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/2752416916 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7e40b7dd0 con 0x5646a2f2c180 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa8007ede00 10 client.27875 _ll_register_callbacks cb 0x5646a2db99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7ec03f040 con 0x5646a2f2c180 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/2752416916 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa7e40adb30 con 0x5646a2f2c180 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/2752416916 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa7e40add10 con 0x5646a2f2c180 2026-02-20T13:24:18.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa8007ede00 10 client.27875 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.917+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5646a2dce3b0 con 0x5646a2f2c180 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/2752416916 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa7e40cb020 con 0x5646a2f2c180 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa8007ede00 10 client.27875 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa8007ede00 10 client.27875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa8007ede00 20 client.27875 populate_metadata read hostname 'trial028' 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa8007ede00 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646a301ee30 0x5646a303f2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa8007ede00 4 client.27875 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646a2acbf40 con 0x5646a301ee30 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa7f77fe640 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646a301ee30 0x5646a303f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa7f77fe640 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646a301ee30 0x5646a303f2b0 crc :-1 s=READY pgs=215 gs=4 cs=0 l=0 c_cookie=14651004539707974230 s_cookie=6662464440582736264 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb52d30127ede256 server_cookie=5c75d41c059b0988 in_seq=0 out_seq=0 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa7b9ffb640 10 client.27875 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:18.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa7b9ffb640 1 -- 10.20.193.28:0/2752416916 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x5646a2acbf40 con 0x5646a301ee30 2026-02-20T13:24:18.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa7b9ffb640 10 client.27875 handle_command_reply: tid=0 2026-02-20T13:24:18.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.918+0000 7fa8007ede00 1 client.27875 shutdown 2026-02-20T13:24:18.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2c180 msgr2=0x5646a2f101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2c180 0x5646a2f101f0 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=12743106173225967284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7e4094fd0 tx=0x7fa7e40052a0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 shutdown_connections 2026-02-20T13:24:18.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646a301ee30 0x5646a303f2b0 crc :-1 s=READY pgs=215 gs=4 cs=0 l=0 c_cookie=14651004539707974230 s_cookie=6662464440582736264 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646a2f71940 0x5646a2f0be20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646a2f2ca90 0x5646a2f10750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 --2- 10.20.193.28:0/2752416916 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646a2f2c180 0x5646a2f101f0 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=12743106173225967284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 >> 10.20.193.28:0/2752416916 conn(0x5646a2f0a680 msgr2=0x5646a2f85510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:18.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa7b9ffb640 0 client.27875 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:18.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 shutdown_connections 2026-02-20T13:24:18.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 1 -- 10.20.193.28:0/2752416916 wait complete. 2026-02-20T13:24:18.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa8007ede00 20 client.27875 trim_cache size 0 max 16384 2026-02-20T13:24:18.929 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:24:18.929 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.930 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.932 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.933 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:24:18.934 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:18.937 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa7fd56a640 1 -- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7cc0b5760 msgr2=0x7fa7cc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7cc0b5760 0x7fa7cc0d5c10 secure :-1 s=READY pgs=418 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7f8124800 tx=0x7fa7e8009310 comp rx=0 tx=0).stop 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa7fd56a640 1 -- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f810f4b0 msgr2=0x7fa7f811de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.919+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f810f4b0 0x7fa7f811de60 secure :-1 s=READY pgs=875 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7e400e9c0 tx=0x7fa7e400ee90 comp rx=0 tx=0).stop 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.920+0000 7fa7fd56a640 1 -- 10.20.193.28:0/448541408 shutdown_connections 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.920+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7cc0b5760 0x7fa7cc0d5c10 unknown :-1 s=CLOSED pgs=418 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.920+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa7f81156a0 0x7fa7f8123770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.920+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7f810fea0 0x7fa7f811e3a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.920+0000 7fa7fd56a640 1 --2- 10.20.193.28:0/448541408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7f810f4b0 0x7fa7f811de60 unknown :-1 s=CLOSED pgs=875 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:18.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.920+0000 7fa7fd56a640 1 -- 10.20.193.28:0/448541408 >> 10.20.193.28:0/448541408 conn(0x7fa7f80ecda0 msgr2=0x7fa7f810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:18.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.920+0000 7fa7fd56a640 1 -- 10.20.193.28:0/448541408 shutdown_connections 2026-02-20T13:24:18.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:18.920+0000 7fa7fd56a640 1 -- 10.20.193.28:0/448541408 wait complete. 2026-02-20T13:24:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:18 trial127 ceph-mon[43817]: pgmap v390: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:24:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:18 trial034 ceph-mon[43332]: pgmap v390: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:24:19.020 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:24:19.021 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:24:19.208 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:19.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.383+0000 7feb39240640 1 -- 10.20.193.28:0/1697728870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb340614f0 msgr2=0x7feb34061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:19.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.383+0000 7feb39240640 1 --2- 10.20.193.28:0/1697728870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb340614f0 0x7feb34061920 secure :-1 s=READY pgs=878 gs=1 cs=0 l=1 c_cookie=6323314143640612664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb24009950 tx=0x7feb2402f190 comp rx=0 tx=0).stop 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 -- 10.20.193.28:0/1697728870 shutdown_connections 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 --2- 10.20.193.28:0/1697728870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb340614f0 0x7feb34061920 unknown :-1 s=CLOSED pgs=878 gs=1 cs=0 l=1 c_cookie=6323314143640612664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 --2- 10.20.193.28:0/1697728870 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb34159d80 0x7feb3417a160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 --2- 10.20.193.28:0/1697728870 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb34062ae0 0x7feb34060fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 -- 10.20.193.28:0/1697728870 >> 10.20.193.28:0/1697728870 conn(0x7feb340eab00 msgr2=0x7feb3410af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 -- 10.20.193.28:0/1697728870 shutdown_connections 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 -- 10.20.193.28:0/1697728870 wait complete. 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 Processor -- start 2026-02-20T13:24:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.384+0000 7feb39240640 1 -- start start 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb39240640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb340614f0 0x7feb340f2e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb39240640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb34062ae0 0x7feb340f33c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb39240640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb34159d80 0x7feb340f8790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb39240640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feb340f8db0 con 0x7feb34159d80 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb39240640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7feb340f8f20 con 0x7feb34062ae0 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb39240640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7feb340f90e0 con 0x7feb340614f0 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb337fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb34062ae0 0x7feb340f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb337fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb34062ae0 0x7feb340f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52354/0 (socket says 10.20.193.28:52354) 2026-02-20T13:24:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb38a3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb34159d80 0x7feb340f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb337fe640 1 -- 10.20.193.28:0/606723727 learned_addr learned my addr 10.20.193.28:0/606723727 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb33fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb340614f0 0x7feb340f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb337fe640 1 -- 10.20.193.28:0/606723727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb340614f0 msgr2=0x7feb340f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb337fe640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb340614f0 0x7feb340f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb337fe640 1 -- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb34159d80 msgr2=0x7feb340f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb337fe640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb34159d80 0x7feb340f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb337fe640 1 -- 10.20.193.28:0/606723727 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb24009570 con 0x7feb34062ae0 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.385+0000 7feb38a3f640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb34159d80 0x7feb340f8790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.386+0000 7feb337fe640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb34062ae0 0x7feb340f33c0 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb24005b30 tx=0x7feb24004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.386+0000 7feb317fa640 1 -- 10.20.193.28:0/606723727 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb2403d070 con 0x7feb34062ae0 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.386+0000 7feb317fa640 1 -- 10.20.193.28:0/606723727 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb24038920 con 0x7feb34062ae0 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.386+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb340f9360 con 0x7feb34062ae0 2026-02-20T13:24:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.386+0000 7feb317fa640 1 -- 10.20.193.28:0/606723727 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb240418a0 con 0x7feb34062ae0 2026-02-20T13:24:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.386+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb340f9aa0 con 0x7feb34062ae0 2026-02-20T13:24:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.386+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb340f9630 con 0x7feb34062ae0 2026-02-20T13:24:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.389+0000 7feb317fa640 1 -- 10.20.193.28:0/606723727 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7feb24048020 con 0x7feb34062ae0 2026-02-20T13:24:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.391+0000 7feb317fa640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb080b56e0 0x7feb080d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.391+0000 7feb317fa640 1 -- 10.20.193.28:0/606723727 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feb2410b1a0 con 0x7feb34062ae0 2026-02-20T13:24:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.391+0000 7feb33fff640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb080b56e0 0x7feb080d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:19.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.391+0000 7feb317fa640 1 -- 10.20.193.28:0/606723727 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7feb2410b620 con 0x7feb34062ae0 2026-02-20T13:24:19.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.391+0000 7feb33fff640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb080b56e0 0x7feb080d5b90 secure :-1 s=READY pgs=419 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb20004740 tx=0x7feb2000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:19.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.533+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb34060f80 con 0x7feb34062ae0 2026-02-20T13:24:19.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.533+0000 7feb317fa640 1 -- 10.20.193.28:0/606723727 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7feb240cdc00 con 0x7feb34062ae0 2026-02-20T13:24:19.537 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:24:19.537 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:24:19.538 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:24:19.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.534+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb080b56e0 msgr2=0x7feb080d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:19.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.534+0000 7feb39240640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb080b56e0 0x7feb080d5b90 secure :-1 s=READY pgs=419 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb20004740 tx=0x7feb2000b410 comp rx=0 tx=0).stop 2026-02-20T13:24:19.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.534+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb34062ae0 msgr2=0x7feb340f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:19.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.534+0000 7feb39240640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb34062ae0 0x7feb340f33c0 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb24005b30 tx=0x7feb24004340 comp rx=0 tx=0).stop 2026-02-20T13:24:19.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.535+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 shutdown_connections 2026-02-20T13:24:19.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.535+0000 7feb39240640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb080b56e0 0x7feb080d5b90 unknown :-1 s=CLOSED pgs=419 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.535+0000 7feb39240640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb34159d80 0x7feb340f8790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.535+0000 7feb39240640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb34062ae0 0x7feb340f33c0 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.535+0000 7feb39240640 1 --2- 10.20.193.28:0/606723727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb340614f0 0x7feb340f2e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:19.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.535+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 >> 10.20.193.28:0/606723727 conn(0x7feb340eab00 msgr2=0x7feb3410fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:19.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.535+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 shutdown_connections 2026-02-20T13:24:19.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:19.535+0000 7feb39240640 1 -- 10.20.193.28:0/606723727 wait complete. 2026-02-20T13:24:19.594 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:19 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/606723727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:19.674 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:24:19.859 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:19.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:19 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/606723727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:19.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:19 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/606723727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 -- 10.20.193.28:0/1074806499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410f5f0 msgr2=0x7f702410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 --2- 10.20.193.28:0/1074806499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410f5f0 0x7f702410f9c0 secure :-1 s=READY pgs=879 gs=2 cs=0 l=1 c_cookie=11553820965599344689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7014009950 tx=0x7f701402f1b0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 -- 10.20.193.28:0/1074806499 shutdown_connections 2026-02-20T13:24:20.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 --2- 10.20.193.28:0/1074806499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f70241157e0 0x7f70241761b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 --2- 10.20.193.28:0/1074806499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f702410ffe0 0x7f7024115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 --2- 10.20.193.28:0/1074806499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410f5f0 0x7f702410f9c0 unknown :-1 s=CLOSED pgs=879 gs=2 cs=0 l=1 c_cookie=11553820965599344689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 -- 10.20.193.28:0/1074806499 >> 10.20.193.28:0/1074806499 conn(0x7f70240ecea0 msgr2=0x7f702410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 -- 10.20.193.28:0/1074806499 shutdown_connections 2026-02-20T13:24:20.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.035+0000 7f702bcda640 1 -- 10.20.193.28:0/1074806499 wait complete. 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.036+0000 7f702bcda640 1 Processor -- start 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.036+0000 7f702bcda640 1 -- start start 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.036+0000 7f702bcda640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f702410f5f0 0x7f702411d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.036+0000 7f702bcda640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410ffe0 0x7f702411dab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.036+0000 7f702bcda640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f70241157e0 0x7f7024122e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.036+0000 7f702bcda640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f70241234a0 con 0x7f702410ffe0 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.036+0000 7f702bcda640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7024123610 con 0x7f702410f5f0 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.036+0000 7f702bcda640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f70241237d0 con 0x7f70241157e0 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702a250640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f70241157e0 0x7f7024122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702924e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410ffe0 0x7f702411dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702a250640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f70241157e0 0x7f7024122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60712/0 (socket says 10.20.193.28:60712) 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702a250640 1 -- 10.20.193.28:0/60713658 learned_addr learned my addr 10.20.193.28:0/60713658 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f7029a4f640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f702410f5f0 0x7f702411d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702924e640 1 -- 10.20.193.28:0/60713658 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f70241157e0 msgr2=0x7f7024122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702924e640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f70241157e0 0x7f7024122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702924e640 1 -- 10.20.193.28:0/60713658 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f702410f5f0 msgr2=0x7f702411d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702924e640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f702410f5f0 0x7f702411d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702924e640 1 -- 10.20.193.28:0/60713658 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7014009570 con 0x7f702410ffe0 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702924e640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410ffe0 0x7f702411dab0 secure :-1 s=READY pgs=880 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f701800e9c0 tx=0x7f701800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f7012ffd640 1 -- 10.20.193.28:0/60713658 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f701800ccb0 con 0x7f702410ffe0 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f7012ffd640 1 -- 10.20.193.28:0/60713658 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f701800ce10 con 0x7f702410ffe0 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702bcda640 1 -- 10.20.193.28:0/60713658 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7024123ab0 con 0x7f702410ffe0 2026-02-20T13:24:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f7012ffd640 1 -- 10.20.193.28:0/60713658 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70180106b0 con 0x7f702410ffe0 2026-02-20T13:24:20.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.037+0000 7f702bcda640 1 -- 10.20.193.28:0/60713658 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70241641b0 con 0x7f702410ffe0 2026-02-20T13:24:20.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.040+0000 7f7012ffd640 1 -- 10.20.193.28:0/60713658 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f701801f060 con 0x7f702410ffe0 2026-02-20T13:24:20.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.042+0000 7f7012ffd640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70000b5760 0x7f70000d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.042+0000 7f7012ffd640 1 -- 10.20.193.28:0/60713658 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7018014070 con 0x7f702410ffe0 2026-02-20T13:24:20.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.042+0000 7f7029a4f640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70000b5760 0x7f70000d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.043+0000 7f7029a4f640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70000b5760 0x7f70000d5c10 secure :-1 s=READY pgs=420 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70140098a0 tx=0x7f7014031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702dcd4e00 1 Processor -- start 2026-02-20T13:24:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702dcd4e00 1 -- start start 2026-02-20T13:24:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209360 0x5592de209730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 0x5592de24e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de24eb20 0x5592de26ef00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592de11f780 con 0x5592de209360 2026-02-20T13:24:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5592de11b4b0 con 0x5592de24eb20 2026-02-20T13:24:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5592de115450 con 0x5592de209c70 2026-02-20T13:24:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f7029a4f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209360 0x5592de209730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702924e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 0x5592de24e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f7029a4f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209360 0x5592de209730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36218/0 (socket says 10.20.193.28:36218) 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f7029a4f640 1 -- 10.20.193.28:0/4019548880 learned_addr learned my addr 10.20.193.28:0/4019548880 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.044+0000 7f702a250640 1 --2- 10.20.193.28:0/4019548880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de24eb20 0x5592de26ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f7029a4f640 1 -- 10.20.193.28:0/4019548880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 msgr2=0x5592de24e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f7029a4f640 1 --2- 10.20.193.28:0/4019548880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 0x5592de24e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f7029a4f640 1 -- 10.20.193.28:0/4019548880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de24eb20 msgr2=0x5592de26ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f7029a4f640 1 --2- 10.20.193.28:0/4019548880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de24eb20 0x5592de26ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f7029a4f640 1 -- 10.20.193.28:0/4019548880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592de0c0d10 con 0x5592de209360 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f7029a4f640 1 --2- 10.20.193.28:0/4019548880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209360 0x5592de209730 secure :-1 s=READY pgs=881 gs=1 cs=0 l=1 c_cookie=8813112686993466374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7014005ad0 tx=0x7f7014040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4e774b81bbe406 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f6ff24e6640 1 -- 10.20.193.28:0/4019548880 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f701402fc30 con 0x5592de209360 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f6ff24e6640 1 -- 10.20.193.28:0/4019548880 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f701402fd90 con 0x5592de209360 2026-02-20T13:24:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f6ff24e6640 1 -- 10.20.193.28:0/4019548880 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f701404f810 con 0x5592de209360 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 -- 10.20.193.28:0/4019548880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209360 msgr2=0x5592de209730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/4019548880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209360 0x5592de209730 secure :-1 s=READY pgs=881 gs=1 cs=0 l=1 c_cookie=8813112686993466374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7014005ad0 tx=0x7f7014040000 comp rx=0 tx=0).stop 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 -- 10.20.193.28:0/4019548880 shutdown_connections 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/4019548880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de24eb20 0x5592de26ef00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/4019548880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 0x5592de24e5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/4019548880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209360 0x5592de209730 unknown :-1 s=CLOSED pgs=881 gs=1 cs=0 l=1 c_cookie=8813112686993466374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 -- 10.20.193.28:0/4019548880 >> 10.20.193.28:0/4019548880 conn(0x5592de1e7860 msgr2=0x5592de207c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 -- 10.20.193.28:0/4019548880 shutdown_connections 2026-02-20T13:24:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.045+0000 7f702dcd4e00 1 -- 10.20.193.28:0/4019548880 wait complete. 2026-02-20T13:24:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702dcd4e00 1 -- start start 2026-02-20T13:24:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702dcd4e00 1 Processor -- start 2026-02-20T13:24:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de266790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de266cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de268a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592de268fd0 con 0x5592de209c70 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5592de269140 con 0x5592de209360 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5592de269300 con 0x5592de24eb20 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702924e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de266cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702924e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de266cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36220/0 (socket says 10.20.193.28:36220) 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702924e640 1 -- 10.20.193.28:0/2531112266 learned_addr learned my addr 10.20.193.28:0/2531112266 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f7029a4f640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de266790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.047+0000 7f702a250640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de268a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702924e640 1 -- 10.20.193.28:0/2531112266 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 msgr2=0x5592de268a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702924e640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de268a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702924e640 1 -- 10.20.193.28:0/2531112266 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 msgr2=0x5592de266790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702924e640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de266790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702924e640 1 -- 10.20.193.28:0/2531112266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592de0993c0 con 0x5592de209c70 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702a250640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de268a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f7029a4f640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de266790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702924e640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de266cd0 secure :-1 s=READY pgs=882 gs=2 cs=0 l=1 c_cookie=4068351951784192009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70180acea0 tx=0x7f70180ad8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3875b08b8b5d2809 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f6fdf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/2531112266 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70180b8000 con 0x5592de209c70 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/2531112266 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f701800b2c0 con 0x5592de209c70 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/2531112266 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70180acbe0 con 0x5592de209c70 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7024176a20 con 0x5592de209c70 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/2531112266 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f70180adb50 con 0x5592de209c70 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702dcd4e00 10 client.17937 _ll_register_callbacks cb 0x5592de096a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.048+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5592dddab6f0 con 0x5592de209c70 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/2531112266 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70180add10 con 0x5592de209c70 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f702dcd4e00 10 client.17937 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5592de0ab0e0 con 0x5592de209c70 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/2531112266 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70180c4d20 con 0x5592de209c70 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f702dcd4e00 10 client.17937 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f702dcd4e00 10 client.17937 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f702dcd4e00 20 client.17937 populate_metadata read hostname 'trial028' 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5592de26ec80 0x5592de24c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f702dcd4e00 4 client.17937 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592de0b7f80 con 0x5592de26ec80 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.049+0000 7f7029a4f640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5592de26ec80 0x5592de24c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.050+0000 7f7029a4f640 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5592de26ec80 0x5592de24c8a0 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=5320972097479769891 s_cookie=17995465695653199264 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=49d7e3ee520bff23 server_cookie=f9bcbcb4c522fda0 in_seq=0 out_seq=0 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.050+0000 7f6fdf7fe640 10 client.17937 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.050+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/2531112266 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5592de0b7f80 con 0x5592de26ec80 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.050+0000 7f6fdf7fe640 10 client.17937 handle_command_reply: tid=0 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.050+0000 7f702dcd4e00 1 client.17937 shutdown 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 msgr2=0x5592de266cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de266cd0 secure :-1 s=READY pgs=882 gs=2 cs=0 l=1 c_cookie=4068351951784192009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70180acea0 tx=0x7f70180ad8c0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 shutdown_connections 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5592de26ec80 0x5592de24c8a0 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=5320972097479769891 s_cookie=17995465695653199264 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de266cd0 unknown :-1 s=CLOSED pgs=882 gs=2 cs=0 l=1 c_cookie=4068351951784192009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de268a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/2531112266 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de266790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 >> 10.20.193.28:0/2531112266 conn(0x5592de1e7860 msgr2=0x5592de207c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f6fdf7fe640 0 client.17937 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:24:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 shutdown_connections 2026-02-20T13:24:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 1 -- 10.20.193.28:0/2531112266 wait complete. 2026-02-20T13:24:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.051+0000 7f702dcd4e00 20 client.17937 trim_cache size 0 max 16384 2026-02-20T13:24:20.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702dcd4e00 1 Processor -- start 2026-02-20T13:24:20.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702dcd4e00 1 -- start start 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de2689f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 0x5592de26c290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de24eb20 0x5592de26c7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592de113080 con 0x5592de24eb20 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5592dddd3700 con 0x5592de209360 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5592de267830 con 0x5592de209c70 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.059+0000 7f702a250640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de24eb20 0x5592de26c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702a250640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de24eb20 0x5592de26c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36234/0 (socket says 10.20.193.28:36234) 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702a250640 1 -- 10.20.193.28:0/1171166829 learned_addr learned my addr 10.20.193.28:0/1171166829 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f7029a4f640 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de2689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702924e640 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 0x5592de26c290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702a250640 1 -- 10.20.193.28:0/1171166829 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 msgr2=0x5592de26c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702a250640 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 0x5592de26c290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702a250640 1 -- 10.20.193.28:0/1171166829 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 msgr2=0x5592de2689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702a250640 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de2689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702a250640 1 -- 10.20.193.28:0/1171166829 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592de258a30 con 0x5592de24eb20 2026-02-20T13:24:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f702a250640 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de24eb20 0x5592de26c7d0 secure :-1 s=READY pgs=883 gs=1 cs=0 l=1 c_cookie=803767489660796756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7020005620 tx=0x7f7020003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b278e45f73d3f54 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f6ff1ce5640 1 -- 10.20.193.28:0/1171166829 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7020018070 con 0x5592de24eb20 2026-02-20T13:24:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f6ff1ce5640 1 -- 10.20.193.28:0/1171166829 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7020008e20 con 0x5592de24eb20 2026-02-20T13:24:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.060+0000 7f6ff1ce5640 1 -- 10.20.193.28:0/1171166829 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7020012ac0 con 0x5592de24eb20 2026-02-20T13:24:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1171166829 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de24eb20 msgr2=0x5592de26c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de24eb20 0x5592de26c7d0 secure :-1 s=READY pgs=883 gs=1 cs=0 l=1 c_cookie=803767489660796756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7020005620 tx=0x7f7020003b50 comp rx=0 tx=0).stop 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1171166829 shutdown_connections 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de24eb20 0x5592de26c7d0 unknown :-1 s=CLOSED pgs=883 gs=1 cs=0 l=1 c_cookie=803767489660796756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de209c70 0x5592de26c290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1171166829 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de2689f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1171166829 >> 10.20.193.28:0/1171166829 conn(0x5592de1e7860 msgr2=0x5592de26bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1171166829 shutdown_connections 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1171166829 wait complete. 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 -- start start 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.061+0000 7f702dcd4e00 1 Processor -- start 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de1ed500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de1eda40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702dcd4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de249300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592de249940 con 0x5592de209c70 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5592de249ab0 con 0x5592de209360 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702dcd4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5592de249c70 con 0x5592de24eb20 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702a250640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de249300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702a250640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de249300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60746/0 (socket says 10.20.193.28:60746) 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702a250640 1 -- 10.20.193.28:0/1368051136 learned_addr learned my addr 10.20.193.28:0/1368051136 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f7029a4f640 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de1ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702924e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de1eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702a250640 1 -- 10.20.193.28:0/1368051136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 msgr2=0x5592de1ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702a250640 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de1ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702a250640 1 -- 10.20.193.28:0/1368051136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 msgr2=0x5592de1eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702a250640 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de1eda40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f702a250640 1 -- 10.20.193.28:0/1368051136 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592de0a5b60 con 0x5592de24eb20 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.062+0000 7f7029a4f640 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de1ed500 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f702a250640 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de249300 secure :-1 s=READY pgs=274 gs=2 cs=0 l=1 c_cookie=17593153714536200671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7020012780 tx=0x7f70200068b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f427701741c639df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f6fdf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/1368051136 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7020023070 con 0x5592de24eb20 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70200052c0 con 0x5592de24eb20 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f702dcd4e00 10 client.27805 _ll_register_callbacks cb 0x5592de096a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f701402fd90 con 0x5592de24eb20 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/1368051136 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f70200124c0 con 0x5592de24eb20 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/1368051136 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7020018040 con 0x5592de24eb20 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/1368051136 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f702001dc10 con 0x5592de24eb20 2026-02-20T13:24:20.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/1368051136 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f702001ddf0 con 0x5592de24eb20 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f702dcd4e00 10 client.27805 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.063+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5592de0996f0 con 0x5592de24eb20 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/1368051136 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f702002f060 con 0x5592de24eb20 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 10 client.27805 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 10 client.27805 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 20 client.27805 populate_metadata read hostname 'trial028' 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5592de2fc3b0 0x5592de31c860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 4 client.27805 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592ddda8f40 con 0x5592de2fc3b0 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f7029a4f640 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5592de2fc3b0 0x5592de31c860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f6fdf7fe640 10 client.27805 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f7029a4f640 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5592de2fc3b0 0x5592de31c860 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=12722565236901741902 s_cookie=15406447844587152045 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b08fa1ad0943054e server_cookie=d5ceb2b0133322ad in_seq=0 out_seq=0 2026-02-20T13:24:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f6fdf7fe640 1 -- 10.20.193.28:0/1368051136 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592ddda8f40 con 0x5592de2fc3b0 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f6fdf7fe640 10 client.27805 handle_command_reply: tid=0 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 1 client.27805 shutdown 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 msgr2=0x5592de249300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.064+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de249300 secure :-1 s=READY pgs=274 gs=2 cs=0 l=1 c_cookie=17593153714536200671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7020012780 tx=0x7f70200068b0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 shutdown_connections 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5592de2fc3b0 0x5592de31c860 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=12722565236901741902 s_cookie=15406447844587152045 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592de209c70 0x5592de1eda40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5592de24eb20 0x5592de249300 unknown :-1 s=CLOSED pgs=274 gs=2 cs=0 l=1 c_cookie=17593153714536200671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 1 --2- 10.20.193.28:0/1368051136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5592de209360 0x5592de1ed500 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f6fdf7fe640 0 client.27805 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 >> 10.20.193.28:0/1368051136 conn(0x5592de1e7860 msgr2=0x5592de26c370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 shutdown_connections 2026-02-20T13:24:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 1 -- 10.20.193.28:0/1368051136 wait complete. 2026-02-20T13:24:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702dcd4e00 20 client.27805 trim_cache size 0 max 16384 2026-02-20T13:24:20.074 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 -- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70000b5760 msgr2=0x7f70000d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70000b5760 0x7f70000d5c10 secure :-1 s=READY pgs=420 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70140098a0 tx=0x7f7014031040 comp rx=0 tx=0).stop 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 -- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410ffe0 msgr2=0x7f702411dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410ffe0 0x7f702411dab0 secure :-1 s=READY pgs=880 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f701800e9c0 tx=0x7f701800ee90 comp rx=0 tx=0).stop 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 -- 10.20.193.28:0/60713658 shutdown_connections 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70000b5760 0x7f70000d5c10 unknown :-1 s=CLOSED pgs=420 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f702410ffe0 0x7f702411dab0 unknown :-1 s=CLOSED pgs=880 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f70241157e0 0x7f7024122e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 --2- 10.20.193.28:0/60713658 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f702410f5f0 0x7f702411d570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 -- 10.20.193.28:0/60713658 >> 10.20.193.28:0/60713658 conn(0x7f70240ecea0 msgr2=0x7f702410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 -- 10.20.193.28:0/60713658 shutdown_connections 2026-02-20T13:24:20.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.065+0000 7f702bcda640 1 -- 10.20.193.28:0/60713658 wait complete. 2026-02-20T13:24:20.165 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:24:20.350 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:20.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 -- 10.20.193.28:0/2219900083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f1010f5f0 msgr2=0x7f2f1010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 --2- 10.20.193.28:0/2219900083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f1010f5f0 0x7f2f1010f9c0 secure :-1 s=READY pgs=884 gs=2 cs=0 l=1 c_cookie=17117723678793479483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f04009950 tx=0x7f2f0402f190 comp rx=0 tx=0).stop 2026-02-20T13:24:20.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 -- 10.20.193.28:0/2219900083 shutdown_connections 2026-02-20T13:24:20.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 --2- 10.20.193.28:0/2219900083 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f101157e0 0x7f2f101761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 --2- 10.20.193.28:0/2219900083 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f1010ffe0 0x7f2f10115030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 --2- 10.20.193.28:0/2219900083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f1010f5f0 0x7f2f1010f9c0 unknown :-1 s=CLOSED pgs=884 gs=2 cs=0 l=1 c_cookie=17117723678793479483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 -- 10.20.193.28:0/2219900083 >> 10.20.193.28:0/2219900083 conn(0x7f2f100ecea0 msgr2=0x7f2f1010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 -- 10.20.193.28:0/2219900083 shutdown_connections 2026-02-20T13:24:20.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.522+0000 7f2f155de640 1 -- 10.20.193.28:0/2219900083 wait complete. 2026-02-20T13:24:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f155de640 1 Processor -- start 2026-02-20T13:24:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f155de640 1 -- start start 2026-02-20T13:24:20.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f155de640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f1010f5f0 0x7f2f1011d4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f155de640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f1010ffe0 0x7f2f1011da20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f155de640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f101157e0 0x7f2f10122df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f155de640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10123410 con 0x7f2f101157e0 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f155de640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10123580 con 0x7f2f1010ffe0 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f155de640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10123740 con 0x7f2f1010f5f0 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0e7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f1010ffe0 0x7f2f1011da20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f101157e0 0x7f2f10122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0e7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f1010ffe0 0x7f2f1011da20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51644/0 (socket says 10.20.193.28:51644) 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0e7fc640 1 -- 10.20.193.28:0/2028911118 learned_addr learned my addr 10.20.193.28:0/2028911118 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0effd640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f1010f5f0 0x7f2f1011d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0f7fe640 1 -- 10.20.193.28:0/2028911118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f1010f5f0 msgr2=0x7f2f1011d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f1010f5f0 0x7f2f1011d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0f7fe640 1 -- 10.20.193.28:0/2028911118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f1010ffe0 msgr2=0x7f2f1011da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f1010ffe0 0x7f2f1011da20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.523+0000 7f2f0f7fe640 1 -- 10.20.193.28:0/2028911118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f04009570 con 0x7f2f101157e0 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.524+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f101157e0 0x7f2f10122df0 secure :-1 s=READY pgs=885 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f0000e720 tx=0x7f2f0000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.524+0000 7f2eeffff640 1 -- 10.20.193.28:0/2028911118 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f00005500 con 0x7f2f101157e0 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.524+0000 7f2eeffff640 1 -- 10.20.193.28:0/2028911118 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f00005660 con 0x7f2f101157e0 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.524+0000 7f2eeffff640 1 -- 10.20.193.28:0/2028911118 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f00011460 con 0x7f2f101157e0 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.524+0000 7f2f155de640 1 -- 10.20.193.28:0/2028911118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f10123a20 con 0x7f2f101157e0 2026-02-20T13:24:20.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.524+0000 7f2f155de640 1 -- 10.20.193.28:0/2028911118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f10164120 con 0x7f2f101157e0 2026-02-20T13:24:20.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.527+0000 7f2eeffff640 1 -- 10.20.193.28:0/2028911118 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2f0000c7e0 con 0x7f2f101157e0 2026-02-20T13:24:20.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.529+0000 7f2eeffff640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2ee40b5760 0x7f2ee40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.529+0000 7f2eeffff640 1 -- 10.20.193.28:0/2028911118 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2f000e76c0 con 0x7f2f101157e0 2026-02-20T13:24:20.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.529+0000 7f2f0effd640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2ee40b5760 0x7f2ee40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.529+0000 7f2f175d8e00 1 Processor -- start 2026-02-20T13:24:20.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f175d8e00 1 -- start start 2026-02-20T13:24:20.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54be1360 0x55bc54be1730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1c70 0x55bc54c265e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2ee40b5760 0x7f2ee40d5c10 secure :-1 s=READY pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f040023d0 tx=0x7f2f04031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54c26b20 0x55bc54c46f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc54af7780 con 0x55bc54be1360 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bc54af34b0 con 0x55bc54c26b20 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bc54aed450 con 0x55bc54be1c70 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54be1360 0x55bc54be1730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54be1360 0x55bc54be1730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36272/0 (socket says 10.20.193.28:36272) 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 -- 10.20.193.28:0/2239732701 learned_addr learned my addr 10.20.193.28:0/2239732701 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0e7fc640 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1c70 0x55bc54c265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54c26b20 0x55bc54c46f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 -- 10.20.193.28:0/2239732701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1c70 msgr2=0x55bc54c265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1c70 0x55bc54c265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 -- 10.20.193.28:0/2239732701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54c26b20 msgr2=0x55bc54c46f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54c26b20 0x55bc54c46f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0effd640 1 -- 10.20.193.28:0/2239732701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc54a98d10 con 0x55bc54be1360 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0e7fc640 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1c70 0x55bc54c265e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.530+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54c26b20 0x55bc54c46f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f0effd640 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54be1360 0x55bc54be1730 secure :-1 s=READY pgs=886 gs=1 cs=0 l=1 c_cookie=2610983024723289403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f04002d80 tx=0x7f2f04040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243c133a3734e53b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2edb7fe640 1 -- 10.20.193.28:0/2239732701 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f04002a00 con 0x55bc54be1360 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2edb7fe640 1 -- 10.20.193.28:0/2239732701 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f04038920 con 0x55bc54be1360 2026-02-20T13:24:20.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2edb7fe640 1 -- 10.20.193.28:0/2239732701 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f040437d0 con 0x55bc54be1360 2026-02-20T13:24:20.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 -- 10.20.193.28:0/2239732701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54be1360 msgr2=0x55bc54be1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54be1360 0x55bc54be1730 secure :-1 s=READY pgs=886 gs=1 cs=0 l=1 c_cookie=2610983024723289403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f04002d80 tx=0x7f2f04040000 comp rx=0 tx=0).stop 2026-02-20T13:24:20.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 -- 10.20.193.28:0/2239732701 shutdown_connections 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54c26b20 0x55bc54c46f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1c70 0x55bc54c265e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/2239732701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54be1360 0x55bc54be1730 unknown :-1 s=CLOSED pgs=886 gs=1 cs=0 l=1 c_cookie=2610983024723289403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 -- 10.20.193.28:0/2239732701 >> 10.20.193.28:0/2239732701 conn(0x55bc54bbf860 msgr2=0x55bc54bdfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 -- 10.20.193.28:0/2239732701 shutdown_connections 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.531+0000 7f2f175d8e00 1 -- 10.20.193.28:0/2239732701 wait complete. 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.532+0000 7f2f175d8e00 1 -- start start 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f175d8e00 1 Processor -- start 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c3e7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c3ecf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c26b20 0x55bc54c40a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc54c40ff0 con 0x55bc54c26b20 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bc54c41160 con 0x55bc54be1c70 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bc54c41320 con 0x55bc54be1360 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c3e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c3e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60784/0 (socket says 10.20.193.28:60784) 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0effd640 1 -- 10.20.193.28:0/1269984276 learned_addr learned my addr 10.20.193.28:0/1269984276 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0e7fc640 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c3ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c26b20 0x55bc54c40a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0effd640 1 -- 10.20.193.28:0/1269984276 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 msgr2=0x55bc54c3ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0effd640 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c3ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0effd640 1 -- 10.20.193.28:0/1269984276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c26b20 msgr2=0x55bc54c40a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0effd640 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c26b20 0x55bc54c40a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.533+0000 7f2f0effd640 1 -- 10.20.193.28:0/1269984276 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f10176a20 con 0x55bc54be1360 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2f0effd640 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c3e7b0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=2783322476580129470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f040098a0 tx=0x7f2f04043630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26a0590bb7eb4abe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2ed8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/1269984276 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f04038a90 con 0x55bc54be1360 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/1269984276 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f04038bf0 con 0x55bc54be1360 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f10164120 con 0x55bc54be1360 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/1269984276 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f040589a0 con 0x55bc54be1360 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2f175d8e00 10 client.27817 _ll_register_callbacks cb 0x55bc54a6ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc547836f0 con 0x55bc54be1360 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.534+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/1269984276 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2f04038d60 con 0x55bc54be1360 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/1269984276 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f04058b30 con 0x55bc54be1360 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f175d8e00 10 client.27817 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:20.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bc54a713c0 con 0x55bc54be1360 2026-02-20T13:24:20.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/1269984276 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f04058c90 con 0x55bc54be1360 2026-02-20T13:24:20.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f175d8e00 10 client.27817 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f175d8e00 10 client.27817 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f175d8e00 20 client.27817 populate_metadata read hostname 'trial028' 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55bc54c23d00 0x55bc54c241a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f175d8e00 4 client.27817 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc54a8ff80 con 0x55bc54c23d00 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.535+0000 7f2f0e7fc640 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55bc54c23d00 0x55bc54c241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.536+0000 7f2f0e7fc640 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55bc54c23d00 0x55bc54c241a0 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=3161833714470084653 s_cookie=1085985539529970700 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2be11702ddd7e02d server_cookie=f1232182ae5140c in_seq=0 out_seq=0 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.536+0000 7f2ed8ff9640 10 client.27817 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.536+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/1269984276 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bc54a8ff80 con 0x55bc54c23d00 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.536+0000 7f2ed8ff9640 10 client.27817 handle_command_reply: tid=0 2026-02-20T13:24:20.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.536+0000 7f2f175d8e00 1 client.27817 shutdown 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 msgr2=0x55bc54c3e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c3e7b0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=2783322476580129470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f040098a0 tx=0x7f2f04043630 comp rx=0 tx=0).stop 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 shutdown_connections 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55bc54c23d00 0x55bc54c241a0 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=3161833714470084653 s_cookie=1085985539529970700 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c26b20 0x55bc54c40a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c3ecf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2ed8ff9640 0 client.27817 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1269984276 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c3e7b0 unknown :-1 s=CLOSED pgs=275 gs=1 cs=0 l=1 c_cookie=2783322476580129470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 >> 10.20.193.28:0/1269984276 conn(0x55bc54bbf860 msgr2=0x55bc54bdfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 shutdown_connections 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1269984276 wait complete. 2026-02-20T13:24:20.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.537+0000 7f2f175d8e00 20 client.27817 trim_cache size 0 max 16384 2026-02-20T13:24:20.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f175d8e00 1 Processor -- start 2026-02-20T13:24:20.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f175d8e00 1 -- start start 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c40a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c3b940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54c3be80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc54aeb080 con 0x55bc54c23d00 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bc547ab700 con 0x55bc54be1c70 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bc54c2be80 con 0x55bc54be1360 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c40a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c40a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60788/0 (socket says 10.20.193.28:60788) 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54c3be80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0effd640 1 -- 10.20.193.28:0/1584730111 learned_addr learned my addr 10.20.193.28:0/1584730111 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0f7fe640 1 -- 10.20.193.28:0/1584730111 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 msgr2=0x55bc54c40a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/1584730111 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c40a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0f7fe640 1 -- 10.20.193.28:0/1584730111 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 msgr2=0x55bc54c3b940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/1584730111 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c3b940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.545+0000 7f2f0f7fe640 1 -- 10.20.193.28:0/1584730111 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc54a830e0 con 0x55bc54c23d00 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/1584730111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54c3be80 secure :-1 s=READY pgs=887 gs=2 cs=0 l=1 c_cookie=9818082786226363183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f000aa030 tx=0x7f2f00003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8840d64690665b2f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2edaffd640 1 -- 10.20.193.28:0/1584730111 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f000ae460 con 0x55bc54c23d00 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2edaffd640 1 -- 10.20.193.28:0/1584730111 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f000b3780 con 0x55bc54c23d00 2026-02-20T13:24:20.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2edaffd640 1 -- 10.20.193.28:0/1584730111 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f000ad600 con 0x55bc54c23d00 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1584730111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 msgr2=0x55bc54c3be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1584730111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54c3be80 secure :-1 s=READY pgs=887 gs=2 cs=0 l=1 c_cookie=9818082786226363183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f000aa030 tx=0x7f2f00003a00 comp rx=0 tx=0).stop 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1584730111 shutdown_connections 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1584730111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54c3be80 unknown :-1 s=CLOSED pgs=887 gs=2 cs=0 l=1 c_cookie=9818082786226363183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1584730111 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c3b940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/1584730111 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c40a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1584730111 >> 10.20.193.28:0/1584730111 conn(0x55bc54bbf860 msgr2=0x55bc54c43310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1584730111 shutdown_connections 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.546+0000 7f2f175d8e00 1 -- 10.20.193.28:0/1584730111 wait complete. 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f175d8e00 1 -- start start 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f175d8e00 1 Processor -- start 2026-02-20T13:24:20.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c425b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c42af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f175d8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54bc0c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc54c44f40 con 0x55bc54c23d00 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bc54bc11e0 con 0x55bc54be1c70 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f175d8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bc54bc13a0 con 0x55bc54be1360 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f0effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.547+0000 7f2f0f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54bc0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60800/0 (socket says 10.20.193.28:60800) 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0effd640 1 -- 10.20.193.28:0/674047598 learned_addr learned my addr 10.20.193.28:0/674047598 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0e7fc640 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c42af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0effd640 1 -- 10.20.193.28:0/674047598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 msgr2=0x55bc54c42af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0effd640 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c42af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0effd640 1 -- 10.20.193.28:0/674047598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 msgr2=0x55bc54bc0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:20.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0effd640 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54bc0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0effd640 1 -- 10.20.193.28:0/674047598 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc54a7db60 con 0x55bc54be1360 2026-02-20T13:24:20.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0f7fe640 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54bc0c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:20.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2f0effd640 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c425b0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=16171080731257878411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f040044a0 tx=0x7f2f04062000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e06b383f3cca378b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:20.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2ed8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:20.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/674047598 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f04043910 con 0x55bc54be1360 2026-02-20T13:24:20.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.548+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/674047598 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f04048030 con 0x55bc54be1360 2026-02-20T13:24:20.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f10123a20 con 0x55bc54be1360 2026-02-20T13:24:20.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/674047598 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f04043b80 con 0x55bc54be1360 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/674047598 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2f04043d10 con 0x55bc54be1360 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 10 client.27823 _ll_register_callbacks cb 0x55bc54a6ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f04038920 con 0x55bc54be1360 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/674047598 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f0404e3a0 con 0x55bc54be1360 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 10 client.27823 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bc54a716f0 con 0x55bc54be1360 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/674047598 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f040573d0 con 0x55bc54be1360 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 10 client.27823 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 10 client.27823 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 20 client.27823 populate_metadata read hostname 'trial028' 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55bc54c26b20 0x55bc54bc2a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 4 client.27823 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:20.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.549+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc54780f40 con 0x55bc54c26b20 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f0e7fc640 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55bc54c26b20 0x55bc54bc2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f0e7fc640 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55bc54c26b20 0x55bc54bc2a50 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=4775780107934507074 s_cookie=5315647367958736624 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4246fab47ad02042 server_cookie=49c4f91e1e6baef0 in_seq=0 out_seq=0 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2ed8ff9640 10 client.27823 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2ed8ff9640 1 -- 10.20.193.28:0/674047598 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc54780f40 con 0x55bc54c26b20 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2ed8ff9640 10 client.27823 handle_command_reply: tid=0 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 client.27823 shutdown 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 msgr2=0x55bc54c425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c425b0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=16171080731257878411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f040044a0 tx=0x7f2f04062000 comp rx=0 tx=0).stop 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 shutdown_connections 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55bc54c26b20 0x55bc54bc2a50 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=4775780107934507074 s_cookie=5315647367958736624 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc54c23d00 0x55bc54bc0c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bc54be1c70 0x55bc54c42af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 --2- 10.20.193.28:0/674047598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bc54be1360 0x55bc54c425b0 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=16171080731257878411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2ed8ff9640 0 client.27823 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:24:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 >> 10.20.193.28:0/674047598 conn(0x55bc54bbf860 msgr2=0x55bc54c3de40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.550+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 shutdown_connections 2026-02-20T13:24:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f175d8e00 1 -- 10.20.193.28:0/674047598 wait complete. 2026-02-20T13:24:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f175d8e00 20 client.27823 trim_cache size 0 max 16384 2026-02-20T13:24:20.559 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 -- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2ee40b5760 msgr2=0x7f2ee40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2ee40b5760 0x7f2ee40d5c10 secure :-1 s=READY pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f040023d0 tx=0x7f2f04031040 comp rx=0 tx=0).stop 2026-02-20T13:24:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 -- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f101157e0 msgr2=0x7f2f10122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f101157e0 0x7f2f10122df0 secure :-1 s=READY pgs=885 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f0000e720 tx=0x7f2f0000ebf0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 -- 10.20.193.28:0/2028911118 shutdown_connections 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2ee40b5760 0x7f2ee40d5c10 unknown :-1 s=CLOSED pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f101157e0 0x7f2f10122df0 unknown :-1 s=CLOSED pgs=885 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2f1010ffe0 0x7f2f1011da20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 --2- 10.20.193.28:0/2028911118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2f1010f5f0 0x7f2f1011d4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 -- 10.20.193.28:0/2028911118 >> 10.20.193.28:0/2028911118 conn(0x7f2f100ecea0 msgr2=0x7f2f1010d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 -- 10.20.193.28:0/2028911118 shutdown_connections 2026-02-20T13:24:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:20.551+0000 7f2f155de640 1 -- 10.20.193.28:0/2028911118 wait complete. 2026-02-20T13:24:20.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:20 trial028 ceph-mon[37442]: pgmap v391: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:24:20.689 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:24:20.876 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:20 trial127 ceph-mon[43817]: pgmap v391: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:24:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:20 trial034 ceph-mon[43332]: pgmap v391: 97 pgs: 97 active+clean; 3.7 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:24:21.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.042+0000 7fa797577640 1 -- 10.20.193.28:0/2142251710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa79810fea0 msgr2=0x7fa798114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.042+0000 7fa797577640 1 --2- 10.20.193.28:0/2142251710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa79810fea0 0x7fa798114ef0 secure :-1 s=READY pgs=888 gs=1 cs=0 l=1 c_cookie=2726095119994928554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa780009950 tx=0x7fa78002f190 comp rx=0 tx=0).stop 2026-02-20T13:24:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 -- 10.20.193.28:0/2142251710 shutdown_connections 2026-02-20T13:24:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 --2- 10.20.193.28:0/2142251710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa79810fea0 0x7fa798114ef0 unknown :-1 s=CLOSED pgs=888 gs=1 cs=0 l=1 c_cookie=2726095119994928554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 --2- 10.20.193.28:0/2142251710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7981156a0 0x7fa798176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 --2- 10.20.193.28:0/2142251710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa79810f4b0 0x7fa79810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 -- 10.20.193.28:0/2142251710 >> 10.20.193.28:0/2142251710 conn(0x7fa7980ecda0 msgr2=0x7fa79810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 -- 10.20.193.28:0/2142251710 shutdown_connections 2026-02-20T13:24:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 -- 10.20.193.28:0/2142251710 wait complete. 2026-02-20T13:24:21.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 Processor -- start 2026-02-20T13:24:21.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.043+0000 7fa797577640 1 -- start start 2026-02-20T13:24:21.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa797577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa79810f4b0 0x7fa7980f57c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa797577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa79810fea0 0x7fa798175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa797577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7981156a0 0x7fa7980f5ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa797577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980fb0d0 con 0x7fa7981156a0 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa797577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980fb240 con 0x7fa79810fea0 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa797577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980fb400 con 0x7fa79810f4b0 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa795d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa79810fea0 0x7fa798175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa795d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa79810fea0 0x7fa798175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51706/0 (socket says 10.20.193.28:51706) 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa795d74640 1 -- 10.20.193.28:0/2675232782 learned_addr learned my addr 10.20.193.28:0/2675232782 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa796d76640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7981156a0 0x7fa7980f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa796575640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa79810f4b0 0x7fa7980f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa796d76640 1 -- 10.20.193.28:0/2675232782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa79810f4b0 msgr2=0x7fa7980f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa796d76640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa79810f4b0 0x7fa7980f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa796d76640 1 -- 10.20.193.28:0/2675232782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa79810fea0 msgr2=0x7fa798175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa796d76640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa79810fea0 0x7fa798175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa796d76640 1 -- 10.20.193.28:0/2675232782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780009570 con 0x7fa7981156a0 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.044+0000 7fa795d74640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa79810fea0 0x7fa798175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.045+0000 7fa796d76640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7981156a0 0x7fa7980f5ec0 secure :-1 s=READY pgs=889 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78800e720 tx=0x7fa78800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.045+0000 7fa77f7fe640 1 -- 10.20.193.28:0/2675232782 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa788005500 con 0x7fa7981156a0 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.045+0000 7fa77f7fe640 1 -- 10.20.193.28:0/2675232782 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa788005660 con 0x7fa7981156a0 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.045+0000 7fa77f7fe640 1 -- 10.20.193.28:0/2675232782 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa788011460 con 0x7fa7981156a0 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.045+0000 7fa797577640 1 -- 10.20.193.28:0/2675232782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7980fb6e0 con 0x7fa7981156a0 2026-02-20T13:24:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.045+0000 7fa797577640 1 -- 10.20.193.28:0/2675232782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7980fbc00 con 0x7fa7981156a0 2026-02-20T13:24:21.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.048+0000 7fa77f7fe640 1 -- 10.20.193.28:0/2675232782 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa78800c7e0 con 0x7fa7981156a0 2026-02-20T13:24:21.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.050+0000 7fa77f7fe640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7700b5750 0x7fa7700d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.050+0000 7fa77f7fe640 1 -- 10.20.193.28:0/2675232782 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa7880e74a0 con 0x7fa7981156a0 2026-02-20T13:24:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.050+0000 7fa796575640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7700b5750 0x7fa7700d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.050+0000 7fa79ee40e00 1 Processor -- start 2026-02-20T13:24:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.050+0000 7fa79ee40e00 1 -- start start 2026-02-20T13:24:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a38140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a7cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9d910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9945780 con 0x55c5f9a38680 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c5f99414b0 con 0x55c5f9a7d530 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c5f993b450 con 0x55c5f9a37d70 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796575640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7700b5750 0x7fa7700d5c00 secure :-1 s=READY pgs=422 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78c004740 tx=0x7fa78c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9d910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9d910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51716/0 (socket says 10.20.193.28:51716) 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796d76640 1 -- 10.20.193.28:0/293103231 learned_addr learned my addr 10.20.193.28:0/293103231 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796d76640 1 -- 10.20.193.28:0/293103231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 msgr2=0x55c5f9a38140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796575640 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a38140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796d76640 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a38140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa795d74640 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a7cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796d76640 1 -- 10.20.193.28:0/293103231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 msgr2=0x55c5f9a7cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796d76640 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a7cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.051+0000 7fa796d76640 1 -- 10.20.193.28:0/293103231 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5f98e6d10 con 0x55c5f9a7d530 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa796d76640 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9d910 secure :-1 s=READY pgs=329 gs=2 cs=0 l=1 c_cookie=6408654484492779376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7880aaab0 tx=0x7fa788003a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58f01d4c9467ff70 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa795d74640 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a7cff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa796575640 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a38140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa77cff9640 1 -- 10.20.193.28:0/293103231 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7880b3070 con 0x55c5f9a7d530 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa77cff9640 1 -- 10.20.193.28:0/293103231 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa7880ae240 con 0x55c5f9a7d530 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa77cff9640 1 -- 10.20.193.28:0/293103231 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7880a9ab0 con 0x55c5f9a7d530 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 -- 10.20.193.28:0/293103231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 msgr2=0x55c5f9a9d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9d910 secure :-1 s=READY pgs=329 gs=2 cs=0 l=1 c_cookie=6408654484492779376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7880aaab0 tx=0x7fa788003a00 comp rx=0 tx=0).stop 2026-02-20T13:24:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 -- 10.20.193.28:0/293103231 shutdown_connections 2026-02-20T13:24:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a7cff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9d910 unknown :-1 s=CLOSED pgs=329 gs=2 cs=0 l=1 c_cookie=6408654484492779376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/293103231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a38140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 -- 10.20.193.28:0/293103231 >> 10.20.193.28:0/293103231 conn(0x55c5f9a16270 msgr2=0x55c5f9a36650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 -- 10.20.193.28:0/293103231 shutdown_connections 2026-02-20T13:24:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.052+0000 7fa79ee40e00 1 -- 10.20.193.28:0/293103231 wait complete. 2026-02-20T13:24:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.053+0000 7fa79ee40e00 1 -- start start 2026-02-20T13:24:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa79ee40e00 1 Processor -- start 2026-02-20T13:24:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a951f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a95730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9a790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9a9acd0 con 0x55c5f9a38680 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9a9ae40 con 0x55c5f9a7d530 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9a9b000 con 0x55c5f9a37d70 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa796575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa795d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a95730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa796575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a951f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60824/0 (socket says 10.20.193.28:60824) 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa796575640 1 -- 10.20.193.28:0/3163868467 learned_addr learned my addr 10.20.193.28:0/3163868467 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa796d76640 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9a790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa796575640 1 -- 10.20.193.28:0/3163868467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 msgr2=0x55c5f9a9a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa796575640 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9a790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.054+0000 7fa796575640 1 -- 10.20.193.28:0/3163868467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 msgr2=0x55c5f9a95730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa796575640 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a95730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa796575640 1 -- 10.20.193.28:0/3163868467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5f98bf3c0 con 0x55c5f9a37d70 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa795d74640 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a95730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa796575640 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a951f0 secure :-1 s=READY pgs=277 gs=3 cs=0 l=1 c_cookie=11104789085619240736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78c01bc10 tx=0x7fa78c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1c22d671f83f20 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa747fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa747fff640 1 -- 10.20.193.28:0/3163868467 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa78c020070 con 0x55c5f9a37d70 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7980fbc00 con 0x55c5f9a37d70 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa747fff640 1 -- 10.20.193.28:0/3163868467 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa78c009e70 con 0x55c5f9a37d70 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa747fff640 1 -- 10.20.193.28:0/3163868467 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa78c0197c0 con 0x55c5f9a37d70 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa79ee40e00 10 client.27832 _ll_register_callbacks cb 0x55c5f98bca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c5f95d16f0 con 0x55c5f9a37d70 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa747fff640 1 -- 10.20.193.28:0/3163868467 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa78c019950 con 0x55c5f9a37d70 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa747fff640 1 -- 10.20.193.28:0/3163868467 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa78c019b70 con 0x55c5f9a37d70 2026-02-20T13:24:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa79ee40e00 10 client.27832 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.055+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c5f98d10e0 con 0x55c5f9a37d70 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.056+0000 7fa747fff640 1 -- 10.20.193.28:0/3163868467 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa78c02c060 con 0x55c5f9a37d70 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.056+0000 7fa79ee40e00 10 client.27832 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.056+0000 7fa79ee40e00 10 client.27832 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.056+0000 7fa79ee40e00 20 client.27832 populate_metadata read hostname 'trial028' 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.056+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c5f9a9d820 0x55c5f9a7b2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.056+0000 7fa79ee40e00 4 client.27832 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.056+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5f98ddf80 con 0x55c5f9a9d820 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.056+0000 7fa795d74640 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c5f9a9d820 0x55c5f9a7b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.057+0000 7fa795d74640 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c5f9a9d820 0x55c5f9a7b2b0 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=13974261942369976195 s_cookie=13347159241063670674 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1ee8d32a138ff83 server_cookie=b93aa29d0c2c2392 in_seq=0 out_seq=0 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.057+0000 7fa747fff640 10 client.27832 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:24:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.057+0000 7fa747fff640 1 -- 10.20.193.28:0/3163868467 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c5f98ddf80 con 0x55c5f9a9d820 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.057+0000 7fa747fff640 10 client.27832 handle_command_reply: tid=0 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.057+0000 7fa79ee40e00 1 client.27832 shutdown 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 msgr2=0x55c5f9a951f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a951f0 secure :-1 s=READY pgs=277 gs=3 cs=0 l=1 c_cookie=11104789085619240736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78c01bc10 tx=0x7fa78c0047e0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 shutdown_connections 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c5f9a9d820 0x55c5f9a7b2b0 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=13974261942369976195 s_cookie=13347159241063670674 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a38680 0x55c5f9a95730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a7d530 0x55c5f9a9a790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/3163868467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a37d70 0x55c5f9a951f0 unknown :-1 s=CLOSED pgs=277 gs=3 cs=0 l=1 c_cookie=11104789085619240736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 >> 10.20.193.28:0/3163868467 conn(0x55c5f9a16270 msgr2=0x55c5f9a36650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa747fff640 0 client.27832 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 shutdown_connections 2026-02-20T13:24:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 1 -- 10.20.193.28:0/3163868467 wait complete. 2026-02-20T13:24:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.058+0000 7fa79ee40e00 20 client.27832 trim_cache size 0 max 16384 2026-02-20T13:24:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.065+0000 7fa79ee40e00 1 Processor -- start 2026-02-20T13:24:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.065+0000 7fa79ee40e00 1 -- start start 2026-02-20T13:24:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.065+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a94670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.065+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a94f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.065+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a954d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.065+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9939080 con 0x55c5f9a37d70 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.065+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c5f95f9700 con 0x55c5f9a38680 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.065+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9a95d10 con 0x55c5f9a7d530 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a94670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a94670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36352/0 (socket says 10.20.193.28:36352) 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 -- 10.20.193.28:0/265052935 learned_addr learned my addr 10.20.193.28:0/265052935 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa795d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a94f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796d76640 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 -- 10.20.193.28:0/265052935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 msgr2=0x55c5f9a954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a954d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 -- 10.20.193.28:0/265052935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 msgr2=0x55c5f9a94f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a94f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 -- 10.20.193.28:0/265052935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5f98cbb60 con 0x55c5f9a37d70 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa795d74640 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a94f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796d76640 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a954d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa796575640 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a94670 secure :-1 s=READY pgs=890 gs=1 cs=0 l=1 c_cookie=2775139488380981927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78c023dd0 tx=0x7fa78c02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268346a94f1b92a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa7624e6640 1 -- 10.20.193.28:0/265052935 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa78c020070 con 0x55c5f9a37d70 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa7624e6640 1 -- 10.20.193.28:0/265052935 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa78c032020 con 0x55c5f9a37d70 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.066+0000 7fa7624e6640 1 -- 10.20.193.28:0/265052935 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa78c02c060 con 0x55c5f9a37d70 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 -- 10.20.193.28:0/265052935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 msgr2=0x55c5f9a94670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a94670 secure :-1 s=READY pgs=890 gs=1 cs=0 l=1 c_cookie=2775139488380981927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78c023dd0 tx=0x7fa78c02a000 comp rx=0 tx=0).stop 2026-02-20T13:24:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 -- 10.20.193.28:0/265052935 shutdown_connections 2026-02-20T13:24:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a954d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a94f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/265052935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a94670 unknown :-1 s=CLOSED pgs=890 gs=1 cs=0 l=1 c_cookie=2775139488380981927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 -- 10.20.193.28:0/265052935 >> 10.20.193.28:0/265052935 conn(0x55c5f9a16270 msgr2=0x55c5f9a7f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 -- 10.20.193.28:0/265052935 shutdown_connections 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.067+0000 7fa79ee40e00 1 -- 10.20.193.28:0/265052935 wait complete. 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa79ee40e00 1 -- start start 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa79ee40e00 1 Processor -- start 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a99f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a16640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa79ee40e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a16b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9ae45b0 con 0x55c5f9a37d70 2026-02-20T13:24:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9a170c0 con 0x55c5f9a38680 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa79ee40e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c5f9a17280 con 0x55c5f9a7d530 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa796575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a99f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa796d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a16b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa796575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a99f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36358/0 (socket says 10.20.193.28:36358) 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa796575640 1 -- 10.20.193.28:0/1130746814 learned_addr learned my addr 10.20.193.28:0/1130746814 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.068+0000 7fa795d74640 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a16640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa796575640 1 -- 10.20.193.28:0/1130746814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 msgr2=0x55c5f9a16b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa796575640 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a16b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa796575640 1 -- 10.20.193.28:0/1130746814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 msgr2=0x55c5f9a16640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa796575640 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a16640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa796575640 1 -- 10.20.193.28:0/1130746814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5f98bf6f0 con 0x55c5f9a37d70 2026-02-20T13:24:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa796575640 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a99f90 secure :-1 s=READY pgs=891 gs=1 cs=0 l=1 c_cookie=18443142060462266063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78c011cb0 tx=0x7fa78c01bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff333fcefeb56cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa747fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa747fff640 1 -- 10.20.193.28:0/1130746814 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa78c020040 con 0x55c5f9a37d70 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa747fff640 1 -- 10.20.193.28:0/1130746814 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c5f95d16f0 con 0x55c5f9a37d70 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa747fff640 1 -- 10.20.193.28:0/1130746814 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa78c0052a0 con 0x55c5f9a37d70 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5f98d10e0 con 0x55c5f9a37d70 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa79ee40e00 10 client.17976 _ll_register_callbacks cb 0x55c5f98bca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7880ae240 con 0x55c5f9a37d70 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa747fff640 1 -- 10.20.193.28:0/1130746814 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa78c033060 con 0x55c5f9a37d70 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.069+0000 7fa747fff640 1 -- 10.20.193.28:0/1130746814 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa78c02c1f0 con 0x55c5f9a37d70 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa79ee40e00 10 client.17976 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c5f98d1340 con 0x55c5f9a37d70 2026-02-20T13:24:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa747fff640 1 -- 10.20.193.28:0/1130746814 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa78c005430 con 0x55c5f9a37d70 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa79ee40e00 10 client.17976 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa79ee40e00 10 client.17976 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa79ee40e00 20 client.17976 populate_metadata read hostname 'trial028' 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c5f9b2af20 0x55c5f9b4b380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa79ee40e00 4 client.17976 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c5f95cef40 con 0x55c5f9b2af20 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.070+0000 7fa795d74640 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c5f9b2af20 0x55c5f9b4b380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa795d74640 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c5f9b2af20 0x55c5f9b4b380 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=3388942287733427094 s_cookie=1514560119738491809 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f07f10e28a68b96 server_cookie=1504cc6787fc63a1 in_seq=0 out_seq=0 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa747fff640 10 client.17976 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa747fff640 1 -- 10.20.193.28:0/1130746814 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c5f95cef40 con 0x55c5f9b2af20 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa747fff640 10 client.17976 handle_command_reply: tid=0 2026-02-20T13:24:21.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 client.17976 shutdown 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 msgr2=0x55c5f9a99f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a99f90 secure :-1 s=READY pgs=891 gs=1 cs=0 l=1 c_cookie=18443142060462266063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78c011cb0 tx=0x7fa78c01bba0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 shutdown_connections 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55c5f9b2af20 0x55c5f9b4b380 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=3388942287733427094 s_cookie=1514560119738491809 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c5f9a7d530 0x55c5f9a16b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c5f9a38680 0x55c5f9a16640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 --2- 10.20.193.28:0/1130746814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5f9a37d70 0x55c5f9a99f90 unknown :-1 s=CLOSED pgs=891 gs=1 cs=0 l=1 c_cookie=18443142060462266063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 >> 10.20.193.28:0/1130746814 conn(0x55c5f9a16270 msgr2=0x55c5f9a94f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa747fff640 0 client.17976 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 shutdown_connections 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 1 -- 10.20.193.28:0/1130746814 wait complete. 2026-02-20T13:24:21.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.071+0000 7fa79ee40e00 20 client.17976 trim_cache size 0 max 16384 2026-02-20T13:24:21.081 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 -- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7700b5750 msgr2=0x7fa7700d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7700b5750 0x7fa7700d5c00 secure :-1 s=READY pgs=422 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78c004740 tx=0x7fa78c005f90 comp rx=0 tx=0).stop 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 -- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7981156a0 msgr2=0x7fa7980f5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7981156a0 0x7fa7980f5ec0 secure :-1 s=READY pgs=889 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa78800e720 tx=0x7fa78800ebf0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 -- 10.20.193.28:0/2675232782 shutdown_connections 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7700b5750 0x7fa7700d5c00 unknown :-1 s=CLOSED pgs=422 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7981156a0 0x7fa7980f5ec0 unknown :-1 s=CLOSED pgs=889 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa79810fea0 0x7fa798175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 --2- 10.20.193.28:0/2675232782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa79810f4b0 0x7fa7980f57c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 -- 10.20.193.28:0/2675232782 >> 10.20.193.28:0/2675232782 conn(0x7fa7980ecda0 msgr2=0x7fa79810d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 -- 10.20.193.28:0/2675232782 shutdown_connections 2026-02-20T13:24:21.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.072+0000 7fa797577640 1 -- 10.20.193.28:0/2675232782 wait complete. 2026-02-20T13:24:21.209 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:24:21.396 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:21.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.565+0000 7f33a2ffd640 1 -- 10.20.193.28:0/3668380591 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33900386f0 con 0x7f33a410f5f0 2026-02-20T13:24:21.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.565+0000 7f33aaa50640 1 -- 10.20.193.28:0/3668380591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f33a410f5f0 msgr2=0x7f33a410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.565+0000 7f33aaa50640 1 --2- 10.20.193.28:0/3668380591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f33a410f5f0 0x7f33a410f9c0 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=3108749066648994073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3390009950 tx=0x7f339002f190 comp rx=0 tx=0).stop 2026-02-20T13:24:21.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.566+0000 7f33aaa50640 1 -- 10.20.193.28:0/3668380591 shutdown_connections 2026-02-20T13:24:21.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.566+0000 7f33aaa50640 1 --2- 10.20.193.28:0/3668380591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33a41157e0 0x7f33a41761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.566+0000 7f33aaa50640 1 --2- 10.20.193.28:0/3668380591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f33a410ffe0 0x7f33a4115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.566+0000 7f33aaa50640 1 --2- 10.20.193.28:0/3668380591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f33a410f5f0 0x7f33a410f9c0 unknown :-1 s=CLOSED pgs=330 gs=1 cs=0 l=1 c_cookie=3108749066648994073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.566+0000 7f33aaa50640 1 -- 10.20.193.28:0/3668380591 >> 10.20.193.28:0/3668380591 conn(0x7f33a40ecea0 msgr2=0x7f33a410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.566+0000 7f33aaa50640 1 -- 10.20.193.28:0/3668380591 shutdown_connections 2026-02-20T13:24:21.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.566+0000 7f33aaa50640 1 -- 10.20.193.28:0/3668380591 wait complete. 2026-02-20T13:24:21.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33aaa50640 1 Processor -- start 2026-02-20T13:24:21.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33aaa50640 1 -- start start 2026-02-20T13:24:21.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33aaa50640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f33a410f5f0 0x7f33a411d520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33aaa50640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f33a410ffe0 0x7f33a411da60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33aaa50640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33a41157e0 0x7f33a4122e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33aaa50640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4123450 con 0x7f33a41157e0 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33aaa50640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f33a41235c0 con 0x7f33a410f5f0 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33aaa50640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4123780 con 0x7f33a410ffe0 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33a8fc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33a41157e0 0x7f33a4122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33a3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f33a410f5f0 0x7f33a411d520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33a8fc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33a41157e0 0x7f33a4122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36370/0 (socket says 10.20.193.28:36370) 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33a8fc6640 1 -- 10.20.193.28:0/755310446 learned_addr learned my addr 10.20.193.28:0/755310446 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.567+0000 7f33a37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f33a410ffe0 0x7f33a411da60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a8fc6640 1 -- 10.20.193.28:0/755310446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f33a410ffe0 msgr2=0x7f33a411da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a8fc6640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f33a410ffe0 0x7f33a411da60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a8fc6640 1 -- 10.20.193.28:0/755310446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f33a410f5f0 msgr2=0x7f33a411d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a8fc6640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f33a410f5f0 0x7f33a411d520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a8fc6640 1 -- 10.20.193.28:0/755310446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339800a590 con 0x7f33a41157e0 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a8fc6640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33a41157e0 0x7f33a4122e30 secure :-1 s=READY pgs=892 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3398005790 tx=0x7f3398003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a17fa640 1 -- 10.20.193.28:0/755310446 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f339800fd60 con 0x7f33a41157e0 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a17fa640 1 -- 10.20.193.28:0/755310446 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3398003e80 con 0x7f33a41157e0 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33aaa50640 1 -- 10.20.193.28:0/755310446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3390009570 con 0x7f33a41157e0 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33a17fa640 1 -- 10.20.193.28:0/755310446 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3398019a80 con 0x7f33a41157e0 2026-02-20T13:24:21.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.568+0000 7f33aaa50640 1 -- 10.20.193.28:0/755310446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a4163fc0 con 0x7f33a41157e0 2026-02-20T13:24:21.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.571+0000 7f33a17fa640 1 -- 10.20.193.28:0/755310446 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3398017020 con 0x7f33a41157e0 2026-02-20T13:24:21.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.573+0000 7f33a17fa640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f33780b5760 0x7f33780d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.573+0000 7f33a17fa640 1 -- 10.20.193.28:0/755310446 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f33980e7c20 con 0x7f33a41157e0 2026-02-20T13:24:21.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.573+0000 7f33a3fff640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f33780b5760 0x7f33780d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.573+0000 7f33a3fff640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f33780b5760 0x7f33780d5c10 secure :-1 s=READY pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3390005b30 tx=0x7f339003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.574+0000 7f33aca4ae00 1 Processor -- start 2026-02-20T13:24:21.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.574+0000 7f33aca4ae00 1 -- start start 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f74257730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f7429c5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f7429cb20 0x561f742bcf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561f7416d780 con 0x561f74257c70 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561f741694b0 con 0x561f74257360 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561f74163450 con 0x561f7429cb20 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f74257730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f74257730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51764/0 (socket says 10.20.193.28:51764) 2026-02-20T13:24:21.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 -- 10.20.193.28:0/2597454490 learned_addr learned my addr 10.20.193.28:0/2597454490 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a37fe640 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f7429c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a8fc6640 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f7429cb20 0x561f742bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 -- 10.20.193.28:0/2597454490 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f7429cb20 msgr2=0x561f742bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f7429cb20 0x561f742bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 -- 10.20.193.28:0/2597454490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 msgr2=0x561f7429c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f7429c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 -- 10.20.193.28:0/2597454490 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7410ed10 con 0x561f74257360 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a37fe640 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f7429c5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:21.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.575+0000 7f33a3fff640 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f74257730 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=14096457670966277740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3390005ce0 tx=0x7f3390040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3a0ad90c546766c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f3374ce3640 1 -- 10.20.193.28:0/2597454490 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3390002980 con 0x561f74257360 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f3374ce3640 1 -- 10.20.193.28:0/2597454490 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f339003e040 con 0x561f74257360 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f3374ce3640 1 -- 10.20.193.28:0/2597454490 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f339004f7e0 con 0x561f74257360 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2597454490 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 msgr2=0x561f74257730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f74257730 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=14096457670966277740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3390005ce0 tx=0x7f3390040000 comp rx=0 tx=0).stop 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2597454490 shutdown_connections 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f7429c5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f7429cb20 0x561f742bcf00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2597454490 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f74257730 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=14096457670966277740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2597454490 >> 10.20.193.28:0/2597454490 conn(0x561f74235860 msgr2=0x561f74255c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2597454490 shutdown_connections 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.576+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2597454490 wait complete. 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.577+0000 7f33aca4ae00 1 -- start start 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.577+0000 7f33aca4ae00 1 Processor -- start 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7425c7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257c70 0x561f7425ccf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f7425b5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561f7425baf0 con 0x561f7429cb20 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561f7425bc60 con 0x561f74257c70 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561f7425be20 con 0x561f74257360 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7425c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7425c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60872/0 (socket says 10.20.193.28:60872) 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 -- 10.20.193.28:0/627441185 learned_addr learned my addr 10.20.193.28:0/627441185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a37fe640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257c70 0x561f7425ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 -- 10.20.193.28:0/627441185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257c70 msgr2=0x561f7425ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257c70 0x561f7425ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 -- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 msgr2=0x561f7425b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a8fc6640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f7425b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f7425b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 -- 10.20.193.28:0/627441185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a4176a20 con 0x561f74257360 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a37fe640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257c70 0x561f7425ccf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a8fc6640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f7425b5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.578+0000 7f33a3fff640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7425c7b0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=4589040110749066510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3390005e90 tx=0x7f3390002390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3faf8baabd37a50e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f3365ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:21.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f3365ffb640 1 -- 10.20.193.28:0/627441185 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3390038c60 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f3365ffb640 1 -- 10.20.193.28:0/627441185 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f339002f9f0 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f3365ffb640 1 -- 10.20.193.28:0/627441185 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33900596a0 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3394009850 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f3365ffb640 1 -- 10.20.193.28:0/627441185 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3390059870 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f33aca4ae00 10 client.27850 _ll_register_callbacks cb 0x561f740e4a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f73df96f0 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f3365ffb640 1 -- 10.20.193.28:0/627441185 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f339002fb60 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f33aca4ae00 10 client.27850 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561f740e73c0 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.579+0000 7f3365ffb640 1 -- 10.20.193.28:0/627441185 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3390059a30 con 0x561f74257360 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f33aca4ae00 10 client.27850 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:21.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f33aca4ae00 10 client.27850 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:24:21.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f33aca4ae00 20 client.27850 populate_metadata read hostname 'trial028' 2026-02-20T13:24:21.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561f742827e0 0x561f74282c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f33aca4ae00 4 client.27850 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:21.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f74105f80 con 0x561f742827e0 2026-02-20T13:24:21.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f33a37fe640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561f742827e0 0x561f74282c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f33a37fe640 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561f742827e0 0x561f74282c80 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=3257358402273688994 s_cookie=3898137627720767036 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d34763569a83da2 server_cookie=3618f784e9e1563c in_seq=0 out_seq=0 2026-02-20T13:24:21.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.580+0000 7f3365ffb640 10 client.27850 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:24:21.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f3365ffb640 1 -- 10.20.193.28:0/627441185 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561f74105f80 con 0x561f742827e0 2026-02-20T13:24:21.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f3365ffb640 10 client.27850 handle_command_reply: tid=0 2026-02-20T13:24:21.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 client.27850 shutdown 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 msgr2=0x561f7425c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7425c7b0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=4589040110749066510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3390005e90 tx=0x7f3390002390 comp rx=0 tx=0).stop 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 shutdown_connections 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561f742827e0 0x561f74282c80 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=3257358402273688994 s_cookie=3898137627720767036 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f7425b5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257c70 0x561f7425ccf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/627441185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7425c7b0 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=4589040110749066510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f3365ffb640 0 client.27850 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 >> 10.20.193.28:0/627441185 conn(0x561f74235860 msgr2=0x561f74255c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 shutdown_connections 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 1 -- 10.20.193.28:0/627441185 wait complete. 2026-02-20T13:24:21.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.581+0000 7f33aca4ae00 20 client.27850 trim_cache size 0 max 16384 2026-02-20T13:24:21.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33aca4ae00 1 Processor -- start 2026-02-20T13:24:21.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33aca4ae00 1 -- start start 2026-02-20T13:24:21.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f7425b5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257c70 0x561f742bc5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f742bcb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561f74161080 con 0x561f7429cb20 2026-02-20T13:24:21.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561f73e21700 con 0x561f74257360 2026-02-20T13:24:21.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561f74258040 con 0x561f74257c70 2026-02-20T13:24:21.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33a3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f7425b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33a3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f7425b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51788/0 (socket says 10.20.193.28:51788) 2026-02-20T13:24:21.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33a3fff640 1 -- 10.20.193.28:0/465416655 learned_addr learned my addr 10.20.193.28:0/465416655 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33a8fc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f742bcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.588+0000 7f33a37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257c70 0x561f742bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33a3fff640 1 -- 10.20.193.28:0/465416655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257c70 msgr2=0x561f742bc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33a3fff640 1 --2- 10.20.193.28:0/465416655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257c70 0x561f742bc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33a3fff640 1 -- 10.20.193.28:0/465416655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 msgr2=0x561f742bcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33a3fff640 1 --2- 10.20.193.28:0/465416655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f742bcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33a3fff640 1 -- 10.20.193.28:0/465416655 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f742af400 con 0x561f74257360 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33a8fc6640 1 --2- 10.20.193.28:0/465416655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f742bcb20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33a3fff640 1 --2- 10.20.193.28:0/465416655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f7425b5a0 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=11677664499210839859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f339002f6a0 tx=0x7f3390063000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20f65fdb9a6e733 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f3367fff640 1 -- 10.20.193.28:0/465416655 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3390038c30 con 0x561f74257360 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f3367fff640 1 -- 10.20.193.28:0/465416655 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f339006b060 con 0x561f74257360 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f3367fff640 1 -- 10.20.193.28:0/465416655 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3390042c50 con 0x561f74257360 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 -- 10.20.193.28:0/465416655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 msgr2=0x561f7425b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/465416655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f7425b5a0 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=11677664499210839859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f339002f6a0 tx=0x7f3390063000 comp rx=0 tx=0).stop 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 -- 10.20.193.28:0/465416655 shutdown_connections 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/465416655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f7429cb20 0x561f742bcb20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/465416655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257c70 0x561f742bc5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/465416655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f74257360 0x561f7425b5a0 unknown :-1 s=CLOSED pgs=332 gs=1 cs=0 l=1 c_cookie=11677664499210839859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 -- 10.20.193.28:0/465416655 >> 10.20.193.28:0/465416655 conn(0x561f74235860 msgr2=0x561f7429bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 -- 10.20.193.28:0/465416655 shutdown_connections 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.589+0000 7f33aca4ae00 1 -- 10.20.193.28:0/465416655 wait complete. 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33aca4ae00 1 -- start start 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33aca4ae00 1 Processor -- start 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7428fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f742902f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33aca4ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f7429cb20 0x561f74292c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561f742354d0 con 0x561f74257c70 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561f74293250 con 0x561f7429cb20 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33aca4ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561f74293410 con 0x561f74257360 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a8fc6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f7429cb20 0x561f74292c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.590+0000 7f33a37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f742902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a8fc6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f7429cb20 0x561f74292c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51800/0 (socket says 10.20.193.28:51800) 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a8fc6640 1 -- 10.20.193.28:0/2195968868 learned_addr learned my addr 10.20.193.28:0/2195968868 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a3fff640 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7428fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a3fff640 1 -- 10.20.193.28:0/2195968868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f7429cb20 msgr2=0x561f74292c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a3fff640 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f7429cb20 0x561f74292c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a3fff640 1 -- 10.20.193.28:0/2195968868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 msgr2=0x561f742902f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a3fff640 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f742902f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a3fff640 1 -- 10.20.193.28:0/2195968868 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f740e73c0 con 0x561f74257360 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a8fc6640 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f7429cb20 0x561f74292c60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a37fe640 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f742902f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:21.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f33a3fff640 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7428fd70 secure :-1 s=READY pgs=279 gs=3 cs=0 l=1 c_cookie=7667945926246023221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33900098a0 tx=0x7f3390005f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a6a043182cc4035 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.591+0000 7f3365ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f3365ffb640 1 -- 10.20.193.28:0/2195968868 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3390038c30 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f3365ffb640 1 -- 10.20.193.28:0/2195968868 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x561f73df96f0 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f3365ffb640 1 -- 10.20.193.28:0/2195968868 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33900649f0 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a4163fc0 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f3365ffb640 1 -- 10.20.193.28:0/2195968868 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3390064b80 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f33aca4ae00 10 client.27856 _ll_register_callbacks cb 0x561f740e4a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f339003e040 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f3365ffb640 1 -- 10.20.193.28:0/2195968868 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3390042de0 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f33aca4ae00 10 client.27856 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.592+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561f740f90e0 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f3365ffb640 1 -- 10.20.193.28:0/2195968868 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3390064d80 con 0x561f74257360 2026-02-20T13:24:21.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33aca4ae00 10 client.27856 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:21.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33aca4ae00 10 client.27856 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:24:21.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33aca4ae00 20 client.27856 populate_metadata read hostname 'trial028' 2026-02-20T13:24:21.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561f743528f0 0x561f74372d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:21.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33aca4ae00 4 client.27856 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:21.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f73df6f40 con 0x561f743528f0 2026-02-20T13:24:21.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33a37fe640 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561f743528f0 0x561f74372d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:21.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33a37fe640 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561f743528f0 0x561f74372d70 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=11087742937844934707 s_cookie=18096082268093719894 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99df9374e317e833 server_cookie=fb2232f217f8a556 in_seq=0 out_seq=0 2026-02-20T13:24:21.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f3365ffb640 10 client.27856 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f3365ffb640 1 -- 10.20.193.28:0/2195968868 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f73df6f40 con 0x561f743528f0 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f3365ffb640 10 client.27856 handle_command_reply: tid=0 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.593+0000 7f33aca4ae00 1 client.27856 shutdown 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 msgr2=0x561f7428fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7428fd70 secure :-1 s=READY pgs=279 gs=3 cs=0 l=1 c_cookie=7667945926246023221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33900098a0 tx=0x7f3390005f40 comp rx=0 tx=0).stop 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 shutdown_connections 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561f743528f0 0x561f74372d70 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=11087742937844934707 s_cookie=18096082268093719894 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f74257c70 0x561f742902f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f7429cb20 0x561f74292c60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 --2- 10.20.193.28:0/2195968868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f74257360 0x561f7428fd70 unknown :-1 s=CLOSED pgs=279 gs=3 cs=0 l=1 c_cookie=7667945926246023221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f3365ffb640 0 client.27856 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:24:21.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 >> 10.20.193.28:0/2195968868 conn(0x561f74235860 msgr2=0x561f7425a590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 shutdown_connections 2026-02-20T13:24:21.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 1 -- 10.20.193.28:0/2195968868 wait complete. 2026-02-20T13:24:21.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aca4ae00 20 client.27856 trim_cache size 0 max 16384 2026-02-20T13:24:21.603 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:21.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 -- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f33780b5760 msgr2=0x7f33780d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f33780b5760 0x7f33780d5c10 secure :-1 s=READY pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3390005b30 tx=0x7f339003a040 comp rx=0 tx=0).stop 2026-02-20T13:24:21.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 -- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33a41157e0 msgr2=0x7f33a4122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:21.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33a41157e0 0x7f33a4122e30 secure :-1 s=READY pgs=892 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3398005790 tx=0x7f3398003c20 comp rx=0 tx=0).stop 2026-02-20T13:24:21.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 -- 10.20.193.28:0/755310446 shutdown_connections 2026-02-20T13:24:21.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f33780b5760 0x7f33780d5c10 unknown :-1 s=CLOSED pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33a41157e0 0x7f33a4122e30 unknown :-1 s=CLOSED pgs=892 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f33a410ffe0 0x7f33a411da60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 --2- 10.20.193.28:0/755310446 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f33a410f5f0 0x7f33a411d520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:21.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 -- 10.20.193.28:0/755310446 >> 10.20.193.28:0/755310446 conn(0x7f33a40ecea0 msgr2=0x7f33a410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:21.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.594+0000 7f33aaa50640 1 -- 10.20.193.28:0/755310446 shutdown_connections 2026-02-20T13:24:21.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:21.595+0000 7f33aaa50640 1 -- 10.20.193.28:0/755310446 wait complete. 2026-02-20T13:24:21.731 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:24:21.918 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 -- 10.20.193.28:0/6568920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 msgr2=0x7f3e28114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/6568920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 0x7f3e28114ef0 secure :-1 s=READY pgs=893 gs=1 cs=0 l=1 c_cookie=7196844321549122780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e1c009890 tx=0x7f3e1c02f120 comp rx=0 tx=0).stop 2026-02-20T13:24:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 -- 10.20.193.28:0/6568920 shutdown_connections 2026-02-20T13:24:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/6568920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 0x7f3e28114ef0 unknown :-1 s=CLOSED pgs=893 gs=1 cs=0 l=1 c_cookie=7196844321549122780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/6568920 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e281156a0 0x7f3e28176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/6568920 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e2810f4b0 0x7f3e2810f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 -- 10.20.193.28:0/6568920 >> 10.20.193.28:0/6568920 conn(0x7f3e280ecda0 msgr2=0x7f3e2810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 -- 10.20.193.28:0/6568920 shutdown_connections 2026-02-20T13:24:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.113+0000 7f3e2f28d640 1 -- 10.20.193.28:0/6568920 wait complete. 2026-02-20T13:24:22.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2f28d640 1 Processor -- start 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2f28d640 1 -- start start 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2f28d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e2810f4b0 0x7f3e280f57c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2f28d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 0x7f3e28175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2f28d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e281156a0 0x7f3e280f5ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2f28d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e280fb0d0 con 0x7f3e2810fea0 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2f28d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3e280fb240 con 0x7f3e2810f4b0 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2f28d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3e280fb400 con 0x7f3e281156a0 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2da8a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 0x7f3e28175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.114+0000 7f3e2ea8c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e281156a0 0x7f3e280f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2da8a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 0x7f3e28175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36416/0 (socket says 10.20.193.28:36416) 2026-02-20T13:24:22.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2da8a640 1 -- 10.20.193.28:0/2485643779 learned_addr learned my addr 10.20.193.28:0/2485643779 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2e28b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e2810f4b0 0x7f3e280f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2da8a640 1 -- 10.20.193.28:0/2485643779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e281156a0 msgr2=0x7f3e280f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e281156a0 0x7f3e280f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2da8a640 1 -- 10.20.193.28:0/2485643779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e2810f4b0 msgr2=0x7f3e280f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e2810f4b0 0x7f3e280f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2da8a640 1 -- 10.20.193.28:0/2485643779 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c0094b0 con 0x7f3e2810fea0 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 0x7f3e28175f70 secure :-1 s=READY pgs=894 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e1c0023b0 tx=0x7f3e1c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e0f7fe640 1 -- 10.20.193.28:0/2485643779 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1c03d070 con 0x7f3e2810fea0 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e0f7fe640 1 -- 10.20.193.28:0/2485643779 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e1c02fcb0 con 0x7f3e2810fea0 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e0f7fe640 1 -- 10.20.193.28:0/2485643779 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1c041ae0 con 0x7f3e2810fea0 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2f28d640 1 -- 10.20.193.28:0/2485643779 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e280fb680 con 0x7f3e2810fea0 2026-02-20T13:24:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.115+0000 7f3e2f28d640 1 -- 10.20.193.28:0/2485643779 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e280fbaa0 con 0x7f3e2810fea0 2026-02-20T13:24:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.118+0000 7f3e0f7fe640 1 -- 10.20.193.28:0/2485643779 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3e1c0386b0 con 0x7f3e2810fea0 2026-02-20T13:24:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.120+0000 7f3e0f7fe640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e040b5750 0x7f3e040d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.120+0000 7f3e0f7fe640 1 -- 10.20.193.28:0/2485643779 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3e1c10b7b0 con 0x7f3e2810fea0 2026-02-20T13:24:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.120+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e040b5750 0x7f3e040d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.120+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e040b5750 0x7f3e040d5c00 secure :-1 s=READY pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e18004740 tx=0x7f3e1800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e32510e00 1 Processor -- start 2026-02-20T13:24:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e32510e00 1 -- start start 2026-02-20T13:24:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b58bf730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b59045e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b5924f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e32510e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635b57d5780 con 0x5635b5904b20 2026-02-20T13:24:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e32510e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5635b57d14b0 con 0x5635b58bfc70 2026-02-20T13:24:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e32510e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5635b57cb450 con 0x5635b58bf360 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e2da8a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b59045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e2ea8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b5924f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e2da8a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b59045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51842/0 (socket says 10.20.193.28:51842) 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.121+0000 7f3e2da8a640 1 -- 10.20.193.28:0/1803821165 learned_addr learned my addr 10.20.193.28:0/1803821165 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b58bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2da8a640 1 -- 10.20.193.28:0/1803821165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 msgr2=0x5635b58bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b58bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2da8a640 1 -- 10.20.193.28:0/1803821165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 msgr2=0x5635b5924f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b5924f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2da8a640 1 -- 10.20.193.28:0/1803821165 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b5776d10 con 0x5635b58bfc70 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2ea8c640 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b5924f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b58bf730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b59045e0 secure :-1 s=READY pgs=333 gs=3 cs=0 l=1 c_cookie=10084240494109247066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e1c0ce190 tx=0x7f3e1c02f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bf26b4d00fdc65a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e0cb0a640 1 -- 10.20.193.28:0/1803821165 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1c0cda60 con 0x5635b58bfc70 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e0cb0a640 1 -- 10.20.193.28:0/1803821165 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e1c0d1c70 con 0x5635b58bfc70 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.122+0000 7f3e0cb0a640 1 -- 10.20.193.28:0/1803821165 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1c0dca40 con 0x5635b58bfc70 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 -- 10.20.193.28:0/1803821165 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 msgr2=0x5635b59045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b59045e0 secure :-1 s=READY pgs=333 gs=3 cs=0 l=1 c_cookie=10084240494109247066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e1c0ce190 tx=0x7f3e1c02f120 comp rx=0 tx=0).stop 2026-02-20T13:24:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 -- 10.20.193.28:0/1803821165 shutdown_connections 2026-02-20T13:24:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b5924f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b59045e0 unknown :-1 s=CLOSED pgs=333 gs=3 cs=0 l=1 c_cookie=10084240494109247066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 --2- 10.20.193.28:0/1803821165 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b58bf730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 -- 10.20.193.28:0/1803821165 >> 10.20.193.28:0/1803821165 conn(0x5635b589d860 msgr2=0x5635b58bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 -- 10.20.193.28:0/1803821165 shutdown_connections 2026-02-20T13:24:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.123+0000 7f3e32510e00 1 -- 10.20.193.28:0/1803821165 wait complete. 2026-02-20T13:24:22.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.124+0000 7f3e32510e00 1 -- start start 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e32510e00 1 Processor -- start 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591c710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bfc70 0x5635b591cc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b5904b20 0x5635b5921c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e32510e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635b5922180 con 0x5635b58bfc70 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e32510e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5635b59222f0 con 0x5635b5904b20 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e32510e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5635b59224b0 con 0x5635b58bf360 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2e28b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591c710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2e28b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591c710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60932/0 (socket says 10.20.193.28:60932) 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2e28b640 1 -- 10.20.193.28:0/2733334248 learned_addr learned my addr 10.20.193.28:0/2733334248 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2ea8c640 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b5904b20 0x5635b5921c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bfc70 0x5635b591cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2e28b640 1 -- 10.20.193.28:0/2733334248 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b5904b20 msgr2=0x5635b5921c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b5904b20 0x5635b5921c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2e28b640 1 -- 10.20.193.28:0/2733334248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bfc70 msgr2=0x5635b591cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.125+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bfc70 0x5635b591cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3e2e28b640 1 -- 10.20.193.28:0/2733334248 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e280fbaa0 con 0x5635b58bf360 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591c710 secure :-1 s=READY pgs=280 gs=2 cs=0 l=1 c_cookie=11610571074568839991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e180116c0 tx=0x7f3e180047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a12108e07b19e337 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3ddbfff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3ddbfff640 1 -- 10.20.193.28:0/2733334248 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1801e940 con 0x5635b58bf360 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3ddbfff640 1 -- 10.20.193.28:0/2733334248 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e1802b070 con 0x5635b58bf360 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e240051a0 con 0x5635b58bf360 2026-02-20T13:24:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3ddbfff640 1 -- 10.20.193.28:0/2733334248 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1801c3d0 con 0x5635b58bf360 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3ddbfff640 1 -- 10.20.193.28:0/2733334248 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3e18027e40 con 0x5635b58bf360 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3ddbfff640 10 client.27868 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3e32510e00 10 client.27868 _ll_register_callbacks cb 0x5635b574ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.126+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635b54616f0 con 0x5635b58bf360 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3ddbfff640 1 -- 10.20.193.28:0/2733334248 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3e1801eaa0 con 0x5635b58bf360 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e32510e00 10 client.27868 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5635b574f3c0 con 0x5635b58bf360 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3ddbfff640 1 -- 10.20.193.28:0/2733334248 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3e18037060 con 0x5635b58bf360 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e32510e00 10 client.27868 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e32510e00 10 client.27868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e32510e00 20 client.27868 populate_metadata read hostname 'trial028' 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e32510e00 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5635b5924c90 0x5635b59028a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e32510e00 4 client.27868 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635b576df80 con 0x5635b5924c90 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.127+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5635b5924c90 0x5635b59028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5635b5924c90 0x5635b59028a0 crc :-1 s=READY pgs=216 gs=4 cs=0 l=0 c_cookie=15188581941474039962 s_cookie=12787878304210570367 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c8aecd9f79189a server_cookie=b177ab9089654c7f in_seq=0 out_seq=0 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3ddbfff640 10 client.27868 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3ddbfff640 1 -- 10.20.193.28:0/2733334248 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5635b576df80 con 0x5635b5924c90 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3ddbfff640 10 client.27868 handle_command_reply: tid=0 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 client.27868 shutdown 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 msgr2=0x5635b591c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591c710 secure :-1 s=READY pgs=280 gs=2 cs=0 l=1 c_cookie=11610571074568839991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e180116c0 tx=0x7f3e180047e0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 shutdown_connections 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5635b5924c90 0x5635b59028a0 crc :-1 s=READY pgs=216 gs=4 cs=0 l=0 c_cookie=15188581941474039962 s_cookie=12787878304210570367 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bfc70 0x5635b591cc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b5904b20 0x5635b5921c40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 --2- 10.20.193.28:0/2733334248 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591c710 unknown :-1 s=CLOSED pgs=280 gs=2 cs=0 l=1 c_cookie=11610571074568839991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3ddbfff640 0 client.27868 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:22.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 >> 10.20.193.28:0/2733334248 conn(0x5635b589d860 msgr2=0x5635b58bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:22.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 shutdown_connections 2026-02-20T13:24:22.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.128+0000 7f3e32510e00 1 -- 10.20.193.28:0/2733334248 wait complete. 2026-02-20T13:24:22.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.129+0000 7f3e32510e00 20 client.27868 trim_cache size 0 max 16384 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e32510e00 1 Processor -- start 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e32510e00 1 -- start start 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bf360 0x5635b59211b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b58ff780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b5904b20 0x5635b58ffcc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e32510e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635b57c9080 con 0x5635b58bf360 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e32510e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5635b5489700 con 0x5635b58bfc70 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e32510e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5635b5911080 con 0x5635b5904b20 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e2e28b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bf360 0x5635b59211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e2e28b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bf360 0x5635b59211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36440/0 (socket says 10.20.193.28:36440) 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e2e28b640 1 -- 10.20.193.28:0/79615166 learned_addr learned my addr 10.20.193.28:0/79615166 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b58ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.136+0000 7f3e2ea8c640 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b5904b20 0x5635b58ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e2e28b640 1 -- 10.20.193.28:0/79615166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b5904b20 msgr2=0x5635b58ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b5904b20 0x5635b58ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e2e28b640 1 -- 10.20.193.28:0/79615166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 msgr2=0x5635b58ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b58ff780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e2e28b640 1 -- 10.20.193.28:0/79615166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b590ea30 con 0x5635b58bf360 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b58ff780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e2ea8c640 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b5904b20 0x5635b58ffcc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:22.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bf360 0x5635b59211b0 secure :-1 s=READY pgs=895 gs=2 cs=0 l=1 c_cookie=864960534400283571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e18011010 tx=0x7f3e18029030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00f505f5a933b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:22.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3df64e6640 1 -- 10.20.193.28:0/79615166 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1802eb00 con 0x5635b58bf360 2026-02-20T13:24:22.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3df64e6640 1 -- 10.20.193.28:0/79615166 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e1802b040 con 0x5635b58bf360 2026-02-20T13:24:22.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3df64e6640 1 -- 10.20.193.28:0/79615166 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1800b660 con 0x5635b58bf360 2026-02-20T13:24:22.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e32510e00 1 -- 10.20.193.28:0/79615166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bf360 msgr2=0x5635b59211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e32510e00 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bf360 0x5635b59211b0 secure :-1 s=READY pgs=895 gs=2 cs=0 l=1 c_cookie=864960534400283571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e18011010 tx=0x7f3e18029030 comp rx=0 tx=0).stop 2026-02-20T13:24:22.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e32510e00 1 -- 10.20.193.28:0/79615166 shutdown_connections 2026-02-20T13:24:22.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e32510e00 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b5904b20 0x5635b58ffcc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e32510e00 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b58ff780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e32510e00 1 --2- 10.20.193.28:0/79615166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b58bf360 0x5635b59211b0 unknown :-1 s=CLOSED pgs=895 gs=2 cs=0 l=1 c_cookie=864960534400283571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e32510e00 1 -- 10.20.193.28:0/79615166 >> 10.20.193.28:0/79615166 conn(0x5635b589d860 msgr2=0x5635b5920aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.137+0000 7f3e32510e00 1 -- 10.20.193.28:0/79615166 shutdown_connections 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.138+0000 7f3e32510e00 1 -- 10.20.193.28:0/79615166 wait complete. 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.138+0000 7f3e32510e00 1 -- start start 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.138+0000 7f3e32510e00 1 Processor -- start 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591a010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b589dc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e32510e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b589e170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e32510e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635b589e6b0 con 0x5635b5904b20 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e32510e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5635b589e820 con 0x5635b58bfc70 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e32510e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5635b589e9e0 con 0x5635b58bf360 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2ea8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b589e170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2e28b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591a010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2da8a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b589dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2da8a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b589dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51874/0 (socket says 10.20.193.28:51874) 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2e28b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591a010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60942/0 (socket says 10.20.193.28:60942) 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2e28b640 1 -- 10.20.193.28:0/862076681 learned_addr learned my addr 10.20.193.28:0/862076681 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2ea8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b589e170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36454/0 (socket says 10.20.193.28:36454) 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2da8a640 1 -- 10.20.193.28:0/862076681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 msgr2=0x5635b591a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591a010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2da8a640 1 -- 10.20.193.28:0/862076681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 msgr2=0x5635b589e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b589e170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2da8a640 1 -- 10.20.193.28:0/862076681 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b57610e0 con 0x5635b58bfc70 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591a010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:22.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.139+0000 7f3e2ea8c640 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b589e170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3e2da8a640 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b589dc30 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=6826899989104333374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e1c002940 tx=0x7f3e1c02f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ebe055e9fae923e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3ddbfff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3ddbfff640 1 -- 10.20.193.28:0/862076681 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1c09d2f0 con 0x5635b58bfc70 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3ddbfff640 1 -- 10.20.193.28:0/862076681 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3e1c0d15a0 con 0x5635b58bfc70 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3ddbfff640 1 -- 10.20.193.28:0/862076681 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1c0dca40 con 0x5635b58bfc70 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b574f3c0 con 0x5635b58bfc70 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3ddbfff640 1 -- 10.20.193.28:0/862076681 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3e1c0dae40 con 0x5635b58bfc70 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3ddbfff640 10 client.27965 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3e32510e00 10 client.27965 _ll_register_callbacks cb 0x5635b574ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e1c0d1c70 con 0x5635b58bfc70 2026-02-20T13:24:22.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.140+0000 7f3ddbfff640 1 -- 10.20.193.28:0/862076681 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c0d13c0 con 0x5635b58bfc70 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e32510e00 10 client.27965 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5635b575bb60 con 0x5635b58bfc70 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3ddbfff640 1 -- 10.20.193.28:0/862076681 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3e1c0cfba0 con 0x5635b58bfc70 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e32510e00 10 client.27965 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e32510e00 10 client.27965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e32510e00 20 client.27965 populate_metadata read hostname 'trial028' 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e32510e00 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5635b59b2120 0x5635b59d25d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e32510e00 4 client.27965 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635b545ef40 con 0x5635b59b2120 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.141+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5635b59b2120 0x5635b59d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e2e28b640 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5635b59b2120 0x5635b59d25d0 crc :-1 s=READY pgs=217 gs=4 cs=0 l=0 c_cookie=16730538596378317288 s_cookie=1325547360546010567 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e82ed036121791e8 server_cookie=12654a4d264d35c7 in_seq=0 out_seq=0 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3ddbfff640 10 client.27965 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3ddbfff640 1 -- 10.20.193.28:0/862076681 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635b545ef40 con 0x5635b59b2120 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3ddbfff640 10 client.27965 handle_command_reply: tid=0 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 client.27965 shutdown 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 msgr2=0x5635b589dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b589dc30 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=6826899989104333374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e1c002940 tx=0x7f3e1c02f120 comp rx=0 tx=0).stop 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 shutdown_connections 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5635b59b2120 0x5635b59d25d0 crc :-1 s=READY pgs=217 gs=4 cs=0 l=0 c_cookie=16730538596378317288 s_cookie=1325547360546010567 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635b5904b20 0x5635b589e170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5635b58bfc70 0x5635b589dc30 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=6826899989104333374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 --2- 10.20.193.28:0/862076681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5635b58bf360 0x5635b591a010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3ddbfff640 0 client.27965 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 >> 10.20.193.28:0/862076681 conn(0x5635b589d860 msgr2=0x5635b59190e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 shutdown_connections 2026-02-20T13:24:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.142+0000 7f3e32510e00 1 -- 10.20.193.28:0/862076681 wait complete. 2026-02-20T13:24:22.152 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e32510e00 20 client.27965 trim_cache size 0 max 16384 2026-02-20T13:24:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 -- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e040b5750 msgr2=0x7f3e040d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e040b5750 0x7f3e040d5c00 secure :-1 s=READY pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e18004740 tx=0x7f3e1800b410 comp rx=0 tx=0).stop 2026-02-20T13:24:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 -- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 msgr2=0x7f3e28175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 0x7f3e28175f70 secure :-1 s=READY pgs=894 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e1c0023b0 tx=0x7f3e1c0028d0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 -- 10.20.193.28:0/2485643779 shutdown_connections 2026-02-20T13:24:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3e040b5750 0x7f3e040d5c00 unknown :-1 s=CLOSED pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e2810fea0 0x7f3e28175f70 unknown :-1 s=CLOSED pgs=894 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e281156a0 0x7f3e280f5ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 --2- 10.20.193.28:0/2485643779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3e2810f4b0 0x7f3e280f57c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 -- 10.20.193.28:0/2485643779 >> 10.20.193.28:0/2485643779 conn(0x7f3e280ecda0 msgr2=0x7f3e2810d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 -- 10.20.193.28:0/2485643779 shutdown_connections 2026-02-20T13:24:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:22.143+0000 7f3e2f28d640 1 -- 10.20.193.28:0/2485643779 wait complete. 2026-02-20T13:24:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:22 trial028 ceph-mon[37442]: pgmap v392: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:24:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:22 trial127 ceph-mon[43817]: pgmap v392: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:24:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:22 trial034 ceph-mon[43332]: pgmap v392: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 19 op/s 2026-02-20T13:24:23.279 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:24:23.280 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:24:23.467 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:23.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 -- 10.20.193.28:0/3852215430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82f4153320 msgr2=0x7f82f4173740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/3852215430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82f4153320 0x7f82f4173740 secure :-1 s=READY pgs=896 gs=2 cs=0 l=1 c_cookie=5481611990490465089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82f000aa30 tx=0x7f82f0030270 comp rx=0 tx=0).stop 2026-02-20T13:24:23.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 -- 10.20.193.28:0/3852215430 shutdown_connections 2026-02-20T13:24:23.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/3852215430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82f4153320 0x7f82f4173740 unknown :-1 s=CLOSED pgs=896 gs=2 cs=0 l=1 c_cookie=5481611990490465089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/3852215430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82f410e760 0x7f82f4152de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/3852215430 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82f410dd70 0x7f82f410e140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 -- 10.20.193.28:0/3852215430 >> 10.20.193.28:0/3852215430 conn(0x7f82f40e9780 msgr2=0x7f82f4109b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:23.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 -- 10.20.193.28:0/3852215430 shutdown_connections 2026-02-20T13:24:23.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 -- 10.20.193.28:0/3852215430 wait complete. 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.639+0000 7f82fc2b9640 1 Processor -- start 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fc2b9640 1 -- start start 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fc2b9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82f410dd70 0x7f82f4161c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fc2b9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82f410e760 0x7f82f41621c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fc2b9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82f4153320 0x7f82f4167590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fc2b9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82f4167bb0 con 0x7f82f410dd70 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fc2b9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f82f4167d20 con 0x7f82f4153320 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fc2b9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f82f4167ee0 con 0x7f82f410e760 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fa82f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82f4153320 0x7f82f4167590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82f982d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82f410e760 0x7f82f41621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fa82f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82f4153320 0x7f82f4167590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51890/0 (socket says 10.20.193.28:51890) 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fa82f640 1 -- 10.20.193.28:0/129156780 learned_addr learned my addr 10.20.193.28:0/129156780 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:23.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.640+0000 7f82fa02e640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82f410dd70 0x7f82f4161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82fa82f640 1 -- 10.20.193.28:0/129156780 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82f410e760 msgr2=0x7f82f41621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82fa82f640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82f410e760 0x7f82f41621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82fa82f640 1 -- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82f410dd70 msgr2=0x7f82f4161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82fa82f640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82f410dd70 0x7f82f4161c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82fa82f640 1 -- 10.20.193.28:0/129156780 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f000a650 con 0x7f82f4153320 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82f982d640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82f410e760 0x7f82f41621c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82fa82f640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82f4153320 0x7f82f4167590 secure :-1 s=READY pgs=335 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82f0006a50 tx=0x7f82f00039b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82db7fe640 1 -- 10.20.193.28:0/129156780 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82f003e070 con 0x7f82f4153320 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82fc2b9640 1 -- 10.20.193.28:0/129156780 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f4168160 con 0x7f82f4153320 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82db7fe640 1 -- 10.20.193.28:0/129156780 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82f00055a0 con 0x7f82f4153320 2026-02-20T13:24:23.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82db7fe640 1 -- 10.20.193.28:0/129156780 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82f0042960 con 0x7f82f4153320 2026-02-20T13:24:23.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.641+0000 7f82fc2b9640 1 -- 10.20.193.28:0/129156780 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f414ef40 con 0x7f82f4153320 2026-02-20T13:24:23.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.644+0000 7f82db7fe640 1 -- 10.20.193.28:0/129156780 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f82f0039b40 con 0x7f82f4153320 2026-02-20T13:24:23.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.646+0000 7f82db7fe640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82d00b5760 0x7f82d00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.646+0000 7f82db7fe640 1 -- 10.20.193.28:0/129156780 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f82f010c680 con 0x7f82f4153320 2026-02-20T13:24:23.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.646+0000 7f82fa02e640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82d00b5760 0x7f82d00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fe2b3e00 1 Processor -- start 2026-02-20T13:24:23.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fe2b3e00 1 -- start start 2026-02-20T13:24:23.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fa02e640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82d00b5760 0x7f82d00d5c10 secure :-1 s=READY pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82e4004740 tx=0x7f82e400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:23.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x5610860677e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x5610860ac480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x5610860ccda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561085f7da20 con 0x561086067d20 2026-02-20T13:24:23.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561085f79750 con 0x5610860ac9c0 2026-02-20T13:24:23.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561085f736f0 con 0x561086067410 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82f982d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x5610860ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fa02e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x5610860677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fa02e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x5610860677e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60974/0 (socket says 10.20.193.28:60974) 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82f982d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x5610860ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36490/0 (socket says 10.20.193.28:36490) 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fa02e640 1 -- 10.20.193.28:0/2426058447 learned_addr learned my addr 10.20.193.28:0/2426058447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.647+0000 7f82fa82f640 1 --2- 10.20.193.28:0/2426058447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x5610860ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82f982d640 1 -- 10.20.193.28:0/2426058447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 msgr2=0x5610860677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82f982d640 1 --2- 10.20.193.28:0/2426058447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x5610860677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82f982d640 1 -- 10.20.193.28:0/2426058447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 msgr2=0x5610860ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82f982d640 1 --2- 10.20.193.28:0/2426058447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x5610860ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82f982d640 1 -- 10.20.193.28:0/2426058447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085f1f120 con 0x561086067d20 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82f982d640 1 --2- 10.20.193.28:0/2426058447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x5610860ac480 secure :-1 s=READY pgs=897 gs=2 cs=0 l=1 c_cookie=5524142966379677941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82e8004740 tx=0x7f82e80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca9b2c27f8888f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82d8884640 1 -- 10.20.193.28:0/2426058447 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82e801a440 con 0x561086067d20 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82d8884640 1 -- 10.20.193.28:0/2426058447 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82e8010910 con 0x561086067d20 2026-02-20T13:24:23.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82d8884640 1 -- 10.20.193.28:0/2426058447 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82e800e980 con 0x561086067d20 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2426058447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 msgr2=0x5610860ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/2426058447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x5610860ac480 secure :-1 s=READY pgs=897 gs=2 cs=0 l=1 c_cookie=5524142966379677941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82e8004740 tx=0x7f82e80045c0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2426058447 shutdown_connections 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/2426058447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x5610860ac480 unknown :-1 s=CLOSED pgs=897 gs=2 cs=0 l=1 c_cookie=5524142966379677941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/2426058447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x5610860ccda0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/2426058447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x5610860677e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2426058447 >> 10.20.193.28:0/2426058447 conn(0x561086045910 msgr2=0x561086065cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2426058447 shutdown_connections 2026-02-20T13:24:23.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.648+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2426058447 wait complete. 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82fe2b3e00 1 -- start start 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82fe2b3e00 1 Processor -- start 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x561086088640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x561086088b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x56108608db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56108608e0b0 con 0x561086067d20 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56108608e220 con 0x5610860ac9c0 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56108608e3e0 con 0x561086067410 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.650+0000 7f82f982d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x561086088b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82f982d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x561086088b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36500/0 (socket says 10.20.193.28:36500) 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82f982d640 1 -- 10.20.193.28:0/3525262416 learned_addr learned my addr 10.20.193.28:0/3525262416 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:23.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82fa82f640 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x56108608db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82fa02e640 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x561086088640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82f982d640 1 -- 10.20.193.28:0/3525262416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 msgr2=0x561086088640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82f982d640 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x561086088640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82f982d640 1 -- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 msgr2=0x56108608db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82f982d640 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x56108608db70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82f982d640 1 -- 10.20.193.28:0/3525262416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085ef7810 con 0x561086067d20 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82fa82f640 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x56108608db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82f982d640 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x561086088b80 secure :-1 s=READY pgs=898 gs=1 cs=0 l=1 c_cookie=7364292046548785229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82e800ed40 tx=0x7f82e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6633389940c6584d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82a7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82a7fff640 1 -- 10.20.193.28:0/3525262416 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82e801e070 con 0x561086067d20 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82a7fff640 1 -- 10.20.193.28:0/3525262416 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82e801f040 con 0x561086067d20 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82a7fff640 1 -- 10.20.193.28:0/3525262416 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82e8005610 con 0x561086067d20 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.651+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e8009c80 con 0x561086067d20 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82a7fff640 1 -- 10.20.193.28:0/3525262416 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f82e8005040 con 0x561086067d20 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 10 client.18021 _ll_register_callbacks cb 0x561085f2ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561085c099d0 con 0x561086067d20 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82a7fff640 1 -- 10.20.193.28:0/3525262416 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f82e8010c90 con 0x561086067d20 2026-02-20T13:24:23.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 10 client.18021 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:23.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561085f094f0 con 0x561086067d20 2026-02-20T13:24:23.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82a7fff640 1 -- 10.20.193.28:0/3525262416 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f82e800e570 con 0x561086067d20 2026-02-20T13:24:23.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 10 client.18021 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:23.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 10 client.18021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:23.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 20 client.18021 populate_metadata read hostname 'trial028' 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561086092ce0 0x561086093180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 4 client.18021 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.652+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561085f80df0 con 0x561086092ce0 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.653+0000 7f82fa02e640 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561086092ce0 0x561086093180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.653+0000 7f82fa02e640 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561086092ce0 0x561086093180 crc :-1 s=READY pgs=218 gs=4 cs=0 l=0 c_cookie=370743294955892110 s_cookie=10966149048398120477 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=525250ffeb42d8e server_cookie=982f967557c2061d in_seq=0 out_seq=0 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.653+0000 7f82a7fff640 10 client.18021 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82a7fff640 1 -- 10.20.193.28:0/3525262416 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561085f80df0 con 0x561086092ce0 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82a7fff640 10 client.18021 handle_command_reply: tid=0 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 client.18021 shutdown 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 msgr2=0x561086088b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x561086088b80 secure :-1 s=READY pgs=898 gs=1 cs=0 l=1 c_cookie=7364292046548785229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82e800ed40 tx=0x7f82e800ed70 comp rx=0 tx=0).stop 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 shutdown_connections 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561086092ce0 0x561086093180 crc :-1 s=READY pgs=218 gs=4 cs=0 l=0 c_cookie=370743294955892110 s_cookie=10966149048398120477 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067d20 0x561086088b80 unknown :-1 s=CLOSED pgs=898 gs=1 cs=0 l=1 c_cookie=7364292046548785229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x56108608db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/3525262416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067410 0x561086088640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82a7fff640 0 client.18021 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.654+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 >> 10.20.193.28:0/3525262416 conn(0x561086045910 msgr2=0x56108604eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.655+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 shutdown_connections 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.655+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/3525262416 wait complete. 2026-02-20T13:24:23.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.655+0000 7f82fe2b3e00 20 client.18021 trim_cache size 0 max 16384 2026-02-20T13:24:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fe2b3e00 1 Processor -- start 2026-02-20T13:24:23.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fe2b3e00 1 -- start start 2026-02-20T13:24:23.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067410 0x561086088370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860888b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x561086063b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561085f71320 con 0x561086067410 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561085c31790 con 0x5610860ac9c0 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561086089160 con 0x561086067d20 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067410 0x561086088370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067410 0x561086088370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36504/0 (socket says 10.20.193.28:36504) 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 -- 10.20.193.28:0/2855383228 learned_addr learned my addr 10.20.193.28:0/2855383228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa82f640 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x561086063b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82f982d640 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 -- 10.20.193.28:0/2855383228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 msgr2=0x5610860888b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860888b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 -- 10.20.193.28:0/2855383228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 msgr2=0x561086063b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x561086063b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 -- 10.20.193.28:0/2855383228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561086046340 con 0x561086067410 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.664+0000 7f82fa02e640 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067410 0x561086088370 secure :-1 s=READY pgs=899 gs=1 cs=0 l=1 c_cookie=15283080242173584800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82e400bdc0 tx=0x7f82e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4186881cc8c25a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82c24e6640 1 -- 10.20.193.28:0/2855383228 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82e4024050 con 0x561086067410 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82c24e6640 1 -- 10.20.193.28:0/2855383228 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82e4025040 con 0x561086067410 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82c24e6640 1 -- 10.20.193.28:0/2855383228 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82e402a320 con 0x561086067410 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2855383228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067410 msgr2=0x561086088370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067410 0x561086088370 secure :-1 s=READY pgs=899 gs=1 cs=0 l=1 c_cookie=15283080242173584800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82e400bdc0 tx=0x7f82e4013000 comp rx=0 tx=0).stop 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2855383228 shutdown_connections 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610860ac9c0 0x561086063b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860888b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/2855383228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561086067410 0x561086088370 unknown :-1 s=CLOSED pgs=899 gs=1 cs=0 l=1 c_cookie=15283080242173584800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2855383228 >> 10.20.193.28:0/2855383228 conn(0x561086045910 msgr2=0x5610860592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:23.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2855383228 shutdown_connections 2026-02-20T13:24:23.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.665+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/2855383228 wait complete. 2026-02-20T13:24:23.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.666+0000 7f82fe2b3e00 1 -- start start 2026-02-20T13:24:23.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.666+0000 7f82fe2b3e00 1 Processor -- start 2026-02-20T13:24:23.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.666+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561086067410 0x5610860a2ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.666+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860a3440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.666+0000 7f82fe2b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610860ac9c0 0x5610860a52d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.666+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561085fd7a40 con 0x5610860ac9c0 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.666+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5610860a58c0 con 0x561086067410 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.666+0000 7f82fe2b3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5610860a5a80 con 0x561086067d20 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa02e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561086067410 0x5610860a2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82f982d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa02e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561086067410 0x5610860a2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51930/0 (socket says 10.20.193.28:51930) 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa02e640 1 -- 10.20.193.28:0/1592134222 learned_addr learned my addr 10.20.193.28:0/1592134222 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa82f640 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610860ac9c0 0x5610860a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa82f640 1 -- 10.20.193.28:0/1592134222 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 msgr2=0x5610860a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa82f640 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa82f640 1 -- 10.20.193.28:0/1592134222 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561086067410 msgr2=0x5610860a2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa82f640 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561086067410 0x5610860a2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa82f640 1 -- 10.20.193.28:0/1592134222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085f03f70 con 0x5610860ac9c0 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82f982d640 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860a3440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82fa82f640 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610860ac9c0 0x5610860a52d0 secure :-1 s=READY pgs=900 gs=3 cs=0 l=1 c_cookie=12440665270504682218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82f010a150 tx=0x7f82f000a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca61f2669f872ea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.667+0000 7f82a7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82a7fff640 1 -- 10.20.193.28:0/1592134222 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82f00d8700 con 0x5610860ac9c0 2026-02-20T13:24:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82a7fff640 1 -- 10.20.193.28:0/1592134222 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82f00dace0 con 0x5610860ac9c0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e4011680 con 0x5610860ac9c0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82a7fff640 1 -- 10.20.193.28:0/1592134222 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82f00d0a70 con 0x5610860ac9c0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 10 client.18027 _ll_register_callbacks cb 0x561085f2ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82a7fff640 1 -- 10.20.193.28:0/1592134222 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f82f00d0bd0 con 0x5610860ac9c0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82e8010910 con 0x5610860ac9c0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82a7fff640 1 -- 10.20.193.28:0/1592134222 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f82f00ddb20 con 0x5610860ac9c0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 10 client.18027 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561085ef7b40 con 0x5610860ac9c0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82a7fff640 1 -- 10.20.193.28:0/1592134222 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f82f0036320 con 0x5610860ac9c0 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 10 client.18027 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 10 client.18027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 20 client.18027 populate_metadata read hostname 'trial028' 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561086163390 0x561086183840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 4 client.18027 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.668+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561085c07220 con 0x561086163390 2026-02-20T13:24:23.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.669+0000 7f82fa02e640 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561086163390 0x561086183840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.670+0000 7f82fa02e640 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561086163390 0x561086183840 crc :-1 s=READY pgs=219 gs=4 cs=0 l=0 c_cookie=12300461064821010872 s_cookie=1078696534294469751 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aab4042af62df1b8 server_cookie=ef84cc863111c77 in_seq=0 out_seq=0 2026-02-20T13:24:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.670+0000 7f82a7fff640 10 client.18027 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.670+0000 7f82a7fff640 1 -- 10.20.193.28:0/1592134222 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561085c07220 con 0x561086163390 2026-02-20T13:24:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.670+0000 7f82a7fff640 10 client.18027 handle_command_reply: tid=0 2026-02-20T13:24:23.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.670+0000 7f82fe2b3e00 1 client.18027 shutdown 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610860ac9c0 msgr2=0x5610860a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610860ac9c0 0x5610860a52d0 secure :-1 s=READY pgs=900 gs=3 cs=0 l=1 c_cookie=12440665270504682218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82f010a150 tx=0x7f82f000a390 comp rx=0 tx=0).stop 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 shutdown_connections 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561086163390 0x561086183840 crc :-1 s=READY pgs=219 gs=4 cs=0 l=0 c_cookie=12300461064821010872 s_cookie=1078696534294469751 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610860ac9c0 0x5610860a52d0 unknown :-1 s=CLOSED pgs=900 gs=3 cs=0 l=1 c_cookie=12440665270504682218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561086067d20 0x5610860a3440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 --2- 10.20.193.28:0/1592134222 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561086067410 0x5610860a2ec0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82a7fff640 0 client.18027 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 >> 10.20.193.28:0/1592134222 conn(0x561086045910 msgr2=0x561086088370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 shutdown_connections 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 1 -- 10.20.193.28:0/1592134222 wait complete. 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.671+0000 7f82fe2b3e00 20 client.18027 trim_cache size 0 max 16384 2026-02-20T13:24:23.675 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:24:23.676 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:24:23.676 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "21f44a7f-24c2-4406-8a6e-28b3985a89fb", 2026-02-20T13:24:23.676 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:24:23.676 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.672+0000 7f82fc2b9640 1 -- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82d00b5760 msgr2=0x7f82d00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.672+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82d00b5760 0x7f82d00d5c10 secure :-1 s=READY pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82e4004740 tx=0x7f82e400b410 comp rx=0 tx=0).stop 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.672+0000 7f82fc2b9640 1 -- 10.20.193.28:0/129156780 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82f4153320 msgr2=0x7f82f4167590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.672+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82f4153320 0x7f82f4167590 secure :-1 s=READY pgs=335 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82f0006a50 tx=0x7f82f00039b0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.673+0000 7f82fc2b9640 1 -- 10.20.193.28:0/129156780 shutdown_connections 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.673+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f82d00b5760 0x7f82d00d5c10 unknown :-1 s=CLOSED pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.673+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f82f4153320 0x7f82f4167590 unknown :-1 s=CLOSED pgs=335 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.673+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f82f410e760 0x7f82f41621c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.673+0000 7f82fc2b9640 1 --2- 10.20.193.28:0/129156780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82f410dd70 0x7f82f4161c80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.673+0000 7f82fc2b9640 1 -- 10.20.193.28:0/129156780 >> 10.20.193.28:0/129156780 conn(0x7f82f40e9780 msgr2=0x7f82f4109b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.673+0000 7f82fc2b9640 1 -- 10.20.193.28:0/129156780 shutdown_connections 2026-02-20T13:24:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:23.673+0000 7f82fc2b9640 1 -- 10.20.193.28:0/129156780 wait complete. 2026-02-20T13:24:23.775 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:24:23.961 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:24.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 -- 10.20.193.28:0/2985901789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10fea0 msgr2=0x7fcb3c114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/2985901789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10fea0 0x7fcb3c114ef0 secure :-1 s=READY pgs=901 gs=1 cs=0 l=1 c_cookie=1233237893240835874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb24009890 tx=0x7fcb2402f120 comp rx=0 tx=0).stop 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 -- 10.20.193.28:0/2985901789 shutdown_connections 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/2985901789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10fea0 0x7fcb3c114ef0 unknown :-1 s=CLOSED pgs=901 gs=1 cs=0 l=1 c_cookie=1233237893240835874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/2985901789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb3c1156a0 0x7fcb3c176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/2985901789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb3c10f4b0 0x7fcb3c10f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 -- 10.20.193.28:0/2985901789 >> 10.20.193.28:0/2985901789 conn(0x7fcb3c0ecda0 msgr2=0x7fcb3c10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 -- 10.20.193.28:0/2985901789 shutdown_connections 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.135+0000 7fcb3bfff640 1 -- 10.20.193.28:0/2985901789 wait complete. 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3bfff640 1 Processor -- start 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3bfff640 1 -- start start 2026-02-20T13:24:24.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10f4b0 0x7fcb3c0f57c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb3c10fea0 0x7fcb3c175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb3c1156a0 0x7fcb3c0f5ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c0fb0d0 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3bfff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c0fb240 con 0x7fcb3c10fea0 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3bfff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c0fb400 con 0x7fcb3c1156a0 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10f4b0 0x7fcb3c0f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10f4b0 0x7fcb3c0f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36522/0 (socket says 10.20.193.28:36522) 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3affd640 1 -- 10.20.193.28:0/1688865303 learned_addr learned my addr 10.20.193.28:0/1688865303 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb3c10fea0 0x7fcb3c175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.136+0000 7fcb3b7fe640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb3c1156a0 0x7fcb3c0f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3affd640 1 -- 10.20.193.28:0/1688865303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb3c1156a0 msgr2=0x7fcb3c0f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3affd640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb3c1156a0 0x7fcb3c0f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3affd640 1 -- 10.20.193.28:0/1688865303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb3c10fea0 msgr2=0x7fcb3c175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3affd640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb3c10fea0 0x7fcb3c175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3affd640 1 -- 10.20.193.28:0/1688865303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb240094b0 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3b7fe640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb3c1156a0 0x7fcb3c0f5ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3affd640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10f4b0 0x7fcb3c0f57c0 secure :-1 s=READY pgs=902 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb3000e9c0 tx=0x7fcb3000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb1bfff640 1 -- 10.20.193.28:0/1688865303 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb3000cd70 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb1bfff640 1 -- 10.20.193.28:0/1688865303 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcb30004d30 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb1bfff640 1 -- 10.20.193.28:0/1688865303 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb300106b0 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3bfff640 1 -- 10.20.193.28:0/1688865303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3c0fb6e0 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.137+0000 7fcb3bfff640 1 -- 10.20.193.28:0/1688865303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3c0fbc00 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.140+0000 7fcb1bfff640 1 -- 10.20.193.28:0/1688865303 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcb3001f060 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.142+0000 7fcb1bfff640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcb100b5750 0x7fcb100d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.142+0000 7fcb1bfff640 1 -- 10.20.193.28:0/1688865303 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcb30014070 con 0x7fcb3c10f4b0 2026-02-20T13:24:24.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.142+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcb100b5750 0x7fcb100d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.142+0000 7fcb433fde00 1 Processor -- start 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.142+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcb100b5750 0x7fcb100d5c00 secure :-1 s=READY pgs=426 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb3c0fc160 tx=0x7fcb2403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.142+0000 7fcb433fde00 1 -- start start 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555feffeff60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff0034e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff0055730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb433fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555fefefd7d0 con 0x555feffefb90 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb433fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555fefef9500 con 0x555ff0035350 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb433fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555fefef34a0 con 0x555fefff04a0 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555feffeff60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555feffeff60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36532/0 (socket says 10.20.193.28:36532) 2026-02-20T13:24:24.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 -- 10.20.193.28:0/3468829339 learned_addr learned my addr 10.20.193.28:0/3468829339 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff0034e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3b7fe640 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff0055730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 -- 10.20.193.28:0/3468829339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 msgr2=0x555ff0034e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:24.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff0034e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 -- 10.20.193.28:0/3468829339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 msgr2=0x555ff0055730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff0055730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 -- 10.20.193.28:0/3468829339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fefe9ed80 con 0x555feffefb90 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb3affd640 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555feffeff60 secure :-1 s=READY pgs=903 gs=1 cs=0 l=1 c_cookie=13608717058810971439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb30005040 tx=0x7fcb300a9760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdbe0101b3a052f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.143+0000 7fcb077fe640 1 -- 10.20.193.28:0/3468829339 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb30072ea0 con 0x555feffefb90 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb077fe640 1 -- 10.20.193.28:0/3468829339 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcb300ac840 con 0x555feffefb90 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb077fe640 1 -- 10.20.193.28:0/3468829339 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb300adf50 con 0x555feffefb90 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 -- 10.20.193.28:0/3468829339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 msgr2=0x555feffeff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555feffeff60 secure :-1 s=READY pgs=903 gs=1 cs=0 l=1 c_cookie=13608717058810971439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb30005040 tx=0x7fcb300a9760 comp rx=0 tx=0).stop 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 -- 10.20.193.28:0/3468829339 shutdown_connections 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff0055730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff0034e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 --2- 10.20.193.28:0/3468829339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555feffeff60 unknown :-1 s=CLOSED pgs=903 gs=1 cs=0 l=1 c_cookie=13608717058810971439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 -- 10.20.193.28:0/3468829339 >> 10.20.193.28:0/3468829339 conn(0x555feffc5680 msgr2=0x555feffe5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 -- 10.20.193.28:0/3468829339 shutdown_connections 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.144+0000 7fcb433fde00 1 -- 10.20.193.28:0/3468829339 wait complete. 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.145+0000 7fcb433fde00 1 -- start start 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.145+0000 7fcb433fde00 1 Processor -- start 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff004cb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004d0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff0052090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb433fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555ff00525d0 con 0x555feffefb90 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb433fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555ff0052740 con 0x555ff0035350 2026-02-20T13:24:24.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb433fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555ff0052900 con 0x555fefff04a0 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff004cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff004cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36534/0 (socket says 10.20.193.28:36534) 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 -- 10.20.193.28:0/4139868626 learned_addr learned my addr 10.20.193.28:0/4139868626 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 -- 10.20.193.28:0/4139868626 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 msgr2=0x555ff004d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 -- 10.20.193.28:0/4139868626 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 msgr2=0x555ff0052090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff0052090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 -- 10.20.193.28:0/4139868626 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fefe77350 con 0x555feffefb90 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004d0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:24.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb3affd640 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff004cb60 secure :-1 s=READY pgs=904 gs=1 cs=0 l=1 c_cookie=8101337057910847424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb300a95c0 tx=0x7fcb300052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706dbb21a67bf7c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.146+0000 7fcb04ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb04ff9640 1 -- 10.20.193.28:0/4139868626 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb3006f070 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb04ff9640 1 -- 10.20.193.28:0/4139868626 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcb300ada40 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb04ff9640 1 -- 10.20.193.28:0/4139868626 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb30072ea0 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3c0fbc00 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 10 client.18039 _ll_register_callbacks cb 0x555fefe749a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555fefb896f0 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb04ff9640 1 -- 10.20.193.28:0/4139868626 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcb300b2d60 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb04ff9640 1 -- 10.20.193.28:0/4139868626 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb300c4ea0 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 10 client.18039 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555fefe89150 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb04ff9640 1 -- 10.20.193.28:0/4139868626 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb300adcd0 con 0x555feffefb90 2026-02-20T13:24:24.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 10 client.18039 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:24.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:24.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 20 client.18039 populate_metadata read hostname 'trial028' 2026-02-20T13:24:24.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555ff00320e0 0x555ff0032580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.147+0000 7fcb433fde00 4 client.18039 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:24.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.148+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555feff00d60 con 0x555ff00320e0 2026-02-20T13:24:24.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.148+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555ff00320e0 0x555ff0032580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555ff00320e0 0x555ff0032580 crc :-1 s=READY pgs=220 gs=4 cs=0 l=0 c_cookie=18146684944413588117 s_cookie=10596643540490914803 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbd5f9cfcab37a95 server_cookie=930ed7281a660bf3 in_seq=0 out_seq=0 2026-02-20T13:24:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb04ff9640 10 client.18039 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb04ff9640 1 -- 10.20.193.28:0/4139868626 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555feff00d60 con 0x555ff00320e0 2026-02-20T13:24:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb04ff9640 10 client.18039 handle_command_reply: tid=0 2026-02-20T13:24:24.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 client.18039 shutdown 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 msgr2=0x555ff004cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff004cb60 secure :-1 s=READY pgs=904 gs=1 cs=0 l=1 c_cookie=8101337057910847424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb300a95c0 tx=0x7fcb300052e0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 shutdown_connections 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555ff00320e0 0x555ff0032580 crc :-1 s=READY pgs=220 gs=4 cs=0 l=0 c_cookie=18146684944413588117 s_cookie=10596643540490914803 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff0052090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004d0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 --2- 10.20.193.28:0/4139868626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff004cb60 unknown :-1 s=CLOSED pgs=904 gs=1 cs=0 l=1 c_cookie=8101337057910847424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 >> 10.20.193.28:0/4139868626 conn(0x555feffc5680 msgr2=0x555feffe5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.149+0000 7fcb04ff9640 0 client.18039 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.150+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 shutdown_connections 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.150+0000 7fcb433fde00 1 -- 10.20.193.28:0/4139868626 wait complete. 2026-02-20T13:24:24.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.150+0000 7fcb433fde00 20 client.18039 trim_cache size 0 max 16384 2026-02-20T13:24:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb433fde00 1 Processor -- start 2026-02-20T13:24:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb433fde00 1 -- start start 2026-02-20T13:24:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff0049f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004a4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff002ffb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb433fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555fefef10d0 con 0x555feffefb90 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb433fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555fefbb1700 con 0x555ff0035350 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb433fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555feffc52f0 con 0x555fefff04a0 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb3a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff0049f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb3affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff0049f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36538/0 (socket says 10.20.193.28:36538) 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb3affd640 1 -- 10.20.193.28:0/3708754825 learned_addr learned my addr 10.20.193.28:0/3708754825 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.159+0000 7fcb3b7fe640 1 --2- 10.20.193.28:0/3708754825 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff002ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb3affd640 1 -- 10.20.193.28:0/3708754825 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 msgr2=0x555ff004a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb3affd640 1 --2- 10.20.193.28:0/3708754825 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb3affd640 1 -- 10.20.193.28:0/3708754825 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 msgr2=0x555ff002ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:24.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb3affd640 1 --2- 10.20.193.28:0/3708754825 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff002ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb3affd640 1 -- 10.20.193.28:0/3708754825 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff003f330 con 0x555feffefb90 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb3affd640 1 --2- 10.20.193.28:0/3708754825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff0049f60 secure :-1 s=READY pgs=905 gs=2 cs=0 l=1 c_cookie=12865907112547467354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb30009540 tx=0x7fcb30074000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28ce25a3490405a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb06ffd640 1 -- 10.20.193.28:0/3708754825 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb3006f070 con 0x555feffefb90 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb06ffd640 1 -- 10.20.193.28:0/3708754825 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcb300cb030 con 0x555feffefb90 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb06ffd640 1 -- 10.20.193.28:0/3708754825 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb300c4ea0 con 0x555feffefb90 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb433fde00 1 -- 10.20.193.28:0/3708754825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 msgr2=0x555ff0049f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb433fde00 1 --2- 10.20.193.28:0/3708754825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff0049f60 secure :-1 s=READY pgs=905 gs=2 cs=0 l=1 c_cookie=12865907112547467354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb30009540 tx=0x7fcb30074000 comp rx=0 tx=0).stop 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb433fde00 1 -- 10.20.193.28:0/3708754825 shutdown_connections 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb433fde00 1 --2- 10.20.193.28:0/3708754825 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ff0035350 0x555ff002ffb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb433fde00 1 --2- 10.20.193.28:0/3708754825 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555fefff04a0 0x555ff004a4a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb433fde00 1 --2- 10.20.193.28:0/3708754825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555feffefb90 0x555ff0049f60 unknown :-1 s=CLOSED pgs=905 gs=2 cs=0 l=1 c_cookie=12865907112547467354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.160+0000 7fcb433fde00 1 -- 10.20.193.28:0/3708754825 >> 10.20.193.28:0/3708754825 conn(0x555feffc5680 msgr2=0x555ff00320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:24.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.161+0000 7fcb433fde00 1 -- 10.20.193.28:0/3708754825 shutdown_connections 2026-02-20T13:24:24.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.161+0000 7fcb433fde00 1 -- 10.20.193.28:0/3708754825 wait complete. 2026-02-20T13:24:24.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.161+0000 7fcb433fde00 1 -- start start 2026-02-20T13:24:24.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.161+0000 7fcb433fde00 1 Processor -- start 2026-02-20T13:24:24.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555feffefb90 0x555ff00512a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555fefff04a0 0x555ff00517e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb433fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ff0035350 0x555feffc5a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb433fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555fefbb1700 con 0x555fefff04a0 2026-02-20T13:24:24.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb433fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555feffc5f90 con 0x555feffefb90 2026-02-20T13:24:24.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb433fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555feffc6150 con 0x555ff0035350 2026-02-20T13:24:24.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555fefff04a0 0x555ff00517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555fefff04a0 0x555ff00517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36546/0 (socket says 10.20.193.28:36546) 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 -- 10.20.193.28:0/423638014 learned_addr learned my addr 10.20.193.28:0/423638014 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3affd640 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555feffefb90 0x555ff00512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3b7fe640 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ff0035350 0x555feffc5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 -- 10.20.193.28:0/423638014 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ff0035350 msgr2=0x555feffc5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ff0035350 0x555feffc5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 -- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555feffefb90 msgr2=0x555ff00512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555feffefb90 0x555ff00512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 -- 10.20.193.28:0/423638014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fefe83bd0 con 0x555fefff04a0 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3affd640 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555feffefb90 0x555ff00512a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb3a7fc640 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555fefff04a0 0x555ff00517e0 secure :-1 s=READY pgs=906 gs=1 cs=0 l=1 c_cookie=4294549963380424308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb24009230 tx=0x7fcb24002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b994e702d74fe74 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:24.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.162+0000 7fcb04ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb04ff9640 1 -- 10.20.193.28:0/423638014 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb2402fa60 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb04ff9640 1 -- 10.20.193.28:0/423638014 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcb24056040 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb04ff9640 1 -- 10.20.193.28:0/423638014 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb24050aa0 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3c0fbc00 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb04ff9640 1 -- 10.20.193.28:0/423638014 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcb24050c30 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 10 client.18045 _ll_register_callbacks cb 0x555fefe749a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb300ac840 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb04ff9640 1 -- 10.20.193.28:0/423638014 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb24050df0 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 10 client.18045 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555fefe77680 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb04ff9640 1 -- 10.20.193.28:0/423638014 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb2405f020 con 0x555fefff04a0 2026-02-20T13:24:24.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 10 client.18045 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 10 client.18045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 20 client.18045 populate_metadata read hostname 'trial028' 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555ff00e2530 0x555ff01029b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 4 client.18045 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.163+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555fefb86f40 con 0x555ff00e2530 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.164+0000 7fcb3affd640 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555ff00e2530 0x555ff01029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb3affd640 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555ff00e2530 0x555ff01029b0 crc :-1 s=READY pgs=221 gs=4 cs=0 l=0 c_cookie=5510813738159648226 s_cookie=6126546302894281365 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c7a57e5b6592de2 server_cookie=5505dd6713ff1295 in_seq=0 out_seq=0 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb04ff9640 10 client.18045 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb04ff9640 1 -- 10.20.193.28:0/423638014 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x555fefb86f40 con 0x555ff00e2530 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb04ff9640 10 client.18045 handle_command_reply: tid=0 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 client.18045 shutdown 2026-02-20T13:24:24.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555fefff04a0 msgr2=0x555ff00517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555fefff04a0 0x555ff00517e0 secure :-1 s=READY pgs=906 gs=1 cs=0 l=1 c_cookie=4294549963380424308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb24009230 tx=0x7fcb24002390 comp rx=0 tx=0).stop 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 shutdown_connections 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555ff00e2530 0x555ff01029b0 crc :-1 s=READY pgs=221 gs=4 cs=0 l=0 c_cookie=5510813738159648226 s_cookie=6126546302894281365 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555fefff04a0 0x555ff00517e0 unknown :-1 s=CLOSED pgs=906 gs=1 cs=0 l=1 c_cookie=4294549963380424308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ff0035350 0x555feffc5a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 --2- 10.20.193.28:0/423638014 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555feffefb90 0x555ff00512a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 >> 10.20.193.28:0/423638014 conn(0x555feffc5680 msgr2=0x555ff0032e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb04ff9640 0 client.18045 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 shutdown_connections 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.165+0000 7fcb433fde00 1 -- 10.20.193.28:0/423638014 wait complete. 2026-02-20T13:24:24.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb433fde00 20 client.18045 trim_cache size 0 max 16384 2026-02-20T13:24:24.174 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:24:24.174 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:24:24.174 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:24:24.174 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:24:24.174 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.174 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "21f44a7f-24c2-4406-8a6e-28b3985a89fb", 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.175 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:24:24.176 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.177 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.178 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.179 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.180 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:24:24.181 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.182 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:24:24.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 -- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcb100b5750 msgr2=0x7fcb100d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcb100b5750 0x7fcb100d5c00 secure :-1 s=READY pgs=426 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb3c0fc160 tx=0x7fcb2403a040 comp rx=0 tx=0).stop 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 -- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10f4b0 msgr2=0x7fcb3c0f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10f4b0 0x7fcb3c0f57c0 secure :-1 s=READY pgs=902 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb3000e9c0 tx=0x7fcb3000ee90 comp rx=0 tx=0).stop 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 -- 10.20.193.28:0/1688865303 shutdown_connections 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcb100b5750 0x7fcb100d5c00 unknown :-1 s=CLOSED pgs=426 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb3c1156a0 0x7fcb3c0f5ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcb3c10fea0 0x7fcb3c175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 --2- 10.20.193.28:0/1688865303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb3c10f4b0 0x7fcb3c0f57c0 unknown :-1 s=CLOSED pgs=902 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 -- 10.20.193.28:0/1688865303 >> 10.20.193.28:0/1688865303 conn(0x7fcb3c0ecda0 msgr2=0x7fcb3c10d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 -- 10.20.193.28:0/1688865303 shutdown_connections 2026-02-20T13:24:24.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:24.166+0000 7fcb3bfff640 1 -- 10.20.193.28:0/1688865303 wait complete. 2026-02-20T13:24:24.267 INFO:tasks.cephfs.filesystem:scrub status for tag:21f44a7f-24c2-4406-8a6e-28b3985a89fb - {'path': '/', 'tag': '21f44a7f-24c2-4406-8a6e-28b3985a89fb', 'options': 'recursive,force'} 2026-02-20T13:24:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:24 trial028 ceph-mon[37442]: pgmap v393: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:24:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:24 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:24:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:24 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:24 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:24:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:24 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:24:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:24 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:24 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:24 trial127 ceph-mon[43817]: pgmap v393: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:24:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:24 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:24:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:24 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:24 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:24:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:24 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:24:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:24 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:24 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:24 trial034 ceph-mon[43332]: pgmap v393: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:24:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:24 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:24:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:24 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:24 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:24:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:24 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:24:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:24 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:24 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:26.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:26 trial028 ceph-mon[37442]: pgmap v394: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:24:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:26 trial127 ceph-mon[43817]: pgmap v394: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:24:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:26 trial034 ceph-mon[43332]: pgmap v394: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:24:27.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 -- 10.20.193.28:0/456887246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 msgr2=0x7fc464171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 --2- 10.20.193.28:0/456887246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 0x7fc464171080 secure :-1 s=READY pgs=907 gs=1 cs=0 l=1 c_cookie=6532338473853119817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc45400aa60 tx=0x7fc4540302b0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 -- 10.20.193.28:0/456887246 shutdown_connections 2026-02-20T13:24:27.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 --2- 10.20.193.28:0/456887246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 0x7fc464171080 unknown :-1 s=CLOSED pgs=907 gs=1 cs=0 l=1 c_cookie=6532338473853119817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 --2- 10.20.193.28:0/456887246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc46410e940 0x7fc46410edb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 --2- 10.20.193.28:0/456887246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc4641100b0 0x7fc4641104a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 -- 10.20.193.28:0/456887246 >> 10.20.193.28:0/456887246 conn(0x7fc4640ec320 msgr2=0x7fc46410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:27.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 -- 10.20.193.28:0/456887246 shutdown_connections 2026-02-20T13:24:27.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 -- 10.20.193.28:0/456887246 wait complete. 2026-02-20T13:24:27.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.750+0000 7fc463fff640 1 Processor -- start 2026-02-20T13:24:27.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc463fff640 1 -- start start 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc463fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc46410e940 0x7fc4640f81e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc463fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 0x7fc464171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc463fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc4641100b0 0x7fc4640f8a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc463fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4640f9630 con 0x7fc46410f2f0 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc463fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc4640f97a0 con 0x7fc46410e940 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc463fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc4640f9960 con 0x7fc4641100b0 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 0x7fc464171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4637fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc4641100b0 0x7fc4640f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 0x7fc464171080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36566/0 (socket says 10.20.193.28:36566) 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 -- 10.20.193.28:0/4075413331 learned_addr learned my addr 10.20.193.28:0/4075413331 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc462ffd640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc46410e940 0x7fc4640f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 -- 10.20.193.28:0/4075413331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc4641100b0 msgr2=0x7fc4640f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc4641100b0 0x7fc4640f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 -- 10.20.193.28:0/4075413331 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc46410e940 msgr2=0x7fc4640f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc46410e940 0x7fc4640f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 -- 10.20.193.28:0/4075413331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45400a650 con 0x7fc46410f2f0 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4637fe640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc4641100b0 0x7fc4640f8a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc4627fc640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 0x7fc464171080 secure :-1 s=READY pgs=908 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc44c009480 tx=0x7fc44c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.751+0000 7fc443fff640 1 -- 10.20.193.28:0/4075413331 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc44c00cd40 con 0x7fc46410f2f0 2026-02-20T13:24:27.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.752+0000 7fc443fff640 1 -- 10.20.193.28:0/4075413331 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc44c004d30 con 0x7fc46410f2f0 2026-02-20T13:24:27.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.752+0000 7fc443fff640 1 -- 10.20.193.28:0/4075413331 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc44c010740 con 0x7fc46410f2f0 2026-02-20T13:24:27.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.752+0000 7fc463fff640 1 -- 10.20.193.28:0/4075413331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4640f9c40 con 0x7fc46410f2f0 2026-02-20T13:24:27.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.752+0000 7fc463fff640 1 -- 10.20.193.28:0/4075413331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4640fa0c0 con 0x7fc46410f2f0 2026-02-20T13:24:27.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.754+0000 7fc443fff640 1 -- 10.20.193.28:0/4075413331 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fc44c01f060 con 0x7fc46410f2f0 2026-02-20T13:24:27.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.755+0000 7fc443fff640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4380b5760 0x7fc4380d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.756+0000 7fc443fff640 1 -- 10.20.193.28:0/4075413331 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc44c014070 con 0x7fc46410f2f0 2026-02-20T13:24:27.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.756+0000 7fc462ffd640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4380b5760 0x7fc4380d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.756+0000 7fc462ffd640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4380b5760 0x7fc4380d5c10 secure :-1 s=READY pgs=427 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc458004740 tx=0x7fc458005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:27.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc46bc98e00 1 Processor -- start 2026-02-20T13:24:27.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc46bc98e00 1 -- start start 2026-02-20T13:24:27.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b256018a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b256221c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25642ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555b254f6fd0 con 0x555b25622700 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555b254f2d00 con 0x555b25601de0 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555b254ecca0 con 0x555b255e14c0 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc4627fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b256221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc462ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b256018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc4627fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b256221c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51996/0 (socket says 10.20.193.28:51996) 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc4627fc640 1 -- 10.20.193.28:0/3096323852 learned_addr learned my addr 10.20.193.28:0/3096323852 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.757+0000 7fc4637fe640 1 --2- 10.20.193.28:0/3096323852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25642ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc4627fc640 1 -- 10.20.193.28:0/3096323852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 msgr2=0x555b256018a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc4627fc640 1 --2- 10.20.193.28:0/3096323852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b256018a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc4627fc640 1 -- 10.20.193.28:0/3096323852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 msgr2=0x555b25642ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc4627fc640 1 --2- 10.20.193.28:0/3096323852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25642ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc4627fc640 1 -- 10.20.193.28:0/3096323852 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b2548f8b0 con 0x555b25601de0 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc4627fc640 1 --2- 10.20.193.28:0/3096323852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b256221c0 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=6133736314801417179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc44c0a97d0 tx=0x7fc44c0a9920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=551f68ae2da6ebdb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc42f7fe640 1 -- 10.20.193.28:0/3096323852 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc44c0aca00 con 0x555b25601de0 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc42f7fe640 1 -- 10.20.193.28:0/3096323852 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc44c0adc00 con 0x555b25601de0 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc42f7fe640 1 -- 10.20.193.28:0/3096323852 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc44c0ad020 con 0x555b25601de0 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3096323852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 msgr2=0x555b256221c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/3096323852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b256221c0 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=6133736314801417179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc44c0a97d0 tx=0x7fc44c0a9920 comp rx=0 tx=0).stop 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3096323852 shutdown_connections 2026-02-20T13:24:27.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/3096323852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25642ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/3096323852 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b256221c0 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=6133736314801417179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/3096323852 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b256018a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3096323852 >> 10.20.193.28:0/3096323852 conn(0x555b255001c0 msgr2=0x555b255dfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:27.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3096323852 shutdown_connections 2026-02-20T13:24:27.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.758+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3096323852 wait complete. 2026-02-20T13:24:27.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc46bc98e00 1 -- start start 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc46bc98e00 1 Processor -- start 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b255fabb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b255fb200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255fbc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555b255fc2c0 con 0x555b25622700 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555b255fc430 con 0x555b25601de0 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555b255fc5f0 con 0x555b255e14c0 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc4627fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b255fb200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc4627fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b255fb200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52000/0 (socket says 10.20.193.28:52000) 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc4627fc640 1 -- 10.20.193.28:0/1596358846 learned_addr learned my addr 10.20.193.28:0/1596358846 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:27.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc462ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b255fabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.760+0000 7fc4637fe640 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc4627fc640 1 -- 10.20.193.28:0/1596358846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 msgr2=0x555b255fabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc4627fc640 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b255fabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc4627fc640 1 -- 10.20.193.28:0/1596358846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 msgr2=0x555b255fbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc4627fc640 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255fbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc4627fc640 1 -- 10.20.193.28:0/1596358846 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b25498400 con 0x555b25601de0 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc4637fe640 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255fbc60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc4627fc640 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b255fb200 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=1474511894893148947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc44c0a9210 tx=0x7fc44c005000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=147684c19031bb13 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc42cff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc42cff9640 1 -- 10.20.193.28:0/1596358846 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc44c0b8340 con 0x555b25601de0 2026-02-20T13:24:27.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4640fa0c0 con 0x555b25601de0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc46bc98e00 10 client.28007 _ll_register_callbacks cb 0x555b25477a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b2518c520 con 0x555b25601de0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc42cff9640 1 -- 10.20.193.28:0/1596358846 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc44c0aca00 con 0x555b25601de0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc42cff9640 1 -- 10.20.193.28:0/1596358846 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc44c072390 con 0x555b25601de0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc42cff9640 1 -- 10.20.193.28:0/1596358846 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc44c0724f0 con 0x555b25601de0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc42cff9640 1 -- 10.20.193.28:0/1596358846 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc44c0ab1e0 con 0x555b25601de0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc46bc98e00 10 client.28007 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.761+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555b25470da0 con 0x555b25601de0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc42cff9640 1 -- 10.20.193.28:0/1596358846 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc44c0040d0 con 0x555b25601de0 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc46bc98e00 10 client.28007 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc46bc98e00 10 client.28007 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc46bc98e00 20 client.28007 populate_metadata read hostname 'trial028' 2026-02-20T13:24:27.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555b255fefb0 0x555b255ff450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc46bc98e00 4 client.28007 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b2551e630 con 0x555b255fefb0 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc462ffd640 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555b255fefb0 0x555b255ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc462ffd640 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555b255fefb0 0x555b255ff450 crc :-1 s=READY pgs=222 gs=4 cs=0 l=0 c_cookie=7024821812841656430 s_cookie=7568476469090045654 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=617d2e383cd7b06e server_cookie=6908a13fc703ced6 in_seq=0 out_seq=0 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.762+0000 7fc42cff9640 10 client.28007 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc42cff9640 1 -- 10.20.193.28:0/1596358846 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555b2551e630 con 0x555b255fefb0 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc42cff9640 10 client.28007 handle_command_reply: tid=0 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 client.28007 shutdown 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 msgr2=0x555b255fb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b255fb200 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=1474511894893148947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc44c0a9210 tx=0x7fc44c005000 comp rx=0 tx=0).stop 2026-02-20T13:24:27.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 shutdown_connections 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555b255fefb0 0x555b255ff450 crc :-1 s=READY pgs=222 gs=4 cs=0 l=0 c_cookie=7024821812841656430 s_cookie=7568476469090045654 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255fbc60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b255fb200 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=1474511894893148947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/1596358846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b255fabb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc42cff9640 0 client.28007 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 >> 10.20.193.28:0/1596358846 conn(0x555b255001c0 msgr2=0x555b255e2790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 shutdown_connections 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 1 -- 10.20.193.28:0/1596358846 wait complete. 2026-02-20T13:24:27.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.763+0000 7fc46bc98e00 20 client.28007 trim_cache size 0 max 16384 2026-02-20T13:24:27.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.771+0000 7fc46bc98e00 1 Processor -- start 2026-02-20T13:24:27.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.771+0000 7fc46bc98e00 1 -- start start 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.771+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b255e14c0 0x555b255fa230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.771+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b25601de0 0x555b255f7ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.771+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255f8410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.771+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555b254ea8d0 con 0x555b25622700 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.771+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555b2522bf10 con 0x555b255e14c0 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.771+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555b255df8c0 con 0x555b25601de0 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b255e14c0 0x555b255fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc4637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b255e14c0 0x555b255fa230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52016/0 (socket says 10.20.193.28:52016) 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 -- 10.20.193.28:0/3823001497 learned_addr learned my addr 10.20.193.28:0/3823001497 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:27.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc4627fc640 1 --2- 10.20.193.28:0/3823001497 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b25601de0 0x555b255f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 -- 10.20.193.28:0/3823001497 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b25601de0 msgr2=0x555b255f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:27.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 --2- 10.20.193.28:0/3823001497 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b25601de0 0x555b255f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 -- 10.20.193.28:0/3823001497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 msgr2=0x555b255f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:27.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 --2- 10.20.193.28:0/3823001497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 -- 10.20.193.28:0/3823001497 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b25482670 con 0x555b255e14c0 2026-02-20T13:24:27.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.772+0000 7fc462ffd640 1 --2- 10.20.193.28:0/3823001497 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b255e14c0 0x555b255fa230 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=3564913822139164516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc458009ec0 tx=0x7fc458014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31791e3bc77c2764 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:27.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc42effd640 1 -- 10.20.193.28:0/3823001497 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc458022030 con 0x555b255e14c0 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc42effd640 1 -- 10.20.193.28:0/3823001497 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc458023040 con 0x555b255e14c0 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc42effd640 1 -- 10.20.193.28:0/3823001497 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4580116a0 con 0x555b255e14c0 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3823001497 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b255e14c0 msgr2=0x555b255fa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/3823001497 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b255e14c0 0x555b255fa230 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=3564913822139164516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc458009ec0 tx=0x7fc458014000 comp rx=0 tx=0).stop 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3823001497 shutdown_connections 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/3823001497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b255f8410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/3823001497 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b25601de0 0x555b255f7ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/3823001497 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b255e14c0 0x555b255fa230 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=3564913822139164516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3823001497 >> 10.20.193.28:0/3823001497 conn(0x555b255001c0 msgr2=0x555b255fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3823001497 shutdown_connections 2026-02-20T13:24:27.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 -- 10.20.193.28:0/3823001497 wait complete. 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.773+0000 7fc46bc98e00 1 -- start start 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc46bc98e00 1 Processor -- start 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b25605040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b25605580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc46bc98e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25606230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555b25606770 con 0x555b25622700 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555b256068e0 con 0x555b25601de0 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc46bc98e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555b25606aa0 con 0x555b255e14c0 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc462ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b25605040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc4637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25606230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc462ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b25605040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:32876/0 (socket says 10.20.193.28:32876) 2026-02-20T13:24:27.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc462ffd640 1 -- 10.20.193.28:0/2966896212 learned_addr learned my addr 10.20.193.28:0/2966896212 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc4627fc640 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b25605580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc4637fe640 1 -- 10.20.193.28:0/2966896212 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 msgr2=0x555b25605040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc4637fe640 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b25605040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc4637fe640 1 -- 10.20.193.28:0/2966896212 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 msgr2=0x555b25605580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc4637fe640 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b25605580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.774+0000 7fc4637fe640 1 -- 10.20.193.28:0/2966896212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b2547d0f0 con 0x555b25622700 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc4637fe640 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25606230 secure :-1 s=READY pgs=909 gs=2 cs=0 l=1 c_cookie=17818844621817912491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc45400a980 tx=0x7fc4540396a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74940c677561cab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc42cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc42cff9640 1 -- 10.20.193.28:0/2966896212 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc45403e040 con 0x555b25622700 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc458009c40 con 0x555b25622700 2026-02-20T13:24:27.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc42cff9640 1 -- 10.20.193.28:0/2966896212 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc454039e40 con 0x555b25622700 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 10 client.18063 _ll_register_callbacks cb 0x555b25477a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b2521e250 con 0x555b25622700 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc42cff9640 1 -- 10.20.193.28:0/2966896212 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4540477b0 con 0x555b25622700 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc42cff9640 1 -- 10.20.193.28:0/2966896212 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc454047940 con 0x555b25622700 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc42cff9640 1 -- 10.20.193.28:0/2966896212 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc454047b00 con 0x555b25622700 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 10 client.18063 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555b254710d0 con 0x555b25622700 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc42cff9640 1 -- 10.20.193.28:0/2966896212 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc45404d020 con 0x555b25622700 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 10 client.18063 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 10 client.18063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 20 client.18063 populate_metadata read hostname 'trial028' 2026-02-20T13:24:27.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555b256cf6a0 0x555b256efb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:27.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 4 client.18063 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:24:27.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.775+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555b2559cca0 con 0x555b256cf6a0 2026-02-20T13:24:27.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.776+0000 7fc462ffd640 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555b256cf6a0 0x555b256efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:27.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.776+0000 7fc462ffd640 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555b256cf6a0 0x555b256efb50 crc :-1 s=READY pgs=223 gs=4 cs=0 l=0 c_cookie=3936909689684328353 s_cookie=7652805493996332017 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36a2b6810e6d7fa1 server_cookie=6a343a0ceccf23f1 in_seq=0 out_seq=0 2026-02-20T13:24:27.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.776+0000 7fc42cff9640 10 client.18063 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:27.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc42cff9640 1 -- 10.20.193.28:0/2966896212 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555b2559cca0 con 0x555b256cf6a0 2026-02-20T13:24:27.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc42cff9640 10 client.18063 handle_command_reply: tid=0 2026-02-20T13:24:27.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 client.18063 shutdown 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 msgr2=0x555b25606230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25606230 secure :-1 s=READY pgs=909 gs=2 cs=0 l=1 c_cookie=17818844621817912491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc45400a980 tx=0x7fc4540396a0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 shutdown_connections 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555b256cf6a0 0x555b256efb50 crc :-1 s=READY pgs=223 gs=4 cs=0 l=0 c_cookie=3936909689684328353 s_cookie=7652805493996332017 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b25622700 0x555b25606230 unknown :-1 s=CLOSED pgs=909 gs=2 cs=0 l=1 c_cookie=17818844621817912491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555b25601de0 0x555b25605580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 --2- 10.20.193.28:0/2966896212 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555b255e14c0 0x555b25605040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 >> 10.20.193.28:0/2966896212 conn(0x555b255001c0 msgr2=0x555b255fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc42cff9640 0 client.18063 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 shutdown_connections 2026-02-20T13:24:27.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 1 -- 10.20.193.28:0/2966896212 wait complete. 2026-02-20T13:24:27.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc46bc98e00 20 client.18063 trim_cache size 0 max 16384 2026-02-20T13:24:27.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:24:27.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:24:27.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:24:27.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:24:27.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc463fff640 1 -- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4380b5760 msgr2=0x7fc4380d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.781+0000 7fc463fff640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4380b5760 0x7fc4380d5c10 secure :-1 s=READY pgs=427 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc458004740 tx=0x7fc458005f90 comp rx=0 tx=0).stop 2026-02-20T13:24:27.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 -- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 msgr2=0x7fc464171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:27.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 0x7fc464171080 secure :-1 s=READY pgs=908 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc44c009480 tx=0x7fc44c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:24:27.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 -- 10.20.193.28:0/4075413331 shutdown_connections 2026-02-20T13:24:27.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4380b5760 0x7fc4380d5c10 unknown :-1 s=CLOSED pgs=427 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc46410f2f0 0x7fc464171080 unknown :-1 s=CLOSED pgs=908 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc4641100b0 0x7fc4640f8a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 --2- 10.20.193.28:0/4075413331 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc46410e940 0x7fc4640f81e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:27.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 -- 10.20.193.28:0/4075413331 >> 10.20.193.28:0/4075413331 conn(0x7fc4640ec320 msgr2=0x7fc4640ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:27.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 -- 10.20.193.28:0/4075413331 shutdown_connections 2026-02-20T13:24:27.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:27.782+0000 7fc463fff640 1 -- 10.20.193.28:0/4075413331 wait complete. 2026-02-20T13:24:28.081 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.081 INFO:tasks.workunit.client.0.trial028.stdout:189/600: open fd = 3 2026-02-20T13:24:28.081 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.081 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.081 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:190/600: open fd = 3 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:191/600: open fd = 3 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:192/600: open fd = 3 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.082 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:193/600: open fd = 3 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:194/600: open fd = 3 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:195/600: open fd = 3 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.083 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:196/600: open fd = 3 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:197/600: open fd = 3 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:198/600: open fd = 3 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.084 INFO:tasks.workunit.client.0.trial028.stdout:199/600: open fd = 3 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:200/600: open fd = 3 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:201/600: open fd = 3 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:202/600: open fd = 3 2026-02-20T13:24:28.085 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:203/600: open fd = 3 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:204/600: open fd = 3 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:205/600: open fd = 3 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.086 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:206/600: open fd = 3 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:207/600: open fd = 3 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:208/600: open fd = 3 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.087 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:209/600: open fd = 3 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:210/600: open fd = 3 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:211/600: open fd = 3 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.088 INFO:tasks.workunit.client.0.trial028.stdout:212/600: open fd = 3 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:213/600: open fd = 3 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:214/600: open fd = 3 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:215/600: open fd = 3 2026-02-20T13:24:28.089 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:216/600: open fd = 3 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:217/600: open fd = 3 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:218/600: open fd = 3 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.090 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:219/600: open fd = 3 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:220/600: open fd = 3 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:221/600: open fd = 3 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.091 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:222/600: open fd = 3 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:223/600: open fd = 3 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:224/600: open fd = 3 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:225/600: open fd = 3 2026-02-20T13:24:28.092 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:226/600: open fd = 3 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:227/600: open fd = 3 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:228/600: open fd = 3 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.093 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:229/600: open fd = 3 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:230/600: open fd = 3 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:231/600: open fd = 3 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.094 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:232/600: open fd = 3 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:233/600: open fd = 3 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:234/600: open fd = 3 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.095 INFO:tasks.workunit.client.0.trial028.stdout:235/600: open fd = 3 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:236/600: open fd = 3 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:237/600: open fd = 3 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:238/600: open fd = 3 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.096 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:239/600: open fd = 3 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:240/600: open fd = 3 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:241/600: open fd = 3 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.097 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:242/600: open fd = 3 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:243/600: open fd = 3 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:244/600: open fd = 3 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:245/600: open fd = 3 2026-02-20T13:24:28.098 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:246/600: open fd = 3 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:247/600: open fd = 3 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:248/600: open fd = 3 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.099 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.100 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.100 INFO:tasks.workunit.client.0.trial028.stdout:249/600: open fd = 3 2026-02-20T13:24:28.100 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.100 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.100 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:24:28.100 INFO:tasks.workunit.client.0.trial028.stdout:250/600: open fd = 3 2026-02-20T13:24:28.100 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.100 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:24:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:28 trial028 ceph-mon[37442]: pgmap v395: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:28 trial127 ceph-mon[43817]: pgmap v395: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:28 trial034 ceph-mon[43332]: pgmap v395: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:30 trial028 ceph-mon[37442]: pgmap v396: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:24:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:30 trial127 ceph-mon[43817]: pgmap v396: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:24:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:30 trial034 ceph-mon[43332]: pgmap v396: 97 pgs: 97 active+clean; 3.8 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2026-02-20T13:24:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:32 trial028 ceph-mon[37442]: pgmap v397: 97 pgs: 97 active+clean; 3.9 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:24:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:32 trial127 ceph-mon[43817]: pgmap v397: 97 pgs: 97 active+clean; 3.9 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:24:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:32 trial034 ceph-mon[43332]: pgmap v397: 97 pgs: 97 active+clean; 3.9 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 21 op/s 2026-02-20T13:24:33.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:33 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:24:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:33 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:24:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:33 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:24:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:33 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:24:33.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:33 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:24:33.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:33 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:24:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:34 trial028 ceph-mon[37442]: pgmap v398: 97 pgs: 97 active+clean; 3.9 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:24:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:34 trial127 ceph-mon[43817]: pgmap v398: 97 pgs: 97 active+clean; 3.9 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:24:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:34 trial034 ceph-mon[43332]: pgmap v398: 97 pgs: 97 active+clean; 3.9 MiB data, 337 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:24:36.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:36 trial028 ceph-mon[37442]: pgmap v399: 97 pgs: 97 active+clean; 3.9 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:24:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:36 trial127 ceph-mon[43817]: pgmap v399: 97 pgs: 97 active+clean; 3.9 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:24:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:36 trial034 ceph-mon[43332]: pgmap v399: 97 pgs: 97 active+clean; 3.9 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:24:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:38 trial028 ceph-mon[37442]: pgmap v400: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:24:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:24:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:38 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:38 trial127 ceph-mon[43817]: pgmap v400: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:24:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:24:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:38 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:38 trial034 ceph-mon[43332]: pgmap v400: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:24:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:24:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:38 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:24:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:24:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:24:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:24:39.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:24:39.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:24:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:24:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:24:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:24:39.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:24:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:40 trial028 ceph-mon[37442]: pgmap v401: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 -- 10.20.193.28:0/3432312426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28150e50 msgr2=0x7fdb28171290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3432312426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28150e50 0x7fdb28171290 secure :-1 s=READY pgs=910 gs=3 cs=0 l=1 c_cookie=2809689918791267899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb2400a970 tx=0x7fdb240301b0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 -- 10.20.193.28:0/3432312426 shutdown_connections 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3432312426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28150e50 0x7fdb28171290 unknown :-1 s=CLOSED pgs=910 gs=3 cs=0 l=1 c_cookie=2809689918791267899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3432312426 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb28061510 0x7fdb28061980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3432312426 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb28062a40 0x7fdb28060fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 -- 10.20.193.28:0/3432312426 >> 10.20.193.28:0/3432312426 conn(0x7fdb280ea4c0 msgr2=0x7fdb2810a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 -- 10.20.193.28:0/3432312426 shutdown_connections 2026-02-20T13:24:40.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.854+0000 7fdb2e883640 1 -- 10.20.193.28:0/3432312426 wait complete. 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e883640 1 Processor -- start 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e883640 1 -- start start 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e883640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb28061510 0x7fdb2815c640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e883640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28062a40 0x7fdb2815cc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e883640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb28150e50 0x7fdb2815d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e883640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2815dfd0 con 0x7fdb28062a40 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e883640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2815e140 con 0x7fdb28150e50 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e883640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2815e300 con 0x7fdb28061510 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2d080640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28062a40 0x7fdb2815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e082640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb28150e50 0x7fdb2815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2d080640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28062a40 0x7fdb2815cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50386/0 (socket says 10.20.193.28:50386) 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2d080640 1 -- 10.20.193.28:0/3882238397 learned_addr learned my addr 10.20.193.28:0/3882238397 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:40.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb28061510 0x7fdb2815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e082640 1 -- 10.20.193.28:0/3882238397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb28061510 msgr2=0x7fdb2815c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e082640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb28061510 0x7fdb2815c640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e082640 1 -- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28062a40 msgr2=0x7fdb2815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e082640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28062a40 0x7fdb2815cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e082640 1 -- 10.20.193.28:0/3882238397 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2400a590 con 0x7fdb28150e50 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.855+0000 7fdb2e082640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb28150e50 0x7fdb2815d890 secure :-1 s=READY pgs=339 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb240306c0 tx=0x7fdb24003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.856+0000 7fdb16ffd640 1 -- 10.20.193.28:0/3882238397 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb2403e070 con 0x7fdb28150e50 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.856+0000 7fdb16ffd640 1 -- 10.20.193.28:0/3882238397 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb24005530 con 0x7fdb28150e50 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.856+0000 7fdb16ffd640 1 -- 10.20.193.28:0/3882238397 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb24042a90 con 0x7fdb28150e50 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.856+0000 7fdb2e883640 1 -- 10.20.193.28:0/3882238397 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2815e580 con 0x7fdb28150e50 2026-02-20T13:24:40.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.856+0000 7fdb2e883640 1 -- 10.20.193.28:0/3882238397 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2815eaa0 con 0x7fdb28150e50 2026-02-20T13:24:40.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.858+0000 7fdb16ffd640 1 -- 10.20.193.28:0/3882238397 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fdb24005050 con 0x7fdb28150e50 2026-02-20T13:24:40.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.860+0000 7fdb16ffd640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb040b5760 0x7fdb040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.860+0000 7fdb16ffd640 1 -- 10.20.193.28:0/3882238397 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdb2410c980 con 0x7fdb28150e50 2026-02-20T13:24:40.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.860+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb040b5760 0x7fdb040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb040b5760 0x7fdb040d5c10 secure :-1 s=READY pgs=428 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb18004740 tx=0x7fdb18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:40.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb321e7e00 1 Processor -- start 2026-02-20T13:24:40.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb321e7e00 1 -- start start 2026-02-20T13:24:40.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731028a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731231c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73143ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561b72ff7fd0 con 0x561b73102de0 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561b72ff3d00 con 0x561b730e24c0 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.861+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561b72fedca0 con 0x561b73123700 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d080640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731028a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43170/0 (socket says 10.20.193.28:43170) 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d080640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731231c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50400/0 (socket says 10.20.193.28:50400) 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d881640 1 -- 10.20.193.28:0/1516883350 learned_addr learned my addr 10.20.193.28:0/1516883350 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2e082640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d080640 1 -- 10.20.193.28:0/1516883350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 msgr2=0x561b73143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d080640 1 --2- 10.20.193.28:0/1516883350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d080640 1 -- 10.20.193.28:0/1516883350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 msgr2=0x561b731028a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d080640 1 --2- 10.20.193.28:0/1516883350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731028a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d080640 1 -- 10.20.193.28:0/1516883350 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b72f908b0 con 0x561b73102de0 2026-02-20T13:24:40.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2e082640 1 --2- 10.20.193.28:0/1516883350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73143ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb2d080640 1 --2- 10.20.193.28:0/1516883350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731231c0 secure :-1 s=READY pgs=911 gs=2 cs=0 l=1 c_cookie=8279123629634554940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb1c004460 tx=0x7fdb1c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e55b1393e90c3c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdaf5bfe640 1 -- 10.20.193.28:0/1516883350 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb1c009ea0 con 0x561b73102de0 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdaf5bfe640 1 -- 10.20.193.28:0/1516883350 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb1c002c80 con 0x561b73102de0 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdaf5bfe640 1 -- 10.20.193.28:0/1516883350 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb1c0108e0 con 0x561b73102de0 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb321e7e00 1 -- 10.20.193.28:0/1516883350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 msgr2=0x561b731231c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.862+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/1516883350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731231c0 secure :-1 s=READY pgs=911 gs=2 cs=0 l=1 c_cookie=8279123629634554940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb1c004460 tx=0x7fdb1c009ca0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.863+0000 7fdb321e7e00 1 -- 10.20.193.28:0/1516883350 shutdown_connections 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.863+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/1516883350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731231c0 unknown :-1 s=CLOSED pgs=911 gs=2 cs=0 l=1 c_cookie=8279123629634554940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.863+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/1516883350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73143ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.863+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/1516883350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731028a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.863+0000 7fdb321e7e00 1 -- 10.20.193.28:0/1516883350 >> 10.20.193.28:0/1516883350 conn(0x561b730011c0 msgr2=0x561b730e0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.863+0000 7fdb321e7e00 1 -- 10.20.193.28:0/1516883350 shutdown_connections 2026-02-20T13:24:40.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.863+0000 7fdb321e7e00 1 -- 10.20.193.28:0/1516883350 wait complete. 2026-02-20T13:24:40.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.864+0000 7fdb321e7e00 1 -- start start 2026-02-20T13:24:40.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.864+0000 7fdb321e7e00 1 Processor -- start 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b730e24c0 0x561b730fbb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b73102de0 0x561b730fc190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b730fcbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561b730fd250 con 0x561b730e24c0 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561b730fd3c0 con 0x561b73102de0 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561b730fd580 con 0x561b73123700 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b730e24c0 0x561b730fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d080640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b73102de0 0x561b730fc190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b730e24c0 0x561b730fbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50412/0 (socket says 10.20.193.28:50412) 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 -- 10.20.193.28:0/4027389605 learned_addr learned my addr 10.20.193.28:0/4027389605 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2e082640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b730fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 -- 10.20.193.28:0/4027389605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 msgr2=0x561b730fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b730fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 -- 10.20.193.28:0/4027389605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b73102de0 msgr2=0x561b730fc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b73102de0 0x561b730fc190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 -- 10.20.193.28:0/4027389605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b72f99400 con 0x561b730e24c0 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2e082640 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b730fcbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb2d881640 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b730e24c0 0x561b730fbb60 secure :-1 s=READY pgs=912 gs=1 cs=0 l=1 c_cookie=16798752936799316813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb18011740 tx=0x7fdb18013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92128cadb792b4d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:40.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdae2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdae2ffd640 1 -- 10.20.193.28:0/4027389605 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb18021040 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdae2ffd640 1 -- 10.20.193.28:0/4027389605 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb1801bb90 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdae2ffd640 1 -- 10.20.193.28:0/4027389605 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb18025770 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c004100 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 10 client.18075 _ll_register_callbacks cb 0x561b72f78a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.865+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b72c8d520 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdae2ffd640 1 -- 10.20.193.28:0/4027389605 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdb18025900 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdae2ffd640 1 -- 10.20.193.28:0/4027389605 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdb1801a460 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb321e7e00 10 client.18075 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561b72f71da0 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdae2ffd640 1 -- 10.20.193.28:0/4027389605 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdb1802d060 con 0x561b730e24c0 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb321e7e00 10 client.18075 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb321e7e00 10 client.18075 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb321e7e00 20 client.18075 populate_metadata read hostname 'trial028' 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561b73100280 0x561b73100720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb321e7e00 4 client.18075 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b7301f630 con 0x561b73100280 2026-02-20T13:24:40.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.866+0000 7fdb2d080640 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561b73100280 0x561b73100720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb2d080640 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561b73100280 0x561b73100720 crc :-1 s=READY pgs=224 gs=4 cs=0 l=0 c_cookie=7198214568573250708 s_cookie=13734768023170742928 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63e5320328d9ac94 server_cookie=be9bb2bf457c7a90 in_seq=0 out_seq=0 2026-02-20T13:24:40.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdae2ffd640 10 client.18075 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:40.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdae2ffd640 1 -- 10.20.193.28:0/4027389605 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561b7301f630 con 0x561b73100280 2026-02-20T13:24:40.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdae2ffd640 10 client.18075 handle_command_reply: tid=0 2026-02-20T13:24:40.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb321e7e00 1 client.18075 shutdown 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b730e24c0 msgr2=0x561b730fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b730e24c0 0x561b730fbb60 secure :-1 s=READY pgs=912 gs=1 cs=0 l=1 c_cookie=16798752936799316813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb18011740 tx=0x7fdb18013040 comp rx=0 tx=0).stop 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 shutdown_connections 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561b73100280 0x561b73100720 crc :-1 s=READY pgs=224 gs=4 cs=0 l=0 c_cookie=7198214568573250708 s_cookie=13734768023170742928 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b730fcbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b73102de0 0x561b730fc190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.867+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/4027389605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b730e24c0 0x561b730fbb60 unknown :-1 s=CLOSED pgs=912 gs=1 cs=0 l=1 c_cookie=16798752936799316813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.868+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 >> 10.20.193.28:0/4027389605 conn(0x561b730011c0 msgr2=0x561b730e3790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.868+0000 7fdae2ffd640 0 client.18075 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.868+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 shutdown_connections 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.868+0000 7fdb321e7e00 1 -- 10.20.193.28:0/4027389605 wait complete. 2026-02-20T13:24:40.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.868+0000 7fdb321e7e00 20 client.18075 trim_cache size 0 max 16384 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb321e7e00 1 Processor -- start 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb321e7e00 1 -- start start 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731006e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731215c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73121b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561b72feb8d0 con 0x561b73102de0 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561b72d2cf10 con 0x561b730e24c0 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561b730e9350 con 0x561b73123700 2026-02-20T13:24:40.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731006e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43198/0 (socket says 10.20.193.28:43198) 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d881640 1 -- 10.20.193.28:0/3772855548 learned_addr learned my addr 10.20.193.28:0/3772855548 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d080640 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2e082640 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d881640 1 -- 10.20.193.28:0/3772855548 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 msgr2=0x561b73121b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73121b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d881640 1 -- 10.20.193.28:0/3772855548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 msgr2=0x561b731215c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731215c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.876+0000 7fdb2d881640 1 -- 10.20.193.28:0/3772855548 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b730e0d20 con 0x561b730e24c0 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731006e0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=5963914697703347763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb1801b7c0 tx=0x7fdb1802b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52c414d1c356d633 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdaf53fd640 1 -- 10.20.193.28:0/3772855548 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb18021040 con 0x561b730e24c0 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdaf53fd640 1 -- 10.20.193.28:0/3772855548 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb18033020 con 0x561b730e24c0 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdaf53fd640 1 -- 10.20.193.28:0/3772855548 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb1800e3e0 con 0x561b730e24c0 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3772855548 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 msgr2=0x561b731006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731006e0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=5963914697703347763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb1801b7c0 tx=0x7fdb1802b000 comp rx=0 tx=0).stop 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3772855548 shutdown_connections 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73102de0 0x561b731215c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73123700 0x561b73121b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3772855548 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b731006e0 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=5963914697703347763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3772855548 >> 10.20.193.28:0/3772855548 conn(0x561b730011c0 msgr2=0x561b730f7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3772855548 shutdown_connections 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.877+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3772855548 wait complete. 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb321e7e00 1 -- start start 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb321e7e00 1 Processor -- start 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b730dffe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73102de0 0x561b73103280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb321e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73123700 0x561b73103970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561b73104070 con 0x561b73123700 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561b731041e0 con 0x561b730e24c0 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb321e7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561b731043a0 con 0x561b73102de0 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2e082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73123700 0x561b73103970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2d080640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73102de0 0x561b73103280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2e082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73123700 0x561b73103970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50426/0 (socket says 10.20.193.28:50426) 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2e082640 1 -- 10.20.193.28:0/3548977420 learned_addr learned my addr 10.20.193.28:0/3548977420 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:40.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b730dffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2e082640 1 -- 10.20.193.28:0/3548977420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73102de0 msgr2=0x561b73103280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2e082640 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73102de0 0x561b73103280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2e082640 1 -- 10.20.193.28:0/3548977420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 msgr2=0x561b730dffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2e082640 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b730dffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.878+0000 7fdb2e082640 1 -- 10.20.193.28:0/3548977420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b72f83670 con 0x561b73123700 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb2e082640 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73123700 0x561b73103970 secure :-1 s=READY pgs=913 gs=2 cs=0 l=1 c_cookie=8512566242599421507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb24042bf0 tx=0x7fdb24042540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7622b5e5691ec643 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdae2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdae2ffd640 1 -- 10.20.193.28:0/3548977420 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb240ddbb0 con 0x561b73123700 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdae2ffd640 1 -- 10.20.193.28:0/3548977420 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb240d2590 con 0x561b73123700 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b72f71da0 con 0x561b73123700 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 10 client.18081 _ll_register_callbacks cb 0x561b72f78a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b7309dca0 con 0x561b73123700 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdae2ffd640 1 -- 10.20.193.28:0/3548977420 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb240d0ff0 con 0x561b73123700 2026-02-20T13:24:40.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdae2ffd640 1 -- 10.20.193.28:0/3548977420 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdb240d46d0 con 0x561b73123700 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdae2ffd640 1 -- 10.20.193.28:0/3548977420 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdb240d4890 con 0x561b73123700 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 10 client.18081 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561b72f7e0f0 con 0x561b73123700 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdae2ffd640 1 -- 10.20.193.28:0/3548977420 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdb24098020 con 0x561b73123700 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 10 client.18081 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 10 client.18081 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 20 client.18081 populate_metadata read hostname 'trial028' 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561b73105f80 0x561b73106420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 4 client.18081 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.879+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b72cd1640 con 0x561b73105f80 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.880+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561b73105f80 0x561b73106420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.880+0000 7fdb2d881640 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561b73105f80 0x561b73106420 crc :-1 s=READY pgs=225 gs=4 cs=0 l=0 c_cookie=16286178229968921715 s_cookie=7120973431190040938 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e20420cff1ff6473 server_cookie=62d2c79b6d13b16a in_seq=0 out_seq=0 2026-02-20T13:24:40.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.880+0000 7fdae2ffd640 10 client.18081 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.885+0000 7fdae2ffd640 1 -- 10.20.193.28:0/3548977420 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b72cd1640 con 0x561b73105f80 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.885+0000 7fdae2ffd640 10 client.18081 handle_command_reply: tid=0 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 client.18081 shutdown 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73123700 msgr2=0x561b73103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73123700 0x561b73103970 secure :-1 s=READY pgs=913 gs=2 cs=0 l=1 c_cookie=8512566242599421507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb24042bf0 tx=0x7fdb24042540 comp rx=0 tx=0).stop 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 shutdown_connections 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561b73105f80 0x561b73106420 crc :-1 s=READY pgs=225 gs=4 cs=0 l=0 c_cookie=16286178229968921715 s_cookie=7120973431190040938 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561b73123700 0x561b73103970 unknown :-1 s=CLOSED pgs=913 gs=2 cs=0 l=1 c_cookie=8512566242599421507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561b73102de0 0x561b73103280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 --2- 10.20.193.28:0/3548977420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561b730e24c0 0x561b730dffe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdae2ffd640 0 client.18081 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 >> 10.20.193.28:0/3548977420 conn(0x561b730011c0 msgr2=0x561b730f85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 shutdown_connections 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 1 -- 10.20.193.28:0/3548977420 wait complete. 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb321e7e00 20 client.18081 trim_cache size 0 max 16384 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:24:40.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 -- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb040b5760 msgr2=0x7fdb040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb040b5760 0x7fdb040d5c10 secure :-1 s=READY pgs=428 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb18004740 tx=0x7fdb18005f90 comp rx=0 tx=0).stop 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 -- 10.20.193.28:0/3882238397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb28150e50 msgr2=0x7fdb2815d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb28150e50 0x7fdb2815d890 secure :-1 s=READY pgs=339 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb240306c0 tx=0x7fdb24003f60 comp rx=0 tx=0).stop 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 -- 10.20.193.28:0/3882238397 shutdown_connections 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb040b5760 0x7fdb040d5c10 unknown :-1 s=CLOSED pgs=428 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb28062a40 0x7fdb2815cc90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb28150e50 0x7fdb2815d890 unknown :-1 s=CLOSED pgs=339 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 --2- 10.20.193.28:0/3882238397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb28061510 0x7fdb2815c640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 -- 10.20.193.28:0/3882238397 >> 10.20.193.28:0/3882238397 conn(0x7fdb280ea4c0 msgr2=0x7fdb2810a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 -- 10.20.193.28:0/3882238397 shutdown_connections 2026-02-20T13:24:40.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:40.886+0000 7fdb2e883640 1 -- 10.20.193.28:0/3882238397 wait complete. 2026-02-20T13:24:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:40 trial127 ceph-mon[43817]: pgmap v401: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:24:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:40 trial034 ceph-mon[43332]: pgmap v401: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:24:42.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:42 trial028 ceph-mon[37442]: pgmap v402: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:42.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:42 trial127 ceph-mon[43817]: pgmap v402: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:42 trial034 ceph-mon[43332]: pgmap v402: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:44.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:44 trial028 ceph-mon[37442]: pgmap v403: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:24:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:44 trial127 ceph-mon[43817]: pgmap v403: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:24:44.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:44 trial034 ceph-mon[43332]: pgmap v403: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2026-02-20T13:24:46.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:46 trial028 ceph-mon[37442]: pgmap v404: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:24:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:46 trial127 ceph-mon[43817]: pgmap v404: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:24:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:46 trial034 ceph-mon[43332]: pgmap v404: 97 pgs: 97 active+clean; 4.0 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:24:48.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:48 trial028 ceph-mon[37442]: pgmap v405: 97 pgs: 97 active+clean; 4.1 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:48 trial127 ceph-mon[43817]: pgmap v405: 97 pgs: 97 active+clean; 4.1 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:48 trial034 ceph-mon[43332]: pgmap v405: 97 pgs: 97 active+clean; 4.1 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:24:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:50 trial028 ceph-mon[37442]: pgmap v406: 97 pgs: 97 active+clean; 4.1 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:24:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:50 trial127 ceph-mon[43817]: pgmap v406: 97 pgs: 97 active+clean; 4.1 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:24:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:50 trial034 ceph-mon[43332]: pgmap v406: 97 pgs: 97 active+clean; 4.1 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:24:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:52 trial028 ceph-mon[37442]: pgmap v407: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:24:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:52 trial127 ceph-mon[43817]: pgmap v407: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:24:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:52 trial034 ceph-mon[43332]: pgmap v407: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:24:53.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 -- 10.20.193.28:0/4234622508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010e270 msgr2=0x7f102010e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 --2- 10.20.193.28:0/4234622508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010e270 0x7f102010e660 secure :-1 s=READY pgs=914 gs=1 cs=0 l=1 c_cookie=11848744064091848474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1010009980 tx=0x7f101002f190 comp rx=0 tx=0).stop 2026-02-20T13:24:53.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 -- 10.20.193.28:0/4234622508 shutdown_connections 2026-02-20T13:24:53.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 --2- 10.20.193.28:0/4234622508 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f102010d4b0 0x7f102016f240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 --2- 10.20.193.28:0/4234622508 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f102010cb00 0x7f102010cf70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 --2- 10.20.193.28:0/4234622508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010e270 0x7f102010e660 unknown :-1 s=CLOSED pgs=914 gs=1 cs=0 l=1 c_cookie=11848744064091848474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 -- 10.20.193.28:0/4234622508 >> 10.20.193.28:0/4234622508 conn(0x7f10200ea4c0 msgr2=0x7f102010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 -- 10.20.193.28:0/4234622508 shutdown_connections 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.957+0000 7f1026f89640 1 -- 10.20.193.28:0/4234622508 wait complete. 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.958+0000 7f1026f89640 1 Processor -- start 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.958+0000 7f1026f89640 1 -- start start 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.958+0000 7f1026f89640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f102010cb00 0x7f10200f9140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.958+0000 7f1026f89640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010d4b0 0x7f102016f240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.958+0000 7f1026f89640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f102010e270 0x7f10200f99a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.958+0000 7f1026f89640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f10200fa590 con 0x7f102010d4b0 2026-02-20T13:24:53.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.958+0000 7f1026f89640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f10200fa700 con 0x7f102010e270 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.958+0000 7f1026f89640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f10200fa8c0 con 0x7f102010cb00 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010d4b0 0x7f102016f240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1026788640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f102010e270 0x7f10200f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010d4b0 0x7f102016f240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50628/0 (socket says 10.20.193.28:50628) 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 -- 10.20.193.28:0/2619975418 learned_addr learned my addr 10.20.193.28:0/2619975418 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025f87640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f102010cb00 0x7f10200f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 -- 10.20.193.28:0/2619975418 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f102010cb00 msgr2=0x7f10200f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f102010cb00 0x7f10200f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 -- 10.20.193.28:0/2619975418 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f102010e270 msgr2=0x7f10200f99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f102010e270 0x7f10200f99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 -- 10.20.193.28:0/2619975418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1010009570 con 0x7f102010d4b0 2026-02-20T13:24:53.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1025786640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010d4b0 0x7f102016f240 secure :-1 s=READY pgs=915 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1014009480 tx=0x7f101400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:53.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f100effd640 1 -- 10.20.193.28:0/2619975418 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f101400cd40 con 0x7f102010d4b0 2026-02-20T13:24:53.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f100effd640 1 -- 10.20.193.28:0/2619975418 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1014004d30 con 0x7f102010d4b0 2026-02-20T13:24:53.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1026f89640 1 -- 10.20.193.28:0/2619975418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10200faba0 con 0x7f102010d4b0 2026-02-20T13:24:53.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f100effd640 1 -- 10.20.193.28:0/2619975418 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1014010740 con 0x7f102010d4b0 2026-02-20T13:24:53.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.959+0000 7f1026f89640 1 -- 10.20.193.28:0/2619975418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10200fb070 con 0x7f102010d4b0 2026-02-20T13:24:53.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.962+0000 7f100effd640 1 -- 10.20.193.28:0/2619975418 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f101401f060 con 0x7f102010d4b0 2026-02-20T13:24:53.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.963+0000 7f100effd640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ffc0b57e0 0x7f0ffc0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.963+0000 7f100effd640 1 -- 10.20.193.28:0/2619975418 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1014014070 con 0x7f102010d4b0 2026-02-20T13:24:53.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.963+0000 7f1025f87640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ffc0b57e0 0x7f0ffc0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.964+0000 7f1025f87640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ffc0b57e0 0x7f0ffc0d5c90 secure :-1 s=READY pgs=429 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10100098a0 tx=0x7f1010031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:53.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f102a7f4e00 1 Processor -- start 2026-02-20T13:24:53.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f102a7f4e00 1 -- start start 2026-02-20T13:24:53.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a0f4c0 0x563be9a2f8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a2fde0 0x563be9a501c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a70ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563be9924fd0 con 0x563be9a0f4c0 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563be9920d00 con 0x563be9a50700 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563be991aca0 con 0x563be9a2fde0 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025f87640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a0f4c0 0x563be9a2f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025786640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a2fde0 0x563be9a501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025786640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a2fde0 0x563be9a501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48254/0 (socket says 10.20.193.28:48254) 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025786640 1 -- 10.20.193.28:0/3481012228 learned_addr learned my addr 10.20.193.28:0/3481012228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:53.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025f87640 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a0f4c0 0x563be9a2f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50632/0 (socket says 10.20.193.28:50632) 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1026788640 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a70ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025786640 1 -- 10.20.193.28:0/3481012228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 msgr2=0x563be9a70ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025786640 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a70ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025786640 1 -- 10.20.193.28:0/3481012228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a0f4c0 msgr2=0x563be9a2f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025786640 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a0f4c0 0x563be9a2f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025786640 1 -- 10.20.193.28:0/3481012228 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be98bd8b0 con 0x563be9a2fde0 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.965+0000 7f1025f87640 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a0f4c0 0x563be9a2f8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f1025786640 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a2fde0 0x563be9a501c0 secure :-1 s=READY pgs=281 gs=2 cs=0 l=1 c_cookie=18361240754753257918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10140a9710 tx=0x7f10140a9860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fed03b2f367e41be server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f0fee3ff640 1 -- 10.20.193.28:0/3481012228 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10140ac940 con 0x563be9a2fde0 2026-02-20T13:24:53.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f0fee3ff640 1 -- 10.20.193.28:0/3481012228 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f10140adb40 con 0x563be9a2fde0 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f0fee3ff640 1 -- 10.20.193.28:0/3481012228 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10140acf60 con 0x563be9a2fde0 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 -- 10.20.193.28:0/3481012228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a2fde0 msgr2=0x563be9a501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a2fde0 0x563be9a501c0 secure :-1 s=READY pgs=281 gs=2 cs=0 l=1 c_cookie=18361240754753257918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10140a9710 tx=0x7f10140a9860 comp rx=0 tx=0).stop 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 -- 10.20.193.28:0/3481012228 shutdown_connections 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a70ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a2fde0 0x563be9a501c0 unknown :-1 s=CLOSED pgs=281 gs=2 cs=0 l=1 c_cookie=18361240754753257918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/3481012228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a0f4c0 0x563be9a2f8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 -- 10.20.193.28:0/3481012228 >> 10.20.193.28:0/3481012228 conn(0x563be992e1c0 msgr2=0x563be9a0dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 -- 10.20.193.28:0/3481012228 shutdown_connections 2026-02-20T13:24:53.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.966+0000 7f102a7f4e00 1 -- 10.20.193.28:0/3481012228 wait complete. 2026-02-20T13:24:53.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.967+0000 7f102a7f4e00 1 -- start start 2026-02-20T13:24:53.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f102a7f4e00 1 Processor -- start 2026-02-20T13:24:53.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a2fde0 0x563be9a29230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a50700 0x563be9a29c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563be9a2a2f0 con 0x563be9a50700 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563be9a2a460 con 0x563be9a2fde0 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563be9a2a620 con 0x563be9a0f4c0 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1025f87640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1026788640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a50700 0x563be9a29c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1025f87640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48264/0 (socket says 10.20.193.28:48264) 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1025f87640 1 -- 10.20.193.28:0/1747092223 learned_addr learned my addr 10.20.193.28:0/1747092223 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1025786640 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a2fde0 0x563be9a29230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1026788640 1 -- 10.20.193.28:0/1747092223 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 msgr2=0x563be9a28be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:53.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1026788640 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1026788640 1 -- 10.20.193.28:0/1747092223 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a2fde0 msgr2=0x563be9a29230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1026788640 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a2fde0 0x563be9a29230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1026788640 1 -- 10.20.193.28:0/1747092223 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be98c6400 con 0x563be9a50700 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.968+0000 7f1025f87640 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28be0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f1026788640 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a50700 0x563be9a29c90 secure :-1 s=READY pgs=916 gs=2 cs=0 l=1 c_cookie=17657757937042952931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f101c005820 tx=0x7f101c00aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50cf549f74792e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f0fdb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/1747092223 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f101c018070 con 0x563be9a50700 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10200fb070 con 0x563be9a50700 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/1747092223 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f101c011d40 con 0x563be9a50700 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 10 client.18093 _ll_register_callbacks cb 0x563be98a5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:53.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563be95ba520 con 0x563be9a50700 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/1747092223 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f101c018070 con 0x563be9a50700 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/1747092223 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f101c010dd0 con 0x563be9a50700 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/1747092223 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f101c011860 con 0x563be9a50700 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 10 client.18093 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563be989eda0 con 0x563be9a50700 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/1747092223 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f101c0119c0 con 0x563be9a50700 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 10 client.18093 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 10 client.18093 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 20 client.18093 populate_metadata read hostname 'trial028' 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563be9a2d390 0x563be9a2d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 4 client.18093 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:53.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.969+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563be994c630 con 0x563be9a2d390 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.970+0000 7f1025f87640 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563be9a2d390 0x563be9a2d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.970+0000 7f1025f87640 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563be9a2d390 0x563be9a2d830 crc :-1 s=READY pgs=226 gs=4 cs=0 l=0 c_cookie=14586747980344575852 s_cookie=3389920804904905580 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca6e8a011495c76c server_cookie=2f0b6b02f1102b6c in_seq=0 out_seq=0 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.970+0000 7f0fdb7fe640 10 client.18093 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/1747092223 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563be994c630 con 0x563be9a2d390 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f0fdb7fe640 10 client.18093 handle_command_reply: tid=0 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 client.18093 shutdown 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a50700 msgr2=0x563be9a29c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a50700 0x563be9a29c90 secure :-1 s=READY pgs=916 gs=2 cs=0 l=1 c_cookie=17657757937042952931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f101c005820 tx=0x7f101c00aab0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 shutdown_connections 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563be9a2d390 0x563be9a2d830 crc :-1 s=READY pgs=226 gs=4 cs=0 l=0 c_cookie=14586747980344575852 s_cookie=3389920804904905580 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a50700 0x563be9a29c90 unknown :-1 s=CLOSED pgs=916 gs=2 cs=0 l=1 c_cookie=17657757937042952931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a2fde0 0x563be9a29230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1747092223 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28be0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f0fdb7fe640 0 client.18093 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:53.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 >> 10.20.193.28:0/1747092223 conn(0x563be992e1c0 msgr2=0x563be9a10790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:53.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 shutdown_connections 2026-02-20T13:24:53.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1747092223 wait complete. 2026-02-20T13:24:53.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.971+0000 7f102a7f4e00 20 client.18093 trim_cache size 0 max 16384 2026-02-20T13:24:53.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f102a7f4e00 1 Processor -- start 2026-02-20T13:24:53.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f102a7f4e00 1 -- start start 2026-02-20T13:24:53.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a2e110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a2e650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563be99188d0 con 0x563be9a2fde0 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563be9659f10 con 0x563be9a50700 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563be9a1acd0 con 0x563be9a0f4c0 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025786640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a2e110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025f87640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025786640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a2e110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50646/0 (socket says 10.20.193.28:50646) 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025786640 1 -- 10.20.193.28:0/1091562976 learned_addr learned my addr 10.20.193.28:0/1091562976 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025f87640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48270/0 (socket says 10.20.193.28:48270) 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1026788640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a2e650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025786640 1 -- 10.20.193.28:0/1091562976 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 msgr2=0x563be9a28260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:53.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025786640 1 --2- 10.20.193.28:0/1091562976 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025786640 1 -- 10.20.193.28:0/1091562976 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 msgr2=0x563be9a2e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.979+0000 7f1025786640 1 --2- 10.20.193.28:0/1091562976 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a2e650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f1025786640 1 -- 10.20.193.28:0/1091562976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be98b0670 con 0x563be9a2fde0 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f1026788640 1 --2- 10.20.193.28:0/1091562976 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a2e650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f1025786640 1 --2- 10.20.193.28:0/1091562976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a2e110 secure :-1 s=READY pgs=917 gs=2 cs=0 l=1 c_cookie=10092938049186972457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10140aa3b0 tx=0x7f1014005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1151ae59d04329 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f0fedbfe640 1 -- 10.20.193.28:0/1091562976 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10140ac940 con 0x563be9a2fde0 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f0fedbfe640 1 -- 10.20.193.28:0/1091562976 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f10140adb40 con 0x563be9a2fde0 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f0fedbfe640 1 -- 10.20.193.28:0/1091562976 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10140acf60 con 0x563be9a2fde0 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1091562976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 msgr2=0x563be9a2e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1091562976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a2e110 secure :-1 s=READY pgs=917 gs=2 cs=0 l=1 c_cookie=10092938049186972457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10140aa3b0 tx=0x7f1014005570 comp rx=0 tx=0).stop 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1091562976 shutdown_connections 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1091562976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a2e110 unknown :-1 s=CLOSED pgs=917 gs=2 cs=0 l=1 c_cookie=10092938049186972457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1091562976 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a50700 0x563be9a2e650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/1091562976 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a0f4c0 0x563be9a28260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1091562976 >> 10.20.193.28:0/1091562976 conn(0x563be992e1c0 msgr2=0x563be9a4e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1091562976 shutdown_connections 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.980+0000 7f102a7f4e00 1 -- 10.20.193.28:0/1091562976 wait complete. 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f102a7f4e00 1 -- start start 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f102a7f4e00 1 Processor -- start 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a0f4c0 0x563be9a263a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a301b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f102a7f4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a50700 0x563be9a306f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563be9a30d30 con 0x563be9a2fde0 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563be9a30ea0 con 0x563be9a0f4c0 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f102a7f4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563be9a31060 con 0x563be9a50700 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f1025f87640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a0f4c0 0x563be9a263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f1025f87640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a0f4c0 0x563be9a263a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59170/0 (socket says 10.20.193.28:59170) 2026-02-20T13:24:53.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f1025f87640 1 -- 10.20.193.28:0/856035766 learned_addr learned my addr 10.20.193.28:0/856035766 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.981+0000 7f1025786640 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f1025f87640 1 -- 10.20.193.28:0/856035766 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a50700 msgr2=0x563be9a306f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f1025f87640 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a50700 0x563be9a306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f1025f87640 1 -- 10.20.193.28:0/856035766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 msgr2=0x563be9a301b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f1025f87640 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a301b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f1025f87640 1 -- 10.20.193.28:0/856035766 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be98ab0f0 con 0x563be9a0f4c0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f1025786640 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a301b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f1025f87640 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a0f4c0 0x563be9a263a0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=14018759189001577566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1010009950 tx=0x7f1010009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28ca335342ea45e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f0fdb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/856035766 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1010058070 con 0x563be9a0f4c0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/856035766 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1010038920 con 0x563be9a0f4c0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563be98bd8b0 con 0x563be9a0f4c0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f102a7f4e00 10 client.28049 _ll_register_callbacks cb 0x563be98a5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563be964c250 con 0x563be9a0f4c0 2026-02-20T13:24:53.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/856035766 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1010058b00 con 0x563be9a0f4c0 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/856035766 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1010058c90 con 0x563be9a0f4c0 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/856035766 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1010058e50 con 0x563be9a0f4c0 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f102a7f4e00 10 client.28049 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.982+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563be989f0d0 con 0x563be9a0f4c0 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/856035766 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f101005f070 con 0x563be9a0f4c0 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f102a7f4e00 10 client.28049 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f102a7f4e00 10 client.28049 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f102a7f4e00 20 client.28049 populate_metadata read hostname 'trial028' 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563be9a33020 0x563be9a334c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f102a7f4e00 4 client.28049 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563be99caca0 con 0x563be9a33020 2026-02-20T13:24:53.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f1025786640 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563be9a33020 0x563be9a334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:53.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f1025786640 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563be9a33020 0x563be9a334c0 crc :-1 s=READY pgs=227 gs=4 cs=0 l=0 c_cookie=3289267162311565264 s_cookie=12681143125019003277 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da5d30e8cf01fd0 server_cookie=affc787c10a5098d in_seq=0 out_seq=0 2026-02-20T13:24:53.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.983+0000 7f0fdb7fe640 10 client.28049 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f0fdb7fe640 1 -- 10.20.193.28:0/856035766 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563be99caca0 con 0x563be9a33020 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f0fdb7fe640 10 client.28049 handle_command_reply: tid=0 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 client.28049 shutdown 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a0f4c0 msgr2=0x563be9a263a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a0f4c0 0x563be9a263a0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=14018759189001577566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1010009950 tx=0x7f1010009310 comp rx=0 tx=0).stop 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 shutdown_connections 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563be9a33020 0x563be9a334c0 crc :-1 s=READY pgs=227 gs=4 cs=0 l=0 c_cookie=3289267162311565264 s_cookie=12681143125019003277 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563be9a2fde0 0x563be9a301b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563be9a50700 0x563be9a306f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 --2- 10.20.193.28:0/856035766 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563be9a0f4c0 0x563be9a263a0 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=14018759189001577566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 >> 10.20.193.28:0/856035766 conn(0x563be992e1c0 msgr2=0x563be9a4e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f0fdb7fe640 0 client.28049 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 shutdown_connections 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 1 -- 10.20.193.28:0/856035766 wait complete. 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f102a7f4e00 20 client.28049 trim_cache size 0 max 16384 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:24:53.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f1026f89640 1 -- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ffc0b57e0 msgr2=0x7f0ffc0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f1026f89640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ffc0b57e0 0x7f0ffc0d5c90 secure :-1 s=READY pgs=429 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10100098a0 tx=0x7f1010031040 comp rx=0 tx=0).stop 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f1026f89640 1 -- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010d4b0 msgr2=0x7f102016f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.989+0000 7f1026f89640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010d4b0 0x7f102016f240 secure :-1 s=READY pgs=915 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1014009480 tx=0x7f101400ee60 comp rx=0 tx=0).stop 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.990+0000 7f1026f89640 1 -- 10.20.193.28:0/2619975418 shutdown_connections 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.990+0000 7f1026f89640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ffc0b57e0 0x7f0ffc0d5c90 unknown :-1 s=CLOSED pgs=429 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.990+0000 7f1026f89640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010d4b0 0x7f102016f240 unknown :-1 s=CLOSED pgs=915 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.990+0000 7f1026f89640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f102010e270 0x7f10200f99a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.990+0000 7f1026f89640 1 --2- 10.20.193.28:0/2619975418 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f102010cb00 0x7f10200f9140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.990+0000 7f1026f89640 1 -- 10.20.193.28:0/2619975418 >> 10.20.193.28:0/2619975418 conn(0x7f10200ea4c0 msgr2=0x7f1020060e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.990+0000 7f1026f89640 1 -- 10.20.193.28:0/2619975418 shutdown_connections 2026-02-20T13:24:53.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:24:53.990+0000 7f1026f89640 1 -- 10.20.193.28:0/2619975418 wait complete. 2026-02-20T13:24:54.267 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:24:54.452 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:54.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 -- 10.20.193.28:0/4153693841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96301157e0 msgr2=0x7f96301761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 --2- 10.20.193.28:0/4153693841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96301157e0 0x7f96301761b0 secure :-1 s=READY pgs=918 gs=2 cs=0 l=1 c_cookie=15941107920675160542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f962000aa30 tx=0x7f9620030270 comp rx=0 tx=0).stop 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 -- 10.20.193.28:0/4153693841 shutdown_connections 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 --2- 10.20.193.28:0/4153693841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96301157e0 0x7f96301761b0 unknown :-1 s=CLOSED pgs=918 gs=2 cs=0 l=1 c_cookie=15941107920675160542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 --2- 10.20.193.28:0/4153693841 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f963010ffe0 0x7f9630115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 --2- 10.20.193.28:0/4153693841 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f963010f5f0 0x7f963010f9c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 -- 10.20.193.28:0/4153693841 >> 10.20.193.28:0/4153693841 conn(0x7f96300ecea0 msgr2=0x7f963010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 -- 10.20.193.28:0/4153693841 shutdown_connections 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 -- 10.20.193.28:0/4153693841 wait complete. 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.624+0000 7f9634cad640 1 Processor -- start 2026-02-20T13:24:54.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f9634cad640 1 -- start start 2026-02-20T13:24:54.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f9634cad640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f963010f5f0 0x7f963011d480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f9634cad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f963010ffe0 0x7f963011d9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f9634cad640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96301157e0 0x7f9630122d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f9634cad640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f96301233b0 con 0x7f963010ffe0 2026-02-20T13:24:54.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f9634cad640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9630123520 con 0x7f963010f5f0 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f9634cad640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f96301236e0 con 0x7f96301157e0 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f963010ffe0 0x7f963011d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f963010f5f0 0x7f963011d480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f963010ffe0 0x7f963011d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50674/0 (socket says 10.20.193.28:50674) 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962dd74640 1 -- 10.20.193.28:0/2160172772 learned_addr learned my addr 10.20.193.28:0/2160172772 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f963010f5f0 0x7f963011d480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59178/0 (socket says 10.20.193.28:59178) 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962ed76640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96301157e0 0x7f9630122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962dd74640 1 -- 10.20.193.28:0/2160172772 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96301157e0 msgr2=0x7f9630122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962dd74640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96301157e0 0x7f9630122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962dd74640 1 -- 10.20.193.28:0/2160172772 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f963010f5f0 msgr2=0x7f963011d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962dd74640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f963010f5f0 0x7f963011d480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.625+0000 7f962dd74640 1 -- 10.20.193.28:0/2160172772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962000a650 con 0x7f963010ffe0 2026-02-20T13:24:54.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.626+0000 7f962dd74640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f963010ffe0 0x7f963011d9c0 secure :-1 s=READY pgs=919 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9618009480 tx=0x7f961800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:54.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.626+0000 7f96177fe640 1 -- 10.20.193.28:0/2160172772 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f961800cd40 con 0x7f963010ffe0 2026-02-20T13:24:54.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.626+0000 7f9634cad640 1 -- 10.20.193.28:0/2160172772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96301239c0 con 0x7f963010ffe0 2026-02-20T13:24:54.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.626+0000 7f9634cad640 1 -- 10.20.193.28:0/2160172772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96301640c0 con 0x7f963010ffe0 2026-02-20T13:24:54.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.626+0000 7f96177fe640 1 -- 10.20.193.28:0/2160172772 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9618004d30 con 0x7f963010ffe0 2026-02-20T13:24:54.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.626+0000 7f96177fe640 1 -- 10.20.193.28:0/2160172772 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9618010740 con 0x7f963010ffe0 2026-02-20T13:24:54.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.629+0000 7f96177fe640 1 -- 10.20.193.28:0/2160172772 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f961801f060 con 0x7f963010ffe0 2026-02-20T13:24:54.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.630+0000 7f96177fe640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96080b5760 0x7f96080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.630+0000 7f96177fe640 1 -- 10.20.193.28:0/2160172772 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9618014070 con 0x7f963010ffe0 2026-02-20T13:24:54.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.630+0000 7f962e575640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96080b5760 0x7f96080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.631+0000 7f962e575640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96080b5760 0x7f96080d5c10 secure :-1 s=READY pgs=430 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9624004740 tx=0x7f9624005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:54.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f9636ca7e00 1 Processor -- start 2026-02-20T13:24:54.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f9636ca7e00 1 -- start start 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3180 0x564c9e6b3550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e6f8400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e718d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c9e5c97d0 con 0x564c9e6b3a90 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564c9e5c5500 con 0x564c9e6b3180 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564c9e5bf4a0 con 0x564c9e6f8940 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f962e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3180 0x564c9e6b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f962e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3180 0x564c9e6b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59192/0 (socket says 10.20.193.28:59192) 2026-02-20T13:24:54.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f962e575640 1 -- 10.20.193.28:0/2560011311 learned_addr learned my addr 10.20.193.28:0/2560011311 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f962dd74640 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e6f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.632+0000 7f962ed76640 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e718d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f962e575640 1 -- 10.20.193.28:0/2560011311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 msgr2=0x564c9e718d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f962e575640 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e718d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f962e575640 1 -- 10.20.193.28:0/2560011311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 msgr2=0x564c9e6f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f962e575640 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e6f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f962e575640 1 -- 10.20.193.28:0/2560011311 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c9e56ad80 con 0x564c9e6b3180 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f962dd74640 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e6f8400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f962ed76640 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e718d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:54.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f962e575640 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3180 0x564c9e6b3550 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=7660872008213393393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9624004220 tx=0x7f9624014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a50e2809f4aeff1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9614ff9640 1 -- 10.20.193.28:0/2560011311 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9624011e60 con 0x564c9e6b3180 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9614ff9640 1 -- 10.20.193.28:0/2560011311 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9624009da0 con 0x564c9e6b3180 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9614ff9640 1 -- 10.20.193.28:0/2560011311 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f962401a6e0 con 0x564c9e6b3180 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2560011311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3180 msgr2=0x564c9e6b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3180 0x564c9e6b3550 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=7660872008213393393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9624004220 tx=0x7f9624014000 comp rx=0 tx=0).stop 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2560011311 shutdown_connections 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e6f8400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e718d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2560011311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3180 0x564c9e6b3550 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=7660872008213393393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2560011311 >> 10.20.193.28:0/2560011311 conn(0x564c9e691680 msgr2=0x564c9e6b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:54.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2560011311 shutdown_connections 2026-02-20T13:24:54.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.633+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2560011311 wait complete. 2026-02-20T13:24:54.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f9636ca7e00 1 -- start start 2026-02-20T13:24:54.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f9636ca7e00 1 Processor -- start 2026-02-20T13:24:54.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6d4560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6d4aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e6d74c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c9e6d7a00 con 0x564c9e6b3180 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564c9e6d7b70 con 0x564c9e6b3a90 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564c9e6d7d30 con 0x564c9e6f8940 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f962dd74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f962e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f962ed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e6d74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f962dd74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6d4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59196/0 (socket says 10.20.193.28:59196) 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.635+0000 7f962dd74640 1 -- 10.20.193.28:0/2441698741 learned_addr learned my addr 10.20.193.28:0/2441698741 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:54.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f962e575640 1 -- 10.20.193.28:0/2441698741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 msgr2=0x564c9e6d74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f962e575640 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e6d74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f962e575640 1 -- 10.20.193.28:0/2441698741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 msgr2=0x564c9e6d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f962e575640 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6d4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f962e575640 1 -- 10.20.193.28:0/2441698741 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9624009970 con 0x564c9e6b3180 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f962e575640 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6d4560 secure :-1 s=READY pgs=920 gs=1 cs=0 l=1 c_cookie=16892412176859317338 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9624004220 tx=0x7f96240054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6de760012ec45a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f95dbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f95dbfff640 1 -- 10.20.193.28:0/2441698741 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f962401a460 con 0x564c9e6b3180 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f95dbfff640 1 -- 10.20.193.28:0/2441698741 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f962401a5c0 con 0x564c9e6b3180 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f95dbfff640 1 -- 10.20.193.28:0/2441698741 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f962402d430 con 0x564c9e6b3180 2026-02-20T13:24:54.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9630176a20 con 0x564c9e6b3180 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f9636ca7e00 10 client.18108 _ll_register_callbacks cb 0x564c9e5409a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c9e2556f0 con 0x564c9e6b3180 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f95dbfff640 1 -- 10.20.193.28:0/2441698741 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f962401a870 con 0x564c9e6b3180 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f95dbfff640 1 -- 10.20.193.28:0/2441698741 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9624004770 con 0x564c9e6b3180 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.636+0000 7f9636ca7e00 10 client.18108 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564c9e543350 con 0x564c9e6b3180 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f95dbfff640 1 -- 10.20.193.28:0/2441698741 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f962401aa30 con 0x564c9e6b3180 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f9636ca7e00 10 client.18108 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f9636ca7e00 10 client.18108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f9636ca7e00 20 client.18108 populate_metadata read hostname 'trial028' 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c9e6de7c0 0x564c9e6dec60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f9636ca7e00 4 client.18108 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c9e5ccd60 con 0x564c9e6de7c0 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.637+0000 7f962dd74640 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c9e6de7c0 0x564c9e6dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.638+0000 7f962dd74640 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c9e6de7c0 0x564c9e6dec60 crc :-1 s=READY pgs=228 gs=4 cs=0 l=0 c_cookie=3745013790873501183 s_cookie=17758264473707745488 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33f8f6336bf43dff server_cookie=f672077396ca10d0 in_seq=0 out_seq=0 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.638+0000 7f95dbfff640 10 client.18108 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f95dbfff640 1 -- 10.20.193.28:0/2441698741 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564c9e5ccd60 con 0x564c9e6de7c0 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f95dbfff640 10 client.18108 handle_command_reply: tid=0 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 client.18108 shutdown 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 msgr2=0x564c9e6d4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6d4560 secure :-1 s=READY pgs=920 gs=1 cs=0 l=1 c_cookie=16892412176859317338 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9624004220 tx=0x7f96240054b0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 shutdown_connections 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c9e6de7c0 0x564c9e6dec60 crc :-1 s=READY pgs=228 gs=4 cs=0 l=0 c_cookie=3745013790873501183 s_cookie=17758264473707745488 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e6d74c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6d4aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/2441698741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6d4560 unknown :-1 s=CLOSED pgs=920 gs=1 cs=0 l=1 c_cookie=16892412176859317338 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 >> 10.20.193.28:0/2441698741 conn(0x564c9e691680 msgr2=0x564c9e69ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f95dbfff640 0 client.18108 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 shutdown_connections 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 1 -- 10.20.193.28:0/2441698741 wait complete. 2026-02-20T13:24:54.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.639+0000 7f9636ca7e00 20 client.18108 trim_cache size 0 max 16384 2026-02-20T13:24:54.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.648+0000 7f9636ca7e00 1 Processor -- start 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f9636ca7e00 1 -- start start 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6b3180 0x564c9e69dc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e69e1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6f8940 0x564c9e6b1ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c9e5bd0d0 con 0x564c9e6b3a90 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564c9e27d700 con 0x564c9e6f8940 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564c9e6b3790 con 0x564c9e6b3180 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e69e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6b3180 0x564c9e69dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6b3180 0x564c9e69dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48314/0 (socket says 10.20.193.28:48314) 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962e575640 1 -- 10.20.193.28:0/779278985 learned_addr learned my addr 10.20.193.28:0/779278985 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962ed76640 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6f8940 0x564c9e6b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962dd74640 1 -- 10.20.193.28:0/779278985 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6b3180 msgr2=0x564c9e69dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962dd74640 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6b3180 0x564c9e69dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962dd74640 1 -- 10.20.193.28:0/779278985 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6f8940 msgr2=0x564c9e6b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962dd74640 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6f8940 0x564c9e6b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962dd74640 1 -- 10.20.193.28:0/779278985 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c9e6a5700 con 0x564c9e6b3a90 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.649+0000 7f962ed76640 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6f8940 0x564c9e6b1ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:54.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f962dd74640 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e69e1b0 secure :-1 s=READY pgs=921 gs=2 cs=0 l=1 c_cookie=1689110897909429937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9618004f50 tx=0x7f96180e5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1770ed699021f6b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:54.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f95fa4e6640 1 -- 10.20.193.28:0/779278985 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96180b3ea0 con 0x564c9e6b3a90 2026-02-20T13:24:54.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f95fa4e6640 1 -- 10.20.193.28:0/779278985 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f96180b6480 con 0x564c9e6b3a90 2026-02-20T13:24:54.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f95fa4e6640 1 -- 10.20.193.28:0/779278985 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96180add20 con 0x564c9e6b3a90 2026-02-20T13:24:54.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 -- 10.20.193.28:0/779278985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 msgr2=0x564c9e69e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e69e1b0 secure :-1 s=READY pgs=921 gs=2 cs=0 l=1 c_cookie=1689110897909429937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9618004f50 tx=0x7f96180e5040 comp rx=0 tx=0).stop 2026-02-20T13:24:54.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 -- 10.20.193.28:0/779278985 shutdown_connections 2026-02-20T13:24:54.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3a90 0x564c9e69e1b0 unknown :-1 s=CLOSED pgs=921 gs=2 cs=0 l=1 c_cookie=1689110897909429937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6f8940 0x564c9e6b1ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/779278985 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6b3180 0x564c9e69dc70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 -- 10.20.193.28:0/779278985 >> 10.20.193.28:0/779278985 conn(0x564c9e691680 msgr2=0x564c9e6de7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 -- 10.20.193.28:0/779278985 shutdown_connections 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.650+0000 7f9636ca7e00 1 -- 10.20.193.28:0/779278985 wait complete. 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.651+0000 7f9636ca7e00 1 -- start start 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.651+0000 7f9636ca7e00 1 Processor -- start 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.651+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6e4dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.651+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6df320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.651+0000 7f9636ca7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e6df860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.651+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c9e6dfda0 con 0x564c9e6b3180 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.651+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564c9e6dff10 con 0x564c9e6b3a90 2026-02-20T13:24:54.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.651+0000 7f9636ca7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564c9e6e00d0 con 0x564c9e6f8940 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962dd74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6df320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6e4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50694/0 (socket says 10.20.193.28:50694) 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 -- 10.20.193.28:0/588254830 learned_addr learned my addr 10.20.193.28:0/588254830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962ed76640 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e6df860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 -- 10.20.193.28:0/588254830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 msgr2=0x564c9e6df860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e6df860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 -- 10.20.193.28:0/588254830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 msgr2=0x564c9e6df320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6df320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 -- 10.20.193.28:0/588254830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c9e555150 con 0x564c9e6b3180 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f962e575640 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6e4dc0 secure :-1 s=READY pgs=922 gs=1 cs=0 l=1 c_cookie=5191709133872248254 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9624004390 tx=0x7f9624009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480ca7f34d9b35be server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f95dbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f95dbfff640 1 -- 10.20.193.28:0/588254830 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9624045070 con 0x564c9e6b3180 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f95dbfff640 1 -- 10.20.193.28:0/588254830 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564c9e2556f0 con 0x564c9e6b3180 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f95dbfff640 1 -- 10.20.193.28:0/588254830 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f962401b3f0 con 0x564c9e6b3180 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.652+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96301239c0 con 0x564c9e6b3180 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 10 client.18114 _ll_register_callbacks cb 0x564c9e5409a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9624009da0 con 0x564c9e6b3180 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f95dbfff640 1 -- 10.20.193.28:0/588254830 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f962401b580 con 0x564c9e6b3180 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f95dbfff640 1 -- 10.20.193.28:0/588254830 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f962401b780 con 0x564c9e6b3180 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 10 client.18114 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:54.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564c9e54fbd0 con 0x564c9e6b3180 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f95dbfff640 1 -- 10.20.193.28:0/588254830 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9624024640 con 0x564c9e6b3180 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 10 client.18114 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 10 client.18114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 20 client.18114 populate_metadata read hostname 'trial028' 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c9e7ae550 0x564c9e7ce9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 4 client.18114 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c9e252f40 con 0x564c9e7ae550 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.653+0000 7f962dd74640 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c9e7ae550 0x564c9e7ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.654+0000 7f962dd74640 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c9e7ae550 0x564c9e7ce9d0 crc :-1 s=READY pgs=229 gs=4 cs=0 l=0 c_cookie=2883346210045561308 s_cookie=3847141696822910935 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2803b419f63c09dc server_cookie=3563cafd7fb91fd7 in_seq=0 out_seq=0 2026-02-20T13:24:54.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.654+0000 7f95dbfff640 10 client.18114 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f95dbfff640 1 -- 10.20.193.28:0/588254830 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x564c9e252f40 con 0x564c9e7ae550 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f95dbfff640 10 client.18114 handle_command_reply: tid=0 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 client.18114 shutdown 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 msgr2=0x564c9e6e4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6e4dc0 secure :-1 s=READY pgs=922 gs=1 cs=0 l=1 c_cookie=5191709133872248254 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9624004390 tx=0x7f9624009690 comp rx=0 tx=0).stop 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 shutdown_connections 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564c9e7ae550 0x564c9e7ce9d0 crc :-1 s=READY pgs=229 gs=4 cs=0 l=0 c_cookie=2883346210045561308 s_cookie=3847141696822910935 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564c9e6f8940 0x564c9e6df860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564c9e6b3a90 0x564c9e6df320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 --2- 10.20.193.28:0/588254830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c9e6b3180 0x564c9e6e4dc0 unknown :-1 s=CLOSED pgs=922 gs=1 cs=0 l=1 c_cookie=5191709133872248254 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 >> 10.20.193.28:0/588254830 conn(0x564c9e691680 msgr2=0x564c9e6f7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:54.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f95dbfff640 0 client.18114 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:54.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 shutdown_connections 2026-02-20T13:24:54.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 1 -- 10.20.193.28:0/588254830 wait complete. 2026-02-20T13:24:54.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9636ca7e00 20 client.18114 trim_cache size 0 max 16384 2026-02-20T13:24:54.665 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:24:54.665 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:24:54.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:24:54.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:24:54.665 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:24:54.665 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:24:54.665 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.667 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:24:54.669 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.670 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.671 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.672 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:54.673 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9634cad640 1 -- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96080b5760 msgr2=0x7f96080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9634cad640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96080b5760 0x7f96080d5c10 secure :-1 s=READY pgs=430 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9624004740 tx=0x7f9624005f90 comp rx=0 tx=0).stop 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9634cad640 1 -- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f963010ffe0 msgr2=0x7f963011d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.655+0000 7f9634cad640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f963010ffe0 0x7f963011d9c0 secure :-1 s=READY pgs=919 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9618009480 tx=0x7f961800ee60 comp rx=0 tx=0).stop 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.656+0000 7f9634cad640 1 -- 10.20.193.28:0/2160172772 shutdown_connections 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.656+0000 7f9634cad640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f96080b5760 0x7f96080d5c10 unknown :-1 s=CLOSED pgs=430 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.656+0000 7f9634cad640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f963010ffe0 0x7f963011d9c0 unknown :-1 s=CLOSED pgs=919 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.656+0000 7f9634cad640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f96301157e0 0x7f9630122d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.656+0000 7f9634cad640 1 --2- 10.20.193.28:0/2160172772 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f963010f5f0 0x7f963011d480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.656+0000 7f9634cad640 1 -- 10.20.193.28:0/2160172772 >> 10.20.193.28:0/2160172772 conn(0x7f96300ecea0 msgr2=0x7f963010d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.657+0000 7f9634cad640 1 -- 10.20.193.28:0/2160172772 shutdown_connections 2026-02-20T13:24:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:54.657+0000 7f9634cad640 1 -- 10.20.193.28:0/2160172772 wait complete. 2026-02-20T13:24:54.756 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:24:54.756 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:24:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:54 trial028 ceph-mon[37442]: pgmap v408: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:24:54.941 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:54 trial127 ceph-mon[43817]: pgmap v408: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:24:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:54 trial034 ceph-mon[43332]: pgmap v408: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:24:55.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 -- 10.20.193.28:0/2710293777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 msgr2=0x7f5ec410f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 --2- 10.20.193.28:0/2710293777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 0x7f5ec410f880 secure :-1 s=READY pgs=923 gs=1 cs=0 l=1 c_cookie=14718720675056364120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eb8009950 tx=0x7f5eb802f190 comp rx=0 tx=0).stop 2026-02-20T13:24:55.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 -- 10.20.193.28:0/2710293777 shutdown_connections 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 --2- 10.20.193.28:0/2710293777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ec41156a0 0x7f5ec4176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 --2- 10.20.193.28:0/2710293777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ec410fea0 0x7f5ec4114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 --2- 10.20.193.28:0/2710293777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 0x7f5ec410f880 unknown :-1 s=CLOSED pgs=923 gs=1 cs=0 l=1 c_cookie=14718720675056364120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 -- 10.20.193.28:0/2710293777 >> 10.20.193.28:0/2710293777 conn(0x7f5ec40ecda0 msgr2=0x7f5ec410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 -- 10.20.193.28:0/2710293777 shutdown_connections 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 -- 10.20.193.28:0/2710293777 wait complete. 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 Processor -- start 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.121+0000 7f5ec3577640 1 -- start start 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 0x7f5ec411de50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec3577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ec410fea0 0x7f5ec411e390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec3577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ec41156a0 0x7f5ec4123760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec3577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec4123d80 con 0x7f5ec410f4b0 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec3577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec4123ef0 con 0x7f5ec410fea0 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec3577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec41240b0 con 0x7f5ec41156a0 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 0x7f5ec411de50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec1d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ec410fea0 0x7f5ec411e390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 0x7f5ec411de50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50714/0 (socket says 10.20.193.28:50714) 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 -- 10.20.193.28:0/3327272755 learned_addr learned my addr 10.20.193.28:0/3327272755 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2d76640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ec41156a0 0x7f5ec4123760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 -- 10.20.193.28:0/3327272755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ec41156a0 msgr2=0x7f5ec4123760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ec41156a0 0x7f5ec4123760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 -- 10.20.193.28:0/3327272755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ec410fea0 msgr2=0x7f5ec411e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ec410fea0 0x7f5ec411e390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 -- 10.20.193.28:0/3327272755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb8009570 con 0x7f5ec410f4b0 2026-02-20T13:24:55.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.122+0000 7f5ec2575640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 0x7f5ec411de50 secure :-1 s=READY pgs=924 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eb8005b30 tx=0x7f5eb8004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:55.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.123+0000 7f5eab7fe640 1 -- 10.20.193.28:0/3327272755 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5eb803d070 con 0x7f5ec410f4b0 2026-02-20T13:24:55.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.123+0000 7f5eab7fe640 1 -- 10.20.193.28:0/3327272755 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5eb8038920 con 0x7f5ec410f4b0 2026-02-20T13:24:55.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.123+0000 7f5eab7fe640 1 -- 10.20.193.28:0/3327272755 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5eb80418a0 con 0x7f5ec410f4b0 2026-02-20T13:24:55.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.123+0000 7f5ec3577640 1 -- 10.20.193.28:0/3327272755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec4124330 con 0x7f5ec410f4b0 2026-02-20T13:24:55.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.123+0000 7f5ec3577640 1 -- 10.20.193.28:0/3327272755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec41648f0 con 0x7f5ec410f4b0 2026-02-20T13:24:55.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.124+0000 7f5ea97fa640 1 -- 10.20.193.28:0/3327272755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec4110790 con 0x7f5ec410f4b0 2026-02-20T13:24:55.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.126+0000 7f5eab7fe640 1 -- 10.20.193.28:0/3327272755 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5eb8048020 con 0x7f5ec410f4b0 2026-02-20T13:24:55.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.127+0000 7f5eab7fe640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e9c0b5760 0x7f5e9c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.128+0000 7f5eab7fe640 1 -- 10.20.193.28:0/3327272755 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5eb810b0d0 con 0x7f5ec410f4b0 2026-02-20T13:24:55.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.128+0000 7f5eab7fe640 1 -- 10.20.193.28:0/3327272755 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f5eb810b5c0 con 0x7f5ec410f4b0 2026-02-20T13:24:55.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.128+0000 7f5ec1d74640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e9c0b5760 0x7f5e9c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.128+0000 7f5ec1d74640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e9c0b5760 0x7f5e9c0d5c10 secure :-1 s=READY pgs=431 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec41247f0 tx=0x7f5eac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:55.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.269+0000 7f5ea97fa640 1 -- 10.20.193.28:0/3327272755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ec411efb0 con 0x7f5ec410f4b0 2026-02-20T13:24:55.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.270+0000 7f5eab7fe640 1 -- 10.20.193.28:0/3327272755 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f5eb80cdac0 con 0x7f5ec410f4b0 2026-02-20T13:24:55.273 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:24:55.273 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:24:55.274 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.271+0000 7f5ea97fa640 1 -- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e9c0b5760 msgr2=0x7f5e9c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.271+0000 7f5ea97fa640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e9c0b5760 0x7f5e9c0d5c10 secure :-1 s=READY pgs=431 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec41247f0 tx=0x7f5eac005f90 comp rx=0 tx=0).stop 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.271+0000 7f5ea97fa640 1 -- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 msgr2=0x7f5ec411de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.271+0000 7f5ea97fa640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 0x7f5ec411de50 secure :-1 s=READY pgs=924 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eb8005b30 tx=0x7f5eb8004340 comp rx=0 tx=0).stop 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.272+0000 7f5ea97fa640 1 -- 10.20.193.28:0/3327272755 shutdown_connections 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.272+0000 7f5ea97fa640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5e9c0b5760 0x7f5e9c0d5c10 unknown :-1 s=CLOSED pgs=431 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.272+0000 7f5ea97fa640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ec41156a0 0x7f5ec4123760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.272+0000 7f5ea97fa640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ec410fea0 0x7f5ec411e390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.272+0000 7f5ea97fa640 1 --2- 10.20.193.28:0/3327272755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ec410f4b0 0x7f5ec411de50 unknown :-1 s=CLOSED pgs=924 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.272+0000 7f5ea97fa640 1 -- 10.20.193.28:0/3327272755 >> 10.20.193.28:0/3327272755 conn(0x7f5ec40ecda0 msgr2=0x7f5ec410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:55.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.272+0000 7f5ea97fa640 1 -- 10.20.193.28:0/3327272755 shutdown_connections 2026-02-20T13:24:55.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.272+0000 7f5ea97fa640 1 -- 10.20.193.28:0/3327272755 wait complete. 2026-02-20T13:24:55.372 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:24:55.555 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.730+0000 7fc2ba98e640 1 -- 10.20.193.28:0/2417483764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b410fea0 msgr2=0x7fc2b4114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.730+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/2417483764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b410fea0 0x7fc2b4114ef0 secure :-1 s=READY pgs=925 gs=1 cs=0 l=1 c_cookie=11480721194792478936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a8009950 tx=0x7fc2a802f1d0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 -- 10.20.193.28:0/2417483764 shutdown_connections 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/2417483764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b410fea0 0x7fc2b4114ef0 unknown :-1 s=CLOSED pgs=925 gs=1 cs=0 l=1 c_cookie=11480721194792478936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/2417483764 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc2b41156a0 0x7fc2b4176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/2417483764 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc2b410f4b0 0x7fc2b410f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 -- 10.20.193.28:0/2417483764 >> 10.20.193.28:0/2417483764 conn(0x7fc2b40ecda0 msgr2=0x7fc2b410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 -- 10.20.193.28:0/2417483764 shutdown_connections 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 -- 10.20.193.28:0/2417483764 wait complete. 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 Processor -- start 2026-02-20T13:24:55.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.731+0000 7fc2ba98e640 1 -- start start 2026-02-20T13:24:55.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2ba98e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc2b410f4b0 0x7fc2b40f5880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2ba98e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc2b410fea0 0x7fc2b4175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2ba98e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b41156a0 0x7fc2b40f5f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2ba98e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b40fb190 con 0x7fc2b41156a0 2026-02-20T13:24:55.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2ba98e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b40fb300 con 0x7fc2b410f4b0 2026-02-20T13:24:55.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2ba98e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b40fb4c0 con 0x7fc2b410fea0 2026-02-20T13:24:55.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b998c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc2b410f4b0 0x7fc2b40f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc2b410fea0 0x7fc2b4175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b998c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc2b410f4b0 0x7fc2b40f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59250/0 (socket says 10.20.193.28:59250) 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b998c640 1 -- 10.20.193.28:0/1796908568 learned_addr learned my addr 10.20.193.28:0/1796908568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b41156a0 0x7fc2b40f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b998c640 1 -- 10.20.193.28:0/1796908568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc2b410fea0 msgr2=0x7fc2b4175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b998c640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc2b410fea0 0x7fc2b4175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b998c640 1 -- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b41156a0 msgr2=0x7fc2b40f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b998c640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b41156a0 0x7fc2b40f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2b998c640 1 -- 10.20.193.28:0/1796908568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a8009570 con 0x7fc2b410f4b0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.732+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b41156a0 0x7fc2b40f5f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.733+0000 7fc2b998c640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc2b410f4b0 0x7fc2b40f5880 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a4009480 tx=0x7fc2a400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.733+0000 7fc2a2ffd640 1 -- 10.20.193.28:0/1796908568 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2a400cd40 con 0x7fc2b410f4b0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.733+0000 7fc2ba98e640 1 -- 10.20.193.28:0/1796908568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b40fb7a0 con 0x7fc2b410f4b0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.733+0000 7fc2a2ffd640 1 -- 10.20.193.28:0/1796908568 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc2a4004d30 con 0x7fc2b410f4b0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.733+0000 7fc2a2ffd640 1 -- 10.20.193.28:0/1796908568 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2a4010740 con 0x7fc2b410f4b0 2026-02-20T13:24:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.733+0000 7fc2ba98e640 1 -- 10.20.193.28:0/1796908568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b40fbc70 con 0x7fc2b410f4b0 2026-02-20T13:24:55.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.735+0000 7fc2a2ffd640 1 -- 10.20.193.28:0/1796908568 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fc2a401f060 con 0x7fc2b410f4b0 2026-02-20T13:24:55.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.737+0000 7fc2a2ffd640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2900b5750 0x7fc2900d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.737+0000 7fc2a2ffd640 1 -- 10.20.193.28:0/1796908568 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc2a4014070 con 0x7fc2b410f4b0 2026-02-20T13:24:55.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.737+0000 7fc2b918b640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2900b5750 0x7fc2900d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.738+0000 7fc2b918b640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2900b5750 0x7fc2900d5c00 secure :-1 s=READY pgs=432 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2b40fc220 tx=0x7fc2a803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:55.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.738+0000 7fc2bdc11e00 1 Processor -- start 2026-02-20T13:24:55.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.738+0000 7fc2bdc11e00 1 -- start start 2026-02-20T13:24:55.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703981f730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398645e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039884f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557039735780 con 0x557039864b20 2026-02-20T13:24:55.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5570397314b0 con 0x55703981fc70 2026-02-20T13:24:55.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55703972b450 con 0x55703981f360 2026-02-20T13:24:55.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2b998c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703981f730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59262/0 (socket says 10.20.193.28:59262) 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2b918b640 1 -- 10.20.193.28:0/2584186352 learned_addr learned my addr 10.20.193.28:0/2584186352 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039884f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2ba18d640 1 -- 10.20.193.28:0/2584186352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 msgr2=0x55703981f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703981f730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2ba18d640 1 -- 10.20.193.28:0/2584186352 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 msgr2=0x5570398645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2ba18d640 1 -- 10.20.193.28:0/2584186352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570396d6d10 con 0x557039864b20 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2b998c640 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703981f730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2b918b640 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398645e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:55.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.739+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039884f00 secure :-1 s=READY pgs=926 gs=3 cs=0 l=1 c_cookie=13048974347082929383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2b00055e0 tx=0x7fc2b0003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5174508411014e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2824e6640 1 -- 10.20.193.28:0/2584186352 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2b000ae30 con 0x557039864b20 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2824e6640 1 -- 10.20.193.28:0/2584186352 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc2b0003e30 con 0x557039864b20 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2824e6640 1 -- 10.20.193.28:0/2584186352 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2b0012a30 con 0x557039864b20 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2584186352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 msgr2=0x557039884f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039884f00 secure :-1 s=READY pgs=926 gs=3 cs=0 l=1 c_cookie=13048974347082929383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2b00055e0 tx=0x7fc2b0003c30 comp rx=0 tx=0).stop 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2584186352 shutdown_connections 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039884f00 unknown :-1 s=CLOSED pgs=926 gs=3 cs=0 l=1 c_cookie=13048974347082929383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398645e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2584186352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703981f730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2584186352 >> 10.20.193.28:0/2584186352 conn(0x5570397fd860 msgr2=0x55703981dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2584186352 shutdown_connections 2026-02-20T13:24:55.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.740+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2584186352 wait complete. 2026-02-20T13:24:55.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2bdc11e00 1 -- start start 2026-02-20T13:24:55.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2bdc11e00 1 Processor -- start 2026-02-20T13:24:55.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981f360 0x55703987c740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x55703987cc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557039864b20 0x557039881c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570398821b0 con 0x55703981fc70 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557039882320 con 0x55703981f360 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5570398824e0 con 0x557039864b20 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x55703987cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x55703987cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50738/0 (socket says 10.20.193.28:50738) 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.742+0000 7fc2b918b640 1 -- 10.20.193.28:0/3920725954 learned_addr learned my addr 10.20.193.28:0/3920725954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2b998c640 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981f360 0x55703987c740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557039864b20 0x557039881c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2b918b640 1 -- 10.20.193.28:0/3920725954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557039864b20 msgr2=0x557039881c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2b918b640 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557039864b20 0x557039881c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2b918b640 1 -- 10.20.193.28:0/3920725954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981f360 msgr2=0x55703987c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2b918b640 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981f360 0x55703987c740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2b918b640 1 -- 10.20.193.28:0/3920725954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b0005200 con 0x55703981fc70 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2b918b640 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x55703987cc80 secure :-1 s=READY pgs=927 gs=1 cs=0 l=1 c_cookie=9172588500194357214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a802f6e0 tx=0x7fc2a8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4b94a478eaefde server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc26f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc26f7fe640 1 -- 10.20.193.28:0/3920725954 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2a8038d50 con 0x55703981fc70 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc26f7fe640 1 -- 10.20.193.28:0/3920725954 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc2a803e040 con 0x55703981fc70 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc26f7fe640 1 -- 10.20.193.28:0/3920725954 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2a8050670 con 0x55703981fc70 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b41768e0 con 0x55703981fc70 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc26f7fe640 1 -- 10.20.193.28:0/3920725954 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc2a8050800 con 0x55703981fc70 2026-02-20T13:24:55.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2bdc11e00 10 client.18132 _ll_register_callbacks cb 0x5570396aca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.743+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570393c16f0 con 0x55703981fc70 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc26f7fe640 1 -- 10.20.193.28:0/3920725954 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc2a8060030 con 0x55703981fc70 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2bdc11e00 10 client.18132 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5570396af3c0 con 0x55703981fc70 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc26f7fe640 1 -- 10.20.193.28:0/3920725954 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc2a804f070 con 0x55703981fc70 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2bdc11e00 10 client.18132 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2bdc11e00 10 client.18132 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2bdc11e00 20 client.18132 populate_metadata read hostname 'trial028' 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557039884c70 0x5570398628a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2bdc11e00 4 client.18132 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570396cdf80 con 0x557039884c70 2026-02-20T13:24:55.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.744+0000 7fc2b998c640 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557039884c70 0x5570398628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2b998c640 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557039884c70 0x5570398628a0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=2832872632862925633 s_cookie=15940468523890250710 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=275062a67fb86341 server_cookie=dd37ebaa8fc613d6 in_seq=0 out_seq=0 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc26f7fe640 10 client.18132 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc26f7fe640 1 -- 10.20.193.28:0/3920725954 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5570396cdf80 con 0x557039884c70 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc26f7fe640 10 client.18132 handle_command_reply: tid=0 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 client.18132 shutdown 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 msgr2=0x55703987cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x55703987cc80 secure :-1 s=READY pgs=927 gs=1 cs=0 l=1 c_cookie=9172588500194357214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a802f6e0 tx=0x7fc2a8009310 comp rx=0 tx=0).stop 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 shutdown_connections 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557039884c70 0x5570398628a0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=2832872632862925633 s_cookie=15940468523890250710 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x55703987cc80 unknown :-1 s=CLOSED pgs=927 gs=1 cs=0 l=1 c_cookie=9172588500194357214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557039864b20 0x557039881c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/3920725954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981f360 0x55703987c740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 >> 10.20.193.28:0/3920725954 conn(0x5570397fd860 msgr2=0x55703981dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:55.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.745+0000 7fc26f7fe640 0 client.18132 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:24:55.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.746+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 shutdown_connections 2026-02-20T13:24:55.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.746+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/3920725954 wait complete. 2026-02-20T13:24:55.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.746+0000 7fc2bdc11e00 20 client.18132 trim_cache size 0 max 16384 2026-02-20T13:24:55.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2bdc11e00 1 Processor -- start 2026-02-20T13:24:55.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2bdc11e00 1 -- start start 2026-02-20T13:24:55.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703987a020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398638b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039863df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55703986ea70 con 0x557039864b20 2026-02-20T13:24:55.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557039729080 con 0x55703981fc70 2026-02-20T13:24:55.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5570393e9700 con 0x55703981f360 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2ba18d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039863df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398638b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59288/0 (socket says 10.20.193.28:59288) 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2ba18d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039863df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50748/0 (socket says 10.20.193.28:50748) 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2b918b640 1 -- 10.20.193.28:0/904867516 learned_addr learned my addr 10.20.193.28:0/904867516 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2b998c640 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703987a020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2ba18d640 1 -- 10.20.193.28:0/904867516 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 msgr2=0x55703987a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703987a020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.753+0000 7fc2ba18d640 1 -- 10.20.193.28:0/904867516 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 msgr2=0x5570398638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2ba18d640 1 -- 10.20.193.28:0/904867516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570396c10e0 con 0x557039864b20 2026-02-20T13:24:55.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2b918b640 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398638b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039863df0 secure :-1 s=READY pgs=928 gs=3 cs=0 l=1 c_cookie=3381183503888796065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5570397df870 tx=0x7fc2b0003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eec607b85b3c9a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc281ce5640 1 -- 10.20.193.28:0/904867516 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2b0005800 con 0x557039864b20 2026-02-20T13:24:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc281ce5640 1 -- 10.20.193.28:0/904867516 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc2b0005e40 con 0x557039864b20 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc281ce5640 1 -- 10.20.193.28:0/904867516 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2b001b470 con 0x557039864b20 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/904867516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 msgr2=0x557039863df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039863df0 secure :-1 s=READY pgs=928 gs=3 cs=0 l=1 c_cookie=3381183503888796065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5570397df870 tx=0x7fc2b0003780 comp rx=0 tx=0).stop 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/904867516 shutdown_connections 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557039864b20 0x557039863df0 unknown :-1 s=CLOSED pgs=928 gs=3 cs=0 l=1 c_cookie=3381183503888796065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55703981fc70 0x5570398638b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/904867516 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x55703987a020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/904867516 >> 10.20.193.28:0/904867516 conn(0x5570397fd860 msgr2=0x557039878900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/904867516 shutdown_connections 2026-02-20T13:24:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.754+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/904867516 wait complete. 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2bdc11e00 1 -- start start 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2bdc11e00 1 Processor -- start 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x5570397ff6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x5570397ffc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2bdc11e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557039864b20 0x5570398ca950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557039869cb0 con 0x55703981fc70 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5570397fa2e0 con 0x557039864b20 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2bdc11e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5570398cae90 con 0x55703981f360 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.755+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x5570397ffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b918b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x5570397ffc00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50758/0 (socket says 10.20.193.28:50758) 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b918b640 1 -- 10.20.193.28:0/2513740173 learned_addr learned my addr 10.20.193.28:0/2513740173 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2ba18d640 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557039864b20 0x5570398ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b998c640 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x5570397ff6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b918b640 1 -- 10.20.193.28:0/2513740173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 msgr2=0x5570397ff6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b918b640 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x5570397ff6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b918b640 1 -- 10.20.193.28:0/2513740173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557039864b20 msgr2=0x5570398ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b918b640 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557039864b20 0x5570398ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b918b640 1 -- 10.20.193.28:0/2513740173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570396d6d10 con 0x55703981fc70 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2b918b640 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x5570397ffc00 secure :-1 s=READY pgs=929 gs=1 cs=0 l=1 c_cookie=2544202619747352427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a80423e0 tx=0x7fc2a802fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234ed2cd8aa8bf6b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc26f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc26f7fe640 1 -- 10.20.193.28:0/2513740173 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2a8060070 con 0x55703981fc70 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc26f7fe640 1 -- 10.20.193.28:0/2513740173 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc2a803e040 con 0x55703981fc70 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc26f7fe640 1 -- 10.20.193.28:0/2513740173 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2a8059a80 con 0x55703981fc70 2026-02-20T13:24:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570396af3c0 con 0x55703981fc70 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc26f7fe640 1 -- 10.20.193.28:0/2513740173 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc2a8061070 con 0x55703981fc70 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc26f7fe640 10 client.18138 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2bdc11e00 10 client.18138 _ll_register_callbacks cb 0x5570396aca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.756+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b0003e30 con 0x55703981fc70 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc26f7fe640 1 -- 10.20.193.28:0/2513740173 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc2a80043a0 con 0x55703981fc70 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2bdc11e00 10 client.18138 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5570396bbb60 con 0x55703981fc70 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc26f7fe640 1 -- 10.20.193.28:0/2513740173 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc2a804f070 con 0x55703981fc70 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2bdc11e00 10 client.18138 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2bdc11e00 10 client.18138 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2bdc11e00 20 client.18138 populate_metadata read hostname 'trial028' 2026-02-20T13:24:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557039912cb0 0x557039933110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2bdc11e00 4 client.18138 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570393bef40 con 0x557039912cb0 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.757+0000 7fc2b998c640 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557039912cb0 0x557039933110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2b998c640 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557039912cb0 0x557039933110 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=3118388588440471084 s_cookie=8698818810869491977 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b46bde635a0462c server_cookie=78b8699ec35ca909 in_seq=0 out_seq=0 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc26f7fe640 10 client.18138 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc26f7fe640 1 -- 10.20.193.28:0/2513740173 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570393bef40 con 0x557039912cb0 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc26f7fe640 10 client.18138 handle_command_reply: tid=0 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 client.18138 shutdown 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 msgr2=0x5570397ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x5570397ffc00 secure :-1 s=READY pgs=929 gs=1 cs=0 l=1 c_cookie=2544202619747352427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a80423e0 tx=0x7fc2a802fe40 comp rx=0 tx=0).stop 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 shutdown_connections 2026-02-20T13:24:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x557039912cb0 0x557039933110 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=3118388588440471084 s_cookie=8698818810869491977 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55703981fc70 0x5570397ffc00 unknown :-1 s=CLOSED pgs=929 gs=1 cs=0 l=1 c_cookie=2544202619747352427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557039864b20 0x5570398ca950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 --2- 10.20.193.28:0/2513740173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55703981f360 0x5570397ff6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc26f7fe640 0 client.18138 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 >> 10.20.193.28:0/2513740173 conn(0x5570397fd860 msgr2=0x5570398790f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 shutdown_connections 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.758+0000 7fc2bdc11e00 1 -- 10.20.193.28:0/2513740173 wait complete. 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2bdc11e00 20 client.18138 trim_cache size 0 max 16384 2026-02-20T13:24:55.767 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 -- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2900b5750 msgr2=0x7fc2900d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2900b5750 0x7fc2900d5c00 secure :-1 s=READY pgs=432 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2b40fc220 tx=0x7fc2a803a040 comp rx=0 tx=0).stop 2026-02-20T13:24:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 -- 10.20.193.28:0/1796908568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc2b410f4b0 msgr2=0x7fc2b40f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc2b410f4b0 0x7fc2b40f5880 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a4009480 tx=0x7fc2a400ee60 comp rx=0 tx=0).stop 2026-02-20T13:24:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 -- 10.20.193.28:0/1796908568 shutdown_connections 2026-02-20T13:24:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc2900b5750 0x7fc2900d5c00 unknown :-1 s=CLOSED pgs=432 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2b41156a0 0x7fc2b40f5f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc2b410fea0 0x7fc2b4175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 --2- 10.20.193.28:0/1796908568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc2b410f4b0 0x7fc2b40f5880 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 -- 10.20.193.28:0/1796908568 >> 10.20.193.28:0/1796908568 conn(0x7fc2b40ecda0 msgr2=0x7fc2b4111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 -- 10.20.193.28:0/1796908568 shutdown_connections 2026-02-20T13:24:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:55.759+0000 7fc2ba98e640 1 -- 10.20.193.28:0/1796908568 wait complete. 2026-02-20T13:24:55.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:55 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3327272755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:55.861 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:24:55.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:55 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3327272755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:55.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:55 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3327272755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:24:56.046 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:56.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 -- 10.20.193.28:0/3189151816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010f5f0 msgr2=0x7fec8010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 --2- 10.20.193.28:0/3189151816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010f5f0 0x7fec8010f9c0 secure :-1 s=READY pgs=930 gs=1 cs=0 l=1 c_cookie=11880574790405764083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec74009950 tx=0x7fec7402f190 comp rx=0 tx=0).stop 2026-02-20T13:24:56.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 -- 10.20.193.28:0/3189151816 shutdown_connections 2026-02-20T13:24:56.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 --2- 10.20.193.28:0/3189151816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec801157e0 0x7fec801761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 --2- 10.20.193.28:0/3189151816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec8010ffe0 0x7fec80115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 --2- 10.20.193.28:0/3189151816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010f5f0 0x7fec8010f9c0 unknown :-1 s=CLOSED pgs=930 gs=1 cs=0 l=1 c_cookie=11880574790405764083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 -- 10.20.193.28:0/3189151816 >> 10.20.193.28:0/3189151816 conn(0x7fec800ecea0 msgr2=0x7fec8010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 -- 10.20.193.28:0/3189151816 shutdown_connections 2026-02-20T13:24:56.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.213+0000 7fec84d8c640 1 -- 10.20.193.28:0/3189151816 wait complete. 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec84d8c640 1 Processor -- start 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec84d8c640 1 -- start start 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec84d8c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec8010f5f0 0x7fec8011d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec84d8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010ffe0 0x7fec8011dab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec84d8c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec801157e0 0x7fec80122e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec84d8c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fec801234a0 con 0x7fec8010ffe0 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec84d8c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fec80123610 con 0x7fec8010f5f0 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec84d8c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fec801237d0 con 0x7fec801157e0 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010ffe0 0x7fec8011dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010ffe0 0x7fec8011dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50778/0 (socket says 10.20.193.28:50778) 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7dd74640 1 -- 10.20.193.28:0/2985628178 learned_addr learned my addr 10.20.193.28:0/2985628178 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7ed76640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec801157e0 0x7fec80122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec8010f5f0 0x7fec8011d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7dd74640 1 -- 10.20.193.28:0/2985628178 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec801157e0 msgr2=0x7fec80122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7dd74640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec801157e0 0x7fec80122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7dd74640 1 -- 10.20.193.28:0/2985628178 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec8010f5f0 msgr2=0x7fec8011d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7dd74640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec8010f5f0 0x7fec8011d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.214+0000 7fec7dd74640 1 -- 10.20.193.28:0/2985628178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec74009570 con 0x7fec8010ffe0 2026-02-20T13:24:56.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.215+0000 7fec7dd74640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010ffe0 0x7fec8011dab0 secure :-1 s=READY pgs=931 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec6800d950 tx=0x7fec6800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.215+0000 7fec677fe640 1 -- 10.20.193.28:0/2985628178 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec68004540 con 0x7fec8010ffe0 2026-02-20T13:24:56.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.215+0000 7fec677fe640 1 -- 10.20.193.28:0/2985628178 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fec68009d00 con 0x7fec8010ffe0 2026-02-20T13:24:56.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.215+0000 7fec677fe640 1 -- 10.20.193.28:0/2985628178 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec680106e0 con 0x7fec8010ffe0 2026-02-20T13:24:56.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.215+0000 7fec84d8c640 1 -- 10.20.193.28:0/2985628178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec80123ab0 con 0x7fec8010ffe0 2026-02-20T13:24:56.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.215+0000 7fec84d8c640 1 -- 10.20.193.28:0/2985628178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec801641b0 con 0x7fec8010ffe0 2026-02-20T13:24:56.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.218+0000 7fec677fe640 1 -- 10.20.193.28:0/2985628178 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fec680097c0 con 0x7fec8010ffe0 2026-02-20T13:24:56.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.220+0000 7fec677fe640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fec580b5760 0x7fec580d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.220+0000 7fec677fe640 1 -- 10.20.193.28:0/2985628178 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fec680e6100 con 0x7fec8010ffe0 2026-02-20T13:24:56.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.220+0000 7fec7e575640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fec580b5760 0x7fec580d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.220+0000 7fec86d86e00 1 Processor -- start 2026-02-20T13:24:56.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.220+0000 7fec7e575640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fec580b5760 0x7fec580d5c10 secure :-1 s=READY pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec740098a0 tx=0x7fec7403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec86d86e00 1 -- start start 2026-02-20T13:24:56.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x564015306140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015306680 0x56401534aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 0x56401536b910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec86d86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564015213780 con 0x564015306680 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec86d86e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56401520f4b0 con 0x56401534b530 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec86d86e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564015209450 con 0x564015305d70 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015306680 0x56401534aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015306680 0x56401534aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50786/0 (socket says 10.20.193.28:50786) 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7dd74640 1 -- 10.20.193.28:0/645651619 learned_addr learned my addr 10.20.193.28:0/645651619 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x564015306140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7ed76640 1 --2- 10.20.193.28:0/645651619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 0x56401536b910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7dd74640 1 -- 10.20.193.28:0/645651619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 msgr2=0x564015306140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7dd74640 1 --2- 10.20.193.28:0/645651619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x564015306140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7dd74640 1 -- 10.20.193.28:0/645651619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 msgr2=0x56401536b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7dd74640 1 --2- 10.20.193.28:0/645651619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 0x56401536b910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.221+0000 7fec7dd74640 1 -- 10.20.193.28:0/645651619 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640151b4d10 con 0x564015306680 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec7dd74640 1 --2- 10.20.193.28:0/645651619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015306680 0x56401534aff0 secure :-1 s=READY pgs=932 gs=2 cs=0 l=1 c_cookie=5591329740718869266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec680a8a30 tx=0x7fec68002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9864c669a00b12 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec64ff9640 1 -- 10.20.193.28:0/645651619 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec680abc60 con 0x564015306680 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec64ff9640 1 -- 10.20.193.28:0/645651619 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fec680ace60 con 0x564015306680 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec64ff9640 1 -- 10.20.193.28:0/645651619 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec680b7110 con 0x564015306680 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 -- 10.20.193.28:0/645651619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015306680 msgr2=0x56401534aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 --2- 10.20.193.28:0/645651619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015306680 0x56401534aff0 secure :-1 s=READY pgs=932 gs=2 cs=0 l=1 c_cookie=5591329740718869266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec680a8a30 tx=0x7fec68002390 comp rx=0 tx=0).stop 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 -- 10.20.193.28:0/645651619 shutdown_connections 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 --2- 10.20.193.28:0/645651619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015306680 0x56401534aff0 unknown :-1 s=CLOSED pgs=932 gs=2 cs=0 l=1 c_cookie=5591329740718869266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 --2- 10.20.193.28:0/645651619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 0x56401536b910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 --2- 10.20.193.28:0/645651619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x564015306140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 -- 10.20.193.28:0/645651619 >> 10.20.193.28:0/645651619 conn(0x5640152db860 msgr2=0x5640152fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 -- 10.20.193.28:0/645651619 shutdown_connections 2026-02-20T13:24:56.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.222+0000 7fec86d86e00 1 -- 10.20.193.28:0/645651619 wait complete. 2026-02-20T13:24:56.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec86d86e00 1 -- start start 2026-02-20T13:24:56.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec86d86e00 1 Processor -- start 2026-02-20T13:24:56.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x5640153631c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x564015363700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015365490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec86d86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564015365a00 con 0x56401534b530 2026-02-20T13:24:56.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec86d86e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564015365b70 con 0x564015306680 2026-02-20T13:24:56.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec86d86e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564015365d30 con 0x564015305d70 2026-02-20T13:24:56.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec7e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x5640153631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec7ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015365490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec7e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x5640153631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48446/0 (socket says 10.20.193.28:48446) 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec7e575640 1 -- 10.20.193.28:0/1765689471 learned_addr learned my addr 10.20.193.28:0/1765689471 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.224+0000 7fec7dd74640 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x564015363700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec7ed76640 1 -- 10.20.193.28:0/1765689471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 msgr2=0x5640153631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec7ed76640 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x5640153631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec7ed76640 1 -- 10.20.193.28:0/1765689471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 msgr2=0x564015363700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec7ed76640 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x564015363700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec7ed76640 1 -- 10.20.193.28:0/1765689471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56401518d3c0 con 0x56401534b530 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec7dd74640 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x564015363700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec7ed76640 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015365490 secure :-1 s=READY pgs=933 gs=1 cs=0 l=1 c_cookie=3373424002779013734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec70005820 tx=0x7fec7000aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed0cf41e26b6266 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec2ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec2ffff640 1 -- 10.20.193.28:0/1765689471 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec70018070 con 0x56401534b530 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec2ffff640 1 -- 10.20.193.28:0/1765689471 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fec70011e00 con 0x56401534b530 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec801641b0 con 0x56401534b530 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec2ffff640 1 -- 10.20.193.28:0/1765689471 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec70010640 con 0x56401534b530 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec86d86e00 10 client.18150 _ll_register_callbacks cb 0x56401518aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:56.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.225+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564014e9f6f0 con 0x56401534b530 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec2ffff640 1 -- 10.20.193.28:0/1765689471 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fec7001ce20 con 0x56401534b530 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec2ffff640 1 -- 10.20.193.28:0/1765689471 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec70011920 con 0x56401534b530 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec86d86e00 10 client.18150 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56401519f0e0 con 0x56401534b530 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec2ffff640 1 -- 10.20.193.28:0/1765689471 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec70011a80 con 0x56401534b530 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec86d86e00 10 client.18150 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec86d86e00 10 client.18150 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec86d86e00 20 client.18150 populate_metadata read hostname 'trial028' 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec86d86e00 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56401536b7a0 0x5640153492b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec86d86e00 4 client.18150 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640151abf80 con 0x56401536b7a0 2026-02-20T13:24:56.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.226+0000 7fec7e575640 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56401536b7a0 0x5640153492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.227+0000 7fec7e575640 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56401536b7a0 0x5640153492b0 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=6778481980027922864 s_cookie=12463221779886696093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5e12017267f369b0 server_cookie=acf6422d030ee69d in_seq=0 out_seq=0 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.227+0000 7fec2ffff640 10 client.18150 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.227+0000 7fec2ffff640 1 -- 10.20.193.28:0/1765689471 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5640151abf80 con 0x56401536b7a0 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.227+0000 7fec2ffff640 10 client.18150 handle_command_reply: tid=0 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 client.18150 shutdown 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 msgr2=0x564015365490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015365490 secure :-1 s=READY pgs=933 gs=1 cs=0 l=1 c_cookie=3373424002779013734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec70005820 tx=0x7fec7000aab0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 shutdown_connections 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56401536b7a0 0x5640153492b0 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=6778481980027922864 s_cookie=12463221779886696093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015365490 unknown :-1 s=CLOSED pgs=933 gs=1 cs=0 l=1 c_cookie=3373424002779013734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x564015363700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 --2- 10.20.193.28:0/1765689471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x5640153631c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 >> 10.20.193.28:0/1765689471 conn(0x5640152db860 msgr2=0x5640152fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec2ffff640 0 client.18150 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:24:56.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 shutdown_connections 2026-02-20T13:24:56.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 1 -- 10.20.193.28:0/1765689471 wait complete. 2026-02-20T13:24:56.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.228+0000 7fec86d86e00 20 client.18150 trim_cache size 0 max 16384 2026-02-20T13:24:56.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.235+0000 7fec86d86e00 1 Processor -- start 2026-02-20T13:24:56.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec86d86e00 1 -- start start 2026-02-20T13:24:56.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x564015365420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x5640153633f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015366bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec86d86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564015207080 con 0x56401534b530 2026-02-20T13:24:56.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec86d86e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564014ec7700 con 0x564015306680 2026-02-20T13:24:56.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec86d86e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564015349710 con 0x564015305d70 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015366bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015366bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50802/0 (socket says 10.20.193.28:50802) 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7e575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x564015365420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 -- 10.20.193.28:0/2260995922 learned_addr learned my addr 10.20.193.28:0/2260995922 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7dd74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x5640153633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 -- 10.20.193.28:0/2260995922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 msgr2=0x564015365420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 --2- 10.20.193.28:0/2260995922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x564015365420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 -- 10.20.193.28:0/2260995922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 msgr2=0x5640153633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 --2- 10.20.193.28:0/2260995922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x5640153633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 -- 10.20.193.28:0/2260995922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564015199b60 con 0x56401534b530 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.236+0000 7fec7ed76640 1 --2- 10.20.193.28:0/2260995922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015366bb0 secure :-1 s=READY pgs=934 gs=1 cs=0 l=1 c_cookie=11345457483553772385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec70010970 tx=0x7fec70020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d73297871851361 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec4a4e6640 1 -- 10.20.193.28:0/2260995922 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec70018040 con 0x56401534b530 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec4a4e6640 1 -- 10.20.193.28:0/2260995922 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564014e9f6f0 con 0x56401534b530 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec4a4e6640 1 -- 10.20.193.28:0/2260995922 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec70010640 con 0x56401534b530 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 -- 10.20.193.28:0/2260995922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 msgr2=0x564015366bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 --2- 10.20.193.28:0/2260995922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015366bb0 secure :-1 s=READY pgs=934 gs=1 cs=0 l=1 c_cookie=11345457483553772385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec70010970 tx=0x7fec70020000 comp rx=0 tx=0).stop 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 -- 10.20.193.28:0/2260995922 shutdown_connections 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 --2- 10.20.193.28:0/2260995922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56401534b530 0x564015366bb0 unknown :-1 s=CLOSED pgs=934 gs=1 cs=0 l=1 c_cookie=11345457483553772385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 --2- 10.20.193.28:0/2260995922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564015306680 0x5640153633f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 --2- 10.20.193.28:0/2260995922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015305d70 0x564015365420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 -- 10.20.193.28:0/2260995922 >> 10.20.193.28:0/2260995922 conn(0x5640152db860 msgr2=0x5640153664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 -- 10.20.193.28:0/2260995922 shutdown_connections 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.237+0000 7fec86d86e00 1 -- 10.20.193.28:0/2260995922 wait complete. 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec86d86e00 1 -- start start 2026-02-20T13:24:56.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec86d86e00 1 Processor -- start 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015305d70 0x564015345180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015306680 0x5640153456c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec86d86e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 0x564015345c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec86d86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5640153461e0 con 0x564015305d70 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec86d86e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564015346350 con 0x56401534b530 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec86d86e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564015346510 con 0x564015306680 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec7e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015305d70 0x564015345180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec7ed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 0x564015345c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec7e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015305d70 0x564015345180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50806/0 (socket says 10.20.193.28:50806) 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.238+0000 7fec7e575640 1 -- 10.20.193.28:0/3892974844 learned_addr learned my addr 10.20.193.28:0/3892974844 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec7dd74640 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015306680 0x5640153456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec7e575640 1 -- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015306680 msgr2=0x5640153456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec7e575640 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015306680 0x5640153456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec7e575640 1 -- 10.20.193.28:0/3892974844 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 msgr2=0x564015345c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec7e575640 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 0x564015345c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec7e575640 1 -- 10.20.193.28:0/3892974844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56401518d6f0 con 0x564015305d70 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec7dd74640 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015306680 0x5640153456c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec7e575640 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015305d70 0x564015345180 secure :-1 s=READY pgs=935 gs=1 cs=0 l=1 c_cookie=17399400816248534981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec74009950 tx=0x7fec74009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17716db3d22b7c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec2ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec2ffff640 1 -- 10.20.193.28:0/3892974844 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec74058070 con 0x564015305d70 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56401519f0e0 con 0x564015305d70 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec86d86e00 10 client.18156 _ll_register_callbacks cb 0x56401518aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec2ffff640 1 -- 10.20.193.28:0/3892974844 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fec7403e040 con 0x564015305d70 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564014f614a0 con 0x564015305d70 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec2ffff640 1 -- 10.20.193.28:0/3892974844 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec74052ad0 con 0x564015305d70 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec2ffff640 1 -- 10.20.193.28:0/3892974844 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fec74052c60 con 0x564015305d70 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec2ffff640 1 -- 10.20.193.28:0/3892974844 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec74052e20 con 0x564015305d70 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.239+0000 7fec86d86e00 10 client.18156 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:56.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56401519f340 con 0x564015305d70 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec2ffff640 1 -- 10.20.193.28:0/3892974844 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec7404f040 con 0x564015305d70 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec86d86e00 10 client.18156 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec86d86e00 10 client.18156 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec86d86e00 20 client.18156 populate_metadata read hostname 'trial028' 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec86d86e00 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5640152e1030 0x5640152e14d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec86d86e00 4 client.18156 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fec680ace60 con 0x5640152e1030 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.240+0000 7fec7dd74640 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5640152e1030 0x5640152e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec7dd74640 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5640152e1030 0x5640152e14d0 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=4652771964884265234 s_cookie=9578851624445090344 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4091f7735bd2a912 server_cookie=84eeeacd2f391a28 in_seq=0 out_seq=0 2026-02-20T13:24:56.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec2ffff640 10 client.18156 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec2ffff640 1 -- 10.20.193.28:0/3892974844 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fec680ace60 con 0x5640152e1030 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec2ffff640 10 client.18156 handle_command_reply: tid=0 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 client.18156 shutdown 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015305d70 msgr2=0x564015345180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015305d70 0x564015345180 secure :-1 s=READY pgs=935 gs=1 cs=0 l=1 c_cookie=17399400816248534981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec74009950 tx=0x7fec74009310 comp rx=0 tx=0).stop 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 shutdown_connections 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5640152e1030 0x5640152e14d0 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=4652771964884265234 s_cookie=9578851624445090344 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56401534b530 0x564015345c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564015306680 0x5640153456c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec2ffff640 0 client.18156 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 --2- 10.20.193.28:0/3892974844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564015305d70 0x564015345180 unknown :-1 s=CLOSED pgs=935 gs=1 cs=0 l=1 c_cookie=17399400816248534981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 >> 10.20.193.28:0/3892974844 conn(0x5640152db860 msgr2=0x564015367d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 shutdown_connections 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 1 -- 10.20.193.28:0/3892974844 wait complete. 2026-02-20T13:24:56.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.241+0000 7fec86d86e00 20 client.18156 trim_cache size 0 max 16384 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 -- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fec580b5760 msgr2=0x7fec580d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fec580b5760 0x7fec580d5c10 secure :-1 s=READY pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec740098a0 tx=0x7fec7403a040 comp rx=0 tx=0).stop 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 -- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010ffe0 msgr2=0x7fec8011dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010ffe0 0x7fec8011dab0 secure :-1 s=READY pgs=931 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec6800d950 tx=0x7fec6800de20 comp rx=0 tx=0).stop 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 -- 10.20.193.28:0/2985628178 shutdown_connections 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fec580b5760 0x7fec580d5c10 unknown :-1 s=CLOSED pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec8010ffe0 0x7fec8011dab0 unknown :-1 s=CLOSED pgs=931 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec801157e0 0x7fec80122e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 --2- 10.20.193.28:0/2985628178 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec8010f5f0 0x7fec8011d570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 -- 10.20.193.28:0/2985628178 >> 10.20.193.28:0/2985628178 conn(0x7fec800ecea0 msgr2=0x7fec8010d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 -- 10.20.193.28:0/2985628178 shutdown_connections 2026-02-20T13:24:56.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.242+0000 7fec84d8c640 1 -- 10.20.193.28:0/2985628178 wait complete. 2026-02-20T13:24:56.341 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:24:56.523 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:56.639 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:56 trial028 ceph-mon[37442]: pgmap v409: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:24:56.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 -- 10.20.193.28:0/2384381990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc43410bb40 msgr2=0x7fc4341551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 --2- 10.20.193.28:0/2384381990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc43410bb40 0x7fc4341551e0 secure :-1 s=READY pgs=936 gs=1 cs=0 l=1 c_cookie=15873142273691621135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc428009950 tx=0x7fc42802f190 comp rx=0 tx=0).stop 2026-02-20T13:24:56.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 -- 10.20.193.28:0/2384381990 shutdown_connections 2026-02-20T13:24:56.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 --2- 10.20.193.28:0/2384381990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc43410bb40 0x7fc4341551e0 unknown :-1 s=CLOSED pgs=936 gs=1 cs=0 l=1 c_cookie=15873142273691621135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 --2- 10.20.193.28:0/2384381990 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc434155850 0x7fc434175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 --2- 10.20.193.28:0/2384381990 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc43410b230 0x7fc43410b600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 -- 10.20.193.28:0/2384381990 >> 10.20.193.28:0/2384381990 conn(0x7fc4340e8ce0 msgr2=0x7fc4341090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 -- 10.20.193.28:0/2384381990 shutdown_connections 2026-02-20T13:24:56.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.705+0000 7fc43ae21640 1 -- 10.20.193.28:0/2384381990 wait complete. 2026-02-20T13:24:56.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43ae21640 1 Processor -- start 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43ae21640 1 -- start start 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43ae21640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc43410b230 0x7fc434168b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43ae21640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc43410bb40 0x7fc434169060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43ae21640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc434155850 0x7fc43416e430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43ae21640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc43416ea50 con 0x7fc434155850 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43ae21640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc43416ebc0 con 0x7fc43410bb40 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43ae21640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc43416ed80 con 0x7fc43410b230 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc43410b230 0x7fc434168b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc43410b230 0x7fc434168b20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48472/0 (socket says 10.20.193.28:48472) 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc439e1f640 1 -- 10.20.193.28:0/3174680817 learned_addr learned my addr 10.20.193.28:0/3174680817 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43a620640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc434155850 0x7fc43416e430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.706+0000 7fc43961e640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc43410bb40 0x7fc434169060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc43a620640 1 -- 10.20.193.28:0/3174680817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc43410b230 msgr2=0x7fc434168b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc43a620640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc43410b230 0x7fc434168b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc43a620640 1 -- 10.20.193.28:0/3174680817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc43410bb40 msgr2=0x7fc434169060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc43a620640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc43410bb40 0x7fc434169060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc43a620640 1 -- 10.20.193.28:0/3174680817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc428009570 con 0x7fc434155850 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc439e1f640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc43410b230 0x7fc434168b20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc43a620640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc434155850 0x7fc43416e430 secure :-1 s=READY pgs=937 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc43000e720 tx=0x7fc43000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc422ffd640 1 -- 10.20.193.28:0/3174680817 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc430005500 con 0x7fc434155850 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc422ffd640 1 -- 10.20.193.28:0/3174680817 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc430005660 con 0x7fc434155850 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc422ffd640 1 -- 10.20.193.28:0/3174680817 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc430011460 con 0x7fc434155850 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc43ae21640 1 -- 10.20.193.28:0/3174680817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43416f060 con 0x7fc434155850 2026-02-20T13:24:56.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.707+0000 7fc43ae21640 1 -- 10.20.193.28:0/3174680817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43414ee50 con 0x7fc434155850 2026-02-20T13:24:56.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.711+0000 7fc422ffd640 1 -- 10.20.193.28:0/3174680817 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fc43000c7e0 con 0x7fc434155850 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc422ffd640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4100b5760 0x7fc4100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43e0a4e00 1 Processor -- start 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc422ffd640 1 -- 10.20.193.28:0/3174680817 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc4300e78b0 con 0x7fc434155850 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc439e1f640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4100b5760 0x7fc4100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43e0a4e00 1 -- start start 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f948b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94d05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94f0f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d6f93a1780 con 0x55d6f948bc70 2026-02-20T13:24:56.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d6f939d4b0 con 0x55d6f94d0b20 2026-02-20T13:24:56.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d6f9397450 con 0x55d6f948b360 2026-02-20T13:24:56.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f948b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f948b730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48484/0 (socket says 10.20.193.28:48484) 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc439e1f640 1 -- 10.20.193.28:0/2455077949 learned_addr learned my addr 10.20.193.28:0/2455077949 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc43a620640 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.713+0000 7fc439e1f640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4100b5760 0x7fc4100d5c10 secure :-1 s=READY pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc42400b2c0 tx=0x7fc4240109a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc43961e640 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc439e1f640 1 -- 10.20.193.28:0/2455077949 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 msgr2=0x55d6f94f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc439e1f640 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc439e1f640 1 -- 10.20.193.28:0/2455077949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 msgr2=0x55d6f94d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc439e1f640 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc439e1f640 1 -- 10.20.193.28:0/2455077949 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f9342d10 con 0x55d6f948b360 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc43961e640 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94d05e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc439e1f640 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f948b730 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=2597881534631316238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc42400bdc0 tx=0x7fc42401b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240d877dd83f0b0e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc4024e6640 1 -- 10.20.193.28:0/2455077949 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4240132f0 con 0x55d6f948b360 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc4024e6640 1 -- 10.20.193.28:0/2455077949 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc424004020 con 0x55d6f948b360 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc4024e6640 1 -- 10.20.193.28:0/2455077949 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc424003be0 con 0x55d6f948b360 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2455077949 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 msgr2=0x55d6f948b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.714+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f948b730 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=2597881534631316238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc42400bdc0 tx=0x7fc42401b000 comp rx=0 tx=0).stop 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.715+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2455077949 shutdown_connections 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.715+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94d05e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.715+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94f0f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.715+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2455077949 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f948b730 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=2597881534631316238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.715+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2455077949 >> 10.20.193.28:0/2455077949 conn(0x55d6f9469860 msgr2=0x55d6f9489c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.715+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2455077949 shutdown_connections 2026-02-20T13:24:56.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.715+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2455077949 wait complete. 2026-02-20T13:24:56.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.716+0000 7fc43e0a4e00 1 -- start start 2026-02-20T13:24:56.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.716+0000 7fc43e0a4e00 1 Processor -- start 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e86e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e8c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94edc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d6f94ee150 con 0x55d6f948bc70 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d6f94ee2c0 con 0x55d6f94d0b20 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d6f94ee480 con 0x55d6f948b360 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc43a620640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48488/0 (socket says 10.20.193.28:48488) 2026-02-20T13:24:56.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc439e1f640 1 -- 10.20.193.28:0/413588395 learned_addr learned my addr 10.20.193.28:0/413588395 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.717+0000 7fc43961e640 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc439e1f640 1 -- 10.20.193.28:0/413588395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 msgr2=0x55d6f94edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc439e1f640 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94edc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc439e1f640 1 -- 10.20.193.28:0/413588395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 msgr2=0x55d6f94e8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc439e1f640 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc439e1f640 1 -- 10.20.193.28:0/413588395 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f931b3c0 con 0x55d6f948b360 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc43961e640 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e8c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc439e1f640 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e86e0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=8849423414935192276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc42400bb30 tx=0x7fc424013eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7acf77b5aa3c82d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc3ef7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/413588395 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4240043b0 con 0x55d6f948b360 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/413588395 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc4240132e0 con 0x55d6f948b360 2026-02-20T13:24:56.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc424013570 con 0x55d6f948b360 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/413588395 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc424011830 con 0x55d6f948b360 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/413588395 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc424019050 con 0x55d6f948b360 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.718+0000 7fc43e0a4e00 10 client.28024 _ll_register_callbacks cb 0x55d6f9318a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d6f902d6f0 con 0x55d6f948b360 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/413588395 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc42400e9d0 con 0x55d6f948b360 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 10 client.28024 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d6f932d0e0 con 0x55d6f948b360 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/413588395 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc424024030 con 0x55d6f948b360 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 10 client.28024 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 10 client.28024 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 20 client.28024 populate_metadata read hostname 'trial028' 2026-02-20T13:24:56.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d6f94f0b30 0x55d6f94ce8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 4 client.28024 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6f9339f80 con 0x55d6f94f0b30 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.719+0000 7fc43961e640 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d6f94f0b30 0x55d6f94ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.720+0000 7fc43961e640 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d6f94f0b30 0x55d6f94ce8a0 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=1040981536478939042 s_cookie=4080514917605639713 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e724f312b9147a2 server_cookie=38a0e6b2b4910621 in_seq=0 out_seq=0 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.720+0000 7fc3ef7fe640 10 client.28024 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.720+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/413588395 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d6f9339f80 con 0x55d6f94f0b30 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.720+0000 7fc3ef7fe640 10 client.28024 handle_command_reply: tid=0 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 client.28024 shutdown 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 msgr2=0x55d6f94e86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e86e0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=8849423414935192276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc42400bb30 tx=0x7fc424013eb0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 shutdown_connections 2026-02-20T13:24:56.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d6f94f0b30 0x55d6f94ce8a0 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=1040981536478939042 s_cookie=4080514917605639713 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e8c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94edc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/413588395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e86e0 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=8849423414935192276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc3ef7fe640 0 client.28024 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:24:56.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 >> 10.20.193.28:0/413588395 conn(0x55d6f9469860 msgr2=0x55d6f9489c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 shutdown_connections 2026-02-20T13:24:56.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/413588395 wait complete. 2026-02-20T13:24:56.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.721+0000 7fc43e0a4e00 20 client.28024 trim_cache size 0 max 16384 2026-02-20T13:24:56.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.728+0000 7fc43e0a4e00 1 Processor -- start 2026-02-20T13:24:56.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.728+0000 7fc43e0a4e00 1 -- start start 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e5dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94cb780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d6f9395080 con 0x55d6f948bc70 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d6f9055700 con 0x55d6f94d0b20 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d6f94e9200 con 0x55d6f948b360 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50854/0 (socket says 10.20.193.28:50854) 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e5890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48496/0 (socket says 10.20.193.28:48496) 2026-02-20T13:24:56.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 -- 10.20.193.28:0/2037727969 learned_addr learned my addr 10.20.193.28:0/2037727969 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43a620640 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 -- 10.20.193.28:0/2037727969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 msgr2=0x55d6f94e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 -- 10.20.193.28:0/2037727969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 msgr2=0x55d6f94cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 -- 10.20.193.28:0/2037727969 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f9327b60 con 0x55d6f948bc70 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc439e1f640 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e5890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.729+0000 7fc43961e640 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e5dd0 secure :-1 s=READY pgs=938 gs=1 cs=0 l=1 c_cookie=12182462419700306429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc43410ea30 tx=0x7fc428031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a910cd0677c851fd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc401ce5640 1 -- 10.20.193.28:0/2037727969 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc428038690 con 0x55d6f948bc70 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc401ce5640 1 -- 10.20.193.28:0/2037727969 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc42803e040 con 0x55d6f948bc70 2026-02-20T13:24:56.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc401ce5640 1 -- 10.20.193.28:0/2037727969 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc428038ba0 con 0x55d6f948bc70 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2037727969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 msgr2=0x55d6f94e5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e5dd0 secure :-1 s=READY pgs=938 gs=1 cs=0 l=1 c_cookie=12182462419700306429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc43410ea30 tx=0x7fc428031040 comp rx=0 tx=0).stop 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2037727969 shutdown_connections 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f948bc70 0x55d6f94e5dd0 unknown :-1 s=CLOSED pgs=938 gs=1 cs=0 l=1 c_cookie=12182462419700306429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f94d0b20 0x55d6f94cb780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2037727969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f94e5890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2037727969 >> 10.20.193.28:0/2037727969 conn(0x55d6f9469860 msgr2=0x55d6f94d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2037727969 shutdown_connections 2026-02-20T13:24:56.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.730+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2037727969 wait complete. 2026-02-20T13:24:56.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43e0a4e00 1 -- start start 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43e0a4e00 1 Processor -- start 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f9469c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f948bc70 0x55d6f946a170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43e0a4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f94d0b20 0x55d6f946a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d6f93f9ae0 con 0x55d6f94d0b20 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d6f94e1570 con 0x55d6f948bc70 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43e0a4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d6f946ed80 con 0x55d6f948b360 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f9469c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43961e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f948bc70 0x55d6f946a170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc439e1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f9469c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48506/0 (socket says 10.20.193.28:48506) 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc439e1f640 1 -- 10.20.193.28:0/2160416783 learned_addr learned my addr 10.20.193.28:0/2160416783 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.731+0000 7fc43a620640 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f94d0b20 0x55d6f946a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc439e1f640 1 -- 10.20.193.28:0/2160416783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f948bc70 msgr2=0x55d6f946a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc439e1f640 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f948bc70 0x55d6f946a170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc439e1f640 1 -- 10.20.193.28:0/2160416783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f94d0b20 msgr2=0x55d6f946a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc439e1f640 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f94d0b20 0x55d6f946a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc439e1f640 1 -- 10.20.193.28:0/2160416783 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f931b6f0 con 0x55d6f948b360 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc43a620640 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f94d0b20 0x55d6f946a6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc439e1f640 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f9469c30 secure :-1 s=READY pgs=284 gs=3 cs=0 l=1 c_cookie=13060327808313550607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc424025e10 tx=0x7fc42400bb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b53f9af1f0af670f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc3ef7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:56.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/2160416783 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4240132e0 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/2160416783 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d6f902d6f0 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4341768c0 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/2160416783 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc42402fa00 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc43e0a4e00 10 client.28030 _ll_register_callbacks cb 0x55d6f9318a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc424004020 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/2160416783 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc424019040 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/2160416783 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc42401d7f0 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc43e0a4e00 10 client.28030 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.732+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d6f932d340 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/2160416783 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc42402fd20 con 0x55d6f948b360 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc43e0a4e00 10 client.28030 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc43e0a4e00 10 client.28030 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:24:56.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc43e0a4e00 20 client.28030 populate_metadata read hostname 'trial028' 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d6f957e8e0 0x55d6f959ed90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc43e0a4e00 4 client.28030 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d6f902af40 con 0x55d6f957e8e0 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc43961e640 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d6f957e8e0 0x55d6f959ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc43961e640 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d6f957e8e0 0x55d6f959ed90 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=4395191968668809817 s_cookie=12743619144511708553 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cfedbcf0c277a59 server_cookie=b0da6e17e57cdd89 in_seq=0 out_seq=0 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.733+0000 7fc3ef7fe640 10 client.28030 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc3ef7fe640 1 -- 10.20.193.28:0/2160416783 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d6f902af40 con 0x55d6f957e8e0 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc3ef7fe640 10 client.28030 handle_command_reply: tid=0 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 client.28030 shutdown 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 msgr2=0x55d6f9469c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f9469c30 secure :-1 s=READY pgs=284 gs=3 cs=0 l=1 c_cookie=13060327808313550607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc424025e10 tx=0x7fc42400bb30 comp rx=0 tx=0).stop 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 shutdown_connections 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d6f957e8e0 0x55d6f959ed90 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=4395191968668809817 s_cookie=12743619144511708553 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d6f94d0b20 0x55d6f946a6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d6f948bc70 0x55d6f946a170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 --2- 10.20.193.28:0/2160416783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d6f948b360 0x55d6f9469c30 unknown :-1 s=CLOSED pgs=284 gs=3 cs=0 l=1 c_cookie=13060327808313550607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc3ef7fe640 0 client.28030 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 >> 10.20.193.28:0/2160416783 conn(0x55d6f9469860 msgr2=0x55d6f94eca70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 shutdown_connections 2026-02-20T13:24:56.743 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:56.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 1 -- 10.20.193.28:0/2160416783 wait complete. 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43e0a4e00 20 client.28030 trim_cache size 0 max 16384 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43ae21640 1 -- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4100b5760 msgr2=0x7fc4100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43ae21640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4100b5760 0x7fc4100d5c10 secure :-1 s=READY pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc42400b2c0 tx=0x7fc4240109a0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43ae21640 1 -- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc434155850 msgr2=0x7fc43416e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.734+0000 7fc43ae21640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc434155850 0x7fc43416e430 secure :-1 s=READY pgs=937 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc43000e720 tx=0x7fc43000ebf0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.735+0000 7fc43ae21640 1 -- 10.20.193.28:0/3174680817 shutdown_connections 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.735+0000 7fc43ae21640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc4100b5760 0x7fc4100d5c10 unknown :-1 s=CLOSED pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.735+0000 7fc43ae21640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc434155850 0x7fc43416e430 unknown :-1 s=CLOSED pgs=937 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.735+0000 7fc43ae21640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc43410bb40 0x7fc434169060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.735+0000 7fc43ae21640 1 --2- 10.20.193.28:0/3174680817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc43410b230 0x7fc434168b20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:56.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.735+0000 7fc43ae21640 1 -- 10.20.193.28:0/3174680817 >> 10.20.193.28:0/3174680817 conn(0x7fc4340e8ce0 msgr2=0x7fc4341090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:56.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.735+0000 7fc43ae21640 1 -- 10.20.193.28:0/3174680817 shutdown_connections 2026-02-20T13:24:56.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:56.735+0000 7fc43ae21640 1 -- 10.20.193.28:0/3174680817 wait complete. 2026-02-20T13:24:56.836 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:24:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:56 trial127 ceph-mon[43817]: pgmap v409: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:24:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:56 trial034 ceph-mon[43332]: pgmap v409: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:24:57.019 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:57.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 -- 10.20.193.28:0/3828865403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810c320 msgr2=0x7f6128155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 --2- 10.20.193.28:0/3828865403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810c320 0x7f6128155200 secure :-1 s=READY pgs=344 gs=3 cs=0 l=1 c_cookie=2079840644572532410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f611c009890 tx=0x7f611c02f120 comp rx=0 tx=0).stop 2026-02-20T13:24:57.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 -- 10.20.193.28:0/3828865403 shutdown_connections 2026-02-20T13:24:57.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 --2- 10.20.193.28:0/3828865403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6128155740 0x7f6128175b20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 --2- 10.20.193.28:0/3828865403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810c320 0x7f6128155200 unknown :-1 s=CLOSED pgs=344 gs=3 cs=0 l=1 c_cookie=2079840644572532410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 --2- 10.20.193.28:0/3828865403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f612810ba10 0x7f612810bde0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 -- 10.20.193.28:0/3828865403 >> 10.20.193.28:0/3828865403 conn(0x7f61280e9670 msgr2=0x7f6128109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 -- 10.20.193.28:0/3828865403 shutdown_connections 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.193+0000 7f613008f640 1 -- 10.20.193.28:0/3828865403 wait complete. 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.194+0000 7f613008f640 1 Processor -- start 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.194+0000 7f613008f640 1 -- start start 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.194+0000 7f613008f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810ba10 0x7f6128160440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.194+0000 7f613008f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f612810c320 0x7f6128160980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.194+0000 7f613008f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6128155740 0x7f6128165d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.194+0000 7f613008f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6128166370 con 0x7f6128155740 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.194+0000 7f613008f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f61281664e0 con 0x7f612810ba10 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.194+0000 7f613008f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f61281666a0 con 0x7f612810c320 2026-02-20T13:24:57.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612de04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810ba10 0x7f6128160440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612d603640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f612810c320 0x7f6128160980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612de04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810ba10 0x7f6128160440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59424/0 (socket says 10.20.193.28:59424) 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612de04640 1 -- 10.20.193.28:0/2022068059 learned_addr learned my addr 10.20.193.28:0/2022068059 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612e605640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6128155740 0x7f6128165d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612e605640 1 -- 10.20.193.28:0/2022068059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f612810c320 msgr2=0x7f6128160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612e605640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f612810c320 0x7f6128160980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612e605640 1 -- 10.20.193.28:0/2022068059 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810ba10 msgr2=0x7f6128160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612e605640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810ba10 0x7f6128160440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612e605640 1 -- 10.20.193.28:0/2022068059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c0094b0 con 0x7f6128155740 2026-02-20T13:24:57.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f612e605640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6128155740 0x7f6128165d50 secure :-1 s=READY pgs=939 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6124005820 tx=0x7f612400fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f6116ffd640 1 -- 10.20.193.28:0/2022068059 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f612400dce0 con 0x7f6128155740 2026-02-20T13:24:57.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f613008f640 1 -- 10.20.193.28:0/2022068059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6128166980 con 0x7f6128155740 2026-02-20T13:24:57.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f6116ffd640 1 -- 10.20.193.28:0/2022068059 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f612400de40 con 0x7f6128155740 2026-02-20T13:24:57.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f6116ffd640 1 -- 10.20.193.28:0/2022068059 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6124006820 con 0x7f6128155740 2026-02-20T13:24:57.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.195+0000 7f613008f640 1 -- 10.20.193.28:0/2022068059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6128152370 con 0x7f6128155740 2026-02-20T13:24:57.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.198+0000 7f6116ffd640 1 -- 10.20.193.28:0/2022068059 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6124020060 con 0x7f6128155740 2026-02-20T13:24:57.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.200+0000 7f6116ffd640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f61040b5760 0x7f61040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.200+0000 7f6116ffd640 1 -- 10.20.193.28:0/2022068059 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6124015070 con 0x7f6128155740 2026-02-20T13:24:57.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.200+0000 7f612de04640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f61040b5760 0x7f61040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.200+0000 7f612de04640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f61040b5760 0x7f61040d5c10 secure :-1 s=READY pgs=435 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118005970 tx=0x7f6118009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.202+0000 7f6132089e00 1 Processor -- start 2026-02-20T13:24:57.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f6132089e00 1 -- start start 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f6132089e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cfb2140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f6132089e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff6ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f6132089e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296d017910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f6132089e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56296cebf780 con 0x56296cfb2680 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f6132089e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56296cebb4b0 con 0x56296cff7530 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f6132089e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56296ceb5450 con 0x56296cfb1d70 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612e605640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296d017910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612e605640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296d017910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59436/0 (socket says 10.20.193.28:59436) 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612e605640 1 -- 10.20.193.28:0/3439562163 learned_addr learned my addr 10.20.193.28:0/3439562163 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612de04640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cfb2140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612d603640 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612e605640 1 -- 10.20.193.28:0/3439562163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 msgr2=0x56296cfb2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612e605640 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cfb2140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612e605640 1 -- 10.20.193.28:0/3439562163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 msgr2=0x56296cff6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612e605640 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612e605640 1 -- 10.20.193.28:0/3439562163 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296ce60d10 con 0x56296cff7530 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612de04640 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cfb2140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.203+0000 7f612d603640 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff6ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f612e605640 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296d017910 secure :-1 s=READY pgs=345 gs=2 cs=0 l=1 c_cookie=6356217031030760277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61240e56a0 tx=0x7f61240ae0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5835d1b689e06355 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f60f64e6640 1 -- 10.20.193.28:0/3439562163 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61240ae930 con 0x56296cff7530 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f60f64e6640 1 -- 10.20.193.28:0/3439562163 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f61240b3c50 con 0x56296cff7530 2026-02-20T13:24:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f60f64e6640 1 -- 10.20.193.28:0/3439562163 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61240add50 con 0x56296cff7530 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 -- 10.20.193.28:0/3439562163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 msgr2=0x56296d017910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296d017910 secure :-1 s=READY pgs=345 gs=2 cs=0 l=1 c_cookie=6356217031030760277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61240e56a0 tx=0x7f61240ae0b0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 -- 10.20.193.28:0/3439562163 shutdown_connections 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff6ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296d017910 unknown :-1 s=CLOSED pgs=345 gs=2 cs=0 l=1 c_cookie=6356217031030760277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 --2- 10.20.193.28:0/3439562163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cfb2140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 -- 10.20.193.28:0/3439562163 >> 10.20.193.28:0/3439562163 conn(0x56296cf87860 msgr2=0x56296cfa7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 -- 10.20.193.28:0/3439562163 shutdown_connections 2026-02-20T13:24:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.204+0000 7f6132089e00 1 -- 10.20.193.28:0/3439562163 wait complete. 2026-02-20T13:24:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.205+0000 7f6132089e00 1 -- start start 2026-02-20T13:24:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f6132089e00 1 Processor -- start 2026-02-20T13:24:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f6132089e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296d00f120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f6132089e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 0x56296d00f660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f6132089e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d014650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f6132089e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56296d014b90 con 0x56296cff7530 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f6132089e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56296d014d00 con 0x56296cfb1d70 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f6132089e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56296d014ec0 con 0x56296cfb2680 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f612de04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296d00f120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f612de04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296d00f120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59440/0 (socket says 10.20.193.28:59440) 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f612de04640 1 -- 10.20.193.28:0/250492007 learned_addr learned my addr 10.20.193.28:0/250492007 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f612d603640 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 0x56296d00f660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.206+0000 7f612e605640 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d014650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f612de04640 1 -- 10.20.193.28:0/250492007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 msgr2=0x56296d00f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f612de04640 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 0x56296d00f660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f612de04640 1 -- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 msgr2=0x56296d014650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f612de04640 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d014650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f612de04640 1 -- 10.20.193.28:0/250492007 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296ce393c0 con 0x56296cfb1d70 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f612e605640 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d014650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f612de04640 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296d00f120 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=15693885091510114736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61180116c0 tx=0x7f61180047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9cbe157494259b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f60e37fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f60e37fe640 1 -- 10.20.193.28:0/250492007 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6118021070 con 0x56296cfb1d70 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f60e37fe640 1 -- 10.20.193.28:0/250492007 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6118011e70 con 0x56296cfb1d70 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f60e37fe640 1 -- 10.20.193.28:0/250492007 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61180036a0 con 0x56296cfb1d70 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6128152370 con 0x56296cfb1d70 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f60e37fe640 1 -- 10.20.193.28:0/250492007 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f611801a470 con 0x56296cfb1d70 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f60e37fe640 10 client.28139 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.207+0000 7f6132089e00 10 client.28139 _ll_register_callbacks cb 0x56296ce36a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56296cb4b6f0 con 0x56296cfb1d70 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f60e37fe640 1 -- 10.20.193.28:0/250492007 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6118003830 con 0x56296cfb1d70 2026-02-20T13:24:57.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 10 client.28139 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56296ce4b0e0 con 0x56296cfb1d70 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f60e37fe640 1 -- 10.20.193.28:0/250492007 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f611802d060 con 0x56296cfb1d70 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 10 client.28139 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 10 client.28139 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 20 client.28139 populate_metadata read hostname 'trial028' 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56296d017670 0x56296cff52b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 4 client.28139 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56296ce57f80 con 0x56296d017670 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.208+0000 7f612d603640 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56296d017670 0x56296cff52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.209+0000 7f612d603640 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56296d017670 0x56296cff52b0 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=12899270945877381858 s_cookie=14359120970406822451 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b3036a94fe89d2e2 server_cookie=c745d871d7f60233 in_seq=0 out_seq=0 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.209+0000 7f60e37fe640 10 client.28139 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:24:57.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.209+0000 7f60e37fe640 1 -- 10.20.193.28:0/250492007 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56296ce57f80 con 0x56296d017670 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.209+0000 7f60e37fe640 10 client.28139 handle_command_reply: tid=0 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.209+0000 7f6132089e00 1 client.28139 shutdown 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 msgr2=0x56296d00f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296d00f120 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=15693885091510114736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61180116c0 tx=0x7f61180047e0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 shutdown_connections 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56296d017670 0x56296cff52b0 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=12899270945877381858 s_cookie=14359120970406822451 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d014650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 0x56296d00f660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 --2- 10.20.193.28:0/250492007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296d00f120 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=15693885091510114736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 >> 10.20.193.28:0/250492007 conn(0x56296cf87860 msgr2=0x56296cfa7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f60e37fe640 0 client.28139 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:24:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 shutdown_connections 2026-02-20T13:24:57.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 1 -- 10.20.193.28:0/250492007 wait complete. 2026-02-20T13:24:57.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.210+0000 7f6132089e00 20 client.28139 trim_cache size 0 max 16384 2026-02-20T13:24:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f6132089e00 1 Processor -- start 2026-02-20T13:24:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f6132089e00 1 -- start start 2026-02-20T13:24:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f6132089e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296cff6860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f6132089e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 0x56296cff6da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f6132089e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d00c310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f6132089e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56296ceb3080 con 0x56296cff7530 2026-02-20T13:24:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f6132089e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56296cb73700 con 0x56296cfb1d70 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f6132089e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56296d00fc40 con 0x56296cfb2680 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612de04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296cff6860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612de04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296cff6860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59454/0 (socket says 10.20.193.28:59454) 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612de04640 1 -- 10.20.193.28:0/1886540565 learned_addr learned my addr 10.20.193.28:0/1886540565 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612d603640 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 0x56296cff6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612e605640 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d00c310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612de04640 1 -- 10.20.193.28:0/1886540565 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 msgr2=0x56296cff6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612de04640 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 0x56296cff6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612de04640 1 -- 10.20.193.28:0/1886540565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 msgr2=0x56296d00c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612de04640 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d00c310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612de04640 1 -- 10.20.193.28:0/1886540565 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296ce45b60 con 0x56296cfb1d70 2026-02-20T13:24:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.218+0000 7f612e605640 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d00c310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f612de04640 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296cff6860 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=1948959547963576249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118005940 tx=0x7f611802b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b0c186201f98fb9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f60f5ce5640 1 -- 10.20.193.28:0/1886540565 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f611803d070 con 0x56296cfb1d70 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f60f5ce5640 1 -- 10.20.193.28:0/1886540565 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56296cb4b6f0 con 0x56296cfb1d70 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f60f5ce5640 1 -- 10.20.193.28:0/1886540565 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6118021040 con 0x56296cfb1d70 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 -- 10.20.193.28:0/1886540565 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 msgr2=0x56296cff6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296cff6860 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=1948959547963576249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118005940 tx=0x7f611802b000 comp rx=0 tx=0).stop 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 -- 10.20.193.28:0/1886540565 shutdown_connections 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cff7530 0x56296d00c310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb2680 0x56296cff6da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 --2- 10.20.193.28:0/1886540565 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cfb1d70 0x56296cff6860 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=1948959547963576249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 -- 10.20.193.28:0/1886540565 >> 10.20.193.28:0/1886540565 conn(0x56296cf87860 msgr2=0x56296cff9910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 -- 10.20.193.28:0/1886540565 shutdown_connections 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.219+0000 7f6132089e00 1 -- 10.20.193.28:0/1886540565 wait complete. 2026-02-20T13:24:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f6132089e00 1 -- start start 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f6132089e00 1 Processor -- start 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f6132089e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cf8d560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f6132089e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff1e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f6132089e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296cff23d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f6132089e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56296d003a90 con 0x56296cfb2680 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f6132089e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56296cf8dbd0 con 0x56296cff7530 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f6132089e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56296cf8dd90 con 0x56296cfb1d70 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f612de04640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cf8d560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f612de04640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cf8d560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48564/0 (socket says 10.20.193.28:48564) 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f612de04640 1 -- 10.20.193.28:0/2017806518 learned_addr learned my addr 10.20.193.28:0/2017806518 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.220+0000 7f612e605640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296cff23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f612d603640 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f612de04640 1 -- 10.20.193.28:0/2017806518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 msgr2=0x56296cff23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f612de04640 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296cff23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f612de04640 1 -- 10.20.193.28:0/2017806518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 msgr2=0x56296cff1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f612de04640 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f612de04640 1 -- 10.20.193.28:0/2017806518 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296ce396f0 con 0x56296cfb1d70 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f612e605640 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296cff23d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f612de04640 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cf8d560 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=896785962830581629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f611800f010 tx=0x7f61180026f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c720614f212cf7d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f60e37fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f60e37fe640 1 -- 10.20.193.28:0/2017806518 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f611803d070 con 0x56296cfb1d70 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f60e37fe640 1 -- 10.20.193.28:0/2017806518 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f611800ea60 con 0x56296cfb1d70 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f60e37fe640 1 -- 10.20.193.28:0/2017806518 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6118021040 con 0x56296cfb1d70 2026-02-20T13:24:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6118011e70 con 0x56296cfb1d70 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.221+0000 7f60e37fe640 1 -- 10.20.193.28:0/2017806518 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f611800e660 con 0x56296cfb1d70 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 10 client.28048 _ll_register_callbacks cb 0x56296ce36a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61240b3c50 con 0x56296cfb1d70 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f60e37fe640 1 -- 10.20.193.28:0/2017806518 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6118011e70 con 0x56296cfb1d70 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 10 client.28048 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56296ce4b340 con 0x56296cfb1d70 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f60e37fe640 1 -- 10.20.193.28:0/2017806518 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6118049060 con 0x56296cfb1d70 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 10 client.28048 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 10 client.28048 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 20 client.28048 populate_metadata read hostname 'trial028' 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56296d0a48b0 0x56296d0c4d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 4 client.28048 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56296cb48f40 con 0x56296d0a48b0 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.222+0000 7f612d603640 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56296d0a48b0 0x56296d0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f60e37fe640 10 client.28048 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f612d603640 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56296d0a48b0 0x56296d0c4d60 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=14678089186940452393 s_cookie=11163279687870998402 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbb30c5901167e29 server_cookie=9aebefbb03e26782 in_seq=0 out_seq=0 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f60e37fe640 1 -- 10.20.193.28:0/2017806518 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56296cb48f40 con 0x56296d0a48b0 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f60e37fe640 10 client.28048 handle_command_reply: tid=0 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 client.28048 shutdown 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 msgr2=0x56296cf8d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cf8d560 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=896785962830581629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f611800f010 tx=0x7f61180026f0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 shutdown_connections 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56296d0a48b0 0x56296d0c4d60 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=14678089186940452393 s_cookie=11163279687870998402 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56296cfb2680 0x56296cff1e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56296cff7530 0x56296cff23d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 --2- 10.20.193.28:0/2017806518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56296cfb1d70 0x56296cf8d560 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=896785962830581629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f60e37fe640 0 client.28048 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:24:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 >> 10.20.193.28:0/2017806518 conn(0x56296cf87860 msgr2=0x56296cff5850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 shutdown_connections 2026-02-20T13:24:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 1 -- 10.20.193.28:0/2017806518 wait complete. 2026-02-20T13:24:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.223+0000 7f6132089e00 20 client.28048 trim_cache size 0 max 16384 2026-02-20T13:24:57.232 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 -- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f61040b5760 msgr2=0x7f61040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f61040b5760 0x7f61040d5c10 secure :-1 s=READY pgs=435 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118005970 tx=0x7f6118009310 comp rx=0 tx=0).stop 2026-02-20T13:24:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 -- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6128155740 msgr2=0x7f6128165d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6128155740 0x7f6128165d50 secure :-1 s=READY pgs=939 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6124005820 tx=0x7f612400fde0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 -- 10.20.193.28:0/2022068059 shutdown_connections 2026-02-20T13:24:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f61040b5760 0x7f61040d5c10 unknown :-1 s=CLOSED pgs=435 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6128155740 0x7f6128165d50 unknown :-1 s=CLOSED pgs=939 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f612810c320 0x7f6128160980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 --2- 10.20.193.28:0/2022068059 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f612810ba10 0x7f6128160440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 -- 10.20.193.28:0/2022068059 >> 10.20.193.28:0/2022068059 conn(0x7f61280e9670 msgr2=0x7f6128109a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 -- 10.20.193.28:0/2022068059 shutdown_connections 2026-02-20T13:24:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.224+0000 7f613008f640 1 -- 10.20.193.28:0/2022068059 wait complete. 2026-02-20T13:24:57.327 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:24:57.510 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:57.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 -- 10.20.193.28:0/1833082504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010dc20 msgr2=0x7ff2b0112c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 --2- 10.20.193.28:0/1833082504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010dc20 0x7ff2b0112c70 secure :-1 s=READY pgs=940 gs=1 cs=0 l=1 c_cookie=1817861959686452705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff298009950 tx=0x7ff29802f190 comp rx=0 tx=0).stop 2026-02-20T13:24:57.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 -- 10.20.193.28:0/1833082504 shutdown_connections 2026-02-20T13:24:57.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 --2- 10.20.193.28:0/1833082504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010dc20 0x7ff2b0112c70 unknown :-1 s=CLOSED pgs=940 gs=1 cs=0 l=1 c_cookie=1817861959686452705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 --2- 10.20.193.28:0/1833082504 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2b0113420 0x7ff2b0173df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 --2- 10.20.193.28:0/1833082504 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2b010d230 0x7ff2b010d600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 -- 10.20.193.28:0/1833082504 >> 10.20.193.28:0/1833082504 conn(0x7ff2b00eab00 msgr2=0x7ff2b010af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 -- 10.20.193.28:0/1833082504 shutdown_connections 2026-02-20T13:24:57.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.682+0000 7ff2af577640 1 -- 10.20.193.28:0/1833082504 wait complete. 2026-02-20T13:24:57.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2af577640 1 Processor -- start 2026-02-20T13:24:57.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2af577640 1 -- start start 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2af577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010d230 0x7ff2b00f57d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2af577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2b010dc20 0x7ff2b0173cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2af577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2b0113420 0x7ff2b00f5ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2af577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00fb0e0 con 0x7ff2b010d230 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2af577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00fb250 con 0x7ff2b0113420 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2af577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00fb410 con 0x7ff2b010dc20 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2ae575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010d230 0x7ff2b00f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2add74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2b010dc20 0x7ff2b0173cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2ae575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010d230 0x7ff2b00f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50942/0 (socket says 10.20.193.28:50942) 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2ae575640 1 -- 10.20.193.28:0/1622984466 learned_addr learned my addr 10.20.193.28:0/1622984466 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.683+0000 7ff2aed76640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2b0113420 0x7ff2b00f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2ae575640 1 -- 10.20.193.28:0/1622984466 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2b010dc20 msgr2=0x7ff2b0173cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2ae575640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2b010dc20 0x7ff2b0173cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2ae575640 1 -- 10.20.193.28:0/1622984466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2b0113420 msgr2=0x7ff2b00f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2ae575640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2b0113420 0x7ff2b00f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2ae575640 1 -- 10.20.193.28:0/1622984466 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff298009570 con 0x7ff2b010d230 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2ae575640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010d230 0x7ff2b00f57d0 secure :-1 s=READY pgs=941 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2a400d950 tx=0x7ff2a400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2977fe640 1 -- 10.20.193.28:0/1622984466 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2a4004540 con 0x7ff2b010d230 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2977fe640 1 -- 10.20.193.28:0/1622984466 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2a4009d00 con 0x7ff2b010d230 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2977fe640 1 -- 10.20.193.28:0/1622984466 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2a40106e0 con 0x7ff2b010d230 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2af577640 1 -- 10.20.193.28:0/1622984466 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b00fb6f0 con 0x7ff2b010d230 2026-02-20T13:24:57.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.684+0000 7ff2af577640 1 -- 10.20.193.28:0/1622984466 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b00fbb70 con 0x7ff2b010d230 2026-02-20T13:24:57.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.687+0000 7ff2977fe640 1 -- 10.20.193.28:0/1622984466 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff2a40097c0 con 0x7ff2b010d230 2026-02-20T13:24:57.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2977fe640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2880b56d0 0x7ff2880d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2977fe640 1 -- 10.20.193.28:0/1622984466 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff2a40e6d80 con 0x7ff2b010d230 2026-02-20T13:24:57.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2add74640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2880b56d0 0x7ff2880d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2b6ac0e00 1 Processor -- start 2026-02-20T13:24:57.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2b6ac0e00 1 -- start start 2026-02-20T13:24:57.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05bd70 0x557aba05c140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05c680 0x557aba0a0ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0c1910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557ab9f69780 con 0x557aba05bd70 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557ab9f654b0 con 0x557aba0a1530 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.689+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557ab9f5f450 con 0x557aba05c680 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2add74640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2880b56d0 0x7ff2880d5b80 secure :-1 s=READY pgs=436 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b00fc170 tx=0x7ff29803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59500/0 (socket says 10.20.193.28:59500) 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 -- 10.20.193.28:0/3595880441 learned_addr learned my addr 10.20.193.28:0/3595880441 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2ae575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05bd70 0x557aba05c140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2add74640 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05c680 0x557aba0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 -- 10.20.193.28:0/3595880441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05c680 msgr2=0x557aba0a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05c680 0x557aba0a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 -- 10.20.193.28:0/3595880441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05bd70 msgr2=0x557aba05c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05bd70 0x557aba05c140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 -- 10.20.193.28:0/3595880441 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab9f0ad10 con 0x557aba0a1530 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2add74640 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05c680 0x557aba0a0ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff2aed76640 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0c1910 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=15796310467074790401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2a0005630 tx=0x7ff2a0003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db37c4ad67c71401 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff294ff9640 1 -- 10.20.193.28:0/3595880441 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2a0003e30 con 0x557aba0a1530 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff294ff9640 1 -- 10.20.193.28:0/3595880441 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2a0011910 con 0x557aba0a1530 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.690+0000 7ff294ff9640 1 -- 10.20.193.28:0/3595880441 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2a001baa0 con 0x557aba0a1530 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3595880441 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 msgr2=0x557aba0c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0c1910 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=15796310467074790401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2a0005630 tx=0x7ff2a0003c30 comp rx=0 tx=0).stop 2026-02-20T13:24:57.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3595880441 shutdown_connections 2026-02-20T13:24:57.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0c1910 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=15796310467074790401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05c680 0x557aba0a0ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/3595880441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05bd70 0x557aba05c140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3595880441 >> 10.20.193.28:0/3595880441 conn(0x557aba03a270 msgr2=0x557aba05a650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3595880441 shutdown_connections 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.691+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3595880441 wait complete. 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.692+0000 7ff2b6ac0e00 1 -- start start 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.692+0000 7ff2b6ac0e00 1 Processor -- start 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba05bd70 0x557aba0b90a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0b95e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba0a1530 0x557aba0be5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557aba0beb10 con 0x557aba05c680 2026-02-20T13:24:57.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557aba0bec80 con 0x557aba05bd70 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557aba0bee40 con 0x557aba0a1530 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2ae575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba05bd70 0x557aba0b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2ae575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba05bd70 0x557aba0b90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59516/0 (socket says 10.20.193.28:59516) 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2ae575640 1 -- 10.20.193.28:0/2625977173 learned_addr learned my addr 10.20.193.28:0/2625977173 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2add74640 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2aed76640 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba0a1530 0x557aba0be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2add74640 1 -- 10.20.193.28:0/2625977173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba0a1530 msgr2=0x557aba0be5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2add74640 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba0a1530 0x557aba0be5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2add74640 1 -- 10.20.193.28:0/2625977173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba05bd70 msgr2=0x557aba0b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2add74640 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba05bd70 0x557aba0b90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.693+0000 7ff2add74640 1 -- 10.20.193.28:0/2625977173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab9ee33c0 con 0x557aba05c680 2026-02-20T13:24:57.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff2add74640 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0b95e0 secure :-1 s=READY pgs=942 gs=2 cs=0 l=1 c_cookie=6976315839999190587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff298004820 tx=0x7ff29802f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d0da4b5c15263b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff25ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff25ffff640 1 -- 10.20.193.28:0/2625977173 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff298038d50 con 0x557aba05c680 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff25ffff640 1 -- 10.20.193.28:0/2625977173 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff29804a050 con 0x557aba05c680 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff25ffff640 1 -- 10.20.193.28:0/2625977173 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff298044410 con 0x557aba05c680 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a00052d0 con 0x557aba05c680 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff25ffff640 1 -- 10.20.193.28:0/2625977173 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff2980445a0 con 0x557aba05c680 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff25ffff640 10 client.18195 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff2b6ac0e00 10 client.18195 _ll_register_callbacks cb 0x557ab9ee0a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:57.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ab9bf56f0 con 0x557aba05c680 2026-02-20T13:24:57.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.694+0000 7ff25ffff640 1 -- 10.20.193.28:0/2625977173 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff2980043a0 con 0x557aba05c680 2026-02-20T13:24:57.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2b6ac0e00 10 client.18195 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:57.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557ab9ef50e0 con 0x557aba05c680 2026-02-20T13:24:57.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff25ffff640 1 -- 10.20.193.28:0/2625977173 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff298044760 con 0x557aba05c680 2026-02-20T13:24:57.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2b6ac0e00 10 client.18195 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:57.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2b6ac0e00 10 client.18195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:57.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2b6ac0e00 20 client.18195 populate_metadata read hostname 'trial028' 2026-02-20T13:24:57.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557aba0c15b0 0x557aba09f2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2b6ac0e00 4 client.18195 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:57.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ab9f01f80 con 0x557aba0c15b0 2026-02-20T13:24:57.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.695+0000 7ff2ae575640 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557aba0c15b0 0x557aba09f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.696+0000 7ff25ffff640 10 client.18195 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:57.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.696+0000 7ff2ae575640 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557aba0c15b0 0x557aba09f2b0 crc :-1 s=READY pgs=230 gs=4 cs=0 l=0 c_cookie=5436224426678490395 s_cookie=6289260077895064912 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b7159504f79151b server_cookie=5747f0b80afb1d50 in_seq=0 out_seq=0 2026-02-20T13:24:57.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff25ffff640 1 -- 10.20.193.28:0/2625977173 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557ab9f01f80 con 0x557aba0c15b0 2026-02-20T13:24:57.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff25ffff640 10 client.18195 handle_command_reply: tid=0 2026-02-20T13:24:57.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 client.18195 shutdown 2026-02-20T13:24:57.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 msgr2=0x557aba0b95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0b95e0 secure :-1 s=READY pgs=942 gs=2 cs=0 l=1 c_cookie=6976315839999190587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff298004820 tx=0x7ff29802f190 comp rx=0 tx=0).stop 2026-02-20T13:24:57.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 shutdown_connections 2026-02-20T13:24:57.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557aba0c15b0 0x557aba09f2b0 crc :-1 s=READY pgs=230 gs=4 cs=0 l=0 c_cookie=5436224426678490395 s_cookie=6289260077895064912 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0b95e0 unknown :-1 s=CLOSED pgs=942 gs=2 cs=0 l=1 c_cookie=6976315839999190587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba0a1530 0x557aba0be5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/2625977173 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba05bd70 0x557aba0b90a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 >> 10.20.193.28:0/2625977173 conn(0x557aba03a270 msgr2=0x557aba05a650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff25ffff640 0 client.18195 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:57.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 shutdown_connections 2026-02-20T13:24:57.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/2625977173 wait complete. 2026-02-20T13:24:57.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.697+0000 7ff2b6ac0e00 20 client.18195 trim_cache size 0 max 16384 2026-02-20T13:24:57.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2b6ac0e00 1 Processor -- start 2026-02-20T13:24:57.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2b6ac0e00 1 -- start start 2026-02-20T13:24:57.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 0x557aba0b69c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0a02c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0a0800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557ab9f5d080 con 0x557aba05c680 2026-02-20T13:24:57.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557ab9c1d700 con 0x557aba0a1530 2026-02-20T13:24:57.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557aba0b1fb0 con 0x557aba05bd70 2026-02-20T13:24:57.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2ae575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 0x557aba0b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50980/0 (socket says 10.20.193.28:50980) 2026-02-20T13:24:57.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 -- 10.20.193.28:0/3519630339 learned_addr learned my addr 10.20.193.28:0/3519630339 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2aed76640 1 --2- 10.20.193.28:0/3519630339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 -- 10.20.193.28:0/3519630339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 msgr2=0x557aba0b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 --2- 10.20.193.28:0/3519630339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 0x557aba0b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 -- 10.20.193.28:0/3519630339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 msgr2=0x557aba0a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 --2- 10.20.193.28:0/3519630339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 -- 10.20.193.28:0/3519630339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab9eefb60 con 0x557aba05c680 2026-02-20T13:24:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.705+0000 7ff2add74640 1 --2- 10.20.193.28:0/3519630339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0a02c0 secure :-1 s=READY pgs=943 gs=1 cs=0 l=1 c_cookie=3032165620607070048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff298009950 tx=0x7ff298059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a146a911c6faf60 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff27a4e6640 1 -- 10.20.193.28:0/3519630339 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff298057eb0 con 0x557aba05c680 2026-02-20T13:24:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff27a4e6640 1 -- 10.20.193.28:0/3519630339 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff29804a030 con 0x557aba05c680 2026-02-20T13:24:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff27a4e6640 1 -- 10.20.193.28:0/3519630339 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff298004130 con 0x557aba05c680 2026-02-20T13:24:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3519630339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 msgr2=0x557aba0a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/3519630339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0a02c0 secure :-1 s=READY pgs=943 gs=1 cs=0 l=1 c_cookie=3032165620607070048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff298009950 tx=0x7ff298059000 comp rx=0 tx=0).stop 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3519630339 shutdown_connections 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/3519630339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba0a02c0 unknown :-1 s=CLOSED pgs=943 gs=1 cs=0 l=1 c_cookie=3032165620607070048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/3519630339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba0a0800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/3519630339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 0x557aba0b69c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3519630339 >> 10.20.193.28:0/3519630339 conn(0x557aba03a270 msgr2=0x557aba0b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3519630339 shutdown_connections 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.706+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/3519630339 wait complete. 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2b6ac0e00 1 -- start start 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2b6ac0e00 1 Processor -- start 2026-02-20T13:24:57.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 0x557aba03fef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba03e9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2b6ac0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba03ef20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557ab9f5d080 con 0x557aba05c680 2026-02-20T13:24:57.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557ab9c1d700 con 0x557aba0a1530 2026-02-20T13:24:57.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2b6ac0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557aba03f460 con 0x557aba05bd70 2026-02-20T13:24:57.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2add74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba03e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2aed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba03ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2aed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba03ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59530/0 (socket says 10.20.193.28:59530) 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2ae575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 0x557aba03fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2aed76640 1 -- 10.20.193.28:0/564071903 learned_addr learned my addr 10.20.193.28:0/564071903 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2add74640 1 -- 10.20.193.28:0/564071903 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 msgr2=0x557aba03fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2add74640 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 0x557aba03fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2add74640 1 -- 10.20.193.28:0/564071903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 msgr2=0x557aba03ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2add74640 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba03ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.707+0000 7ff2add74640 1 -- 10.20.193.28:0/564071903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab9ee36f0 con 0x557aba05c680 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff2add74640 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba03e9e0 secure :-1 s=READY pgs=944 gs=1 cs=0 l=1 c_cookie=8443090700932296488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff298004820 tx=0x7ff298005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752be24253792f28 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff25ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff25ffff640 1 -- 10.20.193.28:0/564071903 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2980043a0 con 0x557aba05c680 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff25ffff640 1 -- 10.20.193.28:0/564071903 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff298061020 con 0x557aba05c680 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff25ffff640 1 -- 10.20.193.28:0/564071903 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2980425e0 con 0x557aba05c680 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab9ef50e0 con 0x557aba05c680 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff2b6ac0e00 10 client.18201 _ll_register_callbacks cb 0x557ab9ee0a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a0011910 con 0x557aba05c680 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff25ffff640 1 -- 10.20.193.28:0/564071903 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff298062030 con 0x557aba05c680 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff25ffff640 1 -- 10.20.193.28:0/564071903 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff298058c50 con 0x557aba05c680 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff2b6ac0e00 10 client.18201 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.708+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557ab9ef5340 con 0x557aba05c680 2026-02-20T13:24:57.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.709+0000 7ff25ffff640 1 -- 10.20.193.28:0/564071903 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff298076020 con 0x557aba05c680 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.709+0000 7ff2b6ac0e00 10 client.18201 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.709+0000 7ff2b6ac0e00 10 client.18201 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.709+0000 7ff2b6ac0e00 20 client.18201 populate_metadata read hostname 'trial028' 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.709+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557aba108210 0x557aba16ea20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.709+0000 7ff2b6ac0e00 4 client.18201 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.709+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ab9bf2f40 con 0x557aba108210 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.709+0000 7ff2ae575640 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557aba108210 0x557aba16ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2ae575640 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557aba108210 0x557aba16ea20 crc :-1 s=READY pgs=231 gs=4 cs=0 l=0 c_cookie=3294123008731174158 s_cookie=12151055837610877844 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db7136c65dcd50e server_cookie=a8a138e7bebba394 in_seq=0 out_seq=0 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff25ffff640 10 client.18201 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:57.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff25ffff640 1 -- 10.20.193.28:0/564071903 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ab9bf2f40 con 0x557aba108210 2026-02-20T13:24:57.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff25ffff640 10 client.18201 handle_command_reply: tid=0 2026-02-20T13:24:57.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 client.18201 shutdown 2026-02-20T13:24:57.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 msgr2=0x557aba03e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba03e9e0 secure :-1 s=READY pgs=944 gs=1 cs=0 l=1 c_cookie=8443090700932296488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff298004820 tx=0x7ff298005e80 comp rx=0 tx=0).stop 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 shutdown_connections 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557aba108210 0x557aba16ea20 crc :-1 s=READY pgs=231 gs=4 cs=0 l=0 c_cookie=3294123008731174158 s_cookie=12151055837610877844 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557aba05c680 0x557aba03e9e0 unknown :-1 s=CLOSED pgs=944 gs=1 cs=0 l=1 c_cookie=8443090700932296488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557aba0a1530 0x557aba03ef20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 --2- 10.20.193.28:0/564071903 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557aba05bd70 0x557aba03fef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff25ffff640 0 client.18201 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.710+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 >> 10.20.193.28:0/564071903 conn(0x557aba03a270 msgr2=0x557aba0b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 shutdown_connections 2026-02-20T13:24:57.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2b6ac0e00 1 -- 10.20.193.28:0/564071903 wait complete. 2026-02-20T13:24:57.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2b6ac0e00 20 client.18201 trim_cache size 0 max 16384 2026-02-20T13:24:57.724 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 -- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2880b56d0 msgr2=0x7ff2880d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2880b56d0 0x7ff2880d5b80 secure :-1 s=READY pgs=436 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b00fc170 tx=0x7ff29803a040 comp rx=0 tx=0).stop 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 -- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010d230 msgr2=0x7ff2b00f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010d230 0x7ff2b00f57d0 secure :-1 s=READY pgs=941 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2a400d950 tx=0x7ff2a400de20 comp rx=0 tx=0).stop 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 -- 10.20.193.28:0/1622984466 shutdown_connections 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2880b56d0 0x7ff2880d5b80 unknown :-1 s=CLOSED pgs=436 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2b0113420 0x7ff2b00f5ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2b010dc20 0x7ff2b0173cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 --2- 10.20.193.28:0/1622984466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b010d230 0x7ff2b00f57d0 unknown :-1 s=CLOSED pgs=941 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:57.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 -- 10.20.193.28:0/1622984466 >> 10.20.193.28:0/1622984466 conn(0x7ff2b00eab00 msgr2=0x7ff2b0111370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:57.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 -- 10.20.193.28:0/1622984466 shutdown_connections 2026-02-20T13:24:57.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:57.711+0000 7ff2af577640 1 -- 10.20.193.28:0/1622984466 wait complete. 2026-02-20T13:24:58.813 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:24:58.813 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:24:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:58 trial028 ceph-mon[37442]: pgmap v410: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-20T13:24:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:58 trial127 ceph-mon[43817]: pgmap v410: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-20T13:24:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:58 trial034 ceph-mon[43332]: pgmap v410: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-20T13:24:59.000 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 -- 10.20.193.28:0/1088529933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810fea0 msgr2=0x7f0218114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 --2- 10.20.193.28:0/1088529933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810fea0 0x7f0218114ef0 secure :-1 s=READY pgs=945 gs=1 cs=0 l=1 c_cookie=14915034433274376316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0208009890 tx=0x7f020802f120 comp rx=0 tx=0).stop 2026-02-20T13:24:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 -- 10.20.193.28:0/1088529933 shutdown_connections 2026-02-20T13:24:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 --2- 10.20.193.28:0/1088529933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810fea0 0x7f0218114ef0 unknown :-1 s=CLOSED pgs=945 gs=1 cs=0 l=1 c_cookie=14915034433274376316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 --2- 10.20.193.28:0/1088529933 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02181156a0 0x7f0218176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 --2- 10.20.193.28:0/1088529933 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f021810f4b0 0x7f021810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 -- 10.20.193.28:0/1088529933 >> 10.20.193.28:0/1088529933 conn(0x7f02180ecda0 msgr2=0x7f021810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 -- 10.20.193.28:0/1088529933 shutdown_connections 2026-02-20T13:24:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.167+0000 7f021d4c9640 1 -- 10.20.193.28:0/1088529933 wait complete. 2026-02-20T13:24:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021d4c9640 1 Processor -- start 2026-02-20T13:24:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021d4c9640 1 -- start start 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021d4c9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810f4b0 0x7f02180f57c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021d4c9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f021810fea0 0x7f0218175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021d4c9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02181156a0 0x7f02180f5ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021d4c9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02180fb080 con 0x7f021810f4b0 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021d4c9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f02180fb1f0 con 0x7f021810fea0 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021d4c9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f02180fb3b0 con 0x7f02181156a0 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f0217fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810f4b0 0x7f02180f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f02177fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f021810fea0 0x7f0218175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f0217fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810f4b0 0x7f02180f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51004/0 (socket says 10.20.193.28:51004) 2026-02-20T13:24:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f0217fff640 1 -- 10.20.193.28:0/3074647674 learned_addr learned my addr 10.20.193.28:0/3074647674 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f021ccc8640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02181156a0 0x7f02180f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f0217fff640 1 -- 10.20.193.28:0/3074647674 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02181156a0 msgr2=0x7f02180f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f0217fff640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02181156a0 0x7f02180f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f0217fff640 1 -- 10.20.193.28:0/3074647674 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f021810fea0 msgr2=0x7f0218175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f0217fff640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f021810fea0 0x7f0218175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.168+0000 7f0217fff640 1 -- 10.20.193.28:0/3074647674 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02080094b0 con 0x7f021810f4b0 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.169+0000 7f0217fff640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810f4b0 0x7f02180f57c0 secure :-1 s=READY pgs=946 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f020400e9c0 tx=0x7f020400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.169+0000 7f02157fa640 1 -- 10.20.193.28:0/3074647674 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f020400cd70 con 0x7f021810f4b0 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.169+0000 7f02157fa640 1 -- 10.20.193.28:0/3074647674 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0204004d30 con 0x7f021810f4b0 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.169+0000 7f021d4c9640 1 -- 10.20.193.28:0/3074647674 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02180fb690 con 0x7f021810f4b0 2026-02-20T13:24:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.169+0000 7f02157fa640 1 -- 10.20.193.28:0/3074647674 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02040106b0 con 0x7f021810f4b0 2026-02-20T13:24:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.169+0000 7f021d4c9640 1 -- 10.20.193.28:0/3074647674 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02180fbbb0 con 0x7f021810f4b0 2026-02-20T13:24:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.172+0000 7f02157fa640 1 -- 10.20.193.28:0/3074647674 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f020401f060 con 0x7f021810f4b0 2026-02-20T13:24:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.173+0000 7f02157fa640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01ec0b5750 0x7f01ec0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.173+0000 7f02157fa640 1 -- 10.20.193.28:0/3074647674 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0204014070 con 0x7f021810f4b0 2026-02-20T13:24:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.174+0000 7f02177fe640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01ec0b5750 0x7f01ec0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.174+0000 7f02177fe640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01ec0b5750 0x7f01ec0d5c00 secure :-1 s=READY pgs=437 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02180fc110 tx=0x7f020803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.174+0000 7f022074ce00 1 Processor -- start 2026-02-20T13:24:59.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.174+0000 7f022074ce00 1 -- start start 2026-02-20T13:24:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f022074ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7ee20 0x556d45e7f1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f022074ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45ec3e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f022074ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45ec43d0 0x556d45ee47b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f022074ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556d45d8ca20 con 0x556d45e7ee20 2026-02-20T13:24:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f022074ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556d45d88750 con 0x556d45e7f730 2026-02-20T13:24:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f022074ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556d45d826f0 con 0x556d45ec43d0 2026-02-20T13:24:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f02177fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45ec3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7ee20 0x556d45e7f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7ee20 0x556d45e7f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51010/0 (socket says 10.20.193.28:51010) 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 -- 10.20.193.28:0/2958208917 learned_addr learned my addr 10.20.193.28:0/2958208917 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f021ccc8640 1 --2- 10.20.193.28:0/2958208917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45ec43d0 0x556d45ee47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 -- 10.20.193.28:0/2958208917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45ec43d0 msgr2=0x556d45ee47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 --2- 10.20.193.28:0/2958208917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45ec43d0 0x556d45ee47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 -- 10.20.193.28:0/2958208917 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 msgr2=0x556d45ec3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 --2- 10.20.193.28:0/2958208917 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45ec3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 -- 10.20.193.28:0/2958208917 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d45d2e120 con 0x556d45e7ee20 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f0217fff640 1 --2- 10.20.193.28:0/2958208917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7ee20 0x556d45e7f1f0 secure :-1 s=READY pgs=947 gs=2 cs=0 l=1 c_cookie=9438247996562146910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0204005040 tx=0x7f02040a96b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fb648c0121065e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f01e8ce3640 1 -- 10.20.193.28:0/2958208917 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02040ac790 con 0x556d45e7ee20 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f01e8ce3640 1 -- 10.20.193.28:0/2958208917 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f02040ad990 con 0x556d45e7ee20 2026-02-20T13:24:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.175+0000 7f01e8ce3640 1 -- 10.20.193.28:0/2958208917 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02040b7c40 con 0x556d45e7ee20 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 -- 10.20.193.28:0/2958208917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7ee20 msgr2=0x556d45e7f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 --2- 10.20.193.28:0/2958208917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7ee20 0x556d45e7f1f0 secure :-1 s=READY pgs=947 gs=2 cs=0 l=1 c_cookie=9438247996562146910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0204005040 tx=0x7f02040a96b0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 -- 10.20.193.28:0/2958208917 shutdown_connections 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 --2- 10.20.193.28:0/2958208917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45ec43d0 0x556d45ee47b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 --2- 10.20.193.28:0/2958208917 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45ec3e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 --2- 10.20.193.28:0/2958208917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7ee20 0x556d45e7f1f0 unknown :-1 s=CLOSED pgs=947 gs=2 cs=0 l=1 c_cookie=9438247996562146910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 -- 10.20.193.28:0/2958208917 >> 10.20.193.28:0/2958208917 conn(0x556d45e54910 msgr2=0x556d45e74cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 -- 10.20.193.28:0/2958208917 shutdown_connections 2026-02-20T13:24:59.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.176+0000 7f022074ce00 1 -- 10.20.193.28:0/2958208917 wait complete. 2026-02-20T13:24:59.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.177+0000 7f022074ce00 1 -- start start 2026-02-20T13:24:59.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f022074ce00 1 Processor -- start 2026-02-20T13:24:59.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f022074ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 0x556d45e97750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f022074ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45e97c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f022074ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec43d0 0x556d45e9cc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f022074ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556d45e9d1c0 con 0x556d45ec43d0 2026-02-20T13:24:59.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f022074ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556d45e9d330 con 0x556d45e7f730 2026-02-20T13:24:59.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f022074ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556d45e9d4f0 con 0x556d45e7ee20 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f021ccc8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec43d0 0x556d45e9cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f0217fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 0x556d45e97750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f021ccc8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec43d0 0x556d45e9cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51022/0 (socket says 10.20.193.28:51022) 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f021ccc8640 1 -- 10.20.193.28:0/2337420877 learned_addr learned my addr 10.20.193.28:0/2337420877 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f02177fe640 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45e97c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f021ccc8640 1 -- 10.20.193.28:0/2337420877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 msgr2=0x556d45e97750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f021ccc8640 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 0x556d45e97750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f021ccc8640 1 -- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 msgr2=0x556d45e97c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f021ccc8640 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45e97c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f021ccc8640 1 -- 10.20.193.28:0/2337420877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d45d06810 con 0x556d45ec43d0 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.178+0000 7f02177fe640 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45e97c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:24:59.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f021ccc8640 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec43d0 0x556d45e9cc80 secure :-1 s=READY pgs=948 gs=2 cs=0 l=1 c_cookie=14133168954987514914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f020c003dc0 tx=0x7f020c00aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4231a48a89c0c22 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f01d9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f01d9ffb640 1 -- 10.20.193.28:0/2337420877 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f020c018070 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02180fbbb0 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f022074ce00 10 client.18213 _ll_register_callbacks cb 0x556d45d39b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d45a189d0 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f01d9ffb640 1 -- 10.20.193.28:0/2337420877 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f020c013c40 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f01d9ffb640 1 -- 10.20.193.28:0/2337420877 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f020c011e20 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f01d9ffb640 1 -- 10.20.193.28:0/2337420877 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f020c01d420 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f01d9ffb640 1 -- 10.20.193.28:0/2337420877 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f020c01d620 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f022074ce00 10 client.18213 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.179+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556d45d184f0 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.180+0000 7f01d9ffb640 1 -- 10.20.193.28:0/2337420877 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f020c013760 con 0x556d45ec43d0 2026-02-20T13:24:59.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.180+0000 7f022074ce00 10 client.18213 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.180+0000 7f022074ce00 10 client.18213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.180+0000 7f022074ce00 20 client.18213 populate_metadata read hostname 'trial028' 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.180+0000 7f022074ce00 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556d45ec2030 0x556d45ec24d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.180+0000 7f022074ce00 4 client.18213 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.180+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d45d8fdf0 con 0x556d45ec2030 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.180+0000 7f0217fff640 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556d45ec2030 0x556d45ec24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.181+0000 7f0217fff640 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556d45ec2030 0x556d45ec24d0 crc :-1 s=READY pgs=232 gs=4 cs=0 l=0 c_cookie=10525973084474163847 s_cookie=14027268633777105616 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9213c4c05767c287 server_cookie=c2aade80b5436ad0 in_seq=0 out_seq=0 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.181+0000 7f01d9ffb640 10 client.18213 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.181+0000 7f01d9ffb640 1 -- 10.20.193.28:0/2337420877 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556d45d8fdf0 con 0x556d45ec2030 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.181+0000 7f01d9ffb640 10 client.18213 handle_command_reply: tid=0 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.181+0000 7f022074ce00 1 client.18213 shutdown 2026-02-20T13:24:59.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec43d0 msgr2=0x556d45e9cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec43d0 0x556d45e9cc80 secure :-1 s=READY pgs=948 gs=2 cs=0 l=1 c_cookie=14133168954987514914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f020c003dc0 tx=0x7f020c00aab0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 shutdown_connections 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556d45ec2030 0x556d45ec24d0 crc :-1 s=READY pgs=232 gs=4 cs=0 l=0 c_cookie=10525973084474163847 s_cookie=14027268633777105616 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec43d0 0x556d45e9cc80 unknown :-1 s=CLOSED pgs=948 gs=2 cs=0 l=1 c_cookie=14133168954987514914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f01d9ffb640 0 client.18213 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7f730 0x556d45e97c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 --2- 10.20.193.28:0/2337420877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 0x556d45e97750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 >> 10.20.193.28:0/2337420877 conn(0x556d45e54910 msgr2=0x556d45e754e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 shutdown_connections 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 1 -- 10.20.193.28:0/2337420877 wait complete. 2026-02-20T13:24:59.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.182+0000 7f022074ce00 20 client.18213 trim_cache size 0 max 16384 2026-02-20T13:24:59.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.191+0000 7f022074ce00 1 Processor -- start 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.191+0000 7f022074ce00 1 -- start start 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.191+0000 7f022074ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7ee20 0x556d45e97950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.191+0000 7f022074ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7f730 0x556d45ec3a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.191+0000 7f022074ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec2030 0x556d45e94b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.191+0000 7f022074ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556d45d80320 con 0x556d45ec2030 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.191+0000 7f022074ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556d45a40790 con 0x556d45e7ee20 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.191+0000 7f022074ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556d45e51390 con 0x556d45e7f730 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f021ccc8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec2030 0x556d45e94b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f02177fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7f730 0x556d45ec3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f0217fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7ee20 0x556d45e97950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f02177fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7f730 0x556d45ec3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48638/0 (socket says 10.20.193.28:48638) 2026-02-20T13:24:59.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f02177fe640 1 -- 10.20.193.28:0/1201138261 learned_addr learned my addr 10.20.193.28:0/1201138261 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f021ccc8640 1 -- 10.20.193.28:0/1201138261 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7f730 msgr2=0x556d45ec3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f021ccc8640 1 --2- 10.20.193.28:0/1201138261 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7f730 0x556d45ec3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f021ccc8640 1 -- 10.20.193.28:0/1201138261 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7ee20 msgr2=0x556d45e97950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f021ccc8640 1 --2- 10.20.193.28:0/1201138261 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7ee20 0x556d45e97950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f021ccc8640 1 -- 10.20.193.28:0/1201138261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d45e89a50 con 0x556d45ec2030 2026-02-20T13:24:59.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f021ccc8640 1 --2- 10.20.193.28:0/1201138261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec2030 0x556d45e94b10 secure :-1 s=READY pgs=949 gs=3 cs=0 l=1 c_cookie=7798789982767166038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f020c0117a0 tx=0x7f020c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3ade2b68b63256 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f01dbfff640 1 -- 10.20.193.28:0/1201138261 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f020c033070 con 0x556d45ec2030 2026-02-20T13:24:59.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f01dbfff640 1 -- 10.20.193.28:0/1201138261 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f020c02a060 con 0x556d45ec2030 2026-02-20T13:24:59.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.192+0000 7f01dbfff640 1 -- 10.20.193.28:0/1201138261 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f020c018040 con 0x556d45ec2030 2026-02-20T13:24:59.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 -- 10.20.193.28:0/1201138261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec2030 msgr2=0x556d45e94b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 --2- 10.20.193.28:0/1201138261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec2030 0x556d45e94b10 secure :-1 s=READY pgs=949 gs=3 cs=0 l=1 c_cookie=7798789982767166038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f020c0117a0 tx=0x7f020c021000 comp rx=0 tx=0).stop 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 -- 10.20.193.28:0/1201138261 shutdown_connections 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 --2- 10.20.193.28:0/1201138261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45ec2030 0x556d45e94b10 unknown :-1 s=CLOSED pgs=949 gs=3 cs=0 l=1 c_cookie=7798789982767166038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 --2- 10.20.193.28:0/1201138261 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7f730 0x556d45ec3a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 --2- 10.20.193.28:0/1201138261 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45e7ee20 0x556d45e97950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 -- 10.20.193.28:0/1201138261 >> 10.20.193.28:0/1201138261 conn(0x556d45e54910 msgr2=0x556d45ec3380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 -- 10.20.193.28:0/1201138261 shutdown_connections 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 -- 10.20.193.28:0/1201138261 wait complete. 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.193+0000 7f022074ce00 1 -- start start 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f022074ce00 1 Processor -- start 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f022074ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 0x556d45e9e250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f022074ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7f730 0x556d45e9e790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f022074ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45ec2030 0x556d45e9ecd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f022074ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556d45ea3f20 con 0x556d45e7f730 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f022074ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556d45f70e50 con 0x556d45ec2030 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f022074ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556d45f71010 con 0x556d45e7ee20 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f0217fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 0x556d45e9e250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f02177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7f730 0x556d45e9e790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f021ccc8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45ec2030 0x556d45e9ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f02177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7f730 0x556d45e9e790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51042/0 (socket says 10.20.193.28:51042) 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.194+0000 7f02177fe640 1 -- 10.20.193.28:0/1987840372 learned_addr learned my addr 10.20.193.28:0/1987840372 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f02177fe640 1 -- 10.20.193.28:0/1987840372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 msgr2=0x556d45e9e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f02177fe640 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 0x556d45e9e250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f02177fe640 1 -- 10.20.193.28:0/1987840372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45ec2030 msgr2=0x556d45e9ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f02177fe640 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45ec2030 0x556d45e9ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f02177fe640 1 -- 10.20.193.28:0/1987840372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d45d12f70 con 0x556d45e7f730 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f02177fe640 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7f730 0x556d45e9e790 secure :-1 s=READY pgs=950 gs=1 cs=0 l=1 c_cookie=13120089958468616321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02080097e0 tx=0x7f0208005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b613ec4dd3b10081 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f01d9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f01d9ffb640 1 -- 10.20.193.28:0/1987840372 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0208002a10 con 0x556d45e7f730 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f01d9ffb640 1 -- 10.20.193.28:0/1987840372 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f020803e040 con 0x556d45e7f730 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f01d9ffb640 1 -- 10.20.193.28:0/1987840372 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0208044670 con 0x556d45e7f730 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d45d184f0 con 0x556d45e7f730 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f01d9ffb640 1 -- 10.20.193.28:0/1987840372 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0208044800 con 0x556d45e7f730 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f01d9ffb640 10 client.18219 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f022074ce00 10 client.18219 _ll_register_callbacks cb 0x556d45d39b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:59.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d45ada530 con 0x556d45e7f730 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f01d9ffb640 1 -- 10.20.193.28:0/1987840372 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0208038e50 con 0x556d45e7f730 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f022074ce00 10 client.18219 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.195+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556d45d06b40 con 0x556d45e7f730 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.196+0000 7f01d9ffb640 1 -- 10.20.193.28:0/1987840372 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0208052470 con 0x556d45e7f730 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.196+0000 7f022074ce00 10 client.18219 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.196+0000 7f022074ce00 10 client.18219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.196+0000 7f022074ce00 20 client.18219 populate_metadata read hostname 'trial028' 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.196+0000 7f022074ce00 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556d45ec43d0 0x556d45f92ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.196+0000 7f022074ce00 4 client.18219 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.196+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f02040ad990 con 0x556d45ec43d0 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.196+0000 7f0217fff640 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556d45ec43d0 0x556d45f92ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.197+0000 7f0217fff640 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556d45ec43d0 0x556d45f92ee0 crc :-1 s=READY pgs=233 gs=4 cs=0 l=0 c_cookie=11354501492732096619 s_cookie=14185862953148667105 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d934af2ebf0706b server_cookie=c4de4f322accd4e1 in_seq=0 out_seq=0 2026-02-20T13:24:59.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.197+0000 7f01d9ffb640 10 client.18219 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:59.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.197+0000 7f01d9ffb640 1 -- 10.20.193.28:0/1987840372 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f02040ad990 con 0x556d45ec43d0 2026-02-20T13:24:59.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.197+0000 7f01d9ffb640 10 client.18219 handle_command_reply: tid=0 2026-02-20T13:24:59.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.197+0000 7f022074ce00 1 client.18219 shutdown 2026-02-20T13:24:59.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7f730 msgr2=0x556d45e9e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7f730 0x556d45e9e790 secure :-1 s=READY pgs=950 gs=1 cs=0 l=1 c_cookie=13120089958468616321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02080097e0 tx=0x7f0208005f90 comp rx=0 tx=0).stop 2026-02-20T13:24:59.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 shutdown_connections 2026-02-20T13:24:59.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556d45ec43d0 0x556d45f92ee0 crc :-1 s=READY pgs=233 gs=4 cs=0 l=0 c_cookie=11354501492732096619 s_cookie=14185862953148667105 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d45e7f730 0x556d45e9e790 unknown :-1 s=CLOSED pgs=950 gs=1 cs=0 l=1 c_cookie=13120089958468616321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556d45ec2030 0x556d45e9ecd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 --2- 10.20.193.28:0/1987840372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556d45e7ee20 0x556d45e9e250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 >> 10.20.193.28:0/1987840372 conn(0x556d45e54910 msgr2=0x556d45ec3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f01d9ffb640 0 client.18219 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:59.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 shutdown_connections 2026-02-20T13:24:59.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 1 -- 10.20.193.28:0/1987840372 wait complete. 2026-02-20T13:24:59.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.198+0000 7f022074ce00 20 client.18219 trim_cache size 0 max 16384 2026-02-20T13:24:59.207 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:24:59.207 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:24:59.207 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "74e9be25-8d05-45c2-8488-6b7ae52cd775", 2026-02-20T13:24:59.207 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:24:59.207 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:24:59.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 -- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01ec0b5750 msgr2=0x7f01ec0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01ec0b5750 0x7f01ec0d5c00 secure :-1 s=READY pgs=437 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02180fc110 tx=0x7f020803a040 comp rx=0 tx=0).stop 2026-02-20T13:24:59.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 -- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810f4b0 msgr2=0x7f02180f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810f4b0 0x7f02180f57c0 secure :-1 s=READY pgs=946 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f020400e9c0 tx=0x7f020400ee90 comp rx=0 tx=0).stop 2026-02-20T13:24:59.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 -- 10.20.193.28:0/3074647674 shutdown_connections 2026-02-20T13:24:59.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f01ec0b5750 0x7f01ec0d5c00 unknown :-1 s=CLOSED pgs=437 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02181156a0 0x7f02180f5ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f021810fea0 0x7f0218175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 --2- 10.20.193.28:0/3074647674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f021810f4b0 0x7f02180f57c0 unknown :-1 s=CLOSED pgs=946 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 -- 10.20.193.28:0/3074647674 >> 10.20.193.28:0/3074647674 conn(0x7f02180ecda0 msgr2=0x7f021810d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 -- 10.20.193.28:0/3074647674 shutdown_connections 2026-02-20T13:24:59.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.199+0000 7f021d4c9640 1 -- 10.20.193.28:0/3074647674 wait complete. 2026-02-20T13:24:59.298 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:24:59.525 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:24:59.657 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:59 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:24:59.657 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:59 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:59.657 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:59 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:24:59.657 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:59 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:24:59.658 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:59 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:59.658 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:24:59 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:59.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.694+0000 7f9807fff640 1 -- 10.20.193.28:0/1273743876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f980810bfb0 msgr2=0x7f9808113d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.694+0000 7f9807fff640 1 --2- 10.20.193.28:0/1273743876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f980810bfb0 0x7f9808113d50 secure :-1 s=READY pgs=951 gs=1 cs=0 l=1 c_cookie=8252721565421113245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0009950 tx=0x7f97f002f190 comp rx=0 tx=0).stop 2026-02-20T13:24:59.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.695+0000 7f9807fff640 1 -- 10.20.193.28:0/1273743876 shutdown_connections 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.695+0000 7f9807fff640 1 --2- 10.20.193.28:0/1273743876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f980810bfb0 0x7f9808113d50 unknown :-1 s=CLOSED pgs=951 gs=1 cs=0 l=1 c_cookie=8252721565421113245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.695+0000 7f9807fff640 1 --2- 10.20.193.28:0/1273743876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98081144d0 0x7f9808176000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.695+0000 7f9807fff640 1 --2- 10.20.193.28:0/1273743876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810b610 0x7f980810b9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.695+0000 7f9807fff640 1 -- 10.20.193.28:0/1273743876 >> 10.20.193.28:0/1273743876 conn(0x7f98080e9080 msgr2=0x7f9808109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.695+0000 7f9807fff640 1 -- 10.20.193.28:0/1273743876 shutdown_connections 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.695+0000 7f9807fff640 1 -- 10.20.193.28:0/1273743876 wait complete. 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.695+0000 7f9807fff640 1 Processor -- start 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9807fff640 1 -- start start 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9807fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810b610 0x7f980811de40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9807fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810bfb0 0x7f980811e380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9807fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081144d0 0x7f9808123750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9807fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9808123d70 con 0x7f98081144d0 2026-02-20T13:24:59.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9807fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9808123ee0 con 0x7f980810bfb0 2026-02-20T13:24:59.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9807fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f98081240a0 con 0x7f980810b610 2026-02-20T13:24:59.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810b610 0x7f980811de40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081144d0 0x7f9808123750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081144d0 0x7f9808123750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51064/0 (socket says 10.20.193.28:51064) 2026-02-20T13:24:59.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 -- 10.20.193.28:0/2712008201 learned_addr learned my addr 10.20.193.28:0/2712008201 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98067fc640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810bfb0 0x7f980811e380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 -- 10.20.193.28:0/2712008201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810b610 msgr2=0x7f980811de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810b610 0x7f980811de40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 -- 10.20.193.28:0/2712008201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810bfb0 msgr2=0x7f980811e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810bfb0 0x7f980811e380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 -- 10.20.193.28:0/2712008201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f0009570 con 0x7f98081144d0 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810b610 0x7f980811de40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98067fc640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810bfb0 0x7f980811e380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.696+0000 7f98077fe640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081144d0 0x7f9808123750 secure :-1 s=READY pgs=952 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f800f8d0 tx=0x7f97f800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.697+0000 7f97e7fff640 1 -- 10.20.193.28:0/2712008201 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f800dce0 con 0x7f98081144d0 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.697+0000 7f97e7fff640 1 -- 10.20.193.28:0/2712008201 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97f800de40 con 0x7f98081144d0 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.697+0000 7f97e7fff640 1 -- 10.20.193.28:0/2712008201 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f80116b0 con 0x7f98081144d0 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.697+0000 7f9807fff640 1 -- 10.20.193.28:0/2712008201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9808124380 con 0x7f98081144d0 2026-02-20T13:24:59.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.697+0000 7f9807fff640 1 -- 10.20.193.28:0/2712008201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9808164a80 con 0x7f98081144d0 2026-02-20T13:24:59.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.700+0000 7f97e7fff640 1 -- 10.20.193.28:0/2712008201 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f97f8020060 con 0x7f98081144d0 2026-02-20T13:24:59.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.701+0000 7f97e7fff640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.701+0000 7f97e7fff640 1 -- 10.20.193.28:0/2712008201 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97f8015070 con 0x7f98081144d0 2026-02-20T13:24:59.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.702+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.702+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 secure :-1 s=READY pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc004740 tx=0x7f97fc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.703+0000 7f980f456e00 1 Processor -- start 2026-02-20T13:24:59.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.703+0000 7f980f456e00 1 -- start start 2026-02-20T13:24:59.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.703+0000 7f980f456e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f00550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.703+0000 7f980f456e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f45400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.703+0000 7f980f456e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 0x562519f65d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.703+0000 7f980f456e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562519e167d0 con 0x562519f00a90 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.703+0000 7f980f456e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562519e12500 con 0x562519f45940 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.703+0000 7f980f456e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562519e0c4a0 con 0x562519f00180 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f00550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f45400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f45400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51072/0 (socket says 10.20.193.28:51072) 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 -- 10.20.193.28:0/1363019523 learned_addr learned my addr 10.20.193.28:0/1363019523 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98077fe640 1 --2- 10.20.193.28:0/1363019523 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 0x562519f65d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 -- 10.20.193.28:0/1363019523 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 msgr2=0x562519f00550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 --2- 10.20.193.28:0/1363019523 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f00550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 -- 10.20.193.28:0/1363019523 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 msgr2=0x562519f65d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 --2- 10.20.193.28:0/1363019523 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 0x562519f65d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 -- 10.20.193.28:0/1363019523 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562519db7d80 con 0x562519f00a90 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f98067fc640 1 --2- 10.20.193.28:0/1363019523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f45400 secure :-1 s=READY pgs=953 gs=1 cs=0 l=1 c_cookie=17846019333071889021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0004820 tx=0x7f97f0005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a9cc07fa80e27d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f97d37fe640 1 -- 10.20.193.28:0/1363019523 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f0038470 con 0x562519f00a90 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f97d37fe640 1 -- 10.20.193.28:0/1363019523 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97f00385d0 con 0x562519f00a90 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.704+0000 7f97d37fe640 1 -- 10.20.193.28:0/1363019523 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f002fe00 con 0x562519f00a90 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 -- 10.20.193.28:0/1363019523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 msgr2=0x562519f45400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 --2- 10.20.193.28:0/1363019523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f45400 secure :-1 s=READY pgs=953 gs=1 cs=0 l=1 c_cookie=17846019333071889021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0004820 tx=0x7f97f0005bf0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 -- 10.20.193.28:0/1363019523 shutdown_connections 2026-02-20T13:24:59.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 --2- 10.20.193.28:0/1363019523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f45400 unknown :-1 s=CLOSED pgs=953 gs=1 cs=0 l=1 c_cookie=17846019333071889021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 --2- 10.20.193.28:0/1363019523 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 0x562519f65d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 --2- 10.20.193.28:0/1363019523 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f00550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 -- 10.20.193.28:0/1363019523 >> 10.20.193.28:0/1363019523 conn(0x562519ede680 msgr2=0x562519efea60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 -- 10.20.193.28:0/1363019523 shutdown_connections 2026-02-20T13:24:59.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.705+0000 7f980f456e00 1 -- 10.20.193.28:0/1363019523 wait complete. 2026-02-20T13:24:59.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.706+0000 7f980f456e00 1 -- start start 2026-02-20T13:24:59.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.706+0000 7f980f456e00 1 Processor -- start 2026-02-20T13:24:59.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f980f456e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f01550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f980f456e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f01a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f980f456e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f26400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f980f456e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562519f26940 con 0x562519f45940 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f980f456e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562519f26ab0 con 0x562519f00180 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f980f456e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562519f26c70 con 0x562519f00a90 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f01a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f01550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f01550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:59612/0 (socket says 10.20.193.28:59612) 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f9806ffd640 1 -- 10.20.193.28:0/27181806 learned_addr learned my addr 10.20.193.28:0/27181806 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98077fe640 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f26400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f01a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48700/0 (socket says 10.20.193.28:48700) 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98077fe640 1 -- 10.20.193.28:0/27181806 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 msgr2=0x562519f01a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98077fe640 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f01a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98077fe640 1 -- 10.20.193.28:0/27181806 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 msgr2=0x562519f01550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98077fe640 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f01550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98077fe640 1 -- 10.20.193.28:0/27181806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562519d90350 con 0x562519f45940 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f9806ffd640 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f01550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f98077fe640 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f26400 secure :-1 s=READY pgs=954 gs=3 cs=0 l=1 c_cookie=6147742873254358518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f80adfd0 tx=0x7f97f80adaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55512b9232c3edf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.707+0000 7f97d0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f97d0ff9640 1 -- 10.20.193.28:0/27181806 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f80733a0 con 0x562519f45940 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f97d0ff9640 1 -- 10.20.193.28:0/27181806 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97f80b62f0 con 0x562519f45940 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f97d0ff9640 1 -- 10.20.193.28:0/27181806 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f80b8ca0 con 0x562519f45940 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9808176840 con 0x562519f45940 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f97d0ff9640 1 -- 10.20.193.28:0/27181806 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97f80b8e20 con 0x562519f45940 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f97d0ff9640 10 client.18231 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:59.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f980f456e00 10 client.18231 _ll_register_callbacks cb 0x562519d8d9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562519aa26f0 con 0x562519f45940 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f97d0ff9640 1 -- 10.20.193.28:0/27181806 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97f8006910 con 0x562519f45940 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f980f456e00 10 client.18231 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.708+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562519da2150 con 0x562519f45940 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.709+0000 7f97d0ff9640 1 -- 10.20.193.28:0/27181806 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97f80179a0 con 0x562519f45940 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.709+0000 7f980f456e00 10 client.18231 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.709+0000 7f980f456e00 10 client.18231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.709+0000 7f980f456e00 20 client.18231 populate_metadata read hostname 'trial028' 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.709+0000 7f980f456e00 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562519f2b4c0 0x562519f2b960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.709+0000 7f980f456e00 4 client.18231 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.709+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562519e19d60 con 0x562519f2b4c0 2026-02-20T13:24:59.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.709+0000 7f9806ffd640 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562519f2b4c0 0x562519f2b960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f9806ffd640 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562519f2b4c0 0x562519f2b960 crc :-1 s=READY pgs=234 gs=4 cs=0 l=0 c_cookie=12388468294143390059 s_cookie=1292001322540161278 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abecae46cf9b316b server_cookie=11ee1c5b875758fe in_seq=0 out_seq=0 2026-02-20T13:24:59.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f97d0ff9640 10 client.18231 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:59.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f97d0ff9640 1 -- 10.20.193.28:0/27181806 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562519e19d60 con 0x562519f2b4c0 2026-02-20T13:24:59.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f97d0ff9640 10 client.18231 handle_command_reply: tid=0 2026-02-20T13:24:59.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 client.18231 shutdown 2026-02-20T13:24:59.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 msgr2=0x562519f26400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f26400 secure :-1 s=READY pgs=954 gs=3 cs=0 l=1 c_cookie=6147742873254358518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f80adfd0 tx=0x7f97f80adaa0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 shutdown_connections 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562519f2b4c0 0x562519f2b960 crc :-1 s=READY pgs=234 gs=4 cs=0 l=0 c_cookie=12388468294143390059 s_cookie=1292001322540161278 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f26400 unknown :-1 s=CLOSED pgs=954 gs=3 cs=0 l=1 c_cookie=6147742873254358518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f01a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 --2- 10.20.193.28:0/27181806 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f01550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 >> 10.20.193.28:0/27181806 conn(0x562519ede680 msgr2=0x562519efea60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.710+0000 7f97d0ff9640 0 client.18231 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.711+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 shutdown_connections 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.711+0000 7f980f456e00 1 -- 10.20.193.28:0/27181806 wait complete. 2026-02-20T13:24:59.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.711+0000 7f980f456e00 20 client.18231 trim_cache size 0 max 16384 2026-02-20T13:24:59.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f980f456e00 1 Processor -- start 2026-02-20T13:24:59.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f980f456e00 1 -- start start 2026-02-20T13:24:59.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f980f456e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f62f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f980f456e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f63450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f980f456e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 0x562519f44c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f980f456e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562519e0a0d0 con 0x562519f00a90 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f980f456e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562519aca700 con 0x562519f45940 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f980f456e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562519e6f550 con 0x562519f00180 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f62f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f62f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48706/0 (socket says 10.20.193.28:48706) 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f98077fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 0x562519f44c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f9806ffd640 1 -- 10.20.193.28:0/3789276644 learned_addr learned my addr 10.20.193.28:0/3789276644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f98067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f63450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f98067fc640 1 -- 10.20.193.28:0/3789276644 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 msgr2=0x562519f62f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f98067fc640 1 --2- 10.20.193.28:0/3789276644 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f62f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f98067fc640 1 -- 10.20.193.28:0/3789276644 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 msgr2=0x562519f44c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f98067fc640 1 --2- 10.20.193.28:0/3789276644 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 0x562519f44c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.720+0000 7f98067fc640 1 -- 10.20.193.28:0/3789276644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562519d9cbd0 con 0x562519f00a90 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f98067fc640 1 --2- 10.20.193.28:0/3789276644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f63450 secure :-1 s=READY pgs=955 gs=3 cs=0 l=1 c_cookie=16137522158291884961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0005b30 tx=0x7f97f002f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff3fee717fb9ba1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f97d2ffd640 1 -- 10.20.193.28:0/3789276644 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f00040c0 con 0x562519f00a90 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f97d2ffd640 1 -- 10.20.193.28:0/3789276644 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97f0004220 con 0x562519f00a90 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f97d2ffd640 1 -- 10.20.193.28:0/3789276644 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f0038ba0 con 0x562519f00a90 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 -- 10.20.193.28:0/3789276644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 msgr2=0x562519f63450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 --2- 10.20.193.28:0/3789276644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f63450 secure :-1 s=READY pgs=955 gs=3 cs=0 l=1 c_cookie=16137522158291884961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0005b30 tx=0x7f97f002f730 comp rx=0 tx=0).stop 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 -- 10.20.193.28:0/3789276644 shutdown_connections 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 --2- 10.20.193.28:0/3789276644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f00a90 0x562519f63450 unknown :-1 s=CLOSED pgs=955 gs=3 cs=0 l=1 c_cookie=16137522158291884961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 --2- 10.20.193.28:0/3789276644 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f45940 0x562519f44c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 --2- 10.20.193.28:0/3789276644 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00180 0x562519f62f10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 -- 10.20.193.28:0/3789276644 >> 10.20.193.28:0/3789276644 conn(0x562519ede680 msgr2=0x562519f2b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 -- 10.20.193.28:0/3789276644 shutdown_connections 2026-02-20T13:24:59.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.721+0000 7f980f456e00 1 -- 10.20.193.28:0/3789276644 wait complete. 2026-02-20T13:24:59.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.722+0000 7f980f456e00 1 -- start start 2026-02-20T13:24:59.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.722+0000 7f980f456e00 1 Processor -- start 2026-02-20T13:24:59.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.722+0000 7f980f456e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f3e500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.722+0000 7f980f456e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f39bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.722+0000 7f980f456e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f3a200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.722+0000 7f980f456e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562519f3a8d0 con 0x562519f45940 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.722+0000 7f980f456e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562519f3aa40 con 0x562519f00180 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.722+0000 7f980f456e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562519ff9400 con 0x562519f00a90 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f39bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f3e500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f3a200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f39bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:48718/0 (socket says 10.20.193.28:48718) 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98067fc640 1 -- 10.20.193.28:0/2596132188 learned_addr learned my addr 10.20.193.28:0/2596132188 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:24:59.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98077fe640 1 -- 10.20.193.28:0/2596132188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 msgr2=0x562519f39bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98077fe640 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f39bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98077fe640 1 -- 10.20.193.28:0/2596132188 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 msgr2=0x562519f3e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98077fe640 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f3e500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98077fe640 1 -- 10.20.193.28:0/2596132188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562519d90680 con 0x562519f45940 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f98077fe640 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f3a200 secure :-1 s=READY pgs=956 gs=3 cs=0 l=1 c_cookie=16576956918876939582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f80b0280 tx=0x7f97f80065a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60d2e7d3e9d253e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f97d0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f97d0ff9640 1 -- 10.20.193.28:0/2596132188 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f80c9020 con 0x562519f45940 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f97d0ff9640 1 -- 10.20.193.28:0/2596132188 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x562519aa26f0 con 0x562519f45940 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f97d0ff9640 1 -- 10.20.193.28:0/2596132188 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f80b9130 con 0x562519f45940 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562519db7d80 con 0x562519f45940 2026-02-20T13:24:59.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.723+0000 7f97d0ff9640 1 -- 10.20.193.28:0/2596132188 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97f80b62f0 con 0x562519f45940 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f97d0ff9640 10 client.18237 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 10 client.18237 _ll_register_callbacks cb 0x562519d8d9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97f00385d0 con 0x562519f45940 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f97d0ff9640 1 -- 10.20.193.28:0/2596132188 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97f80af7a0 con 0x562519f45940 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 10 client.18237 fetch_fsmap learned FSMap version 28 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562519da23b0 con 0x562519f45940 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f97d0ff9640 1 -- 10.20.193.28:0/2596132188 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97f80ae2d0 con 0x562519f45940 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 10 client.18237 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 10 client.18237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 20 client.18237 populate_metadata read hostname 'trial028' 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562519ffaab0 0x56251a01af60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:24:59.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 4 client.18237 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:24:59.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562519a9ff40 con 0x562519ffaab0 2026-02-20T13:24:59.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.724+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562519ffaab0 0x56251a01af60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:24:59.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.725+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562519ffaab0 0x56251a01af60 crc :-1 s=READY pgs=235 gs=4 cs=0 l=0 c_cookie=2265999899652919124 s_cookie=86740350085089574 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f7272e727e20f54 server_cookie=13429e38a83c926 in_seq=0 out_seq=0 2026-02-20T13:24:59.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.725+0000 7f97d0ff9640 10 client.18237 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:59.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.725+0000 7f97d0ff9640 1 -- 10.20.193.28:0/2596132188 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x562519a9ff40 con 0x562519ffaab0 2026-02-20T13:24:59.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.725+0000 7f97d0ff9640 10 client.18237 handle_command_reply: tid=0 2026-02-20T13:24:59.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.725+0000 7f980f456e00 1 client.18237 shutdown 2026-02-20T13:24:59.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 msgr2=0x562519f3a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f3a200 secure :-1 s=READY pgs=956 gs=3 cs=0 l=1 c_cookie=16576956918876939582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f80b0280 tx=0x7f97f80065a0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 shutdown_connections 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562519ffaab0 0x56251a01af60 crc :-1 s=READY pgs=235 gs=4 cs=0 l=0 c_cookie=2265999899652919124 s_cookie=86740350085089574 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562519f45940 0x562519f3a200 unknown :-1 s=CLOSED pgs=956 gs=3 cs=0 l=1 c_cookie=16576956918876939582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562519f00a90 0x562519f39bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 --2- 10.20.193.28:0/2596132188 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562519f00180 0x562519f3e500 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f97d0ff9640 0 client.18237 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 >> 10.20.193.28:0/2596132188 conn(0x562519ede680 msgr2=0x562519f44c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 shutdown_connections 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 1 -- 10.20.193.28:0/2596132188 wait complete. 2026-02-20T13:24:59.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f980f456e00 20 client.18237 trim_cache size 0 max 16384 2026-02-20T13:24:59.736 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:24:59.736 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:24:59.736 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:24:59.736 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:24:59.736 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.736 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "74e9be25-8d05-45c2-8488-6b7ae52cd775", 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.738 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.740 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.741 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:24:59.742 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.744 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:24:59.745 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 -- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 msgr2=0x7f97dc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 secure :-1 s=READY pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc004740 tx=0x7f97fc005f90 comp rx=0 tx=0).stop 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 -- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081144d0 msgr2=0x7f9808123750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081144d0 0x7f9808123750 secure :-1 s=READY pgs=952 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f800f8d0 tx=0x7f97f800fda0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 -- 10.20.193.28:0/2712008201 shutdown_connections 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 unknown :-1 s=CLOSED pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081144d0 0x7f9808123750 unknown :-1 s=CLOSED pgs=952 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810bfb0 0x7f980811e380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 --2- 10.20.193.28:0/2712008201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810b610 0x7f980811de40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 -- 10.20.193.28:0/2712008201 >> 10.20.193.28:0/2712008201 conn(0x7f98080e9080 msgr2=0x7f9808109460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:24:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.726+0000 7f9807fff640 1 -- 10.20.193.28:0/2712008201 shutdown_connections 2026-02-20T13:24:59.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:24:59.727+0000 7f9807fff640 1 -- 10.20.193.28:0/2712008201 wait complete. 2026-02-20T13:24:59.826 INFO:tasks.cephfs.filesystem:scrub status for tag:74e9be25-8d05-45c2-8488-6b7ae52cd775 - {'path': '/', 'tag': '74e9be25-8d05-45c2-8488-6b7ae52cd775', 'options': 'recursive,force'} 2026-02-20T13:24:59.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:59 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:24:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:59 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:59 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:24:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:59 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:24:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:59 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:59.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:24:59 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:59.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:59 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:24:59.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:59 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:59.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:59 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:24:59.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:59 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:24:59.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:59 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:24:59.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:24:59 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:00 trial028 ceph-mon[37442]: pgmap v411: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:25:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:00 trial127 ceph-mon[43817]: pgmap v411: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:25:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:00 trial034 ceph-mon[43332]: pgmap v411: 97 pgs: 97 active+clean; 4.2 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:25:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:02 trial028 ceph-mon[37442]: pgmap v412: 97 pgs: 97 active+clean; 4.3 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:25:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:02 trial127 ceph-mon[43817]: pgmap v412: 97 pgs: 97 active+clean; 4.3 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:25:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:02 trial034 ceph-mon[43332]: pgmap v412: 97 pgs: 97 active+clean; 4.3 MiB data, 338 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:25:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:04 trial028 ceph-mon[37442]: pgmap v413: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:04 trial127 ceph-mon[43817]: pgmap v413: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:04 trial034 ceph-mon[43332]: pgmap v413: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:06 trial028 ceph-mon[37442]: pgmap v414: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:25:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:06 trial127 ceph-mon[43817]: pgmap v414: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:25:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:06 trial034 ceph-mon[43332]: pgmap v414: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:25:07.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 -- 10.20.193.28:0/3836234565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 msgr2=0x7f19c81104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3836234565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 0x7f19c81104a0 secure :-1 s=READY pgs=957 gs=1 cs=0 l=1 c_cookie=18190851639185445110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19b8009980 tx=0x7f19b802f190 comp rx=0 tx=0).stop 2026-02-20T13:25:07.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 -- 10.20.193.28:0/3836234565 shutdown_connections 2026-02-20T13:25:07.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3836234565 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f19c810f2f0 0x7f19c8171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3836234565 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f19c810e940 0x7f19c810edb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3836234565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 0x7f19c81104a0 unknown :-1 s=CLOSED pgs=957 gs=1 cs=0 l=1 c_cookie=18190851639185445110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 -- 10.20.193.28:0/3836234565 >> 10.20.193.28:0/3836234565 conn(0x7f19c80ec320 msgr2=0x7f19c810c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:07.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 -- 10.20.193.28:0/3836234565 shutdown_connections 2026-02-20T13:25:07.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.062+0000 7f19cedd2640 1 -- 10.20.193.28:0/3836234565 wait complete. 2026-02-20T13:25:07.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cedd2640 1 Processor -- start 2026-02-20T13:25:07.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cedd2640 1 -- start start 2026-02-20T13:25:07.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cedd2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f19c810e940 0x7f19c80f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cedd2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f19c810f2f0 0x7f19c8171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cedd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 0x7f19c80f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cedd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f19c80f96a0 con 0x7f19c81100b0 2026-02-20T13:25:07.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cedd2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f19c80f9810 con 0x7f19c810f2f0 2026-02-20T13:25:07.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cedd2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f19c80f99d0 con 0x7f19c810e940 2026-02-20T13:25:07.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cd5cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f19c810f2f0 0x7f19c8171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cddd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f19c810e940 0x7f19c80f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19ce5d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 0x7f19c80f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cddd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f19c810e940 0x7f19c80f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37740/0 (socket says 10.20.193.28:37740) 2026-02-20T13:25:07.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.063+0000 7f19cddd0640 1 -- 10.20.193.28:0/3034100158 learned_addr learned my addr 10.20.193.28:0/3034100158 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:07.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19ce5d1640 1 -- 10.20.193.28:0/3034100158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f19c810e940 msgr2=0x7f19c80f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f19c810e940 0x7f19c80f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19ce5d1640 1 -- 10.20.193.28:0/3034100158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f19c810f2f0 msgr2=0x7f19c8171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f19c810f2f0 0x7f19c8171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19ce5d1640 1 -- 10.20.193.28:0/3034100158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b8009570 con 0x7f19c81100b0 2026-02-20T13:25:07.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 0x7f19c80f8ab0 secure :-1 s=READY pgs=958 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19c400f940 tx=0x7f19c400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:07.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19b6ffd640 1 -- 10.20.193.28:0/3034100158 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19c400dce0 con 0x7f19c81100b0 2026-02-20T13:25:07.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19b6ffd640 1 -- 10.20.193.28:0/3034100158 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f19c400de40 con 0x7f19c81100b0 2026-02-20T13:25:07.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19b6ffd640 1 -- 10.20.193.28:0/3034100158 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19c40116b0 con 0x7f19c81100b0 2026-02-20T13:25:07.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19cedd2640 1 -- 10.20.193.28:0/3034100158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c80f9cb0 con 0x7f19c81100b0 2026-02-20T13:25:07.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.064+0000 7f19cedd2640 1 -- 10.20.193.28:0/3034100158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c80fa130 con 0x7f19c81100b0 2026-02-20T13:25:07.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.067+0000 7f19b6ffd640 1 -- 10.20.193.28:0/3034100158 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f19c4020060 con 0x7f19c81100b0 2026-02-20T13:25:07.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19b6ffd640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f19a40b5760 0x7f19a40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19b6ffd640 1 -- 10.20.193.28:0/3034100158 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f19c4015070 con 0x7f19c81100b0 2026-02-20T13:25:07.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19cddd0640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f19a40b5760 0x7f19a40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19d2676e00 1 Processor -- start 2026-02-20T13:25:07.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19d2676e00 1 -- start start 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cdb4c0 0x564e82cfb8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82d1c1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82d1c700 0x564e82d3cae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19d2676e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564e82bf0fd0 con 0x564e82cfbde0 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19d2676e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564e82becd00 con 0x564e82cdb4c0 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19d2676e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564e82be6ca0 con 0x564e82d1c700 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19cddd0640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f19a40b5760 0x7f19a40d5c10 secure :-1 s=READY pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19b8002d80 tx=0x7f19b803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.069+0000 7f19cddd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cdb4c0 0x564e82cfb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19ce5d1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82d1c700 0x564e82d3cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19cd5cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82d1c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19ce5d1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82d1c700 0x564e82d3cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37754/0 (socket says 10.20.193.28:37754) 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19ce5d1640 1 -- 10.20.193.28:0/2971521676 learned_addr learned my addr 10.20.193.28:0/2971521676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19cd5cf640 1 -- 10.20.193.28:0/2971521676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82d1c700 msgr2=0x564e82d3cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/2971521676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82d1c700 0x564e82d3cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19cd5cf640 1 -- 10.20.193.28:0/2971521676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cdb4c0 msgr2=0x564e82cfb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/2971521676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cdb4c0 0x564e82cfb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19cd5cf640 1 -- 10.20.193.28:0/2971521676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e82b898b0 con 0x564e82cfbde0 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/2971521676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82d1c1c0 secure :-1 s=READY pgs=959 gs=1 cs=0 l=1 c_cookie=388898407669193657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19bc009c30 tx=0x7f19bc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565a50a92d65bb9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19963ff640 1 -- 10.20.193.28:0/2971521676 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19bc004110 con 0x564e82cfbde0 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19963ff640 1 -- 10.20.193.28:0/2971521676 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f19bc004d30 con 0x564e82cfbde0 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19963ff640 1 -- 10.20.193.28:0/2971521676 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19bc005570 con 0x564e82cfbde0 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19d2676e00 1 -- 10.20.193.28:0/2971521676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 msgr2=0x564e82d1c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19d2676e00 1 --2- 10.20.193.28:0/2971521676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82d1c1c0 secure :-1 s=READY pgs=959 gs=1 cs=0 l=1 c_cookie=388898407669193657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19bc009c30 tx=0x7f19bc011810 comp rx=0 tx=0).stop 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19d2676e00 1 -- 10.20.193.28:0/2971521676 shutdown_connections 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19d2676e00 1 --2- 10.20.193.28:0/2971521676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82d1c1c0 unknown :-1 s=CLOSED pgs=959 gs=1 cs=0 l=1 c_cookie=388898407669193657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19d2676e00 1 --2- 10.20.193.28:0/2971521676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82d1c700 0x564e82d3cae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19d2676e00 1 --2- 10.20.193.28:0/2971521676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cdb4c0 0x564e82cfb8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.070+0000 7f19d2676e00 1 -- 10.20.193.28:0/2971521676 >> 10.20.193.28:0/2971521676 conn(0x564e82bfa1c0 msgr2=0x564e82cd9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.071+0000 7f19d2676e00 1 -- 10.20.193.28:0/2971521676 shutdown_connections 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.071+0000 7f19d2676e00 1 -- 10.20.193.28:0/2971521676 wait complete. 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.072+0000 7f19d2676e00 1 -- start start 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.072+0000 7f19d2676e00 1 Processor -- start 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.072+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cf4b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.072+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82cf5190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.072+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.072+0000 7f19d2676e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564e82cf6250 con 0x564e82cfbde0 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.072+0000 7f19d2676e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564e82cf63c0 con 0x564e82d1c700 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.072+0000 7f19d2676e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564e82cf6580 con 0x564e82cdb4c0 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19cddd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cf4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46414/0 (socket says 10.20.193.28:46414) 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 -- 10.20.193.28:0/799850424 learned_addr learned my addr 10.20.193.28:0/799850424 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82cf5190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 -- 10.20.193.28:0/799850424 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 msgr2=0x564e82cf4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cf4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 -- 10.20.193.28:0/799850424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 msgr2=0x564e82cf5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82cf5190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 -- 10.20.193.28:0/799850424 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e82b92400 con 0x564e82d1c700 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82cf5190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf5bf0 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=11301622639879450641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19c400a4e0 tx=0x7f19c4006580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd76de99386f011 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19837fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19837fe640 1 -- 10.20.193.28:0/799850424 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19c40d32d0 con 0x564e82d1c700 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19837fe640 1 -- 10.20.193.28:0/799850424 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f19c40b6250 con 0x564e82d1c700 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc009850 con 0x564e82d1c700 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19d2676e00 10 client.28208 _ll_register_callbacks cb 0x564e82b71a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19837fe640 1 -- 10.20.193.28:0/799850424 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19c40b8e20 con 0x564e82d1c700 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.073+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e82886520 con 0x564e82d1c700 2026-02-20T13:25:07.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19837fe640 1 -- 10.20.193.28:0/799850424 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f19c406ce40 con 0x564e82d1c700 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19837fe640 1 -- 10.20.193.28:0/799850424 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19c40aebe0 con 0x564e82d1c700 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19d2676e00 10 client.28208 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564e82b6ada0 con 0x564e82d1c700 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19837fe640 1 -- 10.20.193.28:0/799850424 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19c40abf30 con 0x564e82d1c700 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19d2676e00 10 client.28208 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19d2676e00 10 client.28208 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19d2676e00 20 client.28208 populate_metadata read hostname 'trial028' 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19d2676e00 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e82cfb250 0x564e82cfb6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19d2676e00 4 client.28208 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e82c18630 con 0x564e82cfb250 2026-02-20T13:25:07.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.074+0000 7f19cddd0640 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e82cfb250 0x564e82cfb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19cddd0640 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e82cfb250 0x564e82cfb6f0 crc :-1 s=READY pgs=236 gs=4 cs=0 l=0 c_cookie=1977148633204095006 s_cookie=18138088839404779705 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b703e34de47781e server_cookie=fbb76fb32132f8b9 in_seq=0 out_seq=0 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19837fe640 10 client.28208 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19837fe640 1 -- 10.20.193.28:0/799850424 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564e82c18630 con 0x564e82cfb250 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19837fe640 10 client.28208 handle_command_reply: tid=0 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 client.28208 shutdown 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 msgr2=0x564e82cf5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf5bf0 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=11301622639879450641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19c400a4e0 tx=0x7f19c4006580 comp rx=0 tx=0).stop 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 shutdown_connections 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e82cfb250 0x564e82cfb6f0 crc :-1 s=READY pgs=236 gs=4 cs=0 l=0 c_cookie=1977148633204095006 s_cookie=18138088839404779705 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cfbde0 0x564e82cf5190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf5bf0 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=11301622639879450641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 --2- 10.20.193.28:0/799850424 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cf4b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19837fe640 0 client.28208 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:07.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 >> 10.20.193.28:0/799850424 conn(0x564e82bfa1c0 msgr2=0x564e82cdc790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:07.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 shutdown_connections 2026-02-20T13:25:07.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.075+0000 7f19d2676e00 1 -- 10.20.193.28:0/799850424 wait complete. 2026-02-20T13:25:07.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.076+0000 7f19d2676e00 20 client.28208 trim_cache size 0 max 16384 2026-02-20T13:25:07.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19d2676e00 1 Processor -- start 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19d2676e00 1 -- start start 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cdb4c0 0x564e82ce1df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cfbde0 0x564e82cf1e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf2340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19d2676e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564e82be48d0 con 0x564e82cdb4c0 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19d2676e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564e82925f10 con 0x564e82d1c700 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19d2676e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564e82cb6810 con 0x564e82cfbde0 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19cddd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cdb4c0 0x564e82ce1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19cd5cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cfbde0 0x564e82cf1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19cddd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cdb4c0 0x564e82ce1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48010/0 (socket says 10.20.193.28:48010) 2026-02-20T13:25:07.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.083+0000 7f19cddd0640 1 -- 10.20.193.28:0/3818871717 learned_addr learned my addr 10.20.193.28:0/3818871717 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/3818871717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf2340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19cd5cf640 1 -- 10.20.193.28:0/3818871717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 msgr2=0x564e82cf2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/3818871717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf2340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19cd5cf640 1 -- 10.20.193.28:0/3818871717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cdb4c0 msgr2=0x564e82ce1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/3818871717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cdb4c0 0x564e82ce1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19cd5cf640 1 -- 10.20.193.28:0/3818871717 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e82b7c670 con 0x564e82cfbde0 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/3818871717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cfbde0 0x564e82cf1e00 secure :-1 s=READY pgs=286 gs=2 cs=0 l=1 c_cookie=3603656748964079982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19bc005940 tx=0x7f19bc004070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3202c2b85e71696e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f1995bfe640 1 -- 10.20.193.28:0/3818871717 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19bc009eb0 con 0x564e82cfbde0 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f1995bfe640 1 -- 10.20.193.28:0/3818871717 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f19bc01e040 con 0x564e82cfbde0 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f1995bfe640 1 -- 10.20.193.28:0/3818871717 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19bc004d60 con 0x564e82cfbde0 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19d2676e00 1 -- 10.20.193.28:0/3818871717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cfbde0 msgr2=0x564e82cf1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3818871717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cfbde0 0x564e82cf1e00 secure :-1 s=READY pgs=286 gs=2 cs=0 l=1 c_cookie=3603656748964079982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19bc005940 tx=0x7f19bc004070 comp rx=0 tx=0).stop 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19d2676e00 1 -- 10.20.193.28:0/3818871717 shutdown_connections 2026-02-20T13:25:07.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3818871717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82d1c700 0x564e82cf2340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3818871717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cfbde0 0x564e82cf1e00 unknown :-1 s=CLOSED pgs=286 gs=2 cs=0 l=1 c_cookie=3603656748964079982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3818871717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82cdb4c0 0x564e82ce1df0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.084+0000 7f19d2676e00 1 -- 10.20.193.28:0/3818871717 >> 10.20.193.28:0/3818871717 conn(0x564e82bfa1c0 msgr2=0x564e82cf41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 -- 10.20.193.28:0/3818871717 shutdown_connections 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 -- 10.20.193.28:0/3818871717 wait complete. 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 -- start start 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 Processor -- start 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cd0b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cfbde0 0x564e82cd11b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82d1c700 0x564e82cd1da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564e82cd2400 con 0x564e82d1c700 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564e82cd2570 con 0x564e82cfbde0 2026-02-20T13:25:07.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.085+0000 7f19d2676e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564e82cd2730 con 0x564e82cdb4c0 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19cd5cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cfbde0 0x564e82cd11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19cddd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cd0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19ce5d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82d1c700 0x564e82cd1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19cd5cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cfbde0 0x564e82cd11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46434/0 (socket says 10.20.193.28:46434) 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19cd5cf640 1 -- 10.20.193.28:0/3937682293 learned_addr learned my addr 10.20.193.28:0/3937682293 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19ce5d1640 1 -- 10.20.193.28:0/3937682293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 msgr2=0x564e82cd0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cd0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19ce5d1640 1 -- 10.20.193.28:0/3937682293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cfbde0 msgr2=0x564e82cd11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cfbde0 0x564e82cd11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19ce5d1640 1 -- 10.20.193.28:0/3937682293 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e82b770f0 con 0x564e82d1c700 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19cddd0640 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cd0b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19cd5cf640 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cfbde0 0x564e82cd11b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19ce5d1640 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82d1c700 0x564e82cd1da0 secure :-1 s=READY pgs=960 gs=1 cs=0 l=1 c_cookie=17094944087064391162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19c40afb00 tx=0x7f19c4006020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3d711304a32dfa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:07.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19837fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19837fe640 1 -- 10.20.193.28:0/3937682293 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19c4005e10 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19837fe640 1 -- 10.20.193.28:0/3937682293 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564e82886520 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19837fe640 1 -- 10.20.193.28:0/3937682293 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19c4073310 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e82b898b0 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.086+0000 7f19837fe640 1 -- 10.20.193.28:0/3937682293 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f19c4006850 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19837fe640 10 client.18255 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 10 client.18255 _ll_register_callbacks cb 0x564e82b71a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e82c96ca0 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19837fe640 1 -- 10.20.193.28:0/3937682293 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19c40af940 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 10 client.18255 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564e82b6b0d0 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19837fe640 1 -- 10.20.193.28:0/3937682293 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19c408c040 con 0x564e82d1c700 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 10 client.18255 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:07.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 10 client.18255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 20 client.18255 populate_metadata read hostname 'trial028' 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e82cd3f70 0x564e82cd4410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 4 client.18255 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e828ca640 con 0x564e82cd3f70 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.087+0000 7f19cddd0640 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e82cd3f70 0x564e82cd4410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.088+0000 7f19cddd0640 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e82cd3f70 0x564e82cd4410 crc :-1 s=READY pgs=237 gs=4 cs=0 l=0 c_cookie=11689134060758468428 s_cookie=11024750053648183679 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a238257f1f6d874c server_cookie=98ffc7c31d2b317f in_seq=0 out_seq=0 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.088+0000 7f19837fe640 10 client.18255 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.093+0000 7f19837fe640 1 -- 10.20.193.28:0/3937682293 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e828ca640 con 0x564e82cd3f70 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.093+0000 7f19837fe640 10 client.18255 handle_command_reply: tid=0 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.093+0000 7f19d2676e00 1 client.18255 shutdown 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.093+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82d1c700 msgr2=0x564e82cd1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.093+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82d1c700 0x564e82cd1da0 secure :-1 s=READY pgs=960 gs=1 cs=0 l=1 c_cookie=17094944087064391162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19c40afb00 tx=0x7f19c4006020 comp rx=0 tx=0).stop 2026-02-20T13:25:07.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 shutdown_connections 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e82cd3f70 0x564e82cd4410 crc :-1 s=READY pgs=237 gs=4 cs=0 l=0 c_cookie=11689134060758468428 s_cookie=11024750053648183679 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e82d1c700 0x564e82cd1da0 unknown :-1 s=CLOSED pgs=960 gs=1 cs=0 l=1 c_cookie=17094944087064391162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e82cfbde0 0x564e82cd11b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 1 --2- 10.20.193.28:0/3937682293 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e82cdb4c0 0x564e82cd0b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 >> 10.20.193.28:0/3937682293 conn(0x564e82bfa1c0 msgr2=0x564e82cf4880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19837fe640 0 client.18255 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 shutdown_connections 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 1 -- 10.20.193.28:0/3937682293 wait complete. 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19d2676e00 20 client.18255 trim_cache size 0 max 16384 2026-02-20T13:25:07.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:25:07.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:25:07.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:25:07.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:25:07.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 -- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f19a40b5760 msgr2=0x7f19a40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f19a40b5760 0x7f19a40d5c10 secure :-1 s=READY pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19b8002d80 tx=0x7f19b803a040 comp rx=0 tx=0).stop 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 -- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 msgr2=0x7f19c80f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 0x7f19c80f8ab0 secure :-1 s=READY pgs=958 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19c400f940 tx=0x7f19c400fe10 comp rx=0 tx=0).stop 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 -- 10.20.193.28:0/3034100158 shutdown_connections 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f19a40b5760 0x7f19a40d5c10 unknown :-1 s=CLOSED pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f19c81100b0 0x7f19c80f8ab0 unknown :-1 s=CLOSED pgs=958 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f19c810f2f0 0x7f19c8171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 --2- 10.20.193.28:0/3034100158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f19c810e940 0x7f19c80f8250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 -- 10.20.193.28:0/3034100158 >> 10.20.193.28:0/3034100158 conn(0x7f19c80ec320 msgr2=0x7f19c80ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 -- 10.20.193.28:0/3034100158 shutdown_connections 2026-02-20T13:25:07.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:07.094+0000 7f19cedd2640 1 -- 10.20.193.28:0/3034100158 wait complete. 2026-02-20T13:25:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:08 trial127 ceph-mon[43817]: pgmap v415: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:25:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:25:08.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:25:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:08 trial034 ceph-mon[43332]: pgmap v415: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:25:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:25:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:25:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:08 trial028 ceph-mon[37442]: pgmap v415: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:25:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:25:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:25:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:10 trial127 ceph-mon[43817]: pgmap v416: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:25:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:10 trial034 ceph-mon[43332]: pgmap v416: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:25:11.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:10 trial028 ceph-mon[37442]: pgmap v416: 97 pgs: 97 active+clean; 4.3 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:25:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:12 trial127 ceph-mon[43817]: pgmap v417: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:25:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:12 trial034 ceph-mon[43332]: pgmap v417: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:25:13.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:12 trial028 ceph-mon[37442]: pgmap v417: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:25:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:14 trial127 ceph-mon[43817]: pgmap v418: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:25:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:14 trial034 ceph-mon[43332]: pgmap v418: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:25:15.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:14 trial028 ceph-mon[37442]: pgmap v418: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:25:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:16 trial127 ceph-mon[43817]: pgmap v419: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:25:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:16 trial034 ceph-mon[43332]: pgmap v419: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:25:17.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:16 trial028 ceph-mon[37442]: pgmap v419: 97 pgs: 97 active+clean; 4.4 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:25:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:18 trial127 ceph-mon[43817]: pgmap v420: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:25:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:18 trial034 ceph-mon[43332]: pgmap v420: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:25:19.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:18 trial028 ceph-mon[37442]: pgmap v420: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:25:20.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.166+0000 7fb7eefd2640 1 -- 10.20.193.28:0/989287022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810c490 msgr2=0x7fb7e810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.166+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/989287022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810c490 0x7fb7e810c910 secure :-1 s=READY pgs=961 gs=1 cs=0 l=1 c_cookie=10294564182355911811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7e400aa30 tx=0x7fb7e4030270 comp rx=0 tx=0).stop 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 -- 10.20.193.28:0/989287022 shutdown_connections 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/989287022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810c490 0x7fb7e810c910 unknown :-1 s=CLOSED pgs=961 gs=1 cs=0 l=1 c_cookie=10294564182355911811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/989287022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7e810b900 0x7fb7e810bd70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/989287022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7e80609a0 0x7fb7e810b2e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 -- 10.20.193.28:0/989287022 >> 10.20.193.28:0/989287022 conn(0x7fb7e80e8f40 msgr2=0x7fb7e8109350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 -- 10.20.193.28:0/989287022 shutdown_connections 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 -- 10.20.193.28:0/989287022 wait complete. 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 Processor -- start 2026-02-20T13:25:20.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.167+0000 7fb7eefd2640 1 -- start start 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7eefd2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7e80609a0 0x7fb7e80f4740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7eefd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810b900 0x7fb7e80f4d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7eefd2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7e810c490 0x7fb7e80f5990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7eefd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80f60d0 con 0x7fb7e810b900 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7eefd2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80f6240 con 0x7fb7e810c490 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7eefd2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80f6400 con 0x7fb7e80609a0 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810b900 0x7fb7e80f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810b900 0x7fb7e80f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34826/0 (socket says 10.20.193.28:34826) 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7edfd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7e80609a0 0x7fb7e80f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 -- 10.20.193.28:0/1005114676 learned_addr learned my addr 10.20.193.28:0/1005114676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7e810c490 0x7fb7e80f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 -- 10.20.193.28:0/1005114676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7e80609a0 msgr2=0x7fb7e80f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7e80609a0 0x7fb7e80f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 -- 10.20.193.28:0/1005114676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7e810c490 msgr2=0x7fb7e80f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7e810c490 0x7fb7e80f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 -- 10.20.193.28:0/1005114676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e400a650 con 0x7fb7e810b900 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.168+0000 7fb7ed7cf640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810b900 0x7fb7e80f4d90 secure :-1 s=READY pgs=962 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7dc00d950 tx=0x7fb7dc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.169+0000 7fb7d6ffd640 1 -- 10.20.193.28:0/1005114676 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7dc004540 con 0x7fb7e810b900 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.169+0000 7fb7d6ffd640 1 -- 10.20.193.28:0/1005114676 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7dc009d00 con 0x7fb7e810b900 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.169+0000 7fb7eefd2640 1 -- 10.20.193.28:0/1005114676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e80f66e0 con 0x7fb7e810b900 2026-02-20T13:25:20.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.169+0000 7fb7d6ffd640 1 -- 10.20.193.28:0/1005114676 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7dc0106e0 con 0x7fb7e810b900 2026-02-20T13:25:20.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.169+0000 7fb7eefd2640 1 -- 10.20.193.28:0/1005114676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e80f6c60 con 0x7fb7e810b900 2026-02-20T13:25:20.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.171+0000 7fb7d6ffd640 1 -- 10.20.193.28:0/1005114676 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb7dc0097c0 con 0x7fb7e810b900 2026-02-20T13:25:20.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.173+0000 7fb7d6ffd640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7c40b5760 0x7fb7c40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.173+0000 7fb7d6ffd640 1 -- 10.20.193.28:0/1005114676 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb7dc0e6d20 con 0x7fb7e810b900 2026-02-20T13:25:20.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7c40b5760 0x7fb7c40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7f287fe00 1 Processor -- start 2026-02-20T13:25:20.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7f287fe00 1 -- start start 2026-02-20T13:25:20.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7c40b5760 0x7fb7c40d5c10 secure :-1 s=READY pgs=440 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7d8004740 tx=0x7fb7d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:20.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf825214c0 0x55bf825418a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf82541de0 0x55bf825621c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82562700 0x55bf82582ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bf82436fd0 con 0x55bf825214c0 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bf82432d00 con 0x55bf82562700 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bf8242cca0 con 0x55bf82541de0 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7edfd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf825214c0 0x55bf825418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7edfd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf825214c0 0x55bf825418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34836/0 (socket says 10.20.193.28:34836) 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7edfd0640 1 -- 10.20.193.28:0/97887227 learned_addr learned my addr 10.20.193.28:0/97887227 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82562700 0x55bf82582ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.174+0000 7fb7ed7cf640 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf82541de0 0x55bf825621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7edfd0640 1 -- 10.20.193.28:0/97887227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf82541de0 msgr2=0x55bf825621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:20.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf82541de0 0x55bf825621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7edfd0640 1 -- 10.20.193.28:0/97887227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82562700 msgr2=0x55bf82582ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:20.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82562700 0x55bf82582ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7edfd0640 1 -- 10.20.193.28:0/97887227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf823cf8b0 con 0x55bf825214c0 2026-02-20T13:25:20.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf825214c0 0x55bf825418a0 secure :-1 s=READY pgs=963 gs=1 cs=0 l=1 c_cookie=399537137799013809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7d8009cc0 tx=0x7fb7d8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b70e8f51625b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:20.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7b63ff640 1 -- 10.20.193.28:0/97887227 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7d8011e60 con 0x55bf825214c0 2026-02-20T13:25:20.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7b63ff640 1 -- 10.20.193.28:0/97887227 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7d80198e0 con 0x55bf825214c0 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7b63ff640 1 -- 10.20.193.28:0/97887227 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7d801bb80 con 0x55bf825214c0 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 -- 10.20.193.28:0/97887227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf825214c0 msgr2=0x55bf825418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf825214c0 0x55bf825418a0 secure :-1 s=READY pgs=963 gs=1 cs=0 l=1 c_cookie=399537137799013809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7d8009cc0 tx=0x7fb7d8014000 comp rx=0 tx=0).stop 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 -- 10.20.193.28:0/97887227 shutdown_connections 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82562700 0x55bf82582ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf82541de0 0x55bf825621c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/97887227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf825214c0 0x55bf825418a0 unknown :-1 s=CLOSED pgs=963 gs=1 cs=0 l=1 c_cookie=399537137799013809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 -- 10.20.193.28:0/97887227 >> 10.20.193.28:0/97887227 conn(0x55bf824401c0 msgr2=0x55bf8251fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 -- 10.20.193.28:0/97887227 shutdown_connections 2026-02-20T13:25:20.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.175+0000 7fb7f287fe00 1 -- 10.20.193.28:0/97887227 wait complete. 2026-02-20T13:25:20.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7f287fe00 1 -- start start 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7f287fe00 1 Processor -- start 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8253aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf8253b140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf8253bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bf8253c200 con 0x55bf82562700 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bf8253c370 con 0x55bf82541de0 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bf8253c530 con 0x55bf825214c0 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7ee7d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf8253bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7ed7cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf8253b140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7ee7d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf8253bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34842/0 (socket says 10.20.193.28:34842) 2026-02-20T13:25:20.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/1194149356 learned_addr learned my addr 10.20.193.28:0/1194149356 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.177+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8253aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/1194149356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 msgr2=0x55bf8253aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8253aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/1194149356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 msgr2=0x55bf8253b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf8253b140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/1194149356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf823d8400 con 0x55bf82562700 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf8253bba0 secure :-1 s=READY pgs=964 gs=1 cs=0 l=1 c_cookie=1341288083597379279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7e4030780 tx=0x7fb7e40396a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129d3667d44946cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7a37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7a37fe640 1 -- 10.20.193.28:0/1194149356 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7e4006eb0 con 0x55bf82562700 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7a37fe640 1 -- 10.20.193.28:0/1194149356 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7e403f050 con 0x55bf82562700 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7a37fe640 1 -- 10.20.193.28:0/1194149356 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7e4044690 con 0x55bf82562700 2026-02-20T13:25:20.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d8009960 con 0x55bf82562700 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7a37fe640 1 -- 10.20.193.28:0/1194149356 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb7e4044820 con 0x55bf82562700 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7f287fe00 10 client.18267 _ll_register_callbacks cb 0x55bf823b7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf820cc520 con 0x55bf82562700 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7a37fe640 1 -- 10.20.193.28:0/1194149356 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb7e4005040 con 0x55bf82562700 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7f287fe00 10 client.18267 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.178+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bf823b0da0 con 0x55bf82562700 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.179+0000 7fb7a37fe640 1 -- 10.20.193.28:0/1194149356 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb7e40051a0 con 0x55bf82562700 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.179+0000 7fb7f287fe00 10 client.18267 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.179+0000 7fb7f287fe00 10 client.18267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.179+0000 7fb7f287fe00 20 client.18267 populate_metadata read hostname 'trial028' 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.179+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bf8253f230 0x55bf8253f6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.179+0000 7fb7f287fe00 4 client.18267 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.179+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf8245e630 con 0x55bf8253f230 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.179+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bf8253f230 0x55bf8253f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.180+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bf8253f230 0x55bf8253f6b0 crc :-1 s=READY pgs=238 gs=4 cs=0 l=0 c_cookie=3326648792894240906 s_cookie=3307451710813576082 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e2aa173a8f1788a server_cookie=2de66dceaecd1b92 in_seq=0 out_seq=0 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.180+0000 7fb7a37fe640 10 client.18267 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7a37fe640 1 -- 10.20.193.28:0/1194149356 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bf8245e630 con 0x55bf8253f230 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7a37fe640 10 client.18267 handle_command_reply: tid=0 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 client.18267 shutdown 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 msgr2=0x55bf8253bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf8253bba0 secure :-1 s=READY pgs=964 gs=1 cs=0 l=1 c_cookie=1341288083597379279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7e4030780 tx=0x7fb7e40396a0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 shutdown_connections 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bf8253f230 0x55bf8253f6b0 crc :-1 s=READY pgs=238 gs=4 cs=0 l=0 c_cookie=3326648792894240906 s_cookie=3307451710813576082 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf8253bba0 unknown :-1 s=CLOSED pgs=964 gs=1 cs=0 l=1 c_cookie=1341288083597379279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf8253b140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/1194149356 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8253aaf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7a37fe640 0 client.18267 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:20.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 >> 10.20.193.28:0/1194149356 conn(0x55bf824401c0 msgr2=0x55bf82522790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:20.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 shutdown_connections 2026-02-20T13:25:20.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 1 -- 10.20.193.28:0/1194149356 wait complete. 2026-02-20T13:25:20.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.181+0000 7fb7f287fe00 20 client.18267 trim_cache size 0 max 16384 2026-02-20T13:25:20.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7f287fe00 1 Processor -- start 2026-02-20T13:25:20.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7f287fe00 1 -- start start 2026-02-20T13:25:20.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf82525d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf825615d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf82561b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bf8242a8d0 con 0x55bf82562700 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bf8216bf10 con 0x55bf82541de0 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bf824924f0 con 0x55bf825214c0 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ee7d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf82561b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ee7d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf82561b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34850/0 (socket says 10.20.193.28:34850) 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/2863279060 learned_addr learned my addr 10.20.193.28:0/2863279060 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf82525d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ed7cf640 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf825615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/2863279060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 msgr2=0x55bf82525d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf82525d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/2863279060 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 msgr2=0x55bf825615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf825615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.189+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/2863279060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf8252d160 con 0x55bf82562700 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf82561b10 secure :-1 s=READY pgs=965 gs=1 cs=0 l=1 c_cookie=2570959148238082655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7e4030290 tx=0x7fb7e404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ade1b94ac5925f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7b5bfe640 1 -- 10.20.193.28:0/2863279060 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7e405d070 con 0x55bf82562700 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7b5bfe640 1 -- 10.20.193.28:0/2863279060 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7e403f070 con 0x55bf82562700 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7b5bfe640 1 -- 10.20.193.28:0/2863279060 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7e40383d0 con 0x55bf82562700 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2863279060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 msgr2=0x55bf82561b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf82561b10 secure :-1 s=READY pgs=965 gs=1 cs=0 l=1 c_cookie=2570959148238082655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7e4030290 tx=0x7fb7e404e000 comp rx=0 tx=0).stop 2026-02-20T13:25:20.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2863279060 shutdown_connections 2026-02-20T13:25:20.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf82561b10 unknown :-1 s=CLOSED pgs=965 gs=1 cs=0 l=1 c_cookie=2570959148238082655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf825615d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2863279060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf82525d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2863279060 >> 10.20.193.28:0/2863279060 conn(0x55bf824401c0 msgr2=0x55bf82537600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:20.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2863279060 shutdown_connections 2026-02-20T13:25:20.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.190+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2863279060 wait complete. 2026-02-20T13:25:20.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7f287fe00 1 -- start start 2026-02-20T13:25:20.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7f287fe00 1 Processor -- start 2026-02-20T13:25:20.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8251ed40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf825421b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7f287fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf825426f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bf82542dd0 con 0x55bf82562700 2026-02-20T13:25:20.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bf82542f40 con 0x55bf82541de0 2026-02-20T13:25:20.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7f287fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bf82543100 con 0x55bf825214c0 2026-02-20T13:25:20.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7edfd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8251ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7edfd0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8251ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:46724/0 (socket says 10.20.193.28:46724) 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7edfd0640 1 -- 10.20.193.28:0/2479014818 learned_addr learned my addr 10.20.193.28:0/2479014818 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf825426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7ed7cf640 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf825421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/2479014818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 msgr2=0x55bf8251ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8251ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/2479014818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 msgr2=0x55bf825421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf825421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7ee7d1640 1 -- 10.20.193.28:0/2479014818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf823c2670 con 0x55bf82562700 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.191+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8251ed40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:20.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7ee7d1640 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf825426f0 secure :-1 s=READY pgs=966 gs=2 cs=0 l=1 c_cookie=11258066468748912895 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55bf82520d70 tx=0x7fb7e4006cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3cafce3783e8ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7a37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7a37fe640 1 -- 10.20.193.28:0/2479014818 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7e405d040 con 0x55bf82562700 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7a37fe640 1 -- 10.20.193.28:0/2479014818 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55bf820cc520 con 0x55bf82562700 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7a37fe640 1 -- 10.20.193.28:0/2479014818 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7e4044b90 con 0x55bf82562700 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf823b0da0 con 0x55bf82562700 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7a37fe640 1 -- 10.20.193.28:0/2479014818 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb7e4044d20 con 0x55bf82562700 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7f287fe00 10 client.18273 _ll_register_callbacks cb 0x55bf823b7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf824dcca0 con 0x55bf82562700 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7a37fe640 1 -- 10.20.193.28:0/2479014818 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb7e40449d0 con 0x55bf82562700 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7f287fe00 10 client.18273 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bf823bd0f0 con 0x55bf82562700 2026-02-20T13:25:20.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.192+0000 7fb7a37fe640 1 -- 10.20.193.28:0/2479014818 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb7e40443f0 con 0x55bf82562700 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7f287fe00 10 client.18273 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7f287fe00 10 client.18273 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7f287fe00 20 client.18273 populate_metadata read hostname 'trial028' 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bf825447c0 0x55bf82544c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7f287fe00 4 client.18273 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bf82110640 con 0x55bf825447c0 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bf825447c0 0x55bf82544c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7edfd0640 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bf825447c0 0x55bf82544c60 crc :-1 s=READY pgs=239 gs=4 cs=0 l=0 c_cookie=12655717728979133229 s_cookie=4805013385205341157 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa22438bd6a232d server_cookie=42aed6373e295be5 in_seq=0 out_seq=0 2026-02-20T13:25:20.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.193+0000 7fb7a37fe640 10 client.18273 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7a37fe640 1 -- 10.20.193.28:0/2479014818 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bf82110640 con 0x55bf825447c0 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7a37fe640 10 client.18273 handle_command_reply: tid=0 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 client.18273 shutdown 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 msgr2=0x55bf825426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf825426f0 secure :-1 s=READY pgs=966 gs=2 cs=0 l=1 c_cookie=11258066468748912895 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55bf82520d70 tx=0x7fb7e4006cb0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 shutdown_connections 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bf825447c0 0x55bf82544c60 crc :-1 s=READY pgs=239 gs=4 cs=0 l=0 c_cookie=12655717728979133229 s_cookie=4805013385205341157 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bf82562700 0x55bf825426f0 unknown :-1 s=CLOSED pgs=966 gs=2 cs=0 l=1 c_cookie=11258066468748912895 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bf82541de0 0x55bf825421b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 --2- 10.20.193.28:0/2479014818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bf825214c0 0x55bf8251ed40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 >> 10.20.193.28:0/2479014818 conn(0x55bf824401c0 msgr2=0x55bf82537d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:20.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7a37fe640 0 client.18273 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:20.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 shutdown_connections 2026-02-20T13:25:20.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 1 -- 10.20.193.28:0/2479014818 wait complete. 2026-02-20T13:25:20.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.199+0000 7fb7f287fe00 20 client.18273 trim_cache size 0 max 16384 2026-02-20T13:25:20.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:25:20.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:25:20.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:25:20.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 -- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7c40b5760 msgr2=0x7fb7c40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7c40b5760 0x7fb7c40d5c10 secure :-1 s=READY pgs=440 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7d8004740 tx=0x7fb7d8005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 -- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810b900 msgr2=0x7fb7e80f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810b900 0x7fb7e80f4d90 secure :-1 s=READY pgs=962 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7dc00d950 tx=0x7fb7dc00de20 comp rx=0 tx=0).stop 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 -- 10.20.193.28:0/1005114676 shutdown_connections 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7c40b5760 0x7fb7c40d5c10 unknown :-1 s=CLOSED pgs=440 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7e810b900 0x7fb7e80f4d90 unknown :-1 s=CLOSED pgs=962 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7e810c490 0x7fb7e80f5990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 --2- 10.20.193.28:0/1005114676 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7e80609a0 0x7fb7e80f4740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:20.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 -- 10.20.193.28:0/1005114676 >> 10.20.193.28:0/1005114676 conn(0x7fb7e80e8f40 msgr2=0x7fb7e80eabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:20.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 -- 10.20.193.28:0/1005114676 shutdown_connections 2026-02-20T13:25:20.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:20.200+0000 7fb7eefd2640 1 -- 10.20.193.28:0/1005114676 wait complete. 2026-02-20T13:25:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:20 trial127 ceph-mon[43817]: pgmap v421: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:25:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:20 trial034 ceph-mon[43332]: pgmap v421: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:25:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:20 trial028 ceph-mon[37442]: pgmap v421: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:25:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:22 trial127 ceph-mon[43817]: pgmap v422: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 19 op/s 2026-02-20T13:25:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:22 trial034 ceph-mon[43332]: pgmap v422: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 19 op/s 2026-02-20T13:25:23.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:22 trial028 ceph-mon[37442]: pgmap v422: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 19 op/s 2026-02-20T13:25:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:24 trial127 ceph-mon[43817]: pgmap v423: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2026-02-20T13:25:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:24 trial034 ceph-mon[43332]: pgmap v423: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2026-02-20T13:25:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:24 trial028 ceph-mon[37442]: pgmap v423: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2026-02-20T13:25:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:26 trial127 ceph-mon[43817]: pgmap v424: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:26.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:26 trial034 ceph-mon[43332]: pgmap v424: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:27.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:26 trial028 ceph-mon[37442]: pgmap v424: 97 pgs: 97 active+clean; 4.5 MiB data, 339 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:28.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:28 trial034 ceph-mon[43332]: pgmap v425: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-20T13:25:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:28 trial127 ceph-mon[43817]: pgmap v425: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-20T13:25:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:28 trial028 ceph-mon[37442]: pgmap v425: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-20T13:25:29.451 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-20T13:25:29.451 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.8 2026-02-20T13:25:29.451 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:25:29.643 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:29.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 -- 10.20.193.28:0/184900750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388060010 msgr2=0x7f13880603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 --2- 10.20.193.28:0/184900750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388060010 0x7f13880603e0 secure :-1 s=READY pgs=967 gs=1 cs=0 l=1 c_cookie=12406469278601679343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1374009950 tx=0x7f137402f190 comp rx=0 tx=0).stop 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 -- 10.20.193.28:0/184900750 shutdown_connections 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 --2- 10.20.193.28:0/184900750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1388113000 0x7f13881739d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 --2- 10.20.193.28:0/184900750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1388060a00 0x7f1388112850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 --2- 10.20.193.28:0/184900750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388060010 0x7f13880603e0 unknown :-1 s=CLOSED pgs=967 gs=1 cs=0 l=1 c_cookie=12406469278601679343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 -- 10.20.193.28:0/184900750 >> 10.20.193.28:0/184900750 conn(0x7f13880e95a0 msgr2=0x7f13881099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 -- 10.20.193.28:0/184900750 shutdown_connections 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.814+0000 7f138d31d640 1 -- 10.20.193.28:0/184900750 wait complete. 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.815+0000 7f138d31d640 1 Processor -- start 2026-02-20T13:25:29.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.815+0000 7f138d31d640 1 -- start start 2026-02-20T13:25:29.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.815+0000 7f138d31d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1388060010 0x7f13880ef930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:29.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.815+0000 7f138d31d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1388060a00 0x7f13881738d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:29.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.815+0000 7f138d31d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388113000 0x7f13880f0030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:29.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.815+0000 7f138d31d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f13880f5240 con 0x7f1388113000 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.815+0000 7f138d31d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f13880f53b0 con 0x7f1388060a00 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.815+0000 7f138d31d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f13880f5570 con 0x7f1388060010 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138cb1c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388113000 0x7f13880f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f13877fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1388060a00 0x7f13881738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f1387fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1388060010 0x7f13880ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f13877fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1388060a00 0x7f13881738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:43906/0 (socket says 10.20.193.28:43906) 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138cb1c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388113000 0x7f13880f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34870/0 (socket says 10.20.193.28:34870) 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f13877fe640 1 -- 10.20.193.28:0/2098962102 learned_addr learned my addr 10.20.193.28:0/2098962102 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138cb1c640 1 -- 10.20.193.28:0/2098962102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1388060010 msgr2=0x7f13880ef930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138cb1c640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1388060010 0x7f13880ef930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138cb1c640 1 -- 10.20.193.28:0/2098962102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1388060a00 msgr2=0x7f13881738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:29.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138cb1c640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1388060a00 0x7f13881738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138cb1c640 1 -- 10.20.193.28:0/2098962102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1374009570 con 0x7f1388113000 2026-02-20T13:25:29.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138cb1c640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388113000 0x7f13880f0030 secure :-1 s=READY pgs=968 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f137c00e720 tx=0x7f137c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:29.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f13857fa640 1 -- 10.20.193.28:0/2098962102 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f137c005500 con 0x7f1388113000 2026-02-20T13:25:29.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f13857fa640 1 -- 10.20.193.28:0/2098962102 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f137c005660 con 0x7f1388113000 2026-02-20T13:25:29.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f13857fa640 1 -- 10.20.193.28:0/2098962102 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f137c011460 con 0x7f1388113000 2026-02-20T13:25:29.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138d31d640 1 -- 10.20.193.28:0/2098962102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13880f5850 con 0x7f1388113000 2026-02-20T13:25:29.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.816+0000 7f138d31d640 1 -- 10.20.193.28:0/2098962102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13880f5cd0 con 0x7f1388113000 2026-02-20T13:25:29.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.817+0000 7f135affd640 1 -- 10.20.193.28:0/2098962102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138810e0f0 con 0x7f1388113000 2026-02-20T13:25:29.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.820+0000 7f13857fa640 1 -- 10.20.193.28:0/2098962102 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f137c00c7e0 con 0x7f1388113000 2026-02-20T13:25:29.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.821+0000 7f13857fa640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f135c0b5750 0x7f135c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:29.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.821+0000 7f13857fa640 1 -- 10.20.193.28:0/2098962102 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f137c0e7980 con 0x7f1388113000 2026-02-20T13:25:29.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.821+0000 7f13857fa640 1 -- 10.20.193.28:0/2098962102 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f137c120730 con 0x7f1388113000 2026-02-20T13:25:29.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.822+0000 7f1387fff640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f135c0b5750 0x7f135c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:29.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.822+0000 7f1387fff640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f135c0b5750 0x7f135c0d5c00 secure :-1 s=READY pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13740098a0 tx=0x7f137403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:29.826 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:25:29.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.966+0000 7f135affd640 1 -- 10.20.193.28:0/2098962102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13880f0af0 con 0x7f1388113000 2026-02-20T13:25:29.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.967+0000 7f13857fa640 1 -- 10.20.193.28:0/2098962102 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f137c0aa3e0 con 0x7f1388113000 2026-02-20T13:25:29.969 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:25:29.969 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:25:29.970 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:25:29.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 -- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f135c0b5750 msgr2=0x7f135c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:29.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f135c0b5750 0x7f135c0d5c00 secure :-1 s=READY pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13740098a0 tx=0x7f137403a040 comp rx=0 tx=0).stop 2026-02-20T13:25:29.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 -- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388113000 msgr2=0x7f13880f0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:29.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388113000 0x7f13880f0030 secure :-1 s=READY pgs=968 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f137c00e720 tx=0x7f137c00ebf0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 -- 10.20.193.28:0/2098962102 shutdown_connections 2026-02-20T13:25:29.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f135c0b5750 0x7f135c0d5c00 unknown :-1 s=CLOSED pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1388113000 0x7f13880f0030 unknown :-1 s=CLOSED pgs=968 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1388060a00 0x7f13881738d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 --2- 10.20.193.28:0/2098962102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1388060010 0x7f13880ef930 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 -- 10.20.193.28:0/2098962102 >> 10.20.193.28:0/2098962102 conn(0x7f13880e95a0 msgr2=0x7f1388111fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 -- 10.20.193.28:0/2098962102 shutdown_connections 2026-02-20T13:25:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:29.969+0000 7f135affd640 1 -- 10.20.193.28:0/2098962102 wait complete. 2026-02-20T13:25:30.040 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:30.075 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 139.8 --await-for 45.0' 2026-02-20T13:25:30.075 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 139.8 --await-for 45.0 2026-02-20T13:25:30.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.222+0000 7fe9ef577640 1 -- 10.20.193.28:0/2335718849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f010f4b0 msgr2=0x7fe9f010f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.222+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2335718849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f010f4b0 0x7fe9f010f880 secure :-1 s=READY pgs=969 gs=1 cs=0 l=1 c_cookie=18288785597009919140 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e4009950 tx=0x7fe9e402f1d0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.222+0000 7fe9ef577640 1 -- 10.20.193.28:0/2335718849 shutdown_connections 2026-02-20T13:25:30.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.222+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2335718849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9f01156a0 0x7fe9f0176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.222+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2335718849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe9f010fea0 0x7fe9f0114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.222+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2335718849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f010f4b0 0x7fe9f010f880 unknown :-1 s=CLOSED pgs=969 gs=1 cs=0 l=1 c_cookie=18288785597009919140 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.222+0000 7fe9ef577640 1 -- 10.20.193.28:0/2335718849 >> 10.20.193.28:0/2335718849 conn(0x7fe9f00ecda0 msgr2=0x7fe9f010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.222+0000 7fe9ef577640 1 -- 10.20.193.28:0/2335718849 shutdown_connections 2026-02-20T13:25:30.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.223+0000 7fe9ef577640 1 -- 10.20.193.28:0/2335718849 wait complete. 2026-02-20T13:25:30.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ef577640 1 Processor -- start 2026-02-20T13:25:30.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ef577640 1 -- start start 2026-02-20T13:25:30.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ef577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9f010f4b0 0x7fe9f011de00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ef577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe9f010fea0 0x7fe9f011e340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ef577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f01156a0 0x7fe9f0123710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ef577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0123d30 con 0x7fe9f01156a0 2026-02-20T13:25:30.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ef577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0123ea0 con 0x7fe9f010f4b0 2026-02-20T13:25:30.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ef577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0124060 con 0x7fe9f010fea0 2026-02-20T13:25:30.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ee575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9f010f4b0 0x7fe9f011de00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ee575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9f010f4b0 0x7fe9f011de00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50876/0 (socket says 10.20.193.28:50876) 2026-02-20T13:25:30.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9ee575640 1 -- 10.20.193.28:0/2456718332 learned_addr learned my addr 10.20.193.28:0/2456718332 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9edd74640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe9f010fea0 0x7fe9f011e340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.224+0000 7fe9eed76640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f01156a0 0x7fe9f0123710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9eed76640 1 -- 10.20.193.28:0/2456718332 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe9f010fea0 msgr2=0x7fe9f011e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9eed76640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe9f010fea0 0x7fe9f011e340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9eed76640 1 -- 10.20.193.28:0/2456718332 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9f010f4b0 msgr2=0x7fe9f011de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9eed76640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9f010f4b0 0x7fe9f011de00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9eed76640 1 -- 10.20.193.28:0/2456718332 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e4009570 con 0x7fe9f01156a0 2026-02-20T13:25:30.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9f010f4b0 0x7fe9f011de00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:30.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9edd74640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe9f010fea0 0x7fe9f011e340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:30.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9eed76640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f01156a0 0x7fe9f0123710 secure :-1 s=READY pgs=970 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e000e5e0 tx=0x7fe9e000eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9d77fe640 1 -- 10.20.193.28:0/2456718332 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e000a960 con 0x7fe9f01156a0 2026-02-20T13:25:30.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9d77fe640 1 -- 10.20.193.28:0/2456718332 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe9e0011460 con 0x7fe9f01156a0 2026-02-20T13:25:30.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9d77fe640 1 -- 10.20.193.28:0/2456718332 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e00197a0 con 0x7fe9f01156a0 2026-02-20T13:25:30.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9ef577640 1 -- 10.20.193.28:0/2456718332 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f0124340 con 0x7fe9f01156a0 2026-02-20T13:25:30.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.225+0000 7fe9ef577640 1 -- 10.20.193.28:0/2456718332 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f0164a40 con 0x7fe9f01156a0 2026-02-20T13:25:30.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.228+0000 7fe9d77fe640 1 -- 10.20.193.28:0/2456718332 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe9e0017020 con 0x7fe9f01156a0 2026-02-20T13:25:30.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.230+0000 7fe9d77fe640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9c80b5830 0x7fe9c80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.230+0000 7fe9d77fe640 1 -- 10.20.193.28:0/2456718332 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe9e00e7970 con 0x7fe9f01156a0 2026-02-20T13:25:30.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.230+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9c80b5830 0x7fe9c80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9c80b5830 0x7fe9c80d5ce0 secure :-1 s=READY pgs=442 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e4038820 tx=0x7fe9e403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9f6c8fe00 1 Processor -- start 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9f6c8fe00 1 -- start start 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d4f550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 0x563359d94400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563359c657d0 con 0x563359d4f180 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563359c61500 con 0x563359d94940 2026-02-20T13:25:30.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563359c5b4a0 con 0x563359d4fa90 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9eed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9ee575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d4f550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9eed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50888/0 (socket says 10.20.193.28:50888) 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9eed76640 1 -- 10.20.193.28:0/1521147977 learned_addr learned my addr 10.20.193.28:0/1521147977 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9edd74640 1 --2- 10.20.193.28:0/1521147977 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 0x563359d94400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9eed76640 1 -- 10.20.193.28:0/1521147977 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 msgr2=0x563359d94400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9eed76640 1 --2- 10.20.193.28:0/1521147977 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 0x563359d94400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9eed76640 1 -- 10.20.193.28:0/1521147977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 msgr2=0x563359d4f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9eed76640 1 --2- 10.20.193.28:0/1521147977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d4f550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.231+0000 7fe9eed76640 1 -- 10.20.193.28:0/1521147977 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563359c06d80 con 0x563359d94940 2026-02-20T13:25:30.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9eed76640 1 --2- 10.20.193.28:0/1521147977 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4d20 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=2391058574920823844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e0006b80 tx=0x7fe9e00a9b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212ebf1b034eb424 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9d4ff9640 1 -- 10.20.193.28:0/1521147977 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e00ad4d0 con 0x563359d94940 2026-02-20T13:25:30.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9d4ff9640 1 -- 10.20.193.28:0/1521147977 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe9e00ae6d0 con 0x563359d94940 2026-02-20T13:25:30.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9d4ff9640 1 -- 10.20.193.28:0/1521147977 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e00a9f40 con 0x563359d94940 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1521147977 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 msgr2=0x563359db4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/1521147977 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4d20 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=2391058574920823844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e0006b80 tx=0x7fe9e00a9b70 comp rx=0 tx=0).stop 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1521147977 shutdown_connections 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/1521147977 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4d20 unknown :-1 s=CLOSED pgs=350 gs=1 cs=0 l=1 c_cookie=2391058574920823844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/1521147977 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 0x563359d94400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/1521147977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d4f550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1521147977 >> 10.20.193.28:0/1521147977 conn(0x563359d2d680 msgr2=0x563359d4da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1521147977 shutdown_connections 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.232+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1521147977 wait complete. 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.233+0000 7fe9f6c8fe00 1 -- start start 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9f6c8fe00 1 Processor -- start 2026-02-20T13:25:30.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4f180 0x563359d50550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d50a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359d75400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563359d75940 con 0x563359d4fa90 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563359d75ab0 con 0x563359d94940 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563359d75c70 con 0x563359d4f180 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9edd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d50a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9edd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d50a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56278/0 (socket says 10.20.193.28:56278) 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9edd74640 1 -- 10.20.193.28:0/2587280789 learned_addr learned my addr 10.20.193.28:0/2587280789 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4f180 0x563359d50550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.234+0000 7fe9eed76640 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359d75400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9edd74640 1 -- 10.20.193.28:0/2587280789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4f180 msgr2=0x563359d50550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9edd74640 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4f180 0x563359d50550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9edd74640 1 -- 10.20.193.28:0/2587280789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 msgr2=0x563359d75400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9edd74640 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359d75400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9edd74640 1 -- 10.20.193.28:0/2587280789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563359bdf350 con 0x563359d4fa90 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9edd74640 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d50a90 secure :-1 s=READY pgs=971 gs=1 cs=0 l=1 c_cookie=535965711266007015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9d80046d0 tx=0x7fe9d8002b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77021f987ccc7e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe99ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe99ffff640 1 -- 10.20.193.28:0/2587280789 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9d8013a40 con 0x563359d4fa90 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe99ffff640 1 -- 10.20.193.28:0/2587280789 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe9d8013ba0 con 0x563359d4fa90 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe99ffff640 1 -- 10.20.193.28:0/2587280789 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9d801b6f0 con 0x563359d4fa90 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f0164a40 con 0x563359d4fa90 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe99ffff640 1 -- 10.20.193.28:0/2587280789 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe9d8013d10 con 0x563359d4fa90 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9f6c8fe00 10 client.18291 _ll_register_callbacks cb 0x563359bdc9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:30.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.235+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5633598f16f0 con 0x563359d4fa90 2026-02-20T13:25:30.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.236+0000 7fe99ffff640 1 -- 10.20.193.28:0/2587280789 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9d801b880 con 0x563359d4fa90 2026-02-20T13:25:30.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9f6c8fe00 10 client.18291 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:30.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563359bf1150 con 0x563359d4fa90 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe99ffff640 1 -- 10.20.193.28:0/2587280789 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe9d8025070 con 0x563359d4fa90 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9f6c8fe00 10 client.18291 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9f6c8fe00 10 client.18291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9f6c8fe00 20 client.18291 populate_metadata read hostname 'trial028' 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563359d7a590 0x563359d7aa30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9f6c8fe00 4 client.18291 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633598f16f0 con 0x563359d7a590 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.237+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563359d7a590 0x563359d7aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.238+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563359d7a590 0x563359d7aa30 crc :-1 s=READY pgs=240 gs=4 cs=0 l=0 c_cookie=929542596849861324 s_cookie=8305678928742837256 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce6661120d482cc server_cookie=7343b2faf629ec08 in_seq=0 out_seq=0 2026-02-20T13:25:30.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.238+0000 7fe99ffff640 10 client.18291 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.238+0000 7fe99ffff640 1 -- 10.20.193.28:0/2587280789 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5633598f16f0 con 0x563359d7a590 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.238+0000 7fe99ffff640 10 client.18291 handle_command_reply: tid=0 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.238+0000 7fe9f6c8fe00 1 client.18291 shutdown 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.238+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 msgr2=0x563359d50a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.238+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d50a90 secure :-1 s=READY pgs=971 gs=1 cs=0 l=1 c_cookie=535965711266007015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9d80046d0 tx=0x7fe9d8002b40 comp rx=0 tx=0).stop 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 shutdown_connections 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563359d7a590 0x563359d7aa30 crc :-1 s=READY pgs=240 gs=4 cs=0 l=0 c_cookie=929542596849861324 s_cookie=8305678928742837256 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d50a90 unknown :-1 s=CLOSED pgs=971 gs=1 cs=0 l=1 c_cookie=535965711266007015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359d75400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2587280789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4f180 0x563359d50550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 >> 10.20.193.28:0/2587280789 conn(0x563359d2d680 msgr2=0x563359d4da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe99ffff640 0 client.18291 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:30.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 shutdown_connections 2026-02-20T13:25:30.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2587280789 wait complete. 2026-02-20T13:25:30.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.239+0000 7fe9f6c8fe00 20 client.18291 trim_cache size 0 max 16384 2026-02-20T13:25:30.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.249+0000 7fe9f6c8fe00 1 Processor -- start 2026-02-20T13:25:30.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.249+0000 7fe9f6c8fe00 1 -- start start 2026-02-20T13:25:30.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.249+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d94400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.249+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 0x563359db3fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.249+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.249+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563359c590d0 con 0x563359d4f180 2026-02-20T13:25:30.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.249+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563359919700 con 0x563359d94940 2026-02-20T13:25:30.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.249+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563359d2a100 con 0x563359d4fa90 2026-02-20T13:25:30.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d94400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d94400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56292/0 (socket says 10.20.193.28:56292) 2026-02-20T13:25:30.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 -- 10.20.193.28:0/1390995711 learned_addr learned my addr 10.20.193.28:0/1390995711 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9edd74640 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 0x563359db3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9eed76640 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 -- 10.20.193.28:0/1390995711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 msgr2=0x563359db3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 0x563359db3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 -- 10.20.193.28:0/1390995711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 msgr2=0x563359db4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 -- 10.20.193.28:0/1390995711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563359da7280 con 0x563359d4f180 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ee575640 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d94400 secure :-1 s=READY pgs=972 gs=1 cs=0 l=1 c_cookie=6744497381627028756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e40093c0 tx=0x7fe9e4043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9944a27c6e6514 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ba4e6640 1 -- 10.20.193.28:0/1390995711 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e4057070 con 0x563359d4f180 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ba4e6640 1 -- 10.20.193.28:0/1390995711 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe9e403e040 con 0x563359d4f180 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.250+0000 7fe9ba4e6640 1 -- 10.20.193.28:0/1390995711 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e4052720 con 0x563359d4f180 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1390995711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 msgr2=0x563359d94400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d94400 secure :-1 s=READY pgs=972 gs=1 cs=0 l=1 c_cookie=6744497381627028756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e40093c0 tx=0x7fe9e4043000 comp rx=0 tx=0).stop 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1390995711 shutdown_connections 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d94940 0x563359db4500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d4fa90 0x563359db3fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/1390995711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4f180 0x563359d94400 unknown :-1 s=CLOSED pgs=972 gs=1 cs=0 l=1 c_cookie=6744497381627028756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1390995711 >> 10.20.193.28:0/1390995711 conn(0x563359d2d680 msgr2=0x563359d93cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1390995711 shutdown_connections 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/1390995711 wait complete. 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 -- start start 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.251+0000 7fe9f6c8fe00 1 Processor -- start 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d4f180 0x563359d89650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d89b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9f6c8fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d94940 0x563359e483d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563359e48910 con 0x563359d4fa90 2026-02-20T13:25:30.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563359e48a50 con 0x563359d4f180 2026-02-20T13:25:30.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9f6c8fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563359e59fd0 con 0x563359d94940 2026-02-20T13:25:30.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9eed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d94940 0x563359e483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9eed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d94940 0x563359e483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54330/0 (socket says 10.20.193.28:54330) 2026-02-20T13:25:30.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9eed76640 1 -- 10.20.193.28:0/2250529568 learned_addr learned my addr 10.20.193.28:0/2250529568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d4f180 0x563359d89650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9edd74640 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d89b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9eed76640 1 -- 10.20.193.28:0/2250529568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d4f180 msgr2=0x563359d89650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9eed76640 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d4f180 0x563359d89650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9eed76640 1 -- 10.20.193.28:0/2250529568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 msgr2=0x563359d89b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9eed76640 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d89b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9eed76640 1 -- 10.20.193.28:0/2250529568 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563359bebbd0 con 0x563359d94940 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.252+0000 7fe9edd74640 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d89b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe9eed76640 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d94940 0x563359e483d0 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=3058115365390081359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e0005900 tx=0x7fe9e0006dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a709bb8e43d5d4f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe99ffff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:25:30.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe99ffff640 1 -- 10.20.193.28:0/2250529568 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e00b5fd0 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe99ffff640 1 -- 10.20.193.28:0/2250529568 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe9e00b8e10 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe99ffff640 1 -- 10.20.193.28:0/2250529568 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e00b8c00 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e404c040 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe99ffff640 1 -- 10.20.193.28:0/2250529568 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe9e00ae960 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe99ffff640 10 client.28156 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe9f6c8fe00 10 client.28156 _ll_register_callbacks cb 0x563359bdc9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.253+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9e00ae6d0 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe99ffff640 1 -- 10.20.193.28:0/2250529568 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9e00115d0 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9f6c8fe00 10 client.28156 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563359bdf680 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe99ffff640 1 -- 10.20.193.28:0/2250529568 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe9e00abcb0 con 0x563359d94940 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9f6c8fe00 10 client.28156 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:30.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9f6c8fe00 10 client.28156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9f6c8fe00 20 client.28156 populate_metadata read hostname 'trial028' 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563359e5b750 0x563359e7bc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9f6c8fe00 4 client.28156 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563359c68d60 con 0x563359e5b750 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.254+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563359e5b750 0x563359e7bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9ee575640 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563359e5b750 0x563359e7bc00 crc :-1 s=READY pgs=241 gs=4 cs=0 l=0 c_cookie=1826905021817077166 s_cookie=10012548207984381067 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=195a78701fc8bdae server_cookie=8af3b78be1620c8b in_seq=0 out_seq=0 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe99ffff640 10 client.28156 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe99ffff640 1 -- 10.20.193.28:0/2250529568 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x563359c68d60 con 0x563359e5b750 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe99ffff640 10 client.28156 handle_command_reply: tid=0 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 client.28156 shutdown 2026-02-20T13:25:30.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d94940 msgr2=0x563359e483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d94940 0x563359e483d0 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=3058115365390081359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e0005900 tx=0x7fe9e0006dd0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 shutdown_connections 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563359e5b750 0x563359e7bc00 crc :-1 s=READY pgs=241 gs=4 cs=0 l=0 c_cookie=1826905021817077166 s_cookie=10012548207984381067 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563359d4fa90 0x563359d89b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563359d94940 0x563359e483d0 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=3058115365390081359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 --2- 10.20.193.28:0/2250529568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563359d4f180 0x563359d89650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe99ffff640 0 client.28156 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 >> 10.20.193.28:0/2250529568 conn(0x563359d2d680 msgr2=0x563359d503a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 shutdown_connections 2026-02-20T13:25:30.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 1 -- 10.20.193.28:0/2250529568 wait complete. 2026-02-20T13:25:30.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.255+0000 7fe9f6c8fe00 20 client.28156 trim_cache size 0 max 16384 2026-02-20T13:25:30.264 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:25:30.264 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:25:30.264 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:25:30.264 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:25:30.264 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.265 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:25:30.266 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.267 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.268 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.269 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.270 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.271 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:25:30.272 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:25:30.273 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:30.273 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:30.273 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:30.273 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:30.273 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:30.273 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:30.273 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:30.273 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 -- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9c80b5830 msgr2=0x7fe9c80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9c80b5830 0x7fe9c80d5ce0 secure :-1 s=READY pgs=442 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e4038820 tx=0x7fe9e403a040 comp rx=0 tx=0).stop 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 -- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f01156a0 msgr2=0x7fe9f0123710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f01156a0 0x7fe9f0123710 secure :-1 s=READY pgs=970 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e000e5e0 tx=0x7fe9e000eab0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 -- 10.20.193.28:0/2456718332 shutdown_connections 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9c80b5830 0x7fe9c80d5ce0 unknown :-1 s=CLOSED pgs=442 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9f01156a0 0x7fe9f0123710 unknown :-1 s=CLOSED pgs=970 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe9f010fea0 0x7fe9f011e340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 --2- 10.20.193.28:0/2456718332 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9f010f4b0 0x7fe9f011de00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 -- 10.20.193.28:0/2456718332 >> 10.20.193.28:0/2456718332 conn(0x7fe9f00ecda0 msgr2=0x7fe9f010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 -- 10.20.193.28:0/2456718332 shutdown_connections 2026-02-20T13:25:30.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.257+0000 7fe9ef577640 1 -- 10.20.193.28:0/2456718332 wait complete. 2026-02-20T13:25:30.275 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:30.311 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.311 INFO:tasks.workunit.client.0.trial028.stdout:251/600: open fd = 3 2026-02-20T13:25:30.311 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.311 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:252/600: open fd = 3 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:253/600: open fd = 3 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:254/600: open fd = 3 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.312 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:255/600: open fd = 3 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:256/600: open fd = 3 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:257/600: open fd = 3 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.313 INFO:tasks.workunit.client.0.trial028.stdout:258/600: open fd = 3 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:259/600: open fd = 3 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:260/600: open fd = 3 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:261/600: open fd = 3 2026-02-20T13:25:30.314 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:262/600: open fd = 3 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:263/600: open fd = 3 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:264/600: open fd = 3 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.315 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:265/600: open fd = 3 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:266/600: open fd = 3 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:267/600: open fd = 3 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.316 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:268/600: open fd = 3 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:269/600: open fd = 3 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:270/600: open fd = 3 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:271/600: open fd = 3 2026-02-20T13:25:30.317 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:272/600: open fd = 3 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:273/600: open fd = 3 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:274/600: open fd = 3 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.318 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:275/600: open fd = 3 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:276/600: open fd = 3 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:277/600: open fd = 3 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.319 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:278/600: open fd = 3 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:279/600: open fd = 3 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:280/600: open fd = 3 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.320 INFO:tasks.workunit.client.0.trial028.stdout:281/600: open fd = 3 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:282/600: open fd = 3 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:283/600: open fd = 3 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:284/600: open fd = 3 2026-02-20T13:25:30.321 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:285/600: open fd = 3 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:286/600: open fd = 3 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:287/600: open fd = 3 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.322 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:288/600: open fd = 3 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:289/600: open fd = 3 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:290/600: open fd = 3 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.323 INFO:tasks.workunit.client.0.trial028.stdout:291/600: open fd = 3 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:292/600: open fd = 3 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:293/600: open fd = 3 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:294/600: open fd = 3 2026-02-20T13:25:30.324 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:295/600: open fd = 3 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:296/600: open fd = 3 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:297/600: open fd = 3 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.325 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:298/600: open fd = 3 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:299/600: open fd = 3 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:300/600: open fd = 3 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.326 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:301/600: open fd = 3 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:302/600: open fd = 3 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:303/600: open fd = 3 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:304/600: open fd = 3 2026-02-20T13:25:30.327 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:305/600: open fd = 3 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:306/600: open fd = 3 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:307/600: open fd = 3 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.328 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:308/600: open fd = 3 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:309/600: open fd = 3 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:310/600: open fd = 3 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.329 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.330 INFO:tasks.workunit.client.0.trial028.stdout:311/600: open fd = 3 2026-02-20T13:25:30.330 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.330 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.330 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:25:30.330 INFO:tasks.workunit.client.0.trial028.stdout:312/600: open fd = 3 2026-02-20T13:25:30.330 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.330 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:25:30.402 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:25:30.402 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:25:30.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.501+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1090937275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcaa410bcd0 msgr2=0x7fcaa410c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.501+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1090937275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcaa410bcd0 0x7fcaa410c0a0 secure :-1 s=READY pgs=288 gs=2 cs=0 l=1 c_cookie=10442528554874522724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca94009950 tx=0x7fca9402f190 comp rx=0 tx=0).stop 2026-02-20T13:25:30.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.502+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1090937275 shutdown_connections 2026-02-20T13:25:30.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.502+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1090937275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcaa410c6c0 0x7fcaa4111710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.502+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1090937275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcaa4111ec0 0x7fcaa4172890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.502+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1090937275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcaa410bcd0 0x7fcaa410c0a0 unknown :-1 s=CLOSED pgs=288 gs=2 cs=0 l=1 c_cookie=10442528554874522724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.502+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1090937275 >> 10.20.193.28:0/1090937275 conn(0x7fcaa40e95a0 msgr2=0x7fcaa41099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.502+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1090937275 shutdown_connections 2026-02-20T13:25:30.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.502+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1090937275 wait complete. 2026-02-20T13:25:30.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.502+0000 7fcaaa4fd640 1 Processor -- start 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaaa4fd640 1 -- start start 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaaa4fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcaa410bcd0 0x7fcaa40f5450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaaa4fd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcaa410c6c0 0x7fcaa4172790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaaa4fd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcaa4111ec0 0x7fcaa40f5b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaaa4fd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa40fad60 con 0x7fcaa410bcd0 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaaa4fd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa40faed0 con 0x7fcaa410c6c0 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaaa4fd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa40fb090 con 0x7fcaa4111ec0 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa94fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcaa410bcd0 0x7fcaa40f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa94fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcaa410bcd0 0x7fcaa40f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56322/0 (socket says 10.20.193.28:56322) 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa94fb640 1 -- 10.20.193.28:0/1320473413 learned_addr learned my addr 10.20.193.28:0/1320473413 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcaa410c6c0 0x7fcaa4172790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcaa4111ec0 0x7fcaa40f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa94fb640 1 -- 10.20.193.28:0/1320473413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcaa4111ec0 msgr2=0x7fcaa40f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcaa4111ec0 0x7fcaa40f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa94fb640 1 -- 10.20.193.28:0/1320473413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcaa410c6c0 msgr2=0x7fcaa4172790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcaa410c6c0 0x7fcaa4172790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.503+0000 7fcaa94fb640 1 -- 10.20.193.28:0/1320473413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca94009570 con 0x7fcaa410bcd0 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.504+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcaa410bcd0 0x7fcaa40f5450 secure :-1 s=READY pgs=973 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca940023d0 tx=0x7fca94004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.504+0000 7fca927fc640 1 -- 10.20.193.28:0/1320473413 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca9403d070 con 0x7fcaa410bcd0 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.504+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1320473413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa40fb310 con 0x7fcaa410bcd0 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.504+0000 7fca927fc640 1 -- 10.20.193.28:0/1320473413 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca94002ad0 con 0x7fcaa410bcd0 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.504+0000 7fca927fc640 1 -- 10.20.193.28:0/1320473413 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca940418a0 con 0x7fcaa410bcd0 2026-02-20T13:25:30.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.504+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1320473413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa40fb7d0 con 0x7fcaa410bcd0 2026-02-20T13:25:30.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.507+0000 7fca927fc640 1 -- 10.20.193.28:0/1320473413 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fca9402f9f0 con 0x7fcaa410bcd0 2026-02-20T13:25:30.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.508+0000 7fca927fc640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca800b5750 0x7fca800d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.509+0000 7fca927fc640 1 -- 10.20.193.28:0/1320473413 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fca9410b090 con 0x7fcaa410bcd0 2026-02-20T13:25:30.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.509+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca800b5750 0x7fca800d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.509+0000 7fcaad780e00 1 Processor -- start 2026-02-20T13:25:30.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.509+0000 7fcaad780e00 1 -- start start 2026-02-20T13:25:30.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.509+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca800b5750 0x7fca800d5c00 secure :-1 s=READY pgs=443 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa40fbdf0 tx=0x7fca98005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289406850 0x55a289406c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289407160 0x55a28944b8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a28946c1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaad780e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a28931b780 con 0x55a28944be00 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaad780e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a2893174b0 con 0x55a289407160 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaad780e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a289311610 con 0x55a289406850 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa94fb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289406850 0x55a289406c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa8cfa640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289407160 0x55a28944b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa94fb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289406850 0x55a289406c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54362/0 (socket says 10.20.193.28:54362) 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa94fb640 1 -- 10.20.193.28:0/693835471 learned_addr learned my addr 10.20.193.28:0/693835471 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa8cfa640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289407160 0x55a28944b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50938/0 (socket says 10.20.193.28:50938) 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa94fb640 1 -- 10.20.193.28:0/693835471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289407160 msgr2=0x55a28944b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289407160 0x55a28944b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa94fb640 1 -- 10.20.193.28:0/693835471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 msgr2=0x55a28946c1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:25:30.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a28946c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a28946c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.510+0000 7fcaa94fb640 1 -- 10.20.193.28:0/693835471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2892bcc50 con 0x55a289406850 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a28946c1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289406850 0x55a289406c20 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=11854727683259403454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca94009480 tx=0x7fca94038f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4847404d5aa8cbe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fca71ce5640 1 -- 10.20.193.28:0/693835471 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca94048e80 con 0x55a289406850 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fca71ce5640 1 -- 10.20.193.28:0/693835471 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca940d1df0 con 0x55a289406850 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fca71ce5640 1 -- 10.20.193.28:0/693835471 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca940dc0a0 con 0x55a289406850 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaad780e00 1 -- 10.20.193.28:0/693835471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289406850 msgr2=0x55a289406c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaad780e00 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289406850 0x55a289406c20 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=11854727683259403454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca94009480 tx=0x7fca94038f90 comp rx=0 tx=0).stop 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaad780e00 1 -- 10.20.193.28:0/693835471 shutdown_connections 2026-02-20T13:25:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaad780e00 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a28946c1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaad780e00 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289407160 0x55a28944b8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaad780e00 1 --2- 10.20.193.28:0/693835471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289406850 0x55a289406c20 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=11854727683259403454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaad780e00 1 -- 10.20.193.28:0/693835471 >> 10.20.193.28:0/693835471 conn(0x55a289324110 msgr2=0x55a289405130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.511+0000 7fcaad780e00 1 -- 10.20.193.28:0/693835471 shutdown_connections 2026-02-20T13:25:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.512+0000 7fcaad780e00 1 -- 10.20.193.28:0/693835471 wait complete. 2026-02-20T13:25:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.513+0000 7fcaad780e00 1 -- start start 2026-02-20T13:25:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.513+0000 7fcaad780e00 1 Processor -- start 2026-02-20T13:25:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.513+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a2894631c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.513+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289407160 0x55a289463700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a28944be00 0x55a2894686f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaad780e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a289468c30 con 0x55a289407160 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaad780e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a289468da0 con 0x55a289406850 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaad780e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a289468f60 con 0x55a28944be00 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a2894631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a2894631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50944/0 (socket says 10.20.193.28:50944) 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 -- 10.20.193.28:0/2809630428 learned_addr learned my addr 10.20.193.28:0/2809630428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289407160 0x55a289463700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a28944be00 0x55a2894686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 -- 10.20.193.28:0/2809630428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a28944be00 msgr2=0x55a2894686f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a28944be00 0x55a2894686f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 -- 10.20.193.28:0/2809630428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289407160 msgr2=0x55a289463700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289407160 0x55a289463700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 -- 10.20.193.28:0/2809630428 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a289294e60 con 0x55a289406850 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289407160 0x55a289463700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a2894631c0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=8097185879404933650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca940d1660 tx=0x7fca94038ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=705efba8163d7212 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fca5affd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fca5affd640 1 -- 10.20.193.28:0/2809630428 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca94048e80 con 0x55a289406850 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fca5affd640 1 -- 10.20.193.28:0/2809630428 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca940dc530 con 0x55a289406850 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.514+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa40fb7d0 con 0x55a289406850 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fca5affd640 1 -- 10.20.193.28:0/2809630428 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca940cf650 con 0x55a289406850 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 10 client.28268 _ll_register_callbacks cb 0x55a289292320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:30.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a288fa7eb0 con 0x55a289406850 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fca5affd640 1 -- 10.20.193.28:0/2809630428 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fca940d22b0 con 0x55a289406850 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fca5affd640 1 -- 10.20.193.28:0/2809630428 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca940d2de0 con 0x55a289406850 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 10 client.28268 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a2892a6d80 con 0x55a289406850 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fca5affd640 1 -- 10.20.193.28:0/2809630428 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca940d06e0 con 0x55a289406850 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 10 client.28268 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 10 client.28268 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 20 client.28268 populate_metadata read hostname 'trial028' 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2894486d0 0x55a289448b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 4 client.28268 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2892e3700 con 0x55a2894486d0 2026-02-20T13:25:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.515+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2894486d0 0x55a289448b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.516+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2894486d0 0x55a289448b70 crc :-1 s=READY pgs=242 gs=4 cs=0 l=0 c_cookie=14594814219681579244 s_cookie=4070603571649306515 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca8b3234c6f0c0ec server_cookie=387db061a597df93 in_seq=0 out_seq=0 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.516+0000 7fca5affd640 10 client.28268 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.516+0000 7fca5affd640 1 -- 10.20.193.28:0/2809630428 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a2892e3700 con 0x55a2894486d0 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.516+0000 7fca5affd640 10 client.28268 handle_command_reply: tid=0 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 client.28268 shutdown 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 msgr2=0x55a2894631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a2894631c0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=8097185879404933650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca940d1660 tx=0x7fca94038ef0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 shutdown_connections 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a2894486d0 0x55a289448b70 crc :-1 s=READY pgs=242 gs=4 cs=0 l=0 c_cookie=14594814219681579244 s_cookie=4070603571649306515 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289407160 0x55a289463700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a28944be00 0x55a2894686f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fca5affd640 0 client.28268 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2809630428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a2894631c0 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=8097185879404933650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 >> 10.20.193.28:0/2809630428 conn(0x55a289324110 msgr2=0x55a289404940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 shutdown_connections 2026-02-20T13:25:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 1 -- 10.20.193.28:0/2809630428 wait complete. 2026-02-20T13:25:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.517+0000 7fcaad780e00 20 client.28268 trim_cache size 0 max 16384 2026-02-20T13:25:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.526+0000 7fcaad780e00 1 Processor -- start 2026-02-20T13:25:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.526+0000 7fcaad780e00 1 -- start start 2026-02-20T13:25:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.526+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a28944e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.526+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a28944e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a289446730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaad780e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a28930f240 con 0x55a28944be00 2026-02-20T13:25:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaad780e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a288fcfec0 con 0x55a289406850 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaad780e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a289463ce0 con 0x55a289407160 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a28944e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a28944e940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54380/0 (socket says 10.20.193.28:54380) 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 -- 10.20.193.28:0/996065789 learned_addr learned my addr 10.20.193.28:0/996065789 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a28944e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a289446730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 -- 10.20.193.28:0/996065789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 msgr2=0x55a28944e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a28944e400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 -- 10.20.193.28:0/996065789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 msgr2=0x55a289446730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a289446730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 -- 10.20.193.28:0/996065789 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2892a1800 con 0x55a289407160 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a289446730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.527+0000 7fcaa8cfa640 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a28944e940 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=16804759358126698553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca98004740 tx=0x7fca98013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9367f99cd103039 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fca714e4640 1 -- 10.20.193.28:0/996065789 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca98022030 con 0x55a289407160 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fca714e4640 1 -- 10.20.193.28:0/996065789 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca98023040 con 0x55a289407160 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fca714e4640 1 -- 10.20.193.28:0/996065789 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca98011b30 con 0x55a289407160 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 -- 10.20.193.28:0/996065789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 msgr2=0x55a28944e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a28944e940 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=16804759358126698553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca98004740 tx=0x7fca98013000 comp rx=0 tx=0).stop 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 -- 10.20.193.28:0/996065789 shutdown_connections 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a28944be00 0x55a289446730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a28944e940 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=16804759358126698553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 --2- 10.20.193.28:0/996065789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a289406850 0x55a28944e400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 -- 10.20.193.28:0/996065789 >> 10.20.193.28:0/996065789 conn(0x55a289324110 msgr2=0x55a289467550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 -- 10.20.193.28:0/996065789 shutdown_connections 2026-02-20T13:25:30.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 -- 10.20.193.28:0/996065789 wait complete. 2026-02-20T13:25:30.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.528+0000 7fcaad780e00 1 -- start start 2026-02-20T13:25:30.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaad780e00 1 Processor -- start 2026-02-20T13:25:30.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289406850 0x55a2893e60f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a2893e6630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaad780e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a28944be00 0x55a2894ba180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaad780e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a28931b780 con 0x55a289406850 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaad780e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a2893e6e50 con 0x55a28944be00 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaad780e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a2894ba6c0 con 0x55a289407160 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaa94fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289406850 0x55a2893e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaa9cfc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a28944be00 0x55a2894ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaa8cfa640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a2893e6630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaa8cfa640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a2893e6630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54392/0 (socket says 10.20.193.28:54392) 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.529+0000 7fcaa8cfa640 1 -- 10.20.193.28:0/2390442303 learned_addr learned my addr 10.20.193.28:0/2390442303 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaa9cfc640 1 -- 10.20.193.28:0/2390442303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 msgr2=0x55a2893e6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a2893e6630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaa9cfc640 1 -- 10.20.193.28:0/2390442303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289406850 msgr2=0x55a2893e60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289406850 0x55a2893e60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaa9cfc640 1 -- 10.20.193.28:0/2390442303 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca98009970 con 0x55a28944be00 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289406850 0x55a2893e60f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaa9cfc640 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a28944be00 0x55a2894ba180 secure :-1 s=READY pgs=352 gs=3 cs=0 l=1 c_cookie=14351162073879962264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa0005820 tx=0x7fcaa000ab80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72991ded7ac6298 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fca5affd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fca5affd640 1 -- 10.20.193.28:0/2390442303 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa0005b50 con 0x55a28944be00 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fca5affd640 1 -- 10.20.193.28:0/2390442303 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcaa001a040 con 0x55a28944be00 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa0005410 con 0x55a28944be00 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fca5affd640 1 -- 10.20.193.28:0/2390442303 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcaa0006820 con 0x55a28944be00 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaad780e00 10 client.28274 _ll_register_callbacks cb 0x55a289292320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca940d1df0 con 0x55a28944be00 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.530+0000 7fca5affd640 1 -- 10.20.193.28:0/2390442303 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcaa0011430 con 0x55a28944be00 2026-02-20T13:25:30.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fca5affd640 1 -- 10.20.193.28:0/2390442303 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcaa0011630 con 0x55a28944be00 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaad780e00 10 client.28274 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a289295190 con 0x55a28944be00 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fca5affd640 1 -- 10.20.193.28:0/2390442303 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcaa0014b20 con 0x55a28944be00 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaad780e00 10 client.28274 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaad780e00 10 client.28274 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaad780e00 20 client.28274 populate_metadata read hostname 'trial028' 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a289502710 0x55a289522bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaad780e00 4 client.28274 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.8, "await_for": 45.0}] 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.8, "await_for": 45.0}) -- 0x55a288ff0a60 con 0x55a289502710 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.531+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a289502710 0x55a289522bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.532+0000 7fca5affd640 10 client.28274 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:30.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.532+0000 7fcaa94fb640 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a289502710 0x55a289522bc0 crc :-1 s=READY pgs=243 gs=4 cs=0 l=0 c_cookie=1098027311163336543 s_cookie=8539207716605881807 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cfa059b91675f server_cookie=76815c2cf3916dcf in_seq=0 out_seq=0 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fca5affd640 1 -- 10.20.193.28:0/2390442303 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a288ff0a60 con 0x55a289502710 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fca5affd640 10 client.28274 handle_command_reply: tid=0 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 client.28274 shutdown 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a28944be00 msgr2=0x55a2894ba180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a28944be00 0x55a2894ba180 secure :-1 s=READY pgs=352 gs=3 cs=0 l=1 c_cookie=14351162073879962264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa0005820 tx=0x7fcaa000ab80 comp rx=0 tx=0).stop 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 shutdown_connections 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a289502710 0x55a289522bc0 crc :-1 s=READY pgs=243 gs=4 cs=0 l=0 c_cookie=1098027311163336543 s_cookie=8539207716605881807 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a28944be00 0x55a2894ba180 unknown :-1 s=CLOSED pgs=352 gs=3 cs=0 l=1 c_cookie=14351162073879962264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a289407160 0x55a2893e6630 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 --2- 10.20.193.28:0/2390442303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a289406850 0x55a2893e60f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fca5affd640 0 client.28274 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 >> 10.20.193.28:0/2390442303 conn(0x55a289324110 msgr2=0x55a28944d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 shutdown_connections 2026-02-20T13:25:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 1 -- 10.20.193.28:0/2390442303 wait complete. 2026-02-20T13:25:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.537+0000 7fcaad780e00 20 client.28274 trim_cache size 0 max 16384 2026-02-20T13:25:30.542 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:25:30.542 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 26, 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "adfb1b52": { 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "version": 26, 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:30.543 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 139.8, 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:30.544 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:30.545 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:25:30.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca800b5750 msgr2=0x7fca800d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca800b5750 0x7fca800d5c00 secure :-1 s=READY pgs=443 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa40fbdf0 tx=0x7fca98005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:30.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcaa410bcd0 msgr2=0x7fcaa40f5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcaa410bcd0 0x7fcaa40f5450 secure :-1 s=READY pgs=973 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca940023d0 tx=0x7fca94004290 comp rx=0 tx=0).stop 2026-02-20T13:25:30.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1320473413 shutdown_connections 2026-02-20T13:25:30.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca800b5750 0x7fca800d5c00 unknown :-1 s=CLOSED pgs=443 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcaa4111ec0 0x7fcaa40f5b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcaa410c6c0 0x7fcaa4172790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 --2- 10.20.193.28:0/1320473413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcaa410bcd0 0x7fcaa40f5450 unknown :-1 s=CLOSED pgs=973 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1320473413 >> 10.20.193.28:0/1320473413 conn(0x7fcaa40e95a0 msgr2=0x7fcaa410f520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1320473413 shutdown_connections 2026-02-20T13:25:30.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.538+0000 7fcaaa4fd640 1 -- 10.20.193.28:0/1320473413 wait complete. 2026-02-20T13:25:30.607 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:30.642 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'adfb1b52', quiesce took 1.2 seconds. Will release after: 18.6 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.781+0000 7fb11932a640 1 -- 10.20.193.28:0/4237580665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114062ae0 msgr2=0x7fb114060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.781+0000 7fb11932a640 1 --2- 10.20.193.28:0/4237580665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114062ae0 0x7fb114060fb0 secure :-1 s=READY pgs=974 gs=1 cs=0 l=1 c_cookie=5918184476571575130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb108009890 tx=0x7fb10802f120 comp rx=0 tx=0).stop 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.782+0000 7fb11932a640 1 -- 10.20.193.28:0/4237580665 shutdown_connections 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.782+0000 7fb11932a640 1 --2- 10.20.193.28:0/4237580665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb114159af0 0x7fb114179ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.782+0000 7fb11932a640 1 --2- 10.20.193.28:0/4237580665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1140614f0 0x7fb114061920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.782+0000 7fb11932a640 1 --2- 10.20.193.28:0/4237580665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114062ae0 0x7fb114060fb0 unknown :-1 s=CLOSED pgs=974 gs=1 cs=0 l=1 c_cookie=5918184476571575130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.782+0000 7fb11932a640 1 -- 10.20.193.28:0/4237580665 >> 10.20.193.28:0/4237580665 conn(0x7fb11405f830 msgr2=0x7fb11410ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.782+0000 7fb11932a640 1 -- 10.20.193.28:0/4237580665 shutdown_connections 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.782+0000 7fb11932a640 1 -- 10.20.193.28:0/4237580665 wait complete. 2026-02-20T13:25:30.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.782+0000 7fb11932a640 1 Processor -- start 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb11932a640 1 -- start start 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb11932a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1140614f0 0x7fb1140f2c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb11932a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb114062ae0 0x7fb1140f31a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb11932a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114159af0 0x7fb1140f8570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb11932a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb1140f8b90 con 0x7fb114159af0 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb11932a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb1140f8d00 con 0x7fb1140614f0 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb11932a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb1140f8ec0 con 0x7fb114062ae0 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb112ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1140614f0 0x7fb1140f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114159af0 0x7fb1140f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114159af0 0x7fb1140f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56372/0 (socket says 10.20.193.28:56372) 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 -- 10.20.193.28:0/1417179408 learned_addr learned my addr 10.20.193.28:0/1417179408 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1127fc640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb114062ae0 0x7fb1140f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 -- 10.20.193.28:0/1417179408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb114062ae0 msgr2=0x7fb1140f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb114062ae0 0x7fb1140f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 -- 10.20.193.28:0/1417179408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1140614f0 msgr2=0x7fb1140f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1140614f0 0x7fb1140f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 -- 10.20.193.28:0/1417179408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1080094b0 con 0x7fb114159af0 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.783+0000 7fb1137fe640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114159af0 0x7fb1140f8570 secure :-1 s=READY pgs=975 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb10400e650 tx=0x7fb10400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.784+0000 7fb0f3fff640 1 -- 10.20.193.28:0/1417179408 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb10400aa20 con 0x7fb114159af0 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.784+0000 7fb0f3fff640 1 -- 10.20.193.28:0/1417179408 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb10400ab80 con 0x7fb114159af0 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.784+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1140f91a0 con 0x7fb114159af0 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.784+0000 7fb0f3fff640 1 -- 10.20.193.28:0/1417179408 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1040106d0 con 0x7fb114159af0 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.784+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1140f9880 con 0x7fb114159af0 2026-02-20T13:25:30.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.784+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1140624c0 con 0x7fb114159af0 2026-02-20T13:25:30.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.787+0000 7fb0f3fff640 1 -- 10.20.193.28:0/1417179408 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb104011460 con 0x7fb114159af0 2026-02-20T13:25:30.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.788+0000 7fb0f3fff640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb0e80b56e0 0x7fb0e80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:30.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.788+0000 7fb0f3fff640 1 -- 10.20.193.28:0/1417179408 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb1040e7fe0 con 0x7fb114159af0 2026-02-20T13:25:30.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.788+0000 7fb0f3fff640 1 -- 10.20.193.28:0/1417179408 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fb1040e8490 con 0x7fb114159af0 2026-02-20T13:25:30.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.789+0000 7fb112ffd640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb0e80b56e0 0x7fb0e80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:30.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.789+0000 7fb112ffd640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb0e80b56e0 0x7fb0e80d5b90 secure :-1 s=READY pgs=444 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1080097e0 tx=0x7fb10803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:30 trial028 ceph-mon[37442]: pgmap v426: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:30 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2098962102' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:30.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.929+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1140f3dc0 con 0x7fb114159af0 2026-02-20T13:25:30.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.929+0000 7fb0f3fff640 1 -- 10.20.193.28:0/1417179408 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fb1040aa9b0 con 0x7fb114159af0 2026-02-20T13:25:30.932 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:25:30.933 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:25:30.933 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.930+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb0e80b56e0 msgr2=0x7fb0e80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.930+0000 7fb11932a640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb0e80b56e0 0x7fb0e80d5b90 secure :-1 s=READY pgs=444 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1080097e0 tx=0x7fb10803a040 comp rx=0 tx=0).stop 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.930+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114159af0 msgr2=0x7fb1140f8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.930+0000 7fb11932a640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114159af0 0x7fb1140f8570 secure :-1 s=READY pgs=975 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb10400e650 tx=0x7fb10400eb20 comp rx=0 tx=0).stop 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.931+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 shutdown_connections 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.931+0000 7fb11932a640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb0e80b56e0 0x7fb0e80d5b90 unknown :-1 s=CLOSED pgs=444 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.931+0000 7fb11932a640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb114159af0 0x7fb1140f8570 unknown :-1 s=CLOSED pgs=975 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.931+0000 7fb11932a640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb114062ae0 0x7fb1140f31a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.931+0000 7fb11932a640 1 --2- 10.20.193.28:0/1417179408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb1140614f0 0x7fb1140f2c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.931+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 >> 10.20.193.28:0/1417179408 conn(0x7fb11405f830 msgr2=0x7fb11410e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.931+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 shutdown_connections 2026-02-20T13:25:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:30.931+0000 7fb11932a640 1 -- 10.20.193.28:0/1417179408 wait complete. 2026-02-20T13:25:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:30 trial127 ceph-mon[43817]: pgmap v426: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:30.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:30 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2098962102' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:30 trial034 ceph-mon[43332]: pgmap v426: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:25:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:30 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2098962102' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:31.036 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:25:31.219 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:31.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 -- 10.20.193.28:0/244483903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10c040 msgr2=0x7feb4c10f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 --2- 10.20.193.28:0/244483903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10c040 0x7feb4c10f990 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=6835102077172509899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c009950 tx=0x7feb3c02f190 comp rx=0 tx=0).stop 2026-02-20T13:25:31.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 -- 10.20.193.28:0/244483903 shutdown_connections 2026-02-20T13:25:31.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 --2- 10.20.193.28:0/244483903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb4c110140 0x7feb4c173d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 --2- 10.20.193.28:0/244483903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10c040 0x7feb4c10f990 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=6835102077172509899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 --2- 10.20.193.28:0/244483903 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb4c10b650 0x7feb4c10ba20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 -- 10.20.193.28:0/244483903 >> 10.20.193.28:0/244483903 conn(0x7feb4c0e9080 msgr2=0x7feb4c109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 -- 10.20.193.28:0/244483903 shutdown_connections 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.401+0000 7feb50dfd640 1 -- 10.20.193.28:0/244483903 wait complete. 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb50dfd640 1 Processor -- start 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb50dfd640 1 -- start start 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb50dfd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10b650 0x7feb4c0f3da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb50dfd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb4c10c040 0x7feb4c173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb50dfd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb4c110140 0x7feb4c0f44a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb50dfd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c0f96b0 con 0x7feb4c10c040 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb50dfd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c0f9820 con 0x7feb4c10b650 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb50dfd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c0f99e0 con 0x7feb4c110140 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb4b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10b650 0x7feb4c0f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb4b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10b650 0x7feb4c0f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51012/0 (socket says 10.20.193.28:51012) 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb4b7fe640 1 -- 10.20.193.28:0/4142965328 learned_addr learned my addr 10.20.193.28:0/4142965328 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb4affd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb4c10c040 0x7feb4c173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.402+0000 7feb4bfff640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb4c110140 0x7feb4c0f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb4b7fe640 1 -- 10.20.193.28:0/4142965328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb4c110140 msgr2=0x7feb4c0f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb4c110140 0x7feb4c0f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb4b7fe640 1 -- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb4c10c040 msgr2=0x7feb4c173c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb4c10c040 0x7feb4c173c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb4b7fe640 1 -- 10.20.193.28:0/4142965328 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c009570 con 0x7feb4c10b650 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb4affd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb4c10c040 0x7feb4c173c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10b650 0x7feb4c0f3da0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb38005db0 tx=0x7feb3800ddf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb48ff9640 1 -- 10.20.193.28:0/4142965328 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb38004500 con 0x7feb4c10b650 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb48ff9640 1 -- 10.20.193.28:0/4142965328 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb38004d30 con 0x7feb4c10b650 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb48ff9640 1 -- 10.20.193.28:0/4142965328 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb380053c0 con 0x7feb4c10b650 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb50dfd640 1 -- 10.20.193.28:0/4142965328 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c0f9cc0 con 0x7feb4c10b650 2026-02-20T13:25:31.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.403+0000 7feb50dfd640 1 -- 10.20.193.28:0/4142965328 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c0fa140 con 0x7feb4c10b650 2026-02-20T13:25:31.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.406+0000 7feb48ff9640 1 -- 10.20.193.28:0/4142965328 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7feb38009940 con 0x7feb4c10b650 2026-02-20T13:25:31.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.407+0000 7feb48ff9640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb200b5750 0x7feb200d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.408+0000 7feb48ff9640 1 -- 10.20.193.28:0/4142965328 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feb380e6b80 con 0x7feb4c10b650 2026-02-20T13:25:31.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.408+0000 7feb4affd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb200b5750 0x7feb200d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.408+0000 7feb4affd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb200b5750 0x7feb200d5c00 secure :-1 s=READY pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb4c0fa740 tx=0x7feb3c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.408+0000 7feb54080e00 1 Processor -- start 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb54080e00 1 -- start start 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb54080e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b3769c6730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb54080e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a0b5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb54080e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 0x55b376a2bf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb54080e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3768dc780 con 0x55b3769c6c70 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb54080e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3768d84b0 con 0x55b3769c6360 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb54080e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3768d2450 con 0x55b376a0bb20 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb4b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b3769c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb4b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b3769c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51022/0 (socket says 10.20.193.28:51022) 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb4b7fe640 1 -- 10.20.193.28:0/176095407 learned_addr learned my addr 10.20.193.28:0/176095407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb4bfff640 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 0x55b376a2bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb4b7fe640 1 -- 10.20.193.28:0/176095407 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 msgr2=0x55b376a2bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 0x55b376a2bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.409+0000 7feb4b7fe640 1 -- 10.20.193.28:0/176095407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 msgr2=0x55b376a0b5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb4affd640 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a0b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a0b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb4b7fe640 1 -- 10.20.193.28:0/176095407 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37687dd10 con 0x55b3769c6360 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb4affd640 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a0b5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b3769c6730 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=14502988719521027602 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb380a94b0 tx=0x7feb380a8d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c944f766788c5612 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb0ffff640 1 -- 10.20.193.28:0/176095407 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb380ad8e0 con 0x55b3769c6360 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb0ffff640 1 -- 10.20.193.28:0/176095407 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb380b2c00 con 0x55b3769c6360 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb0ffff640 1 -- 10.20.193.28:0/176095407 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb380b7e10 con 0x55b3769c6360 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 -- 10.20.193.28:0/176095407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 msgr2=0x55b3769c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b3769c6730 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=14502988719521027602 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb380a94b0 tx=0x7feb380a8d80 comp rx=0 tx=0).stop 2026-02-20T13:25:31.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 -- 10.20.193.28:0/176095407 shutdown_connections 2026-02-20T13:25:31.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a0b5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 0x55b376a2bf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 --2- 10.20.193.28:0/176095407 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b3769c6730 unknown :-1 s=CLOSED pgs=355 gs=1 cs=0 l=1 c_cookie=14502988719521027602 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 -- 10.20.193.28:0/176095407 >> 10.20.193.28:0/176095407 conn(0x55b3769a4860 msgr2=0x55b3769c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 -- 10.20.193.28:0/176095407 shutdown_connections 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.410+0000 7feb54080e00 1 -- 10.20.193.28:0/176095407 wait complete. 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb54080e00 1 -- start start 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb54080e00 1 Processor -- start 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb54080e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b376a23640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb54080e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a23b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb54080e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 0x55b376a28b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb54080e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b376a290b0 con 0x55b3769c6c70 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb54080e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b376a29220 con 0x55b3769c6360 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb54080e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b376a293e0 con 0x55b376a0bb20 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb4affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb4b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b376a23640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb4bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 0x55b376a28b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb4b7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b376a23640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51034/0 (socket says 10.20.193.28:51034) 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.412+0000 7feb4b7fe640 1 -- 10.20.193.28:0/1023242770 learned_addr learned my addr 10.20.193.28:0/1023242770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb4affd640 1 -- 10.20.193.28:0/1023242770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 msgr2=0x55b376a28b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb4affd640 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 0x55b376a28b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb4affd640 1 -- 10.20.193.28:0/1023242770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 msgr2=0x55b376a23640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb4affd640 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b376a23640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb4affd640 1 -- 10.20.193.28:0/1023242770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3768563c0 con 0x55b3769c6c70 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb4affd640 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a23b80 secure :-1 s=READY pgs=976 gs=1 cs=0 l=1 c_cookie=18042700986035039618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c004820 tx=0x7feb3c02f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa648cf3d5356d82 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb0d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:31.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb0d7fa640 1 -- 10.20.193.28:0/1023242770 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3c04f630 con 0x55b3769c6c70 2026-02-20T13:25:31.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c0fa140 con 0x55b3769c6c70 2026-02-20T13:25:31.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb54080e00 10 client.18327 _ll_register_callbacks cb 0x55b376853a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:31.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3765686f0 con 0x55b3769c6c70 2026-02-20T13:25:31.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb0d7fa640 1 -- 10.20.193.28:0/1023242770 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb3c04a050 con 0x55b3769c6c70 2026-02-20T13:25:31.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.413+0000 7feb0d7fa640 1 -- 10.20.193.28:0/1023242770 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3c044720 con 0x55b3769c6c70 2026-02-20T13:25:31.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb0d7fa640 1 -- 10.20.193.28:0/1023242770 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feb3c0448b0 con 0x55b3769c6c70 2026-02-20T13:25:31.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb0d7fa640 1 -- 10.20.193.28:0/1023242770 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feb3c044a70 con 0x55b3769c6c70 2026-02-20T13:25:31.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb54080e00 10 client.18327 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:31.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b3768680e0 con 0x55b3769c6c70 2026-02-20T13:25:31.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb0d7fa640 1 -- 10.20.193.28:0/1023242770 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feb3c044bd0 con 0x55b3769c6c70 2026-02-20T13:25:31.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb54080e00 10 client.18327 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:31.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb54080e00 10 client.18327 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:25:31.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb54080e00 20 client.18327 populate_metadata read hostname 'trial028' 2026-02-20T13:25:31.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb54080e00 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55b376a2bba0 0x55b376a098a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb54080e00 4 client.18327 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:31.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b376874f80 con 0x55b376a2bba0 2026-02-20T13:25:31.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.414+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55b376a2bba0 0x55b376a098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.415+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55b376a2bba0 0x55b376a098a0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=8298362079016445903 s_cookie=12174379631724795413 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7329b4582158e7cf server_cookie=a8f415c5bdb51615 in_seq=0 out_seq=0 2026-02-20T13:25:31.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.415+0000 7feb0d7fa640 10 client.18327 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:25:31.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.415+0000 7feb0d7fa640 1 -- 10.20.193.28:0/1023242770 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b376874f80 con 0x55b376a2bba0 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.415+0000 7feb0d7fa640 10 client.18327 handle_command_reply: tid=0 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.415+0000 7feb54080e00 1 client.18327 shutdown 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 msgr2=0x55b376a23b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a23b80 secure :-1 s=READY pgs=976 gs=1 cs=0 l=1 c_cookie=18042700986035039618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c004820 tx=0x7feb3c02f190 comp rx=0 tx=0).stop 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 shutdown_connections 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55b376a2bba0 0x55b376a098a0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=8298362079016445903 s_cookie=12174379631724795413 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b376a23b80 unknown :-1 s=CLOSED pgs=976 gs=1 cs=0 l=1 c_cookie=18042700986035039618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b376a0bb20 0x55b376a28b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 --2- 10.20.193.28:0/1023242770 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6360 0x55b376a23640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb0d7fa640 0 client.18327 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:25:31.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 >> 10.20.193.28:0/1023242770 conn(0x55b3769a4860 msgr2=0x55b3769c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 shutdown_connections 2026-02-20T13:25:31.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 1 -- 10.20.193.28:0/1023242770 wait complete. 2026-02-20T13:25:31.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.416+0000 7feb54080e00 20 client.18327 trim_cache size 0 max 16384 2026-02-20T13:25:31.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb54080e00 1 Processor -- start 2026-02-20T13:25:31.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb54080e00 1 -- start start 2026-02-20T13:25:31.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb54080e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b376a207f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb54080e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6c70 0x55b376a20d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb54080e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b376a0bb20 0x55b376a0a8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb54080e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3768d0080 con 0x55b376a0bb20 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb54080e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b376590700 con 0x55b3769c6c70 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb54080e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b376a29520 con 0x55b3769c6360 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b376a207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6c70 0x55b376a20d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b376a207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54458/0 (socket says 10.20.193.28:54458) 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4b7fe640 1 -- 10.20.193.28:0/3389313838 learned_addr learned my addr 10.20.193.28:0/3389313838 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4bfff640 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b376a0bb20 0x55b376a0a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4affd640 1 -- 10.20.193.28:0/3389313838 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 msgr2=0x55b376a207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4affd640 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b376a207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4affd640 1 -- 10.20.193.28:0/3389313838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b376a0bb20 msgr2=0x55b376a0a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4affd640 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b376a0bb20 0x55b376a0a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4affd640 1 -- 10.20.193.28:0/3389313838 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b376862b60 con 0x55b3769c6c70 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.424+0000 7feb4bfff640 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b376a0bb20 0x55b376a0a8b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb4affd640 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6c70 0x55b376a20d30 secure :-1 s=READY pgs=356 gs=2 cs=0 l=1 c_cookie=5568421052000032044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c038ec0 tx=0x7feb3c059000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d470171ac44d52c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb0f7fe640 1 -- 10.20.193.28:0/3389313838 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3c002ea0 con 0x55b3769c6c70 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb0f7fe640 1 -- 10.20.193.28:0/3389313838 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb3c04a070 con 0x55b3769c6c70 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb0f7fe640 1 -- 10.20.193.28:0/3389313838 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3c044530 con 0x55b3769c6c70 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb54080e00 1 -- 10.20.193.28:0/3389313838 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6c70 msgr2=0x55b376a20d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb54080e00 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6c70 0x55b376a20d30 secure :-1 s=READY pgs=356 gs=2 cs=0 l=1 c_cookie=5568421052000032044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c038ec0 tx=0x7feb3c059000 comp rx=0 tx=0).stop 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb54080e00 1 -- 10.20.193.28:0/3389313838 shutdown_connections 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb54080e00 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b376a0bb20 0x55b376a0a8b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb54080e00 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3769c6c70 0x55b376a20d30 unknown :-1 s=CLOSED pgs=356 gs=2 cs=0 l=1 c_cookie=5568421052000032044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb54080e00 1 --2- 10.20.193.28:0/3389313838 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b376a207f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.425+0000 7feb54080e00 1 -- 10.20.193.28:0/3389313838 >> 10.20.193.28:0/3389313838 conn(0x55b3769a4860 msgr2=0x55b376a0df00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 -- 10.20.193.28:0/3389313838 shutdown_connections 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 -- 10.20.193.28:0/3389313838 wait complete. 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 -- start start 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 Processor -- start 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b3769aa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b3769a5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b376a0bb20 0x55b3769a5fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b376934ae0 con 0x55b3769c6c70 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b376a1c4d0 con 0x55b376a0bb20 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.426+0000 7feb54080e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3769a6520 con 0x55b3769c6360 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b3769a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b3769a5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56418/0 (socket says 10.20.193.28:56418) 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 -- 10.20.193.28:0/580714183 learned_addr learned my addr 10.20.193.28:0/580714183 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4bfff640 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b376a0bb20 0x55b3769a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b3769aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 -- 10.20.193.28:0/580714183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 msgr2=0x55b3769aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b3769aa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 -- 10.20.193.28:0/580714183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b376a0bb20 msgr2=0x55b3769a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b376a0bb20 0x55b3769a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 -- 10.20.193.28:0/580714183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3768566f0 con 0x55b3769c6c70 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb4affd640 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b3769a5a70 secure :-1 s=READY pgs=977 gs=1 cs=0 l=1 c_cookie=10544660599057305407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c002e00 tx=0x7feb3c02ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925628f263de4f3f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb0d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb0d7fa640 1 -- 10.20.193.28:0/580714183 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3c057360 con 0x55b3769c6c70 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb0d7fa640 1 -- 10.20.193.28:0/580714183 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55b3765686f0 con 0x55b3769c6c70 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb0d7fa640 1 -- 10.20.193.28:0/580714183 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3c058c60 con 0x55b3769c6c70 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.427+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3768680e0 con 0x55b3769c6c70 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb0d7fa640 1 -- 10.20.193.28:0/580714183 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feb3c058df0 con 0x55b3769c6c70 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb0d7fa640 10 client.18333 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 10 client.18333 _ll_register_callbacks cb 0x55b376853a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb380b2c00 con 0x55b3769c6c70 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb0d7fa640 1 -- 10.20.193.28:0/580714183 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feb3c0583c0 con 0x55b3769c6c70 2026-02-20T13:25:31.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 10 client.18333 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b376868340 con 0x55b3769c6c70 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb0d7fa640 1 -- 10.20.193.28:0/580714183 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feb3c057bd0 con 0x55b3769c6c70 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 10 client.18333 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 10 client.18333 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 20 client.18333 populate_metadata read hostname 'trial028' 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55b376a72850 0x55b376ad9080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 4 client.18333 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.428+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b376565f40 con 0x55b376a72850 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55b376a72850 0x55b376ad9080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb0d7fa640 10 client.18333 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb4b7fe640 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55b376a72850 0x55b376ad9080 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=3686515210657560622 s_cookie=1376665587299680918 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3329220d5651782e server_cookie=131ae60ec9808296 in_seq=0 out_seq=0 2026-02-20T13:25:31.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb0d7fa640 1 -- 10.20.193.28:0/580714183 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b376565f40 con 0x55b376a72850 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb0d7fa640 10 client.18333 handle_command_reply: tid=0 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 client.18333 shutdown 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 msgr2=0x55b3769a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b3769a5a70 secure :-1 s=READY pgs=977 gs=1 cs=0 l=1 c_cookie=10544660599057305407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c002e00 tx=0x7feb3c02ffd0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 shutdown_connections 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55b376a72850 0x55b376ad9080 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=3686515210657560622 s_cookie=1376665587299680918 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3769c6c70 0x55b3769a5a70 unknown :-1 s=CLOSED pgs=977 gs=1 cs=0 l=1 c_cookie=10544660599057305407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b376a0bb20 0x55b3769a5fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 --2- 10.20.193.28:0/580714183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3769c6360 0x55b3769aa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 >> 10.20.193.28:0/580714183 conn(0x55b3769a4860 msgr2=0x55b376a1f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb0d7fa640 0 client.18333 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:25:31.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.429+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 shutdown_connections 2026-02-20T13:25:31.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb54080e00 1 -- 10.20.193.28:0/580714183 wait complete. 2026-02-20T13:25:31.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb54080e00 20 client.18333 trim_cache size 0 max 16384 2026-02-20T13:25:31.442 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:25:31.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 -- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb200b5750 msgr2=0x7feb200d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb200b5750 0x7feb200d5c00 secure :-1 s=READY pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb4c0fa740 tx=0x7feb3c03a040 comp rx=0 tx=0).stop 2026-02-20T13:25:31.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 -- 10.20.193.28:0/4142965328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10b650 msgr2=0x7feb4c0f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10b650 0x7feb4c0f3da0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb38005db0 tx=0x7feb3800ddf0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 -- 10.20.193.28:0/4142965328 shutdown_connections 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feb200b5750 0x7feb200d5c00 unknown :-1 s=CLOSED pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feb4c10c040 0x7feb4c173c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feb4c110140 0x7feb4c0f44a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 --2- 10.20.193.28:0/4142965328 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feb4c10b650 0x7feb4c0f3da0 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 -- 10.20.193.28:0/4142965328 >> 10.20.193.28:0/4142965328 conn(0x7feb4c0e9080 msgr2=0x7feb4c109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 -- 10.20.193.28:0/4142965328 shutdown_connections 2026-02-20T13:25:31.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.430+0000 7feb50dfd640 1 -- 10.20.193.28:0/4142965328 wait complete. 2026-02-20T13:25:31.533 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:25:31.719 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:31.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:31 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1417179408' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 -- 10.20.193.28:0/1297800991 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7db8113430 msgr2=0x7f7db8173e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 --2- 10.20.193.28:0/1297800991 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7db8113430 0x7f7db8173e00 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=9315962586199410826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dac00aa30 tx=0x7f7dac030270 comp rx=0 tx=0).stop 2026-02-20T13:25:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 -- 10.20.193.28:0/1297800991 shutdown_connections 2026-02-20T13:25:31.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 --2- 10.20.193.28:0/1297800991 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7db8113430 0x7f7db8173e00 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=9315962586199410826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 --2- 10.20.193.28:0/1297800991 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7db810dc30 0x7f7db8112c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 --2- 10.20.193.28:0/1297800991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7db810d240 0x7f7db810d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 -- 10.20.193.28:0/1297800991 >> 10.20.193.28:0/1297800991 conn(0x7f7db80eaad0 msgr2=0x7f7db810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 -- 10.20.193.28:0/1297800991 shutdown_connections 2026-02-20T13:25:31.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 -- 10.20.193.28:0/1297800991 wait complete. 2026-02-20T13:25:31.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.894+0000 7f7dbd702640 1 Processor -- start 2026-02-20T13:25:31.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7dbd702640 1 -- start start 2026-02-20T13:25:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7dbd702640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7db810d240 0x7f7db80f5690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7dbd702640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7db810dc30 0x7f7db8173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7dbd702640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7db8113430 0x7f7db80f5d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7dbd702640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7db80fafa0 con 0x7f7db810d240 2026-02-20T13:25:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7dbd702640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7db80fb110 con 0x7f7db810dc30 2026-02-20T13:25:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7dbd702640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7db80fb2d0 con 0x7f7db8113430 2026-02-20T13:25:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7db810d240 0x7f7db80f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7db810d240 0x7f7db80f5690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56438/0 (socket says 10.20.193.28:56438) 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 -- 10.20.193.28:0/941409101 learned_addr learned my addr 10.20.193.28:0/941409101 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7dbcf01640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7db8113430 0x7f7db80f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db77fe640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7db810dc30 0x7f7db8173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 -- 10.20.193.28:0/941409101 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7db8113430 msgr2=0x7f7db80f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7db8113430 0x7f7db80f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 -- 10.20.193.28:0/941409101 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7db810dc30 msgr2=0x7f7db8173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7db810dc30 0x7f7db8173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 -- 10.20.193.28:0/941409101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac00a650 con 0x7f7db810d240 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db77fe640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7db810dc30 0x7f7db8173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.895+0000 7f7db7fff640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7db810d240 0x7f7db80f5690 secure :-1 s=READY pgs=978 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da4009480 tx=0x7f7da400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.896+0000 7f7db57fa640 1 -- 10.20.193.28:0/941409101 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da400ccc0 con 0x7f7db810d240 2026-02-20T13:25:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.896+0000 7f7dbd702640 1 -- 10.20.193.28:0/941409101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db80fb5b0 con 0x7f7db810d240 2026-02-20T13:25:31.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.896+0000 7f7dbd702640 1 -- 10.20.193.28:0/941409101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db80fbad0 con 0x7f7db810d240 2026-02-20T13:25:31.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.896+0000 7f7db57fa640 1 -- 10.20.193.28:0/941409101 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7da400ce20 con 0x7f7db810d240 2026-02-20T13:25:31.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.896+0000 7f7db57fa640 1 -- 10.20.193.28:0/941409101 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da40106b0 con 0x7f7db810d240 2026-02-20T13:25:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.898+0000 7f7db57fa640 1 -- 10.20.193.28:0/941409101 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7da401f060 con 0x7f7db810d240 2026-02-20T13:25:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.900+0000 7f7db57fa640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7d8c0b5750 0x7f7d8c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.900+0000 7f7db57fa640 1 -- 10.20.193.28:0/941409101 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7da4014070 con 0x7f7db810d240 2026-02-20T13:25:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.900+0000 7f7db77fe640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7d8c0b5750 0x7f7d8c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.900+0000 7f7db77fe640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7d8c0b5750 0x7f7d8c0d5c00 secure :-1 s=READY pgs=446 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da8005970 tx=0x7f7da8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dc0985e00 1 Processor -- start 2026-02-20T13:25:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dc0985e00 1 -- start start 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79e730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7e35e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 0x55f1de803f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f1de6b4780 con 0x55f1de79e360 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f1de6b04b0 con 0x55f1de7e3b20 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f1de6aa450 con 0x55f1de79ec70 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79e730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79e730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56450/0 (socket says 10.20.193.28:56450) 2026-02-20T13:25:31.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 -- 10.20.193.28:0/964458905 learned_addr learned my addr 10.20.193.28:0/964458905 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7dbcf01640 1 --2- 10.20.193.28:0/964458905 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 0x55f1de803f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 -- 10.20.193.28:0/964458905 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 msgr2=0x55f1de7e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 --2- 10.20.193.28:0/964458905 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7e35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 -- 10.20.193.28:0/964458905 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 msgr2=0x55f1de803f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 --2- 10.20.193.28:0/964458905 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 0x55f1de803f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 -- 10.20.193.28:0/964458905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de655d10 con 0x55f1de79e360 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.902+0000 7f7db7fff640 1 --2- 10.20.193.28:0/964458905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79e730 secure :-1 s=READY pgs=979 gs=1 cs=0 l=1 c_cookie=9907970678333072497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da40092e0 tx=0x7f7da40a9760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89802ed657076471 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7d88ce3640 1 -- 10.20.193.28:0/964458905 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da40ada10 con 0x55f1de79e360 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7d88ce3640 1 -- 10.20.193.28:0/964458905 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7da4096070 con 0x55f1de79e360 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7d88ce3640 1 -- 10.20.193.28:0/964458905 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da40adf20 con 0x55f1de79e360 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 -- 10.20.193.28:0/964458905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 msgr2=0x55f1de79e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/964458905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79e730 secure :-1 s=READY pgs=979 gs=1 cs=0 l=1 c_cookie=9907970678333072497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da40092e0 tx=0x7f7da40a9760 comp rx=0 tx=0).stop 2026-02-20T13:25:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 -- 10.20.193.28:0/964458905 shutdown_connections 2026-02-20T13:25:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/964458905 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 0x55f1de803f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/964458905 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7e35e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/964458905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79e730 unknown :-1 s=CLOSED pgs=979 gs=1 cs=0 l=1 c_cookie=9907970678333072497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 -- 10.20.193.28:0/964458905 >> 10.20.193.28:0/964458905 conn(0x55f1de77c860 msgr2=0x55f1de79cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 -- 10.20.193.28:0/964458905 shutdown_connections 2026-02-20T13:25:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.903+0000 7f7dc0985e00 1 -- 10.20.193.28:0/964458905 wait complete. 2026-02-20T13:25:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dc0985e00 1 -- start start 2026-02-20T13:25:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dc0985e00 1 Processor -- start 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79f730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de79fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 0x55f1de7a2620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f1de7a2b60 con 0x55f1de79e360 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f1de7a2cd0 con 0x55f1de7e3b20 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f1de7a2e90 con 0x55f1de79ec70 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79f730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7dbcf01640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 0x55f1de7a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7db77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de79fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79f730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56460/0 (socket says 10.20.193.28:56460) 2026-02-20T13:25:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.905+0000 7f7db7fff640 1 -- 10.20.193.28:0/740313641 learned_addr learned my addr 10.20.193.28:0/740313641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7db7fff640 1 -- 10.20.193.28:0/740313641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 msgr2=0x55f1de79fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7db7fff640 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de79fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7db7fff640 1 -- 10.20.193.28:0/740313641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 msgr2=0x55f1de7a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7db7fff640 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 0x55f1de7a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7db7fff640 1 -- 10.20.193.28:0/740313641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de62e3c0 con 0x55f1de79e360 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7db7fff640 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79f730 secure :-1 s=READY pgs=980 gs=1 cs=0 l=1 c_cookie=14248204846205562554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da400c6a0 tx=0x7f7da40b8050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bbcad14114eeba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7d79ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7d79ffb640 1 -- 10.20.193.28:0/740313641 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da40b5310 con 0x55f1de79e360 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7d79ffb640 1 -- 10.20.193.28:0/740313641 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7da40b8150 con 0x55f1de79e360 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7d79ffb640 1 -- 10.20.193.28:0/740313641 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da40d20d0 con 0x55f1de79e360 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db80fbad0 con 0x55f1de79e360 2026-02-20T13:25:31.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7dc0985e00 10 client.18345 _ll_register_callbacks cb 0x55f1de62ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f1de3406f0 con 0x55f1de79e360 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7d79ffb640 1 -- 10.20.193.28:0/740313641 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7da40ada10 con 0x55f1de79e360 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.906+0000 7f7d79ffb640 1 -- 10.20.193.28:0/740313641 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7da40c4e70 con 0x55f1de79e360 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7dc0985e00 10 client.18345 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f1de6400e0 con 0x55f1de79e360 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7d79ffb640 1 -- 10.20.193.28:0/740313641 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7da4072110 con 0x55f1de79e360 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7dc0985e00 10 client.18345 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7dc0985e00 10 client.18345 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7dc0985e00 20 client.18345 populate_metadata read hostname 'trial028' 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f1de7c95c0 0x55f1de7c9a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7dc0985e00 4 client.18345 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1de64cf80 con 0x55f1de7c95c0 2026-02-20T13:25:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.907+0000 7f7db77fe640 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f1de7c95c0 0x55f1de7c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.908+0000 7f7db77fe640 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f1de7c95c0 0x55f1de7c9a30 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=98268252777524794 s_cookie=16412966319564251772 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=15d1e748b80ae3a server_cookie=e3c691e87413e27c in_seq=0 out_seq=0 2026-02-20T13:25:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.908+0000 7f7d79ffb640 10 client.18345 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:25:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.908+0000 7f7d79ffb640 1 -- 10.20.193.28:0/740313641 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f1de64cf80 con 0x55f1de7c95c0 2026-02-20T13:25:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.908+0000 7f7d79ffb640 10 client.18345 handle_command_reply: tid=0 2026-02-20T13:25:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.908+0000 7f7dc0985e00 1 client.18345 shutdown 2026-02-20T13:25:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.908+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 msgr2=0x55f1de79f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79f730 secure :-1 s=READY pgs=980 gs=1 cs=0 l=1 c_cookie=14248204846205562554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da400c6a0 tx=0x7f7da40b8050 comp rx=0 tx=0).stop 2026-02-20T13:25:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 shutdown_connections 2026-02-20T13:25:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f1de7c95c0 0x55f1de7c9a30 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=98268252777524794 s_cookie=16412966319564251772 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de7e3b20 0x55f1de7a2620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7d79ffb640 0 client.18345 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:25:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de79fc70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/740313641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de79f730 unknown :-1 s=CLOSED pgs=980 gs=1 cs=0 l=1 c_cookie=14248204846205562554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 >> 10.20.193.28:0/740313641 conn(0x55f1de77c860 msgr2=0x55f1de79cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 shutdown_connections 2026-02-20T13:25:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 1 -- 10.20.193.28:0/740313641 wait complete. 2026-02-20T13:25:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.909+0000 7f7dc0985e00 20 client.18345 trim_cache size 0 max 16384 2026-02-20T13:25:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dc0985e00 1 Processor -- start 2026-02-20T13:25:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dc0985e00 1 -- start start 2026-02-20T13:25:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79e360 0x55f1de79dd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7f5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de7e3b20 0x55f1de79f580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f1de6a8080 con 0x55f1de7e3b20 2026-02-20T13:25:31.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f1de368700 con 0x55f1de79e360 2026-02-20T13:25:31.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f1de70cae0 con 0x55f1de79ec70 2026-02-20T13:25:31.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79e360 0x55f1de79dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7dbcf01640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de7e3b20 0x55f1de79f580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79e360 0x55f1de79dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51100/0 (socket says 10.20.193.28:51100) 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db7fff640 1 -- 10.20.193.28:0/2161317832 learned_addr learned my addr 10.20.193.28:0/2161317832 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db7fff640 1 -- 10.20.193.28:0/2161317832 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 msgr2=0x55f1de7f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db7fff640 1 --2- 10.20.193.28:0/2161317832 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7f5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db7fff640 1 -- 10.20.193.28:0/2161317832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de7e3b20 msgr2=0x55f1de79f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db7fff640 1 --2- 10.20.193.28:0/2161317832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de7e3b20 0x55f1de79f580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.916+0000 7f7db7fff640 1 -- 10.20.193.28:0/2161317832 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de63ab60 con 0x55f1de79e360 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.917+0000 7f7db77fe640 1 --2- 10.20.193.28:0/2161317832 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7f5c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:31.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.917+0000 7f7db7fff640 1 --2- 10.20.193.28:0/2161317832 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79e360 0x55f1de79dd40 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=9025566326319580457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da40a9400 tx=0x7f7da4019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d4140c119018529 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.917+0000 7f7d7bfff640 1 -- 10.20.193.28:0/2161317832 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da40d20d0 con 0x55f1de79e360 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.917+0000 7f7d7bfff640 1 -- 10.20.193.28:0/2161317832 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f1de3406f0 con 0x55f1de79e360 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.917+0000 7f7d7bfff640 1 -- 10.20.193.28:0/2161317832 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da4010810 con 0x55f1de79e360 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.917+0000 7f7dc0985e00 1 -- 10.20.193.28:0/2161317832 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79e360 msgr2=0x55f1de79dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.917+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/2161317832 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79e360 0x55f1de79dd40 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=9025566326319580457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da40a9400 tx=0x7f7da4019000 comp rx=0 tx=0).stop 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 -- 10.20.193.28:0/2161317832 shutdown_connections 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/2161317832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de7e3b20 0x55f1de79f580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/2161317832 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de79ec70 0x55f1de7f5c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/2161317832 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79e360 0x55f1de79dd40 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=9025566326319580457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 -- 10.20.193.28:0/2161317832 >> 10.20.193.28:0/2161317832 conn(0x55f1de77c860 msgr2=0x55f1de7f13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 -- 10.20.193.28:0/2161317832 shutdown_connections 2026-02-20T13:25:31.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 -- 10.20.193.28:0/2161317832 wait complete. 2026-02-20T13:25:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 -- start start 2026-02-20T13:25:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.918+0000 7f7dc0985e00 1 Processor -- start 2026-02-20T13:25:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de7d7fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79ec70 0x55f1de7d84e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dc0985e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de7e3b20 0x55f1de7d8a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f1de897a00 con 0x55f1de79e360 2026-02-20T13:25:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f1de897b70 con 0x55f1de79ec70 2026-02-20T13:25:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dc0985e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f1de897d30 con 0x55f1de7e3b20 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7db7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de7d7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dbcf01640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de7e3b20 0x55f1de7d8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dbcf01640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de7e3b20 0x55f1de7d8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54522/0 (socket says 10.20.193.28:54522) 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7dbcf01640 1 -- 10.20.193.28:0/1079265488 learned_addr learned my addr 10.20.193.28:0/1079265488 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7db77fe640 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79ec70 0x55f1de7d84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7db7fff640 1 -- 10.20.193.28:0/1079265488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de7e3b20 msgr2=0x55f1de7d8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7db7fff640 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de7e3b20 0x55f1de7d8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7db7fff640 1 -- 10.20.193.28:0/1079265488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79ec70 msgr2=0x55f1de7d84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7db7fff640 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79ec70 0x55f1de7d84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.919+0000 7f7db7fff640 1 -- 10.20.193.28:0/1079265488 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db80fbad0 con 0x55f1de79e360 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7db7fff640 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de7d7fa0 secure :-1 s=READY pgs=981 gs=1 cs=0 l=1 c_cookie=3341985934037943263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da40aa280 tx=0x7f7da4005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e611e801aaf03df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:31.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7d79ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7d79ffb640 1 -- 10.20.193.28:0/1079265488 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da40b5380 con 0x55f1de79e360 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da800fb40 con 0x55f1de79e360 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7d79ffb640 1 -- 10.20.193.28:0/1079265488 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7da40d20d0 con 0x55f1de79e360 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7d79ffb640 1 -- 10.20.193.28:0/1079265488 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da40040f0 con 0x55f1de79e360 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7d79ffb640 1 -- 10.20.193.28:0/1079265488 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7da4004250 con 0x55f1de79e360 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7d79ffb640 10 client.18351 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7dc0985e00 10 client.18351 _ll_register_callbacks cb 0x55f1de62ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.920+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da4096070 con 0x55f1de79e360 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7d79ffb640 1 -- 10.20.193.28:0/1079265488 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7da40ada10 con 0x55f1de79e360 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7dc0985e00 10 client.18351 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f1de62e6f0 con 0x55f1de79e360 2026-02-20T13:25:31.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7d79ffb640 1 -- 10.20.193.28:0/1079265488 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7da40aaff0 con 0x55f1de79e360 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7dc0985e00 10 client.18351 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7dc0985e00 10 client.18351 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7dc0985e00 20 client.18351 populate_metadata read hostname 'trial028' 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f1de899380 0x55f1de8b9830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7dc0985e00 4 client.18351 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1de33df40 con 0x55f1de899380 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.921+0000 7f7db77fe640 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f1de899380 0x55f1de8b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7db77fe640 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f1de899380 0x55f1de8b9830 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=17001822340597821519 s_cookie=13446448477834115222 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ebf29b56d9a2304f server_cookie=ba9b61a5f3e4f896 in_seq=0 out_seq=0 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7d79ffb640 10 client.18351 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7d79ffb640 1 -- 10.20.193.28:0/1079265488 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1de33df40 con 0x55f1de899380 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7d79ffb640 10 client.18351 handle_command_reply: tid=0 2026-02-20T13:25:31.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 client.18351 shutdown 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 msgr2=0x55f1de7d7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de7d7fa0 secure :-1 s=READY pgs=981 gs=1 cs=0 l=1 c_cookie=3341985934037943263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da40aa280 tx=0x7f7da4005870 comp rx=0 tx=0).stop 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 shutdown_connections 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55f1de899380 0x55f1de8b9830 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=17001822340597821519 s_cookie=13446448477834115222 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f1de7e3b20 0x55f1de7d8a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f1de79ec70 0x55f1de7d84e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 --2- 10.20.193.28:0/1079265488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1de79e360 0x55f1de7d7fa0 unknown :-1 s=CLOSED pgs=981 gs=1 cs=0 l=1 c_cookie=3341985934037943263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 >> 10.20.193.28:0/1079265488 conn(0x55f1de77c860 msgr2=0x55f1de7f5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7d79ffb640 0 client.18351 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 shutdown_connections 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 1 -- 10.20.193.28:0/1079265488 wait complete. 2026-02-20T13:25:31.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.922+0000 7f7dc0985e00 20 client.18351 trim_cache size 0 max 16384 2026-02-20T13:25:31.932 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 -- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7d8c0b5750 msgr2=0x7f7d8c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7d8c0b5750 0x7f7d8c0d5c00 secure :-1 s=READY pgs=446 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da8005970 tx=0x7f7da8005900 comp rx=0 tx=0).stop 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 -- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7db810d240 msgr2=0x7f7db80f5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7db810d240 0x7f7db80f5690 secure :-1 s=READY pgs=978 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da4009480 tx=0x7f7da400ee60 comp rx=0 tx=0).stop 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 -- 10.20.193.28:0/941409101 shutdown_connections 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7d8c0b5750 0x7f7d8c0d5c00 unknown :-1 s=CLOSED pgs=446 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7db8113430 0x7f7db80f5d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7db810dc30 0x7f7db8173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 --2- 10.20.193.28:0/941409101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7db810d240 0x7f7db80f5690 unknown :-1 s=CLOSED pgs=978 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 -- 10.20.193.28:0/941409101 >> 10.20.193.28:0/941409101 conn(0x7f7db80eaad0 msgr2=0x7f7db81102f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:31.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 -- 10.20.193.28:0/941409101 shutdown_connections 2026-02-20T13:25:31.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:31.923+0000 7f7dbd702640 1 -- 10.20.193.28:0/941409101 wait complete. 2026-02-20T13:25:31.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:31 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1417179408' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:31.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:31 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1417179408' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:32.063 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:25:32.249 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.436+0000 7f373735e640 1 -- 10.20.193.28:0/199179798 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 msgr2=0x7f3730115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.436+0000 7f373735e640 1 --2- 10.20.193.28:0/199179798 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 0x7f3730115030 secure :-1 s=READY pgs=982 gs=1 cs=0 l=1 c_cookie=18182768664377394683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3724009890 tx=0x7f372402f120 comp rx=0 tx=0).stop 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.436+0000 7f373735e640 1 -- 10.20.193.28:0/199179798 shutdown_connections 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.436+0000 7f373735e640 1 --2- 10.20.193.28:0/199179798 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 0x7f3730115030 unknown :-1 s=CLOSED pgs=982 gs=1 cs=0 l=1 c_cookie=18182768664377394683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.436+0000 7f373735e640 1 --2- 10.20.193.28:0/199179798 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f37301157e0 0x7f37301761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.436+0000 7f373735e640 1 --2- 10.20.193.28:0/199179798 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f373010f5f0 0x7f373010f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.436+0000 7f373735e640 1 -- 10.20.193.28:0/199179798 >> 10.20.193.28:0/199179798 conn(0x7f37300ecea0 msgr2=0x7f373010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.437+0000 7f373735e640 1 -- 10.20.193.28:0/199179798 shutdown_connections 2026-02-20T13:25:32.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.437+0000 7f373735e640 1 -- 10.20.193.28:0/199179798 wait complete. 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.437+0000 7f373735e640 1 Processor -- start 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f373735e640 1 -- start start 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f373735e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f373010f5f0 0x7f37300f4c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f373735e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 0x7f37301760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f373735e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37301157e0 0x7f37300f5370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f373735e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f37300fa580 con 0x7f373010ffe0 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f373735e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f37300fa6f0 con 0x7f373010f5f0 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f373735e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f37300fa8b0 con 0x7f37301157e0 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37348d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 0x7f37301760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37350d3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f373010f5f0 0x7f37300f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37350d3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f373010f5f0 0x7f37300f4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51136/0 (socket says 10.20.193.28:51136) 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37350d3640 1 -- 10.20.193.28:0/1427013687 learned_addr learned my addr 10.20.193.28:0/1427013687 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37348d2640 1 -- 10.20.193.28:0/1427013687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37301157e0 msgr2=0x7f37300f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37358d4640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37301157e0 0x7f37300f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37348d2640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37301157e0 0x7f37300f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37348d2640 1 -- 10.20.193.28:0/1427013687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f373010f5f0 msgr2=0x7f37300f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37348d2640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f373010f5f0 0x7f37300f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37348d2640 1 -- 10.20.193.28:0/1427013687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37240094b0 con 0x7f373010ffe0 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37350d3640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f373010f5f0 0x7f37300f4c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.438+0000 7f37358d4640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37301157e0 0x7f37300f5370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.439+0000 7f37348d2640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 0x7f37301760b0 secure :-1 s=READY pgs=983 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37240097e0 tx=0x7f37240028b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.439+0000 7f371e7fc640 1 -- 10.20.193.28:0/1427013687 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f372403d070 con 0x7f373010ffe0 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.439+0000 7f371e7fc640 1 -- 10.20.193.28:0/1427013687 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f37240044f0 con 0x7f373010ffe0 2026-02-20T13:25:32.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.439+0000 7f371e7fc640 1 -- 10.20.193.28:0/1427013687 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3724041ae0 con 0x7f373010ffe0 2026-02-20T13:25:32.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.439+0000 7f373735e640 1 -- 10.20.193.28:0/1427013687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37300fab30 con 0x7f373010ffe0 2026-02-20T13:25:32.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.439+0000 7f373735e640 1 -- 10.20.193.28:0/1427013687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37300faf50 con 0x7f373010ffe0 2026-02-20T13:25:32.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.442+0000 7f371e7fc640 1 -- 10.20.193.28:0/1427013687 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f37240386b0 con 0x7f373010ffe0 2026-02-20T13:25:32.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.443+0000 7f371e7fc640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f370c0b5750 0x7f370c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.443+0000 7f371e7fc640 1 -- 10.20.193.28:0/1427013687 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f372410b630 con 0x7f373010ffe0 2026-02-20T13:25:32.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.443+0000 7f37350d3640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f370c0b5750 0x7f370c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.444+0000 7f37350d3640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f370c0b5750 0x7f370c0d5c00 secure :-1 s=READY pgs=447 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37200095b0 tx=0x7f3720005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.444+0000 7f3739358e00 1 Processor -- start 2026-02-20T13:25:32.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.444+0000 7f3739358e00 1 -- start start 2026-02-20T13:25:32.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f3739358e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7c360 0x562fe6f7c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f3739358e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fc15e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f3739358e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 0x562fe6fe1f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f3739358e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fe6e92780 con 0x562fe6f7c360 2026-02-20T13:25:32.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f3739358e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fe6e8e4b0 con 0x562fe6fc1b20 2026-02-20T13:25:32.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f3739358e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fe6e88450 con 0x562fe6f7cc70 2026-02-20T13:25:32.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37350d3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7c360 0x562fe6f7c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fc15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37358d4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 0x562fe6fe1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fc15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54540/0 (socket says 10.20.193.28:54540) 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 -- 10.20.193.28:0/150722037 learned_addr learned my addr 10.20.193.28:0/150722037 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 -- 10.20.193.28:0/150722037 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 msgr2=0x562fe6fe1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 --2- 10.20.193.28:0/150722037 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 0x562fe6fe1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 -- 10.20.193.28:0/150722037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7c360 msgr2=0x562fe6f7c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 --2- 10.20.193.28:0/150722037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7c360 0x562fe6f7c730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 -- 10.20.193.28:0/150722037 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6e33d10 con 0x562fe6f7cc70 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f37348d2640 1 --2- 10.20.193.28:0/150722037 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fc15e0 secure :-1 s=READY pgs=292 gs=2 cs=0 l=1 c_cookie=2146997429067897590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3724109100 tx=0x7f372402f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dcbaac95544daf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.445+0000 7f36fdce5640 1 -- 10.20.193.28:0/150722037 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f372400b0c0 con 0x562fe6f7cc70 2026-02-20T13:25:32.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f36fdce5640 1 -- 10.20.193.28:0/150722037 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3724005b60 con 0x562fe6f7cc70 2026-02-20T13:25:32.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f36fdce5640 1 -- 10.20.193.28:0/150722037 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37240cdc00 con 0x562fe6f7cc70 2026-02-20T13:25:32.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 -- 10.20.193.28:0/150722037 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 msgr2=0x562fe6fc15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 --2- 10.20.193.28:0/150722037 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fc15e0 secure :-1 s=READY pgs=292 gs=2 cs=0 l=1 c_cookie=2146997429067897590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3724109100 tx=0x7f372402f120 comp rx=0 tx=0).stop 2026-02-20T13:25:32.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 -- 10.20.193.28:0/150722037 shutdown_connections 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 --2- 10.20.193.28:0/150722037 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 0x562fe6fe1f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 --2- 10.20.193.28:0/150722037 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fc15e0 unknown :-1 s=CLOSED pgs=292 gs=2 cs=0 l=1 c_cookie=2146997429067897590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 --2- 10.20.193.28:0/150722037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7c360 0x562fe6f7c730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 -- 10.20.193.28:0/150722037 >> 10.20.193.28:0/150722037 conn(0x562fe6f5a860 msgr2=0x562fe6f7ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 -- 10.20.193.28:0/150722037 shutdown_connections 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.446+0000 7f3739358e00 1 -- 10.20.193.28:0/150722037 wait complete. 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.447+0000 7f3739358e00 1 -- start start 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.447+0000 7f3739358e00 1 Processor -- start 2026-02-20T13:25:32.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f3739358e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7c360 0x562fe6f81790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f3739358e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6f81cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f3739358e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 0x562fe6f805b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f3739358e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fe6f80b20 con 0x562fe6f7cc70 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f3739358e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fe6f80c90 con 0x562fe6fc1b20 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f3739358e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fe6f80e50 con 0x562fe6f7c360 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f37350d3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7c360 0x562fe6f81790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f37350d3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7c360 0x562fe6f81790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54542/0 (socket says 10.20.193.28:54542) 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f37350d3640 1 -- 10.20.193.28:0/737984197 learned_addr learned my addr 10.20.193.28:0/737984197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.448+0000 7f37348d2640 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6f81cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f37350d3640 1 -- 10.20.193.28:0/737984197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 msgr2=0x562fe6f805b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f37350d3640 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 0x562fe6f805b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f37350d3640 1 -- 10.20.193.28:0/737984197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 msgr2=0x562fe6f81cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f37350d3640 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6f81cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f37350d3640 1 -- 10.20.193.28:0/737984197 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6e0c3c0 con 0x562fe6f7c360 2026-02-20T13:25:32.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f37350d3640 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7c360 0x562fe6f81790 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=10665659860661153496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3720011bb0 tx=0x7f3720013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9404092259d9aed8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f36e6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f36e6ffd640 1 -- 10.20.193.28:0/737984197 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3720021040 con 0x562fe6f7c360 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f36e6ffd640 1 -- 10.20.193.28:0/737984197 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f372001be50 con 0x562fe6f7c360 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f36e6ffd640 1 -- 10.20.193.28:0/737984197 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3720025b10 con 0x562fe6f7c360 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37300faf50 con 0x562fe6f7c360 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f3739358e00 10 client.28225 _ll_register_callbacks cb 0x562fe6e09a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562fe6b1e6f0 con 0x562fe6f7c360 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f36e6ffd640 1 -- 10.20.193.28:0/737984197 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3720025ca0 con 0x562fe6f7c360 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.449+0000 7f36e6ffd640 1 -- 10.20.193.28:0/737984197 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3720025ea0 con 0x562fe6f7c360 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f3739358e00 10 client.28225 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:32.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562fe6e1e0e0 con 0x562fe6f7c360 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f36e6ffd640 1 -- 10.20.193.28:0/737984197 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f372001ac80 con 0x562fe6f7c360 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f3739358e00 10 client.28225 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f3739358e00 10 client.28225 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f3739358e00 20 client.28225 populate_metadata read hostname 'trial028' 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f3739358e00 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fe6fa7bc0 0x562fe6fa8060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f3739358e00 4 client.28225 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fe6e2af80 con 0x562fe6fa7bc0 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.450+0000 7f37348d2640 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fe6fa7bc0 0x562fe6fa8060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.451+0000 7f37348d2640 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fe6fa7bc0 0x562fe6fa8060 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=10795013549720313024 s_cookie=12017784581587600047 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=95cf97a1089b9cc0 server_cookie=a6c7bf676cb202af in_seq=0 out_seq=0 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.451+0000 7f36e6ffd640 10 client.28225 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.451+0000 7f36e6ffd640 1 -- 10.20.193.28:0/737984197 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562fe6e2af80 con 0x562fe6fa7bc0 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.451+0000 7f36e6ffd640 10 client.28225 handle_command_reply: tid=0 2026-02-20T13:25:32.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 client.28225 shutdown 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7c360 msgr2=0x562fe6f81790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7c360 0x562fe6f81790 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=10665659860661153496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3720011bb0 tx=0x7f3720013040 comp rx=0 tx=0).stop 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 shutdown_connections 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fe6fa7bc0 0x562fe6fa8060 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=10795013549720313024 s_cookie=12017784581587600047 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6f81cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6fc1b20 0x562fe6f805b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 --2- 10.20.193.28:0/737984197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7c360 0x562fe6f81790 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=10665659860661153496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f36e6ffd640 0 client.28225 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 >> 10.20.193.28:0/737984197 conn(0x562fe6f5a860 msgr2=0x562fe6f7ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 shutdown_connections 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 1 -- 10.20.193.28:0/737984197 wait complete. 2026-02-20T13:25:32.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.452+0000 7f3739358e00 20 client.28225 trim_cache size 0 max 16384 2026-02-20T13:25:32.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.459+0000 7f3739358e00 1 Processor -- start 2026-02-20T13:25:32.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.459+0000 7f3739358e00 1 -- start start 2026-02-20T13:25:32.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.459+0000 7f3739358e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6f805a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.459+0000 7f3739358e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6fe1570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.459+0000 7f3739358e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6fc1b20 0x562fe6fe1ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.459+0000 7f3739358e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fe6e86080 con 0x562fe6f7cc70 2026-02-20T13:25:32.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.459+0000 7f3739358e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fe6b46700 con 0x562fe6f7c360 2026-02-20T13:25:32.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.459+0000 7f3739358e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fe6fa6240 con 0x562fe6fc1b20 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6f805a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6f805a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51168/0 (socket says 10.20.193.28:51168) 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 -- 10.20.193.28:0/2466556714 learned_addr learned my addr 10.20.193.28:0/2466556714 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37348d2640 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6fe1570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37358d4640 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6fc1b20 0x562fe6fe1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 -- 10.20.193.28:0/2466556714 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6fc1b20 msgr2=0x562fe6fe1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6fc1b20 0x562fe6fe1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 -- 10.20.193.28:0/2466556714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 msgr2=0x562fe6fe1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6fe1570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 -- 10.20.193.28:0/2466556714 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6e18b60 con 0x562fe6f7c360 2026-02-20T13:25:32.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37348d2640 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6fe1570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.460+0000 7f37350d3640 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6f805a0 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=7353466773792115232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f372001bc60 tx=0x7f372002c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660cc31207844a20 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f36fd4e4640 1 -- 10.20.193.28:0/2466556714 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f372001a460 con 0x562fe6f7c360 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f36fd4e4640 1 -- 10.20.193.28:0/2466556714 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x562fe6b1e6f0 con 0x562fe6f7c360 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f36fd4e4640 1 -- 10.20.193.28:0/2466556714 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3720019c50 con 0x562fe6f7c360 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 -- 10.20.193.28:0/2466556714 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 msgr2=0x562fe6f805a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6f805a0 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=7353466773792115232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f372001bc60 tx=0x7f372002c000 comp rx=0 tx=0).stop 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 -- 10.20.193.28:0/2466556714 shutdown_connections 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6f7cc70 0x562fe6fe1570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6fc1b20 0x562fe6fe1ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 --2- 10.20.193.28:0/2466556714 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6f805a0 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=7353466773792115232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 -- 10.20.193.28:0/2466556714 >> 10.20.193.28:0/2466556714 conn(0x562fe6f5a860 msgr2=0x562fe6fc0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 -- 10.20.193.28:0/2466556714 shutdown_connections 2026-02-20T13:25:32.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 -- 10.20.193.28:0/2466556714 wait complete. 2026-02-20T13:25:32.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.461+0000 7f3739358e00 1 -- start start 2026-02-20T13:25:32.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f3739358e00 1 Processor -- start 2026-02-20T13:25:32.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f3739358e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6fadfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f3739358e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fae5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f3739358e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6fc1b20 0x562fe6fa8970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f3739358e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fe6fa9010 con 0x562fe6fc1b20 2026-02-20T13:25:32.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f3739358e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fe6fa9180 con 0x562fe6f7c360 2026-02-20T13:25:32.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f3739358e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fe6fa9340 con 0x562fe6f7cc70 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37350d3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6fadfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37350d3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6fadfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51172/0 (socket says 10.20.193.28:51172) 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37350d3640 1 -- 10.20.193.28:0/703250338 learned_addr learned my addr 10.20.193.28:0/703250338 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37348d2640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37358d4640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6fc1b20 0x562fe6fa8970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37358d4640 1 -- 10.20.193.28:0/703250338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 msgr2=0x562fe6fae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37358d4640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37358d4640 1 -- 10.20.193.28:0/703250338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 msgr2=0x562fe6fadfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37358d4640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6fadfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37358d4640 1 -- 10.20.193.28:0/703250338 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6e1e0e0 con 0x562fe6fc1b20 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.462+0000 7f37348d2640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fae5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f37350d3640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6fadfb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f37358d4640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6fc1b20 0x562fe6fa8970 secure :-1 s=READY pgs=984 gs=2 cs=0 l=1 c_cookie=4241540585450228184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x562fe6eecb80 tx=0x7f372c014e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adcfab09829c9d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f36e6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f36e6ffd640 1 -- 10.20.193.28:0/703250338 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f372c019070 con 0x562fe6fc1b20 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f36e6ffd640 1 -- 10.20.193.28:0/703250338 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f372c012db0 con 0x562fe6fc1b20 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f36e6ffd640 1 -- 10.20.193.28:0/703250338 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f372c003ea0 con 0x562fe6fc1b20 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe6e33d10 con 0x562fe6fc1b20 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f36e6ffd640 1 -- 10.20.193.28:0/703250338 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f372c0113d0 con 0x562fe6fc1b20 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f36e6ffd640 10 client.18369 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f3739358e00 10 client.18369 _ll_register_callbacks cb 0x562fe6e09a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3724005b60 con 0x562fe6fc1b20 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f36e6ffd640 1 -- 10.20.193.28:0/703250338 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f372c003780 con 0x562fe6fc1b20 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f3739358e00 10 client.18369 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.463+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562fe6e0c6f0 con 0x562fe6fc1b20 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.464+0000 7f36e6ffd640 1 -- 10.20.193.28:0/703250338 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f372c005500 con 0x562fe6fc1b20 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.464+0000 7f3739358e00 10 client.18369 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.464+0000 7f3739358e00 10 client.18369 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.464+0000 7f3739358e00 20 client.18369 populate_metadata read hostname 'trial028' 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.464+0000 7f3739358e00 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fe7077f80 0x562fe7098430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.464+0000 7f3739358e00 4 client.18369 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.464+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fe6b1bf40 con 0x562fe7077f80 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.464+0000 7f37350d3640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fe7077f80 0x562fe7098430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f37350d3640 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fe7077f80 0x562fe7098430 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=18368809244287730905 s_cookie=8632026613968550772 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=feeb1eaf80ae84d9 server_cookie=77cb1e7891503b74 in_seq=0 out_seq=0 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f36e6ffd640 10 client.18369 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:25:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f36e6ffd640 1 -- 10.20.193.28:0/703250338 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fe6b1bf40 con 0x562fe7077f80 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f36e6ffd640 10 client.18369 handle_command_reply: tid=0 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 client.18369 shutdown 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6fc1b20 msgr2=0x562fe6fa8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6fc1b20 0x562fe6fa8970 secure :-1 s=READY pgs=984 gs=2 cs=0 l=1 c_cookie=4241540585450228184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x562fe6eecb80 tx=0x7f372c014e20 comp rx=0 tx=0).stop 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 shutdown_connections 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fe7077f80 0x562fe7098430 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=18368809244287730905 s_cookie=8632026613968550772 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe6fc1b20 0x562fe6fa8970 unknown :-1 s=CLOSED pgs=984 gs=2 cs=0 l=1 c_cookie=4241540585450228184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fe6f7cc70 0x562fe6fae5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 --2- 10.20.193.28:0/703250338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fe6f7c360 0x562fe6fadfb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f36e6ffd640 0 client.18369 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 >> 10.20.193.28:0/703250338 conn(0x562fe6f5a860 msgr2=0x562fe6f81370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 shutdown_connections 2026-02-20T13:25:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 1 -- 10.20.193.28:0/703250338 wait complete. 2026-02-20T13:25:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.465+0000 7f3739358e00 20 client.18369 trim_cache size 0 max 16384 2026-02-20T13:25:32.476 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 -- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f370c0b5750 msgr2=0x7f370c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f370c0b5750 0x7f370c0d5c00 secure :-1 s=READY pgs=447 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37200095b0 tx=0x7f3720005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 -- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 msgr2=0x7f37301760b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 0x7f37301760b0 secure :-1 s=READY pgs=983 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37240097e0 tx=0x7f37240028b0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 -- 10.20.193.28:0/1427013687 shutdown_connections 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f370c0b5750 0x7f370c0d5c00 unknown :-1 s=CLOSED pgs=447 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f373010ffe0 0x7f37301760b0 unknown :-1 s=CLOSED pgs=983 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37301157e0 0x7f37300f5370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 --2- 10.20.193.28:0/1427013687 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f373010f5f0 0x7f37300f4c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 -- 10.20.193.28:0/1427013687 >> 10.20.193.28:0/1427013687 conn(0x7f37300ecea0 msgr2=0x7f373010da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 -- 10.20.193.28:0/1427013687 shutdown_connections 2026-02-20T13:25:32.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.466+0000 7f373735e640 1 -- 10.20.193.28:0/1427013687 wait complete. 2026-02-20T13:25:32.574 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:25:32.758 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:32.889 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:32 trial028 ceph-mon[37442]: pgmap v427: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:25:32.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.928+0000 7f4833fff640 1 -- 10.20.193.28:0/3177101678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4834110f10 msgr2=0x7f48341113b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.928+0000 7f4833fff640 1 --2- 10.20.193.28:0/3177101678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4834110f10 0x7f48341113b0 secure :-1 s=READY pgs=985 gs=2 cs=0 l=1 c_cookie=2793420363015828866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f482400a9a0 tx=0x7f48240301b0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.929+0000 7f4833fff640 1 -- 10.20.193.28:0/3177101678 shutdown_connections 2026-02-20T13:25:32.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.929+0000 7f4833fff640 1 --2- 10.20.193.28:0/3177101678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4834110f10 0x7f48341113b0 unknown :-1 s=CLOSED pgs=985 gs=2 cs=0 l=1 c_cookie=2793420363015828866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.929+0000 7f4833fff640 1 --2- 10.20.193.28:0/3177101678 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f483410c320 0x7f48341108f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.929+0000 7f4833fff640 1 --2- 10.20.193.28:0/3177101678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f483410b930 0x7f483410bd00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.929+0000 7f4833fff640 1 -- 10.20.193.28:0/3177101678 >> 10.20.193.28:0/3177101678 conn(0x7f48340e95c0 msgr2=0x7f48341099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.929+0000 7f4833fff640 1 -- 10.20.193.28:0/3177101678 shutdown_connections 2026-02-20T13:25:32.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.929+0000 7f4833fff640 1 -- 10.20.193.28:0/3177101678 wait complete. 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4833fff640 1 Processor -- start 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4833fff640 1 -- start start 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4833fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f483410b930 0x7f48341222a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4833fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f483410c320 0x7f48341227e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4833fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4834110f10 0x7f4834127bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4833fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f48341281d0 con 0x7f483410c320 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4833fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f4834128340 con 0x7f483410b930 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4833fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4834128500 con 0x7f4834110f10 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48327fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f483410c320 0x7f48341227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f4832ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f483410b930 0x7f48341222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48327fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f483410c320 0x7f48341227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56542/0 (socket says 10.20.193.28:56542) 2026-02-20T13:25:32.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48327fc640 1 -- 10.20.193.28:0/3736432925 learned_addr learned my addr 10.20.193.28:0/3736432925 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48337fe640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4834110f10 0x7f4834127bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48327fc640 1 -- 10.20.193.28:0/3736432925 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4834110f10 msgr2=0x7f4834127bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48327fc640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4834110f10 0x7f4834127bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48327fc640 1 -- 10.20.193.28:0/3736432925 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f483410b930 msgr2=0x7f48341222a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48327fc640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f483410b930 0x7f48341222a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.930+0000 7f48327fc640 1 -- 10.20.193.28:0/3736432925 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c009570 con 0x7f483410c320 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.931+0000 7f48327fc640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f483410c320 0x7f48341227e0 secure :-1 s=READY pgs=986 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f481c005b30 tx=0x7f481c002c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.931+0000 7f4813fff640 1 -- 10.20.193.28:0/3736432925 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f481c00ed60 con 0x7f483410c320 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.931+0000 7f4813fff640 1 -- 10.20.193.28:0/3736432925 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f481c002e70 con 0x7f483410c320 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.931+0000 7f4813fff640 1 -- 10.20.193.28:0/3736432925 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f481c00f870 con 0x7f483410c320 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.931+0000 7f4833fff640 1 -- 10.20.193.28:0/3736432925 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482400a590 con 0x7f483410c320 2026-02-20T13:25:32.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.931+0000 7f4833fff640 1 -- 10.20.193.28:0/3736432925 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4834168d40 con 0x7f483410c320 2026-02-20T13:25:32.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.934+0000 7f4813fff640 1 -- 10.20.193.28:0/3736432925 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f481c01f060 con 0x7f483410c320 2026-02-20T13:25:32.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.935+0000 7f4813fff640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48080b5760 0x7f48080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.936+0000 7f4813fff640 1 -- 10.20.193.28:0/3736432925 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f481c0e6f90 con 0x7f483410c320 2026-02-20T13:25:32.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.936+0000 7f4832ffd640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48080b5760 0x7f48080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.936+0000 7f4832ffd640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48080b5760 0x7f48080d5c10 secure :-1 s=READY pgs=448 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4828004740 tx=0x7f4828005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f483b7dee00 1 Processor -- start 2026-02-20T13:25:32.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f483b7dee00 1 -- start start 2026-02-20T13:25:32.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87360 0x555ad1b87730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1bcc5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1becf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f483b7dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555ad1a9d780 con 0x555ad1bccb20 2026-02-20T13:25:32.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f483b7dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555ad1a994b0 con 0x555ad1b87360 2026-02-20T13:25:32.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f483b7dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555ad1a93450 con 0x555ad1b87c70 2026-02-20T13:25:32.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f48327fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1bcc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f48337fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1becf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f48327fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1bcc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54588/0 (socket says 10.20.193.28:54588) 2026-02-20T13:25:32.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f48327fc640 1 -- 10.20.193.28:0/1290256172 learned_addr learned my addr 10.20.193.28:0/1290256172 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.937+0000 7f4832ffd640 1 --2- 10.20.193.28:0/1290256172 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87360 0x555ad1b87730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f48327fc640 1 -- 10.20.193.28:0/1290256172 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87360 msgr2=0x555ad1b87730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f48327fc640 1 --2- 10.20.193.28:0/1290256172 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87360 0x555ad1b87730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f48327fc640 1 -- 10.20.193.28:0/1290256172 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 msgr2=0x555ad1becf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f48327fc640 1 --2- 10.20.193.28:0/1290256172 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1becf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f48327fc640 1 -- 10.20.193.28:0/1290256172 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad1a3ed10 con 0x555ad1b87c70 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f48327fc640 1 --2- 10.20.193.28:0/1290256172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1bcc5e0 secure :-1 s=READY pgs=294 gs=2 cs=0 l=1 c_cookie=11935888625302203519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f481c009480 tx=0x7f481c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a4cb7735c36c7f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f47ff7fe640 1 -- 10.20.193.28:0/1290256172 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f481c06d020 con 0x555ad1b87c70 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f47ff7fe640 1 -- 10.20.193.28:0/1290256172 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f481c0acaf0 con 0x555ad1b87c70 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f47ff7fe640 1 -- 10.20.193.28:0/1290256172 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f481c0ad110 con 0x555ad1b87c70 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 -- 10.20.193.28:0/1290256172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 msgr2=0x555ad1bcc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 --2- 10.20.193.28:0/1290256172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1bcc5e0 secure :-1 s=READY pgs=294 gs=2 cs=0 l=1 c_cookie=11935888625302203519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f481c009480 tx=0x7f481c020000 comp rx=0 tx=0).stop 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 -- 10.20.193.28:0/1290256172 shutdown_connections 2026-02-20T13:25:32.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 --2- 10.20.193.28:0/1290256172 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1becf00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 --2- 10.20.193.28:0/1290256172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1bcc5e0 unknown :-1 s=CLOSED pgs=294 gs=2 cs=0 l=1 c_cookie=11935888625302203519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 --2- 10.20.193.28:0/1290256172 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87360 0x555ad1b87730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 -- 10.20.193.28:0/1290256172 >> 10.20.193.28:0/1290256172 conn(0x555ad1b65860 msgr2=0x555ad1b85c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 -- 10.20.193.28:0/1290256172 shutdown_connections 2026-02-20T13:25:32.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.938+0000 7f483b7dee00 1 -- 10.20.193.28:0/1290256172 wait complete. 2026-02-20T13:25:32.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.940+0000 7f483b7dee00 1 -- start start 2026-02-20T13:25:32.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.940+0000 7f483b7dee00 1 Processor -- start 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.940+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87360 0x555ad1be4740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.940+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 0x555ad1be4c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.940+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1be9c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.940+0000 7f483b7dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555ad1bea1b0 con 0x555ad1bccb20 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.940+0000 7f483b7dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555ad1bea320 con 0x555ad1b87c70 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.940+0000 7f483b7dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555ad1bea4e0 con 0x555ad1b87360 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87360 0x555ad1be4740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87360 0x555ad1be4740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54592/0 (socket says 10.20.193.28:54592) 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 -- 10.20.193.28:0/3817524579 learned_addr learned my addr 10.20.193.28:0/3817524579 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f48327fc640 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 0x555ad1be4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f48337fe640 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1be9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 -- 10.20.193.28:0/3817524579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 msgr2=0x555ad1be4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 0x555ad1be4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 -- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 msgr2=0x555ad1be9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1be9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 -- 10.20.193.28:0/3817524579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad1a173c0 con 0x555ad1b87360 2026-02-20T13:25:32.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f48337fe640 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1be9c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:32.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f4832ffd640 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87360 0x555ad1be4740 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=7475460538560797133 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4828011790 tx=0x7f4828013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67be2bc0cd5dd9cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.941+0000 7f47fcff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f47fcff9640 1 -- 10.20.193.28:0/3817524579 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4828021040 con 0x555ad1b87360 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f47fcff9640 1 -- 10.20.193.28:0/3817524579 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4828019400 con 0x555ad1b87360 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f47fcff9640 1 -- 10.20.193.28:0/3817524579 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4828025660 con 0x555ad1b87360 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4834168d40 con 0x555ad1b87360 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f47fcff9640 1 -- 10.20.193.28:0/3817524579 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f48280257f0 con 0x555ad1b87360 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f47fcff9640 10 client.28240 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f483b7dee00 10 client.28240 _ll_register_callbacks cb 0x555ad1a14a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555ad17296f0 con 0x555ad1b87360 2026-02-20T13:25:32.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f47fcff9640 1 -- 10.20.193.28:0/3817524579 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f482801bb10 con 0x555ad1b87360 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f483b7dee00 10 client.28240 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.942+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555ad1a290e0 con 0x555ad1b87360 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f47fcff9640 1 -- 10.20.193.28:0/3817524579 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f482801bc70 con 0x555ad1b87360 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f483b7dee00 10 client.28240 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f483b7dee00 10 client.28240 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f483b7dee00 20 client.28240 populate_metadata read hostname 'trial028' 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f483b7dee00 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x555ad1becd40 0x555ad1bca8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f483b7dee00 4 client.28240 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ad1a35f80 con 0x555ad1becd40 2026-02-20T13:25:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f48327fc640 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x555ad1becd40 0x555ad1bca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f48327fc640 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x555ad1becd40 0x555ad1bca8a0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=11181489473798349682 s_cookie=15946956867941807439 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b2ca16f31852372 server_cookie=dd4ef8c7e225b54f in_seq=0 out_seq=0 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.943+0000 7f47fcff9640 10 client.28240 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f47fcff9640 1 -- 10.20.193.28:0/3817524579 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555ad1a35f80 con 0x555ad1becd40 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f47fcff9640 10 client.28240 handle_command_reply: tid=0 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 client.28240 shutdown 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87360 msgr2=0x555ad1be4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87360 0x555ad1be4740 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=7475460538560797133 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4828011790 tx=0x7f4828013040 comp rx=0 tx=0).stop 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 shutdown_connections 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x555ad1becd40 0x555ad1bca8a0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=11181489473798349682 s_cookie=15946956867941807439 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1bccb20 0x555ad1be9c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 0x555ad1be4c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 --2- 10.20.193.28:0/3817524579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87360 0x555ad1be4740 unknown :-1 s=CLOSED pgs=295 gs=1 cs=0 l=1 c_cookie=7475460538560797133 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 >> 10.20.193.28:0/3817524579 conn(0x555ad1b65860 msgr2=0x555ad1b85c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f47fcff9640 0 client.28240 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:25:32.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 shutdown_connections 2026-02-20T13:25:32.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 1 -- 10.20.193.28:0/3817524579 wait complete. 2026-02-20T13:25:32.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.944+0000 7f483b7dee00 20 client.28240 trim_cache size 0 max 16384 2026-02-20T13:25:32.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.952+0000 7f483b7dee00 1 Processor -- start 2026-02-20T13:25:32.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.952+0000 7f483b7dee00 1 -- start start 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.952+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1be1960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1be1ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1bccb20 0x555ad1bc7780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f483b7dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555ad1a91080 con 0x555ad1b87360 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f483b7dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555ad1751700 con 0x555ad1bccb20 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f483b7dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555ad1bd90e0 con 0x555ad1b87c70 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1be1960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1be1960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56570/0 (socket says 10.20.193.28:56570) 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 -- 10.20.193.28:0/458522823 learned_addr learned my addr 10.20.193.28:0/458522823 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f48327fc640 1 --2- 10.20.193.28:0/458522823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1be1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 -- 10.20.193.28:0/458522823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 msgr2=0x555ad1be1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 --2- 10.20.193.28:0/458522823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1be1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 -- 10.20.193.28:0/458522823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1bccb20 msgr2=0x555ad1bc7780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:25:32.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 --2- 10.20.193.28:0/458522823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1bccb20 0x555ad1bc7780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 -- 10.20.193.28:0/458522823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad1a23b60 con 0x555ad1b87360 2026-02-20T13:25:32.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.953+0000 7f4832ffd640 1 --2- 10.20.193.28:0/458522823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1be1960 secure :-1 s=READY pgs=987 gs=1 cs=0 l=1 c_cookie=3395544956119116537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4828025b90 tx=0x7f482801d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1f6625b0596af9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f47feffd640 1 -- 10.20.193.28:0/458522823 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4828025c60 con 0x555ad1b87360 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f47feffd640 1 -- 10.20.193.28:0/458522823 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555ad17296f0 con 0x555ad1b87360 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f47feffd640 1 -- 10.20.193.28:0/458522823 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4828026430 con 0x555ad1b87360 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 -- 10.20.193.28:0/458522823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 msgr2=0x555ad1be1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 --2- 10.20.193.28:0/458522823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1be1960 secure :-1 s=READY pgs=987 gs=1 cs=0 l=1 c_cookie=3395544956119116537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4828025b90 tx=0x7f482801d020 comp rx=0 tx=0).stop 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 -- 10.20.193.28:0/458522823 shutdown_connections 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 --2- 10.20.193.28:0/458522823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1bccb20 0x555ad1bc7780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 --2- 10.20.193.28:0/458522823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1b87c70 0x555ad1be1ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 --2- 10.20.193.28:0/458522823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1be1960 unknown :-1 s=CLOSED pgs=987 gs=1 cs=0 l=1 c_cookie=3395544956119116537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 -- 10.20.193.28:0/458522823 >> 10.20.193.28:0/458522823 conn(0x555ad1b65860 msgr2=0x555ad1bcef00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 -- 10.20.193.28:0/458522823 shutdown_connections 2026-02-20T13:25:32.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 -- 10.20.193.28:0/458522823 wait complete. 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.954+0000 7f483b7dee00 1 -- start start 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f483b7dee00 1 Processor -- start 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1bcbea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 0x555ad1b65c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f483b7dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1bccb20 0x555ad1b66170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f483b7dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555ad1be57e0 con 0x555ad1b87360 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f483b7dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555ad1bcc3e0 con 0x555ad1b87c70 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f483b7dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555ad1bcc5a0 con 0x555ad1bccb20 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1bcbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1bcbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56582/0 (socket says 10.20.193.28:56582) 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 -- 10.20.193.28:0/155931719 learned_addr learned my addr 10.20.193.28:0/155931719 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f48337fe640 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1bccb20 0x555ad1b66170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f48327fc640 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 0x555ad1b65c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 -- 10.20.193.28:0/155931719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1bccb20 msgr2=0x555ad1b66170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1bccb20 0x555ad1b66170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 -- 10.20.193.28:0/155931719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 msgr2=0x555ad1b65c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 0x555ad1b65c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 -- 10.20.193.28:0/155931719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad1a176f0 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.955+0000 7f4832ffd640 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1bcbea0 secure :-1 s=READY pgs=988 gs=1 cs=0 l=1 c_cookie=3656073451129221742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4828016040 tx=0x7f4828009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bcfb6edf4b326e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f47fcff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f47fcff9640 1 -- 10.20.193.28:0/155931719 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4828026650 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f47fcff9640 1 -- 10.20.193.28:0/155931719 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4828025c60 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f47fcff9640 1 -- 10.20.193.28:0/155931719 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f48280253e0 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ad1a290e0 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f47fcff9640 1 -- 10.20.193.28:0/155931719 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f4828025570 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f483b7dee00 10 client.18387 _ll_register_callbacks cb 0x555ad1a14a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f481c0acaf0 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f47fcff9640 1 -- 10.20.193.28:0/155931719 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4828026970 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f483b7dee00 10 client.18387 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555ad1a29340 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.956+0000 7f47fcff9640 1 -- 10.20.193.28:0/155931719 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f482804b020 con 0x555ad1b87360 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 10 client.18387 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:32.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 10 client.18387 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 20 client.18387 populate_metadata read hostname 'trial028' 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x555ad1c7a020 0x555ad1c9a400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 4 client.18387 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ad1726f40 con 0x555ad1c7a020 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f48327fc640 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x555ad1c7a020 0x555ad1c9a400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f48327fc640 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x555ad1c7a020 0x555ad1c9a400 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=9163665833381646098 s_cookie=9862441302181200301 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f2be1863718cf12 server_cookie=88de6e1c62a6c1ad in_seq=0 out_seq=0 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f47fcff9640 10 client.18387 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f47fcff9640 1 -- 10.20.193.28:0/155931719 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ad1726f40 con 0x555ad1c7a020 2026-02-20T13:25:32.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f47fcff9640 10 client.18387 handle_command_reply: tid=0 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 client.18387 shutdown 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 msgr2=0x555ad1bcbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1bcbea0 secure :-1 s=READY pgs=988 gs=1 cs=0 l=1 c_cookie=3656073451129221742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4828016040 tx=0x7f4828009f40 comp rx=0 tx=0).stop 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 shutdown_connections 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x555ad1c7a020 0x555ad1c9a400 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=9163665833381646098 s_cookie=9862441302181200301 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555ad1bccb20 0x555ad1b66170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555ad1b87c70 0x555ad1b65c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f47fcff9640 0 client.18387 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 --2- 10.20.193.28:0/155931719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ad1b87360 0x555ad1bcbea0 unknown :-1 s=CLOSED pgs=988 gs=1 cs=0 l=1 c_cookie=3656073451129221742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.957+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 >> 10.20.193.28:0/155931719 conn(0x555ad1b65860 msgr2=0x555ad1be8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 shutdown_connections 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f483b7dee00 1 -- 10.20.193.28:0/155931719 wait complete. 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f483b7dee00 20 client.18387 trim_cache size 0 max 16384 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:25:32.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 -- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48080b5760 msgr2=0x7f48080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48080b5760 0x7f48080d5c10 secure :-1 s=READY pgs=448 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4828004740 tx=0x7f4828005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 -- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f483410c320 msgr2=0x7f48341227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f483410c320 0x7f48341227e0 secure :-1 s=READY pgs=986 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f481c005b30 tx=0x7f481c002c10 comp rx=0 tx=0).stop 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 -- 10.20.193.28:0/3736432925 shutdown_connections 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f48080b5760 0x7f48080d5c10 unknown :-1 s=CLOSED pgs=448 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f483410c320 0x7f48341227e0 unknown :-1 s=CLOSED pgs=986 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4834110f10 0x7f4834127bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 --2- 10.20.193.28:0/3736432925 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f483410b930 0x7f48341222a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.958+0000 7f4833fff640 1 -- 10.20.193.28:0/3736432925 >> 10.20.193.28:0/3736432925 conn(0x7f48340e95c0 msgr2=0x7f48341099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.959+0000 7f4833fff640 1 -- 10.20.193.28:0/3736432925 shutdown_connections 2026-02-20T13:25:32.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:32.959+0000 7f4833fff640 1 -- 10.20.193.28:0/3736432925 wait complete. 2026-02-20T13:25:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:32 trial127 ceph-mon[43817]: pgmap v427: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:25:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:32 trial034 ceph-mon[43332]: pgmap v427: 97 pgs: 97 active+clean; 4.6 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:25:33.059 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:25:33.243 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:33.275 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 -- 10.20.193.28:0/1189073209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010b330 msgr2=0x7fa00010cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.275 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 --2- 10.20.193.28:0/1189073209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010b330 0x7fa00010cf80 secure :-1 s=READY pgs=989 gs=2 cs=0 l=1 c_cookie=5303101320268963709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff000af10 tx=0x7f9ff0030370 comp rx=0 tx=0).stop 2026-02-20T13:25:33.275 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 -- 10.20.193.28:0/1189073209 shutdown_connections 2026-02-20T13:25:33.275 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 --2- 10.20.193.28:0/1189073209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010b330 0x7fa00010cf80 unknown :-1 s=CLOSED pgs=989 gs=2 cs=0 l=1 c_cookie=5303101320268963709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.275 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 --2- 10.20.193.28:0/1189073209 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa00010a980 0x7fa00010adf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 --2- 10.20.193.28:0/1189073209 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa00010c030 0x7fa00010c420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 -- 10.20.193.28:0/1189073209 >> 10.20.193.28:0/1189073209 conn(0x7fa0000e8640 msgr2=0x7fa000108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 -- 10.20.193.28:0/1189073209 shutdown_connections 2026-02-20T13:25:33.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.271+0000 7fa004a1a640 1 -- 10.20.193.28:0/1189073209 wait complete. 2026-02-20T13:25:33.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.272+0000 7fa004a1a640 1 Processor -- start 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.272+0000 7fa004a1a640 1 -- start start 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.272+0000 7fa004a1a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa00010a980 0x7fa0000f3290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.272+0000 7fa004a1a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa00010b330 0x7fa0000f38e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.272+0000 7fa004a1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010c030 0x7fa0000f44e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.272+0000 7fa004a1a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000f4c20 con 0x7fa00010c030 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.272+0000 7fa004a1a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000f4d90 con 0x7fa00010a980 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.272+0000 7fa004a1a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000f4f50 con 0x7fa00010b330 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010c030 0x7fa0000f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9ffe575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa00010b330 0x7fa0000f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010c030 0x7fa0000f44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56610/0 (socket says 10.20.193.28:56610) 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 -- 10.20.193.28:0/3530192247 learned_addr learned my addr 10.20.193.28:0/3530192247 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9ffed76640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa00010a980 0x7fa0000f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 -- 10.20.193.28:0/3530192247 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa00010b330 msgr2=0x7fa0000f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa00010b330 0x7fa0000f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 -- 10.20.193.28:0/3530192247 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa00010a980 msgr2=0x7fa0000f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa00010a980 0x7fa0000f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 -- 10.20.193.28:0/3530192247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe8009570 con 0x7fa00010c030 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fff577640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010c030 0x7fa0000f44e0 secure :-1 s=READY pgs=990 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff0030880 tx=0x7f9ff0005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fdffff640 1 -- 10.20.193.28:0/3530192247 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ff0003990 con 0x7fa00010c030 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fdffff640 1 -- 10.20.193.28:0/3530192247 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9ff004ad10 con 0x7fa00010c030 2026-02-20T13:25:33.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7f9fdffff640 1 -- 10.20.193.28:0/3530192247 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ff0008d00 con 0x7fa00010c030 2026-02-20T13:25:33.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7fa004a1a640 1 -- 10.20.193.28:0/3530192247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff000abb0 con 0x7fa00010c030 2026-02-20T13:25:33.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.273+0000 7fa004a1a640 1 -- 10.20.193.28:0/3530192247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0000561f0 con 0x7fa00010c030 2026-02-20T13:25:33.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.276+0000 7f9fdffff640 1 -- 10.20.193.28:0/3530192247 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9ff004a830 con 0x7fa00010c030 2026-02-20T13:25:33.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.278+0000 7f9fdffff640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9fd40b5760 0x7f9fd40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.278+0000 7f9fdffff640 1 -- 10.20.193.28:0/3530192247 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9ff011dde0 con 0x7fa00010c030 2026-02-20T13:25:33.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.278+0000 7f9ffed76640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9fd40b5760 0x7f9fd40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.278+0000 7fa007808e00 1 Processor -- start 2026-02-20T13:25:33.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7fa007808e00 1 -- start start 2026-02-20T13:25:33.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffed76640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9fd40b5760 0x7f9fd40d5c10 secure :-1 s=READY pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff4004740 tx=0x7f9ff4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7fa007808e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a0866708a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7fa007808e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866911c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7fa007808e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a0866b1ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7fa007808e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a086565fd0 con 0x55a086670de0 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7fa007808e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a086561d00 con 0x55a0866504c0 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7fa007808e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a08655bca0 con 0x55a086691700 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a0866708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a0866708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51256/0 (socket says 10.20.193.28:51256) 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffed76640 1 -- 10.20.193.28:0/1592698954 learned_addr learned my addr 10.20.193.28:0/1592698954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffe575640 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9fff577640 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a0866b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffe575640 1 -- 10.20.193.28:0/1592698954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 msgr2=0x55a0866b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffe575640 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a0866b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffe575640 1 -- 10.20.193.28:0/1592698954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 msgr2=0x55a0866708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.279+0000 7f9ffe575640 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a0866708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7f9ffe575640 1 -- 10.20.193.28:0/1592698954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0864fe8b0 con 0x55a086670de0 2026-02-20T13:25:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7f9ffe575640 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866911c0 secure :-1 s=READY pgs=991 gs=3 cs=0 l=1 c_cookie=16419090812614039905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fe8005e70 tx=0x7f9fe8009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dc541a1cbd5961 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7f9fdd3fe640 1 -- 10.20.193.28:0/1592698954 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fe8002c50 con 0x55a086670de0 2026-02-20T13:25:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7f9fdd3fe640 1 -- 10.20.193.28:0/1592698954 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9fe8002db0 con 0x55a086670de0 2026-02-20T13:25:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7f9fdd3fe640 1 -- 10.20.193.28:0/1592698954 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fe80108e0 con 0x55a086670de0 2026-02-20T13:25:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 -- 10.20.193.28:0/1592698954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 msgr2=0x55a0866911c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866911c0 secure :-1 s=READY pgs=991 gs=3 cs=0 l=1 c_cookie=16419090812614039905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fe8005e70 tx=0x7f9fe8009cc0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 -- 10.20.193.28:0/1592698954 shutdown_connections 2026-02-20T13:25:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866911c0 unknown :-1 s=CLOSED pgs=991 gs=3 cs=0 l=1 c_cookie=16419090812614039905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a0866b1ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 --2- 10.20.193.28:0/1592698954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a0866708a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 -- 10.20.193.28:0/1592698954 >> 10.20.193.28:0/1592698954 conn(0x55a08656f1c0 msgr2=0x55a08664eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 -- 10.20.193.28:0/1592698954 shutdown_connections 2026-02-20T13:25:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.280+0000 7fa007808e00 1 -- 10.20.193.28:0/1592698954 wait complete. 2026-02-20T13:25:33.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.282+0000 7fa007808e00 1 -- start start 2026-02-20T13:25:33.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.282+0000 7fa007808e00 1 Processor -- start 2026-02-20T13:25:33.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.282+0000 7fa007808e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0866504c0 0x55a086669b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.282+0000 7fa007808e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a08666a190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7fa007808e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a08666abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7fa007808e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a08666b250 con 0x55a0866504c0 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7fa007808e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a08666b3c0 con 0x55a086670de0 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7fa007808e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a08666b580 con 0x55a086691700 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9ffe575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a08666a190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9ffe575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a08666a190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51268/0 (socket says 10.20.193.28:51268) 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9ffe575640 1 -- 10.20.193.28:0/1542726268 learned_addr learned my addr 10.20.193.28:0/1542726268 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9fff577640 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a08666abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9ffed76640 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0866504c0 0x55a086669b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9fff577640 1 -- 10.20.193.28:0/1542726268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 msgr2=0x55a08666a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9fff577640 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a08666a190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9fff577640 1 -- 10.20.193.28:0/1542726268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0866504c0 msgr2=0x55a086669b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9fff577640 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0866504c0 0x55a086669b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.283+0000 7f9fff577640 1 -- 10.20.193.28:0/1542726268 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a086507400 con 0x55a086691700 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7f9fff577640 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a08666abf0 secure :-1 s=READY pgs=296 gs=2 cs=0 l=1 c_cookie=11339122000731960649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff011b880 tx=0x7f9ff00087b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5ca761e671f549 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7f9fc8bfc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/1542726268 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ff00ef010 con 0x55a086691700 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/1542726268 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9ff00e3940 con 0x55a086691700 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/1542726268 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ff00e5010 con 0x55a086691700 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe8004350 con 0x55a086691700 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/1542726268 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9ff00ec440 con 0x55a086691700 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7f9fc8bfc640 10 client.28258 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7fa007808e00 10 client.28258 _ll_register_callbacks cb 0x55a0864e6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:33.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0861fb520 con 0x55a086691700 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/1542726268 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9ff0008420 con 0x55a086691700 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7fa007808e00 10 client.28258 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.284+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a0864dfda0 con 0x55a086691700 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.285+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/1542726268 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9ff00a92f0 con 0x55a086691700 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.285+0000 7fa007808e00 10 client.28258 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.285+0000 7fa007808e00 10 client.28258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.285+0000 7fa007808e00 20 client.28258 populate_metadata read hostname 'trial028' 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.285+0000 7fa007808e00 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a08666dd50 0x55a08666e1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.285+0000 7fa007808e00 4 client.28258 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.285+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a08658d630 con 0x55a08666dd50 2026-02-20T13:25:33.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.285+0000 7f9ffed76640 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a08666dd50 0x55a08666e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.286+0000 7f9ffed76640 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a08666dd50 0x55a08666e1f0 crc :-1 s=READY pgs=244 gs=4 cs=0 l=0 c_cookie=6494306872193303771 s_cookie=16776195568417121738 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2069b12375c4db server_cookie=e8d104fc41fc25ca in_seq=0 out_seq=0 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.286+0000 7f9fc8bfc640 10 client.28258 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.286+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/1542726268 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a08658d630 con 0x55a08666dd50 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.286+0000 7f9fc8bfc640 10 client.28258 handle_command_reply: tid=0 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.286+0000 7fa007808e00 1 client.28258 shutdown 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.286+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 msgr2=0x55a08666abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.286+0000 7fa007808e00 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a08666abf0 secure :-1 s=READY pgs=296 gs=2 cs=0 l=1 c_cookie=11339122000731960649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff011b880 tx=0x7f9ff00087b0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 shutdown_connections 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a08666dd50 0x55a08666e1f0 crc :-1 s=READY pgs=244 gs=4 cs=0 l=0 c_cookie=6494306872193303771 s_cookie=16776195568417121738 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a08666abf0 unknown :-1 s=CLOSED pgs=296 gs=2 cs=0 l=1 c_cookie=11339122000731960649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a08666a190 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 1 --2- 10.20.193.28:0/1542726268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0866504c0 0x55a086669b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7f9fc8bfc640 0 client.28258 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 >> 10.20.193.28:0/1542726268 conn(0x55a08656f1c0 msgr2=0x55a086651790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 shutdown_connections 2026-02-20T13:25:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 1 -- 10.20.193.28:0/1542726268 wait complete. 2026-02-20T13:25:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.287+0000 7fa007808e00 20 client.28258 trim_cache size 0 max 16384 2026-02-20T13:25:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7fa007808e00 1 Processor -- start 2026-02-20T13:25:33.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7fa007808e00 1 -- start start 2026-02-20T13:25:33.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7fa007808e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0866504c0 0x55a08666a0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7fa007808e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a086656df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7fa007808e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086691700 0x55a086666e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7fa007808e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0865598d0 con 0x55a086691700 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7fa007808e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a08629af10 con 0x55a086670de0 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7fa007808e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a086625410 con 0x55a0866504c0 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0866504c0 0x55a08666a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0866504c0 0x55a08666a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54650/0 (socket says 10.20.193.28:54650) 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffed76640 1 -- 10.20.193.28:0/2078789934 learned_addr learned my addr 10.20.193.28:0/2078789934 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffe575640 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a086656df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9fff577640 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086691700 0x55a086666e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffed76640 1 -- 10.20.193.28:0/2078789934 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 msgr2=0x55a086656df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffed76640 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a086656df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffed76640 1 -- 10.20.193.28:0/2078789934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086691700 msgr2=0x55a086666e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffed76640 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086691700 0x55a086666e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.295+0000 7f9ffed76640 1 -- 10.20.193.28:0/2078789934 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0864f1670 con 0x55a0866504c0 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.296+0000 7f9ffed76640 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0866504c0 0x55a08666a0c0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=3694739409390401235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff4011cb0 tx=0x7f9ff4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=334659ead259f6d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.296+0000 7f9fdcbfd640 1 -- 10.20.193.28:0/2078789934 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ff4021030 con 0x55a0866504c0 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.296+0000 7f9fdcbfd640 1 -- 10.20.193.28:0/2078789934 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9ff4022040 con 0x55a0866504c0 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.296+0000 7f9fdcbfd640 1 -- 10.20.193.28:0/2078789934 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ff402a880 con 0x55a0866504c0 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 -- 10.20.193.28:0/2078789934 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0866504c0 msgr2=0x55a08666a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0866504c0 0x55a08666a0c0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=3694739409390401235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff4011cb0 tx=0x7f9ff4014000 comp rx=0 tx=0).stop 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 -- 10.20.193.28:0/2078789934 shutdown_connections 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086691700 0x55a086666e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a086670de0 0x55a086656df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 --2- 10.20.193.28:0/2078789934 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0866504c0 0x55a08666a0c0 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=3694739409390401235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 -- 10.20.193.28:0/2078789934 >> 10.20.193.28:0/2078789934 conn(0x55a08656f1c0 msgr2=0x55a0866699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 -- 10.20.193.28:0/2078789934 shutdown_connections 2026-02-20T13:25:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 -- 10.20.193.28:0/2078789934 wait complete. 2026-02-20T13:25:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 -- start start 2026-02-20T13:25:33.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.297+0000 7fa007808e00 1 Processor -- start 2026-02-20T13:25:33.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7fa007808e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a086672130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7fa007808e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866727d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7fa007808e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a086673320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7fa007808e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0866739d0 con 0x55a086670de0 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7fa007808e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a086673b40 con 0x55a0866504c0 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7fa007808e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a086673d00 con 0x55a086691700 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a086672130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffed76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a086672130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51286/0 (socket says 10.20.193.28:51286) 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffed76640 1 -- 10.20.193.28:0/656908858 learned_addr learned my addr 10.20.193.28:0/656908858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9fff577640 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a086673320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffed76640 1 -- 10.20.193.28:0/656908858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 msgr2=0x55a086673320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffed76640 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a086673320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffed76640 1 -- 10.20.193.28:0/656908858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 msgr2=0x55a0866727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffed76640 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffed76640 1 -- 10.20.193.28:0/656908858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0864ec0f0 con 0x55a0866504c0 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.298+0000 7f9ffe575640 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866727d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7f9ffed76640 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a086672130 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=7947545990525300406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff4005900 tx=0x7f9ff4005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4b5af871572eb6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7f9fc8bfc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/656908858 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ff4021050 con 0x55a0866504c0 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/656908858 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9ff4003b90 con 0x55a0866504c0 2026-02-20T13:25:33.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff4004040 con 0x55a0866504c0 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/656908858 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ff40339c0 con 0x55a0866504c0 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7fa007808e00 10 client.28364 _ll_register_callbacks cb 0x55a0864e6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a08660bca0 con 0x55a0866504c0 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/656908858 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9ff4033b50 con 0x55a0866504c0 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/656908858 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9ff4033d10 con 0x55a0866504c0 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7fa007808e00 10 client.28364 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.299+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a0864e00d0 con 0x55a0866504c0 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.300+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/656908858 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9ff4027040 con 0x55a0866504c0 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.300+0000 7fa007808e00 10 client.28364 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.300+0000 7fa007808e00 10 client.28364 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.300+0000 7fa007808e00 20 client.28364 populate_metadata read hostname 'trial028' 2026-02-20T13:25:33.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.300+0000 7fa007808e00 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a086675c70 0x55a086676110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.300+0000 7fa007808e00 4 client.28364 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:25:33.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.300+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a08623f640 con 0x55a086675c70 2026-02-20T13:25:33.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.303+0000 7f9ffe575640 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a086675c70 0x55a086676110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.303+0000 7f9ffe575640 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a086675c70 0x55a086676110 crc :-1 s=READY pgs=245 gs=4 cs=0 l=0 c_cookie=16691433396964449375 s_cookie=15890838283020561271 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7a3e23d52285c5f server_cookie=dc879939a29e6b77 in_seq=0 out_seq=0 2026-02-20T13:25:33.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.303+0000 7f9fc8bfc640 10 client.28364 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:33.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.308+0000 7f9fc8bfc640 1 -- 10.20.193.28:0/656908858 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a08623f640 con 0x55a086675c70 2026-02-20T13:25:33.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.308+0000 7f9fc8bfc640 10 client.28364 handle_command_reply: tid=0 2026-02-20T13:25:33.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.308+0000 7fa007808e00 1 client.28364 shutdown 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.308+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 msgr2=0x55a086672130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.308+0000 7fa007808e00 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a086672130 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=7947545990525300406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff4005900 tx=0x7f9ff4005780 comp rx=0 tx=0).stop 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 shutdown_connections 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a086675c70 0x55a086676110 crc :-1 s=READY pgs=245 gs=4 cs=0 l=0 c_cookie=16691433396964449375 s_cookie=15890838283020561271 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a086670de0 0x55a0866727d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a086691700 0x55a086673320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 1 --2- 10.20.193.28:0/656908858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0866504c0 0x55a086672130 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=7947545990525300406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7f9fc8bfc640 0 client.28364 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 >> 10.20.193.28:0/656908858 conn(0x55a08656f1c0 msgr2=0x55a086669fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 shutdown_connections 2026-02-20T13:25:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 1 -- 10.20.193.28:0/656908858 wait complete. 2026-02-20T13:25:33.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa007808e00 20 client.28364 trim_cache size 0 max 16384 2026-02-20T13:25:33.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:25:33.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:25:33.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:25:33.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:25:33.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 -- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9fd40b5760 msgr2=0x7f9fd40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9fd40b5760 0x7f9fd40d5c10 secure :-1 s=READY pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff4004740 tx=0x7f9ff4005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:33.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 -- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010c030 msgr2=0x7fa0000f44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010c030 0x7fa0000f44e0 secure :-1 s=READY pgs=990 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ff0030880 tx=0x7f9ff0005270 comp rx=0 tx=0).stop 2026-02-20T13:25:33.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 -- 10.20.193.28:0/3530192247 shutdown_connections 2026-02-20T13:25:33.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9fd40b5760 0x7f9fd40d5c10 unknown :-1 s=CLOSED pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00010c030 0x7fa0000f44e0 unknown :-1 s=CLOSED pgs=990 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa00010b330 0x7fa0000f38e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 --2- 10.20.193.28:0/3530192247 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa00010a980 0x7fa0000f3290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 -- 10.20.193.28:0/3530192247 >> 10.20.193.28:0/3530192247 conn(0x7fa0000e8640 msgr2=0x7fa000109a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 -- 10.20.193.28:0/3530192247 shutdown_connections 2026-02-20T13:25:33.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:33.309+0000 7fa004a1a640 1 -- 10.20.193.28:0/3530192247 wait complete. 2026-02-20T13:25:33.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 -- 10.20.193.28:0/2991592086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc115110 msgr2=0x7fb5fc119620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 --2- 10.20.193.28:0/2991592086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc115110 0x7fb5fc119620 secure :-1 s=READY pgs=992 gs=1 cs=0 l=1 c_cookie=12009959802906531069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e4009950 tx=0x7fb5e402f190 comp rx=0 tx=0).stop 2026-02-20T13:25:33.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 -- 10.20.193.28:0/2991592086 shutdown_connections 2026-02-20T13:25:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 --2- 10.20.193.28:0/2991592086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc115110 0x7fb5fc119620 unknown :-1 s=CLOSED pgs=992 gs=1 cs=0 l=1 c_cookie=12009959802906531069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 --2- 10.20.193.28:0/2991592086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5fc119d10 0x7fb5fc11a6e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 --2- 10.20.193.28:0/2991592086 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5fc114800 0x7fb5fc114bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 -- 10.20.193.28:0/2991592086 >> 10.20.193.28:0/2991592086 conn(0x7fb5fc058ff0 msgr2=0x7fb5fc0593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 -- 10.20.193.28:0/2991592086 shutdown_connections 2026-02-20T13:25:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.420+0000 7fb600dfc640 1 -- 10.20.193.28:0/2991592086 wait complete. 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.421+0000 7fb600dfc640 1 Processor -- start 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.421+0000 7fb600dfc640 1 -- start start 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.421+0000 7fb600dfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc114800 0x7fb5fc12b7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.421+0000 7fb600dfc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5fc115110 0x7fb5fc12bce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.421+0000 7fb600dfc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5fc119d10 0x7fb5fc131060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.421+0000 7fb600dfc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc131680 con 0x7fb5fc114800 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.421+0000 7fb600dfc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc1317f0 con 0x7fb5fc119d10 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.421+0000 7fb600dfc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc1319b0 con 0x7fb5fc115110 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc114800 0x7fb5fc12b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc114800 0x7fb5fc12b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56642/0 (socket says 10.20.193.28:56642) 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 -- 10.20.193.28:0/3187960131 learned_addr learned my addr 10.20.193.28:0/3187960131 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5f9d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5fc115110 0x7fb5fc12bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5fc119d10 0x7fb5fc131060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 -- 10.20.193.28:0/3187960131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5fc115110 msgr2=0x7fb5fc12bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5fc115110 0x7fb5fc12bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 -- 10.20.193.28:0/3187960131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5fc119d10 msgr2=0x7fb5fc131060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5fc119d10 0x7fb5fc131060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 -- 10.20.193.28:0/3187960131 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e4009570 con 0x7fb5fc114800 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5fa575640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc114800 0x7fb5fc12b7a0 secure :-1 s=READY pgs=993 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f0009480 tx=0x7fb5f000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5e37fe640 1 -- 10.20.193.28:0/3187960131 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5f000cd40 con 0x7fb5fc114800 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5e37fe640 1 -- 10.20.193.28:0/3187960131 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5f0004d30 con 0x7fb5fc114800 2026-02-20T13:25:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb5e37fe640 1 -- 10.20.193.28:0/3187960131 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5f00106b0 con 0x7fb5fc114800 2026-02-20T13:25:33.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb600dfc640 1 -- 10.20.193.28:0/3187960131 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc131c90 con 0x7fb5fc114800 2026-02-20T13:25:33.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.422+0000 7fb600dfc640 1 -- 10.20.193.28:0/3187960131 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc172390 con 0x7fb5fc114800 2026-02-20T13:25:33.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.425+0000 7fb5e37fe640 1 -- 10.20.193.28:0/3187960131 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb5f001f060 con 0x7fb5fc114800 2026-02-20T13:25:33.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.427+0000 7fb5e37fe640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5d40b5760 0x7fb5d40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.427+0000 7fb5e37fe640 1 -- 10.20.193.28:0/3187960131 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5f0014070 con 0x7fb5fc114800 2026-02-20T13:25:33.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.427+0000 7fb5f9d74640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5d40b5760 0x7fb5d40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb602df6e00 1 Processor -- start 2026-02-20T13:25:33.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb602df6e00 1 -- start start 2026-02-20T13:25:33.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458360 0x55c945458730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458c70 0x55c94549d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c94549db20 0x55c9454bdf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb602df6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c94536e780 con 0x55c945458c70 2026-02-20T13:25:33.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb602df6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c94536a4b0 con 0x55c945458360 2026-02-20T13:25:33.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb602df6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c945364450 con 0x55c94549db20 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5f9d74640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5d40b5760 0x7fb5d40d5c10 secure :-1 s=READY pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5fc1320f0 tx=0x7fb5e403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5f9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458c70 0x55c94549d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fa575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458360 0x55c945458730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fa575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458360 0x55c945458730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51304/0 (socket says 10.20.193.28:51304) 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fa575640 1 -- 10.20.193.28:0/2914143377 learned_addr learned my addr 10.20.193.28:0/2914143377 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fad76640 1 --2- 10.20.193.28:0/2914143377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c94549db20 0x55c9454bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fa575640 1 -- 10.20.193.28:0/2914143377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c94549db20 msgr2=0x55c9454bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fa575640 1 --2- 10.20.193.28:0/2914143377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c94549db20 0x55c9454bdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fa575640 1 -- 10.20.193.28:0/2914143377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458c70 msgr2=0x55c94549d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fa575640 1 --2- 10.20.193.28:0/2914143377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458c70 0x55c94549d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.428+0000 7fb5fa575640 1 -- 10.20.193.28:0/2914143377 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94530fd10 con 0x55c945458360 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb5fa575640 1 --2- 10.20.193.28:0/2914143377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458360 0x55c945458730 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=6643984786863458286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f0004f50 tx=0x7fb5f00093a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c342cf65a1887ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb5e0ff9640 1 -- 10.20.193.28:0/2914143377 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5f00ac780 con 0x55c945458360 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb5e0ff9640 1 -- 10.20.193.28:0/2914143377 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5f00ad980 con 0x55c945458360 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb5e0ff9640 1 -- 10.20.193.28:0/2914143377 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5f00acb20 con 0x55c945458360 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 -- 10.20.193.28:0/2914143377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458360 msgr2=0x55c945458730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 --2- 10.20.193.28:0/2914143377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458360 0x55c945458730 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=6643984786863458286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f0004f50 tx=0x7fb5f00093a0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 -- 10.20.193.28:0/2914143377 shutdown_connections 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 --2- 10.20.193.28:0/2914143377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458c70 0x55c94549d5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 --2- 10.20.193.28:0/2914143377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c94549db20 0x55c9454bdf00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 --2- 10.20.193.28:0/2914143377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458360 0x55c945458730 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=6643984786863458286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 -- 10.20.193.28:0/2914143377 >> 10.20.193.28:0/2914143377 conn(0x55c945436860 msgr2=0x55c945456c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 -- 10.20.193.28:0/2914143377 shutdown_connections 2026-02-20T13:25:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.429+0000 7fb602df6e00 1 -- 10.20.193.28:0/2914143377 wait complete. 2026-02-20T13:25:33.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.430+0000 7fb602df6e00 1 -- start start 2026-02-20T13:25:33.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb602df6e00 1 Processor -- start 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 0x55c9454b56b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c9454b5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454babe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb602df6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9454bb120 con 0x55c94549db20 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb602df6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c9454bb290 con 0x55c945458c70 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb602df6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c9454bb450 con 0x55c945458360 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5f9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c9454b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5fad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454babe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5fa575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 0x55c9454b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5f9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c9454b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51312/0 (socket says 10.20.193.28:51312) 2026-02-20T13:25:33.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5f9d74640 1 -- 10.20.193.28:0/1993977717 learned_addr learned my addr 10.20.193.28:0/1993977717 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5fad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454babe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56660/0 (socket says 10.20.193.28:56660) 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5fad76640 1 -- 10.20.193.28:0/1993977717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 msgr2=0x55c9454b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5fad76640 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 0x55c9454b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5fad76640 1 -- 10.20.193.28:0/1993977717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 msgr2=0x55c9454b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.431+0000 7fb5fad76640 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c9454b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb5fad76640 1 -- 10.20.193.28:0/1993977717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9452e83c0 con 0x55c94549db20 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb5fad76640 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454babe0 secure :-1 s=READY pgs=994 gs=3 cs=0 l=1 c_cookie=12274513452505949390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5ec005820 tx=0x7fb5ec014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa57d4f3af5ee4ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb5abfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb5abfff640 1 -- 10.20.193.28:0/1993977717 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5ec005b50 con 0x55c94549db20 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb5abfff640 1 -- 10.20.193.28:0/1993977717 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5ec003e20 con 0x55c94549db20 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc172390 con 0x55c94549db20 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb5abfff640 1 -- 10.20.193.28:0/1993977717 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5ec026b10 con 0x55c94549db20 2026-02-20T13:25:33.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb602df6e00 10 client.18414 _ll_register_callbacks cb 0x55c9452e5a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c944ffa6f0 con 0x55c94549db20 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb5abfff640 1 -- 10.20.193.28:0/1993977717 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5ec026ca0 con 0x55c94549db20 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb5abfff640 1 -- 10.20.193.28:0/1993977717 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb5ec011420 con 0x55c94549db20 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb602df6e00 10 client.18414 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.432+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c9452fa0e0 con 0x55c94549db20 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb5abfff640 1 -- 10.20.193.28:0/1993977717 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb5ec02e420 con 0x55c94549db20 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb602df6e00 10 client.18414 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb602df6e00 10 client.18414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb602df6e00 20 client.18414 populate_metadata read hostname 'trial028' 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb602df6e00 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c9454bdd20 0x55c94549b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb602df6e00 4 client.18414 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:33.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c945306f80 con 0x55c9454bdd20 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb5fa575640 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c9454bdd20 0x55c94549b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb5fa575640 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c9454bdd20 0x55c94549b8a0 crc :-1 s=READY pgs=246 gs=4 cs=0 l=0 c_cookie=1279028313105307003 s_cookie=8211342465824947757 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11c00579644f157b server_cookie=71f48c7794937e2d in_seq=0 out_seq=0 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.433+0000 7fb5abfff640 10 client.18414 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb5abfff640 1 -- 10.20.193.28:0/1993977717 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c945306f80 con 0x55c9454bdd20 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb5abfff640 10 client.18414 handle_command_reply: tid=0 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 client.18414 shutdown 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 msgr2=0x55c9454babe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454babe0 secure :-1 s=READY pgs=994 gs=3 cs=0 l=1 c_cookie=12274513452505949390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5ec005820 tx=0x7fb5ec014830 comp rx=0 tx=0).stop 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 shutdown_connections 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c9454bdd20 0x55c94549b8a0 crc :-1 s=READY pgs=246 gs=4 cs=0 l=0 c_cookie=1279028313105307003 s_cookie=8211342465824947757 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454babe0 unknown :-1 s=CLOSED pgs=994 gs=3 cs=0 l=1 c_cookie=12274513452505949390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c9454b5bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 --2- 10.20.193.28:0/1993977717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 0x55c9454b56b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 >> 10.20.193.28:0/1993977717 conn(0x55c945436860 msgr2=0x55c945456c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb5abfff640 0 client.18414 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:33.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 shutdown_connections 2026-02-20T13:25:33.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 1 -- 10.20.193.28:0/1993977717 wait complete. 2026-02-20T13:25:33.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.434+0000 7fb602df6e00 20 client.18414 trim_cache size 0 max 16384 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb602df6e00 1 Processor -- start 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb602df6e00 1 -- start start 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 0x55c945498780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c945498cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454b2770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb602df6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9454a79e0 con 0x55c94549db20 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb602df6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c945362080 con 0x55c945458c70 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb602df6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c945022700 con 0x55c945458360 2026-02-20T13:25:33.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb5f9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c945498cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb5fad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb5f9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c945498cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51322/0 (socket says 10.20.193.28:51322) 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb5f9d74640 1 -- 10.20.193.28:0/78782197 learned_addr learned my addr 10.20.193.28:0/78782197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb5fa575640 1 --2- 10.20.193.28:0/78782197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 0x55c945498780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb5fad76640 1 -- 10.20.193.28:0/78782197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 msgr2=0x55c945498780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.443+0000 7fb5fad76640 1 --2- 10.20.193.28:0/78782197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 0x55c945498780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb5fad76640 1 -- 10.20.193.28:0/78782197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 msgr2=0x55c945498cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb5fad76640 1 --2- 10.20.193.28:0/78782197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c945498cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb5fad76640 1 -- 10.20.193.28:0/78782197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9452f4b60 con 0x55c94549db20 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb5fad76640 1 --2- 10.20.193.28:0/78782197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454b2770 secure :-1 s=READY pgs=995 gs=2 cs=0 l=1 c_cookie=10741782423040823767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5ec02ec50 tx=0x7fb5ec036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95127a338be211d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb5c64e6640 1 -- 10.20.193.28:0/78782197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5ec03c030 con 0x55c94549db20 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb5c64e6640 1 -- 10.20.193.28:0/78782197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5ec03d040 con 0x55c94549db20 2026-02-20T13:25:33.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb5c64e6640 1 -- 10.20.193.28:0/78782197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5ec036c00 con 0x55c94549db20 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 -- 10.20.193.28:0/78782197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 msgr2=0x55c9454b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 --2- 10.20.193.28:0/78782197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454b2770 secure :-1 s=READY pgs=995 gs=2 cs=0 l=1 c_cookie=10741782423040823767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5ec02ec50 tx=0x7fb5ec036000 comp rx=0 tx=0).stop 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 -- 10.20.193.28:0/78782197 shutdown_connections 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 --2- 10.20.193.28:0/78782197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c94549db20 0x55c9454b2770 unknown :-1 s=CLOSED pgs=995 gs=2 cs=0 l=1 c_cookie=10741782423040823767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 --2- 10.20.193.28:0/78782197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c945458c70 0x55c945498cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 --2- 10.20.193.28:0/78782197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458360 0x55c945498780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 -- 10.20.193.28:0/78782197 >> 10.20.193.28:0/78782197 conn(0x55c945436860 msgr2=0x55c9454b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 -- 10.20.193.28:0/78782197 shutdown_connections 2026-02-20T13:25:33.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.444+0000 7fb602df6e00 1 -- 10.20.193.28:0/78782197 wait complete. 2026-02-20T13:25:33.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.445+0000 7fb602df6e00 1 -- start start 2026-02-20T13:25:33.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.445+0000 7fb602df6e00 1 Processor -- start 2026-02-20T13:25:33.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.445+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458360 0x55c945438060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.445+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458c70 0x55c9454385a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.445+0000 7fb602df6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c94549db20 0x55c945438ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.445+0000 7fb602df6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9454362a0 con 0x55c945458360 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.445+0000 7fb602df6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c945503800 con 0x55c94549db20 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.445+0000 7fb602df6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c9455039c0 con 0x55c945458c70 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5f9d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458c70 0x55c9454385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458360 0x55c945438060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c94549db20 0x55c945438ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458360 0x55c945438060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56676/0 (socket says 10.20.193.28:56676) 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 -- 10.20.193.28:0/3895075024 learned_addr learned my addr 10.20.193.28:0/3895075024 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 -- 10.20.193.28:0/3895075024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458c70 msgr2=0x55c9454385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458c70 0x55c9454385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 -- 10.20.193.28:0/3895075024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c94549db20 msgr2=0x55c945438ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c94549db20 0x55c945438ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 -- 10.20.193.28:0/3895075024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9452e86f0 con 0x55c945458360 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5fa575640 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458360 0x55c945438060 secure :-1 s=READY pgs=996 gs=1 cs=0 l=1 c_cookie=2264501204184179101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f00af210 tx=0x7fb5f00adaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6d1fd8ecd7a19d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5abfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.446+0000 7fb5abfff640 1 -- 10.20.193.28:0/3895075024 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5f00b2ca0 con 0x55c945458360 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb5abfff640 1 -- 10.20.193.28:0/3895075024 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5f00b5280 con 0x55c945458360 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9452fa0e0 con 0x55c945458360 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb5abfff640 1 -- 10.20.193.28:0/3895075024 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5f00d20b0 con 0x55c945458360 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 10 client.18420 _ll_register_callbacks cb 0x55c9452e5a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f00ad980 con 0x55c945458360 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb5abfff640 1 -- 10.20.193.28:0/3895075024 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5f00d2240 con 0x55c945458360 2026-02-20T13:25:33.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb5abfff640 1 -- 10.20.193.28:0/3895075024 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb5f00b7c30 con 0x55c945458360 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 10 client.18420 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c9452fa340 con 0x55c945458360 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb5abfff640 1 -- 10.20.193.28:0/3895075024 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb5f00b7040 con 0x55c945458360 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 10 client.18420 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 10 client.18420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 20 client.18420 populate_metadata read hostname 'trial028' 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c94554b610 0x55c94556bac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 4 client.18420 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c944ff7f40 con 0x55c94554b610 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.447+0000 7fb5f9d74640 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c94554b610 0x55c94556bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb5f9d74640 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c94554b610 0x55c94556bac0 crc :-1 s=READY pgs=247 gs=4 cs=0 l=0 c_cookie=5537137961924170030 s_cookie=2881734521692986237 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd7dda3acd2112e server_cookie=27fdfa47867d9b7d in_seq=0 out_seq=0 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb5abfff640 10 client.18420 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:33.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb5abfff640 1 -- 10.20.193.28:0/3895075024 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c944ff7f40 con 0x55c94554b610 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb5abfff640 10 client.18420 handle_command_reply: tid=0 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb602df6e00 1 client.18420 shutdown 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458360 msgr2=0x55c945438060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb602df6e00 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458360 0x55c945438060 secure :-1 s=READY pgs=996 gs=1 cs=0 l=1 c_cookie=2264501204184179101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f00af210 tx=0x7fb5f00adaf0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 shutdown_connections 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb602df6e00 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c94554b610 0x55c94556bac0 crc :-1 s=READY pgs=247 gs=4 cs=0 l=0 c_cookie=5537137961924170030 s_cookie=2881734521692986237 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb602df6e00 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c94549db20 0x55c945438ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb602df6e00 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c945458c70 0x55c9454385a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.448+0000 7fb602df6e00 1 --2- 10.20.193.28:0/3895075024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c945458360 0x55c945438060 unknown :-1 s=CLOSED pgs=996 gs=1 cs=0 l=1 c_cookie=2264501204184179101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb5abfff640 0 client.18420 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 >> 10.20.193.28:0/3895075024 conn(0x55c945436860 msgr2=0x55c9454b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 shutdown_connections 2026-02-20T13:25:33.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb602df6e00 1 -- 10.20.193.28:0/3895075024 wait complete. 2026-02-20T13:25:33.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb602df6e00 20 client.18420 trim_cache size 0 max 16384 2026-02-20T13:25:33.458 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:25:33.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 -- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5d40b5760 msgr2=0x7fb5d40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5d40b5760 0x7fb5d40d5c10 secure :-1 s=READY pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5fc1320f0 tx=0x7fb5e403a040 comp rx=0 tx=0).stop 2026-02-20T13:25:33.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 -- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc114800 msgr2=0x7fb5fc12b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:33.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc114800 0x7fb5fc12b7a0 secure :-1 s=READY pgs=993 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f0009480 tx=0x7fb5f000ee60 comp rx=0 tx=0).stop 2026-02-20T13:25:33.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 -- 10.20.193.28:0/3187960131 shutdown_connections 2026-02-20T13:25:33.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5d40b5760 0x7fb5d40d5c10 unknown :-1 s=CLOSED pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5fc119d10 0x7fb5fc131060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5fc115110 0x7fb5fc12bce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 --2- 10.20.193.28:0/3187960131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5fc114800 0x7fb5fc12b7a0 unknown :-1 s=CLOSED pgs=993 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:33.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.449+0000 7fb600dfc640 1 -- 10.20.193.28:0/3187960131 >> 10.20.193.28:0/3187960131 conn(0x7fb5fc058ff0 msgr2=0x7fb5fc116330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:33.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.450+0000 7fb600dfc640 1 -- 10.20.193.28:0/3187960131 shutdown_connections 2026-02-20T13:25:33.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:33.450+0000 7fb600dfc640 1 -- 10.20.193.28:0/3187960131 wait complete. 2026-02-20T13:25:34.552 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:25:34.552 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:25:34.737 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:34.870 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:34 trial028 ceph-mon[37442]: pgmap v428: 97 pgs: 97 active+clean; 4.7 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:25:34.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 -- 10.20.193.28:0/1864663704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71e00614f0 msgr2=0x7f71e0061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 --2- 10.20.193.28:0/1864663704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71e00614f0 0x7f71e0061920 secure :-1 s=READY pgs=997 gs=1 cs=0 l=1 c_cookie=4998931443457862977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8009950 tx=0x7f71c802f190 comp rx=0 tx=0).stop 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 -- 10.20.193.28:0/1864663704 shutdown_connections 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 --2- 10.20.193.28:0/1864663704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71e00614f0 0x7f71e0061920 unknown :-1 s=CLOSED pgs=997 gs=1 cs=0 l=1 c_cookie=4998931443457862977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 --2- 10.20.193.28:0/1864663704 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f71e0159d80 0x7f71e017a160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 --2- 10.20.193.28:0/1864663704 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f71e0062ae0 0x7f71e0060fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 -- 10.20.193.28:0/1864663704 >> 10.20.193.28:0/1864663704 conn(0x7f71e00eab00 msgr2=0x7f71e010af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 -- 10.20.193.28:0/1864663704 shutdown_connections 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.913+0000 7f71e4837640 1 -- 10.20.193.28:0/1864663704 wait complete. 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.914+0000 7f71e4837640 1 Processor -- start 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.914+0000 7f71e4837640 1 -- start start 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.914+0000 7f71e4837640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f71e00614f0 0x7f71e00f2e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.914+0000 7f71e4837640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f71e0062ae0 0x7f71e00f33d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.914+0000 7f71e4837640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71e0159d80 0x7f71e00f87a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.914+0000 7f71e4837640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71e00f8dc0 con 0x7f71e0159d80 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.914+0000 7f71e4837640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f71e00f8f30 con 0x7f71e00614f0 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.914+0000 7f71e4837640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f71e00f90f0 con 0x7f71e0062ae0 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f71e00614f0 0x7f71e00f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f71e00614f0 0x7f71e00f2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51338/0 (socket says 10.20.193.28:51338) 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 -- 10.20.193.28:0/671458298 learned_addr learned my addr 10.20.193.28:0/671458298 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71df577640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71e0159d80 0x7f71e00f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71de575640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f71e0062ae0 0x7f71e00f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 -- 10.20.193.28:0/671458298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f71e0062ae0 msgr2=0x7f71e00f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f71e0062ae0 0x7f71e00f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 -- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71e0159d80 msgr2=0x7f71e00f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71e0159d80 0x7f71e00f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 -- 10.20.193.28:0/671458298 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c8009570 con 0x7f71e00614f0 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71ded76640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f71e00614f0 0x7f71e00f2e90 secure :-1 s=READY pgs=361 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d4009480 tx=0x7f71d400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.915+0000 7f71bffff640 1 -- 10.20.193.28:0/671458298 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d400cd40 con 0x7f71e00614f0 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.916+0000 7f71bffff640 1 -- 10.20.193.28:0/671458298 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71d4004d30 con 0x7f71e00614f0 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.916+0000 7f71bffff640 1 -- 10.20.193.28:0/671458298 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d40106b0 con 0x7f71e00614f0 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.916+0000 7f71e4837640 1 -- 10.20.193.28:0/671458298 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e00f93d0 con 0x7f71e00614f0 2026-02-20T13:25:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.916+0000 7f71e4837640 1 -- 10.20.193.28:0/671458298 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e00f9ab0 con 0x7f71e00614f0 2026-02-20T13:25:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.919+0000 7f71bffff640 1 -- 10.20.193.28:0/671458298 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f71d401f060 con 0x7f71e00614f0 2026-02-20T13:25:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.920+0000 7f71bffff640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71b40b5760 0x7f71b40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.920+0000 7f71bffff640 1 -- 10.20.193.28:0/671458298 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f71d4014070 con 0x7f71e00614f0 2026-02-20T13:25:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.920+0000 7f71de575640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71b40b5760 0x7f71b40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.921+0000 7f71de575640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71b40b5760 0x7f71b40d5c10 secure :-1 s=READY pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71e00f9830 tx=0x7f71c803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.921+0000 7f71e7032e00 1 Processor -- start 2026-02-20T13:25:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.921+0000 7f71e7032e00 1 -- start start 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5410 0x56187c9a57e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9ea480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187ca0ada0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71e7032e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56187c8bba20 con 0x56187c9a5410 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71e7032e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56187c8b7750 con 0x56187c9a5d20 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71e7032e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56187c8b16f0 con 0x56187c9ea9c0 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5410 0x56187c9a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5410 0x56187c9a57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56706/0 (socket says 10.20.193.28:56706) 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 -- 10.20.193.28:0/763342755 learned_addr learned my addr 10.20.193.28:0/763342755 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71de575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71df577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187ca0ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 -- 10.20.193.28:0/763342755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 msgr2=0x56187ca0ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:34.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 --2- 10.20.193.28:0/763342755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187ca0ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 -- 10.20.193.28:0/763342755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 msgr2=0x56187c9ea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 --2- 10.20.193.28:0/763342755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9ea480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 -- 10.20.193.28:0/763342755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187c85d120 con 0x56187c9a5410 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.922+0000 7f71ded76640 1 --2- 10.20.193.28:0/763342755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5410 0x56187c9a57e0 secure :-1 s=READY pgs=998 gs=1 cs=0 l=1 c_cookie=12921269519609169550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d40058d0 tx=0x7f71d4009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b351922b1363068e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71ab7fe640 1 -- 10.20.193.28:0/763342755 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d40ac780 con 0x56187c9a5410 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71ab7fe640 1 -- 10.20.193.28:0/763342755 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71d40ad980 con 0x56187c9a5410 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71ab7fe640 1 -- 10.20.193.28:0/763342755 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d40a9380 con 0x56187c9a5410 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 -- 10.20.193.28:0/763342755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5410 msgr2=0x56187c9a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 --2- 10.20.193.28:0/763342755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5410 0x56187c9a57e0 secure :-1 s=READY pgs=998 gs=1 cs=0 l=1 c_cookie=12921269519609169550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d40058d0 tx=0x7f71d4009380 comp rx=0 tx=0).stop 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 -- 10.20.193.28:0/763342755 shutdown_connections 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 --2- 10.20.193.28:0/763342755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187ca0ada0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 --2- 10.20.193.28:0/763342755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9ea480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 --2- 10.20.193.28:0/763342755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5410 0x56187c9a57e0 unknown :-1 s=CLOSED pgs=998 gs=1 cs=0 l=1 c_cookie=12921269519609169550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 -- 10.20.193.28:0/763342755 >> 10.20.193.28:0/763342755 conn(0x56187c983910 msgr2=0x56187c9a3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 -- 10.20.193.28:0/763342755 shutdown_connections 2026-02-20T13:25:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.923+0000 7f71e7032e00 1 -- 10.20.193.28:0/763342755 wait complete. 2026-02-20T13:25:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.924+0000 7f71e7032e00 1 -- start start 2026-02-20T13:25:34.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.924+0000 7f71e7032e00 1 Processor -- start 2026-02-20T13:25:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9bdd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5d20 0x56187c9be280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187c9c3270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71e7032e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56187c9c37b0 con 0x56187c9a5d20 2026-02-20T13:25:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71e7032e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56187c9c3920 con 0x56187c9a5410 2026-02-20T13:25:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71e7032e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56187c9c3ae0 con 0x56187c9ea9c0 2026-02-20T13:25:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71de575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5d20 0x56187c9be280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71de575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5d20 0x56187c9be280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56718/0 (socket says 10.20.193.28:56718) 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71de575640 1 -- 10.20.193.28:0/4262839195 learned_addr learned my addr 10.20.193.28:0/4262839195 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71ded76640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71df577640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187c9c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71de575640 1 -- 10.20.193.28:0/4262839195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 msgr2=0x56187c9c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71de575640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187c9c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71de575640 1 -- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 msgr2=0x56187c9bdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71de575640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9bdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.925+0000 7f71de575640 1 -- 10.20.193.28:0/4262839195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187c835810 con 0x56187c9a5d20 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71df577640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187c9c3270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71ded76640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9bdd40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71de575640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5d20 0x56187c9be280 secure :-1 s=READY pgs=999 gs=1 cs=0 l=1 c_cookie=11717387508735064048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8009950 tx=0x7f71c8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29c85db99c0b7f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:34.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71a8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71a8ff9640 1 -- 10.20.193.28:0/4262839195 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71c8038d50 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e00f9ab0 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71e7032e00 10 client.18432 _ll_register_callbacks cb 0x56187c868b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56187c5479d0 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71a8ff9640 1 -- 10.20.193.28:0/4262839195 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71c803e040 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.926+0000 7f71a8ff9640 1 -- 10.20.193.28:0/4262839195 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71c8050670 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71a8ff9640 1 -- 10.20.193.28:0/4262839195 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f71c8044e20 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71a8ff9640 1 -- 10.20.193.28:0/4262839195 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f71c80043a0 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71e7032e00 10 client.18432 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56187c8474f0 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71a8ff9640 1 -- 10.20.193.28:0/4262839195 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f71c804f070 con 0x56187c9a5d20 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71e7032e00 10 client.18432 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71e7032e00 10 client.18432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71e7032e00 20 client.18432 populate_metadata read hostname 'trial028' 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71e7032e00 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56187c9e85c0 0x56187c9e8a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71e7032e00 4 client.18432 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56187c8bedf0 con 0x56187c9e85c0 2026-02-20T13:25:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.927+0000 7f71ded76640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56187c9e85c0 0x56187c9e8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.928+0000 7f71ded76640 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56187c9e85c0 0x56187c9e8a60 crc :-1 s=READY pgs=248 gs=4 cs=0 l=0 c_cookie=1214104692856146441 s_cookie=15857704047554095615 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10d95dc919d34a09 server_cookie=dc11e1d043bc69ff in_seq=0 out_seq=0 2026-02-20T13:25:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.928+0000 7f71a8ff9640 10 client.18432 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.928+0000 7f71a8ff9640 1 -- 10.20.193.28:0/4262839195 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56187c8bedf0 con 0x56187c9e85c0 2026-02-20T13:25:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.928+0000 7f71a8ff9640 10 client.18432 handle_command_reply: tid=0 2026-02-20T13:25:34.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.928+0000 7f71e7032e00 1 client.18432 shutdown 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.928+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5d20 msgr2=0x56187c9be280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.928+0000 7f71e7032e00 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5d20 0x56187c9be280 secure :-1 s=READY pgs=999 gs=1 cs=0 l=1 c_cookie=11717387508735064048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8009950 tx=0x7f71c8009310 comp rx=0 tx=0).stop 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 shutdown_connections 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56187c9e85c0 0x56187c9e8a60 crc :-1 s=READY pgs=248 gs=4 cs=0 l=0 c_cookie=1214104692856146441 s_cookie=15857704047554095615 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9a5d20 0x56187c9be280 unknown :-1 s=CLOSED pgs=999 gs=1 cs=0 l=1 c_cookie=11717387508735064048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9ea9c0 0x56187c9c3270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 1 --2- 10.20.193.28:0/4262839195 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9bdd40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 >> 10.20.193.28:0/4262839195 conn(0x56187c983910 msgr2=0x56187c9a44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71a8ff9640 0 client.18432 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 shutdown_connections 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 1 -- 10.20.193.28:0/4262839195 wait complete. 2026-02-20T13:25:34.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.929+0000 7f71e7032e00 20 client.18432 trim_cache size 0 max 16384 2026-02-20T13:25:34.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.938+0000 7f71e7032e00 1 Processor -- start 2026-02-20T13:25:34.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.938+0000 7f71e7032e00 1 -- start start 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.938+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9e36a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.938+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5d20 0x56187c9e3be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.938+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9ba0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.938+0000 7f71e7032e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56187c8af320 con 0x56187c9ea9c0 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.938+0000 7f71e7032e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56187c56f790 con 0x56187c9a5410 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.938+0000 7f71e7032e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56187c9c3c20 con 0x56187c9a5d20 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71de575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5d20 0x56187c9e3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9ba0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56728/0 (socket says 10.20.193.28:56728) 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 -- 10.20.193.28:0/2441205964 learned_addr learned my addr 10.20.193.28:0/2441205964 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71ded76640 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9e36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 -- 10.20.193.28:0/2441205964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5d20 msgr2=0x56187c9e3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5d20 0x56187c9e3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 -- 10.20.193.28:0/2441205964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 msgr2=0x56187c9e36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9e36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 -- 10.20.193.28:0/2441205964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187c9b0040 con 0x56187c9ea9c0 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71de575640 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5d20 0x56187c9e3be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71df577640 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9ba0f0 secure :-1 s=READY pgs=1000 gs=3 cs=0 l=1 c_cookie=3287480787682141361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d0005780 tx=0x7f71d0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9f7a5bcbb724b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71aaffd640 1 -- 10.20.193.28:0/2441205964 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d000ade0 con 0x56187c9ea9c0 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71aaffd640 1 -- 10.20.193.28:0/2441205964 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71d0019040 con 0x56187c9ea9c0 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.939+0000 7f71aaffd640 1 -- 10.20.193.28:0/2441205964 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d001d910 con 0x56187c9ea9c0 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 -- 10.20.193.28:0/2441205964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 msgr2=0x56187c9ba0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9ba0f0 secure :-1 s=READY pgs=1000 gs=3 cs=0 l=1 c_cookie=3287480787682141361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d0005780 tx=0x7f71d0004d10 comp rx=0 tx=0).stop 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 -- 10.20.193.28:0/2441205964 shutdown_connections 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9ba0f0 unknown :-1 s=CLOSED pgs=1000 gs=3 cs=0 l=1 c_cookie=3287480787682141361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5d20 0x56187c9e3be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 --2- 10.20.193.28:0/2441205964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5410 0x56187c9e36a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 -- 10.20.193.28:0/2441205964 >> 10.20.193.28:0/2441205964 conn(0x56187c983910 msgr2=0x56187c9e9120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:34.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 -- 10.20.193.28:0/2441205964 shutdown_connections 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 -- 10.20.193.28:0/2441205964 wait complete. 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 -- start start 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.940+0000 7f71e7032e00 1 Processor -- start 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5410 0x56187c9c9850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9c9d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71e7032e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9c6070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71e7032e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56187c9c66d0 con 0x56187c9ea9c0 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71e7032e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56187c9c6840 con 0x56187c9a5d20 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71e7032e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56187c9c6a00 con 0x56187c9a5410 2026-02-20T13:25:34.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71de575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71de575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51374/0 (socket says 10.20.193.28:51374) 2026-02-20T13:25:34.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71de575640 1 -- 10.20.193.28:0/1992465627 learned_addr learned my addr 10.20.193.28:0/1992465627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:34.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71ded76640 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5410 0x56187c9c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71df577640 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71ded76640 1 -- 10.20.193.28:0/1992465627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 msgr2=0x56187c9c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71ded76640 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71ded76640 1 -- 10.20.193.28:0/1992465627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 msgr2=0x56187c9c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71ded76640 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71ded76640 1 -- 10.20.193.28:0/1992465627 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d0005420 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.941+0000 7f71df577640 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9c6070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71ded76640 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5410 0x56187c9c9850 secure :-1 s=READY pgs=298 gs=2 cs=0 l=1 c_cookie=4037058134943567260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d40aa1f0 tx=0x7f71d4005580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=380682fc06e98d9c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71a8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71a8ff9640 1 -- 10.20.193.28:0/1992465627 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d40b2ca0 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71a8ff9640 1 -- 10.20.193.28:0/1992465627 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71d40b5280 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71a8ff9640 1 -- 10.20.193.28:0/1992465627 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d40b7c30 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56187c8474f0 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71a8ff9640 1 -- 10.20.193.28:0/1992465627 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f71d4070040 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71e7032e00 10 client.28300 _ll_register_callbacks cb 0x56187c868b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56187c609530 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71a8ff9640 1 -- 10.20.193.28:0/1992465627 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f71d40b80c0 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71e7032e00 10 client.28300 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.942+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56187c841f70 con 0x56187c9a5410 2026-02-20T13:25:34.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71a8ff9640 1 -- 10.20.193.28:0/1992465627 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f71d40adc10 con 0x56187c9a5410 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71e7032e00 10 client.28300 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71e7032e00 10 client.28300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71e7032e00 20 client.28300 populate_metadata read hostname 'trial028' 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71e7032e00 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56187ca986a0 0x56187cab8b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71e7032e00 4 client.28300 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f71d40ad980 con 0x56187ca986a0 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71de575640 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56187ca986a0 0x56187cab8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71de575640 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56187ca986a0 0x56187cab8b50 crc :-1 s=READY pgs=249 gs=4 cs=0 l=0 c_cookie=11684498099057759463 s_cookie=12583276409728713583 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a227ad1d2d1094e7 server_cookie=aea0c739c06ec36f in_seq=0 out_seq=0 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.943+0000 7f71a8ff9640 10 client.28300 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71a8ff9640 1 -- 10.20.193.28:0/1992465627 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f71d40ad980 con 0x56187ca986a0 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71a8ff9640 10 client.28300 handle_command_reply: tid=0 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 client.28300 shutdown 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5410 msgr2=0x56187c9c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5410 0x56187c9c9850 secure :-1 s=READY pgs=298 gs=2 cs=0 l=1 c_cookie=4037058134943567260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d40aa1f0 tx=0x7f71d4005580 comp rx=0 tx=0).stop 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 shutdown_connections 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56187ca986a0 0x56187cab8b50 crc :-1 s=READY pgs=249 gs=4 cs=0 l=0 c_cookie=11684498099057759463 s_cookie=12583276409728713583 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56187c9ea9c0 0x56187c9c6070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56187c9a5d20 0x56187c9c9d90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 --2- 10.20.193.28:0/1992465627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56187c9a5410 0x56187c9c9850 unknown :-1 s=CLOSED pgs=298 gs=2 cs=0 l=1 c_cookie=4037058134943567260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 >> 10.20.193.28:0/1992465627 conn(0x56187c983910 msgr2=0x56187c9e9910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71a8ff9640 0 client.28300 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.944+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 shutdown_connections 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e7032e00 1 -- 10.20.193.28:0/1992465627 wait complete. 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e7032e00 20 client.28300 trim_cache size 0 max 16384 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "0c437939-f452-4571-ad83-7ea1c854387d", 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:25:34.947 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 -- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71b40b5760 msgr2=0x7f71b40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71b40b5760 0x7f71b40d5c10 secure :-1 s=READY pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71e00f9830 tx=0x7f71c803a040 comp rx=0 tx=0).stop 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 -- 10.20.193.28:0/671458298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f71e00614f0 msgr2=0x7f71e00f2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f71e00614f0 0x7f71e00f2e90 secure :-1 s=READY pgs=361 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d4009480 tx=0x7f71d400ee60 comp rx=0 tx=0).stop 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 -- 10.20.193.28:0/671458298 shutdown_connections 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f71b40b5760 0x7f71b40d5c10 unknown :-1 s=CLOSED pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71e0159d80 0x7f71e00f87a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f71e0062ae0 0x7f71e00f33d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 --2- 10.20.193.28:0/671458298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f71e00614f0 0x7f71e00f2e90 unknown :-1 s=CLOSED pgs=361 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.945+0000 7f71e4837640 1 -- 10.20.193.28:0/671458298 >> 10.20.193.28:0/671458298 conn(0x7f71e00eab00 msgr2=0x7f71e010fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.946+0000 7f71e4837640 1 -- 10.20.193.28:0/671458298 shutdown_connections 2026-02-20T13:25:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:34.946+0000 7f71e4837640 1 -- 10.20.193.28:0/671458298 wait complete. 2026-02-20T13:25:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:34 trial127 ceph-mon[43817]: pgmap v428: 97 pgs: 97 active+clean; 4.7 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:25:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:34 trial034 ceph-mon[43332]: pgmap v428: 97 pgs: 97 active+clean; 4.7 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:25:35.045 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:25:35.229 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:35.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.403+0000 7fca53577640 1 -- 10.20.193.28:0/685327135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 msgr2=0x7fca5410f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.403+0000 7fca53577640 1 --2- 10.20.193.28:0/685327135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 0x7fca5410f880 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=10070552143683446261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca48009950 tx=0x7fca4802f190 comp rx=0 tx=0).stop 2026-02-20T13:25:35.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.403+0000 7fca53577640 1 -- 10.20.193.28:0/685327135 shutdown_connections 2026-02-20T13:25:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.403+0000 7fca53577640 1 --2- 10.20.193.28:0/685327135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fca541156a0 0x7fca54176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.403+0000 7fca53577640 1 --2- 10.20.193.28:0/685327135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fca5410fea0 0x7fca54114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.403+0000 7fca53577640 1 --2- 10.20.193.28:0/685327135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 0x7fca5410f880 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=10070552143683446261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.403+0000 7fca53577640 1 -- 10.20.193.28:0/685327135 >> 10.20.193.28:0/685327135 conn(0x7fca540ecda0 msgr2=0x7fca5410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.403+0000 7fca53577640 1 -- 10.20.193.28:0/685327135 shutdown_connections 2026-02-20T13:25:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.404+0000 7fca53577640 1 -- 10.20.193.28:0/685327135 wait complete. 2026-02-20T13:25:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.404+0000 7fca53577640 1 Processor -- start 2026-02-20T13:25:35.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.404+0000 7fca53577640 1 -- start start 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca53577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 0x7fca5411de20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca53577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fca5410fea0 0x7fca5411e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca53577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fca541156a0 0x7fca54123730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca53577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fca54123d50 con 0x7fca541156a0 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca53577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fca54123ec0 con 0x7fca5410f4b0 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca53577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fca54124080 con 0x7fca5410fea0 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fca541156a0 0x7fca54123730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 0x7fca5411de20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca51d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fca5410fea0 0x7fca5411e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 0x7fca5411de20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51398/0 (socket says 10.20.193.28:51398) 2026-02-20T13:25:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fca541156a0 0x7fca54123730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56756/0 (socket says 10.20.193.28:56756) 2026-02-20T13:25:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52575640 1 -- 10.20.193.28:0/1825846732 learned_addr learned my addr 10.20.193.28:0/1825846732 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52d76640 1 -- 10.20.193.28:0/1825846732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fca5410fea0 msgr2=0x7fca5411e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52d76640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fca5410fea0 0x7fca5411e360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52d76640 1 -- 10.20.193.28:0/1825846732 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 msgr2=0x7fca5411de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52d76640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 0x7fca5411de20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52d76640 1 -- 10.20.193.28:0/1825846732 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4400a590 con 0x7fca541156a0 2026-02-20T13:25:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.405+0000 7fca52575640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 0x7fca5411de20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.406+0000 7fca52d76640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fca541156a0 0x7fca54123730 secure :-1 s=READY pgs=1001 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca4400aef0 tx=0x7fca44003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.406+0000 7fca3b7fe640 1 -- 10.20.193.28:0/1825846732 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca4400fb50 con 0x7fca541156a0 2026-02-20T13:25:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.406+0000 7fca3b7fe640 1 -- 10.20.193.28:0/1825846732 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca4400fcb0 con 0x7fca541156a0 2026-02-20T13:25:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.406+0000 7fca3b7fe640 1 -- 10.20.193.28:0/1825846732 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca44010870 con 0x7fca541156a0 2026-02-20T13:25:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.406+0000 7fca53577640 1 -- 10.20.193.28:0/1825846732 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca48009570 con 0x7fca541156a0 2026-02-20T13:25:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.406+0000 7fca53577640 1 -- 10.20.193.28:0/1825846732 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541648c0 con 0x7fca541156a0 2026-02-20T13:25:35.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.409+0000 7fca3b7fe640 1 -- 10.20.193.28:0/1825846732 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fca44017070 con 0x7fca541156a0 2026-02-20T13:25:35.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.410+0000 7fca3b7fe640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca2c0b5760 0x7fca2c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.410+0000 7fca3b7fe640 1 -- 10.20.193.28:0/1825846732 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fca440e7ee0 con 0x7fca541156a0 2026-02-20T13:25:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.411+0000 7fca52575640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca2c0b5760 0x7fca2c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.411+0000 7fca52575640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca2c0b5760 0x7fca2c0d5c10 secure :-1 s=READY pgs=452 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca48038820 tx=0x7fca4803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.411+0000 7fca5aa7ae00 1 Processor -- start 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca5aa7ae00 1 -- start start 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x558289127550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828916c400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x55828918cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55828903d7d0 con 0x55828916c940 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558289039500 con 0x558289127a90 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5582890334a0 con 0x558289127180 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x558289127550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x558289127550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54798/0 (socket says 10.20.193.28:54798) 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52575640 1 -- 10.20.193.28:0/4153656863 learned_addr learned my addr 10.20.193.28:0/4153656863 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52d76640 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x55828918cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca51d74640 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828916c400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52575640 1 -- 10.20.193.28:0/4153656863 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 msgr2=0x55828916c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52575640 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828916c400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52575640 1 -- 10.20.193.28:0/4153656863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 msgr2=0x55828918cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52575640 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x55828918cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52575640 1 -- 10.20.193.28:0/4153656863 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558288fded80 con 0x558289127180 2026-02-20T13:25:35.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.412+0000 7fca52d76640 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x55828918cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca52575640 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x558289127550 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=11370790408224136253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca48002de0 tx=0x7fca48040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dcd29a1999e5c3d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca38ff9640 1 -- 10.20.193.28:0/4153656863 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca4802fc10 con 0x558289127180 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca38ff9640 1 -- 10.20.193.28:0/4153656863 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca4803e040 con 0x558289127180 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca38ff9640 1 -- 10.20.193.28:0/4153656863 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca48044ba0 con 0x558289127180 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/4153656863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 msgr2=0x558289127550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x558289127550 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=11370790408224136253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca48002de0 tx=0x7fca48040000 comp rx=0 tx=0).stop 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/4153656863 shutdown_connections 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x55828918cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828916c400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/4153656863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x558289127550 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=11370790408224136253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/4153656863 >> 10.20.193.28:0/4153656863 conn(0x558289105680 msgr2=0x558289125a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:35.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/4153656863 shutdown_connections 2026-02-20T13:25:35.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.413+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/4153656863 wait complete. 2026-02-20T13:25:35.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.415+0000 7fca5aa7ae00 1 -- start start 2026-02-20T13:25:35.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.415+0000 7fca5aa7ae00 1 Processor -- start 2026-02-20T13:25:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.415+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289184020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.415+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x558289184560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.415+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55828916c940 0x558289189550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.415+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558289189a90 con 0x558289127180 2026-02-20T13:25:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.415+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558289189c00 con 0x558289127a90 2026-02-20T13:25:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.415+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558289189dc0 con 0x55828916c940 2026-02-20T13:25:35.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55828916c940 0x558289189550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca51d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x558289184560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55828916c940 0x558289189550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54800/0 (socket says 10.20.193.28:54800) 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 -- 10.20.193.28:0/2501906145 learned_addr learned my addr 10.20.193.28:0/2501906145 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52575640 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289184020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 -- 10.20.193.28:0/2501906145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 msgr2=0x558289184560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x558289184560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 -- 10.20.193.28:0/2501906145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 msgr2=0x558289184020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289184020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 -- 10.20.193.28:0/2501906145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca541768e0 con 0x55828916c940 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52575640 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289184020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.416+0000 7fca52d76640 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55828916c940 0x558289189550 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=12742398724299185529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca440ae220 tx=0x7fca440adcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d61820ac3e5d79 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:35.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca03fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca03fff640 1 -- 10.20.193.28:0/2501906145 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca4406e070 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca03fff640 1 -- 10.20.193.28:0/2501906145 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca44073630 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca03fff640 1 -- 10.20.193.28:0/2501906145 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca440b8ef0 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541648c0 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca03fff640 1 -- 10.20.193.28:0/2501906145 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fca440b9070 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca03fff640 10 client.28312 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 10 client.28312 _ll_register_callbacks cb 0x558288fb49a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558288cc96f0 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca03fff640 1 -- 10.20.193.28:0/2501906145 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca440b9380 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 10 client.28312 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558288fb7350 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca03fff640 1 -- 10.20.193.28:0/2501906145 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca440aeed0 con 0x55828916c940 2026-02-20T13:25:35.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 10 client.28312 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 10 client.28312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 20 client.28312 populate_metadata read hostname 'trial028' 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558289169850 0x558289169cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 4 client.28312 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.417+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558289040d60 con 0x558289169850 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.418+0000 7fca52575640 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558289169850 0x558289169cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.418+0000 7fca52575640 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558289169850 0x558289169cf0 crc :-1 s=READY pgs=250 gs=4 cs=0 l=0 c_cookie=8371572385966628472 s_cookie=5552903409148254131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=742dccbb05029e78 server_cookie=4d0fe03ae65657b3 in_seq=0 out_seq=0 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.418+0000 7fca03fff640 10 client.28312 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca03fff640 1 -- 10.20.193.28:0/2501906145 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558289040d60 con 0x558289169850 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca03fff640 10 client.28312 handle_command_reply: tid=0 2026-02-20T13:25:35.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 client.28312 shutdown 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55828916c940 msgr2=0x558289189550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55828916c940 0x558289189550 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=12742398724299185529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca440ae220 tx=0x7fca440adcf0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 shutdown_connections 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558289169850 0x558289169cf0 crc :-1 s=READY pgs=250 gs=4 cs=0 l=0 c_cookie=8371572385966628472 s_cookie=5552903409148254131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55828916c940 0x558289189550 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=12742398724299185529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x558289184560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2501906145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289184020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca03fff640 0 client.28312 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 >> 10.20.193.28:0/2501906145 conn(0x558289105680 msgr2=0x558289125a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 shutdown_connections 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.419+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2501906145 wait complete. 2026-02-20T13:25:35.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.420+0000 7fca5aa7ae00 20 client.28312 trim_cache size 0 max 16384 2026-02-20T13:25:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca5aa7ae00 1 Processor -- start 2026-02-20T13:25:35.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca5aa7ae00 1 -- start start 2026-02-20T13:25:35.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289181420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127a90 0x558289181960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55828916c940 0x55828916b3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5582890310d0 con 0x558289127180 2026-02-20T13:25:35.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558288cf1700 con 0x55828916c940 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558289127790 con 0x558289127a90 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55828916c940 0x55828916b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55828916c940 0x55828916b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51420/0 (socket says 10.20.193.28:51420) 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52d76640 1 -- 10.20.193.28:0/1084954413 learned_addr learned my addr 10.20.193.28:0/1084954413 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52575640 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289181420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca51d74640 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127a90 0x558289181960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52d76640 1 -- 10.20.193.28:0/1084954413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127a90 msgr2=0x558289181960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52d76640 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127a90 0x558289181960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52d76640 1 -- 10.20.193.28:0/1084954413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 msgr2=0x558289181420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52d76640 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289181420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.429+0000 7fca52d76640 1 -- 10.20.193.28:0/1084954413 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558288fc9150 con 0x55828916c940 2026-02-20T13:25:35.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca51d74640 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127a90 0x558289181960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca52d76640 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55828916c940 0x55828916b3c0 secure :-1 s=READY pgs=363 gs=2 cs=0 l=1 c_cookie=3271090063488625903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca440e5a10 tx=0x7fca440c9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d653f14ee8cacef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca1e4e6640 1 -- 10.20.193.28:0/1084954413 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca4406e030 con 0x55828916c940 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca1e4e6640 1 -- 10.20.193.28:0/1084954413 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x558288cc96f0 con 0x55828916c940 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca1e4e6640 1 -- 10.20.193.28:0/1084954413 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca440d3490 con 0x55828916c940 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/1084954413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55828916c940 msgr2=0x55828916b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55828916c940 0x55828916b3c0 secure :-1 s=READY pgs=363 gs=2 cs=0 l=1 c_cookie=3271090063488625903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca440e5a10 tx=0x7fca440c9000 comp rx=0 tx=0).stop 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/1084954413 shutdown_connections 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55828916c940 0x55828916b3c0 unknown :-1 s=CLOSED pgs=363 gs=2 cs=0 l=1 c_cookie=3271090063488625903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127a90 0x558289181960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/1084954413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558289127180 0x558289181420 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/1084954413 >> 10.20.193.28:0/1084954413 conn(0x558289105680 msgr2=0x558289176020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:35.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/1084954413 shutdown_connections 2026-02-20T13:25:35.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.430+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/1084954413 wait complete. 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.431+0000 7fca5aa7ae00 1 -- start start 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.431+0000 7fca5aa7ae00 1 Processor -- start 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.431+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x55828910b0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.431+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828910b5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.431+0000 7fca5aa7ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x558289106d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.431+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558289107460 con 0x55828916c940 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.431+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5582891075d0 con 0x558289127a90 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.431+0000 7fca5aa7ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558289107790 con 0x558289127180 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828910b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca52575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x55828910b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca52d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x558289106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828910b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51430/0 (socket says 10.20.193.28:51430) 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca52575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x55828910b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54830/0 (socket says 10.20.193.28:54830) 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 -- 10.20.193.28:0/2157102919 learned_addr learned my addr 10.20.193.28:0/2157102919 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 -- 10.20.193.28:0/2157102919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 msgr2=0x55828910b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x55828910b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 -- 10.20.193.28:0/2157102919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 msgr2=0x558289106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x558289106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 -- 10.20.193.28:0/2157102919 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558288fc3bd0 con 0x558289127a90 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca51d74640 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828910b5f0 secure :-1 s=READY pgs=364 gs=2 cs=0 l=1 c_cookie=4961525863950118673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca3c009cb0 tx=0x7fca3c003a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44dae17c68a8ef11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.432+0000 7fca03fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca03fff640 1 -- 10.20.193.28:0/2157102919 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca3c004a70 con 0x558289127a90 2026-02-20T13:25:35.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca03fff640 1 -- 10.20.193.28:0/2157102919 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca3c017050 con 0x558289127a90 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca03fff640 1 -- 10.20.193.28:0/2157102919 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca3c010bb0 con 0x558289127a90 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558288fb7350 con 0x558289127a90 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca03fff640 1 -- 10.20.193.28:0/2157102919 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fca3c010d40 con 0x558289127a90 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca03fff640 10 client.28418 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 10 client.28418 _ll_register_callbacks cb 0x558288fb49a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca4803e040 con 0x558289127a90 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca03fff640 1 -- 10.20.193.28:0/2157102919 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca3c004bd0 con 0x558289127a90 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 10 client.28418 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558288fb7680 con 0x558289127a90 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca03fff640 1 -- 10.20.193.28:0/2157102919 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca3c004d70 con 0x558289127a90 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 10 client.28418 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 10 client.28418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 20 client.28418 populate_metadata read hostname 'trial028' 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5582891d2b20 0x5582891d2fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 4 client.28418 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.433+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558288cc6f40 con 0x5582891d2b20 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.434+0000 7fca52575640 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5582891d2b20 0x5582891d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.434+0000 7fca52575640 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5582891d2b20 0x5582891d2fc0 crc :-1 s=READY pgs=251 gs=4 cs=0 l=0 c_cookie=2594795273682606499 s_cookie=16353569285288721471 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2402908db8b6d9a3 server_cookie=e2f38c9ebb5f7c3f in_seq=0 out_seq=0 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.434+0000 7fca03fff640 10 client.28418 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.434+0000 7fca03fff640 1 -- 10.20.193.28:0/2157102919 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x558288cc6f40 con 0x5582891d2b20 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.434+0000 7fca03fff640 10 client.28418 handle_command_reply: tid=0 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.434+0000 7fca5aa7ae00 1 client.28418 shutdown 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.434+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 msgr2=0x55828910b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.434+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828910b5f0 secure :-1 s=READY pgs=364 gs=2 cs=0 l=1 c_cookie=4961525863950118673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca3c009cb0 tx=0x7fca3c003a80 comp rx=0 tx=0).stop 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 shutdown_connections 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5582891d2b20 0x5582891d2fc0 crc :-1 s=READY pgs=251 gs=4 cs=0 l=0 c_cookie=2594795273682606499 s_cookie=16353569285288721471 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55828916c940 0x558289106d80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558289127a90 0x55828910b5f0 unknown :-1 s=CLOSED pgs=364 gs=2 cs=0 l=1 c_cookie=4961525863950118673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 1 --2- 10.20.193.28:0/2157102919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558289127180 0x55828910b0b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 >> 10.20.193.28:0/2157102919 conn(0x558289105680 msgr2=0x558289180410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca03fff640 0 client.28418 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 shutdown_connections 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 1 -- 10.20.193.28:0/2157102919 wait complete. 2026-02-20T13:25:35.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca5aa7ae00 20 client.28418 trim_cache size 0 max 16384 2026-02-20T13:25:35.444 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:25:35.444 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:25:35.444 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:25:35.444 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:25:35.444 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.444 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "0c437939-f452-4571-ad83-7ea1c854387d", 2026-02-20T13:25:35.444 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:25:35.444 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:25:35.445 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.446 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:25:35.447 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.448 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:25:35.449 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.450 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.451 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:25:35.452 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:35.453 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 -- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca2c0b5760 msgr2=0x7fca2c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca2c0b5760 0x7fca2c0d5c10 secure :-1 s=READY pgs=452 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca48038820 tx=0x7fca4803a040 comp rx=0 tx=0).stop 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 -- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fca541156a0 msgr2=0x7fca54123730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fca541156a0 0x7fca54123730 secure :-1 s=READY pgs=1001 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca4400aef0 tx=0x7fca44003b50 comp rx=0 tx=0).stop 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 -- 10.20.193.28:0/1825846732 shutdown_connections 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fca2c0b5760 0x7fca2c0d5c10 unknown :-1 s=CLOSED pgs=452 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fca541156a0 0x7fca54123730 unknown :-1 s=CLOSED pgs=1001 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fca5410fea0 0x7fca5411e360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 --2- 10.20.193.28:0/1825846732 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fca5410f4b0 0x7fca5411de20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.435+0000 7fca53577640 1 -- 10.20.193.28:0/1825846732 >> 10.20.193.28:0/1825846732 conn(0x7fca540ecda0 msgr2=0x7fca5410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.436+0000 7fca53577640 1 -- 10.20.193.28:0/1825846732 shutdown_connections 2026-02-20T13:25:35.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:35.436+0000 7fca53577640 1 -- 10.20.193.28:0/1825846732 wait complete. 2026-02-20T13:25:35.538 INFO:tasks.cephfs.filesystem:scrub status for tag:0c437939-f452-4571-ad83-7ea1c854387d - {'path': '/', 'tag': '0c437939-f452-4571-ad83-7ea1c854387d', 'options': 'recursive,force'} 2026-02-20T13:25:35.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:35 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:25:35.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:35 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:35.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:35 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:25:35.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:35 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:25:35.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:35 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:35.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:35 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:35.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:35 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:25:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:35 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:35 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:25:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:35 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:25:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:35 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:35.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:35 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:35.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:35 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:25:35.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:35 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:35.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:35 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:25:35.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:35 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:25:35.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:35 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:35.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:35 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:25:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:36 trial127 ceph-mon[43817]: pgmap v429: 97 pgs: 97 active+clean; 4.7 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:25:36.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:36 trial034 ceph-mon[43332]: pgmap v429: 97 pgs: 97 active+clean; 4.7 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:25:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:36 trial028 ceph-mon[37442]: pgmap v429: 97 pgs: 97 active+clean; 4.7 MiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:25:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:38 trial127 ceph-mon[43817]: pgmap v430: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2026-02-20T13:25:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:38 trial034 ceph-mon[43332]: pgmap v430: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2026-02-20T13:25:39.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:38 trial028 ceph-mon[37442]: pgmap v430: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2026-02-20T13:25:39.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:39 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:25:39.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:39 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:25:40.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:39 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:25:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:40 trial127 ceph-mon[43817]: pgmap v431: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:25:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:25:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:25:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:25:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:25:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:40 trial034 ceph-mon[43332]: pgmap v431: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:25:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:25:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:25:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:25:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:25:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:40 trial028 ceph-mon[37442]: pgmap v431: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:25:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:25:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:25:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:25:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:25:42.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:42 trial127 ceph-mon[43817]: pgmap v432: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:25:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:42 trial034 ceph-mon[43332]: pgmap v432: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:25:43.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:42 trial028 ceph-mon[37442]: pgmap v432: 97 pgs: 97 active+clean; 696 KiB data, 340 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:25:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:44 trial127 ceph-mon[43817]: pgmap v433: 97 pgs: 97 active+clean; 702 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 16 op/s 2026-02-20T13:25:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:44 trial034 ceph-mon[43332]: pgmap v433: 97 pgs: 97 active+clean; 702 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 16 op/s 2026-02-20T13:25:45.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:44 trial028 ceph-mon[37442]: pgmap v433: 97 pgs: 97 active+clean; 702 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 16 op/s 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 -- 10.20.193.28:0/3540295416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee010f2f0 msgr2=0x7feee0171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 --2- 10.20.193.28:0/3540295416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee010f2f0 0x7feee0171080 secure :-1 s=READY pgs=1002 gs=2 cs=0 l=1 c_cookie=5694537897378717473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed400aa60 tx=0x7feed40302b0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 -- 10.20.193.28:0/3540295416 shutdown_connections 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 --2- 10.20.193.28:0/3540295416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee010f2f0 0x7feee0171080 unknown :-1 s=CLOSED pgs=1002 gs=2 cs=0 l=1 c_cookie=5694537897378717473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 --2- 10.20.193.28:0/3540295416 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feee010e940 0x7feee010edb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 --2- 10.20.193.28:0/3540295416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feee01100b0 0x7feee01104a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 -- 10.20.193.28:0/3540295416 >> 10.20.193.28:0/3540295416 conn(0x7feee00ec320 msgr2=0x7feee010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 -- 10.20.193.28:0/3540295416 shutdown_connections 2026-02-20T13:25:46.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.383+0000 7feee4a43640 1 -- 10.20.193.28:0/3540295416 wait complete. 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.384+0000 7feee4a43640 1 Processor -- start 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.384+0000 7feee4a43640 1 -- start start 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.384+0000 7feee4a43640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feee010e940 0x7feee00f81f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.384+0000 7feee4a43640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feee010f2f0 0x7feee0171060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.384+0000 7feee4a43640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee01100b0 0x7feee00f8a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.384+0000 7feee4a43640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feee00f9690 con 0x7feee01100b0 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.384+0000 7feee4a43640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7feee00f9800 con 0x7feee010f2f0 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.384+0000 7feee4a43640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7feee00f99c0 con 0x7feee010e940 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee01100b0 0x7feee00f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feee010f2f0 0x7feee0171060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedf7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feee010e940 0x7feee00f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee01100b0 0x7feee00f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59296/0 (socket says 10.20.193.28:59296) 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 -- 10.20.193.28:0/344930221 learned_addr learned my addr 10.20.193.28:0/344930221 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 -- 10.20.193.28:0/344930221 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feee010e940 msgr2=0x7feee00f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feee010e940 0x7feee00f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 -- 10.20.193.28:0/344930221 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feee010f2f0 msgr2=0x7feee0171060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feee010f2f0 0x7feee0171060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 -- 10.20.193.28:0/344930221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed400a650 con 0x7feee01100b0 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedf7fe640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feee010e940 0x7feee00f81f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedffff640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee01100b0 0x7feee00f8a30 secure :-1 s=READY pgs=1003 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed400a360 tx=0x7feed40039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedcff9640 1 -- 10.20.193.28:0/344930221 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed403e070 con 0x7feee01100b0 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feee4a43640 1 -- 10.20.193.28:0/344930221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee00f9c40 con 0x7feee01100b0 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedcff9640 1 -- 10.20.193.28:0/344930221 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feed4006eb0 con 0x7feee01100b0 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feedcff9640 1 -- 10.20.193.28:0/344930221 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed403e070 con 0x7feee01100b0 2026-02-20T13:25:46.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.385+0000 7feee4a43640 1 -- 10.20.193.28:0/344930221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee00fa0b0 con 0x7feee01100b0 2026-02-20T13:25:46.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.388+0000 7feedcff9640 1 -- 10.20.193.28:0/344930221 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7feed4039b40 con 0x7feee01100b0 2026-02-20T13:25:46.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feedcff9640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feeb40b57a0 0x7feeb40d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feedcff9640 1 -- 10.20.193.28:0/344930221 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feed410c1a0 con 0x7feee01100b0 2026-02-20T13:25:46.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feedf7fe640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feeb40b57a0 0x7feeb40d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feee82d4e00 1 Processor -- start 2026-02-20T13:25:46.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feee82d4e00 1 -- start start 2026-02-20T13:25:46.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feedf7fe640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feeb40b57a0 0x7feeb40d5c50 secure :-1 s=READY pgs=453 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feecc004740 tx=0x7feecc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:46.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54cf8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54f01c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f5510ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feee82d4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5556f53c4fd0 con 0x5556f54f0700 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feee82d4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5556f53c0d00 con 0x5556f54cfde0 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.390+0000 7feee82d4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5556f53baca0 con 0x5556f54af4c0 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedf7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f5510ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedf7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57000/0 (socket says 10.20.193.28:57000) 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedf7fe640 1 -- 10.20.193.28:0/221052706 learned_addr learned my addr 10.20.193.28:0/221052706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedeffd640 1 --2- 10.20.193.28:0/221052706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedffff640 1 -- 10.20.193.28:0/221052706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 msgr2=0x5556f54cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedffff640 1 --2- 10.20.193.28:0/221052706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedffff640 1 -- 10.20.193.28:0/221052706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 msgr2=0x5556f54f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedffff640 1 --2- 10.20.193.28:0/221052706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedffff640 1 -- 10.20.193.28:0/221052706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f535d8b0 con 0x5556f54f0700 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feedffff640 1 --2- 10.20.193.28:0/221052706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f5510ae0 secure :-1 s=READY pgs=1004 gs=2 cs=0 l=1 c_cookie=16268313586019409301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed40d2770 tx=0x7feed40ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c4a90365591d95 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feeab7fe640 1 -- 10.20.193.28:0/221052706 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed403e070 con 0x5556f54f0700 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feeab7fe640 1 -- 10.20.193.28:0/221052706 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feed40d2f00 con 0x5556f54f0700 2026-02-20T13:25:46.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feeab7fe640 1 -- 10.20.193.28:0/221052706 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed40d3410 con 0x5556f54f0700 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feee82d4e00 1 -- 10.20.193.28:0/221052706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 msgr2=0x5556f5510ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feee82d4e00 1 --2- 10.20.193.28:0/221052706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f5510ae0 secure :-1 s=READY pgs=1004 gs=2 cs=0 l=1 c_cookie=16268313586019409301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed40d2770 tx=0x7feed40ce3a0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feee82d4e00 1 -- 10.20.193.28:0/221052706 shutdown_connections 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feee82d4e00 1 --2- 10.20.193.28:0/221052706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f5510ae0 unknown :-1 s=CLOSED pgs=1004 gs=2 cs=0 l=1 c_cookie=16268313586019409301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feee82d4e00 1 --2- 10.20.193.28:0/221052706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54f01c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feee82d4e00 1 --2- 10.20.193.28:0/221052706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54cf8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.391+0000 7feee82d4e00 1 -- 10.20.193.28:0/221052706 >> 10.20.193.28:0/221052706 conn(0x5556f53ce1c0 msgr2=0x5556f54adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.392+0000 7feee82d4e00 1 -- 10.20.193.28:0/221052706 shutdown_connections 2026-02-20T13:25:46.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.392+0000 7feee82d4e00 1 -- 10.20.193.28:0/221052706 wait complete. 2026-02-20T13:25:46.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.393+0000 7feee82d4e00 1 -- start start 2026-02-20T13:25:46.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.393+0000 7feee82d4e00 1 Processor -- start 2026-02-20T13:25:46.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54c8820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54c8e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54c98d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feee82d4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5556f54c9f30 con 0x5556f54f0700 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feee82d4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5556f54ca0a0 con 0x5556f54cfde0 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feee82d4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5556f54ca260 con 0x5556f54af4c0 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedf7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59318/0 (socket says 10.20.193.28:59318) 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 -- 10.20.193.28:0/1348626845 learned_addr learned my addr 10.20.193.28:0/1348626845 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedeffd640 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 -- 10.20.193.28:0/1348626845 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 msgr2=0x5556f54c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 -- 10.20.193.28:0/1348626845 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 msgr2=0x5556f54c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 -- 10.20.193.28:0/1348626845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f5366400 con 0x5556f54f0700 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feedffff640 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54c98d0 secure :-1 s=READY pgs=1005 gs=1 cs=0 l=1 c_cookie=8013988095459858580 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed40d24e0 tx=0x7feed40dd540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3767b680181894 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feea8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feea8ff9640 1 -- 10.20.193.28:0/1348626845 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed403e040 con 0x5556f54f0700 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feea8ff9640 1 -- 10.20.193.28:0/1348626845 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feed40dd640 con 0x5556f54f0700 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feea8ff9640 1 -- 10.20.193.28:0/1348626845 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed40d04e0 con 0x5556f54f0700 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee00fa0b0 con 0x5556f54f0700 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feea8ff9640 1 -- 10.20.193.28:0/1348626845 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feed4107e40 con 0x5556f54f0700 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.394+0000 7feea8ff9640 10 client.18468 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:46.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 10 client.18468 _ll_register_callbacks cb 0x5556f5345a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556f505a520 con 0x5556f54f0700 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feea8ff9640 1 -- 10.20.193.28:0/1348626845 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feed40d8220 con 0x5556f54f0700 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 10 client.18468 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5556f533eda0 con 0x5556f54f0700 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feea8ff9640 1 -- 10.20.193.28:0/1348626845 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feed40d0640 con 0x5556f54f0700 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 10 client.18468 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 10 client.18468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 20 client.18468 populate_metadata read hostname 'trial028' 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5556f54ccc20 0x5556f54cd0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 4 client.18468 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556f53ec630 con 0x5556f54ccc20 2026-02-20T13:25:46.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.395+0000 7feedf7fe640 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5556f54ccc20 0x5556f54cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.396+0000 7feea8ff9640 10 client.18468 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.396+0000 7feedf7fe640 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5556f54ccc20 0x5556f54cd0c0 crc :-1 s=READY pgs=252 gs=4 cs=0 l=0 c_cookie=8054244273511584503 s_cookie=4010661256943719560 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fc66c7e58e1d2f7 server_cookie=37a8bb29ee8d5488 in_seq=0 out_seq=0 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.396+0000 7feea8ff9640 1 -- 10.20.193.28:0/1348626845 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5556f53ec630 con 0x5556f54ccc20 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.396+0000 7feea8ff9640 10 client.18468 handle_command_reply: tid=0 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 client.18468 shutdown 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 msgr2=0x5556f54c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54c98d0 secure :-1 s=READY pgs=1005 gs=1 cs=0 l=1 c_cookie=8013988095459858580 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed40d24e0 tx=0x7feed40dd540 comp rx=0 tx=0).stop 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 shutdown_connections 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5556f54ccc20 0x5556f54cd0c0 crc :-1 s=READY pgs=252 gs=4 cs=0 l=0 c_cookie=8054244273511584503 s_cookie=4010661256943719560 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54c98d0 unknown :-1 s=CLOSED pgs=1005 gs=1 cs=0 l=1 c_cookie=8013988095459858580 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54c8e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 --2- 10.20.193.28:0/1348626845 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54af4c0 0x5556f54c8820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feea8ff9640 0 client.18468 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:46.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 >> 10.20.193.28:0/1348626845 conn(0x5556f53ce1c0 msgr2=0x5556f54b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:46.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 shutdown_connections 2026-02-20T13:25:46.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 1 -- 10.20.193.28:0/1348626845 wait complete. 2026-02-20T13:25:46.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.397+0000 7feee82d4e00 20 client.18468 trim_cache size 0 max 16384 2026-02-20T13:25:46.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.404+0000 7feee82d4e00 1 Processor -- start 2026-02-20T13:25:46.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.404+0000 7feee82d4e00 1 -- start start 2026-02-20T13:25:46.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54af4c0 0x5556f54c8f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54cfde0 0x5556f54b5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54ef5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feee82d4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5556f53b88d0 con 0x5556f54f0700 2026-02-20T13:25:46.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feee82d4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5556f50f9f10 con 0x5556f54af4c0 2026-02-20T13:25:46.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feee82d4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5556f54adc90 con 0x5556f54cfde0 2026-02-20T13:25:46.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedeffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54cfde0 0x5556f54b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedeffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54cfde0 0x5556f54b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57012/0 (socket says 10.20.193.28:57012) 2026-02-20T13:25:46.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedeffd640 1 -- 10.20.193.28:0/436936050 learned_addr learned my addr 10.20.193.28:0/436936050 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:46.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedf7fe640 1 --2- 10.20.193.28:0/436936050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54af4c0 0x5556f54c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedffff640 1 -- 10.20.193.28:0/436936050 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54cfde0 msgr2=0x5556f54b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:46.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedffff640 1 --2- 10.20.193.28:0/436936050 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54cfde0 0x5556f54b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedffff640 1 -- 10.20.193.28:0/436936050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54af4c0 msgr2=0x5556f54c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedffff640 1 --2- 10.20.193.28:0/436936050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54af4c0 0x5556f54c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedffff640 1 -- 10.20.193.28:0/436936050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f5350670 con 0x5556f54f0700 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feedffff640 1 --2- 10.20.193.28:0/436936050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54ef5d0 secure :-1 s=READY pgs=1006 gs=2 cs=0 l=1 c_cookie=6074412409358812887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed40dd5b0 tx=0x7feed403b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544ca5e7170e86d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feeaaffd640 1 -- 10.20.193.28:0/436936050 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed403e070 con 0x5556f54f0700 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feeaaffd640 1 -- 10.20.193.28:0/436936050 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5556f505a520 con 0x5556f54f0700 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.405+0000 7feeaaffd640 1 -- 10.20.193.28:0/436936050 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed4036320 con 0x5556f54f0700 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 -- 10.20.193.28:0/436936050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 msgr2=0x5556f54ef5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 --2- 10.20.193.28:0/436936050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54ef5d0 secure :-1 s=READY pgs=1006 gs=2 cs=0 l=1 c_cookie=6074412409358812887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed40dd5b0 tx=0x7feed403b070 comp rx=0 tx=0).stop 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 -- 10.20.193.28:0/436936050 shutdown_connections 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 --2- 10.20.193.28:0/436936050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54f0700 0x5556f54ef5d0 unknown :-1 s=CLOSED pgs=1006 gs=2 cs=0 l=1 c_cookie=6074412409358812887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 --2- 10.20.193.28:0/436936050 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54cfde0 0x5556f54b5c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 --2- 10.20.193.28:0/436936050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54af4c0 0x5556f54c8f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 -- 10.20.193.28:0/436936050 >> 10.20.193.28:0/436936050 conn(0x5556f53ce1c0 msgr2=0x5556f54c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 -- 10.20.193.28:0/436936050 shutdown_connections 2026-02-20T13:25:46.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 -- 10.20.193.28:0/436936050 wait complete. 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 -- start start 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 Processor -- start 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54af4c0 0x5556f54d2d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.406+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54d32c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feee82d4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54f0700 0x5556f54d4010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feee82d4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5556f50f9f10 con 0x5556f54af4c0 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feee82d4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5556f54d4550 con 0x5556f54cfde0 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feee82d4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5556f54d4710 con 0x5556f54f0700 2026-02-20T13:25:46.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54af4c0 0x5556f54d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54af4c0 0x5556f54d2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59334/0 (socket says 10.20.193.28:59334) 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 -- 10.20.193.28:0/2617247782 learned_addr learned my addr 10.20.193.28:0/2617247782 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedeffd640 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedffff640 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54f0700 0x5556f54d4010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 -- 10.20.193.28:0/2617247782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54f0700 msgr2=0x5556f54d4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54f0700 0x5556f54d4010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 -- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 msgr2=0x5556f54d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 -- 10.20.193.28:0/2617247782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f534b0f0 con 0x5556f54af4c0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedeffd640 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54d32c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feedf7fe640 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54af4c0 0x5556f54d2d80 secure :-1 s=READY pgs=1007 gs=1 cs=0 l=1 c_cookie=10009816254545426792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feecc004580 tx=0x7feecc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aea02d9671c7968 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feea8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feea8ff9640 1 -- 10.20.193.28:0/2617247782 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feecc022070 con 0x5556f54af4c0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feea8ff9640 1 -- 10.20.193.28:0/2617247782 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feecc023040 con 0x5556f54af4c0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f533eda0 con 0x5556f54af4c0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feea8ff9640 1 -- 10.20.193.28:0/2617247782 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feecc011d60 con 0x5556f54af4c0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feee82d4e00 10 client.18474 _ll_register_callbacks cb 0x5556f5345a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.407+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556f546aca0 con 0x5556f54af4c0 2026-02-20T13:25:46.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feea8ff9640 1 -- 10.20.193.28:0/2617247782 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7feecc01b3d0 con 0x5556f54af4c0 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feea8ff9640 1 -- 10.20.193.28:0/2617247782 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feecc01b5f0 con 0x5556f54af4c0 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feee82d4e00 10 client.18474 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5556f533f0d0 con 0x5556f54af4c0 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feea8ff9640 1 -- 10.20.193.28:0/2617247782 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feecc028040 con 0x5556f54af4c0 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feee82d4e00 10 client.18474 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feee82d4e00 10 client.18474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feee82d4e00 20 client.18474 populate_metadata read hostname 'trial028' 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feee82d4e00 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5556f559d2d0 0x5556f55bd780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feee82d4e00 4 client.18474 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5556f509e640 con 0x5556f559d2d0 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.408+0000 7feedeffd640 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5556f559d2d0 0x5556f55bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.409+0000 7feedeffd640 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5556f559d2d0 0x5556f55bd780 crc :-1 s=READY pgs=253 gs=4 cs=0 l=0 c_cookie=6075272807562858208 s_cookie=7030952677525288614 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=544fb46e285fcee0 server_cookie=6192f6356879f6a6 in_seq=0 out_seq=0 2026-02-20T13:25:46.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.409+0000 7feea8ff9640 10 client.18474 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:46.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feea8ff9640 1 -- 10.20.193.28:0/2617247782 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5556f509e640 con 0x5556f559d2d0 2026-02-20T13:25:46.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feea8ff9640 10 client.18474 handle_command_reply: tid=0 2026-02-20T13:25:46.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 client.18474 shutdown 2026-02-20T13:25:46.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54af4c0 msgr2=0x5556f54d2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54af4c0 0x5556f54d2d80 secure :-1 s=READY pgs=1007 gs=1 cs=0 l=1 c_cookie=10009816254545426792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feecc004580 tx=0x7feecc0047e0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 shutdown_connections 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5556f559d2d0 0x5556f55bd780 crc :-1 s=READY pgs=253 gs=4 cs=0 l=0 c_cookie=6075272807562858208 s_cookie=7030952677525288614 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5556f54f0700 0x5556f54d4010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5556f54cfde0 0x5556f54d32c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 --2- 10.20.193.28:0/2617247782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5556f54af4c0 0x5556f54d2d80 unknown :-1 s=CLOSED pgs=1007 gs=1 cs=0 l=1 c_cookie=10009816254545426792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feea8ff9640 0 client.18474 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 >> 10.20.193.28:0/2617247782 conn(0x5556f53ce1c0 msgr2=0x5556f54ee5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 shutdown_connections 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.413+0000 7feee82d4e00 1 -- 10.20.193.28:0/2617247782 wait complete. 2026-02-20T13:25:46.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee82d4e00 20 client.18474 trim_cache size 0 max 16384 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 -- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feeb40b57a0 msgr2=0x7feeb40d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feeb40b57a0 0x7feeb40d5c50 secure :-1 s=READY pgs=453 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feecc004740 tx=0x7feecc005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 -- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee01100b0 msgr2=0x7feee00f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee01100b0 0x7feee00f8a30 secure :-1 s=READY pgs=1003 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed400a360 tx=0x7feed40039b0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 -- 10.20.193.28:0/344930221 shutdown_connections 2026-02-20T13:25:46.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feeb40b57a0 0x7feeb40d5c50 unknown :-1 s=CLOSED pgs=453 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feee01100b0 0x7feee00f8a30 unknown :-1 s=CLOSED pgs=1003 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feee010f2f0 0x7feee0171060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 --2- 10.20.193.28:0/344930221 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feee010e940 0x7feee00f81f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:46.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 -- 10.20.193.28:0/344930221 >> 10.20.193.28:0/344930221 conn(0x7feee00ec320 msgr2=0x7feee00ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:46.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 -- 10.20.193.28:0/344930221 shutdown_connections 2026-02-20T13:25:46.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:46.414+0000 7feee4a43640 1 -- 10.20.193.28:0/344930221 wait complete. 2026-02-20T13:25:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:46 trial127 ceph-mon[43817]: pgmap v434: 97 pgs: 97 active+clean; 702 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2026-02-20T13:25:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:46 trial034 ceph-mon[43332]: pgmap v434: 97 pgs: 97 active+clean; 702 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2026-02-20T13:25:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:46 trial028 ceph-mon[37442]: pgmap v434: 97 pgs: 97 active+clean; 702 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2026-02-20T13:25:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:48 trial127 ceph-mon[43817]: pgmap v435: 97 pgs: 97 active+clean; 712 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2026-02-20T13:25:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:48 trial034 ceph-mon[43332]: pgmap v435: 97 pgs: 97 active+clean; 712 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2026-02-20T13:25:49.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:48 trial028 ceph-mon[37442]: pgmap v435: 97 pgs: 97 active+clean; 712 KiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2026-02-20T13:25:49.243 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:25:49.431 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:49.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.618+0000 7fd81841e640 1 -- 10.20.193.28:0/3474251719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 msgr2=0x7fd810114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:49.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.618+0000 7fd81841e640 1 --2- 10.20.193.28:0/3474251719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 0x7fd810114c70 secure :-1 s=READY pgs=1008 gs=1 cs=0 l=1 c_cookie=16089787067244581587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd804009950 tx=0x7fd80402f190 comp rx=0 tx=0).stop 2026-02-20T13:25:49.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.619+0000 7fd81841e640 1 -- 10.20.193.28:0/3474251719 shutdown_connections 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.619+0000 7fd81841e640 1 --2- 10.20.193.28:0/3474251719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 0x7fd810114c70 unknown :-1 s=CLOSED pgs=1008 gs=1 cs=0 l=1 c_cookie=16089787067244581587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.619+0000 7fd81841e640 1 --2- 10.20.193.28:0/3474251719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd810115420 0x7fd810175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.619+0000 7fd81841e640 1 --2- 10.20.193.28:0/3474251719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd81010f230 0x7fd81010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.619+0000 7fd81841e640 1 -- 10.20.193.28:0/3474251719 >> 10.20.193.28:0/3474251719 conn(0x7fd81005f830 msgr2=0x7fd81010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.619+0000 7fd81841e640 1 -- 10.20.193.28:0/3474251719 shutdown_connections 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.619+0000 7fd81841e640 1 -- 10.20.193.28:0/3474251719 wait complete. 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.619+0000 7fd81841e640 1 Processor -- start 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd81841e640 1 -- start start 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd81841e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd81010f230 0x7fd8100f5600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd81841e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 0x7fd810175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd81841e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd810115420 0x7fd8100f5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:49.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd81841e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd8100faf10 con 0x7fd81010fc20 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd81841e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd8100fb080 con 0x7fd81010f230 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd81841e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd8100fb240 con 0x7fd810115420 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 0x7fd810175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 0x7fd810175cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59354/0 (socket says 10.20.193.28:59354) 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 -- 10.20.193.28:0/2169887055 learned_addr learned my addr 10.20.193.28:0/2169887055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd816193640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd81010f230 0x7fd8100f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd816994640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd810115420 0x7fd8100f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 -- 10.20.193.28:0/2169887055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd810115420 msgr2=0x7fd8100f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd810115420 0x7fd8100f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 -- 10.20.193.28:0/2169887055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd81010f230 msgr2=0x7fd8100f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:49.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd81010f230 0x7fd8100f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 -- 10.20.193.28:0/2169887055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd804009570 con 0x7fd81010fc20 2026-02-20T13:25:49.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.620+0000 7fd815992640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 0x7fd810175cf0 secure :-1 s=READY pgs=1009 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd804005dd0 tx=0x7fd804005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:49.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.621+0000 7fd7f77fe640 1 -- 10.20.193.28:0/2169887055 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd80402fe20 con 0x7fd81010fc20 2026-02-20T13:25:49.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.621+0000 7fd7f77fe640 1 -- 10.20.193.28:0/2169887055 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd804002ce0 con 0x7fd81010fc20 2026-02-20T13:25:49.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.621+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8100fb4c0 con 0x7fd81010fc20 2026-02-20T13:25:49.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.621+0000 7fd7f77fe640 1 -- 10.20.193.28:0/2169887055 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd804041a40 con 0x7fd81010fc20 2026-02-20T13:25:49.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.621+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8100fb8e0 con 0x7fd81010fc20 2026-02-20T13:25:49.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.621+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd810110510 con 0x7fd81010fc20 2026-02-20T13:25:49.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.626+0000 7fd7f77fe640 1 -- 10.20.193.28:0/2169887055 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd80403f070 con 0x7fd81010fc20 2026-02-20T13:25:49.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.628+0000 7fd7f77fe640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7ec0b56d0 0x7fd7ec0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:49.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.628+0000 7fd7f77fe640 1 -- 10.20.193.28:0/2169887055 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd80410b3a0 con 0x7fd81010fc20 2026-02-20T13:25:49.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.628+0000 7fd816193640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7ec0b56d0 0x7fd7ec0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:49.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.628+0000 7fd7f77fe640 1 -- 10.20.193.28:0/2169887055 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fd80410b820 con 0x7fd81010fc20 2026-02-20T13:25:49.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.628+0000 7fd816193640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7ec0b56d0 0x7fd7ec0d5b80 secure :-1 s=READY pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd800004740 tx=0x7fd800005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:49.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.770+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd81010f600 con 0x7fd81010fc20 2026-02-20T13:25:49.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.771+0000 7fd7f77fe640 1 -- 10.20.193.28:0/2169887055 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fd8040cdd50 con 0x7fd81010fc20 2026-02-20T13:25:49.774 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:25:49.774 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:25:49.775 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:25:49.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7ec0b56d0 msgr2=0x7fd7ec0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:49.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7ec0b56d0 0x7fd7ec0d5b80 secure :-1 s=READY pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd800004740 tx=0x7fd800005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:49.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 msgr2=0x7fd810175cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:49.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 0x7fd810175cf0 secure :-1 s=READY pgs=1009 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd804005dd0 tx=0x7fd804005e00 comp rx=0 tx=0).stop 2026-02-20T13:25:49.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 shutdown_connections 2026-02-20T13:25:49.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7ec0b56d0 0x7fd7ec0d5b80 unknown :-1 s=CLOSED pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd81010fc20 0x7fd810175cf0 unknown :-1 s=CLOSED pgs=1009 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd810115420 0x7fd8100f5d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 --2- 10.20.193.28:0/2169887055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd81010f230 0x7fd8100f5600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:49.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 >> 10.20.193.28:0/2169887055 conn(0x7fd81005f830 msgr2=0x7fd810112a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:49.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 shutdown_connections 2026-02-20T13:25:49.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:49.772+0000 7fd81841e640 1 -- 10.20.193.28:0/2169887055 wait complete. 2026-02-20T13:25:49.872 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id adfb1b52 --release --await' 2026-02-20T13:25:49.872 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id adfb1b52 --release --await 2026-02-20T13:25:50.057 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:50.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e45ffb640 1 -- 10.20.193.28:0/4140684628 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c0386f0 con 0x7f0e4810b930 2026-02-20T13:25:50.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e47fff640 1 -- 10.20.193.28:0/4140684628 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4810b930 msgr2=0x7f0e4810bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e47fff640 1 --2- 10.20.193.28:0/4140684628 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4810b930 0x7f0e4810bd00 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=14611008198473575848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c009980 tx=0x7f0e3c02f1a0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e47fff640 1 -- 10.20.193.28:0/4140684628 shutdown_connections 2026-02-20T13:25:50.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e47fff640 1 --2- 10.20.193.28:0/4140684628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4810c320 0x7f0e481108f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e47fff640 1 --2- 10.20.193.28:0/4140684628 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e48110f10 0x7f0e481113b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e47fff640 1 --2- 10.20.193.28:0/4140684628 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4810b930 0x7f0e4810bd00 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=14611008198473575848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e47fff640 1 -- 10.20.193.28:0/4140684628 >> 10.20.193.28:0/4140684628 conn(0x7f0e480e95c0 msgr2=0x7f0e481099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:50.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.239+0000 7f0e47fff640 1 -- 10.20.193.28:0/4140684628 shutdown_connections 2026-02-20T13:25:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.240+0000 7f0e47fff640 1 -- 10.20.193.28:0/4140684628 wait complete. 2026-02-20T13:25:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e47fff640 1 Processor -- start 2026-02-20T13:25:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e47fff640 1 -- start start 2026-02-20T13:25:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4810b930 0x7f0e48122360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e47fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4810c320 0x7f0e481228a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e47fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e48110f10 0x7f0e48127c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e47fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48128290 con 0x7f0e4810b930 2026-02-20T13:25:50.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e47fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48128400 con 0x7f0e4810c320 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e47fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481285c0 con 0x7f0e48110f10 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e46ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4810b930 0x7f0e48122360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e46ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4810b930 0x7f0e48122360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47616/0 (socket says 10.20.193.28:47616) 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e46ffd640 1 -- 10.20.193.28:0/389006654 learned_addr learned my addr 10.20.193.28:0/389006654 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.241+0000 7f0e467fc640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4810c320 0x7f0e481228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e477fe640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e48110f10 0x7f0e48127c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e46ffd640 1 -- 10.20.193.28:0/389006654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e48110f10 msgr2=0x7f0e48127c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e48110f10 0x7f0e48127c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e46ffd640 1 -- 10.20.193.28:0/389006654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4810c320 msgr2=0x7f0e481228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4810c320 0x7f0e481228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e46ffd640 1 -- 10.20.193.28:0/389006654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e300094b0 con 0x7f0e4810b930 2026-02-20T13:25:50.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4810b930 0x7f0e48122360 secure :-1 s=READY pgs=1010 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c0092e0 tx=0x7f0e3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:50.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e4c8d5640 1 -- 10.20.193.28:0/389006654 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c03d070 con 0x7f0e4810b930 2026-02-20T13:25:50.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e47fff640 1 -- 10.20.193.28:0/389006654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3c009570 con 0x7f0e4810b930 2026-02-20T13:25:50.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.242+0000 7f0e47fff640 1 -- 10.20.193.28:0/389006654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e48168e00 con 0x7f0e4810b930 2026-02-20T13:25:50.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.243+0000 7f0e4c8d5640 1 -- 10.20.193.28:0/389006654 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e3c002b80 con 0x7f0e4810b930 2026-02-20T13:25:50.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.243+0000 7f0e4c8d5640 1 -- 10.20.193.28:0/389006654 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c041720 con 0x7f0e4810b930 2026-02-20T13:25:50.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.246+0000 7f0e4c8d5640 1 -- 10.20.193.28:0/389006654 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0e3c0418d0 con 0x7f0e4810b930 2026-02-20T13:25:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.248+0000 7f0e4c8d5640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e1c0b5760 0x7f0e1c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.248+0000 7f0e4c8d5640 1 -- 10.20.193.28:0/389006654 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0e3c10aff0 con 0x7f0e4810b930 2026-02-20T13:25:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e467fc640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e1c0b5760 0x7f0e1c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e4f8d1e00 1 Processor -- start 2026-02-20T13:25:50.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e4f8d1e00 1 -- start start 2026-02-20T13:25:50.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e467fc640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e1c0b5760 0x7f0e1c0d5c10 secure :-1 s=READY pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e48128d00 tx=0x7f0e30005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268a08f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268e5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af26905eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55af267b5c70 con 0x55af268a0e30 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55af267b19a0 con 0x55af268e5ad0 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.249+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55af267abb00 con 0x55af268a0520 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e467fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43254/0 (socket says 10.20.193.28:43254) 2026-02-20T13:25:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 -- 10.20.193.28:0/2300930239 learned_addr learned my addr 10.20.193.28:0/2300930239 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e467fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268e5590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47628/0 (socket says 10.20.193.28:47628) 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e477fe640 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af26905eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 -- 10.20.193.28:0/2300930239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 msgr2=0x55af26905eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af26905eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 -- 10.20.193.28:0/2300930239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 msgr2=0x55af268e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 -- 10.20.193.28:0/2300930239 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af26756f80 con 0x55af268a0520 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e477fe640 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af26905eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e467fc640 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268e5590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.250+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268a08f0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=1853055828477501055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c0044a0 tx=0x7f0e3c0d2560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19b76075455e5e7f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e0bfff640 1 -- 10.20.193.28:0/2300930239 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c0d9900 con 0x55af268a0520 2026-02-20T13:25:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e0bfff640 1 -- 10.20.193.28:0/2300930239 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e3c0d2de0 con 0x55af268a0520 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e0bfff640 1 -- 10.20.193.28:0/2300930239 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c0cce50 con 0x55af268a0520 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2300930239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 msgr2=0x55af268a08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268a08f0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=1853055828477501055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c0044a0 tx=0x7f0e3c0d2560 comp rx=0 tx=0).stop 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2300930239 shutdown_connections 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268e5590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af26905eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2300930239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268a08f0 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=1853055828477501055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2300930239 >> 10.20.193.28:0/2300930239 conn(0x55af267bea60 msgr2=0x55af2689ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2300930239 shutdown_connections 2026-02-20T13:25:50.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.251+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2300930239 wait complete. 2026-02-20T13:25:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.252+0000 7f0e4f8d1e00 1 -- start start 2026-02-20T13:25:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e4f8d1e00 1 Processor -- start 2026-02-20T13:25:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b8220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af268b8760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 0x55af268bd750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55af268bdc90 con 0x55af268e5ad0 2026-02-20T13:25:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55af268bde00 con 0x55af268a0e30 2026-02-20T13:25:50.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55af268bdfc0 con 0x55af268a0520 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e467fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af268b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e467fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af268b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44768/0 (socket says 10.20.193.28:44768) 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e467fc640 1 -- 10.20.193.28:0/593202136 learned_addr learned my addr 10.20.193.28:0/593202136 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.253+0000 7f0e477fe640 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 0x55af268bd750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e467fc640 1 -- 10.20.193.28:0/593202136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 msgr2=0x55af268b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e467fc640 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e467fc640 1 -- 10.20.193.28:0/593202136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 msgr2=0x55af268bd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e467fc640 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 0x55af268bd750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e467fc640 1 -- 10.20.193.28:0/593202136 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e48168e00 con 0x55af268a0e30 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e467fc640 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af268b8760 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=13567406299121721770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e30009fd0 tx=0x7f0e30013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc491c25568c21aa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e097fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:25:50.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e097fa640 1 -- 10.20.193.28:0/593202136 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e30021040 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e097fa640 1 -- 10.20.193.28:0/593202136 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e3001bda0 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e30009d60 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e097fa640 1 -- 10.20.193.28:0/593202136 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e300258d0 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e4f8d1e00 10 client.28454 _ll_register_callbacks cb 0x55af2672cd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af26441ba0 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.254+0000 7f0e097fa640 1 -- 10.20.193.28:0/593202136 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0e30025a60 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e097fa640 1 -- 10.20.193.28:0/593202136 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0e30025c60 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e4f8d1e00 10 client.28454 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55af2672f710 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e097fa640 1 -- 10.20.193.28:0/593202136 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0e3001aa60 con 0x55af268a0e30 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e4f8d1e00 10 client.28454 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e4f8d1e00 10 client.28454 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e4f8d1e00 20 client.28454 populate_metadata read hostname 'trial028' 2026-02-20T13:25:50.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55af268e2b60 0x55af268e3000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e4f8d1e00 4 client.28454 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af2677e410 con 0x55af268e2b60 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.255+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55af268e2b60 0x55af268e3000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.256+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55af268e2b60 0x55af268e3000 crc :-1 s=READY pgs=254 gs=4 cs=0 l=0 c_cookie=3444503665007117452 s_cookie=8736745766979733786 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fcd55d56447c48c server_cookie=793f27fc5db9891a in_seq=0 out_seq=0 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.256+0000 7f0e097fa640 10 client.28454 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.256+0000 7f0e097fa640 1 -- 10.20.193.28:0/593202136 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55af2677e410 con 0x55af268e2b60 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.256+0000 7f0e097fa640 10 client.28454 handle_command_reply: tid=0 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.256+0000 7f0e4f8d1e00 1 client.28454 shutdown 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 msgr2=0x55af268b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af268b8760 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=13567406299121721770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e30009fd0 tx=0x7f0e30013040 comp rx=0 tx=0).stop 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 shutdown_connections 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55af268e2b60 0x55af268e3000 crc :-1 s=READY pgs=254 gs=4 cs=0 l=0 c_cookie=3444503665007117452 s_cookie=8736745766979733786 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 0x55af268bd750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af268b8760 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=13567406299121721770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/593202136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b8220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 >> 10.20.193.28:0/593202136 conn(0x55af267bea60 msgr2=0x55af2689f510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e097fa640 0 client.28454 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 shutdown_connections 2026-02-20T13:25:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/593202136 wait complete. 2026-02-20T13:25:50.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.257+0000 7f0e4f8d1e00 20 client.28454 trim_cache size 0 max 16384 2026-02-20T13:25:50.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e4f8d1e00 1 Processor -- start 2026-02-20T13:25:50.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e4f8d1e00 1 -- start start 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b56e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af2689f710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 0x55af2689fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55af267a9730 con 0x55af268e5ad0 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55af26469960 con 0x55af268a0e30 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e4f8d1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55af267b19a0 con 0x55af268a0520 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43262/0 (socket says 10.20.193.28:43262) 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.266+0000 7f0e46ffd640 1 -- 10.20.193.28:0/1117952947 learned_addr learned my addr 10.20.193.28:0/1117952947 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e477fe640 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 0x55af2689fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e467fc640 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af2689f710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e46ffd640 1 -- 10.20.193.28:0/1117952947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 msgr2=0x55af2689f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:50.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af2689f710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e46ffd640 1 -- 10.20.193.28:0/1117952947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 msgr2=0x55af2689fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 0x55af2689fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e46ffd640 1 -- 10.20.193.28:0/1117952947 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af268aab30 con 0x55af268a0520 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e467fc640 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af2689f710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b56e0 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=16002331878683668292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c0d2650 tx=0x7f0e3c108040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de13b40f46d96f44 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e0b7fe640 1 -- 10.20.193.28:0/1117952947 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c0dc610 con 0x55af268a0520 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e0b7fe640 1 -- 10.20.193.28:0/1117952947 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e3c0ce650 con 0x55af268a0520 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.267+0000 7f0e0b7fe640 1 -- 10.20.193.28:0/1117952947 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c0d3070 con 0x55af268a0520 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/1117952947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 msgr2=0x55af268b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b56e0 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=16002331878683668292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c0d2650 tx=0x7f0e3c108040 comp rx=0 tx=0).stop 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/1117952947 shutdown_connections 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268e5ad0 0x55af2689fc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268a0e30 0x55af2689f710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/1117952947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268b56e0 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=16002331878683668292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/1117952947 >> 10.20.193.28:0/1117952947 conn(0x55af267bea60 msgr2=0x55af268b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/1117952947 shutdown_connections 2026-02-20T13:25:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/1117952947 wait complete. 2026-02-20T13:25:50.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 -- start start 2026-02-20T13:25:50.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.268+0000 7f0e4f8d1e00 1 Processor -- start 2026-02-20T13:25:50.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268c3e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268c04d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e4f8d1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af268c0a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268c3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43264/0 (socket says 10.20.193.28:43264) 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55af267b19a0 con 0x55af268a0e30 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55af267a9730 con 0x55af268e5ad0 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55af268c46b0 con 0x55af268a0520 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e46ffd640 1 -- 10.20.193.28:0/2771164729 learned_addr learned my addr 10.20.193.28:0/2771164729 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e477fe640 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af268c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e467fc640 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e46ffd640 1 -- 10.20.193.28:0/2771164729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 msgr2=0x55af268c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.269+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af268c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e46ffd640 1 -- 10.20.193.28:0/2771164729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 msgr2=0x55af268c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e46ffd640 1 -- 10.20.193.28:0/2771164729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af26741350 con 0x55af268a0520 2026-02-20T13:25:50.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e467fc640 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268c04d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e46ffd640 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268c3e80 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=14912084968104539483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c0418a0 tx=0x7f0e3c005ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef25e455850355b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e097fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e097fa640 1 -- 10.20.193.28:0/2771164729 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c0dc610 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e097fa640 1 -- 10.20.193.28:0/2771164729 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e3c0dc150 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e097fa640 1 -- 10.20.193.28:0/2771164729 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e3c0d03c0 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af26756f80 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e097fa640 1 -- 10.20.193.28:0/2771164729 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0e3c0d0550 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e4f8d1e00 10 client.28354 _ll_register_callbacks cb 0x55af2672cd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af26503700 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e097fa640 1 -- 10.20.193.28:0/2771164729 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0e3c0dc2c0 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e4f8d1e00 10 client.28354 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.270+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55af2673bdd0 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e097fa640 1 -- 10.20.193.28:0/2771164729 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0e3c0ea030 con 0x55af268a0520 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e4f8d1e00 10 client.28354 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e4f8d1e00 10 client.28354 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e4f8d1e00 20 client.28354 populate_metadata read hostname 'trial028' 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55af26993550 0x55af269b3a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e4f8d1e00 4 client.28354 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "adfb1b52", "release": true, "await": true}] 2026-02-20T13:25:50.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "adfb1b52", "release": true, "await": true}) -- 0x7f0e3c0d2de0 con 0x55af26993550 2026-02-20T13:25:50.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e467fc640 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55af26993550 0x55af269b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e467fc640 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55af26993550 0x55af269b3a00 crc :-1 s=READY pgs=255 gs=4 cs=0 l=0 c_cookie=17819735258975836505 s_cookie=9821951836860247276 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f74c6ace16c21959 server_cookie=884e95281d0cecec in_seq=0 out_seq=0 2026-02-20T13:25:50.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.271+0000 7f0e097fa640 10 client.28354 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:50.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e097fa640 1 -- 10.20.193.28:0/2771164729 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f0e3c0d2de0 con 0x55af26993550 2026-02-20T13:25:50.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e097fa640 10 client.28354 handle_command_reply: tid=0 2026-02-20T13:25:50.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 client.28354 shutdown 2026-02-20T13:25:50.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 msgr2=0x55af268c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268c3e80 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=14912084968104539483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c0418a0 tx=0x7f0e3c005ca0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 shutdown_connections 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55af26993550 0x55af269b3a00 crc :-1 s=READY pgs=255 gs=4 cs=0 l=0 c_cookie=17819735258975836505 s_cookie=9821951836860247276 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af268a0e30 0x55af268c04d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55af268e5ad0 0x55af268c0a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 --2- 10.20.193.28:0/2771164729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55af268a0520 0x55af268c3e80 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=14912084968104539483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e097fa640 0 client.28354 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.273+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 >> 10.20.193.28:0/2771164729 conn(0x55af267bea60 msgr2=0x55af268b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 shutdown_connections 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e4f8d1e00 1 -- 10.20.193.28:0/2771164729 wait complete. 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e4f8d1e00 20 client.28354 trim_cache size 0 max 16384 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:25:50.276 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 28, 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "adfb1b52": { 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "version": 28, 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 139.8, 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:50.277 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 -- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e1c0b5760 msgr2=0x7f0e1c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e1c0b5760 0x7f0e1c0d5c10 secure :-1 s=READY pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e48128d00 tx=0x7f0e30005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 -- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4810b930 msgr2=0x7f0e48122360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4810b930 0x7f0e48122360 secure :-1 s=READY pgs=1010 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c0092e0 tx=0x7f0e3c004270 comp rx=0 tx=0).stop 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 -- 10.20.193.28:0/389006654 shutdown_connections 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0e1c0b5760 0x7f0e1c0d5c10 unknown :-1 s=CLOSED pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e48110f10 0x7f0e48127c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0e4810c320 0x7f0e481228a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 --2- 10.20.193.28:0/389006654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e4810b930 0x7f0e48122360 unknown :-1 s=CLOSED pgs=1010 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 -- 10.20.193.28:0/389006654 >> 10.20.193.28:0/389006654 conn(0x7f0e480e95c0 msgr2=0x7f0e481099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 -- 10.20.193.28:0/389006654 shutdown_connections 2026-02-20T13:25:50.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.274+0000 7f0e47fff640 1 -- 10.20.193.28:0/389006654 wait complete. 2026-02-20T13:25:50.375 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'adfb1b52', total seconds elapsed: 20.9 2026-02-20T13:25:50.376 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.8 2026-02-20T13:25:50.376 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:25:50.561 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:50.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 -- 10.20.193.28:0/2949219585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 msgr2=0x7f30cc111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2949219585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 0x7f30cc111b40 secure :-1 s=READY pgs=1011 gs=1 cs=0 l=1 c_cookie=8093157982457542053 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c800aa30 tx=0x7f30c8030270 comp rx=0 tx=0).stop 2026-02-20T13:25:50.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 -- 10.20.193.28:0/2949219585 shutdown_connections 2026-02-20T13:25:50.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2949219585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 0x7f30cc111b40 unknown :-1 s=CLOSED pgs=1011 gs=1 cs=0 l=1 c_cookie=8093157982457542053 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2949219585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30cc10bb40 0x7f30cc1109d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2949219585 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30cc10b150 0x7f30cc10b520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 -- 10.20.193.28:0/2949219585 >> 10.20.193.28:0/2949219585 conn(0x7f30cc0e8ce0 msgr2=0x7f30cc1090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 -- 10.20.193.28:0/2949219585 shutdown_connections 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 -- 10.20.193.28:0/2949219585 wait complete. 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 Processor -- start 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.737+0000 7f30d2a20640 1 -- start start 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d2a20640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30cc10b150 0x7f30cc123390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d2a20640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30cc10bb40 0x7f30cc1238d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d2a20640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 0x7f30cc128ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d2a20640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1292c0 con 0x7f30cc111160 2026-02-20T13:25:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d2a20640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc129430 con 0x7f30cc10bb40 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d2a20640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1295f0 con 0x7f30cc10b150 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d1a1e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30cc10b150 0x7f30cc123390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d1a1e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30cc10b150 0x7f30cc123390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43280/0 (socket says 10.20.193.28:43280) 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d1a1e640 1 -- 10.20.193.28:0/2065609926 learned_addr learned my addr 10.20.193.28:0/2065609926 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d221f640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 0x7f30cc128ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d121d640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30cc10bb40 0x7f30cc1238d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d221f640 1 -- 10.20.193.28:0/2065609926 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30cc10b150 msgr2=0x7f30cc123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d221f640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30cc10b150 0x7f30cc123390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d221f640 1 -- 10.20.193.28:0/2065609926 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30cc10bb40 msgr2=0x7f30cc1238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d221f640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30cc10bb40 0x7f30cc1238d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d221f640 1 -- 10.20.193.28:0/2065609926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c800a650 con 0x7f30cc111160 2026-02-20T13:25:50.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.738+0000 7f30d221f640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 0x7f30cc128ca0 secure :-1 s=READY pgs=1012 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c8033040 tx=0x7f30c80039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:50.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.739+0000 7f30baffd640 1 -- 10.20.193.28:0/2065609926 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30c803e070 con 0x7f30cc111160 2026-02-20T13:25:50.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.739+0000 7f30baffd640 1 -- 10.20.193.28:0/2065609926 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f30c80055a0 con 0x7f30cc111160 2026-02-20T13:25:50.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.739+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30cc129870 con 0x7f30cc111160 2026-02-20T13:25:50.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.739+0000 7f30baffd640 1 -- 10.20.193.28:0/2065609926 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30c8042950 con 0x7f30cc111160 2026-02-20T13:25:50.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.739+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30cc169e30 con 0x7f30cc111160 2026-02-20T13:25:50.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.739+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30cc10c270 con 0x7f30cc111160 2026-02-20T13:25:50.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.741+0000 7f30baffd640 1 -- 10.20.193.28:0/2065609926 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f30c8039c40 con 0x7f30cc111160 2026-02-20T13:25:50.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.743+0000 7f30baffd640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30a80b56e0 0x7f30a80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:50.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.743+0000 7f30baffd640 1 -- 10.20.193.28:0/2065609926 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f30c810c6a0 con 0x7f30cc111160 2026-02-20T13:25:50.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.743+0000 7f30d1a1e640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30a80b56e0 0x7f30a80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:50.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.743+0000 7f30baffd640 1 -- 10.20.193.28:0/2065609926 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f30c810cb20 con 0x7f30cc111160 2026-02-20T13:25:50.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.744+0000 7f30d1a1e640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30a80b56e0 0x7f30a80d5b90 secure :-1 s=READY pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30bc00b2c0 tx=0x7f30bc00b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:50.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.883+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30cc1109d0 con 0x7f30cc111160 2026-02-20T13:25:50.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.883+0000 7f30baffd640 1 -- 10.20.193.28:0/2065609926 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f30c80cf100 con 0x7f30cc111160 2026-02-20T13:25:50.887 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:25:50.887 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:25:50.887 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:25:50.888 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:50 trial028 ceph-mon[37442]: pgmap v436: 97 pgs: 97 active+clean; 712 KiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2026-02-20T13:25:50.888 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:50 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2169887055' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:50.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30a80b56e0 msgr2=0x7f30a80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30a80b56e0 0x7f30a80d5b90 secure :-1 s=READY pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30bc00b2c0 tx=0x7f30bc00b4a0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 msgr2=0x7f30cc128ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:50.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 0x7f30cc128ca0 secure :-1 s=READY pgs=1012 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c8033040 tx=0x7f30c80039b0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 shutdown_connections 2026-02-20T13:25:50.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30a80b56e0 0x7f30a80d5b90 unknown :-1 s=CLOSED pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30cc111160 0x7f30cc128ca0 unknown :-1 s=CLOSED pgs=1012 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30cc10bb40 0x7f30cc1238d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 --2- 10.20.193.28:0/2065609926 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30cc10b150 0x7f30cc123390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:50.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 >> 10.20.193.28:0/2065609926 conn(0x7f30cc0e8ce0 msgr2=0x7f30cc1090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:50.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 shutdown_connections 2026-02-20T13:25:50.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:50.885+0000 7f30d2a20640 1 -- 10.20.193.28:0/2065609926 wait complete. 2026-02-20T13:25:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:50 trial127 ceph-mon[43817]: pgmap v436: 97 pgs: 97 active+clean; 712 KiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2026-02-20T13:25:50.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:50 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2169887055' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:50.988 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 139.8 --await-for 45.0' 2026-02-20T13:25:50.988 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 139.8 --await-for 45.0 2026-02-20T13:25:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:50 trial034 ceph-mon[43332]: pgmap v436: 97 pgs: 97 active+clean; 712 KiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2026-02-20T13:25:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:50 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2169887055' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:51.175 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.359+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1562729868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f1810b630 msgr2=0x7f3f1810ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.359+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1562729868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f1810b630 0x7f3f1810ba00 secure :-1 s=READY pgs=367 gs=3 cs=0 l=1 c_cookie=14171722865265041873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f08009890 tx=0x7f3f0802f120 comp rx=0 tx=0).stop 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.359+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1562729868 shutdown_connections 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.359+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1562729868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f18113380 0x7f3f18173d50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.359+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1562729868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f1810c020 0x7f3f18112bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.359+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1562729868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f1810b630 0x7f3f1810ba00 unknown :-1 s=CLOSED pgs=367 gs=3 cs=0 l=1 c_cookie=14171722865265041873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.359+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1562729868 >> 10.20.193.28:0/1562729868 conn(0x7f3f180e9080 msgr2=0x7f3f18109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.359+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1562729868 shutdown_connections 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.360+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1562729868 wait complete. 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.360+0000 7f3f1f2e9640 1 Processor -- start 2026-02-20T13:25:51.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.360+0000 7f3f1f2e9640 1 -- start start 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.360+0000 7f3f1f2e9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f1810b630 0x7f3f180f3db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.360+0000 7f3f1f2e9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1810c020 0x7f3f18173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1f2e9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f18113380 0x7f3f180f44b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1f2e9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3f180f9670 con 0x7f3f1810c020 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1f2e9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3f180f97e0 con 0x7f3f18113380 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1f2e9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3f180f99a0 con 0x7f3f1810b630 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1e2e7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f1810b630 0x7f3f180f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1e2e7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f1810b630 0x7f3f180f3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43296/0 (socket says 10.20.193.28:43296) 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/1890450939 learned_addr learned my addr 10.20.193.28:0/1890450939 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1810c020 0x7f3f18173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1eae8640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f18113380 0x7f3f180f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1dae6640 1 -- 10.20.193.28:0/1890450939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f1810b630 msgr2=0x7f3f180f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f1810b630 0x7f3f180f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1dae6640 1 -- 10.20.193.28:0/1890450939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f18113380 msgr2=0x7f3f180f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f18113380 0x7f3f180f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1dae6640 1 -- 10.20.193.28:0/1890450939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f080094b0 con 0x7f3f1810c020 2026-02-20T13:25:51.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.361+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1810c020 0x7f3f18173c50 secure :-1 s=READY pgs=1013 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f0c004740 tx=0x7f3f0c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:51.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.362+0000 7f3eff7fe640 1 -- 10.20.193.28:0/1890450939 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f0c00cd40 con 0x7f3f1810c020 2026-02-20T13:25:51.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.362+0000 7f3eff7fe640 1 -- 10.20.193.28:0/1890450939 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f0c004d30 con 0x7f3f1810c020 2026-02-20T13:25:51.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.362+0000 7f3eff7fe640 1 -- 10.20.193.28:0/1890450939 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f0c0106b0 con 0x7f3f1810c020 2026-02-20T13:25:51.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.362+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1890450939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f180f9c80 con 0x7f3f1810c020 2026-02-20T13:25:51.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.362+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1890450939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f180fa1a0 con 0x7f3f1810c020 2026-02-20T13:25:51.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.364+0000 7f3eff7fe640 1 -- 10.20.193.28:0/1890450939 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3f0c01f060 con 0x7f3f1810c020 2026-02-20T13:25:51.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.366+0000 7f3eff7fe640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ef40b5750 0x7f3ef40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.366+0000 7f3eff7fe640 1 -- 10.20.193.28:0/1890450939 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3f0c014070 con 0x7f3f1810c020 2026-02-20T13:25:51.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.366+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ef40b5750 0x7f3ef40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.367+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ef40b5750 0x7f3ef40d5c00 secure :-1 s=READY pgs=457 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f080097e0 tx=0x7f3f0803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:51.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.367+0000 7f3f2256ce00 1 Processor -- start 2026-02-20T13:25:51.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f2256ce00 1 -- start start 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb131e0c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb132258c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb132461e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eb130f5780 con 0x55eb131e0850 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55eb130f14b0 con 0x55eb13225e00 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55eb130eb610 con 0x55eb131e1160 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb131e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1eae8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb132461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb131e0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47730/0 (socket says 10.20.193.28:47730) 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/1993732496 learned_addr learned my addr 10.20.193.28:0/1993732496 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/1993732496 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb132258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/1993732496 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 msgr2=0x55eb132258c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/1993732496 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb132258c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/1993732496 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 msgr2=0x55eb132461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/1993732496 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb132461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/1993732496 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb13096c50 con 0x55eb131e0850 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.368+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/1993732496 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb131e0c20 secure :-1 s=READY pgs=1014 gs=1 cs=0 l=1 c_cookie=15540941371968343352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f08002df0 tx=0x7f3f08040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ac83d69f584d38 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3efcb0a640 1 -- 10.20.193.28:0/1993732496 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f08005d40 con 0x55eb131e0850 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3efcb0a640 1 -- 10.20.193.28:0/1993732496 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f0803e040 con 0x55eb131e0850 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3efcb0a640 1 -- 10.20.193.28:0/1993732496 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f0804f6b0 con 0x55eb131e0850 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1993732496 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 msgr2=0x55eb131e0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1993732496 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb131e0c20 secure :-1 s=READY pgs=1014 gs=1 cs=0 l=1 c_cookie=15540941371968343352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f08002df0 tx=0x7f3f08040000 comp rx=0 tx=0).stop 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1993732496 shutdown_connections 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1993732496 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb132461e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1993732496 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb132258c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1993732496 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb131e0c20 unknown :-1 s=CLOSED pgs=1014 gs=1 cs=0 l=1 c_cookie=15540941371968343352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1993732496 >> 10.20.193.28:0/1993732496 conn(0x55eb130fe110 msgr2=0x55eb131df130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:51.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1993732496 shutdown_connections 2026-02-20T13:25:51.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.369+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1993732496 wait complete. 2026-02-20T13:25:51.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.370+0000 7f3f2256ce00 1 -- start start 2026-02-20T13:25:51.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f2256ce00 1 Processor -- start 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb131e0850 0x55eb131f87e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131f8d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb13225e00 0x55eb131fdd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eb131fe250 con 0x55eb131e1160 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55eb131fe3c0 con 0x55eb131e0850 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55eb131fe580 con 0x55eb13225e00 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1e2e7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb131e0850 0x55eb131f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1dae6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1e2e7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb131e0850 0x55eb131f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44826/0 (socket says 10.20.193.28:44826) 2026-02-20T13:25:51.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/1072833763 learned_addr learned my addr 10.20.193.28:0/1072833763 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1dae6640 1 -- 10.20.193.28:0/1072833763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb13225e00 msgr2=0x55eb131fdd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb13225e00 0x55eb131fdd10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1dae6640 1 -- 10.20.193.28:0/1072833763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb131e0850 msgr2=0x55eb131f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb131e0850 0x55eb131f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1dae6640 1 -- 10.20.193.28:0/1072833763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1306ee60 con 0x55eb131e1160 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb131e0850 0x55eb131f87e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.371+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131f8d20 secure :-1 s=READY pgs=1015 gs=2 cs=0 l=1 c_cookie=2505657189949097559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f0c0acea0 tx=0x7f3f0c0ac970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c5e1f04fd1c657 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3ecbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3ecbfff640 1 -- 10.20.193.28:0/1072833763 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f0c0b2be0 con 0x55eb131e1160 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3ecbfff640 1 -- 10.20.193.28:0/1072833763 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f0c0b51c0 con 0x55eb131e1160 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3ecbfff640 1 -- 10.20.193.28:0/1072833763 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f0c0acce0 con 0x55eb131e1160 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f181745c0 con 0x55eb131e1160 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3f2256ce00 10 client.18516 _ll_register_callbacks cb 0x55eb1306c320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb12d81eb0 con 0x55eb131e1160 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3ecbfff640 1 -- 10.20.193.28:0/1072833763 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3f0c0051e0 con 0x55eb131e1160 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3ecbfff640 1 -- 10.20.193.28:0/1072833763 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f0c0b8000 con 0x55eb131e1160 2026-02-20T13:25:51.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3f2256ce00 10 client.18516 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.372+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55eb13080d80 con 0x55eb131e1160 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.373+0000 7f3ecbfff640 1 -- 10.20.193.28:0/1072833763 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3f0c06bd20 con 0x55eb131e1160 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.373+0000 7f3f2256ce00 10 client.18516 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.373+0000 7f3f2256ce00 10 client.18516 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.373+0000 7f3f2256ce00 20 client.18516 populate_metadata read hostname 'trial028' 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.373+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb13223030 0x55eb132234d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.373+0000 7f3f2256ce00 4 client.18516 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.373+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb130bd700 con 0x55eb13223030 2026-02-20T13:25:51.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.373+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb13223030 0x55eb132234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb13223030 0x55eb132234d0 crc :-1 s=READY pgs=256 gs=3 cs=0 l=0 c_cookie=8029416801727875951 s_cookie=12676705124205069564 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f6e380a1c8b0b6f server_cookie=afecb4257a9e04fc in_seq=0 out_seq=0 2026-02-20T13:25:51.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3ecbfff640 10 client.18516 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:51.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3ecbfff640 1 -- 10.20.193.28:0/1072833763 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55eb130bd700 con 0x55eb13223030 2026-02-20T13:25:51.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3ecbfff640 10 client.18516 handle_command_reply: tid=0 2026-02-20T13:25:51.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 client.18516 shutdown 2026-02-20T13:25:51.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 msgr2=0x55eb131f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131f8d20 secure :-1 s=READY pgs=1015 gs=2 cs=0 l=1 c_cookie=2505657189949097559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f0c0acea0 tx=0x7f3f0c0ac970 comp rx=0 tx=0).stop 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 shutdown_connections 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb13223030 0x55eb132234d0 crc :-1 s=READY pgs=256 gs=3 cs=0 l=0 c_cookie=8029416801727875951 s_cookie=12676705124205069564 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131f8d20 unknown :-1 s=CLOSED pgs=1015 gs=2 cs=0 l=1 c_cookie=2505657189949097559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb13225e00 0x55eb131fdd10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/1072833763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb131e0850 0x55eb131f87e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3ecbfff640 0 client.18516 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.374+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 >> 10.20.193.28:0/1072833763 conn(0x55eb130fe110 msgr2=0x55eb131df840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.375+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 shutdown_connections 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.375+0000 7f3f2256ce00 1 -- 10.20.193.28:0/1072833763 wait complete. 2026-02-20T13:25:51.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.375+0000 7f3f2256ce00 20 client.18516 trim_cache size 0 max 16384 2026-02-20T13:25:51.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.383+0000 7f3f2256ce00 1 Processor -- start 2026-02-20T13:25:51.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.383+0000 7f3f2256ce00 1 -- start start 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e0850 0x55eb131f5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131dfa40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb131dff80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eb130e9240 con 0x55eb131e1160 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55eb12da9ec0 con 0x55eb13225e00 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55eb1314f120 con 0x55eb131e0850 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e0850 0x55eb131f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e0850 0x55eb131f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43330/0 (socket says 10.20.193.28:43330) 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/2255883070 learned_addr learned my addr 10.20.193.28:0/2255883070 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1eae8640 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb131dff80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1dae6640 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/2255883070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 msgr2=0x55eb131dff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb131dff80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/2255883070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 msgr2=0x55eb131dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131dfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 -- 10.20.193.28:0/2255883070 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1307b800 con 0x55eb131e0850 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e0850 0x55eb131f5cd0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=17331965314111859484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f08002df0 tx=0x7f3f08038d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f087829fdf076b1c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3ee64e6640 1 -- 10.20.193.28:0/2255883070 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f080389c0 con 0x55eb131e0850 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.384+0000 7f3ee64e6640 1 -- 10.20.193.28:0/2255883070 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f08005900 con 0x55eb131e0850 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3ee64e6640 1 -- 10.20.193.28:0/2255883070 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f0805ad80 con 0x55eb131e0850 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 -- 10.20.193.28:0/2255883070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e0850 msgr2=0x55eb131f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e0850 0x55eb131f5cd0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=17331965314111859484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f08002df0 tx=0x7f3f08038d40 comp rx=0 tx=0).stop 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 -- 10.20.193.28:0/2255883070 shutdown_connections 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e1160 0x55eb131dfa40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb131dff80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/2255883070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e0850 0x55eb131f5cd0 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=17331965314111859484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 -- 10.20.193.28:0/2255883070 >> 10.20.193.28:0/2255883070 conn(0x55eb130fe110 msgr2=0x55eb131f55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 -- 10.20.193.28:0/2255883070 shutdown_connections 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 -- 10.20.193.28:0/2255883070 wait complete. 2026-02-20T13:25:51.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.385+0000 7f3f2256ce00 1 -- start start 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f2256ce00 1 Processor -- start 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb13202320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb13202860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f2256ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb1328b330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eb130e9240 con 0x55eb131e0850 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55eb13203120 con 0x55eb13225e00 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f2256ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55eb1328b870 con 0x55eb131e1160 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f1dae6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb13202860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f1eae8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb1328b330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f1dae6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb13202860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43344/0 (socket says 10.20.193.28:43344) 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f1dae6640 1 -- 10.20.193.28:0/3023740220 learned_addr learned my addr 10.20.193.28:0/3023740220 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb13202320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f1eae8640 1 -- 10.20.193.28:0/3023740220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 msgr2=0x55eb13202860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.386+0000 7f3f1eae8640 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb13202860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3f1eae8640 1 -- 10.20.193.28:0/3023740220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 msgr2=0x55eb13202320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3f1eae8640 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb13202320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3f1eae8640 1 -- 10.20.193.28:0/3023740220 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1306f190 con 0x55eb13225e00 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb13202320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3f1eae8640 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb1328b330 secure :-1 s=READY pgs=368 gs=2 cs=0 l=1 c_cookie=12299751371756255732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f14003ca0 tx=0x7f3f14012810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aab17eb4ab27b9f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3ecbfff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3ecbfff640 1 -- 10.20.193.28:0/3023740220 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f1401d620 con 0x55eb13225e00 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3ecbfff640 1 -- 10.20.193.28:0/3023740220 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f1401dc60 con 0x55eb13225e00 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb13096c50 con 0x55eb13225e00 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3ecbfff640 1 -- 10.20.193.28:0/3023740220 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f140103c0 con 0x55eb13225e00 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3ecbfff640 1 -- 10.20.193.28:0/3023740220 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3f14010550 con 0x55eb13225e00 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3ecbfff640 10 client.28481 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3f2256ce00 10 client.28481 _ll_register_callbacks cb 0x55eb1306c320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.387+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb12d7f700 con 0x55eb13225e00 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3ecbfff640 1 -- 10.20.193.28:0/3023740220 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f1401d780 con 0x55eb13225e00 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f2256ce00 10 client.28481 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55eb13080fe0 con 0x55eb13225e00 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3ecbfff640 1 -- 10.20.193.28:0/3023740220 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3f1401d960 con 0x55eb13225e00 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f2256ce00 10 client.28481 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f2256ce00 10 client.28481 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f2256ce00 20 client.28481 populate_metadata read hostname 'trial028' 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb132d3a00 0x55eb132f3e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f2256ce00 4 client.28481 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.8, "await_for": 45.0}] 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.8, "await_for": 45.0}) -- 0x7f3f0803e040 con 0x55eb132d3a00 2026-02-20T13:25:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.388+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb132d3a00 0x55eb132f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.389+0000 7f3f1e2e7640 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb132d3a00 0x55eb132f3e80 crc :-1 s=READY pgs=257 gs=4 cs=0 l=0 c_cookie=6391233282206841450 s_cookie=524970927708563110 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58b238ced697ba6a server_cookie=7491246ff79e6a6 in_seq=0 out_seq=0 2026-02-20T13:25:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.389+0000 7f3ecbfff640 10 client.28481 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3ecbfff640 1 -- 10.20.193.28:0/3023740220 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f3f0803e040 con 0x55eb132d3a00 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3ecbfff640 10 client.28481 handle_command_reply: tid=0 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 client.28481 shutdown 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 msgr2=0x55eb1328b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb1328b330 secure :-1 s=READY pgs=368 gs=2 cs=0 l=1 c_cookie=12299751371756255732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f14003ca0 tx=0x7f3f14012810 comp rx=0 tx=0).stop 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 shutdown_connections 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb132d3a00 0x55eb132f3e80 crc :-1 s=READY pgs=257 gs=4 cs=0 l=0 c_cookie=6391233282206841450 s_cookie=524970927708563110 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb13225e00 0x55eb1328b330 unknown :-1 s=CLOSED pgs=368 gs=2 cs=0 l=1 c_cookie=12299751371756255732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb131e1160 0x55eb13202860 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 --2- 10.20.193.28:0/3023740220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb131e0850 0x55eb13202320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3ecbfff640 0 client.28481 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 >> 10.20.193.28:0/3023740220 conn(0x55eb130fe110 msgr2=0x55eb131f5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 shutdown_connections 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 1 -- 10.20.193.28:0/3023740220 wait complete. 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.394+0000 7f3f2256ce00 20 client.28481 trim_cache size 0 max 16384 2026-02-20T13:25:51.396 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 30, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "6808ef13": { 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "version": 30, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 139.8, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ef40b5750 msgr2=0x7f3ef40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ef40b5750 0x7f3ef40d5c00 secure :-1 s=READY pgs=457 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f080097e0 tx=0x7f3f0803a040 comp rx=0 tx=0).stop 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1810c020 msgr2=0x7f3f18173c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1810c020 0x7f3f18173c50 secure :-1 s=READY pgs=1013 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f0c004740 tx=0x7f3f0c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1890450939 shutdown_connections 2026-02-20T13:25:51.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3ef40b5750 0x7f3ef40d5c00 unknown :-1 s=CLOSED pgs=457 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1810c020 0x7f3f18173c50 unknown :-1 s=CLOSED pgs=1013 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3f18113380 0x7f3f180f44b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 --2- 10.20.193.28:0/1890450939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f1810b630 0x7f3f180f3db0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:51.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1890450939 >> 10.20.193.28:0/1890450939 conn(0x7f3f180e9080 msgr2=0x7f3f18110420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:51.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1890450939 shutdown_connections 2026-02-20T13:25:51.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:25:51.395+0000 7f3f1f2e9640 1 -- 10.20.193.28:0/1890450939 wait complete. 2026-02-20T13:25:51.499 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6808ef13', quiesce took 1.1 seconds. Will release after: 18.7 2026-02-20T13:25:51.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2065609926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:51.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2065609926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:51.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2065609926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:25:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:52 trial127 ceph-mon[43817]: pgmap v437: 97 pgs: 97 active+clean; 712 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:25:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:52 trial034 ceph-mon[43332]: pgmap v437: 97 pgs: 97 active+clean; 712 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:25:53.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:52 trial028 ceph-mon[37442]: pgmap v437: 97 pgs: 97 active+clean; 712 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:25:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:54 trial127 ceph-mon[43817]: pgmap v438: 97 pgs: 97 active+clean; 736 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2026-02-20T13:25:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:54 trial034 ceph-mon[43332]: pgmap v438: 97 pgs: 97 active+clean; 736 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2026-02-20T13:25:55.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:54 trial028 ceph-mon[37442]: pgmap v438: 97 pgs: 97 active+clean; 736 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2026-02-20T13:25:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:56 trial127 ceph-mon[43817]: pgmap v439: 97 pgs: 97 active+clean; 736 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2026-02-20T13:25:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:56 trial034 ceph-mon[43332]: pgmap v439: 97 pgs: 97 active+clean; 736 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2026-02-20T13:25:57.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:56 trial028 ceph-mon[37442]: pgmap v439: 97 pgs: 97 active+clean; 736 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2026-02-20T13:25:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:58 trial127 ceph-mon[43817]: pgmap v440: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2026-02-20T13:25:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:58 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:25:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:58 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:25:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:58 trial034 ceph-mon[43332]: pgmap v440: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2026-02-20T13:25:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:58 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:25:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:58 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:25:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:58 trial028 ceph-mon[37442]: pgmap v440: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2026-02-20T13:25:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:58 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:25:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:58 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:25:59.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 -- 10.20.193.28:0/648142460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0062a40 msgr2=0x7fc1a0060fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 --2- 10.20.193.28:0/648142460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0062a40 0x7fc1a0060fd0 secure :-1 s=READY pgs=1016 gs=1 cs=0 l=1 c_cookie=10052449412801194290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c009950 tx=0x7fc18c02f190 comp rx=0 tx=0).stop 2026-02-20T13:25:59.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 -- 10.20.193.28:0/648142460 shutdown_connections 2026-02-20T13:25:59.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 --2- 10.20.193.28:0/648142460 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc1a0150e50 0x7fc1a0171290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 --2- 10.20.193.28:0/648142460 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc1a0061510 0x7fc1a0061980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 --2- 10.20.193.28:0/648142460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0062a40 0x7fc1a0060fd0 unknown :-1 s=CLOSED pgs=1016 gs=1 cs=0 l=1 c_cookie=10052449412801194290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 -- 10.20.193.28:0/648142460 >> 10.20.193.28:0/648142460 conn(0x7fc1a00ea4c0 msgr2=0x7fc1a010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 -- 10.20.193.28:0/648142460 shutdown_connections 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.488+0000 7fc1a5483640 1 -- 10.20.193.28:0/648142460 wait complete. 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a5483640 1 Processor -- start 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a5483640 1 -- start start 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a5483640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc1a0061510 0x7fc1a015c6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a5483640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc1a0062a40 0x7fc1a015ccf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a5483640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0150e50 0x7fc1a015d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a5483640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a015e030 con 0x7fc1a0150e50 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a5483640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a015e1a0 con 0x7fc1a0061510 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a5483640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a015e360 con 0x7fc1a0062a40 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc1a0061510 0x7fc1a015c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc1a0061510 0x7fc1a015c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44862/0 (socket says 10.20.193.28:44862) 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19ffff640 1 -- 10.20.193.28:0/1633221911 learned_addr learned my addr 10.20.193.28:0/1633221911 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a4c82640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0150e50 0x7fc1a015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc1a0062a40 0x7fc1a015ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19ffff640 1 -- 10.20.193.28:0/1633221911 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc1a0062a40 msgr2=0x7fc1a015ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19ffff640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc1a0062a40 0x7fc1a015ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19ffff640 1 -- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0150e50 msgr2=0x7fc1a015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19ffff640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0150e50 0x7fc1a015d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc19ffff640 1 -- 10.20.193.28:0/1633221911 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c009570 con 0x7fc1a0061510 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.489+0000 7fc1a4c82640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0150e50 0x7fc1a015d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.490+0000 7fc19ffff640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc1a0061510 0x7fc1a015c6a0 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c002d80 tx=0x7fc18c002e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.490+0000 7fc19d7fa640 1 -- 10.20.193.28:0/1633221911 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c03d070 con 0x7fc1a0061510 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.490+0000 7fc19d7fa640 1 -- 10.20.193.28:0/1633221911 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc18c038920 con 0x7fc1a0061510 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.490+0000 7fc19d7fa640 1 -- 10.20.193.28:0/1633221911 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c0419d0 con 0x7fc1a0061510 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.490+0000 7fc1a5483640 1 -- 10.20.193.28:0/1633221911 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a015e5e0 con 0x7fc1a0061510 2026-02-20T13:25:59.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.490+0000 7fc1a5483640 1 -- 10.20.193.28:0/1633221911 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a015eb00 con 0x7fc1a0061510 2026-02-20T13:25:59.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.493+0000 7fc19d7fa640 1 -- 10.20.193.28:0/1633221911 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fc18c038a90 con 0x7fc1a0061510 2026-02-20T13:25:59.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.494+0000 7fc19d7fa640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc1740b56e0 0x7fc1740d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.494+0000 7fc19d7fa640 1 -- 10.20.193.28:0/1633221911 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc18c10b120 con 0x7fc1a0061510 2026-02-20T13:25:59.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.494+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc1740b56e0 0x7fc1740d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a8e38e00 1 Processor -- start 2026-02-20T13:25:59.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc1740b56e0 0x7fc1740d5b90 secure :-1 s=READY pgs=458 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc190004740 tx=0x7fc190005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a8e38e00 1 -- start start 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02d08a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02f11c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc0311ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560cc01c5fd0 con 0x560cc02f1700 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560cc01c1d00 con 0x560cc02d0de0 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560cc01bbca0 con 0x560cc02b04c0 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc19f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a4c82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc0311ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a4c82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc0311ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47790/0 (socket says 10.20.193.28:47790) 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a4c82640 1 -- 10.20.193.28:0/3736288664 learned_addr learned my addr 10.20.193.28:0/3736288664 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc19ffff640 1 --2- 10.20.193.28:0/3736288664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a4c82640 1 -- 10.20.193.28:0/3736288664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 msgr2=0x560cc02d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a4c82640 1 --2- 10.20.193.28:0/3736288664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a4c82640 1 -- 10.20.193.28:0/3736288664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 msgr2=0x560cc02f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a4c82640 1 --2- 10.20.193.28:0/3736288664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.495+0000 7fc1a4c82640 1 -- 10.20.193.28:0/3736288664 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc015e8b0 con 0x560cc02f1700 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a4c82640 1 --2- 10.20.193.28:0/3736288664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc0311ae0 secure :-1 s=READY pgs=1017 gs=3 cs=0 l=1 c_cookie=15948955447828511343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc19400afd0 tx=0x7fc1940056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd56127a86597a6f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:59.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc163fff640 1 -- 10.20.193.28:0/3736288664 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc19401b440 con 0x560cc02f1700 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc163fff640 1 -- 10.20.193.28:0/3736288664 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc19401ba80 con 0x560cc02f1700 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc163fff640 1 -- 10.20.193.28:0/3736288664 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc194011ca0 con 0x560cc02f1700 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/3736288664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 msgr2=0x560cc0311ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/3736288664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc0311ae0 secure :-1 s=READY pgs=1017 gs=3 cs=0 l=1 c_cookie=15948955447828511343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc19400afd0 tx=0x7fc1940056c0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/3736288664 shutdown_connections 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/3736288664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc0311ae0 unknown :-1 s=CLOSED pgs=1017 gs=3 cs=0 l=1 c_cookie=15948955447828511343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/3736288664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02f11c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/3736288664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02d08a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/3736288664 >> 10.20.193.28:0/3736288664 conn(0x560cc01cf1c0 msgr2=0x560cc02aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:59.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/3736288664 shutdown_connections 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.496+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/3736288664 wait complete. 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a8e38e00 1 -- start start 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a8e38e00 1 Processor -- start 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02b04c0 0x560cc02c9ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 0x560cc02ca120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02f1700 0x560cc02cab80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560cc02cb1e0 con 0x560cc02b04c0 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560cc02cb350 con 0x560cc02f1700 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560cc02cb510 con 0x560cc02d0de0 2026-02-20T13:25:59.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a4c82640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02f1700 0x560cc02cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc19ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02b04c0 0x560cc02c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a4c82640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02f1700 0x560cc02cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44882/0 (socket says 10.20.193.28:44882) 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc1a4c82640 1 -- 10.20.193.28:0/947663944 learned_addr learned my addr 10.20.193.28:0/947663944 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 0x560cc02ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc19ffff640 1 -- 10.20.193.28:0/947663944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 msgr2=0x560cc02ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc19ffff640 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 0x560cc02ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc19ffff640 1 -- 10.20.193.28:0/947663944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02f1700 msgr2=0x560cc02cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc19ffff640 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02f1700 0x560cc02cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.498+0000 7fc19ffff640 1 -- 10.20.193.28:0/947663944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc0167400 con 0x560cc02b04c0 2026-02-20T13:25:59.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc19ffff640 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02b04c0 0x560cc02c9ad0 secure :-1 s=READY pgs=1018 gs=2 cs=0 l=1 c_cookie=10512087808256806136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c108bf0 tx=0x7fc18c0d3640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e2702a8adc8cf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1617fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1617fa640 1 -- 10.20.193.28:0/947663944 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c038e00 con 0x560cc02b04c0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19400ae40 con 0x560cc02b04c0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 10 client.18534 _ll_register_callbacks cb 0x560cc0146a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1617fa640 1 -- 10.20.193.28:0/947663944 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc18c0f6070 con 0x560cc02b04c0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cbfe5b520 con 0x560cc02b04c0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1617fa640 1 -- 10.20.193.28:0/947663944 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c038e00 con 0x560cc02b04c0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1617fa640 1 -- 10.20.193.28:0/947663944 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc18c041de0 con 0x560cc02b04c0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1617fa640 1 -- 10.20.193.28:0/947663944 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc18c0d0820 con 0x560cc02b04c0 2026-02-20T13:25:59.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 10 client.18534 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560cc013fda0 con 0x560cc02b04c0 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1617fa640 1 -- 10.20.193.28:0/947663944 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc18c0cbd20 con 0x560cc02b04c0 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 10 client.18534 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 10 client.18534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 20 client.18534 populate_metadata read hostname 'trial028' 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560cc02cdef0 0x560cc02ce390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 4 client.18534 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.499+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cc01ed630 con 0x560cc02cdef0 2026-02-20T13:25:59.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.500+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560cc02cdef0 0x560cc02ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.500+0000 7fc1617fa640 10 client.18534 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.500+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560cc02cdef0 0x560cc02ce390 crc :-1 s=READY pgs=258 gs=4 cs=0 l=0 c_cookie=10225041775786400973 s_cookie=16993852262036102561 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de6a5520b471ccd server_cookie=ebd64a9854215da1 in_seq=0 out_seq=0 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1617fa640 1 -- 10.20.193.28:0/947663944 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560cc01ed630 con 0x560cc02cdef0 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1617fa640 10 client.18534 handle_command_reply: tid=0 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 client.18534 shutdown 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02b04c0 msgr2=0x560cc02c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02b04c0 0x560cc02c9ad0 secure :-1 s=READY pgs=1018 gs=2 cs=0 l=1 c_cookie=10512087808256806136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c108bf0 tx=0x7fc18c0d3640 comp rx=0 tx=0).stop 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 shutdown_connections 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560cc02cdef0 0x560cc02ce390 crc :-1 s=READY pgs=258 gs=4 cs=0 l=0 c_cookie=10225041775786400973 s_cookie=16993852262036102561 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02f1700 0x560cc02cab80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 0x560cc02ca120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/947663944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02b04c0 0x560cc02c9ad0 unknown :-1 s=CLOSED pgs=1018 gs=2 cs=0 l=1 c_cookie=10512087808256806136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1617fa640 0 client.18534 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:59.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 >> 10.20.193.28:0/947663944 conn(0x560cc01cf1c0 msgr2=0x560cc02b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:59.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 shutdown_connections 2026-02-20T13:25:59.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/947663944 wait complete. 2026-02-20T13:25:59.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.501+0000 7fc1a8e38e00 20 client.18534 trim_cache size 0 max 16384 2026-02-20T13:25:59.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.508+0000 7fc1a8e38e00 1 Processor -- start 2026-02-20T13:25:59.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.508+0000 7fc1a8e38e00 1 -- start start 2026-02-20T13:25:59.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02c9960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02bb970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02ef5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560cc01b98d0 con 0x560cc02f1700 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560cbfefaf10 con 0x560cc02d0de0 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560cc02cb3d0 con 0x560cc02b04c0 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02bb970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1a4c82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43398/0 (socket says 10.20.193.28:43398) 2026-02-20T13:25:59.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 -- 10.20.193.28:0/1013440397 learned_addr learned my addr 10.20.193.28:0/1013440397 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02bb970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44892/0 (socket says 10.20.193.28:44892) 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 -- 10.20.193.28:0/1013440397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 msgr2=0x560cc02bb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 --2- 10.20.193.28:0/1013440397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02bb970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 -- 10.20.193.28:0/1013440397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 msgr2=0x560cc02ef5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 --2- 10.20.193.28:0/1013440397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02ef5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 -- 10.20.193.28:0/1013440397 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc02bc140 con 0x560cc02b04c0 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc19ffff640 1 --2- 10.20.193.28:0/1013440397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02c9960 secure :-1 s=READY pgs=305 gs=3 cs=0 l=1 c_cookie=15380963065864755641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c0d97d0 tx=0x7fc18c095000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d574286aa44599b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1637fe640 1 -- 10.20.193.28:0/1013440397 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c038e00 con 0x560cc02b04c0 2026-02-20T13:25:59.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1637fe640 1 -- 10.20.193.28:0/1013440397 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc18c0f6040 con 0x560cc02b04c0 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.509+0000 7fc1637fe640 1 -- 10.20.193.28:0/1013440397 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c0d3460 con 0x560cc02b04c0 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/1013440397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 msgr2=0x560cc02c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/1013440397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02c9960 secure :-1 s=READY pgs=305 gs=3 cs=0 l=1 c_cookie=15380963065864755641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c0d97d0 tx=0x7fc18c095000 comp rx=0 tx=0).stop 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/1013440397 shutdown_connections 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/1013440397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02ef5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/1013440397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02d0de0 0x560cc02bb970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/1013440397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02b04c0 0x560cc02c9960 unknown :-1 s=CLOSED pgs=305 gs=3 cs=0 l=1 c_cookie=15380963065864755641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/1013440397 >> 10.20.193.28:0/1013440397 conn(0x560cc01cf1c0 msgr2=0x560cc02c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/1013440397 shutdown_connections 2026-02-20T13:25:59.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/1013440397 wait complete. 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 -- start start 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.510+0000 7fc1a8e38e00 1 Processor -- start 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02b04c0 0x560cc02d26d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 0x560cc02d2c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a8e38e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02d3380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560cc01b98d0 con 0x560cc02f1700 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560cc02d3ab0 con 0x560cc02b04c0 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a8e38e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560cc02d3c70 con 0x560cc02d0de0 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02b04c0 0x560cc02d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02b04c0 0x560cc02d26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44904/0 (socket says 10.20.193.28:44904) 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 -- 10.20.193.28:0/931645883 learned_addr learned my addr 10.20.193.28:0/931645883 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 0x560cc02d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a4c82640 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 -- 10.20.193.28:0/931645883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 msgr2=0x560cc02d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 0x560cc02d2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 -- 10.20.193.28:0/931645883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 msgr2=0x560cc02d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 -- 10.20.193.28:0/931645883 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc0151670 con 0x560cc02b04c0 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a4c82640 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02d3380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:25:59.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc19ffff640 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02b04c0 0x560cc02d26d0 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=5189106782085649335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c10b380 tx=0x7fc18c0d3640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=480369200fc913b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1617fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1617fa640 1 -- 10.20.193.28:0/931645883 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c038e00 con 0x560cc02b04c0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1617fa640 1 -- 10.20.193.28:0/931645883 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560cbfe5b520 con 0x560cc02b04c0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1617fa640 1 -- 10.20.193.28:0/931645883 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c0d30f0 con 0x560cc02b04c0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.511+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c094030 con 0x560cc02b04c0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1617fa640 1 -- 10.20.193.28:0/931645883 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc18c041de0 con 0x560cc02b04c0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1617fa640 10 client.28499 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 10 client.28499 _ll_register_callbacks cb 0x560cc0146a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cc026bca0 con 0x560cc02b04c0 2026-02-20T13:25:59.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1617fa640 1 -- 10.20.193.28:0/931645883 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc18c0d3440 con 0x560cc02b04c0 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 10 client.28499 fetch_fsmap learned FSMap version 28 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560cc014c0f0 con 0x560cc02b04c0 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1617fa640 1 -- 10.20.193.28:0/931645883 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc18c0cbd20 con 0x560cc02b04c0 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 10 client.28499 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 10 client.28499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 20 client.28499 populate_metadata read hostname 'trial028' 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560cc02d52c0 0x560cc02d5760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 4 client.28499 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560cbfe9f640 con 0x560cc02d52c0 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.512+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560cc02d52c0 0x560cc02d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.513+0000 7fc19f7fe640 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560cc02d52c0 0x560cc02d5760 crc :-1 s=READY pgs=259 gs=4 cs=0 l=0 c_cookie=9132205815038445514 s_cookie=17000115204440095604 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ebc1ccde51f87ca server_cookie=ebec8ab53d5e7b74 in_seq=0 out_seq=0 2026-02-20T13:25:59.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.513+0000 7fc1617fa640 10 client.28499 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1617fa640 1 -- 10.20.193.28:0/931645883 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560cbfe9f640 con 0x560cc02d52c0 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1617fa640 10 client.28499 handle_command_reply: tid=0 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 client.28499 shutdown 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02b04c0 msgr2=0x560cc02d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02b04c0 0x560cc02d26d0 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=5189106782085649335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c10b380 tx=0x7fc18c0d3640 comp rx=0 tx=0).stop 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 shutdown_connections 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560cc02d52c0 0x560cc02d5760 crc :-1 s=READY pgs=259 gs=4 cs=0 l=0 c_cookie=9132205815038445514 s_cookie=17000115204440095604 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560cc02f1700 0x560cc02d3380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560cc02d0de0 0x560cc02d2c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1617fa640 0 client.28499 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:25:59.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 --2- 10.20.193.28:0/931645883 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560cc02b04c0 0x560cc02d26d0 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=5189106782085649335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.517+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 >> 10.20.193.28:0/931645883 conn(0x560cc01cf1c0 msgr2=0x560cc02c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:59.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 shutdown_connections 2026-02-20T13:25:59.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a8e38e00 1 -- 10.20.193.28:0/931645883 wait complete. 2026-02-20T13:25:59.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a8e38e00 20 client.28499 trim_cache size 0 max 16384 2026-02-20T13:25:59.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:25:59.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:25:59.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:25:59.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:25:59.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 -- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc1740b56e0 msgr2=0x7fc1740d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc1740b56e0 0x7fc1740d5b90 secure :-1 s=READY pgs=458 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc190004740 tx=0x7fc190005f90 comp rx=0 tx=0).stop 2026-02-20T13:25:59.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 -- 10.20.193.28:0/1633221911 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc1a0061510 msgr2=0x7fc1a015c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:25:59.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc1a0061510 0x7fc1a015c6a0 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c002d80 tx=0x7fc18c002e20 comp rx=0 tx=0).stop 2026-02-20T13:25:59.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 -- 10.20.193.28:0/1633221911 shutdown_connections 2026-02-20T13:25:59.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc1740b56e0 0x7fc1740d5b90 unknown :-1 s=CLOSED pgs=458 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc1a0150e50 0x7fc1a015d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc1a0062a40 0x7fc1a015ccf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 --2- 10.20.193.28:0/1633221911 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc1a0061510 0x7fc1a015c6a0 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:25:59.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 -- 10.20.193.28:0/1633221911 >> 10.20.193.28:0/1633221911 conn(0x7fc1a00ea4c0 msgr2=0x7fc1a010a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:25:59.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 -- 10.20.193.28:0/1633221911 shutdown_connections 2026-02-20T13:25:59.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:25:59.518+0000 7fc1a5483640 1 -- 10.20.193.28:0/1633221911 wait complete. 2026-02-20T13:25:59.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:25:59 trial127 ceph-mon[43817]: pgmap v441: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2026-02-20T13:25:59.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:25:59 trial034 ceph-mon[43332]: pgmap v441: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2026-02-20T13:26:00.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:25:59 trial028 ceph-mon[37442]: pgmap v441: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2026-02-20T13:26:02.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:02 trial028 ceph-mon[37442]: pgmap v442: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2026-02-20T13:26:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:02 trial127 ceph-mon[43817]: pgmap v442: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2026-02-20T13:26:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:02 trial034 ceph-mon[43332]: pgmap v442: 97 pgs: 97 active+clean; 738 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2026-02-20T13:26:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:04 trial028 ceph-mon[37442]: pgmap v443: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2026-02-20T13:26:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:04 trial127 ceph-mon[43817]: pgmap v443: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2026-02-20T13:26:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:04 trial034 ceph-mon[43332]: pgmap v443: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2026-02-20T13:26:05.539 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:26:05.723 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:05.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 -- 10.20.193.28:0/1226212401 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 msgr2=0x7f68d810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 --2- 10.20.193.28:0/1226212401 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 0x7f68d810f880 secure :-1 s=READY pgs=1019 gs=1 cs=0 l=1 c_cookie=15669978102845642798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68cc009950 tx=0x7f68cc02f190 comp rx=0 tx=0).stop 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 -- 10.20.193.28:0/1226212401 shutdown_connections 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 --2- 10.20.193.28:0/1226212401 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d81156a0 0x7f68d8176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 --2- 10.20.193.28:0/1226212401 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f68d810fea0 0x7f68d8114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 --2- 10.20.193.28:0/1226212401 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 0x7f68d810f880 unknown :-1 s=CLOSED pgs=1019 gs=1 cs=0 l=1 c_cookie=15669978102845642798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 -- 10.20.193.28:0/1226212401 >> 10.20.193.28:0/1226212401 conn(0x7f68d80ecda0 msgr2=0x7f68d810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 -- 10.20.193.28:0/1226212401 shutdown_connections 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.893+0000 7f68d7577640 1 -- 10.20.193.28:0/1226212401 wait complete. 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d7577640 1 Processor -- start 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d7577640 1 -- start start 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 0x7f68d811de50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d7577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d810fea0 0x7f68d811e390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d7577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f68d81156a0 0x7f68d8123760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d7577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8123d80 con 0x7f68d810f4b0 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d7577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8123ef0 con 0x7f68d81156a0 2026-02-20T13:26:05.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d7577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81240b0 con 0x7f68d810fea0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.894+0000 7f68d6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 0x7f68d811de50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f68d81156a0 0x7f68d8123760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 0x7f68d811de50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37764/0 (socket says 10.20.193.28:37764) 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6575640 1 -- 10.20.193.28:0/1200708946 learned_addr learned my addr 10.20.193.28:0/1200708946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d5d74640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d810fea0 0x7f68d811e390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6575640 1 -- 10.20.193.28:0/1200708946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d810fea0 msgr2=0x7f68d811e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6575640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d810fea0 0x7f68d811e390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6575640 1 -- 10.20.193.28:0/1200708946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f68d81156a0 msgr2=0x7f68d8123760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6575640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f68d81156a0 0x7f68d8123760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6575640 1 -- 10.20.193.28:0/1200708946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68cc009570 con 0x7f68d810f4b0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d5d74640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d810fea0 0x7f68d811e390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d6575640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 0x7f68d811de50 secure :-1 s=READY pgs=1020 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68cc038820 tx=0x7f68cc004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68bf7fe640 1 -- 10.20.193.28:0/1200708946 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68cc03d070 con 0x7f68d810f4b0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68bf7fe640 1 -- 10.20.193.28:0/1200708946 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68cc002ad0 con 0x7f68d810f4b0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68bf7fe640 1 -- 10.20.193.28:0/1200708946 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68cc041930 con 0x7f68d810f4b0 2026-02-20T13:26:05.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d7577640 1 -- 10.20.193.28:0/1200708946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d8124330 con 0x7f68d810f4b0 2026-02-20T13:26:05.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.895+0000 7f68d7577640 1 -- 10.20.193.28:0/1200708946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d81648f0 con 0x7f68d810f4b0 2026-02-20T13:26:05.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.898+0000 7f68bf7fe640 1 -- 10.20.193.28:0/1200708946 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f68cc02f9f0 con 0x7f68d810f4b0 2026-02-20T13:26:05.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.900+0000 7f68bf7fe640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68b00b5760 0x7f68b00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.900+0000 7f68bf7fe640 1 -- 10.20.193.28:0/1200708946 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f68cc10b050 con 0x7f68d810f4b0 2026-02-20T13:26:05.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.900+0000 7f68d5d74640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68b00b5760 0x7f68b00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68d5d74640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68b00b5760 0x7f68b00d5c10 secure :-1 s=READY pgs=459 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68d81247f0 tx=0x7f68c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68defa1e00 1 Processor -- start 2026-02-20T13:26:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68defa1e00 1 -- start start 2026-02-20T13:26:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0da550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa11f400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa13fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68defa1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557af9ff07d0 con 0x557afa11f940 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68defa1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557af9fec500 con 0x557afa0daa90 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.901+0000 7f68defa1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557af9fe64a0 con 0x557afa0da180 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d5d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa11f400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0da550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d5d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa11f400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35382/0 (socket says 10.20.193.28:35382) 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d5d74640 1 -- 10.20.193.28:0/2798980254 learned_addr learned my addr 10.20.193.28:0/2798980254 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6d76640 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6575640 1 -- 10.20.193.28:0/2798980254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 msgr2=0x557afa11f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6575640 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa11f400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6575640 1 -- 10.20.193.28:0/2798980254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 msgr2=0x557afa13fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6575640 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa13fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6575640 1 -- 10.20.193.28:0/2798980254 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af9f91d80 con 0x557afa0da180 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6d76640 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa13fd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68d6575640 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0da550 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=16314146569342858890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68cc108c10 tx=0x7f68cc038ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2677dde6756b68a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68bcff9640 1 -- 10.20.193.28:0/2798980254 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68cc0d1df0 con 0x557afa0da180 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.902+0000 7f68bcff9640 1 -- 10.20.193.28:0/2798980254 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68cc0d7110 con 0x557afa0da180 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 -- 10.20.193.28:0/2798980254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 msgr2=0x557afa0da550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0da550 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=16314146569342858890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68cc108c10 tx=0x7f68cc038ad0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 -- 10.20.193.28:0/2798980254 shutdown_connections 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa13fd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa11f400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2798980254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0da550 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=16314146569342858890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 -- 10.20.193.28:0/2798980254 >> 10.20.193.28:0/2798980254 conn(0x557afa0b8680 msgr2=0x557afa0d8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 -- 10.20.193.28:0/2798980254 shutdown_connections 2026-02-20T13:26:05.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.903+0000 7f68defa1e00 1 -- 10.20.193.28:0/2798980254 wait complete. 2026-02-20T13:26:05.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.904+0000 7f68defa1e00 1 -- start start 2026-02-20T13:26:05.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.904+0000 7f68defa1e00 1 Processor -- start 2026-02-20T13:26:05.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.904+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0da180 0x557afa0f26f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.904+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0daa90 0x557afa0f2c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.904+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f7c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.904+0000 7f68defa1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557afa0f8160 con 0x557afa11f940 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.904+0000 7f68defa1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557afa0f82d0 con 0x557afa0da180 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.904+0000 7f68defa1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557afa0f8490 con 0x557afa0daa90 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0daa90 0x557afa0f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0daa90 0x557afa0f2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40696/0 (socket says 10.20.193.28:40696) 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 -- 10.20.193.28:0/134714728 learned_addr learned my addr 10.20.193.28:0/134714728 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d6575640 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0da180 0x557afa0f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d6d76640 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 -- 10.20.193.28:0/134714728 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0da180 msgr2=0x557afa0f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0da180 0x557afa0f26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 -- 10.20.193.28:0/134714728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 msgr2=0x557afa0f7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 -- 10.20.193.28:0/134714728 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af9f6a350 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68d5d74640 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0daa90 0x557afa0f2c30 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=18234457000961359274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c0004290 tx=0x7f68c00047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd0dce08366fbdaa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f6887fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f6887fff640 1 -- 10.20.193.28:0/134714728 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68c0022070 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d81648f0 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f6887fff640 1 -- 10.20.193.28:0/134714728 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68c001dd90 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f6887fff640 1 -- 10.20.193.28:0/134714728 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68c001ae50 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68defa1e00 10 client.28405 _ll_register_callbacks cb 0x557af9f679a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.905+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557af9c7c6f0 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f6887fff640 1 -- 10.20.193.28:0/134714728 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f68c001c3e0 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f6887fff640 1 -- 10.20.193.28:0/134714728 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f68c001c5e0 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f68defa1e00 10 client.28405 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557af9f7c150 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f6887fff640 1 -- 10.20.193.28:0/134714728 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f68c001d8b0 con 0x557afa0daa90 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f68defa1e00 10 client.28405 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f68defa1e00 10 client.28405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:05.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f68defa1e00 20 client.28405 populate_metadata read hostname 'trial028' 2026-02-20T13:26:05.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f68defa1e00 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557afa11cf60 0x557afa11d400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f68defa1e00 4 client.28405 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:05.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.906+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557af9ff3d60 con 0x557afa11cf60 2026-02-20T13:26:05.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.907+0000 7f68d6575640 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557afa11cf60 0x557afa11d400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.907+0000 7f68d6575640 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557afa11cf60 0x557afa11d400 crc :-1 s=READY pgs=260 gs=4 cs=0 l=0 c_cookie=16933974322951595187 s_cookie=17747657951789736236 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb018fed3b1da4b3 server_cookie=f64c58e04390612c in_seq=0 out_seq=0 2026-02-20T13:26:05.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.907+0000 7f6887fff640 10 client.28405 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f6887fff640 1 -- 10.20.193.28:0/134714728 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557af9ff3d60 con 0x557afa11cf60 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f6887fff640 10 client.28405 handle_command_reply: tid=0 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 client.28405 shutdown 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0daa90 msgr2=0x557afa0f2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0daa90 0x557afa0f2c30 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=18234457000961359274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c0004290 tx=0x7f68c00047e0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 shutdown_connections 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557afa11cf60 0x557afa11d400 crc :-1 s=READY pgs=260 gs=4 cs=0 l=0 c_cookie=16933974322951595187 s_cookie=17747657951789736236 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f7c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f6887fff640 0 client.28405 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:05.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0daa90 0x557afa0f2c30 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=18234457000961359274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 --2- 10.20.193.28:0/134714728 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0da180 0x557afa0f26f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 >> 10.20.193.28:0/134714728 conn(0x557afa0b8680 msgr2=0x557afa0d9250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:05.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 shutdown_connections 2026-02-20T13:26:05.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 1 -- 10.20.193.28:0/134714728 wait complete. 2026-02-20T13:26:05.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.908+0000 7f68defa1e00 20 client.28405 trim_cache size 0 max 16384 2026-02-20T13:26:05.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68defa1e00 1 Processor -- start 2026-02-20T13:26:05.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68defa1e00 1 -- start start 2026-02-20T13:26:05.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0dd3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa0daa90 0x557afa118070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa11f940 0x557afa1185b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68defa1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557af9fe40d0 con 0x557afa0daa90 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68defa1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557af9ca4700 con 0x557afa11f940 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68defa1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557af9ff07d0 con 0x557afa0da180 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa0daa90 0x557afa118070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa0daa90 0x557afa118070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37788/0 (socket says 10.20.193.28:37788) 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d5d74640 1 -- 10.20.193.28:0/1930164837 learned_addr learned my addr 10.20.193.28:0/1930164837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d6575640 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d6d76640 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa11f940 0x557afa1185b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d5d74640 1 -- 10.20.193.28:0/1930164837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 msgr2=0x557afa0dd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d5d74640 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0dd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d5d74640 1 -- 10.20.193.28:0/1930164837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa11f940 msgr2=0x557afa1185b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d5d74640 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa11f940 0x557afa1185b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.918+0000 7f68d5d74640 1 -- 10.20.193.28:0/1930164837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af9f76bd0 con 0x557afa0daa90 2026-02-20T13:26:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68d5d74640 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa0daa90 0x557afa118070 secure :-1 s=READY pgs=1021 gs=1 cs=0 l=1 c_cookie=5187435582200520728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c0011d80 tx=0x7f68c002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fd792d8448a018 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68a24e6640 1 -- 10.20.193.28:0/1930164837 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68c0022030 con 0x557afa0daa90 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68a24e6640 1 -- 10.20.193.28:0/1930164837 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557af9c7c6f0 con 0x557afa0daa90 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68a24e6640 1 -- 10.20.193.28:0/1930164837 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68c0009e40 con 0x557afa0daa90 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 -- 10.20.193.28:0/1930164837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa0daa90 msgr2=0x557afa118070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa0daa90 0x557afa118070 secure :-1 s=READY pgs=1021 gs=1 cs=0 l=1 c_cookie=5187435582200520728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c0011d80 tx=0x7f68c002b000 comp rx=0 tx=0).stop 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 -- 10.20.193.28:0/1930164837 shutdown_connections 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa0daa90 0x557afa118070 unknown :-1 s=CLOSED pgs=1021 gs=1 cs=0 l=1 c_cookie=5187435582200520728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa11f940 0x557afa1185b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 --2- 10.20.193.28:0/1930164837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0dd3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 -- 10.20.193.28:0/1930164837 >> 10.20.193.28:0/1930164837 conn(0x557afa0b8680 msgr2=0x557afa0f7270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 -- 10.20.193.28:0/1930164837 shutdown_connections 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.919+0000 7f68defa1e00 1 -- 10.20.193.28:0/1930164837 wait complete. 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68defa1e00 1 -- start start 2026-02-20T13:26:05.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68defa1e00 1 Processor -- start 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0fe980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa0f8ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68defa1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f9430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68defa1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557afa0b5100 con 0x557afa11f940 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68defa1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557afa0f2d80 con 0x557afa0daa90 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68defa1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557afa0f9be0 con 0x557afa0da180 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68d5d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa0f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68d5d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa0f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35406/0 (socket says 10.20.193.28:35406) 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68d5d74640 1 -- 10.20.193.28:0/2232734783 learned_addr learned my addr 10.20.193.28:0/2232734783 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68d6d76640 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68d6575640 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0fe980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68d5d74640 1 -- 10.20.193.28:0/2232734783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 msgr2=0x557afa0fe980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68d5d74640 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0fe980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.920+0000 7f68d5d74640 1 -- 10.20.193.28:0/2232734783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 msgr2=0x557afa0f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68d5d74640 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68d5d74640 1 -- 10.20.193.28:0/2232734783 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af9f6a680 con 0x557afa0daa90 2026-02-20T13:26:05.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68d6d76640 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f9430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68d5d74640 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa0f8ef0 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=7214070764871477683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c0005840 tx=0x7f68c001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=641d87238cb1e9b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f6887fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f6887fff640 1 -- 10.20.193.28:0/2232734783 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68c0041070 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c0037040 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f6887fff640 1 -- 10.20.193.28:0/2232734783 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68c0009e20 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f6887fff640 1 -- 10.20.193.28:0/2232734783 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68c0022040 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68defa1e00 10 client.28514 _ll_register_callbacks cb 0x557af9f679a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557af9d3e4a0 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f6887fff640 1 -- 10.20.193.28:0/2232734783 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f68c001c3e0 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f6887fff640 1 -- 10.20.193.28:0/2232734783 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f68c0027aa0 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68defa1e00 10 client.28514 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.921+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557af9f7c3b0 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f6887fff640 1 -- 10.20.193.28:0/2232734783 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f68c0018870 con 0x557afa0daa90 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f68defa1e00 10 client.28514 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f68defa1e00 10 client.28514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f68defa1e00 20 client.28514 populate_metadata read hostname 'trial028' 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557afa1cda30 0x557afa1edee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f68defa1e00 4 client.28514 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f68cc0d7110 con 0x557afa1cda30 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f68d6575640 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557afa1cda30 0x557afa1edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f68d6575640 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557afa1cda30 0x557afa1edee0 crc :-1 s=READY pgs=261 gs=4 cs=0 l=0 c_cookie=14335207940823576224 s_cookie=9624131209786770939 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f0e3abc625eea0 server_cookie=858fc8582f1745fb in_seq=0 out_seq=0 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.922+0000 7f6887fff640 10 client.28514 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f6887fff640 1 -- 10.20.193.28:0/2232734783 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x7f68cc0d7110 con 0x557afa1cda30 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f6887fff640 10 client.28514 handle_command_reply: tid=0 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 client.28514 shutdown 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 msgr2=0x557afa0f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa0f8ef0 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=7214070764871477683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c0005840 tx=0x7f68c001c350 comp rx=0 tx=0).stop 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 shutdown_connections 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557afa1cda30 0x557afa1edee0 crc :-1 s=READY pgs=261 gs=4 cs=0 l=0 c_cookie=14335207940823576224 s_cookie=9624131209786770939 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557afa11f940 0x557afa0f9430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557afa0daa90 0x557afa0f8ef0 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=7214070764871477683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 --2- 10.20.193.28:0/2232734783 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557afa0da180 0x557afa0fe980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 >> 10.20.193.28:0/2232734783 conn(0x557afa0b8680 msgr2=0x557afa0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:05.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f6887fff640 0 client.28514 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:05.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 shutdown_connections 2026-02-20T13:26:05.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 1 -- 10.20.193.28:0/2232734783 wait complete. 2026-02-20T13:26:05.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68defa1e00 20 client.28514 trim_cache size 0 max 16384 2026-02-20T13:26:05.926 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.927 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:26:05.928 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:26:05.929 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:26:05.930 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68d7577640 1 -- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68b00b5760 msgr2=0x7f68b00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68d7577640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68b00b5760 0x7f68b00d5c10 secure :-1 s=READY pgs=459 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68d81247f0 tx=0x7f68c0005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68d7577640 1 -- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 msgr2=0x7f68d811de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.923+0000 7f68d7577640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 0x7f68d811de50 secure :-1 s=READY pgs=1020 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68cc038820 tx=0x7f68cc004300 comp rx=0 tx=0).stop 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.924+0000 7f68d7577640 1 -- 10.20.193.28:0/1200708946 shutdown_connections 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.924+0000 7f68d7577640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68b00b5760 0x7f68b00d5c10 unknown :-1 s=CLOSED pgs=459 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.924+0000 7f68d7577640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f68d81156a0 0x7f68d8123760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.924+0000 7f68d7577640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d810fea0 0x7f68d811e390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.924+0000 7f68d7577640 1 --2- 10.20.193.28:0/1200708946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68d810f4b0 0x7f68d811de50 unknown :-1 s=CLOSED pgs=1020 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.924+0000 7f68d7577640 1 -- 10.20.193.28:0/1200708946 >> 10.20.193.28:0/1200708946 conn(0x7f68d80ecda0 msgr2=0x7f68d810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.924+0000 7f68d7577640 1 -- 10.20.193.28:0/1200708946 shutdown_connections 2026-02-20T13:26:05.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:05.924+0000 7f68d7577640 1 -- 10.20.193.28:0/1200708946 wait complete. 2026-02-20T13:26:06.028 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:26:06.028 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:26:06.213 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:06.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 -- 10.20.193.28:0/3751821849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac110f10 msgr2=0x7f7aac1113b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:06.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 --2- 10.20.193.28:0/3751821849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac110f10 0x7f7aac1113b0 secure :-1 s=READY pgs=1022 gs=1 cs=0 l=1 c_cookie=15521515731414465738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7aa000a9a0 tx=0x7f7aa00301b0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 -- 10.20.193.28:0/3751821849 shutdown_connections 2026-02-20T13:26:06.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 --2- 10.20.193.28:0/3751821849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac110f10 0x7f7aac1113b0 unknown :-1 s=CLOSED pgs=1022 gs=1 cs=0 l=1 c_cookie=15521515731414465738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 --2- 10.20.193.28:0/3751821849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7aac10c320 0x7f7aac1108f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 --2- 10.20.193.28:0/3751821849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7aac10b930 0x7f7aac10bd00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 -- 10.20.193.28:0/3751821849 >> 10.20.193.28:0/3751821849 conn(0x7f7aac0e95a0 msgr2=0x7f7aac1099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 -- 10.20.193.28:0/3751821849 shutdown_connections 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 -- 10.20.193.28:0/3751821849 wait complete. 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.386+0000 7f7ab089b640 1 Processor -- start 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7ab089b640 1 -- start start 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7ab089b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7aac10b930 0x7f7aac1222d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7ab089b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac10c320 0x7f7aac122810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7ab089b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7aac110f10 0x7f7aac127b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7ab089b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac1281b0 con 0x7f7aac10c320 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7ab089b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac128320 con 0x7f7aac110f10 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7ab089b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac1284e0 con 0x7f7aac10b930 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac10c320 0x7f7aac122810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:06.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aab7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7aac10b930 0x7f7aac1222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac10c320 0x7f7aac122810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37804/0 (socket says 10.20.193.28:37804) 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 -- 10.20.193.28:0/2482587718 learned_addr learned my addr 10.20.193.28:0/2482587718 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aabfff640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7aac110f10 0x7f7aac127b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 -- 10.20.193.28:0/2482587718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7aac10b930 msgr2=0x7f7aac1222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7aac10b930 0x7f7aac1222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 -- 10.20.193.28:0/2482587718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7aac110f10 msgr2=0x7f7aac127b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7aac110f10 0x7f7aac127b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 -- 10.20.193.28:0/2482587718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa000a590 con 0x7f7aac10c320 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.387+0000 7f7aaaffd640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac10c320 0x7f7aac122810 secure :-1 s=READY pgs=1023 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a9c009480 tx=0x7f7a9c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.388+0000 7f7aa8ff9640 1 -- 10.20.193.28:0/2482587718 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a9c00ccc0 con 0x7f7aac10c320 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.388+0000 7f7aa8ff9640 1 -- 10.20.193.28:0/2482587718 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7a9c00ce20 con 0x7f7aac10c320 2026-02-20T13:26:06.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.388+0000 7f7aa8ff9640 1 -- 10.20.193.28:0/2482587718 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a9c0106b0 con 0x7f7aac10c320 2026-02-20T13:26:06.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.388+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aac1287c0 con 0x7f7aac10c320 2026-02-20T13:26:06.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.388+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aac168ec0 con 0x7f7aac10c320 2026-02-20T13:26:06.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.388+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aac1289e0 con 0x7f7aac10c320 2026-02-20T13:26:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.390+0000 7f7aa8ff9640 1 -- 10.20.193.28:0/2482587718 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7a9c01f060 con 0x7f7aac10c320 2026-02-20T13:26:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.392+0000 7f7aa8ff9640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7a800b57e0 0x7f7a800d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.392+0000 7f7aa8ff9640 1 -- 10.20.193.28:0/2482587718 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7a9c014070 con 0x7f7aac10c320 2026-02-20T13:26:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.392+0000 7f7aa8ff9640 1 -- 10.20.193.28:0/2482587718 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f7a9c11f730 con 0x7f7aac10c320 2026-02-20T13:26:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.392+0000 7f7aab7fe640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7a800b57e0 0x7f7a800d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:06.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.393+0000 7f7aab7fe640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7a800b57e0 0x7f7a800d5c90 secure :-1 s=READY pgs=460 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a98005b30 tx=0x7f7a98009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:06.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.533+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7aac1233e0 con 0x7f7aac10c320 2026-02-20T13:26:06.536 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:06 trial028 ceph-mon[37442]: pgmap v444: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2026-02-20T13:26:06.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.534+0000 7f7aa8ff9640 1 -- 10.20.193.28:0/2482587718 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f7a9c0a95e0 con 0x7f7aac10c320 2026-02-20T13:26:06.536 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:26:06.536 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:26:06.536 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:26:06.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.535+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7a800b57e0 msgr2=0x7f7a800d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:06.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.535+0000 7f7ab089b640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7a800b57e0 0x7f7a800d5c90 secure :-1 s=READY pgs=460 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a98005b30 tx=0x7f7a98009310 comp rx=0 tx=0).stop 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.535+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac10c320 msgr2=0x7f7aac122810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.535+0000 7f7ab089b640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac10c320 0x7f7aac122810 secure :-1 s=READY pgs=1023 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a9c009480 tx=0x7f7a9c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.536+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 shutdown_connections 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.536+0000 7f7ab089b640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7a800b57e0 0x7f7a800d5c90 unknown :-1 s=CLOSED pgs=460 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.536+0000 7f7ab089b640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aac10c320 0x7f7aac122810 unknown :-1 s=CLOSED pgs=1023 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.536+0000 7f7ab089b640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7aac110f10 0x7f7aac127b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.536+0000 7f7ab089b640 1 --2- 10.20.193.28:0/2482587718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7aac10b930 0x7f7aac1222d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.536+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 >> 10.20.193.28:0/2482587718 conn(0x7f7aac0e95a0 msgr2=0x7f7aac109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.536+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 shutdown_connections 2026-02-20T13:26:06.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.536+0000 7f7ab089b640 1 -- 10.20.193.28:0/2482587718 wait complete. 2026-02-20T13:26:06.638 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:26:06.822 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:06 trial127 ceph-mon[43817]: pgmap v444: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2026-02-20T13:26:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:06 trial034 ceph-mon[43332]: pgmap v444: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 -- 10.20.193.28:0/194063730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f288410fea0 msgr2=0x7f2884114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 --2- 10.20.193.28:0/194063730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f288410fea0 0x7f2884114ef0 secure :-1 s=READY pgs=372 gs=2 cs=0 l=1 c_cookie=11921457093689600298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f286c009950 tx=0x7f286c02f190 comp rx=0 tx=0).stop 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 -- 10.20.193.28:0/194063730 shutdown_connections 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 --2- 10.20.193.28:0/194063730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28841156a0 0x7f2884176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 --2- 10.20.193.28:0/194063730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f288410fea0 0x7f2884114ef0 unknown :-1 s=CLOSED pgs=372 gs=2 cs=0 l=1 c_cookie=11921457093689600298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 --2- 10.20.193.28:0/194063730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f288410f4b0 0x7f288410f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 -- 10.20.193.28:0/194063730 >> 10.20.193.28:0/194063730 conn(0x7f28840ecda0 msgr2=0x7f288410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 -- 10.20.193.28:0/194063730 shutdown_connections 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 -- 10.20.193.28:0/194063730 wait complete. 2026-02-20T13:26:07.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 Processor -- start 2026-02-20T13:26:07.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.998+0000 7f2883577640 1 -- start start 2026-02-20T13:26:07.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2883577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f288410f4b0 0x7f28840f57a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2883577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f288410fea0 0x7f2884175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2883577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28841156a0 0x7f28840f5ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2883577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f28840fb0b0 con 0x7f28841156a0 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2883577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f28840fb220 con 0x7f288410fea0 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2883577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f28840fb3e0 con 0x7f288410f4b0 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2881d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f288410fea0 0x7f2884175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28841156a0 0x7f28840f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28841156a0 0x7f28840f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37816/0 (socket says 10.20.193.28:37816) 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 -- 10.20.193.28:0/1550073659 learned_addr learned my addr 10.20.193.28:0/1550073659 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882575640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f288410f4b0 0x7f28840f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 -- 10.20.193.28:0/1550073659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f288410f4b0 msgr2=0x7f28840f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f288410f4b0 0x7f28840f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 -- 10.20.193.28:0/1550073659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f288410fea0 msgr2=0x7f2884175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f288410fea0 0x7f2884175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 -- 10.20.193.28:0/1550073659 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287400a590 con 0x7f28841156a0 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f2882d76640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28841156a0 0x7f28840f5ea0 secure :-1 s=READY pgs=1024 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2874005790 tx=0x7f2874003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:06.999+0000 7f286b7fe640 1 -- 10.20.193.28:0/1550073659 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f287400fd60 con 0x7f28841156a0 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.000+0000 7f2883577640 1 -- 10.20.193.28:0/1550073659 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c009570 con 0x7f28841156a0 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.000+0000 7f2883577640 1 -- 10.20.193.28:0/1550073659 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28840fba50 con 0x7f28841156a0 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.000+0000 7f286b7fe640 1 -- 10.20.193.28:0/1550073659 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2874003e80 con 0x7f28841156a0 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.001+0000 7f286b7fe640 1 -- 10.20.193.28:0/1550073659 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2874019990 con 0x7f28841156a0 2026-02-20T13:26:07.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.003+0000 7f286b7fe640 1 -- 10.20.193.28:0/1550073659 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2874017020 con 0x7f28841156a0 2026-02-20T13:26:07.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.004+0000 7f286b7fe640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f285c0b56d0 0x7f285c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.004+0000 7f286b7fe640 1 -- 10.20.193.28:0/1550073659 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f28740e7e60 con 0x7f28841156a0 2026-02-20T13:26:07.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.004+0000 7f2882575640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f285c0b56d0 0x7f285c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f288ac74e00 1 Processor -- start 2026-02-20T13:26:07.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f288ac74e00 1 -- start start 2026-02-20T13:26:07.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f2882575640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f285c0b56d0 0x7f285c0d5b80 secure :-1 s=READY pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2878004740 tx=0x7f2878005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe16bf730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17045e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1724f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f288ac74e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559fe15d5780 con 0x559fe16bfc70 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f288ac74e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559fe15d14b0 con 0x559fe1704b20 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f288ac74e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559fe15cb450 con 0x559fe16bf360 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f2881d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f2882575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe16bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f2882575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe16bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40780/0 (socket says 10.20.193.28:40780) 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f2882575640 1 -- 10.20.193.28:0/1949727527 learned_addr learned my addr 10.20.193.28:0/1949727527 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.005+0000 7f2882d76640 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1724f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2882d76640 1 -- 10.20.193.28:0/1949727527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 msgr2=0x559fe16bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2882d76640 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe16bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2882d76640 1 -- 10.20.193.28:0/1949727527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 msgr2=0x559fe17045e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2882d76640 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17045e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2882d76640 1 -- 10.20.193.28:0/1949727527 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe1576d10 con 0x559fe1704b20 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2881d74640 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17045e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2882d76640 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1724f00 secure :-1 s=READY pgs=373 gs=3 cs=0 l=1 c_cookie=5983770098195413802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28740e5930 tx=0x7f28740ae860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530a9f33708abb2a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2868ff9640 1 -- 10.20.193.28:0/1949727527 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28740b41c0 con 0x559fe1704b20 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2868ff9640 1 -- 10.20.193.28:0/1949727527 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2874011c10 con 0x559fe1704b20 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f2868ff9640 1 -- 10.20.193.28:0/1949727527 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28740aa960 con 0x559fe1704b20 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f288ac74e00 1 -- 10.20.193.28:0/1949727527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 msgr2=0x559fe1724f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.006+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1724f00 secure :-1 s=READY pgs=373 gs=3 cs=0 l=1 c_cookie=5983770098195413802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28740e5930 tx=0x7f28740ae860 comp rx=0 tx=0).stop 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.007+0000 7f288ac74e00 1 -- 10.20.193.28:0/1949727527 shutdown_connections 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.007+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17045e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.007+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1724f00 unknown :-1 s=CLOSED pgs=373 gs=3 cs=0 l=1 c_cookie=5983770098195413802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.007+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1949727527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe16bf730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.007+0000 7f288ac74e00 1 -- 10.20.193.28:0/1949727527 >> 10.20.193.28:0/1949727527 conn(0x559fe169d860 msgr2=0x559fe16bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.007+0000 7f288ac74e00 1 -- 10.20.193.28:0/1949727527 shutdown_connections 2026-02-20T13:26:07.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.007+0000 7f288ac74e00 1 -- 10.20.193.28:0/1949727527 wait complete. 2026-02-20T13:26:07.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.008+0000 7f288ac74e00 1 -- start start 2026-02-20T13:26:07.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.008+0000 7f288ac74e00 1 Processor -- start 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.008+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bf360 0x559fe171c710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.008+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe171cc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.008+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 0x559fe171e9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.008+0000 7f288ac74e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559fe171ef50 con 0x559fe16bfc70 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.008+0000 7f288ac74e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559fe171f0c0 con 0x559fe16bf360 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.008+0000 7f288ac74e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559fe171f280 con 0x559fe1704b20 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bf360 0x559fe171c710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2881d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe171cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bf360 0x559fe171c710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35454/0 (socket says 10.20.193.28:35454) 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 -- 10.20.193.28:0/1450211011 learned_addr learned my addr 10.20.193.28:0/1450211011 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882d76640 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 0x559fe171e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 -- 10.20.193.28:0/1450211011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 msgr2=0x559fe171e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 0x559fe171e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 -- 10.20.193.28:0/1450211011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 msgr2=0x559fe171cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe171cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 -- 10.20.193.28:0/1450211011 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28840fba50 con 0x559fe16bf360 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2881d74640 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe171cc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2882575640 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bf360 0x559fe171c710 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=2844111400389353033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2878011490 tx=0x7f2878013070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2778503ff9d89e49 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2833fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2833fff640 1 -- 10.20.193.28:0/1450211011 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2878022040 con 0x559fe16bf360 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2833fff640 1 -- 10.20.193.28:0/1450211011 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f287801de30 con 0x559fe16bf360 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28841768e0 con 0x559fe16bf360 2026-02-20T13:26:07.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.009+0000 7f2833fff640 1 -- 10.20.193.28:0/1450211011 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2878027650 con 0x559fe16bf360 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f2833fff640 1 -- 10.20.193.28:0/1450211011 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f28780277b0 con 0x559fe16bf360 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 10 client.28532 _ll_register_callbacks cb 0x559fe154ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559fe12616f0 con 0x559fe16bf360 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f2833fff640 1 -- 10.20.193.28:0/1450211011 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2878018ea0 con 0x559fe16bf360 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 10 client.28532 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559fe154f3c0 con 0x559fe16bf360 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f2833fff640 1 -- 10.20.193.28:0/1450211011 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f287801d950 con 0x559fe16bf360 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 10 client.28532 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 10 client.28532 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 20 client.28532 populate_metadata read hostname 'trial028' 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559fe1724c90 0x559fe17028a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 4 client.28532 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:07.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.010+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fe156df80 con 0x559fe1724c90 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.011+0000 7f2881d74640 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559fe1724c90 0x559fe17028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.011+0000 7f2881d74640 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559fe1724c90 0x559fe17028a0 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=6555956707459164116 s_cookie=10944736568342498704 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5afb6fe3f6f167d4 server_cookie=97e383ebd4484d90 in_seq=0 out_seq=0 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.011+0000 7f2833fff640 10 client.28532 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f2833fff640 1 -- 10.20.193.28:0/1450211011 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559fe156df80 con 0x559fe1724c90 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f2833fff640 10 client.28532 handle_command_reply: tid=0 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 client.28532 shutdown 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bf360 msgr2=0x559fe171c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bf360 0x559fe171c710 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=2844111400389353033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2878011490 tx=0x7f2878013070 comp rx=0 tx=0).stop 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 shutdown_connections 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559fe1724c90 0x559fe17028a0 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=6555956707459164116 s_cookie=10944736568342498704 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f2833fff640 0 client.28532 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:26:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe171cc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 0x559fe171e9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 --2- 10.20.193.28:0/1450211011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bf360 0x559fe171c710 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=2844111400389353033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 >> 10.20.193.28:0/1450211011 conn(0x559fe169d860 msgr2=0x559fe16bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 shutdown_connections 2026-02-20T13:26:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 1 -- 10.20.193.28:0/1450211011 wait complete. 2026-02-20T13:26:07.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.012+0000 7f288ac74e00 20 client.28532 trim_cache size 0 max 16384 2026-02-20T13:26:07.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f288ac74e00 1 Processor -- start 2026-02-20T13:26:07.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f288ac74e00 1 -- start start 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe171e970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17198a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1719de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f288ac74e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559fe15c9080 con 0x559fe16bfc70 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f288ac74e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559fe1289700 con 0x559fe1704b20 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f288ac74e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559fe1722c70 con 0x559fe16bf360 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f2882575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe171e970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f2882575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe171e970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40798/0 (socket says 10.20.193.28:40798) 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f2882575640 1 -- 10.20.193.28:0/3615950024 learned_addr learned my addr 10.20.193.28:0/3615950024 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f2881d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.020+0000 7f2882d76640 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1719de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f2882575640 1 -- 10.20.193.28:0/3615950024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 msgr2=0x559fe1719de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f2882575640 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1719de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f2882575640 1 -- 10.20.193.28:0/3615950024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 msgr2=0x559fe17198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f2882575640 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f2882575640 1 -- 10.20.193.28:0/3615950024 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe15610e0 con 0x559fe16bf360 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f2881d74640 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17198a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f2882d76640 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1719de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f2882575640 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe171e970 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=1189086022664605940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2878027fd0 tx=0x7f287802b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10807b70044e50f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f284e4e6640 1 -- 10.20.193.28:0/3615950024 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2878022070 con 0x559fe16bf360 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f284e4e6640 1 -- 10.20.193.28:0/3615950024 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559fe12616f0 con 0x559fe16bf360 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f284e4e6640 1 -- 10.20.193.28:0/3615950024 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f287802fab0 con 0x559fe16bf360 2026-02-20T13:26:07.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f288ac74e00 1 -- 10.20.193.28:0/3615950024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 msgr2=0x559fe171e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe171e970 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=1189086022664605940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2878027fd0 tx=0x7f287802b000 comp rx=0 tx=0).stop 2026-02-20T13:26:07.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.021+0000 7f288ac74e00 1 -- 10.20.193.28:0/3615950024 shutdown_connections 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.022+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bfc70 0x559fe17198a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.022+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe1704b20 0x559fe1719de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.022+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3615950024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe16bf360 0x559fe171e970 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=1189086022664605940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.022+0000 7f288ac74e00 1 -- 10.20.193.28:0/3615950024 >> 10.20.193.28:0/3615950024 conn(0x559fe169d860 msgr2=0x559fe1721270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.022+0000 7f288ac74e00 1 -- 10.20.193.28:0/3615950024 shutdown_connections 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.022+0000 7f288ac74e00 1 -- 10.20.193.28:0/3615950024 wait complete. 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.022+0000 7f288ac74e00 1 -- start start 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.022+0000 7f288ac74e00 1 Processor -- start 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bf360 0x559fe16fe770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bfc70 0x559fe16fecb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f288ac74e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 0x559fe16ff1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f288ac74e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559fe16ff830 con 0x559fe16bf360 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f288ac74e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559fe16ff9a0 con 0x559fe16bfc70 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f288ac74e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559fe16ffb60 con 0x559fe1704b20 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bf360 0x559fe16fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 0x559fe16ff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2881d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bfc70 0x559fe16fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bf360 0x559fe16fe770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37862/0 (socket says 10.20.193.28:37862) 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 -- 10.20.193.28:0/3562336427 learned_addr learned my addr 10.20.193.28:0/3562336427 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 -- 10.20.193.28:0/3562336427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 msgr2=0x559fe16ff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 0x559fe16ff1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 -- 10.20.193.28:0/3562336427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bfc70 msgr2=0x559fe16fecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bfc70 0x559fe16fecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 -- 10.20.193.28:0/3562336427 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe154f3c0 con 0x559fe16bf360 2026-02-20T13:26:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2882575640 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bf360 0x559fe16fe770 secure :-1 s=READY pgs=1025 gs=1 cs=0 l=1 c_cookie=269716932183895502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2878004460 tx=0x7f28780092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be3a1eecbaadce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2833fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2833fff640 1 -- 10.20.193.28:0/3562336427 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2878022070 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2833fff640 1 -- 10.20.193.28:0/3562336427 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f287801a3f0 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f2833fff640 1 -- 10.20.193.28:0/3562336427 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f287801a930 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.023+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c0385b0 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f2833fff640 1 -- 10.20.193.28:0/3562336427 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f287801aac0 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 10 client.18576 _ll_register_callbacks cb 0x559fe154ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2874011c10 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f2833fff640 1 -- 10.20.193.28:0/3562336427 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f287801acc0 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 10 client.18576 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559fe155bb60 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f2833fff640 1 -- 10.20.193.28:0/3562336427 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f287802fc40 con 0x559fe16bf360 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 10 client.18576 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 10 client.18576 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 20 client.18576 populate_metadata read hostname 'trial028' 2026-02-20T13:26:07.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559fe16a2970 0x559fe16a2e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 4 client.18576 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559fe125ef40 con 0x559fe16a2970 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.024+0000 7f2881d74640 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559fe16a2970 0x559fe16a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f2881d74640 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559fe16a2970 0x559fe16a2e10 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=6739564611741193402 s_cookie=12644092712021212443 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5d87be4e7fa094ba server_cookie=af78d7548f213d1b in_seq=0 out_seq=0 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f2833fff640 10 client.18576 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f2833fff640 1 -- 10.20.193.28:0/3562336427 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559fe125ef40 con 0x559fe16a2970 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f2833fff640 10 client.18576 handle_command_reply: tid=0 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 client.18576 shutdown 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bf360 msgr2=0x559fe16fe770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bf360 0x559fe16fe770 secure :-1 s=READY pgs=1025 gs=1 cs=0 l=1 c_cookie=269716932183895502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2878004460 tx=0x7f28780092e0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 shutdown_connections 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559fe16a2970 0x559fe16a2e10 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=6739564611741193402 s_cookie=12644092712021212443 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559fe1704b20 0x559fe16ff1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559fe16bfc70 0x559fe16fecb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 --2- 10.20.193.28:0/3562336427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fe16bf360 0x559fe16fe770 unknown :-1 s=CLOSED pgs=1025 gs=1 cs=0 l=1 c_cookie=269716932183895502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 >> 10.20.193.28:0/3562336427 conn(0x559fe169d860 msgr2=0x559fe1721b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f2833fff640 0 client.18576 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:26:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 shutdown_connections 2026-02-20T13:26:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.025+0000 7f288ac74e00 1 -- 10.20.193.28:0/3562336427 wait complete. 2026-02-20T13:26:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f288ac74e00 20 client.18576 trim_cache size 0 max 16384 2026-02-20T13:26:07.033 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 -- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f285c0b56d0 msgr2=0x7f285c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f285c0b56d0 0x7f285c0d5b80 secure :-1 s=READY pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2878004740 tx=0x7f2878005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 -- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28841156a0 msgr2=0x7f28840f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28841156a0 0x7f28840f5ea0 secure :-1 s=READY pgs=1024 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2874005790 tx=0x7f2874003c20 comp rx=0 tx=0).stop 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 -- 10.20.193.28:0/1550073659 shutdown_connections 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f285c0b56d0 0x7f285c0d5b80 unknown :-1 s=CLOSED pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28841156a0 0x7f28840f5ea0 unknown :-1 s=CLOSED pgs=1024 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f288410fea0 0x7f2884175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 --2- 10.20.193.28:0/1550073659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f288410f4b0 0x7f28840f57a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 -- 10.20.193.28:0/1550073659 >> 10.20.193.28:0/1550073659 conn(0x7f28840ecda0 msgr2=0x7f2884111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 -- 10.20.193.28:0/1550073659 shutdown_connections 2026-02-20T13:26:07.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.026+0000 7f2883577640 1 -- 10.20.193.28:0/1550073659 wait complete. 2026-02-20T13:26:07.165 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:26:07.355 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:07.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2504622972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff55810ffe0 msgr2=0x7ff558115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2504622972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff55810ffe0 0x7ff558115030 secure :-1 s=READY pgs=375 gs=2 cs=0 l=1 c_cookie=5174753758794606888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff540009890 tx=0x7ff54002f0e0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2504622972 shutdown_connections 2026-02-20T13:26:07.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2504622972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5581157e0 0x7ff5581761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2504622972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff55810ffe0 0x7ff558115030 unknown :-1 s=CLOSED pgs=375 gs=2 cs=0 l=1 c_cookie=5174753758794606888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2504622972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff55810f5f0 0x7ff55810f9c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2504622972 >> 10.20.193.28:0/2504622972 conn(0x7ff5580ecea0 msgr2=0x7ff55810d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2504622972 shutdown_connections 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.538+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2504622972 wait complete. 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.539+0000 7ff55cbbb640 1 Processor -- start 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.539+0000 7ff55cbbb640 1 -- start start 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.539+0000 7ff55cbbb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff55810f5f0 0x7ff5580f4f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.539+0000 7ff55cbbb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff55810ffe0 0x7ff5581760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.539+0000 7ff55cbbb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff5581157e0 0x7ff5580f5660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.539+0000 7ff55cbbb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5580fa870 con 0x7ff55810f5f0 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.539+0000 7ff55cbbb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff5580fa9e0 con 0x7ff5581157e0 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.539+0000 7ff55cbbb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff5580faba0 con 0x7ff55810ffe0 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff5581157e0 0x7ff5580f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff55810f5f0 0x7ff5580f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff5581157e0 0x7ff5580f5660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35496/0 (socket says 10.20.193.28:35496) 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff55810f5f0 0x7ff5580f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37888/0 (socket says 10.20.193.28:37888) 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 -- 10.20.193.28:0/2532073204 learned_addr learned my addr 10.20.193.28:0/2532073204 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff555d74640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff55810ffe0 0x7ff5581760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 -- 10.20.193.28:0/2532073204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff55810ffe0 msgr2=0x7ff5581760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff55810ffe0 0x7ff5581760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 -- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff55810f5f0 msgr2=0x7ff5580f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff55810f5f0 0x7ff5580f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 -- 10.20.193.28:0/2532073204 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54800a650 con 0x7ff5581157e0 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff556d76640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff5581157e0 0x7ff5580f5660 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff54800afd0 tx=0x7ff548003c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.540+0000 7ff53f7fe640 1 -- 10.20.193.28:0/2532073204 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff54800fd60 con 0x7ff5581157e0 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.541+0000 7ff53f7fe640 1 -- 10.20.193.28:0/2532073204 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff54800fec0 con 0x7ff5581157e0 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.541+0000 7ff53f7fe640 1 -- 10.20.193.28:0/2532073204 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5480109b0 con 0x7ff5581157e0 2026-02-20T13:26:07.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.541+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2532073204 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5400094b0 con 0x7ff5581157e0 2026-02-20T13:26:07.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.541+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2532073204 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5580fb170 con 0x7ff5581157e0 2026-02-20T13:26:07.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.543+0000 7ff53f7fe640 1 -- 10.20.193.28:0/2532073204 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff548020060 con 0x7ff5581157e0 2026-02-20T13:26:07.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.545+0000 7ff53f7fe640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff5300b5750 0x7ff5300d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.545+0000 7ff53f7fe640 1 -- 10.20.193.28:0/2532073204 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff5480e7ef0 con 0x7ff5581157e0 2026-02-20T13:26:07.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.545+0000 7ff556575640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff5300b5750 0x7ff5300d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff556575640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff5300b5750 0x7ff5300d5c00 secure :-1 s=READY pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff54c004740 tx=0x7ff54c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff55ebb5e00 1 Processor -- start 2026-02-20T13:26:07.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff55ebb5e00 1 -- start start 2026-02-20T13:26:07.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f3bd730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bdc70 0x555a2f4025e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f402b20 0x555a2f422f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555a2f2d3780 con 0x555a2f402b20 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555a2f2cf4b0 con 0x555a2f3bdc70 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555a2f2c9450 con 0x555a2f3bd360 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.546+0000 7ff556575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f3bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f3bd730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40838/0 (socket says 10.20.193.28:40838) 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556575640 1 -- 10.20.193.28:0/1491880145 learned_addr learned my addr 10.20.193.28:0/1491880145 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff555d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bdc70 0x555a2f4025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556d76640 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f402b20 0x555a2f422f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556575640 1 -- 10.20.193.28:0/1491880145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bdc70 msgr2=0x555a2f4025e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556575640 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bdc70 0x555a2f4025e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556575640 1 -- 10.20.193.28:0/1491880145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f402b20 msgr2=0x555a2f422f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556575640 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f402b20 0x555a2f422f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556575640 1 -- 10.20.193.28:0/1491880145 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2f274d10 con 0x555a2f3bd360 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556d76640 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f402b20 0x555a2f422f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff556575640 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f3bd730 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=16815978239798931173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff54c004140 tx=0x7ff54c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95e5b1d3de9eee5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff53cff9640 1 -- 10.20.193.28:0/1491880145 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff54c002cf0 con 0x555a2f3bd360 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.547+0000 7ff53cff9640 1 -- 10.20.193.28:0/1491880145 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff54c022070 con 0x555a2f3bd360 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1491880145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 msgr2=0x555a2f3bd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f3bd730 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=16815978239798931173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff54c004140 tx=0x7ff54c014000 comp rx=0 tx=0).stop 2026-02-20T13:26:07.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1491880145 shutdown_connections 2026-02-20T13:26:07.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f402b20 0x555a2f422f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bdc70 0x555a2f4025e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1491880145 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f3bd730 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=16815978239798931173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1491880145 >> 10.20.193.28:0/1491880145 conn(0x555a2f39b860 msgr2=0x555a2f3bbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1491880145 shutdown_connections 2026-02-20T13:26:07.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.548+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1491880145 wait complete. 2026-02-20T13:26:07.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.549+0000 7ff55ebb5e00 1 -- start start 2026-02-20T13:26:07.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.549+0000 7ff55ebb5e00 1 Processor -- start 2026-02-20T13:26:07.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f41a550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f41aa90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f402b20 0x555a2f41c820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555a2f41cd90 con 0x555a2f3bdc70 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555a2f41cf00 con 0x555a2f402b20 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555a2f41d0c0 con 0x555a2f3bd360 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff555d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f41aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff556d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f402b20 0x555a2f41c820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff556d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f402b20 0x555a2f41c820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35524/0 (socket says 10.20.193.28:35524) 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff556d76640 1 -- 10.20.193.28:0/178337074 learned_addr learned my addr 10.20.193.28:0/178337074 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.550+0000 7ff556575640 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f41a550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff555d74640 1 -- 10.20.193.28:0/178337074 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 msgr2=0x555a2f41a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff555d74640 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f41a550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff555d74640 1 -- 10.20.193.28:0/178337074 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f402b20 msgr2=0x555a2f41c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff555d74640 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f402b20 0x555a2f41c820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff555d74640 1 -- 10.20.193.28:0/178337074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2f24d3c0 con 0x555a2f3bdc70 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff556d76640 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f402b20 0x555a2f41c820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff555d74640 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f41aa90 secure :-1 s=READY pgs=1026 gs=2 cs=0 l=1 c_cookie=6940842456844163857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5580fb900 tx=0x7ff54002fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6052d370ba255b11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff507fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff507fff640 1 -- 10.20.193.28:0/178337074 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff54003d040 con 0x555a2f3bdc70 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff507fff640 1 -- 10.20.193.28:0/178337074 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff54003e040 con 0x555a2f3bdc70 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff507fff640 1 -- 10.20.193.28:0/178337074 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff540038e80 con 0x555a2f3bdc70 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff54c009d00 con 0x555a2f3bdc70 2026-02-20T13:26:07.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff507fff640 1 -- 10.20.193.28:0/178337074 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff540044450 con 0x555a2f3bdc70 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff55ebb5e00 10 client.18585 _ll_register_callbacks cb 0x555a2f24aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.551+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555a2ef5f6f0 con 0x555a2f3bdc70 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff507fff640 1 -- 10.20.193.28:0/178337074 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff54002fc60 con 0x555a2f3bdc70 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff55ebb5e00 10 client.18585 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555a2f25f0e0 con 0x555a2f3bdc70 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff507fff640 1 -- 10.20.193.28:0/178337074 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff5400386b0 con 0x555a2f3bdc70 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff55ebb5e00 10 client.18585 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff55ebb5e00 10 client.18585 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff55ebb5e00 20 client.18585 populate_metadata read hostname 'trial028' 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555a2f3ffe50 0x555a2f4002f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff55ebb5e00 4 client.18585 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a2f26bf80 con 0x555a2f3ffe50 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.552+0000 7ff556575640 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555a2f3ffe50 0x555a2f4002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.553+0000 7ff507fff640 10 client.18585 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.553+0000 7ff556575640 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555a2f3ffe50 0x555a2f4002f0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=5132616138415886399 s_cookie=5957458802383619058 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=473ab72f22b7503f server_cookie=52ad2537801983f2 in_seq=0 out_seq=0 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff507fff640 1 -- 10.20.193.28:0/178337074 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555a2f26bf80 con 0x555a2f3ffe50 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff507fff640 10 client.18585 handle_command_reply: tid=0 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 client.18585 shutdown 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 msgr2=0x555a2f41aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f41aa90 secure :-1 s=READY pgs=1026 gs=2 cs=0 l=1 c_cookie=6940842456844163857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5580fb900 tx=0x7ff54002fb70 comp rx=0 tx=0).stop 2026-02-20T13:26:07.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 shutdown_connections 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555a2f3ffe50 0x555a2f4002f0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=5132616138415886399 s_cookie=5957458802383619058 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f41aa90 unknown :-1 s=CLOSED pgs=1026 gs=2 cs=0 l=1 c_cookie=6940842456844163857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f402b20 0x555a2f41c820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/178337074 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f3bd360 0x555a2f41a550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 >> 10.20.193.28:0/178337074 conn(0x555a2f39b860 msgr2=0x555a2f3bbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff507fff640 0 client.18585 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 shutdown_connections 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/178337074 wait complete. 2026-02-20T13:26:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.554+0000 7ff55ebb5e00 20 client.18585 trim_cache size 0 max 16384 2026-02-20T13:26:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff55ebb5e00 1 Processor -- start 2026-02-20T13:26:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff55ebb5e00 1 -- start start 2026-02-20T13:26:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f4176c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f417c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 0x555a2f3fd780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555a2f2c7080 con 0x555a2f3bdc70 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555a2ef87700 con 0x555a2f3bd360 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555a2f4133a0 con 0x555a2f402b20 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f4176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f4176c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35532/0 (socket says 10.20.193.28:35532) 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 -- 10.20.193.28:0/3132408955 learned_addr learned my addr 10.20.193.28:0/3132408955 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556d76640 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 0x555a2f3fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff555d74640 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f417c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 -- 10.20.193.28:0/3132408955 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 msgr2=0x555a2f3fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 0x555a2f3fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 -- 10.20.193.28:0/3132408955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 msgr2=0x555a2f417c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f417c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 -- 10.20.193.28:0/3132408955 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2f259b60 con 0x555a2f3bd360 2026-02-20T13:26:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.562+0000 7ff556575640 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f4176c0 secure :-1 s=READY pgs=377 gs=3 cs=0 l=1 c_cookie=11285317897309072397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff54c002b40 tx=0x7ff54c01be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c9d80d5de772c0d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff5224e6640 1 -- 10.20.193.28:0/3132408955 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff54c02d070 con 0x555a2f3bd360 2026-02-20T13:26:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff5224e6640 1 -- 10.20.193.28:0/3132408955 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff54c02e040 con 0x555a2f3bd360 2026-02-20T13:26:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff5224e6640 1 -- 10.20.193.28:0/3132408955 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff54c01d9c0 con 0x555a2f3bd360 2026-02-20T13:26:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/3132408955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 msgr2=0x555a2f4176c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f4176c0 secure :-1 s=READY pgs=377 gs=3 cs=0 l=1 c_cookie=11285317897309072397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff54c002b40 tx=0x7ff54c01be00 comp rx=0 tx=0).stop 2026-02-20T13:26:07.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/3132408955 shutdown_connections 2026-02-20T13:26:07.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f417c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 0x555a2f3fd780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/3132408955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f4176c0 unknown :-1 s=CLOSED pgs=377 gs=3 cs=0 l=1 c_cookie=11285317897309072397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/3132408955 >> 10.20.193.28:0/3132408955 conn(0x555a2f39b860 msgr2=0x555a2f404f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/3132408955 shutdown_connections 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.563+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/3132408955 wait complete. 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff55ebb5e00 1 -- start start 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff55ebb5e00 1 Processor -- start 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f3a1360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f3a18a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff55ebb5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 0x555a2f41e560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555a2f3982e0 con 0x555a2f3bdc70 2026-02-20T13:26:07.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555a2f41eaa0 con 0x555a2f3bd360 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff55ebb5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555a2f41ec60 con 0x555a2f402b20 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff556575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f3a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff555d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f3a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff556d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 0x555a2f41e560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff556575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f3a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35544/0 (socket says 10.20.193.28:35544) 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.564+0000 7ff556575640 1 -- 10.20.193.28:0/1384138604 learned_addr learned my addr 10.20.193.28:0/1384138604 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff555d74640 1 -- 10.20.193.28:0/1384138604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 msgr2=0x555a2f41e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff555d74640 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 0x555a2f41e560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff555d74640 1 -- 10.20.193.28:0/1384138604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 msgr2=0x555a2f3a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff555d74640 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f3a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff555d74640 1 -- 10.20.193.28:0/1384138604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2f24d6f0 con 0x555a2f3bdc70 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff556575640 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f3a1360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff555d74640 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f3a18a0 secure :-1 s=READY pgs=1027 gs=2 cs=0 l=1 c_cookie=294733955242605358 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff540004160 tx=0x7ff540005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4171af8817b3b2e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff507fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff507fff640 1 -- 10.20.193.28:0/1384138604 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff54003d070 con 0x555a2f3bdc70 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff507fff640 1 -- 10.20.193.28:0/1384138604 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff54003e040 con 0x555a2f3bdc70 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff507fff640 1 -- 10.20.193.28:0/1384138604 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff540056c40 con 0x555a2f3bdc70 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2f274d10 con 0x555a2f3bdc70 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff55ebb5e00 10 client.18591 _ll_register_callbacks cb 0x555a2f24aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff507fff640 1 -- 10.20.193.28:0/1384138604 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff540056dd0 con 0x555a2f3bdc70 2026-02-20T13:26:07.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff54c022070 con 0x555a2f3bdc70 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.565+0000 7ff507fff640 1 -- 10.20.193.28:0/1384138604 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff54002fb70 con 0x555a2f3bdc70 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff55ebb5e00 10 client.18591 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555a2f25f340 con 0x555a2f3bdc70 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff507fff640 1 -- 10.20.193.28:0/1384138604 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff54004cc40 con 0x555a2f3bdc70 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff55ebb5e00 10 client.18591 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff55ebb5e00 10 client.18591 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff55ebb5e00 20 client.18591 populate_metadata read hostname 'trial028' 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555a2f4afff0 0x555a2f4d0450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff55ebb5e00 4 client.18591 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a2ef5cf40 con 0x555a2f4afff0 2026-02-20T13:26:07.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.566+0000 7ff556575640 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555a2f4afff0 0x555a2f4d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff556575640 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555a2f4afff0 0x555a2f4d0450 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=12405649137441125960 s_cookie=6078222146030185120 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ac29b8299d4f3648 server_cookie=545a2ed6880aaaa0 in_seq=0 out_seq=0 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff507fff640 10 client.18591 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff507fff640 1 -- 10.20.193.28:0/1384138604 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a2ef5cf40 con 0x555a2f4afff0 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff507fff640 10 client.18591 handle_command_reply: tid=0 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 client.18591 shutdown 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 msgr2=0x555a2f3a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f3a18a0 secure :-1 s=READY pgs=1027 gs=2 cs=0 l=1 c_cookie=294733955242605358 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff540004160 tx=0x7ff540005d40 comp rx=0 tx=0).stop 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 shutdown_connections 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x555a2f4afff0 0x555a2f4d0450 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=12405649137441125960 s_cookie=6078222146030185120 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555a2f3bdc70 0x555a2f3a18a0 unknown :-1 s=CLOSED pgs=1027 gs=2 cs=0 l=1 c_cookie=294733955242605358 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555a2f402b20 0x555a2f41e560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 --2- 10.20.193.28:0/1384138604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555a2f3bd360 0x555a2f3a1360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff507fff640 0 client.18591 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:26:07.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 >> 10.20.193.28:0/1384138604 conn(0x555a2f39b860 msgr2=0x555a2f41b730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 shutdown_connections 2026-02-20T13:26:07.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.567+0000 7ff55ebb5e00 1 -- 10.20.193.28:0/1384138604 wait complete. 2026-02-20T13:26:07.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55ebb5e00 20 client.18591 trim_cache size 0 max 16384 2026-02-20T13:26:07.577 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:07.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff5300b5750 msgr2=0x7ff5300d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff5300b5750 0x7ff5300d5c00 secure :-1 s=READY pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff54c004740 tx=0x7ff54c005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:07.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2532073204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff5581157e0 msgr2=0x7ff5580f5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:07.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff5581157e0 0x7ff5580f5660 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff54800afd0 tx=0x7ff548003c70 comp rx=0 tx=0).stop 2026-02-20T13:26:07.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2532073204 shutdown_connections 2026-02-20T13:26:07.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff5300b5750 0x7ff5300d5c00 unknown :-1 s=CLOSED pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff5581157e0 0x7ff5580f5660 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff55810ffe0 0x7ff5581760b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 --2- 10.20.193.28:0/2532073204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff55810f5f0 0x7ff5580f4f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:07.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2532073204 >> 10.20.193.28:0/2532073204 conn(0x7ff5580ecea0 msgr2=0x7ff558114070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:07.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2532073204 shutdown_connections 2026-02-20T13:26:07.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:07.568+0000 7ff55cbbb640 1 -- 10.20.193.28:0/2532073204 wait complete. 2026-02-20T13:26:07.658 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:07 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2482587718' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:07.709 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:26:07.895 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:07.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:07 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2482587718' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:07.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:07 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2482587718' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:08.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 -- 10.20.193.28:0/2747783559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 msgr2=0x7f56d810bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 --2- 10.20.193.28:0/2747783559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 0x7f56d810bcf0 secure :-1 s=READY pgs=1028 gs=1 cs=0 l=1 c_cookie=16756872290619836822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c8009950 tx=0x7f56c802f190 comp rx=0 tx=0).stop 2026-02-20T13:26:08.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 -- 10.20.193.28:0/2747783559 shutdown_connections 2026-02-20T13:26:08.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 --2- 10.20.193.28:0/2747783559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56d8155650 0x7f56d8175a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 --2- 10.20.193.28:0/2747783559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56d810c230 0x7f56d8155110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 --2- 10.20.193.28:0/2747783559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 0x7f56d810bcf0 unknown :-1 s=CLOSED pgs=1028 gs=1 cs=0 l=1 c_cookie=16756872290619836822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 -- 10.20.193.28:0/2747783559 >> 10.20.193.28:0/2747783559 conn(0x7f56d80e95a0 msgr2=0x7f56d81099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 -- 10.20.193.28:0/2747783559 shutdown_connections 2026-02-20T13:26:08.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.067+0000 7f56de23c640 1 -- 10.20.193.28:0/2747783559 wait complete. 2026-02-20T13:26:08.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56de23c640 1 Processor -- start 2026-02-20T13:26:08.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56de23c640 1 -- start start 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56de23c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 0x7f56d8160d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56de23c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56d810c230 0x7f56d8161260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56de23c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56d8155650 0x7f56d8166630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56de23c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56d8166c50 con 0x7f56d810b920 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56de23c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f56d8166dc0 con 0x7f56d810c230 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56de23c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f56d8166f80 con 0x7f56d8155650 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 0x7f56d8160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dca39640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56d810c230 0x7f56d8161260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 0x7f56d8160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37948/0 (socket says 10.20.193.28:37948) 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dd23a640 1 -- 10.20.193.28:0/2477324532 learned_addr learned my addr 10.20.193.28:0/2477324532 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dda3b640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56d8155650 0x7f56d8166630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dd23a640 1 -- 10.20.193.28:0/2477324532 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56d8155650 msgr2=0x7f56d8166630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dd23a640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56d8155650 0x7f56d8166630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dd23a640 1 -- 10.20.193.28:0/2477324532 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56d810c230 msgr2=0x7f56d8161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.068+0000 7f56dd23a640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56d810c230 0x7f56d8161260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.069+0000 7f56dd23a640 1 -- 10.20.193.28:0/2477324532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c8009570 con 0x7f56d810b920 2026-02-20T13:26:08.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.069+0000 7f56dda3b640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56d8155650 0x7f56d8166630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:08.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.069+0000 7f56dd23a640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 0x7f56d8160d20 secure :-1 s=READY pgs=1029 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c8005b30 tx=0x7f56c8004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.069+0000 7f56c67fc640 1 -- 10.20.193.28:0/2477324532 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c803d070 con 0x7f56d810b920 2026-02-20T13:26:08.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.069+0000 7f56c67fc640 1 -- 10.20.193.28:0/2477324532 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56c8038920 con 0x7f56d810b920 2026-02-20T13:26:08.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.069+0000 7f56c67fc640 1 -- 10.20.193.28:0/2477324532 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80418a0 con 0x7f56d810b920 2026-02-20T13:26:08.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.069+0000 7f56de23c640 1 -- 10.20.193.28:0/2477324532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d8167200 con 0x7f56d810b920 2026-02-20T13:26:08.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.069+0000 7f56de23c640 1 -- 10.20.193.28:0/2477324532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d81520e0 con 0x7f56d810b920 2026-02-20T13:26:08.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.072+0000 7f56c67fc640 1 -- 10.20.193.28:0/2477324532 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f56c8038a90 con 0x7f56d810b920 2026-02-20T13:26:08.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.074+0000 7f56c67fc640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56b40b5760 0x7f56b40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.074+0000 7f56c67fc640 1 -- 10.20.193.28:0/2477324532 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56c810af60 con 0x7f56d810b920 2026-02-20T13:26:08.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.074+0000 7f56dca39640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56b40b5760 0x7f56b40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56dca39640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56b40b5760 0x7f56b40d5c10 secure :-1 s=READY pgs=463 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56d81676c0 tx=0x7f56cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56e14bfe00 1 Processor -- start 2026-02-20T13:26:08.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56e14bfe00 1 -- start start 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d760d2730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d761175e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d76137f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564d75fe8780 con 0x564d760d2360 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564d75fe44b0 con 0x564d760d2c70 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.075+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564d75fde450 con 0x564d76117b20 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dca39640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d761175e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d760d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d760d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37956/0 (socket says 10.20.193.28:37956) 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 -- 10.20.193.28:0/3767327154 learned_addr learned my addr 10.20.193.28:0/3767327154 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dda3b640 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d76137f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 -- 10.20.193.28:0/3767327154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 msgr2=0x564d76137f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d76137f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 -- 10.20.193.28:0/3767327154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 msgr2=0x564d761175e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d761175e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 -- 10.20.193.28:0/3767327154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d75f89d10 con 0x564d760d2360 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dda3b640 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d76137f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d760d2730 secure :-1 s=READY pgs=1030 gs=1 cs=0 l=1 c_cookie=15874898244009648270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c8005940 tx=0x7f56c8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4ef7d817aae08e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56a5ce5640 1 -- 10.20.193.28:0/3767327154 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80d1cc0 con 0x564d760d2360 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56a5ce5640 1 -- 10.20.193.28:0/3767327154 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56c80d6fe0 con 0x564d760d2360 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56a5ce5640 1 -- 10.20.193.28:0/3767327154 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80482f0 con 0x564d760d2360 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3767327154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 msgr2=0x564d760d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d760d2730 secure :-1 s=READY pgs=1030 gs=1 cs=0 l=1 c_cookie=15874898244009648270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c8005940 tx=0x7f56c8009310 comp rx=0 tx=0).stop 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3767327154 shutdown_connections 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d76137f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d761175e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3767327154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d760d2730 unknown :-1 s=CLOSED pgs=1030 gs=1 cs=0 l=1 c_cookie=15874898244009648270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3767327154 >> 10.20.193.28:0/3767327154 conn(0x564d760b0860 msgr2=0x564d760d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3767327154 shutdown_connections 2026-02-20T13:26:08.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.076+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3767327154 wait complete. 2026-02-20T13:26:08.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56e14bfe00 1 -- start start 2026-02-20T13:26:08.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56e14bfe00 1 Processor -- start 2026-02-20T13:26:08.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612f720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d7612fc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d761319f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564d76131f60 con 0x564d760d2360 2026-02-20T13:26:08.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564d761320d0 con 0x564d760d2c70 2026-02-20T13:26:08.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564d76132290 con 0x564d76117b20 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612f720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612f720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37966/0 (socket says 10.20.193.28:37966) 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56dd23a640 1 -- 10.20.193.28:0/3223495185 learned_addr learned my addr 10.20.193.28:0/3223495185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56dca39640 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d7612fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.078+0000 7f56dda3b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d761319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56dd23a640 1 -- 10.20.193.28:0/3223495185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 msgr2=0x564d761319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d761319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56dd23a640 1 -- 10.20.193.28:0/3223495185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 msgr2=0x564d7612fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d7612fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56dd23a640 1 -- 10.20.193.28:0/3223495185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d75f623c0 con 0x564d760d2360 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612f720 secure :-1 s=READY pgs=1031 gs=1 cs=0 l=1 c_cookie=6211121961785110225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c8038820 tx=0x7f56c802f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563256842cd42ed1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f5692ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f5692ffd640 1 -- 10.20.193.28:0/3223495185 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80d95c0 con 0x564d760d2360 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f5692ffd640 1 -- 10.20.193.28:0/3223495185 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56c80dc400 con 0x564d760d2360 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f5692ffd640 1 -- 10.20.193.28:0/3223495185 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80d2f30 con 0x564d760d2360 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d81520e0 con 0x564d760d2360 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56e14bfe00 10 client.18603 _ll_register_callbacks cb 0x564d75f5fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d75c746f0 con 0x564d760d2360 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.079+0000 7f5692ffd640 1 -- 10.20.193.28:0/3223495185 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56c80d1cc0 con 0x564d760d2360 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f5692ffd640 1 -- 10.20.193.28:0/3223495185 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56c80cf530 con 0x564d760d2360 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56e14bfe00 10 client.18603 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:08.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564d75f740e0 con 0x564d760d2360 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f5692ffd640 1 -- 10.20.193.28:0/3223495185 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f56c8093020 con 0x564d760d2360 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56e14bfe00 10 client.18603 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56e14bfe00 10 client.18603 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56e14bfe00 20 client.18603 populate_metadata read hostname 'trial028' 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564d76114c00 0x564d761150a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56e14bfe00 4 client.18603 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d75f80f80 con 0x564d76114c00 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.080+0000 7f56dca39640 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564d76114c00 0x564d761150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.081+0000 7f56dca39640 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564d76114c00 0x564d761150a0 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=14453969438235249369 s_cookie=583417675853570063 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c896d09fa85d4ad9 server_cookie=818b748fcefa00f in_seq=0 out_seq=0 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.081+0000 7f5692ffd640 10 client.18603 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.081+0000 7f5692ffd640 1 -- 10.20.193.28:0/3223495185 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564d75f80f80 con 0x564d76114c00 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.081+0000 7f5692ffd640 10 client.18603 handle_command_reply: tid=0 2026-02-20T13:26:08.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.081+0000 7f56e14bfe00 1 client.18603 shutdown 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 msgr2=0x564d7612f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612f720 secure :-1 s=READY pgs=1031 gs=1 cs=0 l=1 c_cookie=6211121961785110225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c8038820 tx=0x7f56c802f190 comp rx=0 tx=0).stop 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 shutdown_connections 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564d76114c00 0x564d761150a0 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=14453969438235249369 s_cookie=583417675853570063 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d761319f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d7612fc60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3223495185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612f720 unknown :-1 s=CLOSED pgs=1031 gs=1 cs=0 l=1 c_cookie=6211121961785110225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f5692ffd640 0 client.18603 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 >> 10.20.193.28:0/3223495185 conn(0x564d760b0860 msgr2=0x564d760d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 shutdown_connections 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3223495185 wait complete. 2026-02-20T13:26:08.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.082+0000 7f56e14bfe00 20 client.18603 trim_cache size 0 max 16384 2026-02-20T13:26:08.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.089+0000 7f56e14bfe00 1 Processor -- start 2026-02-20T13:26:08.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.089+0000 7f56e14bfe00 1 -- start start 2026-02-20T13:26:08.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.089+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612e670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.089+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d7612c8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.089+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d7612cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.089+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564d76121710 con 0x564d760d2360 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.089+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564d75fdc080 con 0x564d760d2c70 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.089+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564d75c9c700 con 0x564d76117b20 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612e670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612e670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37968/0 (socket says 10.20.193.28:37968) 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 -- 10.20.193.28:0/3937716118 learned_addr learned my addr 10.20.193.28:0/3937716118 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dda3b640 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d7612cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dca39640 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d7612c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 -- 10.20.193.28:0/3937716118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 msgr2=0x564d7612cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d7612cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 -- 10.20.193.28:0/3937716118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 msgr2=0x564d7612c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d7612c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 -- 10.20.193.28:0/3937716118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d7611d020 con 0x564d760d2360 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56dd23a640 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612e670 secure :-1 s=READY pgs=1032 gs=1 cs=0 l=1 c_cookie=1932364053159365882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c80ce530 tx=0x7f56c803a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad122de454c4cfa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56a54e4640 1 -- 10.20.193.28:0/3937716118 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80f6670 con 0x564d760d2360 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56a54e4640 1 -- 10.20.193.28:0/3937716118 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564d75c746f0 con 0x564d760d2360 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.090+0000 7f56a54e4640 1 -- 10.20.193.28:0/3937716118 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80cd530 con 0x564d760d2360 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3937716118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 msgr2=0x564d7612e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612e670 secure :-1 s=READY pgs=1032 gs=1 cs=0 l=1 c_cookie=1932364053159365882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c80ce530 tx=0x7f56c803a030 comp rx=0 tx=0).stop 2026-02-20T13:26:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3937716118 shutdown_connections 2026-02-20T13:26:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d76117b20 0x564d7612cdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d760d2c70 0x564d7612c8b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/3937716118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612e670 unknown :-1 s=CLOSED pgs=1032 gs=1 cs=0 l=1 c_cookie=1932364053159365882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3937716118 >> 10.20.193.28:0/3937716118 conn(0x564d760b0860 msgr2=0x564d76134280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3937716118 shutdown_connections 2026-02-20T13:26:08.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 -- 10.20.193.28:0/3937716118 wait complete. 2026-02-20T13:26:08.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 -- start start 2026-02-20T13:26:08.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.091+0000 7f56e14bfe00 1 Processor -- start 2026-02-20T13:26:08.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612d660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d760d2c70 0x564d7612dba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56e14bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d76117b20 0x564d760b3c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564d75c9c700 con 0x564d760d2360 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564d7611cee0 con 0x564d76117b20 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56e14bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564d760b02a0 con 0x564d760d2c70 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612d660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612d660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37974/0 (socket says 10.20.193.28:37974) 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 -- 10.20.193.28:0/2070776240 learned_addr learned my addr 10.20.193.28:0/2070776240 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dca39640 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d760d2c70 0x564d7612dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dda3b640 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d76117b20 0x564d760b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 -- 10.20.193.28:0/2070776240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d760d2c70 msgr2=0x564d7612dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d760d2c70 0x564d7612dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 -- 10.20.193.28:0/2070776240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d76117b20 msgr2=0x564d760b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d76117b20 0x564d760b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 -- 10.20.193.28:0/2070776240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d75f6eb60 con 0x564d760d2360 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f56dd23a640 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612d660 secure :-1 s=READY pgs=1033 gs=1 cs=0 l=1 c_cookie=2551834473430208438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c80d3550 tx=0x7f56c8002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2369efeef2674fb6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.092+0000 7f5692ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f5692ffd640 1 -- 10.20.193.28:0/2070776240 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80f6640 con 0x564d760d2360 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f5692ffd640 1 -- 10.20.193.28:0/2070776240 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56c80d1cc0 con 0x564d760d2360 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d75f740e0 con 0x564d760d2360 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f5692ffd640 1 -- 10.20.193.28:0/2070776240 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c80d2cb0 con 0x564d760d2360 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 10 client.18609 _ll_register_callbacks cb 0x564d75f5fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c80d6fe0 con 0x564d760d2360 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f5692ffd640 1 -- 10.20.193.28:0/2070776240 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56c80d2e40 con 0x564d760d2360 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f5692ffd640 1 -- 10.20.193.28:0/2070776240 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56c80d1770 con 0x564d760d2360 2026-02-20T13:26:08.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 10 client.18609 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564d75f626f0 con 0x564d760d2360 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f5692ffd640 1 -- 10.20.193.28:0/2070776240 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f56c8093070 con 0x564d760d2360 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 10 client.18609 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 10 client.18609 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 20 client.18609 populate_metadata read hostname 'trial028' 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564d760b50a0 0x564d760b5540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 4 client.18609 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564d75c71f40 con 0x564d760b50a0 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.093+0000 7f56dca39640 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564d760b50a0 0x564d760b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56dca39640 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564d760b50a0 0x564d760b5540 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=9316695680576602307 s_cookie=1423532246343727492 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=814b8d5c092f40c3 server_cookie=13c167092da1b984 in_seq=0 out_seq=0 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f5692ffd640 10 client.18609 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:26:08.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f5692ffd640 1 -- 10.20.193.28:0/2070776240 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564d75c71f40 con 0x564d760b50a0 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f5692ffd640 10 client.18609 handle_command_reply: tid=0 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 client.18609 shutdown 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 msgr2=0x564d7612d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612d660 secure :-1 s=READY pgs=1033 gs=1 cs=0 l=1 c_cookie=2551834473430208438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c80d3550 tx=0x7f56c8002b90 comp rx=0 tx=0).stop 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 shutdown_connections 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564d760b50a0 0x564d760b5540 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=9316695680576602307 s_cookie=1423532246343727492 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564d76117b20 0x564d760b3c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564d760d2c70 0x564d7612dba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 --2- 10.20.193.28:0/2070776240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d760d2360 0x564d7612d660 unknown :-1 s=CLOSED pgs=1033 gs=1 cs=0 l=1 c_cookie=2551834473430208438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 >> 10.20.193.28:0/2070776240 conn(0x564d760b0860 msgr2=0x564d76130900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f5692ffd640 0 client.18609 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 shutdown_connections 2026-02-20T13:26:08.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.094+0000 7f56e14bfe00 1 -- 10.20.193.28:0/2070776240 wait complete. 2026-02-20T13:26:08.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56e14bfe00 20 client.18609 trim_cache size 0 max 16384 2026-02-20T13:26:08.104 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 -- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56b40b5760 msgr2=0x7f56b40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56b40b5760 0x7f56b40d5c10 secure :-1 s=READY pgs=463 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56d81676c0 tx=0x7f56cc005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 -- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 msgr2=0x7f56d8160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 0x7f56d8160d20 secure :-1 s=READY pgs=1029 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c8005b30 tx=0x7f56c8004340 comp rx=0 tx=0).stop 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 -- 10.20.193.28:0/2477324532 shutdown_connections 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56b40b5760 0x7f56b40d5c10 unknown :-1 s=CLOSED pgs=463 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56d8155650 0x7f56d8166630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f56d810c230 0x7f56d8161260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 --2- 10.20.193.28:0/2477324532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d810b920 0x7f56d8160d20 unknown :-1 s=CLOSED pgs=1029 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 -- 10.20.193.28:0/2477324532 >> 10.20.193.28:0/2477324532 conn(0x7f56d80e95a0 msgr2=0x7f56d8109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 -- 10.20.193.28:0/2477324532 shutdown_connections 2026-02-20T13:26:08.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.095+0000 7f56de23c640 1 -- 10.20.193.28:0/2477324532 wait complete. 2026-02-20T13:26:08.195 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:26:08.381 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 -- 10.20.193.28:0/573968527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60641157e0 msgr2=0x7f60641761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 --2- 10.20.193.28:0/573968527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60641157e0 0x7f60641761b0 secure :-1 s=READY pgs=1034 gs=2 cs=0 l=1 c_cookie=4658996836400244299 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f605800aa30 tx=0x7f6058030270 comp rx=0 tx=0).stop 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 -- 10.20.193.28:0/573968527 shutdown_connections 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 --2- 10.20.193.28:0/573968527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60641157e0 0x7f60641761b0 unknown :-1 s=CLOSED pgs=1034 gs=2 cs=0 l=1 c_cookie=4658996836400244299 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 --2- 10.20.193.28:0/573968527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f606410ffe0 0x7f6064115030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 --2- 10.20.193.28:0/573968527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f606410f5f0 0x7f606410f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 -- 10.20.193.28:0/573968527 >> 10.20.193.28:0/573968527 conn(0x7f60640ecea0 msgr2=0x7f606410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 -- 10.20.193.28:0/573968527 shutdown_connections 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.557+0000 7f606a96d640 1 -- 10.20.193.28:0/573968527 wait complete. 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.558+0000 7f606a96d640 1 Processor -- start 2026-02-20T13:26:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.558+0000 7f606a96d640 1 -- start start 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f606a96d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f606410f5f0 0x7f606411d510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f606a96d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f606410ffe0 0x7f606411da50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f606a96d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f60641157e0 0x7f6064122e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f606a96d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6064123440 con 0x7f606410ffe0 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f606a96d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f60641235b0 con 0x7f606410f5f0 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f606a96d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6064123770 con 0x7f60641157e0 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f606410ffe0 0x7f606411da50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f6063fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f606410f5f0 0x7f606411d510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f606410ffe0 0x7f606411da50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37990/0 (socket says 10.20.193.28:37990) 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 -- 10.20.193.28:0/3139589067 learned_addr learned my addr 10.20.193.28:0/3139589067 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f6068ee3640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f60641157e0 0x7f6064122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 -- 10.20.193.28:0/3139589067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f60641157e0 msgr2=0x7f6064122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f60641157e0 0x7f6064122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 -- 10.20.193.28:0/3139589067 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f606410f5f0 msgr2=0x7f606411d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f606410f5f0 0x7f606411d510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 -- 10.20.193.28:0/3139589067 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605800a650 con 0x7f606410ffe0 2026-02-20T13:26:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f6068ee3640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f60641157e0 0x7f6064122e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:08.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f6063fff640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f606410f5f0 0x7f606411d510 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:08.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60637fe640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f606410ffe0 0x7f606411da50 secure :-1 s=READY pgs=1035 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f605400d950 tx=0x7f605400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60617fa640 1 -- 10.20.193.28:0/3139589067 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6054004540 con 0x7f606410ffe0 2026-02-20T13:26:08.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60617fa640 1 -- 10.20.193.28:0/3139589067 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6054009d00 con 0x7f606410ffe0 2026-02-20T13:26:08.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f60617fa640 1 -- 10.20.193.28:0/3139589067 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60540106e0 con 0x7f606410ffe0 2026-02-20T13:26:08.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.559+0000 7f606a96d640 1 -- 10.20.193.28:0/3139589067 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6064123a50 con 0x7f606410ffe0 2026-02-20T13:26:08.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.560+0000 7f606a96d640 1 -- 10.20.193.28:0/3139589067 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6064164150 con 0x7f606410ffe0 2026-02-20T13:26:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f60617fa640 1 -- 10.20.193.28:0/3139589067 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f60540097c0 con 0x7f606410ffe0 2026-02-20T13:26:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f606c967e00 1 Processor -- start 2026-02-20T13:26:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f606c967e00 1 -- start start 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f606c967e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 0x56242b922b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f606c967e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b9679f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f606c967e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b988310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f606c967e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56242b827780 con 0x56242b923080 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f606c967e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56242b8234b0 con 0x56242b922770 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f606c967e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56242b81d450 con 0x56242b967f30 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f6063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b9679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f6063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b9679f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38004/0 (socket says 10.20.193.28:38004) 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f6063fff640 1 -- 10.20.193.28:0/2423259023 learned_addr learned my addr 10.20.193.28:0/2423259023 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.565+0000 7f60637fe640 1 --2- 10.20.193.28:0/2423259023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b988310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6063fff640 1 -- 10.20.193.28:0/2423259023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 msgr2=0x56242b988310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6063fff640 1 --2- 10.20.193.28:0/2423259023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b988310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6063fff640 1 -- 10.20.193.28:0/2423259023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 msgr2=0x56242b922b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6063fff640 1 --2- 10.20.193.28:0/2423259023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 0x56242b922b40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6063fff640 1 -- 10.20.193.28:0/2423259023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242b7c8d10 con 0x56242b923080 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6063fff640 1 --2- 10.20.193.28:0/2423259023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b9679f0 secure :-1 s=READY pgs=1036 gs=1 cs=0 l=1 c_cookie=9912976306466793588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6050004170 tx=0x7f6050004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8991f76df5d12874 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6034ce3640 1 -- 10.20.193.28:0/2423259023 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6050002e40 con 0x56242b923080 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6034ce3640 1 -- 10.20.193.28:0/2423259023 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f605001a920 con 0x56242b923080 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f6034ce3640 1 -- 10.20.193.28:0/2423259023 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6050010c30 con 0x56242b923080 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f60617fa640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60380b57e0 0x7f60380d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f606c967e00 1 -- 10.20.193.28:0/2423259023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 msgr2=0x56242b9679f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f606c967e00 1 --2- 10.20.193.28:0/2423259023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b9679f0 secure :-1 s=READY pgs=1036 gs=1 cs=0 l=1 c_cookie=9912976306466793588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6050004170 tx=0x7f6050004640 comp rx=0 tx=0).stop 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.566+0000 7f60617fa640 1 -- 10.20.193.28:0/3139589067 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f60540e6640 con 0x7f606410ffe0 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f6068ee3640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60380b57e0 0x7f60380d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f606c967e00 1 -- 10.20.193.28:0/2423259023 shutdown_connections 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f606c967e00 1 --2- 10.20.193.28:0/2423259023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b9679f0 unknown :-1 s=CLOSED pgs=1036 gs=1 cs=0 l=1 c_cookie=9912976306466793588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f606c967e00 1 --2- 10.20.193.28:0/2423259023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b988310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f606c967e00 1 --2- 10.20.193.28:0/2423259023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 0x56242b922b40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f606c967e00 1 -- 10.20.193.28:0/2423259023 >> 10.20.193.28:0/2423259023 conn(0x56242b8ef860 msgr2=0x56242b90fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f606c967e00 1 -- 10.20.193.28:0/2423259023 shutdown_connections 2026-02-20T13:26:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f606c967e00 1 -- 10.20.193.28:0/2423259023 wait complete. 2026-02-20T13:26:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.567+0000 7f6068ee3640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60380b57e0 0x7f60380d5c90 secure :-1 s=READY pgs=464 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f605800a980 tx=0x7f605803b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.568+0000 7f606c967e00 1 -- start start 2026-02-20T13:26:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.568+0000 7f606c967e00 1 Processor -- start 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f606c967e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b97fb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f606c967e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b980040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f606c967e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b981dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f606c967e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56242b982340 con 0x56242b922770 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f606c967e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56242b9824b0 con 0x56242b923080 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f606c967e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56242b982670 con 0x56242b967f30 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b97fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b97fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38006/0 (socket says 10.20.193.28:38006) 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 -- 10.20.193.28:0/1174027559 learned_addr learned my addr 10.20.193.28:0/1174027559 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6068ee3640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b981dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f60637fe640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b980040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 -- 10.20.193.28:0/1174027559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 msgr2=0x56242b981dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b981dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 -- 10.20.193.28:0/1174027559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 msgr2=0x56242b980040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b980040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 -- 10.20.193.28:0/1174027559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242b7a13c0 con 0x56242b922770 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6068ee3640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b981dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:26:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f60637fe640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b980040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6063fff640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b97fb00 secure :-1 s=READY pgs=1037 gs=1 cs=0 l=1 c_cookie=1983910158640811024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60500106e0 tx=0x7f6050010a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8843c730130c10 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6025ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.569+0000 7f6025ffb640 1 -- 10.20.193.28:0/1174027559 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f605001e030 con 0x56242b922770 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6050009d40 con 0x56242b922770 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f606c967e00 10 client.18621 _ll_register_callbacks cb 0x56242b79ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56242b4b36f0 con 0x56242b922770 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f6025ffb640 1 -- 10.20.193.28:0/1174027559 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f605001f040 con 0x56242b922770 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f6025ffb640 1 -- 10.20.193.28:0/1174027559 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6050004b30 con 0x56242b922770 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f6025ffb640 1 -- 10.20.193.28:0/1174027559 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6050002e40 con 0x56242b922770 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f6025ffb640 1 -- 10.20.193.28:0/1174027559 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6050010540 con 0x56242b922770 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f606c967e00 10 client.18621 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56242b7b30e0 con 0x56242b922770 2026-02-20T13:26:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f6025ffb640 1 -- 10.20.193.28:0/1174027559 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f605001aca0 con 0x56242b922770 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.570+0000 7f606c967e00 10 client.18621 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.571+0000 7f606c967e00 10 client.18621 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.571+0000 7f606c967e00 20 client.18621 populate_metadata read hostname 'trial028' 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.571+0000 7f606c967e00 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56242b987f40 0x56242b965cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.571+0000 7f606c967e00 4 client.18621 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.571+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56242b7bff80 con 0x56242b987f40 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.571+0000 7f60637fe640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56242b987f40 0x56242b965cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.571+0000 7f60637fe640 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56242b987f40 0x56242b965cb0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=2139860930724566889 s_cookie=10868332178740845366 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1db2502dd4931769 server_cookie=96d412889ecb9b36 in_seq=0 out_seq=0 2026-02-20T13:26:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.571+0000 7f6025ffb640 10 client.18621 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:26:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f6025ffb640 1 -- 10.20.193.28:0/1174027559 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56242b7bff80 con 0x56242b987f40 2026-02-20T13:26:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f6025ffb640 10 client.18621 handle_command_reply: tid=0 2026-02-20T13:26:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 client.18621 shutdown 2026-02-20T13:26:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 msgr2=0x56242b97fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b97fb00 secure :-1 s=READY pgs=1037 gs=1 cs=0 l=1 c_cookie=1983910158640811024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60500106e0 tx=0x7f6050010a50 comp rx=0 tx=0).stop 2026-02-20T13:26:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 shutdown_connections 2026-02-20T13:26:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56242b987f40 0x56242b965cb0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=2139860930724566889 s_cookie=10868332178740845366 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b981dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b980040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 --2- 10.20.193.28:0/1174027559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b97fb00 unknown :-1 s=CLOSED pgs=1037 gs=1 cs=0 l=1 c_cookie=1983910158640811024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f6025ffb640 0 client.18621 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:26:08.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 >> 10.20.193.28:0/1174027559 conn(0x56242b8ef860 msgr2=0x56242b90fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 shutdown_connections 2026-02-20T13:26:08.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 1 -- 10.20.193.28:0/1174027559 wait complete. 2026-02-20T13:26:08.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.572+0000 7f606c967e00 20 client.18621 trim_cache size 0 max 16384 2026-02-20T13:26:08.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.579+0000 7f606c967e00 1 Processor -- start 2026-02-20T13:26:08.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.579+0000 7f606c967e00 1 -- start start 2026-02-20T13:26:08.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.579+0000 7f606c967e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b981d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.579+0000 7f606c967e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b985600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.579+0000 7f606c967e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b985b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.579+0000 7f606c967e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56242b81b080 con 0x56242b922770 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.579+0000 7f606c967e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56242b4db700 con 0x56242b923080 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.579+0000 7f606c967e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56242b980620 con 0x56242b967f30 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b981d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b981d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38008/0 (socket says 10.20.193.28:38008) 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 -- 10.20.193.28:0/600780761 learned_addr learned my addr 10.20.193.28:0/600780761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6068ee3640 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b985b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f60637fe640 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b985600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 -- 10.20.193.28:0/600780761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 msgr2=0x56242b985b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b985b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 -- 10.20.193.28:0/600780761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 msgr2=0x56242b985600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b985600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 -- 10.20.193.28:0/600780761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242b7adb60 con 0x56242b922770 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6063fff640 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b981d60 secure :-1 s=READY pgs=1038 gs=1 cs=0 l=1 c_cookie=4624662350045527001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6050004170 tx=0x7f6050029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402e19e7a4963bd9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6027fff640 1 -- 10.20.193.28:0/600780761 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f605001e070 con 0x56242b922770 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6027fff640 1 -- 10.20.193.28:0/600780761 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f605001f040 con 0x56242b922770 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f6027fff640 1 -- 10.20.193.28:0/600780761 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f605000ed00 con 0x56242b922770 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f606c967e00 1 -- 10.20.193.28:0/600780761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 msgr2=0x56242b981d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.580+0000 7f606c967e00 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b981d60 secure :-1 s=READY pgs=1038 gs=1 cs=0 l=1 c_cookie=4624662350045527001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6050004170 tx=0x7f6050029000 comp rx=0 tx=0).stop 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 -- 10.20.193.28:0/600780761 shutdown_connections 2026-02-20T13:26:08.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b985b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b923080 0x56242b985600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 --2- 10.20.193.28:0/600780761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b922770 0x56242b981d60 unknown :-1 s=CLOSED pgs=1038 gs=1 cs=0 l=1 c_cookie=4624662350045527001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 -- 10.20.193.28:0/600780761 >> 10.20.193.28:0/600780761 conn(0x56242b8ef860 msgr2=0x56242b984ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 -- 10.20.193.28:0/600780761 shutdown_connections 2026-02-20T13:26:08.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 -- 10.20.193.28:0/600780761 wait complete. 2026-02-20T13:26:08.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 -- start start 2026-02-20T13:26:08.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.581+0000 7f606c967e00 1 Processor -- start 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f606c967e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 0x56242b8f5330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f606c967e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b8f5870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f606c967e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b9625f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f606c967e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56242b81b080 con 0x56242b923080 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f606c967e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56242b962b30 con 0x56242b922770 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f606c967e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56242b962cf0 con 0x56242b967f30 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b8f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b8f5870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38014/0 (socket says 10.20.193.28:38014) 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f6068ee3640 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b9625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 -- 10.20.193.28:0/4188345428 learned_addr learned my addr 10.20.193.28:0/4188345428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f6063fff640 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 0x56242b8f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 -- 10.20.193.28:0/4188345428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 msgr2=0x56242b9625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b9625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 -- 10.20.193.28:0/4188345428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 msgr2=0x56242b8f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 0x56242b8f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 -- 10.20.193.28:0/4188345428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242b7a16f0 con 0x56242b923080 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f60637fe640 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b8f5870 secure :-1 s=READY pgs=1039 gs=1 cs=0 l=1 c_cookie=5273106006757333064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6054005970 tx=0x7f6054002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492dd5f99bbfd848 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.582+0000 7f6025ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f6025ffb640 1 -- 10.20.193.28:0/4188345428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60540ac1a0 con 0x56242b923080 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f6025ffb640 1 -- 10.20.193.28:0/4188345428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f60540ad3a0 con 0x56242b923080 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56242b7b30e0 con 0x56242b923080 2026-02-20T13:26:08.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f6025ffb640 1 -- 10.20.193.28:0/4188345428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60540a8c10 con 0x56242b923080 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 10 client.18627 _ll_register_callbacks cb 0x56242b79ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f605001a920 con 0x56242b923080 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f6025ffb640 1 -- 10.20.193.28:0/4188345428 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f60540a8d90 con 0x56242b923080 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f6025ffb640 1 -- 10.20.193.28:0/4188345428 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f60540ac540 con 0x56242b923080 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 10 client.18627 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56242b7b3340 con 0x56242b923080 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f6025ffb640 1 -- 10.20.193.28:0/4188345428 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f60540ad630 con 0x56242b923080 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 10 client.18627 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 10 client.18627 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 20 client.18627 populate_metadata read hostname 'trial028' 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56242ba15790 0x56242ba35c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:08.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 4 client.18627 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.583+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56242b4b0f40 con 0x56242ba15790 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.584+0000 7f6063fff640 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56242ba15790 0x56242ba35c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.584+0000 7f6025ffb640 10 client.18627 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.584+0000 7f6063fff640 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56242ba15790 0x56242ba35c10 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=15680296868292935056 s_cookie=9963446099753631077 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d99b9aec87453d90 server_cookie=8a4545706a90fd65 in_seq=0 out_seq=0 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.584+0000 7f6025ffb640 1 -- 10.20.193.28:0/4188345428 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56242b4b0f40 con 0x56242ba15790 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.584+0000 7f6025ffb640 10 client.18627 handle_command_reply: tid=0 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.584+0000 7f606c967e00 1 client.18627 shutdown 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.584+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 msgr2=0x56242b8f5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.584+0000 7f606c967e00 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b8f5870 secure :-1 s=READY pgs=1039 gs=1 cs=0 l=1 c_cookie=5273106006757333064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6054005970 tx=0x7f6054002f90 comp rx=0 tx=0).stop 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 shutdown_connections 2026-02-20T13:26:08.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x56242ba15790 0x56242ba35c10 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=15680296868292935056 s_cookie=9963446099753631077 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56242b923080 0x56242b8f5870 unknown :-1 s=CLOSED pgs=1039 gs=1 cs=0 l=1 c_cookie=5273106006757333064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56242b967f30 0x56242b9625f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 1 --2- 10.20.193.28:0/4188345428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56242b922770 0x56242b8f5330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f6025ffb640 0 client.18627 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 >> 10.20.193.28:0/4188345428 conn(0x56242b8ef860 msgr2=0x56242b9856e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 shutdown_connections 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 1 -- 10.20.193.28:0/4188345428 wait complete. 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606c967e00 20 client.18627 trim_cache size 0 max 16384 2026-02-20T13:26:08.593 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:08.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 -- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60380b57e0 msgr2=0x7f60380d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60380b57e0 0x7f60380d5c90 secure :-1 s=READY pgs=464 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f605800a980 tx=0x7f605803b040 comp rx=0 tx=0).stop 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 -- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f606410ffe0 msgr2=0x7f606411da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f606410ffe0 0x7f606411da50 secure :-1 s=READY pgs=1035 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f605400d950 tx=0x7f605400de20 comp rx=0 tx=0).stop 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 -- 10.20.193.28:0/3139589067 shutdown_connections 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60380b57e0 0x7f60380d5c90 unknown :-1 s=CLOSED pgs=464 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f606410ffe0 0x7f606411da50 unknown :-1 s=CLOSED pgs=1035 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f60641157e0 0x7f6064122e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 --2- 10.20.193.28:0/3139589067 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f606410f5f0 0x7f606411d510 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 -- 10.20.193.28:0/3139589067 >> 10.20.193.28:0/3139589067 conn(0x7f60640ecea0 msgr2=0x7f606410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 -- 10.20.193.28:0/3139589067 shutdown_connections 2026-02-20T13:26:08.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:08.585+0000 7f606a96d640 1 -- 10.20.193.28:0/3139589067 wait complete. 2026-02-20T13:26:08.687 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:26:08.736 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:08 trial028 ceph-mon[37442]: pgmap v445: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2026-02-20T13:26:08.870 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:08 trial127 ceph-mon[43817]: pgmap v445: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2026-02-20T13:26:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:08 trial034 ceph-mon[43332]: pgmap v445: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2026-02-20T13:26:09.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.039+0000 7fde5ee0b640 1 -- 10.20.193.28:0/3986450681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde581156a0 msgr2=0x7fde58176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.039+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/3986450681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde581156a0 0x7fde58176070 secure :-1 s=READY pgs=1040 gs=1 cs=0 l=1 c_cookie=16924334932157645809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde5400aa30 tx=0x7fde54030270 comp rx=0 tx=0).stop 2026-02-20T13:26:09.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.039+0000 7fde5ee0b640 1 -- 10.20.193.28:0/3986450681 shutdown_connections 2026-02-20T13:26:09.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.039+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/3986450681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde581156a0 0x7fde58176070 unknown :-1 s=CLOSED pgs=1040 gs=1 cs=0 l=1 c_cookie=16924334932157645809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.039+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/3986450681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde5810fea0 0x7fde58114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.039+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/3986450681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fde5810f4b0 0x7fde5810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.039+0000 7fde5ee0b640 1 -- 10.20.193.28:0/3986450681 >> 10.20.193.28:0/3986450681 conn(0x7fde580ecda0 msgr2=0x7fde5810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:09.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.040+0000 7fde5ee0b640 1 -- 10.20.193.28:0/3986450681 shutdown_connections 2026-02-20T13:26:09.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.040+0000 7fde5ee0b640 1 -- 10.20.193.28:0/3986450681 wait complete. 2026-02-20T13:26:09.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.040+0000 7fde5ee0b640 1 Processor -- start 2026-02-20T13:26:09.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.040+0000 7fde5ee0b640 1 -- start start 2026-02-20T13:26:09.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5ee0b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde5810f4b0 0x7fde580f5740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5ee0b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde5810fea0 0x7fde58175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5ee0b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fde581156a0 0x7fde580f5e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5ee0b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fde580fb050 con 0x7fde5810fea0 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5ee0b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fde580fb1c0 con 0x7fde581156a0 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5ee0b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fde580fb380 con 0x7fde5810f4b0 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5de09640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde5810f4b0 0x7fde580f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5d608640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde5810fea0 0x7fde58175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5de09640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde5810f4b0 0x7fde580f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40990/0 (socket says 10.20.193.28:40990) 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5de09640 1 -- 10.20.193.28:0/449239275 learned_addr learned my addr 10.20.193.28:0/449239275 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5d608640 1 -- 10.20.193.28:0/449239275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde5810f4b0 msgr2=0x7fde580f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5d608640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde5810f4b0 0x7fde580f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5d608640 1 -- 10.20.193.28:0/449239275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fde581156a0 msgr2=0x7fde580f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5d608640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fde581156a0 0x7fde580f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5d608640 1 -- 10.20.193.28:0/449239275 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5400a650 con 0x7fde5810fea0 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5de09640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde5810f4b0 0x7fde580f5740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.041+0000 7fde5d608640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde5810fea0 0x7fde58175f70 secure :-1 s=READY pgs=1041 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde4c00e7b0 tx=0x7fde4c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.042+0000 7fde46ffd640 1 -- 10.20.193.28:0/449239275 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde4c00cce0 con 0x7fde5810fea0 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.042+0000 7fde46ffd640 1 -- 10.20.193.28:0/449239275 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde4c00ce40 con 0x7fde5810fea0 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.042+0000 7fde46ffd640 1 -- 10.20.193.28:0/449239275 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde4c0052a0 con 0x7fde5810fea0 2026-02-20T13:26:09.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.042+0000 7fde5ee0b640 1 -- 10.20.193.28:0/449239275 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde580fb660 con 0x7fde5810fea0 2026-02-20T13:26:09.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.042+0000 7fde5ee0b640 1 -- 10.20.193.28:0/449239275 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde580fbab0 con 0x7fde5810fea0 2026-02-20T13:26:09.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.045+0000 7fde46ffd640 1 -- 10.20.193.28:0/449239275 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fde4c004770 con 0x7fde5810fea0 2026-02-20T13:26:09.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.046+0000 7fde46ffd640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fde340b56d0 0x7fde340d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.046+0000 7fde46ffd640 1 -- 10.20.193.28:0/449239275 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fde4c014070 con 0x7fde5810fea0 2026-02-20T13:26:09.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.046+0000 7fde5de09640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fde340b56d0 0x7fde340d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.047+0000 7fde5de09640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fde340b56d0 0x7fde340d5b80 secure :-1 s=READY pgs=465 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde480095d0 tx=0x7fde48005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:09.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.047+0000 7fde6208ee00 1 Processor -- start 2026-02-20T13:26:09.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.047+0000 7fde6208ee00 1 -- start start 2026-02-20T13:26:09.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3360 0x55c3123e3730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3c70 0x55c3124285e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312448f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde6208ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c3122f9780 con 0x55c312428b20 2026-02-20T13:26:09.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde6208ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c3122f54b0 con 0x55c3123e3c70 2026-02-20T13:26:09.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde6208ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c3122ef450 con 0x55c3123e3360 2026-02-20T13:26:09.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312448f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312448f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38042/0 (socket says 10.20.193.28:38042) 2026-02-20T13:26:09.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 -- 10.20.193.28:0/3941493553 learned_addr learned my addr 10.20.193.28:0/3941493553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:09.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5de09640 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3360 0x55c3123e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5d608640 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3c70 0x55c3124285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 -- 10.20.193.28:0/3941493553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3360 msgr2=0x55c3123e3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:09.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3360 0x55c3123e3730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 -- 10.20.193.28:0/3941493553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3c70 msgr2=0x55c3124285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:09.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3c70 0x55c3124285e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 -- 10.20.193.28:0/3941493553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31229ad10 con 0x55c312428b20 2026-02-20T13:26:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.048+0000 7fde5e60a640 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312448f00 secure :-1 s=READY pgs=1042 gs=3 cs=0 l=1 c_cookie=4516752157391015118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde5400a980 tx=0x7fde54006d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eaeba2807c54cce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde264e6640 1 -- 10.20.193.28:0/3941493553 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde5403e070 con 0x55c312428b20 2026-02-20T13:26:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde264e6640 1 -- 10.20.193.28:0/3941493553 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde54030ad0 con 0x55c312428b20 2026-02-20T13:26:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde264e6640 1 -- 10.20.193.28:0/3941493553 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde54005040 con 0x55c312428b20 2026-02-20T13:26:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 -- 10.20.193.28:0/3941493553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 msgr2=0x55c312448f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312448f00 secure :-1 s=READY pgs=1042 gs=3 cs=0 l=1 c_cookie=4516752157391015118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde5400a980 tx=0x7fde54006d50 comp rx=0 tx=0).stop 2026-02-20T13:26:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 -- 10.20.193.28:0/3941493553 shutdown_connections 2026-02-20T13:26:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312448f00 unknown :-1 s=CLOSED pgs=1042 gs=3 cs=0 l=1 c_cookie=4516752157391015118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3c70 0x55c3124285e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3941493553 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3360 0x55c3123e3730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 -- 10.20.193.28:0/3941493553 >> 10.20.193.28:0/3941493553 conn(0x55c3123c1860 msgr2=0x55c3123e1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 -- 10.20.193.28:0/3941493553 shutdown_connections 2026-02-20T13:26:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.049+0000 7fde6208ee00 1 -- 10.20.193.28:0/3941493553 wait complete. 2026-02-20T13:26:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.050+0000 7fde6208ee00 1 -- start start 2026-02-20T13:26:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.050+0000 7fde6208ee00 1 Processor -- start 2026-02-20T13:26:09.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c312440770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3123e3c70 0x55c312440cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c312428b20 0x55c312442a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde6208ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c312442fb0 con 0x55c3123e3c70 2026-02-20T13:26:09.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde6208ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c312443120 con 0x55c3123e3360 2026-02-20T13:26:09.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde6208ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c3124432e0 con 0x55c312428b20 2026-02-20T13:26:09.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5d608640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3123e3c70 0x55c312440cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5d608640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3123e3c70 0x55c312440cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38046/0 (socket says 10.20.193.28:38046) 2026-02-20T13:26:09.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5d608640 1 -- 10.20.193.28:0/3816927372 learned_addr learned my addr 10.20.193.28:0/3816927372 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:09.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5e60a640 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c312428b20 0x55c312442a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5de09640 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c312440770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5d608640 1 -- 10.20.193.28:0/3816927372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c312428b20 msgr2=0x55c312442a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:09.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5d608640 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c312428b20 0x55c312442a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5d608640 1 -- 10.20.193.28:0/3816927372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 msgr2=0x55c312440770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:09.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5d608640 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c312440770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.051+0000 7fde5d608640 1 -- 10.20.193.28:0/3816927372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3122733c0 con 0x55c3123e3c70 2026-02-20T13:26:09.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde5d608640 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3123e3c70 0x55c312440cb0 secure :-1 s=READY pgs=1043 gs=1 cs=0 l=1 c_cookie=16697294037371079663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde4c0a9450 tx=0x7fde4c0acd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b8b475ffc04bef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:09.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde137fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:09.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde137fe640 1 -- 10.20.193.28:0/3816927372 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde4c0b3160 con 0x55c3123e3c70 2026-02-20T13:26:09.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde137fe640 1 -- 10.20.193.28:0/3816927372 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde4c0b5740 con 0x55c3123e3c70 2026-02-20T13:26:09.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde581768e0 con 0x55c3123e3c70 2026-02-20T13:26:09.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 10 client.18639 _ll_register_callbacks cb 0x55c312270a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:09.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde137fe640 1 -- 10.20.193.28:0/3816927372 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde4c0b8350 con 0x55c3123e3c70 2026-02-20T13:26:09.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c311f856f0 con 0x55c3123e3c70 2026-02-20T13:26:09.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde137fe640 1 -- 10.20.193.28:0/3816927372 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fde4c072540 con 0x55c3123e3c70 2026-02-20T13:26:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde137fe640 1 -- 10.20.193.28:0/3816927372 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fde4c072760 con 0x55c3123e3c70 2026-02-20T13:26:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 10 client.18639 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c3122850e0 con 0x55c3123e3c70 2026-02-20T13:26:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde137fe640 1 -- 10.20.193.28:0/3816927372 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fde4c0ae0d0 con 0x55c3123e3c70 2026-02-20T13:26:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 10 client.18639 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 10 client.18639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 20 client.18639 populate_metadata read hostname 'trial028' 2026-02-20T13:26:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c312448d60 0x55c3124268a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 4 client.18639 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:09.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.052+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c312291f80 con 0x55c312448d60 2026-02-20T13:26:09.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.053+0000 7fde5de09640 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c312448d60 0x55c3124268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.053+0000 7fde5de09640 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c312448d60 0x55c3124268a0 crc :-1 s=READY pgs=262 gs=4 cs=0 l=0 c_cookie=11941674644363076157 s_cookie=9210509662348393635 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5b959d1c08ce23d server_cookie=7fd24dbd10943ca3 in_seq=0 out_seq=0 2026-02-20T13:26:09.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.053+0000 7fde137fe640 10 client.18639 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:09.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde137fe640 1 -- 10.20.193.28:0/3816927372 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c312291f80 con 0x55c312448d60 2026-02-20T13:26:09.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde137fe640 10 client.18639 handle_command_reply: tid=0 2026-02-20T13:26:09.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 client.18639 shutdown 2026-02-20T13:26:09.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3123e3c70 msgr2=0x55c312440cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3123e3c70 0x55c312440cb0 secure :-1 s=READY pgs=1043 gs=1 cs=0 l=1 c_cookie=16697294037371079663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde4c0a9450 tx=0x7fde4c0acd60 comp rx=0 tx=0).stop 2026-02-20T13:26:09.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 shutdown_connections 2026-02-20T13:26:09.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c312448d60 0x55c3124268a0 crc :-1 s=READY pgs=262 gs=4 cs=0 l=0 c_cookie=11941674644363076157 s_cookie=9210509662348393635 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3123e3c70 0x55c312440cb0 unknown :-1 s=CLOSED pgs=1043 gs=1 cs=0 l=1 c_cookie=16697294037371079663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c312428b20 0x55c312442a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3816927372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c312440770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 >> 10.20.193.28:0/3816927372 conn(0x55c3123c1860 msgr2=0x55c3123e1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:09.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde137fe640 0 client.18639 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:09.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.054+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 shutdown_connections 2026-02-20T13:26:09.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.055+0000 7fde6208ee00 1 -- 10.20.193.28:0/3816927372 wait complete. 2026-02-20T13:26:09.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.055+0000 7fde6208ee00 20 client.18639 trim_cache size 0 max 16384 2026-02-20T13:26:09.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.062+0000 7fde6208ee00 1 Processor -- start 2026-02-20T13:26:09.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.062+0000 7fde6208ee00 1 -- start start 2026-02-20T13:26:09.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c3124429d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 0x55c312427fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312428500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde6208ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c3122ed080 con 0x55c312428b20 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde6208ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c311fad700 con 0x55c3123e3360 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde6208ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c312351ae0 con 0x55c3123e3c70 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5e60a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312428500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5d608640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 0x55c312427fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5de09640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c3124429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5de09640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c3124429d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35724/0 (socket says 10.20.193.28:35724) 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5de09640 1 -- 10.20.193.28:0/3490554915 learned_addr learned my addr 10.20.193.28:0/3490554915 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5e60a640 1 -- 10.20.193.28:0/3490554915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 msgr2=0x55c312427fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5e60a640 1 --2- 10.20.193.28:0/3490554915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 0x55c312427fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5e60a640 1 -- 10.20.193.28:0/3490554915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 msgr2=0x55c3124429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5e60a640 1 --2- 10.20.193.28:0/3490554915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c3124429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5e60a640 1 -- 10.20.193.28:0/3490554915 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31227fb60 con 0x55c312428b20 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.063+0000 7fde5de09640 1 --2- 10.20.193.28:0/3490554915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c3124429d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde5e60a640 1 --2- 10.20.193.28:0/3490554915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312428500 secure :-1 s=READY pgs=1044 gs=3 cs=0 l=1 c_cookie=4015904063617471783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde54006c10 tx=0x7fde54039a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bb5b77fbf79527 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde25ce5640 1 -- 10.20.193.28:0/3490554915 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde5403e040 con 0x55c312428b20 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde25ce5640 1 -- 10.20.193.28:0/3490554915 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde54039690 con 0x55c312428b20 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde25ce5640 1 -- 10.20.193.28:0/3490554915 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde54005330 con 0x55c312428b20 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 -- 10.20.193.28:0/3490554915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 msgr2=0x55c312428500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3490554915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312428500 secure :-1 s=READY pgs=1044 gs=3 cs=0 l=1 c_cookie=4015904063617471783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde54006c10 tx=0x7fde54039a30 comp rx=0 tx=0).stop 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 -- 10.20.193.28:0/3490554915 shutdown_connections 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3490554915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312428500 unknown :-1 s=CLOSED pgs=1044 gs=3 cs=0 l=1 c_cookie=4015904063617471783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3490554915 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 0x55c312427fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 --2- 10.20.193.28:0/3490554915 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c3124429d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 -- 10.20.193.28:0/3490554915 >> 10.20.193.28:0/3490554915 conn(0x55c3123c1860 msgr2=0x55c31242af00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 -- 10.20.193.28:0/3490554915 shutdown_connections 2026-02-20T13:26:09.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.064+0000 7fde6208ee00 1 -- 10.20.193.28:0/3490554915 wait complete. 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde6208ee00 1 -- start start 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde6208ee00 1 Processor -- start 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c312445270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 0x55c312423430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde6208ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312423970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde6208ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c312423f50 con 0x55c312428b20 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde6208ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c3124240c0 con 0x55c3123e3360 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde6208ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c312424280 con 0x55c3123e3c70 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.065+0000 7fde5e60a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312423970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5e60a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312423970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38076/0 (socket says 10.20.193.28:38076) 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5e60a640 1 -- 10.20.193.28:0/2454980214 learned_addr learned my addr 10.20.193.28:0/2454980214 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5d608640 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 0x55c312423430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5de09640 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c312445270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5e60a640 1 -- 10.20.193.28:0/2454980214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 msgr2=0x55c312423430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5e60a640 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 0x55c312423430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5e60a640 1 -- 10.20.193.28:0/2454980214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 msgr2=0x55c312445270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5e60a640 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c312445270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5e60a640 1 -- 10.20.193.28:0/2454980214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31229ad10 con 0x55c312428b20 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde5e60a640 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312423970 secure :-1 s=READY pgs=1045 gs=1 cs=0 l=1 c_cookie=4696865238763134610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde5400a3d0 tx=0x7fde54003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412e9e0cb25b5e92 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde137fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde137fe640 1 -- 10.20.193.28:0/2454980214 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde540039a0 con 0x55c312428b20 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde137fe640 1 -- 10.20.193.28:0/2454980214 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde54030c40 con 0x55c312428b20 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde48003d70 con 0x55c312428b20 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde137fe640 1 -- 10.20.193.28:0/2454980214 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde54042dd0 con 0x55c312428b20 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.066+0000 7fde6208ee00 10 client.18645 _ll_register_callbacks cb 0x55c312270a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde54030ad0 con 0x55c312428b20 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde137fe640 1 -- 10.20.193.28:0/2454980214 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fde5405d3f0 con 0x55c312428b20 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde137fe640 1 -- 10.20.193.28:0/2454980214 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fde5405d5d0 con 0x55c312428b20 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 10 client.18645 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:09.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c3122736f0 con 0x55c312428b20 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde137fe640 1 -- 10.20.193.28:0/2454980214 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fde54049070 con 0x55c312428b20 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 10 client.18645 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 10 client.18645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 20 client.18645 populate_metadata read hostname 'trial028' 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c3123c62a0 0x55c3123c6710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 4 client.18645 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.067+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c311f82f40 con 0x55c3123c62a0 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.068+0000 7fde5de09640 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c3123c62a0 0x55c3123c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.068+0000 7fde5de09640 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c3123c62a0 0x55c3123c6710 crc :-1 s=READY pgs=263 gs=4 cs=0 l=0 c_cookie=16760261868827545993 s_cookie=1897718956634110764 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e898695eb9fd9189 server_cookie=1a560d5625b37b2c in_seq=0 out_seq=0 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.068+0000 7fde137fe640 10 client.18645 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.068+0000 7fde137fe640 1 -- 10.20.193.28:0/2454980214 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c311f82f40 con 0x55c3123c62a0 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.068+0000 7fde137fe640 10 client.18645 handle_command_reply: tid=0 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.068+0000 7fde6208ee00 1 client.18645 shutdown 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.068+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 msgr2=0x55c312423970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.068+0000 7fde6208ee00 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312423970 secure :-1 s=READY pgs=1045 gs=1 cs=0 l=1 c_cookie=4696865238763134610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde5400a3d0 tx=0x7fde54003bc0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 shutdown_connections 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c3123c62a0 0x55c3123c6710 crc :-1 s=READY pgs=263 gs=4 cs=0 l=0 c_cookie=16760261868827545993 s_cookie=1897718956634110764 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c312428b20 0x55c312423970 unknown :-1 s=CLOSED pgs=1045 gs=1 cs=0 l=1 c_cookie=4696865238763134610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c3123e3c70 0x55c312423430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 1 --2- 10.20.193.28:0/2454980214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c3123e3360 0x55c312445270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde137fe640 0 client.18645 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 >> 10.20.193.28:0/2454980214 conn(0x55c3123c1860 msgr2=0x55c3123e2050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 shutdown_connections 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 1 -- 10.20.193.28:0/2454980214 wait complete. 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde6208ee00 20 client.18645 trim_cache size 0 max 16384 2026-02-20T13:26:09.084 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:09.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 -- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fde340b56d0 msgr2=0x7fde340d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fde340b56d0 0x7fde340d5b80 secure :-1 s=READY pgs=465 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde480095d0 tx=0x7fde48005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 -- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde5810fea0 msgr2=0x7fde58175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde5810fea0 0x7fde58175f70 secure :-1 s=READY pgs=1041 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde4c00e7b0 tx=0x7fde4c00ec80 comp rx=0 tx=0).stop 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 -- 10.20.193.28:0/449239275 shutdown_connections 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fde340b56d0 0x7fde340d5b80 unknown :-1 s=CLOSED pgs=465 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde5810fea0 0x7fde58175f70 unknown :-1 s=CLOSED pgs=1041 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fde581156a0 0x7fde580f5e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 --2- 10.20.193.28:0/449239275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde5810f4b0 0x7fde580f5740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.069+0000 7fde5ee0b640 1 -- 10.20.193.28:0/449239275 >> 10.20.193.28:0/449239275 conn(0x7fde580ecda0 msgr2=0x7fde5810d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.070+0000 7fde5ee0b640 1 -- 10.20.193.28:0/449239275 shutdown_connections 2026-02-20T13:26:09.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:09.070+0000 7fde5ee0b640 1 -- 10.20.193.28:0/449239275 wait complete. 2026-02-20T13:26:10.200 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:26:10.211 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:26:10.211 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:26:10.387 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:10.432 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:10.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.578+0000 7f7447577640 1 -- 10.20.193.28:0/3225890084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f744810f4b0 msgr2=0x7f744810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.578+0000 7f7447577640 1 --2- 10.20.193.28:0/3225890084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f744810f4b0 0x7f744810f880 secure :-1 s=READY pgs=1046 gs=1 cs=0 l=1 c_cookie=2669637932234722905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f743c009950 tx=0x7f743c02f1d0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.578+0000 7f7447577640 1 -- 10.20.193.28:0/3225890084 shutdown_connections 2026-02-20T13:26:10.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.578+0000 7f7447577640 1 --2- 10.20.193.28:0/3225890084 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f74481156a0 0x7f7448176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.578+0000 7f7447577640 1 --2- 10.20.193.28:0/3225890084 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f744810fea0 0x7f7448114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.578+0000 7f7447577640 1 --2- 10.20.193.28:0/3225890084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f744810f4b0 0x7f744810f880 unknown :-1 s=CLOSED pgs=1046 gs=1 cs=0 l=1 c_cookie=2669637932234722905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.578+0000 7f7447577640 1 -- 10.20.193.28:0/3225890084 >> 10.20.193.28:0/3225890084 conn(0x7f74480ecda0 msgr2=0x7f744810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:10.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.579+0000 7f7447577640 1 -- 10.20.193.28:0/3225890084 shutdown_connections 2026-02-20T13:26:10.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.579+0000 7f7447577640 1 -- 10.20.193.28:0/3225890084 wait complete. 2026-02-20T13:26:10.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.579+0000 7f7447577640 1 Processor -- start 2026-02-20T13:26:10.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7447577640 1 -- start start 2026-02-20T13:26:10.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7447577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f744810f4b0 0x7f7448066f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7447577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f744810fea0 0x7f74480631a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7447577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74481156a0 0x7f7448063850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7447577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7448063fe0 con 0x7f74481156a0 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7447577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f744811db10 con 0x7f744810f4b0 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7447577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f744811dcd0 con 0x7f744810fea0 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7446d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74481156a0 0x7f7448063850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7446575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f744810f4b0 0x7f7448066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7445d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f744810fea0 0x7f74480631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7446d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74481156a0 0x7f7448063850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52106/0 (socket says 10.20.193.28:52106) 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.580+0000 7f7446d76640 1 -- 10.20.193.28:0/2666616828 learned_addr learned my addr 10.20.193.28:0/2666616828 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f7446d76640 1 -- 10.20.193.28:0/2666616828 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f744810fea0 msgr2=0x7f74480631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f7446d76640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f744810fea0 0x7f74480631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f7446d76640 1 -- 10.20.193.28:0/2666616828 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f744810f4b0 msgr2=0x7f7448066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f7446d76640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f744810f4b0 0x7f7448066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f7446d76640 1 -- 10.20.193.28:0/2666616828 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c009570 con 0x7f74481156a0 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f7446575640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f744810f4b0 0x7f7448066f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f7446d76640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74481156a0 0x7f7448063850 secure :-1 s=READY pgs=1047 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f743800f8d0 tx=0x7f743800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f742f7fe640 1 -- 10.20.193.28:0/2666616828 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f743800dce0 con 0x7f74481156a0 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f742f7fe640 1 -- 10.20.193.28:0/2666616828 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f743800de40 con 0x7f74481156a0 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.581+0000 7f742f7fe640 1 -- 10.20.193.28:0/2666616828 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7438006430 con 0x7f74481156a0 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.582+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744811df50 con 0x7f74481156a0 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.582+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744811e3a0 con 0x7f74481156a0 2026-02-20T13:26:10.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.582+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7448110790 con 0x7f74481156a0 2026-02-20T13:26:10.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.584+0000 7f742f7fe640 1 -- 10.20.193.28:0/2666616828 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7438039020 con 0x7f74481156a0 2026-02-20T13:26:10.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.586+0000 7f742f7fe640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f74200b5760 0x7f74200d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.586+0000 7f742f7fe640 1 -- 10.20.193.28:0/2666616828 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f74380f9770 con 0x7f74481156a0 2026-02-20T13:26:10.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.586+0000 7f742f7fe640 1 -- 10.20.193.28:0/2666616828 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f74380f9bf0 con 0x7f74481156a0 2026-02-20T13:26:10.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.586+0000 7f7446575640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f74200b5760 0x7f74200d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.587+0000 7f7446575640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f74200b5760 0x7f74200d5c10 secure :-1 s=READY pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f743c038820 tx=0x7f743c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:10.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 -- 10.20.193.28:0/1806863350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3d410f4b0 msgr2=0x7fd3d410f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/1806863350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3d410f4b0 0x7fd3d410f880 secure :-1 s=READY pgs=1048 gs=1 cs=0 l=1 c_cookie=7349645505043310389 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c0009950 tx=0x7fd3c002f190 comp rx=0 tx=0).stop 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 -- 10.20.193.28:0/1806863350 shutdown_connections 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/1806863350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3d41156a0 0x7fd3d4176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/1806863350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3d410fea0 0x7fd3d4114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/1806863350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3d410f4b0 0x7fd3d410f880 unknown :-1 s=CLOSED pgs=1048 gs=1 cs=0 l=1 c_cookie=7349645505043310389 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 -- 10.20.193.28:0/1806863350 >> 10.20.193.28:0/1806863350 conn(0x7fd3d40ecd60 msgr2=0x7fd3d410d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 -- 10.20.193.28:0/1806863350 shutdown_connections 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.600+0000 7fd3d8da5640 1 -- 10.20.193.28:0/1806863350 wait complete. 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.601+0000 7fd3d8da5640 1 Processor -- start 2026-02-20T13:26:10.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.601+0000 7fd3d8da5640 1 -- start start 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.601+0000 7fd3d8da5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3d410f4b0 0x7fd3d4066ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.601+0000 7fd3d8da5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3d410fea0 0x7fd3d4063150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.601+0000 7fd3d8da5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3d41156a0 0x7fd3d40637b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.601+0000 7fd3d8da5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4063f40 con 0x7fd3d41156a0 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.601+0000 7fd3d8da5640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d41685d0 con 0x7fd3d410f4b0 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.601+0000 7fd3d8da5640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4168790 con 0x7fd3d410fea0 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3d410fea0 0x7fd3d4063150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3d410fea0 0x7fd3d4063150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34858/0 (socket says 10.20.193.28:34858) 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/3017358974 learned_addr learned my addr 10.20.193.28:0/3017358974 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d3fff640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3d41156a0 0x7fd3d40637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3d410f4b0 0x7fd3d4066ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/3017358974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3d410f4b0 msgr2=0x7fd3d4066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3d410f4b0 0x7fd3d4066ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3d41156a0 msgr2=0x7fd3d40637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3d41156a0 0x7fd3d40637b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/3017358974 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c40094b0 con 0x7fd3d410fea0 2026-02-20T13:26:10.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.602+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3d410fea0 0x7fd3d4063150 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c4009fd0 tx=0x7fd3c4002bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:10.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.603+0000 7fd3d0ff9640 1 -- 10.20.193.28:0/3017358974 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c400ed60 con 0x7fd3d410fea0 2026-02-20T13:26:10.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.603+0000 7fd3d0ff9640 1 -- 10.20.193.28:0/3017358974 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd3c4002e20 con 0x7fd3d410fea0 2026-02-20T13:26:10.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.603+0000 7fd3d0ff9640 1 -- 10.20.193.28:0/3017358974 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c4018950 con 0x7fd3d410fea0 2026-02-20T13:26:10.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.603+0000 7fd3d8da5640 1 -- 10.20.193.28:0/3017358974 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c0009570 con 0x7fd3d410fea0 2026-02-20T13:26:10.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.603+0000 7fd3d8da5640 1 -- 10.20.193.28:0/3017358974 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d4168d60 con 0x7fd3d410fea0 2026-02-20T13:26:10.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.606+0000 7fd3d0ff9640 1 -- 10.20.193.28:0/3017358974 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd3c4016020 con 0x7fd3d410fea0 2026-02-20T13:26:10.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.607+0000 7fd3d0ff9640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3a80b5760 0x7fd3a80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.608+0000 7fd3d0ff9640 1 -- 10.20.193.28:0/3017358974 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd3c40e6d00 con 0x7fd3d410fea0 2026-02-20T13:26:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.608+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3a80b5760 0x7fd3a80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.608+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3a80b5760 0x7fd3a80d5c10 secure :-1 s=READY pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c00023d0 tx=0x7fd3c0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3dc028e00 1 Processor -- start 2026-02-20T13:26:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3dc028e00 1 -- start start 2026-02-20T13:26:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff067547e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06799480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff067b9da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff0666aa20 con 0x55ff06754410 2026-02-20T13:26:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ff06666750 con 0x55ff067999c0 2026-02-20T13:26:10.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ff066606f0 con 0x55ff06754d20 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3d2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06799480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff067547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3d2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06799480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34870/0 (socket says 10.20.193.28:34870) 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/2842781538 learned_addr learned my addr 10.20.193.28:0/2842781538 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.609+0000 7fd3d3fff640 1 --2- 10.20.193.28:0/2842781538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff067b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/2842781538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 msgr2=0x55ff067b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/2842781538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff067b9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/2842781538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 msgr2=0x55ff067547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/2842781538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff067547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/2842781538 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0660c120 con 0x55ff06754d20 2026-02-20T13:26:10.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/2842781538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06799480 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=8530760478475975808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c4010f30 tx=0x7fd3c4002f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=766359750f807c80 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd397fff640 1 -- 10.20.193.28:0/2842781538 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c406bea0 con 0x55ff06754d20 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd397fff640 1 -- 10.20.193.28:0/2842781538 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd3c40ada60 con 0x55ff06754d20 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd397fff640 1 -- 10.20.193.28:0/2842781538 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c40adf70 con 0x55ff06754d20 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2842781538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 msgr2=0x55ff06799480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/2842781538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06799480 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=8530760478475975808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c4010f30 tx=0x7fd3c4002f90 comp rx=0 tx=0).stop 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2842781538 shutdown_connections 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/2842781538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff067b9da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/2842781538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06799480 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=8530760478475975808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/2842781538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff067547e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2842781538 >> 10.20.193.28:0/2842781538 conn(0x55ff06732910 msgr2=0x55ff06752cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.610+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2842781538 shutdown_connections 2026-02-20T13:26:10.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.611+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2842781538 wait complete. 2026-02-20T13:26:10.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.612+0000 7fd3dc028e00 1 -- start start 2026-02-20T13:26:10.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.612+0000 7fd3dc028e00 1 Processor -- start 2026-02-20T13:26:10.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.612+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754410 0x55ff0676cc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.612+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff06754d20 0x55ff0676d140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.612+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff067999c0 0x55ff06772130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.612+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff06772670 con 0x55ff067999c0 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.612+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ff067727e0 con 0x55ff06754d20 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.612+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ff067729a0 con 0x55ff06754410 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff06754d20 0x55ff0676d140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754410 0x55ff0676cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff067999c0 0x55ff06772130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff06754d20 0x55ff0676d140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54692/0 (socket says 10.20.193.28:54692) 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/3091026652 learned_addr learned my addr 10.20.193.28:0/3091026652 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/3091026652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754410 msgr2=0x55ff0676cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:10.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754410 0x55ff0676cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/3091026652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff067999c0 msgr2=0x55ff06772130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff067999c0 0x55ff06772130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/3091026652 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff065e4810 con 0x55ff06754d20 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff06754d20 0x55ff0676d140 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=2055535818564122698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c40a95e0 tx=0x7fd3c40adbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c86baefb09b384a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.613+0000 7fd3957fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3957fa640 1 -- 10.20.193.28:0/3091026652 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c406bea0 con 0x55ff06754d20 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3957fa640 1 -- 10.20.193.28:0/3091026652 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd3c40b2d80 con 0x55ff06754d20 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d4168d60 con 0x55ff06754d20 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3957fa640 1 -- 10.20.193.28:0/3091026652 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c40ab2c0 con 0x55ff06754d20 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3957fa640 1 -- 10.20.193.28:0/3091026652 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd3c4096040 con 0x55ff06754d20 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3957fa640 10 client.28619 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3dc028e00 10 client.28619 _ll_register_callbacks cb 0x55ff06617b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:10.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff062f69d0 con 0x55ff06754d20 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3957fa640 1 -- 10.20.193.28:0/3091026652 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3c40721f0 con 0x55ff06754d20 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3dc028e00 10 client.28619 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.614+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ff065f64f0 con 0x55ff06754d20 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.615+0000 7fd3957fa640 1 -- 10.20.193.28:0/3091026652 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3c40d0d20 con 0x55ff06754d20 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.615+0000 7fd3dc028e00 10 client.28619 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.615+0000 7fd3dc028e00 10 client.28619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.615+0000 7fd3dc028e00 20 client.28619 populate_metadata read hostname 'trial028' 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.615+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ff06796fb0 0x55ff06797450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.615+0000 7fd3dc028e00 4 client.28619 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.615+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff0666ddf0 con 0x55ff06796fb0 2026-02-20T13:26:10.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.615+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ff06796fb0 0x55ff06797450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.616+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ff06796fb0 0x55ff06797450 crc :-1 s=READY pgs=264 gs=4 cs=0 l=0 c_cookie=15524895609362628708 s_cookie=11601016808545363886 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d773824d6314c064 server_cookie=a0ff175292aea7ae in_seq=0 out_seq=0 2026-02-20T13:26:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.616+0000 7fd3957fa640 10 client.28619 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.616+0000 7fd3957fa640 1 -- 10.20.193.28:0/3091026652 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ff0666ddf0 con 0x55ff06796fb0 2026-02-20T13:26:10.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.616+0000 7fd3957fa640 10 client.28619 handle_command_reply: tid=0 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.616+0000 7fd3dc028e00 1 client.28619 shutdown 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff06754d20 msgr2=0x55ff0676d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff06754d20 0x55ff0676d140 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=2055535818564122698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c40a95e0 tx=0x7fd3c40adbd0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 shutdown_connections 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ff06796fb0 0x55ff06797450 crc :-1 s=READY pgs=264 gs=4 cs=0 l=0 c_cookie=15524895609362628708 s_cookie=11601016808545363886 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff067999c0 0x55ff06772130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff06754d20 0x55ff0676d140 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=2055535818564122698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/3091026652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754410 0x55ff0676cc00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 >> 10.20.193.28:0/3091026652 conn(0x55ff06732910 msgr2=0x55ff067534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3957fa640 0 client.28619 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:10.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 shutdown_connections 2026-02-20T13:26:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 1 -- 10.20.193.28:0/3091026652 wait complete. 2026-02-20T13:26:10.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.617+0000 7fd3dc028e00 20 client.28619 trim_cache size 0 max 16384 2026-02-20T13:26:10.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.627+0000 7fd3dc028e00 1 Processor -- start 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3dc028e00 1 -- start start 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06797d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06798270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff067987b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff0675ed60 con 0x55ff06754410 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ff0665e320 con 0x55ff067999c0 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ff0631e790 con 0x55ff06754d20 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06798270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06798270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34900/0 (socket says 10.20.193.28:34900) 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/2214225038 learned_addr learned my addr 10.20.193.28:0/2214225038 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d3fff640 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff067987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/2214225038 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 msgr2=0x55ff067987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06797d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff067987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/2214225038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 msgr2=0x55ff06797d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06797d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d2ffd640 1 -- 10.20.193.28:0/2214225038 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0675ef90 con 0x55ff06754d20 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.628+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06797d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06798270 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=4203222782110006310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c40aa2d0 tx=0x7fd3c40cd000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a54d8d9c77efc26 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3977fe640 1 -- 10.20.193.28:0/2214225038 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c406bea0 con 0x55ff06754d20 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3977fe640 1 -- 10.20.193.28:0/2214225038 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ff062f69d0 con 0x55ff06754d20 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3977fe640 1 -- 10.20.193.28:0/2214225038 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c40b5360 con 0x55ff06754d20 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2214225038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 msgr2=0x55ff06798270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06798270 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=4203222782110006310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c40aa2d0 tx=0x7fd3c40cd000 comp rx=0 tx=0).stop 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2214225038 shutdown_connections 2026-02-20T13:26:10.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff067987b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06798270 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=4203222782110006310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/2214225038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06797d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2214225038 >> 10.20.193.28:0/2214225038 conn(0x55ff06732910 msgr2=0x55ff06769020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2214225038 shutdown_connections 2026-02-20T13:26:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.629+0000 7fd3dc028e00 1 -- 10.20.193.28:0/2214225038 wait complete. 2026-02-20T13:26:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.630+0000 7fd3dc028e00 1 -- start start 2026-02-20T13:26:10.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.630+0000 7fd3dc028e00 1 Processor -- start 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06778f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06776510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3dc028e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff06776ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff0665e320 con 0x55ff06754410 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ff067feef0 con 0x55ff067999c0 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3dc028e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ff067ff0b0 con 0x55ff06754d20 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06778f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06778f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52174/0 (socket says 10.20.193.28:52174) 2026-02-20T13:26:10.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 -- 10.20.193.28:0/4092703763 learned_addr learned my addr 10.20.193.28:0/4092703763 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d3fff640 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff06776ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06776510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 -- 10.20.193.28:0/4092703763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 msgr2=0x55ff06776510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06776510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 -- 10.20.193.28:0/4092703763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 msgr2=0x55ff06776ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff06776ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 -- 10.20.193.28:0/4092703763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff065f0f70 con 0x55ff06754410 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06776510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3d37fe640 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06778f90 secure :-1 s=READY pgs=1049 gs=1 cs=0 l=1 c_cookie=8899943214917578323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c002f6a0 tx=0x7fd3c002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b82f333364f6e53 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.631+0000 7fd3957fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3957fa640 1 -- 10.20.193.28:0/4092703763 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c002fc10 con 0x55ff06754410 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3957fa640 1 -- 10.20.193.28:0/4092703763 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ff0666ddf0 con 0x55ff06754410 2026-02-20T13:26:10.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff065f64f0 con 0x55ff06754410 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3957fa640 1 -- 10.20.193.28:0/4092703763 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3c0057bb0 con 0x55ff06754410 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3dc028e00 10 client.18666 _ll_register_callbacks cb 0x55ff06617b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3c40ada60 con 0x55ff06754410 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3957fa640 1 -- 10.20.193.28:0/4092703763 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd3c002fd70 con 0x55ff06754410 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3957fa640 1 -- 10.20.193.28:0/4092703763 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3c0038920 con 0x55ff06754410 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3dc028e00 10 client.18666 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ff065e4b40 con 0x55ff06754410 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3957fa640 1 -- 10.20.193.28:0/4092703763 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3c0038ac0 con 0x55ff06754410 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3dc028e00 10 client.18666 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3dc028e00 10 client.18666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.632+0000 7fd3dc028e00 20 client.18666 populate_metadata read hostname 'trial028' 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.633+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ff06847030 0x55ff068674e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.633+0000 7fd3dc028e00 4 client.18666 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.633+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ff062f4220 con 0x55ff06847030 2026-02-20T13:26:10.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.633+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ff06847030 0x55ff068674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.633+0000 7fd3d2ffd640 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ff06847030 0x55ff068674e0 crc :-1 s=READY pgs=265 gs=4 cs=0 l=0 c_cookie=9529419269299660302 s_cookie=12998723235914738143 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=843f4c561e5e660e server_cookie=b464bde9b25069df in_seq=0 out_seq=0 2026-02-20T13:26:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.633+0000 7fd3957fa640 10 client.18666 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.634+0000 7fd3957fa640 1 -- 10.20.193.28:0/4092703763 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ff062f4220 con 0x55ff06847030 2026-02-20T13:26:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.634+0000 7fd3957fa640 10 client.18666 handle_command_reply: tid=0 2026-02-20T13:26:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.634+0000 7fd3dc028e00 1 client.18666 shutdown 2026-02-20T13:26:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.634+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 msgr2=0x55ff06778f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.634+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06778f90 secure :-1 s=READY pgs=1049 gs=1 cs=0 l=1 c_cookie=8899943214917578323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c002f6a0 tx=0x7fd3c002f190 comp rx=0 tx=0).stop 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 shutdown_connections 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ff06847030 0x55ff068674e0 crc :-1 s=READY pgs=265 gs=4 cs=0 l=0 c_cookie=9529419269299660302 s_cookie=12998723235914738143 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ff067999c0 0x55ff06776ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ff06754d20 0x55ff06776510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 1 --2- 10.20.193.28:0/4092703763 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff06754410 0x55ff06778f90 unknown :-1 s=CLOSED pgs=1049 gs=1 cs=0 l=1 c_cookie=8899943214917578323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3957fa640 0 client.18666 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 >> 10.20.193.28:0/4092703763 conn(0x55ff06732910 msgr2=0x55ff06769810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 shutdown_connections 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 1 -- 10.20.193.28:0/4092703763 wait complete. 2026-02-20T13:26:10.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3dc028e00 20 client.18666 trim_cache size 0 max 16384 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6", 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.635+0000 7fd3d8da5640 1 -- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3a80b5760 msgr2=0x7fd3a80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3a80b5760 0x7fd3a80d5c10 secure :-1 s=READY pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c00023d0 tx=0x7fd3c0031040 comp rx=0 tx=0).stop 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 -- 10.20.193.28:0/3017358974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3d410fea0 msgr2=0x7fd3d4063150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3d410fea0 0x7fd3d4063150 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3c4009fd0 tx=0x7fd3c4002bc0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 -- 10.20.193.28:0/3017358974 shutdown_connections 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd3a80b5760 0x7fd3a80d5c10 unknown :-1 s=CLOSED pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3d41156a0 0x7fd3d40637b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd3d410fea0 0x7fd3d4063150 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 --2- 10.20.193.28:0/3017358974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd3d410f4b0 0x7fd3d4066ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 -- 10.20.193.28:0/3017358974 >> 10.20.193.28:0/3017358974 conn(0x7fd3d40ecd60 msgr2=0x7fd3d410d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:10.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 -- 10.20.193.28:0/3017358974 shutdown_connections 2026-02-20T13:26:10.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.636+0000 7fd3d8da5640 1 -- 10.20.193.28:0/3017358974 wait complete. 2026-02-20T13:26:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.728+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74480644a0 con 0x7f74481156a0 2026-02-20T13:26:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.728+0000 7f742f7fe640 1 -- 10.20.193.28:0/2666616828 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f74380bc120 con 0x7f74481156a0 2026-02-20T13:26:10.731 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:26:10.732 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:26:10.732 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:26:10.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f74200b5760 msgr2=0x7f74200d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f74200b5760 0x7f74200d5c10 secure :-1 s=READY pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f743c038820 tx=0x7f743c03a040 comp rx=0 tx=0).stop 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74481156a0 msgr2=0x7f7448063850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74481156a0 0x7f7448063850 secure :-1 s=READY pgs=1047 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f743800f8d0 tx=0x7f743800fda0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 shutdown_connections 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f74200b5760 0x7f74200d5c10 unknown :-1 s=CLOSED pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74481156a0 0x7f7448063850 unknown :-1 s=CLOSED pgs=1047 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f744810fea0 0x7f74480631a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 --2- 10.20.193.28:0/2666616828 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f744810f4b0 0x7f7448066f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 >> 10.20.193.28:0/2666616828 conn(0x7f74480ecda0 msgr2=0x7f744810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 shutdown_connections 2026-02-20T13:26:10.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:10.731+0000 7f7447577640 1 -- 10.20.193.28:0/2666616828 wait complete. 2026-02-20T13:26:10.739 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:26:10.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:10 trial028 ceph-mon[37442]: pgmap v446: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:26:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id 6808ef13 --release --await' 2026-02-20T13:26:10.833 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id 6808ef13 --release --await 2026-02-20T13:26:10.926 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:10 trial127 ceph-mon[43817]: pgmap v446: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:26:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:10 trial034 ceph-mon[43332]: pgmap v446: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:26:11.057 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 -- 10.20.193.28:0/300286580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 msgr2=0x7fbf48176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/300286580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 0x7fbf48176070 secure :-1 s=READY pgs=1050 gs=3 cs=0 l=1 c_cookie=11969455663714982695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf3c00aa30 tx=0x7fbf3c030270 comp rx=0 tx=0).stop 2026-02-20T13:26:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 -- 10.20.193.28:0/300286580 shutdown_connections 2026-02-20T13:26:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/300286580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 0x7fbf48176070 unknown :-1 s=CLOSED pgs=1050 gs=3 cs=0 l=1 c_cookie=11969455663714982695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/300286580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf4810fea0 0x7fbf48114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/300286580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf4810f4b0 0x7fbf4810f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 -- 10.20.193.28:0/300286580 >> 10.20.193.28:0/300286580 conn(0x7fbf480ecd60 msgr2=0x7fbf4810d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 -- 10.20.193.28:0/300286580 shutdown_connections 2026-02-20T13:26:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 -- 10.20.193.28:0/300286580 wait complete. 2026-02-20T13:26:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.113+0000 7fbf4cb01640 1 Processor -- start 2026-02-20T13:26:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf4cb01640 1 -- start start 2026-02-20T13:26:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf4cb01640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf4810f4b0 0x7fbf48066f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf4cb01640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf4810fea0 0x7fbf48175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf4cb01640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 0x7fbf48063200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf4cb01640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf48063900 con 0x7fbf481156a0 2026-02-20T13:26:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf4cb01640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbf48063a70 con 0x7fbf4810f4b0 2026-02-20T13:26:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf4cb01640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbf48063c30 con 0x7fbf4810fea0 2026-02-20T13:26:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf4810fea0 0x7fbf48175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf4810fea0 0x7fbf48175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34922/0 (socket says 10.20.193.28:34922) 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf46ffd640 1 -- 10.20.193.28:0/2576565966 learned_addr learned my addr 10.20.193.28:0/2576565966 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf47fff640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 0x7fbf48063200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf46ffd640 1 -- 10.20.193.28:0/2576565966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf4810f4b0 msgr2=0x7fbf48066f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf4810f4b0 0x7fbf48066f30 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf46ffd640 1 -- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 msgr2=0x7fbf48063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 0x7fbf48063200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf46ffd640 1 -- 10.20.193.28:0/2576565966 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c00a650 con 0x7fbf4810fea0 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.114+0000 7fbf47fff640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 0x7fbf48063200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.115+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf4810fea0 0x7fbf48175f70 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf3800b500 tx=0x7fbf3800b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.115+0000 7fbf44ff9640 1 -- 10.20.193.28:0/2576565966 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf380044a0 con 0x7fbf4810fea0 2026-02-20T13:26:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.115+0000 7fbf44ff9640 1 -- 10.20.193.28:0/2576565966 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf38002b80 con 0x7fbf4810fea0 2026-02-20T13:26:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.115+0000 7fbf4cb01640 1 -- 10.20.193.28:0/2576565966 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf48063f10 con 0x7fbf4810fea0 2026-02-20T13:26:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.115+0000 7fbf44ff9640 1 -- 10.20.193.28:0/2576565966 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf38010de0 con 0x7fbf4810fea0 2026-02-20T13:26:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.115+0000 7fbf4cb01640 1 -- 10.20.193.28:0/2576565966 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf48100140 con 0x7fbf4810fea0 2026-02-20T13:26:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.118+0000 7fbf44ff9640 1 -- 10.20.193.28:0/2576565966 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbf3801a460 con 0x7fbf4810fea0 2026-02-20T13:26:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.120+0000 7fbf44ff9640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf1c0b5760 0x7fbf1c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.120+0000 7fbf477fe640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf1c0b5760 0x7fbf1c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.120+0000 7fbf44ff9640 1 -- 10.20.193.28:0/2576565966 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbf380e6110 con 0x7fbf4810fea0 2026-02-20T13:26:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.120+0000 7fbf4fd84e00 1 Processor -- start 2026-02-20T13:26:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf4fd84e00 1 -- start start 2026-02-20T13:26:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf1c0b5760 0x7fbf1c0d5c10 secure :-1 s=READY pgs=468 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf34004740 tx=0x7fbf34005cb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af251b550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af2560400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 0x558af2580d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558af24317d0 con 0x558af251b180 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558af242d500 con 0x558af2560940 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558af24274a0 con 0x558af251ba90 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af251b550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af251b550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52186/0 (socket says 10.20.193.28:52186) 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 -- 10.20.193.28:0/2853391474 learned_addr learned my addr 10.20.193.28:0/2853391474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf47fff640 1 --2- 10.20.193.28:0/2853391474 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 0x558af2580d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 -- 10.20.193.28:0/2853391474 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 msgr2=0x558af2560400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 --2- 10.20.193.28:0/2853391474 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af2560400 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 -- 10.20.193.28:0/2853391474 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 msgr2=0x558af2580d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 --2- 10.20.193.28:0/2853391474 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 0x558af2580d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.121+0000 7fbf477fe640 1 -- 10.20.193.28:0/2853391474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af23d2d80 con 0x558af251b180 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.122+0000 7fbf477fe640 1 --2- 10.20.193.28:0/2853391474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af251b550 secure :-1 s=READY pgs=1051 gs=1 cs=0 l=1 c_cookie=10267676424407482853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf34004510 tx=0x7fbf3400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7e1d4eb97601e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.122+0000 7fbf0bfff640 1 -- 10.20.193.28:0/2853391474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf34014040 con 0x558af251b180 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.122+0000 7fbf0bfff640 1 -- 10.20.193.28:0/2853391474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf34002e40 con 0x558af251b180 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.122+0000 7fbf0bfff640 1 -- 10.20.193.28:0/2853391474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf3401b850 con 0x558af251b180 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.122+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/2853391474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 msgr2=0x558af251b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.122+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/2853391474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af251b550 secure :-1 s=READY pgs=1051 gs=1 cs=0 l=1 c_cookie=10267676424407482853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf34004510 tx=0x7fbf3400f000 comp rx=0 tx=0).stop 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.122+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/2853391474 shutdown_connections 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.123+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/2853391474 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 0x558af2580d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.123+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/2853391474 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af2560400 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.123+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/2853391474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af251b550 unknown :-1 s=CLOSED pgs=1051 gs=1 cs=0 l=1 c_cookie=10267676424407482853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.123+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/2853391474 >> 10.20.193.28:0/2853391474 conn(0x558af24f9680 msgr2=0x558af2519a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.123+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/2853391474 shutdown_connections 2026-02-20T13:26:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.123+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/2853391474 wait complete. 2026-02-20T13:26:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.124+0000 7fbf4fd84e00 1 -- start start 2026-02-20T13:26:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.124+0000 7fbf4fd84e00 1 Processor -- start 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251b180 0x558af25781e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af2578720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af2560940 0x558af257d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558af257dc50 con 0x558af2560940 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558af257ddc0 con 0x558af251ba90 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558af257df80 con 0x558af251b180 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf46ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af2578720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af2560940 0x558af257d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf477fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251b180 0x558af25781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af2560940 0x558af257d710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52188/0 (socket says 10.20.193.28:52188) 2026-02-20T13:26:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.125+0000 7fbf47fff640 1 -- 10.20.193.28:0/1704060082 learned_addr learned my addr 10.20.193.28:0/1704060082 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.126+0000 7fbf477fe640 1 -- 10.20.193.28:0/1704060082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 msgr2=0x558af2578720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.126+0000 7fbf477fe640 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af2578720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.126+0000 7fbf477fe640 1 -- 10.20.193.28:0/1704060082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af2560940 msgr2=0x558af257d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.126+0000 7fbf477fe640 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af2560940 0x558af257d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.126+0000 7fbf477fe640 1 -- 10.20.193.28:0/1704060082 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af23ab350 con 0x558af251b180 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.126+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af2578720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.126+0000 7fbf47fff640 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af2560940 0x558af257d710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.127+0000 7fbf477fe640 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251b180 0x558af25781e0 secure :-1 s=READY pgs=314 gs=3 cs=0 l=1 c_cookie=13869477891895103521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf34004510 tx=0x7fbf34005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c07a48a8b68a9021 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.127+0000 7fbf097fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.127+0000 7fbf097fa640 1 -- 10.20.193.28:0/1704060082 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf3401bc00 con 0x558af251b180 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.127+0000 7fbf097fa640 1 -- 10.20.193.28:0/1704060082 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf34005e60 con 0x558af251b180 2026-02-20T13:26:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.127+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf340041b0 con 0x558af251b180 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.127+0000 7fbf097fa640 1 -- 10.20.193.28:0/1704060082 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf34028810 con 0x558af251b180 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.127+0000 7fbf4fd84e00 10 client.28534 _ll_register_callbacks cb 0x558af23a89a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.127+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558af20bd6f0 con 0x558af251b180 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.128+0000 7fbf097fa640 1 -- 10.20.193.28:0/1704060082 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbf3401bd60 con 0x558af251b180 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.128+0000 7fbf097fa640 1 -- 10.20.193.28:0/1704060082 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf340289a0 con 0x558af251b180 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.128+0000 7fbf4fd84e00 10 client.28534 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.128+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558af23bd150 con 0x558af251b180 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.129+0000 7fbf097fa640 1 -- 10.20.193.28:0/1704060082 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf3401a040 con 0x558af251b180 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.129+0000 7fbf4fd84e00 10 client.28534 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.129+0000 7fbf4fd84e00 10 client.28534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.129+0000 7fbf4fd84e00 20 client.28534 populate_metadata read hostname 'trial028' 2026-02-20T13:26:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.129+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558af255d8f0 0x558af255dd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.129+0000 7fbf4fd84e00 4 client.28534 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.129+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558af2434d60 con 0x558af255d8f0 2026-02-20T13:26:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.129+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558af255d8f0 0x558af255dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.130+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558af255d8f0 0x558af255dd90 crc :-1 s=READY pgs=266 gs=4 cs=0 l=0 c_cookie=6776011508391643128 s_cookie=11993456124484188717 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e093a90e7a487f8 server_cookie=a67150cd191cfa2d in_seq=0 out_seq=0 2026-02-20T13:26:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.130+0000 7fbf097fa640 10 client.28534 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.130+0000 7fbf097fa640 1 -- 10.20.193.28:0/1704060082 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558af2434d60 con 0x558af255d8f0 2026-02-20T13:26:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.130+0000 7fbf097fa640 10 client.28534 handle_command_reply: tid=0 2026-02-20T13:26:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.130+0000 7fbf4fd84e00 1 client.28534 shutdown 2026-02-20T13:26:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251b180 msgr2=0x558af25781e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251b180 0x558af25781e0 secure :-1 s=READY pgs=314 gs=3 cs=0 l=1 c_cookie=13869477891895103521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf34004510 tx=0x7fbf34005780 comp rx=0 tx=0).stop 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 shutdown_connections 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558af255d8f0 0x558af255dd90 crc :-1 s=READY pgs=266 gs=4 cs=0 l=0 c_cookie=6776011508391643128 s_cookie=11993456124484188717 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af2560940 0x558af257d710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af2578720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/1704060082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251b180 0x558af25781e0 unknown :-1 s=CLOSED pgs=314 gs=3 cs=0 l=1 c_cookie=13869477891895103521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 >> 10.20.193.28:0/1704060082 conn(0x558af24f9680 msgr2=0x558af2519a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf097fa640 0 client.28534 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 shutdown_connections 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/1704060082 wait complete. 2026-02-20T13:26:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.131+0000 7fbf4fd84e00 20 client.28534 trim_cache size 0 max 16384 2026-02-20T13:26:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.140+0000 7fbf4fd84e00 1 Processor -- start 2026-02-20T13:26:11.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.140+0000 7fbf4fd84e00 1 -- start start 2026-02-20T13:26:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af25657c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af25755e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 0x558af2575b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558af24250d0 con 0x558af251b180 2026-02-20T13:26:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558af20e5700 con 0x558af2560940 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558af2579280 con 0x558af251ba90 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af25755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf46ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af25755e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34950/0 (socket says 10.20.193.28:34950) 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf46ffd640 1 -- 10.20.193.28:0/160827468 learned_addr learned my addr 10.20.193.28:0/160827468 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf47fff640 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 0x558af2575b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf46ffd640 1 -- 10.20.193.28:0/160827468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 msgr2=0x558af2575b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 0x558af2575b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf46ffd640 1 -- 10.20.193.28:0/160827468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 msgr2=0x558af25657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf477fe640 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af25657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af25657c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.141+0000 7fbf46ffd640 1 -- 10.20.193.28:0/160827468 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af23b7bd0 con 0x558af251ba90 2026-02-20T13:26:11.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf477fe640 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af25657c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:26:11.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af25755e0 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=6566246945510455528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf380a9830 tx=0x7fbf38010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b1ffeceb6a4f8e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf0b7fe640 1 -- 10.20.193.28:0/160827468 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf380d1040 con 0x558af251ba90 2026-02-20T13:26:11.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf0b7fe640 1 -- 10.20.193.28:0/160827468 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf380acf50 con 0x558af251ba90 2026-02-20T13:26:11.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf0b7fe640 1 -- 10.20.193.28:0/160827468 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf380b73a0 con 0x558af251ba90 2026-02-20T13:26:11.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/160827468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 msgr2=0x558af25755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af25755e0 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=6566246945510455528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf380a9830 tx=0x7fbf38010890 comp rx=0 tx=0).stop 2026-02-20T13:26:11.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/160827468 shutdown_connections 2026-02-20T13:26:11.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af2560940 0x558af2575b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af251ba90 0x558af25755e0 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=6566246945510455528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/160827468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af25657c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/160827468 >> 10.20.193.28:0/160827468 conn(0x558af24f9680 msgr2=0x558af2562d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/160827468 shutdown_connections 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.142+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/160827468 wait complete. 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.143+0000 7fbf4fd84e00 1 -- start start 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.143+0000 7fbf4fd84e00 1 Processor -- start 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af257c030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af257c570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf4fd84e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af2560940 0x558af24fba70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558af257f100 con 0x558af251b180 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558af257cb60 con 0x558af251ba90 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf46ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af257c570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf4fd84e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558af257cd20 con 0x558af2560940 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf46ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af257c570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54784/0 (socket says 10.20.193.28:54784) 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf46ffd640 1 -- 10.20.193.28:0/630472876 learned_addr learned my addr 10.20.193.28:0/630472876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf477fe640 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af257c030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf47fff640 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af2560940 0x558af24fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf46ffd640 1 -- 10.20.193.28:0/630472876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af2560940 msgr2=0x558af24fba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af2560940 0x558af24fba70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf46ffd640 1 -- 10.20.193.28:0/630472876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 msgr2=0x558af257c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af257c030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf46ffd640 1 -- 10.20.193.28:0/630472876 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af23ab680 con 0x558af251ba90 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.144+0000 7fbf477fe640 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af257c030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf46ffd640 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af257c570 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=11013251904574524774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf3800bee0 tx=0x7fbf38004880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d6ee41aa0f0d66 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf097fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf097fa640 1 -- 10.20.193.28:0/630472876 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf380a8830 con 0x558af251ba90 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf48100140 con 0x558af251ba90 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 10 client.28637 _ll_register_callbacks cb 0x558af23a89a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf34002e40 con 0x558af251ba90 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf097fa640 1 -- 10.20.193.28:0/630472876 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf380b4770 con 0x558af251ba90 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf097fa640 1 -- 10.20.193.28:0/630472876 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf380abb30 con 0x558af251ba90 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf097fa640 1 -- 10.20.193.28:0/630472876 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbf38072240 con 0x558af251ba90 2026-02-20T13:26:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf097fa640 1 -- 10.20.193.28:0/630472876 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf38072400 con 0x558af251ba90 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 10 client.28637 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558af23bd3b0 con 0x558af251ba90 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf097fa640 1 -- 10.20.193.28:0/630472876 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf380726d0 con 0x558af251ba90 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 10 client.28637 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 10 client.28637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 20 client.28637 populate_metadata read hostname 'trial028' 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.145+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558af261ede0 0x558af263f1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.146+0000 7fbf4fd84e00 4 client.28637 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:26:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.146+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558af20baf40 con 0x558af261ede0 2026-02-20T13:26:11.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.146+0000 7fbf477fe640 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558af261ede0 0x558af263f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.146+0000 7fbf477fe640 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558af261ede0 0x558af263f1c0 crc :-1 s=READY pgs=267 gs=4 cs=0 l=0 c_cookie=11957785222827480053 s_cookie=6594607444237132745 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5f2964e1b0c13f5 server_cookie=5b84c087e2e6a3c9 in_seq=0 out_seq=0 2026-02-20T13:26:11.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.146+0000 7fbf097fa640 10 client.28637 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:11.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf097fa640 1 -- 10.20.193.28:0/630472876 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x558af20baf40 con 0x558af261ede0 2026-02-20T13:26:11.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf097fa640 10 client.28637 handle_command_reply: tid=0 2026-02-20T13:26:11.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 client.28637 shutdown 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 msgr2=0x558af257c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af257c570 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=11013251904574524774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf3800bee0 tx=0x7fbf38004880 comp rx=0 tx=0).stop 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 shutdown_connections 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558af261ede0 0x558af263f1c0 crc :-1 s=READY pgs=267 gs=4 cs=0 l=0 c_cookie=11957785222827480053 s_cookie=6594607444237132745 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558af2560940 0x558af24fba70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf097fa640 0 client.28637 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558af251ba90 0x558af257c570 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=11013251904574524774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 --2- 10.20.193.28:0/630472876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558af251b180 0x558af257c030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 >> 10.20.193.28:0/630472876 conn(0x558af24f9680 msgr2=0x558af255e450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 shutdown_connections 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 1 -- 10.20.193.28:0/630472876 wait complete. 2026-02-20T13:26:11.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.147+0000 7fbf4fd84e00 20 client.28637 trim_cache size 0 max 16384 2026-02-20T13:26:11.156 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:26:11.156 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:26:11.156 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:26:11.156 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:26:11.156 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.156 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6", 2026-02-20T13:26:11.156 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.157 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.158 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:26:11.159 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.160 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:26:11.161 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.162 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.163 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.164 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.165 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:11.166 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:26:11.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 -- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf1c0b5760 msgr2=0x7fbf1c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf1c0b5760 0x7fbf1c0d5c10 secure :-1 s=READY pgs=468 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf34004740 tx=0x7fbf34005cb0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 -- 10.20.193.28:0/2576565966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf4810fea0 msgr2=0x7fbf48175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf4810fea0 0x7fbf48175f70 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf3800b500 tx=0x7fbf3800b9d0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 -- 10.20.193.28:0/2576565966 shutdown_connections 2026-02-20T13:26:11.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf1c0b5760 0x7fbf1c0d5c10 unknown :-1 s=CLOSED pgs=468 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf481156a0 0x7fbf48063200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf4810fea0 0x7fbf48175f70 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 --2- 10.20.193.28:0/2576565966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf4810f4b0 0x7fbf48066f30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 -- 10.20.193.28:0/2576565966 >> 10.20.193.28:0/2576565966 conn(0x7fbf480ecd60 msgr2=0x7fbf4810d920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 -- 10.20.193.28:0/2576565966 shutdown_connections 2026-02-20T13:26:11.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.150+0000 7fbf4cb01640 1 -- 10.20.193.28:0/2576565966 wait complete. 2026-02-20T13:26:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/2030384977 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b8115420 msgr2=0x7fb6b8175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/2030384977 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b8115420 0x7fb6b8175df0 secure :-1 s=READY pgs=380 gs=3 cs=0 l=1 c_cookie=9182662087662430915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a800a970 tx=0x7fb6a80301b0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/2030384977 shutdown_connections 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/2030384977 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b8115420 0x7fb6b8175df0 unknown :-1 s=CLOSED pgs=380 gs=3 cs=0 l=1 c_cookie=9182662087662430915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/2030384977 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6b810fc20 0x7fb6b8114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/2030384977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6b810f230 0x7fb6b810f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/2030384977 >> 10.20.193.28:0/2030384977 conn(0x7fb6b805f830 msgr2=0x7fb6b810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/2030384977 shutdown_connections 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.240+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/2030384977 wait complete. 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.241+0000 7fb6bd3ac640 1 Processor -- start 2026-02-20T13:26:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.241+0000 7fb6bd3ac640 1 -- start start 2026-02-20T13:26:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6bd3ac640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b810f230 0x7fb6b811b4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6bd3ac640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6b810fc20 0x7fb6b811ba20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6bd3ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6b8115420 0x7fb6b8120df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6bd3ac640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b8121410 con 0x7fb6b8115420 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6bd3ac640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b8121580 con 0x7fb6b810f230 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6bd3ac640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b8121740 con 0x7fb6b810fc20 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6b67fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6b810fc20 0x7fb6b811ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6b6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b810f230 0x7fb6b811b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6b6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b810f230 0x7fb6b811b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54794/0 (socket says 10.20.193.28:54794) 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6b6ffd640 1 -- 10.20.193.28:0/3037361326 learned_addr learned my addr 10.20.193.28:0/3037361326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.242+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6b8115420 0x7fb6b8120df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6b67fc640 1 -- 10.20.193.28:0/3037361326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b810f230 msgr2=0x7fb6b811b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b810f230 0x7fb6b811b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6b67fc640 1 -- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6b8115420 msgr2=0x7fb6b8120df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6b8115420 0x7fb6b8120df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6b67fc640 1 -- 10.20.193.28:0/3037361326 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a800a590 con 0x7fb6b810fc20 2026-02-20T13:26:11.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6b8115420 0x7fb6b8120df0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:11.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6b810fc20 0x7fb6b811ba20 secure :-1 s=READY pgs=316 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a0005b30 tx=0x7fb6a000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb697fff640 1 -- 10.20.193.28:0/3037361326 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6a0004460 con 0x7fb6b810fc20 2026-02-20T13:26:11.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb697fff640 1 -- 10.20.193.28:0/3037361326 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6a00045c0 con 0x7fb6b810fc20 2026-02-20T13:26:11.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb697fff640 1 -- 10.20.193.28:0/3037361326 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6a00052a0 con 0x7fb6b810fc20 2026-02-20T13:26:11.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/3037361326 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b8121a20 con 0x7fb6b810fc20 2026-02-20T13:26:11.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.243+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/3037361326 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b8162120 con 0x7fb6b810fc20 2026-02-20T13:26:11.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.247+0000 7fb697fff640 1 -- 10.20.193.28:0/3037361326 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb6a000c8e0 con 0x7fb6b810fc20 2026-02-20T13:26:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.249+0000 7fb697fff640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb68c0b5760 0x7fb68c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.249+0000 7fb6bf3a6e00 1 Processor -- start 2026-02-20T13:26:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.249+0000 7fb697fff640 1 -- 10.20.193.28:0/3037361326 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6a0014070 con 0x7fb6b810fc20 2026-02-20T13:26:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.249+0000 7fb6bf3a6e00 1 -- start start 2026-02-20T13:26:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d8e8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb68c0b5760 0x7fb68c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dd3590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6df3eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fea6ca3c70 con 0x55fea6d8ee30 2026-02-20T13:26:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fea6c9f9a0 con 0x55fea6d8e520 2026-02-20T13:26:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fea6c99b00 con 0x55fea6dd3ad0 2026-02-20T13:26:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb68c0b5760 0x7fb68c0d5c10 secure :-1 s=READY pgs=469 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6ac0095d0 tx=0x7fb6ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6b77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6df3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6b77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6df3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34984/0 (socket says 10.20.193.28:34984) 2026-02-20T13:26:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6b77fe640 1 -- 10.20.193.28:0/2183520664 learned_addr learned my addr 10.20.193.28:0/2183520664 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.255 INFO:tasks.cephfs.filesystem:scrub status for tag:4e1ec8ab-682b-4e53-85ff-f339a10e3aa6 - {'path': '/', 'tag': '4e1ec8ab-682b-4e53-85ff-f339a10e3aa6', 'options': 'recursive,force'} 2026-02-20T13:26:11.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.250+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/2183520664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d8e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6b77fe640 1 -- 10.20.193.28:0/2183520664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 msgr2=0x55fea6d8e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/2183520664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d8e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6b77fe640 1 -- 10.20.193.28:0/2183520664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 msgr2=0x55fea6dd3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/2183520664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dd3590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6b77fe640 1 -- 10.20.193.28:0/2183520664 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea6c44f80 con 0x55fea6dd3ad0 2026-02-20T13:26:11.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/2183520664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6df3eb0 secure :-1 s=READY pgs=317 gs=2 cs=0 l=1 c_cookie=6492048421129248272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a8006cc0 tx=0x7fb6a80058c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a1863a4860b5e10 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6837fe640 1 -- 10.20.193.28:0/2183520664 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6a8030ad0 con 0x55fea6dd3ad0 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6837fe640 1 -- 10.20.193.28:0/2183520664 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6a8030c30 con 0x55fea6dd3ad0 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6837fe640 1 -- 10.20.193.28:0/2183520664 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6a8005030 con 0x55fea6dd3ad0 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/2183520664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 msgr2=0x55fea6df3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.251+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/2183520664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6df3eb0 secure :-1 s=READY pgs=317 gs=2 cs=0 l=1 c_cookie=6492048421129248272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a8006cc0 tx=0x7fb6a80058c0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.252+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/2183520664 shutdown_connections 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.252+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/2183520664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dd3590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.252+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/2183520664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6df3eb0 unknown :-1 s=CLOSED pgs=317 gs=2 cs=0 l=1 c_cookie=6492048421129248272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.252+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/2183520664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d8e8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.252+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/2183520664 >> 10.20.193.28:0/2183520664 conn(0x55fea6caca60 msgr2=0x55fea6d8ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.252+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/2183520664 shutdown_connections 2026-02-20T13:26:11.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.252+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/2183520664 wait complete. 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.253+0000 7fb6bf3a6e00 1 -- start start 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.253+0000 7fb6bf3a6e00 1 Processor -- start 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8e520 0x55fea6deb110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6deb650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6dd3ad0 0x55fea6df0640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fea6df0b80 con 0x55fea6d8e520 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fea6df0cf0 con 0x55fea6dd3ad0 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fea6df0eb0 con 0x55fea6d8ee30 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6b67fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6deb650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6b6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8e520 0x55fea6deb110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6b6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8e520 0x55fea6deb110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52236/0 (socket says 10.20.193.28:52236) 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6b6ffd640 1 -- 10.20.193.28:0/708717381 learned_addr learned my addr 10.20.193.28:0/708717381 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6dd3ad0 0x55fea6df0640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.254+0000 7fb6b67fc640 1 -- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6dd3ad0 msgr2=0x55fea6df0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6dd3ad0 0x55fea6df0640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6b67fc640 1 -- 10.20.193.28:0/708717381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8e520 msgr2=0x55fea6deb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8e520 0x55fea6deb110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6b67fc640 1 -- 10.20.193.28:0/708717381 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea6c1d710 con 0x55fea6d8ee30 2026-02-20T13:26:11.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6dd3ad0 0x55fea6df0640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:11.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8e520 0x55fea6deb110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6deb650 secure :-1 s=READY pgs=318 gs=2 cs=0 l=1 c_cookie=16869092615468792632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a00e4740 tx=0x7fb6a00ac7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea1b0e5b842ebb38 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb680ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb680ff9640 1 -- 10.20.193.28:0/708717381 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6a00e4e00 con 0x55fea6d8ee30 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb680ff9640 1 -- 10.20.193.28:0/708717381 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6a00b2cf0 con 0x55fea6d8ee30 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b8176660 con 0x55fea6d8ee30 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb680ff9640 1 -- 10.20.193.28:0/708717381 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6a00b7c80 con 0x55fea6d8ee30 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb680ff9640 1 -- 10.20.193.28:0/708717381 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6a00b7de0 con 0x55fea6d8ee30 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb680ff9640 10 client.28552 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6bf3a6e00 10 client.28552 _ll_register_callbacks cb 0x55fea6c1ad60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.255+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fea692fba0 con 0x55fea6d8ee30 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb680ff9640 1 -- 10.20.193.28:0/708717381 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6a00b8110 con 0x55fea6d8ee30 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6bf3a6e00 10 client.28552 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:11.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55fea6c2f350 con 0x55fea6d8ee30 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb680ff9640 1 -- 10.20.193.28:0/708717381 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6a0072160 con 0x55fea6d8ee30 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6bf3a6e00 10 client.28552 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6bf3a6e00 10 client.28552 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6bf3a6e00 20 client.28552 populate_metadata read hostname 'trial028' 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fea6dd07d0 0x55fea6dd0c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6bf3a6e00 4 client.28552 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fea6c6c410 con 0x55fea6dd07d0 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.256+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fea6dd07d0 0x55fea6dd0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fea6dd07d0 0x55fea6dd0c70 crc :-1 s=READY pgs=268 gs=4 cs=0 l=0 c_cookie=4734189451626198391 s_cookie=12443675282302307739 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b338393394b577 server_cookie=acb0d0bd65f00d9b in_seq=0 out_seq=0 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb680ff9640 10 client.28552 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb680ff9640 1 -- 10.20.193.28:0/708717381 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fea6c6c410 con 0x55fea6dd07d0 2026-02-20T13:26:11.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb680ff9640 10 client.28552 handle_command_reply: tid=0 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 client.28552 shutdown 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 msgr2=0x55fea6deb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6deb650 secure :-1 s=READY pgs=318 gs=2 cs=0 l=1 c_cookie=16869092615468792632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a00e4740 tx=0x7fb6a00ac7d0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 shutdown_connections 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fea6dd07d0 0x55fea6dd0c70 crc :-1 s=READY pgs=268 gs=4 cs=0 l=0 c_cookie=4734189451626198391 s_cookie=12443675282302307739 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6dd3ad0 0x55fea6df0640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6deb650 unknown :-1 s=CLOSED pgs=318 gs=2 cs=0 l=1 c_cookie=16869092615468792632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/708717381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8e520 0x55fea6deb110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb680ff9640 0 client.28552 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 >> 10.20.193.28:0/708717381 conn(0x55fea6caca60 msgr2=0x55fea6d8c610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 shutdown_connections 2026-02-20T13:26:11.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.257+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/708717381 wait complete. 2026-02-20T13:26:11.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.258+0000 7fb6bf3a6e00 20 client.28552 trim_cache size 0 max 16384 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6bf3a6e00 1 Processor -- start 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6bf3a6e00 1 -- start start 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6de85d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dce400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6dce940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fea6c97730 con 0x55fea6d8ee30 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fea6957960 con 0x55fea6d8e520 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fea6cfde10 con 0x55fea6dd3ad0 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6b67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dce400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6b67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dce400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52250/0 (socket says 10.20.193.28:52250) 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6b67fc640 1 -- 10.20.193.28:0/3182770885 learned_addr learned my addr 10.20.193.28:0/3182770885 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6de85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.267+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6dce940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb6b67fc640 1 -- 10.20.193.28:0/3182770885 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 msgr2=0x55fea6dce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6dce940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb6b67fc640 1 -- 10.20.193.28:0/3182770885 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 msgr2=0x55fea6de85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6de85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb6b67fc640 1 -- 10.20.193.28:0/3182770885 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea6ddda20 con 0x55fea6d8ee30 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dce400 secure :-1 s=READY pgs=1052 gs=1 cs=0 l=1 c_cookie=9102330175284559200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a00a95a0 tx=0x7fb6a0070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e51f9117627bd60 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb682ffd640 1 -- 10.20.193.28:0/3182770885 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6a00b74c0 con 0x55fea6d8ee30 2026-02-20T13:26:11.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb682ffd640 1 -- 10.20.193.28:0/3182770885 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55fea692fba0 con 0x55fea6d8ee30 2026-02-20T13:26:11.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb682ffd640 1 -- 10.20.193.28:0/3182770885 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6a00e4480 con 0x55fea6d8ee30 2026-02-20T13:26:11.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/3182770885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 msgr2=0x55fea6dce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.268+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dce400 secure :-1 s=READY pgs=1052 gs=1 cs=0 l=1 c_cookie=9102330175284559200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a00a95a0 tx=0x7fb6a0070000 comp rx=0 tx=0).stop 2026-02-20T13:26:11.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/3182770885 shutdown_connections 2026-02-20T13:26:11.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6d8ee30 0x55fea6dce400 unknown :-1 s=CLOSED pgs=1052 gs=1 cs=0 l=1 c_cookie=9102330175284559200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6dd3ad0 0x55fea6dce940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/3182770885 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6de85d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/3182770885 >> 10.20.193.28:0/3182770885 conn(0x55fea6caca60 msgr2=0x55fea6de7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/3182770885 shutdown_connections 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/3182770885 wait complete. 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 -- start start 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.269+0000 7fb6bf3a6e00 1 Processor -- start 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d6dd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6d6e2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6bf3a6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6dd3ad0 0x55fea6d6e810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fea6c97730 con 0x55fea6dd3ad0 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fea6e4a900 con 0x55fea6d8e520 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6bf3a6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fea6e4aac0 con 0x55fea6d8ee30 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d6dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d6dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54830/0 (socket says 10.20.193.28:54830) 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b6ffd640 1 -- 10.20.193.28:0/1646218196 learned_addr learned my addr 10.20.193.28:0/1646218196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6d6e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6dd3ad0 0x55fea6d6e810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b6ffd640 1 -- 10.20.193.28:0/1646218196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 msgr2=0x55fea6d6e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6d6e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b6ffd640 1 -- 10.20.193.28:0/1646218196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6dd3ad0 msgr2=0x55fea6d6e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6dd3ad0 0x55fea6d6e810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b6ffd640 1 -- 10.20.193.28:0/1646218196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea6c29dd0 con 0x55fea6d8e520 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.270+0000 7fb6b77fe640 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6dd3ad0 0x55fea6d6e810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6b6ffd640 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d6dd90 secure :-1 s=READY pgs=381 gs=2 cs=0 l=1 c_cookie=4025312853665260762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55fea6dd0ba0 tx=0x7fb6ac0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37dcc8b6a08824da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb680ff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb680ff9640 1 -- 10.20.193.28:0/1646218196 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6ac021050 con 0x55fea6d8e520 2026-02-20T13:26:11.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb680ff9640 1 -- 10.20.193.28:0/1646218196 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6ac022040 con 0x55fea6d8e520 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb680ff9640 1 -- 10.20.193.28:0/1646218196 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6ac01b3f0 con 0x55fea6d8e520 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea6c2f350 con 0x55fea6d8e520 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb680ff9640 1 -- 10.20.193.28:0/1646218196 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6ac01b580 con 0x55fea6d8e520 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 10 client.28655 _ll_register_callbacks cb 0x55fea6c1ad60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6a8030c30 con 0x55fea6d8e520 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb680ff9640 1 -- 10.20.193.28:0/1646218196 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6ac028600 con 0x55fea6d8e520 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 10 client.28655 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55fea6c1da40 con 0x55fea6d8e520 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb680ff9640 1 -- 10.20.193.28:0/1646218196 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6ac0287a0 con 0x55fea6d8e520 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 10 client.28655 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 10 client.28655 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 20 client.28655 populate_metadata read hostname 'trial028' 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.271+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fea6e92d50 0x55fea6eb3200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:11.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.272+0000 7fb6bf3a6e00 4 client.28655 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6808ef13", "release": true, "await": true}] 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.272+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6808ef13", "release": true, "await": true}) -- 0x55fea692d3f0 con 0x55fea6e92d50 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.272+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fea6e92d50 0x55fea6eb3200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.272+0000 7fb6b67fc640 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fea6e92d50 0x55fea6eb3200 crc :-1 s=READY pgs=269 gs=4 cs=0 l=0 c_cookie=15257053898196915432 s_cookie=8859108854581355333 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3bbf1af610414e8 server_cookie=7af1e090cfd6e345 in_seq=0 out_seq=0 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.272+0000 7fb680ff9640 10 client.28655 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb680ff9640 1 -- 10.20.193.28:0/1646218196 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fea692d3f0 con 0x55fea6e92d50 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb680ff9640 10 client.28655 handle_command_reply: tid=0 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 client.28655 shutdown 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 msgr2=0x55fea6d6dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d6dd90 secure :-1 s=READY pgs=381 gs=2 cs=0 l=1 c_cookie=4025312853665260762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55fea6dd0ba0 tx=0x7fb6ac0047e0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 shutdown_connections 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fea6e92d50 0x55fea6eb3200 crc :-1 s=READY pgs=269 gs=4 cs=0 l=0 c_cookie=15257053898196915432 s_cookie=8859108854581355333 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fea6dd3ad0 0x55fea6d6e810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fea6d8ee30 0x55fea6d6e2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 --2- 10.20.193.28:0/1646218196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fea6d8e520 0x55fea6d6dd90 unknown :-1 s=CLOSED pgs=381 gs=2 cs=0 l=1 c_cookie=4025312853665260762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 >> 10.20.193.28:0/1646218196 conn(0x55fea6caca60 msgr2=0x55fea6de85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb680ff9640 0 client.28655 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:11.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 shutdown_connections 2026-02-20T13:26:11.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 1 -- 10.20.193.28:0/1646218196 wait complete. 2026-02-20T13:26:11.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.274+0000 7fb6bf3a6e00 20 client.28655 trim_cache size 0 max 16384 2026-02-20T13:26:11.282 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:26:11.282 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:26:11.282 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 32, 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "6808ef13": { 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "version": 32, 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 139.8, 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:26:11.283 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:11.284 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb68c0b5760 msgr2=0x7fb68c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb68c0b5760 0x7fb68c0d5c10 secure :-1 s=READY pgs=469 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6ac0095d0 tx=0x7fb6ac005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/3037361326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6b810fc20 msgr2=0x7fb6b811ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6b810fc20 0x7fb6b811ba20 secure :-1 s=READY pgs=316 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a0005b30 tx=0x7fb6a000ee60 comp rx=0 tx=0).stop 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/3037361326 shutdown_connections 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb68c0b5760 0x7fb68c0d5c10 unknown :-1 s=CLOSED pgs=469 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6b8115420 0x7fb6b8120df0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6b810fc20 0x7fb6b811ba20 unknown :-1 s=CLOSED pgs=316 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 --2- 10.20.193.28:0/3037361326 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6b810f230 0x7fb6b811b4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/3037361326 >> 10.20.193.28:0/3037361326 conn(0x7fb6b805f830 msgr2=0x7fb6b810cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:11.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/3037361326 shutdown_connections 2026-02-20T13:26:11.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:11.275+0000 7fb6bd3ac640 1 -- 10.20.193.28:0/3037361326 wait complete. 2026-02-20T13:26:11.379 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6808ef13', total seconds elapsed: 21.0 2026-02-20T13:26:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:11 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:26:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:11 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:11 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:26:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:11 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:26:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:11 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:11 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:11 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2666616828' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:11.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:11 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:26:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:11 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:11 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:26:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:11 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:26:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:11 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:11 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:11 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2666616828' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:11.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:11 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:26:11.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:11 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:11 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:26:11.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:11 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:26:11.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:11 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:11 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:11.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:11 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2666616828' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:12.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.587+0000 7f50b6e83640 1 -- 10.20.193.28:0/1138139419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0157720 msgr2=0x7f50b0177b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.587+0000 7f50b6e83640 1 --2- 10.20.193.28:0/1138139419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0157720 0x7f50b0177b00 secure :-1 s=READY pgs=1053 gs=1 cs=0 l=1 c_cookie=14032822231011433711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50ac00aa30 tx=0x7f50ac030270 comp rx=0 tx=0).stop 2026-02-20T13:26:12.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.587+0000 7f50b6e83640 1 -- 10.20.193.28:0/1138139419 shutdown_connections 2026-02-20T13:26:12.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.587+0000 7f50b6e83640 1 --2- 10.20.193.28:0/1138139419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0157720 0x7f50b0177b00 unknown :-1 s=CLOSED pgs=1053 gs=1 cs=0 l=1 c_cookie=14032822231011433711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.587+0000 7f50b6e83640 1 --2- 10.20.193.28:0/1138139419 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f50b0114710 0x7f50b01571e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.587+0000 7f50b6e83640 1 --2- 10.20.193.28:0/1138139419 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50b0113de0 0x7f50b01141d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.588+0000 7f50b6e83640 1 -- 10.20.193.28:0/1138139419 >> 10.20.193.28:0/1138139419 conn(0x7f50b005be90 msgr2=0x7f50b005c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:12.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.588+0000 7f50b6e83640 1 -- 10.20.193.28:0/1138139419 shutdown_connections 2026-02-20T13:26:12.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.588+0000 7f50b6e83640 1 -- 10.20.193.28:0/1138139419 wait complete. 2026-02-20T13:26:12.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.588+0000 7f50b6e83640 1 Processor -- start 2026-02-20T13:26:12.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.588+0000 7f50b6e83640 1 -- start start 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b6e83640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f50b0113de0 0x7f50b0103670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b6e83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0114710 0x7f50b0103cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b6e83640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50b0157720 0x7f50b01048c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b6e83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f50b0105000 con 0x7f50b0114710 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b6e83640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f50b0105170 con 0x7f50b0113de0 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b6e83640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f50b0105330 con 0x7f50b0157720 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0114710 0x7f50b0103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0114710 0x7f50b0103cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52260/0 (socket says 10.20.193.28:52260) 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 -- 10.20.193.28:0/2377534274 learned_addr learned my addr 10.20.193.28:0/2377534274 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:12.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5e81640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f50b0113de0 0x7f50b0103670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b6682640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50b0157720 0x7f50b01048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 -- 10.20.193.28:0/2377534274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50b0157720 msgr2=0x7f50b01048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50b0157720 0x7f50b01048c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 -- 10.20.193.28:0/2377534274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f50b0113de0 msgr2=0x7f50b0103670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f50b0113de0 0x7f50b0103670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 -- 10.20.193.28:0/2377534274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a40094b0 con 0x7f50b0114710 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5e81640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f50b0113de0 0x7f50b0103670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b5680640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0114710 0x7f50b0103cc0 secure :-1 s=READY pgs=1054 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a4009fd0 tx=0x7f50a4002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:12.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f509effd640 1 -- 10.20.193.28:0/2377534274 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50a400ed60 con 0x7f50b0114710 2026-02-20T13:26:12.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f509effd640 1 -- 10.20.193.28:0/2377534274 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50a4002e20 con 0x7f50b0114710 2026-02-20T13:26:12.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f509effd640 1 -- 10.20.193.28:0/2377534274 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50a40189f0 con 0x7f50b0114710 2026-02-20T13:26:12.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.589+0000 7f50b6e83640 1 -- 10.20.193.28:0/2377534274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac00a650 con 0x7f50b0114710 2026-02-20T13:26:12.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.590+0000 7f50b6e83640 1 -- 10.20.193.28:0/2377534274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b01550f0 con 0x7f50b0114710 2026-02-20T13:26:12.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.592+0000 7f509effd640 1 -- 10.20.193.28:0/2377534274 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f50a4016020 con 0x7f50b0114710 2026-02-20T13:26:12.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.594+0000 7f509effd640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f508c0b5760 0x7f508c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.594+0000 7f509effd640 1 -- 10.20.193.28:0/2377534274 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f50a40e6c90 con 0x7f50b0114710 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.594+0000 7f50b5e81640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f508c0b5760 0x7f508c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.594+0000 7f50b5e81640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f508c0b5760 0x7f508c0d5c10 secure :-1 s=READY pgs=470 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a0004740 tx=0x7f50a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.594+0000 7f50ba82ee00 1 Processor -- start 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50ba82ee00 1 -- start start 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b698a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b8a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b8a700 0x558e32baaae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558e32a5efd0 con 0x558e32b8a700 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558e32a5ad00 con 0x558e32b494c0 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558e32a54ca0 con 0x558e32b69de0 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54876/0 (socket says 10.20.193.28:54876) 2026-02-20T13:26:12.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5680640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b8a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5e81640 1 -- 10.20.193.28:0/3694651877 learned_addr learned my addr 10.20.193.28:0/3694651877 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b6682640 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b8a700 0x558e32baaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5680640 1 -- 10.20.193.28:0/3694651877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 msgr2=0x558e32b698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5680640 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5680640 1 -- 10.20.193.28:0/3694651877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b8a700 msgr2=0x558e32baaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5680640 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b8a700 0x558e32baaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5680640 1 -- 10.20.193.28:0/3694651877 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e329f78b0 con 0x558e32b69de0 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.595+0000 7f50b5e81640 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b698a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50b5680640 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b8a1c0 secure :-1 s=READY pgs=319 gs=2 cs=0 l=1 c_cookie=15475049654219919066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a40ad260 tx=0x7f50a4018400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c26bab914f4eda server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f507e3ff640 1 -- 10.20.193.28:0/3694651877 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50a40ad9f0 con 0x558e32b69de0 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f507e3ff640 1 -- 10.20.193.28:0/3694651877 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50a40b2d10 con 0x558e32b69de0 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f507e3ff640 1 -- 10.20.193.28:0/3694651877 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50a40adc80 con 0x558e32b69de0 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 -- 10.20.193.28:0/3694651877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 msgr2=0x558e32b8a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b8a1c0 secure :-1 s=READY pgs=319 gs=2 cs=0 l=1 c_cookie=15475049654219919066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a40ad260 tx=0x7f50a4018400 comp rx=0 tx=0).stop 2026-02-20T13:26:12.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 -- 10.20.193.28:0/3694651877 shutdown_connections 2026-02-20T13:26:12.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b8a700 0x558e32baaae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b8a1c0 unknown :-1 s=CLOSED pgs=319 gs=2 cs=0 l=1 c_cookie=15475049654219919066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/3694651877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b698a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 -- 10.20.193.28:0/3694651877 >> 10.20.193.28:0/3694651877 conn(0x558e32a681c0 msgr2=0x558e32b47da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:12.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 -- 10.20.193.28:0/3694651877 shutdown_connections 2026-02-20T13:26:12.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.596+0000 7f50ba82ee00 1 -- 10.20.193.28:0/3694651877 wait complete. 2026-02-20T13:26:12.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.597+0000 7f50ba82ee00 1 -- start start 2026-02-20T13:26:12.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.597+0000 7f50ba82ee00 1 Processor -- start 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b62b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 0x558e32b631e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 0x558e32b63c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558e32b642a0 con 0x558e32b69de0 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558e32b64410 con 0x558e32b494c0 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558e32b645d0 con 0x558e32b8a700 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b62b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b6682640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 0x558e32b63c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b62b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54886/0 (socket says 10.20.193.28:54886) 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5e81640 1 -- 10.20.193.28:0/1925536898 learned_addr learned my addr 10.20.193.28:0/1925536898 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5680640 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 0x558e32b631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5e81640 1 -- 10.20.193.28:0/1925536898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 msgr2=0x558e32b63c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5e81640 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 0x558e32b63c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5e81640 1 -- 10.20.193.28:0/1925536898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 msgr2=0x558e32b631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5e81640 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 0x558e32b631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.598+0000 7f50b5e81640 1 -- 10.20.193.28:0/1925536898 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e32a00400 con 0x558e32b494c0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f50b5e81640 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b62b90 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=15521599236969580643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a0009920 tx=0x7f50a0013070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d767cc44e18bc863 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f506b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f506b7fe640 1 -- 10.20.193.28:0/1925536898 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50a0022040 con 0x558e32b494c0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f506b7fe640 1 -- 10.20.193.28:0/1925536898 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50a001dd70 con 0x558e32b494c0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f506b7fe640 1 -- 10.20.193.28:0/1925536898 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50a0018400 con 0x558e32b494c0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b01550f0 con 0x558e32b494c0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f506b7fe640 1 -- 10.20.193.28:0/1925536898 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f50a0018590 con 0x558e32b494c0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f506b7fe640 10 client.28667 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f50ba82ee00 10 client.28667 _ll_register_callbacks cb 0x558e329dfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e326f4520 con 0x558e32b494c0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f506b7fe640 1 -- 10.20.193.28:0/1925536898 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f50a001d890 con 0x558e32b494c0 2026-02-20T13:26:12.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f50ba82ee00 10 client.28667 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558e329d8da0 con 0x558e32b494c0 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f506b7fe640 1 -- 10.20.193.28:0/1925536898 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f50a001da70 con 0x558e32b494c0 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f50ba82ee00 10 client.28667 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.599+0000 7f50ba82ee00 10 client.28667 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.600+0000 7f50ba82ee00 20 client.28667 populate_metadata read hostname 'trial028' 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.600+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558e32b67360 0x558e32b67800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.600+0000 7f50ba82ee00 4 client.28667 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.600+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e32a86630 con 0x558e32b67360 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.600+0000 7f50b5680640 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558e32b67360 0x558e32b67800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.600+0000 7f50b5680640 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558e32b67360 0x558e32b67800 crc :-1 s=READY pgs=270 gs=4 cs=0 l=0 c_cookie=6655606187430616220 s_cookie=8088688441304438323 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c5d769086b19c9c server_cookie=7040cb481ac25633 in_seq=0 out_seq=0 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.600+0000 7f506b7fe640 10 client.28667 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f506b7fe640 1 -- 10.20.193.28:0/1925536898 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558e32a86630 con 0x558e32b67360 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f506b7fe640 10 client.28667 handle_command_reply: tid=0 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 client.28667 shutdown 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 msgr2=0x558e32b62b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b62b90 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=15521599236969580643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a0009920 tx=0x7f50a0013070 comp rx=0 tx=0).stop 2026-02-20T13:26:12.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 shutdown_connections 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558e32b67360 0x558e32b67800 crc :-1 s=READY pgs=270 gs=4 cs=0 l=0 c_cookie=6655606187430616220 s_cookie=8088688441304438323 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 0x558e32b631e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 0x558e32b63c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1925536898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b62b90 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=15521599236969580643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 >> 10.20.193.28:0/1925536898 conn(0x558e32a681c0 msgr2=0x558e32b4a790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f506b7fe640 0 client.28667 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 shutdown_connections 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1925536898 wait complete. 2026-02-20T13:26:12.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.601+0000 7f50ba82ee00 20 client.28667 trim_cache size 0 max 16384 2026-02-20T13:26:12.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50ba82ee00 1 Processor -- start 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50ba82ee00 1 -- start start 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b494c0 0x558e32b62a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b885c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b8a700 0x558e32b88b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558e32a528d0 con 0x558e32b494c0 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558e32793f10 con 0x558e32b8a700 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558e32b63320 con 0x558e32b69de0 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50b5e81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b494c0 0x558e32b62a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50b6682640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b8a700 0x558e32b88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50b5680640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b885c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50b6682640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b8a700 0x558e32b88b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54888/0 (socket says 10.20.193.28:54888) 2026-02-20T13:26:12.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.609+0000 7f50b6682640 1 -- 10.20.193.28:0/1884706820 learned_addr learned my addr 10.20.193.28:0/1884706820 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:12.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50b6682640 1 -- 10.20.193.28:0/1884706820 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 msgr2=0x558e32b885c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:12.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50b6682640 1 --2- 10.20.193.28:0/1884706820 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b885c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50b6682640 1 -- 10.20.193.28:0/1884706820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b494c0 msgr2=0x558e32b62a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50b6682640 1 --2- 10.20.193.28:0/1884706820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b494c0 0x558e32b62a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50b6682640 1 -- 10.20.193.28:0/1884706820 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e329ea670 con 0x558e32b8a700 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50b5e81640 1 --2- 10.20.193.28:0/1884706820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b494c0 0x558e32b62a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50b6682640 1 --2- 10.20.193.28:0/1884706820 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b8a700 0x558e32b88b00 secure :-1 s=READY pgs=383 gs=2 cs=0 l=1 c_cookie=8433275616683769015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50ac00a230 tx=0x7f50ac0069e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7509037df1663cb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f507dbfe640 1 -- 10.20.193.28:0/1884706820 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50ac03e040 con 0x558e32b8a700 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f507dbfe640 1 -- 10.20.193.28:0/1884706820 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50ac006eb0 con 0x558e32b8a700 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f507dbfe640 1 -- 10.20.193.28:0/1884706820 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50ac0050c0 con 0x558e32b8a700 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1884706820 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b8a700 msgr2=0x558e32b88b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1884706820 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b8a700 0x558e32b88b00 secure :-1 s=READY pgs=383 gs=2 cs=0 l=1 c_cookie=8433275616683769015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50ac00a230 tx=0x7f50ac0069e0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1884706820 shutdown_connections 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1884706820 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b8a700 0x558e32b88b00 unknown :-1 s=CLOSED pgs=383 gs=2 cs=0 l=1 c_cookie=8433275616683769015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1884706820 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b69de0 0x558e32b885c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/1884706820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b494c0 0x558e32b62a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1884706820 >> 10.20.193.28:0/1884706820 conn(0x558e32a681c0 msgr2=0x558e32b5eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1884706820 shutdown_connections 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.610+0000 7f50ba82ee00 1 -- 10.20.193.28:0/1884706820 wait complete. 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50ba82ee00 1 -- start start 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50ba82ee00 1 Processor -- start 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b6a3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 0x558e32b6a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50ba82ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 0x558e32b6afb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558e32b6b6b0 con 0x558e32b69de0 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558e32b6b820 con 0x558e32b494c0 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50ba82ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558e32b6b9e0 con 0x558e32b8a700 2026-02-20T13:26:12.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50b5e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b6a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50b5680640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 0x558e32b6a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50b5e81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b6a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54890/0 (socket says 10.20.193.28:54890) 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50b5e81640 1 -- 10.20.193.28:0/2461890946 learned_addr learned my addr 10.20.193.28:0/2461890946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.611+0000 7f50b6682640 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 0x558e32b6afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50b5e81640 1 -- 10.20.193.28:0/2461890946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 msgr2=0x558e32b6afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50b5e81640 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 0x558e32b6afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50b5e81640 1 -- 10.20.193.28:0/2461890946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 msgr2=0x558e32b6a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50b5e81640 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 0x558e32b6a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50b5e81640 1 -- 10.20.193.28:0/2461890946 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b0178690 con 0x558e32b494c0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50b5e81640 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b6a3a0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=521583265071241209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a0004580 tx=0x7f50a0009fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73d0937535c17f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f506b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f506b7fe640 1 -- 10.20.193.28:0/2461890946 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50a0040070 con 0x558e32b494c0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f506b7fe640 1 -- 10.20.193.28:0/2461890946 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x558e326f4520 con 0x558e32b494c0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e329d8da0 con 0x558e32b494c0 2026-02-20T13:26:12.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f506b7fe640 1 -- 10.20.193.28:0/2461890946 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50a0022030 con 0x558e32b494c0 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50ba82ee00 10 client.28673 _ll_register_callbacks cb 0x558e329dfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e32b04ca0 con 0x558e32b494c0 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f506b7fe640 1 -- 10.20.193.28:0/2461890946 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f50a001bad0 con 0x558e32b494c0 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f506b7fe640 1 -- 10.20.193.28:0/2461890946 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f50a000ea20 con 0x558e32b494c0 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50ba82ee00 10 client.28673 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.612+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558e329e50f0 con 0x558e32b494c0 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f506b7fe640 1 -- 10.20.193.28:0/2461890946 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f50a000eb80 con 0x558e32b494c0 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f50ba82ee00 10 client.28673 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f50ba82ee00 10 client.28673 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f50ba82ee00 20 client.28673 populate_metadata read hostname 'trial028' 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558e32b6d960 0x558e32b6de00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f50ba82ee00 4 client.28673 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558e32738640 con 0x558e32b6d960 2026-02-20T13:26:12.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f50b5680640 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558e32b6d960 0x558e32b6de00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:12.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f50b5680640 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558e32b6d960 0x558e32b6de00 crc :-1 s=READY pgs=271 gs=4 cs=0 l=0 c_cookie=4937311288795746739 s_cookie=474440188358869481 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4484da754a3251b3 server_cookie=6958cd66e4cc1e9 in_seq=0 out_seq=0 2026-02-20T13:26:12.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.613+0000 7f506b7fe640 10 client.28673 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:12.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.617+0000 7f506b7fe640 1 -- 10.20.193.28:0/2461890946 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558e32738640 con 0x558e32b6d960 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.617+0000 7f506b7fe640 10 client.28673 handle_command_reply: tid=0 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.617+0000 7f50ba82ee00 1 client.28673 shutdown 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 msgr2=0x558e32b6a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b6a3a0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=521583265071241209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a0004580 tx=0x7f50a0009fc0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 shutdown_connections 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558e32b6d960 0x558e32b6de00 crc :-1 s=READY pgs=271 gs=4 cs=0 l=0 c_cookie=4937311288795746739 s_cookie=474440188358869481 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558e32b69de0 0x558e32b6a8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558e32b8a700 0x558e32b6afb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 --2- 10.20.193.28:0/2461890946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558e32b494c0 0x558e32b6a3a0 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=521583265071241209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f506b7fe640 0 client.28673 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 >> 10.20.193.28:0/2461890946 conn(0x558e32a681c0 msgr2=0x558e32b5eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 shutdown_connections 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 1 -- 10.20.193.28:0/2461890946 wait complete. 2026-02-20T13:26:12.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50ba82ee00 20 client.28673 trim_cache size 0 max 16384 2026-02-20T13:26:12.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:26:12.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:26:12.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:26:12.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:26:12.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 -- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f508c0b5760 msgr2=0x7f508c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f508c0b5760 0x7f508c0d5c10 secure :-1 s=READY pgs=470 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a0004740 tx=0x7f50a0005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:12.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 -- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0114710 msgr2=0x7f50b0103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0114710 0x7f50b0103cc0 secure :-1 s=READY pgs=1054 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a4009fd0 tx=0x7f50a4002bc0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 -- 10.20.193.28:0/2377534274 shutdown_connections 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f508c0b5760 0x7f508c0d5c10 unknown :-1 s=CLOSED pgs=470 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50b0114710 0x7f50b0103cc0 unknown :-1 s=CLOSED pgs=1054 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50b0157720 0x7f50b01048c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 --2- 10.20.193.28:0/2377534274 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f50b0113de0 0x7f50b0103670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 -- 10.20.193.28:0/2377534274 >> 10.20.193.28:0/2377534274 conn(0x7f50b005be90 msgr2=0x7f50b00f9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 -- 10.20.193.28:0/2377534274 shutdown_connections 2026-02-20T13:26:12.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:12.618+0000 7f50b6e83640 1 -- 10.20.193.28:0/2377534274 wait complete. 2026-02-20T13:26:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:12 trial028 ceph-mon[37442]: pgmap v447: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:26:12.878 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:12 trial127 ceph-mon[43817]: pgmap v447: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:26:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:12 trial034 ceph-mon[43332]: pgmap v447: 97 pgs: 97 active+clean; 750 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:26:14.793 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:14 trial034 ceph-mon[43332]: pgmap v448: 97 pgs: 97 active+clean; 762 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:26:14.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:14 trial028 ceph-mon[37442]: pgmap v448: 97 pgs: 97 active+clean; 762 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:26:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:14 trial127 ceph-mon[43817]: pgmap v448: 97 pgs: 97 active+clean; 762 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:26:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:16 trial028 ceph-mon[37442]: pgmap v449: 97 pgs: 97 active+clean; 762 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2026-02-20T13:26:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:16 trial127 ceph-mon[43817]: pgmap v449: 97 pgs: 97 active+clean; 762 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2026-02-20T13:26:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:16 trial034 ceph-mon[43332]: pgmap v449: 97 pgs: 97 active+clean; 762 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2026-02-20T13:26:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:18 trial028 ceph-mon[37442]: pgmap v450: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 16 op/s 2026-02-20T13:26:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:18 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:26:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:18 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:26:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:18 trial127 ceph-mon[43817]: pgmap v450: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 16 op/s 2026-02-20T13:26:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:18 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:26:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:18 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:26:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:18 trial034 ceph-mon[43332]: pgmap v450: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 16 op/s 2026-02-20T13:26:18.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:18 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:26:18.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:18 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:26:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:20 trial028 ceph-mon[37442]: pgmap v451: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2026-02-20T13:26:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:20 trial127 ceph-mon[43817]: pgmap v451: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2026-02-20T13:26:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:20 trial034 ceph-mon[43332]: pgmap v451: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2026-02-20T13:26:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:22 trial028 ceph-mon[37442]: pgmap v452: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 16 op/s 2026-02-20T13:26:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:22 trial127 ceph-mon[43817]: pgmap v452: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 16 op/s 2026-02-20T13:26:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:22 trial034 ceph-mon[43332]: pgmap v452: 97 pgs: 97 active+clean; 821 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 16 op/s 2026-02-20T13:26:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:24 trial028 ceph-mon[37442]: pgmap v453: 97 pgs: 97 active+clean; 883 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:26:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:24 trial127 ceph-mon[43817]: pgmap v453: 97 pgs: 97 active+clean; 883 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:26:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:24 trial034 ceph-mon[43332]: pgmap v453: 97 pgs: 97 active+clean; 883 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 -- 10.20.193.28:0/2205075449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810e940 msgr2=0x7f186810edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 --2- 10.20.193.28:0/2205075449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810e940 0x7f186810edb0 secure :-1 s=READY pgs=1055 gs=1 cs=0 l=1 c_cookie=1555338307905365678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850009980 tx=0x7f185002f190 comp rx=0 tx=0).stop 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 -- 10.20.193.28:0/2205075449 shutdown_connections 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 --2- 10.20.193.28:0/2205075449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810e940 0x7f186810edb0 unknown :-1 s=CLOSED pgs=1055 gs=1 cs=0 l=1 c_cookie=1555338307905365678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 --2- 10.20.193.28:0/2205075449 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186810f2f0 0x7f1868171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 --2- 10.20.193.28:0/2205075449 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18681100b0 0x7f18681104a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 -- 10.20.193.28:0/2205075449 >> 10.20.193.28:0/2205075449 conn(0x7f18680ec320 msgr2=0x7f186810c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 -- 10.20.193.28:0/2205075449 shutdown_connections 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.695+0000 7f186c8c2640 1 -- 10.20.193.28:0/2205075449 wait complete. 2026-02-20T13:26:25.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f186c8c2640 1 Processor -- start 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f186c8c2640 1 -- start start 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f186c8c2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186810e940 0x7f18680f8240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f186c8c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810f2f0 0x7f1868171060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f186c8c2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18681100b0 0x7f18680f8a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f186c8c2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f18680f96e0 con 0x7f186810f2f0 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f186c8c2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f18680f9850 con 0x7f186810e940 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f186c8c2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f18680f9a10 con 0x7f18681100b0 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810f2f0 0x7f1868171060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186810e940 0x7f18680f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186810e940 0x7f18680f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58464/0 (socket says 10.20.193.28:58464) 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866d76640 1 -- 10.20.193.28:0/3901473788 learned_addr learned my addr 10.20.193.28:0/3901473788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1867577640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18681100b0 0x7f18680f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866575640 1 -- 10.20.193.28:0/3901473788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18681100b0 msgr2=0x7f18680f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866575640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18681100b0 0x7f18680f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866575640 1 -- 10.20.193.28:0/3901473788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186810e940 msgr2=0x7f18680f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866575640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186810e940 0x7f18680f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.696+0000 7f1866575640 1 -- 10.20.193.28:0/3901473788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1850009570 con 0x7f186810f2f0 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.697+0000 7f1866575640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810f2f0 0x7f1868171060 secure :-1 s=READY pgs=1056 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18500098a0 tx=0x7f18500028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.697+0000 7f1847fff640 1 -- 10.20.193.28:0/3901473788 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f185003d070 con 0x7f186810f2f0 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.697+0000 7f1847fff640 1 -- 10.20.193.28:0/3901473788 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18500043d0 con 0x7f186810f2f0 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.697+0000 7f186c8c2640 1 -- 10.20.193.28:0/3901473788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18680f9c90 con 0x7f186810f2f0 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.697+0000 7f1847fff640 1 -- 10.20.193.28:0/3901473788 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1850041a90 con 0x7f186810f2f0 2026-02-20T13:26:25.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.697+0000 7f186c8c2640 1 -- 10.20.193.28:0/3901473788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18680fa150 con 0x7f186810f2f0 2026-02-20T13:26:25.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.700+0000 7f1847fff640 1 -- 10.20.193.28:0/3901473788 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1850038920 con 0x7f186810f2f0 2026-02-20T13:26:25.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.701+0000 7f1847fff640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f183c0b5760 0x7f183c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f1847fff640 1 -- 10.20.193.28:0/3901473788 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f185010b460 con 0x7f186810f2f0 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f1866d76640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f183c0b5760 0x7f183c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f186f6ade00 1 Processor -- start 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f186f6ade00 1 -- start start 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d72b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67f7bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67f8110 0x55f0f68184f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f186f6ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0f66c3fd0 con 0x55f0f67f8110 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f186f6ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f0f66bfd00 con 0x55f0f67b6ed0 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f186f6ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f0f66b9ca0 con 0x55f0f67d77f0 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f1866d76640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f183c0b5760 0x7f183c0d5c10 secure :-1 s=READY pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f185c0095b0 tx=0x7f185c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:25.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f1866575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f1866575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56562/0 (socket says 10.20.193.28:56562) 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f1866575640 1 -- 10.20.193.28:0/1403136585 learned_addr learned my addr 10.20.193.28:0/1403136585 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f1866d76640 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.702+0000 7f1867577640 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67f8110 0x55f0f68184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f1866575640 1 -- 10.20.193.28:0/1403136585 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67b6ed0 msgr2=0x55f0f67d72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f1866575640 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f1866575640 1 -- 10.20.193.28:0/1403136585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67f8110 msgr2=0x55f0f68184f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f1866575640 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67f8110 0x55f0f68184f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f1866575640 1 -- 10.20.193.28:0/1403136585 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f665c8b0 con 0x55f0f67d77f0 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f1866575640 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67f7bd0 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=2531952894907603523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18500cde40 tx=0x7f1850041410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23234dbe38fd5a43 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f18453fe640 1 -- 10.20.193.28:0/1403136585 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18500d1250 con 0x55f0f67d77f0 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f18453fe640 1 -- 10.20.193.28:0/1403136585 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18500d1070 con 0x55f0f67d77f0 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f18453fe640 1 -- 10.20.193.28:0/1403136585 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18500d1690 con 0x55f0f67d77f0 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f186f6ade00 1 -- 10.20.193.28:0/1403136585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 msgr2=0x55f0f67f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f186f6ade00 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67f7bd0 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=2531952894907603523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18500cde40 tx=0x7f1850041410 comp rx=0 tx=0).stop 2026-02-20T13:26:25.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f186f6ade00 1 -- 10.20.193.28:0/1403136585 shutdown_connections 2026-02-20T13:26:25.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f186f6ade00 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67f8110 0x55f0f68184f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f186f6ade00 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67f7bd0 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=2531952894907603523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f186f6ade00 1 --2- 10.20.193.28:0/1403136585 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d72b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f186f6ade00 1 -- 10.20.193.28:0/1403136585 >> 10.20.193.28:0/1403136585 conn(0x55f0f66cd1c0 msgr2=0x55f0f67acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:25.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.703+0000 7f186f6ade00 1 -- 10.20.193.28:0/1403136585 shutdown_connections 2026-02-20T13:26:25.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.704+0000 7f186f6ade00 1 -- 10.20.193.28:0/1403136585 wait complete. 2026-02-20T13:26:25.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.705+0000 7f186f6ade00 1 -- start start 2026-02-20T13:26:25.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.705+0000 7f186f6ade00 1 Processor -- start 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d02c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67d77f0 0x55f0f67d0910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67f8110 0x55f0f67d1370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f186f6ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0f67d19d0 con 0x55f0f67b6ed0 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f186f6ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f0f67d1b40 con 0x55f0f67d77f0 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f186f6ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f0f67d1d00 con 0x55f0f67f8110 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1866575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67d77f0 0x55f0f67d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1867577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67f8110 0x55f0f67d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1867577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67f8110 0x55f0f67d1370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56566/0 (socket says 10.20.193.28:56566) 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1867577640 1 -- 10.20.193.28:0/270041052 learned_addr learned my addr 10.20.193.28:0/270041052 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1866d76640 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1866575640 1 -- 10.20.193.28:0/270041052 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67f8110 msgr2=0x55f0f67d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1866575640 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67f8110 0x55f0f67d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1866575640 1 -- 10.20.193.28:0/270041052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 msgr2=0x55f0f67d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1866575640 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1866575640 1 -- 10.20.193.28:0/270041052 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f6665400 con 0x55f0f67d77f0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.706+0000 7f1866d76640 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d02c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f1866575640 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67d77f0 0x55f0f67d0910 secure :-1 s=READY pgs=385 gs=2 cs=0 l=1 c_cookie=141016697447611144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850108f90 tx=0x7f1850002b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f4fdf06ec37b08 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f18313fd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f18313fd640 1 -- 10.20.193.28:0/270041052 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18500d1250 con 0x55f0f67d77f0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f18313fd640 1 -- 10.20.193.28:0/270041052 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18500d9ac0 con 0x55f0f67d77f0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18680fa150 con 0x55f0f67d77f0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f18313fd640 1 -- 10.20.193.28:0/270041052 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18500d31b0 con 0x55f0f67d77f0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f18313fd640 1 -- 10.20.193.28:0/270041052 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f18500d3310 con 0x55f0f67d77f0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f18313fd640 10 client.28685 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f186f6ade00 10 client.28685 _ll_register_callbacks cb 0x55f0f6644a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0f6359520 con 0x55f0f67d77f0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f18313fd640 1 -- 10.20.193.28:0/270041052 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18500d1070 con 0x55f0f67d77f0 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f186f6ade00 10 client.28685 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:25.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f0f663dda0 con 0x55f0f67d77f0 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.707+0000 7f18313fd640 1 -- 10.20.193.28:0/270041052 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18500f50a0 con 0x55f0f67d77f0 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f186f6ade00 10 client.28685 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f186f6ade00 10 client.28685 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f186f6ade00 20 client.28685 populate_metadata read hostname 'trial028' 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f186f6ade00 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f0f67d46e0 0x55f0f67d4b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f186f6ade00 4 client.28685 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0f66eb630 con 0x55f0f67d46e0 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f1866d76640 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f0f67d46e0 0x55f0f67d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f1866d76640 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f0f67d46e0 0x55f0f67d4b80 crc :-1 s=READY pgs=272 gs=4 cs=0 l=0 c_cookie=5741562852976172389 s_cookie=2454306296553847829 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fae20fea3391d65 server_cookie=220f7292c018bc15 in_seq=0 out_seq=0 2026-02-20T13:26:25.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.708+0000 7f18313fd640 10 client.28685 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f18313fd640 1 -- 10.20.193.28:0/270041052 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f0f66eb630 con 0x55f0f67d46e0 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f18313fd640 10 client.28685 handle_command_reply: tid=0 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 client.28685 shutdown 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67d77f0 msgr2=0x55f0f67d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67d77f0 0x55f0f67d0910 secure :-1 s=READY pgs=385 gs=2 cs=0 l=1 c_cookie=141016697447611144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850108f90 tx=0x7f1850002b80 comp rx=0 tx=0).stop 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 shutdown_connections 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f0f67d46e0 0x55f0f67d4b80 crc :-1 s=READY pgs=272 gs=4 cs=0 l=0 c_cookie=5741562852976172389 s_cookie=2454306296553847829 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67f8110 0x55f0f67d1370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67d77f0 0x55f0f67d0910 unknown :-1 s=CLOSED pgs=385 gs=2 cs=0 l=1 c_cookie=141016697447611144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 --2- 10.20.193.28:0/270041052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d02c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 >> 10.20.193.28:0/270041052 conn(0x55f0f66cd1c0 msgr2=0x55f0f67b81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:25.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f18313fd640 0 client.28685 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:25.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 shutdown_connections 2026-02-20T13:26:25.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.709+0000 7f186f6ade00 1 -- 10.20.193.28:0/270041052 wait complete. 2026-02-20T13:26:25.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.710+0000 7f186f6ade00 20 client.28685 trim_cache size 0 max 16384 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f186f6ade00 1 Processor -- start 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f186f6ade00 1 -- start start 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d0860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67d77f0 0x55f0f67cd5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 0x55f0f67cdb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f186f6ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0f66b78d0 con 0x55f0f67d77f0 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f186f6ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f0f63f8f10 con 0x55f0f67f8110 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f186f6ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f0f66b9ca0 con 0x55f0f67b6ed0 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56570/0 (socket says 10.20.193.28:56570) 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866d76640 1 -- 10.20.193.28:0/1002898056 learned_addr learned my addr 10.20.193.28:0/1002898056 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866575640 1 --2- 10.20.193.28:0/1002898056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67d77f0 0x55f0f67cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866d76640 1 -- 10.20.193.28:0/1002898056 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 msgr2=0x55f0f67cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866d76640 1 --2- 10.20.193.28:0/1002898056 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 0x55f0f67cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866d76640 1 -- 10.20.193.28:0/1002898056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67d77f0 msgr2=0x55f0f67cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866d76640 1 --2- 10.20.193.28:0/1002898056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67d77f0 0x55f0f67cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.718+0000 7f1866d76640 1 -- 10.20.193.28:0/1002898056 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f664f670 con 0x55f0f67b6ed0 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f1866d76640 1 --2- 10.20.193.28:0/1002898056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d0860 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=7897502798203468173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f185c005db0 tx=0x7f185c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d9990f3c392398d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f1844bfd640 1 -- 10.20.193.28:0/1002898056 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f185c021030 con 0x55f0f67b6ed0 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f1844bfd640 1 -- 10.20.193.28:0/1002898056 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f185c022040 con 0x55f0f67b6ed0 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f1844bfd640 1 -- 10.20.193.28:0/1002898056 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f185c0283f0 con 0x55f0f67b6ed0 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 -- 10.20.193.28:0/1002898056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67b6ed0 msgr2=0x55f0f67d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 --2- 10.20.193.28:0/1002898056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d0860 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=7897502798203468173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f185c005db0 tx=0x7f185c014000 comp rx=0 tx=0).stop 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 -- 10.20.193.28:0/1002898056 shutdown_connections 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 --2- 10.20.193.28:0/1002898056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67d77f0 0x55f0f67cd5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 --2- 10.20.193.28:0/1002898056 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 0x55f0f67cdb30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 --2- 10.20.193.28:0/1002898056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67b6ed0 0x55f0f67d0860 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=7897502798203468173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 -- 10.20.193.28:0/1002898056 >> 10.20.193.28:0/1002898056 conn(0x55f0f66cd1c0 msgr2=0x55f0f67d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 -- 10.20.193.28:0/1002898056 shutdown_connections 2026-02-20T13:26:25.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.719+0000 7f186f6ade00 1 -- 10.20.193.28:0/1002898056 wait complete. 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f186f6ade00 1 -- start start 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f186f6ade00 1 Processor -- start 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67dd250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67dd790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f186f6ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 0x55f0f67dbfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f186f6ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0f67d75c0 con 0x55f0f67b6ed0 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f186f6ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f0f67dc610 con 0x55f0f67f8110 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f186f6ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f0f67dc7d0 con 0x55f0f67d77f0 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f1866575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67dd790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f1866575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67dd790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:56572/0 (socket says 10.20.193.28:56572) 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f1866575640 1 -- 10.20.193.28:0/2574877012 learned_addr learned my addr 10.20.193.28:0/2574877012 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f1866d76640 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67dd250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.720+0000 7f1867577640 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 0x55f0f67dbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1866575640 1 -- 10.20.193.28:0/2574877012 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 msgr2=0x55f0f67dbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1866575640 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 0x55f0f67dbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1866575640 1 -- 10.20.193.28:0/2574877012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 msgr2=0x55f0f67dd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1866575640 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67dd250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1866575640 1 -- 10.20.193.28:0/2574877012 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f664a0f0 con 0x55f0f67d77f0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1866d76640 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67dd250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1866575640 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67dd790 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=1538946711826666302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850038fd0 tx=0x7f18500414a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155b6fe176af133e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1830bfc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1830bfc640 1 -- 10.20.193.28:0/2574877012 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18500d9ac0 con 0x55f0f67d77f0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1830bfc640 1 -- 10.20.193.28:0/2574877012 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f0f6359520 con 0x55f0f67d77f0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185c011640 con 0x55f0f67d77f0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1830bfc640 1 -- 10.20.193.28:0/2574877012 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18500cd1c0 con 0x55f0f67d77f0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1830bfc640 1 -- 10.20.193.28:0/2574877012 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f18500d1b50 con 0x55f0f67d77f0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1830bfc640 10 client.28594 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f186f6ade00 10 client.28594 _ll_register_callbacks cb 0x55f0f6644a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:25.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0f6769ca0 con 0x55f0f67d77f0 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f1830bfc640 1 -- 10.20.193.28:0/2574877012 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18500d1070 con 0x55f0f67d77f0 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f186f6ade00 10 client.28594 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.721+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f0f663e0d0 con 0x55f0f67d77f0 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f1830bfc640 1 -- 10.20.193.28:0/2574877012 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18500cdae0 con 0x55f0f67d77f0 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f186f6ade00 10 client.28594 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f186f6ade00 10 client.28594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f186f6ade00 20 client.28594 populate_metadata read hostname 'trial028' 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f186f6ade00 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f0f68a4b90 0x55f0f68c4f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f186f6ade00 4 client.28594 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f0f639d640 con 0x55f0f68a4b90 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f1866d76640 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f0f68a4b90 0x55f0f68c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f1866d76640 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f0f68a4b90 0x55f0f68c4f70 crc :-1 s=READY pgs=273 gs=4 cs=0 l=0 c_cookie=5132866393086192654 s_cookie=5854731226260179521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473b9aca17716c0e server_cookie=51402f07d4a00a41 in_seq=0 out_seq=0 2026-02-20T13:26:25.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.722+0000 7f1830bfc640 10 client.28594 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f1830bfc640 1 -- 10.20.193.28:0/2574877012 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f0f639d640 con 0x55f0f68a4b90 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f1830bfc640 10 client.28594 handle_command_reply: tid=0 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 client.28594 shutdown 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 msgr2=0x55f0f67dd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67dd790 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=1538946711826666302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850038fd0 tx=0x7f18500414a0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 shutdown_connections 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f0f68a4b90 0x55f0f68c4f70 crc :-1 s=READY pgs=273 gs=4 cs=0 l=0 c_cookie=5132866393086192654 s_cookie=5854731226260179521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f0f67f8110 0x55f0f67dbfd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f0f67d77f0 0x55f0f67dd790 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=1538946711826666302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 --2- 10.20.193.28:0/2574877012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0f67b6ed0 0x55f0f67dd250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 >> 10.20.193.28:0/2574877012 conn(0x55f0f66cd1c0 msgr2=0x55f0f67cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f1830bfc640 0 client.28594 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 shutdown_connections 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 1 -- 10.20.193.28:0/2574877012 wait complete. 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.727+0000 7f186f6ade00 20 client.28594 trim_cache size 0 max 16384 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 -- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f183c0b5760 msgr2=0x7f183c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f183c0b5760 0x7f183c0d5c10 secure :-1 s=READY pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f185c0095b0 tx=0x7f185c005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 -- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810f2f0 msgr2=0x7f1868171060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810f2f0 0x7f1868171060 secure :-1 s=READY pgs=1056 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18500098a0 tx=0x7f18500028d0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 -- 10.20.193.28:0/3901473788 shutdown_connections 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f183c0b5760 0x7f183c0d5c10 unknown :-1 s=CLOSED pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f186810f2f0 0x7f1868171060 unknown :-1 s=CLOSED pgs=1056 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18681100b0 0x7f18680f8a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 --2- 10.20.193.28:0/3901473788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f186810e940 0x7f18680f8240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 -- 10.20.193.28:0/3901473788 >> 10.20.193.28:0/3901473788 conn(0x7f18680ec320 msgr2=0x7f18680ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 -- 10.20.193.28:0/3901473788 shutdown_connections 2026-02-20T13:26:25.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:25.728+0000 7f186c8c2640 1 -- 10.20.193.28:0/3901473788 wait complete. 2026-02-20T13:26:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:26 trial028 ceph-mon[37442]: pgmap v454: 97 pgs: 97 active+clean; 883 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:26 trial127 ceph-mon[43817]: pgmap v454: 97 pgs: 97 active+clean; 883 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:26 trial034 ceph-mon[43332]: pgmap v454: 97 pgs: 97 active+clean; 883 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:28 trial028 ceph-mon[37442]: pgmap v455: 97 pgs: 97 active+clean; 955 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:28 trial127 ceph-mon[43817]: pgmap v455: 97 pgs: 97 active+clean; 955 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:28 trial034 ceph-mon[43332]: pgmap v455: 97 pgs: 97 active+clean; 955 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:30 trial028 ceph-mon[37442]: pgmap v456: 97 pgs: 97 active+clean; 955 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:26:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:30 trial127 ceph-mon[43817]: pgmap v456: 97 pgs: 97 active+clean; 955 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:26:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:30 trial034 ceph-mon[43332]: pgmap v456: 97 pgs: 97 active+clean; 955 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:26:32.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:32 trial028 ceph-mon[37442]: pgmap v457: 97 pgs: 97 active+clean; 955 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:26:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:32 trial127 ceph-mon[43817]: pgmap v457: 97 pgs: 97 active+clean; 955 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:26:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:32 trial034 ceph-mon[43332]: pgmap v457: 97 pgs: 97 active+clean; 955 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:26:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:34 trial028 ceph-mon[37442]: pgmap v458: 97 pgs: 97 active+clean; 1011 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:34 trial127 ceph-mon[43817]: pgmap v458: 97 pgs: 97 active+clean; 1011 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:34 trial034 ceph-mon[43332]: pgmap v458: 97 pgs: 97 active+clean; 1011 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:36.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:36 trial028 ceph-mon[37442]: pgmap v459: 97 pgs: 97 active+clean; 1011 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:26:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:36 trial127 ceph-mon[43817]: pgmap v459: 97 pgs: 97 active+clean; 1011 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:26:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:36 trial034 ceph-mon[43332]: pgmap v459: 97 pgs: 97 active+clean; 1011 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.800+0000 7f295f577640 1 -- 10.20.193.28:0/1143298727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f296010e940 msgr2=0x7f296010edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.800+0000 7f295f577640 1 --2- 10.20.193.28:0/1143298727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f296010e940 0x7f296010edb0 secure :-1 s=READY pgs=1057 gs=2 cs=0 l=1 c_cookie=5384988929220099426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2948009980 tx=0x7f294802f190 comp rx=0 tx=0).stop 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.800+0000 7f295f577640 1 -- 10.20.193.28:0/1143298727 shutdown_connections 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.800+0000 7f295f577640 1 --2- 10.20.193.28:0/1143298727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f296010e940 0x7f296010edb0 unknown :-1 s=CLOSED pgs=1057 gs=2 cs=0 l=1 c_cookie=5384988929220099426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.800+0000 7f295f577640 1 --2- 10.20.193.28:0/1143298727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f296010f2f0 0x7f2960171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.800+0000 7f295f577640 1 --2- 10.20.193.28:0/1143298727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f29601100b0 0x7f29601104a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.800+0000 7f295f577640 1 -- 10.20.193.28:0/1143298727 >> 10.20.193.28:0/1143298727 conn(0x7f29600ec320 msgr2=0x7f296010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.801+0000 7f295f577640 1 -- 10.20.193.28:0/1143298727 shutdown_connections 2026-02-20T13:26:38.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.801+0000 7f295f577640 1 -- 10.20.193.28:0/1143298727 wait complete. 2026-02-20T13:26:38.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.801+0000 7f295f577640 1 Processor -- start 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.801+0000 7f295f577640 1 -- start start 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295f577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f296010e940 0x7f29600f8240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295f577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f296010f2f0 0x7f2960171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29601100b0 0x7f29600f8aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f29600f9690 con 0x7f29601100b0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295f577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f29600f9800 con 0x7f296010f2f0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295f577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f29600f99c0 con 0x7f296010e940 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29601100b0 0x7f29600f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29601100b0 0x7f29600f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39538/0 (socket says 10.20.193.28:39538) 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 -- 10.20.193.28:0/1006731083 learned_addr learned my addr 10.20.193.28:0/1006731083 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295e575640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f296010e940 0x7f29600f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295dd74640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f296010f2f0 0x7f2960171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 -- 10.20.193.28:0/1006731083 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f296010e940 msgr2=0x7f29600f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f296010e940 0x7f29600f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 -- 10.20.193.28:0/1006731083 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f296010f2f0 msgr2=0x7f2960171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f296010f2f0 0x7f2960171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 -- 10.20.193.28:0/1006731083 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2948009570 con 0x7f29601100b0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295ed76640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29601100b0 0x7f29600f8aa0 secure :-1 s=READY pgs=1058 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f295000f8d0 tx=0x7f295000fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f29477fe640 1 -- 10.20.193.28:0/1006731083 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f295000dce0 con 0x7f29601100b0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295f577640 1 -- 10.20.193.28:0/1006731083 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29600f9ca0 con 0x7f29601100b0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f29477fe640 1 -- 10.20.193.28:0/1006731083 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f295000de40 con 0x7f29601100b0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f29477fe640 1 -- 10.20.193.28:0/1006731083 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29500116b0 con 0x7f29601100b0 2026-02-20T13:26:38.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.802+0000 7f295f577640 1 -- 10.20.193.28:0/1006731083 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29600fa170 con 0x7f29601100b0 2026-02-20T13:26:38.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.805+0000 7f29477fe640 1 -- 10.20.193.28:0/1006731083 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2950020060 con 0x7f29601100b0 2026-02-20T13:26:38.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.806+0000 7f29477fe640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29380b5760 0x7f29380d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29477fe640 1 -- 10.20.193.28:0/1006731083 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2950015070 con 0x7f29601100b0 2026-02-20T13:26:38.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f295e575640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29380b5760 0x7f29380d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29673d2e00 1 Processor -- start 2026-02-20T13:26:38.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f295e575640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29380b5760 0x7f29380d5c10 secure :-1 s=READY pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2954004740 tx=0x7f2954005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:38.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29673d2e00 1 -- start start 2026-02-20T13:26:38.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 0x556aae9ec8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9ecde0 0x556aaea0d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 0x556aaea2dae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29673d2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556aae8e1fd0 con 0x556aae9ecde0 2026-02-20T13:26:38.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29673d2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556aae8ddd00 con 0x556aae9cc4c0 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.807+0000 7f29673d2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556aae8d7ca0 con 0x556aaea0d700 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9ecde0 0x556aaea0d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295e575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 0x556aae9ec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9ecde0 0x556aaea0d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39550/0 (socket says 10.20.193.28:39550) 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 -- 10.20.193.28:0/2119132368 learned_addr learned my addr 10.20.193.28:0/2119132368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295ed76640 1 --2- 10.20.193.28:0/2119132368 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 0x556aaea2dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 -- 10.20.193.28:0/2119132368 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 msgr2=0x556aaea2dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 --2- 10.20.193.28:0/2119132368 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 0x556aaea2dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 -- 10.20.193.28:0/2119132368 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 msgr2=0x556aae9ec8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 --2- 10.20.193.28:0/2119132368 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 0x556aae9ec8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 -- 10.20.193.28:0/2119132368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aae87a8b0 con 0x556aae9ecde0 2026-02-20T13:26:38.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f295dd74640 1 --2- 10.20.193.28:0/2119132368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9ecde0 0x556aaea0d1c0 secure :-1 s=READY pgs=1059 gs=2 cs=0 l=1 c_cookie=10863453358361407084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29480047c0 tx=0x7f2948005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c2bd45bb27ee6c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f2944ff9640 1 -- 10.20.193.28:0/2119132368 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2948038690 con 0x556aae9ecde0 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f2944ff9640 1 -- 10.20.193.28:0/2119132368 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2948002e20 con 0x556aae9ecde0 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.808+0000 7f2944ff9640 1 -- 10.20.193.28:0/2119132368 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2948038ba0 con 0x556aae9ecde0 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 -- 10.20.193.28:0/2119132368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9ecde0 msgr2=0x556aaea0d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 --2- 10.20.193.28:0/2119132368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9ecde0 0x556aaea0d1c0 secure :-1 s=READY pgs=1059 gs=2 cs=0 l=1 c_cookie=10863453358361407084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29480047c0 tx=0x7f2948005bd0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 -- 10.20.193.28:0/2119132368 shutdown_connections 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 --2- 10.20.193.28:0/2119132368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9ecde0 0x556aaea0d1c0 unknown :-1 s=CLOSED pgs=1059 gs=2 cs=0 l=1 c_cookie=10863453358361407084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 --2- 10.20.193.28:0/2119132368 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 0x556aaea2dae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 --2- 10.20.193.28:0/2119132368 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 0x556aae9ec8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 -- 10.20.193.28:0/2119132368 >> 10.20.193.28:0/2119132368 conn(0x556aae8eb1c0 msgr2=0x556aae9cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 -- 10.20.193.28:0/2119132368 shutdown_connections 2026-02-20T13:26:38.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.809+0000 7f29673d2e00 1 -- 10.20.193.28:0/2119132368 wait complete. 2026-02-20T13:26:38.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.810+0000 7f29673d2e00 1 -- start start 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f29673d2e00 1 Processor -- start 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 0x556aae9e5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e6140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aaea0d700 0x556aae9e6ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f29673d2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556aae9e7200 con 0x556aaea0d700 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f29673d2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556aae9e7370 con 0x556aae9cc4c0 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f29673d2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556aae9e7530 con 0x556aae9ecde0 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aaea0d700 0x556aae9e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aaea0d700 0x556aae9e6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39554/0 (socket says 10.20.193.28:39554) 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295ed76640 1 -- 10.20.193.28:0/398042706 learned_addr learned my addr 10.20.193.28:0/398042706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295e575640 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 0x556aae9e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295dd74640 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e6140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295ed76640 1 -- 10.20.193.28:0/398042706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 msgr2=0x556aae9e6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295ed76640 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e6140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295ed76640 1 -- 10.20.193.28:0/398042706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 msgr2=0x556aae9e5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295ed76640 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 0x556aae9e5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.811+0000 7f295ed76640 1 -- 10.20.193.28:0/398042706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aae883400 con 0x556aaea0d700 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f295ed76640 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aaea0d700 0x556aae9e6ba0 secure :-1 s=READY pgs=1060 gs=1 cs=0 l=1 c_cookie=2677548260891338044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29500adf70 tx=0x7f2950006400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25288ff4ff64a53c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f290ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f290ffff640 1 -- 10.20.193.28:0/398042706 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29500add50 con 0x556aaea0d700 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f290ffff640 1 -- 10.20.193.28:0/398042706 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f29500d32f0 con 0x556aaea0d700 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f290ffff640 1 -- 10.20.193.28:0/398042706 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29500b8c40 con 0x556aaea0d700 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2960171ae0 con 0x556aaea0d700 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f290ffff640 1 -- 10.20.193.28:0/398042706 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f29500b8dc0 con 0x556aaea0d700 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f290ffff640 10 client.18744 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:26:38.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 10 client.18744 _ll_register_callbacks cb 0x556aae862a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556aae577520 con 0x556aaea0d700 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f290ffff640 1 -- 10.20.193.28:0/398042706 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29500b90d0 con 0x556aaea0d700 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 10 client.18744 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556aae85bda0 con 0x556aaea0d700 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f290ffff640 1 -- 10.20.193.28:0/398042706 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29500b1070 con 0x556aaea0d700 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 10 client.18744 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 10 client.18744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 20 client.18744 populate_metadata read hostname 'trial028' 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.812+0000 7f29673d2e00 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556aae9ea270 0x556aae9ea710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.813+0000 7f29673d2e00 4 client.18744 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.813+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aae909630 con 0x556aae9ea270 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.813+0000 7f295e575640 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556aae9ea270 0x556aae9ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.813+0000 7f295e575640 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556aae9ea270 0x556aae9ea710 crc :-1 s=READY pgs=274 gs=4 cs=0 l=0 c_cookie=2671716794278361761 s_cookie=2057391022730582510 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2513d844df683aa1 server_cookie=1c8d523c11ef19ee in_seq=0 out_seq=0 2026-02-20T13:26:38.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.813+0000 7f290ffff640 10 client.18744 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f290ffff640 1 -- 10.20.193.28:0/398042706 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556aae909630 con 0x556aae9ea270 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f290ffff640 10 client.18744 handle_command_reply: tid=0 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 client.18744 shutdown 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aaea0d700 msgr2=0x556aae9e6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aaea0d700 0x556aae9e6ba0 secure :-1 s=READY pgs=1060 gs=1 cs=0 l=1 c_cookie=2677548260891338044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29500adf70 tx=0x7f2950006400 comp rx=0 tx=0).stop 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 shutdown_connections 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556aae9ea270 0x556aae9ea710 crc :-1 s=READY pgs=274 gs=4 cs=0 l=0 c_cookie=2671716794278361761 s_cookie=2057391022730582510 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aaea0d700 0x556aae9e6ba0 unknown :-1 s=CLOSED pgs=1060 gs=1 cs=0 l=1 c_cookie=2677548260891338044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e6140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 --2- 10.20.193.28:0/398042706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9cc4c0 0x556aae9e5af0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f290ffff640 0 client.18744 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 >> 10.20.193.28:0/398042706 conn(0x556aae8eb1c0 msgr2=0x556aae9cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 shutdown_connections 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.814+0000 7f29673d2e00 1 -- 10.20.193.28:0/398042706 wait complete. 2026-02-20T13:26:38.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.815+0000 7f29673d2e00 20 client.18744 trim_cache size 0 max 16384 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f29673d2e00 1 Processor -- start 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f29673d2e00 1 -- start start 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9e6090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aaea0d700 0x556aae9e3360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f29673d2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556aae8d58d0 con 0x556aae9cc4c0 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f29673d2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556aae616f10 con 0x556aaea0d700 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f29673d2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556aae93d4f0 con 0x556aae9ecde0 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295dd74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295dd74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42788/0 (socket says 10.20.193.28:42788) 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295dd74640 1 -- 10.20.193.28:0/1247432351 learned_addr learned my addr 10.20.193.28:0/1247432351 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295ed76640 1 --2- 10.20.193.28:0/1247432351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aaea0d700 0x556aae9e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295e575640 1 -- 10.20.193.28:0/1247432351 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 msgr2=0x556aae9e2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295e575640 1 --2- 10.20.193.28:0/1247432351 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295e575640 1 -- 10.20.193.28:0/1247432351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aaea0d700 msgr2=0x556aae9e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295e575640 1 --2- 10.20.193.28:0/1247432351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aaea0d700 0x556aae9e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.823+0000 7f295e575640 1 -- 10.20.193.28:0/1247432351 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aae86d670 con 0x556aae9cc4c0 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f295e575640 1 --2- 10.20.193.28:0/1247432351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9e6090 secure :-1 s=READY pgs=1061 gs=1 cs=0 l=1 c_cookie=15090287890773590086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x556aae9ead10 tx=0x7f2954014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16b78e287f04046 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f292a3ff640 1 -- 10.20.193.28:0/1247432351 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f295402aa40 con 0x556aae9cc4c0 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f292a3ff640 1 -- 10.20.193.28:0/1247432351 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2954022040 con 0x556aae9cc4c0 2026-02-20T13:26:38.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f292a3ff640 1 -- 10.20.193.28:0/1247432351 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f295401a6f0 con 0x556aae9cc4c0 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 -- 10.20.193.28:0/1247432351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 msgr2=0x556aae9e6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1247432351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9e6090 secure :-1 s=READY pgs=1061 gs=1 cs=0 l=1 c_cookie=15090287890773590086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x556aae9ead10 tx=0x7f2954014000 comp rx=0 tx=0).stop 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 -- 10.20.193.28:0/1247432351 shutdown_connections 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1247432351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aaea0d700 0x556aae9e3360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1247432351 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aae9ecde0 0x556aae9e2e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1247432351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9e6090 unknown :-1 s=CLOSED pgs=1061 gs=1 cs=0 l=1 c_cookie=15090287890773590086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 -- 10.20.193.28:0/1247432351 >> 10.20.193.28:0/1247432351 conn(0x556aae8eb1c0 msgr2=0x556aae9e5980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 -- 10.20.193.28:0/1247432351 shutdown_connections 2026-02-20T13:26:38.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.824+0000 7f29673d2e00 1 -- 10.20.193.28:0/1247432351 wait complete. 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f29673d2e00 1 -- start start 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f29673d2e00 1 Processor -- start 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9ed1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9ecde0 0x556aae9ed730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f29673d2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 0x556aae9ede20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f29673d2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556aae9a7810 con 0x556aae9cc4c0 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f29673d2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556aae93b490 con 0x556aae9ecde0 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f29673d2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556aae9ee5d0 con 0x556aaea0d700 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f295e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f295ed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 0x556aae9ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f295e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9ed1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39582/0 (socket says 10.20.193.28:39582) 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f295e575640 1 -- 10.20.193.28:0/1537246471 learned_addr learned my addr 10.20.193.28:0/1537246471 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.825+0000 7f295dd74640 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9ecde0 0x556aae9ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f295e575640 1 -- 10.20.193.28:0/1537246471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 msgr2=0x556aae9ede20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f295e575640 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 0x556aae9ede20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f295e575640 1 -- 10.20.193.28:0/1537246471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9ecde0 msgr2=0x556aae9ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:38.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f295e575640 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9ecde0 0x556aae9ed730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f295e575640 1 -- 10.20.193.28:0/1537246471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aae85c0d0 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f295e575640 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9ed1b0 secure :-1 s=READY pgs=1062 gs=1 cs=0 l=1 c_cookie=9953668796480573233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29540097e0 tx=0x7f2954005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2289089a1d4f31 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f290ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f290ffff640 1 -- 10.20.193.28:0/1537246471 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f295402ac60 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f290ffff640 1 -- 10.20.193.28:0/1537246471 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f295401a680 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f290ffff640 1 -- 10.20.193.28:0/1537246471 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2954034c50 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aae8680f0 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f290ffff640 1 -- 10.20.193.28:0/1537246471 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2954034de0 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f290ffff640 10 client.18750 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f29673d2e00 10 client.18750 _ll_register_callbacks cb 0x556aae862a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556aae987ca0 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f290ffff640 1 -- 10.20.193.28:0/1537246471 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f295402adc0 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f29673d2e00 10 client.18750 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.826+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556aae86d8d0 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.827+0000 7f290ffff640 1 -- 10.20.193.28:0/1537246471 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f295403b060 con 0x556aae9cc4c0 2026-02-20T13:26:38.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.827+0000 7f29673d2e00 10 client.18750 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:38.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.827+0000 7f29673d2e00 10 client.18750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:38.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.827+0000 7f29673d2e00 20 client.18750 populate_metadata read hostname 'trial028' 2026-02-20T13:26:38.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.827+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556aae9f04e0 0x556aae9f0980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:38.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.827+0000 7f29673d2e00 4 client.18750 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:26:38.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.827+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556aae5bb640 con 0x556aae9f04e0 2026-02-20T13:26:38.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.827+0000 7f295dd74640 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556aae9f04e0 0x556aae9f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:38.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.828+0000 7f295dd74640 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556aae9f04e0 0x556aae9f0980 crc :-1 s=READY pgs=275 gs=4 cs=0 l=0 c_cookie=12945088364117548103 s_cookie=5075707071462843231 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3a63147f944dc47 server_cookie=467088b0727b235f in_seq=0 out_seq=0 2026-02-20T13:26:38.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.828+0000 7f290ffff640 10 client.18750 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:38.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f290ffff640 1 -- 10.20.193.28:0/1537246471 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556aae5bb640 con 0x556aae9f04e0 2026-02-20T13:26:38.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f290ffff640 10 client.18750 handle_command_reply: tid=0 2026-02-20T13:26:38.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 client.18750 shutdown 2026-02-20T13:26:38.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 msgr2=0x556aae9ed1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9ed1b0 secure :-1 s=READY pgs=1062 gs=1 cs=0 l=1 c_cookie=9953668796480573233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29540097e0 tx=0x7f2954005680 comp rx=0 tx=0).stop 2026-02-20T13:26:38.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 shutdown_connections 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556aae9f04e0 0x556aae9f0980 crc :-1 s=READY pgs=275 gs=4 cs=0 l=0 c_cookie=12945088364117548103 s_cookie=5075707071462843231 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556aaea0d700 0x556aae9ede20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556aae9ecde0 0x556aae9ed730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 --2- 10.20.193.28:0/1537246471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556aae9cc4c0 0x556aae9ed1b0 unknown :-1 s=CLOSED pgs=1062 gs=1 cs=0 l=1 c_cookie=9953668796480573233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.832+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 >> 10.20.193.28:0/1537246471 conn(0x556aae8eb1c0 msgr2=0x556aae9e5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f290ffff640 0 client.18750 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 shutdown_connections 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f29673d2e00 1 -- 10.20.193.28:0/1537246471 wait complete. 2026-02-20T13:26:38.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f29673d2e00 20 client.18750 trim_cache size 0 max 16384 2026-02-20T13:26:38.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:26:38.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:26:38.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:26:38.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:26:38.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 -- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29380b5760 msgr2=0x7f29380d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29380b5760 0x7f29380d5c10 secure :-1 s=READY pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2954004740 tx=0x7f2954005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:38.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 -- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29601100b0 msgr2=0x7f29600f8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:38.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29601100b0 0x7f29600f8aa0 secure :-1 s=READY pgs=1058 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f295000f8d0 tx=0x7f295000fda0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 -- 10.20.193.28:0/1006731083 shutdown_connections 2026-02-20T13:26:38.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29380b5760 0x7f29380d5c10 unknown :-1 s=CLOSED pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29601100b0 0x7f29600f8aa0 unknown :-1 s=CLOSED pgs=1058 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f296010f2f0 0x7f2960171080 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 --2- 10.20.193.28:0/1006731083 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f296010e940 0x7f29600f8240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:38.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 -- 10.20.193.28:0/1006731083 >> 10.20.193.28:0/1006731083 conn(0x7f29600ec320 msgr2=0x7f29600ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:38.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 -- 10.20.193.28:0/1006731083 shutdown_connections 2026-02-20T13:26:38.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:38.833+0000 7f295f577640 1 -- 10.20.193.28:0/1006731083 wait complete. 2026-02-20T13:26:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:38 trial028 ceph-mon[37442]: pgmap v460: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:26:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:38 trial127 ceph-mon[43817]: pgmap v460: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:26:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:38 trial034 ceph-mon[43332]: pgmap v460: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:26:40.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: pgmap v461: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:26:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:26:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:40.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:40 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: pgmap v461: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:26:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:26:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:40.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:40 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: pgmap v461: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:40.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:40.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:40 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:41.256 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:26:41.446 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:41.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial127 to 16915M 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial034 to 16915M 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:26:41.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:41.579 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:26:41.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 -- 10.20.193.28:0/1688776070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 msgr2=0x7f1848176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 --2- 10.20.193.28:0/1688776070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 0x7f1848176070 secure :-1 s=READY pgs=1063 gs=2 cs=0 l=1 c_cookie=16380345703928664191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f183800aa30 tx=0x7f1838030270 comp rx=0 tx=0).stop 2026-02-20T13:26:41.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 -- 10.20.193.28:0/1688776070 shutdown_connections 2026-02-20T13:26:41.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 --2- 10.20.193.28:0/1688776070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 0x7f1848176070 unknown :-1 s=CLOSED pgs=1063 gs=2 cs=0 l=1 c_cookie=16380345703928664191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 --2- 10.20.193.28:0/1688776070 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f184810fea0 0x7f1848114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 --2- 10.20.193.28:0/1688776070 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f184810f4b0 0x7f184810f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 -- 10.20.193.28:0/1688776070 >> 10.20.193.28:0/1688776070 conn(0x7f18480ecda0 msgr2=0x7f184810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:41.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 -- 10.20.193.28:0/1688776070 shutdown_connections 2026-02-20T13:26:41.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.619+0000 7f1847577640 1 -- 10.20.193.28:0/1688776070 wait complete. 2026-02-20T13:26:41.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1847577640 1 Processor -- start 2026-02-20T13:26:41.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1847577640 1 -- start start 2026-02-20T13:26:41.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1847577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f184810f4b0 0x7f18480f5740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1847577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f184810fea0 0x7f1848175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1847577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 0x7f18480f5e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1847577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f18480fb050 con 0x7f18481156a0 2026-02-20T13:26:41.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1847577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f18480fb1c0 con 0x7f184810f4b0 2026-02-20T13:26:41.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1847577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f18480fb380 con 0x7f184810fea0 2026-02-20T13:26:41.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 0x7f18480f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 0x7f18480f5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46130/0 (socket says 10.20.193.28:46130) 2026-02-20T13:26:41.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846d76640 1 -- 10.20.193.28:0/4244289570 learned_addr learned my addr 10.20.193.28:0/4244289570 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:41.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846575640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f184810f4b0 0x7f18480f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1845d74640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f184810fea0 0x7f1848175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846d76640 1 -- 10.20.193.28:0/4244289570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f184810fea0 msgr2=0x7f1848175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846d76640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f184810fea0 0x7f1848175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846d76640 1 -- 10.20.193.28:0/4244289570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f184810f4b0 msgr2=0x7f18480f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846d76640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f184810f4b0 0x7f18480f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846d76640 1 -- 10.20.193.28:0/4244289570 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183800a650 con 0x7f18481156a0 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1846575640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f184810f4b0 0x7f18480f5740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.620+0000 7f1845d74640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f184810fea0 0x7f1848175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.621+0000 7f1846d76640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 0x7f18480f5e40 secure :-1 s=READY pgs=1064 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1838006a50 tx=0x7f18380039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.621+0000 7f182f7fe640 1 -- 10.20.193.28:0/4244289570 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f183803e070 con 0x7f18481156a0 2026-02-20T13:26:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.621+0000 7f182f7fe640 1 -- 10.20.193.28:0/4244289570 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18380055a0 con 0x7f18481156a0 2026-02-20T13:26:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.621+0000 7f1847577640 1 -- 10.20.193.28:0/4244289570 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18480fb600 con 0x7f18481156a0 2026-02-20T13:26:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.621+0000 7f182f7fe640 1 -- 10.20.193.28:0/4244289570 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1838042960 con 0x7f18481156a0 2026-02-20T13:26:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.621+0000 7f1847577640 1 -- 10.20.193.28:0/4244289570 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18480fba70 con 0x7f18481156a0 2026-02-20T13:26:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.624+0000 7f182f7fe640 1 -- 10.20.193.28:0/4244289570 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1838039b40 con 0x7f18481156a0 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.625+0000 7f182f7fe640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18200b5750 0x7f18200d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f182f7fe640 1 -- 10.20.193.28:0/4244289570 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f183810c870 con 0x7f18481156a0 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f1846575640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18200b5750 0x7f18200d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f184eb82e00 1 Processor -- start 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f184eb82e00 1 -- start start 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f1846575640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18200b5750 0x7f18200d5c00 secure :-1 s=READY pgs=473 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f183c004740 tx=0x7f183c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c53550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c98400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077cb8d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f184eb82e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556077b697d0 con 0x556077c53a90 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f184eb82e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556077b65500 con 0x556077c53180 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.626+0000 7f184eb82e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556077b5f4a0 con 0x556077c98940 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c53550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c53550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33428/0 (socket says 10.20.193.28:33428) 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 -- 10.20.193.28:0/3594244692 learned_addr learned my addr 10.20.193.28:0/3594244692 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846d76640 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077cb8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1845d74640 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c98400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 -- 10.20.193.28:0/3594244692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 msgr2=0x556077cb8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077cb8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 -- 10.20.193.28:0/3594244692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 msgr2=0x556077c98400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c98400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 -- 10.20.193.28:0/3594244692 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556077b0ad80 con 0x556077c53180 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1845d74640 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c98400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f1846575640 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c53550 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=15735006100206820972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f183c003010 tx=0x7f183c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5df8ae356e9e6c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.627+0000 7f182cff9640 1 -- 10.20.193.28:0/3594244692 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f183c011e60 con 0x556077c53180 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f182cff9640 1 -- 10.20.193.28:0/3594244692 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f183c01d940 con 0x556077c53180 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f182cff9640 1 -- 10.20.193.28:0/3594244692 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f183c01abd0 con 0x556077c53180 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 -- 10.20.193.28:0/3594244692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 msgr2=0x556077c53550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c53550 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=15735006100206820972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f183c003010 tx=0x7f183c013000 comp rx=0 tx=0).stop 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 -- 10.20.193.28:0/3594244692 shutdown_connections 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c98400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077cb8d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 --2- 10.20.193.28:0/3594244692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c53550 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=15735006100206820972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 -- 10.20.193.28:0/3594244692 >> 10.20.193.28:0/3594244692 conn(0x556077c31680 msgr2=0x556077c51a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 -- 10.20.193.28:0/3594244692 shutdown_connections 2026-02-20T13:26:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.628+0000 7f184eb82e00 1 -- 10.20.193.28:0/3594244692 wait complete. 2026-02-20T13:26:41.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.629+0000 7f184eb82e00 1 -- start start 2026-02-20T13:26:41.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.629+0000 7f184eb82e00 1 Processor -- start 2026-02-20T13:26:41.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53180 0x556077cb0130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53a90 0x556077cb0670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077cb5660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f184eb82e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556077cb5ba0 con 0x556077c53180 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f184eb82e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556077cb5d10 con 0x556077c53a90 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f184eb82e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556077cb5ed0 con 0x556077c98940 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53a90 0x556077cb0670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1846575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53180 0x556077cb0130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53a90 0x556077cb0670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33440/0 (socket says 10.20.193.28:33440) 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 -- 10.20.193.28:0/75671576 learned_addr learned my addr 10.20.193.28:0/75671576 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1846d76640 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077cb5660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 -- 10.20.193.28:0/75671576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 msgr2=0x556077cb5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077cb5660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 -- 10.20.193.28:0/75671576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53180 msgr2=0x556077cb0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:41.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53180 0x556077cb0130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 -- 10.20.193.28:0/75671576 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556077ae3350 con 0x556077c53a90 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f1845d74640 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53a90 0x556077cb0670 secure :-1 s=READY pgs=387 gs=2 cs=0 l=1 c_cookie=11639613245774361604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1830002fd0 tx=0x7f1830010810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1883693e54ff404 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.630+0000 7f17f7fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f17f7fff640 1 -- 10.20.193.28:0/75671576 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1830012940 con 0x556077c53a90 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f17f7fff640 1 -- 10.20.193.28:0/75671576 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f183001b480 con 0x556077c53a90 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f17f7fff640 1 -- 10.20.193.28:0/75671576 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1830011660 con 0x556077c53a90 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c002dd0 con 0x556077c53a90 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f17f7fff640 1 -- 10.20.193.28:0/75671576 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1830016070 con 0x556077c53a90 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f184eb82e00 10 client.28718 _ll_register_callbacks cb 0x556077ae09a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5560777f56f0 con 0x556077c53a90 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f17f7fff640 1 -- 10.20.193.28:0/75671576 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1830012aa0 con 0x556077c53a90 2026-02-20T13:26:41.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f184eb82e00 10 client.28718 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556077af5150 con 0x556077c53a90 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f17f7fff640 1 -- 10.20.193.28:0/75671576 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1830012c00 con 0x556077c53a90 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f184eb82e00 10 client.28718 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.631+0000 7f184eb82e00 10 client.28718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.632+0000 7f184eb82e00 20 client.28718 populate_metadata read hostname 'trial028' 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.632+0000 7f184eb82e00 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556077c95ae0 0x556077c95f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.632+0000 7f184eb82e00 4 client.28718 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.632+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556077b6cd60 con 0x556077c95ae0 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.632+0000 7f1846575640 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556077c95ae0 0x556077c95f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.632+0000 7f1846575640 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556077c95ae0 0x556077c95f80 crc :-1 s=READY pgs=276 gs=4 cs=0 l=0 c_cookie=4987850139254651349 s_cookie=3318809694680168130 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453867465f27f9d5 server_cookie=2e0ec7d56088b6c2 in_seq=0 out_seq=0 2026-02-20T13:26:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.632+0000 7f17f7fff640 10 client.28718 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f17f7fff640 1 -- 10.20.193.28:0/75671576 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556077b6cd60 con 0x556077c95ae0 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f17f7fff640 10 client.28718 handle_command_reply: tid=0 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 client.28718 shutdown 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53a90 msgr2=0x556077cb0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53a90 0x556077cb0670 secure :-1 s=READY pgs=387 gs=2 cs=0 l=1 c_cookie=11639613245774361604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1830002fd0 tx=0x7f1830010810 comp rx=0 tx=0).stop 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 shutdown_connections 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556077c95ae0 0x556077c95f80 crc :-1 s=READY pgs=276 gs=4 cs=0 l=0 c_cookie=4987850139254651349 s_cookie=3318809694680168130 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077cb5660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53a90 0x556077cb0670 unknown :-1 s=CLOSED pgs=387 gs=2 cs=0 l=1 c_cookie=11639613245774361604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 --2- 10.20.193.28:0/75671576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53180 0x556077cb0130 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 >> 10.20.193.28:0/75671576 conn(0x556077c31680 msgr2=0x556077c51a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:41.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f17f7fff640 0 client.28718 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:41.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 shutdown_connections 2026-02-20T13:26:41.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 1 -- 10.20.193.28:0/75671576 wait complete. 2026-02-20T13:26:41.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.633+0000 7f184eb82e00 20 client.28718 trim_cache size 0 max 16384 2026-02-20T13:26:41.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f184eb82e00 1 Processor -- start 2026-02-20T13:26:41.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f184eb82e00 1 -- start start 2026-02-20T13:26:41.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c53180 0x556077cadc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c92590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c98940 0x556077c92ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f184eb82e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556077b5d0d0 con 0x556077c53a90 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f184eb82e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55607781d700 con 0x556077c98940 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f184eb82e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556077ca91e0 con 0x556077c53180 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1846575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c53180 0x556077cadc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1845d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c92590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1845d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c92590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46152/0 (socket says 10.20.193.28:46152) 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1845d74640 1 -- 10.20.193.28:0/3836392214 learned_addr learned my addr 10.20.193.28:0/3836392214 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1846d76640 1 --2- 10.20.193.28:0/3836392214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c98940 0x556077c92ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1845d74640 1 -- 10.20.193.28:0/3836392214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c53180 msgr2=0x556077cadc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:41.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1845d74640 1 --2- 10.20.193.28:0/3836392214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c53180 0x556077cadc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1845d74640 1 -- 10.20.193.28:0/3836392214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c98940 msgr2=0x556077c92ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:41.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1845d74640 1 --2- 10.20.193.28:0/3836392214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c98940 0x556077c92ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.644+0000 7f1845d74640 1 -- 10.20.193.28:0/3836392214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556077aefbd0 con 0x556077c53a90 2026-02-20T13:26:41.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f1845d74640 1 --2- 10.20.193.28:0/3836392214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c92590 secure :-1 s=READY pgs=1065 gs=2 cs=0 l=1 c_cookie=17137071523995946719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1830011010 tx=0x7f183001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd31bc1463d8edf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:41.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f18124e6640 1 -- 10.20.193.28:0/3836392214 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1830011e70 con 0x556077c53a90 2026-02-20T13:26:41.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f18124e6640 1 -- 10.20.193.28:0/3836392214 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5560777f56f0 con 0x556077c53a90 2026-02-20T13:26:41.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f18124e6640 1 -- 10.20.193.28:0/3836392214 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f183000eee0 con 0x556077c53a90 2026-02-20T13:26:41.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 -- 10.20.193.28:0/3836392214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 msgr2=0x556077c92590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 --2- 10.20.193.28:0/3836392214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c92590 secure :-1 s=READY pgs=1065 gs=2 cs=0 l=1 c_cookie=17137071523995946719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1830011010 tx=0x7f183001f000 comp rx=0 tx=0).stop 2026-02-20T13:26:41.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 -- 10.20.193.28:0/3836392214 shutdown_connections 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 --2- 10.20.193.28:0/3836392214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c92590 unknown :-1 s=CLOSED pgs=1065 gs=2 cs=0 l=1 c_cookie=17137071523995946719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 --2- 10.20.193.28:0/3836392214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c98940 0x556077c92ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 --2- 10.20.193.28:0/3836392214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c53180 0x556077cadc10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 -- 10.20.193.28:0/3836392214 >> 10.20.193.28:0/3836392214 conn(0x556077c31680 msgr2=0x556077cac4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 -- 10.20.193.28:0/3836392214 shutdown_connections 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.645+0000 7f184eb82e00 1 -- 10.20.193.28:0/3836392214 wait complete. 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f184eb82e00 1 -- start start 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f184eb82e00 1 Processor -- start 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c376a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c32d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f184eb82e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077c33340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f184eb82e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556077c33a90 con 0x556077c53a90 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f184eb82e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556077c33c00 con 0x556077c53180 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f184eb82e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556077cfe370 con 0x556077c98940 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f1846575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f1845d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c32d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f1846575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c376a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33456/0 (socket says 10.20.193.28:33456) 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f1846575640 1 -- 10.20.193.28:0/1319260023 learned_addr learned my addr 10.20.193.28:0/1319260023 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.646+0000 7f1846d76640 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077c33340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f1845d74640 1 -- 10.20.193.28:0/1319260023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 msgr2=0x556077c33340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f1845d74640 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077c33340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f1845d74640 1 -- 10.20.193.28:0/1319260023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 msgr2=0x556077c376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f1845d74640 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f1845d74640 1 -- 10.20.193.28:0/1319260023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556077ae3680 con 0x556077c53a90 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f1845d74640 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c32d80 secure :-1 s=READY pgs=1066 gs=2 cs=0 l=1 c_cookie=14115256479760412831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18300118c0 tx=0x7f1830004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e376fb85a6709f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f17f7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f17f7fff640 1 -- 10.20.193.28:0/1319260023 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1830011690 con 0x556077c53a90 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f17f7fff640 1 -- 10.20.193.28:0/1319260023 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1830026e70 con 0x556077c53a90 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f17f7fff640 1 -- 10.20.193.28:0/1319260023 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1830011c60 con 0x556077c53a90 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556077af5150 con 0x556077c53a90 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f184eb82e00 10 client.18765 _ll_register_callbacks cb 0x556077ae09a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f17f7fff640 1 -- 10.20.193.28:0/1319260023 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1830016070 con 0x556077c53a90 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f183c01d940 con 0x556077c53a90 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.647+0000 7f17f7fff640 1 -- 10.20.193.28:0/1319260023 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1830047050 con 0x556077c53a90 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f184eb82e00 10 client.18765 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:41.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556077af53b0 con 0x556077c53a90 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f17f7fff640 1 -- 10.20.193.28:0/1319260023 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f183003f020 con 0x556077c53a90 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f184eb82e00 10 client.18765 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f184eb82e00 10 client.18765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f184eb82e00 20 client.18765 populate_metadata read hostname 'trial028' 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f184eb82e00 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556077d45f60 0x556077d66410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f184eb82e00 4 client.18765 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560777f2f40 con 0x556077d45f60 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.648+0000 7f1846575640 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556077d45f60 0x556077d66410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f17f7fff640 10 client.18765 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f1846575640 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556077d45f60 0x556077d66410 crc :-1 s=READY pgs=277 gs=4 cs=0 l=0 c_cookie=16219335657002370842 s_cookie=16568232857201122812 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e116a7d8a874071a server_cookie=e5ee3000596d9dfc in_seq=0 out_seq=0 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f17f7fff640 1 -- 10.20.193.28:0/1319260023 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x5560777f2f40 con 0x556077d45f60 2026-02-20T13:26:41.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f17f7fff640 10 client.18765 handle_command_reply: tid=0 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 client.18765 shutdown 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 msgr2=0x556077c32d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c32d80 secure :-1 s=READY pgs=1066 gs=2 cs=0 l=1 c_cookie=14115256479760412831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18300118c0 tx=0x7f1830004390 comp rx=0 tx=0).stop 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 shutdown_connections 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556077d45f60 0x556077d66410 crc :-1 s=READY pgs=277 gs=4 cs=0 l=0 c_cookie=16219335657002370842 s_cookie=16568232857201122812 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556077c53a90 0x556077c32d80 unknown :-1 s=CLOSED pgs=1066 gs=2 cs=0 l=1 c_cookie=14115256479760412831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556077c98940 0x556077c33340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 --2- 10.20.193.28:0/1319260023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556077c53180 0x556077c376a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 >> 10.20.193.28:0/1319260023 conn(0x556077c31680 msgr2=0x556077cacce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f17f7fff640 0 client.18765 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 shutdown_connections 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.649+0000 7f184eb82e00 1 -- 10.20.193.28:0/1319260023 wait complete. 2026-02-20T13:26:41.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.650+0000 7f184eb82e00 20 client.18765 trim_cache size 0 max 16384 2026-02-20T13:26:41.658 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:26:41.658 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:26:41.658 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:26:41.658 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.659 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.660 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.661 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:26:41.662 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.663 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:26:41.664 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.665 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.666 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.667 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:41.668 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:26:41.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.650+0000 7f1847577640 1 -- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18200b5750 msgr2=0x7f18200d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.650+0000 7f1847577640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18200b5750 0x7f18200d5c00 secure :-1 s=READY pgs=473 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f183c004740 tx=0x7f183c005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:41.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.650+0000 7f1847577640 1 -- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 msgr2=0x7f18480f5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:41.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.650+0000 7f1847577640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 0x7f18480f5e40 secure :-1 s=READY pgs=1064 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1838006a50 tx=0x7f18380039b0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.651+0000 7f1847577640 1 -- 10.20.193.28:0/4244289570 shutdown_connections 2026-02-20T13:26:41.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.651+0000 7f1847577640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18200b5750 0x7f18200d5c00 unknown :-1 s=CLOSED pgs=473 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.651+0000 7f1847577640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18481156a0 0x7f18480f5e40 unknown :-1 s=CLOSED pgs=1064 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.651+0000 7f1847577640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f184810fea0 0x7f1848175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.651+0000 7f1847577640 1 --2- 10.20.193.28:0/4244289570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f184810f4b0 0x7f18480f5740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:41.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.651+0000 7f1847577640 1 -- 10.20.193.28:0/4244289570 >> 10.20.193.28:0/4244289570 conn(0x7f18480ecda0 msgr2=0x7f184810d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:41.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.651+0000 7f1847577640 1 -- 10.20.193.28:0/4244289570 shutdown_connections 2026-02-20T13:26:41.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:41.651+0000 7f1847577640 1 -- 10.20.193.28:0/4244289570 wait complete. 2026-02-20T13:26:41.792 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:26:41.792 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:26:41.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial127 to 16915M 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial034 to 16915M 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:26:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:41.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:26:41.979 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:41.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial127 to 16915M 2026-02-20T13:26:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial034 to 16915M 2026-02-20T13:26:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-20T13:26:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:26:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:26:41.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:26:41.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:26:42.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.145+0000 7faa470c1640 1 -- 10.20.193.28:0/2944763367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa4010f230 msgr2=0x7faa4010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.145+0000 7faa470c1640 1 --2- 10.20.193.28:0/2944763367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa4010f230 0x7faa4010f600 secure :-1 s=READY pgs=1067 gs=1 cs=0 l=1 c_cookie=10747215766692285221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa30009950 tx=0x7faa3002f190 comp rx=0 tx=0).stop 2026-02-20T13:26:42.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.146+0000 7faa470c1640 1 -- 10.20.193.28:0/2944763367 shutdown_connections 2026-02-20T13:26:42.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.146+0000 7faa470c1640 1 --2- 10.20.193.28:0/2944763367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faa40115420 0x7faa40175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.146+0000 7faa470c1640 1 --2- 10.20.193.28:0/2944763367 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faa4010fc20 0x7faa40114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.146+0000 7faa470c1640 1 --2- 10.20.193.28:0/2944763367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa4010f230 0x7faa4010f600 unknown :-1 s=CLOSED pgs=1067 gs=1 cs=0 l=1 c_cookie=10747215766692285221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.146+0000 7faa470c1640 1 -- 10.20.193.28:0/2944763367 >> 10.20.193.28:0/2944763367 conn(0x7faa4005f830 msgr2=0x7faa4010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:42.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.146+0000 7faa470c1640 1 -- 10.20.193.28:0/2944763367 shutdown_connections 2026-02-20T13:26:42.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.146+0000 7faa470c1640 1 -- 10.20.193.28:0/2944763367 wait complete. 2026-02-20T13:26:42.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa470c1640 1 Processor -- start 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa470c1640 1 -- start start 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa470c1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faa4010f230 0x7faa4011db20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa470c1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faa4010fc20 0x7faa4011e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa470c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa40115420 0x7faa40123430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa470c1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa40123a50 con 0x7faa40115420 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa470c1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7faa40123bc0 con 0x7faa4010f230 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa470c1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7faa40123d80 con 0x7faa4010fc20 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa45637640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa40115420 0x7faa40123430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa45637640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa40115420 0x7faa40123430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46194/0 (socket says 10.20.193.28:46194) 2026-02-20T13:26:42.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa45637640 1 -- 10.20.193.28:0/3003271638 learned_addr learned my addr 10.20.193.28:0/3003271638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.147+0000 7faa37fff640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faa4010fc20 0x7faa4011e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa44e36640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faa4010f230 0x7faa4011db20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa45637640 1 -- 10.20.193.28:0/3003271638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faa4010fc20 msgr2=0x7faa4011e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa45637640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faa4010fc20 0x7faa4011e060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa45637640 1 -- 10.20.193.28:0/3003271638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faa4010f230 msgr2=0x7faa4011db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa45637640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faa4010f230 0x7faa4011db20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa45637640 1 -- 10.20.193.28:0/3003271638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa30009570 con 0x7faa40115420 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa44e36640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faa4010f230 0x7faa4011db20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa45637640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa40115420 0x7faa40123430 secure :-1 s=READY pgs=1068 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3c00f8d0 tx=0x7faa3c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa35ffb640 1 -- 10.20.193.28:0/3003271638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa3c00dce0 con 0x7faa40115420 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa470c1640 1 -- 10.20.193.28:0/3003271638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa40124060 con 0x7faa40115420 2026-02-20T13:26:42.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa35ffb640 1 -- 10.20.193.28:0/3003271638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faa3c00de40 con 0x7faa40115420 2026-02-20T13:26:42.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa470c1640 1 -- 10.20.193.28:0/3003271638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa40164760 con 0x7faa40115420 2026-02-20T13:26:42.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.148+0000 7faa35ffb640 1 -- 10.20.193.28:0/3003271638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa3c00dce0 con 0x7faa40115420 2026-02-20T13:26:42.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.149+0000 7faa0f7fe640 1 -- 10.20.193.28:0/3003271638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa08005300 con 0x7faa40115420 2026-02-20T13:26:42.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.151+0000 7faa35ffb640 1 -- 10.20.193.28:0/3003271638 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7faa3c020060 con 0x7faa40115420 2026-02-20T13:26:42.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.153+0000 7faa35ffb640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa1c0b5740 0x7faa1c0d5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.153+0000 7faa35ffb640 1 -- 10.20.193.28:0/3003271638 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7faa3c015070 con 0x7faa40115420 2026-02-20T13:26:42.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.153+0000 7faa44e36640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa1c0b5740 0x7faa1c0d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.153+0000 7faa35ffb640 1 -- 10.20.193.28:0/3003271638 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7faa3c120730 con 0x7faa40115420 2026-02-20T13:26:42.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.153+0000 7faa44e36640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa1c0b5740 0x7faa1c0d5bf0 secure :-1 s=READY pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa300098a0 tx=0x7faa30031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:42.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.293+0000 7faa0f7fe640 1 -- 10.20.193.28:0/3003271638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa08005950 con 0x7faa40115420 2026-02-20T13:26:42.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.294+0000 7faa35ffb640 1 -- 10.20.193.28:0/3003271638 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7faa3c0aa530 con 0x7faa40115420 2026-02-20T13:26:42.298 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:26:42.298 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:26:42.299 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:26:42.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 -- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa1c0b5740 msgr2=0x7faa1c0d5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa1c0b5740 0x7faa1c0d5bf0 secure :-1 s=READY pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa300098a0 tx=0x7faa30031040 comp rx=0 tx=0).stop 2026-02-20T13:26:42.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 -- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa40115420 msgr2=0x7faa40123430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa40115420 0x7faa40123430 secure :-1 s=READY pgs=1068 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3c00f8d0 tx=0x7faa3c00fda0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 -- 10.20.193.28:0/3003271638 shutdown_connections 2026-02-20T13:26:42.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa1c0b5740 0x7faa1c0d5bf0 unknown :-1 s=CLOSED pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa40115420 0x7faa40123430 unknown :-1 s=CLOSED pgs=1068 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faa4010fc20 0x7faa4011e060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 --2- 10.20.193.28:0/3003271638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faa4010f230 0x7faa4011db20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 -- 10.20.193.28:0/3003271638 >> 10.20.193.28:0/3003271638 conn(0x7faa4005f830 msgr2=0x7faa4010cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:42.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 -- 10.20.193.28:0/3003271638 shutdown_connections 2026-02-20T13:26:42.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.295+0000 7faa0f7fe640 1 -- 10.20.193.28:0/3003271638 wait complete. 2026-02-20T13:26:42.397 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:26:42.581 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:42.625 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:42 trial028 ceph-mon[37442]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-20T13:26:42.625 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:42 trial028 ceph-mon[37442]: pgmap v462: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:26:42.625 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:42 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3003271638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 -- 10.20.193.28:0/4044485717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac1156a0 msgr2=0x7f04ac176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 --2- 10.20.193.28:0/4044485717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac1156a0 0x7f04ac176070 secure :-1 s=READY pgs=1069 gs=3 cs=0 l=1 c_cookie=6930619091956995671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04a000aa30 tx=0x7f04a0030270 comp rx=0 tx=0).stop 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 -- 10.20.193.28:0/4044485717 shutdown_connections 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 --2- 10.20.193.28:0/4044485717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac1156a0 0x7f04ac176070 unknown :-1 s=CLOSED pgs=1069 gs=3 cs=0 l=1 c_cookie=6930619091956995671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 --2- 10.20.193.28:0/4044485717 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04ac10fea0 0x7f04ac114ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 --2- 10.20.193.28:0/4044485717 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04ac10f4b0 0x7f04ac10f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 -- 10.20.193.28:0/4044485717 >> 10.20.193.28:0/4044485717 conn(0x7f04ac0ecd60 msgr2=0x7f04ac10d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 -- 10.20.193.28:0/4044485717 shutdown_connections 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.756+0000 7f04b110f640 1 -- 10.20.193.28:0/4044485717 wait complete. 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.757+0000 7f04b110f640 1 Processor -- start 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.757+0000 7f04b110f640 1 -- start start 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.757+0000 7f04b110f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac10f4b0 0x7f04ac066f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.757+0000 7f04b110f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04ac10fea0 0x7f04ac0631a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.757+0000 7f04b110f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04ac1156a0 0x7f04ac063850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.757+0000 7f04b110f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac063fe0 con 0x7f04ac10f4b0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.757+0000 7f04b110f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac168550 con 0x7f04ac1156a0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.757+0000 7f04b110f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac168710 con 0x7f04ac10fea0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac10f4b0 0x7f04ac066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac10f4b0 0x7f04ac066f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46200/0 (socket says 10.20.193.28:46200) 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 -- 10.20.193.28:0/2233767423 learned_addr learned my addr 10.20.193.28:0/2233767423 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04b090e640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04ac1156a0 0x7f04ac063850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04ac10fea0 0x7f04ac0631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 -- 10.20.193.28:0/2233767423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04ac10fea0 msgr2=0x7f04ac0631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04ac10fea0 0x7f04ac0631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 -- 10.20.193.28:0/2233767423 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04ac1156a0 msgr2=0x7f04ac063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04ac1156a0 0x7f04ac063850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 -- 10.20.193.28:0/2233767423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c0094b0 con 0x7f04ac10f4b0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04abfff640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac10f4b0 0x7f04ac066f30 secure :-1 s=READY pgs=1070 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0498009480 tx=0x7f049800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04a97fa640 1 -- 10.20.193.28:0/2233767423 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f049800cd40 con 0x7f04ac10f4b0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04a97fa640 1 -- 10.20.193.28:0/2233767423 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0498004d30 con 0x7f04ac10f4b0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04a97fa640 1 -- 10.20.193.28:0/2233767423 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0498010740 con 0x7f04ac10f4b0 2026-02-20T13:26:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04b110f640 1 -- 10.20.193.28:0/2233767423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a000a650 con 0x7f04ac10f4b0 2026-02-20T13:26:42.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.758+0000 7f04b110f640 1 -- 10.20.193.28:0/2233767423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac168c80 con 0x7f04ac10f4b0 2026-02-20T13:26:42.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.761+0000 7f04a97fa640 1 -- 10.20.193.28:0/2233767423 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f049801f060 con 0x7f04ac10f4b0 2026-02-20T13:26:42.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.763+0000 7f04a97fa640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04800b5760 0x7f04800d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.763+0000 7f04a97fa640 1 -- 10.20.193.28:0/2233767423 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0498014070 con 0x7f04ac10f4b0 2026-02-20T13:26:42.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.763+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04800b5760 0x7f04800d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b4392e00 1 Processor -- start 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04800b5760 0x7f04800d5c10 secure :-1 s=READY pgs=475 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04ac111e90 tx=0x7f049c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b4392e00 1 -- start start 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed1c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 0x55829ed615e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ed81f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b4392e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55829ec32780 con 0x55829ed61b20 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b4392e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55829ec2e4b0 con 0x55829ed1cc70 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b4392e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55829ec28450 con 0x55829ed1c360 2026-02-20T13:26:42.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b090e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ed81f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b090e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ed81f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46206/0 (socket says 10.20.193.28:46206) 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04b090e640 1 -- 10.20.193.28:0/334862997 learned_addr learned my addr 10.20.193.28:0/334862997 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 0x55829ed615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.764+0000 7f04abfff640 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed1c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b090e640 1 -- 10.20.193.28:0/334862997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 msgr2=0x55829ed1c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b090e640 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed1c730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b090e640 1 -- 10.20.193.28:0/334862997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 msgr2=0x55829ed615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b090e640 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 0x55829ed615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b090e640 1 -- 10.20.193.28:0/334862997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55829ebd3d10 con 0x55829ed61b20 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b090e640 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ed81f00 secure :-1 s=READY pgs=1071 gs=1 cs=0 l=1 c_cookie=4731720326472702686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04a000a420 tx=0x7f04a0006cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41aa729133e69ade server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f047cce3640 1 -- 10.20.193.28:0/334862997 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04a003e040 con 0x55829ed61b20 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f047cce3640 1 -- 10.20.193.28:0/334862997 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04a0030ad0 con 0x55829ed61b20 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f047cce3640 1 -- 10.20.193.28:0/334862997 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04a00050c0 con 0x55829ed61b20 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 -- 10.20.193.28:0/334862997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 msgr2=0x55829ed81f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ed81f00 secure :-1 s=READY pgs=1071 gs=1 cs=0 l=1 c_cookie=4731720326472702686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04a000a420 tx=0x7f04a0006cb0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 -- 10.20.193.28:0/334862997 shutdown_connections 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ed81f00 unknown :-1 s=CLOSED pgs=1071 gs=1 cs=0 l=1 c_cookie=4731720326472702686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 0x55829ed615e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 --2- 10.20.193.28:0/334862997 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed1c730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 -- 10.20.193.28:0/334862997 >> 10.20.193.28:0/334862997 conn(0x55829ecfa860 msgr2=0x55829ed1ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:42.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 -- 10.20.193.28:0/334862997 shutdown_connections 2026-02-20T13:26:42.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.765+0000 7f04b4392e00 1 -- 10.20.193.28:0/334862997 wait complete. 2026-02-20T13:26:42.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.767+0000 7f04b4392e00 1 -- start start 2026-02-20T13:26:42.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.767+0000 7f04b4392e00 1 Processor -- start 2026-02-20T13:26:42.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.767+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed79770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.767+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1cc70 0x55829ed79cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.767+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed61b20 0x55829ed7ba40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.767+0000 7f04b4392e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55829ed7bfb0 con 0x55829ed1cc70 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.767+0000 7f04b4392e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55829ed7c120 con 0x55829ed61b20 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.767+0000 7f04b4392e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55829ed7c2e0 con 0x55829ed1c360 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed79770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed79770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54422/0 (socket says 10.20.193.28:54422) 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 -- 10.20.193.28:0/2589323066 learned_addr learned my addr 10.20.193.28:0/2589323066 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04b090e640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed61b20 0x55829ed7ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1cc70 0x55829ed79cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 -- 10.20.193.28:0/2589323066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed61b20 msgr2=0x55829ed7ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed61b20 0x55829ed7ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 -- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1cc70 msgr2=0x55829ed79cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:42.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1cc70 0x55829ed79cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 -- 10.20.193.28:0/2589323066 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55829ebac3c0 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04b090e640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed61b20 0x55829ed7ba40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1cc70 0x55829ed79cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f04abfff640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed79770 secure :-1 s=READY pgs=323 gs=2 cs=0 l=1 c_cookie=6518079459541907898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f049800c6a0 tx=0x7f04980ad2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a74debbf3c3f9ba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.768+0000 7f046dffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f046dffb640 1 -- 10.20.193.28:0/2589323066 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04980ae0d0 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f046dffb640 1 -- 10.20.193.28:0/2589323066 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04980adc20 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac1768e0 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f046dffb640 1 -- 10.20.193.28:0/2589323066 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04980723b0 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f046dffb640 1 -- 10.20.193.28:0/2589323066 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0498072510 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f04b4392e00 10 client.28648 _ll_register_callbacks cb 0x55829eba9a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55829e8be6f0 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f046dffb640 1 -- 10.20.193.28:0/2589323066 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f04980b8360 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f04b4392e00 10 client.28648 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55829ebbe0e0 con 0x55829ed1c360 2026-02-20T13:26:42.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.769+0000 7f046dffb640 1 -- 10.20.193.28:0/2589323066 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f04980cc060 con 0x55829ed1c360 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f04b4392e00 10 client.28648 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f04b4392e00 10 client.28648 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f04b4392e00 20 client.28648 populate_metadata read hostname 'trial028' 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55829ed81ba0 0x55829ed5f8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f04b4392e00 4 client.28648 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55829ebcaf80 con 0x55829ed81ba0 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55829ed81ba0 0x55829ed5f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55829ed81ba0 0x55829ed5f8a0 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=545519756096953267 s_cookie=6105324913871485697 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7921353f01ddbb3 server_cookie=54ba78a969a6fb01 in_seq=0 out_seq=0 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.770+0000 7f046dffb640 10 client.28648 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:26:42.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f046dffb640 1 -- 10.20.193.28:0/2589323066 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55829ebcaf80 con 0x55829ed81ba0 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f046dffb640 10 client.28648 handle_command_reply: tid=0 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 client.28648 shutdown 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 msgr2=0x55829ed79770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed79770 secure :-1 s=READY pgs=323 gs=2 cs=0 l=1 c_cookie=6518079459541907898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f049800c6a0 tx=0x7f04980ad2d0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 shutdown_connections 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55829ed81ba0 0x55829ed5f8a0 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=545519756096953267 s_cookie=6105324913871485697 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1cc70 0x55829ed79cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed61b20 0x55829ed7ba40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2589323066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1c360 0x55829ed79770 unknown :-1 s=CLOSED pgs=323 gs=2 cs=0 l=1 c_cookie=6518079459541907898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 >> 10.20.193.28:0/2589323066 conn(0x55829ecfa860 msgr2=0x55829ed1ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f046dffb640 0 client.28648 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 shutdown_connections 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 1 -- 10.20.193.28:0/2589323066 wait complete. 2026-02-20T13:26:42.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.771+0000 7f04b4392e00 20 client.28648 trim_cache size 0 max 16384 2026-02-20T13:26:42.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.778+0000 7f04b4392e00 1 Processor -- start 2026-02-20T13:26:42.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.778+0000 7f04b4392e00 1 -- start start 2026-02-20T13:26:42.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.778+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1c360 0x55829ed7b9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.778+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 0x55829ed7f200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.778+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed61b20 0x55829ed7f740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.778+0000 7f04b4392e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55829ec26080 con 0x55829ed1c360 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.778+0000 7f04b4392e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55829e8e6700 con 0x55829ed1cc70 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.778+0000 7f04b4392e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55829ec8aae0 con 0x55829ed61b20 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1c360 0x55829ed7b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1c360 0x55829ed7b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46222/0 (socket says 10.20.193.28:46222) 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 -- 10.20.193.28:0/2234994987 learned_addr learned my addr 10.20.193.28:0/2234994987 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 0x55829ed7f200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04b090e640 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed61b20 0x55829ed7f740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 -- 10.20.193.28:0/2234994987 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed61b20 msgr2=0x55829ed7f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed61b20 0x55829ed7f740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 -- 10.20.193.28:0/2234994987 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 msgr2=0x55829ed7f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 0x55829ed7f200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 -- 10.20.193.28:0/2234994987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55829ebb8b60 con 0x55829ed1c360 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.779+0000 7f04abfff640 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1c360 0x55829ed7b9d0 secure :-1 s=READY pgs=1072 gs=3 cs=0 l=1 c_cookie=377802367317873543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980af4b0 tx=0x7f04980e4030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e39405b489387 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f046ffff640 1 -- 10.20.193.28:0/2234994987 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04980b8360 con 0x55829ed1c360 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f046ffff640 1 -- 10.20.193.28:0/2234994987 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55829e8be6f0 con 0x55829ed1c360 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f046ffff640 1 -- 10.20.193.28:0/2234994987 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04980ad040 con 0x55829ed1c360 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 -- 10.20.193.28:0/2234994987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1c360 msgr2=0x55829ed7b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1c360 0x55829ed7b9d0 secure :-1 s=READY pgs=1072 gs=3 cs=0 l=1 c_cookie=377802367317873543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980af4b0 tx=0x7f04980e4030 comp rx=0 tx=0).stop 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 -- 10.20.193.28:0/2234994987 shutdown_connections 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed61b20 0x55829ed7f740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1cc70 0x55829ed7f200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 --2- 10.20.193.28:0/2234994987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed1c360 0x55829ed7b9d0 unknown :-1 s=CLOSED pgs=1072 gs=3 cs=0 l=1 c_cookie=377802367317873543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 -- 10.20.193.28:0/2234994987 >> 10.20.193.28:0/2234994987 conn(0x55829ecfa860 msgr2=0x55829ed7dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 -- 10.20.193.28:0/2234994987 shutdown_connections 2026-02-20T13:26:42.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 -- 10.20.193.28:0/2234994987 wait complete. 2026-02-20T13:26:42.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.780+0000 7f04b4392e00 1 -- start start 2026-02-20T13:26:42.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04b4392e00 1 Processor -- start 2026-02-20T13:26:42.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1c360 0x55829ed5c0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1cc70 0x55829ed5c620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04b4392e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ecfcc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04b4392e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55829ed7fcd0 con 0x55829ed61b20 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04b4392e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55829ecfd210 con 0x55829ed1c360 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04b4392e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55829ecfd3d0 con 0x55829ed1cc70 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04abfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1c360 0x55829ed5c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04abfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1c360 0x55829ed5c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33522/0 (socket says 10.20.193.28:33522) 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.781+0000 7f04abfff640 1 -- 10.20.193.28:0/1552562199 learned_addr learned my addr 10.20.193.28:0/1552562199 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f04b090e640 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ecfcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1cc70 0x55829ed5c620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f04abfff640 1 -- 10.20.193.28:0/1552562199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1cc70 msgr2=0x55829ed5c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f04abfff640 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1cc70 0x55829ed5c620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f04abfff640 1 -- 10.20.193.28:0/1552562199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 msgr2=0x55829ecfcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f04abfff640 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ecfcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f04abfff640 1 -- 10.20.193.28:0/1552562199 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55829ebac6f0 con 0x55829ed1c360 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f04abfff640 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1c360 0x55829ed5c0c0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=5260699896639595794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980e6f60 tx=0x7f0498005610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4901c2af01232512 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.782+0000 7f046dffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f046dffb640 1 -- 10.20.193.28:0/1552562199 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04980b8360 con 0x55829ed1c360 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f046dffb640 1 -- 10.20.193.28:0/1552562199 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04980c9050 con 0x55829ed1c360 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04980c8030 con 0x55829ed1c360 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f046dffb640 1 -- 10.20.193.28:0/1552562199 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04980a7a10 con 0x55829ed1c360 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 10 client.28745 _ll_register_callbacks cb 0x55829eba9a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f046dffb640 1 -- 10.20.193.28:0/1552562199 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0498005b40 con 0x55829ed1c360 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04a0030ad0 con 0x55829ed1c360 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f046dffb640 1 -- 10.20.193.28:0/1552562199 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f04980ad500 con 0x55829ed1c360 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 10 client.28745 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55829ebbe340 con 0x55829ed1c360 2026-02-20T13:26:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f046dffb640 1 -- 10.20.193.28:0/1552562199 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f04980cc070 con 0x55829ed1c360 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 10 client.28745 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 10 client.28745 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 20 client.28745 populate_metadata read hostname 'trial028' 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55829ecfe980 0x55829ecfedf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 4 client.28745 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.783+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55829e8bbf40 con 0x55829ecfe980 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.784+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55829ecfe980 0x55829ecfedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.784+0000 7f04ab7fe640 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55829ecfe980 0x55829ecfedf0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=5629950008760393925 s_cookie=12520414737809640855 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4e2199b4475ee0c5 server_cookie=adc172de37b58d97 in_seq=0 out_seq=0 2026-02-20T13:26:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.784+0000 7f046dffb640 10 client.28745 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:26:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f046dffb640 1 -- 10.20.193.28:0/1552562199 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55829e8bbf40 con 0x55829ecfe980 2026-02-20T13:26:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f046dffb640 10 client.28745 handle_command_reply: tid=0 2026-02-20T13:26:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 client.28745 shutdown 2026-02-20T13:26:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1c360 msgr2=0x55829ed5c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1c360 0x55829ed5c0c0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=5260699896639595794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980e6f60 tx=0x7f0498005610 comp rx=0 tx=0).stop 2026-02-20T13:26:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 shutdown_connections 2026-02-20T13:26:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55829ecfe980 0x55829ecfedf0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=5629950008760393925 s_cookie=12520414737809640855 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55829ed61b20 0x55829ecfcc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55829ed1cc70 0x55829ed5c620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 --2- 10.20.193.28:0/1552562199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55829ed1c360 0x55829ed5c0c0 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=5260699896639595794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f046dffb640 0 client.28745 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 >> 10.20.193.28:0/1552562199 conn(0x55829ecfa860 msgr2=0x55829ed7d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 shutdown_connections 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 1 -- 10.20.193.28:0/1552562199 wait complete. 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b4392e00 20 client.28745 trim_cache size 0 max 16384 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b110f640 1 -- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04800b5760 msgr2=0x7f04800d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b110f640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04800b5760 0x7f04800d5c10 secure :-1 s=READY pgs=475 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04ac111e90 tx=0x7f049c005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b110f640 1 -- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac10f4b0 msgr2=0x7f04ac066f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.785+0000 7f04b110f640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac10f4b0 0x7f04ac066f30 secure :-1 s=READY pgs=1070 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0498009480 tx=0x7f049800ee60 comp rx=0 tx=0).stop 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.786+0000 7f04b110f640 1 -- 10.20.193.28:0/2233767423 shutdown_connections 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.786+0000 7f04b110f640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f04800b5760 0x7f04800d5c10 unknown :-1 s=CLOSED pgs=475 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.786+0000 7f04b110f640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f04ac1156a0 0x7f04ac063850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.786+0000 7f04b110f640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f04ac10fea0 0x7f04ac0631a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.786+0000 7f04b110f640 1 --2- 10.20.193.28:0/2233767423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04ac10f4b0 0x7f04ac066f30 unknown :-1 s=CLOSED pgs=1070 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.786+0000 7f04b110f640 1 -- 10.20.193.28:0/2233767423 >> 10.20.193.28:0/2233767423 conn(0x7f04ac0ecd60 msgr2=0x7f04ac10d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.786+0000 7f04b110f640 1 -- 10.20.193.28:0/2233767423 shutdown_connections 2026-02-20T13:26:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:42.786+0000 7f04b110f640 1 -- 10.20.193.28:0/2233767423 wait complete. 2026-02-20T13:26:42.878 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:42 trial127 ceph-mon[43817]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-20T13:26:42.878 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:42 trial127 ceph-mon[43817]: pgmap v462: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:26:42.878 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:42 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3003271638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:42.886 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:26:42.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:42 trial034 ceph-mon[43332]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-20T13:26:42.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:42 trial034 ceph-mon[43332]: pgmap v462: 97 pgs: 97 active+clean; 1.0 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:26:42.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:42 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3003271638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:26:43.072 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:43.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 -- 10.20.193.28:0/8977043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810f4b0 msgr2=0x7fbe0810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 --2- 10.20.193.28:0/8977043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810f4b0 0x7fbe0810f880 secure :-1 s=READY pgs=1073 gs=1 cs=0 l=1 c_cookie=4951428155756973682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdfc009950 tx=0x7fbdfc02f190 comp rx=0 tx=0).stop 2026-02-20T13:26:43.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 -- 10.20.193.28:0/8977043 shutdown_connections 2026-02-20T13:26:43.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 --2- 10.20.193.28:0/8977043 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe081156a0 0x7fbe08176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 --2- 10.20.193.28:0/8977043 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbe0810fea0 0x7fbe08114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 --2- 10.20.193.28:0/8977043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810f4b0 0x7fbe0810f880 unknown :-1 s=CLOSED pgs=1073 gs=1 cs=0 l=1 c_cookie=4951428155756973682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 -- 10.20.193.28:0/8977043 >> 10.20.193.28:0/8977043 conn(0x7fbe080ecda0 msgr2=0x7fbe0810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 -- 10.20.193.28:0/8977043 shutdown_connections 2026-02-20T13:26:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.252+0000 7fbe07fff640 1 -- 10.20.193.28:0/8977043 wait complete. 2026-02-20T13:26:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe07fff640 1 Processor -- start 2026-02-20T13:26:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe07fff640 1 -- start start 2026-02-20T13:26:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe07fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f4b0 0x7fbe0811ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe07fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810fea0 0x7fbe0811e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe07fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbe081156a0 0x7fbe081236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe07fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08123d00 con 0x7fbe0810fea0 2026-02-20T13:26:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe07fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08123e70 con 0x7fbe081156a0 2026-02-20T13:26:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe07fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08124030 con 0x7fbe0810f4b0 2026-02-20T13:26:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810fea0 0x7fbe0811e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe077fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbe081156a0 0x7fbe081236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe06ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f4b0 0x7fbe0811ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe06ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f4b0 0x7fbe0811ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54444/0 (socket says 10.20.193.28:54444) 2026-02-20T13:26:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.253+0000 7fbe06ffd640 1 -- 10.20.193.28:0/2007342600 learned_addr learned my addr 10.20.193.28:0/2007342600 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbe067fc640 1 -- 10.20.193.28:0/2007342600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f4b0 msgr2=0x7fbe0811ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbe067fc640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f4b0 0x7fbe0811ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbe067fc640 1 -- 10.20.193.28:0/2007342600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbe081156a0 msgr2=0x7fbe081236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbe067fc640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbe081156a0 0x7fbe081236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbe067fc640 1 -- 10.20.193.28:0/2007342600 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc009570 con 0x7fbe0810fea0 2026-02-20T13:26:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbe067fc640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810fea0 0x7fbe0811e310 secure :-1 s=READY pgs=1074 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf000d720 tx=0x7fbdf000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbde7fff640 1 -- 10.20.193.28:0/2007342600 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf0004500 con 0x7fbe0810fea0 2026-02-20T13:26:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbde7fff640 1 -- 10.20.193.28:0/2007342600 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbdf0004d30 con 0x7fbe0810fea0 2026-02-20T13:26:43.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbde7fff640 1 -- 10.20.193.28:0/2007342600 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf00052a0 con 0x7fbe0810fea0 2026-02-20T13:26:43.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbe07fff640 1 -- 10.20.193.28:0/2007342600 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe08124310 con 0x7fbe0810fea0 2026-02-20T13:26:43.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.254+0000 7fbe07fff640 1 -- 10.20.193.28:0/2007342600 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe08164a10 con 0x7fbe0810fea0 2026-02-20T13:26:43.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.257+0000 7fbde7fff640 1 -- 10.20.193.28:0/2007342600 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbdf0005430 con 0x7fbe0810fea0 2026-02-20T13:26:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.259+0000 7fbde7fff640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbddc0b5760 0x7fbddc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.259+0000 7fbde7fff640 1 -- 10.20.193.28:0/2007342600 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbdf00e6480 con 0x7fbe0810fea0 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.259+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbddc0b5760 0x7fbddc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.259+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbddc0b5760 0x7fbddc0d5c10 secure :-1 s=READY pgs=476 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdfc0023d0 tx=0x7fbdfc03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.260+0000 7fbe0f53fe00 1 Processor -- start 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.260+0000 7fbe0f53fe00 1 -- start start 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563360 0x55a331563730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315a85e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 0x55a3315c8f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a331479780 con 0x55a331563c70 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3314754b0 con 0x55a331563360 2026-02-20T13:26:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a33146f450 con 0x55a3315a8b20 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe06ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563360 0x55a331563730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315a85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46254/0 (socket says 10.20.193.28:46254) 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 -- 10.20.193.28:0/2895336056 learned_addr learned my addr 10.20.193.28:0/2895336056 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe077fe640 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 0x55a3315c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 -- 10.20.193.28:0/2895336056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 msgr2=0x55a3315c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 0x55a3315c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 -- 10.20.193.28:0/2895336056 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563360 msgr2=0x55a331563730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563360 0x55a331563730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 -- 10.20.193.28:0/2895336056 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a33141ad10 con 0x55a331563c70 2026-02-20T13:26:43.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563360 0x55a331563730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbe067fc640 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315a85e0 secure :-1 s=READY pgs=1075 gs=2 cs=0 l=1 c_cookie=13419178853502617451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00a8e60 tx=0x7fbdf000df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3a8011c475076b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbdd37fe640 1 -- 10.20.193.28:0/2895336056 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf00b2500 con 0x55a331563c70 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbdd37fe640 1 -- 10.20.193.28:0/2895336056 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbdf00b4ae0 con 0x55a331563c70 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.261+0000 7fbdd37fe640 1 -- 10.20.193.28:0/2895336056 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf00b7490 con 0x55a331563c70 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2895336056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 msgr2=0x55a3315a85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315a85e0 secure :-1 s=READY pgs=1075 gs=2 cs=0 l=1 c_cookie=13419178853502617451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00a8e60 tx=0x7fbdf000df10 comp rx=0 tx=0).stop 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2895336056 shutdown_connections 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315a85e0 unknown :-1 s=CLOSED pgs=1075 gs=2 cs=0 l=1 c_cookie=13419178853502617451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 0x55a3315c8f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2895336056 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563360 0x55a331563730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2895336056 >> 10.20.193.28:0/2895336056 conn(0x55a331541860 msgr2=0x55a331561c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2895336056 shutdown_connections 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.262+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2895336056 wait complete. 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.263+0000 7fbe0f53fe00 1 -- start start 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.263+0000 7fbe0f53fe00 1 Processor -- start 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.263+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 0x55a3315c07b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.263+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315c0cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.263+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3315a8b20 0x55a3315c2a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.263+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3315c2ff0 con 0x55a331563c70 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.263+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3315c3160 con 0x55a3315a8b20 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.263+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3315c3320 con 0x55a331563360 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46270/0 (socket says 10.20.193.28:46270) 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 -- 10.20.193.28:0/788323238 learned_addr learned my addr 10.20.193.28:0/788323238 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 0x55a3315c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe077fe640 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3315a8b20 0x55a3315c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 -- 10.20.193.28:0/788323238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 msgr2=0x55a3315c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 0x55a3315c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 -- 10.20.193.28:0/788323238 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3315a8b20 msgr2=0x55a3315c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3315a8b20 0x55a3315c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 -- 10.20.193.28:0/788323238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3313f33c0 con 0x55a331563c70 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe067fc640 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315c0cf0 secure :-1 s=READY pgs=1076 gs=1 cs=0 l=1 c_cookie=11534160910338485342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00040a0 tx=0x7fbdf0002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a011923cc2ebec5e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbdd0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/788323238 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf00b7920 con 0x55a331563c70 2026-02-20T13:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe08164a10 con 0x55a331563c70 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/788323238 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbdf00b2500 con 0x55a331563c70 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe0f53fe00 10 client.18801 _ll_register_callbacks cb 0x55a3313f0a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3311056f0 con 0x55a331563c70 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.264+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/788323238 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf0020300 con 0x55a331563c70 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/788323238 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbdf0020490 con 0x55a331563c70 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/788323238 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbdf00aa870 con 0x55a331563c70 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe0f53fe00 10 client.18801 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a3314050e0 con 0x55a331563c70 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/788323238 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbdf00097c0 con 0x55a331563c70 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe0f53fe00 10 client.18801 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe0f53fe00 10 client.18801 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe0f53fe00 20 client.18801 populate_metadata read hostname 'trial028' 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55a3315a5d10 0x55a3315a61b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe0f53fe00 4 client.18801 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a331411f80 con 0x55a3315a5d10 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.265+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55a3315a5d10 0x55a3315a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.266+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55a3315a5d10 0x55a3315a61b0 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=12349212700977797650 s_cookie=4930132607101017759 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ab613785c9861a12 server_cookie=446b597c35d39e9f in_seq=0 out_seq=0 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.266+0000 7fbdd0ff9640 10 client.18801 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.266+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/788323238 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a331411f80 con 0x55a3315a5d10 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.266+0000 7fbdd0ff9640 10 client.18801 handle_command_reply: tid=0 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.266+0000 7fbe0f53fe00 1 client.18801 shutdown 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 msgr2=0x55a3315c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315c0cf0 secure :-1 s=READY pgs=1076 gs=1 cs=0 l=1 c_cookie=11534160910338485342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00040a0 tx=0x7fbdf0002390 comp rx=0 tx=0).stop 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 shutdown_connections 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55a3315a5d10 0x55a3315a61b0 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=12349212700977797650 s_cookie=4930132607101017759 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563c70 0x55a3315c0cf0 unknown :-1 s=CLOSED pgs=1076 gs=1 cs=0 l=1 c_cookie=11534160910338485342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a3315a8b20 0x55a3315c2a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/788323238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 0x55a3315c07b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbdd0ff9640 0 client.18801 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 >> 10.20.193.28:0/788323238 conn(0x55a331541860 msgr2=0x55a331561c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 shutdown_connections 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/788323238 wait complete. 2026-02-20T13:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.267+0000 7fbe0f53fe00 20 client.18801 trim_cache size 0 max 16384 2026-02-20T13:26:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe0f53fe00 1 Processor -- start 2026-02-20T13:26:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe0f53fe00 1 -- start start 2026-02-20T13:26:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563360 0x55a3315c2a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a3315bd940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 0x55a3315bde80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a33146d080 con 0x55a331563360 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a33112d700 con 0x55a331563c70 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3315412a0 con 0x55a3315a8b20 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.274+0000 7fbe06ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563360 0x55a3315c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe06ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563360 0x55a3315c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46272/0 (socket says 10.20.193.28:46272) 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe06ffd640 1 -- 10.20.193.28:0/71381918 learned_addr learned my addr 10.20.193.28:0/71381918 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe067fc640 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a3315bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe077fe640 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 0x55a3315bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe06ffd640 1 -- 10.20.193.28:0/71381918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 msgr2=0x55a3315bde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 0x55a3315bde80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe06ffd640 1 -- 10.20.193.28:0/71381918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 msgr2=0x55a3315bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a3315bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe06ffd640 1 -- 10.20.193.28:0/71381918 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3313ffb60 con 0x55a331563360 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563360 0x55a3315c2a10 secure :-1 s=READY pgs=1077 gs=1 cs=0 l=1 c_cookie=9853993117003594529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdfc004820 tx=0x7fbdfc043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c06a87fe24bb21 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbdd2ffd640 1 -- 10.20.193.28:0/71381918 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdfc0028c0 con 0x55a331563360 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbdd2ffd640 1 -- 10.20.193.28:0/71381918 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbdfc03e040 con 0x55a331563360 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbdd2ffd640 1 -- 10.20.193.28:0/71381918 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdfc057680 con 0x55a331563360 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/71381918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563360 msgr2=0x55a3315c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563360 0x55a3315c2a10 secure :-1 s=READY pgs=1077 gs=1 cs=0 l=1 c_cookie=9853993117003594529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdfc004820 tx=0x7fbdfc043000 comp rx=0 tx=0).stop 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/71381918 shutdown_connections 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a3315a8b20 0x55a3315bde80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a3315bd940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/71381918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a331563360 0x55a3315c2a10 unknown :-1 s=CLOSED pgs=1077 gs=1 cs=0 l=1 c_cookie=9853993117003594529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/71381918 >> 10.20.193.28:0/71381918 conn(0x55a331541860 msgr2=0x55a3315c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.275+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/71381918 shutdown_connections 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.276+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/71381918 wait complete. 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.276+0000 7fbe0f53fe00 1 -- start start 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.276+0000 7fbe0f53fe00 1 Processor -- start 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 0x55a331541de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a331542320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe0f53fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3315a8b20 0x55a331546c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a331542860 con 0x55a3315a8b20 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a3315429d0 con 0x55a331563c70 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe0f53fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a3315471c0 con 0x55a331563360 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe067fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a331542320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3315a8b20 0x55a331546c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe067fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a331542320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33562/0 (socket says 10.20.193.28:33562) 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe067fc640 1 -- 10.20.193.28:0/2944764507 learned_addr learned my addr 10.20.193.28:0/2944764507 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 0x55a331541de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe077fe640 1 -- 10.20.193.28:0/2944764507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 msgr2=0x55a331541de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe077fe640 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 0x55a331541de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe077fe640 1 -- 10.20.193.28:0/2944764507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 msgr2=0x55a331542320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe077fe640 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a331542320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe077fe640 1 -- 10.20.193.28:0/2944764507 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3313f36f0 con 0x55a3315a8b20 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbe077fe640 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3315a8b20 0x55a331546c80 secure :-1 s=READY pgs=1078 gs=3 cs=0 l=1 c_cookie=8437974781470310223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a331523870 tx=0x7fbdf8013820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7519b55b813dff4f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.277+0000 7fbdd0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/2944764507 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf8005500 con 0x55a3315a8b20 2026-02-20T13:26:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/2944764507 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbdf8019040 con 0x55a3315a8b20 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe081768e0 con 0x55a3315a8b20 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/2944764507 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf8011ba0 con 0x55a3315a8b20 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 10 client.18807 _ll_register_callbacks cb 0x55a3313f0a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdf00b4ae0 con 0x55a3315a8b20 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/2944764507 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbdf8011d30 con 0x55a3315a8b20 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/2944764507 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbdf8027440 con 0x55a3315a8b20 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 10 client.18807 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a331405340 con 0x55a3315a8b20 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/2944764507 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbdf8025060 con 0x55a3315a8b20 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 10 client.18807 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 10 client.18807 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 20 client.18807 populate_metadata read hostname 'trial028' 2026-02-20T13:26:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55a331656f00 0x55a3316773b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 4 client.18807 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a331102f40 con 0x55a331656f00 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.278+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55a331656f00 0x55a3316773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe06ffd640 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55a331656f00 0x55a3316773b0 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=1906716017157514706 s_cookie=8999712725131849956 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1a76041d8a38a5d2 server_cookie=7ce5670a7e0bf0e4 in_seq=0 out_seq=0 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbdd0ff9640 10 client.18807 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbdd0ff9640 1 -- 10.20.193.28:0/2944764507 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a331102f40 con 0x55a331656f00 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbdd0ff9640 10 client.18807 handle_command_reply: tid=0 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 client.18807 shutdown 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3315a8b20 msgr2=0x55a331546c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3315a8b20 0x55a331546c80 secure :-1 s=READY pgs=1078 gs=3 cs=0 l=1 c_cookie=8437974781470310223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a331523870 tx=0x7fbdf8013820 comp rx=0 tx=0).stop 2026-02-20T13:26:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 shutdown_connections 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55a331656f00 0x55a3316773b0 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=1906716017157514706 s_cookie=8999712725131849956 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3315a8b20 0x55a331546c80 unknown :-1 s=CLOSED pgs=1078 gs=3 cs=0 l=1 c_cookie=8437974781470310223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a331563c70 0x55a331542320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 --2- 10.20.193.28:0/2944764507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a331563360 0x55a331541de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbdd0ff9640 0 client.18807 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 >> 10.20.193.28:0/2944764507 conn(0x55a331541860 msgr2=0x55a3315c1950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 shutdown_connections 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 1 -- 10.20.193.28:0/2944764507 wait complete. 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.279+0000 7fbe0f53fe00 20 client.18807 trim_cache size 0 max 16384 2026-02-20T13:26:43.292 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:43.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 -- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbddc0b5760 msgr2=0x7fbddc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbddc0b5760 0x7fbddc0d5c10 secure :-1 s=READY pgs=476 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdfc0023d0 tx=0x7fbdfc03a040 comp rx=0 tx=0).stop 2026-02-20T13:26:43.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 -- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810fea0 msgr2=0x7fbe0811e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810fea0 0x7fbe0811e310 secure :-1 s=READY pgs=1074 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf000d720 tx=0x7fbdf000dbf0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 -- 10.20.193.28:0/2007342600 shutdown_connections 2026-02-20T13:26:43.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbddc0b5760 0x7fbddc0d5c10 unknown :-1 s=CLOSED pgs=476 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe0810fea0 0x7fbe0811e310 unknown :-1 s=CLOSED pgs=1074 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbe081156a0 0x7fbe081236e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 --2- 10.20.193.28:0/2007342600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f4b0 0x7fbe0811ddd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 -- 10.20.193.28:0/2007342600 >> 10.20.193.28:0/2007342600 conn(0x7fbe080ecda0 msgr2=0x7fbe0810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 -- 10.20.193.28:0/2007342600 shutdown_connections 2026-02-20T13:26:43.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.280+0000 7fbe07fff640 1 -- 10.20.193.28:0/2007342600 wait complete. 2026-02-20T13:26:43.380 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:26:43.567 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:43.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 -- 10.20.193.28:0/3899731287 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8aec10bb40 msgr2=0x7f8aec1109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 --2- 10.20.193.28:0/3899731287 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8aec10bb40 0x7f8aec1109d0 secure :-1 s=READY pgs=324 gs=3 cs=0 l=1 c_cookie=12088247975610655937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ae0009950 tx=0x7f8ae002f1d0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 -- 10.20.193.28:0/3899731287 shutdown_connections 2026-02-20T13:26:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 --2- 10.20.193.28:0/3899731287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8aec111160 0x7f8aec111b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 --2- 10.20.193.28:0/3899731287 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8aec10bb40 0x7f8aec1109d0 unknown :-1 s=CLOSED pgs=324 gs=3 cs=0 l=1 c_cookie=12088247975610655937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 --2- 10.20.193.28:0/3899731287 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8aec10b150 0x7f8aec10b520 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 -- 10.20.193.28:0/3899731287 >> 10.20.193.28:0/3899731287 conn(0x7f8aec0e8ce0 msgr2=0x7f8aec1090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 -- 10.20.193.28:0/3899731287 shutdown_connections 2026-02-20T13:26:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.743+0000 7f8af3379640 1 -- 10.20.193.28:0/3899731287 wait complete. 2026-02-20T13:26:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af3379640 1 Processor -- start 2026-02-20T13:26:43.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af3379640 1 -- start start 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af3379640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8aec10b150 0x7f8aec0f1170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af3379640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8aec10bb40 0x7f8aec0f16b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af3379640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8aec111160 0x7f8aec0f6a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af3379640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec0f7050 con 0x7f8aec10b150 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af3379640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec0f71c0 con 0x7f8aec111160 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af3379640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec0f7380 con 0x7f8aec10bb40 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af2377640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8aec10b150 0x7f8aec0f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af2b78640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8aec111160 0x7f8aec0f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af2377640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8aec10b150 0x7f8aec0f1170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46308/0 (socket says 10.20.193.28:46308) 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af2b78640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8aec111160 0x7f8aec0f6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33578/0 (socket says 10.20.193.28:33578) 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af2377640 1 -- 10.20.193.28:0/3640892239 learned_addr learned my addr 10.20.193.28:0/3640892239 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.744+0000 7f8af1b76640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8aec10bb40 0x7f8aec0f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af2377640 1 -- 10.20.193.28:0/3640892239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8aec10bb40 msgr2=0x7f8aec0f16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af2377640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8aec10bb40 0x7f8aec0f16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af2377640 1 -- 10.20.193.28:0/3640892239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8aec111160 msgr2=0x7f8aec0f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af2377640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8aec111160 0x7f8aec0f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af2377640 1 -- 10.20.193.28:0/3640892239 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae800a590 con 0x7f8aec10b150 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af2b78640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8aec111160 0x7f8aec0f6a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af2377640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8aec10b150 0x7f8aec0f1170 secure :-1 s=READY pgs=1079 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8adc009480 tx=0x7f8adc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8ad37fe640 1 -- 10.20.193.28:0/3640892239 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8adc00cd40 con 0x7f8aec10b150 2026-02-20T13:26:43.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af3379640 1 -- 10.20.193.28:0/3640892239 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae0009570 con 0x7f8aec10b150 2026-02-20T13:26:43.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8ad37fe640 1 -- 10.20.193.28:0/3640892239 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8adc004d30 con 0x7f8aec10b150 2026-02-20T13:26:43.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8af3379640 1 -- 10.20.193.28:0/3640892239 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aec0f7ba0 con 0x7f8aec10b150 2026-02-20T13:26:43.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.745+0000 7f8ad37fe640 1 -- 10.20.193.28:0/3640892239 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8adc018650 con 0x7f8aec10b150 2026-02-20T13:26:43.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.748+0000 7f8ad37fe640 1 -- 10.20.193.28:0/3640892239 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8adc01f060 con 0x7f8aec10b150 2026-02-20T13:26:43.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.750+0000 7f8ad37fe640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ac80b56e0 0x7f8ac80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.750+0000 7f8ad37fe640 1 -- 10.20.193.28:0/3640892239 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8adc014070 con 0x7f8aec10b150 2026-02-20T13:26:43.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.750+0000 7f8af1b76640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ac80b56e0 0x7f8ac80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.750+0000 7f8af1b76640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ac80b56e0 0x7f8ac80d5b90 secure :-1 s=READY pgs=477 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8aec0f7ac0 tx=0x7f8ae003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af65fce00 1 Processor -- start 2026-02-20T13:26:43.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af65fce00 1 -- start start 2026-02-20T13:26:43.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c86730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 0x55e083ccb5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083cebf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af65fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e083b9c780 con 0x55e083c86360 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af65fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e083b984b0 con 0x55e083ccbb20 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af65fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e083b92450 con 0x55e083c86c70 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af2b78640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083cebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af2377640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c86730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af2b78640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083cebf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33588/0 (socket says 10.20.193.28:33588) 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af2b78640 1 -- 10.20.193.28:0/3534070468 learned_addr learned my addr 10.20.193.28:0/3534070468 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.751+0000 7f8af1b76640 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 0x55e083ccb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8af2b78640 1 -- 10.20.193.28:0/3534070468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 msgr2=0x55e083ccb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8af2b78640 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 0x55e083ccb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8af2b78640 1 -- 10.20.193.28:0/3534070468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 msgr2=0x55e083c86730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8af2b78640 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c86730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8af2b78640 1 -- 10.20.193.28:0/3534070468 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e083b3dd10 con 0x55e083ccbb20 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8af2377640 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c86730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8af2b78640 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083cebf00 secure :-1 s=READY pgs=389 gs=3 cs=0 l=1 c_cookie=16220770142207549359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ae800abc0 tx=0x7f8ae8003b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e11bc080c58b1faf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8ad0b0a640 1 -- 10.20.193.28:0/3534070468 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ae800aea0 con 0x55e083ccbb20 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8ad0b0a640 1 -- 10.20.193.28:0/3534070468 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8ae8003c90 con 0x55e083ccbb20 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.752+0000 7f8ad0b0a640 1 -- 10.20.193.28:0/3534070468 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ae801ae00 con 0x55e083ccbb20 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 -- 10.20.193.28:0/3534070468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 msgr2=0x55e083cebf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083cebf00 secure :-1 s=READY pgs=389 gs=3 cs=0 l=1 c_cookie=16220770142207549359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ae800abc0 tx=0x7f8ae8003b50 comp rx=0 tx=0).stop 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 -- 10.20.193.28:0/3534070468 shutdown_connections 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083cebf00 unknown :-1 s=CLOSED pgs=389 gs=3 cs=0 l=1 c_cookie=16220770142207549359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 0x55e083ccb5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3534070468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c86730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 -- 10.20.193.28:0/3534070468 >> 10.20.193.28:0/3534070468 conn(0x55e083c64860 msgr2=0x55e083c84c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 -- 10.20.193.28:0/3534070468 shutdown_connections 2026-02-20T13:26:43.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.753+0000 7f8af65fce00 1 -- 10.20.193.28:0/3534070468 wait complete. 2026-02-20T13:26:43.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.754+0000 7f8af65fce00 1 -- start start 2026-02-20T13:26:43.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.754+0000 7f8af65fce00 1 Processor -- start 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86360 0x55e083ce3710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083ce3c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083ccbb20 0x55e083ce8c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af65fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e083ce9180 con 0x55e083ccbb20 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af65fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e083ce92f0 con 0x55e083c86c70 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af65fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e083ce94b0 con 0x55e083c86360 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af2377640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86360 0x55e083ce3710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af1b76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083ce3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af1b76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083ce3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33594/0 (socket says 10.20.193.28:33594) 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af1b76640 1 -- 10.20.193.28:0/3314440680 learned_addr learned my addr 10.20.193.28:0/3314440680 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af2b78640 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083ccbb20 0x55e083ce8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af1b76640 1 -- 10.20.193.28:0/3314440680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86360 msgr2=0x55e083ce3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af1b76640 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86360 0x55e083ce3710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af1b76640 1 -- 10.20.193.28:0/3314440680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083ccbb20 msgr2=0x55e083ce8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af1b76640 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083ccbb20 0x55e083ce8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.755+0000 7f8af1b76640 1 -- 10.20.193.28:0/3314440680 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae800a860 con 0x55e083c86c70 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8af1b76640 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083ce3c50 secure :-1 s=READY pgs=390 gs=2 cs=0 l=1 c_cookie=8339541042307877250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8aec111a60 tx=0x7f8ae002f1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73bc0064a88d4982 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8a9ffff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8a9ffff640 1 -- 10.20.193.28:0/3314440680 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ae0038d50 con 0x55e083c86c70 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8a9ffff640 1 -- 10.20.193.28:0/3314440680 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8ae003e040 con 0x55e083c86c70 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aec0f7ba0 con 0x55e083c86c70 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8a9ffff640 1 -- 10.20.193.28:0/3314440680 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ae0044410 con 0x55e083c86c70 2026-02-20T13:26:43.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8a9ffff640 1 -- 10.20.193.28:0/3314440680 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8ae00445a0 con 0x55e083c86c70 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8af65fce00 10 client.28775 _ll_register_callbacks cb 0x55e083b13a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0838286f0 con 0x55e083c86c70 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8a9ffff640 1 -- 10.20.193.28:0/3314440680 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ae0004350 con 0x55e083c86c70 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8af65fce00 10 client.28775 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.756+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e083b163c0 con 0x55e083c86c70 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8a9ffff640 1 -- 10.20.193.28:0/3314440680 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8ae0050420 con 0x55e083c86c70 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8af65fce00 10 client.28775 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8af65fce00 10 client.28775 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8af65fce00 20 client.28775 populate_metadata read hostname 'trial028' 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e083cebbd0 0x55e083cc98a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8af65fce00 4 client.28775 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:43.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e083b34f80 con 0x55e083cebbd0 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8af2377640 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e083cebbd0 0x55e083cc98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8af2377640 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e083cebbd0 0x55e083cc98a0 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=10087522684409303519 s_cookie=17789956832272473401 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8bfe146f7be951df server_cookie=f6e29f7bd5225d39 in_seq=0 out_seq=0 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.757+0000 7f8a9ffff640 10 client.28775 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8a9ffff640 1 -- 10.20.193.28:0/3314440680 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e083b34f80 con 0x55e083cebbd0 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8a9ffff640 10 client.28775 handle_command_reply: tid=0 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 client.28775 shutdown 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 msgr2=0x55e083ce3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083ce3c50 secure :-1 s=READY pgs=390 gs=2 cs=0 l=1 c_cookie=8339541042307877250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8aec111a60 tx=0x7f8ae002f1d0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 shutdown_connections 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e083cebbd0 0x55e083cc98a0 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=10087522684409303519 s_cookie=17789956832272473401 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083ccbb20 0x55e083ce8c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083ce3c50 unknown :-1 s=CLOSED pgs=390 gs=2 cs=0 l=1 c_cookie=8339541042307877250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8a9ffff640 0 client.28775 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:26:43.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 --2- 10.20.193.28:0/3314440680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86360 0x55e083ce3710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 >> 10.20.193.28:0/3314440680 conn(0x55e083c64860 msgr2=0x55e083c84c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 shutdown_connections 2026-02-20T13:26:43.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 1 -- 10.20.193.28:0/3314440680 wait complete. 2026-02-20T13:26:43.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.758+0000 7f8af65fce00 20 client.28775 trim_cache size 0 max 16384 2026-02-20T13:26:43.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.766+0000 7f8af65fce00 1 Processor -- start 2026-02-20T13:26:43.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.766+0000 7f8af65fce00 1 -- start start 2026-02-20T13:26:43.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.766+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083ce1040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.766+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083cca8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.766+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083ccbb20 0x55e083ccadf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.766+0000 7f8af65fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e083b90080 con 0x55e083c86360 2026-02-20T13:26:43.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.766+0000 7f8af65fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e083850700 con 0x55e083c86c70 2026-02-20T13:26:43.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.766+0000 7f8af65fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e083cd80b0 con 0x55e083ccbb20 2026-02-20T13:26:43.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2b78640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083ccbb20 0x55e083ccadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af1b76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083cca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2377640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083ce1040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2b78640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083ccbb20 0x55e083ccadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54506/0 (socket says 10.20.193.28:54506) 2026-02-20T13:26:43.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2b78640 1 -- 10.20.193.28:0/1280043017 learned_addr learned my addr 10.20.193.28:0/1280043017 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2377640 1 -- 10.20.193.28:0/1280043017 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083ccbb20 msgr2=0x55e083ccadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2377640 1 --2- 10.20.193.28:0/1280043017 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083ccbb20 0x55e083ccadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2377640 1 -- 10.20.193.28:0/1280043017 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 msgr2=0x55e083cca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2377640 1 --2- 10.20.193.28:0/1280043017 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083cca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2377640 1 -- 10.20.193.28:0/1280043017 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e083cd5a60 con 0x55e083c86360 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8af2377640 1 --2- 10.20.193.28:0/1280043017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083ce1040 secure :-1 s=READY pgs=1080 gs=2 cs=0 l=1 c_cookie=16192844533797625978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8adc0a95e0 tx=0x7f8adc0e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b88a4f6422207a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8aba4e6640 1 -- 10.20.193.28:0/1280043017 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8adc0ada10 con 0x55e083c86360 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8aba4e6640 1 -- 10.20.193.28:0/1280043017 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8adc096040 con 0x55e083c86360 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.767+0000 7f8aba4e6640 1 -- 10.20.193.28:0/1280043017 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8adc0acbb0 con 0x55e083c86360 2026-02-20T13:26:43.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 -- 10.20.193.28:0/1280043017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 msgr2=0x55e083ce1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 --2- 10.20.193.28:0/1280043017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083ce1040 secure :-1 s=READY pgs=1080 gs=2 cs=0 l=1 c_cookie=16192844533797625978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8adc0a95e0 tx=0x7f8adc0e46e0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 -- 10.20.193.28:0/1280043017 shutdown_connections 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 --2- 10.20.193.28:0/1280043017 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083ccbb20 0x55e083ccadf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 --2- 10.20.193.28:0/1280043017 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083c86c70 0x55e083cca8b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 --2- 10.20.193.28:0/1280043017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083ce1040 unknown :-1 s=CLOSED pgs=1080 gs=2 cs=0 l=1 c_cookie=16192844533797625978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 -- 10.20.193.28:0/1280043017 >> 10.20.193.28:0/1280043017 conn(0x55e083c64860 msgr2=0x55e083cdf920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 -- 10.20.193.28:0/1280043017 shutdown_connections 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 -- 10.20.193.28:0/1280043017 wait complete. 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 -- start start 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.768+0000 7f8af65fce00 1 Processor -- start 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c66760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 0x55e083c66ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af65fce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083d30940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af65fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e083ce95f0 con 0x55e083c86360 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af65fce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e083d30e80 con 0x55e083ccbb20 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af65fce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e083d31040 con 0x55e083c86c70 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2377640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c66760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2377640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c66760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46348/0 (socket says 10.20.193.28:46348) 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2377640 1 -- 10.20.193.28:0/2183929522 learned_addr learned my addr 10.20.193.28:0/2183929522 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af1b76640 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 0x55e083c66ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2b78640 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083d30940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2377640 1 -- 10.20.193.28:0/2183929522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 msgr2=0x55e083c66ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2377640 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 0x55e083c66ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2377640 1 -- 10.20.193.28:0/2183929522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 msgr2=0x55e083d30940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:43.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2377640 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083d30940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.769+0000 7f8af2377640 1 -- 10.20.193.28:0/2183929522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e083b280e0 con 0x55e083c86360 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8af2377640 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c66760 secure :-1 s=READY pgs=1081 gs=1 cs=0 l=1 c_cookie=16368172316287518078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8adc0ad280 tx=0x7f8adc002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3276dffd6b3457e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8a9ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8a9ffff640 1 -- 10.20.193.28:0/2183929522 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8adc0b8150 con 0x55e083c86360 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8adc0c4e70 con 0x55e083c86360 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8af65fce00 10 client.18825 _ll_register_callbacks cb 0x55e083b13a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ae8003c90 con 0x55e083c86360 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8a9ffff640 1 -- 10.20.193.28:0/2183929522 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8adc0ada10 con 0x55e083c86360 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8a9ffff640 1 -- 10.20.193.28:0/2183929522 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8adc0b7f40 con 0x55e083c86360 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8a9ffff640 1 -- 10.20.193.28:0/2183929522 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8adc0adca0 con 0x55e083c86360 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8a9ffff640 1 -- 10.20.193.28:0/2183929522 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8adc0ace30 con 0x55e083c86360 2026-02-20T13:26:43.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8af65fce00 10 client.18825 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e083b22b60 con 0x55e083c86360 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.770+0000 7f8a9ffff640 1 -- 10.20.193.28:0/2183929522 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8adc0a9280 con 0x55e083c86360 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af65fce00 10 client.18825 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af65fce00 10 client.18825 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af65fce00 20 client.18825 populate_metadata read hostname 'trial028' 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af65fce00 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e083d328b0 0x55e083d5a0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af65fce00 4 client.18825 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e083825f40 con 0x55e083d328b0 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af1b76640 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e083d328b0 0x55e083d5a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af1b76640 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e083d328b0 0x55e083d5a0c0 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=7131829533463231009 s_cookie=6440978459448275902 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62f9592cb4b73a21 server_cookie=5962f3c8795b73be in_seq=0 out_seq=0 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8a9ffff640 10 client.18825 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:26:43.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8a9ffff640 1 -- 10.20.193.28:0/2183929522 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e083825f40 con 0x55e083d328b0 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8a9ffff640 10 client.18825 handle_command_reply: tid=0 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.771+0000 7f8af65fce00 1 client.18825 shutdown 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 msgr2=0x55e083c66760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c66760 secure :-1 s=READY pgs=1081 gs=1 cs=0 l=1 c_cookie=16368172316287518078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8adc0ad280 tx=0x7f8adc002390 comp rx=0 tx=0).stop 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 shutdown_connections 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55e083d328b0 0x55e083d5a0c0 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=7131829533463231009 s_cookie=6440978459448275902 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e083ccbb20 0x55e083d30940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e083c86c70 0x55e083c66ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 --2- 10.20.193.28:0/2183929522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e083c86360 0x55e083c66760 unknown :-1 s=CLOSED pgs=1081 gs=1 cs=0 l=1 c_cookie=16368172316287518078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 >> 10.20.193.28:0/2183929522 conn(0x55e083c64860 msgr2=0x55e083ce0110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8a9ffff640 0 client.18825 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:26:43.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 shutdown_connections 2026-02-20T13:26:43.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 1 -- 10.20.193.28:0/2183929522 wait complete. 2026-02-20T13:26:43.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af65fce00 20 client.18825 trim_cache size 0 max 16384 2026-02-20T13:26:43.781 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:43.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af3379640 1 -- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ac80b56e0 msgr2=0x7f8ac80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af3379640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ac80b56e0 0x7f8ac80d5b90 secure :-1 s=READY pgs=477 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8aec0f7ac0 tx=0x7f8ae003a040 comp rx=0 tx=0).stop 2026-02-20T13:26:43.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af3379640 1 -- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8aec10b150 msgr2=0x7f8aec0f1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:43.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.772+0000 7f8af3379640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8aec10b150 0x7f8aec0f1170 secure :-1 s=READY pgs=1079 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8adc009480 tx=0x7f8adc00ee60 comp rx=0 tx=0).stop 2026-02-20T13:26:43.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.773+0000 7f8af3379640 1 -- 10.20.193.28:0/3640892239 shutdown_connections 2026-02-20T13:26:43.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.773+0000 7f8af3379640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ac80b56e0 0x7f8ac80d5b90 unknown :-1 s=CLOSED pgs=477 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.773+0000 7f8af3379640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8aec111160 0x7f8aec0f6a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.773+0000 7f8af3379640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8aec10bb40 0x7f8aec0f16b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.773+0000 7f8af3379640 1 --2- 10.20.193.28:0/3640892239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8aec10b150 0x7f8aec0f1170 unknown :-1 s=CLOSED pgs=1079 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:43.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.773+0000 7f8af3379640 1 -- 10.20.193.28:0/3640892239 >> 10.20.193.28:0/3640892239 conn(0x7f8aec0e8ce0 msgr2=0x7f8aec10efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:43.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.773+0000 7f8af3379640 1 -- 10.20.193.28:0/3640892239 shutdown_connections 2026-02-20T13:26:43.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:43.773+0000 7f8af3379640 1 -- 10.20.193.28:0/3640892239 wait complete. 2026-02-20T13:26:43.874 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:26:44.058 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:44.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.245+0000 7f201012a640 1 -- 10.20.193.28:0/1852034534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20081157e0 msgr2=0x7f20081761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.245+0000 7f201012a640 1 --2- 10.20.193.28:0/1852034534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20081157e0 0x7f20081761b0 secure :-1 s=READY pgs=1082 gs=1 cs=0 l=1 c_cookie=15461532167520177559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f200400aa30 tx=0x7f2004030270 comp rx=0 tx=0).stop 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.245+0000 7f201012a640 1 -- 10.20.193.28:0/1852034534 shutdown_connections 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.245+0000 7f201012a640 1 --2- 10.20.193.28:0/1852034534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20081157e0 0x7f20081761b0 unknown :-1 s=CLOSED pgs=1082 gs=1 cs=0 l=1 c_cookie=15461532167520177559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.245+0000 7f201012a640 1 --2- 10.20.193.28:0/1852034534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f200810ffe0 0x7f2008115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.245+0000 7f201012a640 1 --2- 10.20.193.28:0/1852034534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f200810f5f0 0x7f200810f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.245+0000 7f201012a640 1 -- 10.20.193.28:0/1852034534 >> 10.20.193.28:0/1852034534 conn(0x7f20080ecea0 msgr2=0x7f200810d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.245+0000 7f201012a640 1 -- 10.20.193.28:0/1852034534 shutdown_connections 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.246+0000 7f201012a640 1 -- 10.20.193.28:0/1852034534 wait complete. 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.246+0000 7f201012a640 1 Processor -- start 2026-02-20T13:26:44.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f201012a640 1 -- start start 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f201012a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f200810f5f0 0x7f200811d530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f201012a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f200810ffe0 0x7f200811da70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f201012a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20081157e0 0x7f2008122e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f201012a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2008123460 con 0x7f200810ffe0 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f201012a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f20081235d0 con 0x7f200810f5f0 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f201012a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2008123790 con 0x7f20081157e0 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200d69e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f200810ffe0 0x7f200811da70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200de9f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f200810f5f0 0x7f200811d530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200d69e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f200810ffe0 0x7f200811da70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46370/0 (socket says 10.20.193.28:46370) 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200d69e640 1 -- 10.20.193.28:0/2627113389 learned_addr learned my addr 10.20.193.28:0/2627113389 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200e6a0640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20081157e0 0x7f2008122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200d69e640 1 -- 10.20.193.28:0/2627113389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20081157e0 msgr2=0x7f2008122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200d69e640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20081157e0 0x7f2008122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200d69e640 1 -- 10.20.193.28:0/2627113389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f200810f5f0 msgr2=0x7f200811d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200d69e640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f200810f5f0 0x7f200811d530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200d69e640 1 -- 10.20.193.28:0/2627113389 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200400a650 con 0x7f200810ffe0 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.247+0000 7f200de9f640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f200810f5f0 0x7f200811d530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.248+0000 7f200d69e640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f200810ffe0 0x7f200811da70 secure :-1 s=READY pgs=1083 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ffc009480 tx=0x7f1ffc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.248+0000 7f1ff6ffd640 1 -- 10.20.193.28:0/2627113389 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ffc00cd40 con 0x7f200810ffe0 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.248+0000 7f1ff6ffd640 1 -- 10.20.193.28:0/2627113389 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ffc004d30 con 0x7f200810ffe0 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.248+0000 7f1ff6ffd640 1 -- 10.20.193.28:0/2627113389 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ffc0106b0 con 0x7f200810ffe0 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.248+0000 7f201012a640 1 -- 10.20.193.28:0/2627113389 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2008123a70 con 0x7f200810ffe0 2026-02-20T13:26:44.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.248+0000 7f201012a640 1 -- 10.20.193.28:0/2627113389 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2008164170 con 0x7f200810ffe0 2026-02-20T13:26:44.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.251+0000 7f1ff6ffd640 1 -- 10.20.193.28:0/2627113389 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1ffc01f060 con 0x7f200810ffe0 2026-02-20T13:26:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.253+0000 7f1ff6ffd640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1fe40b5760 0x7f1fe40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.253+0000 7f1ff6ffd640 1 -- 10.20.193.28:0/2627113389 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1ffc014070 con 0x7f200810ffe0 2026-02-20T13:26:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.253+0000 7f200de9f640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1fe40b5760 0x7f1fe40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.253+0000 7f2012124e00 1 Processor -- start 2026-02-20T13:26:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.253+0000 7f2012124e00 1 -- start start 2026-02-20T13:26:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.253+0000 7f200de9f640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1fe40b5760 0x7f1fe40d5c10 secure :-1 s=READY pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff8005970 tx=0x7f1ff8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f2012124e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af3c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f2012124e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af815e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f2012124e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af81b20 0x55d52afa1f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f2012124e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d52ae52780 con 0x55d52af3c360 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f2012124e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d52ae4e4b0 con 0x55d52af81b20 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f2012124e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d52ae48450 con 0x55d52af3cc70 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200de9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af3c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200e6a0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af81b20 0x55d52afa1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200de9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af3c730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46386/0 (socket says 10.20.193.28:46386) 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200de9f640 1 -- 10.20.193.28:0/2216522199 learned_addr learned my addr 10.20.193.28:0/2216522199 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200d69e640 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200e6a0640 1 -- 10.20.193.28:0/2216522199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 msgr2=0x55d52af815e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200e6a0640 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af815e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200e6a0640 1 -- 10.20.193.28:0/2216522199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 msgr2=0x55d52af3c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200e6a0640 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af3c730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200e6a0640 1 -- 10.20.193.28:0/2216522199 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d52adf3d10 con 0x55d52af81b20 2026-02-20T13:26:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200d69e640 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af815e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.254+0000 7f200e6a0640 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af81b20 0x55d52afa1f00 secure :-1 s=READY pgs=391 gs=2 cs=0 l=1 c_cookie=6883277388632691455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f200400aa30 tx=0x7f2004006cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f865050d7ee12ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f1fd64e6640 1 -- 10.20.193.28:0/2216522199 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f200403e040 con 0x55d52af81b20 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f1fd64e6640 1 -- 10.20.193.28:0/2216522199 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2004030ad0 con 0x55d52af81b20 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f1fd64e6640 1 -- 10.20.193.28:0/2216522199 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2004039e70 con 0x55d52af81b20 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 -- 10.20.193.28:0/2216522199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af81b20 msgr2=0x55d52afa1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af81b20 0x55d52afa1f00 secure :-1 s=READY pgs=391 gs=2 cs=0 l=1 c_cookie=6883277388632691455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f200400aa30 tx=0x7f2004006cb0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 -- 10.20.193.28:0/2216522199 shutdown_connections 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af81b20 0x55d52afa1f00 unknown :-1 s=CLOSED pgs=391 gs=2 cs=0 l=1 c_cookie=6883277388632691455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af815e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 --2- 10.20.193.28:0/2216522199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af3c730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 -- 10.20.193.28:0/2216522199 >> 10.20.193.28:0/2216522199 conn(0x55d52af1a860 msgr2=0x55d52af3ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 -- 10.20.193.28:0/2216522199 shutdown_connections 2026-02-20T13:26:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.255+0000 7f2012124e00 1 -- 10.20.193.28:0/2216522199 wait complete. 2026-02-20T13:26:44.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f2012124e00 1 -- start start 2026-02-20T13:26:44.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f2012124e00 1 Processor -- start 2026-02-20T13:26:44.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f2012124e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3c360 0x55d52af3d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f2012124e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af3dc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f2012124e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af40620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f2012124e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d52af40b60 con 0x55d52af81b20 2026-02-20T13:26:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f2012124e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d52af40cd0 con 0x55d52af3cc70 2026-02-20T13:26:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f2012124e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d52af40e90 con 0x55d52af3c360 2026-02-20T13:26:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f200d69e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af3dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f200e6a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af40620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f200d69e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af3dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33648/0 (socket says 10.20.193.28:33648) 2026-02-20T13:26:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.257+0000 7f200d69e640 1 -- 10.20.193.28:0/1609247046 learned_addr learned my addr 10.20.193.28:0/1609247046 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f200de9f640 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3c360 0x55d52af3d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f200d69e640 1 -- 10.20.193.28:0/1609247046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3c360 msgr2=0x55d52af3d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f200d69e640 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3c360 0x55d52af3d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f200d69e640 1 -- 10.20.193.28:0/1609247046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 msgr2=0x55d52af40620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f200d69e640 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af40620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f200d69e640 1 -- 10.20.193.28:0/1609247046 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d52adcc3c0 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f200e6a0640 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af40620 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f200d69e640 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af3dc70 secure :-1 s=READY pgs=392 gs=3 cs=0 l=1 c_cookie=10152792339996474589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ffc0e47e0 tx=0x7f1ffc0a9010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce5f6d767cbfcdd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f1fc37fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1609247046 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ffc0adf50 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1609247046 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ffc0adaa0 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1609247046 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ffc0724b0 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2008176a20 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1609247046 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1ffc0b53a0 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f2012124e00 10 client.28793 _ll_register_callbacks cb 0x55d52adc9a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.258+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d52aade6f0 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1609247046 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ffc0b2dc0 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f2012124e00 10 client.28793 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d52adde0e0 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1609247046 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1ffc0ab080 con 0x55d52af3cc70 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f2012124e00 10 client.28793 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f2012124e00 10 client.28793 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f2012124e00 20 client.28793 populate_metadata read hostname 'trial028' 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f2012124e00 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55d52af86720 0x55d52af86b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f2012124e00 4 client.28793 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d52adeaf80 con 0x55d52af86720 2026-02-20T13:26:44.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.259+0000 7f200de9f640 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55d52af86720 0x55d52af86b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.260+0000 7f200de9f640 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55d52af86720 0x55d52af86b90 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=3639059324734170396 s_cookie=6967546410228803739 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3280892cdf5a651c server_cookie=60b1b28b61bc689b in_seq=0 out_seq=0 2026-02-20T13:26:44.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.260+0000 7f1fc37fe640 10 client.28793 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:26:44.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.260+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1609247046 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d52adeaf80 con 0x55d52af86720 2026-02-20T13:26:44.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.260+0000 7f1fc37fe640 10 client.28793 handle_command_reply: tid=0 2026-02-20T13:26:44.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.260+0000 7f2012124e00 1 client.28793 shutdown 2026-02-20T13:26:44.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.260+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 msgr2=0x55d52af3dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.260+0000 7f2012124e00 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af3dc70 secure :-1 s=READY pgs=392 gs=3 cs=0 l=1 c_cookie=10152792339996474589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ffc0e47e0 tx=0x7f1ffc0a9010 comp rx=0 tx=0).stop 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 shutdown_connections 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55d52af86720 0x55d52af86b90 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=3639059324734170396 s_cookie=6967546410228803739 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af40620 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af3dc70 unknown :-1 s=CLOSED pgs=392 gs=3 cs=0 l=1 c_cookie=10152792339996474589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 1 --2- 10.20.193.28:0/1609247046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3c360 0x55d52af3d730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f1fc37fe640 0 client.28793 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 >> 10.20.193.28:0/1609247046 conn(0x55d52af1a860 msgr2=0x55d52af3ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 shutdown_connections 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 1 -- 10.20.193.28:0/1609247046 wait complete. 2026-02-20T13:26:44.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.261+0000 7f2012124e00 20 client.28793 trim_cache size 0 max 16384 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f2012124e00 1 Processor -- start 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f2012124e00 1 -- start start 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f2012124e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af9f310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f2012124e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af9f850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f2012124e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af81b20 0x55d52afa05f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f2012124e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d52ae46080 con 0x55d52af3c360 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f2012124e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d52ab06700 con 0x55d52af3cc70 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f2012124e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d52af3e270 con 0x55d52af81b20 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f200de9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af9f310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f200d69e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af9f850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f200d69e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af9f850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33652/0 (socket says 10.20.193.28:33652) 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f200d69e640 1 -- 10.20.193.28:0/2374603563 learned_addr learned my addr 10.20.193.28:0/2374603563 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f200de9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af9f310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46406/0 (socket says 10.20.193.28:46406) 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.268+0000 7f200e6a0640 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af81b20 0x55d52afa05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f200de9f640 1 -- 10.20.193.28:0/2374603563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af81b20 msgr2=0x55d52afa05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f200de9f640 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af81b20 0x55d52afa05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f200de9f640 1 -- 10.20.193.28:0/2374603563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 msgr2=0x55d52af9f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f200de9f640 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af9f850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f200de9f640 1 -- 10.20.193.28:0/2374603563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d52add8b60 con 0x55d52af3c360 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f200d69e640 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af9f850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f200de9f640 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af9f310 secure :-1 s=READY pgs=1084 gs=2 cs=0 l=1 c_cookie=17062295856720478454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55d52af87410 tx=0x7f1ff8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc973ae887180f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f1fd5ce5640 1 -- 10.20.193.28:0/2374603563 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ff8023040 con 0x55d52af3c360 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f1fd5ce5640 1 -- 10.20.193.28:0/2374603563 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ff8029480 con 0x55d52af3c360 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f1fd5ce5640 1 -- 10.20.193.28:0/2374603563 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ff8029320 con 0x55d52af3c360 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f2012124e00 1 -- 10.20.193.28:0/2374603563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 msgr2=0x55d52af9f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f2012124e00 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af9f310 secure :-1 s=READY pgs=1084 gs=2 cs=0 l=1 c_cookie=17062295856720478454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55d52af87410 tx=0x7f1ff8012000 comp rx=0 tx=0).stop 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f2012124e00 1 -- 10.20.193.28:0/2374603563 shutdown_connections 2026-02-20T13:26:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f2012124e00 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af81b20 0x55d52afa05f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f2012124e00 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3cc70 0x55d52af9f850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f2012124e00 1 --2- 10.20.193.28:0/2374603563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af3c360 0x55d52af9f310 unknown :-1 s=CLOSED pgs=1084 gs=2 cs=0 l=1 c_cookie=17062295856720478454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f2012124e00 1 -- 10.20.193.28:0/2374603563 >> 10.20.193.28:0/2374603563 conn(0x55d52af1a860 msgr2=0x55d52af80390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.269+0000 7f2012124e00 1 -- 10.20.193.28:0/2374603563 shutdown_connections 2026-02-20T13:26:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.270+0000 7f2012124e00 1 -- 10.20.193.28:0/2374603563 wait complete. 2026-02-20T13:26:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.270+0000 7f2012124e00 1 -- start start 2026-02-20T13:26:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.270+0000 7f2012124e00 1 Processor -- start 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f2012124e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3c360 0x55d52af713f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f2012124e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af71930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f2012124e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af71e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f2012124e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d52b02d7c0 con 0x55d52af81b20 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f2012124e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d52b02d930 con 0x55d52af3c360 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f2012124e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d52b02daf0 con 0x55d52af3cc70 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200e6a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af71e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200de9f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3c360 0x55d52af713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200e6a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af71e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46410/0 (socket says 10.20.193.28:46410) 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200de9f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3c360 0x55d52af713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33660/0 (socket says 10.20.193.28:33660) 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200de9f640 1 -- 10.20.193.28:0/1562539974 learned_addr learned my addr 10.20.193.28:0/1562539974 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200d69e640 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af71930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200de9f640 1 -- 10.20.193.28:0/1562539974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 msgr2=0x55d52af71930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200de9f640 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af71930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200de9f640 1 -- 10.20.193.28:0/1562539974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 msgr2=0x55d52af71e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200de9f640 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af71e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.271+0000 7f200de9f640 1 -- 10.20.193.28:0/1562539974 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff800fab0 con 0x55d52af3c360 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f200de9f640 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3c360 0x55d52af713f0 secure :-1 s=READY pgs=393 gs=3 cs=0 l=1 c_cookie=6752352936137089677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff80040c0 tx=0x7f1ff802af60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5db52d384c84628d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f1fc37fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1562539974 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ff8023050 con 0x55d52af3c360 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2008176a20 con 0x55d52af3c360 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1562539974 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ff8011e20 con 0x55d52af3c360 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1562539974 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ff8004740 con 0x55d52af3c360 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f2012124e00 10 client.28799 _ll_register_callbacks cb 0x55d52adc9a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2004030ad0 con 0x55d52af3c360 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1562539974 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1ff80048a0 con 0x55d52af3c360 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1562539974 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ff8004a80 con 0x55d52af3c360 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f2012124e00 10 client.28799 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d52adcc6f0 con 0x55d52af3c360 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1562539974 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1ff8041060 con 0x55d52af3c360 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f2012124e00 10 client.28799 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f2012124e00 10 client.28799 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.272+0000 7f2012124e00 20 client.28799 populate_metadata read hostname 'trial028' 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55d52b02f840 0x55d52b04fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 4 client.28799 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d52aadbf40 con 0x55d52b02f840 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f200d69e640 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55d52b02f840 0x55d52b04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f200d69e640 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55d52b02f840 0x55d52b04fcf0 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=11248024571945024115 s_cookie=15478294080724509514 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c1902c0eba5fa73 server_cookie=d6cdf2757a9da34a in_seq=0 out_seq=0 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f1fc37fe640 10 client.28799 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f1fc37fe640 1 -- 10.20.193.28:0/1562539974 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d52aadbf40 con 0x55d52b02f840 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f1fc37fe640 10 client.28799 handle_command_reply: tid=0 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 client.28799 shutdown 2026-02-20T13:26:44.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3c360 msgr2=0x55d52af713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3c360 0x55d52af713f0 secure :-1 s=READY pgs=393 gs=3 cs=0 l=1 c_cookie=6752352936137089677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff80040c0 tx=0x7f1ff802af60 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 shutdown_connections 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55d52b02f840 0x55d52b04fcf0 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=11248024571945024115 s_cookie=15478294080724509514 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d52af81b20 0x55d52af71e70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d52af3cc70 0x55d52af71930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f1fc37fe640 0 client.28799 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.273+0000 7f2012124e00 1 --2- 10.20.193.28:0/1562539974 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d52af3c360 0x55d52af713f0 unknown :-1 s=CLOSED pgs=393 gs=3 cs=0 l=1 c_cookie=6752352936137089677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 >> 10.20.193.28:0/1562539974 conn(0x55d52af1a860 msgr2=0x55d52af80b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 shutdown_connections 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f2012124e00 1 -- 10.20.193.28:0/1562539974 wait complete. 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f2012124e00 20 client.28799 trim_cache size 0 max 16384 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 -- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1fe40b5760 msgr2=0x7f1fe40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1fe40b5760 0x7f1fe40d5c10 secure :-1 s=READY pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff8005970 tx=0x7f1ff8005900 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 -- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f200810ffe0 msgr2=0x7f200811da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f200810ffe0 0x7f200811da70 secure :-1 s=READY pgs=1083 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ffc009480 tx=0x7f1ffc00ee60 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 -- 10.20.193.28:0/2627113389 shutdown_connections 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1fe40b5760 0x7f1fe40d5c10 unknown :-1 s=CLOSED pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f200810ffe0 0x7f200811da70 unknown :-1 s=CLOSED pgs=1083 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f20081157e0 0x7f2008122e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 --2- 10.20.193.28:0/2627113389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f200810f5f0 0x7f200811d530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 -- 10.20.193.28:0/2627113389 >> 10.20.193.28:0/2627113389 conn(0x7f20080ecea0 msgr2=0x7f200810d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 -- 10.20.193.28:0/2627113389 shutdown_connections 2026-02-20T13:26:44.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.274+0000 7f201012a640 1 -- 10.20.193.28:0/2627113389 wait complete. 2026-02-20T13:26:44.373 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:26:44.561 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:44.629 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:44 trial028 ceph-mon[37442]: pgmap v463: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:44.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 -- 10.20.193.28:0/3627223216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 msgr2=0x7f9f38152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/3627223216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 0x7f9f38152c40 secure :-1 s=READY pgs=1085 gs=1 cs=0 l=1 c_cookie=9018425247357783507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2c009950 tx=0x7f9f2c02f190 comp rx=0 tx=0).stop 2026-02-20T13:26:44.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 -- 10.20.193.28:0/3627223216 shutdown_connections 2026-02-20T13:26:44.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/3627223216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 0x7f9f38152c40 unknown :-1 s=CLOSED pgs=1085 gs=1 cs=0 l=1 c_cookie=9018425247357783507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/3627223216 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f38153180 0x7f9f381735a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/3627223216 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f3810dbd0 0x7f9f3810dfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 -- 10.20.193.28:0/3627223216 >> 10.20.193.28:0/3627223216 conn(0x7f9f380e95a0 msgr2=0x7f9f381099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 -- 10.20.193.28:0/3627223216 shutdown_connections 2026-02-20T13:26:44.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.736+0000 7f9f3e50f640 1 -- 10.20.193.28:0/3627223216 wait complete. 2026-02-20T13:26:44.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3e50f640 1 Processor -- start 2026-02-20T13:26:44.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3e50f640 1 -- start start 2026-02-20T13:26:44.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3e50f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f3810dbd0 0x7f9f3815f8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3e50f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 0x7f9f3815fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3e50f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f38153180 0x7f9f381651d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3e50f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9f381657f0 con 0x7f9f3810e5c0 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3e50f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9f38165960 con 0x7f9f38153180 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3e50f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9f38165b20 con 0x7f9f3810dbd0 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3cd0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 0x7f9f3815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3d50d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f3810dbd0 0x7f9f3815f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3cd0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 0x7f9f3815fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46440/0 (socket says 10.20.193.28:46440) 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/998375391 learned_addr learned my addr 10.20.193.28:0/998375391 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.737+0000 7f9f3dd0e640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f38153180 0x7f9f381651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/998375391 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f3810dbd0 msgr2=0x7f9f3815f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f3810dbd0 0x7f9f3815f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/998375391 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f38153180 msgr2=0x7f9f381651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f38153180 0x7f9f381651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/998375391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c009570 con 0x7f9f3810e5c0 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 0x7f9f3815fe00 secure :-1 s=READY pgs=1086 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2c038820 tx=0x7f9f2c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f267fc640 1 -- 10.20.193.28:0/998375391 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f2c03d070 con 0x7f9f3810e5c0 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f267fc640 1 -- 10.20.193.28:0/998375391 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f2c038920 con 0x7f9f3810e5c0 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f267fc640 1 -- 10.20.193.28:0/998375391 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f2c041960 con 0x7f9f3810e5c0 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f3e50f640 1 -- 10.20.193.28:0/998375391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f38165da0 con 0x7f9f3810e5c0 2026-02-20T13:26:44.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.738+0000 7f9f3e50f640 1 -- 10.20.193.28:0/998375391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3810b940 con 0x7f9f3810e5c0 2026-02-20T13:26:44.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.741+0000 7f9f267fc640 1 -- 10.20.193.28:0/998375391 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9f2c041b10 con 0x7f9f3810e5c0 2026-02-20T13:26:44.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.743+0000 7f9f267fc640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f140b5760 0x7f9f140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.743+0000 7f9f267fc640 1 -- 10.20.193.28:0/998375391 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f2c10b170 con 0x7f9f3810e5c0 2026-02-20T13:26:44.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.743+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f140b5760 0x7f9f140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.743+0000 7f9f41792e00 1 Processor -- start 2026-02-20T13:26:44.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.743+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f140b5760 0x7f9f140d5c10 secure :-1 s=READY pgs=479 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28004740 tx=0x7f9f2800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f41792e00 1 -- start start 2026-02-20T13:26:44.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f8149b2730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2c70 0x55f8149f75e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 0x55f814a17f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f41792e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8148c8780 con 0x55f8149b2c70 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f41792e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f8148c44b0 con 0x55f8149f7b20 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f41792e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f8148be450 con 0x55f8149b2360 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3d50d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f8149b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3d50d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f8149b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54592/0 (socket says 10.20.193.28:54592) 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3d50d640 1 -- 10.20.193.28:0/3503259125 learned_addr learned my addr 10.20.193.28:0/3503259125 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3dd0e640 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 0x55f814a17f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2c70 0x55f8149f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3d50d640 1 -- 10.20.193.28:0/3503259125 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 msgr2=0x55f814a17f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 0x55f814a17f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3d50d640 1 -- 10.20.193.28:0/3503259125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2c70 msgr2=0x55f8149f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2c70 0x55f8149f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3d50d640 1 -- 10.20.193.28:0/3503259125 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f814869d10 con 0x55f8149b2360 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.744+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2c70 0x55f8149f75e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f8149b2730 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=5367957697983939935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28005db0 tx=0x7f9f28013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a7ed115eda8055f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f05ce5640 1 -- 10.20.193.28:0/3503259125 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f2801e640 con 0x55f8149b2360 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f05ce5640 1 -- 10.20.193.28:0/3503259125 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f28015070 con 0x55f8149b2360 2026-02-20T13:26:44.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f05ce5640 1 -- 10.20.193.28:0/3503259125 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f28026df0 con 0x55f8149b2360 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 -- 10.20.193.28:0/3503259125 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 msgr2=0x55f8149b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f8149b2730 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=5367957697983939935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28005db0 tx=0x7f9f28013000 comp rx=0 tx=0).stop 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 -- 10.20.193.28:0/3503259125 shutdown_connections 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2c70 0x55f8149f75e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 0x55f814a17f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 --2- 10.20.193.28:0/3503259125 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f8149b2730 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=5367957697983939935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 -- 10.20.193.28:0/3503259125 >> 10.20.193.28:0/3503259125 conn(0x55f814990860 msgr2=0x55f8149b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 -- 10.20.193.28:0/3503259125 shutdown_connections 2026-02-20T13:26:44.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.745+0000 7f9f41792e00 1 -- 10.20.193.28:0/3503259125 wait complete. 2026-02-20T13:26:44.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.746+0000 7f9f41792e00 1 -- start start 2026-02-20T13:26:44.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.746+0000 7f9f41792e00 1 Processor -- start 2026-02-20T13:26:44.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2360 0x55f814a0f650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0fb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814a14b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f41792e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f814a150c0 con 0x55f8149f7b20 2026-02-20T13:26:44.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f41792e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f814a15230 con 0x55f8149b2360 2026-02-20T13:26:44.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f41792e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f814a153f0 con 0x55f8149b2c70 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3d50d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2360 0x55f814a0f650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3cd0c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3d50d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2360 0x55f814a0f650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33694/0 (socket says 10.20.193.28:33694) 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3d50d640 1 -- 10.20.193.28:0/2372504718 learned_addr learned my addr 10.20.193.28:0/2372504718 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3dd0e640 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814a14b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/2372504718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2360 msgr2=0x55f814a0f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2360 0x55f814a0f650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/2372504718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 msgr2=0x55f814a14b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814a14b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/2372504718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8148423c0 con 0x55f8149b2c70 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3dd0e640 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814a14b80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:26:44.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0fb90 secure :-1 s=READY pgs=326 gs=2 cs=0 l=1 c_cookie=12464128849718086463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2c0cde80 tx=0x7f9f2c041410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf97b26aa250b3f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.747+0000 7f9ef2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/2372504718 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f2c0d0d30 con 0x55f8149b2c70 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/2372504718 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f2c0dc610 con 0x55f8149b2c70 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/2372504718 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f2c02fc50 con 0x55f8149b2c70 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2800bd10 con 0x55f8149b2c70 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/2372504718 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f2c0f6030 con 0x55f8149b2c70 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9f41792e00 10 client.28714 _ll_register_callbacks cb 0x55f81483fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8145546f0 con 0x55f8149b2c70 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/2372504718 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f2c02fde0 con 0x55f8149b2c70 2026-02-20T13:26:44.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9f41792e00 10 client.28714 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f8148540e0 con 0x55f8149b2c70 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/2372504718 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f2c0d0580 con 0x55f8149b2c70 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9f41792e00 10 client.28714 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.748+0000 7f9f41792e00 10 client.28714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.749+0000 7f9f41792e00 20 client.28714 populate_metadata read hostname 'trial028' 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.749+0000 7f9f41792e00 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f8149f4d60 0x55f8149f5200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.749+0000 7f9f41792e00 4 client.28714 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.749+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f814860f80 con 0x55f8149f4d60 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.749+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f8149f4d60 0x55f8149f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.749+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f8149f4d60 0x55f8149f5200 crc :-1 s=READY pgs=278 gs=4 cs=0 l=0 c_cookie=576889300246052155 s_cookie=60090189439280083 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80185c317e3bd3b server_cookie=d57bb57c03a3d3 in_seq=0 out_seq=0 2026-02-20T13:26:44.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.749+0000 7f9ef2ffd640 10 client.28714 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/2372504718 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f814860f80 con 0x55f8149f4d60 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9ef2ffd640 10 client.28714 handle_command_reply: tid=0 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 client.28714 shutdown 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 msgr2=0x55f814a0fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0fb90 secure :-1 s=READY pgs=326 gs=2 cs=0 l=1 c_cookie=12464128849718086463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2c0cde80 tx=0x7f9f2c041410 comp rx=0 tx=0).stop 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 shutdown_connections 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f8149f4d60 0x55f8149f5200 crc :-1 s=READY pgs=278 gs=4 cs=0 l=0 c_cookie=576889300246052155 s_cookie=60090189439280083 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814a14b80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0fb90 unknown :-1 s=CLOSED pgs=326 gs=2 cs=0 l=1 c_cookie=12464128849718086463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 --2- 10.20.193.28:0/2372504718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2360 0x55f814a0f650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9ef2ffd640 0 client.28714 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:44.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 >> 10.20.193.28:0/2372504718 conn(0x55f814990860 msgr2=0x55f8149b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 shutdown_connections 2026-02-20T13:26:44.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 1 -- 10.20.193.28:0/2372504718 wait complete. 2026-02-20T13:26:44.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.750+0000 7f9f41792e00 20 client.28714 trim_cache size 0 max 16384 2026-02-20T13:26:44.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.757+0000 7f9f41792e00 1 Processor -- start 2026-02-20T13:26:44.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.757+0000 7f9f41792e00 1 -- start start 2026-02-20T13:26:44.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.757+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2360 0x55f814a0c800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.757+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0cd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.757+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 0x55f8149f1770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.757+0000 7f9f41792e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8148bc080 con 0x55f8149b2360 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.757+0000 7f9f41792e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f81457c700 con 0x55f8149f7b20 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.757+0000 7f9f41792e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f814a084e0 con 0x55f8149b2c70 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2360 0x55f814a0c800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3cd0c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2360 0x55f814a0c800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46470/0 (socket says 10.20.193.28:46470) 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 -- 10.20.193.28:0/3023392526 learned_addr learned my addr 10.20.193.28:0/3023392526 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3dd0e640 1 --2- 10.20.193.28:0/3023392526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 0x55f8149f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 -- 10.20.193.28:0/3023392526 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 msgr2=0x55f814a0cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/3023392526 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 -- 10.20.193.28:0/3023392526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 msgr2=0x55f8149f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/3023392526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 0x55f8149f1770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 -- 10.20.193.28:0/3023392526 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81484eb60 con 0x55f8149b2360 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/3023392526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2360 0x55f814a0c800 secure :-1 s=READY pgs=1087 gs=1 cs=0 l=1 c_cookie=1839562876970435073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28005db0 tx=0x7f9f28026940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198770b0afd18201 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f054e4640 1 -- 10.20.193.28:0/3023392526 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f280269b0 con 0x55f8149b2360 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f054e4640 1 -- 10.20.193.28:0/3023392526 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f2802b040 con 0x55f8149b2360 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.758+0000 7f9f054e4640 1 -- 10.20.193.28:0/3023392526 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f28005720 con 0x55f8149b2360 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 -- 10.20.193.28:0/3023392526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2360 msgr2=0x55f814a0c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 --2- 10.20.193.28:0/3023392526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2360 0x55f814a0c800 secure :-1 s=READY pgs=1087 gs=1 cs=0 l=1 c_cookie=1839562876970435073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28005db0 tx=0x7f9f28026940 comp rx=0 tx=0).stop 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 -- 10.20.193.28:0/3023392526 shutdown_connections 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 --2- 10.20.193.28:0/3023392526 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149f7b20 0x55f8149f1770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 --2- 10.20.193.28:0/3023392526 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2c70 0x55f814a0cd40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 --2- 10.20.193.28:0/3023392526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149b2360 0x55f814a0c800 unknown :-1 s=CLOSED pgs=1087 gs=1 cs=0 l=1 c_cookie=1839562876970435073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 -- 10.20.193.28:0/3023392526 >> 10.20.193.28:0/3023392526 conn(0x55f814990860 msgr2=0x55f8149f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 -- 10.20.193.28:0/3023392526 shutdown_connections 2026-02-20T13:26:44.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 -- 10.20.193.28:0/3023392526 wait complete. 2026-02-20T13:26:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.759+0000 7f9f41792e00 1 -- start start 2026-02-20T13:26:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f41792e00 1 Processor -- start 2026-02-20T13:26:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f814996980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2c70 0x55f814991e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f41792e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814992550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f41792e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8149f5390 con 0x55f8149f7b20 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f41792e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f814992c80 con 0x55f8149b2c70 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f41792e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f814a5d9a0 con 0x55f8149b2360 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3cd0c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2c70 0x55f814991e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3dd0e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814992550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3cd0c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2c70 0x55f814991e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33710/0 (socket says 10.20.193.28:33710) 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/1340213475 learned_addr learned my addr 10.20.193.28:0/1340213475 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f814996980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/1340213475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 msgr2=0x55f814996980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f814996980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/1340213475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 msgr2=0x55f814992550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814992550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.760+0000 7f9f3cd0c640 1 -- 10.20.193.28:0/1340213475 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8148426f0 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f3cd0c640 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2c70 0x55f814991e60 secure :-1 s=READY pgs=394 gs=2 cs=0 l=1 c_cookie=8700894949882556429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2c0d1a90 tx=0x7f9f2c0d5000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78bfc9db8bbd700d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9ef2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/1340213475 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f2c0d71c0 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/1340213475 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f8145546f0 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f814869d10 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 10 client.28817 _ll_register_callbacks cb 0x55f81483fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f28015070 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/1340213475 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f2c0f6610 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/1340213475 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f2c0f6030 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/1340213475 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f2c0f6770 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 10 client.28817 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f814854340 con 0x55f8149b2c70 2026-02-20T13:26:44.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/1340213475 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f2c0d39b0 con 0x55f8149b2c70 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 10 client.28817 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 10 client.28817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 20 client.28817 populate_metadata read hostname 'trial028' 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f814aa51c0 0x55f814ac5670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 4 client.28817 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f814551f40 con 0x55f814aa51c0 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.761+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f814aa51c0 0x55f814ac5670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f3d50d640 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f814aa51c0 0x55f814ac5670 crc :-1 s=READY pgs=279 gs=4 cs=0 l=0 c_cookie=6595293280719355508 s_cookie=16389617131257460672 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b87304ba2cc3e74 server_cookie=e3739df1e941f7c0 in_seq=0 out_seq=0 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9ef2ffd640 10 client.28817 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9ef2ffd640 1 -- 10.20.193.28:0/1340213475 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f814551f40 con 0x55f814aa51c0 2026-02-20T13:26:44.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9ef2ffd640 10 client.28817 handle_command_reply: tid=0 2026-02-20T13:26:44.771 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:26:44.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 client.28817 shutdown 2026-02-20T13:26:44.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2c70 msgr2=0x55f814991e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2c70 0x55f814991e60 secure :-1 s=READY pgs=394 gs=2 cs=0 l=1 c_cookie=8700894949882556429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2c0d1a90 tx=0x7f9f2c0d5000 comp rx=0 tx=0).stop 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 shutdown_connections 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f814aa51c0 0x55f814ac5670 crc :-1 s=READY pgs=279 gs=4 cs=0 l=0 c_cookie=6595293280719355508 s_cookie=16389617131257460672 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8149f7b20 0x55f814992550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8149b2c70 0x55f814991e60 unknown :-1 s=CLOSED pgs=394 gs=2 cs=0 l=1 c_cookie=8700894949882556429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 --2- 10.20.193.28:0/1340213475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f8149b2360 0x55f814996980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9ef2ffd640 0 client.28817 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 >> 10.20.193.28:0/1340213475 conn(0x55f814990860 msgr2=0x55f814a0b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 shutdown_connections 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 1 -- 10.20.193.28:0/1340213475 wait complete. 2026-02-20T13:26:44.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.762+0000 7f9f41792e00 20 client.28817 trim_cache size 0 max 16384 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 -- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f140b5760 msgr2=0x7f9f140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f140b5760 0x7f9f140d5c10 secure :-1 s=READY pgs=479 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28004740 tx=0x7f9f2800b410 comp rx=0 tx=0).stop 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 -- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 msgr2=0x7f9f3815fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 0x7f9f3815fe00 secure :-1 s=READY pgs=1086 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f2c038820 tx=0x7f9f2c0043d0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 -- 10.20.193.28:0/998375391 shutdown_connections 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f140b5760 0x7f9f140d5c10 unknown :-1 s=CLOSED pgs=479 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f3810e5c0 0x7f9f3815fe00 unknown :-1 s=CLOSED pgs=1086 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f38153180 0x7f9f381651d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 --2- 10.20.193.28:0/998375391 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f3810dbd0 0x7f9f3815f8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 -- 10.20.193.28:0/998375391 >> 10.20.193.28:0/998375391 conn(0x7f9f380e95a0 msgr2=0x7f9f38109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 -- 10.20.193.28:0/998375391 shutdown_connections 2026-02-20T13:26:44.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:44.763+0000 7f9f3e50f640 1 -- 10.20.193.28:0/998375391 wait complete. 2026-02-20T13:26:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:44 trial127 ceph-mon[43817]: pgmap v463: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:44 trial034 ceph-mon[43332]: pgmap v463: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:26:45.863 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:26:45.864 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:26:46.050 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:46.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 -- 10.20.193.28:0/706847311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c8113190 msgr2=0x7f59c8173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/706847311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c8113190 0x7f59c8173b60 secure :-1 s=READY pgs=1088 gs=1 cs=0 l=1 c_cookie=8562985075700509306 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b800aa30 tx=0x7f59b8030270 comp rx=0 tx=0).stop 2026-02-20T13:26:46.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 -- 10.20.193.28:0/706847311 shutdown_connections 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/706847311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c8113190 0x7f59c8173b60 unknown :-1 s=CLOSED pgs=1088 gs=1 cs=0 l=1 c_cookie=8562985075700509306 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/706847311 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c810d990 0x7f59c81129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/706847311 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c810cfa0 0x7f59c810d370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 -- 10.20.193.28:0/706847311 >> 10.20.193.28:0/706847311 conn(0x7f59c805f830 msgr2=0x7f59c810ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 -- 10.20.193.28:0/706847311 shutdown_connections 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 -- 10.20.193.28:0/706847311 wait complete. 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.231+0000 7f59ccf5e640 1 Processor -- start 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59ccf5e640 1 -- start start 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59ccf5e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c810cfa0 0x7f59c80f54d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59ccf5e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c810d990 0x7f59c8173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59ccf5e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c8113190 0x7f59c80f5bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59ccf5e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59c80fade0 con 0x7f59c8113190 2026-02-20T13:26:46.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59ccf5e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f59c80faf50 con 0x7f59c810cfa0 2026-02-20T13:26:46.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59ccf5e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f59c80fb110 con 0x7f59c810d990 2026-02-20T13:26:46.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c810d990 0x7f59c8173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c810d990 0x7f59c8173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54620/0 (socket says 10.20.193.28:54620) 2026-02-20T13:26:46.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59c5d74640 1 -- 10.20.193.28:0/3199437600 learned_addr learned my addr 10.20.193.28:0/3199437600 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59c6575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c810cfa0 0x7f59c80f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.232+0000 7f59c6d76640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c8113190 0x7f59c80f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59c5d74640 1 -- 10.20.193.28:0/3199437600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c810cfa0 msgr2=0x7f59c80f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59c5d74640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c810cfa0 0x7f59c80f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59c5d74640 1 -- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c8113190 msgr2=0x7f59c80f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59c5d74640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c8113190 0x7f59c80f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59c5d74640 1 -- 10.20.193.28:0/3199437600 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b800a650 con 0x7f59c810d990 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59c6575640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c810cfa0 0x7f59c80f54d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59c5d74640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c810d990 0x7f59c8173a60 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b0009480 tx=0x7f59b000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59af7fe640 1 -- 10.20.193.28:0/3199437600 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b000ccc0 con 0x7f59c810d990 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59af7fe640 1 -- 10.20.193.28:0/3199437600 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59b000ce20 con 0x7f59c810d990 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59af7fe640 1 -- 10.20.193.28:0/3199437600 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b00106b0 con 0x7f59c810d990 2026-02-20T13:26:46.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59ccf5e640 1 -- 10.20.193.28:0/3199437600 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c80fb3f0 con 0x7f59c810d990 2026-02-20T13:26:46.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.233+0000 7f59ccf5e640 1 -- 10.20.193.28:0/3199437600 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c80fb870 con 0x7f59c810d990 2026-02-20T13:26:46.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.236+0000 7f59af7fe640 1 -- 10.20.193.28:0/3199437600 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f59b001f060 con 0x7f59c810d990 2026-02-20T13:26:46.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.238+0000 7f59af7fe640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b5750 0x7f59a00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.238+0000 7f59af7fe640 1 -- 10.20.193.28:0/3199437600 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f59b0014070 con 0x7f59c810d990 2026-02-20T13:26:46.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.238+0000 7f59c6575640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b5750 0x7f59a00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.238+0000 7f59c6575640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b5750 0x7f59a00d5c00 secure :-1 s=READY pgs=480 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59bc004740 tx=0x7f59bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.239+0000 7f59cef58e00 1 Processor -- start 2026-02-20T13:26:46.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.239+0000 7f59cef58e00 1 -- start start 2026-02-20T13:26:46.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.239+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf25f77e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.239+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf263c480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.239+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf265cda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.239+0000 7f59cef58e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dbf250da20 con 0x55dbf263c9c0 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.239+0000 7f59cef58e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dbf2509750 con 0x55dbf25f7410 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.239+0000 7f59cef58e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dbf25036f0 con 0x55dbf25f7d20 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf265cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf263c480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf263c480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54628/0 (socket says 10.20.193.28:54628) 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c5d74640 1 -- 10.20.193.28:0/2982181240 learned_addr learned my addr 10.20.193.28:0/2982181240 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c6575640 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf25f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c6d76640 1 -- 10.20.193.28:0/2982181240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 msgr2=0x55dbf263c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c6d76640 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf263c480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c6d76640 1 -- 10.20.193.28:0/2982181240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 msgr2=0x55dbf25f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c6d76640 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf25f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c6d76640 1 -- 10.20.193.28:0/2982181240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf24af120 con 0x55dbf263c9c0 2026-02-20T13:26:46.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c5d74640 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf263c480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:46.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.240+0000 7f59c6d76640 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf265cda0 secure :-1 s=READY pgs=1089 gs=1 cs=0 l=1 c_cookie=4436050043852518480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b800aa30 tx=0x7f59b8006eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d900402fdaf7450 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59acff9640 1 -- 10.20.193.28:0/2982181240 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b803e050 con 0x55dbf263c9c0 2026-02-20T13:26:46.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59acff9640 1 -- 10.20.193.28:0/2982181240 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59b803f040 con 0x55dbf263c9c0 2026-02-20T13:26:46.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59acff9640 1 -- 10.20.193.28:0/2982181240 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b8039920 con 0x55dbf263c9c0 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 -- 10.20.193.28:0/2982181240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 msgr2=0x55dbf265cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf265cda0 secure :-1 s=READY pgs=1089 gs=1 cs=0 l=1 c_cookie=4436050043852518480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b800aa30 tx=0x7f59b8006eb0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 -- 10.20.193.28:0/2982181240 shutdown_connections 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf265cda0 unknown :-1 s=CLOSED pgs=1089 gs=1 cs=0 l=1 c_cookie=4436050043852518480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf263c480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2982181240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf25f77e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 -- 10.20.193.28:0/2982181240 >> 10.20.193.28:0/2982181240 conn(0x55dbf25d5910 msgr2=0x55dbf25f5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 -- 10.20.193.28:0/2982181240 shutdown_connections 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.241+0000 7f59cef58e00 1 -- 10.20.193.28:0/2982181240 wait complete. 2026-02-20T13:26:46.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.243+0000 7f59cef58e00 1 -- start start 2026-02-20T13:26:46.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.243+0000 7f59cef58e00 1 Processor -- start 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.243+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf260fb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.243+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26100d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.243+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf263c9c0 0x55dbf26150c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.243+0000 7f59cef58e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dbf2615600 con 0x55dbf25f7d20 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.243+0000 7f59cef58e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dbf2615770 con 0x55dbf25f7410 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.243+0000 7f59cef58e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dbf2615930 con 0x55dbf263c9c0 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c6d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf263c9c0 0x55dbf26150c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c6575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf260fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46516/0 (socket says 10.20.193.28:46516) 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 -- 10.20.193.28:0/2492265972 learned_addr learned my addr 10.20.193.28:0/2492265972 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 -- 10.20.193.28:0/2492265972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf263c9c0 msgr2=0x55dbf26150c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf263c9c0 0x55dbf26150c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 -- 10.20.193.28:0/2492265972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 msgr2=0x55dbf260fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf260fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 -- 10.20.193.28:0/2492265972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c81743d0 con 0x55dbf25f7d20 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59c5d74640 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26100d0 secure :-1 s=READY pgs=1090 gs=2 cs=0 l=1 c_cookie=3985862065593493371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b00e46e0 tx=0x7f59b00a9670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3750a06e3f67a77b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f5977fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f5977fff640 1 -- 10.20.193.28:0/2492265972 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b00d0df0 con 0x55dbf25f7d20 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c80fb870 con 0x55dbf25f7d20 2026-02-20T13:26:46.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59cef58e00 10 client.18873 _ll_register_callbacks cb 0x55dbf24bab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dbf21999d0 con 0x55dbf25f7d20 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f5977fff640 1 -- 10.20.193.28:0/2492265972 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59b00ac710 con 0x55dbf25f7d20 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.244+0000 7f5977fff640 1 -- 10.20.193.28:0/2492265972 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b00ade20 con 0x55dbf25f7d20 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f5977fff640 1 -- 10.20.193.28:0/2492265972 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f59b00aaef0 con 0x55dbf25f7d20 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f5977fff640 1 -- 10.20.193.28:0/2492265972 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f59b00ab0d0 con 0x55dbf25f7d20 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59cef58e00 10 client.18873 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dbf2487810 con 0x55dbf25f7d20 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f5977fff640 1 -- 10.20.193.28:0/2492265972 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f59b00ae900 con 0x55dbf25f7d20 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59cef58e00 10 client.18873 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59cef58e00 10 client.18873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:46.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59cef58e00 20 client.18873 populate_metadata read hostname 'trial028' 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dbf263a3c0 0x55dbf263a860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59cef58e00 4 client.18873 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbf2510df0 con 0x55dbf263a3c0 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.245+0000 7f59c6575640 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dbf263a3c0 0x55dbf263a860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.246+0000 7f59c6575640 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dbf263a3c0 0x55dbf263a860 crc :-1 s=READY pgs=280 gs=4 cs=0 l=0 c_cookie=14151481627661569424 s_cookie=17478737622013928785 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4642990063c0d90 server_cookie=f290f342ca656551 in_seq=0 out_seq=0 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.246+0000 7f5977fff640 10 client.18873 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.246+0000 7f5977fff640 1 -- 10.20.193.28:0/2492265972 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dbf2510df0 con 0x55dbf263a3c0 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.246+0000 7f5977fff640 10 client.18873 handle_command_reply: tid=0 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.246+0000 7f59cef58e00 1 client.18873 shutdown 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 msgr2=0x55dbf26100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26100d0 secure :-1 s=READY pgs=1090 gs=2 cs=0 l=1 c_cookie=3985862065593493371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b00e46e0 tx=0x7f59b00a9670 comp rx=0 tx=0).stop 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 shutdown_connections 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dbf263a3c0 0x55dbf263a860 crc :-1 s=READY pgs=280 gs=4 cs=0 l=0 c_cookie=14151481627661569424 s_cookie=17478737622013928785 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26100d0 unknown :-1 s=CLOSED pgs=1090 gs=2 cs=0 l=1 c_cookie=3985862065593493371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf263c9c0 0x55dbf26150c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 --2- 10.20.193.28:0/2492265972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf260fb90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 >> 10.20.193.28:0/2492265972 conn(0x55dbf25d5910 msgr2=0x55dbf25f64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f5977fff640 0 client.18873 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 shutdown_connections 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 1 -- 10.20.193.28:0/2492265972 wait complete. 2026-02-20T13:26:46.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.247+0000 7f59cef58e00 20 client.18873 trim_cache size 0 max 16384 2026-02-20T13:26:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59cef58e00 1 Processor -- start 2026-02-20T13:26:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59cef58e00 1 -- start start 2026-02-20T13:26:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7410 0x55dbf2635290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26357d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf263c9c0 0x55dbf260bf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59cef58e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dbf2501320 con 0x55dbf25f7d20 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59cef58e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dbf21c1790 con 0x55dbf263c9c0 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59cef58e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dbf2615a70 con 0x55dbf25f7410 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c6d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf263c9c0 0x55dbf260bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26357d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46520/0 (socket says 10.20.193.28:46520) 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c5d74640 1 -- 10.20.193.28:0/3177288826 learned_addr learned my addr 10.20.193.28:0/3177288826 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c6575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7410 0x55dbf2635290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c5d74640 1 -- 10.20.193.28:0/3177288826 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7410 msgr2=0x55dbf2635290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c5d74640 1 --2- 10.20.193.28:0/3177288826 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7410 0x55dbf2635290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c5d74640 1 -- 10.20.193.28:0/3177288826 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf263c9c0 msgr2=0x55dbf260bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c5d74640 1 --2- 10.20.193.28:0/3177288826 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf263c9c0 0x55dbf260bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.257+0000 7f59c5d74640 1 -- 10.20.193.28:0/3177288826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf2601e90 con 0x55dbf25f7d20 2026-02-20T13:26:46.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59c5d74640 1 --2- 10.20.193.28:0/3177288826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26357d0 secure :-1 s=READY pgs=1091 gs=1 cs=0 l=1 c_cookie=15415188712601513993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b000c6a0 tx=0x7f59b00c5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5edc07600397009 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59924e6640 1 -- 10.20.193.28:0/3177288826 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b0010810 con 0x55dbf25f7d20 2026-02-20T13:26:46.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59924e6640 1 -- 10.20.193.28:0/3177288826 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59b00c8070 con 0x55dbf25f7d20 2026-02-20T13:26:46.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59924e6640 1 -- 10.20.193.28:0/3177288826 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b00b2c30 con 0x55dbf25f7d20 2026-02-20T13:26:46.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 -- 10.20.193.28:0/3177288826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 msgr2=0x55dbf26357d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 --2- 10.20.193.28:0/3177288826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26357d0 secure :-1 s=READY pgs=1091 gs=1 cs=0 l=1 c_cookie=15415188712601513993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b000c6a0 tx=0x7f59b00c5000 comp rx=0 tx=0).stop 2026-02-20T13:26:46.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 -- 10.20.193.28:0/3177288826 shutdown_connections 2026-02-20T13:26:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 --2- 10.20.193.28:0/3177288826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf25f7d20 0x55dbf26357d0 unknown :-1 s=CLOSED pgs=1091 gs=1 cs=0 l=1 c_cookie=15415188712601513993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 --2- 10.20.193.28:0/3177288826 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf263c9c0 0x55dbf260bf40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 --2- 10.20.193.28:0/3177288826 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7410 0x55dbf2635290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 -- 10.20.193.28:0/3177288826 >> 10.20.193.28:0/3177288826 conn(0x55dbf25d5910 msgr2=0x55dbf263b140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 -- 10.20.193.28:0/3177288826 shutdown_connections 2026-02-20T13:26:46.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.258+0000 7f59cef58e00 1 -- 10.20.193.28:0/3177288826 wait complete. 2026-02-20T13:26:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59cef58e00 1 -- start start 2026-02-20T13:26:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59cef58e00 1 Processor -- start 2026-02-20T13:26:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf26179d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf2617f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59cef58e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf26a1ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59cef58e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dbf26a2420 con 0x55dbf263c9c0 2026-02-20T13:26:46.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59cef58e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dbf26a2590 con 0x55dbf25f7410 2026-02-20T13:26:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59cef58e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dbf26a2750 con 0x55dbf25f7d20 2026-02-20T13:26:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.259+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf2617f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c5d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf2617f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:54664/0 (socket says 10.20.193.28:54664) 2026-02-20T13:26:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c5d74640 1 -- 10.20.193.28:0/1738587525 learned_addr learned my addr 10.20.193.28:0/1738587525 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c6d76640 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf26a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c6575640 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf26179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c5d74640 1 -- 10.20.193.28:0/1738587525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 msgr2=0x55dbf26179d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c5d74640 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf26179d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c5d74640 1 -- 10.20.193.28:0/1738587525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 msgr2=0x55dbf26a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c5d74640 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf26a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c5d74640 1 -- 10.20.193.28:0/1738587525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf24994f0 con 0x55dbf25f7d20 2026-02-20T13:26:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c6d76640 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf26a1ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:46.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59c5d74640 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf2617f10 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=7992436231887318036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b00ad180 tx=0x7f59b0016fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eead6683b9aec14 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f5977fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:26:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f5977fff640 1 -- 10.20.193.28:0/1738587525 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b00b2c30 con 0x55dbf25f7d20 2026-02-20T13:26:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f5977fff640 1 -- 10.20.193.28:0/1738587525 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55dbf21999d0 con 0x55dbf25f7d20 2026-02-20T13:26:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f5977fff640 1 -- 10.20.193.28:0/1738587525 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b0010810 con 0x55dbf25f7d20 2026-02-20T13:26:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b00722b0 con 0x55dbf25f7d20 2026-02-20T13:26:46.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.260+0000 7f5977fff640 1 -- 10.20.193.28:0/1738587525 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f59b00ae470 con 0x55dbf25f7d20 2026-02-20T13:26:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f5977fff640 10 client.28738 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:26:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 10 client.28738 _ll_register_callbacks cb 0x55dbf24bab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dbf225b530 con 0x55dbf25f7d20 2026-02-20T13:26:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f5977fff640 1 -- 10.20.193.28:0/1738587525 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f59b00b41e0 con 0x55dbf25f7d20 2026-02-20T13:26:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 10 client.28738 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dbf2493f70 con 0x55dbf25f7d20 2026-02-20T13:26:46.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f5977fff640 1 -- 10.20.193.28:0/1738587525 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f59b00d0bd0 con 0x55dbf25f7d20 2026-02-20T13:26:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 10 client.28738 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 10 client.28738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 20 client.28738 populate_metadata read hostname 'trial028' 2026-02-20T13:26:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dbf26e9f80 0x55dbf270a430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 4 client.28738 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:26:46.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f59b803f040 con 0x55dbf26e9f80 2026-02-20T13:26:46.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.261+0000 7f59c6575640 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dbf26e9f80 0x55dbf270a430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.262+0000 7f59c6575640 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dbf26e9f80 0x55dbf270a430 crc :-1 s=READY pgs=281 gs=4 cs=0 l=0 c_cookie=15397991378647816311 s_cookie=1158357415058241685 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b0a793aad49877 server_cookie=10134fee877c7895 in_seq=0 out_seq=0 2026-02-20T13:26:46.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.262+0000 7f5977fff640 10 client.28738 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:46.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.262+0000 7f5977fff640 1 -- 10.20.193.28:0/1738587525 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f59b803f040 con 0x55dbf26e9f80 2026-02-20T13:26:46.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.262+0000 7f5977fff640 10 client.28738 handle_command_reply: tid=0 2026-02-20T13:26:46.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.262+0000 7f59cef58e00 1 client.28738 shutdown 2026-02-20T13:26:46.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.262+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 msgr2=0x55dbf2617f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.262+0000 7f59cef58e00 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf2617f10 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=7992436231887318036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b00ad180 tx=0x7f59b0016fb0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 shutdown_connections 2026-02-20T13:26:46.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dbf26e9f80 0x55dbf270a430 crc :-1 s=READY pgs=281 gs=4 cs=0 l=0 c_cookie=15397991378647816311 s_cookie=1158357415058241685 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbf263c9c0 0x55dbf26a1ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dbf25f7d20 0x55dbf2617f10 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=7992436231887318036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 1 --2- 10.20.193.28:0/1738587525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dbf25f7410 0x55dbf26179d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 >> 10.20.193.28:0/1738587525 conn(0x55dbf25d5910 msgr2=0x55dbf263b930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f5977fff640 0 client.28738 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:46.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 shutdown_connections 2026-02-20T13:26:46.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 1 -- 10.20.193.28:0/1738587525 wait complete. 2026-02-20T13:26:46.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59cef58e00 20 client.28738 trim_cache size 0 max 16384 2026-02-20T13:26:46.276 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:26:46.277 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:26:46.277 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "f0a289d9-6e3e-4203-a096-2c93fa2928ba", 2026-02-20T13:26:46.277 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:26:46.277 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:26:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 -- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b5750 msgr2=0x7f59a00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b5750 0x7f59a00d5c00 secure :-1 s=READY pgs=480 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59bc004740 tx=0x7f59bc005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 -- 10.20.193.28:0/3199437600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c810d990 msgr2=0x7f59c8173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c810d990 0x7f59c8173a60 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b0009480 tx=0x7f59b000ee60 comp rx=0 tx=0).stop 2026-02-20T13:26:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 -- 10.20.193.28:0/3199437600 shutdown_connections 2026-02-20T13:26:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f59a00b5750 0x7f59a00d5c00 unknown :-1 s=CLOSED pgs=480 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59c8113190 0x7f59c80f5bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f59c810d990 0x7f59c8173a60 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 --2- 10.20.193.28:0/3199437600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f59c810cfa0 0x7f59c80f54d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.263+0000 7f59ccf5e640 1 -- 10.20.193.28:0/3199437600 >> 10.20.193.28:0/3199437600 conn(0x7f59c805f830 msgr2=0x7f59c810b490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.264+0000 7f59ccf5e640 1 -- 10.20.193.28:0/3199437600 shutdown_connections 2026-02-20T13:26:46.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.264+0000 7f59ccf5e640 1 -- 10.20.193.28:0/3199437600 wait complete. 2026-02-20T13:26:46.398 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:26:46.583 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:26:46.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:46 trial028 ceph-mon[37442]: pgmap v464: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:26:46.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:46 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:26:46.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:46 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:46.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:46 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:26:46.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:46 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:26:46.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:46 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:46.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:46 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:46.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 -- 10.20.193.28:0/4000571339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 msgr2=0x7f46cc10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 --2- 10.20.193.28:0/4000571339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 0x7f46cc10f880 secure :-1 s=READY pgs=1092 gs=1 cs=0 l=1 c_cookie=7368360821167316487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46b8009950 tx=0x7f46b802f190 comp rx=0 tx=0).stop 2026-02-20T13:26:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 -- 10.20.193.28:0/4000571339 shutdown_connections 2026-02-20T13:26:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 --2- 10.20.193.28:0/4000571339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f46cc1156a0 0x7f46cc176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 --2- 10.20.193.28:0/4000571339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f46cc10fea0 0x7f46cc114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 --2- 10.20.193.28:0/4000571339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 0x7f46cc10f880 unknown :-1 s=CLOSED pgs=1092 gs=1 cs=0 l=1 c_cookie=7368360821167316487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 -- 10.20.193.28:0/4000571339 >> 10.20.193.28:0/4000571339 conn(0x7f46cc0ecda0 msgr2=0x7f46cc10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 -- 10.20.193.28:0/4000571339 shutdown_connections 2026-02-20T13:26:46.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.759+0000 7f46cbfff640 1 -- 10.20.193.28:0/4000571339 wait complete. 2026-02-20T13:26:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cbfff640 1 Processor -- start 2026-02-20T13:26:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cbfff640 1 -- start start 2026-02-20T13:26:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 0x7f46cc11ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f46cc10fea0 0x7f46cc11e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f46cc1156a0 0x7f46cc1236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc123d00 con 0x7f46cc10f4b0 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cbfff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc123e70 con 0x7f46cc1156a0 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cbfff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc124030 con 0x7f46cc10fea0 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46caffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 0x7f46cc11ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46cb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f46cc1156a0 0x7f46cc1236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46caffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 0x7f46cc11ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46538/0 (socket says 10.20.193.28:46538) 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46caffd640 1 -- 10.20.193.28:0/2652637661 learned_addr learned my addr 10.20.193.28:0/2652637661 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f46cc10fea0 0x7f46cc11e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46caffd640 1 -- 10.20.193.28:0/2652637661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f46cc10fea0 msgr2=0x7f46cc11e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.760+0000 7f46caffd640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f46cc10fea0 0x7f46cc11e310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46caffd640 1 -- 10.20.193.28:0/2652637661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f46cc1156a0 msgr2=0x7f46cc1236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46caffd640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f46cc1156a0 0x7f46cc1236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46caffd640 1 -- 10.20.193.28:0/2652637661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b8009570 con 0x7f46cc10f4b0 2026-02-20T13:26:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46caffd640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 0x7f46cc11ddd0 secure :-1 s=READY pgs=1093 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46b8005b30 tx=0x7f46b8004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46d0802640 1 -- 10.20.193.28:0/2652637661 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46b803d070 con 0x7f46cc10f4b0 2026-02-20T13:26:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46cbfff640 1 -- 10.20.193.28:0/2652637661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46cc1242b0 con 0x7f46cc10f4b0 2026-02-20T13:26:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46d0802640 1 -- 10.20.193.28:0/2652637661 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f46b8038920 con 0x7f46cc10f4b0 2026-02-20T13:26:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46d0802640 1 -- 10.20.193.28:0/2652637661 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46b80418a0 con 0x7f46cc10f4b0 2026-02-20T13:26:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.761+0000 7f46cbfff640 1 -- 10.20.193.28:0/2652637661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46cc164a10 con 0x7f46cc10f4b0 2026-02-20T13:26:46.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.764+0000 7f46d0802640 1 -- 10.20.193.28:0/2652637661 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f46b8048020 con 0x7f46cc10f4b0 2026-02-20T13:26:46.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.765+0000 7f46d0802640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46a00b5760 0x7f46a00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.765+0000 7f46d0802640 1 -- 10.20.193.28:0/2652637661 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f46b810adc0 con 0x7f46cc10f4b0 2026-02-20T13:26:46.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.765+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46a00b5760 0x7f46a00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.766+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46a00b5760 0x7f46a00d5c10 secure :-1 s=READY pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46cc124770 tx=0x7f46c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.766+0000 7f46d37fee00 1 Processor -- start 2026-02-20T13:26:46.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.766+0000 7f46d37fee00 1 -- start start 2026-02-20T13:26:46.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.766+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe67b90 0x562dabe67f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.766+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabeace10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabead350 0x562dabecd730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46d37fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562dabd757d0 con 0x562dabe684a0 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46d37fee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562dabd71500 con 0x562dabead350 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46d37fee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562dabd6b4a0 con 0x562dabe67b90 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabeace10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46cb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabead350 0x562dabecd730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabeace10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46550/0 (socket says 10.20.193.28:46550) 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 -- 10.20.193.28:0/2949511895 learned_addr learned my addr 10.20.193.28:0/2949511895 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46caffd640 1 --2- 10.20.193.28:0/2949511895 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe67b90 0x562dabe67f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 -- 10.20.193.28:0/2949511895 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe67b90 msgr2=0x562dabe67f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2949511895 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe67b90 0x562dabe67f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 -- 10.20.193.28:0/2949511895 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabead350 msgr2=0x562dabecd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2949511895 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabead350 0x562dabecd730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 -- 10.20.193.28:0/2949511895 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dabd16d80 con 0x562dabe684a0 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2949511895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabeace10 secure :-1 s=READY pgs=1094 gs=2 cs=0 l=1 c_cookie=3975746999154169975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c0004200 tx=0x7f46c0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372cb0d4d168d877 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f468ffff640 1 -- 10.20.193.28:0/2949511895 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46c0011e60 con 0x562dabe684a0 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f468ffff640 1 -- 10.20.193.28:0/2949511895 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f46c0009d70 con 0x562dabe684a0 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.767+0000 7f468ffff640 1 -- 10.20.193.28:0/2949511895 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46c001b920 con 0x562dabe684a0 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 -- 10.20.193.28:0/2949511895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 msgr2=0x562dabeace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2949511895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabeace10 secure :-1 s=READY pgs=1094 gs=2 cs=0 l=1 c_cookie=3975746999154169975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c0004200 tx=0x7f46c0014000 comp rx=0 tx=0).stop 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 -- 10.20.193.28:0/2949511895 shutdown_connections 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2949511895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabeace10 unknown :-1 s=CLOSED pgs=1094 gs=2 cs=0 l=1 c_cookie=3975746999154169975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2949511895 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabead350 0x562dabecd730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2949511895 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe67b90 0x562dabe67f60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 -- 10.20.193.28:0/2949511895 >> 10.20.193.28:0/2949511895 conn(0x562dabe3d680 msgr2=0x562dabe5da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 -- 10.20.193.28:0/2949511895 shutdown_connections 2026-02-20T13:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.768+0000 7f46d37fee00 1 -- 10.20.193.28:0/2949511895 wait complete. 2026-02-20T13:26:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.769+0000 7f46d37fee00 1 -- start start 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46d37fee00 1 Processor -- start 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabec4b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 0x562dabec50b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabeca0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46d37fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562dabeca5e0 con 0x562dabead350 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46d37fee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562dabeca750 con 0x562dabe67b90 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46d37fee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562dabeca910 con 0x562dabe684a0 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46caffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabec4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabeca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabeca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46562/0 (socket says 10.20.193.28:46562) 2026-02-20T13:26:46.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46cb7fe640 1 -- 10.20.193.28:0/2035702110 learned_addr learned my addr 10.20.193.28:0/2035702110 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 0x562dabec50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46cb7fe640 1 -- 10.20.193.28:0/2035702110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 msgr2=0x562dabec50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46cb7fe640 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 0x562dabec50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46cb7fe640 1 -- 10.20.193.28:0/2035702110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 msgr2=0x562dabec4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46cb7fe640 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabec4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.770+0000 7f46cb7fe640 1 -- 10.20.193.28:0/2035702110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dabcef350 con 0x562dabead350 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f46cb7fe640 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabeca0a0 secure :-1 s=READY pgs=1095 gs=3 cs=0 l=1 c_cookie=14501923018126158222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46bc012490 tx=0x7f46bc012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9412e268778698e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f468d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f468d7fa640 1 -- 10.20.193.28:0/2035702110 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46bc017070 con 0x562dabead350 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f468d7fa640 1 -- 10.20.193.28:0/2035702110 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f46bc005500 con 0x562dabead350 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f468d7fa640 1 -- 10.20.193.28:0/2035702110 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46bc011e30 con 0x562dabead350 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c0009940 con 0x562dabead350 2026-02-20T13:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f468d7fa640 1 -- 10.20.193.28:0/2035702110 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f46bc01c420 con 0x562dabead350 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f46d37fee00 10 client.18891 _ll_register_callbacks cb 0x562dabcec9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562daba016f0 con 0x562dabead350 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f468d7fa640 1 -- 10.20.193.28:0/2035702110 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46bc0114f0 con 0x562dabead350 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f46d37fee00 10 client.18891 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.771+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562dabd01150 con 0x562dabead350 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.772+0000 7f468d7fa640 1 -- 10.20.193.28:0/2035702110 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f46bc011690 con 0x562dabead350 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.772+0000 7f46d37fee00 10 client.18891 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.772+0000 7f46d37fee00 10 client.18891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.772+0000 7f46d37fee00 20 client.18891 populate_metadata read hostname 'trial028' 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.772+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562dabeaa5d0 0x562dabeaaa70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.772+0000 7f46d37fee00 4 client.18891 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.772+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562dabd78d60 con 0x562dabeaa5d0 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.772+0000 7f46caffd640 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562dabeaa5d0 0x562dabeaaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.773+0000 7f46caffd640 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562dabeaa5d0 0x562dabeaaa70 crc :-1 s=READY pgs=282 gs=4 cs=0 l=0 c_cookie=17413488904556174465 s_cookie=3031453453621793052 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1a923e5e846dc81 server_cookie=2a11e2dad042111c in_seq=0 out_seq=0 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.773+0000 7f468d7fa640 10 client.18891 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.773+0000 7f468d7fa640 1 -- 10.20.193.28:0/2035702110 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562dabd78d60 con 0x562dabeaa5d0 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.773+0000 7f468d7fa640 10 client.18891 handle_command_reply: tid=0 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.773+0000 7f46d37fee00 1 client.18891 shutdown 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.773+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 msgr2=0x562dabeca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.773+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabeca0a0 secure :-1 s=READY pgs=1095 gs=3 cs=0 l=1 c_cookie=14501923018126158222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46bc012490 tx=0x7f46bc012960 comp rx=0 tx=0).stop 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 shutdown_connections 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562dabeaa5d0 0x562dabeaaa70 crc :-1 s=READY pgs=282 gs=4 cs=0 l=0 c_cookie=17413488904556174465 s_cookie=3031453453621793052 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabeca0a0 unknown :-1 s=CLOSED pgs=1095 gs=3 cs=0 l=1 c_cookie=14501923018126158222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 0x562dabec50b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2035702110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabec4b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 >> 10.20.193.28:0/2035702110 conn(0x562dabe3d680 msgr2=0x562dabe5da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f468d7fa640 0 client.18891 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:46.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 shutdown_connections 2026-02-20T13:26:46.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 1 -- 10.20.193.28:0/2035702110 wait complete. 2026-02-20T13:26:46.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.774+0000 7f46d37fee00 20 client.18891 trim_cache size 0 max 16384 2026-02-20T13:26:46.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46d37fee00 1 Processor -- start 2026-02-20T13:26:46.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46d37fee00 1 -- start start 2026-02-20T13:26:46.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabeb6b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabec1e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabead350 0x562dabec23a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46d37fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562dabd690d0 con 0x562dabe684a0 2026-02-20T13:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46d37fee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562daba29700 con 0x562dabe67b90 2026-02-20T13:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46d37fee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562dabe3d0c0 con 0x562dabead350 2026-02-20T13:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46ca7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabec1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46ca7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabec1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46568/0 (socket says 10.20.193.28:46568) 2026-02-20T13:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46ca7fc640 1 -- 10.20.193.28:0/2450674983 learned_addr learned my addr 10.20.193.28:0/2450674983 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46cb7fe640 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabead350 0x562dabec23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46caffd640 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabeb6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46ca7fc640 1 -- 10.20.193.28:0/2450674983 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabead350 msgr2=0x562dabec23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabead350 0x562dabec23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46ca7fc640 1 -- 10.20.193.28:0/2450674983 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 msgr2=0x562dabeb6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.783+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabeb6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46ca7fc640 1 -- 10.20.193.28:0/2450674983 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dabeb7340 con 0x562dabe684a0 2026-02-20T13:26:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabec1e60 secure :-1 s=READY pgs=1096 gs=2 cs=0 l=1 c_cookie=187214141662974787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c0005760 tx=0x7f46c0005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2991e451ac05343 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f468f7fe640 1 -- 10.20.193.28:0/2450674983 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46c0032070 con 0x562dabe684a0 2026-02-20T13:26:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f468f7fe640 1 -- 10.20.193.28:0/2450674983 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f46c0025920 con 0x562dabe684a0 2026-02-20T13:26:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f468f7fe640 1 -- 10.20.193.28:0/2450674983 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46c002ea20 con 0x562dabe684a0 2026-02-20T13:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 -- 10.20.193.28:0/2450674983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 msgr2=0x562dabec1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabec1e60 secure :-1 s=READY pgs=1096 gs=2 cs=0 l=1 c_cookie=187214141662974787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c0005760 tx=0x7f46c0005790 comp rx=0 tx=0).stop 2026-02-20T13:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 -- 10.20.193.28:0/2450674983 shutdown_connections 2026-02-20T13:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabe684a0 0x562dabec1e60 unknown :-1 s=CLOSED pgs=1096 gs=2 cs=0 l=1 c_cookie=187214141662974787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabead350 0x562dabec23a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 --2- 10.20.193.28:0/2450674983 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabeb6b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 -- 10.20.193.28:0/2450674983 >> 10.20.193.28:0/2450674983 conn(0x562dabe3d680 msgr2=0x562dabec1750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 -- 10.20.193.28:0/2450674983 shutdown_connections 2026-02-20T13:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.784+0000 7f46d37fee00 1 -- 10.20.193.28:0/2450674983 wait complete. 2026-02-20T13:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.785+0000 7f46d37fee00 1 -- start start 2026-02-20T13:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.785+0000 7f46d37fee00 1 Processor -- start 2026-02-20T13:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.785+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabe3f060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.785+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 0x562dabe3f5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.785+0000 7f46d37fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabe3fae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.785+0000 7f46d37fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562dabf12e20 con 0x562dabead350 2026-02-20T13:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.785+0000 7f46d37fee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562dabf12f90 con 0x562dabe67b90 2026-02-20T13:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.785+0000 7f46d37fee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562dabf13150 con 0x562dabe684a0 2026-02-20T13:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabe3fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabe3fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46582/0 (socket says 10.20.193.28:46582) 2026-02-20T13:26:46.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 -- 10.20.193.28:0/3321186696 learned_addr learned my addr 10.20.193.28:0/3321186696 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:46.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46caffd640 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabe3f060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46ca7fc640 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 0x562dabe3f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 -- 10.20.193.28:0/3321186696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 msgr2=0x562dabe3f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 0x562dabe3f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 -- 10.20.193.28:0/3321186696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 msgr2=0x562dabe3f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabe3f060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 -- 10.20.193.28:0/3321186696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dabcfbbd0 con 0x562dabead350 2026-02-20T13:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46cb7fe640 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabe3fae0 secure :-1 s=READY pgs=1097 gs=2 cs=0 l=1 c_cookie=15891436095606699211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46bc00f6d0 tx=0x7f46bc008610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc89b8eeb97534cb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f468d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f468d7fa640 1 -- 10.20.193.28:0/3321186696 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46bc017070 con 0x562dabead350 2026-02-20T13:26:46.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f468d7fa640 1 -- 10.20.193.28:0/3321186696 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x562daba016f0 con 0x562dabead350 2026-02-20T13:26:46.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f468d7fa640 1 -- 10.20.193.28:0/3321186696 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46bc02c040 con 0x562dabead350 2026-02-20T13:26:46.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.786+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dabd16d80 con 0x562dabead350 2026-02-20T13:26:46.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f468d7fa640 1 -- 10.20.193.28:0/3321186696 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f46bc027870 con 0x562dabead350 2026-02-20T13:26:46.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 10 client.18897 _ll_register_callbacks cb 0x562dabcec9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:46.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562dabac34a0 con 0x562dabead350 2026-02-20T13:26:46.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f468d7fa640 1 -- 10.20.193.28:0/3321186696 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46bc005510 con 0x562dabead350 2026-02-20T13:26:46.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 10 client.18897 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:46.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562dabcef680 con 0x562dabead350 2026-02-20T13:26:46.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f468d7fa640 1 -- 10.20.193.28:0/3321186696 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f46bc026670 con 0x562dabead350 2026-02-20T13:26:46.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 10 client.18897 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:46.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 10 client.18897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:46.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 20 client.18897 populate_metadata read hostname 'trial028' 2026-02-20T13:26:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562dabf5b210 0x562dabf7b6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 4 client.18897 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:26:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.787+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f46c0009d70 con 0x562dabf5b210 2026-02-20T13:26:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.788+0000 7f46caffd640 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562dabf5b210 0x562dabf7b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.788+0000 7f46caffd640 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562dabf5b210 0x562dabf7b6c0 crc :-1 s=READY pgs=283 gs=4 cs=0 l=0 c_cookie=7145396011090806805 s_cookie=596461512000864731 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63298bd06c8f8815 server_cookie=8470e95c10101db in_seq=0 out_seq=0 2026-02-20T13:26:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.788+0000 7f468d7fa640 10 client.18897 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f468d7fa640 1 -- 10.20.193.28:0/3321186696 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x7f46c0009d70 con 0x562dabf5b210 2026-02-20T13:26:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f468d7fa640 10 client.18897 handle_command_reply: tid=0 2026-02-20T13:26:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 client.18897 shutdown 2026-02-20T13:26:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 msgr2=0x562dabe3fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabe3fae0 secure :-1 s=READY pgs=1097 gs=2 cs=0 l=1 c_cookie=15891436095606699211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46bc00f6d0 tx=0x7f46bc008610 comp rx=0 tx=0).stop 2026-02-20T13:26:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 shutdown_connections 2026-02-20T13:26:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562dabf5b210 0x562dabf7b6c0 crc :-1 s=READY pgs=283 gs=4 cs=0 l=0 c_cookie=7145396011090806805 s_cookie=596461512000864731 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562dabead350 0x562dabe3fae0 unknown :-1 s=CLOSED pgs=1097 gs=2 cs=0 l=1 c_cookie=15891436095606699211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562dabe684a0 0x562dabe3f5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 --2- 10.20.193.28:0/3321186696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562dabe67b90 0x562dabe3f060 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f468d7fa640 0 client.18897 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 >> 10.20.193.28:0/3321186696 conn(0x562dabe3d680 msgr2=0x562dabec1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 shutdown_connections 2026-02-20T13:26:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.789+0000 7f46d37fee00 1 -- 10.20.193.28:0/3321186696 wait complete. 2026-02-20T13:26:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46d37fee00 20 client.18897 trim_cache size 0 max 16384 2026-02-20T13:26:46.808 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:26:46.808 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:26:46.808 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:26:46.808 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:26:46.808 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "f0a289d9-6e3e-4203-a096-2c93fa2928ba", 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.809 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.810 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.811 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:26:46.812 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.813 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:26:46.814 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 -- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46a00b5760 msgr2=0x7f46a00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46a00b5760 0x7f46a00d5c10 secure :-1 s=READY pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46cc124770 tx=0x7f46c0005f90 comp rx=0 tx=0).stop 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 -- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 msgr2=0x7f46cc11ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 0x7f46cc11ddd0 secure :-1 s=READY pgs=1093 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46b8005b30 tx=0x7f46b8004340 comp rx=0 tx=0).stop 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 -- 10.20.193.28:0/2652637661 shutdown_connections 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f46a00b5760 0x7f46a00d5c10 unknown :-1 s=CLOSED pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f46cc1156a0 0x7f46cc1236e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f46cc10fea0 0x7f46cc11e310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 --2- 10.20.193.28:0/2652637661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46cc10f4b0 0x7f46cc11ddd0 unknown :-1 s=CLOSED pgs=1093 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 -- 10.20.193.28:0/2652637661 >> 10.20.193.28:0/2652637661 conn(0x7f46cc0ecda0 msgr2=0x7f46cc10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 -- 10.20.193.28:0/2652637661 shutdown_connections 2026-02-20T13:26:46.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:26:46.790+0000 7f46cbfff640 1 -- 10.20.193.28:0/2652637661 wait complete. 2026-02-20T13:26:46.891 INFO:tasks.cephfs.filesystem:scrub status for tag:f0a289d9-6e3e-4203-a096-2c93fa2928ba - {'path': '/', 'tag': 'f0a289d9-6e3e-4203-a096-2c93fa2928ba', 'options': 'recursive,force'} 2026-02-20T13:26:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:46 trial127 ceph-mon[43817]: pgmap v464: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:26:46.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:46 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:26:46.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:46 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:46.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:46 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:26:46.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:46 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:26:46.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:46 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:46.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:46 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:46 trial034 ceph-mon[43332]: pgmap v464: 97 pgs: 97 active+clean; 1.1 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:26:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:46 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:26:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:46 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:46 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:26:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:46 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:26:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:46 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:46 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:26:48.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:48 trial028 ceph-mon[37442]: pgmap v465: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:26:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:48 trial127 ceph-mon[43817]: pgmap v465: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:26:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:48 trial034 ceph-mon[43332]: pgmap v465: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:26:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:50 trial028 ceph-mon[37442]: pgmap v466: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:50 trial127 ceph-mon[43817]: pgmap v466: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:50 trial034 ceph-mon[43332]: pgmap v466: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 -- 10.20.193.28:0/2017412425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 msgr2=0x7f023410edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 --2- 10.20.193.28:0/2017412425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 0x7f023410edb0 secure :-1 s=READY pgs=1098 gs=1 cs=0 l=1 c_cookie=4020242182037836013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c009980 tx=0x7f021c02f190 comp rx=0 tx=0).stop 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 -- 10.20.193.28:0/2017412425 shutdown_connections 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 --2- 10.20.193.28:0/2017412425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 0x7f023410edb0 unknown :-1 s=CLOSED pgs=1098 gs=1 cs=0 l=1 c_cookie=4020242182037836013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 --2- 10.20.193.28:0/2017412425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f023410f2f0 0x7f0234171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 --2- 10.20.193.28:0/2017412425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f02341100b0 0x7f02341104a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 -- 10.20.193.28:0/2017412425 >> 10.20.193.28:0/2017412425 conn(0x7f02340ec320 msgr2=0x7f023410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 -- 10.20.193.28:0/2017412425 shutdown_connections 2026-02-20T13:26:51.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.907+0000 7f0239a43640 1 -- 10.20.193.28:0/2017412425 wait complete. 2026-02-20T13:26:51.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239a43640 1 Processor -- start 2026-02-20T13:26:51.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239a43640 1 -- start start 2026-02-20T13:26:51.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239a43640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 0x7f02340f8210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239a43640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f023410f2f0 0x7f0234171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239a43640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02341100b0 0x7f02340f8a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239a43640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02340f9660 con 0x7f023410e940 2026-02-20T13:26:51.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239a43640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f02340f97d0 con 0x7f023410f2f0 2026-02-20T13:26:51.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239a43640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f02340f9990 con 0x7f02341100b0 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0238a41640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 0x7f02340f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0238a41640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 0x7f02340f8210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55864/0 (socket says 10.20.193.28:55864) 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0238a41640 1 -- 10.20.193.28:0/4039798268 learned_addr learned my addr 10.20.193.28:0/4039798268 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f022bfff640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f023410f2f0 0x7f0234171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0239242640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02341100b0 0x7f02340f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0238a41640 1 -- 10.20.193.28:0/4039798268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02341100b0 msgr2=0x7f02340f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0238a41640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02341100b0 0x7f02340f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0238a41640 1 -- 10.20.193.28:0/4039798268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f023410f2f0 msgr2=0x7f0234171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0238a41640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f023410f2f0 0x7f0234171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.908+0000 7f0238a41640 1 -- 10.20.193.28:0/4039798268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02240094b0 con 0x7f023410e940 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.909+0000 7f0238a41640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 0x7f02340f8210 secure :-1 s=READY pgs=1099 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0224009fd0 tx=0x7f0224002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:51.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.909+0000 7f0229ffb640 1 -- 10.20.193.28:0/4039798268 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f022400ed60 con 0x7f023410e940 2026-02-20T13:26:51.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.909+0000 7f0229ffb640 1 -- 10.20.193.28:0/4039798268 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0224002e20 con 0x7f023410e940 2026-02-20T13:26:51.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.909+0000 7f0229ffb640 1 -- 10.20.193.28:0/4039798268 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02240189f0 con 0x7f023410e940 2026-02-20T13:26:51.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.909+0000 7f0239a43640 1 -- 10.20.193.28:0/4039798268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021c009570 con 0x7f023410e940 2026-02-20T13:26:51.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.909+0000 7f0239a43640 1 -- 10.20.193.28:0/4039798268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02340fa000 con 0x7f023410e940 2026-02-20T13:26:51.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.912+0000 7f0229ffb640 1 -- 10.20.193.28:0/4039798268 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0224016020 con 0x7f023410e940 2026-02-20T13:26:51.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.913+0000 7f0229ffb640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02100b5760 0x7f02100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.913+0000 7f0229ffb640 1 -- 10.20.193.28:0/4039798268 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f02240e6b50 con 0x7f023410e940 2026-02-20T13:26:51.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.913+0000 7f022bfff640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02100b5760 0x7f02100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.914+0000 7f022bfff640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02100b5760 0x7f02100d5c10 secure :-1 s=READY pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c0098a0 tx=0x7f021c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:51.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.914+0000 7f023d2c2e00 1 Processor -- start 2026-02-20T13:26:51.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.914+0000 7f023d2c2e00 1 -- start start 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca68a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035cc71c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035ce7ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556035b9bfd0 con 0x556035ca6de0 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556035b97d00 con 0x556035cc7700 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556035b91ca0 con 0x556035c864c0 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035cc71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f0238a41640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f0239242640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035ce7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035cc71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55878/0 (socket says 10.20.193.28:55878) 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 -- 10.20.193.28:0/3767705613 learned_addr learned my addr 10.20.193.28:0/3767705613 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 -- 10.20.193.28:0/3767705613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 msgr2=0x556035ca68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 --2- 10.20.193.28:0/3767705613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 -- 10.20.193.28:0/3767705613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 msgr2=0x556035ce7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 --2- 10.20.193.28:0/3767705613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035ce7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 -- 10.20.193.28:0/3767705613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556035b348b0 con 0x556035ca6de0 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f022bfff640 1 --2- 10.20.193.28:0/3767705613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035cc71c0 secure :-1 s=READY pgs=1100 gs=1 cs=0 l=1 c_cookie=3544794861063968628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c02f6a0 tx=0x7f021c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3131a4251f591774 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f0200ffe640 1 -- 10.20.193.28:0/3767705613 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f021c002980 con 0x556035ca6de0 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f0200ffe640 1 -- 10.20.193.28:0/3767705613 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f021c03e040 con 0x556035ca6de0 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.915+0000 7f0200ffe640 1 -- 10.20.193.28:0/3767705613 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f021c04f8f0 con 0x556035ca6de0 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3767705613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 msgr2=0x556035cc71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3767705613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035cc71c0 secure :-1 s=READY pgs=1100 gs=1 cs=0 l=1 c_cookie=3544794861063968628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c02f6a0 tx=0x7f021c040000 comp rx=0 tx=0).stop 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3767705613 shutdown_connections 2026-02-20T13:26:51.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3767705613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035cc71c0 unknown :-1 s=CLOSED pgs=1100 gs=1 cs=0 l=1 c_cookie=3544794861063968628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3767705613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035ce7ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3767705613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca68a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3767705613 >> 10.20.193.28:0/3767705613 conn(0x556035ba51c0 msgr2=0x556035c84da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:51.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3767705613 shutdown_connections 2026-02-20T13:26:51.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.916+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3767705613 wait complete. 2026-02-20T13:26:51.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.917+0000 7f023d2c2e00 1 -- start start 2026-02-20T13:26:51.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.917+0000 7f023d2c2e00 1 Processor -- start 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035c9fb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035ca0150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035ca0bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556035ca1210 con 0x556035ca6de0 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556035ca1380 con 0x556035cc7700 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556035ca1540 con 0x556035c864c0 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035ca0150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f0238a41640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035c9fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f0239242640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035ca0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035ca0150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55892/0 (socket says 10.20.193.28:55892) 2026-02-20T13:26:51.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 -- 10.20.193.28:0/3488541837 learned_addr learned my addr 10.20.193.28:0/3488541837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:51.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 -- 10.20.193.28:0/3488541837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 msgr2=0x556035c9fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:51.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035c9fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 -- 10.20.193.28:0/3488541837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 msgr2=0x556035ca0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:51.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035ca0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 -- 10.20.193.28:0/3488541837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556035b3d400 con 0x556035ca6de0 2026-02-20T13:26:51.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f022bfff640 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035ca0150 secure :-1 s=READY pgs=1101 gs=1 cs=0 l=1 c_cookie=4628037952320288048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c0047e0 tx=0x7f021c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403a17ff4b13b530 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:51.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.918+0000 7f01f9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3488541837 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f021c002980 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3488541837 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f021c03e040 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3488541837 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f021c0589c0 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0234171ae0 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f023d2c2e00 10 client.18909 _ll_register_callbacks cb 0x556035b1ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556035831520 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3488541837 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f021c058b50 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3488541837 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f021c058d50 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f023d2c2e00 10 client.18909 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.919+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556035b15da0 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3488541837 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f021c061060 con 0x556035ca6de0 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f023d2c2e00 10 client.18909 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:51.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f023d2c2e00 10 client.18909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:51.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f023d2c2e00 20 client.18909 populate_metadata read hostname 'trial028' 2026-02-20T13:26:51.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556035ca3f20 0x556035ca43c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f023d2c2e00 4 client.18909 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:26:51.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556035bc3630 con 0x556035ca3f20 2026-02-20T13:26:51.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f0238a41640 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556035ca3f20 0x556035ca43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f0238a41640 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556035ca3f20 0x556035ca43c0 crc :-1 s=READY pgs=284 gs=4 cs=0 l=0 c_cookie=3485603883751938195 s_cookie=2783674254334351300 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=305f5a43c6c19893 server_cookie=26a198fc5bffd7c4 in_seq=0 out_seq=0 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.920+0000 7f01f9ffb640 10 client.18909 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3488541837 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556035bc3630 con 0x556035ca3f20 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f01f9ffb640 10 client.18909 handle_command_reply: tid=0 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 client.18909 shutdown 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 msgr2=0x556035ca0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035ca0150 secure :-1 s=READY pgs=1101 gs=1 cs=0 l=1 c_cookie=4628037952320288048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c0047e0 tx=0x7f021c009310 comp rx=0 tx=0).stop 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 shutdown_connections 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556035ca3f20 0x556035ca43c0 crc :-1 s=READY pgs=284 gs=4 cs=0 l=0 c_cookie=3485603883751938195 s_cookie=2783674254334351300 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035ca0150 unknown :-1 s=CLOSED pgs=1101 gs=1 cs=0 l=1 c_cookie=4628037952320288048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f01f9ffb640 0 client.18909 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035ca0bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3488541837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035c9fb00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 >> 10.20.193.28:0/3488541837 conn(0x556035ba51c0 msgr2=0x556035c87790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:51.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 shutdown_connections 2026-02-20T13:26:51.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3488541837 wait complete. 2026-02-20T13:26:51.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.921+0000 7f023d2c2e00 20 client.18909 trim_cache size 0 max 16384 2026-02-20T13:26:51.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f023d2c2e00 1 Processor -- start 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f023d2c2e00 1 -- start start 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035c864c0 0x556035ca0080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035c91990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035cc7700 0x556035c9ce20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556035b8f8d0 con 0x556035ca6de0 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5560358d0f10 con 0x556035c864c0 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556035ca1680 con 0x556035cc7700 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f0238a41640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035c864c0 0x556035ca0080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f022bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035c91990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f0238a41640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035c864c0 0x556035ca0080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46486/0 (socket says 10.20.193.28:46486) 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f0238a41640 1 -- 10.20.193.28:0/3157707471 learned_addr learned my addr 10.20.193.28:0/3157707471 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:51.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.929+0000 7f0239242640 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035cc7700 0x556035c9ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f022bfff640 1 -- 10.20.193.28:0/3157707471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035cc7700 msgr2=0x556035c9ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:51.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f022bfff640 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035cc7700 0x556035c9ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f022bfff640 1 -- 10.20.193.28:0/3157707471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035c864c0 msgr2=0x556035ca0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:51.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f022bfff640 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035c864c0 0x556035ca0080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f022bfff640 1 -- 10.20.193.28:0/3157707471 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556035c92160 con 0x556035ca6de0 2026-02-20T13:26:51.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f0238a41640 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035c864c0 0x556035ca0080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:26:51.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f022bfff640 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035c91990 secure :-1 s=READY pgs=1102 gs=1 cs=0 l=1 c_cookie=11522952794086023611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c0584c0 tx=0x7f021c05f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe9c083d717a1bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f01fbfff640 1 -- 10.20.193.28:0/3157707471 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f021c0423f0 con 0x556035ca6de0 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f01fbfff640 1 -- 10.20.193.28:0/3157707471 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f021c03e070 con 0x556035ca6de0 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f01fbfff640 1 -- 10.20.193.28:0/3157707471 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f021c0423f0 con 0x556035ca6de0 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3157707471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 msgr2=0x556035c91990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.930+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035c91990 secure :-1 s=READY pgs=1102 gs=1 cs=0 l=1 c_cookie=11522952794086023611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c0584c0 tx=0x7f021c05f000 comp rx=0 tx=0).stop 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3157707471 shutdown_connections 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035c91990 unknown :-1 s=CLOSED pgs=1102 gs=1 cs=0 l=1 c_cookie=11522952794086023611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035cc7700 0x556035c9ce20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3157707471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035c864c0 0x556035ca0080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3157707471 >> 10.20.193.28:0/3157707471 conn(0x556035ba51c0 msgr2=0x556035c9f970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3157707471 shutdown_connections 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3157707471 wait complete. 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 -- start start 2026-02-20T13:26:51.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 Processor -- start 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca9fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035caa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035cab0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5560358d0f10 con 0x556035ca6de0 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556035cab610 con 0x556035cc7700 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.931+0000 7f023d2c2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556035cab7d0 con 0x556035c864c0 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60496/0 (socket says 10.20.193.28:60496) 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 -- 10.20.193.28:0/3053069193 learned_addr learned my addr 10.20.193.28:0/3053069193 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f022bfff640 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035caa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0239242640 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035cab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 -- 10.20.193.28:0/3053069193 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 msgr2=0x556035cab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:51.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035cab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 -- 10.20.193.28:0/3053069193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 msgr2=0x556035caa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035caa510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 -- 10.20.193.28:0/3053069193 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556035b15da0 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f0238a41640 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca9fd0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=16781048348206083748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02240aa120 tx=0x7f0224010b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e24290197aaea4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f01f9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3053069193 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02240722c0 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3053069193 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f02240b7ff0 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02340fa000 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f023d2c2e00 10 client.28774 _ll_register_callbacks cb 0x556035b1ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556035c41ca0 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.932+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3053069193 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02240b7d80 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3053069193 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f02240a9290 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3053069193 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02240acc80 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f023d2c2e00 10 client.28774 fetch_fsmap learned FSMap version 28 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556035b27670 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3053069193 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02240b2040 con 0x556035c864c0 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f023d2c2e00 10 client.28774 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f023d2c2e00 10 client.28774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f023d2c2e00 20 client.28774 populate_metadata read hostname 'trial028' 2026-02-20T13:26:51.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556035d74390 0x556035d94810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:26:51.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f023d2c2e00 4 client.28774 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:26:51.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556035875640 con 0x556035d74390 2026-02-20T13:26:51.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.933+0000 7f022bfff640 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556035d74390 0x556035d94810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:26:51.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.934+0000 7f022bfff640 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556035d74390 0x556035d94810 crc :-1 s=READY pgs=285 gs=4 cs=0 l=0 c_cookie=5509727502365447260 s_cookie=7491645678240929189 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c767bf8bbb1545c server_cookie=67f7ac0d4aa415a5 in_seq=0 out_seq=0 2026-02-20T13:26:51.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.934+0000 7f01f9ffb640 10 client.28774 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f01f9ffb640 1 -- 10.20.193.28:0/3053069193 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556035875640 con 0x556035d74390 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f01f9ffb640 10 client.28774 handle_command_reply: tid=0 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 client.28774 shutdown 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 msgr2=0x556035ca9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca9fd0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=16781048348206083748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02240aa120 tx=0x7f0224010b30 comp rx=0 tx=0).stop 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 shutdown_connections 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556035d74390 0x556035d94810 crc :-1 s=READY pgs=285 gs=4 cs=0 l=0 c_cookie=5509727502365447260 s_cookie=7491645678240929189 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556035ca6de0 0x556035caa510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556035cc7700 0x556035cab0d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 --2- 10.20.193.28:0/3053069193 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556035c864c0 0x556035ca9fd0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=16781048348206083748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f01f9ffb640 0 client.28774 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 >> 10.20.193.28:0/3053069193 conn(0x556035ba51c0 msgr2=0x556035c9ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:51.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 shutdown_connections 2026-02-20T13:26:51.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 1 -- 10.20.193.28:0/3053069193 wait complete. 2026-02-20T13:26:51.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.938+0000 7f023d2c2e00 20 client.28774 trim_cache size 0 max 16384 2026-02-20T13:26:51.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:26:51.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:26:51.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:26:51.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 -- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02100b5760 msgr2=0x7f02100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02100b5760 0x7f02100d5c10 secure :-1 s=READY pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021c0098a0 tx=0x7f021c03a040 comp rx=0 tx=0).stop 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 -- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 msgr2=0x7f02340f8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 0x7f02340f8210 secure :-1 s=READY pgs=1099 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0224009fd0 tx=0x7f0224002bc0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 -- 10.20.193.28:0/4039798268 shutdown_connections 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f02100b5760 0x7f02100d5c10 unknown :-1 s=CLOSED pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f02341100b0 0x7f02340f8a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f023410f2f0 0x7f0234171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 --2- 10.20.193.28:0/4039798268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f023410e940 0x7f02340f8210 unknown :-1 s=CLOSED pgs=1099 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:26:51.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 -- 10.20.193.28:0/4039798268 >> 10.20.193.28:0/4039798268 conn(0x7f02340ec320 msgr2=0x7f02340ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:26:51.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 -- 10.20.193.28:0/4039798268 shutdown_connections 2026-02-20T13:26:51.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:26:51.939+0000 7f0239a43640 1 -- 10.20.193.28:0/4039798268 wait complete. 2026-02-20T13:26:52.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:52 trial028 ceph-mon[37442]: pgmap v467: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:52 trial127 ceph-mon[43817]: pgmap v467: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:52 trial034 ceph-mon[43332]: pgmap v467: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:26:53.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:53 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:26:53.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:53 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:26:53.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:53 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:26:53.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:53 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:26:53.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:53 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:26:53.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:53 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:26:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:54 trial028 ceph-mon[37442]: pgmap v468: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:26:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:54 trial127 ceph-mon[43817]: pgmap v468: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:26:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:54 trial034 ceph-mon[43332]: pgmap v468: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:26:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:56 trial028 ceph-mon[37442]: pgmap v469: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:26:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:56 trial127 ceph-mon[43817]: pgmap v469: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:26:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:56 trial034 ceph-mon[43332]: pgmap v469: 97 pgs: 97 active+clean; 1.2 MiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:26:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:26:58 trial028 ceph-mon[37442]: pgmap v470: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:26:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:26:58 trial127 ceph-mon[43817]: pgmap v470: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:26:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:26:58 trial034 ceph-mon[43332]: pgmap v470: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2026-02-20T13:27:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:00 trial028 ceph-mon[37442]: pgmap v471: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:27:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:00 trial127 ceph-mon[43817]: pgmap v471: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:27:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:00 trial034 ceph-mon[43332]: pgmap v471: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:27:02.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:02 trial028 ceph-mon[37442]: pgmap v472: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:27:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:02 trial127 ceph-mon[43817]: pgmap v472: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:27:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:02 trial034 ceph-mon[43332]: pgmap v472: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:27:04.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:04 trial028 ceph-mon[37442]: pgmap v473: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:27:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:04 trial127 ceph-mon[43817]: pgmap v473: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:27:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:04 trial034 ceph-mon[43332]: pgmap v473: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 -- 10.20.193.28:0/2081539764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 msgr2=0x7f86c014e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 --2- 10.20.193.28:0/2081539764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 0x7f86c014e400 secure :-1 s=READY pgs=1103 gs=1 cs=0 l=1 c_cookie=8224605355608483849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b4009950 tx=0x7f86b402f190 comp rx=0 tx=0).stop 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 -- 10.20.193.28:0/2081539764 shutdown_connections 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 --2- 10.20.193.28:0/2081539764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 0x7f86c014e400 unknown :-1 s=CLOSED pgs=1103 gs=1 cs=0 l=1 c_cookie=8224605355608483849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 --2- 10.20.193.28:0/2081539764 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86c014eb40 0x7f86c016eff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 --2- 10.20.193.28:0/2081539764 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c010b110 0x7f86c010b500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 -- 10.20.193.28:0/2081539764 >> 10.20.193.28:0/2081539764 conn(0x7f86c00e8a80 msgr2=0x7f86c0108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 -- 10.20.193.28:0/2081539764 shutdown_connections 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 -- 10.20.193.28:0/2081539764 wait complete. 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.011+0000 7f86c7483640 1 Processor -- start 2026-02-20T13:27:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c7483640 1 -- start start 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c7483640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86c010b110 0x7f86c015d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c7483640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 0x7f86c014e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c7483640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c014eb40 0x7f86c015ded0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c7483640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f86c015eb30 con 0x7f86c010bb20 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c7483640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f86c015eca0 con 0x7f86c010b110 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c7483640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f86c015ee60 con 0x7f86c014eb40 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 0x7f86c014e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c6481640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86c010b110 0x7f86c015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 0x7f86c014e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54794/0 (socket says 10.20.193.28:54794) 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 -- 10.20.193.28:0/3799798547 learned_addr learned my addr 10.20.193.28:0/3799798547 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c6c82640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c014eb40 0x7f86c015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 -- 10.20.193.28:0/3799798547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c014eb40 msgr2=0x7f86c015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c014eb40 0x7f86c015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 -- 10.20.193.28:0/3799798547 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86c010b110 msgr2=0x7f86c015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86c010b110 0x7f86c015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 -- 10.20.193.28:0/3799798547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b4009570 con 0x7f86c010bb20 2026-02-20T13:27:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c5c80640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 0x7f86c014e3e0 secure :-1 s=READY pgs=1104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b4002d80 tx=0x7f86b40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86a77fe640 1 -- 10.20.193.28:0/3799798547 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b403d070 con 0x7f86c010bb20 2026-02-20T13:27:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86a77fe640 1 -- 10.20.193.28:0/3799798547 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f86b4002a40 con 0x7f86c010bb20 2026-02-20T13:27:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86c7483640 1 -- 10.20.193.28:0/3799798547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c015f0e0 con 0x7f86c010bb20 2026-02-20T13:27:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.012+0000 7f86a77fe640 1 -- 10.20.193.28:0/3799798547 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b4041ba0 con 0x7f86c010bb20 2026-02-20T13:27:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.013+0000 7f86c7483640 1 -- 10.20.193.28:0/3799798547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c015f5a0 con 0x7f86c010bb20 2026-02-20T13:27:05.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.015+0000 7f86a77fe640 1 -- 10.20.193.28:0/3799798547 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f86b4038920 con 0x7f86c010bb20 2026-02-20T13:27:05.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.016+0000 7f86a77fe640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f869c0b5760 0x7f869c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.017+0000 7f86a77fe640 1 -- 10.20.193.28:0/3799798547 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f86b410b420 con 0x7f86c010bb20 2026-02-20T13:27:05.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.017+0000 7f86c6481640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f869c0b5760 0x7f869c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.017+0000 7f86c6481640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f869c0b5760 0x7f869c0d5c10 secure :-1 s=READY pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b0004740 tx=0x7f86b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86cae37e00 1 Processor -- start 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86cae37e00 1 -- start start 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f861c4c0 0x55a8f863c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f865d700 0x55a8f867dae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86cae37e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8f8531fd0 con 0x55a8f863cde0 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86cae37e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a8f852dd00 con 0x55a8f865d700 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86cae37e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a8f8527ca0 con 0x55a8f861c4c0 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86c6481640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f861c4c0 0x55a8f863c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86c6c82640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f865d700 0x55a8f867dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86c5c80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86c6481640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f861c4c0 0x55a8f863c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49204/0 (socket says 10.20.193.28:49204) 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.019+0000 7f86c6481640 1 -- 10.20.193.28:0/2806896377 learned_addr learned my addr 10.20.193.28:0/2806896377 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86c6481640 1 -- 10.20.193.28:0/2806896377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f865d700 msgr2=0x55a8f867dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86c6481640 1 --2- 10.20.193.28:0/2806896377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f865d700 0x55a8f867dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86c6481640 1 -- 10.20.193.28:0/2806896377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 msgr2=0x55a8f865d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86c6481640 1 --2- 10.20.193.28:0/2806896377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86c6481640 1 -- 10.20.193.28:0/2806896377 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8f84ca8b0 con 0x55a8f861c4c0 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86c5c80640 1 --2- 10.20.193.28:0/2806896377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865d1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86c6481640 1 --2- 10.20.193.28:0/2806896377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f861c4c0 0x55a8f863c8a0 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=18106583957629615498 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b0009c50 tx=0x7f86b0013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb47822d3a4cbd8a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f868e3ff640 1 -- 10.20.193.28:0/2806896377 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b001b470 con 0x55a8f861c4c0 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f868e3ff640 1 -- 10.20.193.28:0/2806896377 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f86b001bab0 con 0x55a8f861c4c0 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f868e3ff640 1 -- 10.20.193.28:0/2806896377 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b001dc20 con 0x55a8f861c4c0 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86cae37e00 1 -- 10.20.193.28:0/2806896377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f861c4c0 msgr2=0x55a8f863c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.020+0000 7f86cae37e00 1 --2- 10.20.193.28:0/2806896377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f861c4c0 0x55a8f863c8a0 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=18106583957629615498 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b0009c50 tx=0x7f86b0013000 comp rx=0 tx=0).stop 2026-02-20T13:27:05.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.021+0000 7f86cae37e00 1 -- 10.20.193.28:0/2806896377 shutdown_connections 2026-02-20T13:27:05.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.021+0000 7f86cae37e00 1 --2- 10.20.193.28:0/2806896377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865d1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.021+0000 7f86cae37e00 1 --2- 10.20.193.28:0/2806896377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f865d700 0x55a8f867dae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.021+0000 7f86cae37e00 1 --2- 10.20.193.28:0/2806896377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f861c4c0 0x55a8f863c8a0 unknown :-1 s=CLOSED pgs=330 gs=1 cs=0 l=1 c_cookie=18106583957629615498 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.021+0000 7f86cae37e00 1 -- 10.20.193.28:0/2806896377 >> 10.20.193.28:0/2806896377 conn(0x55a8f853b1c0 msgr2=0x55a8f861ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:05.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.021+0000 7f86cae37e00 1 -- 10.20.193.28:0/2806896377 shutdown_connections 2026-02-20T13:27:05.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.021+0000 7f86cae37e00 1 -- 10.20.193.28:0/2806896377 wait complete. 2026-02-20T13:27:05.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.022+0000 7f86cae37e00 1 -- start start 2026-02-20T13:27:05.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.022+0000 7f86cae37e00 1 Processor -- start 2026-02-20T13:27:05.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.022+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8635ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.022+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f8636100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.022+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 0x55a8f8636b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.022+0000 7f86cae37e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8f86371c0 con 0x55a8f863cde0 2026-02-20T13:27:05.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.022+0000 7f86cae37e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a8f8637330 con 0x55a8f861c4c0 2026-02-20T13:27:05.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.022+0000 7f86cae37e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a8f86374f0 con 0x55a8f865d700 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8635ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c5c80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f8636100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8635ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56732/0 (socket says 10.20.193.28:56732) 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 -- 10.20.193.28:0/1621571851 learned_addr learned my addr 10.20.193.28:0/1621571851 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6c82640 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 0x55a8f8636b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 -- 10.20.193.28:0/1621571851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 msgr2=0x55a8f8636b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 0x55a8f8636b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 -- 10.20.193.28:0/1621571851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 msgr2=0x55a8f8636100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f8636100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 -- 10.20.193.28:0/1621571851 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8f84d3400 con 0x55a8f861c4c0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c5c80640 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f8636100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86c6481640 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8635ab0 secure :-1 s=READY pgs=395 gs=2 cs=0 l=1 c_cookie=4257428264105079333 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b0009480 tx=0x7f86b0004050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b156c730ab0f225 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f867b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f867b7fe640 1 -- 10.20.193.28:0/1621571851 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b001db90 con 0x55a8f861c4c0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f867b7fe640 1 -- 10.20.193.28:0/1621571851 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f86b001b950 con 0x55a8f861c4c0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f867b7fe640 1 -- 10.20.193.28:0/1621571851 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b0027900 con 0x55a8f861c4c0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.023+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b00098c0 con 0x55a8f861c4c0 2026-02-20T13:27:05.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f867b7fe640 1 -- 10.20.193.28:0/1621571851 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f86b0027a90 con 0x55a8f861c4c0 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 10 client.28883 _ll_register_callbacks cb 0x55a8f84b2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8f81c7520 con 0x55a8f861c4c0 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f867b7fe640 1 -- 10.20.193.28:0/1621571851 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f86b0027c50 con 0x55a8f861c4c0 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 10 client.28883 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a8f84abda0 con 0x55a8f861c4c0 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f867b7fe640 1 -- 10.20.193.28:0/1621571851 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f86b0038060 con 0x55a8f861c4c0 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 10 client.28883 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 10 client.28883 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 20 client.28883 populate_metadata read hostname 'trial028' 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a8f863a0b0 0x55a8f863a550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 4 client.28883 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.024+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8f8559630 con 0x55a8f863a0b0 2026-02-20T13:27:05.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.025+0000 7f86c5c80640 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a8f863a0b0 0x55a8f863a550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.025+0000 7f86c5c80640 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a8f863a0b0 0x55a8f863a550 crc :-1 s=READY pgs=286 gs=4 cs=0 l=0 c_cookie=13037725213571815352 s_cookie=7363021080618116750 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ef4e01421a17b8 server_cookie=662eb4a96ff4a68e in_seq=0 out_seq=0 2026-02-20T13:27:05.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.025+0000 7f867b7fe640 10 client.28883 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.025+0000 7f867b7fe640 1 -- 10.20.193.28:0/1621571851 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a8f8559630 con 0x55a8f863a0b0 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.025+0000 7f867b7fe640 10 client.28883 handle_command_reply: tid=0 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.025+0000 7f86cae37e00 1 client.28883 shutdown 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.025+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 msgr2=0x55a8f8635ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.025+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8635ab0 secure :-1 s=READY pgs=395 gs=2 cs=0 l=1 c_cookie=4257428264105079333 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b0009480 tx=0x7f86b0004050 comp rx=0 tx=0).stop 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 shutdown_connections 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a8f863a0b0 0x55a8f863a550 crc :-1 s=READY pgs=286 gs=4 cs=0 l=0 c_cookie=13037725213571815352 s_cookie=7363021080618116750 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f8636100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 0x55a8f8636b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1621571851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8635ab0 unknown :-1 s=CLOSED pgs=395 gs=2 cs=0 l=1 c_cookie=4257428264105079333 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f867b7fe640 0 client.28883 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 >> 10.20.193.28:0/1621571851 conn(0x55a8f853b1c0 msgr2=0x55a8f861d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 shutdown_connections 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 1 -- 10.20.193.28:0/1621571851 wait complete. 2026-02-20T13:27:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.026+0000 7f86cae37e00 20 client.28883 trim_cache size 0 max 16384 2026-02-20T13:27:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.033+0000 7f86cae37e00 1 Processor -- start 2026-02-20T13:27:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.033+0000 7f86cae37e00 1 -- start start 2026-02-20T13:27:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.033+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8627950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.033+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865c4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.033+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 0x55a8f865ca00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.033+0000 7f86cae37e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8f85258d0 con 0x55a8f863cde0 2026-02-20T13:27:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.033+0000 7f86cae37e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a8f8266f10 con 0x55a8f861c4c0 2026-02-20T13:27:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.033+0000 7f86cae37e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a8f8636240 con 0x55a8f865d700 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c6481640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8627950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c5c80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c6481640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8627950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56738/0 (socket says 10.20.193.28:56738) 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c6481640 1 -- 10.20.193.28:0/3490934113 learned_addr learned my addr 10.20.193.28:0/3490934113 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c6c82640 1 --2- 10.20.193.28:0/3490934113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 0x55a8f865ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c5c80640 1 -- 10.20.193.28:0/3490934113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 msgr2=0x55a8f865ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c5c80640 1 --2- 10.20.193.28:0/3490934113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 0x55a8f865ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c5c80640 1 -- 10.20.193.28:0/3490934113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 msgr2=0x55a8f8627950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c5c80640 1 --2- 10.20.193.28:0/3490934113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8627950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c5c80640 1 -- 10.20.193.28:0/3490934113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8f8628120 con 0x55a8f863cde0 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86c5c80640 1 --2- 10.20.193.28:0/3490934113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865c4c0 secure :-1 s=READY pgs=1105 gs=2 cs=0 l=1 c_cookie=5615326419739760749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b4108f50 tx=0x7f86b4041410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4deda5a0a274586d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f868dbfe640 1 -- 10.20.193.28:0/3490934113 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b40d74a0 con 0x55a8f863cde0 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f868dbfe640 1 -- 10.20.193.28:0/3490934113 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f86b40d9a80 con 0x55a8f863cde0 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f868dbfe640 1 -- 10.20.193.28:0/3490934113 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b40d2410 con 0x55a8f863cde0 2026-02-20T13:27:05.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86cae37e00 1 -- 10.20.193.28:0/3490934113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 msgr2=0x55a8f865c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.034+0000 7f86cae37e00 1 --2- 10.20.193.28:0/3490934113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865c4c0 secure :-1 s=READY pgs=1105 gs=2 cs=0 l=1 c_cookie=5615326419739760749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b4108f50 tx=0x7f86b4041410 comp rx=0 tx=0).stop 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 -- 10.20.193.28:0/3490934113 shutdown_connections 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 --2- 10.20.193.28:0/3490934113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f863cde0 0x55a8f865c4c0 unknown :-1 s=CLOSED pgs=1105 gs=2 cs=0 l=1 c_cookie=5615326419739760749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 --2- 10.20.193.28:0/3490934113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f865d700 0x55a8f865ca00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 --2- 10.20.193.28:0/3490934113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f8627950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 -- 10.20.193.28:0/3490934113 >> 10.20.193.28:0/3490934113 conn(0x55a8f853b1c0 msgr2=0x55a8f865bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 -- 10.20.193.28:0/3490934113 shutdown_connections 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 -- 10.20.193.28:0/3490934113 wait complete. 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 -- start start 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.035+0000 7f86cae37e00 1 Processor -- start 2026-02-20T13:27:05.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f863e710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f863cde0 0x55a8f863edb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86cae37e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f865d700 0x55a8f863f660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86cae37e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8f863fd10 con 0x55a8f865d700 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86cae37e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a8f863fe80 con 0x55a8f861c4c0 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86cae37e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a8f8640040 con 0x55a8f863cde0 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6c82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f865d700 0x55a8f863f660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6481640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f863e710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6481640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f863e710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56740/0 (socket says 10.20.193.28:56740) 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6481640 1 -- 10.20.193.28:0/1415072140 learned_addr learned my addr 10.20.193.28:0/1415072140 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c5c80640 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f863cde0 0x55a8f863edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6c82640 1 -- 10.20.193.28:0/1415072140 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f863cde0 msgr2=0x55a8f863edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6c82640 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f863cde0 0x55a8f863edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6c82640 1 -- 10.20.193.28:0/1415072140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 msgr2=0x55a8f863e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6c82640 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f863e710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6c82640 1 -- 10.20.193.28:0/1415072140 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8f84bd670 con 0x55a8f865d700 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6481640 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f863e710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86c6c82640 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f865d700 0x55a8f863f660 secure :-1 s=READY pgs=1106 gs=2 cs=0 l=1 c_cookie=15431640146632835761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a8f85f67a0 tx=0x7f86bc013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62832f3f9b502b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:05.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f867b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f867b7fe640 1 -- 10.20.193.28:0/1415072140 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86bc021070 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f867b7fe640 1 -- 10.20.193.28:0/1415072140 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f86bc0055b0 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f867b7fe640 1 -- 10.20.193.28:0/1415072140 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86bc017040 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.036+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c015f0e0 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f867b7fe640 1 -- 10.20.193.28:0/1415072140 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f86bc003780 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 10 client.18933 _ll_register_callbacks cb 0x55a8f84b2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8f85d7ca0 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f867b7fe640 1 -- 10.20.193.28:0/1415072140 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f86bc011900 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 10 client.18933 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a8f84b80f0 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f867b7fe640 1 -- 10.20.193.28:0/1415072140 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f86bc0050d0 con 0x55a8f865d700 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 10 client.18933 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 10 client.18933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 20 client.18933 populate_metadata read hostname 'trial028' 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a8f8641f80 0x55a8f8642420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 4 client.18933 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a8f820b640 con 0x55a8f8641f80 2026-02-20T13:27:05.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.037+0000 7f86c6481640 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a8f8641f80 0x55a8f8642420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:05.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.038+0000 7f867b7fe640 10 client.18933 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:05.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.038+0000 7f86c6481640 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a8f8641f80 0x55a8f8642420 crc :-1 s=READY pgs=287 gs=4 cs=0 l=0 c_cookie=3368512570457679388 s_cookie=12908545830681924475 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ebf5c55ef91661c server_cookie=b3245e0a64a5537b in_seq=0 out_seq=0 2026-02-20T13:27:05.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.042+0000 7f867b7fe640 1 -- 10.20.193.28:0/1415072140 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a8f820b640 con 0x55a8f8641f80 2026-02-20T13:27:05.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.042+0000 7f867b7fe640 10 client.18933 handle_command_reply: tid=0 2026-02-20T13:27:05.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.042+0000 7f86cae37e00 1 client.18933 shutdown 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f865d700 msgr2=0x55a8f863f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f865d700 0x55a8f863f660 secure :-1 s=READY pgs=1106 gs=2 cs=0 l=1 c_cookie=15431640146632835761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a8f85f67a0 tx=0x7f86bc013b70 comp rx=0 tx=0).stop 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 shutdown_connections 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a8f8641f80 0x55a8f8642420 crc :-1 s=READY pgs=287 gs=4 cs=0 l=0 c_cookie=3368512570457679388 s_cookie=12908545830681924475 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8f865d700 0x55a8f863f660 unknown :-1 s=CLOSED pgs=1106 gs=2 cs=0 l=1 c_cookie=15431640146632835761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a8f863cde0 0x55a8f863edb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 --2- 10.20.193.28:0/1415072140 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a8f861c4c0 0x55a8f863e710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f867b7fe640 0 client.18933 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 >> 10.20.193.28:0/1415072140 conn(0x55a8f853b1c0 msgr2=0x55a8f865c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 shutdown_connections 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 1 -- 10.20.193.28:0/1415072140 wait complete. 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86cae37e00 20 client.18933 trim_cache size 0 max 16384 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:27:05.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 -- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f869c0b5760 msgr2=0x7f869c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f869c0b5760 0x7f869c0d5c10 secure :-1 s=READY pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b0004740 tx=0x7f86b0005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 -- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 msgr2=0x7f86c014e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 0x7f86c014e3e0 secure :-1 s=READY pgs=1104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b4002d80 tx=0x7f86b40028d0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 -- 10.20.193.28:0/3799798547 shutdown_connections 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f869c0b5760 0x7f869c0d5c10 unknown :-1 s=CLOSED pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010bb20 0x7f86c014e3e0 unknown :-1 s=CLOSED pgs=1104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c014eb40 0x7f86c015ded0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 --2- 10.20.193.28:0/3799798547 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f86c010b110 0x7f86c015d690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 -- 10.20.193.28:0/3799798547 >> 10.20.193.28:0/3799798547 conn(0x7f86c00e8a80 msgr2=0x7f86c0108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 -- 10.20.193.28:0/3799798547 shutdown_connections 2026-02-20T13:27:05.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:05.043+0000 7f86c7483640 1 -- 10.20.193.28:0/3799798547 wait complete. 2026-02-20T13:27:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:06 trial028 ceph-mon[37442]: pgmap v474: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:27:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:06 trial127 ceph-mon[43817]: pgmap v474: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:27:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:06 trial034 ceph-mon[43332]: pgmap v474: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:27:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:08 trial028 ceph-mon[37442]: pgmap v475: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:27:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:08 trial127 ceph-mon[43817]: pgmap v475: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:27:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:08 trial034 ceph-mon[43332]: pgmap v475: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:27:10.481 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.481 INFO:tasks.workunit.client.0.trial028.stdout:313/600: open fd = 3 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:314/600: open fd = 3 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:315/600: open fd = 3 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.482 INFO:tasks.workunit.client.0.trial028.stdout:316/600: open fd = 3 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:317/600: open fd = 3 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:318/600: open fd = 3 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:319/600: open fd = 3 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.483 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:320/600: open fd = 3 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:321/600: open fd = 3 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:322/600: open fd = 3 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.484 INFO:tasks.workunit.client.0.trial028.stdout:323/600: open fd = 3 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:324/600: open fd = 3 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:325/600: open fd = 3 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:326/600: open fd = 3 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:327/600: open fd = 3 2026-02-20T13:27:10.485 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:328/600: open fd = 3 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:329/600: open fd = 3 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:330/600: open fd = 3 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:331/600: open fd = 3 2026-02-20T13:27:10.486 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:332/600: open fd = 3 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:333/600: open fd = 3 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:334/600: open fd = 3 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:335/600: open fd = 3 2026-02-20T13:27:10.487 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:336/600: open fd = 3 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:337/600: open fd = 3 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:338/600: open fd = 3 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:339/600: open fd = 3 2026-02-20T13:27:10.488 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:340/600: open fd = 3 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:341/600: open fd = 3 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:342/600: open fd = 3 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:343/600: open fd = 3 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.489 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:344/600: open fd = 3 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:345/600: open fd = 3 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:346/600: open fd = 3 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:347/600: open fd = 3 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.490 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:348/600: open fd = 3 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:349/600: open fd = 3 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:350/600: open fd = 3 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:351/600: open fd = 3 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.491 INFO:tasks.workunit.client.0.trial028.stdout:352/600: open fd = 3 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:353/600: open fd = 3 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:354/600: open fd = 3 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:355/600: open fd = 3 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:356/600: open fd = 3 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.492 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:357/600: open fd = 3 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:358/600: open fd = 3 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:359/600: open fd = 3 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:360/600: open fd = 3 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:361/600: open fd = 3 2026-02-20T13:27:10.493 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:362/600: open fd = 3 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:363/600: open fd = 3 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:364/600: open fd = 3 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:365/600: open fd = 3 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.494 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:366/600: open fd = 3 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:367/600: open fd = 3 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:368/600: open fd = 3 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:369/600: open fd = 3 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:370/600: open fd = 3 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.495 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:371/600: open fd = 3 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:372/600: open fd = 3 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:373/600: open fd = 3 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:374/600: open fd = 3 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:27:10.496 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:27:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:10 trial028 ceph-mon[37442]: pgmap v476: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:27:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:10 trial127 ceph-mon[43817]: pgmap v476: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:27:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:10 trial034 ceph-mon[43332]: pgmap v476: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2026-02-20T13:27:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:12 trial028 ceph-mon[37442]: pgmap v477: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:27:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:12 trial127 ceph-mon[43817]: pgmap v477: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:27:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:12 trial034 ceph-mon[43332]: pgmap v477: 97 pgs: 97 active+clean; 1.4 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2026-02-20T13:27:14.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:14 trial028 ceph-mon[37442]: pgmap v478: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:27:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:14 trial127 ceph-mon[43817]: pgmap v478: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:27:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:14 trial034 ceph-mon[43332]: pgmap v478: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2026-02-20T13:27:16.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:16 trial028 ceph-mon[37442]: pgmap v479: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:27:16.891 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:27:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:16 trial127 ceph-mon[43817]: pgmap v479: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:27:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:16 trial034 ceph-mon[43332]: pgmap v479: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2026-02-20T13:27:17.077 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:17.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/2687049954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410ffe0 msgr2=0x7f1bf4115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/2687049954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410ffe0 0x7f1bf4115030 secure :-1 s=READY pgs=1107 gs=1 cs=0 l=1 c_cookie=14888752601168813538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be8009950 tx=0x7f1be802f190 comp rx=0 tx=0).stop 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/2687049954 shutdown_connections 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/2687049954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410ffe0 0x7f1bf4115030 unknown :-1 s=CLOSED pgs=1107 gs=1 cs=0 l=1 c_cookie=14888752601168813538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/2687049954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1bf41157e0 0x7f1bf41761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/2687049954 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1bf410f5f0 0x7f1bf410f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/2687049954 >> 10.20.193.28:0/2687049954 conn(0x7f1bf40ecea0 msgr2=0x7f1bf410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/2687049954 shutdown_connections 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.255+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/2687049954 wait complete. 2026-02-20T13:27:17.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.256+0000 7f1bfc4dd640 1 Processor -- start 2026-02-20T13:27:17.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.256+0000 7f1bfc4dd640 1 -- start start 2026-02-20T13:27:17.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.256+0000 7f1bfc4dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410f5f0 0x7f1bf40f4e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.256+0000 7f1bfc4dd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1bf410ffe0 0x7f1bf41760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.256+0000 7f1bfc4dd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1bf41157e0 0x7f1bf40f5530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.256+0000 7f1bfc4dd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf40fa740 con 0x7f1bf410f5f0 2026-02-20T13:27:17.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.256+0000 7f1bfc4dd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf40fa8b0 con 0x7f1bf410ffe0 2026-02-20T13:27:17.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.256+0000 7f1bfc4dd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf40faa70 con 0x7f1bf41157e0 2026-02-20T13:27:17.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfa252640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410f5f0 0x7f1bf40f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bf9a51640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1bf410ffe0 0x7f1bf41760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bf9a51640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1bf410ffe0 0x7f1bf41760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41096/0 (socket says 10.20.193.28:41096) 2026-02-20T13:27:17.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bf9a51640 1 -- 10.20.193.28:0/480817130 learned_addr learned my addr 10.20.193.28:0/480817130 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:17.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1bf41157e0 0x7f1bf40f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfa252640 1 -- 10.20.193.28:0/480817130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1bf41157e0 msgr2=0x7f1bf40f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfa252640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1bf41157e0 0x7f1bf40f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfa252640 1 -- 10.20.193.28:0/480817130 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1bf410ffe0 msgr2=0x7f1bf41760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfa252640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1bf410ffe0 0x7f1bf41760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfa252640 1 -- 10.20.193.28:0/480817130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be8009570 con 0x7f1bf410f5f0 2026-02-20T13:27:17.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1bf41157e0 0x7f1bf40f5530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:17.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfa252640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410f5f0 0x7f1bf40f4e30 secure :-1 s=READY pgs=1108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be400e9c0 tx=0x7f1be400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:17.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bdb7fe640 1 -- 10.20.193.28:0/480817130 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1be400ccb0 con 0x7f1bf410f5f0 2026-02-20T13:27:17.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bdb7fe640 1 -- 10.20.193.28:0/480817130 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1be400ce10 con 0x7f1bf410f5f0 2026-02-20T13:27:17.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bdb7fe640 1 -- 10.20.193.28:0/480817130 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1be40106b0 con 0x7f1bf410f5f0 2026-02-20T13:27:17.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/480817130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf40fad50 con 0x7f1bf410f5f0 2026-02-20T13:27:17.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.257+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/480817130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf40fb220 con 0x7f1bf410f5f0 2026-02-20T13:27:17.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.260+0000 7f1bdb7fe640 1 -- 10.20.193.28:0/480817130 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1be401f060 con 0x7f1bf410f5f0 2026-02-20T13:27:17.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.262+0000 7f1bdb7fe640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1bd00b56d0 0x7f1bd00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.262+0000 7f1bdb7fe640 1 -- 10.20.193.28:0/480817130 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1be4014070 con 0x7f1bf410f5f0 2026-02-20T13:27:17.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.262+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1bd00b56d0 0x7f1bd00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfe4d7e00 1 Processor -- start 2026-02-20T13:27:17.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfe4d7e00 1 -- start start 2026-02-20T13:27:17.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1bd00b56d0 0x7f1bd00d5b80 secure :-1 s=READY pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bf40fb7d0 tx=0x7f1be803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a6087550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cc400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60ecd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9a5f9d7d0 con 0x55e9a60cc940 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9a5f99500 con 0x55e9a6087180 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9a5f934a0 con 0x55e9a6087a90 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bf9a51640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfa252640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a6087550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bf9a51640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40290/0 (socket says 10.20.193.28:40290) 2026-02-20T13:27:17.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bf9a51640 1 -- 10.20.193.28:0/175260534 learned_addr learned my addr 10.20.193.28:0/175260534 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.263+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bf9a51640 1 -- 10.20.193.28:0/175260534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 msgr2=0x55e9a6087550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a6087550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bf9a51640 1 -- 10.20.193.28:0/175260534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 msgr2=0x55e9a60ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60ecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bf9a51640 1 -- 10.20.193.28:0/175260534 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a5f3ed80 con 0x55e9a6087a90 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60ecd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfa252640 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a6087550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cc400 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=14250685857774065614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be8002ee0 tx=0x7f1be8040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c49b48c64e57ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bd8a6d640 1 -- 10.20.193.28:0/175260534 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1be8002a80 con 0x55e9a6087a90 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bd8a6d640 1 -- 10.20.193.28:0/175260534 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1be803e040 con 0x55e9a6087a90 2026-02-20T13:27:17.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bd8a6d640 1 -- 10.20.193.28:0/175260534 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1be80448c0 con 0x55e9a6087a90 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/175260534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 msgr2=0x55e9a60cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cc400 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=14250685857774065614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be8002ee0 tx=0x7f1be8040000 comp rx=0 tx=0).stop 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/175260534 shutdown_connections 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60ecd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cc400 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=14250685857774065614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/175260534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a6087550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.264+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/175260534 >> 10.20.193.28:0/175260534 conn(0x55e9a6065680 msgr2=0x55e9a6085a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.265+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/175260534 shutdown_connections 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.265+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/175260534 wait complete. 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.266+0000 7f1bfe4d7e00 1 -- start start 2026-02-20T13:27:17.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.266+0000 7f1bfe4d7e00 1 Processor -- start 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.266+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087180 0x55e9a609f670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.266+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087a90 0x55e9a609fbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.266+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.266+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9a60a50e0 con 0x55e9a60cc940 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.266+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9a60a5250 con 0x55e9a6087a90 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.266+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9a60a5410 con 0x55e9a6087180 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bf9a51640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087a90 0x55e9a609fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfa252640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087180 0x55e9a609f670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41458/0 (socket says 10.20.193.28:41458) 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 -- 10.20.193.28:0/3709803010 learned_addr learned my addr 10.20.193.28:0/3709803010 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 -- 10.20.193.28:0/3709803010 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087180 msgr2=0x55e9a609f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087180 0x55e9a609f670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 -- 10.20.193.28:0/3709803010 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087a90 msgr2=0x55e9a609fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087a90 0x55e9a609fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 -- 10.20.193.28:0/3709803010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf4176a20 con 0x55e9a60cc940 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087a90 0x55e9a609fbb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60a4ba0 secure :-1 s=READY pgs=1109 gs=1 cs=0 l=1 c_cookie=4844331545796631721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bf0006a50 tx=0x7f1bf0013820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433a85dfe16d5ca9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:17.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1ba7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3709803010 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1bf0011760 con 0x55e9a60cc940 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3709803010 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1bf0011da0 con 0x55e9a60cc940 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3709803010 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1bf000f350 con 0x55e9a60cc940 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.267+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf0005520 con 0x55e9a60cc940 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3709803010 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1bf000f4e0 con 0x55e9a60cc940 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1ba7fff640 10 client.18945 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 10 client.18945 _ll_register_callbacks cb 0x55e9a5f149a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9a5c296f0 con 0x55e9a60cc940 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3709803010 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1bf00118c0 con 0x55e9a60cc940 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 10 client.18945 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:17.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e9a5f17350 con 0x55e9a60cc940 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3709803010 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1bf0011a60 con 0x55e9a60cc940 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 10 client.18945 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 10 client.18945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 20 client.18945 populate_metadata read hostname 'trial028' 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9a60c9ec0 0x55e9a60ca360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 4 client.18945 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.268+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9a5fa0d60 con 0x55e9a60c9ec0 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.269+0000 7f1bfa252640 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9a60c9ec0 0x55e9a60ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.269+0000 7f1bfa252640 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9a60c9ec0 0x55e9a60ca360 crc :-1 s=READY pgs=288 gs=4 cs=0 l=0 c_cookie=17198162412138884324 s_cookie=4377303931996846068 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeac259815036ce4 server_cookie=3cbf4ebbf497b7f4 in_seq=0 out_seq=0 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.269+0000 7f1ba7fff640 10 client.18945 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3709803010 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x7f1be40c4e90 con 0x55e9a60c9ec0 2026-02-20T13:27:17.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1ba7fff640 10 client.18945 handle_command_reply: tid=0 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 client.18945 shutdown 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 msgr2=0x55e9a60a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60a4ba0 secure :-1 s=READY pgs=1109 gs=1 cs=0 l=1 c_cookie=4844331545796631721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bf0006a50 tx=0x7f1bf0013820 comp rx=0 tx=0).stop 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 shutdown_connections 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9a60c9ec0 0x55e9a60ca360 crc :-1 s=READY pgs=288 gs=4 cs=0 l=0 c_cookie=17198162412138884324 s_cookie=4377303931996846068 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60a4ba0 unknown :-1 s=CLOSED pgs=1109 gs=1 cs=0 l=1 c_cookie=4844331545796631721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087a90 0x55e9a609fbb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3709803010 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087180 0x55e9a609f670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1ba7fff640 0 client.18945 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 >> 10.20.193.28:0/3709803010 conn(0x55e9a6065680 msgr2=0x55e9a6086250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 shutdown_connections 2026-02-20T13:27:17.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3709803010 wait complete. 2026-02-20T13:27:17.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.270+0000 7f1bfe4d7e00 20 client.18945 trim_cache size 0 max 16384 2026-02-20T13:27:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.279+0000 7f1bfe4d7e00 1 Processor -- start 2026-02-20T13:27:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.279+0000 7f1bfe4d7e00 1 -- start start 2026-02-20T13:27:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.279+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a60cba30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.279+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cbf70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.279+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60c4070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.279+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9a5f910d0 con 0x55e9a60cc940 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.279+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9a5c51700 con 0x55e9a6087180 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.279+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9a60c6750 con 0x55e9a6087a90 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfa252640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a60cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41460/0 (socket says 10.20.193.28:41460) 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 -- 10.20.193.28:0/1543851950 learned_addr learned my addr 10.20.193.28:0/1543851950 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 -- 10.20.193.28:0/1543851950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 msgr2=0x55e9a60cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 -- 10.20.193.28:0/1543851950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 msgr2=0x55e9a60cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a60cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 -- 10.20.193.28:0/1543851950 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a5f29150 con 0x55e9a60cc940 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfa252640 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a60cba30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60c4070 secure :-1 s=READY pgs=1110 gs=1 cs=0 l=1 c_cookie=13239463699669471566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bf0003490 tx=0x7f1bf0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bc0616d37a514e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bc24e6640 1 -- 10.20.193.28:0/1543851950 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1bf0010440 con 0x55e9a60cc940 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bc24e6640 1 -- 10.20.193.28:0/1543851950 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e9a5c296f0 con 0x55e9a60cc940 2026-02-20T13:27:17.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.280+0000 7f1bc24e6640 1 -- 10.20.193.28:0/1543851950 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1bf0003d70 con 0x55e9a60cc940 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/1543851950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 msgr2=0x55e9a60c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60c4070 secure :-1 s=READY pgs=1110 gs=1 cs=0 l=1 c_cookie=13239463699669471566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bf0003490 tx=0x7f1bf0020000 comp rx=0 tx=0).stop 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/1543851950 shutdown_connections 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a60cc940 0x55e9a60c4070 unknown :-1 s=CLOSED pgs=1110 gs=1 cs=0 l=1 c_cookie=13239463699669471566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60cbf70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/1543851950 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a6087180 0x55e9a60cba30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/1543851950 >> 10.20.193.28:0/1543851950 conn(0x55e9a6065680 msgr2=0x55e9a609ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/1543851950 shutdown_connections 2026-02-20T13:27:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/1543851950 wait complete. 2026-02-20T13:27:17.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.281+0000 7f1bfe4d7e00 1 -- start start 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfe4d7e00 1 Processor -- start 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a6087180 0x55e9a60a76f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60a7c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfe4d7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a60cc940 0x55e9a6131e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9a61323a0 con 0x55e9a6087180 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e9a6132510 con 0x55e9a60cc940 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfe4d7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e9a61326d0 con 0x55e9a6087a90 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfa252640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a6087180 0x55e9a60a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfa252640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a6087180 0x55e9a60a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41466/0 (socket says 10.20.193.28:41466) 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfa252640 1 -- 10.20.193.28:0/3414433906 learned_addr learned my addr 10.20.193.28:0/3414433906 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:17.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfaa53640 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a60cc940 0x55e9a6131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfa252640 1 -- 10.20.193.28:0/3414433906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 msgr2=0x55e9a60a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfa252640 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfa252640 1 -- 10.20.193.28:0/3414433906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a60cc940 msgr2=0x55e9a6131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfa252640 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a60cc940 0x55e9a6131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.282+0000 7f1bfa252640 1 -- 10.20.193.28:0/3414433906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a5f23bd0 con 0x55e9a6087180 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfa252640 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a6087180 0x55e9a60a76f0 secure :-1 s=READY pgs=1111 gs=1 cs=0 l=1 c_cookie=2195771216691873869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be40ad010 tx=0x7f1be40b5400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e78f249b2f2484d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1ba7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3414433906 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1be4073ea0 con 0x55e9a6087180 2026-02-20T13:27:17.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf0018040 con 0x55e9a6087180 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 10 client.18951 _ll_register_callbacks cb 0x55e9a5f149a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be803e040 con 0x55e9a6087180 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3414433906 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e9a5fa0d60 con 0x55e9a6087180 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3414433906 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1be40adf40 con 0x55e9a6087180 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3414433906 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1be40b7ce0 con 0x55e9a6087180 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3414433906 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1be40b7f00 con 0x55e9a6087180 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 10 client.18951 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e9a5f17680 con 0x55e9a6087180 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3414433906 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1be40a92a0 con 0x55e9a6087180 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 10 client.18951 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 10 client.18951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 20 client.18951 populate_metadata read hostname 'trial028' 2026-02-20T13:27:17.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9a617a6b0 0x55e9a619ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 4 client.18951 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.283+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e9a5c26f40 con 0x55e9a617a6b0 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.284+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9a617a6b0 0x55e9a619ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bf9a51640 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9a617a6b0 0x55e9a619ab60 crc :-1 s=READY pgs=289 gs=4 cs=0 l=0 c_cookie=2518469892770136290 s_cookie=16001958832084959950 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22f36706281480e2 server_cookie=de1260c698d942ce in_seq=0 out_seq=0 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1ba7fff640 10 client.18951 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1ba7fff640 1 -- 10.20.193.28:0/3414433906 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x55e9a5c26f40 con 0x55e9a617a6b0 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1ba7fff640 10 client.18951 handle_command_reply: tid=0 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 client.18951 shutdown 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a6087180 msgr2=0x55e9a60a76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a6087180 0x55e9a60a76f0 secure :-1 s=READY pgs=1111 gs=1 cs=0 l=1 c_cookie=2195771216691873869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be40ad010 tx=0x7f1be40b5400 comp rx=0 tx=0).stop 2026-02-20T13:27:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 shutdown_connections 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e9a617a6b0 0x55e9a619ab60 crc :-1 s=READY pgs=289 gs=4 cs=0 l=0 c_cookie=2518469892770136290 s_cookie=16001958832084959950 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e9a60cc940 0x55e9a6131e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e9a6087a90 0x55e9a60a7c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 --2- 10.20.193.28:0/3414433906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a6087180 0x55e9a60a76f0 unknown :-1 s=CLOSED pgs=1111 gs=1 cs=0 l=1 c_cookie=2195771216691873869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 >> 10.20.193.28:0/3414433906 conn(0x55e9a6065680 msgr2=0x55e9a609c250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1ba7fff640 0 client.18951 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 shutdown_connections 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 1 -- 10.20.193.28:0/3414433906 wait complete. 2026-02-20T13:27:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.285+0000 7f1bfe4d7e00 20 client.18951 trim_cache size 0 max 16384 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:27:17.296 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:27:17.297 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.299 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:27:17.300 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.301 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.302 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.303 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.304 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:17.305 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:17.306 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:17.306 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:17.306 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:17.306 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:27:17.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1bd00b56d0 msgr2=0x7f1bd00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1bd00b56d0 0x7f1bd00d5b80 secure :-1 s=READY pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bf40fb7d0 tx=0x7f1be803a040 comp rx=0 tx=0).stop 2026-02-20T13:27:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410f5f0 msgr2=0x7f1bf40f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410f5f0 0x7f1bf40f4e30 secure :-1 s=READY pgs=1108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be400e9c0 tx=0x7f1be400ee90 comp rx=0 tx=0).stop 2026-02-20T13:27:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/480817130 shutdown_connections 2026-02-20T13:27:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1bd00b56d0 0x7f1bd00d5b80 unknown :-1 s=CLOSED pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1bf41157e0 0x7f1bf40f5530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1bf410ffe0 0x7f1bf41760b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 --2- 10.20.193.28:0/480817130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1bf410f5f0 0x7f1bf40f4e30 unknown :-1 s=CLOSED pgs=1108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/480817130 >> 10.20.193.28:0/480817130 conn(0x7f1bf40ecea0 msgr2=0x7f1bf4111e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/480817130 shutdown_connections 2026-02-20T13:27:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.286+0000 7f1bfc4dd640 1 -- 10.20.193.28:0/480817130 wait complete. 2026-02-20T13:27:17.386 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:27:17.386 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:27:17.572 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:17.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3378902007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27410ddc0 msgr2=0x7fe274112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3378902007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27410ddc0 0x7fe274112e10 secure :-1 s=READY pgs=1112 gs=2 cs=0 l=1 c_cookie=16709257204045347541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe264009890 tx=0x7fe26402f0e0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3378902007 shutdown_connections 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3378902007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27410ddc0 0x7fe274112e10 unknown :-1 s=CLOSED pgs=1112 gs=2 cs=0 l=1 c_cookie=16709257204045347541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3378902007 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe2741135c0 0x7fe274173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3378902007 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe27410d3d0 0x7fe27410d7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3378902007 >> 10.20.193.28:0/3378902007 conn(0x7fe2740eacc0 msgr2=0x7fe27410b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3378902007 shutdown_connections 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.752+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3378902007 wait complete. 2026-02-20T13:27:17.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.753+0000 7fe27a4fe640 1 Processor -- start 2026-02-20T13:27:17.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.753+0000 7fe27a4fe640 1 -- start start 2026-02-20T13:27:17.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.753+0000 7fe27a4fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe27410d3d0 0x7fe2740f58c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.753+0000 7fe27a4fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe27410ddc0 0x7fe274173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.753+0000 7fe27a4fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2741135c0 0x7fe2740f5fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.753+0000 7fe27a4fe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe2740fb1d0 con 0x7fe2741135c0 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.753+0000 7fe27a4fe640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe2740fb340 con 0x7fe27410d3d0 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.753+0000 7fe27a4fe640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe2740fb500 con 0x7fe27410ddc0 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe273fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe27410d3d0 0x7fe2740f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe273fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe27410d3d0 0x7fe2740f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41154/0 (socket says 10.20.193.28:41154) 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe273fff640 1 -- 10.20.193.28:0/3478573134 learned_addr learned my addr 10.20.193.28:0/3478573134 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe278a74640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2741135c0 0x7fe2740f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe2737fe640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe27410ddc0 0x7fe274173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe278a74640 1 -- 10.20.193.28:0/3478573134 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe27410ddc0 msgr2=0x7fe274173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe278a74640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe27410ddc0 0x7fe274173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe278a74640 1 -- 10.20.193.28:0/3478573134 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe27410d3d0 msgr2=0x7fe2740f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe278a74640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe27410d3d0 0x7fe2740f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe278a74640 1 -- 10.20.193.28:0/3478573134 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe260009570 con 0x7fe2741135c0 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe278a74640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2741135c0 0x7fe2740f5fc0 secure :-1 s=READY pgs=1113 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe26800f940 tx=0x7fe26800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe2717fa640 1 -- 10.20.193.28:0/3478573134 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe26800dce0 con 0x7fe2741135c0 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe2717fa640 1 -- 10.20.193.28:0/3478573134 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe26800de40 con 0x7fe2741135c0 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe2717fa640 1 -- 10.20.193.28:0/3478573134 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2680116b0 con 0x7fe2741135c0 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.754+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2640094b0 con 0x7fe2741135c0 2026-02-20T13:27:17.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.755+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2740fbad0 con 0x7fe2741135c0 2026-02-20T13:27:17.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.755+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe27410e6b0 con 0x7fe2741135c0 2026-02-20T13:27:17.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.757+0000 7fe2717fa640 1 -- 10.20.193.28:0/3478573134 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe268020060 con 0x7fe2741135c0 2026-02-20T13:27:17.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.759+0000 7fe2717fa640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2480b56d0 0x7fe2480d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:17.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.759+0000 7fe2717fa640 1 -- 10.20.193.28:0/3478573134 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe268015070 con 0x7fe2741135c0 2026-02-20T13:27:17.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.759+0000 7fe2717fa640 1 -- 10.20.193.28:0/3478573134 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe268120730 con 0x7fe2741135c0 2026-02-20T13:27:17.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.759+0000 7fe273fff640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2480b56d0 0x7fe2480d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:17.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.760+0000 7fe273fff640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2480b56d0 0x7fe2480d5b80 secure :-1 s=READY pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe260004050 tx=0x7fe260009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:17.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.902+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe27410d7a0 con 0x7fe2741135c0 2026-02-20T13:27:17.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.902+0000 7fe2717fa640 1 -- 10.20.193.28:0/3478573134 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fe2680aa710 con 0x7fe2741135c0 2026-02-20T13:27:17.905 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:27:17.906 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:27:17.906 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2480b56d0 msgr2=0x7fe2480d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2480b56d0 0x7fe2480d5b80 secure :-1 s=READY pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe260004050 tx=0x7fe260009310 comp rx=0 tx=0).stop 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2741135c0 msgr2=0x7fe2740f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2741135c0 0x7fe2740f5fc0 secure :-1 s=READY pgs=1113 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe26800f940 tx=0x7fe26800fe10 comp rx=0 tx=0).stop 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 shutdown_connections 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe2480b56d0 0x7fe2480d5b80 unknown :-1 s=CLOSED pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2741135c0 0x7fe2740f5fc0 unknown :-1 s=CLOSED pgs=1113 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe27410ddc0 0x7fe274173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 --2- 10.20.193.28:0/3478573134 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe27410d3d0 0x7fe2740f58c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:17.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 >> 10.20.193.28:0/3478573134 conn(0x7fe2740eacc0 msgr2=0x7fe27410c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:17.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 shutdown_connections 2026-02-20T13:27:17.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:17.904+0000 7fe27a4fe640 1 -- 10.20.193.28:0/3478573134 wait complete. 2026-02-20T13:27:18.003 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:27:18.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/400666301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 msgr2=0x7fbf9c171290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/400666301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 0x7fbf9c171290 secure :-1 s=READY pgs=1114 gs=1 cs=0 l=1 c_cookie=11723165180461675875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf9800aa30 tx=0x7fbf98030270 comp rx=0 tx=0).stop 2026-02-20T13:27:18.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/400666301 shutdown_connections 2026-02-20T13:27:18.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/400666301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 0x7fbf9c171290 unknown :-1 s=CLOSED pgs=1114 gs=1 cs=0 l=1 c_cookie=11723165180461675875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/400666301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf9c061510 0x7fbf9c061980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/400666301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf9c062a40 0x7fbf9c060fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/400666301 >> 10.20.193.28:0/400666301 conn(0x7fbf9c0ea4c0 msgr2=0x7fbf9c10a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/400666301 shutdown_connections 2026-02-20T13:27:18.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/400666301 wait complete. 2026-02-20T13:27:18.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.115+0000 7fbfa2dd2640 1 Processor -- start 2026-02-20T13:27:18.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa2dd2640 1 -- start start 2026-02-20T13:27:18.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa2dd2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf9c061510 0x7fbf9c15c660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa2dd2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf9c062a40 0x7fbf9c15ccb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa2dd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 0x7fbf9c15d8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa2dd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c15df60 con 0x7fbf9c150e50 2026-02-20T13:27:18.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa2dd2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c15e0d0 con 0x7fbf9c062a40 2026-02-20T13:27:18.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa2dd2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c15e290 con 0x7fbf9c061510 2026-02-20T13:27:18.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa25d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 0x7fbf9c15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa25d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 0x7fbf9c15d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41500/0 (socket says 10.20.193.28:41500) 2026-02-20T13:27:18.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa25d1640 1 -- 10.20.193.28:0/4088258990 learned_addr learned my addr 10.20.193.28:0/4088258990 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf9c062a40 0x7fbf9c15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf9c061510 0x7fbf9c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa25d1640 1 -- 10.20.193.28:0/4088258990 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf9c061510 msgr2=0x7fbf9c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa25d1640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf9c061510 0x7fbf9c15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa25d1640 1 -- 10.20.193.28:0/4088258990 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf9c062a40 msgr2=0x7fbf9c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa25d1640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf9c062a40 0x7fbf9c15ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.116+0000 7fbfa25d1640 1 -- 10.20.193.28:0/4088258990 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9800a650 con 0x7fbf9c150e50 2026-02-20T13:27:18.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.117+0000 7fbfa25d1640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 0x7fbf9c15d8b0 secure :-1 s=READY pgs=1115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf9800a980 tx=0x7fbf980039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.117+0000 7fbf8affd640 1 -- 10.20.193.28:0/4088258990 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf9803e070 con 0x7fbf9c150e50 2026-02-20T13:27:18.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.117+0000 7fbf8affd640 1 -- 10.20.193.28:0/4088258990 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf980055a0 con 0x7fbf9c150e50 2026-02-20T13:27:18.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.117+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/4088258990 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9c15e510 con 0x7fbf9c150e50 2026-02-20T13:27:18.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.117+0000 7fbf8affd640 1 -- 10.20.193.28:0/4088258990 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf98042b00 con 0x7fbf9c150e50 2026-02-20T13:27:18.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.117+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/4088258990 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9c15eac0 con 0x7fbf9c150e50 2026-02-20T13:27:18.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.120+0000 7fbf8affd640 1 -- 10.20.193.28:0/4088258990 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbf980050c0 con 0x7fbf9c150e50 2026-02-20T13:27:18.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.122+0000 7fbf8affd640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf780b56e0 0x7fbf780d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.122+0000 7fbf8affd640 1 -- 10.20.193.28:0/4088258990 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbf9810c9a0 con 0x7fbf9c150e50 2026-02-20T13:27:18.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.122+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf780b56e0 0x7fbf780d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.122+0000 7fbfa667de00 1 Processor -- start 2026-02-20T13:27:18.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.122+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf780b56e0 0x7fbf780d5b90 secure :-1 s=READY pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf8c005fd0 tx=0x7fbf8c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa667de00 1 -- start start 2026-02-20T13:27:18.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e7c1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 0x563cf9e9cae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa667de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563cf9d50fd0 con 0x563cf9e5bde0 2026-02-20T13:27:18.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa667de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563cf9d4cd00 con 0x563cf9e3b4c0 2026-02-20T13:27:18.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa667de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563cf9d46ca0 con 0x563cf9e7c700 2026-02-20T13:27:18.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa1dd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa1dd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41166/0 (socket says 10.20.193.28:41166) 2026-02-20T13:27:18.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/2720776521 learned_addr learned my addr 10.20.193.28:0/2720776521 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa15cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e7c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa25d1640 1 --2- 10.20.193.28:0/2720776521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 0x563cf9e9cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa15cf640 1 -- 10.20.193.28:0/2720776521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 msgr2=0x563cf9e9cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/2720776521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 0x563cf9e9cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa15cf640 1 -- 10.20.193.28:0/2720776521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 msgr2=0x563cf9e5b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/2720776521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa15cf640 1 -- 10.20.193.28:0/2720776521 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cf9ce98b0 con 0x563cf9e5bde0 2026-02-20T13:27:18.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.123+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/2720776521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e7c1c0 secure :-1 s=READY pgs=1116 gs=2 cs=0 l=1 c_cookie=14188119948207398664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf90007c40 tx=0x7fbf900107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e653ebc7891f08 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbf6a3ff640 1 -- 10.20.193.28:0/2720776521 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf900040d0 con 0x563cf9e5bde0 2026-02-20T13:27:18.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbf6a3ff640 1 -- 10.20.193.28:0/2720776521 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf900026a0 con 0x563cf9e5bde0 2026-02-20T13:27:18.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbf6a3ff640 1 -- 10.20.193.28:0/2720776521 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf900118b0 con 0x563cf9e5bde0 2026-02-20T13:27:18.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 -- 10.20.193.28:0/2720776521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 msgr2=0x563cf9e7c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2720776521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e7c1c0 secure :-1 s=READY pgs=1116 gs=2 cs=0 l=1 c_cookie=14188119948207398664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf90007c40 tx=0x7fbf900107a0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 -- 10.20.193.28:0/2720776521 shutdown_connections 2026-02-20T13:27:18.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2720776521 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e7c1c0 unknown :-1 s=CLOSED pgs=1116 gs=2 cs=0 l=1 c_cookie=14188119948207398664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2720776521 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 0x563cf9e9cae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2720776521 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5b8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 -- 10.20.193.28:0/2720776521 >> 10.20.193.28:0/2720776521 conn(0x563cf9d5a1c0 msgr2=0x563cf9e39da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 -- 10.20.193.28:0/2720776521 shutdown_connections 2026-02-20T13:27:18.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.124+0000 7fbfa667de00 1 -- 10.20.193.28:0/2720776521 wait complete. 2026-02-20T13:27:18.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa667de00 1 -- start start 2026-02-20T13:27:18.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa667de00 1 Processor -- start 2026-02-20T13:27:18.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e54b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e55190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 0x563cf9e55bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa667de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563cf9e56250 con 0x563cf9e5bde0 2026-02-20T13:27:18.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa667de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563cf9e563c0 con 0x563cf9e3b4c0 2026-02-20T13:27:18.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa667de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563cf9e56580 con 0x563cf9e7c700 2026-02-20T13:27:18.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa1dd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e54b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa25d1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 0x563cf9e55bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa1dd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e54b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41170/0 (socket says 10.20.193.28:41170) 2026-02-20T13:27:18.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/2385341318 learned_addr learned my addr 10.20.193.28:0/2385341318 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.126+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e55190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa15cf640 1 -- 10.20.193.28:0/2385341318 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 msgr2=0x563cf9e55bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 0x563cf9e55bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa15cf640 1 -- 10.20.193.28:0/2385341318 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 msgr2=0x563cf9e54b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e54b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa15cf640 1 -- 10.20.193.28:0/2385341318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cf9cf2400 con 0x563cf9e5bde0 2026-02-20T13:27:18.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e55190 secure :-1 s=READY pgs=1117 gs=2 cs=0 l=1 c_cookie=6643778223089868316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf90010cb0 tx=0x7fbf90003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c337117f9bf5e1c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbf577fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:18.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbf577fe640 1 -- 10.20.193.28:0/2385341318 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf90021070 con 0x563cf9e5bde0 2026-02-20T13:27:18.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbf577fe640 1 -- 10.20.193.28:0/2385341318 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf90011850 con 0x563cf9e5bde0 2026-02-20T13:27:18.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbf577fe640 1 -- 10.20.193.28:0/2385341318 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf90005560 con 0x563cf9e5bde0 2026-02-20T13:27:18.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf90007860 con 0x563cf9e5bde0 2026-02-20T13:27:18.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbf577fe640 1 -- 10.20.193.28:0/2385341318 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbf9001a420 con 0x563cf9e5bde0 2026-02-20T13:27:18.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa667de00 10 client.18969 _ll_register_callbacks cb 0x563cf9cd1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:18.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.127+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563cf99e6520 con 0x563cf9e5bde0 2026-02-20T13:27:18.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbf577fe640 1 -- 10.20.193.28:0/2385341318 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf900056f0 con 0x563cf9e5bde0 2026-02-20T13:27:18.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa667de00 10 client.18969 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:18.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563cf9ccada0 con 0x563cf9e5bde0 2026-02-20T13:27:18.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbf577fe640 1 -- 10.20.193.28:0/2385341318 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf9002d060 con 0x563cf9e5bde0 2026-02-20T13:27:18.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa667de00 10 client.18969 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:18.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa667de00 10 client.18969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:18.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa667de00 20 client.18969 populate_metadata read hostname 'trial028' 2026-02-20T13:27:18.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563cf9e58fe0 0x563cf9e59460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa667de00 4 client.18969 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:18.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cf9d78630 con 0x563cf9e58fe0 2026-02-20T13:27:18.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.128+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563cf9e58fe0 0x563cf9e59460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbf577fe640 10 client.18969 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:18.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563cf9e58fe0 0x563cf9e59460 crc :-1 s=READY pgs=290 gs=4 cs=0 l=0 c_cookie=13373709583740907466 s_cookie=3476092458214982181 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b998f6026c1d2fca server_cookie=303d8fac72518225 in_seq=0 out_seq=0 2026-02-20T13:27:18.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbf577fe640 1 -- 10.20.193.28:0/2385341318 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563cf9d78630 con 0x563cf9e58fe0 2026-02-20T13:27:18.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbf577fe640 10 client.18969 handle_command_reply: tid=0 2026-02-20T13:27:18.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 client.18969 shutdown 2026-02-20T13:27:18.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 msgr2=0x563cf9e55190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e55190 secure :-1 s=READY pgs=1117 gs=2 cs=0 l=1 c_cookie=6643778223089868316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf90010cb0 tx=0x7fbf90003e90 comp rx=0 tx=0).stop 2026-02-20T13:27:18.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 shutdown_connections 2026-02-20T13:27:18.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563cf9e58fe0 0x563cf9e59460 crc :-1 s=READY pgs=290 gs=4 cs=0 l=0 c_cookie=13373709583740907466 s_cookie=3476092458214982181 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e5bde0 0x563cf9e55190 unknown :-1 s=CLOSED pgs=1117 gs=2 cs=0 l=1 c_cookie=6643778223089868316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e7c700 0x563cf9e55bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 --2- 10.20.193.28:0/2385341318 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e54b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbf577fe640 0 client.18969 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:18.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 >> 10.20.193.28:0/2385341318 conn(0x563cf9d5a1c0 msgr2=0x563cf9e3c790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 shutdown_connections 2026-02-20T13:27:18.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 1 -- 10.20.193.28:0/2385341318 wait complete. 2026-02-20T13:27:18.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.129+0000 7fbfa667de00 20 client.18969 trim_cache size 0 max 16384 2026-02-20T13:27:18.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.137+0000 7fbfa667de00 1 Processor -- start 2026-02-20T13:27:18.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa667de00 1 -- start start 2026-02-20T13:27:18.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e550c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e51e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e7c700 0x563cf9e52340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa667de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563cf9d448d0 con 0x563cf9e7c700 2026-02-20T13:27:18.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa667de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563cf9a85f10 con 0x563cf9e3b4c0 2026-02-20T13:27:18.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa667de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563cf9e42020 con 0x563cf9e5bde0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41176/0 (socket says 10.20.193.28:41176) 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/3337277001 learned_addr learned my addr 10.20.193.28:0/3337277001 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa25d1640 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e7c700 0x563cf9e52340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e51e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/3337277001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 msgr2=0x563cf9e51e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e51e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/3337277001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e7c700 msgr2=0x563cf9e52340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e7c700 0x563cf9e52340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/3337277001 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cf9cdc670 con 0x563cf9e3b4c0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa25d1640 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e7c700 0x563cf9e52340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.138+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e550c0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=2579476590305297677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf8c00a4a0 tx=0x7fbf8c011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23cc244acf95450d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbf69bfe640 1 -- 10.20.193.28:0/3337277001 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf8c023070 con 0x563cf9e3b4c0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbf69bfe640 1 -- 10.20.193.28:0/3337277001 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf8c02e030 con 0x563cf9e3b4c0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbf69bfe640 1 -- 10.20.193.28:0/3337277001 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf8c029320 con 0x563cf9e3b4c0 2026-02-20T13:27:18.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 -- 10.20.193.28:0/3337277001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 msgr2=0x563cf9e550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e550c0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=2579476590305297677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf8c00a4a0 tx=0x7fbf8c011000 comp rx=0 tx=0).stop 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 -- 10.20.193.28:0/3337277001 shutdown_connections 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e7c700 0x563cf9e52340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e51e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 --2- 10.20.193.28:0/3337277001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e3b4c0 0x563cf9e550c0 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=2579476590305297677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 -- 10.20.193.28:0/3337277001 >> 10.20.193.28:0/3337277001 conn(0x563cf9d5a1c0 msgr2=0x563cf9e549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 -- 10.20.193.28:0/3337277001 shutdown_connections 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.139+0000 7fbfa667de00 1 -- 10.20.193.28:0/3337277001 wait complete. 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa667de00 1 -- start start 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa667de00 1 Processor -- start 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e5dc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa667de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e7c700 0x563cf9e5e3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa667de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563cf9e5eab0 con 0x563cf9e3b4c0 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa667de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563cf9e5ec20 con 0x563cf9e7c700 2026-02-20T13:27:18.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa667de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563cf9e5ede0 con 0x563cf9e5bde0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa1dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa1dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5d690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41540/0 (socket says 10.20.193.28:41540) 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/4239705511 learned_addr learned my addr 10.20.193.28:0/4239705511 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa15cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e5dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa25d1640 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e7c700 0x563cf9e5e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/4239705511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 msgr2=0x563cf9e5dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e5dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/4239705511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e7c700 msgr2=0x563cf9e5e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e7c700 0x563cf9e5e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa1dd0640 1 -- 10.20.193.28:0/4239705511 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c00ee60 con 0x563cf9e3b4c0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.140+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e5dc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbfa1dd0640 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5d690 secure :-1 s=READY pgs=1118 gs=1 cs=0 l=1 c_cookie=17438000045228121599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf8c00ee10 tx=0x7fbf8c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20038a691115dff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbf577fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbf577fe640 1 -- 10.20.193.28:0/4239705511 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf8c023050 con 0x563cf9e3b4c0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbf577fe640 1 -- 10.20.193.28:0/4239705511 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf8c01edf0 con 0x563cf9e3b4c0 2026-02-20T13:27:18.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbf577fe640 1 -- 10.20.193.28:0/4239705511 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf8c010650 con 0x563cf9e3b4c0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9c15eac0 con 0x563cf9e3b4c0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbf577fe640 1 -- 10.20.193.28:0/4239705511 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbf8c0107e0 con 0x563cf9e3b4c0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbf577fe640 10 client.18975 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbfa667de00 10 client.18975 _ll_register_callbacks cb 0x563cf9cd1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563cf9df6ca0 con 0x563cf9e3b4c0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbf577fe640 1 -- 10.20.193.28:0/4239705511 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf8c029b50 con 0x563cf9e3b4c0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbfa667de00 10 client.18975 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.141+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563cf9cd70f0 con 0x563cf9e3b4c0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbf577fe640 1 -- 10.20.193.28:0/4239705511 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf8c043020 con 0x563cf9e3b4c0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbfa667de00 10 client.18975 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbfa667de00 10 client.18975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbfa667de00 20 client.18975 populate_metadata read hostname 'trial028' 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbfa667de00 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563cf9e60aa0 0x563cf9e60f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbfa667de00 4 client.18975 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563cf9a2a640 con 0x563cf9e60aa0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563cf9e60aa0 0x563cf9e60f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbfa15cf640 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563cf9e60aa0 0x563cf9e60f40 crc :-1 s=READY pgs=291 gs=4 cs=0 l=0 c_cookie=15481468846609405548 s_cookie=7651968677494761089 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d939e4436e166c server_cookie=6a3140f8667da681 in_seq=0 out_seq=0 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.142+0000 7fbf577fe640 10 client.18975 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbf577fe640 1 -- 10.20.193.28:0/4239705511 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563cf9a2a640 con 0x563cf9e60aa0 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbf577fe640 10 client.18975 handle_command_reply: tid=0 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 client.18975 shutdown 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e3b4c0 msgr2=0x563cf9e5d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5d690 secure :-1 s=READY pgs=1118 gs=1 cs=0 l=1 c_cookie=17438000045228121599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf8c00ee10 tx=0x7fbf8c005750 comp rx=0 tx=0).stop 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 shutdown_connections 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563cf9e60aa0 0x563cf9e60f40 crc :-1 s=READY pgs=291 gs=4 cs=0 l=0 c_cookie=15481468846609405548 s_cookie=7651968677494761089 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563cf9e7c700 0x563cf9e5e3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563cf9e5bde0 0x563cf9e5dc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 --2- 10.20.193.28:0/4239705511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563cf9e3b4c0 0x563cf9e5d690 unknown :-1 s=CLOSED pgs=1118 gs=1 cs=0 l=1 c_cookie=17438000045228121599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbf577fe640 0 client.18975 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 >> 10.20.193.28:0/4239705511 conn(0x563cf9d5a1c0 msgr2=0x563cf9e55030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 shutdown_connections 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 1 -- 10.20.193.28:0/4239705511 wait complete. 2026-02-20T13:27:18.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.148+0000 7fbfa667de00 20 client.18975 trim_cache size 0 max 16384 2026-02-20T13:27:18.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:27:18.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:27:18.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:27:18.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:27:18.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf780b56e0 msgr2=0x7fbf780d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf780b56e0 0x7fbf780d5b90 secure :-1 s=READY pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf8c005fd0 tx=0x7fbf8c00a560 comp rx=0 tx=0).stop 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 msgr2=0x7fbf9c15d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 0x7fbf9c15d8b0 secure :-1 s=READY pgs=1115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf9800a980 tx=0x7fbf980039b0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/4088258990 shutdown_connections 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbf780b56e0 0x7fbf780d5b90 unknown :-1 s=CLOSED pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf9c150e50 0x7fbf9c15d8b0 unknown :-1 s=CLOSED pgs=1115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbf9c062a40 0x7fbf9c15ccb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 --2- 10.20.193.28:0/4088258990 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbf9c061510 0x7fbf9c15c660 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/4088258990 >> 10.20.193.28:0/4088258990 conn(0x7fbf9c0ea4c0 msgr2=0x7fbf9c10a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/4088258990 shutdown_connections 2026-02-20T13:27:18.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:18.149+0000 7fbfa2dd2640 1 -- 10.20.193.28:0/4088258990 wait complete. 2026-02-20T13:27:18.189 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:18.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 -- 10.20.193.28:0/317119281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b0113430 msgr2=0x7fb5b0173e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/317119281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b0113430 0x7fb5b0173e00 secure :-1 s=READY pgs=1119 gs=2 cs=0 l=1 c_cookie=16204502368857486316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a400a970 tx=0x7fb5a40301b0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 -- 10.20.193.28:0/317119281 shutdown_connections 2026-02-20T13:27:18.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/317119281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b0113430 0x7fb5b0173e00 unknown :-1 s=CLOSED pgs=1119 gs=2 cs=0 l=1 c_cookie=16204502368857486316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/317119281 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5b010dc30 0x7fb5b0112c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/317119281 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5b010d240 0x7fb5b010d610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 -- 10.20.193.28:0/317119281 >> 10.20.193.28:0/317119281 conn(0x7fb5b00eaad0 msgr2=0x7fb5b010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 -- 10.20.193.28:0/317119281 shutdown_connections 2026-02-20T13:27:18.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.366+0000 7fb5b4a79640 1 -- 10.20.193.28:0/317119281 wait complete. 2026-02-20T13:27:18.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.367+0000 7fb5b4a79640 1 Processor -- start 2026-02-20T13:27:18.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.367+0000 7fb5b4a79640 1 -- start start 2026-02-20T13:27:18.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.367+0000 7fb5b4a79640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b010d240 0x7fb5b00f56e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5b4a79640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5b010dc30 0x7fb5b0173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5b4a79640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5b0113430 0x7fb5b00f5de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5b4a79640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00faff0 con 0x7fb5b010d240 2026-02-20T13:27:18.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5b4a79640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00fb160 con 0x7fb5b010dc30 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5b4a79640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00fb320 con 0x7fb5b0113430 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5b0113430 0x7fb5b00f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5b0113430 0x7fb5b00f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40412/0 (socket says 10.20.193.28:40412) 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 -- 10.20.193.28:0/1579981392 learned_addr learned my addr 10.20.193.28:0/1579981392 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b010d240 0x7fb5b00f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5b010dc30 0x7fb5b0173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 -- 10.20.193.28:0/1579981392 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5b010dc30 msgr2=0x7fb5b0173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5b010dc30 0x7fb5b0173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 -- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b010d240 msgr2=0x7fb5b00f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b010d240 0x7fb5b00f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 -- 10.20.193.28:0/1579981392 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a400a590 con 0x7fb5b0113430 2026-02-20T13:27:18.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b010d240 0x7fb5b00f56e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.368+0000 7fb5affff640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5b0113430 0x7fb5b00f5de0 secure :-1 s=READY pgs=332 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a400a8c0 tx=0x7fb5a4003f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.369+0000 7fb5acff9640 1 -- 10.20.193.28:0/1579981392 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a403e070 con 0x7fb5b0113430 2026-02-20T13:27:18.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.369+0000 7fb5acff9640 1 -- 10.20.193.28:0/1579981392 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5a4003a90 con 0x7fb5b0113430 2026-02-20T13:27:18.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.369+0000 7fb5b4a79640 1 -- 10.20.193.28:0/1579981392 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b00fb5a0 con 0x7fb5b0113430 2026-02-20T13:27:18.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.369+0000 7fb5acff9640 1 -- 10.20.193.28:0/1579981392 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a4042850 con 0x7fb5b0113430 2026-02-20T13:27:18.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.369+0000 7fb5b4a79640 1 -- 10.20.193.28:0/1579981392 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b00fba10 con 0x7fb5b0113430 2026-02-20T13:27:18.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.371+0000 7fb5acff9640 1 -- 10.20.193.28:0/1579981392 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb5a404a060 con 0x7fb5b0113430 2026-02-20T13:27:18.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.373+0000 7fb5acff9640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5840b5750 0x7fb5840d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.373+0000 7fb5acff9640 1 -- 10.20.193.28:0/1579981392 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5a410c470 con 0x7fb5b0113430 2026-02-20T13:27:18.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.373+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5840b5750 0x7fb5840d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5840b5750 0x7fb5840d5c00 secure :-1 s=READY pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c004740 tx=0x7fb59c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5b7cfce00 1 Processor -- start 2026-02-20T13:27:18.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5b7cfce00 1 -- start start 2026-02-20T13:27:18.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfb360 0x5586aacfb730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfbc70 0x5586aad405e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 0x5586aad60f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5586aac11780 con 0x5586aacfbc70 2026-02-20T13:27:18.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5586aac0d4b0 con 0x5586aacfb360 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5586aac07450 con 0x5586aad40b20 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5af7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfb360 0x5586aacfb730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5af7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfb360 0x5586aacfb730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41218/0 (socket says 10.20.193.28:41218) 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5af7fe640 1 -- 10.20.193.28:0/849801469 learned_addr learned my addr 10.20.193.28:0/849801469 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.374+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfbc70 0x5586aad405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5affff640 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 0x5586aad60f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5af7fe640 1 -- 10.20.193.28:0/849801469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 msgr2=0x5586aad60f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 0x5586aad60f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5af7fe640 1 -- 10.20.193.28:0/849801469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfbc70 msgr2=0x5586aad405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfbc70 0x5586aad405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5af7fe640 1 -- 10.20.193.28:0/849801469 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586aabb2d10 con 0x5586aacfb360 2026-02-20T13:27:18.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfbc70 0x5586aad405e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfb360 0x5586aacfb730 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=9305201465723773298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c011490 tx=0x7fb59c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8122b76e97e8e172 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb573fff640 1 -- 10.20.193.28:0/849801469 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb59c004a70 con 0x5586aacfb360 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb573fff640 1 -- 10.20.193.28:0/849801469 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb59c005500 con 0x5586aacfb360 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb573fff640 1 -- 10.20.193.28:0/849801469 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb59c01aba0 con 0x5586aacfb360 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/849801469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfb360 msgr2=0x5586aacfb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfb360 0x5586aacfb730 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=9305201465723773298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c011490 tx=0x7fb59c014000 comp rx=0 tx=0).stop 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/849801469 shutdown_connections 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfbc70 0x5586aad405e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 0x5586aad60f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.375+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/849801469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfb360 0x5586aacfb730 unknown :-1 s=CLOSED pgs=397 gs=1 cs=0 l=1 c_cookie=9305201465723773298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.376+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/849801469 >> 10.20.193.28:0/849801469 conn(0x5586aacd9860 msgr2=0x5586aacf9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.376+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/849801469 shutdown_connections 2026-02-20T13:27:18.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.376+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/849801469 wait complete. 2026-02-20T13:27:18.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.377+0000 7fb5b7cfce00 1 -- start start 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.377+0000 7fb5b7cfce00 1 Processor -- start 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad58750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad58c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad5dc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5586aad5e1c0 con 0x5586aad40b20 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5586aad5e330 con 0x5586aacfbc70 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5586aad5e4f0 con 0x5586aacfb360 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5af7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad58750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5af7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad58750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40438/0 (socket says 10.20.193.28:40438) 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5af7fe640 1 -- 10.20.193.28:0/2139805546 learned_addr learned my addr 10.20.193.28:0/2139805546 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad58c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.378+0000 7fb5affff640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad5dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5aeffd640 1 -- 10.20.193.28:0/2139805546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 msgr2=0x5586aad58750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad58750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5aeffd640 1 -- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 msgr2=0x5586aad5dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad5dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5aeffd640 1 -- 10.20.193.28:0/2139805546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586aab8b3c0 con 0x5586aacfbc70 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5affff640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad5dc80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad58750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad58c90 secure :-1 s=READY pgs=398 gs=2 cs=0 l=1 c_cookie=18400872516983217331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a0004740 tx=0x7fb5a0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5d080fec085cb3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5717fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5717fa640 1 -- 10.20.193.28:0/2139805546 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a0004850 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5717fa640 1 -- 10.20.193.28:0/2139805546 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5a0004e90 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5717fa640 1 -- 10.20.193.28:0/2139805546 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a0010a80 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb59c003d20 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5b7cfce00 10 client.28943 _ll_register_callbacks cb 0x5586aab88a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.379+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5586aa89d6f0 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5717fa640 1 -- 10.20.193.28:0/2139805546 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5a0010c10 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5717fa640 1 -- 10.20.193.28:0/2139805546 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb5a0010df0 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5b7cfce00 10 client.28943 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5586aab9d0e0 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5717fa640 1 -- 10.20.193.28:0/2139805546 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb5a00049b0 con 0x5586aacfbc70 2026-02-20T13:27:18.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5b7cfce00 10 client.28943 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5b7cfce00 10 client.28943 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5b7cfce00 20 client.28943 populate_metadata read hostname 'trial028' 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5586aad60d00 0x5586aad3e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5b7cfce00 4 client.28943 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586aaba9f80 con 0x5586aad60d00 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.380+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5586aad60d00 0x5586aad3e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.381+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5586aad60d00 0x5586aad3e8a0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=15999799232614273300 s_cookie=16501933309789152943 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=de0ab4a1a98a9114 server_cookie=e502a4ea0d2b26af in_seq=0 out_seq=0 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.381+0000 7fb5717fa640 10 client.28943 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.381+0000 7fb5717fa640 1 -- 10.20.193.28:0/2139805546 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5586aaba9f80 con 0x5586aad60d00 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.381+0000 7fb5717fa640 10 client.28943 handle_command_reply: tid=0 2026-02-20T13:27:18.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.381+0000 7fb5b7cfce00 1 client.28943 shutdown 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.381+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 msgr2=0x5586aad58c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.381+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad58c90 secure :-1 s=READY pgs=398 gs=2 cs=0 l=1 c_cookie=18400872516983217331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a0004740 tx=0x7fb5a0009920 comp rx=0 tx=0).stop 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 shutdown_connections 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5586aad60d00 0x5586aad3e8a0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=15999799232614273300 s_cookie=16501933309789152943 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad5dc80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad58c90 unknown :-1 s=CLOSED pgs=398 gs=2 cs=0 l=1 c_cookie=18400872516983217331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5717fa640 0 client.28943 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/2139805546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad58750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 >> 10.20.193.28:0/2139805546 conn(0x5586aacd9860 msgr2=0x5586aacf9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 shutdown_connections 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/2139805546 wait complete. 2026-02-20T13:27:18.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.382+0000 7fb5b7cfce00 20 client.28943 trim_cache size 0 max 16384 2026-02-20T13:27:18.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.389+0000 7fb5b7cfce00 1 Processor -- start 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.389+0000 7fb5b7cfce00 1 -- start start 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.389+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad3ff10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.389+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad40450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.389+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad3b780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.389+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5586aac05080 con 0x5586aad40b20 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.389+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5586aa8c5700 con 0x5586aacfbc70 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.389+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5586aad4d080 con 0x5586aacfb360 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5aeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad40450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5aeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad40450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41234/0 (socket says 10.20.193.28:41234) 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5aeffd640 1 -- 10.20.193.28:0/3143906988 learned_addr learned my addr 10.20.193.28:0/3143906988 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad3ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5affff640 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad3b780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5af7fe640 1 -- 10.20.193.28:0/3143906988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 msgr2=0x5586aad40450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad40450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5af7fe640 1 -- 10.20.193.28:0/3143906988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 msgr2=0x5586aad3b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad3b780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5af7fe640 1 -- 10.20.193.28:0/3143906988 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586aab97b60 con 0x5586aacfb360 2026-02-20T13:27:18.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad40450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.390+0000 7fb5affff640 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad3b780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad3ff10 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=5096830130734896935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c009e60 tx=0x7fb59c01a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46bb93ffeef61727 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5737fe640 1 -- 10.20.193.28:0/3143906988 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb59c005670 con 0x5586aacfb360 2026-02-20T13:27:18.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5737fe640 1 -- 10.20.193.28:0/3143906988 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb59c01aaa0 con 0x5586aacfb360 2026-02-20T13:27:18.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5737fe640 1 -- 10.20.193.28:0/3143906988 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb59c030690 con 0x5586aacfb360 2026-02-20T13:27:18.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/3143906988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 msgr2=0x5586aad3ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad3ff10 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=5096830130734896935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c009e60 tx=0x7fb59c01a650 comp rx=0 tx=0).stop 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/3143906988 shutdown_connections 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aad40b20 0x5586aad3b780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aad40450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/3143906988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aacfb360 0x5586aad3ff10 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=5096830130734896935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/3143906988 >> 10.20.193.28:0/3143906988 conn(0x5586aacd9860 msgr2=0x5586aad42f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/3143906988 shutdown_connections 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.391+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/3143906988 wait complete. 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5b7cfce00 1 -- start start 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5b7cfce00 1 Processor -- start 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfb360 0x5586aacdf780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aacdaf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5b7cfce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 0x5586aacdb4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5586aac69ae0 con 0x5586aacfb360 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5586aacdbbf0 con 0x5586aacfbc70 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5b7cfce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5586aacdbdb0 con 0x5586aad40b20 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5aeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aacdaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5aeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aacdaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41238/0 (socket says 10.20.193.28:41238) 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5aeffd640 1 -- 10.20.193.28:0/135083685 learned_addr learned my addr 10.20.193.28:0/135083685 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5affff640 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 0x5586aacdb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5aeffd640 1 -- 10.20.193.28:0/135083685 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 msgr2=0x5586aacdb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 0x5586aacdb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.392+0000 7fb5aeffd640 1 -- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfb360 msgr2=0x5586aacdf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfb360 0x5586aacdf780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfb360 0x5586aacdf780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5aeffd640 1 -- 10.20.193.28:0/135083685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b00fba10 con 0x5586aacfbc70 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfb360 0x5586aacdf780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5aeffd640 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aacdaf60 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=10182993089843957379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a0024af0 tx=0x7fb5a001b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d5142436e680e83 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5717fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5717fa640 1 -- 10.20.193.28:0/135083685 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a0035070 con 0x5586aacfbc70 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5717fa640 1 -- 10.20.193.28:0/135083685 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5586aa89d6f0 con 0x5586aacfbc70 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a0018040 con 0x5586aacfbc70 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5717fa640 1 -- 10.20.193.28:0/135083685 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a0025650 con 0x5586aacfbc70 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5b7cfce00 10 client.28949 _ll_register_callbacks cb 0x5586aab88a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb59c005500 con 0x5586aacfbc70 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5717fa640 1 -- 10.20.193.28:0/135083685 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5a00055a0 con 0x5586aacfbc70 2026-02-20T13:27:18.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5717fa640 1 -- 10.20.193.28:0/135083685 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb5a000e540 con 0x5586aacfbc70 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5b7cfce00 10 client.28949 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.393+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5586aabb2d10 con 0x5586aacfbc70 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5717fa640 1 -- 10.20.193.28:0/135083685 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb5a000ec50 con 0x5586aacfbc70 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5b7cfce00 10 client.28949 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5b7cfce00 10 client.28949 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5b7cfce00 20 client.28949 populate_metadata read hostname 'trial028' 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5586aad60d00 0x5586aae0e720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5b7cfce00 4 client.28949 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586aa89af40 con 0x5586aad60d00 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5586aad60d00 0x5586aae0e720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5af7fe640 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5586aad60d00 0x5586aae0e720 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=9520529175773803484 s_cookie=14577540363844223007 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=841fb6d7ebbd73dc server_cookie=ca4dd3b9cdda801f in_seq=0 out_seq=0 2026-02-20T13:27:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5717fa640 10 client.28949 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.394+0000 7fb5717fa640 1 -- 10.20.193.28:0/135083685 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586aa89af40 con 0x5586aad60d00 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5717fa640 10 client.28949 handle_command_reply: tid=0 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 client.28949 shutdown 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 msgr2=0x5586aacdaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aacdaf60 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=10182993089843957379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a0024af0 tx=0x7fb5a001b610 comp rx=0 tx=0).stop 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 shutdown_connections 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5586aad60d00 0x5586aae0e720 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=9520529175773803484 s_cookie=14577540363844223007 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5586aad40b20 0x5586aacdb4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5586aacfbc70 0x5586aacdaf60 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=10182993089843957379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 --2- 10.20.193.28:0/135083685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5586aacfb360 0x5586aacdf780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 >> 10.20.193.28:0/135083685 conn(0x5586aacd9860 msgr2=0x5586aad3eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5717fa640 0 client.28949 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:27:18.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 shutdown_connections 2026-02-20T13:27:18.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 1 -- 10.20.193.28:0/135083685 wait complete. 2026-02-20T13:27:18.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b7cfce00 20 client.28949 trim_cache size 0 max 16384 2026-02-20T13:27:18.404 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:18.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 -- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5840b5750 msgr2=0x7fb5840d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5840b5750 0x7fb5840d5c00 secure :-1 s=READY pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c004740 tx=0x7fb59c009310 comp rx=0 tx=0).stop 2026-02-20T13:27:18.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 -- 10.20.193.28:0/1579981392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5b0113430 msgr2=0x7fb5b00f5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5b0113430 0x7fb5b00f5de0 secure :-1 s=READY pgs=332 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a400a8c0 tx=0x7fb5a4003f70 comp rx=0 tx=0).stop 2026-02-20T13:27:18.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 -- 10.20.193.28:0/1579981392 shutdown_connections 2026-02-20T13:27:18.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5840b5750 0x7fb5840d5c00 unknown :-1 s=CLOSED pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5b0113430 0x7fb5b00f5de0 unknown :-1 s=CLOSED pgs=332 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5b010dc30 0x7fb5b0173d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 --2- 10.20.193.28:0/1579981392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5b010d240 0x7fb5b00f56e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.395+0000 7fb5b4a79640 1 -- 10.20.193.28:0/1579981392 >> 10.20.193.28:0/1579981392 conn(0x7fb5b00eaad0 msgr2=0x7fb5b0111380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.396+0000 7fb5b4a79640 1 -- 10.20.193.28:0/1579981392 shutdown_connections 2026-02-20T13:27:18.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.396+0000 7fb5b4a79640 1 -- 10.20.193.28:0/1579981392 wait complete. 2026-02-20T13:27:18.496 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:27:18.681 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:18.753 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:18 trial028 ceph-mon[37442]: pgmap v480: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:27:18.753 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:18 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3478573134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 -- 10.20.193.28:0/3026107660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc10f4b0 msgr2=0x7f22cc10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 --2- 10.20.193.28:0/3026107660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc10f4b0 0x7f22cc10f880 secure :-1 s=READY pgs=1120 gs=1 cs=0 l=1 c_cookie=5749553734374779558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc009950 tx=0x7f22bc02f190 comp rx=0 tx=0).stop 2026-02-20T13:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 -- 10.20.193.28:0/3026107660 shutdown_connections 2026-02-20T13:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 --2- 10.20.193.28:0/3026107660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f22cc1156a0 0x7f22cc176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 --2- 10.20.193.28:0/3026107660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f22cc10fea0 0x7f22cc114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 --2- 10.20.193.28:0/3026107660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc10f4b0 0x7f22cc10f880 unknown :-1 s=CLOSED pgs=1120 gs=1 cs=0 l=1 c_cookie=5749553734374779558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 -- 10.20.193.28:0/3026107660 >> 10.20.193.28:0/3026107660 conn(0x7f22cc0ecda0 msgr2=0x7f22cc10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 -- 10.20.193.28:0/3026107660 shutdown_connections 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.854+0000 7f22d255a640 1 -- 10.20.193.28:0/3026107660 wait complete. 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.855+0000 7f22d255a640 1 Processor -- start 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.855+0000 7f22d255a640 1 -- start start 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d255a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f22cc10f4b0 0x7f22cc11de40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d255a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f22cc10fea0 0x7f22cc11e380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d255a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc1156a0 0x7f22cc123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d255a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc123d20 con 0x7f22cc1156a0 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d255a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc123e90 con 0x7f22cc10fea0 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d255a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc124050 con 0x7f22cc10f4b0 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1d59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc1156a0 0x7f22cc123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f22cc10f4b0 0x7f22cc11de40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d0d57640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f22cc10fea0 0x7f22cc11e380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f22cc10f4b0 0x7f22cc11de40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40476/0 (socket says 10.20.193.28:40476) 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 -- 10.20.193.28:0/3870477393 learned_addr learned my addr 10.20.193.28:0/3870477393 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 -- 10.20.193.28:0/3870477393 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f22cc10fea0 msgr2=0x7f22cc11e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f22cc10fea0 0x7f22cc11e380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 -- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc1156a0 msgr2=0x7f22cc123700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc1156a0 0x7f22cc123700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 -- 10.20.193.28:0/3870477393 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc009570 con 0x7f22cc10f4b0 2026-02-20T13:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1d59640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc1156a0 0x7f22cc123700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.856+0000 7f22d1558640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f22cc10f4b0 0x7f22cc11de40 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc038820 tx=0x7f22bc0043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.857+0000 7f22ba7fc640 1 -- 10.20.193.28:0/3870477393 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22bc03d070 con 0x7f22cc10f4b0 2026-02-20T13:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.857+0000 7f22ba7fc640 1 -- 10.20.193.28:0/3870477393 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f22bc038920 con 0x7f22cc10f4b0 2026-02-20T13:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.857+0000 7f22ba7fc640 1 -- 10.20.193.28:0/3870477393 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22bc041960 con 0x7f22cc10f4b0 2026-02-20T13:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.857+0000 7f22d255a640 1 -- 10.20.193.28:0/3870477393 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22cc1242d0 con 0x7f22cc10f4b0 2026-02-20T13:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.857+0000 7f22d255a640 1 -- 10.20.193.28:0/3870477393 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22cc164a30 con 0x7f22cc10f4b0 2026-02-20T13:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.859+0000 7f22ba7fc640 1 -- 10.20.193.28:0/3870477393 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f22bc038a90 con 0x7f22cc10f4b0 2026-02-20T13:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.861+0000 7f22ba7fc640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f22a80b56e0 0x7f22a80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.861+0000 7f22ba7fc640 1 -- 10.20.193.28:0/3870477393 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f22bc10b1f0 con 0x7f22cc10f4b0 2026-02-20T13:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.861+0000 7f22d0d57640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f22a80b56e0 0x7f22a80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d0d57640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f22a80b56e0 0x7f22a80d5b90 secure :-1 s=READY pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22cc124790 tx=0x7f22c000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d57dde00 1 Processor -- start 2026-02-20T13:27:18.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d57dde00 1 -- start start 2026-02-20T13:27:18.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024a360 0x560f6024a730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6028f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f602aff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d57dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f60160780 con 0x560f6024a360 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d57dde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560f6015c4b0 con 0x560f6028fb20 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d57dde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560f60156450 con 0x560f6024ac70 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d0d57640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6028f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d0d57640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6028f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40488/0 (socket says 10.20.193.28:40488) 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d0d57640 1 -- 10.20.193.28:0/2123728362 learned_addr learned my addr 10.20.193.28:0/2123728362 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.862+0000 7f22d1d59640 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f602aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f22d1558640 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024a360 0x560f6024a730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f22d0d57640 1 -- 10.20.193.28:0/2123728362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 msgr2=0x560f602aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f22d0d57640 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f602aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f22d0d57640 1 -- 10.20.193.28:0/2123728362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024a360 msgr2=0x560f6024a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f22d0d57640 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024a360 0x560f6024a730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f22d0d57640 1 -- 10.20.193.28:0/2123728362 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f60101d10 con 0x560f6024ac70 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f22d1558640 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024a360 0x560f6024a730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f22d0d57640 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6028f5e0 secure :-1 s=READY pgs=335 gs=2 cs=0 l=1 c_cookie=3726843263401948002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22c0011440 tx=0x7f22c0013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b86833d0a17362 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f2299ce5640 1 -- 10.20.193.28:0/2123728362 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22c001e640 con 0x560f6024ac70 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f2299ce5640 1 -- 10.20.193.28:0/2123728362 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f22c0015070 con 0x560f6024ac70 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.863+0000 7f2299ce5640 1 -- 10.20.193.28:0/2123728362 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22c001ccd0 con 0x560f6024ac70 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 -- 10.20.193.28:0/2123728362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 msgr2=0x560f6028f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6028f5e0 secure :-1 s=READY pgs=335 gs=2 cs=0 l=1 c_cookie=3726843263401948002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22c0011440 tx=0x7f22c0013000 comp rx=0 tx=0).stop 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 -- 10.20.193.28:0/2123728362 shutdown_connections 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f602aff00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6028f5e0 unknown :-1 s=CLOSED pgs=335 gs=2 cs=0 l=1 c_cookie=3726843263401948002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 --2- 10.20.193.28:0/2123728362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024a360 0x560f6024a730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 -- 10.20.193.28:0/2123728362 >> 10.20.193.28:0/2123728362 conn(0x560f60228860 msgr2=0x560f60248c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 -- 10.20.193.28:0/2123728362 shutdown_connections 2026-02-20T13:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.864+0000 7f22d57dde00 1 -- 10.20.193.28:0/2123728362 wait complete. 2026-02-20T13:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.865+0000 7f22d57dde00 1 -- start start 2026-02-20T13:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.865+0000 7f22d57dde00 1 Processor -- start 2026-02-20T13:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.865+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6024a360 0x560f6024e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.865+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6024ee80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.865+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6028fb20 0x560f6024d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.865+0000 7f22d57dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f6024dca0 con 0x560f6028fb20 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.865+0000 7f22d57dde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560f6024de10 con 0x560f6024a360 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.865+0000 7f22d57dde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560f6024dfd0 con 0x560f6024ac70 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6024a360 0x560f6024e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6024a360 0x560f6024e940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41282/0 (socket says 10.20.193.28:41282) 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 -- 10.20.193.28:0/1910531019 learned_addr learned my addr 10.20.193.28:0/1910531019 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d0d57640 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6024ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1d59640 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6028fb20 0x560f6024d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 -- 10.20.193.28:0/1910531019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 msgr2=0x560f6024ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6024ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 -- 10.20.193.28:0/1910531019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6028fb20 msgr2=0x560f6024d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6028fb20 0x560f6024d760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 -- 10.20.193.28:0/1910531019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f600da3c0 con 0x560f6024a360 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1d59640 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6028fb20 0x560f6024d760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f22d1558640 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6024a360 0x560f6024e940 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=7877575080633647359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc041ae0 tx=0x7f22bc041410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d52c4cc74a340ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f2286ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.866+0000 7f2286ffd640 1 -- 10.20.193.28:0/1910531019 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22bc0d7070 con 0x560f6024a360 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c000bd10 con 0x560f6024a360 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f2286ffd640 1 -- 10.20.193.28:0/1910531019 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f22bc0d0e40 con 0x560f6024a360 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f2286ffd640 1 -- 10.20.193.28:0/1910531019 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22bc02fc70 con 0x560f6024a360 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 10 client.28961 _ll_register_callbacks cb 0x560f600d7a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f5fdec6f0 con 0x560f6024a360 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f2286ffd640 1 -- 10.20.193.28:0/1910531019 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f22bc0d0c10 con 0x560f6024a360 2026-02-20T13:27:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f2286ffd640 1 -- 10.20.193.28:0/1910531019 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f22bc0cd020 con 0x560f6024a360 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 10 client.28961 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560f600ec0e0 con 0x560f6024a360 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f2286ffd640 1 -- 10.20.193.28:0/1910531019 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f22bc0cd240 con 0x560f6024a360 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 10 client.28961 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 10 client.28961 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 20 client.28961 populate_metadata read hostname 'trial028' 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560f60275af0 0x560f60275f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 4 client.28961 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f600f8f80 con 0x560f60275af0 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.867+0000 7f22d0d57640 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560f60275af0 0x560f60275f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.868+0000 7f22d0d57640 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560f60275af0 0x560f60275f90 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=11758984755722246182 s_cookie=7519705078076591729 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a3304e55640ed826 server_cookie=685b5bed6a74ce71 in_seq=0 out_seq=0 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.868+0000 7f2286ffd640 10 client.28961 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.868+0000 7f2286ffd640 1 -- 10.20.193.28:0/1910531019 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560f600f8f80 con 0x560f60275af0 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.868+0000 7f2286ffd640 10 client.28961 handle_command_reply: tid=0 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.868+0000 7f22d57dde00 1 client.28961 shutdown 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6024a360 msgr2=0x560f6024e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6024a360 0x560f6024e940 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=7877575080633647359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc041ae0 tx=0x7f22bc041410 comp rx=0 tx=0).stop 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 shutdown_connections 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560f60275af0 0x560f60275f90 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=11758984755722246182 s_cookie=7519705078076591729 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6028fb20 0x560f6024d760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024ac70 0x560f6024ee80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1910531019 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6024a360 0x560f6024e940 unknown :-1 s=CLOSED pgs=400 gs=1 cs=0 l=1 c_cookie=7877575080633647359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f2286ffd640 0 client.28961 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:27:18.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 >> 10.20.193.28:0/1910531019 conn(0x560f60228860 msgr2=0x560f60248c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 shutdown_connections 2026-02-20T13:27:18.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 1 -- 10.20.193.28:0/1910531019 wait complete. 2026-02-20T13:27:18.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.869+0000 7f22d57dde00 20 client.28961 trim_cache size 0 max 16384 2026-02-20T13:27:18.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d57dde00 1 Processor -- start 2026-02-20T13:27:18.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d57dde00 1 -- start start 2026-02-20T13:27:18.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f60249d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f6024e790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d1558640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f60249d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d1558640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f60249d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40516/0 (socket says 10.20.193.28:40516) 2026-02-20T13:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f6024ecd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d57dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f60154080 con 0x560f6024ac70 2026-02-20T13:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d57dde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560f5fe14700 con 0x560f6028fb20 2026-02-20T13:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d57dde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560f602a8ea0 con 0x560f6024a360 2026-02-20T13:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d0d57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f6024e790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d0d57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f6024e790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41620/0 (socket says 10.20.193.28:41620) 2026-02-20T13:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.876+0000 7f22d0d57640 1 -- 10.20.193.28:0/1806077389 learned_addr learned my addr 10.20.193.28:0/1806077389 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d1558640 1 -- 10.20.193.28:0/1806077389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 msgr2=0x560f6024ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d1558640 1 --2- 10.20.193.28:0/1806077389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f6024ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d1558640 1 -- 10.20.193.28:0/1806077389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 msgr2=0x560f6024e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d1558640 1 --2- 10.20.193.28:0/1806077389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f6024e790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d1558640 1 -- 10.20.193.28:0/1806077389 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f600e6b60 con 0x560f6024a360 2026-02-20T13:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d1558640 1 --2- 10.20.193.28:0/1806077389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f60249d40 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=9010574200451173433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc0d0650 tx=0x7f22bc093000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0bfd7ec8310c39 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22994e4640 1 -- 10.20.193.28:0/1806077389 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22bc0d7040 con 0x560f6024a360 2026-02-20T13:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22994e4640 1 -- 10.20.193.28:0/1806077389 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f22bc0ed030 con 0x560f6024a360 2026-02-20T13:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22994e4640 1 -- 10.20.193.28:0/1806077389 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22bc0d72b0 con 0x560f6024a360 2026-02-20T13:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d57dde00 1 -- 10.20.193.28:0/1806077389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 msgr2=0x560f60249d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1806077389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f60249d40 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=9010574200451173433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc0d0650 tx=0x7f22bc093000 comp rx=0 tx=0).stop 2026-02-20T13:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d57dde00 1 -- 10.20.193.28:0/1806077389 shutdown_connections 2026-02-20T13:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1806077389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f6024e790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1806077389 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f6024ecd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d57dde00 1 --2- 10.20.193.28:0/1806077389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f60249d40 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=9010574200451173433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.877+0000 7f22d57dde00 1 -- 10.20.193.28:0/1806077389 >> 10.20.193.28:0/1806077389 conn(0x560f60228860 msgr2=0x560f602ad690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.878+0000 7f22d57dde00 1 -- 10.20.193.28:0/1806077389 shutdown_connections 2026-02-20T13:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.878+0000 7f22d57dde00 1 -- 10.20.193.28:0/1806077389 wait complete. 2026-02-20T13:27:18.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.878+0000 7f22d57dde00 1 -- start start 2026-02-20T13:27:18.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.878+0000 7f22d57dde00 1 Processor -- start 2026-02-20T13:27:18.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f602887d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f60284cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d57dde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f60285200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d57dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f602a8ea0 con 0x560f6024ac70 2026-02-20T13:27:18.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d57dde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560f60154080 con 0x560f6028fb20 2026-02-20T13:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d57dde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560f60285740 con 0x560f6024a360 2026-02-20T13:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d1558640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f602887d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d1558640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f602887d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40532/0 (socket says 10.20.193.28:40532) 2026-02-20T13:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d1558640 1 -- 10.20.193.28:0/194195935 learned_addr learned my addr 10.20.193.28:0/194195935 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d0d57640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f60284cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.879+0000 7f22d1d59640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f60285200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f22d1558640 1 -- 10.20.193.28:0/194195935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 msgr2=0x560f60285200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f22d1558640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f60285200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f22d1558640 1 -- 10.20.193.28:0/194195935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 msgr2=0x560f60284cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f22d1558640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f60284cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f22d1558640 1 -- 10.20.193.28:0/194195935 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f600da6f0 con 0x560f6024a360 2026-02-20T13:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f22d0d57640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f60284cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f22d1d59640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f60285200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f22d1558640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f602887d0 secure :-1 s=READY pgs=337 gs=2 cs=0 l=1 c_cookie=2137140453528033446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc009350 tx=0x7f22bc041410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1da8a5eb5fa7d8a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.880+0000 7f2286ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f2286ffd640 1 -- 10.20.193.28:0/194195935 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22bc0d8460 con 0x560f6024a360 2026-02-20T13:27:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f2286ffd640 1 -- 10.20.193.28:0/194195935 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560f5fdec6f0 con 0x560f6024a360 2026-02-20T13:27:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f2286ffd640 1 -- 10.20.193.28:0/194195935 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22bc0d0bb0 con 0x560f6024a360 2026-02-20T13:27:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f600ec0e0 con 0x560f6024a360 2026-02-20T13:27:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f2286ffd640 1 -- 10.20.193.28:0/194195935 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f22bc0dc6d0 con 0x560f6024a360 2026-02-20T13:27:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f2286ffd640 10 client.28867 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 10 client.28867 _ll_register_callbacks cb 0x560f600d7a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:18.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22c0015070 con 0x560f6024a360 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f2286ffd640 1 -- 10.20.193.28:0/194195935 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f22bc0f5070 con 0x560f6024a360 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 10 client.28867 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560f600ec340 con 0x560f6024a360 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f2286ffd640 1 -- 10.20.193.28:0/194195935 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f22bc0b4060 con 0x560f6024a360 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 10 client.28867 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 10 client.28867 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 20 client.28867 populate_metadata read hostname 'trial028' 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560f603457e0 0x560f60365c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 4 client.28867 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.881+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f5fde9f40 con 0x560f603457e0 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.882+0000 7f22d0d57640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560f603457e0 0x560f60365c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.882+0000 7f22d0d57640 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560f603457e0 0x560f60365c60 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=9737039896578482240 s_cookie=6818576189300465815 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8720ea32675de040 server_cookie=5ea072eaf530e097 in_seq=0 out_seq=0 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.882+0000 7f2286ffd640 10 client.28867 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.882+0000 7f2286ffd640 1 -- 10.20.193.28:0/194195935 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f5fde9f40 con 0x560f603457e0 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.882+0000 7f2286ffd640 10 client.28867 handle_command_reply: tid=0 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.882+0000 7f22d57dde00 1 client.28867 shutdown 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.882+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 msgr2=0x560f602887d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.882+0000 7f22d57dde00 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f602887d0 secure :-1 s=READY pgs=337 gs=2 cs=0 l=1 c_cookie=2137140453528033446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc009350 tx=0x7f22bc041410 comp rx=0 tx=0).stop 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 shutdown_connections 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560f603457e0 0x560f60365c60 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=9737039896578482240 s_cookie=6818576189300465815 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f6024ac70 0x560f60284cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f6028fb20 0x560f60285200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 1 --2- 10.20.193.28:0/194195935 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f6024a360 0x560f602887d0 unknown :-1 s=CLOSED pgs=337 gs=2 cs=0 l=1 c_cookie=2137140453528033446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f2286ffd640 0 client.28867 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 >> 10.20.193.28:0/194195935 conn(0x560f60228860 msgr2=0x560f6024e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 shutdown_connections 2026-02-20T13:27:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 1 -- 10.20.193.28:0/194195935 wait complete. 2026-02-20T13:27:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d57dde00 20 client.28867 trim_cache size 0 max 16384 2026-02-20T13:27:18.897 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 -- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f22a80b56e0 msgr2=0x7f22a80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f22a80b56e0 0x7f22a80d5b90 secure :-1 s=READY pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22cc124790 tx=0x7f22c000b410 comp rx=0 tx=0).stop 2026-02-20T13:27:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 -- 10.20.193.28:0/3870477393 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f22cc10f4b0 msgr2=0x7f22cc11de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:18.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f22cc10f4b0 0x7f22cc11de40 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22bc038820 tx=0x7f22bc0043d0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 -- 10.20.193.28:0/3870477393 shutdown_connections 2026-02-20T13:27:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f22a80b56e0 0x7f22a80d5b90 unknown :-1 s=CLOSED pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22cc1156a0 0x7f22cc123700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f22cc10fea0 0x7f22cc11e380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 --2- 10.20.193.28:0/3870477393 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f22cc10f4b0 0x7f22cc11de40 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 -- 10.20.193.28:0/3870477393 >> 10.20.193.28:0/3870477393 conn(0x7f22cc0ecda0 msgr2=0x7f22cc10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.883+0000 7f22d255a640 1 -- 10.20.193.28:0/3870477393 shutdown_connections 2026-02-20T13:27:18.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:18.884+0000 7f22d255a640 1 -- 10.20.193.28:0/3870477393 wait complete. 2026-02-20T13:27:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:18 trial127 ceph-mon[43817]: pgmap v480: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:27:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:18 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3478573134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:18.983 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:27:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:18 trial034 ceph-mon[43332]: pgmap v480: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2026-02-20T13:27:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:18 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3478573134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:19.168 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 -- 10.20.193.28:0/3642657012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9b41157e0 msgr2=0x7fa9b41761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/3642657012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9b41157e0 0x7fa9b41761b0 secure :-1 s=READY pgs=1121 gs=2 cs=0 l=1 c_cookie=13400807682916223221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a800aa30 tx=0x7fa9a8030290 comp rx=0 tx=0).stop 2026-02-20T13:27:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 -- 10.20.193.28:0/3642657012 shutdown_connections 2026-02-20T13:27:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/3642657012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9b41157e0 0x7fa9b41761b0 unknown :-1 s=CLOSED pgs=1121 gs=2 cs=0 l=1 c_cookie=13400807682916223221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/3642657012 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9b410ffe0 0x7fa9b4115030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/3642657012 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9b410f5f0 0x7fa9b410f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 -- 10.20.193.28:0/3642657012 >> 10.20.193.28:0/3642657012 conn(0x7fa9b40ecea0 msgr2=0x7fa9b410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 -- 10.20.193.28:0/3642657012 shutdown_connections 2026-02-20T13:27:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.353+0000 7fa9ba97c640 1 -- 10.20.193.28:0/3642657012 wait complete. 2026-02-20T13:27:19.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9ba97c640 1 Processor -- start 2026-02-20T13:27:19.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9ba97c640 1 -- start start 2026-02-20T13:27:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9ba97c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9b410f5f0 0x7fa9b411d510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9ba97c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9b410ffe0 0x7fa9b411da50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9ba97c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9b41157e0 0x7fa9b4122dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9ba97c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b41233f0 con 0x7fa9b41157e0 2026-02-20T13:27:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9ba97c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b4123560 con 0x7fa9b410ffe0 2026-02-20T13:27:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9ba97c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b4123720 con 0x7fa9b410f5f0 2026-02-20T13:27:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9b37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9b410ffe0 0x7fa9b411da50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9b37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9b410ffe0 0x7fa9b411da50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41312/0 (socket says 10.20.193.28:41312) 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9b37fe640 1 -- 10.20.193.28:0/233156303 learned_addr learned my addr 10.20.193.28:0/233156303 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9b410f5f0 0x7fa9b411d510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.354+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9b41157e0 0x7fa9b4122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b37fe640 1 -- 10.20.193.28:0/233156303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9b410f5f0 msgr2=0x7fa9b411d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9b410f5f0 0x7fa9b411d510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b37fe640 1 -- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9b41157e0 msgr2=0x7fa9b4122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9b41157e0 0x7fa9b4122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b37fe640 1 -- 10.20.193.28:0/233156303 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a40094b0 con 0x7fa9b410ffe0 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9b410ffe0 0x7fa9b411da50 secure :-1 s=READY pgs=401 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a4009fd0 tx=0x7fa9a4002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b17fa640 1 -- 10.20.193.28:0/233156303 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a400ed60 con 0x7fa9b410ffe0 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b17fa640 1 -- 10.20.193.28:0/233156303 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9a4002e20 con 0x7fa9b410ffe0 2026-02-20T13:27:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9b17fa640 1 -- 10.20.193.28:0/233156303 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a4018950 con 0x7fa9b410ffe0 2026-02-20T13:27:19.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9ba97c640 1 -- 10.20.193.28:0/233156303 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a800a650 con 0x7fa9b410ffe0 2026-02-20T13:27:19.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.355+0000 7fa9ba97c640 1 -- 10.20.193.28:0/233156303 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b4163f60 con 0x7fa9b410ffe0 2026-02-20T13:27:19.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.358+0000 7fa9b17fa640 1 -- 10.20.193.28:0/233156303 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa9a4016020 con 0x7fa9b410ffe0 2026-02-20T13:27:19.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.360+0000 7fa9b17fa640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa9880b56e0 0x7fa9880d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.360+0000 7fa9b17fa640 1 -- 10.20.193.28:0/233156303 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa9a40e6e10 con 0x7fa9b410ffe0 2026-02-20T13:27:19.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.360+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa9880b56e0 0x7fa9880d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.360+0000 7fa9bc976e00 1 Processor -- start 2026-02-20T13:27:19.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.360+0000 7fa9bc976e00 1 -- start start 2026-02-20T13:27:19.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa9880b56e0 0x7fa9880d5b90 secure :-1 s=READY pgs=489 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a0004740 tx=0x7fa9a0004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861360 0x562fa2861730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28a65e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c6f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fa2777780 con 0x562fa2861360 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fa27734b0 con 0x562fa2861c70 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fa276d450 con 0x562fa28a6b20 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b8ef2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b8ef2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40556/0 (socket says 10.20.193.28:40556) 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b8ef2640 1 -- 10.20.193.28:0/1176668734 learned_addr learned my addr 10.20.193.28:0/1176668734 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861360 0x562fa2861730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b8ef2640 1 -- 10.20.193.28:0/1176668734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 msgr2=0x562fa28a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b8ef2640 1 -- 10.20.193.28:0/1176668734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861360 msgr2=0x562fa2861730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861360 0x562fa2861730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.361+0000 7fa9b8ef2640 1 -- 10.20.193.28:0/1176668734 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa2718d10 con 0x562fa28a6b20 2026-02-20T13:27:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c6f00 secure :-1 s=READY pgs=338 gs=2 cs=0 l=1 c_cookie=18144893241835523515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a8006db0 tx=0x7fa9a8006eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbcf9c4486fe0dbb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa984ce3640 1 -- 10.20.193.28:0/1176668734 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a803f070 con 0x562fa28a6b20 2026-02-20T13:27:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa984ce3640 1 -- 10.20.193.28:0/1176668734 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9a8030af0 con 0x562fa28a6b20 2026-02-20T13:27:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa984ce3640 1 -- 10.20.193.28:0/1176668734 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a80060d0 con 0x562fa28a6b20 2026-02-20T13:27:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa9bc976e00 1 -- 10.20.193.28:0/1176668734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 msgr2=0x562fa28c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c6f00 secure :-1 s=READY pgs=338 gs=2 cs=0 l=1 c_cookie=18144893241835523515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a8006db0 tx=0x7fa9a8006eb0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa9bc976e00 1 -- 10.20.193.28:0/1176668734 shutdown_connections 2026-02-20T13:27:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c6f00 unknown :-1 s=CLOSED pgs=338 gs=2 cs=0 l=1 c_cookie=18144893241835523515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28a65e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/1176668734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861360 0x562fa2861730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.362+0000 7fa9bc976e00 1 -- 10.20.193.28:0/1176668734 >> 10.20.193.28:0/1176668734 conn(0x562fa283f860 msgr2=0x562fa285fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.363+0000 7fa9bc976e00 1 -- 10.20.193.28:0/1176668734 shutdown_connections 2026-02-20T13:27:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.363+0000 7fa9bc976e00 1 -- 10.20.193.28:0/1176668734 wait complete. 2026-02-20T13:27:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.364+0000 7fa9bc976e00 1 -- start start 2026-02-20T13:27:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.364+0000 7fa9bc976e00 1 Processor -- start 2026-02-20T13:27:19.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861360 0x562fa28be720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28bec60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c09f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fa28c0f60 con 0x562fa2861c70 2026-02-20T13:27:19.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fa28c10d0 con 0x562fa2861360 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fa28c1290 con 0x562fa28a6b20 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861360 0x562fa28be720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861360 0x562fa28be720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41326/0 (socket says 10.20.193.28:41326) 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 -- 10.20.193.28:0/2799702938 learned_addr learned my addr 10.20.193.28:0/2799702938 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 -- 10.20.193.28:0/2799702938 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 msgr2=0x562fa28c09f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c09f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 -- 10.20.193.28:0/2799702938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 msgr2=0x562fa28bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28bec60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 -- 10.20.193.28:0/2799702938 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa26f13c0 con 0x562fa2861360 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28bec60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:19.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861360 0x562fa28be720 secure :-1 s=READY pgs=402 gs=2 cs=0 l=1 c_cookie=6608147234876579110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a0011490 tx=0x7fa9a0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb4dae60e4c5d26 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.365+0000 7fa975ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa975ffb640 1 -- 10.20.193.28:0/2799702938 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a001f650 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa975ffb640 1 -- 10.20.193.28:0/2799702938 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9a0023070 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa975ffb640 1 -- 10.20.193.28:0/2799702938 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a001ece0 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b4176a20 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 10 client.28976 _ll_register_callbacks cb 0x562fa26eea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562fa24036f0 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa975ffb640 1 -- 10.20.193.28:0/2799702938 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa9a001ee70 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa975ffb640 1 -- 10.20.193.28:0/2799702938 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa9a001e440 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 10 client.28976 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562fa27030e0 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa975ffb640 1 -- 10.20.193.28:0/2799702938 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa9a001f7b0 con 0x562fa2861360 2026-02-20T13:27:19.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 10 client.28976 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 10 client.28976 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 20 client.28976 populate_metadata read hostname 'trial028' 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fa28c6d40 0x562fa28a48a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 4 client.28976 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.366+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fa270ff80 con 0x562fa28c6d40 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.367+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fa28c6d40 0x562fa28a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.367+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fa28c6d40 0x562fa28a48a0 crc :-1 s=READY pgs=58 gs=3 cs=0 l=0 c_cookie=12954701267640910179 s_cookie=8788967811113797008 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3c8582a7d0a0163 server_cookie=79f8afa883c7c590 in_seq=0 out_seq=0 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.367+0000 7fa975ffb640 10 client.28976 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa975ffb640 1 -- 10.20.193.28:0/2799702938 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562fa270ff80 con 0x562fa28c6d40 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa975ffb640 10 client.28976 handle_command_reply: tid=0 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 client.28976 shutdown 2026-02-20T13:27:19.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861360 msgr2=0x562fa28be720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861360 0x562fa28be720 secure :-1 s=READY pgs=402 gs=2 cs=0 l=1 c_cookie=6608147234876579110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a0011490 tx=0x7fa9a0004770 comp rx=0 tx=0).stop 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 shutdown_connections 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fa28c6d40 0x562fa28a48a0 crc :-1 s=READY pgs=58 gs=3 cs=0 l=0 c_cookie=12954701267640910179 s_cookie=8788967811113797008 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28bec60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa28a6b20 0x562fa28c09f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/2799702938 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861360 0x562fa28be720 unknown :-1 s=CLOSED pgs=402 gs=2 cs=0 l=1 c_cookie=6608147234876579110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa975ffb640 0 client.28976 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 >> 10.20.193.28:0/2799702938 conn(0x562fa283f860 msgr2=0x562fa285fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 shutdown_connections 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 1 -- 10.20.193.28:0/2799702938 wait complete. 2026-02-20T13:27:19.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.368+0000 7fa9bc976e00 20 client.28976 trim_cache size 0 max 16384 2026-02-20T13:27:19.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9bc976e00 1 Processor -- start 2026-02-20T13:27:19.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9bc976e00 1 -- start start 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28c0980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28bb8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa28a6b20 0x562fa28bbdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fa276b080 con 0x562fa28a6b20 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fa242b700 con 0x562fa2861c70 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fa2862040 con 0x562fa2861360 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9b37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28bb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9b37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28bb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41338/0 (socket says 10.20.193.28:41338) 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9b37fe640 1 -- 10.20.193.28:0/3115155399 learned_addr learned my addr 10.20.193.28:0/3115155399 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9b37fe640 1 -- 10.20.193.28:0/3115155399 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 msgr2=0x562fa28c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.376+0000 7fa9b37fe640 1 -- 10.20.193.28:0/3115155399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa28a6b20 msgr2=0x562fa28bbdf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:27:19.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa28a6b20 0x562fa28bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa28a6b20 0x562fa28bbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9b37fe640 1 -- 10.20.193.28:0/3115155399 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa26fdb60 con 0x562fa2861c70 2026-02-20T13:27:19.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa28a6b20 0x562fa28bbdf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:19.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9b37fe640 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28bb8b0 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=11389868748562236542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a40ad150 tx=0x7fa9a4002390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e10f147dc60047e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa977fff640 1 -- 10.20.193.28:0/3115155399 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a40b5470 con 0x562fa2861c70 2026-02-20T13:27:19.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa977fff640 1 -- 10.20.193.28:0/3115155399 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9a40b82b0 con 0x562fa2861c70 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa977fff640 1 -- 10.20.193.28:0/3115155399 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a40acd10 con 0x562fa2861c70 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3115155399 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 msgr2=0x562fa28bb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28bb8b0 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=11389868748562236542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a40ad150 tx=0x7fa9a4002390 comp rx=0 tx=0).stop 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3115155399 shutdown_connections 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa28a6b20 0x562fa28bbdf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa2861c70 0x562fa28bb8b0 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=11389868748562236542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3115155399 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28c0980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3115155399 >> 10.20.193.28:0/3115155399 conn(0x562fa283f860 msgr2=0x562fa28c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3115155399 shutdown_connections 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.377+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3115155399 wait complete. 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.378+0000 7fa9bc976e00 1 -- start start 2026-02-20T13:27:19.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.378+0000 7fa9bc976e00 1 Processor -- start 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28a1950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28a1ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9bc976e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa28a6b20 0x562fa28a0860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fa28c4c80 con 0x562fa2861c70 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fa28a0f60 con 0x562fa28a6b20 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9bc976e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fa28a1120 con 0x562fa2861360 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40582/0 (socket says 10.20.193.28:40582) 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b3fff640 1 -- 10.20.193.28:0/3516147457 learned_addr learned my addr 10.20.193.28:0/3516147457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa28a6b20 0x562fa28a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b8ef2640 1 -- 10.20.193.28:0/3516147457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 msgr2=0x562fa28a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b8ef2640 1 -- 10.20.193.28:0/3516147457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 msgr2=0x562fa28a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b8ef2640 1 -- 10.20.193.28:0/3516147457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa26f16f0 con 0x562fa28a6b20 2026-02-20T13:27:19.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.379+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28a1950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:19.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa9b8ef2640 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa28a6b20 0x562fa28a0860 secure :-1 s=READY pgs=404 gs=3 cs=0 l=1 c_cookie=12441431470748857147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a800a980 tx=0x7fa9a80069e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aca8d8014f59f33b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa975ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:19.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa975ffb640 1 -- 10.20.193.28:0/3516147457 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a804a070 con 0x562fa28a6b20 2026-02-20T13:27:19.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa975ffb640 1 -- 10.20.193.28:0/3516147457 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9a8039e40 con 0x562fa28a6b20 2026-02-20T13:27:19.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b4163f60 con 0x562fa28a6b20 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa975ffb640 1 -- 10.20.193.28:0/3516147457 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9a803f050 con 0x562fa28a6b20 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa975ffb640 1 -- 10.20.193.28:0/3516147457 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa9a8044860 con 0x562fa28a6b20 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa975ffb640 10 client.28982 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa9bc976e00 10 client.28982 _ll_register_callbacks cb 0x562fa26eea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9a8030af0 con 0x562fa28a6b20 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa975ffb640 1 -- 10.20.193.28:0/3516147457 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa9a8039960 con 0x562fa28a6b20 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa9bc976e00 10 client.28982 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562fa2703340 con 0x562fa28a6b20 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.380+0000 7fa975ffb640 1 -- 10.20.193.28:0/3516147457 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa9a8039b40 con 0x562fa28a6b20 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 10 client.28982 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 10 client.28982 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 20 client.28982 populate_metadata read hostname 'trial028' 2026-02-20T13:27:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fa2844f80 0x562fa2845420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 4 client.28982 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fa2400f40 con 0x562fa2844f80 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fa2844f80 0x562fa2845420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9b3fff640 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fa2844f80 0x562fa2845420 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=9023259103372736875 s_cookie=664938399384780289 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d390e58e4d7796b server_cookie=93a55f384d8be01 in_seq=0 out_seq=0 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa975ffb640 10 client.28982 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa975ffb640 1 -- 10.20.193.28:0/3516147457 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fa2400f40 con 0x562fa2844f80 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa975ffb640 10 client.28982 handle_command_reply: tid=0 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 1 client.28982 shutdown 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa28a6b20 msgr2=0x562fa28a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.381+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa28a6b20 0x562fa28a0860 secure :-1 s=READY pgs=404 gs=3 cs=0 l=1 c_cookie=12441431470748857147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a800a980 tx=0x7fa9a80069e0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 shutdown_connections 2026-02-20T13:27:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x562fa2844f80 0x562fa2845420 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=9023259103372736875 s_cookie=664938399384780289 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fa2861c70 0x562fa28a1ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fa28a6b20 0x562fa28a0860 unknown :-1 s=CLOSED pgs=404 gs=3 cs=0 l=1 c_cookie=12441431470748857147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 1 --2- 10.20.193.28:0/3516147457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fa2861360 0x562fa28a1950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa975ffb640 0 client.28982 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 >> 10.20.193.28:0/3516147457 conn(0x562fa283f860 msgr2=0x562fa28c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 shutdown_connections 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 1 -- 10.20.193.28:0/3516147457 wait complete. 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9bc976e00 20 client.28982 trim_cache size 0 max 16384 2026-02-20T13:27:19.390 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9ba97c640 1 -- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa9880b56e0 msgr2=0x7fa9880d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa9880b56e0 0x7fa9880d5b90 secure :-1 s=READY pgs=489 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a0004740 tx=0x7fa9a0004420 comp rx=0 tx=0).stop 2026-02-20T13:27:19.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9ba97c640 1 -- 10.20.193.28:0/233156303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9b410ffe0 msgr2=0x7fa9b411da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.382+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9b410ffe0 0x7fa9b411da50 secure :-1 s=READY pgs=401 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a4009fd0 tx=0x7fa9a4002bc0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.383+0000 7fa9ba97c640 1 -- 10.20.193.28:0/233156303 shutdown_connections 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.383+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa9880b56e0 0x7fa9880d5b90 unknown :-1 s=CLOSED pgs=489 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.383+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9b41157e0 0x7fa9b4122dd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.383+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9b410ffe0 0x7fa9b411da50 unknown :-1 s=CLOSED pgs=401 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.383+0000 7fa9ba97c640 1 --2- 10.20.193.28:0/233156303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9b410f5f0 0x7fa9b411d510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.383+0000 7fa9ba97c640 1 -- 10.20.193.28:0/233156303 >> 10.20.193.28:0/233156303 conn(0x7fa9b40ecea0 msgr2=0x7fa9b410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.383+0000 7fa9ba97c640 1 -- 10.20.193.28:0/233156303 shutdown_connections 2026-02-20T13:27:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.383+0000 7fa9ba97c640 1 -- 10.20.193.28:0/233156303 wait complete. 2026-02-20T13:27:19.483 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:27:19.668 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:19.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 -- 10.20.193.28:0/1718029898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010ffe0 msgr2=0x7f6920115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 --2- 10.20.193.28:0/1718029898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010ffe0 0x7f6920115030 secure :-1 s=READY pgs=1122 gs=1 cs=0 l=1 c_cookie=16480546043536349843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6914009890 tx=0x7f691402f120 comp rx=0 tx=0).stop 2026-02-20T13:27:19.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 -- 10.20.193.28:0/1718029898 shutdown_connections 2026-02-20T13:27:19.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 --2- 10.20.193.28:0/1718029898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010ffe0 0x7f6920115030 unknown :-1 s=CLOSED pgs=1122 gs=1 cs=0 l=1 c_cookie=16480546043536349843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 --2- 10.20.193.28:0/1718029898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f69201157e0 0x7f69201761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 --2- 10.20.193.28:0/1718029898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f692010f5f0 0x7f692010f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 -- 10.20.193.28:0/1718029898 >> 10.20.193.28:0/1718029898 conn(0x7f69200ecea0 msgr2=0x7f692010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 -- 10.20.193.28:0/1718029898 shutdown_connections 2026-02-20T13:27:19.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.840+0000 7f69279ef640 1 -- 10.20.193.28:0/1718029898 wait complete. 2026-02-20T13:27:19.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f69279ef640 1 Processor -- start 2026-02-20T13:27:19.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f69279ef640 1 -- start start 2026-02-20T13:27:19.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f69279ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010f5f0 0x7f69200f4f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f69279ef640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f692010ffe0 0x7f69201760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f69279ef640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f69201157e0 0x7f69200f5600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f69279ef640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f69200fa7c0 con 0x7f692010f5f0 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f69279ef640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f69200fa930 con 0x7f69201157e0 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f69279ef640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f69200faaf0 con 0x7f692010ffe0 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f6925764640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010f5f0 0x7f69200f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f6925764640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010f5f0 0x7f69200f4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41668/0 (socket says 10.20.193.28:41668) 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f6925764640 1 -- 10.20.193.28:0/2903771788 learned_addr learned my addr 10.20.193.28:0/2903771788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f6925f65640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f69201157e0 0x7f69200f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.841+0000 7f6924f63640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f692010ffe0 0x7f69201760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f6925764640 1 -- 10.20.193.28:0/2903771788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f692010ffe0 msgr2=0x7f69201760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f6925764640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f692010ffe0 0x7f69201760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f6925764640 1 -- 10.20.193.28:0/2903771788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f69201157e0 msgr2=0x7f69200f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f6925764640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f69201157e0 0x7f69200f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f6925764640 1 -- 10.20.193.28:0/2903771788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69100094b0 con 0x7f692010f5f0 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f6925764640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010f5f0 0x7f69200f4f00 secure :-1 s=READY pgs=1123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6910009fd0 tx=0x7f6910002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f690e7fc640 1 -- 10.20.193.28:0/2903771788 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691000eb50 con 0x7f692010f5f0 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f690e7fc640 1 -- 10.20.193.28:0/2903771788 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f691000ecb0 con 0x7f692010f5f0 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f690e7fc640 1 -- 10.20.193.28:0/2903771788 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69100188b0 con 0x7f692010f5f0 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f69279ef640 1 -- 10.20.193.28:0/2903771788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c00a650 con 0x7f692010f5f0 2026-02-20T13:27:19.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.842+0000 7f69279ef640 1 -- 10.20.193.28:0/2903771788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69140094b0 con 0x7f692010f5f0 2026-02-20T13:27:19.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.846+0000 7f690e7fc640 1 -- 10.20.193.28:0/2903771788 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6910016020 con 0x7f692010f5f0 2026-02-20T13:27:19.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.847+0000 7f690e7fc640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68fc0b5750 0x7f68fc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.847+0000 7f690e7fc640 1 -- 10.20.193.28:0/2903771788 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f69100e6c00 con 0x7f692010f5f0 2026-02-20T13:27:19.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.847+0000 7f6924f63640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68fc0b5750 0x7f68fc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.847+0000 7f69299e9e00 1 Processor -- start 2026-02-20T13:27:19.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f69299e9e00 1 -- start start 2026-02-20T13:27:19.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 0x5601a48e2730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2c70 0x5601a49275e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a4927b20 0x5601a4947f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f69299e9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5601a47f8780 con 0x5601a4927b20 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f69299e9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5601a47f44b0 con 0x5601a48e2360 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f69299e9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5601a47ee450 con 0x5601a48e2c70 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925764640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 0x5601a48e2730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925764640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 0x5601a48e2730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:41370/0 (socket says 10.20.193.28:41370) 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925764640 1 -- 10.20.193.28:0/3046933036 learned_addr learned my addr 10.20.193.28:0/3046933036 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925f65640 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a4927b20 0x5601a4947f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6924f63640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68fc0b5750 0x7f68fc0d5c00 secure :-1 s=READY pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69200fb850 tx=0x7f691403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6924f63640 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2c70 0x5601a49275e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925f65640 1 -- 10.20.193.28:0/3046933036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2c70 msgr2=0x5601a49275e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925f65640 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2c70 0x5601a49275e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925f65640 1 -- 10.20.193.28:0/3046933036 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 msgr2=0x5601a48e2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925f65640 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 0x5601a48e2730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.848+0000 7f6925f65640 1 -- 10.20.193.28:0/3046933036 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a4799d10 con 0x5601a4927b20 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f6925f65640 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a4927b20 0x5601a4947f00 secure :-1 s=READY pgs=1124 gs=2 cs=0 l=1 c_cookie=13451651364621946628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c006c10 tx=0x7f691c00ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baaddda56eb08f04 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f68edce5640 1 -- 10.20.193.28:0/3046933036 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c003d30 con 0x5601a4927b20 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f68edce5640 1 -- 10.20.193.28:0/3046933036 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f691c003e90 con 0x5601a4927b20 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f68edce5640 1 -- 10.20.193.28:0/3046933036 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c01b8a0 con 0x5601a4927b20 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 -- 10.20.193.28:0/3046933036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a4927b20 msgr2=0x5601a4947f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a4927b20 0x5601a4947f00 secure :-1 s=READY pgs=1124 gs=2 cs=0 l=1 c_cookie=13451651364621946628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c006c10 tx=0x7f691c00ac50 comp rx=0 tx=0).stop 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 -- 10.20.193.28:0/3046933036 shutdown_connections 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a4927b20 0x5601a4947f00 unknown :-1 s=CLOSED pgs=1124 gs=2 cs=0 l=1 c_cookie=13451651364621946628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2c70 0x5601a49275e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 --2- 10.20.193.28:0/3046933036 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 0x5601a48e2730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 -- 10.20.193.28:0/3046933036 >> 10.20.193.28:0/3046933036 conn(0x5601a48c0860 msgr2=0x5601a48e0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 -- 10.20.193.28:0/3046933036 shutdown_connections 2026-02-20T13:27:19.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.849+0000 7f69299e9e00 1 -- 10.20.193.28:0/3046933036 wait complete. 2026-02-20T13:27:19.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.850+0000 7f69299e9e00 1 -- start start 2026-02-20T13:27:19.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.850+0000 7f69299e9e00 1 Processor -- start 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 0x5601a493f720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493fc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a4927b20 0x5601a49419f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f69299e9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5601a4941f60 con 0x5601a48e2c70 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f69299e9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5601a49420d0 con 0x5601a48e2360 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f69299e9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5601a4942290 con 0x5601a4927b20 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f6925f65640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a4927b20 0x5601a49419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f6925f65640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a4927b20 0x5601a49419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40602/0 (socket says 10.20.193.28:40602) 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f6925f65640 1 -- 10.20.193.28:0/2232075061 learned_addr learned my addr 10.20.193.28:0/2232075061 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f6925f65640 1 -- 10.20.193.28:0/2232075061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 msgr2=0x5601a493f720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:27:19.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f6925f65640 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 0x5601a493f720 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.851+0000 7f6925f65640 1 -- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 msgr2=0x5601a493fc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f6924f63640 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f6925f65640 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f6925f65640 1 -- 10.20.193.28:0/2232075061 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a47723c0 con 0x5601a4927b20 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f6924f63640 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493fc60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f6925f65640 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a4927b20 0x5601a49419f0 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=14659369743320575629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c011c80 tx=0x7f691c01cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb708b1ce5bb6e8d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f68daffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f68daffd640 1 -- 10.20.193.28:0/2232075061 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c011df0 con 0x5601a4927b20 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f68daffd640 1 -- 10.20.193.28:0/2232075061 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f691c020040 con 0x5601a4927b20 2026-02-20T13:27:19.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f68daffd640 1 -- 10.20.193.28:0/2232075061 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c006040 con 0x5601a4927b20 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.852+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c005360 con 0x5601a4927b20 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f68daffd640 1 -- 10.20.193.28:0/2232075061 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f691c0061d0 con 0x5601a4927b20 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f68daffd640 10 client.28894 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 10 client.28894 _ll_register_callbacks cb 0x5601a476fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5601a44846f0 con 0x5601a4927b20 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f68daffd640 1 -- 10.20.193.28:0/2232075061 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f691c00aeb0 con 0x5601a4927b20 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 10 client.28894 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5601a47840e0 con 0x5601a4927b20 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f68daffd640 1 -- 10.20.193.28:0/2232075061 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f691c02c060 con 0x5601a4927b20 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 10 client.28894 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:19.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 10 client.28894 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 20 client.28894 populate_metadata read hostname 'trial028' 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5601a4947ba0 0x5601a49258a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 4 client.28894 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.853+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601a4790f80 con 0x5601a4947ba0 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.854+0000 7f6925764640 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5601a4947ba0 0x5601a49258a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.854+0000 7f6925764640 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5601a4947ba0 0x5601a49258a0 crc :-1 s=READY pgs=59 gs=3 cs=0 l=0 c_cookie=3218258739115988915 s_cookie=6583429442383523433 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2ca98d45ac4e17b3 server_cookie=5b5d0a32851e2e69 in_seq=0 out_seq=0 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.854+0000 7f68daffd640 10 client.28894 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.854+0000 7f68daffd640 1 -- 10.20.193.28:0/2232075061 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5601a4790f80 con 0x5601a4947ba0 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.854+0000 7f68daffd640 10 client.28894 handle_command_reply: tid=0 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.854+0000 7f69299e9e00 1 client.28894 shutdown 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a4927b20 msgr2=0x5601a49419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a4927b20 0x5601a49419f0 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=14659369743320575629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c011c80 tx=0x7f691c01cc70 comp rx=0 tx=0).stop 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 shutdown_connections 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5601a4947ba0 0x5601a49258a0 crc :-1 s=READY pgs=59 gs=3 cs=0 l=0 c_cookie=3218258739115988915 s_cookie=6583429442383523433 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493fc60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a4927b20 0x5601a49419f0 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=14659369743320575629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2232075061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a48e2360 0x5601a493f720 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f68daffd640 0 client.28894 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 >> 10.20.193.28:0/2232075061 conn(0x5601a48c0860 msgr2=0x5601a48e0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 shutdown_connections 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 1 -- 10.20.193.28:0/2232075061 wait complete. 2026-02-20T13:27:19.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.855+0000 7f69299e9e00 20 client.28894 trim_cache size 0 max 16384 2026-02-20T13:27:19.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f69299e9e00 1 Processor -- start 2026-02-20T13:27:19.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f69299e9e00 1 -- start start 2026-02-20T13:27:19.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4941980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493c8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 0x5601a493cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f69299e9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5601a47ec080 con 0x5601a48e2c70 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f69299e9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5601a44ac700 con 0x5601a4927b20 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f69299e9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5601a4946710 con 0x5601a48e2360 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6924f63640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6925f65640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 0x5601a493cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6925764640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4941980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6924f63640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41710/0 (socket says 10.20.193.28:41710) 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6924f63640 1 -- 10.20.193.28:0/2307149536 learned_addr learned my addr 10.20.193.28:0/2307149536 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6924f63640 1 -- 10.20.193.28:0/2307149536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 msgr2=0x5601a4941980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6924f63640 1 --2- 10.20.193.28:0/2307149536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4941980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6924f63640 1 -- 10.20.193.28:0/2307149536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 msgr2=0x5601a493cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.862+0000 7f6924f63640 1 --2- 10.20.193.28:0/2307149536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 0x5601a493cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f6924f63640 1 -- 10.20.193.28:0/2307149536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a477eb60 con 0x5601a48e2c70 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f6925764640 1 --2- 10.20.193.28:0/2307149536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4941980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f6924f63640 1 --2- 10.20.193.28:0/2307149536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493c8b0 secure :-1 s=READY pgs=1125 gs=2 cs=0 l=1 c_cookie=6807073846158422201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6914005c70 tx=0x7f6914040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e779599001ff0b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f68ed4e4640 1 -- 10.20.193.28:0/2307149536 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69140040c0 con 0x5601a48e2c70 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f68ed4e4640 1 -- 10.20.193.28:0/2307149536 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f691403e040 con 0x5601a48e2c70 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 -- 10.20.193.28:0/2307149536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 msgr2=0x5601a493c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2307149536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493c8b0 secure :-1 s=READY pgs=1125 gs=2 cs=0 l=1 c_cookie=6807073846158422201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6914005c70 tx=0x7f6914040000 comp rx=0 tx=0).stop 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 -- 10.20.193.28:0/2307149536 shutdown_connections 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2307149536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a493c8b0 unknown :-1 s=CLOSED pgs=1125 gs=2 cs=0 l=1 c_cookie=6807073846158422201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2307149536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 0x5601a493cdf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2307149536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4941980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 -- 10.20.193.28:0/2307149536 >> 10.20.193.28:0/2307149536 conn(0x5601a48c0860 msgr2=0x5601a4944280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 -- 10.20.193.28:0/2307149536 shutdown_connections 2026-02-20T13:27:19.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.863+0000 7f69299e9e00 1 -- 10.20.193.28:0/2307149536 wait complete. 2026-02-20T13:27:19.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.864+0000 7f69299e9e00 1 -- start start 2026-02-20T13:27:19.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.864+0000 7f69299e9e00 1 Processor -- start 2026-02-20T13:27:19.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.864+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4921920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.864+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a4921e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.864+0000 7f69299e9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 0x5601a4922530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.864+0000 7f69299e9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5601a48c04d0 con 0x5601a48e2c70 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.864+0000 7f69299e9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5601a4922c30 con 0x5601a4927b20 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.864+0000 7f69299e9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5601a4922df0 con 0x5601a48e2360 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4921920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4921920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40620/0 (socket says 10.20.193.28:40620) 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 -- 10.20.193.28:0/2126418491 learned_addr learned my addr 10.20.193.28:0/2126418491 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925f65640 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 0x5601a4922530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6924f63640 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a4921e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 -- 10.20.193.28:0/2126418491 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 msgr2=0x5601a4922530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 0x5601a4922530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 -- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 msgr2=0x5601a4921e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a4921e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 -- 10.20.193.28:0/2126418491 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a47726f0 con 0x5601a48e2360 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6924f63640 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a4921e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f6925764640 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4921920 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=9493927258725704250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69100d2010 tx=0x7f6910002390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c1348a73be623a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.865+0000 7f68daffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f68daffd640 1 -- 10.20.193.28:0/2126418491 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69100ad960 con 0x5601a48e2360 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f68daffd640 1 -- 10.20.193.28:0/2126418491 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f69100b2c80 con 0x5601a48e2360 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f68daffd640 1 -- 10.20.193.28:0/2126418491 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69100acd60 con 0x5601a48e2360 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6920176a20 con 0x5601a48e2360 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f68daffd640 1 -- 10.20.193.28:0/2126418491 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6910078050 con 0x5601a48e2360 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f68daffd640 10 client.28900 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:19.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 10 client.28900 _ll_register_callbacks cb 0x5601a476fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f691c003e90 con 0x5601a48e2360 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f68daffd640 1 -- 10.20.193.28:0/2126418491 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f69100b5260 con 0x5601a48e2360 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 10 client.28900 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5601a4784340 con 0x5601a48e2360 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f68daffd640 1 -- 10.20.193.28:0/2126418491 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f69100adbf0 con 0x5601a48e2360 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 10 client.28900 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 10 client.28900 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 20 client.28900 populate_metadata read hostname 'trial028' 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5601a48c60f0 0x5601a48c6590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 4 client.28900 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.866+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601a4481f40 con 0x5601a48c60f0 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f6924f63640 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5601a48c60f0 0x5601a48c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:19.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f6924f63640 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5601a48c60f0 0x5601a48c6590 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=10714420421829839748 s_cookie=17674744547514699988 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94b1449b315bcb84 server_cookie=f5494e856a62d0d4 in_seq=0 out_seq=0 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f68daffd640 10 client.28900 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f68daffd640 1 -- 10.20.193.28:0/2126418491 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601a4481f40 con 0x5601a48c60f0 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f68daffd640 10 client.28900 handle_command_reply: tid=0 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 client.28900 shutdown 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 msgr2=0x5601a4921920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4921920 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=9493927258725704250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69100d2010 tx=0x7f6910002390 comp rx=0 tx=0).stop 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 shutdown_connections 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5601a48c60f0 0x5601a48c6590 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=10714420421829839748 s_cookie=17674744547514699988 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601a48e2c70 0x5601a4921e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5601a4927b20 0x5601a4922530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 --2- 10.20.193.28:0/2126418491 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5601a48e2360 0x5601a4921920 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=9493927258725704250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f68daffd640 0 client.28900 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:27:19.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 >> 10.20.193.28:0/2126418491 conn(0x5601a48c0860 msgr2=0x5601a49429a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.867+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 shutdown_connections 2026-02-20T13:27:19.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69299e9e00 1 -- 10.20.193.28:0/2126418491 wait complete. 2026-02-20T13:27:19.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69299e9e00 20 client.28900 trim_cache size 0 max 16384 2026-02-20T13:27:19.877 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 -- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68fc0b5750 msgr2=0x7f68fc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68fc0b5750 0x7f68fc0d5c00 secure :-1 s=READY pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69200fb850 tx=0x7f691403a040 comp rx=0 tx=0).stop 2026-02-20T13:27:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 -- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010f5f0 msgr2=0x7f69200f4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010f5f0 0x7f69200f4f00 secure :-1 s=READY pgs=1123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6910009fd0 tx=0x7f6910002bc0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 -- 10.20.193.28:0/2903771788 shutdown_connections 2026-02-20T13:27:19.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68fc0b5750 0x7f68fc0d5c00 unknown :-1 s=CLOSED pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f69201157e0 0x7f69200f5600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f692010ffe0 0x7f69201760b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 --2- 10.20.193.28:0/2903771788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f692010f5f0 0x7f69200f4f00 unknown :-1 s=CLOSED pgs=1123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:19.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 -- 10.20.193.28:0/2903771788 >> 10.20.193.28:0/2903771788 conn(0x7f69200ecea0 msgr2=0x7f692010db60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:19.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 -- 10.20.193.28:0/2903771788 shutdown_connections 2026-02-20T13:27:19.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:19.868+0000 7f69279ef640 1 -- 10.20.193.28:0/2903771788 wait complete. 2026-02-20T13:27:19.967 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:27:20.150 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:20.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.322+0000 7ff517a4e640 1 -- 10.20.193.28:0/293406565 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 msgr2=0x7ff510173ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.322+0000 7ff517a4e640 1 --2- 10.20.193.28:0/293406565 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 0x7ff510173ee0 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=2557371932198632238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff50c00aa30 tx=0x7ff50c030270 comp rx=0 tx=0).stop 2026-02-20T13:27:20.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.322+0000 7ff517a4e640 1 -- 10.20.193.28:0/293406565 shutdown_connections 2026-02-20T13:27:20.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.322+0000 7ff517a4e640 1 --2- 10.20.193.28:0/293406565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff51010dd10 0x7ff510112d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.322+0000 7ff517a4e640 1 --2- 10.20.193.28:0/293406565 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 0x7ff510173ee0 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=2557371932198632238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.322+0000 7ff517a4e640 1 --2- 10.20.193.28:0/293406565 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff51010d320 0x7ff51010d6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.323+0000 7ff517a4e640 1 -- 10.20.193.28:0/293406565 >> 10.20.193.28:0/293406565 conn(0x7ff5100eabb0 msgr2=0x7ff51010afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:20.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.323+0000 7ff517a4e640 1 -- 10.20.193.28:0/293406565 shutdown_connections 2026-02-20T13:27:20.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.323+0000 7ff517a4e640 1 -- 10.20.193.28:0/293406565 wait complete. 2026-02-20T13:27:20.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.323+0000 7ff517a4e640 1 Processor -- start 2026-02-20T13:27:20.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.323+0000 7ff517a4e640 1 -- start start 2026-02-20T13:27:20.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff517a4e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff51010d320 0x7ff5100f4f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff517a4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff51010dd10 0x7ff510173de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff517a4e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 0x7ff5100f5600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff517a4e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100fa810 con 0x7ff51010dd10 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff517a4e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100fa980 con 0x7ff510113510 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff517a4e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100fab40 con 0x7ff51010d320 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 0x7ff5100f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff514fc2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff51010dd10 0x7ff510173de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff5157c3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff51010d320 0x7ff5100f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 0x7ff5100f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46602/0 (socket says 10.20.193.28:46602) 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 -- 10.20.193.28:0/3322868079 learned_addr learned my addr 10.20.193.28:0/3322868079 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 -- 10.20.193.28:0/3322868079 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff51010d320 msgr2=0x7ff5100f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff51010d320 0x7ff5100f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 -- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff51010dd10 msgr2=0x7ff510173de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff51010dd10 0x7ff510173de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 -- 10.20.193.28:0/3322868079 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c00a650 con 0x7ff510113510 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.324+0000 7ff515fc4640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 0x7ff5100f5600 secure :-1 s=READY pgs=406 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff50c006a50 tx=0x7ff50c006fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.325+0000 7ff4fe7fc640 1 -- 10.20.193.28:0/3322868079 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff50c03e070 con 0x7ff510113510 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.325+0000 7ff4fe7fc640 1 -- 10.20.193.28:0/3322868079 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff50c039e00 con 0x7ff510113510 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.325+0000 7ff517a4e640 1 -- 10.20.193.28:0/3322868079 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5100fadc0 con 0x7ff510113510 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.325+0000 7ff4fe7fc640 1 -- 10.20.193.28:0/3322868079 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff50c0428c0 con 0x7ff510113510 2026-02-20T13:27:20.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.325+0000 7ff517a4e640 1 -- 10.20.193.28:0/3322868079 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5100fb1e0 con 0x7ff510113510 2026-02-20T13:27:20.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.327+0000 7ff4fe7fc640 1 -- 10.20.193.28:0/3322868079 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff50c039920 con 0x7ff510113510 2026-02-20T13:27:20.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.329+0000 7ff4fe7fc640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4ec0b56d0 0x7ff4ec0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.329+0000 7ff4fe7fc640 1 -- 10.20.193.28:0/3322868079 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff50c10c690 con 0x7ff510113510 2026-02-20T13:27:20.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.329+0000 7ff5157c3640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4ec0b56d0 0x7ff4ec0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.329+0000 7ff5157c3640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4ec0b56d0 0x7ff4ec0d5b80 secure :-1 s=READY pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff500004740 tx=0x7ff500005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:20.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.330+0000 7ff519a48e00 1 Processor -- start 2026-02-20T13:27:20.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.330+0000 7ff519a48e00 1 -- start start 2026-02-20T13:27:20.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9137730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a917c5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a919cf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff519a48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3a904d780 con 0x55f3a9137360 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff519a48e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3a90494b0 con 0x55f3a9137c70 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff519a48e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3a9043450 con 0x55f3a917cb20 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9137730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9137730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52576/0 (socket says 10.20.193.28:52576) 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff515fc4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a919cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 -- 10.20.193.28:0/679189878 learned_addr learned my addr 10.20.193.28:0/679189878 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff514fc2640 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a917c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 -- 10.20.193.28:0/679189878 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 msgr2=0x55f3a919cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:20.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a919cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 -- 10.20.193.28:0/679189878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 msgr2=0x55f3a917c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a917c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 -- 10.20.193.28:0/679189878 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3a8feed10 con 0x55f3a9137360 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff515fc4640 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a919cf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff5157c3640 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9137730 secure :-1 s=READY pgs=1126 gs=1 cs=0 l=1 c_cookie=11335256360328795920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff500009c20 tx=0x7ff500013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4eeb9a5b629710 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff4ddce5640 1 -- 10.20.193.28:0/679189878 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff50001d460 con 0x55f3a9137360 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff4ddce5640 1 -- 10.20.193.28:0/679189878 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff50001daa0 con 0x55f3a9137360 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.331+0000 7ff4ddce5640 1 -- 10.20.193.28:0/679189878 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff50001abf0 con 0x55f3a9137360 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 -- 10.20.193.28:0/679189878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 msgr2=0x55f3a9137730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9137730 secure :-1 s=READY pgs=1126 gs=1 cs=0 l=1 c_cookie=11335256360328795920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff500009c20 tx=0x7ff500013000 comp rx=0 tx=0).stop 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 -- 10.20.193.28:0/679189878 shutdown_connections 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a919cf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a917c5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 --2- 10.20.193.28:0/679189878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9137730 unknown :-1 s=CLOSED pgs=1126 gs=1 cs=0 l=1 c_cookie=11335256360328795920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 -- 10.20.193.28:0/679189878 >> 10.20.193.28:0/679189878 conn(0x55f3a9115860 msgr2=0x55f3a9135c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 -- 10.20.193.28:0/679189878 shutdown_connections 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.332+0000 7ff519a48e00 1 -- 10.20.193.28:0/679189878 wait complete. 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.333+0000 7ff519a48e00 1 -- start start 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.333+0000 7ff519a48e00 1 Processor -- start 2026-02-20T13:27:20.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a913d8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a913dde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 0x55f3a913c650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff519a48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3a913cb90 con 0x55f3a9137c70 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff519a48e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3a913cd00 con 0x55f3a917cb20 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff519a48e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3a913cec0 con 0x55f3a9137360 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff5157c3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a913d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff5157c3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a913d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57908/0 (socket says 10.20.193.28:57908) 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff5157c3640 1 -- 10.20.193.28:0/1760439890 learned_addr learned my addr 10.20.193.28:0/1760439890 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff515fc4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 0x55f3a913c650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff514fc2640 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a913dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff5157c3640 1 -- 10.20.193.28:0/1760439890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 msgr2=0x55f3a913c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:20.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff5157c3640 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 0x55f3a913c650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff5157c3640 1 -- 10.20.193.28:0/1760439890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 msgr2=0x55f3a913dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff5157c3640 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a913dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff5157c3640 1 -- 10.20.193.28:0/1760439890 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5000098c0 con 0x55f3a9137360 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.334+0000 7ff514fc2640 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a913dde0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff5157c3640 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a913d8a0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=14587809586456081361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff500011cb0 tx=0x7ff500009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca724f8783c0b3d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff4caffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff4caffd640 1 -- 10.20.193.28:0/1760439890 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff50002c070 con 0x55f3a9137360 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5100fb1e0 con 0x55f3a9137360 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff4caffd640 1 -- 10.20.193.28:0/1760439890 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff500005050 con 0x55f3a9137360 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff4caffd640 1 -- 10.20.193.28:0/1760439890 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5000049f0 con 0x55f3a9137360 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 10 client.28912 _ll_register_callbacks cb 0x55f3a8fc4a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3a8cd96f0 con 0x55f3a9137360 2026-02-20T13:27:20.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff4caffd640 1 -- 10.20.193.28:0/1760439890 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff500004b50 con 0x55f3a9137360 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff4caffd640 1 -- 10.20.193.28:0/1760439890 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff500004d10 con 0x55f3a9137360 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 10 client.28912 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f3a8fc73c0 con 0x55f3a9137360 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff4caffd640 1 -- 10.20.193.28:0/1760439890 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff500039060 con 0x55f3a9137360 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 10 client.28912 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 10 client.28912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 20 client.28912 populate_metadata read hostname 'trial028' 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3a9162b30 0x55f3a9162fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 4 client.28912 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.335+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3a8fe5f80 con 0x55f3a9162b30 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.336+0000 7ff514fc2640 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3a9162b30 0x55f3a9162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.336+0000 7ff514fc2640 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3a9162b30 0x55f3a9162fa0 crc :-1 s=READY pgs=292 gs=4 cs=0 l=0 c_cookie=2451357250146582525 s_cookie=18380046914441426822 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2204f86e6090bffd server_cookie=ff130b497a4bb786 in_seq=0 out_seq=0 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.336+0000 7ff4caffd640 10 client.28912 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff4caffd640 1 -- 10.20.193.28:0/1760439890 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f3a8fe5f80 con 0x55f3a9162b30 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff4caffd640 10 client.28912 handle_command_reply: tid=0 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 client.28912 shutdown 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 msgr2=0x55f3a913d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a913d8a0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=14587809586456081361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff500011cb0 tx=0x7ff500009f50 comp rx=0 tx=0).stop 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 shutdown_connections 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3a9162b30 0x55f3a9162fa0 crc :-1 s=READY pgs=292 gs=4 cs=0 l=0 c_cookie=2451357250146582525 s_cookie=18380046914441426822 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a913dde0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 0x55f3a913c650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 --2- 10.20.193.28:0/1760439890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a913d8a0 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=14587809586456081361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff4caffd640 0 client.28912 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:20.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 >> 10.20.193.28:0/1760439890 conn(0x55f3a9115860 msgr2=0x55f3a9135c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:20.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 shutdown_connections 2026-02-20T13:27:20.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 1 -- 10.20.193.28:0/1760439890 wait complete. 2026-02-20T13:27:20.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.337+0000 7ff519a48e00 20 client.28912 trim_cache size 0 max 16384 2026-02-20T13:27:20.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff519a48e00 1 Processor -- start 2026-02-20T13:27:20.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff519a48e00 1 -- start start 2026-02-20T13:27:20.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9136d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a913d660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a913dba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff519a48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3a9041080 con 0x55f3a9137360 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff519a48e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3a8d01700 con 0x55f3a9137c70 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff519a48e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3a90aa8f0 con 0x55f3a917cb20 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff515fc4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a913dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff514fc2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a913d660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff514fc2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a913d660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46630/0 (socket says 10.20.193.28:46630) 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.345+0000 7ff514fc2640 1 -- 10.20.193.28:0/4196954044 learned_addr learned my addr 10.20.193.28:0/4196954044 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff514fc2640 1 -- 10.20.193.28:0/4196954044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 msgr2=0x55f3a913dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff514fc2640 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a913dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff514fc2640 1 -- 10.20.193.28:0/4196954044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 msgr2=0x55f3a9136d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:27:20.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff5157c3640 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9136d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff514fc2640 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9136d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff514fc2640 1 -- 10.20.193.28:0/4196954044 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3a8fd90e0 con 0x55f3a9137c70 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff5157c3640 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9136d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff514fc2640 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a913d660 secure :-1 s=READY pgs=407 gs=2 cs=0 l=1 c_cookie=14807137845035250995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff504004740 tx=0x7ff504004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd7d856b2191b533 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.346+0000 7ff4dd4e4640 1 -- 10.20.193.28:0/4196954044 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff504016040 con 0x55f3a9137c70 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff4dd4e4640 1 -- 10.20.193.28:0/4196954044 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff504017040 con 0x55f3a9137c70 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff4dd4e4640 1 -- 10.20.193.28:0/4196954044 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff504010980 con 0x55f3a9137c70 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 -- 10.20.193.28:0/4196954044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 msgr2=0x55f3a913d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a913d660 secure :-1 s=READY pgs=407 gs=2 cs=0 l=1 c_cookie=14807137845035250995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff504004740 tx=0x7ff504004640 comp rx=0 tx=0).stop 2026-02-20T13:27:20.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 -- 10.20.193.28:0/4196954044 shutdown_connections 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a917cb20 0x55f3a913dba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a9137c70 0x55f3a913d660 unknown :-1 s=CLOSED pgs=407 gs=2 cs=0 l=1 c_cookie=14807137845035250995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 --2- 10.20.193.28:0/4196954044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137360 0x55f3a9136d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 -- 10.20.193.28:0/4196954044 >> 10.20.193.28:0/4196954044 conn(0x55f3a9115860 msgr2=0x55f3a918ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 -- 10.20.193.28:0/4196954044 shutdown_connections 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.347+0000 7ff519a48e00 1 -- 10.20.193.28:0/4196954044 wait complete. 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff519a48e00 1 -- start start 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff519a48e00 1 Processor -- start 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a9171cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a9172210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff519a48e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 0x55f3a91751b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff519a48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f3a9175740 con 0x55f3a9137c70 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff519a48e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f3a91758b0 con 0x55f3a917cb20 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff519a48e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f3a9175a70 con 0x55f3a9137360 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.348+0000 7ff5157c3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a9171cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff5157c3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a9171cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57932/0 (socket says 10.20.193.28:57932) 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff5157c3640 1 -- 10.20.193.28:0/3456428800 learned_addr learned my addr 10.20.193.28:0/3456428800 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff514fc2640 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a9172210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff515fc4640 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 0x55f3a91751b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff5157c3640 1 -- 10.20.193.28:0/3456428800 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 msgr2=0x55f3a91751b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff5157c3640 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 0x55f3a91751b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff5157c3640 1 -- 10.20.193.28:0/3456428800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 msgr2=0x55f3a9172210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff5157c3640 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a9172210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff5157c3640 1 -- 10.20.193.28:0/3456428800 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3a8fd3b60 con 0x55f3a9137360 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff514fc2640 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a9172210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff5157c3640 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a9171cb0 secure :-1 s=READY pgs=342 gs=2 cs=0 l=1 c_cookie=9751537455240013399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff500010600 tx=0x7ff500037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87546ba6517f6657 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff4caffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff4caffd640 1 -- 10.20.193.28:0/3456428800 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff50002c040 con 0x55f3a9137360 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff4caffd640 1 -- 10.20.193.28:0/3456428800 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff50003f070 con 0x55f3a9137360 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.349+0000 7ff4caffd640 1 -- 10.20.193.28:0/3456428800 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5000054a0 con 0x55f3a9137360 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff504009c40 con 0x55f3a9137360 2026-02-20T13:27:20.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff4caffd640 1 -- 10.20.193.28:0/3456428800 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff500005630 con 0x55f3a9137360 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 10 client.28918 _ll_register_callbacks cb 0x55f3a8fc4a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff50001daa0 con 0x55f3a9137360 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff4caffd640 1 -- 10.20.193.28:0/3456428800 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff50001ce80 con 0x55f3a9137360 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 10 client.28918 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f3a8fc76f0 con 0x55f3a9137360 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff4caffd640 1 -- 10.20.193.28:0/3456428800 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff500025070 con 0x55f3a9137360 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 10 client.28918 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 10 client.28918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 20 client.28918 populate_metadata read hostname 'trial028' 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3a9232d00 0x55f3a9253180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:20.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 4 client.28918 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3a8cd6f40 con 0x55f3a9232d00 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.350+0000 7ff514fc2640 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3a9232d00 0x55f3a9253180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff514fc2640 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3a9232d00 0x55f3a9253180 crc :-1 s=READY pgs=293 gs=4 cs=0 l=0 c_cookie=4273940012834140865 s_cookie=5964287737859554746 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b5015cc204eb2c1 server_cookie=52c56818f1563dba in_seq=0 out_seq=0 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff4caffd640 10 client.28918 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff4caffd640 1 -- 10.20.193.28:0/3456428800 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3a8cd6f40 con 0x55f3a9232d00 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff4caffd640 10 client.28918 handle_command_reply: tid=0 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 client.28918 shutdown 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 msgr2=0x55f3a9171cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a9171cb0 secure :-1 s=READY pgs=342 gs=2 cs=0 l=1 c_cookie=9751537455240013399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff500010600 tx=0x7ff500037000 comp rx=0 tx=0).stop 2026-02-20T13:27:20.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 shutdown_connections 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f3a9232d00 0x55f3a9253180 crc :-1 s=READY pgs=293 gs=4 cs=0 l=0 c_cookie=4273940012834140865 s_cookie=5964287737859554746 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f3a9137c70 0x55f3a9172210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f3a917cb20 0x55f3a91751b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 --2- 10.20.193.28:0/3456428800 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f3a9137360 0x55f3a9171cb0 unknown :-1 s=CLOSED pgs=342 gs=2 cs=0 l=1 c_cookie=9751537455240013399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff4caffd640 0 client.28918 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 >> 10.20.193.28:0/3456428800 conn(0x55f3a9115860 msgr2=0x55f3a918ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 shutdown_connections 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 1 -- 10.20.193.28:0/3456428800 wait complete. 2026-02-20T13:27:20.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.351+0000 7ff519a48e00 20 client.28918 trim_cache size 0 max 16384 2026-02-20T13:27:20.365 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:20.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 -- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4ec0b56d0 msgr2=0x7ff4ec0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4ec0b56d0 0x7ff4ec0d5b80 secure :-1 s=READY pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff500004740 tx=0x7ff500005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:20.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 -- 10.20.193.28:0/3322868079 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 msgr2=0x7ff5100f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:20.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 0x7ff5100f5600 secure :-1 s=READY pgs=406 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff50c006a50 tx=0x7ff50c006fb0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 -- 10.20.193.28:0/3322868079 shutdown_connections 2026-02-20T13:27:20.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4ec0b56d0 0x7ff4ec0d5b80 unknown :-1 s=CLOSED pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff51010dd10 0x7ff510173de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff510113510 0x7ff5100f5600 unknown :-1 s=CLOSED pgs=406 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 --2- 10.20.193.28:0/3322868079 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff51010d320 0x7ff5100f4f00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:20.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 -- 10.20.193.28:0/3322868079 >> 10.20.193.28:0/3322868079 conn(0x7ff5100eabb0 msgr2=0x7ff510111bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:20.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 -- 10.20.193.28:0/3322868079 shutdown_connections 2026-02-20T13:27:20.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:20.352+0000 7ff517a4e640 1 -- 10.20.193.28:0/3322868079 wait complete. 2026-02-20T13:27:20.585 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:20 trial028 ceph-mon[37442]: pgmap v481: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:27:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:20 trial127 ceph-mon[43817]: pgmap v481: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:27:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:20 trial034 ceph-mon[43332]: pgmap v481: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2026-02-20T13:27:21.452 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:27:21.452 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:27:21.637 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 -- 10.20.193.28:0/2004863499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 msgr2=0x7fb3ac17a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2004863499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 0x7fb3ac17a570 secure :-1 s=READY pgs=1127 gs=1 cs=0 l=1 c_cookie=16314142113279418915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a800aa30 tx=0x7fb3a8030270 comp rx=0 tx=0).stop 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 -- 10.20.193.28:0/2004863499 shutdown_connections 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2004863499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 0x7fb3ac17a570 unknown :-1 s=CLOSED pgs=1127 gs=1 cs=0 l=1 c_cookie=16314142113279418915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2004863499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb3ac114990 0x7fb3ac1193f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2004863499 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb3ac113fa0 0x7fb3ac114370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 -- 10.20.193.28:0/2004863499 >> 10.20.193.28:0/2004863499 conn(0x7fb3ac064a90 msgr2=0x7fb3ac064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 -- 10.20.193.28:0/2004863499 shutdown_connections 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.811+0000 7fb3b3063640 1 -- 10.20.193.28:0/2004863499 wait complete. 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b3063640 1 Processor -- start 2026-02-20T13:27:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b3063640 1 -- start start 2026-02-20T13:27:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b3063640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb3ac113fa0 0x7fb3ac122270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b3063640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb3ac114990 0x7fb3ac1227b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b3063640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 0x7fb3ac127b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b3063640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1281a0 con 0x7fb3ac119ba0 2026-02-20T13:27:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b3063640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac128310 con 0x7fb3ac114990 2026-02-20T13:27:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b3063640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1284d0 con 0x7fb3ac113fa0 2026-02-20T13:27:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b2061640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb3ac113fa0 0x7fb3ac122270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b2862640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 0x7fb3ac127b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b2061640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb3ac113fa0 0x7fb3ac122270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57950/0 (socket says 10.20.193.28:57950) 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b2061640 1 -- 10.20.193.28:0/2193342373 learned_addr learned my addr 10.20.193.28:0/2193342373 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.812+0000 7fb3b1860640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb3ac114990 0x7fb3ac1227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3b2862640 1 -- 10.20.193.28:0/2193342373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb3ac113fa0 msgr2=0x7fb3ac122270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3b2862640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb3ac113fa0 0x7fb3ac122270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3b2862640 1 -- 10.20.193.28:0/2193342373 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb3ac114990 msgr2=0x7fb3ac1227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3b2862640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb3ac114990 0x7fb3ac1227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3b2862640 1 -- 10.20.193.28:0/2193342373 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a800a650 con 0x7fb3ac119ba0 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3b2862640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 0x7fb3ac127b80 secure :-1 s=READY pgs=1128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a8033040 tx=0x7fb3a80039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3937fe640 1 -- 10.20.193.28:0/2193342373 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3a803e070 con 0x7fb3ac119ba0 2026-02-20T13:27:21.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3937fe640 1 -- 10.20.193.28:0/2193342373 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb3a80055a0 con 0x7fb3ac119ba0 2026-02-20T13:27:21.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3937fe640 1 -- 10.20.193.28:0/2193342373 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3a8042910 con 0x7fb3ac119ba0 2026-02-20T13:27:21.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3b3063640 1 -- 10.20.193.28:0/2193342373 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac128750 con 0x7fb3ac119ba0 2026-02-20T13:27:21.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.813+0000 7fb3b3063640 1 -- 10.20.193.28:0/2193342373 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac168eb0 con 0x7fb3ac119ba0 2026-02-20T13:27:21.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.816+0000 7fb3937fe640 1 -- 10.20.193.28:0/2193342373 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb3a8039bd0 con 0x7fb3ac119ba0 2026-02-20T13:27:21.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.818+0000 7fb3937fe640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3880b5760 0x7fb3880d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.818+0000 7fb3937fe640 1 -- 10.20.193.28:0/2193342373 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb3a810c3e0 con 0x7fb3ac119ba0 2026-02-20T13:27:21.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.818+0000 7fb3b2061640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3880b5760 0x7fb3880d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.818+0000 7fb3b62e6e00 1 Processor -- start 2026-02-20T13:27:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.818+0000 7fb3b2061640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3880b5760 0x7fb3880d5c10 secure :-1 s=READY pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c0095d0 tx=0x7fb39c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.818+0000 7fb3b62e6e00 1 -- start start 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743847e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743c9480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e9da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56367429aa20 con 0x563674384410 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563674296750 con 0x563674384d20 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5636742906f0 con 0x5636743c99c0 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b1860640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b2862640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b1860640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46662/0 (socket says 10.20.193.28:46662) 2026-02-20T13:27:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b1860640 1 -- 10.20.193.28:0/3091222299 learned_addr learned my addr 10.20.193.28:0/3091222299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b2061640 1 --2- 10.20.193.28:0/3091222299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b2061640 1 -- 10.20.193.28:0/3091222299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 msgr2=0x5636743e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b2061640 1 --2- 10.20.193.28:0/3091222299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b2061640 1 -- 10.20.193.28:0/3091222299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 msgr2=0x5636743c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b2061640 1 --2- 10.20.193.28:0/3091222299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b2061640 1 -- 10.20.193.28:0/3091222299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367423c120 con 0x563674384410 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.819+0000 7fb3b2061640 1 --2- 10.20.193.28:0/3091222299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743847e0 secure :-1 s=READY pgs=1129 gs=2 cs=0 l=1 c_cookie=9348208437235910859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c003dc0 tx=0x7fb39c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bb820b73c188cb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb390884640 1 -- 10.20.193.28:0/3091222299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb39c011e60 con 0x563674384410 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb390884640 1 -- 10.20.193.28:0/3091222299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb39c003ec0 con 0x563674384410 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/3091222299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 msgr2=0x5636743847e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/3091222299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743847e0 secure :-1 s=READY pgs=1129 gs=2 cs=0 l=1 c_cookie=9348208437235910859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c003dc0 tx=0x7fb39c014000 comp rx=0 tx=0).stop 2026-02-20T13:27:21.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/3091222299 shutdown_connections 2026-02-20T13:27:21.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/3091222299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e9da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/3091222299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743c9480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/3091222299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743847e0 unknown :-1 s=CLOSED pgs=1129 gs=2 cs=0 l=1 c_cookie=9348208437235910859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/3091222299 >> 10.20.193.28:0/3091222299 conn(0x563674362910 msgr2=0x563674382cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:21.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/3091222299 shutdown_connections 2026-02-20T13:27:21.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.820+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/3091222299 wait complete. 2026-02-20T13:27:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.821+0000 7fb3b62e6e00 1 -- start start 2026-02-20T13:27:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.821+0000 7fb3b62e6e00 1 Processor -- start 2026-02-20T13:27:21.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743e1400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743e1940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e6930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5636743e6e70 con 0x563674384410 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5636743e6fe0 con 0x563674384d20 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5636743e71a0 con 0x5636743c99c0 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b2061640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743e1940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46674/0 (socket says 10.20.193.28:46674) 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 -- 10.20.193.28:0/4033589568 learned_addr learned my addr 10.20.193.28:0/4033589568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b2862640 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 -- 10.20.193.28:0/4033589568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 msgr2=0x5636743e6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:21.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e6930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 -- 10.20.193.28:0/4033589568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 msgr2=0x5636743e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 -- 10.20.193.28:0/4033589568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563674214810 con 0x563674384d20 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b2862640 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e6930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b2061640 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743e1400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb3b1860640 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743e1940 secure :-1 s=READY pgs=408 gs=2 cs=0 l=1 c_cookie=8554131317882317248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a00116c0 tx=0x7fb3a0011b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76b6611ca46b69c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.822+0000 7fb35ffff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb35ffff640 1 -- 10.20.193.28:0/4033589568 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3a0016070 con 0x563674384d20 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb35ffff640 1 -- 10.20.193.28:0/4033589568 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb3a0004500 con 0x563674384d20 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb35ffff640 1 -- 10.20.193.28:0/4033589568 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3a001a640 con 0x563674384d20 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39c009de0 con 0x563674384d20 2026-02-20T13:27:21.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb3b62e6e00 10 client.29027 _ll_register_callbacks cb 0x563674247b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563673f269d0 con 0x563674384d20 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb35ffff640 1 -- 10.20.193.28:0/4033589568 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb3a0010930 con 0x563674384d20 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb35ffff640 1 -- 10.20.193.28:0/4033589568 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb3a0010af0 con 0x563674384d20 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb3b62e6e00 10 client.29027 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.823+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5636742264f0 con 0x563674384d20 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb35ffff640 1 -- 10.20.193.28:0/4033589568 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb3a0022060 con 0x563674384d20 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb3b62e6e00 10 client.29027 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb3b62e6e00 10 client.29027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb3b62e6e00 20 client.29027 populate_metadata read hostname 'trial028' 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636743c6d50 0x5636743c71f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb3b62e6e00 4 client.29027 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:21.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56367429ddf0 con 0x5636743c6d50 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb3b2061640 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636743c6d50 0x5636743c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb3b2061640 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636743c6d50 0x5636743c71f0 crc :-1 s=READY pgs=294 gs=4 cs=0 l=0 c_cookie=14266536419031103917 s_cookie=15357053665557274984 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5fceb492785b9ad server_cookie=d51f36f19426e168 in_seq=0 out_seq=0 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.824+0000 7fb35ffff640 10 client.29027 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb35ffff640 1 -- 10.20.193.28:0/4033589568 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56367429ddf0 con 0x5636743c6d50 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb35ffff640 10 client.29027 handle_command_reply: tid=0 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 client.29027 shutdown 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 msgr2=0x5636743e1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743e1940 secure :-1 s=READY pgs=408 gs=2 cs=0 l=1 c_cookie=8554131317882317248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a00116c0 tx=0x7fb3a0011b90 comp rx=0 tx=0).stop 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 shutdown_connections 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636743c6d50 0x5636743c71f0 crc :-1 s=READY pgs=294 gs=4 cs=0 l=0 c_cookie=14266536419031103917 s_cookie=15357053665557274984 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636743c99c0 0x5636743e6930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563674384d20 0x5636743e1940 unknown :-1 s=CLOSED pgs=408 gs=2 cs=0 l=1 c_cookie=8554131317882317248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/4033589568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743e1400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 >> 10.20.193.28:0/4033589568 conn(0x563674362910 msgr2=0x563674382cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:21.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb35ffff640 0 client.29027 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:21.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 shutdown_connections 2026-02-20T13:27:21.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/4033589568 wait complete. 2026-02-20T13:27:21.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.825+0000 7fb3b62e6e00 20 client.29027 trim_cache size 0 max 16384 2026-02-20T13:27:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b62e6e00 1 Processor -- start 2026-02-20T13:27:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b62e6e00 1 -- start start 2026-02-20T13:27:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743c4510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384d20 0x5636743c4a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 0x5636743c7ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5636743d3630 con 0x563674384410 2026-02-20T13:27:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56367428e320 con 0x5636743c99c0 2026-02-20T13:27:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563673f4e790 con 0x563674384d20 2026-02-20T13:27:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b2061640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b2061640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52652/0 (socket says 10.20.193.28:52652) 2026-02-20T13:27:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b2061640 1 -- 10.20.193.28:0/2284710058 learned_addr learned my addr 10.20.193.28:0/2284710058 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.834+0000 7fb3b2862640 1 --2- 10.20.193.28:0/2284710058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 0x5636743c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b2061640 1 -- 10.20.193.28:0/2284710058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384d20 msgr2=0x5636743c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b2061640 1 --2- 10.20.193.28:0/2284710058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384d20 0x5636743c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b2061640 1 -- 10.20.193.28:0/2284710058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 msgr2=0x5636743c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b2061640 1 --2- 10.20.193.28:0/2284710058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 0x5636743c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b2061640 1 -- 10.20.193.28:0/2284710058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636743d3860 con 0x563674384410 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b2061640 1 --2- 10.20.193.28:0/2284710058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743c4510 secure :-1 s=READY pgs=1130 gs=1 cs=0 l=1 c_cookie=371035335690012839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c009480 tx=0x7fb39c005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5262eac06ebc8a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb37a4e6640 1 -- 10.20.193.28:0/2284710058 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb39c0055d0 con 0x563674384410 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb37a4e6640 1 -- 10.20.193.28:0/2284710058 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb39c035700 con 0x563674384410 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb37a4e6640 1 -- 10.20.193.28:0/2284710058 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb39c0048d0 con 0x563674384410 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2284710058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 msgr2=0x5636743c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2284710058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743c4510 secure :-1 s=READY pgs=1130 gs=1 cs=0 l=1 c_cookie=371035335690012839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c009480 tx=0x7fb39c005560 comp rx=0 tx=0).stop 2026-02-20T13:27:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2284710058 shutdown_connections 2026-02-20T13:27:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2284710058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 0x5636743c7ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2284710058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384d20 0x5636743c4a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2284710058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384410 0x5636743c4510 unknown :-1 s=CLOSED pgs=1130 gs=1 cs=0 l=1 c_cookie=371035335690012839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2284710058 >> 10.20.193.28:0/2284710058 conn(0x563674362910 msgr2=0x5636743dd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.835+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2284710058 shutdown_connections 2026-02-20T13:27:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.836+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2284710058 wait complete. 2026-02-20T13:27:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.836+0000 7fb3b62e6e00 1 -- start start 2026-02-20T13:27:21.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.836+0000 7fb3b62e6e00 1 Processor -- start 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384410 0x5636743685f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384d20 0x563674364010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b62e6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 0x563674364550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563674364a90 con 0x563674384d20 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563674364c00 con 0x5636743c99c0 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b62e6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563674364dc0 con 0x563674384410 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2862640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 0x563674364550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384410 0x5636743685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384410 0x5636743685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57988/0 (socket says 10.20.193.28:57988) 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 -- 10.20.193.28:0/2498045801 learned_addr learned my addr 10.20.193.28:0/2498045801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b1860640 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384d20 0x563674364010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 -- 10.20.193.28:0/2498045801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 msgr2=0x563674364550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 0x563674364550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 -- 10.20.193.28:0/2498045801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384d20 msgr2=0x563674364010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384d20 0x563674364010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 -- 10.20.193.28:0/2498045801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563674220f70 con 0x563674384410 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb3b2061640 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384410 0x5636743685f0 secure :-1 s=READY pgs=343 gs=2 cs=0 l=1 c_cookie=13888815974560511419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c009ca0 tx=0x7fb39c0055d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0befc8af27335bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.837+0000 7fb35ffff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb35ffff640 1 -- 10.20.193.28:0/2498045801 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb39c0048d0 con 0x563674384410 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb35ffff640 1 -- 10.20.193.28:0/2498045801 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb39c035870 con 0x563674384410 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39c028040 con 0x563674384410 2026-02-20T13:27:21.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb35ffff640 1 -- 10.20.193.28:0/2498045801 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb39c0051c0 con 0x563674384410 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb35ffff640 1 -- 10.20.193.28:0/2498045801 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb39c03e410 con 0x563674384410 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb35ffff640 10 client.28933 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 10 client.28933 _ll_register_callbacks cb 0x563674247b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb39c003ec0 con 0x563674384410 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb35ffff640 1 -- 10.20.193.28:0/2498045801 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb39c0359e0 con 0x563674384410 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 10 client.28933 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563674214b40 con 0x563674384410 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb35ffff640 1 -- 10.20.193.28:0/2498045801 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb39c01ab50 con 0x563674384410 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 10 client.28933 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 10 client.28933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 20 client.28933 populate_metadata read hostname 'trial028' 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563674488070 0x5636744a8520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 4 client.28933 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.838+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563673f24220 con 0x563674488070 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.839+0000 7fb3b1860640 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563674488070 0x5636744a8520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.839+0000 7fb3b1860640 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563674488070 0x5636744a8520 crc :-1 s=READY pgs=295 gs=4 cs=0 l=0 c_cookie=13629971399080717939 s_cookie=18132038078635544874 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd2762c5d4f0ae73 server_cookie=fba1f0909aed912a in_seq=0 out_seq=0 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.839+0000 7fb35ffff640 10 client.28933 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.840+0000 7fb35ffff640 1 -- 10.20.193.28:0/2498045801 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563673f24220 con 0x563674488070 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.840+0000 7fb35ffff640 10 client.28933 handle_command_reply: tid=0 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.840+0000 7fb3b62e6e00 1 client.28933 shutdown 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.840+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384410 msgr2=0x5636743685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.840+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384410 0x5636743685f0 secure :-1 s=READY pgs=343 gs=2 cs=0 l=1 c_cookie=13888815974560511419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c009ca0 tx=0x7fb39c0055d0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 shutdown_connections 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563674488070 0x5636744a8520 crc :-1 s=READY pgs=295 gs=4 cs=0 l=0 c_cookie=13629971399080717939 s_cookie=18132038078635544874 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563674384d20 0x563674364010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636743c99c0 0x563674364550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 1 --2- 10.20.193.28:0/2498045801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563674384410 0x5636743685f0 unknown :-1 s=CLOSED pgs=343 gs=2 cs=0 l=1 c_cookie=13888815974560511419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb35ffff640 0 client.28933 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 >> 10.20.193.28:0/2498045801 conn(0x563674362910 msgr2=0x5636743ddfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 shutdown_connections 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 1 -- 10.20.193.28:0/2498045801 wait complete. 2026-02-20T13:27:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b62e6e00 20 client.28933 trim_cache size 0 max 16384 2026-02-20T13:27:21.850 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:27:21.850 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:27:21.850 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "fd00bfa9-8409-4d07-98ec-91f808c4c54a", 2026-02-20T13:27:21.850 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:27:21.850 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:27:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b3063640 1 -- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3880b5760 msgr2=0x7fb3880d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3880b5760 0x7fb3880d5c10 secure :-1 s=READY pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c0095d0 tx=0x7fb39c005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b3063640 1 -- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 msgr2=0x7fb3ac127b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.841+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 0x7fb3ac127b80 secure :-1 s=READY pgs=1128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a8033040 tx=0x7fb3a80039b0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.842+0000 7fb3b3063640 1 -- 10.20.193.28:0/2193342373 shutdown_connections 2026-02-20T13:27:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.842+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3880b5760 0x7fb3880d5c10 unknown :-1 s=CLOSED pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.842+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3ac119ba0 0x7fb3ac127b80 unknown :-1 s=CLOSED pgs=1128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.842+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb3ac114990 0x7fb3ac1227b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.842+0000 7fb3b3063640 1 --2- 10.20.193.28:0/2193342373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb3ac113fa0 0x7fb3ac122270 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:21.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.842+0000 7fb3b3063640 1 -- 10.20.193.28:0/2193342373 >> 10.20.193.28:0/2193342373 conn(0x7fb3ac064a90 msgr2=0x7fb3ac1179f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:21.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.842+0000 7fb3b3063640 1 -- 10.20.193.28:0/2193342373 shutdown_connections 2026-02-20T13:27:21.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:21.842+0000 7fb3b3063640 1 -- 10.20.193.28:0/2193342373 wait complete. 2026-02-20T13:27:21.947 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:27:22.131 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:22.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 -- 10.20.193.28:0/1842702409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec10ffe0 msgr2=0x7f5bec115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 --2- 10.20.193.28:0/1842702409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec10ffe0 0x7f5bec115030 secure :-1 s=READY pgs=1131 gs=2 cs=0 l=1 c_cookie=8068109928017286347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bdc009890 tx=0x7f5bdc02f120 comp rx=0 tx=0).stop 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 -- 10.20.193.28:0/1842702409 shutdown_connections 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 --2- 10.20.193.28:0/1842702409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec10ffe0 0x7f5bec115030 unknown :-1 s=CLOSED pgs=1131 gs=2 cs=0 l=1 c_cookie=8068109928017286347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 --2- 10.20.193.28:0/1842702409 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bec1157e0 0x7f5bec1761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 --2- 10.20.193.28:0/1842702409 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bec10f5f0 0x7f5bec10f9c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 -- 10.20.193.28:0/1842702409 >> 10.20.193.28:0/1842702409 conn(0x7f5bec0ecea0 msgr2=0x7f5bec10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 -- 10.20.193.28:0/1842702409 shutdown_connections 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.308+0000 7f5bf2401640 1 -- 10.20.193.28:0/1842702409 wait complete. 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.309+0000 7f5bf2401640 1 Processor -- start 2026-02-20T13:27:22.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.309+0000 7f5bf2401640 1 -- start start 2026-02-20T13:27:22.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.309+0000 7f5bf2401640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bec10f5f0 0x7f5bec0f4eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.309+0000 7f5bf2401640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bec10ffe0 0x7f5bec1760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.309+0000 7f5bf2401640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec1157e0 0x7f5bec0f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.309+0000 7f5bf2401640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec0fa7c0 con 0x7f5bec1157e0 2026-02-20T13:27:22.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.309+0000 7f5bf2401640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec0fa930 con 0x7f5bec10f5f0 2026-02-20T13:27:22.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.309+0000 7f5bf2401640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec0faaf0 con 0x7f5bec10ffe0 2026-02-20T13:27:22.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bec10ffe0 0x7f5bec1760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bec10ffe0 0x7f5bec1760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58002/0 (socket says 10.20.193.28:58002) 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5bf0977640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec1157e0 0x7f5bec0f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 -- 10.20.193.28:0/322874931 learned_addr learned my addr 10.20.193.28:0/322874931 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5bebfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bec10f5f0 0x7f5bec0f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 -- 10.20.193.28:0/322874931 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bec10f5f0 msgr2=0x7f5bec0f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bec10f5f0 0x7f5bec0f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 -- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec1157e0 msgr2=0x7f5bec0f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec1157e0 0x7f5bec0f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 -- 10.20.193.28:0/322874931 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd8009570 con 0x7f5bec10ffe0 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5bf0977640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec1157e0 0x7f5bec0f55b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:22.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bec10ffe0 0x7f5bec1760b0 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bdc0023b0 tx=0x7f5bdc0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:22.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5be97fa640 1 -- 10.20.193.28:0/322874931 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bdc03d070 con 0x7f5bec10ffe0 2026-02-20T13:27:22.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5be97fa640 1 -- 10.20.193.28:0/322874931 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5bdc0044f0 con 0x7f5bec10ffe0 2026-02-20T13:27:22.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5be97fa640 1 -- 10.20.193.28:0/322874931 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bdc041a00 con 0x7f5bec10ffe0 2026-02-20T13:27:22.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5bf2401640 1 -- 10.20.193.28:0/322874931 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bdc0094b0 con 0x7f5bec10ffe0 2026-02-20T13:27:22.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.310+0000 7f5bf2401640 1 -- 10.20.193.28:0/322874931 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bec0fb000 con 0x7f5bec10ffe0 2026-02-20T13:27:22.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.313+0000 7f5be97fa640 1 -- 10.20.193.28:0/322874931 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5bdc038c20 con 0x7f5bec10ffe0 2026-02-20T13:27:22.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.314+0000 7f5be97fa640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5bc00b5750 0x7f5bc00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.315+0000 7f5be97fa640 1 -- 10.20.193.28:0/322874931 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5bdc10b380 con 0x7f5bec10ffe0 2026-02-20T13:27:22.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.315+0000 7f5bebfff640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5bc00b5750 0x7f5bc00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.315+0000 7f5bebfff640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5bc00b5750 0x7f5bc00d5c00 secure :-1 s=READY pgs=493 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd8005b30 tx=0x7f5bd8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:22.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.316+0000 7f5bf43fbe00 1 Processor -- start 2026-02-20T13:27:22.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.316+0000 7f5bf43fbe00 1 -- start start 2026-02-20T13:27:22.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.316+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501f180 0x55c4b501f550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.316+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501fa90 0x55c4b5064400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.316+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b5064940 0x55c4b5084d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.316+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4f357d0 con 0x55c4b501f180 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.316+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4f31500 con 0x55c4b501fa90 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.316+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4f2b4a0 con 0x55c4b5064940 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bf0977640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b5064940 0x55c4b5084d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501f180 0x55c4b501f550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501f180 0x55c4b501f550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52680/0 (socket says 10.20.193.28:52680) 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 -- 10.20.193.28:0/1644611308 learned_addr learned my addr 10.20.193.28:0/1644611308 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/1644611308 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501fa90 0x55c4b5064400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 -- 10.20.193.28:0/1644611308 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b5064940 msgr2=0x55c4b5084d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:22.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 --2- 10.20.193.28:0/1644611308 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b5064940 0x55c4b5084d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 -- 10.20.193.28:0/1644611308 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501fa90 msgr2=0x55c4b5064400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 --2- 10.20.193.28:0/1644611308 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501fa90 0x55c4b5064400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 -- 10.20.193.28:0/1644611308 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b4ed6d80 con 0x55c4b501f180 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bebfff640 1 --2- 10.20.193.28:0/1644611308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501f180 0x55c4b501f550 secure :-1 s=READY pgs=1132 gs=1 cs=0 l=1 c_cookie=6178023220206131753 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd80043e0 tx=0x7f5bd8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bcbf62de805a29 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bbcce3640 1 -- 10.20.193.28:0/1644611308 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bd8025480 con 0x55c4b501f180 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bbcce3640 1 -- 10.20.193.28:0/1644611308 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5bd8025ac0 con 0x55c4b501f180 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bbcce3640 1 -- 10.20.193.28:0/1644611308 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bd801abf0 con 0x55c4b501f180 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/1644611308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501f180 msgr2=0x55c4b501f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.317+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/1644611308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501f180 0x55c4b501f550 secure :-1 s=READY pgs=1132 gs=1 cs=0 l=1 c_cookie=6178023220206131753 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd80043e0 tx=0x7f5bd8014000 comp rx=0 tx=0).stop 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.318+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/1644611308 shutdown_connections 2026-02-20T13:27:22.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.318+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/1644611308 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b5064940 0x55c4b5084d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.318+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/1644611308 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501fa90 0x55c4b5064400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.318+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/1644611308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501f180 0x55c4b501f550 unknown :-1 s=CLOSED pgs=1132 gs=1 cs=0 l=1 c_cookie=6178023220206131753 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.318+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/1644611308 >> 10.20.193.28:0/1644611308 conn(0x55c4b4ffd680 msgr2=0x55c4b501da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:22.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.318+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/1644611308 shutdown_connections 2026-02-20T13:27:22.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.318+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/1644611308 wait complete. 2026-02-20T13:27:22.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.319+0000 7f5bf43fbe00 1 -- start start 2026-02-20T13:27:22.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.319+0000 7f5bf43fbe00 1 Processor -- start 2026-02-20T13:27:22.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5040560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b5040aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 0x55c4b5042440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c4b5042980 con 0x55c4b5064940 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c4b5042af0 con 0x55c4b501f180 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c4b5042cb0 con 0x55c4b501fa90 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5beb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b5040aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bebfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5040560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bebfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5040560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46728/0 (socket says 10.20.193.28:46728) 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bebfff640 1 -- 10.20.193.28:0/2051440635 learned_addr learned my addr 10.20.193.28:0/2051440635 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bf0977640 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 0x55c4b5042440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bebfff640 1 -- 10.20.193.28:0/2051440635 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 msgr2=0x55c4b5040aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bebfff640 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b5040aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bebfff640 1 -- 10.20.193.28:0/2051440635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 msgr2=0x55c4b5042440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bebfff640 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 0x55c4b5042440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.320+0000 7f5bebfff640 1 -- 10.20.193.28:0/2051440635 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b4ec1150 con 0x55c4b501f180 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5bebfff640 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5040560 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=10490407618647196124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd8004100 tx=0x7f5bd801a9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91956a260a8481dc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5badffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5badffb640 1 -- 10.20.193.28:0/2051440635 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bd801a500 con 0x55c4b501f180 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5badffb640 1 -- 10.20.193.28:0/2051440635 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5bd801ab90 con 0x55c4b501f180 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5badffb640 1 -- 10.20.193.28:0/2051440635 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bd8004720 con 0x55c4b501f180 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b4eaf350 con 0x55c4b501f180 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5bf43fbe00 10 client.29045 _ll_register_callbacks cb 0x55c4b4eac9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5badffb640 1 -- 10.20.193.28:0/2051440635 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5bd802b030 con 0x55c4b501f180 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c4b4bc16f0 con 0x55c4b501f180 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5badffb640 1 -- 10.20.193.28:0/2051440635 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5bd801ae20 con 0x55c4b501f180 2026-02-20T13:27:22.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5bf43fbe00 10 client.29045 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.321+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c4b4ebbbd0 con 0x55c4b501f180 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5badffb640 1 -- 10.20.193.28:0/2051440635 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5bd80048f0 con 0x55c4b501f180 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5bf43fbe00 10 client.29045 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5bf43fbe00 10 client.29045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5bf43fbe00 20 client.29045 populate_metadata read hostname 'trial028' 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c4b4fffaa0 0x55c4b4ffff40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5bf43fbe00 4 client.29045 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4b4f38d60 con 0x55c4b4fffaa0 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c4b4fffaa0 0x55c4b4ffff40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c4b4fffaa0 0x55c4b4ffff40 crc :-1 s=READY pgs=296 gs=4 cs=0 l=0 c_cookie=18368039376112799058 s_cookie=1735581837045002201 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fee8627e99974d52 server_cookie=1816067c3bafefd9 in_seq=0 out_seq=0 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.322+0000 7f5badffb640 10 client.29045 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:22.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5badffb640 1 -- 10.20.193.28:0/2051440635 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c4b4f38d60 con 0x55c4b4fffaa0 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5badffb640 10 client.29045 handle_command_reply: tid=0 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 client.29045 shutdown 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 msgr2=0x55c4b5040560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5040560 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=10490407618647196124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd8004100 tx=0x7f5bd801a9f0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 shutdown_connections 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c4b4fffaa0 0x55c4b4ffff40 crc :-1 s=READY pgs=296 gs=4 cs=0 l=0 c_cookie=18368039376112799058 s_cookie=1735581837045002201 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 0x55c4b5042440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5badffb640 0 client.29045 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b5040aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2051440635 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5040560 unknown :-1 s=CLOSED pgs=409 gs=1 cs=0 l=1 c_cookie=10490407618647196124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 >> 10.20.193.28:0/2051440635 conn(0x55c4b4ffd680 msgr2=0x55c4b5006c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:22.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 shutdown_connections 2026-02-20T13:27:22.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2051440635 wait complete. 2026-02-20T13:27:22.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.323+0000 7f5bf43fbe00 20 client.29045 trim_cache size 0 max 16384 2026-02-20T13:27:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.332+0000 7f5bf43fbe00 1 Processor -- start 2026-02-20T13:27:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.332+0000 7f5bf43fbe00 1 -- start start 2026-02-20T13:27:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.332+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5042290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.332+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b501c370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.332+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 0x55c4b5009970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.332+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4f290d0 con 0x55c4b5064940 2026-02-20T13:27:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.332+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4be9700 con 0x55c4b501f180 2026-02-20T13:27:22.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.332+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c4b501f790 con 0x55c4b501fa90 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5042290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5042290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46736/0 (socket says 10.20.193.28:46736) 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5beb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b501c370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 -- 10.20.193.28:0/895726897 learned_addr learned my addr 10.20.193.28:0/895726897 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bf0977640 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 0x55c4b5009970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 -- 10.20.193.28:0/895726897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 msgr2=0x55c4b501c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b501c370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 -- 10.20.193.28:0/895726897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 msgr2=0x55c4b5009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 0x55c4b5009970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 -- 10.20.193.28:0/895726897 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b50116c0 con 0x55c4b501f180 2026-02-20T13:27:22.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b501c370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5bebfff640 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5042290 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=11528021487865547953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd8004130 tx=0x7f5bd8032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ffbc277134bccb1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5baffff640 1 -- 10.20.193.28:0/895726897 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bd8004720 con 0x55c4b501f180 2026-02-20T13:27:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5baffff640 1 -- 10.20.193.28:0/895726897 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c4b4bc16f0 con 0x55c4b501f180 2026-02-20T13:27:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.333+0000 7f5baffff640 1 -- 10.20.193.28:0/895726897 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bd802fe70 con 0x55c4b501f180 2026-02-20T13:27:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/895726897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 msgr2=0x55c4b5042290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5042290 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=11528021487865547953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd8004130 tx=0x7f5bd8032000 comp rx=0 tx=0).stop 2026-02-20T13:27:22.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/895726897 shutdown_connections 2026-02-20T13:27:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b5064940 0x55c4b5009970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501fa90 0x55c4b501c370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/895726897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b501f180 0x55c4b5042290 unknown :-1 s=CLOSED pgs=410 gs=1 cs=0 l=1 c_cookie=11528021487865547953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/895726897 >> 10.20.193.28:0/895726897 conn(0x55c4b4ffd680 msgr2=0x55c4b5044cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/895726897 shutdown_connections 2026-02-20T13:27:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/895726897 wait complete. 2026-02-20T13:27:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 -- start start 2026-02-20T13:27:22.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.334+0000 7f5bf43fbe00 1 Processor -- start 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501f180 0x55c4b50007b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501fa90 0x55c4b5000d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf43fbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b5064940 0x55c4b5005650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4f93060 con 0x55c4b501fa90 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4be9700 con 0x55c4b5064940 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf43fbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4f290d0 con 0x55c4b501f180 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf0977640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b5064940 0x55c4b5005650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf0977640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b5064940 0x55c4b5005650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46740/0 (socket says 10.20.193.28:46740) 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf0977640 1 -- 10.20.193.28:0/2255693472 learned_addr learned my addr 10.20.193.28:0/2255693472 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bebfff640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501f180 0x55c4b50007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501fa90 0x55c4b5000d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf0977640 1 -- 10.20.193.28:0/2255693472 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501f180 msgr2=0x55c4b50007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf0977640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501f180 0x55c4b50007b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf0977640 1 -- 10.20.193.28:0/2255693472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501fa90 msgr2=0x55c4b5000d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf0977640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501fa90 0x55c4b5000d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bf0977640 1 -- 10.20.193.28:0/2255693472 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b4eaf680 con 0x55c4b5064940 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5bebfff640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501f180 0x55c4b50007b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.335+0000 7f5beb7fe640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501fa90 0x55c4b5000d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf0977640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b5064940 0x55c4b5005650 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=11525770024767966516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be000a290 tx=0x7f5be0003ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff3c2c57923cd34 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5badffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5badffb640 1 -- 10.20.193.28:0/2255693472 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5be0018070 con 0x55c4b5064940 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b4ebbbd0 con 0x55c4b5064940 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5badffb640 1 -- 10.20.193.28:0/2255693472 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5be0019040 con 0x55c4b5064940 2026-02-20T13:27:22.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5badffb640 1 -- 10.20.193.28:0/2255693472 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5be001d680 con 0x55c4b5064940 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 10 client.29051 _ll_register_callbacks cb 0x55c4b4eac9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd8025ac0 con 0x55c4b5064940 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5badffb640 1 -- 10.20.193.28:0/2255693472 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5be0027440 con 0x55c4b5064940 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5badffb640 1 -- 10.20.193.28:0/2255693472 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5be0027640 con 0x55c4b5064940 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 10 client.29051 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c4b4ec13b0 con 0x55c4b5064940 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5badffb640 1 -- 10.20.193.28:0/2255693472 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5be0013bd0 con 0x55c4b5064940 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 10 client.29051 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 10 client.29051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 20 client.29051 populate_metadata read hostname 'trial028' 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c4b5123d70 0x55c4b51441f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:22.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 4 client.29051 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.336+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c4b4bbef40 con 0x55c4b5123d70 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.337+0000 7f5bebfff640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c4b5123d70 0x55c4b51441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.337+0000 7f5bebfff640 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c4b5123d70 0x55c4b51441f0 crc :-1 s=READY pgs=297 gs=4 cs=0 l=0 c_cookie=16652193456929658883 s_cookie=14741848179038858871 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e71879b8d3605803 server_cookie=cc9590d02c59ae77 in_seq=0 out_seq=0 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.337+0000 7f5badffb640 10 client.29051 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.337+0000 7f5badffb640 1 -- 10.20.193.28:0/2255693472 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5398 (crc 0 0 0) 0x55c4b4bbef40 con 0x55c4b5123d70 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.337+0000 7f5badffb640 10 client.29051 handle_command_reply: tid=0 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.337+0000 7f5bf43fbe00 1 client.29051 shutdown 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b5064940 msgr2=0x55c4b5005650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b5064940 0x55c4b5005650 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=11525770024767966516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be000a290 tx=0x7f5be0003ea0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 shutdown_connections 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c4b5123d70 0x55c4b51441f0 crc :-1 s=READY pgs=297 gs=4 cs=0 l=0 c_cookie=16652193456929658883 s_cookie=14741848179038858871 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c4b501fa90 0x55c4b5000d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c4b5064940 0x55c4b5005650 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=11525770024767966516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 --2- 10.20.193.28:0/2255693472 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c4b501f180 0x55c4b50007b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 >> 10.20.193.28:0/2255693472 conn(0x55c4b4ffd680 msgr2=0x55c4b5041a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:22.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5badffb640 0 client.29051 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:22.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 shutdown_connections 2026-02-20T13:27:22.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 1 -- 10.20.193.28:0/2255693472 wait complete. 2026-02-20T13:27:22.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf43fbe00 20 client.29051 trim_cache size 0 max 16384 2026-02-20T13:27:22.348 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:27:22.348 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:27:22.348 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:27:22.348 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:27:22.348 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.348 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "fd00bfa9-8409-4d07-98ec-91f808c4c54a", 2026-02-20T13:27:22.348 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:27:22.348 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.349 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:27:22.350 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.351 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.352 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.353 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.354 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.355 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:27:22.356 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.357 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.358 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:22.359 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 -- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5bc00b5750 msgr2=0x7f5bc00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5bc00b5750 0x7f5bc00d5c00 secure :-1 s=READY pgs=493 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd8005b30 tx=0x7f5bd8009310 comp rx=0 tx=0).stop 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 -- 10.20.193.28:0/322874931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bec10ffe0 msgr2=0x7f5bec1760b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bec10ffe0 0x7f5bec1760b0 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bdc0023b0 tx=0x7f5bdc0028d0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 -- 10.20.193.28:0/322874931 shutdown_connections 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5bc00b5750 0x7f5bc00d5c00 unknown :-1 s=CLOSED pgs=493 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5bec1157e0 0x7f5bec0f55b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5bec10ffe0 0x7f5bec1760b0 unknown :-1 s=CLOSED pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 --2- 10.20.193.28:0/322874931 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5bec10f5f0 0x7f5bec0f4eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:22.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.338+0000 7f5bf2401640 1 -- 10.20.193.28:0/322874931 >> 10.20.193.28:0/322874931 conn(0x7f5bec0ecea0 msgr2=0x7f5bec113fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:22.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.339+0000 7f5bf2401640 1 -- 10.20.193.28:0/322874931 shutdown_connections 2026-02-20T13:27:22.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:22.339+0000 7f5bf2401640 1 -- 10.20.193.28:0/322874931 wait complete. 2026-02-20T13:27:22.440 INFO:tasks.cephfs.filesystem:scrub status for tag:fd00bfa9-8409-4d07-98ec-91f808c4c54a - {'path': '/', 'tag': 'fd00bfa9-8409-4d07-98ec-91f808c4c54a', 'options': 'recursive,force'} 2026-02-20T13:27:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:22 trial028 ceph-mon[37442]: pgmap v482: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:27:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:22 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:27:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:22 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:22 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:27:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:22 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:27:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:22 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:22 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:22 trial127 ceph-mon[43817]: pgmap v482: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:27:22.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:22 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:27:22.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:22 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:22.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:22 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:27:22.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:22 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:27:22.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:22 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:22.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:22 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:22 trial034 ceph-mon[43332]: pgmap v482: 97 pgs: 97 active+clean; 1.5 MiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:27:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:22 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:27:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:22 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:22 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:27:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:22 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:27:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:22 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:22.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:22 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:24 trial028 ceph-mon[37442]: pgmap v483: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:27:24.924 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.2 2026-02-20T13:27:24.924 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:27:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:24 trial127 ceph-mon[43817]: pgmap v483: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:27:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:24 trial034 ceph-mon[43332]: pgmap v483: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2026-02-20T13:27:25.111 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.304+0000 7fdc80899640 1 -- 10.20.193.28:0/1991620767 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc6c0386f0 con 0x7fdc7c10f4b0 2026-02-20T13:27:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.304+0000 7fdc8289d640 1 -- 10.20.193.28:0/1991620767 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdc7c10f4b0 msgr2=0x7fdc7c10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.304+0000 7fdc8289d640 1 --2- 10.20.193.28:0/1991620767 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdc7c10f4b0 0x7fdc7c10f880 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=163766168335345687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc6c009950 tx=0x7fdc6c02f190 comp rx=0 tx=0).stop 2026-02-20T13:27:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.304+0000 7fdc8289d640 1 -- 10.20.193.28:0/1991620767 shutdown_connections 2026-02-20T13:27:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.304+0000 7fdc8289d640 1 --2- 10.20.193.28:0/1991620767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc7c1156a0 0x7fdc7c176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.304+0000 7fdc8289d640 1 --2- 10.20.193.28:0/1991620767 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdc7c10fea0 0x7fdc7c114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.304+0000 7fdc8289d640 1 --2- 10.20.193.28:0/1991620767 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdc7c10f4b0 0x7fdc7c10f880 unknown :-1 s=CLOSED pgs=412 gs=1 cs=0 l=1 c_cookie=163766168335345687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.304+0000 7fdc8289d640 1 -- 10.20.193.28:0/1991620767 >> 10.20.193.28:0/1991620767 conn(0x7fdc7c0ecda0 msgr2=0x7fdc7c10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:25.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.305+0000 7fdc8289d640 1 -- 10.20.193.28:0/1991620767 shutdown_connections 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.305+0000 7fdc8289d640 1 -- 10.20.193.28:0/1991620767 wait complete. 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8289d640 1 Processor -- start 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8289d640 1 -- start start 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8289d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdc7c10f4b0 0x7fdc7c11de20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8289d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc7c10fea0 0x7fdc7c11e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8289d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdc7c1156a0 0x7fdc7c123730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8289d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c123d50 con 0x7fdc7c10fea0 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8289d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c123ec0 con 0x7fdc7c10f4b0 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8289d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c124080 con 0x7fdc7c1156a0 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8109a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc7c10fea0 0x7fdc7c11e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8189b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdc7c10f4b0 0x7fdc7c11de20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8109a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc7c10fea0 0x7fdc7c11e360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52712/0 (socket says 10.20.193.28:52712) 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8109a640 1 -- 10.20.193.28:0/155774678 learned_addr learned my addr 10.20.193.28:0/155774678 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:25.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.306+0000 7fdc8209c640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdc7c1156a0 0x7fdc7c123730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8109a640 1 -- 10.20.193.28:0/155774678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdc7c1156a0 msgr2=0x7fdc7c123730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8109a640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdc7c1156a0 0x7fdc7c123730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8109a640 1 -- 10.20.193.28:0/155774678 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdc7c10f4b0 msgr2=0x7fdc7c11de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8109a640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdc7c10f4b0 0x7fdc7c11de20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8109a640 1 -- 10.20.193.28:0/155774678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7800a590 con 0x7fdc7c10fea0 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8209c640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdc7c1156a0 0x7fdc7c123730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8109a640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc7c10fea0 0x7fdc7c11e360 secure :-1 s=READY pgs=1133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc70009480 tx=0x7fdc7000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc6affd640 1 -- 10.20.193.28:0/155774678 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc7000cd40 con 0x7fdc7c10fea0 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc6affd640 1 -- 10.20.193.28:0/155774678 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdc70004d30 con 0x7fdc7c10fea0 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc6affd640 1 -- 10.20.193.28:0/155774678 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc70010740 con 0x7fdc7c10fea0 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6c009570 con 0x7fdc7c10fea0 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c1648c0 con 0x7fdc7c10fea0 2026-02-20T13:27:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.307+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7c110790 con 0x7fdc7c10fea0 2026-02-20T13:27:25.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.310+0000 7fdc6affd640 1 -- 10.20.193.28:0/155774678 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fdc7001f060 con 0x7fdc7c10fea0 2026-02-20T13:27:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.312+0000 7fdc6affd640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdc580b5760 0x7fdc580d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.312+0000 7fdc6affd640 1 -- 10.20.193.28:0/155774678 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdc70014070 con 0x7fdc7c10fea0 2026-02-20T13:27:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.312+0000 7fdc6affd640 1 -- 10.20.193.28:0/155774678 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fdc700e70f0 con 0x7fdc7c10fea0 2026-02-20T13:27:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.312+0000 7fdc8189b640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdc580b5760 0x7fdc580d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.312+0000 7fdc8189b640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdc580b5760 0x7fdc580d5c10 secure :-1 s=READY pgs=494 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc6c005b30 tx=0x7fdc6c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:25.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.455+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc7c10f8b0 con 0x7fdc7c10fea0 2026-02-20T13:27:25.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.455+0000 7fdc6affd640 1 -- 10.20.193.28:0/155774678 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7fdc700a97e0 con 0x7fdc7c10fea0 2026-02-20T13:27:25.459 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:27:25.459 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:27:25.460 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:27:25.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdc580b5760 msgr2=0x7fdc580d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdc580b5760 0x7fdc580d5c10 secure :-1 s=READY pgs=494 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc6c005b30 tx=0x7fdc6c03a040 comp rx=0 tx=0).stop 2026-02-20T13:27:25.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc7c10fea0 msgr2=0x7fdc7c11e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc7c10fea0 0x7fdc7c11e360 secure :-1 s=READY pgs=1133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc70009480 tx=0x7fdc7000ee60 comp rx=0 tx=0).stop 2026-02-20T13:27:25.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 shutdown_connections 2026-02-20T13:27:25.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdc580b5760 0x7fdc580d5c10 unknown :-1 s=CLOSED pgs=494 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc7c10fea0 0x7fdc7c11e360 unknown :-1 s=CLOSED pgs=1133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdc7c1156a0 0x7fdc7c123730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 --2- 10.20.193.28:0/155774678 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdc7c10f4b0 0x7fdc7c11de20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 >> 10.20.193.28:0/155774678 conn(0x7fdc7c0ecda0 msgr2=0x7fdc7c10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:25.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 shutdown_connections 2026-02-20T13:27:25.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.457+0000 7fdc8289d640 1 -- 10.20.193.28:0/155774678 wait complete. 2026-02-20T13:27:25.555 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0' 2026-02-20T13:27:25.556 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0 2026-02-20T13:27:25.740 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:25.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:25 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/155774678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.932+0000 7f6f6f58c640 1 -- 10.20.193.28:0/3211162256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f6810f230 msgr2=0x7f6f6810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.932+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/3211162256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f6810f230 0x7f6f6810f600 secure :-1 s=READY pgs=1134 gs=2 cs=0 l=1 c_cookie=13965486596235841332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f58009890 tx=0x7f6f5802f120 comp rx=0 tx=0).stop 2026-02-20T13:27:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.932+0000 7f6f6f58c640 1 -- 10.20.193.28:0/3211162256 shutdown_connections 2026-02-20T13:27:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.932+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/3211162256 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6f68115420 0x7f6f68175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.932+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/3211162256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6f6810fc20 0x7f6f68114c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.932+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/3211162256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f6810f230 0x7f6f6810f600 unknown :-1 s=CLOSED pgs=1134 gs=2 cs=0 l=1 c_cookie=13965486596235841332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.932+0000 7f6f6f58c640 1 -- 10.20.193.28:0/3211162256 >> 10.20.193.28:0/3211162256 conn(0x7f6f6805f830 msgr2=0x7f6f6810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.932+0000 7f6f6f58c640 1 -- 10.20.193.28:0/3211162256 shutdown_connections 2026-02-20T13:27:25.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.933+0000 7f6f6f58c640 1 -- 10.20.193.28:0/3211162256 wait complete. 2026-02-20T13:27:25.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.933+0000 7f6f6f58c640 1 Processor -- start 2026-02-20T13:27:25.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.933+0000 7f6f6f58c640 1 -- start start 2026-02-20T13:27:25.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.933+0000 7f6f6f58c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6f6810f230 0x7f6f6811db00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6f58c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6f6810fc20 0x7f6f6811e040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6f58c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f68115420 0x7f6f68123410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6f58c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6f68123a30 con 0x7f6f68115420 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6f58c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6f68123ba0 con 0x7f6f6810f230 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6f58c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6f68123d60 con 0x7f6f6810fc20 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6d301640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6f6810f230 0x7f6f6811db00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6cb00640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6f6810fc20 0x7f6f6811e040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6cb00640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6f6810fc20 0x7f6f6811e040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58088/0 (socket says 10.20.193.28:58088) 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6d301640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6f6810f230 0x7f6f6811db00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46768/0 (socket says 10.20.193.28:46768) 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6cb00640 1 -- 10.20.193.28:0/2190090491 learned_addr learned my addr 10.20.193.28:0/2190090491 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6db02640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f68115420 0x7f6f68123410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6db02640 1 -- 10.20.193.28:0/2190090491 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6f6810fc20 msgr2=0x7f6f6811e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6db02640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6f6810fc20 0x7f6f6811e040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6db02640 1 -- 10.20.193.28:0/2190090491 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6f6810f230 msgr2=0x7f6f6811db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6db02640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6f6810f230 0x7f6f6811db00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6db02640 1 -- 10.20.193.28:0/2190090491 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f580094b0 con 0x7f6f68115420 2026-02-20T13:27:25.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6d301640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6f6810f230 0x7f6f6811db00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:25.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f6db02640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f68115420 0x7f6f68123410 secure :-1 s=READY pgs=1135 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f6400e720 tx=0x7f6f6400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:25.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f567fc640 1 -- 10.20.193.28:0/2190090491 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f64005500 con 0x7f6f68115420 2026-02-20T13:27:25.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f567fc640 1 -- 10.20.193.28:0/2190090491 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f64005660 con 0x7f6f68115420 2026-02-20T13:27:25.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.934+0000 7f6f567fc640 1 -- 10.20.193.28:0/2190090491 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f64011460 con 0x7f6f68115420 2026-02-20T13:27:25.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.935+0000 7f6f6f58c640 1 -- 10.20.193.28:0/2190090491 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f68124040 con 0x7f6f68115420 2026-02-20T13:27:25.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.935+0000 7f6f6f58c640 1 -- 10.20.193.28:0/2190090491 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f68164740 con 0x7f6f68115420 2026-02-20T13:27:25.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.938+0000 7f6f567fc640 1 -- 10.20.193.28:0/2190090491 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6f6400c7e0 con 0x7f6f68115420 2026-02-20T13:27:25.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.939+0000 7f6f567fc640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6f440b5760 0x7f6f440d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.939+0000 7f6f567fc640 1 -- 10.20.193.28:0/2190090491 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6f640e79d0 con 0x7f6f68115420 2026-02-20T13:27:25.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f6d301640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6f440b5760 0x7f6f440d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f71586e00 1 Processor -- start 2026-02-20T13:27:25.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f71586e00 1 -- start start 2026-02-20T13:27:25.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d870ac20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d874f8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 0x5555d87701e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f71586e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555d861f780 con 0x5555d870a850 2026-02-20T13:27:25.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f71586e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555d861b4b0 con 0x5555d870b160 2026-02-20T13:27:25.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f71586e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555d8615610 con 0x5555d874fe00 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.940+0000 7f6f6cb00640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d874f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6cb00640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d874f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46778/0 (socket says 10.20.193.28:46778) 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6cb00640 1 -- 10.20.193.28:0/1394065397 learned_addr learned my addr 10.20.193.28:0/1394065397 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6d301640 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d870ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6db02640 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 0x5555d87701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6d301640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6f440b5760 0x7f6f440d5c10 secure :-1 s=READY pgs=495 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f580097e0 tx=0x7f6f5803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6d301640 1 -- 10.20.193.28:0/1394065397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 msgr2=0x5555d87701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6d301640 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 0x5555d87701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6d301640 1 -- 10.20.193.28:0/1394065397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 msgr2=0x5555d874f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6d301640 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d874f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6d301640 1 -- 10.20.193.28:0/1394065397 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d85c0c50 con 0x5555d870a850 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6cb00640 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d874f8c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:25.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f6d301640 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d870ac20 secure :-1 s=READY pgs=1136 gs=2 cs=0 l=1 c_cookie=8589701877580359487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f58009890 tx=0x7f6f58040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7734c058f3aee73f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f35ce5640 1 -- 10.20.193.28:0/1394065397 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f580386b0 con 0x5555d870a850 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f35ce5640 1 -- 10.20.193.28:0/1394065397 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f5803e040 con 0x5555d870a850 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.941+0000 7f6f35ce5640 1 -- 10.20.193.28:0/1394065397 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f5804eca0 con 0x5555d870a850 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 -- 10.20.193.28:0/1394065397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 msgr2=0x5555d870ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d870ac20 secure :-1 s=READY pgs=1136 gs=2 cs=0 l=1 c_cookie=8589701877580359487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f58009890 tx=0x7f6f58040000 comp rx=0 tx=0).stop 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 -- 10.20.193.28:0/1394065397 shutdown_connections 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 0x5555d87701e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d874f8c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 --2- 10.20.193.28:0/1394065397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d870ac20 unknown :-1 s=CLOSED pgs=1136 gs=2 cs=0 l=1 c_cookie=8589701877580359487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 -- 10.20.193.28:0/1394065397 >> 10.20.193.28:0/1394065397 conn(0x5555d8628110 msgr2=0x5555d8709130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 -- 10.20.193.28:0/1394065397 shutdown_connections 2026-02-20T13:27:25.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.942+0000 7f6f71586e00 1 -- 10.20.193.28:0/1394065397 wait complete. 2026-02-20T13:27:25.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.943+0000 7f6f71586e00 1 -- start start 2026-02-20T13:27:25.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.943+0000 7f6f71586e00 1 Processor -- start 2026-02-20T13:27:25.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870a850 0x5555d872b880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 0x5555d872bdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d874fe00 0x5555d8730720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6d301640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870a850 0x5555d872b880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f71586e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555d8730c60 con 0x5555d874fe00 2026-02-20T13:27:25.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f71586e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555d8730dd0 con 0x5555d870a850 2026-02-20T13:27:25.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6d301640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870a850 0x5555d872b880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46780/0 (socket says 10.20.193.28:46780) 2026-02-20T13:27:25.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6d301640 1 -- 10.20.193.28:0/4139274677 learned_addr learned my addr 10.20.193.28:0/4139274677 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:25.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f71586e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555d8730f90 con 0x5555d870b160 2026-02-20T13:27:25.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6db02640 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d874fe00 0x5555d8730720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6cb00640 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 0x5555d872bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6db02640 1 -- 10.20.193.28:0/4139274677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 msgr2=0x5555d872bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6db02640 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 0x5555d872bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6db02640 1 -- 10.20.193.28:0/4139274677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870a850 msgr2=0x5555d872b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6db02640 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870a850 0x5555d872b880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6db02640 1 -- 10.20.193.28:0/4139274677 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f68176660 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f6db02640 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d874fe00 0x5555d8730720 secure :-1 s=READY pgs=1137 gs=2 cs=0 l=1 c_cookie=15557776510643138507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f640ab050 tx=0x7f6f640a9c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e8534ecbccefcb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f22ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f22ffd640 1 -- 10.20.193.28:0/4139274677 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f640b8c00 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f22ffd640 1 -- 10.20.193.28:0/4139274677 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f640d30c0 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f22ffd640 1 -- 10.20.193.28:0/4139274677 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f640ac040 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.944+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5c0041e0 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f22ffd640 1 -- 10.20.193.28:0/4139274677 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6f640b8e70 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 10 client.19104 _ll_register_callbacks cb 0x5555d8596320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555d82abeb0 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f22ffd640 1 -- 10.20.193.28:0/4139274677 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f640b3a50 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 10 client.19104 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5555d8598e60 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f22ffd640 1 -- 10.20.193.28:0/4139274677 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6f640af720 con 0x5555d874fe00 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 10 client.19104 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 10 client.19104 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 20 client.19104 populate_metadata read hostname 'trial028' 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555d8735850 0x5555d8735cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 4 client.19104 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:25.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.945+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555d85e7700 con 0x5555d8735850 2026-02-20T13:27:25.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.946+0000 7f6f6d301640 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555d8735850 0x5555d8735cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.946+0000 7f6f6d301640 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555d8735850 0x5555d8735cf0 crc :-1 s=READY pgs=298 gs=4 cs=0 l=0 c_cookie=12340741230452796805 s_cookie=9817770936948063982 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab431ec3da27ed85 server_cookie=883fbaa67ef17eee in_seq=0 out_seq=0 2026-02-20T13:27:25.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.946+0000 7f6f22ffd640 10 client.19104 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:25.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f22ffd640 1 -- 10.20.193.28:0/4139274677 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5555d85e7700 con 0x5555d8735850 2026-02-20T13:27:25.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f22ffd640 10 client.19104 handle_command_reply: tid=0 2026-02-20T13:27:25.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 client.19104 shutdown 2026-02-20T13:27:25.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d874fe00 msgr2=0x5555d8730720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d874fe00 0x5555d8730720 secure :-1 s=READY pgs=1137 gs=2 cs=0 l=1 c_cookie=15557776510643138507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f640ab050 tx=0x7f6f640a9c80 comp rx=0 tx=0).stop 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 shutdown_connections 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555d8735850 0x5555d8735cf0 crc :-1 s=READY pgs=298 gs=4 cs=0 l=0 c_cookie=12340741230452796805 s_cookie=9817770936948063982 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d874fe00 0x5555d8730720 unknown :-1 s=CLOSED pgs=1137 gs=2 cs=0 l=1 c_cookie=15557776510643138507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 0x5555d872bdc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 --2- 10.20.193.28:0/4139274677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870a850 0x5555d872b880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f22ffd640 0 client.19104 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 >> 10.20.193.28:0/4139274677 conn(0x5555d8628110 msgr2=0x5555d86f2240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 shutdown_connections 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 1 -- 10.20.193.28:0/4139274677 wait complete. 2026-02-20T13:27:25.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.947+0000 7f6f71586e00 20 client.19104 trim_cache size 0 max 16384 2026-02-20T13:27:25.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f71586e00 1 Processor -- start 2026-02-20T13:27:25.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f71586e00 1 -- start start 2026-02-20T13:27:25.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d86f5260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 0x5555d86f57a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d874fe00 0x5555d8706f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f71586e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555d8613240 con 0x5555d870a850 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f71586e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555d82d3ec0 con 0x5555d874fe00 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f71586e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555d8702540 con 0x5555d870b160 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6d301640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d86f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6d301640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d86f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52756/0 (socket says 10.20.193.28:52756) 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6d301640 1 -- 10.20.193.28:0/1506483681 learned_addr learned my addr 10.20.193.28:0/1506483681 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6cb00640 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 0x5555d86f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6d301640 1 -- 10.20.193.28:0/1506483681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 msgr2=0x5555d86f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6d301640 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 0x5555d86f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6d301640 1 -- 10.20.193.28:0/1506483681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d874fe00 msgr2=0x5555d8706f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6db02640 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d874fe00 0x5555d8706f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6d301640 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d874fe00 0x5555d8706f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6d301640 1 -- 10.20.193.28:0/1506483681 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d86fce70 con 0x5555d870a850 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.957+0000 7f6f6db02640 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d874fe00 0x5555d8706f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:25.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f6d301640 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d86f5260 secure :-1 s=READY pgs=1138 gs=1 cs=0 l=1 c_cookie=8274861665875271802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f58004710 tx=0x7f6f5802f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d636d7cffe207a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:25.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f354e4640 1 -- 10.20.193.28:0/1506483681 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f58005940 con 0x5555d870a850 2026-02-20T13:27:25.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f354e4640 1 -- 10.20.193.28:0/1506483681 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f5802fb30 con 0x5555d870a850 2026-02-20T13:27:25.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f354e4640 1 -- 10.20.193.28:0/1506483681 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f58058400 con 0x5555d870a850 2026-02-20T13:27:25.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 -- 10.20.193.28:0/1506483681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 msgr2=0x5555d86f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d86f5260 secure :-1 s=READY pgs=1138 gs=1 cs=0 l=1 c_cookie=8274861665875271802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f58004710 tx=0x7f6f5802f120 comp rx=0 tx=0).stop 2026-02-20T13:27:25.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 -- 10.20.193.28:0/1506483681 shutdown_connections 2026-02-20T13:27:25.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d874fe00 0x5555d8706f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d870b160 0x5555d86f57a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 --2- 10.20.193.28:0/1506483681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d86f5260 unknown :-1 s=CLOSED pgs=1138 gs=1 cs=0 l=1 c_cookie=8274861665875271802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 -- 10.20.193.28:0/1506483681 >> 10.20.193.28:0/1506483681 conn(0x5555d8628110 msgr2=0x5555d87067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:25.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 -- 10.20.193.28:0/1506483681 shutdown_connections 2026-02-20T13:27:25.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.958+0000 7f6f71586e00 1 -- 10.20.193.28:0/1506483681 wait complete. 2026-02-20T13:27:25.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.959+0000 7f6f71586e00 1 -- start start 2026-02-20T13:27:25.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.959+0000 7f6f71586e00 1 Processor -- start 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.959+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d8738f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.959+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d8739470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.959+0000 7f6f71586e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 0x5555d88043c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.959+0000 7f6f71586e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555d8804900 con 0x5555d870a850 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.959+0000 7f6f71586e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555d8804a40 con 0x5555d870b160 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.959+0000 7f6f71586e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555d8804b80 con 0x5555d874fe00 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6cb00640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d8739470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6d301640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d8738f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6cb00640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d8739470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:46790/0 (socket says 10.20.193.28:46790) 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6db02640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 0x5555d88043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6cb00640 1 -- 10.20.193.28:0/3452104531 learned_addr learned my addr 10.20.193.28:0/3452104531 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6d301640 1 -- 10.20.193.28:0/3452104531 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 msgr2=0x5555d88043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6d301640 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 0x5555d88043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6d301640 1 -- 10.20.193.28:0/3452104531 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 msgr2=0x5555d8739470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6d301640 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d8739470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6d301640 1 -- 10.20.193.28:0/3452104531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d85aad80 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f6d301640 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d8738f30 secure :-1 s=READY pgs=1139 gs=1 cs=0 l=1 c_cookie=18366246988482089949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f58005e70 tx=0x7f6f5804e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee20453d59013dd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f22ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f22ffd640 1 -- 10.20.193.28:0/3452104531 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f58005940 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f22ffd640 1 -- 10.20.193.28:0/3452104531 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f5804ec30 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d85c0c50 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f22ffd640 1 -- 10.20.193.28:0/3452104531 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f58058b20 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f71586e00 10 client.19110 _ll_register_callbacks cb 0x5555d8596320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.960+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f5803e040 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f22ffd640 1 -- 10.20.193.28:0/3452104531 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6f58058cb0 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f22ffd640 1 -- 10.20.193.28:0/3452104531 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f58058e90 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f71586e00 10 client.19110 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5555d85a5800 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f22ffd640 1 -- 10.20.193.28:0/3452104531 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6f580386b0 con 0x5555d870a850 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f71586e00 10 client.19110 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:25.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f71586e00 10 client.19110 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:27:25.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f71586e00 20 client.19110 populate_metadata read hostname 'trial028' 2026-02-20T13:27:25.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f71586e00 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555d88063c0 0x5555d8826870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:25.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f71586e00 4 client.19110 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}] 2026-02-20T13:27:25.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}) -- 0x5555d82f4a60 con 0x5555d88063c0 2026-02-20T13:27:25.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.961+0000 7f6f6cb00640 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555d88063c0 0x5555d8826870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:25.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.962+0000 7f6f6cb00640 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555d88063c0 0x5555d8826870 crc :-1 s=READY pgs=299 gs=4 cs=0 l=0 c_cookie=6230705755009865830 s_cookie=16566703626423458388 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5677e9df5b585866 server_cookie=e5e8c12c90255a54 in_seq=0 out_seq=0 2026-02-20T13:27:25.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.962+0000 7f6f22ffd640 10 client.19110 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f22ffd640 1 -- 10.20.193.28:0/3452104531 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5555d82f4a60 con 0x5555d88063c0 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f22ffd640 10 client.19110 handle_command_reply: tid=0 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 client.19110 shutdown 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 msgr2=0x5555d8738f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d8738f30 secure :-1 s=READY pgs=1139 gs=1 cs=0 l=1 c_cookie=18366246988482089949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f58005e70 tx=0x7f6f5804e6b0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 shutdown_connections 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555d88063c0 0x5555d8826870 crc :-1 s=READY pgs=299 gs=4 cs=0 l=0 c_cookie=6230705755009865830 s_cookie=16566703626423458388 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555d874fe00 0x5555d88043c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555d870b160 0x5555d8739470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 --2- 10.20.193.28:0/3452104531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555d870a850 0x5555d8738f30 unknown :-1 s=CLOSED pgs=1139 gs=1 cs=0 l=1 c_cookie=18366246988482089949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f22ffd640 0 client.19110 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 >> 10.20.193.28:0/3452104531 conn(0x5555d8628110 msgr2=0x5555d8706fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 shutdown_connections 2026-02-20T13:27:25.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 1 -- 10.20.193.28:0/3452104531 wait complete. 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f71586e00 20 client.19110 trim_cache size 0 max 16384 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 34, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "d12c1745": { 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "version": 34, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 144.2, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:25.970 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f6f58c640 1 -- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6f440b5760 msgr2=0x7f6f440d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6f440b5760 0x7f6f440d5c10 secure :-1 s=READY pgs=495 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f580097e0 tx=0x7f6f5803a040 comp rx=0 tx=0).stop 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f6f58c640 1 -- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f68115420 msgr2=0x7f6f68123410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.967+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f68115420 0x7f6f68123410 secure :-1 s=READY pgs=1135 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f6400e720 tx=0x7f6f6400ebf0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.968+0000 7f6f6f58c640 1 -- 10.20.193.28:0/2190090491 shutdown_connections 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.968+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6f440b5760 0x7f6f440d5c10 unknown :-1 s=CLOSED pgs=495 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.968+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f68115420 0x7f6f68123410 unknown :-1 s=CLOSED pgs=1135 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.968+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6f6810fc20 0x7f6f6811e040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.968+0000 7f6f6f58c640 1 --2- 10.20.193.28:0/2190090491 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6f6810f230 0x7f6f6811db00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.968+0000 7f6f6f58c640 1 -- 10.20.193.28:0/2190090491 >> 10.20.193.28:0/2190090491 conn(0x7f6f6805f830 msgr2=0x7f6f6810cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.968+0000 7f6f6f58c640 1 -- 10.20.193.28:0/2190090491 shutdown_connections 2026-02-20T13:27:25.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:25.968+0000 7f6f6f58c640 1 -- 10.20.193.28:0/2190090491 wait complete. 2026-02-20T13:27:25.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:25 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/155774678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:25.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:25 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/155774678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:26.071 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd12c1745', quiesce took 1.1 seconds. Will release after: 23.099999999999998 2026-02-20T13:27:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:26 trial028 ceph-mon[37442]: pgmap v484: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:27:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:26 trial127 ceph-mon[43817]: pgmap v484: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:27:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:26 trial034 ceph-mon[43332]: pgmap v484: 97 pgs: 97 active+clean; 1.6 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2026-02-20T13:27:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:28 trial028 ceph-mon[37442]: pgmap v485: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:27:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:28 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:27:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:28 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:27:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:28 trial127 ceph-mon[43817]: pgmap v485: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:27:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:28 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:27:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:28 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:27:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:28 trial034 ceph-mon[43332]: pgmap v485: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2026-02-20T13:27:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:28 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:27:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:28 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:27:30.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:30 trial028 ceph-mon[37442]: pgmap v486: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:27:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:30 trial127 ceph-mon[43817]: pgmap v486: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:27:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:30 trial034 ceph-mon[43332]: pgmap v486: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:27:31.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.221+0000 7fa3affff640 1 -- 10.20.193.28:0/3684555583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0150e50 msgr2=0x7fa3b0171290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.221+0000 7fa3affff640 1 --2- 10.20.193.28:0/3684555583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0150e50 0x7fa3b0171290 secure :-1 s=READY pgs=1140 gs=1 cs=0 l=1 c_cookie=2988588784079673083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a000aa30 tx=0x7fa3a0030270 comp rx=0 tx=0).stop 2026-02-20T13:27:31.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.221+0000 7fa3affff640 1 -- 10.20.193.28:0/3684555583 shutdown_connections 2026-02-20T13:27:31.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.221+0000 7fa3affff640 1 --2- 10.20.193.28:0/3684555583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0150e50 0x7fa3b0171290 unknown :-1 s=CLOSED pgs=1140 gs=1 cs=0 l=1 c_cookie=2988588784079673083 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.221+0000 7fa3affff640 1 --2- 10.20.193.28:0/3684555583 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa3b0061510 0x7fa3b0061980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.221+0000 7fa3affff640 1 --2- 10.20.193.28:0/3684555583 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3b0062a40 0x7fa3b0060fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.221+0000 7fa3affff640 1 -- 10.20.193.28:0/3684555583 >> 10.20.193.28:0/3684555583 conn(0x7fa3b00ea4c0 msgr2=0x7fa3b010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:31.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.222+0000 7fa3affff640 1 -- 10.20.193.28:0/3684555583 shutdown_connections 2026-02-20T13:27:31.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.222+0000 7fa3affff640 1 -- 10.20.193.28:0/3684555583 wait complete. 2026-02-20T13:27:31.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.222+0000 7fa3affff640 1 Processor -- start 2026-02-20T13:27:31.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.222+0000 7fa3affff640 1 -- start start 2026-02-20T13:27:31.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3affff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa3b0061510 0x7fa3b015c610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3affff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0062a40 0x7fa3b015cc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3affff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3b0150e50 0x7fa3b015d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3affff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b015dfa0 con 0x7fa3b0062a40 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3affff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b015e110 con 0x7fa3b0150e50 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3affff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b015e2d0 con 0x7fa3b0061510 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0062a40 0x7fa3b015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0062a40 0x7fa3b015cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56718/0 (socket says 10.20.193.28:56718) 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 -- 10.20.193.28:0/271796158 learned_addr learned my addr 10.20.193.28:0/271796158 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa3b0061510 0x7fa3b015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3af7fe640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3b0150e50 0x7fa3b015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 -- 10.20.193.28:0/271796158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa3b0061510 msgr2=0x7fa3b015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa3b0061510 0x7fa3b015c610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 -- 10.20.193.28:0/271796158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3b0150e50 msgr2=0x7fa3b015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3b0150e50 0x7fa3b015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 -- 10.20.193.28:0/271796158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a000a650 con 0x7fa3b0062a40 2026-02-20T13:27:31.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.223+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0062a40 0x7fa3b015cc60 secure :-1 s=READY pgs=1141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398005db0 tx=0x7fa39800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:31.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.224+0000 7fa38ffff640 1 -- 10.20.193.28:0/271796158 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa398004500 con 0x7fa3b0062a40 2026-02-20T13:27:31.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.224+0000 7fa38ffff640 1 -- 10.20.193.28:0/271796158 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa398004d30 con 0x7fa3b0062a40 2026-02-20T13:27:31.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.224+0000 7fa3affff640 1 -- 10.20.193.28:0/271796158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b015e5b0 con 0x7fa3b0062a40 2026-02-20T13:27:31.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.224+0000 7fa38ffff640 1 -- 10.20.193.28:0/271796158 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa398005330 con 0x7fa3b0062a40 2026-02-20T13:27:31.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.224+0000 7fa3affff640 1 -- 10.20.193.28:0/271796158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b015eb20 con 0x7fa3b0062a40 2026-02-20T13:27:31.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.226+0000 7fa38ffff640 1 -- 10.20.193.28:0/271796158 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa3980098c0 con 0x7fa3b0062a40 2026-02-20T13:27:31.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.228+0000 7fa38ffff640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3840b5760 0x7fa3840d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.228+0000 7fa38ffff640 1 -- 10.20.193.28:0/271796158 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa3980e6a80 con 0x7fa3b0062a40 2026-02-20T13:27:31.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.228+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3840b5760 0x7fa3840d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.228+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3840b5760 0x7fa3840d5c10 secure :-1 s=READY pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a4004740 tx=0x7fa3a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:31.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.228+0000 7fa3b79fde00 1 Processor -- start 2026-02-20T13:27:31.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3b79fde00 1 -- start start 2026-02-20T13:27:31.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94174aed0 0x55b94176b2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 0x55b94178bbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b9417ac4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b941657fd0 con 0x55b94178c110 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b941653d00 con 0x55b94174aed0 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b94164dca0 con 0x55b94176b7f0 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3aeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94174aed0 0x55b94176b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3ae7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 0x55b94178bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3aeffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94174aed0 0x55b94176b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:49072/0 (socket says 10.20.193.28:49072) 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3aeffd640 1 -- 10.20.193.28:0/2064313457 learned_addr learned my addr 10.20.193.28:0/2064313457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3af7fe640 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b9417ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3aeffd640 1 -- 10.20.193.28:0/2064313457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 msgr2=0x55b94178bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:31.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 0x55b94178bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3aeffd640 1 -- 10.20.193.28:0/2064313457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 msgr2=0x55b9417ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b9417ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3aeffd640 1 -- 10.20.193.28:0/2064313457 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9415f08b0 con 0x55b94174aed0 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.229+0000 7fa3af7fe640 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b9417ac4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94174aed0 0x55b94176b2b0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=10769740022764995489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a40114b0 tx=0x7fa3a4013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9575cd7d7c3703a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa38d3fe640 1 -- 10.20.193.28:0/2064313457 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3a401e640 con 0x55b94174aed0 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa38d3fe640 1 -- 10.20.193.28:0/2064313457 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa3a4015070 con 0x55b94174aed0 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa38d3fe640 1 -- 10.20.193.28:0/2064313457 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3a4026d20 con 0x55b94174aed0 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 -- 10.20.193.28:0/2064313457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94174aed0 msgr2=0x55b94176b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94174aed0 0x55b94176b2b0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=10769740022764995489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a40114b0 tx=0x7fa3a4013000 comp rx=0 tx=0).stop 2026-02-20T13:27:31.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 -- 10.20.193.28:0/2064313457 shutdown_connections 2026-02-20T13:27:31.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b9417ac4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 0x55b94178bbd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/2064313457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94174aed0 0x55b94176b2b0 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=10769740022764995489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 -- 10.20.193.28:0/2064313457 >> 10.20.193.28:0/2064313457 conn(0x55b9416611c0 msgr2=0x55b9417497b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:31.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 -- 10.20.193.28:0/2064313457 shutdown_connections 2026-02-20T13:27:31.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.230+0000 7fa3b79fde00 1 -- 10.20.193.28:0/2064313457 wait complete. 2026-02-20T13:27:31.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.231+0000 7fa3b79fde00 1 -- start start 2026-02-20T13:27:31.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3b79fde00 1 Processor -- start 2026-02-20T13:27:31.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 0x55b941763d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94176b7f0 0x55b941764390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b941764df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b941765450 con 0x55b94178c110 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b9417655c0 con 0x55b94176b7f0 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b941765780 con 0x55b94174aed0 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b941764df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b941764df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56748/0 (socket says 10.20.193.28:56748) 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3aeffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 0x55b941763d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3af7fe640 1 -- 10.20.193.28:0/4100156424 learned_addr learned my addr 10.20.193.28:0/4100156424 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94176b7f0 0x55b941764390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3af7fe640 1 -- 10.20.193.28:0/4100156424 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 msgr2=0x55b941763d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3af7fe640 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 0x55b941763d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3af7fe640 1 -- 10.20.193.28:0/4100156424 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94176b7f0 msgr2=0x55b941764390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3af7fe640 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94176b7f0 0x55b941764390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.232+0000 7fa3af7fe640 1 -- 10.20.193.28:0/4100156424 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9415f9400 con 0x55b94178c110 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa3af7fe640 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b941764df0 secure :-1 s=READY pgs=1142 gs=1 cs=0 l=1 c_cookie=6900374833750318295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a000a230 tx=0x7fa3a00397e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc30e59febb9cd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa378bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa378bfc640 1 -- 10.20.193.28:0/4100156424 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3a003e040 con 0x55b94178c110 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa378bfc640 1 -- 10.20.193.28:0/4100156424 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa3a003f040 con 0x55b94178c110 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa378bfc640 1 -- 10.20.193.28:0/4100156424 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3a00456d0 con 0x55b94178c110 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a400bd10 con 0x55b94178c110 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa378bfc640 1 -- 10.20.193.28:0/4100156424 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa3a0045860 con 0x55b94178c110 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa3b79fde00 10 client.19122 _ll_register_callbacks cb 0x55b9415d8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9412ed520 con 0x55b94178c110 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa378bfc640 1 -- 10.20.193.28:0/4100156424 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa3a0045a20 con 0x55b94178c110 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa3b79fde00 10 client.19122 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:31.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.233+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b9415d1da0 con 0x55b94178c110 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.234+0000 7fa378bfc640 1 -- 10.20.193.28:0/4100156424 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa3a0045b80 con 0x55b94178c110 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.234+0000 7fa3b79fde00 10 client.19122 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.234+0000 7fa3b79fde00 10 client.19122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.234+0000 7fa3b79fde00 20 client.19122 populate_metadata read hostname 'trial028' 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.234+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b941768c10 0x55b9417690b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.234+0000 7fa3b79fde00 4 client.19122 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.234+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b94167f630 con 0x55b941768c10 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.234+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b941768c10 0x55b9417690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b941768c10 0x55b9417690b0 crc :-1 s=READY pgs=300 gs=4 cs=0 l=0 c_cookie=2506302357067741408 s_cookie=14740234839258435443 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22c82cb6fcbf38e0 server_cookie=cc8fd57d3bd60f73 in_seq=0 out_seq=0 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa378bfc640 10 client.19122 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:31.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa378bfc640 1 -- 10.20.193.28:0/4100156424 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b94167f630 con 0x55b941768c10 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa378bfc640 10 client.19122 handle_command_reply: tid=0 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 client.19122 shutdown 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 msgr2=0x55b941764df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b941764df0 secure :-1 s=READY pgs=1142 gs=1 cs=0 l=1 c_cookie=6900374833750318295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a000a230 tx=0x7fa3a00397e0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 shutdown_connections 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b941768c10 0x55b9417690b0 crc :-1 s=READY pgs=300 gs=4 cs=0 l=0 c_cookie=2506302357067741408 s_cookie=14740234839258435443 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94178c110 0x55b941764df0 unknown :-1 s=CLOSED pgs=1142 gs=1 cs=0 l=1 c_cookie=6900374833750318295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94176b7f0 0x55b941764390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/4100156424 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 0x55b941763d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa378bfc640 0 client.19122 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.235+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 >> 10.20.193.28:0/4100156424 conn(0x55b9416611c0 msgr2=0x55b94174ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:31.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.236+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 shutdown_connections 2026-02-20T13:27:31.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.236+0000 7fa3b79fde00 1 -- 10.20.193.28:0/4100156424 wait complete. 2026-02-20T13:27:31.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.236+0000 7fa3b79fde00 20 client.19122 trim_cache size 0 max 16384 2026-02-20T13:27:31.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.243+0000 7fa3b79fde00 1 Processor -- start 2026-02-20T13:27:31.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.243+0000 7fa3b79fde00 1 -- start start 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.243+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 0x55b941748ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.243+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94176b7f0 0x55b941761060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.243+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 0x55b9417615a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.243+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b94164b8d0 con 0x55b94176b7f0 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.243+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b94138cf10 con 0x55b94178c110 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.243+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b9416b1490 con 0x55b94174aed0 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94176b7f0 0x55b941761060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94176b7f0 0x55b941761060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56760/0 (socket says 10.20.193.28:56760) 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 -- 10.20.193.28:0/3783249207 learned_addr learned my addr 10.20.193.28:0/3783249207 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3aeffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 0x55b941748ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3af7fe640 1 --2- 10.20.193.28:0/3783249207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 0x55b9417615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 -- 10.20.193.28:0/3783249207 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 msgr2=0x55b941748ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/3783249207 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 0x55b941748ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 -- 10.20.193.28:0/3783249207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 msgr2=0x55b9417615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/3783249207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 0x55b9417615a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 -- 10.20.193.28:0/3783249207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9415e3670 con 0x55b94176b7f0 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/3783249207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94176b7f0 0x55b941761060 secure :-1 s=READY pgs=1143 gs=1 cs=0 l=1 c_cookie=8564578175289163209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398009fd0 tx=0x7fa398009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76db7e792d2c7dc9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa38cbfd640 1 -- 10.20.193.28:0/3783249207 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3980ac5e0 con 0x55b94176b7f0 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa38cbfd640 1 -- 10.20.193.28:0/3783249207 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa3980ad7e0 con 0x55b94176b7f0 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa38cbfd640 1 -- 10.20.193.28:0/3783249207 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3980e4340 con 0x55b94176b7f0 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3b79fde00 1 -- 10.20.193.28:0/3783249207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94176b7f0 msgr2=0x55b941761060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/3783249207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94176b7f0 0x55b941761060 secure :-1 s=READY pgs=1143 gs=1 cs=0 l=1 c_cookie=8564578175289163209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398009fd0 tx=0x7fa398009d90 comp rx=0 tx=0).stop 2026-02-20T13:27:31.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3b79fde00 1 -- 10.20.193.28:0/3783249207 shutdown_connections 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/3783249207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94176b7f0 0x55b941761060 unknown :-1 s=CLOSED pgs=1143 gs=1 cs=0 l=1 c_cookie=8564578175289163209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/3783249207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 0x55b9417615a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/3783249207 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94174aed0 0x55b941748ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.244+0000 7fa3b79fde00 1 -- 10.20.193.28:0/3783249207 >> 10.20.193.28:0/3783249207 conn(0x55b9416611c0 msgr2=0x55b941763d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 -- 10.20.193.28:0/3783249207 shutdown_connections 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 -- 10.20.193.28:0/3783249207 wait complete. 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 -- start start 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 Processor -- start 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94174aed0 0x55b94176a760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 0x55b94176ae00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 0x55b94176bd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b94176c370 con 0x55b94174aed0 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b94176c4e0 con 0x55b94178c110 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.245+0000 7fa3b79fde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b94176c6a0 con 0x55b94176b7f0 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94174aed0 0x55b94176a760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3af7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 0x55b94176bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3ae7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 0x55b94176ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94174aed0 0x55b94176a760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56772/0 (socket says 10.20.193.28:56772) 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 -- 10.20.193.28:0/1428633099 learned_addr learned my addr 10.20.193.28:0/1428633099 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 -- 10.20.193.28:0/1428633099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 msgr2=0x55b94176ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 0x55b94176ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 -- 10.20.193.28:0/1428633099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 msgr2=0x55b94176bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:31.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 0x55b94176bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 -- 10.20.193.28:0/1428633099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9415de0f0 con 0x55b94174aed0 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3aeffd640 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94174aed0 0x55b94176a760 secure :-1 s=READY pgs=1144 gs=1 cs=0 l=1 c_cookie=17826281692914663690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a4011e20 tx=0x7fa3a40268e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f763acc0843a410a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa378bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa378bfc640 1 -- 10.20.193.28:0/1428633099 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3a4026620 con 0x55b94174aed0 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b015eb20 con 0x55b94174aed0 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa378bfc640 1 -- 10.20.193.28:0/1428633099 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa3a4015040 con 0x55b94174aed0 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa378bfc640 1 -- 10.20.193.28:0/1428633099 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3a40365e0 con 0x55b94174aed0 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3b79fde00 10 client.19128 _ll_register_callbacks cb 0x55b9415d8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:31.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9416fdca0 con 0x55b94174aed0 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.246+0000 7fa378bfc640 1 -- 10.20.193.28:0/1428633099 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa3a4017070 con 0x55b94174aed0 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa378bfc640 1 -- 10.20.193.28:0/1428633099 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa3a4004770 con 0x55b94174aed0 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3b79fde00 10 client.19128 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b9415d20d0 con 0x55b94174aed0 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa378bfc640 1 -- 10.20.193.28:0/1428633099 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa3a4024020 con 0x55b94174aed0 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3b79fde00 10 client.19128 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3b79fde00 10 client.19128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3b79fde00 20 client.19128 populate_metadata read hostname 'trial028' 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b94176e650 0x55b94176eaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3b79fde00 4 client.19128 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b941331640 con 0x55b94176e650 2026-02-20T13:27:31.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.247+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b94176e650 0x55b94176eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:31.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.248+0000 7fa378bfc640 10 client.19128 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:31.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.248+0000 7fa3ae7fc640 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b94176e650 0x55b94176eaf0 crc :-1 s=READY pgs=301 gs=4 cs=0 l=0 c_cookie=16581912935455178661 s_cookie=9502240275929780490 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e61ec9f5c642bfa5 server_cookie=83debd2f9934510a in_seq=0 out_seq=0 2026-02-20T13:27:31.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.252+0000 7fa378bfc640 1 -- 10.20.193.28:0/1428633099 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b941331640 con 0x55b94176e650 2026-02-20T13:27:31.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.252+0000 7fa378bfc640 10 client.19128 handle_command_reply: tid=0 2026-02-20T13:27:31.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.252+0000 7fa3b79fde00 1 client.19128 shutdown 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94174aed0 msgr2=0x55b94176a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94174aed0 0x55b94176a760 secure :-1 s=READY pgs=1144 gs=1 cs=0 l=1 c_cookie=17826281692914663690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a4011e20 tx=0x7fa3a40268e0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 shutdown_connections 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b94176e650 0x55b94176eaf0 crc :-1 s=READY pgs=301 gs=4 cs=0 l=0 c_cookie=16581912935455178661 s_cookie=9502240275929780490 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b94178c110 0x55b94176bd30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b94176b7f0 0x55b94176ae00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 --2- 10.20.193.28:0/1428633099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b94174aed0 0x55b94176a760 unknown :-1 s=CLOSED pgs=1144 gs=1 cs=0 l=1 c_cookie=17826281692914663690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa378bfc640 0 client.19128 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 >> 10.20.193.28:0/1428633099 conn(0x55b9416611c0 msgr2=0x55b941760050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 shutdown_connections 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 1 -- 10.20.193.28:0/1428633099 wait complete. 2026-02-20T13:27:31.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3b79fde00 20 client.19128 trim_cache size 0 max 16384 2026-02-20T13:27:31.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:27:31.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:27:31.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:27:31.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:27:31.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 -- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3840b5760 msgr2=0x7fa3840d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3840b5760 0x7fa3840d5c10 secure :-1 s=READY pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a4004740 tx=0x7fa3a400b410 comp rx=0 tx=0).stop 2026-02-20T13:27:31.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 -- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0062a40 msgr2=0x7fa3b015cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:31.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0062a40 0x7fa3b015cc60 secure :-1 s=READY pgs=1141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398005db0 tx=0x7fa39800ddf0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 -- 10.20.193.28:0/271796158 shutdown_connections 2026-02-20T13:27:31.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa3840b5760 0x7fa3840d5c10 unknown :-1 s=CLOSED pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3b0062a40 0x7fa3b015cc60 unknown :-1 s=CLOSED pgs=1141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa3b0150e50 0x7fa3b015d860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 --2- 10.20.193.28:0/271796158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa3b0061510 0x7fa3b015c610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:31.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 -- 10.20.193.28:0/271796158 >> 10.20.193.28:0/271796158 conn(0x7fa3b00ea4c0 msgr2=0x7fa3b010a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:31.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 -- 10.20.193.28:0/271796158 shutdown_connections 2026-02-20T13:27:31.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:31.253+0000 7fa3affff640 1 -- 10.20.193.28:0/271796158 wait complete. 2026-02-20T13:27:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:32 trial127 ceph-mon[43817]: pgmap v487: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:27:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:32 trial034 ceph-mon[43332]: pgmap v487: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:27:33.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:32 trial028 ceph-mon[37442]: pgmap v487: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2026-02-20T13:27:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:34 trial127 ceph-mon[43817]: pgmap v488: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:27:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:34 trial034 ceph-mon[43332]: pgmap v488: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:27:35.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:34 trial028 ceph-mon[37442]: pgmap v488: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2026-02-20T13:27:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:36 trial127 ceph-mon[43817]: pgmap v489: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 15 op/s 2026-02-20T13:27:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:36 trial034 ceph-mon[43332]: pgmap v489: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 15 op/s 2026-02-20T13:27:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:36 trial028 ceph-mon[37442]: pgmap v489: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 15 op/s 2026-02-20T13:27:38.902 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:38 trial028 ceph-mon[37442]: pgmap v490: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 15 op/s 2026-02-20T13:27:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:38 trial127 ceph-mon[43817]: pgmap v490: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 15 op/s 2026-02-20T13:27:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:38 trial034 ceph-mon[43332]: pgmap v490: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 15 op/s 2026-02-20T13:27:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:40 trial127 ceph-mon[43817]: pgmap v491: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:27:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:40 trial034 ceph-mon[43332]: pgmap v491: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:27:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:40 trial028 ceph-mon[37442]: pgmap v491: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:27:41.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:27:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:27:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:27:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:27:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:27:41.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:27:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:27:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:27:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:27:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:27:42.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:27:42.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:27:42.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:27:42.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:27:42.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:27:42.878 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:42 trial127 ceph-mon[43817]: pgmap v492: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:27:42.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:42 trial034 ceph-mon[43332]: pgmap v492: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:27:43.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:42 trial028 ceph-mon[37442]: pgmap v492: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.326+0000 7ff908bd2640 1 -- 10.20.193.28:0/696350879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9040609a0 msgr2=0x7ff90410b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.326+0000 7ff908bd2640 1 --2- 10.20.193.28:0/696350879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9040609a0 0x7ff90410b2e0 secure :-1 s=READY pgs=1145 gs=1 cs=0 l=1 c_cookie=3464792338748113024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f0009950 tx=0x7ff8f002f190 comp rx=0 tx=0).stop 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.326+0000 7ff908bd2640 1 -- 10.20.193.28:0/696350879 shutdown_connections 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.326+0000 7ff908bd2640 1 --2- 10.20.193.28:0/696350879 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff90410c490 0x7ff90410c910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.326+0000 7ff908bd2640 1 --2- 10.20.193.28:0/696350879 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff90410b900 0x7ff90410bd70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.326+0000 7ff908bd2640 1 --2- 10.20.193.28:0/696350879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9040609a0 0x7ff90410b2e0 unknown :-1 s=CLOSED pgs=1145 gs=1 cs=0 l=1 c_cookie=3464792338748113024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.326+0000 7ff908bd2640 1 -- 10.20.193.28:0/696350879 >> 10.20.193.28:0/696350879 conn(0x7ff9040e8f40 msgr2=0x7ff904109350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 -- 10.20.193.28:0/696350879 shutdown_connections 2026-02-20T13:27:44.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 -- 10.20.193.28:0/696350879 wait complete. 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 Processor -- start 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 -- start start 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff9040609a0 0x7ff9040f4780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff90410b900 0x7ff9040f4dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff90410c490 0x7ff9040f59d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040f6110 con 0x7ff90410c490 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040f6280 con 0x7ff90410b900 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.327+0000 7ff908bd2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040f6440 con 0x7ff9040609a0 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff903fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff90410c490 0x7ff9040f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff9037fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff9040609a0 0x7ff9040f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff902ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff90410b900 0x7ff9040f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff9037fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff9040609a0 0x7ff9040f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:47012/0 (socket says 10.20.193.28:47012) 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff9037fe640 1 -- 10.20.193.28:0/1667261119 learned_addr learned my addr 10.20.193.28:0/1667261119 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:44.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff903fff640 1 -- 10.20.193.28:0/1667261119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff9040609a0 msgr2=0x7ff9040f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff903fff640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff9040609a0 0x7ff9040f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff903fff640 1 -- 10.20.193.28:0/1667261119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff90410b900 msgr2=0x7ff9040f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff903fff640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff90410b900 0x7ff9040f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff903fff640 1 -- 10.20.193.28:0/1667261119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f0009570 con 0x7ff90410c490 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff903fff640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff90410c490 0x7ff9040f59d0 secure :-1 s=READY pgs=1146 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f800f940 tx=0x7ff8f800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff900ff9640 1 -- 10.20.193.28:0/1667261119 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f800dce0 con 0x7ff90410c490 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff900ff9640 1 -- 10.20.193.28:0/1667261119 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8f800de40 con 0x7ff90410c490 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff900ff9640 1 -- 10.20.193.28:0/1667261119 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f80116b0 con 0x7ff90410c490 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff908bd2640 1 -- 10.20.193.28:0/1667261119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9040f6720 con 0x7ff90410c490 2026-02-20T13:27:44.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.328+0000 7ff908bd2640 1 -- 10.20.193.28:0/1667261119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9040f6c90 con 0x7ff90410c490 2026-02-20T13:27:44.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.331+0000 7ff900ff9640 1 -- 10.20.193.28:0/1667261119 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff8f8020060 con 0x7ff90410c490 2026-02-20T13:27:44.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.332+0000 7ff900ff9640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8d80b5760 0x7ff8d80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.332+0000 7ff900ff9640 1 -- 10.20.193.28:0/1667261119 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff8f8015070 con 0x7ff90410c490 2026-02-20T13:27:44.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff9037fe640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8d80b5760 0x7ff8d80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff9037fe640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8d80b5760 0x7ff8d80d5c10 secure :-1 s=READY pgs=497 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f00023d0 tx=0x7ff8f003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:44.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff90c44be00 1 Processor -- start 2026-02-20T13:27:44.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff90c44be00 1 -- start start 2026-02-20T13:27:44.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x55715581f8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x5571558401c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155860ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff90c44be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557155714fd0 con 0x557155840700 2026-02-20T13:27:44.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff90c44be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557155710d00 con 0x5571557ff4c0 2026-02-20T13:27:44.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.333+0000 7ff90c44be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55715570aca0 con 0x55715581fde0 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff9037fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x55715581f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff903fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155860ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff9037fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x55715581f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57312/0 (socket says 10.20.193.28:57312) 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff9037fe640 1 -- 10.20.193.28:0/2515271369 learned_addr learned my addr 10.20.193.28:0/2515271369 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff902ffd640 1 --2- 10.20.193.28:0/2515271369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x5571558401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff903fff640 1 -- 10.20.193.28:0/2515271369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 msgr2=0x5571558401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff903fff640 1 --2- 10.20.193.28:0/2515271369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x5571558401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff903fff640 1 -- 10.20.193.28:0/2515271369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 msgr2=0x55715581f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff903fff640 1 --2- 10.20.193.28:0/2515271369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x55715581f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff903fff640 1 -- 10.20.193.28:0/2515271369 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571556ad8b0 con 0x557155840700 2026-02-20T13:27:44.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff903fff640 1 --2- 10.20.193.28:0/2515271369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155860ae0 secure :-1 s=READY pgs=1147 gs=2 cs=0 l=1 c_cookie=6982777340295101622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f80e56a0 tx=0x7ff8f8006580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e7cefea1efbcb6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff8cf7fe640 1 -- 10.20.193.28:0/2515271369 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f80b3c50 con 0x557155840700 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff8cf7fe640 1 -- 10.20.193.28:0/2515271369 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8f80b6230 con 0x557155840700 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff8cf7fe640 1 -- 10.20.193.28:0/2515271369 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f80adad0 con 0x557155840700 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 -- 10.20.193.28:0/2515271369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 msgr2=0x557155860ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 --2- 10.20.193.28:0/2515271369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155860ae0 secure :-1 s=READY pgs=1147 gs=2 cs=0 l=1 c_cookie=6982777340295101622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f80e56a0 tx=0x7ff8f8006580 comp rx=0 tx=0).stop 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 -- 10.20.193.28:0/2515271369 shutdown_connections 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 --2- 10.20.193.28:0/2515271369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155860ae0 unknown :-1 s=CLOSED pgs=1147 gs=2 cs=0 l=1 c_cookie=6982777340295101622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 --2- 10.20.193.28:0/2515271369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x5571558401c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 --2- 10.20.193.28:0/2515271369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x55715581f8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 -- 10.20.193.28:0/2515271369 >> 10.20.193.28:0/2515271369 conn(0x55715571e1c0 msgr2=0x5571557fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 -- 10.20.193.28:0/2515271369 shutdown_connections 2026-02-20T13:27:44.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.334+0000 7ff90c44be00 1 -- 10.20.193.28:0/2515271369 wait complete. 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.336+0000 7ff90c44be00 1 -- start start 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.336+0000 7ff90c44be00 1 Processor -- start 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.336+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155818b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.336+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x5571558191b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.336+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155819c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.336+0000 7ff90c44be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55715581a270 con 0x557155840700 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.336+0000 7ff90c44be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55715581a3e0 con 0x5571557ff4c0 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.336+0000 7ff90c44be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55715581a5a0 con 0x55715581fde0 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff902ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x5571558191b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff9037fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155818b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff903fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155819c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff9037fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155818b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57322/0 (socket says 10.20.193.28:57322) 2026-02-20T13:27:44.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff9037fe640 1 -- 10.20.193.28:0/1963597510 learned_addr learned my addr 10.20.193.28:0/1963597510 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:44.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff903fff640 1 -- 10.20.193.28:0/1963597510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 msgr2=0x5571558191b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:44.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff903fff640 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x5571558191b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff903fff640 1 -- 10.20.193.28:0/1963597510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 msgr2=0x557155818b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:44.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff903fff640 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155818b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff903fff640 1 -- 10.20.193.28:0/1963597510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571556b6400 con 0x557155840700 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff903fff640 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155819c10 secure :-1 s=READY pgs=1148 gs=3 cs=0 l=1 c_cookie=2782794176436154687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f80e56a0 tx=0x7ff8f8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269e788f4180b13f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff8ccff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1963597510 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f80b9070 con 0x557155840700 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1963597510 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8f80b3c50 con 0x557155840700 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1963597510 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f80abf10 con 0x557155840700 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9040f6c90 con 0x557155840700 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1963597510 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff8f8073310 con 0x557155840700 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff8ccff9640 10 client.19140 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff90c44be00 10 client.19140 _ll_register_callbacks cb 0x557155695a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.337+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5571553aa520 con 0x557155840700 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1963597510 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8f80b6230 con 0x557155840700 2026-02-20T13:27:44.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff90c44be00 10 client.19140 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55715568eda0 con 0x557155840700 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1963597510 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8f8073030 con 0x557155840700 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff90c44be00 10 client.19140 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff90c44be00 10 client.19140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff90c44be00 20 client.19140 populate_metadata read hostname 'trial028' 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55715581cf60 0x55715581d400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff90c44be00 4 client.19140 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55715573c630 con 0x55715581cf60 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.338+0000 7ff9037fe640 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55715581cf60 0x55715581d400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff9037fe640 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55715581cf60 0x55715581d400 crc :-1 s=READY pgs=302 gs=4 cs=0 l=0 c_cookie=9594897833730916018 s_cookie=3604547274451980440 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8527ecbe6bb23eb2 server_cookie=3205eca5fdd01098 in_seq=0 out_seq=0 2026-02-20T13:27:44.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff8ccff9640 10 client.19140 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:44.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1963597510 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55715573c630 con 0x55715581cf60 2026-02-20T13:27:44.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff8ccff9640 10 client.19140 handle_command_reply: tid=0 2026-02-20T13:27:44.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 client.19140 shutdown 2026-02-20T13:27:44.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 msgr2=0x557155819c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155819c10 secure :-1 s=READY pgs=1148 gs=3 cs=0 l=1 c_cookie=2782794176436154687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f80e56a0 tx=0x7ff8f8006000 comp rx=0 tx=0).stop 2026-02-20T13:27:44.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 shutdown_connections 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55715581cf60 0x55715581d400 crc :-1 s=READY pgs=302 gs=4 cs=0 l=0 c_cookie=9594897833730916018 s_cookie=3604547274451980440 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155819c10 unknown :-1 s=CLOSED pgs=1148 gs=3 cs=0 l=1 c_cookie=2782794176436154687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x5571558191b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1963597510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155818b60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 >> 10.20.193.28:0/1963597510 conn(0x55715571e1c0 msgr2=0x557155800790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff8ccff9640 0 client.19140 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 shutdown_connections 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.339+0000 7ff90c44be00 1 -- 10.20.193.28:0/1963597510 wait complete. 2026-02-20T13:27:44.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.340+0000 7ff90c44be00 20 client.19140 trim_cache size 0 max 16384 2026-02-20T13:27:44.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.347+0000 7ff90c44be00 1 Processor -- start 2026-02-20T13:27:44.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.347+0000 7ff90c44be00 1 -- start start 2026-02-20T13:27:44.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5571557ff4c0 0x55715583e5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x55715583eb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557155840700 0x55715583f040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff90c44be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5571557088d0 con 0x5571557ff4c0 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff90c44be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557155449f10 con 0x557155840700 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff90c44be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5571557d4410 con 0x55715581fde0 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff902ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x55715583eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff9037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5571557ff4c0 0x55715583e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff902ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x55715583eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:47044/0 (socket says 10.20.193.28:47044) 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff902ffd640 1 -- 10.20.193.28:0/3637202369 learned_addr learned my addr 10.20.193.28:0/3637202369 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff903fff640 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557155840700 0x55715583f040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff9037fe640 1 -- 10.20.193.28:0/3637202369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 msgr2=0x55715583eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff9037fe640 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x55715583eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff9037fe640 1 -- 10.20.193.28:0/3637202369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557155840700 msgr2=0x55715583f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff9037fe640 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557155840700 0x55715583f040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff9037fe640 1 -- 10.20.193.28:0/3637202369 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571556a0670 con 0x5571557ff4c0 2026-02-20T13:27:44.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff902ffd640 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x55715583eb00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:44.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.348+0000 7ff9037fe640 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5571557ff4c0 0x55715583e5c0 secure :-1 s=READY pgs=1149 gs=1 cs=0 l=1 c_cookie=2918905201158646430 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f0005f70 tx=0x7ff8f0043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288208d0c019ea9e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:44.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff8ceffd640 1 -- 10.20.193.28:0/3637202369 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f0058070 con 0x5571557ff4c0 2026-02-20T13:27:44.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff8ceffd640 1 -- 10.20.193.28:0/3637202369 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8f003e040 con 0x5571557ff4c0 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff8ceffd640 1 -- 10.20.193.28:0/3637202369 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f0038dd0 con 0x5571557ff4c0 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 -- 10.20.193.28:0/3637202369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5571557ff4c0 msgr2=0x55715583e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5571557ff4c0 0x55715583e5c0 secure :-1 s=READY pgs=1149 gs=1 cs=0 l=1 c_cookie=2918905201158646430 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f0005f70 tx=0x7ff8f0043000 comp rx=0 tx=0).stop 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 -- 10.20.193.28:0/3637202369 shutdown_connections 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557155840700 0x55715583f040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x55715583eb00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 --2- 10.20.193.28:0/3637202369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5571557ff4c0 0x55715583e5c0 unknown :-1 s=CLOSED pgs=1149 gs=1 cs=0 l=1 c_cookie=2918905201158646430 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 -- 10.20.193.28:0/3637202369 >> 10.20.193.28:0/3637202369 conn(0x55715571e1c0 msgr2=0x557155814e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 -- 10.20.193.28:0/3637202369 shutdown_connections 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 -- 10.20.193.28:0/3637202369 wait complete. 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.349+0000 7ff90c44be00 1 -- start start 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff90c44be00 1 Processor -- start 2026-02-20T13:27:44.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155825aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x557155824840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff90c44be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155824d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff90c44be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5571558262b0 con 0x557155840700 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff90c44be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5571558252c0 con 0x5571557ff4c0 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff90c44be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557155825480 con 0x55715581fde0 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff9037fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155825aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff903fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155824d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff902ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x557155824840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff902ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x557155824840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:47060/0 (socket says 10.20.193.28:47060) 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff902ffd640 1 -- 10.20.193.28:0/1347644518 learned_addr learned my addr 10.20.193.28:0/1347644518 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff903fff640 1 -- 10.20.193.28:0/1347644518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 msgr2=0x557155824840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff903fff640 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x557155824840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff903fff640 1 -- 10.20.193.28:0/1347644518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 msgr2=0x557155825aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff903fff640 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155825aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.350+0000 7ff903fff640 1 -- 10.20.193.28:0/1347644518 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f004c040 con 0x557155840700 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff903fff640 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155824d80 secure :-1 s=READY pgs=1150 gs=3 cs=0 l=1 c_cookie=13897141874619822012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f80aa250 tx=0x7ff8f80064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0dc90e79debafbc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff8ccff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1347644518 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f80b9070 con 0x557155840700 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1347644518 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5571553aa520 con 0x557155840700 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f4004280 con 0x557155840700 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1347644518 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f80b62c0 con 0x557155840700 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 10 client.19146 _ll_register_callbacks cb 0x557155695a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55715543c250 con 0x557155840700 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1347644518 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff8f80b3c50 con 0x557155840700 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1347644518 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8f80aee40 con 0x557155840700 2026-02-20T13:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 10 client.19146 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55715569b0f0 con 0x557155840700 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1347644518 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8f8073040 con 0x557155840700 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 10 client.19146 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 10 client.19146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 20 client.19146 populate_metadata read hostname 'trial028' 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5571558ed320 0x55715590d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 4 client.19146 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5571557baca0 con 0x5571558ed320 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.351+0000 7ff9037fe640 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5571558ed320 0x55715590d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.352+0000 7ff9037fe640 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5571558ed320 0x55715590d7a0 crc :-1 s=READY pgs=303 gs=4 cs=0 l=0 c_cookie=14474824188800688447 s_cookie=900611539465295190 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8e0e7e8a7b2613f server_cookie=c7f9d6c6a725556 in_seq=0 out_seq=0 2026-02-20T13:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.352+0000 7ff8ccff9640 10 client.19146 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff8ccff9640 1 -- 10.20.193.28:0/1347644518 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5571557baca0 con 0x5571558ed320 2026-02-20T13:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff8ccff9640 10 client.19146 handle_command_reply: tid=0 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 client.19146 shutdown 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 msgr2=0x557155824d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155824d80 secure :-1 s=READY pgs=1150 gs=3 cs=0 l=1 c_cookie=13897141874619822012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f80aa250 tx=0x7ff8f80064e0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 shutdown_connections 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5571558ed320 0x55715590d7a0 crc :-1 s=READY pgs=303 gs=4 cs=0 l=0 c_cookie=14474824188800688447 s_cookie=900611539465295190 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557155840700 0x557155824d80 unknown :-1 s=CLOSED pgs=1150 gs=3 cs=0 l=1 c_cookie=13897141874619822012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55715581fde0 0x557155824840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 --2- 10.20.193.28:0/1347644518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5571557ff4c0 0x557155825aa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff8ccff9640 0 client.19146 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.356+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 >> 10.20.193.28:0/1347644518 conn(0x55715571e1c0 msgr2=0x557155815660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 shutdown_connections 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff90c44be00 1 -- 10.20.193.28:0/1347644518 wait complete. 2026-02-20T13:27:44.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff90c44be00 20 client.19146 trim_cache size 0 max 16384 2026-02-20T13:27:44.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:27:44.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:27:44.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:27:44.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 -- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8d80b5760 msgr2=0x7ff8d80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8d80b5760 0x7ff8d80d5c10 secure :-1 s=READY pgs=497 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f00023d0 tx=0x7ff8f003a040 comp rx=0 tx=0).stop 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 -- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff90410c490 msgr2=0x7ff9040f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff90410c490 0x7ff9040f59d0 secure :-1 s=READY pgs=1146 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f800f940 tx=0x7ff8f800fe10 comp rx=0 tx=0).stop 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 -- 10.20.193.28:0/1667261119 shutdown_connections 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8d80b5760 0x7ff8d80d5c10 unknown :-1 s=CLOSED pgs=497 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff90410c490 0x7ff9040f59d0 unknown :-1 s=CLOSED pgs=1146 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff90410b900 0x7ff9040f4dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 --2- 10.20.193.28:0/1667261119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff9040609a0 0x7ff9040f4780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 -- 10.20.193.28:0/1667261119 >> 10.20.193.28:0/1667261119 conn(0x7ff9040e8f40 msgr2=0x7ff9040eabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 -- 10.20.193.28:0/1667261119 shutdown_connections 2026-02-20T13:27:44.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:44.357+0000 7ff908bd2640 1 -- 10.20.193.28:0/1667261119 wait complete. 2026-02-20T13:27:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:44 trial127 ceph-mon[43817]: pgmap v493: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:27:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:44 trial034 ceph-mon[43332]: pgmap v493: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:27:45.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:44 trial028 ceph-mon[37442]: pgmap v493: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2026-02-20T13:27:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:46 trial127 ceph-mon[43817]: pgmap v494: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:27:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:46 trial034 ceph-mon[43332]: pgmap v494: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:27:47.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:46 trial028 ceph-mon[37442]: pgmap v494: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2026-02-20T13:27:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:48 trial127 ceph-mon[43817]: pgmap v495: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:27:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:48 trial034 ceph-mon[43332]: pgmap v495: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:27:49.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:48 trial028 ceph-mon[37442]: pgmap v495: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:27:49.172 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:27:49.358 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.536+0000 7f7401f7d640 1 -- 10.20.193.28:0/2726506277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc113430 msgr2=0x7f73fc173e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.536+0000 7f7401f7d640 1 --2- 10.20.193.28:0/2726506277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc113430 0x7f73fc173e00 secure :-1 s=READY pgs=1151 gs=1 cs=0 l=1 c_cookie=17547184994151601505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73f800aa30 tx=0x7f73f8030270 comp rx=0 tx=0).stop 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.536+0000 7f7401f7d640 1 -- 10.20.193.28:0/2726506277 shutdown_connections 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.536+0000 7f7401f7d640 1 --2- 10.20.193.28:0/2726506277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc113430 0x7f73fc173e00 unknown :-1 s=CLOSED pgs=1151 gs=1 cs=0 l=1 c_cookie=17547184994151601505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.536+0000 7f7401f7d640 1 --2- 10.20.193.28:0/2726506277 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73fc10dc30 0x7f73fc112c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.536+0000 7f7401f7d640 1 --2- 10.20.193.28:0/2726506277 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73fc10d240 0x7f73fc10d610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.536+0000 7f7401f7d640 1 -- 10.20.193.28:0/2726506277 >> 10.20.193.28:0/2726506277 conn(0x7f73fc0eaad0 msgr2=0x7f73fc10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.536+0000 7f7401f7d640 1 -- 10.20.193.28:0/2726506277 shutdown_connections 2026-02-20T13:27:49.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.537+0000 7f7401f7d640 1 -- 10.20.193.28:0/2726506277 wait complete. 2026-02-20T13:27:49.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7401f7d640 1 Processor -- start 2026-02-20T13:27:49.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7401f7d640 1 -- start start 2026-02-20T13:27:49.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7401f7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc10d240 0x7f73fc0f5720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7401f7d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73fc10dc30 0x7f73fc173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7401f7d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73fc113430 0x7f73fc0f5e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7401f7d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0fb030 con 0x7f73fc10d240 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7401f7d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0fb1a0 con 0x7f73fc113430 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7401f7d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0fb360 con 0x7f73fc10dc30 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7400f7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc10d240 0x7f73fc0f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f740177c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73fc113430 0x7f73fc0f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7400f7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc10d240 0x7f73fc0f5720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57262/0 (socket says 10.20.193.28:57262) 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f73f3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73fc10dc30 0x7f73fc173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:49.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.538+0000 7f7400f7b640 1 -- 10.20.193.28:0/3135224816 learned_addr learned my addr 10.20.193.28:0/3135224816 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f7400f7b640 1 -- 10.20.193.28:0/3135224816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73fc10dc30 msgr2=0x7f73fc173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f7400f7b640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73fc10dc30 0x7f73fc173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f7400f7b640 1 -- 10.20.193.28:0/3135224816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73fc113430 msgr2=0x7f73fc0f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f7400f7b640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73fc113430 0x7f73fc0f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f7400f7b640 1 -- 10.20.193.28:0/3135224816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f800a650 con 0x7f73fc10d240 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f740177c640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73fc113430 0x7f73fc0f5e20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f7400f7b640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc10d240 0x7f73fc0f5720 secure :-1 s=READY pgs=1152 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73ec009480 tx=0x7f73ec00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f73f1ffb640 1 -- 10.20.193.28:0/3135224816 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73ec00cd40 con 0x7f73fc10d240 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f73f1ffb640 1 -- 10.20.193.28:0/3135224816 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f73ec004d30 con 0x7f73fc10d240 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc0fb640 con 0x7f73fc10d240 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f73f1ffb640 1 -- 10.20.193.28:0/3135224816 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73ec0106b0 con 0x7f73fc10d240 2026-02-20T13:27:49.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.539+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc0fbb60 con 0x7f73fc10d240 2026-02-20T13:27:49.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.541+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73fc10e520 con 0x7f73fc10d240 2026-02-20T13:27:49.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.542+0000 7f73f1ffb640 1 -- 10.20.193.28:0/3135224816 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f73ec01f060 con 0x7f73fc10d240 2026-02-20T13:27:49.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.544+0000 7f73f1ffb640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73d80b5750 0x7f73d80d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:49.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.544+0000 7f73f1ffb640 1 -- 10.20.193.28:0/3135224816 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f73ec014070 con 0x7f73fc10d240 2026-02-20T13:27:49.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.544+0000 7f73f3fff640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73d80b5750 0x7f73d80d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:49.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.545+0000 7f73f3fff640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73d80b5750 0x7f73d80d5c00 secure :-1 s=READY pgs=498 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73fc0fc0c0 tx=0x7f73e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:49.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.545+0000 7f73f1ffb640 1 -- 10.20.193.28:0/3135224816 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f73ec0a9690 con 0x7f73fc10d240 2026-02-20T13:27:49.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.688+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73fc0f6880 con 0x7f73fc10d240 2026-02-20T13:27:49.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.689+0000 7f73f1ffb640 1 -- 10.20.193.28:0/3135224816 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f73ec096090 con 0x7f73fc10d240 2026-02-20T13:27:49.692 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:27:49.692 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:27:49.693 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:27:49.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73d80b5750 msgr2=0x7f73d80d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:49.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73d80b5750 0x7f73d80d5c00 secure :-1 s=READY pgs=498 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73fc0fc0c0 tx=0x7f73e4005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:49.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc10d240 msgr2=0x7f73fc0f5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:49.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc10d240 0x7f73fc0f5720 secure :-1 s=READY pgs=1152 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73ec009480 tx=0x7f73ec00ee60 comp rx=0 tx=0).stop 2026-02-20T13:27:49.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 shutdown_connections 2026-02-20T13:27:49.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73d80b5750 0x7f73d80d5c00 unknown :-1 s=CLOSED pgs=498 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73fc113430 0x7f73fc0f5e20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73fc10dc30 0x7f73fc173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 --2- 10.20.193.28:0/3135224816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73fc10d240 0x7f73fc0f5720 unknown :-1 s=CLOSED pgs=1152 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:49.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 >> 10.20.193.28:0/3135224816 conn(0x7f73fc0eaad0 msgr2=0x7f73fc10bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:49.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 shutdown_connections 2026-02-20T13:27:49.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:49.690+0000 7f7401f7d640 1 -- 10.20.193.28:0/3135224816 wait complete. 2026-02-20T13:27:49.792 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id d12c1745 --release --await' 2026-02-20T13:27:49.793 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id d12c1745 --release --await 2026-02-20T13:27:49.977 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:50.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 -- 10.20.193.28:0/4118363390 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a2c0614f0 msgr2=0x7f2a2c061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 --2- 10.20.193.28:0/4118363390 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a2c0614f0 0x7f2a2c061920 secure :-1 s=READY pgs=345 gs=2 cs=0 l=1 c_cookie=6911254661608513110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c009950 tx=0x7f2a1c02f190 comp rx=0 tx=0).stop 2026-02-20T13:27:50.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 -- 10.20.193.28:0/4118363390 shutdown_connections 2026-02-20T13:27:50.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 --2- 10.20.193.28:0/4118363390 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a2c159d80 0x7f2a2c17a160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 --2- 10.20.193.28:0/4118363390 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a2c0614f0 0x7f2a2c061920 unknown :-1 s=CLOSED pgs=345 gs=2 cs=0 l=1 c_cookie=6911254661608513110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 --2- 10.20.193.28:0/4118363390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a2c062ae0 0x7f2a2c060fb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 -- 10.20.193.28:0/4118363390 >> 10.20.193.28:0/4118363390 conn(0x7f2a2c0eab00 msgr2=0x7f2a2c10af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:50.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 -- 10.20.193.28:0/4118363390 shutdown_connections 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.168+0000 7f2a315e8640 1 -- 10.20.193.28:0/4118363390 wait complete. 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.169+0000 7f2a315e8640 1 Processor -- start 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.169+0000 7f2a315e8640 1 -- start start 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.169+0000 7f2a315e8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a2c0614f0 0x7f2a2c0f2e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.169+0000 7f2a315e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a2c062ae0 0x7f2a2c0f33c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.169+0000 7f2a315e8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a2c159d80 0x7f2a2c0f8790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.169+0000 7f2a315e8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c0f8db0 con 0x7f2a2c062ae0 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.169+0000 7f2a315e8640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c0f8f20 con 0x7f2a2c0614f0 2026-02-20T13:27:50.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.169+0000 7f2a315e8640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c0f90e0 con 0x7f2a2c159d80 2026-02-20T13:27:50.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a2c0614f0 0x7f2a2c0f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a2c062ae0 0x7f2a2c0f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a2c0614f0 0x7f2a2c0f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51036/0 (socket says 10.20.193.28:51036) 2026-02-20T13:27:50.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2bfff640 1 -- 10.20.193.28:0/3061109652 learned_addr learned my addr 10.20.193.28:0/3061109652 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:50.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a30de7640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a2c159d80 0x7f2a2c0f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/3061109652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a2c159d80 msgr2=0x7f2a2c0f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a2c159d80 0x7f2a2c0f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/3061109652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a2c0614f0 msgr2=0x7f2a2c0f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a2c0614f0 0x7f2a2c0f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/3061109652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a180094b0 con 0x7f2a2c062ae0 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a2c062ae0 0x7f2a2c0f33c0 secure :-1 s=READY pgs=1153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c02f6a0 tx=0x7f2a1c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a297fa640 1 -- 10.20.193.28:0/3061109652 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c03d070 con 0x7f2a2c062ae0 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a297fa640 1 -- 10.20.193.28:0/3061109652 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a1c002ad0 con 0x7f2a2c062ae0 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a315e8640 1 -- 10.20.193.28:0/3061109652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1c009570 con 0x7f2a2c062ae0 2026-02-20T13:27:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.170+0000 7f2a297fa640 1 -- 10.20.193.28:0/3061109652 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c041820 con 0x7f2a2c062ae0 2026-02-20T13:27:50.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.171+0000 7f2a315e8640 1 -- 10.20.193.28:0/3061109652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2c0f9900 con 0x7f2a2c062ae0 2026-02-20T13:27:50.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.174+0000 7f2a297fa640 1 -- 10.20.193.28:0/3061109652 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2a1c02f9f0 con 0x7f2a2c062ae0 2026-02-20T13:27:50.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.175+0000 7f2a297fa640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a000b5760 0x7f2a000d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.175+0000 7f2a297fa640 1 -- 10.20.193.28:0/3061109652 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2a1c10b0a0 con 0x7f2a2c062ae0 2026-02-20T13:27:50.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a000b5760 0x7f2a000d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a3486be00 1 Processor -- start 2026-02-20T13:27:50.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a3486be00 1 -- start start 2026-02-20T13:27:50.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a000b5760 0x7f2a000d5c10 secure :-1 s=READY pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a18005c70 tx=0x7f2a18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206520 0x559b112068f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1124b590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b1124bad0 0x559b1126beb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a3486be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b1111bc70 con 0x559b11206520 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a3486be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b111179a0 con 0x559b1124bad0 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.176+0000 7f2a3486be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b11111b00 con 0x559b11206e30 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206520 0x559b112068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1124b590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206520 0x559b112068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48448/0 (socket says 10.20.193.28:48448) 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 -- 10.20.193.28:0/3521801159 learned_addr learned my addr 10.20.193.28:0/3521801159 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:50.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 -- 10.20.193.28:0/3521801159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 msgr2=0x559b1124b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/3521801159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1124b590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 -- 10.20.193.28:0/3521801159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b1124bad0 msgr2=0x559b1126beb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/3521801159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b1124bad0 0x559b1126beb0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 -- 10.20.193.28:0/3521801159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b110bcf80 con 0x559b11206520 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/3521801159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1124b590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/3521801159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206520 0x559b112068f0 secure :-1 s=READY pgs=1154 gs=1 cs=0 l=1 c_cookie=18039313664850306550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a18009ec0 tx=0x7f2a18014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa588433a940a5f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f29fcce3640 1 -- 10.20.193.28:0/3521801159 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a18012d80 con 0x559b11206520 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f29fcce3640 1 -- 10.20.193.28:0/3521801159 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a18016070 con 0x559b11206520 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.177+0000 7f29fcce3640 1 -- 10.20.193.28:0/3521801159 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1801b8b0 con 0x559b11206520 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 -- 10.20.193.28:0/3521801159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206520 msgr2=0x559b112068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 --2- 10.20.193.28:0/3521801159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206520 0x559b112068f0 secure :-1 s=READY pgs=1154 gs=1 cs=0 l=1 c_cookie=18039313664850306550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a18009ec0 tx=0x7f2a18014000 comp rx=0 tx=0).stop 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 -- 10.20.193.28:0/3521801159 shutdown_connections 2026-02-20T13:27:50.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 --2- 10.20.193.28:0/3521801159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b1124bad0 0x559b1126beb0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 --2- 10.20.193.28:0/3521801159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1124b590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 --2- 10.20.193.28:0/3521801159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206520 0x559b112068f0 unknown :-1 s=CLOSED pgs=1154 gs=1 cs=0 l=1 c_cookie=18039313664850306550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 -- 10.20.193.28:0/3521801159 >> 10.20.193.28:0/3521801159 conn(0x559b11124a60 msgr2=0x559b11204e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:50.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 -- 10.20.193.28:0/3521801159 shutdown_connections 2026-02-20T13:27:50.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.178+0000 7f2a3486be00 1 -- 10.20.193.28:0/3521801159 wait complete. 2026-02-20T13:27:50.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.179+0000 7f2a3486be00 1 -- start start 2026-02-20T13:27:50.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.179+0000 7f2a3486be00 1 Processor -- start 2026-02-20T13:27:50.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121e640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1121eb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b1124bad0 0x559b11223b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a3486be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b112240b0 con 0x559b1124bad0 2026-02-20T13:27:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a3486be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b11224220 con 0x559b11206520 2026-02-20T13:27:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a3486be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b112243e0 con 0x559b11206e30 2026-02-20T13:27:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a30de7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b1124bad0 0x559b11223b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a2bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121e640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a2bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121e640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51060/0 (socket says 10.20.193.28:51060) 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a2bfff640 1 -- 10.20.193.28:0/138162171 learned_addr learned my addr 10.20.193.28:0/138162171 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1121eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a30de7640 1 -- 10.20.193.28:0/138162171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 msgr2=0x559b1121eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a30de7640 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1121eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a30de7640 1 -- 10.20.193.28:0/138162171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 msgr2=0x559b1121e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a30de7640 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121e640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a30de7640 1 -- 10.20.193.28:0/138162171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a18002e20 con 0x559b1124bad0 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f2a30de7640 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b1124bad0 0x559b11223b70 secure :-1 s=READY pgs=1155 gs=2 cs=0 l=1 c_cookie=16819081448821232794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a20003c20 tx=0x7f2a2000aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9696177655a149a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.180+0000 7f29edffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f29edffb640 1 -- 10.20.193.28:0/138162171 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a20012870 con 0x559b1124bad0 2026-02-20T13:27:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f29edffb640 1 -- 10.20.193.28:0/138162171 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a2001b470 con 0x559b1124bad0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f29edffb640 1 -- 10.20.193.28:0/138162171 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a200116c0 con 0x559b1124bad0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2c0f9900 con 0x559b1124bad0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f29edffb640 1 -- 10.20.193.28:0/138162171 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2a200129d0 con 0x559b1124bad0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 10 client.19164 _ll_register_callbacks cb 0x559b11092d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559b10da7ba0 con 0x559b1124bad0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f29edffb640 1 -- 10.20.193.28:0/138162171 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a2001b5e0 con 0x559b1124bad0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 10 client.19164 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559b11095710 con 0x559b1124bad0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f29edffb640 1 -- 10.20.193.28:0/138162171 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a20012bd0 con 0x559b1124bad0 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 10 client.19164 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 10 client.19164 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 20 client.19164 populate_metadata read hostname 'trial028' 2026-02-20T13:27:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b11248e30 0x559b112492d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 4 client.19164 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.181+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b110e4410 con 0x559b11248e30 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.182+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b11248e30 0x559b112492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.182+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b11248e30 0x559b112492d0 crc :-1 s=READY pgs=304 gs=4 cs=0 l=0 c_cookie=4817766701048852626 s_cookie=5210192837777397396 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42dc2549fab8f092 server_cookie=484e52c7fb019694 in_seq=0 out_seq=0 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.182+0000 7f29edffb640 10 client.19164 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f29edffb640 1 -- 10.20.193.28:0/138162171 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559b110e4410 con 0x559b11248e30 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f29edffb640 10 client.19164 handle_command_reply: tid=0 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 client.19164 shutdown 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b1124bad0 msgr2=0x559b11223b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b1124bad0 0x559b11223b70 secure :-1 s=READY pgs=1155 gs=2 cs=0 l=1 c_cookie=16819081448821232794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a20003c20 tx=0x7f2a2000aa00 comp rx=0 tx=0).stop 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 shutdown_connections 2026-02-20T13:27:50.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b11248e30 0x559b112492d0 crc :-1 s=READY pgs=304 gs=4 cs=0 l=0 c_cookie=4817766701048852626 s_cookie=5210192837777397396 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b1124bad0 0x559b11223b70 unknown :-1 s=CLOSED pgs=1155 gs=2 cs=0 l=1 c_cookie=16819081448821232794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b11206e30 0x559b1121eb80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f29edffb640 0 client.19164 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 --2- 10.20.193.28:0/138162171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121e640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 >> 10.20.193.28:0/138162171 conn(0x559b11124a60 msgr2=0x559b11205510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 shutdown_connections 2026-02-20T13:27:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 1 -- 10.20.193.28:0/138162171 wait complete. 2026-02-20T13:27:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.183+0000 7f2a3486be00 20 client.19164 trim_cache size 0 max 16384 2026-02-20T13:27:50.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.192+0000 7f2a3486be00 1 Processor -- start 2026-02-20T13:27:50.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.192+0000 7f2a3486be00 1 -- start start 2026-02-20T13:27:50.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.192+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121bc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.192+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b11244050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.192+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11244590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.192+0000 7f2a3486be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b1110f730 con 0x559b11206e30 2026-02-20T13:27:50.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.192+0000 7f2a3486be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b10dcf960 con 0x559b11206520 2026-02-20T13:27:50.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.192+0000 7f2a3486be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b11175340 con 0x559b1124bad0 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a2bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a30de7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11244590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a30de7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11244590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36040/0 (socket says 10.20.193.28:36040) 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a30de7640 1 -- 10.20.193.28:0/1062363458 learned_addr learned my addr 10.20.193.28:0/1062363458 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b11244050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/1062363458 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 msgr2=0x559b11244590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11244590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/1062363458 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 msgr2=0x559b1121bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/1062363458 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b11210f50 con 0x559b11206e30 2026-02-20T13:27:50.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a30de7640 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11244590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b11244050 secure :-1 s=READY pgs=1156 gs=3 cs=0 l=1 c_cookie=11450454948328680099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c108c60 tx=0x7f2a1c038ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee8301bbfbeaaa3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f29effff640 1 -- 10.20.193.28:0/1062363458 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c048e80 con 0x559b11206e30 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f29effff640 1 -- 10.20.193.28:0/1062363458 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a1c0d1e40 con 0x559b11206e30 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.193+0000 7f29effff640 1 -- 10.20.193.28:0/1062363458 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c0d0fe0 con 0x559b11206e30 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 -- 10.20.193.28:0/1062363458 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 msgr2=0x559b11244050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b11244050 secure :-1 s=READY pgs=1156 gs=3 cs=0 l=1 c_cookie=11450454948328680099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c108c60 tx=0x7f2a1c038ec0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 -- 10.20.193.28:0/1062363458 shutdown_connections 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b11244050 unknown :-1 s=CLOSED pgs=1156 gs=3 cs=0 l=1 c_cookie=11450454948328680099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11244590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1062363458 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b1121bc10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 -- 10.20.193.28:0/1062363458 >> 10.20.193.28:0/1062363458 conn(0x559b11124a60 msgr2=0x559b1121d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:50.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 -- 10.20.193.28:0/1062363458 shutdown_connections 2026-02-20T13:27:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 -- 10.20.193.28:0/1062363458 wait complete. 2026-02-20T13:27:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.194+0000 7f2a3486be00 1 -- start start 2026-02-20T13:27:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a3486be00 1 Processor -- start 2026-02-20T13:27:50.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b11229e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b1122a370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a3486be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11228bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a3486be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559b1122aa70 con 0x559b11206e30 2026-02-20T13:27:50.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a3486be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559b11229100 con 0x559b11206520 2026-02-20T13:27:50.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a3486be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559b112292c0 con 0x559b1124bad0 2026-02-20T13:27:50.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b11229e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b1122a370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a30de7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11228bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b1122a370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48490/0 (socket says 10.20.193.28:48490) 2026-02-20T13:27:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/1510762657 learned_addr learned my addr 10.20.193.28:0/1510762657 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/1510762657 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 msgr2=0x559b11228bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11228bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/1510762657 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 msgr2=0x559b11229e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b11229e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/1510762657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c009570 con 0x559b11206e30 2026-02-20T13:27:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f2a2b7fe640 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b1122a370 secure :-1 s=READY pgs=1157 gs=1 cs=0 l=1 c_cookie=6998227553780155788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c032040 tx=0x7f2a1c038c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611eb2e1c86ac58c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.195+0000 7f29edffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f29edffb640 1 -- 10.20.193.28:0/1510762657 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c0d1200 con 0x559b11206e30 2026-02-20T13:27:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f29edffb640 1 -- 10.20.193.28:0/1510762657 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a1c048e80 con 0x559b11206e30 2026-02-20T13:27:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f29edffb640 1 -- 10.20.193.28:0/1510762657 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c0dc0f0 con 0x559b11206e30 2026-02-20T13:27:50.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b11095710 con 0x559b11206e30 2026-02-20T13:27:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f29edffb640 1 -- 10.20.193.28:0/1510762657 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2a1c0dc290 con 0x559b11206e30 2026-02-20T13:27:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f29edffb640 10 client.19170 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 10 client.19170 _ll_register_callbacks cb 0x559b11092d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a18016070 con 0x559b11206e30 2026-02-20T13:27:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f29edffb640 1 -- 10.20.193.28:0/1510762657 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a1c0dc580 con 0x559b11206e30 2026-02-20T13:27:50.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 10 client.19170 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559b110a7350 con 0x559b11206e30 2026-02-20T13:27:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f29edffb640 1 -- 10.20.193.28:0/1510762657 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a1c0f3060 con 0x559b11206e30 2026-02-20T13:27:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 10 client.19170 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 10 client.19170 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:27:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 20 client.19170 populate_metadata read hostname 'trial028' 2026-02-20T13:27:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b112f93d0 0x559b11319880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:50.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 4 client.19170 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d12c1745", "release": true, "await": true}] 2026-02-20T13:27:50.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.196+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d12c1745", "release": true, "await": true}) -- 0x559b10da53f0 con 0x559b112f93d0 2026-02-20T13:27:50.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.197+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b112f93d0 0x559b11319880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:50.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.197+0000 7f2a2bfff640 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b112f93d0 0x559b11319880 crc :-1 s=READY pgs=305 gs=4 cs=0 l=0 c_cookie=9729365696334193522 s_cookie=14919410620435270877 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8705a68d6bdee372 server_cookie=cf0c64e9b13c0cdd in_seq=0 out_seq=0 2026-02-20T13:27:50.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.197+0000 7f29edffb640 10 client.19170 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:50.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f29edffb640 1 -- 10.20.193.28:0/1510762657 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559b10da53f0 con 0x559b112f93d0 2026-02-20T13:27:50.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f29edffb640 10 client.19170 handle_command_reply: tid=0 2026-02-20T13:27:50.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 client.19170 shutdown 2026-02-20T13:27:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 msgr2=0x559b1122a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b1122a370 secure :-1 s=READY pgs=1157 gs=1 cs=0 l=1 c_cookie=6998227553780155788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c032040 tx=0x7f2a1c038c30 comp rx=0 tx=0).stop 2026-02-20T13:27:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 shutdown_connections 2026-02-20T13:27:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559b112f93d0 0x559b11319880 crc :-1 s=READY pgs=305 gs=4 cs=0 l=0 c_cookie=9729365696334193522 s_cookie=14919410620435270877 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559b11206e30 0x559b1122a370 unknown :-1 s=CLOSED pgs=1157 gs=1 cs=0 l=1 c_cookie=6998227553780155788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559b1124bad0 0x559b11228bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 --2- 10.20.193.28:0/1510762657 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559b11206520 0x559b11229e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f29edffb640 0 client.19170 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 >> 10.20.193.28:0/1510762657 conn(0x559b11124a60 msgr2=0x559b1121ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 shutdown_connections 2026-02-20T13:27:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 1 -- 10.20.193.28:0/1510762657 wait complete. 2026-02-20T13:27:50.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.199+0000 7f2a3486be00 20 client.19170 trim_cache size 0 max 16384 2026-02-20T13:27:50.213 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:27:50.213 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T13:27:50.213 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:27:50.214 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 36, 2026-02-20T13:27:50.214 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:27:50.214 INFO:teuthology.orchestra.run.trial028.stdout: "d12c1745": { 2026-02-20T13:27:50.214 INFO:teuthology.orchestra.run.trial028.stdout: "version": 36, 2026-02-20T13:27:50.214 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:27:50.214 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:27:50.214 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:27:50.215 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:27:50.215 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:50.215 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:27:50.215 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 144.2, 2026-02-20T13:27:50.215 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:27:50.215 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:27:50.215 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:27:50.215 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:27:50.216 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:27:50.216 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:27:50.216 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:50.216 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:50.216 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:50.216 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:50.216 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:50.216 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:27:50.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 -- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a000b5760 msgr2=0x7f2a000d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a000b5760 0x7f2a000d5c10 secure :-1 s=READY pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a18005c70 tx=0x7f2a18005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 -- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a2c062ae0 msgr2=0x7f2a2c0f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a2c062ae0 0x7f2a2c0f33c0 secure :-1 s=READY pgs=1153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c02f6a0 tx=0x7f2a1c004290 comp rx=0 tx=0).stop 2026-02-20T13:27:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 -- 10.20.193.28:0/3061109652 shutdown_connections 2026-02-20T13:27:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a000b5760 0x7f2a000d5c10 unknown :-1 s=CLOSED pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a2c062ae0 0x7f2a2c0f33c0 unknown :-1 s=CLOSED pgs=1153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2a2c159d80 0x7f2a2c0f8790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 --2- 10.20.193.28:0/3061109652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2a2c0614f0 0x7f2a2c0f2e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 -- 10.20.193.28:0/3061109652 >> 10.20.193.28:0/3061109652 conn(0x7f2a2c0eab00 msgr2=0x7f2a2c10fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 -- 10.20.193.28:0/3061109652 shutdown_connections 2026-02-20T13:27:50.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:50.200+0000 7f2a315e8640 1 -- 10.20.193.28:0/3061109652 wait complete. 2026-02-20T13:27:50.303 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd12c1745', total seconds elapsed: 25.4 2026-02-20T13:27:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:50 trial127 ceph-mon[43817]: pgmap v496: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:27:50.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:50 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3135224816' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:50 trial034 ceph-mon[43332]: pgmap v496: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:27:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:50 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3135224816' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:51.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:50 trial028 ceph-mon[37442]: pgmap v496: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:27:51.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:50 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3135224816' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:52.442 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:27:52.630 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:52.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:52 trial028 ceph-mon[37442]: pgmap v497: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:27:52.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 -- 10.20.193.28:0/540127888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 msgr2=0x7fb6f0176000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 --2- 10.20.193.28:0/540127888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 0x7fb6f0176000 secure :-1 s=READY pgs=1158 gs=2 cs=0 l=1 c_cookie=4887672009096650623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e400aa30 tx=0x7fb6e4030270 comp rx=0 tx=0).stop 2026-02-20T13:27:52.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 -- 10.20.193.28:0/540127888 shutdown_connections 2026-02-20T13:27:52.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 --2- 10.20.193.28:0/540127888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 0x7fb6f0176000 unknown :-1 s=CLOSED pgs=1158 gs=2 cs=0 l=1 c_cookie=4887672009096650623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 --2- 10.20.193.28:0/540127888 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f010bfb0 0x7fb6f0113d50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 --2- 10.20.193.28:0/540127888 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f010b610 0x7fb6f010b9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 -- 10.20.193.28:0/540127888 >> 10.20.193.28:0/540127888 conn(0x7fb6f00e9080 msgr2=0x7fb6f0109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:52.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 -- 10.20.193.28:0/540127888 shutdown_connections 2026-02-20T13:27:52.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.805+0000 7fb6f57df640 1 -- 10.20.193.28:0/540127888 wait complete. 2026-02-20T13:27:52.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f57df640 1 Processor -- start 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f57df640 1 -- start start 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f57df640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f010b610 0x7fb6f011dd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f57df640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f010bfb0 0x7fb6f011e2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f57df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 0x7fb6f0123680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f57df640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f0123ca0 con 0x7fb6f01144d0 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f57df640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f0123e10 con 0x7fb6f010b610 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f57df640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f0123fd0 con 0x7fb6f010bfb0 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6ef7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f010bfb0 0x7fb6f011e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6f4fde640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 0x7fb6f0123680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6ef7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f010bfb0 0x7fb6f011e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36068/0 (socket says 10.20.193.28:36068) 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6ef7fe640 1 -- 10.20.193.28:0/1180097179 learned_addr learned my addr 10.20.193.28:0/1180097179 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.806+0000 7fb6effff640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f010b610 0x7fb6f011dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ef7fe640 1 -- 10.20.193.28:0/1180097179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f010b610 msgr2=0x7fb6f011dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f010b610 0x7fb6f011dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ef7fe640 1 -- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 msgr2=0x7fb6f0123680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 0x7fb6f0123680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ef7fe640 1 -- 10.20.193.28:0/1180097179 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e400a650 con 0x7fb6f010bfb0 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6f4fde640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 0x7fb6f0123680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f010bfb0 0x7fb6f011e2b0 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e000e9c0 tx=0x7fb6e000ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ed7fa640 1 -- 10.20.193.28:0/1180097179 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e000cc30 con 0x7fb6f010bfb0 2026-02-20T13:27:52.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ed7fa640 1 -- 10.20.193.28:0/1180097179 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6e000cd90 con 0x7fb6f010bfb0 2026-02-20T13:27:52.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6ed7fa640 1 -- 10.20.193.28:0/1180097179 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e00106b0 con 0x7fb6f010bfb0 2026-02-20T13:27:52.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6f57df640 1 -- 10.20.193.28:0/1180097179 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f01242b0 con 0x7fb6f010bfb0 2026-02-20T13:27:52.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.807+0000 7fb6f57df640 1 -- 10.20.193.28:0/1180097179 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f01649b0 con 0x7fb6f010bfb0 2026-02-20T13:27:52.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.810+0000 7fb6ed7fa640 1 -- 10.20.193.28:0/1180097179 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb6e001f060 con 0x7fb6f010bfb0 2026-02-20T13:27:52.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.811+0000 7fb6ed7fa640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6c40b5760 0x7fb6c40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.812+0000 7fb6ed7fa640 1 -- 10.20.193.28:0/1180097179 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6e0014070 con 0x7fb6f010bfb0 2026-02-20T13:27:52.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.812+0000 7fb6effff640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6c40b5760 0x7fb6c40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.812+0000 7fb6effff640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6c40b5760 0x7fb6c40d5c10 secure :-1 s=READY pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6dc004740 tx=0x7fb6dc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.813+0000 7fb6f8a62e00 1 Processor -- start 2026-02-20T13:27:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.813+0000 7fb6f8a62e00 1 -- start start 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.813+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6180 0x5649291b6550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.813+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6a90 0x5649291fb400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.813+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291fb940 0x56492921bd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.813+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5649290cc7d0 con 0x5649291fb940 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.813+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5649290c8500 con 0x5649291b6180 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.813+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5649290c24a0 con 0x5649291b6a90 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291fb940 0x56492921bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291fb940 0x56492921bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48514/0 (socket says 10.20.193.28:48514) 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 -- 10.20.193.28:0/1431622225 learned_addr learned my addr 10.20.193.28:0/1431622225 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 -- 10.20.193.28:0/1431622225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6a90 msgr2=0x5649291fb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6a90 0x5649291fb400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6a90 0x5649291fb400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6effff640 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6180 0x5649291b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 -- 10.20.193.28:0/1431622225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6180 msgr2=0x5649291b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6180 0x5649291b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 -- 10.20.193.28:0/1431622225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492906dd80 con 0x5649291fb940 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6effff640 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6180 0x5649291b6550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6a90 0x5649291fb400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6f4fde640 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291fb940 0x56492921bd20 secure :-1 s=READY pgs=1159 gs=1 cs=0 l=1 c_cookie=11329429723444355240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e4030780 tx=0x7fb6e4006cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3a384ebda720a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6c0ce3640 1 -- 10.20.193.28:0/1431622225 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e403e050 con 0x5649291fb940 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6c0ce3640 1 -- 10.20.193.28:0/1431622225 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6e403f040 con 0x5649291fb940 2026-02-20T13:27:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.814+0000 7fb6c0ce3640 1 -- 10.20.193.28:0/1431622225 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e40050c0 con 0x5649291fb940 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1431622225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291fb940 msgr2=0x56492921bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291fb940 0x56492921bd20 secure :-1 s=READY pgs=1159 gs=1 cs=0 l=1 c_cookie=11329429723444355240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e4030780 tx=0x7fb6e4006cd0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1431622225 shutdown_connections 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291fb940 0x56492921bd20 unknown :-1 s=CLOSED pgs=1159 gs=1 cs=0 l=1 c_cookie=11329429723444355240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6a90 0x5649291fb400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1431622225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6180 0x5649291b6550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1431622225 >> 10.20.193.28:0/1431622225 conn(0x564929194680 msgr2=0x5649291b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1431622225 shutdown_connections 2026-02-20T13:27:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.815+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1431622225 wait complete. 2026-02-20T13:27:52.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.816+0000 7fb6f8a62e00 1 -- start start 2026-02-20T13:27:52.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.816+0000 7fb6f8a62e00 1 Processor -- start 2026-02-20T13:27:52.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x5649292132f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929213830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929218820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564929218d60 con 0x5649291b6a90 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564929218ed0 con 0x5649291fb940 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564929219090 con 0x5649291b6180 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f4fde640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929218820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f4fde640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929218820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51126/0 (socket says 10.20.193.28:51126) 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f4fde640 1 -- 10.20.193.28:0/2681381420 learned_addr learned my addr 10.20.193.28:0/2681381420 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6effff640 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x5649292132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929213830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f4fde640 1 -- 10.20.193.28:0/2681381420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 msgr2=0x5649292132f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f4fde640 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x5649292132f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f4fde640 1 -- 10.20.193.28:0/2681381420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 msgr2=0x564929213830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f4fde640 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929213830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6f4fde640 1 -- 10.20.193.28:0/2681381420 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564929046350 con 0x5649291fb940 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.817+0000 7fb6effff640 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x5649292132f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f4fde640 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929218820 secure :-1 s=READY pgs=414 gs=2 cs=0 l=1 c_cookie=1101056036279909506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e4039820 tx=0x7fb6e4039e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47bca1a0437c82 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6b1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/2681381420 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e4005680 con 0x5649291fb940 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f0176840 con 0x5649291fb940 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 10 client.29138 _ll_register_callbacks cb 0x5649290439a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564928d586f0 con 0x5649291fb940 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/2681381420 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6e4043400 con 0x5649291fb940 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/2681381420 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e404c650 con 0x5649291fb940 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/2681381420 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6e404c7e0 con 0x5649291fb940 2026-02-20T13:27:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/2681381420 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6e404c9a0 con 0x5649291fb940 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 10 client.29138 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564929058150 con 0x5649291fb940 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/2681381420 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6e4003780 con 0x5649291fb940 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 10 client.29138 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 10 client.29138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 20 client.29138 populate_metadata read hostname 'trial028' 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.818+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5649291f89a0 0x5649291f8e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.819+0000 7fb6f8a62e00 4 client.29138 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.819+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649290cfd60 con 0x5649291f89a0 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.819+0000 7fb6effff640 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5649291f89a0 0x5649291f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.819+0000 7fb6effff640 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5649291f89a0 0x5649291f8e40 crc :-1 s=READY pgs=306 gs=4 cs=0 l=0 c_cookie=5332874440498724256 s_cookie=9818325655642611571 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a022d0c81afbda0 server_cookie=8841b32a01ae9f73 in_seq=0 out_seq=0 2026-02-20T13:27:52.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.819+0000 7fb6b1ffb640 10 client.29138 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/2681381420 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5649290cfd60 con 0x5649291f89a0 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6b1ffb640 10 client.29138 handle_command_reply: tid=0 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 client.29138 shutdown 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 msgr2=0x564929218820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929218820 secure :-1 s=READY pgs=414 gs=2 cs=0 l=1 c_cookie=1101056036279909506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e4039820 tx=0x7fb6e4039e70 comp rx=0 tx=0).stop 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 shutdown_connections 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5649291f89a0 0x5649291f8e40 crc :-1 s=READY pgs=306 gs=4 cs=0 l=0 c_cookie=5332874440498724256 s_cookie=9818325655642611571 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929213830 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929218820 unknown :-1 s=CLOSED pgs=414 gs=2 cs=0 l=1 c_cookie=1101056036279909506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/2681381420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x5649292132f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 >> 10.20.193.28:0/2681381420 conn(0x564929194680 msgr2=0x5649291b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:52.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6b1ffb640 0 client.29138 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:52.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 shutdown_connections 2026-02-20T13:27:52.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/2681381420 wait complete. 2026-02-20T13:27:52.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.820+0000 7fb6f8a62e00 20 client.29138 trim_cache size 0 max 16384 2026-02-20T13:27:52.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.829+0000 7fb6f8a62e00 1 Processor -- start 2026-02-20T13:27:52.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.829+0000 7fb6f8a62e00 1 -- start start 2026-02-20T13:27:52.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.829+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6180 0x5649291f6cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.829+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6a90 0x5649292134d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.829+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291fb940 0x5649292114b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.829+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5649290c00d0 con 0x5649291b6180 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.829+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564928d80700 con 0x5649291b6a90 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.829+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5649292191d0 con 0x5649291fb940 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6180 0x5649291f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6ef7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6a90 0x5649292134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6180 0x5649291f6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48534/0 (socket says 10.20.193.28:48534) 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6f4fde640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291fb940 0x5649292114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 -- 10.20.193.28:0/495687528 learned_addr learned my addr 10.20.193.28:0/495687528 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:52.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 -- 10.20.193.28:0/495687528 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291fb940 msgr2=0x5649292114b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 --2- 10.20.193.28:0/495687528 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291fb940 0x5649292114b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 -- 10.20.193.28:0/495687528 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6a90 msgr2=0x5649292134d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 --2- 10.20.193.28:0/495687528 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6a90 0x5649292134d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 -- 10.20.193.28:0/495687528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564929052bd0 con 0x5649291b6180 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/495687528 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6a90 0x5649292134d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6effff640 1 --2- 10.20.193.28:0/495687528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6180 0x5649291f6cb0 secure :-1 s=READY pgs=1160 gs=1 cs=0 l=1 c_cookie=2350031040476335339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6dc009f40 tx=0x7fb6dc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209cfcc7c2bbcceb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6b3fff640 1 -- 10.20.193.28:0/495687528 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6dc02a070 con 0x5649291b6180 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6b3fff640 1 -- 10.20.193.28:0/495687528 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6dc021040 con 0x5649291b6180 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.830+0000 7fb6b3fff640 1 -- 10.20.193.28:0/495687528 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6dc020070 con 0x5649291b6180 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/495687528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6180 msgr2=0x5649291f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/495687528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6180 0x5649291f6cb0 secure :-1 s=READY pgs=1160 gs=1 cs=0 l=1 c_cookie=2350031040476335339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6dc009f40 tx=0x7fb6dc014000 comp rx=0 tx=0).stop 2026-02-20T13:27:52.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/495687528 shutdown_connections 2026-02-20T13:27:52.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/495687528 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291fb940 0x5649292114b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/495687528 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291b6a90 0x5649292134d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/495687528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6180 0x5649291f6cb0 unknown :-1 s=CLOSED pgs=1160 gs=1 cs=0 l=1 c_cookie=2350031040476335339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/495687528 >> 10.20.193.28:0/495687528 conn(0x564929194680 msgr2=0x5649291f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:52.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/495687528 shutdown_connections 2026-02-20T13:27:52.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/495687528 wait complete. 2026-02-20T13:27:52.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 -- start start 2026-02-20T13:27:52.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.831+0000 7fb6f8a62e00 1 Processor -- start 2026-02-20T13:27:52.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x564929197730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929197c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6f8a62e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929260340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56492920c090 con 0x5649291b6a90 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564929260900 con 0x5649291fb940 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6f8a62e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564929260ac0 con 0x5649291b6180 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6effff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x564929197730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6effff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x564929197730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36112/0 (socket says 10.20.193.28:36112) 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6effff640 1 -- 10.20.193.28:0/1015331176 learned_addr learned my addr 10.20.193.28:0/1015331176 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6f4fde640 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929260340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48548/0 (socket says 10.20.193.28:48548) 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6effff640 1 -- 10.20.193.28:0/1015331176 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 msgr2=0x564929260340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6effff640 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929260340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6effff640 1 -- 10.20.193.28:0/1015331176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 msgr2=0x564929197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6effff640 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.832+0000 7fb6effff640 1 -- 10.20.193.28:0/1015331176 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564929046680 con 0x5649291b6180 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6effff640 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x564929197730 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=6813192931802086486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6dc009790 tx=0x7fb6dc0053d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e8d52dfa643fc56 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6b1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/1015331176 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6dc020040 con 0x5649291b6180 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/1015331176 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6dc011df0 con 0x5649291b6180 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6dc009be0 con 0x5649291b6180 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/1015331176 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6dc01be10 con 0x5649291b6180 2026-02-20T13:27:52.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/1015331176 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6dc034440 con 0x5649291b6180 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6f8a62e00 10 client.29050 _ll_register_callbacks cb 0x5649290439a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6e403f040 con 0x5649291b6180 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/1015331176 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6dc01b450 con 0x5649291b6180 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6f8a62e00 10 client.29050 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.833+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5649290583b0 con 0x5649291b6180 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/1015331176 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6dc011910 con 0x5649291b6180 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6f8a62e00 10 client.29050 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6f8a62e00 10 client.29050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6f8a62e00 20 client.29050 populate_metadata read hostname 'trial028' 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5649292a8a70 0x5649292c8f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6f8a62e00 4 client.29050 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:27:52.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564928d55f40 con 0x5649292a8a70 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5649292a8a70 0x5649292c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6ef7fe640 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5649292a8a70 0x5649292c8f20 crc :-1 s=READY pgs=307 gs=4 cs=0 l=0 c_cookie=9238734952299049520 s_cookie=12722316951489351048 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8036947d7dc53230 server_cookie=b08ebfdc95740d88 in_seq=0 out_seq=0 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.834+0000 7fb6b1ffb640 10 client.29050 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6b1ffb640 1 -- 10.20.193.28:0/1015331176 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x564928d55f40 con 0x5649292a8a70 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6b1ffb640 10 client.29050 handle_command_reply: tid=0 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 client.29050 shutdown 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 msgr2=0x564929197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x564929197730 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=6813192931802086486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6dc009790 tx=0x7fb6dc0053d0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 shutdown_connections 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5649292a8a70 0x5649292c8f20 crc :-1 s=READY pgs=307 gs=4 cs=0 l=0 c_cookie=9238734952299049520 s_cookie=12722316951489351048 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649291b6a90 0x564929197c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5649291fb940 0x564929260340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 --2- 10.20.193.28:0/1015331176 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5649291b6180 0x564929197730 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=6813192931802086486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 >> 10.20.193.28:0/1015331176 conn(0x564929194680 msgr2=0x5649291f5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:52.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6b1ffb640 0 client.29050 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:52.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 shutdown_connections 2026-02-20T13:27:52.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 1 -- 10.20.193.28:0/1015331176 wait complete. 2026-02-20T13:27:52.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.835+0000 7fb6f8a62e00 20 client.29050 trim_cache size 0 max 16384 2026-02-20T13:27:52.844 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.845 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:27:52.849 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.851 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:27:52.853 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:52.856 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 -- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6c40b5760 msgr2=0x7fb6c40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6c40b5760 0x7fb6c40d5c10 secure :-1 s=READY pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6dc004740 tx=0x7fb6dc005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 -- 10.20.193.28:0/1180097179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f010bfb0 msgr2=0x7fb6f011e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f010bfb0 0x7fb6f011e2b0 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e000e9c0 tx=0x7fb6e000ee90 comp rx=0 tx=0).stop 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 -- 10.20.193.28:0/1180097179 shutdown_connections 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6c40b5760 0x7fb6c40d5c10 unknown :-1 s=CLOSED pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f01144d0 0x7fb6f0123680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f010bfb0 0x7fb6f011e2b0 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 --2- 10.20.193.28:0/1180097179 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f010b610 0x7fb6f011dd70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 -- 10.20.193.28:0/1180097179 >> 10.20.193.28:0/1180097179 conn(0x7fb6f00e9080 msgr2=0x7fb6f0109460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:52.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 -- 10.20.193.28:0/1180097179 shutdown_connections 2026-02-20T13:27:52.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:52.836+0000 7fb6f57df640 1 -- 10.20.193.28:0/1180097179 wait complete. 2026-02-20T13:27:52.939 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:27:52.940 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:27:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:52 trial127 ceph-mon[43817]: pgmap v497: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:27:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:52 trial034 ceph-mon[43332]: pgmap v497: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:27:53.123 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:53.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.306+0000 7f73b1d24640 1 -- 10.20.193.28:0/1112787564 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac10b4f0 msgr2=0x7f73ac10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.306+0000 7f73b1d24640 1 --2- 10.20.193.28:0/1112787564 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac10b4f0 0x7f73ac10b8c0 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=4742389750826497567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f739c009950 tx=0x7f739c02f190 comp rx=0 tx=0).stop 2026-02-20T13:27:53.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.306+0000 7f73b1d24640 1 -- 10.20.193.28:0/1112787564 shutdown_connections 2026-02-20T13:27:53.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.306+0000 7f73b1d24640 1 --2- 10.20.193.28:0/1112787564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73ac10bee0 0x7f73ac110f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.306+0000 7f73b1d24640 1 --2- 10.20.193.28:0/1112787564 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73ac1116e0 0x7f73ac1720b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.306+0000 7f73b1d24640 1 --2- 10.20.193.28:0/1112787564 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac10b4f0 0x7f73ac10b8c0 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=4742389750826497567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.306+0000 7f73b1d24640 1 -- 10.20.193.28:0/1112787564 >> 10.20.193.28:0/1112787564 conn(0x7f73ac0e8de0 msgr2=0x7f73ac1091f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:53.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.307+0000 7f73b1d24640 1 -- 10.20.193.28:0/1112787564 shutdown_connections 2026-02-20T13:27:53.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.307+0000 7f73b1d24640 1 -- 10.20.193.28:0/1112787564 wait complete. 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.307+0000 7f73b1d24640 1 Processor -- start 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.307+0000 7f73b1d24640 1 -- start start 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1d24640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73ac10b4f0 0x7f73ac0f5d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1d24640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73ac10bee0 0x7f73ac171fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1d24640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac1116e0 0x7f73ac0f6430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1d24640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0fb640 con 0x7f73ac10b4f0 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1d24640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0fb7b0 con 0x7f73ac1116e0 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1d24640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0fb970 con 0x7f73ac10bee0 2026-02-20T13:27:53.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1523640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac1116e0 0x7f73ac0f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b0d22640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73ac10b4f0 0x7f73ac0f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1523640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac1116e0 0x7f73ac0f6430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51172/0 (socket says 10.20.193.28:51172) 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b1523640 1 -- 10.20.193.28:0/2833895696 learned_addr learned my addr 10.20.193.28:0/2833895696 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73a3fff640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73ac10bee0 0x7f73ac171fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b0d22640 1 -- 10.20.193.28:0/2833895696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73ac10bee0 msgr2=0x7f73ac171fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b0d22640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73ac10bee0 0x7f73ac171fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b0d22640 1 -- 10.20.193.28:0/2833895696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac1116e0 msgr2=0x7f73ac0f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b0d22640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac1116e0 0x7f73ac0f6430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b0d22640 1 -- 10.20.193.28:0/2833895696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739c009570 con 0x7f73ac10b4f0 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.308+0000 7f73b0d22640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73ac10b4f0 0x7f73ac0f5d30 secure :-1 s=READY pgs=1161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f739c02f6a0 tx=0x7f739c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.309+0000 7f73a1ffb640 1 -- 10.20.193.28:0/2833895696 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f739c03d070 con 0x7f73ac10b4f0 2026-02-20T13:27:53.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.309+0000 7f73b1d24640 1 -- 10.20.193.28:0/2833895696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac0fbbf0 con 0x7f73ac10b4f0 2026-02-20T13:27:53.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.309+0000 7f73a1ffb640 1 -- 10.20.193.28:0/2833895696 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f739c002ad0 con 0x7f73ac10b4f0 2026-02-20T13:27:53.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.309+0000 7f73a1ffb640 1 -- 10.20.193.28:0/2833895696 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f739c041820 con 0x7f73ac10b4f0 2026-02-20T13:27:53.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.309+0000 7f73b1d24640 1 -- 10.20.193.28:0/2833895696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac0fc0b0 con 0x7f73ac10b4f0 2026-02-20T13:27:53.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.309+0000 7f737b7fe640 1 -- 10.20.193.28:0/2833895696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac10c7d0 con 0x7f73ac10b4f0 2026-02-20T13:27:53.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.311+0000 7f73a1ffb640 1 -- 10.20.193.28:0/2833895696 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f739c02f9f0 con 0x7f73ac10b4f0 2026-02-20T13:27:53.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.313+0000 7f73a1ffb640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73880b5750 0x7f73880d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.313+0000 7f73a1ffb640 1 -- 10.20.193.28:0/2833895696 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f739c10b370 con 0x7f73ac10b4f0 2026-02-20T13:27:53.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.313+0000 7f73a3fff640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73880b5750 0x7f73880d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.313+0000 7f73a1ffb640 1 -- 10.20.193.28:0/2833895696 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f739c10b7f0 con 0x7f73ac10b4f0 2026-02-20T13:27:53.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.314+0000 7f73a3fff640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73880b5750 0x7f73880d5c00 secure :-1 s=READY pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73ac0fc6d0 tx=0x7f739400c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:53.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.455+0000 7f737b7fe640 1 -- 10.20.193.28:0/2833895696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73ac0f6e90 con 0x7f73ac10b4f0 2026-02-20T13:27:53.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.455+0000 7f73a1ffb640 1 -- 10.20.193.28:0/2833895696 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11996 (secure 0 0 0) 0x7f739c0cddd0 con 0x7f73ac10b4f0 2026-02-20T13:27:53.458 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:27:53.459 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T13:19:23:602529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:19:23.340930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:27:53.460 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T13:27:53.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.456+0000 7f737b7fe640 1 -- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73880b5750 msgr2=0x7f73880d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.456+0000 7f737b7fe640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73880b5750 0x7f73880d5c00 secure :-1 s=READY pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73ac0fc6d0 tx=0x7f739400c040 comp rx=0 tx=0).stop 2026-02-20T13:27:53.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.456+0000 7f737b7fe640 1 -- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73ac10b4f0 msgr2=0x7f73ac0f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.456+0000 7f737b7fe640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73ac10b4f0 0x7f73ac0f5d30 secure :-1 s=READY pgs=1161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f739c02f6a0 tx=0x7f739c004290 comp rx=0 tx=0).stop 2026-02-20T13:27:53.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.457+0000 7f737b7fe640 1 -- 10.20.193.28:0/2833895696 shutdown_connections 2026-02-20T13:27:53.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.457+0000 7f737b7fe640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f73880b5750 0x7f73880d5c00 unknown :-1 s=CLOSED pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.457+0000 7f737b7fe640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f73ac1116e0 0x7f73ac0f6430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.457+0000 7f737b7fe640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73ac10bee0 0x7f73ac171fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.457+0000 7f737b7fe640 1 --2- 10.20.193.28:0/2833895696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73ac10b4f0 0x7f73ac0f5d30 unknown :-1 s=CLOSED pgs=1161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.457+0000 7f737b7fe640 1 -- 10.20.193.28:0/2833895696 >> 10.20.193.28:0/2833895696 conn(0x7f73ac0e8de0 msgr2=0x7f73ac10e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:53.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.457+0000 7f737b7fe640 1 -- 10.20.193.28:0/2833895696 shutdown_connections 2026-02-20T13:27:53.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.457+0000 7f737b7fe640 1 -- 10.20.193.28:0/2833895696 wait complete. 2026-02-20T13:27:53.556 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:27:53.741 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:53.784 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:53 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2833895696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 -- 10.20.193.28:0/3496257969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 msgr2=0x7fecd4115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 --2- 10.20.193.28:0/3496257969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 0x7fecd4115030 secure :-1 s=READY pgs=1162 gs=1 cs=0 l=1 c_cookie=6797048717038087251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecbc009950 tx=0x7fecbc02f190 comp rx=0 tx=0).stop 2026-02-20T13:27:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 -- 10.20.193.28:0/3496257969 shutdown_connections 2026-02-20T13:27:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 --2- 10.20.193.28:0/3496257969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 0x7fecd4115030 unknown :-1 s=CLOSED pgs=1162 gs=1 cs=0 l=1 c_cookie=6797048717038087251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 --2- 10.20.193.28:0/3496257969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fecd41157e0 0x7fecd41761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 --2- 10.20.193.28:0/3496257969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fecd410f5f0 0x7fecd410f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 -- 10.20.193.28:0/3496257969 >> 10.20.193.28:0/3496257969 conn(0x7fecd40ecea0 msgr2=0x7fecd410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 -- 10.20.193.28:0/3496257969 shutdown_connections 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 -- 10.20.193.28:0/3496257969 wait complete. 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.920+0000 7fecd902c640 1 Processor -- start 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd902c640 1 -- start start 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd902c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fecd410f5f0 0x7fecd40f4eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd902c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 0x7fecd41760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd902c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fecd41157e0 0x7fecd40f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd902c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fecd40fa7c0 con 0x7fecd410ffe0 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd902c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fecd40fa930 con 0x7fecd41157e0 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd902c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fecd40faaf0 con 0x7fecd410f5f0 2026-02-20T13:27:53.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 0x7fecd41760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 0x7fecd41760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48582/0 (socket says 10.20.193.28:48582) 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2575640 1 -- 10.20.193.28:0/3504665080 learned_addr learned my addr 10.20.193.28:0/3504665080 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2d76640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fecd410f5f0 0x7fecd40f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd3577640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fecd41157e0 0x7fecd40f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2575640 1 -- 10.20.193.28:0/3504665080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fecd410f5f0 msgr2=0x7fecd40f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2575640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fecd410f5f0 0x7fecd40f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2575640 1 -- 10.20.193.28:0/3504665080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fecd41157e0 msgr2=0x7fecd40f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2575640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fecd41157e0 0x7fecd40f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.921+0000 7fecd2575640 1 -- 10.20.193.28:0/3504665080 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecbc009570 con 0x7fecd410ffe0 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.922+0000 7fecd2575640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 0x7fecd41760b0 secure :-1 s=READY pgs=1163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecbc005b30 tx=0x7fecbc004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.922+0000 7fecb3fff640 1 -- 10.20.193.28:0/3504665080 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecbc03d070 con 0x7fecd410ffe0 2026-02-20T13:27:53.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.922+0000 7fecb3fff640 1 -- 10.20.193.28:0/3504665080 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fecbc038920 con 0x7fecd410ffe0 2026-02-20T13:27:53.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.922+0000 7fecb3fff640 1 -- 10.20.193.28:0/3504665080 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecbc0418a0 con 0x7fecd410ffe0 2026-02-20T13:27:53.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.922+0000 7fecd902c640 1 -- 10.20.193.28:0/3504665080 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd40fad70 con 0x7fecd410ffe0 2026-02-20T13:27:53.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.922+0000 7fecd902c640 1 -- 10.20.193.28:0/3504665080 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd40fb190 con 0x7fecd410ffe0 2026-02-20T13:27:53.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.925+0000 7fecb3fff640 1 -- 10.20.193.28:0/3504665080 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fecbc048020 con 0x7fecd410ffe0 2026-02-20T13:27:53.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.926+0000 7fecb3fff640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feca80b5750 0x7feca80d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.926+0000 7fecb3fff640 1 -- 10.20.193.28:0/3504665080 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fecbc10af00 con 0x7fecd410ffe0 2026-02-20T13:27:53.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecd2d76640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feca80b5750 0x7feca80d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecdb026e00 1 Processor -- start 2026-02-20T13:27:53.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecd2d76640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feca80b5750 0x7feca80d5c00 secure :-1 s=READY pgs=502 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc8004740 tx=0x7fecc800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:53.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecdb026e00 1 -- start start 2026-02-20T13:27:53.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674360 0x56445d674730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6b95e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 0x56445d6d9f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecdb026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56445d58a780 con 0x56445d674360 2026-02-20T13:27:53.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecdb026e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56445d5864b0 con 0x56445d674c70 2026-02-20T13:27:53.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecdb026e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56445d580450 con 0x56445d6b9b20 2026-02-20T13:27:53.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecd2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674360 0x56445d674730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecd2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674360 0x56445d674730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48592/0 (socket says 10.20.193.28:48592) 2026-02-20T13:27:53.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecd2d76640 1 -- 10.20.193.28:0/2102925704 learned_addr learned my addr 10.20.193.28:0/2102925704 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecd3577640 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 0x56445d6d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.927+0000 7fecd2575640 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecd2d76640 1 -- 10.20.193.28:0/2102925704 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 msgr2=0x56445d6d9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecd2d76640 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 0x56445d6d9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecd2d76640 1 -- 10.20.193.28:0/2102925704 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 msgr2=0x56445d6b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecd2d76640 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6b95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecd2d76640 1 -- 10.20.193.28:0/2102925704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445d52bd10 con 0x56445d674360 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecd2575640 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6b95e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecd2d76640 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674360 0x56445d674730 secure :-1 s=READY pgs=1164 gs=1 cs=0 l=1 c_cookie=6227834630656537631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc8005db0 tx=0x7fecc8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566db699a028b41f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:53.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fec9f7fe640 1 -- 10.20.193.28:0/2102925704 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc801e640 con 0x56445d674360 2026-02-20T13:27:53.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fec9f7fe640 1 -- 10.20.193.28:0/2102925704 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fecc8015070 con 0x56445d674360 2026-02-20T13:27:53.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fec9f7fe640 1 -- 10.20.193.28:0/2102925704 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc8026d50 con 0x56445d674360 2026-02-20T13:27:53.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecdb026e00 1 -- 10.20.193.28:0/2102925704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674360 msgr2=0x56445d674730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.928+0000 7fecdb026e00 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674360 0x56445d674730 secure :-1 s=READY pgs=1164 gs=1 cs=0 l=1 c_cookie=6227834630656537631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc8005db0 tx=0x7fecc8013000 comp rx=0 tx=0).stop 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.929+0000 7fecdb026e00 1 -- 10.20.193.28:0/2102925704 shutdown_connections 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.929+0000 7fecdb026e00 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 0x56445d6d9f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.929+0000 7fecdb026e00 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6b95e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.929+0000 7fecdb026e00 1 --2- 10.20.193.28:0/2102925704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674360 0x56445d674730 unknown :-1 s=CLOSED pgs=1164 gs=1 cs=0 l=1 c_cookie=6227834630656537631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.929+0000 7fecdb026e00 1 -- 10.20.193.28:0/2102925704 >> 10.20.193.28:0/2102925704 conn(0x56445d652860 msgr2=0x56445d672c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.929+0000 7fecdb026e00 1 -- 10.20.193.28:0/2102925704 shutdown_connections 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.929+0000 7fecdb026e00 1 -- 10.20.193.28:0/2102925704 wait complete. 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.930+0000 7fecdb026e00 1 -- start start 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.930+0000 7fecdb026e00 1 Processor -- start 2026-02-20T13:27:53.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.930+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d1740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.930+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6d1c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.930+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d6b9b20 0x56445d6d3a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.930+0000 7fecdb026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56445d6d3f80 con 0x56445d674c70 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.930+0000 7fecdb026e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56445d6d40f0 con 0x56445d6b9b20 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.930+0000 7fecdb026e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56445d6d42b0 con 0x56445d674360 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd2d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd2d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36152/0 (socket says 10.20.193.28:36152) 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd2d76640 1 -- 10.20.193.28:0/3365286955 learned_addr learned my addr 10.20.193.28:0/3365286955 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd3577640 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d6b9b20 0x56445d6d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd2575640 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd3577640 1 -- 10.20.193.28:0/3365286955 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 msgr2=0x56445d6d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd3577640 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd3577640 1 -- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 msgr2=0x56445d6d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd3577640 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd3577640 1 -- 10.20.193.28:0/3365286955 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc800bd10 con 0x56445d6b9b20 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd2575640 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6d1c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecd3577640 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d6b9b20 0x56445d6d3a10 secure :-1 s=READY pgs=416 gs=2 cs=0 l=1 c_cookie=1967708861167270596 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc4005820 tx=0x7fecc400aa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b4eb4c8ab437ac4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fec9cff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fec9cff9640 1 -- 10.20.193.28:0/3365286955 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc4017070 con 0x56445d6b9b20 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fec9cff9640 1 -- 10.20.193.28:0/3365286955 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fecc4012d50 con 0x56445d6b9b20 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.931+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd40fb190 con 0x56445d6b9b20 2026-02-20T13:27:53.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fec9cff9640 1 -- 10.20.193.28:0/3365286955 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc4011440 con 0x56445d6b9b20 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 10 client.29162 _ll_register_callbacks cb 0x56445d501a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fec9cff9640 1 -- 10.20.193.28:0/3365286955 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fecc4012870 con 0x56445d6b9b20 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56445d2166f0 con 0x56445d6b9b20 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fec9cff9640 1 -- 10.20.193.28:0/3365286955 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fecc401c610 con 0x56445d6b9b20 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 10 client.29162 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56445d5043c0 con 0x56445d6b9b20 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fec9cff9640 1 -- 10.20.193.28:0/3365286955 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fecc4012a30 con 0x56445d6b9b20 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 10 client.29162 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 10 client.29162 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 20 client.29162 populate_metadata read hostname 'trial028' 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x56445d6d9cb0 0x56445d6b78a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 4 client.29162 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:53.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56445d522f80 con 0x56445d6d9cb0 2026-02-20T13:27:53.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.932+0000 7fecd2d76640 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x56445d6d9cb0 0x56445d6b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.933+0000 7fecd2d76640 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x56445d6d9cb0 0x56445d6b78a0 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=1137358242939837904 s_cookie=7802105628976779778 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fc8b54bc4ca9dd0 server_cookie=6c46a5bb733c9202 in_seq=0 out_seq=0 2026-02-20T13:27:53.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.933+0000 7fec9cff9640 10 client.29162 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:27:53.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fec9cff9640 1 -- 10.20.193.28:0/3365286955 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56445d522f80 con 0x56445d6d9cb0 2026-02-20T13:27:53.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fec9cff9640 10 client.29162 handle_command_reply: tid=0 2026-02-20T13:27:53.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 client.29162 shutdown 2026-02-20T13:27:53.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d6b9b20 msgr2=0x56445d6d3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d6b9b20 0x56445d6d3a10 secure :-1 s=READY pgs=416 gs=2 cs=0 l=1 c_cookie=1967708861167270596 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc4005820 tx=0x7fecc400aa00 comp rx=0 tx=0).stop 2026-02-20T13:27:53.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 shutdown_connections 2026-02-20T13:27:53.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x56445d6d9cb0 0x56445d6b78a0 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=1137358242939837904 s_cookie=7802105628976779778 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6d1c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d6b9b20 0x56445d6d3a10 unknown :-1 s=CLOSED pgs=416 gs=2 cs=0 l=1 c_cookie=1967708861167270596 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3365286955 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d1740 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fec9cff9640 0 client.29162 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:27:53.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 >> 10.20.193.28:0/3365286955 conn(0x56445d652860 msgr2=0x56445d672c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:53.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 shutdown_connections 2026-02-20T13:27:53.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 1 -- 10.20.193.28:0/3365286955 wait complete. 2026-02-20T13:27:53.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.934+0000 7fecdb026e00 20 client.29162 trim_cache size 0 max 16384 2026-02-20T13:27:53.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.942+0000 7fecdb026e00 1 Processor -- start 2026-02-20T13:27:53.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.942+0000 7fecdb026e00 1 -- start start 2026-02-20T13:27:53.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.942+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d39a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.942+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6ce8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.942+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d6b9b20 0x56445d6cee10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.942+0000 7fecdb026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56445d57e080 con 0x56445d6b9b20 2026-02-20T13:27:53.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.942+0000 7fecdb026e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56445d23e700 con 0x56445d674c70 2026-02-20T13:27:53.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.942+0000 7fecdb026e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56445d6522a0 con 0x56445d674360 2026-02-20T13:27:53.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d6b9b20 0x56445d6cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d6b9b20 0x56445d6cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48602/0 (socket says 10.20.193.28:48602) 2026-02-20T13:27:53.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 -- 10.20.193.28:0/1830564749 learned_addr learned my addr 10.20.193.28:0/1830564749 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd2d76640 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd2575640 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 -- 10.20.193.28:0/1830564749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 msgr2=0x56445d6d39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 -- 10.20.193.28:0/1830564749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 msgr2=0x56445d6ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 -- 10.20.193.28:0/1830564749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445d6bf0c0 con 0x56445d6b9b20 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecd3577640 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d6b9b20 0x56445d6cee10 secure :-1 s=READY pgs=1165 gs=2 cs=0 l=1 c_cookie=7504266169033905349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc4011020 tx=0x7fecc4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68248252493f54c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fec9effd640 1 -- 10.20.193.28:0/1830564749 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc4034070 con 0x56445d6b9b20 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fec9effd640 1 -- 10.20.193.28:0/1830564749 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56445d2166f0 con 0x56445d6b9b20 2026-02-20T13:27:53.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fec9effd640 1 -- 10.20.193.28:0/1830564749 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc4017040 con 0x56445d6b9b20 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecdb026e00 1 -- 10.20.193.28:0/1830564749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d6b9b20 msgr2=0x56445d6cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.943+0000 7fecdb026e00 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d6b9b20 0x56445d6cee10 secure :-1 s=READY pgs=1165 gs=2 cs=0 l=1 c_cookie=7504266169033905349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc4011020 tx=0x7fecc4020000 comp rx=0 tx=0).stop 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 -- 10.20.193.28:0/1830564749 shutdown_connections 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d6b9b20 0x56445d6cee10 unknown :-1 s=CLOSED pgs=1165 gs=2 cs=0 l=1 c_cookie=7504266169033905349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674c70 0x56445d6ce8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 --2- 10.20.193.28:0/1830564749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d674360 0x56445d6d39a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 -- 10.20.193.28:0/1830564749 >> 10.20.193.28:0/1830564749 conn(0x56445d652860 msgr2=0x56445d6d62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 -- 10.20.193.28:0/1830564749 shutdown_connections 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 -- 10.20.193.28:0/1830564749 wait complete. 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 -- start start 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.944+0000 7fecdb026e00 1 Processor -- start 2026-02-20T13:27:53.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674360 0x56445d6b3770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6b3cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecdb026e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 0x56445d6b41f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecdb026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56445d6b47b0 con 0x56445d674c70 2026-02-20T13:27:53.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecdb026e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56445d6b4920 con 0x56445d674360 2026-02-20T13:27:53.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecdb026e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56445d6b4ae0 con 0x56445d6b9b20 2026-02-20T13:27:53.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd3577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 0x56445d6b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48608/0 (socket says 10.20.193.28:48608) 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 -- 10.20.193.28:0/3126316337 learned_addr learned my addr 10.20.193.28:0/3126316337 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2d76640 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674360 0x56445d6b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 -- 10.20.193.28:0/3126316337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 msgr2=0x56445d6b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 0x56445d6b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 -- 10.20.193.28:0/3126316337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674360 msgr2=0x56445d6b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674360 0x56445d6b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 -- 10.20.193.28:0/3126316337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445d5160e0 con 0x56445d674c70 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecd2575640 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6b3cb0 secure :-1 s=READY pgs=1166 gs=2 cs=0 l=1 c_cookie=3319647458229438831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecbc0d14d0 tx=0x7fecbc0044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e11c1c6674b496f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fec9cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fec9cff9640 1 -- 10.20.193.28:0/3126316337 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecbc0d1c60 con 0x56445d674c70 2026-02-20T13:27:53.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fec9cff9640 1 -- 10.20.193.28:0/3126316337 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fecbc0d6f80 con 0x56445d674c70 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fec9cff9640 1 -- 10.20.193.28:0/3126316337 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecbc106ba0 con 0x56445d674c70 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.945+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445d5043c0 con 0x56445d674c70 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 10 client.19212 _ll_register_callbacks cb 0x56445d501a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc8015070 con 0x56445d674c70 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fec9cff9640 1 -- 10.20.193.28:0/3126316337 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fecbc0d9560 con 0x56445d674c70 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fec9cff9640 1 -- 10.20.193.28:0/3126316337 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fecbc106d00 con 0x56445d674c70 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 10 client.19212 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56445d510b60 con 0x56445d674c70 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fec9cff9640 1 -- 10.20.193.28:0/3126316337 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fecbc035320 con 0x56445d674c70 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 10 client.19212 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 10 client.19212 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:27:53.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 20 client.19212 populate_metadata read hostname 'trial028' 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x56445d657c30 0x56445d6580d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 4 client.19212 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56445d213f40 con 0x56445d657c30 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.946+0000 7fecd2d76640 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x56445d657c30 0x56445d6580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecd2d76640 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x56445d657c30 0x56445d6580d0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=2337518629086157763 s_cookie=14690884430582808234 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=207088cef689dbc3 server_cookie=cbe0818dd1347eaa in_seq=0 out_seq=0 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fec9cff9640 10 client.19212 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fec9cff9640 1 -- 10.20.193.28:0/3126316337 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56445d213f40 con 0x56445d657c30 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fec9cff9640 10 client.19212 handle_command_reply: tid=0 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 client.19212 shutdown 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 msgr2=0x56445d6b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6b3cb0 secure :-1 s=READY pgs=1166 gs=2 cs=0 l=1 c_cookie=3319647458229438831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecbc0d14d0 tx=0x7fecbc0044b0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 shutdown_connections 2026-02-20T13:27:53.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x56445d657c30 0x56445d6580d0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=2337518629086157763 s_cookie=14690884430582808234 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56445d674c70 0x56445d6b3cb0 unknown :-1 s=CLOSED pgs=1166 gs=2 cs=0 l=1 c_cookie=3319647458229438831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56445d6b9b20 0x56445d6b41f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 --2- 10.20.193.28:0/3126316337 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56445d674360 0x56445d6b3770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 >> 10.20.193.28:0/3126316337 conn(0x56445d652860 msgr2=0x56445d6d49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:53.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fec9cff9640 0 client.19212 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:27:53.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 shutdown_connections 2026-02-20T13:27:53.957 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 1 -- 10.20.193.28:0/3126316337 wait complete. 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.947+0000 7fecdb026e00 20 client.19212 trim_cache size 0 max 16384 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 -- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feca80b5750 msgr2=0x7feca80d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feca80b5750 0x7feca80d5c00 secure :-1 s=READY pgs=502 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc8004740 tx=0x7fecc800b410 comp rx=0 tx=0).stop 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 -- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 msgr2=0x7fecd41760b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 0x7fecd41760b0 secure :-1 s=READY pgs=1163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecbc005b30 tx=0x7fecbc004340 comp rx=0 tx=0).stop 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 -- 10.20.193.28:0/3504665080 shutdown_connections 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feca80b5750 0x7feca80d5c00 unknown :-1 s=CLOSED pgs=502 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410ffe0 0x7fecd41760b0 unknown :-1 s=CLOSED pgs=1163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fecd41157e0 0x7fecd40f55b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 --2- 10.20.193.28:0/3504665080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fecd410f5f0 0x7fecd40f4eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:53.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 -- 10.20.193.28:0/3504665080 >> 10.20.193.28:0/3504665080 conn(0x7fecd40ecea0 msgr2=0x7fecd4113fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:53.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 -- 10.20.193.28:0/3504665080 shutdown_connections 2026-02-20T13:27:53.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:53.948+0000 7fecd902c640 1 -- 10.20.193.28:0/3504665080 wait complete. 2026-02-20T13:27:53.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:53 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2833895696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:53.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:53 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2833895696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:27:54.049 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:27:54.233 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:54.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.409+0000 7fedd1e2a640 1 -- 10.20.193.28:0/2868586058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc1156a0 msgr2=0x7fedcc176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.409+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/2868586058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc1156a0 0x7fedcc176070 secure :-1 s=READY pgs=348 gs=3 cs=0 l=1 c_cookie=10171702969139197390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedc800aa30 tx=0x7fedc8030270 comp rx=0 tx=0).stop 2026-02-20T13:27:54.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.409+0000 7fedd1e2a640 1 -- 10.20.193.28:0/2868586058 shutdown_connections 2026-02-20T13:27:54.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.409+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/2868586058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedcc10fea0 0x7fedcc114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.409+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/2868586058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc1156a0 0x7fedcc176070 unknown :-1 s=CLOSED pgs=348 gs=3 cs=0 l=1 c_cookie=10171702969139197390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.409+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/2868586058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fedcc10f4b0 0x7fedcc10f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.409+0000 7fedd1e2a640 1 -- 10.20.193.28:0/2868586058 >> 10.20.193.28:0/2868586058 conn(0x7fedcc0ecda0 msgr2=0x7fedcc10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.409+0000 7fedd1e2a640 1 -- 10.20.193.28:0/2868586058 shutdown_connections 2026-02-20T13:27:54.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.410+0000 7fedd1e2a640 1 -- 10.20.193.28:0/2868586058 wait complete. 2026-02-20T13:27:54.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.410+0000 7fedd1e2a640 1 Processor -- start 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd1e2a640 1 -- start start 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd1e2a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fedcc10f4b0 0x7fedcc11ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd1e2a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc10fea0 0x7fedcc11e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd1e2a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedcc1156a0 0x7fedcc1236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd1e2a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc123d00 con 0x7fedcc1156a0 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd1e2a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc123e70 con 0x7fedcc10f4b0 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd1e2a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc124030 con 0x7fedcc10fea0 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fedcc10f4b0 0x7fedcc11ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fedcc10f4b0 0x7fedcc11ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51234/0 (socket says 10.20.193.28:51234) 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd0e28640 1 -- 10.20.193.28:0/4168229912 learned_addr learned my addr 10.20.193.28:0/4168229912 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedc3fff640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc10fea0 0x7fedcc11e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedd1629640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedcc1156a0 0x7fedcc1236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedc3fff640 1 -- 10.20.193.28:0/4168229912 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fedcc10f4b0 msgr2=0x7fedcc11ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedc3fff640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fedcc10f4b0 0x7fedcc11ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedc3fff640 1 -- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedcc1156a0 msgr2=0x7fedcc1236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedc3fff640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedcc1156a0 0x7fedcc1236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.411+0000 7fedc3fff640 1 -- 10.20.193.28:0/4168229912 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc800a650 con 0x7fedcc10fea0 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.412+0000 7fedc3fff640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc10fea0 0x7fedcc11e310 secure :-1 s=READY pgs=349 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedb400e9c0 tx=0x7fedb400ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.412+0000 7fedc1ffb640 1 -- 10.20.193.28:0/4168229912 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedb400cc30 con 0x7fedcc10fea0 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.412+0000 7fedc1ffb640 1 -- 10.20.193.28:0/4168229912 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fedb400cd90 con 0x7fedcc10fea0 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.412+0000 7fedd1e2a640 1 -- 10.20.193.28:0/4168229912 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc124310 con 0x7fedcc10fea0 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.412+0000 7fedd1e2a640 1 -- 10.20.193.28:0/4168229912 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc164a10 con 0x7fedcc10fea0 2026-02-20T13:27:54.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.412+0000 7fedc1ffb640 1 -- 10.20.193.28:0/4168229912 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedb4010430 con 0x7fedcc10fea0 2026-02-20T13:27:54.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.415+0000 7fedc1ffb640 1 -- 10.20.193.28:0/4168229912 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fedb401f060 con 0x7fedcc10fea0 2026-02-20T13:27:54.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.416+0000 7fedc1ffb640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feda80b56e0 0x7feda80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.416+0000 7fedc1ffb640 1 -- 10.20.193.28:0/4168229912 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fedb4014070 con 0x7fedcc10fea0 2026-02-20T13:27:54.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.416+0000 7fedd0e28640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feda80b56e0 0x7feda80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.417+0000 7fedd0e28640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feda80b56e0 0x7feda80d5b90 secure :-1 s=READY pgs=503 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedbc0095d0 tx=0x7fedbc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.417+0000 7fedd50ade00 1 Processor -- start 2026-02-20T13:27:54.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd50ade00 1 -- start start 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5e730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5ec70 0x5591deca35e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 0x5591decc3f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd50ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5591deb74780 con 0x5591deca3b20 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd50ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5591deb704b0 con 0x5591dec5ec70 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd50ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5591deb6a450 con 0x5591dec5e360 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5e730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5e730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36190/0 (socket says 10.20.193.28:36190) 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd0e28640 1 -- 10.20.193.28:0/2913328204 learned_addr learned my addr 10.20.193.28:0/2913328204 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5ec70 0x5591deca35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd1629640 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 0x5591decc3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedc3fff640 1 -- 10.20.193.28:0/2913328204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 msgr2=0x5591dec5e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5e730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedc3fff640 1 -- 10.20.193.28:0/2913328204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 msgr2=0x5591decc3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 0x5591decc3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedc3fff640 1 -- 10.20.193.28:0/2913328204 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591deb15d10 con 0x5591dec5ec70 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.418+0000 7fedd0e28640 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5e730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5ec70 0x5591deca35e0 secure :-1 s=READY pgs=417 gs=3 cs=0 l=1 c_cookie=9249340711854414763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedb40e45b0 tx=0x7fedb40acef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=805c425f50a41bab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fed994e4640 1 -- 10.20.193.28:0/2913328204 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedb4005000 con 0x5591dec5ec70 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fed994e4640 1 -- 10.20.193.28:0/2913328204 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fedb40ad840 con 0x5591dec5ec70 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fed994e4640 1 -- 10.20.193.28:0/2913328204 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedb40b7d70 con 0x5591dec5ec70 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 -- 10.20.193.28:0/2913328204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5ec70 msgr2=0x5591deca35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5ec70 0x5591deca35e0 secure :-1 s=READY pgs=417 gs=3 cs=0 l=1 c_cookie=9249340711854414763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedb40e45b0 tx=0x7fedb40acef0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 -- 10.20.193.28:0/2913328204 shutdown_connections 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 0x5591decc3f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5ec70 0x5591deca35e0 unknown :-1 s=CLOSED pgs=417 gs=3 cs=0 l=1 c_cookie=9249340711854414763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2913328204 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5e730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 -- 10.20.193.28:0/2913328204 >> 10.20.193.28:0/2913328204 conn(0x5591dec3c860 msgr2=0x5591dec5cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 -- 10.20.193.28:0/2913328204 shutdown_connections 2026-02-20T13:27:54.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.419+0000 7fedd50ade00 1 -- 10.20.193.28:0/2913328204 wait complete. 2026-02-20T13:27:54.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.421+0000 7fedd50ade00 1 -- start start 2026-02-20T13:27:54.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.421+0000 7fedd50ade00 1 Processor -- start 2026-02-20T13:27:54.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.421+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5f730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.421+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec5fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.421+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec64740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.421+0000 7fedd50ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5591dec64c80 con 0x5591dec5ec70 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.421+0000 7fedd50ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5591dec64df0 con 0x5591deca3b20 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.421+0000 7fedd50ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5591dec64fb0 con 0x5591dec5e360 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5f730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5f730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36198/0 (socket says 10.20.193.28:36198) 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 -- 10.20.193.28:0/2096978113 learned_addr learned my addr 10.20.193.28:0/2096978113 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec5fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd1629640 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec64740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 -- 10.20.193.28:0/2096978113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 msgr2=0x5591dec64740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec64740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 -- 10.20.193.28:0/2096978113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 msgr2=0x5591dec5fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec5fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 -- 10.20.193.28:0/2096978113 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc164a10 con 0x5591dec5e360 2026-02-20T13:27:54.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec5fc70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:54.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fedd0e28640 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5f730 secure :-1 s=READY pgs=350 gs=2 cs=0 l=1 c_cookie=3344731489744766840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedbc009700 tx=0x7fedbc013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e6adf919b4cc778 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.422+0000 7fed8a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:54.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2096978113 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedbc021040 con 0x5591dec5e360 2026-02-20T13:27:54.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2096978113 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fedbc01be10 con 0x5591dec5e360 2026-02-20T13:27:54.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc003c80 con 0x5591dec5e360 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2096978113 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedbc01a460 con 0x5591dec5e360 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2096978113 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fedbc01a5c0 con 0x5591dec5e360 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 10 client.29086 _ll_register_callbacks cb 0x5591deaeba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591de8006f0 con 0x5591dec5e360 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2096978113 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedbc005000 con 0x5591dec5e360 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 10 client.29086 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5591deaee3c0 con 0x5591dec5e360 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2096978113 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedbc0051a0 con 0x5591dec5e360 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 10 client.29086 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 10 client.29086 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 20 client.29086 populate_metadata read hostname 'trial028' 2026-02-20T13:27:54.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.423+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5591dec89a00 0x5591dec89ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.424+0000 7fedd50ade00 4 client.29086 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.424+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591deb0cf80 con 0x5591dec89a00 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.424+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5591dec89a00 0x5591dec89ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.424+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5591dec89a00 0x5591dec89ea0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=12258657331370238270 s_cookie=10530478327822281896 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa1f7fe4cb8fa13e server_cookie=9223c63f0ccbeca8 in_seq=0 out_seq=0 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.424+0000 7fed8a7fc640 10 client.29086 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2096978113 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5591deb0cf80 con 0x5591dec89a00 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fed8a7fc640 10 client.29086 handle_command_reply: tid=0 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 client.29086 shutdown 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 msgr2=0x5591dec5f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5f730 secure :-1 s=READY pgs=350 gs=2 cs=0 l=1 c_cookie=3344731489744766840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedbc009700 tx=0x7fedbc013040 comp rx=0 tx=0).stop 2026-02-20T13:27:54.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 shutdown_connections 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5591dec89a00 0x5591dec89ea0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=12258657331370238270 s_cookie=10530478327822281896 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec5fc70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec64740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2096978113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec5f730 unknown :-1 s=CLOSED pgs=350 gs=2 cs=0 l=1 c_cookie=3344731489744766840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fed8a7fc640 0 client.29086 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 >> 10.20.193.28:0/2096978113 conn(0x5591dec3c860 msgr2=0x5591dec5cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 shutdown_connections 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 1 -- 10.20.193.28:0/2096978113 wait complete. 2026-02-20T13:27:54.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.425+0000 7fedd50ade00 20 client.29086 trim_cache size 0 max 16384 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.432+0000 7fedd50ade00 1 Processor -- start 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.432+0000 7fedd50ade00 1 -- start start 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.432+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5e360 0x5591decc33d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.432+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5ec70 0x5591decc3910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.432+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 0x5591deca2d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.432+0000 7fedd50ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5591deb68080 con 0x5591deca3b20 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.432+0000 7fedd50ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5591de828700 con 0x5591dec5e360 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.432+0000 7fedd50ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5591dec60250 con 0x5591dec5ec70 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5e360 0x5591decc33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedc3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5ec70 0x5591decc3910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5e360 0x5591decc33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51268/0 (socket says 10.20.193.28:51268) 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedd0e28640 1 -- 10.20.193.28:0/853923802 learned_addr learned my addr 10.20.193.28:0/853923802 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedd1629640 1 --2- 10.20.193.28:0/853923802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 0x5591deca2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedc3fff640 1 -- 10.20.193.28:0/853923802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5e360 msgr2=0x5591decc33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedc3fff640 1 --2- 10.20.193.28:0/853923802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5e360 0x5591decc33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedc3fff640 1 -- 10.20.193.28:0/853923802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 msgr2=0x5591deca2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedc3fff640 1 --2- 10.20.193.28:0/853923802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 0x5591deca2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedc3fff640 1 -- 10.20.193.28:0/853923802 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591deb000e0 con 0x5591dec5ec70 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fedc3fff640 1 --2- 10.20.193.28:0/853923802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5ec70 0x5591decc3910 secure :-1 s=READY pgs=351 gs=2 cs=0 l=1 c_cookie=1025390114101581055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedb40aa0b0 tx=0x7fedb40052d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3aeae04338d4ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fed98ce3640 1 -- 10.20.193.28:0/853923802 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedb40b7f80 con 0x5591dec5ec70 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fed98ce3640 1 -- 10.20.193.28:0/853923802 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fedb40b5140 con 0x5591dec5ec70 2026-02-20T13:27:54.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.433+0000 7fed98ce3640 1 -- 10.20.193.28:0/853923802 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedb40adad0 con 0x5591dec5ec70 2026-02-20T13:27:54.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 -- 10.20.193.28:0/853923802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5ec70 msgr2=0x5591decc3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 --2- 10.20.193.28:0/853923802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5ec70 0x5591decc3910 secure :-1 s=READY pgs=351 gs=2 cs=0 l=1 c_cookie=1025390114101581055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedb40aa0b0 tx=0x7fedb40052d0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 -- 10.20.193.28:0/853923802 shutdown_connections 2026-02-20T13:27:54.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 --2- 10.20.193.28:0/853923802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591deca3b20 0x5591deca2d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 --2- 10.20.193.28:0/853923802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5ec70 0x5591decc3910 unknown :-1 s=CLOSED pgs=351 gs=2 cs=0 l=1 c_cookie=1025390114101581055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 --2- 10.20.193.28:0/853923802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591dec5e360 0x5591decc33d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 -- 10.20.193.28:0/853923802 >> 10.20.193.28:0/853923802 conn(0x5591dec3c860 msgr2=0x5591decb5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 -- 10.20.193.28:0/853923802 shutdown_connections 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 -- 10.20.193.28:0/853923802 wait complete. 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 -- start start 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.434+0000 7fedd50ade00 1 Processor -- start 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec90140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec8a610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd50ade00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec8ab50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd50ade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5591dec60250 con 0x5591dec5ec70 2026-02-20T13:27:54.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd50ade00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5591dec8b280 con 0x5591deca3b20 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd50ade00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5591dec8b440 con 0x5591dec5e360 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec90140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd0e28640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec90140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36212/0 (socket says 10.20.193.28:36212) 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd0e28640 1 -- 10.20.193.28:0/2065327900 learned_addr learned my addr 10.20.193.28:0/2065327900 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec8a610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd1629640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec8ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd0e28640 1 -- 10.20.193.28:0/2065327900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 msgr2=0x5591dec8ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd0e28640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec8ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd0e28640 1 -- 10.20.193.28:0/2065327900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 msgr2=0x5591dec8a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd0e28640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec8a610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd0e28640 1 -- 10.20.193.28:0/2065327900 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591deafab60 con 0x5591dec5e360 2026-02-20T13:27:54.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedd1629640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec8ab50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.435+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec8a610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fedd0e28640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec90140 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=12535015977793076466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedbc009700 tx=0x7fedbc02df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adf5529e5233bcf2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fed8a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2065327900 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedbc021030 con 0x5591dec5e360 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2065327900 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fedbc034070 con 0x5591dec5e360 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2065327900 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedbc02e940 con 0x5591dec5e360 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591deb15d10 con 0x5591dec5e360 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2065327900 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fedbc00f960 con 0x5591dec5e360 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fed8a7fc640 10 client.29092 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fedd50ade00 10 client.29092 _ll_register_callbacks cb 0x5591deaeba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedb40ad840 con 0x5591dec5e360 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2065327900 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedbc02eaa0 con 0x5591dec5e360 2026-02-20T13:27:54.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fedd50ade00 10 client.29092 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.436+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5591deaee6f0 con 0x5591dec5e360 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2065327900 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedbc042030 con 0x5591dec5e360 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fedd50ade00 10 client.29092 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fedd50ade00 10 client.29092 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fedd50ade00 20 client.29092 populate_metadata read hostname 'trial028' 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5591ded5a570 0x5591ded7aa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fedd50ade00 4 client.29092 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5591de7fdf40 con 0x5591ded5a570 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5591ded5a570 0x5591ded7aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fedc3fff640 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5591ded5a570 0x5591ded7aa20 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=9726660167888313412 s_cookie=9330831200726747202 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=86fc09e37dec9c44 server_cookie=817dc58a4a730842 in_seq=0 out_seq=0 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.437+0000 7fed8a7fc640 10 client.29092 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:27:54.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fed8a7fc640 1 -- 10.20.193.28:0/2065327900 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5591de7fdf40 con 0x5591ded5a570 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fed8a7fc640 10 client.29092 handle_command_reply: tid=0 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 client.29092 shutdown 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 msgr2=0x5591dec90140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec90140 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=12535015977793076466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedbc009700 tx=0x7fedbc02df80 comp rx=0 tx=0).stop 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 shutdown_connections 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5591ded5a570 0x5591ded7aa20 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=9726660167888313412 s_cookie=9330831200726747202 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591dec5ec70 0x5591dec8a610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5591deca3b20 0x5591dec8ab50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 --2- 10.20.193.28:0/2065327900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5591dec5e360 0x5591dec90140 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=12535015977793076466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fed8a7fc640 0 client.29092 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 >> 10.20.193.28:0/2065327900 conn(0x5591dec3c860 msgr2=0x5591deca2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 shutdown_connections 2026-02-20T13:27:54.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 1 -- 10.20.193.28:0/2065327900 wait complete. 2026-02-20T13:27:54.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.438+0000 7fedd50ade00 20 client.29092 trim_cache size 0 max 16384 2026-02-20T13:27:54.447 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 -- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feda80b56e0 msgr2=0x7feda80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feda80b56e0 0x7feda80d5b90 secure :-1 s=READY pgs=503 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedbc0095d0 tx=0x7fedbc005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 -- 10.20.193.28:0/4168229912 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc10fea0 msgr2=0x7fedcc11e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc10fea0 0x7fedcc11e310 secure :-1 s=READY pgs=349 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedb400e9c0 tx=0x7fedb400ee90 comp rx=0 tx=0).stop 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 -- 10.20.193.28:0/4168229912 shutdown_connections 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7feda80b56e0 0x7feda80d5b90 unknown :-1 s=CLOSED pgs=503 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedcc1156a0 0x7fedcc1236e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fedcc10fea0 0x7fedcc11e310 unknown :-1 s=CLOSED pgs=349 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 --2- 10.20.193.28:0/4168229912 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fedcc10f4b0 0x7fedcc11ddd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 -- 10.20.193.28:0/4168229912 >> 10.20.193.28:0/4168229912 conn(0x7fedcc0ecda0 msgr2=0x7fedcc10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 -- 10.20.193.28:0/4168229912 shutdown_connections 2026-02-20T13:27:54.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.439+0000 7fedd1e2a640 1 -- 10.20.193.28:0/4168229912 wait complete. 2026-02-20T13:27:54.542 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:27:54.727 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:54 trial028 ceph-mon[37442]: pgmap v498: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2026-02-20T13:27:54.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.899+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/2483463439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 msgr2=0x7ff8f0112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.899+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/2483463439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 0x7ff8f0112c80 secure :-1 s=READY pgs=1167 gs=2 cs=0 l=1 c_cookie=1982889363627914327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e4009890 tx=0x7ff8e402f120 comp rx=0 tx=0).stop 2026-02-20T13:27:54.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.900+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/2483463439 shutdown_connections 2026-02-20T13:27:54.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.900+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/2483463439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 0x7ff8f0112c80 unknown :-1 s=CLOSED pgs=1167 gs=2 cs=0 l=1 c_cookie=1982889363627914327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.900+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/2483463439 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8f0113430 0x7ff8f0173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.900+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/2483463439 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff8f010d240 0x7ff8f010d610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.900+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/2483463439 >> 10.20.193.28:0/2483463439 conn(0x7ff8f00eaad0 msgr2=0x7ff8f010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.900+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/2483463439 shutdown_connections 2026-02-20T13:27:54.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.900+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/2483463439 wait complete. 2026-02-20T13:27:54.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.900+0000 7ff8f6a1d640 1 Processor -- start 2026-02-20T13:27:54.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f6a1d640 1 -- start start 2026-02-20T13:27:54.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f6a1d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8f010d240 0x7ff8f00f56f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f6a1d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 0x7ff8f0173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f6a1d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff8f0113430 0x7ff8f00f5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f6a1d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f00fb000 con 0x7ff8f010dc30 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f6a1d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f00fb170 con 0x7ff8f0113430 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f6a1d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f00fb330 con 0x7ff8f010d240 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 0x7ff8f0173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f5a1b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8f010d240 0x7ff8f00f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 0x7ff8f0173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48670/0 (socket says 10.20.193.28:48670) 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 -- 10.20.193.28:0/4080254837 learned_addr learned my addr 10.20.193.28:0/4080254837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f621c640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff8f0113430 0x7ff8f00f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 -- 10.20.193.28:0/4080254837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8f010d240 msgr2=0x7ff8f00f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8f010d240 0x7ff8f00f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 -- 10.20.193.28:0/4080254837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff8f0113430 msgr2=0x7ff8f00f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff8f0113430 0x7ff8f00f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 -- 10.20.193.28:0/4080254837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e40094b0 con 0x7ff8f010dc30 2026-02-20T13:27:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.901+0000 7ff8f521a640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 0x7ff8f0173d00 secure :-1 s=READY pgs=1168 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e40023b0 tx=0x7ff8e40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.902+0000 7ff8deffd640 1 -- 10.20.193.28:0/4080254837 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e403d070 con 0x7ff8f010dc30 2026-02-20T13:27:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.902+0000 7ff8deffd640 1 -- 10.20.193.28:0/4080254837 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8e40044f0 con 0x7ff8f010dc30 2026-02-20T13:27:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.902+0000 7ff8deffd640 1 -- 10.20.193.28:0/4080254837 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e4041a00 con 0x7ff8f010dc30 2026-02-20T13:27:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.902+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/4080254837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f00fb5b0 con 0x7ff8f010dc30 2026-02-20T13:27:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.902+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/4080254837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f00fb9d0 con 0x7ff8f010dc30 2026-02-20T13:27:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.905+0000 7ff8deffd640 1 -- 10.20.193.28:0/4080254837 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff8e4038c20 con 0x7ff8f010dc30 2026-02-20T13:27:54.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.906+0000 7ff8deffd640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8cc0b5750 0x7ff8cc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.906+0000 7ff8deffd640 1 -- 10.20.193.28:0/4080254837 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff8e410b350 con 0x7ff8f010dc30 2026-02-20T13:27:54.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.907+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8cc0b5750 0x7ff8cc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.907+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8cc0b5750 0x7ff8cc0d5c00 secure :-1 s=READY pgs=504 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e0005b30 tx=0x7ff8e0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.907+0000 7ff8f9ca0e00 1 Processor -- start 2026-02-20T13:27:54.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f9ca0e00 1 -- start start 2026-02-20T13:27:54.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4360 0x5596d11a4730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4c70 0x5596d11e95e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 0x5596d1209f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596d10ba780 con 0x5596d11a4360 2026-02-20T13:27:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596d10b64b0 con 0x5596d11e9b20 2026-02-20T13:27:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596d10b0450 con 0x5596d11a4c70 2026-02-20T13:27:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4360 0x5596d11a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4360 0x5596d11a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48680/0 (socket says 10.20.193.28:48680) 2026-02-20T13:27:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 -- 10.20.193.28:0/3893485394 learned_addr learned my addr 10.20.193.28:0/3893485394 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f521a640 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4c70 0x5596d11e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f621c640 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 0x5596d1209f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 -- 10.20.193.28:0/3893485394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4c70 msgr2=0x5596d11e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4c70 0x5596d11e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 -- 10.20.193.28:0/3893485394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 msgr2=0x5596d1209f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 0x5596d1209f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 -- 10.20.193.28:0/3893485394 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d105bd10 con 0x5596d11a4360 2026-02-20T13:27:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.908+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4360 0x5596d11a4730 secure :-1 s=READY pgs=1169 gs=1 cs=0 l=1 c_cookie=7637987023604573191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e0004370 tx=0x7ff8e0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ff94baecfe6407 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8be4e6640 1 -- 10.20.193.28:0/3893485394 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e00119c0 con 0x5596d11a4360 2026-02-20T13:27:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8be4e6640 1 -- 10.20.193.28:0/3893485394 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8e00028e0 con 0x5596d11a4360 2026-02-20T13:27:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8be4e6640 1 -- 10.20.193.28:0/3893485394 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e0003790 con 0x5596d11a4360 2026-02-20T13:27:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3893485394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4360 msgr2=0x5596d11a4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4360 0x5596d11a4730 secure :-1 s=READY pgs=1169 gs=1 cs=0 l=1 c_cookie=7637987023604573191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e0004370 tx=0x7ff8e0014000 comp rx=0 tx=0).stop 2026-02-20T13:27:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3893485394 shutdown_connections 2026-02-20T13:27:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 0x5596d1209f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4c70 0x5596d11e95e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/3893485394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4360 0x5596d11a4730 unknown :-1 s=CLOSED pgs=1169 gs=1 cs=0 l=1 c_cookie=7637987023604573191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3893485394 >> 10.20.193.28:0/3893485394 conn(0x5596d1182860 msgr2=0x5596d11a2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3893485394 shutdown_connections 2026-02-20T13:27:54.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.909+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3893485394 wait complete. 2026-02-20T13:27:54.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.910+0000 7ff8f9ca0e00 1 -- start start 2026-02-20T13:27:54.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f9ca0e00 1 Processor -- start 2026-02-20T13:27:54.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d1201770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d1201cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d1203a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596d1203fb0 con 0x5596d11e9b20 2026-02-20T13:27:54.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596d1204120 con 0x5596d11a4c70 2026-02-20T13:27:54.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596d12042e0 con 0x5596d11a4360 2026-02-20T13:27:54.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f621c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d1203a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f621c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d1203a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48696/0 (socket says 10.20.193.28:48696) 2026-02-20T13:27:54.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f621c640 1 -- 10.20.193.28:0/2707861048 learned_addr learned my addr 10.20.193.28:0/2707861048 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d1201770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f521a640 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d1201cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f621c640 1 -- 10.20.193.28:0/2707861048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 msgr2=0x5596d1201770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f621c640 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d1201770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f621c640 1 -- 10.20.193.28:0/2707861048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 msgr2=0x5596d1201cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f621c640 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d1201cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.911+0000 7ff8f621c640 1 -- 10.20.193.28:0/2707861048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d10343c0 con 0x5596d11e9b20 2026-02-20T13:27:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f621c640 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d1203a40 secure :-1 s=READY pgs=1170 gs=2 cs=0 l=1 c_cookie=8279153226485798186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ec003cd0 tx=0x7ff8ec00aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e575fea1b7152a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8ab7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:54.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/2707861048 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8ec018070 con 0x5596d11e9b20 2026-02-20T13:27:54.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/2707861048 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8ec011d40 con 0x5596d11e9b20 2026-02-20T13:27:54.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/2707861048 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8ec0103c0 con 0x5596d11e9b20 2026-02-20T13:27:54.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e00039b0 con 0x5596d11e9b20 2026-02-20T13:27:54.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/2707861048 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff8ec010550 con 0x5596d11e9b20 2026-02-20T13:27:54.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f9ca0e00 10 client.19242 _ll_register_callbacks cb 0x5596d1031a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:54.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596d0d466f0 con 0x5596d11e9b20 2026-02-20T13:27:54.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/2707861048 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8ec011860 con 0x5596d11e9b20 2026-02-20T13:27:54.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f9ca0e00 10 client.19242 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:54.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5596d10460e0 con 0x5596d11e9b20 2026-02-20T13:27:54.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/2707861048 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8ec011a00 con 0x5596d11e9b20 2026-02-20T13:27:54.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f9ca0e00 10 client.19242 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:54.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f9ca0e00 10 client.19242 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:27:54.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.912+0000 7ff8f9ca0e00 20 client.19242 populate_metadata read hostname 'trial028' 2026-02-20T13:27:54.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.913+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5596d1209c90 0x5596d11e78a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.913+0000 7ff8f9ca0e00 4 client.19242 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:54.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.913+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596d1052f80 con 0x5596d1209c90 2026-02-20T13:27:54.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.913+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5596d1209c90 0x5596d11e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5596d1209c90 0x5596d11e78a0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=14205110460687468822 s_cookie=4366180629127291925 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c522b0b3bc764916 server_cookie=3c97ca263052e415 in_seq=0 out_seq=0 2026-02-20T13:27:54.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8ab7fe640 10 client.19242 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:27:54.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/2707861048 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5596d1052f80 con 0x5596d1209c90 2026-02-20T13:27:54.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8ab7fe640 10 client.19242 handle_command_reply: tid=0 2026-02-20T13:27:54.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 client.19242 shutdown 2026-02-20T13:27:54.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 msgr2=0x5596d1203a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d1203a40 secure :-1 s=READY pgs=1170 gs=2 cs=0 l=1 c_cookie=8279153226485798186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ec003cd0 tx=0x7ff8ec00aab0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 shutdown_connections 2026-02-20T13:27:54.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5596d1209c90 0x5596d11e78a0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=14205110460687468822 s_cookie=4366180629127291925 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d1203a40 unknown :-1 s=CLOSED pgs=1170 gs=2 cs=0 l=1 c_cookie=8279153226485798186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d1201cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/2707861048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d1201770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8ab7fe640 0 client.19242 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:27:54.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 >> 10.20.193.28:0/2707861048 conn(0x5596d1182860 msgr2=0x5596d11a2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.914+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 shutdown_connections 2026-02-20T13:27:54.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.915+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/2707861048 wait complete. 2026-02-20T13:27:54.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.915+0000 7ff8f9ca0e00 20 client.19242 trim_cache size 0 max 16384 2026-02-20T13:27:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f9ca0e00 1 Processor -- start 2026-02-20T13:27:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f9ca0e00 1 -- start start 2026-02-20T13:27:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d12039d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4c70 0x5596d11fe900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 0x5596d11fee40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596d10ae080 con 0x5596d11a4c70 2026-02-20T13:27:54.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596d0d6e700 con 0x5596d11e9b20 2026-02-20T13:27:54.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596d11822a0 con 0x5596d11a4360 2026-02-20T13:27:54.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f521a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4c70 0x5596d11fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f621c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 0x5596d11fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f521a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4c70 0x5596d11fe900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48710/0 (socket says 10.20.193.28:48710) 2026-02-20T13:27:54.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f521a640 1 -- 10.20.193.28:0/3363295408 learned_addr learned my addr 10.20.193.28:0/3363295408 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d12039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f521a640 1 -- 10.20.193.28:0/3363295408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 msgr2=0x5596d12039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f521a640 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d12039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f521a640 1 -- 10.20.193.28:0/3363295408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 msgr2=0x5596d11fee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f521a640 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 0x5596d11fee40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.922+0000 7ff8f521a640 1 -- 10.20.193.28:0/3363295408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d1040b60 con 0x5596d11a4c70 2026-02-20T13:27:54.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f521a640 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4c70 0x5596d11fe900 secure :-1 s=READY pgs=1171 gs=2 cs=0 l=1 c_cookie=103547401601443136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e40bb0b0 tx=0x7ff8e40414b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fdfd029de6540 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d12039d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:54.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8bdce5640 1 -- 10.20.193.28:0/3363295408 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e40d0f60 con 0x5596d11a4c70 2026-02-20T13:27:54.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8bdce5640 1 -- 10.20.193.28:0/3363295408 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8e4005b60 con 0x5596d11a4c70 2026-02-20T13:27:54.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8bdce5640 1 -- 10.20.193.28:0/3363295408 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e40dc360 con 0x5596d11a4c70 2026-02-20T13:27:54.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3363295408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4c70 msgr2=0x5596d11fe900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4c70 0x5596d11fe900 secure :-1 s=READY pgs=1171 gs=2 cs=0 l=1 c_cookie=103547401601443136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e40bb0b0 tx=0x7ff8e40414b0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3363295408 shutdown_connections 2026-02-20T13:27:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11a4c70 0x5596d11fe900 unknown :-1 s=CLOSED pgs=1171 gs=2 cs=0 l=1 c_cookie=103547401601443136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11e9b20 0x5596d11fee40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/3363295408 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d12039d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3363295408 >> 10.20.193.28:0/3363295408 conn(0x5596d1182860 msgr2=0x5596d12062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3363295408 shutdown_connections 2026-02-20T13:27:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.923+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/3363295408 wait complete. 2026-02-20T13:27:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.924+0000 7ff8f9ca0e00 1 -- start start 2026-02-20T13:27:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.924+0000 7ff8f9ca0e00 1 Processor -- start 2026-02-20T13:27:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.924+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d11e3920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.924+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d11e3e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.924+0000 7ff8f9ca0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d11e4510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.924+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596d11e4c10 con 0x5596d11e9b20 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.924+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596d11e4d80 con 0x5596d11a4c70 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.924+0000 7ff8f9ca0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596d11e4f40 con 0x5596d11a4360 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d11e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d11e4510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48724/0 (socket says 10.20.193.28:48724) 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 -- 10.20.193.28:0/283682102 learned_addr learned my addr 10.20.193.28:0/283682102 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d11e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f521a640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d11e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 -- 10.20.193.28:0/283682102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 msgr2=0x5596d11e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d11e3920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 -- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 msgr2=0x5596d11e3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d11e3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 -- 10.20.193.28:0/283682102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d10346f0 con 0x5596d11e9b20 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d11e3920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f521a640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d11e3e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f621c640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d11e4510 secure :-1 s=READY pgs=1172 gs=1 cs=0 l=1 c_cookie=13219410881608244884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ec025f70 tx=0x7ff8ec01d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b774c8284a315e94 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8ab7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/283682102 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8ec018070 con 0x5596d11e9b20 2026-02-20T13:27:54.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/283682102 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5596d0d466f0 con 0x5596d11e9b20 2026-02-20T13:27:54.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.925+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f00fb9d0 con 0x5596d11e9b20 2026-02-20T13:27:54.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/283682102 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8ec02c040 con 0x5596d11e9b20 2026-02-20T13:27:54.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 10 client.19248 _ll_register_callbacks cb 0x5596d1031a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:54.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8e00028e0 con 0x5596d11e9b20 2026-02-20T13:27:54.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/283682102 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff8ec025c60 con 0x5596d11e9b20 2026-02-20T13:27:54.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/283682102 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8ec01db00 con 0x5596d11e9b20 2026-02-20T13:27:54.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 10 client.19248 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:54.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5596d1046340 con 0x5596d11e9b20 2026-02-20T13:27:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/283682102 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8ec039030 con 0x5596d11e9b20 2026-02-20T13:27:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 10 client.19248 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 10 client.19248 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:27:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 20 client.19248 populate_metadata read hostname 'trial028' 2026-02-20T13:27:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5596d1188420 0x5596d11888c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 4 client.19248 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596d0d43f40 con 0x5596d1188420 2026-02-20T13:27:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.926+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5596d1188420 0x5596d11888c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f5a1b640 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5596d1188420 0x5596d11888c0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=4754720090685751638 s_cookie=15601084733518856520 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41fc28bb1bbcc156 server_cookie=d8822fe834294148 in_seq=0 out_seq=0 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8ab7fe640 10 client.19248 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8ab7fe640 1 -- 10.20.193.28:0/283682102 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596d0d43f40 con 0x5596d1188420 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8ab7fe640 10 client.19248 handle_command_reply: tid=0 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 client.19248 shutdown 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 msgr2=0x5596d11e4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d11e4510 secure :-1 s=READY pgs=1172 gs=1 cs=0 l=1 c_cookie=13219410881608244884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ec025f70 tx=0x7ff8ec01d4f0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 shutdown_connections 2026-02-20T13:27:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5596d1188420 0x5596d11888c0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=4754720090685751638 s_cookie=15601084733518856520 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596d11e9b20 0x5596d11e4510 unknown :-1 s=CLOSED pgs=1172 gs=1 cs=0 l=1 c_cookie=13219410881608244884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596d11a4c70 0x5596d11e3e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 --2- 10.20.193.28:0/283682102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596d11a4360 0x5596d11e3920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8ab7fe640 0 client.19248 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:27:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.927+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 >> 10.20.193.28:0/283682102 conn(0x5596d1182860 msgr2=0x5596d1204a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 shutdown_connections 2026-02-20T13:27:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f9ca0e00 1 -- 10.20.193.28:0/283682102 wait complete. 2026-02-20T13:27:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f9ca0e00 20 client.19248 trim_cache size 0 max 16384 2026-02-20T13:27:54.954 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8cc0b5750 msgr2=0x7ff8cc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8cc0b5750 0x7ff8cc0d5c00 secure :-1 s=READY pgs=504 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e0005b30 tx=0x7ff8e0009310 comp rx=0 tx=0).stop 2026-02-20T13:27:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 msgr2=0x7ff8f0173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 0x7ff8f0173d00 secure :-1 s=READY pgs=1168 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e40023b0 tx=0x7ff8e40028d0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/4080254837 shutdown_connections 2026-02-20T13:27:54.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff8cc0b5750 0x7ff8cc0d5c00 unknown :-1 s=CLOSED pgs=504 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f010dc30 0x7ff8f0173d00 unknown :-1 s=CLOSED pgs=1168 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff8f0113430 0x7ff8f00f5df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 --2- 10.20.193.28:0/4080254837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8f010d240 0x7ff8f00f56f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:54.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/4080254837 >> 10.20.193.28:0/4080254837 conn(0x7ff8f00eaad0 msgr2=0x7ff8f010fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:54.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/4080254837 shutdown_connections 2026-02-20T13:27:54.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:54.928+0000 7ff8f6a1d640 1 -- 10.20.193.28:0/4080254837 wait complete. 2026-02-20T13:27:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:54 trial127 ceph-mon[43817]: pgmap v498: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2026-02-20T13:27:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:54 trial034 ceph-mon[43332]: pgmap v498: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2026-02-20T13:27:55.032 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:27:55.220 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:55.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.402+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/224144267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0c8113fa0 msgr2=0x7fe0c8114370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.402+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/224144267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0c8113fa0 0x7fe0c8114370 secure :-1 s=READY pgs=418 gs=2 cs=0 l=1 c_cookie=1292728887103686284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b4009950 tx=0x7fe0b402f190 comp rx=0 tx=0).stop 2026-02-20T13:27:55.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.403+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/224144267 shutdown_connections 2026-02-20T13:27:55.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.403+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/224144267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0c8114990 0x7fe0c8119170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.403+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/224144267 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0c8119920 0x7fe0c817a2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.403+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/224144267 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0c8113fa0 0x7fe0c8114370 unknown :-1 s=CLOSED pgs=418 gs=2 cs=0 l=1 c_cookie=1292728887103686284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.403+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/224144267 >> 10.20.193.28:0/224144267 conn(0x7fe0c8064790 msgr2=0x7fe0c8064b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.403+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/224144267 shutdown_connections 2026-02-20T13:27:55.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.403+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/224144267 wait complete. 2026-02-20T13:27:55.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.403+0000 7fe0ce3bd640 1 Processor -- start 2026-02-20T13:27:55.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0ce3bd640 1 -- start start 2026-02-20T13:27:55.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0ce3bd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0c8113fa0 0x7fe0c8122060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0ce3bd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0c8114990 0x7fe0c81225a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0ce3bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0c8119920 0x7fe0c8127970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0ce3bd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8127f90 con 0x7fe0c8119920 2026-02-20T13:27:55.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0ce3bd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8128100 con 0x7fe0c8113fa0 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0ce3bd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c81282c0 con 0x7fe0c8114990 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0c8119920 0x7fe0c8127970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0c8119920 0x7fe0c8127970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48738/0 (socket says 10.20.193.28:48738) 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 -- 10.20.193.28:0/3282753744 learned_addr learned my addr 10.20.193.28:0/3282753744 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0c77fe640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0c8114990 0x7fe0c81225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0c8113fa0 0x7fe0c8122060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 -- 10.20.193.28:0/3282753744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0c8114990 msgr2=0x7fe0c81225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0c8114990 0x7fe0c81225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 -- 10.20.193.28:0/3282753744 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0c8113fa0 msgr2=0x7fe0c8122060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0c8113fa0 0x7fe0c8122060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 -- 10.20.193.28:0/3282753744 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b80094b0 con 0x7fe0c8119920 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.404+0000 7fe0cc933640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0c8119920 0x7fe0c8127970 secure :-1 s=READY pgs=1173 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0bc00f8d0 tx=0x7fe0bc00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.405+0000 7fe0c57fa640 1 -- 10.20.193.28:0/3282753744 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0bc00dce0 con 0x7fe0c8119920 2026-02-20T13:27:55.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.405+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/3282753744 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b4009570 con 0x7fe0c8119920 2026-02-20T13:27:55.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.405+0000 7fe0c57fa640 1 -- 10.20.193.28:0/3282753744 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0bc00de40 con 0x7fe0c8119920 2026-02-20T13:27:55.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.405+0000 7fe0c57fa640 1 -- 10.20.193.28:0/3282753744 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0bc0116b0 con 0x7fe0c8119920 2026-02-20T13:27:55.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.405+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/3282753744 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c8168b00 con 0x7fe0c8119920 2026-02-20T13:27:55.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.408+0000 7fe0c57fa640 1 -- 10.20.193.28:0/3282753744 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe0bc020060 con 0x7fe0c8119920 2026-02-20T13:27:55.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.409+0000 7fe0c57fa640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe09c0b5760 0x7fe09c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.409+0000 7fe0c57fa640 1 -- 10.20.193.28:0/3282753744 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe0bc015070 con 0x7fe0c8119920 2026-02-20T13:27:55.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.409+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe09c0b5760 0x7fe09c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe09c0b5760 0x7fe09c0d5c10 secure :-1 s=READY pgs=505 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b40023d0 tx=0x7fe0b4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0d03b7e00 1 Processor -- start 2026-02-20T13:27:55.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0d03b7e00 1 -- start start 2026-02-20T13:27:55.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13d360 0x55900e13d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e1825e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e182b20 0x55900e1a2f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55900e053780 con 0x55900e182b20 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55900e04f4b0 con 0x55900e13dc70 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55900e049450 con 0x55900e13d360 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e1825e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e1825e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51366/0 (socket says 10.20.193.28:51366) 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0cc933640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e182b20 0x55900e1a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0c77fe640 1 -- 10.20.193.28:0/263938403 learned_addr learned my addr 10.20.193.28:0/263938403 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.410+0000 7fe0c7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13d360 0x55900e13d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0c77fe640 1 -- 10.20.193.28:0/263938403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13d360 msgr2=0x55900e13d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0c77fe640 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13d360 0x55900e13d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0c77fe640 1 -- 10.20.193.28:0/263938403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e182b20 msgr2=0x55900e1a2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0c77fe640 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e182b20 0x55900e1a2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0c77fe640 1 -- 10.20.193.28:0/263938403 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55900dff4d10 con 0x55900e13dc70 2026-02-20T13:27:55.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13d360 0x55900e13d730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:55.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0cc933640 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e182b20 0x55900e1a2f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:55.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0c77fe640 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e1825e0 secure :-1 s=READY pgs=419 gs=2 cs=0 l=1 c_cookie=12431975169401029190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b8004240 tx=0x7fe0b8009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac873f8c94a00246 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe098ce3640 1 -- 10.20.193.28:0/263938403 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0b8002c80 con 0x55900e13dc70 2026-02-20T13:27:55.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe098ce3640 1 -- 10.20.193.28:0/263938403 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0b8002de0 con 0x55900e13dc70 2026-02-20T13:27:55.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe098ce3640 1 -- 10.20.193.28:0/263938403 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0b8010840 con 0x55900e13dc70 2026-02-20T13:27:55.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/263938403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 msgr2=0x55900e1825e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.411+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e1825e0 secure :-1 s=READY pgs=419 gs=2 cs=0 l=1 c_cookie=12431975169401029190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b8004240 tx=0x7fe0b8009c50 comp rx=0 tx=0).stop 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.412+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/263938403 shutdown_connections 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.412+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e182b20 0x55900e1a2f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.412+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e1825e0 unknown :-1 s=CLOSED pgs=419 gs=2 cs=0 l=1 c_cookie=12431975169401029190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.412+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/263938403 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13d360 0x55900e13d730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.412+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/263938403 >> 10.20.193.28:0/263938403 conn(0x55900e11b860 msgr2=0x55900e13bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.412+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/263938403 shutdown_connections 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.412+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/263938403 wait complete. 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.413+0000 7fe0d03b7e00 1 -- start start 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.413+0000 7fe0d03b7e00 1 Processor -- start 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.413+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19a710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.413+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e19ac50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.413+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e19c9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.413+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55900e19cf50 con 0x55900e13d360 2026-02-20T13:27:55.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.413+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55900e19d0c0 con 0x55900e13dc70 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.413+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55900e19d280 con 0x55900e182b20 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0cc933640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48756/0 (socket says 10.20.193.28:48756) 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0c7fff640 1 -- 10.20.193.28:0/3231588361 learned_addr learned my addr 10.20.193.28:0/3231588361 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e19ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51368/0 (socket says 10.20.193.28:51368) 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0cc933640 1 -- 10.20.193.28:0/3231588361 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 msgr2=0x55900e19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0cc933640 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0cc933640 1 -- 10.20.193.28:0/3231588361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 msgr2=0x55900e19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0cc933640 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0cc933640 1 -- 10.20.193.28:0/3231588361 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b8004400 con 0x55900e182b20 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0cc933640 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e19c9e0 secure :-1 s=READY pgs=353 gs=3 cs=0 l=1 c_cookie=8715499859944266217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0bc0e5730 tx=0x7fe0bc0ad9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f3acf227f1d9e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe089ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe089ffb640 1 -- 10.20.193.28:0/3231588361 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0bc0add80 con 0x55900e182b20 2026-02-20T13:27:55.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe089ffb640 1 -- 10.20.193.28:0/3231588361 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0bc0b3ce0 con 0x55900e182b20 2026-02-20T13:27:55.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe089ffb640 1 -- 10.20.193.28:0/3231588361 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0bc0b8ef0 con 0x55900e182b20 2026-02-20T13:27:55.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.414+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c8168b00 con 0x55900e182b20 2026-02-20T13:27:55.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe089ffb640 1 -- 10.20.193.28:0/3231588361 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe0bc0e5bd0 con 0x55900e182b20 2026-02-20T13:27:55.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 10 client.29116 _ll_register_callbacks cb 0x55900dfcaa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:55.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55900dcdf6f0 con 0x55900e182b20 2026-02-20T13:27:55.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe089ffb640 1 -- 10.20.193.28:0/3231588361 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc0ca020 con 0x55900e182b20 2026-02-20T13:27:55.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 10 client.29116 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55900dfcd3c0 con 0x55900e182b20 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe089ffb640 1 -- 10.20.193.28:0/3231588361 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0bc074280 con 0x55900e182b20 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 10 client.29116 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 10 client.29116 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 20 client.29116 populate_metadata read hostname 'trial028' 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55900e1a2c40 0x55900e1808a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 4 client.29116 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55900dfebf80 con 0x55900e1a2c40 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.415+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55900e1a2c40 0x55900e1808a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55900e1a2c40 0x55900e1808a0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=7472228795193898909 s_cookie=12513382421155803349 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=67b2b07fe9fa379d server_cookie=ada87703679bf0d5 in_seq=0 out_seq=0 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe089ffb640 10 client.29116 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe089ffb640 1 -- 10.20.193.28:0/3231588361 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55900dfebf80 con 0x55900e1a2c40 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe089ffb640 10 client.29116 handle_command_reply: tid=0 2026-02-20T13:27:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0d03b7e00 1 client.29116 shutdown 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 msgr2=0x55900e19c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e19c9e0 secure :-1 s=READY pgs=353 gs=3 cs=0 l=1 c_cookie=8715499859944266217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0bc0e5730 tx=0x7fe0bc0ad9a0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 shutdown_connections 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55900e1a2c40 0x55900e1808a0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=7472228795193898909 s_cookie=12513382421155803349 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e19c9e0 unknown :-1 s=CLOSED pgs=353 gs=3 cs=0 l=1 c_cookie=8715499859944266217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13dc70 0x55900e19ac50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/3231588361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19a710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.416+0000 7fe089ffb640 0 client.29116 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.417+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 >> 10.20.193.28:0/3231588361 conn(0x55900e11b860 msgr2=0x55900e13bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.417+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 shutdown_connections 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.417+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/3231588361 wait complete. 2026-02-20T13:27:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.417+0000 7fe0d03b7e00 20 client.29116 trim_cache size 0 max 16384 2026-02-20T13:27:55.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0d03b7e00 1 Processor -- start 2026-02-20T13:27:55.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0d03b7e00 1 -- start start 2026-02-20T13:27:55.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13d360 0x55900e19c970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13dc70 0x55900e181e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e182390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55900e047080 con 0x55900e13dc70 2026-02-20T13:27:55.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55900dd07700 con 0x55900e13d360 2026-02-20T13:27:55.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55900e11b2a0 con 0x55900e182b20 2026-02-20T13:27:55.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0c7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13d360 0x55900e19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0c77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13dc70 0x55900e181e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0c7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13d360 0x55900e19c970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51376/0 (socket says 10.20.193.28:51376) 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0c7fff640 1 -- 10.20.193.28:0/1391269807 learned_addr learned my addr 10.20.193.28:0/1391269807 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0cc933640 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e182390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0c7fff640 1 -- 10.20.193.28:0/1391269807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 msgr2=0x55900e182390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e182390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0c7fff640 1 -- 10.20.193.28:0/1391269807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13dc70 msgr2=0x55900e181e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.424+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13dc70 0x55900e181e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0c7fff640 1 -- 10.20.193.28:0/1391269807 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55900e188080 con 0x55900e13d360 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0c77fe640 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13dc70 0x55900e181e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13d360 0x55900e19c970 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=7902879651855513462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b4009950 tx=0x7fe0b403b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dacab2c0f82b776 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe08bfff640 1 -- 10.20.193.28:0/1391269807 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0b40028c0 con 0x55900e13d360 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe08bfff640 1 -- 10.20.193.28:0/1391269807 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0b4002e10 con 0x55900e13d360 2026-02-20T13:27:55.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe08bfff640 1 -- 10.20.193.28:0/1391269807 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0b4038ea0 con 0x55900e13d360 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/1391269807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13d360 msgr2=0x55900e19c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13d360 0x55900e19c970 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=7902879651855513462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b4009950 tx=0x7fe0b403b000 comp rx=0 tx=0).stop 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/1391269807 shutdown_connections 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13dc70 0x55900e181e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e182b20 0x55900e182390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/1391269807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e13d360 0x55900e19c970 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=7902879651855513462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/1391269807 >> 10.20.193.28:0/1391269807 conn(0x55900e11b860 msgr2=0x55900e19f270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/1391269807 shutdown_connections 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.425+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/1391269807 wait complete. 2026-02-20T13:27:55.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.426+0000 7fe0d03b7e00 1 -- start start 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.426+0000 7fe0d03b7e00 1 Processor -- start 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.426+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19f0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.426+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13dc70 0x55900e19dc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.426+0000 7fe0d03b7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e182b20 0x55900e19e160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.426+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55900e19f6a0 con 0x55900e13d360 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.426+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55900e19f810 con 0x55900e182b20 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.426+0000 7fe0d03b7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55900e19e6a0 con 0x55900e13dc70 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e182b20 0x55900e19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e182b20 0x55900e19e160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51386/0 (socket says 10.20.193.28:51386) 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 -- 10.20.193.28:0/954292057 learned_addr learned my addr 10.20.193.28:0/954292057 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0c77fe640 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13dc70 0x55900e19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 -- 10.20.193.28:0/954292057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13dc70 msgr2=0x55900e19dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13dc70 0x55900e19dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 -- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 msgr2=0x55900e19f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 -- 10.20.193.28:0/954292057 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b404c040 con 0x55900e182b20 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19f0e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0cc933640 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e182b20 0x55900e19e160 secure :-1 s=READY pgs=421 gs=3 cs=0 l=1 c_cookie=3738420230037232913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0bc0ae230 tx=0x7fe0bc0064a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e189646880dd11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe089ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe089ffb640 1 -- 10.20.193.28:0/954292057 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0bc0ca040 con 0x55900e182b20 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe089ffb640 1 -- 10.20.193.28:0/954292057 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55900dcdf6f0 con 0x55900e182b20 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe089ffb640 1 -- 10.20.193.28:0/954292057 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0bc0b3ce0 con 0x55900e182b20 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.427+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55900dff4d10 con 0x55900e182b20 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe089ffb640 1 -- 10.20.193.28:0/954292057 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe0bc0747e0 con 0x55900e182b20 2026-02-20T13:27:55.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe089ffb640 10 client.29216 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 10 client.29216 _ll_register_callbacks cb 0x55900dfcaa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0b8002de0 con 0x55900e182b20 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe089ffb640 1 -- 10.20.193.28:0/954292057 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc016e80 con 0x55900e182b20 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 10 client.29216 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55900dfdf0e0 con 0x55900e182b20 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe089ffb640 1 -- 10.20.193.28:0/954292057 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0bc0b5060 con 0x55900e182b20 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 10 client.29216 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 10 client.29216 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 20 client.29216 populate_metadata read hostname 'trial028' 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55900e11ee10 0x55900e11f280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 4 client.29216 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55900dcdcf40 con 0x55900e11ee10 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.428+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55900e11ee10 0x55900e11f280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0c7fff640 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55900e11ee10 0x55900e11f280 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=15815720216125332621 s_cookie=9193888618731277121 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db7cb9bdc51d5c8d server_cookie=7f9740fcc7fc0b41 in_seq=0 out_seq=0 2026-02-20T13:27:55.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe089ffb640 10 client.29216 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:27:55.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe089ffb640 1 -- 10.20.193.28:0/954292057 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55900dcdcf40 con 0x55900e11ee10 2026-02-20T13:27:55.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe089ffb640 10 client.29216 handle_command_reply: tid=0 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 client.29216 shutdown 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e182b20 msgr2=0x55900e19e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e182b20 0x55900e19e160 secure :-1 s=READY pgs=421 gs=3 cs=0 l=1 c_cookie=3738420230037232913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0bc0ae230 tx=0x7fe0bc0064a0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 shutdown_connections 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55900e11ee10 0x55900e11f280 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=15815720216125332621 s_cookie=9193888618731277121 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55900e182b20 0x55900e19e160 unknown :-1 s=CLOSED pgs=421 gs=3 cs=0 l=1 c_cookie=3738420230037232913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55900e13dc70 0x55900e19dc20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe089ffb640 0 client.29216 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 --2- 10.20.193.28:0/954292057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55900e13d360 0x55900e19f0e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 >> 10.20.193.28:0/954292057 conn(0x55900e11b860 msgr2=0x55900e19b740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 shutdown_connections 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 1 -- 10.20.193.28:0/954292057 wait complete. 2026-02-20T13:27:55.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.429+0000 7fe0d03b7e00 20 client.29216 trim_cache size 0 max 16384 2026-02-20T13:27:55.437 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:55.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe09c0b5760 msgr2=0x7fe09c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe09c0b5760 0x7fe09c0d5c10 secure :-1 s=READY pgs=505 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b40023d0 tx=0x7fe0b4031040 comp rx=0 tx=0).stop 2026-02-20T13:27:55.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0c8119920 msgr2=0x7fe0c8127970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0c8119920 0x7fe0c8127970 secure :-1 s=READY pgs=1173 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0bc00f8d0 tx=0x7fe0bc00fda0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/3282753744 shutdown_connections 2026-02-20T13:27:55.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe09c0b5760 0x7fe09c0d5c10 unknown :-1 s=CLOSED pgs=505 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0c8119920 0x7fe0c8127970 unknown :-1 s=CLOSED pgs=1173 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0c8114990 0x7fe0c81225a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 --2- 10.20.193.28:0/3282753744 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0c8113fa0 0x7fe0c8122060 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/3282753744 >> 10.20.193.28:0/3282753744 conn(0x7fe0c8064790 msgr2=0x7fe0c8065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/3282753744 shutdown_connections 2026-02-20T13:27:55.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.430+0000 7fe0ce3bd640 1 -- 10.20.193.28:0/3282753744 wait complete. 2026-02-20T13:27:55.531 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:27:55.717 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:55.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1900073046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc10c040 msgr2=0x7fbfcc10f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1900073046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc10c040 0x7fbfcc10f990 secure :-1 s=READY pgs=1174 gs=1 cs=0 l=1 c_cookie=4001105771139969345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc0009950 tx=0x7fbfc002f190 comp rx=0 tx=0).stop 2026-02-20T13:27:55.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1900073046 shutdown_connections 2026-02-20T13:27:55.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1900073046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc10c040 0x7fbfcc10f990 unknown :-1 s=CLOSED pgs=1174 gs=1 cs=0 l=1 c_cookie=4001105771139969345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1900073046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbfcc110140 0x7fbfcc173d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1900073046 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbfcc10b650 0x7fbfcc10ba20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1900073046 >> 10.20.193.28:0/1900073046 conn(0x7fbfcc0e9080 msgr2=0x7fbfcc109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1900073046 shutdown_connections 2026-02-20T13:27:55.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.901+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1900073046 wait complete. 2026-02-20T13:27:55.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.902+0000 7fbfd22cd640 1 Processor -- start 2026-02-20T13:27:55.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.902+0000 7fbfd22cd640 1 -- start start 2026-02-20T13:27:55.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.902+0000 7fbfd22cd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbfcc10b650 0x7fbfcc0f3d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.902+0000 7fbfd22cd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbfcc10c040 0x7fbfcc173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.902+0000 7fbfd22cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc110140 0x7fbfcc0f4440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.902+0000 7fbfd22cd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc0f9600 con 0x7fbfcc110140 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.902+0000 7fbfd22cd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc0f9770 con 0x7fbfcc10b650 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.902+0000 7fbfd22cd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc0f9930 con 0x7fbfcc10c040 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd12cb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbfcc10b650 0x7fbfcc0f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd12cb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbfcc10b650 0x7fbfcc0f3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51404/0 (socket says 10.20.193.28:51404) 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd12cb640 1 -- 10.20.193.28:0/1729303406 learned_addr learned my addr 10.20.193.28:0/1729303406 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd0aca640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbfcc10c040 0x7fbfcc173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc110140 0x7fbfcc0f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd1acc640 1 -- 10.20.193.28:0/1729303406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbfcc10c040 msgr2=0x7fbfcc173c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbfcc10c040 0x7fbfcc173c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd1acc640 1 -- 10.20.193.28:0/1729303406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbfcc10b650 msgr2=0x7fbfcc0f3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbfcc10b650 0x7fbfcc0f3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd1acc640 1 -- 10.20.193.28:0/1729303406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc0009570 con 0x7fbfcc110140 2026-02-20T13:27:55.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc110140 0x7fbfcc0f4440 secure :-1 s=READY pgs=1175 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc800f940 tx=0x7fbfc800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfba7fc640 1 -- 10.20.193.28:0/1729303406 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfc800dce0 con 0x7fbfcc110140 2026-02-20T13:27:55.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfba7fc640 1 -- 10.20.193.28:0/1729303406 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbfc800de40 con 0x7fbfcc110140 2026-02-20T13:27:55.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfba7fc640 1 -- 10.20.193.28:0/1729303406 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfc80116b0 con 0x7fbfcc110140 2026-02-20T13:27:55.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1729303406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfcc0f9c10 con 0x7fbfcc110140 2026-02-20T13:27:55.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.903+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1729303406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc0fa0e0 con 0x7fbfcc110140 2026-02-20T13:27:55.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.907+0000 7fbfba7fc640 1 -- 10.20.193.28:0/1729303406 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbfc8020060 con 0x7fbfcc110140 2026-02-20T13:27:55.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.908+0000 7fbfba7fc640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfa80b5750 0x7fbfa80d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.908+0000 7fbfba7fc640 1 -- 10.20.193.28:0/1729303406 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbfc8015070 con 0x7fbfcc110140 2026-02-20T13:27:55.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.908+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfa80b5750 0x7fbfa80d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.909+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfa80b5750 0x7fbfa80d5c00 secure :-1 s=READY pgs=506 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfbc0095d0 tx=0x7fbfbc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.909+0000 7fbfd5550e00 1 Processor -- start 2026-02-20T13:27:55.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.909+0000 7fbfd5550e00 1 -- start start 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8360 0x55a0cfef8730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 0x55a0cff3d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff5df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0cfe0e780 con 0x55a0cff3db20 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a0cfe0a4b0 con 0x55a0cfef8360 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a0cfe04450 con 0x55a0cfef8c70 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd1acc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff5df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd12cb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8360 0x55a0cfef8730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd1acc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff5df00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48810/0 (socket says 10.20.193.28:48810) 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd1acc640 1 -- 10.20.193.28:0/934729682 learned_addr learned my addr 10.20.193.28:0/934729682 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd0aca640 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 0x55a0cff3d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd12cb640 1 -- 10.20.193.28:0/934729682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 msgr2=0x55a0cff3d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 0x55a0cff3d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd12cb640 1 -- 10.20.193.28:0/934729682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 msgr2=0x55a0cff5df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff5df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd12cb640 1 -- 10.20.193.28:0/934729682 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0cfdafd10 con 0x55a0cfef8360 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff5df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8360 0x55a0cfef8730 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=236338802943482183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfbc01c580 tx=0x7fbfbc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=347a4e39c165947 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.910+0000 7fbf99ce5640 1 -- 10.20.193.28:0/934729682 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfbc004110 con 0x55a0cfef8360 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbf99ce5640 1 -- 10.20.193.28:0/934729682 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbfbc003b90 con 0x55a0cfef8360 2026-02-20T13:27:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbf99ce5640 1 -- 10.20.193.28:0/934729682 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfbc01d970 con 0x55a0cfef8360 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 -- 10.20.193.28:0/934729682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8360 msgr2=0x55a0cfef8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8360 0x55a0cfef8730 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=236338802943482183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfbc01c580 tx=0x7fbfbc014000 comp rx=0 tx=0).stop 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 -- 10.20.193.28:0/934729682 shutdown_connections 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff5df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 0x55a0cff3d5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/934729682 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8360 0x55a0cfef8730 unknown :-1 s=CLOSED pgs=422 gs=1 cs=0 l=1 c_cookie=236338802943482183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 -- 10.20.193.28:0/934729682 >> 10.20.193.28:0/934729682 conn(0x55a0cfed6860 msgr2=0x55a0cfef6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 -- 10.20.193.28:0/934729682 shutdown_connections 2026-02-20T13:27:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.911+0000 7fbfd5550e00 1 -- 10.20.193.28:0/934729682 wait complete. 2026-02-20T13:27:55.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.912+0000 7fbfd5550e00 1 -- start start 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.912+0000 7fbfd5550e00 1 Processor -- start 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cff55710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 0x55a0cff55c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cff3db20 0x55a0cff5ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0cff5b180 con 0x55a0cfef8360 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a0cff5b2f0 con 0x55a0cff3db20 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a0cff5b4b0 con 0x55a0cfef8c70 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cff3db20 0x55a0cff5ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cff3db20 0x55a0cff5ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51422/0 (socket says 10.20.193.28:51422) 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 -- 10.20.193.28:0/4182340625 learned_addr learned my addr 10.20.193.28:0/4182340625 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cff55710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 -- 10.20.193.28:0/4182340625 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 msgr2=0x55a0cff55c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 0x55a0cff55c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 -- 10.20.193.28:0/4182340625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 msgr2=0x55a0cff55710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cff55710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 -- 10.20.193.28:0/4182340625 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc009df0 con 0x55a0cff3db20 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cff3db20 0x55a0cff5ac40 secure :-1 s=READY pgs=423 gs=2 cs=0 l=1 c_cookie=984451980100967746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc80aa4d0 tx=0x7fbfc80ae080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da979dc2c591d42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbf86ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbf86ffd640 1 -- 10.20.193.28:0/4182340625 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfc80adcc0 con 0x55a0cff3db20 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc0fa0e0 con 0x55a0cff3db20 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbf86ffd640 1 -- 10.20.193.28:0/4182340625 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbfc80d3280 con 0x55a0cff3db20 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbf86ffd640 1 -- 10.20.193.28:0/4182340625 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfc80b8e30 con 0x55a0cff3db20 2026-02-20T13:27:55.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 10 client.29228 _ll_register_callbacks cb 0x55a0cfd85a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.913+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0cfa9a6f0 con 0x55a0cff3db20 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbf86ffd640 1 -- 10.20.193.28:0/4182340625 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbfc80b6200 con 0x55a0cff3db20 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbf86ffd640 1 -- 10.20.193.28:0/4182340625 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbfc80ae900 con 0x55a0cff3db20 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbfd5550e00 10 client.29228 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a0cfd883c0 con 0x55a0cff3db20 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbf86ffd640 1 -- 10.20.193.28:0/4182340625 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbfc80aeb90 con 0x55a0cff3db20 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbfd5550e00 10 client.29228 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbfd5550e00 10 client.29228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbfd5550e00 20 client.29228 populate_metadata read hostname 'trial028' 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a0cff5dd50 0x55a0cff3b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbfd5550e00 4 client.29228 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.914+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0cfda6f80 con 0x55a0cff5dd50 2026-02-20T13:27:55.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.915+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a0cff5dd50 0x55a0cff3b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.915+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a0cff5dd50 0x55a0cff3b8a0 crc :-1 s=READY pgs=308 gs=4 cs=0 l=0 c_cookie=14698172226775554144 s_cookie=8128827675071495678 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbfa65c418781860 server_cookie=70cf65b3bd003dfe in_seq=0 out_seq=0 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.915+0000 7fbf86ffd640 10 client.29228 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbf86ffd640 1 -- 10.20.193.28:0/4182340625 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a0cfda6f80 con 0x55a0cff5dd50 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbf86ffd640 10 client.29228 handle_command_reply: tid=0 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 client.29228 shutdown 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cff3db20 msgr2=0x55a0cff5ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cff3db20 0x55a0cff5ac40 secure :-1 s=READY pgs=423 gs=2 cs=0 l=1 c_cookie=984451980100967746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc80aa4d0 tx=0x7fbfc80ae080 comp rx=0 tx=0).stop 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 shutdown_connections 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a0cff5dd50 0x55a0cff3b8a0 crc :-1 s=READY pgs=308 gs=4 cs=0 l=0 c_cookie=14698172226775554144 s_cookie=8128827675071495678 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cff3db20 0x55a0cff5ac40 unknown :-1 s=CLOSED pgs=423 gs=2 cs=0 l=1 c_cookie=984451980100967746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8c70 0x55a0cff55c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/4182340625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cff55710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbf86ffd640 0 client.29228 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:55.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 >> 10.20.193.28:0/4182340625 conn(0x55a0cfed6860 msgr2=0x55a0cfef6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 shutdown_connections 2026-02-20T13:27:55.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 1 -- 10.20.193.28:0/4182340625 wait complete. 2026-02-20T13:27:55.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.916+0000 7fbfd5550e00 20 client.29228 trim_cache size 0 max 16384 2026-02-20T13:27:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd5550e00 1 Processor -- start 2026-02-20T13:27:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd5550e00 1 -- start start 2026-02-20T13:27:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8360 0x55a0cff53040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cff3c8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff3cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0cfe02080 con 0x55a0cff3db20 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a0cfac2700 con 0x55a0cfef8c70 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a0cff4a0b0 con 0x55a0cfef8360 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd1acc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff3cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd1acc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff3cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48828/0 (socket says 10.20.193.28:48828) 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd1acc640 1 -- 10.20.193.28:0/891716329 learned_addr learned my addr 10.20.193.28:0/891716329 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8360 0x55a0cff53040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd0aca640 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cff3c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd1acc640 1 -- 10.20.193.28:0/891716329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8360 msgr2=0x55a0cff53040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8360 0x55a0cff53040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd1acc640 1 -- 10.20.193.28:0/891716329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 msgr2=0x55a0cff3c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cff3c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.924+0000 7fbfd1acc640 1 -- 10.20.193.28:0/891716329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0cff47a60 con 0x55a0cff3db20 2026-02-20T13:27:55.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff3cdf0 secure :-1 s=READY pgs=1176 gs=3 cs=0 l=1 c_cookie=4203484863065307236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc8073340 tx=0x7fbfc8070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a55c73641bd3864 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbf994e4640 1 -- 10.20.193.28:0/891716329 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfc80a9c10 con 0x55a0cff3db20 2026-02-20T13:27:55.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbf994e4640 1 -- 10.20.193.28:0/891716329 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55a0cfa9a6f0 con 0x55a0cff3db20 2026-02-20T13:27:55.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbf994e4640 1 -- 10.20.193.28:0/891716329 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfc80a9c10 con 0x55a0cff3db20 2026-02-20T13:27:55.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 -- 10.20.193.28:0/891716329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 msgr2=0x55a0cff3cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff3cdf0 secure :-1 s=READY pgs=1176 gs=3 cs=0 l=1 c_cookie=4203484863065307236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc8073340 tx=0x7fbfc8070000 comp rx=0 tx=0).stop 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 -- 10.20.193.28:0/891716329 shutdown_connections 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cff3db20 0x55a0cff3cdf0 unknown :-1 s=CLOSED pgs=1176 gs=3 cs=0 l=1 c_cookie=4203484863065307236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cff3c8b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/891716329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cfef8360 0x55a0cff53040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 -- 10.20.193.28:0/891716329 >> 10.20.193.28:0/891716329 conn(0x55a0cfed6860 msgr2=0x55a0cff51920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 -- 10.20.193.28:0/891716329 shutdown_connections 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.925+0000 7fbfd5550e00 1 -- 10.20.193.28:0/891716329 wait complete. 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.926+0000 7fbfd5550e00 1 -- start start 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.926+0000 7fbfd5550e00 1 Processor -- start 2026-02-20T13:27:55.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.926+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cfed8800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.926+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cfed8d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.926+0000 7fbfd5550e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cff3db20 0x55a0cff8c350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.926+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0cfe66ae0 con 0x55a0cfef8360 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.926+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a0cff8c890 con 0x55a0cfef8c70 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.926+0000 7fbfd5550e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a0cff8ca50 con 0x55a0cff3db20 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd0aca640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cfed8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd0aca640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cfed8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51434/0 (socket says 10.20.193.28:51434) 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd0aca640 1 -- 10.20.193.28:0/1222791379 learned_addr learned my addr 10.20.193.28:0/1222791379 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cfed8800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cff3db20 0x55a0cff8c350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd0aca640 1 -- 10.20.193.28:0/1222791379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cff3db20 msgr2=0x55a0cff8c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd0aca640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cff3db20 0x55a0cff8c350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd0aca640 1 -- 10.20.193.28:0/1222791379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 msgr2=0x55a0cfed8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd0aca640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cfed8800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd0aca640 1 -- 10.20.193.28:0/1222791379 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0cfd9a0e0 con 0x55a0cfef8c70 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.927+0000 7fbfd1acc640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cff3db20 0x55a0cff8c350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.928+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cfed8800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.928+0000 7fbfd0aca640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cfed8d40 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=15366622590418860073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc002f6a0 tx=0x7fbfc00386a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d54135d48368b829 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.928+0000 7fbf86ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.928+0000 7fbf86ffd640 1 -- 10.20.193.28:0/1222791379 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfc003d040 con 0x55a0cfef8c70 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.928+0000 7fbf86ffd640 1 -- 10.20.193.28:0/1222791379 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbfc002f9f0 con 0x55a0cfef8c70 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0cfd883c0 con 0x55a0cfef8c70 2026-02-20T13:27:55.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbf86ffd640 1 -- 10.20.193.28:0/1222791379 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfc0046470 con 0x55a0cfef8c70 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 10 client.29234 _ll_register_callbacks cb 0x55a0cfd85a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfbc003b90 con 0x55a0cfef8c70 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbf86ffd640 1 -- 10.20.193.28:0/1222791379 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbfc002fb60 con 0x55a0cfef8c70 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbf86ffd640 1 -- 10.20.193.28:0/1222791379 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbfc002fd20 con 0x55a0cfef8c70 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 10 client.29234 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a0cfd94b60 con 0x55a0cfef8c70 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbf86ffd640 1 -- 10.20.193.28:0/1222791379 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbfc00026a0 con 0x55a0cfef8c70 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 10 client.29234 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 10 client.29234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 20 client.29234 populate_metadata read hostname 'trial028' 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a0cff8e810 0x55a0cff8ec80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:55.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 4 client.29234 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:27:55.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.929+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0cfa97f40 con 0x55a0cff8e810 2026-02-20T13:27:55.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.930+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a0cff8e810 0x55a0cff8ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:55.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.930+0000 7fbfd12cb640 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a0cff8e810 0x55a0cff8ec80 crc :-1 s=READY pgs=309 gs=4 cs=0 l=0 c_cookie=11649793716487481568 s_cookie=17498387592612644038 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ac61a971d068e0 server_cookie=f2d6c2ce17c784c6 in_seq=0 out_seq=0 2026-02-20T13:27:55.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.930+0000 7fbf86ffd640 10 client.29234 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:55.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbf86ffd640 1 -- 10.20.193.28:0/1222791379 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0cfa97f40 con 0x55a0cff8e810 2026-02-20T13:27:55.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbf86ffd640 10 client.29234 handle_command_reply: tid=0 2026-02-20T13:27:55.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 client.29234 shutdown 2026-02-20T13:27:55.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 msgr2=0x55a0cfed8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cfed8d40 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=15366622590418860073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc002f6a0 tx=0x7fbfc00386a0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 shutdown_connections 2026-02-20T13:27:55.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a0cff8e810 0x55a0cff8ec80 crc :-1 s=READY pgs=309 gs=4 cs=0 l=0 c_cookie=11649793716487481568 s_cookie=17498387592612644038 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a0cff3db20 0x55a0cff8c350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a0cfef8c70 0x55a0cfed8d40 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=15366622590418860073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 --2- 10.20.193.28:0/1222791379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0cfef8360 0x55a0cfed8800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbf86ffd640 0 client.29234 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 >> 10.20.193.28:0/1222791379 conn(0x55a0cfed6860 msgr2=0x55a0cff52110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 shutdown_connections 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 1 -- 10.20.193.28:0/1222791379 wait complete. 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.931+0000 7fbfd5550e00 20 client.29234 trim_cache size 0 max 16384 2026-02-20T13:27:55.939 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:27:55.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfa80b5750 msgr2=0x7fbfa80d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfa80b5750 0x7fbfa80d5c00 secure :-1 s=READY pgs=506 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfbc0095d0 tx=0x7fbfbc005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:55.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc110140 msgr2=0x7fbfcc0f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:55.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc110140 0x7fbfcc0f4440 secure :-1 s=READY pgs=1175 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc800f940 tx=0x7fbfc800fe10 comp rx=0 tx=0).stop 2026-02-20T13:27:55.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1729303406 shutdown_connections 2026-02-20T13:27:55.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfa80b5750 0x7fbfa80d5c00 unknown :-1 s=CLOSED pgs=506 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfcc110140 0x7fbfcc0f4440 unknown :-1 s=CLOSED pgs=1175 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbfcc10c040 0x7fbfcc173c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 --2- 10.20.193.28:0/1729303406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbfcc10b650 0x7fbfcc0f3d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:55.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1729303406 >> 10.20.193.28:0/1729303406 conn(0x7fbfcc0e9080 msgr2=0x7fbfcc109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:55.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1729303406 shutdown_connections 2026-02-20T13:27:55.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:55.932+0000 7fbfd22cd640 1 -- 10.20.193.28:0/1729303406 wait complete. 2026-02-20T13:27:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:56 trial127 ceph-mon[43817]: pgmap v499: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2026-02-20T13:27:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:56 trial034 ceph-mon[43332]: pgmap v499: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2026-02-20T13:27:57.039 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:27:57.039 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:27:57.090 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:56 trial028 ceph-mon[37442]: pgmap v499: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2026-02-20T13:27:57.223 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:57.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 -- 10.20.193.28:0/1734307898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 msgr2=0x7f002c10f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 --2- 10.20.193.28:0/1734307898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 0x7f002c10f990 secure :-1 s=READY pgs=1177 gs=1 cs=0 l=1 c_cookie=11569142764999810814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0020009950 tx=0x7f002002f190 comp rx=0 tx=0).stop 2026-02-20T13:27:57.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 -- 10.20.193.28:0/1734307898 shutdown_connections 2026-02-20T13:27:57.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 --2- 10.20.193.28:0/1734307898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 0x7f002c10f990 unknown :-1 s=CLOSED pgs=1177 gs=1 cs=0 l=1 c_cookie=11569142764999810814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 --2- 10.20.193.28:0/1734307898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f002c110140 0x7f002c173d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 --2- 10.20.193.28:0/1734307898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f002c10b650 0x7f002c10ba20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 -- 10.20.193.28:0/1734307898 >> 10.20.193.28:0/1734307898 conn(0x7f002c0e9080 msgr2=0x7f002c109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 -- 10.20.193.28:0/1734307898 shutdown_connections 2026-02-20T13:27:57.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.395+0000 7f00332ff640 1 -- 10.20.193.28:0/1734307898 wait complete. 2026-02-20T13:27:57.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.396+0000 7f00332ff640 1 Processor -- start 2026-02-20T13:27:57.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.396+0000 7f00332ff640 1 -- start start 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.396+0000 7f00332ff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f002c10b650 0x7f002c0f3da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.396+0000 7f00332ff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 0x7f002c173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.396+0000 7f00332ff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f002c110140 0x7f002c0f44a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.396+0000 7f00332ff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f002c0f96b0 con 0x7f002c10c040 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.396+0000 7f00332ff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f002c0f9820 con 0x7f002c10b650 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.396+0000 7f00332ff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f002c0f99e0 con 0x7f002c110140 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 0x7f002c173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f00322fd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f002c10b650 0x7f002c0f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 0x7f002c173c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48862/0 (socket says 10.20.193.28:48862) 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 -- 10.20.193.28:0/1641630073 learned_addr learned my addr 10.20.193.28:0/1641630073 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0032afe640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f002c110140 0x7f002c0f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 -- 10.20.193.28:0/1641630073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f002c110140 msgr2=0x7f002c0f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f002c110140 0x7f002c0f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 -- 10.20.193.28:0/1641630073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f002c10b650 msgr2=0x7f002c0f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f002c10b650 0x7f002c0f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 -- 10.20.193.28:0/1641630073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0020009570 con 0x7f002c10c040 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0032afe640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f002c110140 0x7f002c0f44a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f0031afc640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 0x7f002c173c50 secure :-1 s=READY pgs=1178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0020005b30 tx=0x7f0020004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.397+0000 7f00137fe640 1 -- 10.20.193.28:0/1641630073 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f002003d070 con 0x7f002c10c040 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.398+0000 7f00137fe640 1 -- 10.20.193.28:0/1641630073 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0020038920 con 0x7f002c10c040 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.398+0000 7f00137fe640 1 -- 10.20.193.28:0/1641630073 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00200418a0 con 0x7f002c10c040 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.398+0000 7f00332ff640 1 -- 10.20.193.28:0/1641630073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c0f9c60 con 0x7f002c10c040 2026-02-20T13:27:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.398+0000 7f00332ff640 1 -- 10.20.193.28:0/1641630073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c0fa080 con 0x7f002c10c040 2026-02-20T13:27:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.401+0000 7f00137fe640 1 -- 10.20.193.28:0/1641630073 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0020048020 con 0x7f002c10c040 2026-02-20T13:27:57.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.402+0000 7f00137fe640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f00080b5750 0x7f00080d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.402+0000 7f00137fe640 1 -- 10.20.193.28:0/1641630073 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f002010af10 con 0x7f002c10c040 2026-02-20T13:27:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.403+0000 7f00322fd640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f00080b5750 0x7f00080d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.403+0000 7f00322fd640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f00080b5750 0x7f00080d5c00 secure :-1 s=READY pgs=507 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c004740 tx=0x7f001c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.404+0000 7f0036582e00 1 Processor -- start 2026-02-20T13:27:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.404+0000 7f0036582e00 1 -- start start 2026-02-20T13:27:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.404+0000 7f0036582e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd56217e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.404+0000 7f0036582e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621d20 0x562fd5666480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.404+0000 7f0036582e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd56669c0 0x562fd5686da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.404+0000 7f0036582e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fd5537a20 con 0x562fd5621d20 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.404+0000 7f0036582e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fd5533750 con 0x562fd5621410 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.404+0000 7f0036582e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fd552d6f0 con 0x562fd56669c0 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd56217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f0032afe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd56669c0 0x562fd5686da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd56217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51466/0 (socket says 10.20.193.28:51466) 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 -- 10.20.193.28:0/540270157 learned_addr learned my addr 10.20.193.28:0/540270157 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f0031afc640 1 --2- 10.20.193.28:0/540270157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621d20 0x562fd5666480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 -- 10.20.193.28:0/540270157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd56669c0 msgr2=0x562fd5686da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 --2- 10.20.193.28:0/540270157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd56669c0 0x562fd5686da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 -- 10.20.193.28:0/540270157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621d20 msgr2=0x562fd5666480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 --2- 10.20.193.28:0/540270157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621d20 0x562fd5666480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 -- 10.20.193.28:0/540270157 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fd54d9120 con 0x562fd5621410 2026-02-20T13:27:57.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f00322fd640 1 --2- 10.20.193.28:0/540270157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd56217e0 secure :-1 s=READY pgs=425 gs=2 cs=0 l=1 c_cookie=1984704559860934749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c009cc0 tx=0x7f001c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b8b1648229be85d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f0010b0a640 1 -- 10.20.193.28:0/540270157 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f001c011e60 con 0x562fd5621410 2026-02-20T13:27:57.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f0010b0a640 1 -- 10.20.193.28:0/540270157 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f001c0198e0 con 0x562fd5621410 2026-02-20T13:27:57.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.405+0000 7f0010b0a640 1 -- 10.20.193.28:0/540270157 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f001c01bb80 con 0x562fd5621410 2026-02-20T13:27:57.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 -- 10.20.193.28:0/540270157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 msgr2=0x562fd56217e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 --2- 10.20.193.28:0/540270157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd56217e0 secure :-1 s=READY pgs=425 gs=2 cs=0 l=1 c_cookie=1984704559860934749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c009cc0 tx=0x7f001c014000 comp rx=0 tx=0).stop 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 -- 10.20.193.28:0/540270157 shutdown_connections 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 --2- 10.20.193.28:0/540270157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621d20 0x562fd5666480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 --2- 10.20.193.28:0/540270157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd56669c0 0x562fd5686da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 --2- 10.20.193.28:0/540270157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd56217e0 unknown :-1 s=CLOSED pgs=425 gs=2 cs=0 l=1 c_cookie=1984704559860934749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 -- 10.20.193.28:0/540270157 >> 10.20.193.28:0/540270157 conn(0x562fd55ff910 msgr2=0x562fd561fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 -- 10.20.193.28:0/540270157 shutdown_connections 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.406+0000 7f0036582e00 1 -- 10.20.193.28:0/540270157 wait complete. 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.407+0000 7f0036582e00 1 -- start start 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.407+0000 7f0036582e00 1 Processor -- start 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0036582e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0036582e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5642bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0036582e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd5647ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0036582e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fd56480e0 con 0x562fd5621410 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0036582e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fd5648250 con 0x562fd56669c0 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0036582e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fd5648410 con 0x562fd5621d20 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0031afc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5642bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0031afc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5642bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36406/0 (socket says 10.20.193.28:36406) 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0031afc640 1 -- 10.20.193.28:0/1162079733 learned_addr learned my addr 10.20.193.28:0/1162079733 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0032afe640 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd5647ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f00322fd640 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0031afc640 1 -- 10.20.193.28:0/1162079733 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 msgr2=0x562fd5647ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0031afc640 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd5647ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0031afc640 1 -- 10.20.193.28:0/1162079733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 msgr2=0x562fd5642670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0031afc640 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f0031afc640 1 -- 10.20.193.28:0/1162079733 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fd54b1810 con 0x562fd5621d20 2026-02-20T13:27:57.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.408+0000 7f00322fd640 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:57.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7f0031afc640 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5642bb0 secure :-1 s=READY pgs=354 gs=2 cs=0 l=1 c_cookie=14022026698988537311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0020005940 tx=0x7f00200d1320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2983efda84145df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7effdffff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:27:57.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7effdffff640 1 -- 10.20.193.28:0/1162079733 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00200dc140 con 0x562fd5621d20 2026-02-20T13:27:57.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7effdffff640 1 -- 10.20.193.28:0/1162079733 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00200d6f90 con 0x562fd5621d20 2026-02-20T13:27:57.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7effdffff640 1 -- 10.20.193.28:0/1162079733 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00200cf250 con 0x562fd5621d20 2026-02-20T13:27:57.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c009960 con 0x562fd5621d20 2026-02-20T13:27:57.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7effdffff640 1 -- 10.20.193.28:0/1162079733 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f00200cf3d0 con 0x562fd5621d20 2026-02-20T13:27:57.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7effdffff640 10 client.29146 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:27:57.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7f0036582e00 10 client.29146 _ll_register_callbacks cb 0x562fd54e4b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:57.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562fd51c39d0 con 0x562fd5621d20 2026-02-20T13:27:57.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.409+0000 7effdffff640 1 -- 10.20.193.28:0/1162079733 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00200d9570 con 0x562fd5621d20 2026-02-20T13:27:57.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f0036582e00 10 client.29146 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:57.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562fd54c34f0 con 0x562fd5621d20 2026-02-20T13:27:57.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7effdffff640 1 -- 10.20.193.28:0/1162079733 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f002009c030 con 0x562fd5621d20 2026-02-20T13:27:57.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f0036582e00 10 client.29146 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:57.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f0036582e00 10 client.29146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:57.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f0036582e00 20 client.29146 populate_metadata read hostname 'trial028' 2026-02-20T13:27:57.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f0036582e00 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fd564cbf0 0x562fd564d090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f0036582e00 4 client.29146 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:57.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fd553adf0 con 0x562fd564cbf0 2026-02-20T13:27:57.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.410+0000 7f00322fd640 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fd564cbf0 0x562fd564d090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.411+0000 7f00322fd640 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fd564cbf0 0x562fd564d090 crc :-1 s=READY pgs=310 gs=4 cs=0 l=0 c_cookie=12600445714506515515 s_cookie=1166443039881851114 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeddc69e08c1043b server_cookie=103009c3c2e270ea in_seq=0 out_seq=0 2026-02-20T13:27:57.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.411+0000 7effdffff640 10 client.29146 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.411+0000 7effdffff640 1 -- 10.20.193.28:0/1162079733 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562fd553adf0 con 0x562fd564cbf0 2026-02-20T13:27:57.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.411+0000 7effdffff640 10 client.29146 handle_command_reply: tid=0 2026-02-20T13:27:57.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.411+0000 7f0036582e00 1 client.29146 shutdown 2026-02-20T13:27:57.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 msgr2=0x562fd5642bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5642bb0 secure :-1 s=READY pgs=354 gs=2 cs=0 l=1 c_cookie=14022026698988537311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0020005940 tx=0x7f00200d1320 comp rx=0 tx=0).stop 2026-02-20T13:27:57.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 shutdown_connections 2026-02-20T13:27:57.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fd564cbf0 0x562fd564d090 crc :-1 s=READY pgs=310 gs=4 cs=0 l=0 c_cookie=12600445714506515515 s_cookie=1166443039881851114 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd5647ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5642bb0 unknown :-1 s=CLOSED pgs=354 gs=2 cs=0 l=1 c_cookie=14022026698988537311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 --2- 10.20.193.28:0/1162079733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7effdffff640 0 client.29146 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 >> 10.20.193.28:0/1162079733 conn(0x562fd55ff910 msgr2=0x562fd5608ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 shutdown_connections 2026-02-20T13:27:57.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 1 -- 10.20.193.28:0/1162079733 wait complete. 2026-02-20T13:27:57.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.412+0000 7f0036582e00 20 client.29146 trim_cache size 0 max 16384 2026-02-20T13:27:57.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.421+0000 7f0036582e00 1 Processor -- start 2026-02-20T13:27:57.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.421+0000 7f0036582e00 1 -- start start 2026-02-20T13:27:57.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.421+0000 7f0036582e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.421+0000 7f0036582e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd561ea80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.421+0000 7f0036582e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd561efc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.421+0000 7f0036582e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fd552b320 con 0x562fd5621410 2026-02-20T13:27:57.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.421+0000 7f0036582e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fd51eb790 con 0x562fd56669c0 2026-02-20T13:27:57.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.421+0000 7f0036582e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fd55ff350 con 0x562fd5621d20 2026-02-20T13:27:57.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f0032afe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd561efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f00322fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f0032afe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd561efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51474/0 (socket says 10.20.193.28:51474) 2026-02-20T13:27:57.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f00322fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48896/0 (socket says 10.20.193.28:48896) 2026-02-20T13:27:57.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f0032afe640 1 -- 10.20.193.28:0/1151376055 learned_addr learned my addr 10.20.193.28:0/1151376055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f0031afc640 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd561ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f00322fd640 1 -- 10.20.193.28:0/1151376055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 msgr2=0x562fd561ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f00322fd640 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd561ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f00322fd640 1 -- 10.20.193.28:0/1151376055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 msgr2=0x562fd561efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f00322fd640 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd561efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f00322fd640 1 -- 10.20.193.28:0/1151376055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fd54bdf70 con 0x562fd5621410 2026-02-20T13:27:57.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f0031afc640 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd561ea80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:27:57.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7f00322fd640 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642bb0 secure :-1 s=READY pgs=1179 gs=1 cs=0 l=1 c_cookie=2136587061988765811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c01b670 tx=0x7f001c01d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da6ae9cdd893073 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7efffa4e6640 1 -- 10.20.193.28:0/1151376055 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f001c01b850 con 0x562fd5621410 2026-02-20T13:27:57.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7efffa4e6640 1 -- 10.20.193.28:0/1151376055 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f001c01b9b0 con 0x562fd5621410 2026-02-20T13:27:57.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.422+0000 7efffa4e6640 1 -- 10.20.193.28:0/1151376055 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f001c005350 con 0x562fd5621410 2026-02-20T13:27:57.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 -- 10.20.193.28:0/1151376055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 msgr2=0x562fd5642bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642bb0 secure :-1 s=READY pgs=1179 gs=1 cs=0 l=1 c_cookie=2136587061988765811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c01b670 tx=0x7f001c01d040 comp rx=0 tx=0).stop 2026-02-20T13:27:57.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 -- 10.20.193.28:0/1151376055 shutdown_connections 2026-02-20T13:27:57.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd56669c0 0x562fd561efc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd561ea80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 --2- 10.20.193.28:0/1151376055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd5621410 0x562fd5642bb0 unknown :-1 s=CLOSED pgs=1179 gs=1 cs=0 l=1 c_cookie=2136587061988765811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 -- 10.20.193.28:0/1151376055 >> 10.20.193.28:0/1151376055 conn(0x562fd55ff910 msgr2=0x562fd56424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 -- 10.20.193.28:0/1151376055 shutdown_connections 2026-02-20T13:27:57.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 -- 10.20.193.28:0/1151376055 wait complete. 2026-02-20T13:27:57.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 -- start start 2026-02-20T13:27:57.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.423+0000 7f0036582e00 1 Processor -- start 2026-02-20T13:27:57.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0036582e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd5650450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0036582e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5650990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0036582e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd56669c0 0x562fd571af80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0036582e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fd571b4c0 con 0x562fd56669c0 2026-02-20T13:27:57.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0036582e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x562fd571b630 con 0x562fd5621410 2026-02-20T13:27:57.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0036582e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x562fd571b7f0 con 0x562fd5621d20 2026-02-20T13:27:57.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f00322fd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd5650450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd56669c0 0x562fd571af80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0031afc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5650990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd56669c0 0x562fd571af80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48908/0 (socket says 10.20.193.28:48908) 2026-02-20T13:27:57.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 -- 10.20.193.28:0/3161717346 learned_addr learned my addr 10.20.193.28:0/3161717346 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 -- 10.20.193.28:0/3161717346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 msgr2=0x562fd5650990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5650990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 -- 10.20.193.28:0/3161717346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 msgr2=0x562fd5650450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd5650450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 -- 10.20.193.28:0/3161717346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fd54b1b40 con 0x562fd56669c0 2026-02-20T13:27:57.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7f0032afe640 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd56669c0 0x562fd571af80 secure :-1 s=READY pgs=1180 gs=2 cs=0 l=1 c_cookie=14454418901490094069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0028005290 tx=0x7f0028014b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89869687a024ff5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7effdffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:57.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7effdffff640 1 -- 10.20.193.28:0/3161717346 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0028019070 con 0x562fd56669c0 2026-02-20T13:27:57.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7effdffff640 1 -- 10.20.193.28:0/3161717346 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f002801d410 con 0x562fd56669c0 2026-02-20T13:27:57.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.424+0000 7effdffff640 1 -- 10.20.193.28:0/3161717346 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f002801c5f0 con 0x562fd56669c0 2026-02-20T13:27:57.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fd54d9120 con 0x562fd56669c0 2026-02-20T13:27:57.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 10 client.19299 _ll_register_callbacks cb 0x562fd54e4b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:57.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f001c0198e0 con 0x562fd56669c0 2026-02-20T13:27:57.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7effdffff640 1 -- 10.20.193.28:0/3161717346 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0028012b00 con 0x562fd56669c0 2026-02-20T13:27:57.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7effdffff640 1 -- 10.20.193.28:0/3161717346 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0028012d00 con 0x562fd56669c0 2026-02-20T13:27:57.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 10 client.19299 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:57.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562fd54c3750 con 0x562fd56669c0 2026-02-20T13:27:57.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7effdffff640 1 -- 10.20.193.28:0/3161717346 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f002801d580 con 0x562fd56669c0 2026-02-20T13:27:57.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 10 client.19299 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:57.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 10 client.19299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:57.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 20 client.19299 populate_metadata read hostname 'trial028' 2026-02-20T13:27:57.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fd571d520 0x562fd573d9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 4 client.19299 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:27:57.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.425+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562fd51c1220 con 0x562fd571d520 2026-02-20T13:27:57.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.426+0000 7f00322fd640 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fd571d520 0x562fd573d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.426+0000 7f00322fd640 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fd571d520 0x562fd573d9d0 crc :-1 s=READY pgs=311 gs=4 cs=0 l=0 c_cookie=1772699505461980089 s_cookie=8573463265138947731 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1899e4cedc926bb9 server_cookie=76fb0f6a5d77b693 in_seq=0 out_seq=0 2026-02-20T13:27:57.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.426+0000 7effdffff640 10 client.19299 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.427+0000 7effdffff640 1 -- 10.20.193.28:0/3161717346 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562fd51c1220 con 0x562fd571d520 2026-02-20T13:27:57.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.427+0000 7effdffff640 10 client.19299 handle_command_reply: tid=0 2026-02-20T13:27:57.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.427+0000 7f0036582e00 1 client.19299 shutdown 2026-02-20T13:27:57.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.427+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd56669c0 msgr2=0x562fd571af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.427+0000 7f0036582e00 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd56669c0 0x562fd571af80 secure :-1 s=READY pgs=1180 gs=2 cs=0 l=1 c_cookie=14454418901490094069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0028005290 tx=0x7f0028014b80 comp rx=0 tx=0).stop 2026-02-20T13:27:57.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 shutdown_connections 2026-02-20T13:27:57.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x562fd571d520 0x562fd573d9d0 crc :-1 s=READY pgs=311 gs=4 cs=0 l=0 c_cookie=1772699505461980089 s_cookie=8573463265138947731 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fd56669c0 0x562fd571af80 unknown :-1 s=CLOSED pgs=1180 gs=2 cs=0 l=1 c_cookie=14454418901490094069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x562fd5621d20 0x562fd5650990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 1 --2- 10.20.193.28:0/3161717346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x562fd5621410 0x562fd5650450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7effdffff640 0 client.19299 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 >> 10.20.193.28:0/3161717346 conn(0x562fd55ff910 msgr2=0x562fd561da70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 shutdown_connections 2026-02-20T13:27:57.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 1 -- 10.20.193.28:0/3161717346 wait complete. 2026-02-20T13:27:57.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.428+0000 7f0036582e00 20 client.19299 trim_cache size 0 max 16384 2026-02-20T13:27:57.444 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:27:57.444 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:27:57.445 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "e217eec4-719c-444b-96c3-95c9c672b821", 2026-02-20T13:27:57.445 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:27:57.445 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:27:57.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 -- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f00080b5750 msgr2=0x7f00080d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f00080b5750 0x7f00080d5c00 secure :-1 s=READY pgs=507 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c004740 tx=0x7f001c005f90 comp rx=0 tx=0).stop 2026-02-20T13:27:57.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 -- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 msgr2=0x7f002c173c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 0x7f002c173c50 secure :-1 s=READY pgs=1178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0020005b30 tx=0x7f0020004340 comp rx=0 tx=0).stop 2026-02-20T13:27:57.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 -- 10.20.193.28:0/1641630073 shutdown_connections 2026-02-20T13:27:57.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f00080b5750 0x7f00080d5c00 unknown :-1 s=CLOSED pgs=507 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f002c10c040 0x7f002c173c50 unknown :-1 s=CLOSED pgs=1178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f002c110140 0x7f002c0f44a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 --2- 10.20.193.28:0/1641630073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f002c10b650 0x7f002c0f3da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 -- 10.20.193.28:0/1641630073 >> 10.20.193.28:0/1641630073 conn(0x7f002c0e9080 msgr2=0x7f002c109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 -- 10.20.193.28:0/1641630073 shutdown_connections 2026-02-20T13:27:57.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.429+0000 7f00332ff640 1 -- 10.20.193.28:0/1641630073 wait complete. 2026-02-20T13:27:57.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.430+0000 7fe704ccc640 1 -- 10.20.193.28:0/2315575810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe700110cc0 msgr2=0x7fe700171650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.430+0000 7fe704ccc640 1 --2- 10.20.193.28:0/2315575810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe700110cc0 0x7fe700171650 secure :-1 s=READY pgs=1181 gs=3 cs=0 l=1 c_cookie=17437247247534273843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f000a970 tx=0x7fe6f00301b0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.430+0000 7fe704ccc640 1 -- 10.20.193.28:0/2315575810 shutdown_connections 2026-02-20T13:27:57.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.430+0000 7fe704ccc640 1 --2- 10.20.193.28:0/2315575810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe700110cc0 0x7fe700171650 unknown :-1 s=CLOSED pgs=1181 gs=3 cs=0 l=1 c_cookie=17437247247534273843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.430+0000 7fe704ccc640 1 --2- 10.20.193.28:0/2315575810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe700110310 0x7fe700110780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.430+0000 7fe704ccc640 1 --2- 10.20.193.28:0/2315575810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe70010f180 0x7fe70010f570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.430+0000 7fe704ccc640 1 -- 10.20.193.28:0/2315575810 >> 10.20.193.28:0/2315575810 conn(0x7fe7000ec8f0 msgr2=0x7fe70010cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 -- 10.20.193.28:0/2315575810 shutdown_connections 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 -- 10.20.193.28:0/2315575810 wait complete. 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 Processor -- start 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 -- start start 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70010f180 0x7fe7000f8780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe700110310 0x7fe700171650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe700110cc0 0x7fe7000f8fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe7000f9bd0 con 0x7fe70010f180 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe7000f9d40 con 0x7fe700110310 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.431+0000 7fe704ccc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe7000f9f00 con 0x7fe700110cc0 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70010f180 0x7fe7000f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70010f180 0x7fe7000f8780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48930/0 (socket says 10.20.193.28:48930) 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 -- 10.20.193.28:0/1832672692 learned_addr learned my addr 10.20.193.28:0/1832672692 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fed76640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe700110cc0 0x7fe7000f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe700110310 0x7fe700171650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 -- 10.20.193.28:0/1832672692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe700110cc0 msgr2=0x7fe7000f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe700110cc0 0x7fe7000f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 -- 10.20.193.28:0/1832672692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe700110310 msgr2=0x7fe700171650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe700110310 0x7fe700171650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 -- 10.20.193.28:0/1832672692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f40094b0 con 0x7fe70010f180 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe700110310 0x7fe700171650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6fe575640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70010f180 0x7fe7000f8780 secure :-1 s=READY pgs=1182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f4009fd0 tx=0x7fe6f4002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6e77fe640 1 -- 10.20.193.28:0/1832672692 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f400ece0 con 0x7fe70010f180 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe704ccc640 1 -- 10.20.193.28:0/1832672692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f000a590 con 0x7fe70010f180 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6e77fe640 1 -- 10.20.193.28:0/1832672692 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6f400ee40 con 0x7fe70010f180 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe6e77fe640 1 -- 10.20.193.28:0/1832672692 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f4018950 con 0x7fe70010f180 2026-02-20T13:27:57.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.432+0000 7fe704ccc640 1 -- 10.20.193.28:0/1832672692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7000fa570 con 0x7fe70010f180 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.435+0000 7fe6e77fe640 1 -- 10.20.193.28:0/1832672692 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe6f4016020 con 0x7fe70010f180 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.437+0000 7fe6e77fe640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6d80b5760 0x7fe6d80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.437+0000 7fe6e77fe640 1 -- 10.20.193.28:0/1832672692 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe6f40e6c10 con 0x7fe70010f180 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.437+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6d80b5760 0x7fe6d80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.437+0000 7fe7072bae00 1 Processor -- start 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.437+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6d80b5760 0x7fe6d80d5c10 secure :-1 s=READY pgs=508 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e8004740 tx=0x7fe6e8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe7072bae00 1 -- start start 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7682b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e788bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7a94f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe7072bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d36e654fd0 con 0x55d36e747ed0 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe7072bae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d36e650d00 con 0x55d36e7687f0 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe7072bae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d36e64aca0 con 0x55d36e789110 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fdd74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e788bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fdd74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e788bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51518/0 (socket says 10.20.193.28:51518) 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fed76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36452/0 (socket says 10.20.193.28:36452) 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fdd74640 1 -- 10.20.193.28:0/2128916823 learned_addr learned my addr 10.20.193.28:0/2128916823 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fe575640 1 --2- 10.20.193.28:0/2128916823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fed76640 1 -- 10.20.193.28:0/2128916823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 msgr2=0x55d36e788bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fed76640 1 --2- 10.20.193.28:0/2128916823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e788bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fed76640 1 -- 10.20.193.28:0/2128916823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 msgr2=0x55d36e7682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fed76640 1 --2- 10.20.193.28:0/2128916823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.438+0000 7fe6fed76640 1 -- 10.20.193.28:0/2128916823 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36e5ed8b0 con 0x55d36e789110 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe6fed76640 1 --2- 10.20.193.28:0/2128916823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7a94f0 secure :-1 s=READY pgs=355 gs=3 cs=0 l=1 c_cookie=12456540553786935457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f000a8c0 tx=0x7fe6f0003e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acde85a2d6b7c8a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe6e4bfe640 1 -- 10.20.193.28:0/2128916823 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f003e070 con 0x55d36e789110 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe6e4bfe640 1 -- 10.20.193.28:0/2128916823 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6f003f040 con 0x55d36e789110 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe6e4bfe640 1 -- 10.20.193.28:0/2128916823 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f0005030 con 0x55d36e789110 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 -- 10.20.193.28:0/2128916823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 msgr2=0x55d36e7a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2128916823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7a94f0 secure :-1 s=READY pgs=355 gs=3 cs=0 l=1 c_cookie=12456540553786935457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f000a8c0 tx=0x7fe6f0003e40 comp rx=0 tx=0).stop 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 -- 10.20.193.28:0/2128916823 shutdown_connections 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2128916823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7a94f0 unknown :-1 s=CLOSED pgs=355 gs=3 cs=0 l=1 c_cookie=12456540553786935457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2128916823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e788bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2128916823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7682b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 -- 10.20.193.28:0/2128916823 >> 10.20.193.28:0/2128916823 conn(0x55d36e65e1c0 msgr2=0x55d36e73dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 -- 10.20.193.28:0/2128916823 shutdown_connections 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.439+0000 7fe7072bae00 1 -- 10.20.193.28:0/2128916823 wait complete. 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe7072bae00 1 -- start start 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe7072bae00 1 Processor -- start 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e747ed0 0x55d36e7a94f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e7687f0 0x55d36e781cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7823b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe7072bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d36e782d80 con 0x55d36e7687f0 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe7072bae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d36e782ef0 con 0x55d36e747ed0 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe7072bae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d36e7830b0 con 0x55d36e789110 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe6fe575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e747ed0 0x55d36e7a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe6fe575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e747ed0 0x55d36e7a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51524/0 (socket says 10.20.193.28:51524) 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe6fe575640 1 -- 10.20.193.28:0/2171665858 learned_addr learned my addr 10.20.193.28:0/2171665858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e7687f0 0x55d36e781cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.441+0000 7fe6fed76640 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6fe575640 1 -- 10.20.193.28:0/2171665858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 msgr2=0x55d36e7823b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6fe575640 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7823b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6fe575640 1 -- 10.20.193.28:0/2171665858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e7687f0 msgr2=0x55d36e781cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6fe575640 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e7687f0 0x55d36e781cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6fe575640 1 -- 10.20.193.28:0/2171665858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36e5f6400 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6fed76640 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7823b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6fe575640 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e747ed0 0x55d36e7a94f0 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=7528476840032470535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f40acf50 tx=0x7fe6f4010db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=687a85cc65e40607 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6affff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6affff640 1 -- 10.20.193.28:0/2171665858 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f40af050 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6affff640 1 -- 10.20.193.28:0/2171665858 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6f40d22d0 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe700171fa0 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6affff640 1 -- 10.20.193.28:0/2171665858 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f40acd90 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe6affff640 1 -- 10.20.193.28:0/2171665858 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe6f40adc00 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe7072bae00 10 client.29264 _ll_register_callbacks cb 0x55d36e5d5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.442+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d36e2ea520 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe6affff640 1 -- 10.20.193.28:0/2171665858 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6f40c9020 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe7072bae00 10 client.29264 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d36e5ceda0 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe6affff640 1 -- 10.20.193.28:0/2171665858 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe6f40b7c20 con 0x55d36e747ed0 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe7072bae00 10 client.29264 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe7072bae00 10 client.29264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe7072bae00 20 client.29264 populate_metadata read hostname 'trial028' 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d36e787c30 0x55d36e7880d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe7072bae00 4 client.29264 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d36e67c630 con 0x55d36e787c30 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.443+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d36e787c30 0x55d36e7880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.444+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d36e787c30 0x55d36e7880d0 crc :-1 s=READY pgs=312 gs=4 cs=0 l=0 c_cookie=17198597031870597888 s_cookie=14555447680200083496 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeadb0e0dfbc0b00 server_cookie=c9ff568c0d1c0828 in_seq=0 out_seq=0 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.444+0000 7fe6affff640 10 client.29264 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.444+0000 7fe6affff640 1 -- 10.20.193.28:0/2171665858 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d36e67c630 con 0x55d36e787c30 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.444+0000 7fe6affff640 10 client.29264 handle_command_reply: tid=0 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.445+0000 7fe7072bae00 1 client.29264 shutdown 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e747ed0 msgr2=0x55d36e7a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e747ed0 0x55d36e7a94f0 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=7528476840032470535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f40acf50 tx=0x7fe6f4010db0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 shutdown_connections 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d36e787c30 0x55d36e7880d0 crc :-1 s=READY pgs=312 gs=4 cs=0 l=0 c_cookie=17198597031870597888 s_cookie=14555447680200083496 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e7687f0 0x55d36e781cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7823b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2171665858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e747ed0 0x55d36e7a94f0 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=7528476840032470535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 >> 10.20.193.28:0/2171665858 conn(0x55d36e65e1c0 msgr2=0x55d36e769ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe6affff640 0 client.29264 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 shutdown_connections 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 1 -- 10.20.193.28:0/2171665858 wait complete. 2026-02-20T13:27:57.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.446+0000 7fe7072bae00 20 client.29264 trim_cache size 0 max 16384 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.455+0000 7fe7072bae00 1 Processor -- start 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe7072bae00 1 -- start start 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e773a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e7687f0 0x55d36e77eed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e789110 0x55d36e77f410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe7072bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d36e6488d0 con 0x55d36e747ed0 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe7072bae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d36e389f10 con 0x55d36e789110 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe7072bae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d36e76f170 con 0x55d36e7687f0 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e773a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e773a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48960/0 (socket says 10.20.193.28:48960) 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fe575640 1 -- 10.20.193.28:0/904768785 learned_addr learned my addr 10.20.193.28:0/904768785 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e7687f0 0x55d36e77eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fed76640 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e789110 0x55d36e77f410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fe575640 1 -- 10.20.193.28:0/904768785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e7687f0 msgr2=0x55d36e77eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fe575640 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e7687f0 0x55d36e77eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fe575640 1 -- 10.20.193.28:0/904768785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e789110 msgr2=0x55d36e77f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fe575640 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e789110 0x55d36e77f410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.457+0000 7fe6fe575640 1 -- 10.20.193.28:0/904768785 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36e774210 con 0x55d36e747ed0 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe6fe575640 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e773a40 secure :-1 s=READY pgs=1183 gs=1 cs=0 l=1 c_cookie=8889348794164604920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f40e4740 tx=0x7fe6f40a96f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5d4fa168ba6ff8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe6ca3ff640 1 -- 10.20.193.28:0/904768785 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f40c9070 con 0x55d36e747ed0 2026-02-20T13:27:57.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe6ca3ff640 1 -- 10.20.193.28:0/904768785 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d36e2ea520 con 0x55d36e747ed0 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe6ca3ff640 1 -- 10.20.193.28:0/904768785 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f40b80b0 con 0x55d36e747ed0 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe7072bae00 1 -- 10.20.193.28:0/904768785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 msgr2=0x55d36e773a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe7072bae00 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e773a40 secure :-1 s=READY pgs=1183 gs=1 cs=0 l=1 c_cookie=8889348794164604920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f40e4740 tx=0x7fe6f40a96f0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe7072bae00 1 -- 10.20.193.28:0/904768785 shutdown_connections 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe7072bae00 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e789110 0x55d36e77f410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe7072bae00 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e7687f0 0x55d36e77eed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe7072bae00 1 --2- 10.20.193.28:0/904768785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e773a40 unknown :-1 s=CLOSED pgs=1183 gs=1 cs=0 l=1 c_cookie=8889348794164604920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.458+0000 7fe7072bae00 1 -- 10.20.193.28:0/904768785 >> 10.20.193.28:0/904768785 conn(0x55d36e65e1c0 msgr2=0x55d36e787c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.459+0000 7fe7072bae00 1 -- 10.20.193.28:0/904768785 shutdown_connections 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.459+0000 7fe7072bae00 1 -- 10.20.193.28:0/904768785 wait complete. 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.459+0000 7fe7072bae00 1 -- start start 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.459+0000 7fe7072bae00 1 Processor -- start 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7494e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e749b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe7072bae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7482a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe7072bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d36e6488d0 con 0x55d36e747ed0 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe7072bae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d36e389f10 con 0x55d36e7687f0 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe7072bae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d36e748a00 con 0x55d36e789110 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48974/0 (socket says 10.20.193.28:48974) 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 -- 10.20.193.28:0/2222898519 learned_addr learned my addr 10.20.193.28:0/2222898519 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e749b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fed76640 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 -- 10.20.193.28:0/2222898519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 msgr2=0x55d36e7482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 -- 10.20.193.28:0/2222898519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 msgr2=0x55d36e749b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e749b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 -- 10.20.193.28:0/2222898519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36e5e0670 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6fe575640 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7494e0 secure :-1 s=READY pgs=1184 gs=1 cs=0 l=1 c_cookie=18416033337602226123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f400e720 tx=0x7fe6f40e47c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff92e4bf8b8837cb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6affff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6affff640 1 -- 10.20.193.28:0/2222898519 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f40c9070 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.460+0000 7fe6affff640 1 -- 10.20.193.28:0/2222898519 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6f40b3e40 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe6affff640 1 -- 10.20.193.28:0/2222898519 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f40ae540 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d36e5ceda0 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 10 client.19317 _ll_register_callbacks cb 0x55d36e5d5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d36e6faca0 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe6affff640 1 -- 10.20.193.28:0/2222898519 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe6f40ae6a0 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe6affff640 1 -- 10.20.193.28:0/2222898519 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6f40abe50 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 10 client.19317 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d36e5db0f0 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe6affff640 1 -- 10.20.193.28:0/2222898519 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe6f40b7c20 con 0x55d36e747ed0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 10 client.19317 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 10 client.19317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 20 client.19317 populate_metadata read hostname 'trial028' 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d36e74b150 0x55d36e74b5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 4 client.19317 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.461+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d36e32e640 con 0x55d36e74b150 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.462+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d36e74b150 0x55d36e74b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.462+0000 7fe6fdd74640 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d36e74b150 0x55d36e74b5c0 crc :-1 s=READY pgs=313 gs=4 cs=0 l=0 c_cookie=13458417502889635690 s_cookie=2441559753926781928 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac5e769c2a2ef6a server_cookie=21e229a906b22be8 in_seq=0 out_seq=0 2026-02-20T13:27:57.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.462+0000 7fe6affff640 10 client.19317 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe6affff640 1 -- 10.20.193.28:0/2222898519 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d36e32e640 con 0x55d36e74b150 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe6affff640 10 client.19317 handle_command_reply: tid=0 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 client.19317 shutdown 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 msgr2=0x55d36e7494e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7494e0 secure :-1 s=READY pgs=1184 gs=1 cs=0 l=1 c_cookie=18416033337602226123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f400e720 tx=0x7fe6f40e47c0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 shutdown_connections 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d36e74b150 0x55d36e74b5c0 crc :-1 s=READY pgs=313 gs=4 cs=0 l=0 c_cookie=13458417502889635690 s_cookie=2441559753926781928 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d36e789110 0x55d36e7482a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d36e7687f0 0x55d36e749b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 --2- 10.20.193.28:0/2222898519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d36e747ed0 0x55d36e7494e0 unknown :-1 s=CLOSED pgs=1184 gs=1 cs=0 l=1 c_cookie=18416033337602226123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 >> 10.20.193.28:0/2222898519 conn(0x55d36e65e1c0 msgr2=0x55d36e781c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.467+0000 7fe6affff640 0 client.19317 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.468+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 shutdown_connections 2026-02-20T13:27:57.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.468+0000 7fe7072bae00 1 -- 10.20.193.28:0/2222898519 wait complete. 2026-02-20T13:27:57.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.468+0000 7fe7072bae00 20 client.19317 trim_cache size 0 max 16384 2026-02-20T13:27:57.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:27:57.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:27:57.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:27:57.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:27:57.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 -- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6d80b5760 msgr2=0x7fe6d80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6d80b5760 0x7fe6d80d5c10 secure :-1 s=READY pgs=508 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e8004740 tx=0x7fe6e8009310 comp rx=0 tx=0).stop 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 -- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70010f180 msgr2=0x7fe7000f8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70010f180 0x7fe7000f8780 secure :-1 s=READY pgs=1182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f4009fd0 tx=0x7fe6f4002bc0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 -- 10.20.193.28:0/1832672692 shutdown_connections 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6d80b5760 0x7fe6d80d5c10 unknown :-1 s=CLOSED pgs=508 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe700110cc0 0x7fe7000f8fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe700110310 0x7fe700171650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 --2- 10.20.193.28:0/1832672692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70010f180 0x7fe7000f8780 unknown :-1 s=CLOSED pgs=1182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.470+0000 7fe704ccc640 1 -- 10.20.193.28:0/1832672692 >> 10.20.193.28:0/1832672692 conn(0x7fe7000ec8f0 msgr2=0x7fe7000ee880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.471+0000 7fe704ccc640 1 -- 10.20.193.28:0/1832672692 shutdown_connections 2026-02-20T13:27:57.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:27:57.471+0000 7fe704ccc640 1 -- 10.20.193.28:0/1832672692 wait complete. 2026-02-20T13:27:57.534 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:27:57.719 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:27:57.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.891+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/1606293695 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4b4113430 msgr2=0x7ff4b4173e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.891+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/1606293695 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4b4113430 0x7ff4b4173e00 secure :-1 s=READY pgs=356 gs=3 cs=0 l=1 c_cookie=10779984357994087220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b000aa30 tx=0x7ff4b0030270 comp rx=0 tx=0).stop 2026-02-20T13:27:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.892+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/1606293695 shutdown_connections 2026-02-20T13:27:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.892+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/1606293695 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4b4113430 0x7ff4b4173e00 unknown :-1 s=CLOSED pgs=356 gs=3 cs=0 l=1 c_cookie=10779984357994087220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.892+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/1606293695 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4b410dc30 0x7ff4b4112c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.892+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/1606293695 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4b410d240 0x7ff4b410d610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.892+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/1606293695 >> 10.20.193.28:0/1606293695 conn(0x7ff4b40eaad0 msgr2=0x7ff4b410aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.892+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/1606293695 shutdown_connections 2026-02-20T13:27:57.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.892+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/1606293695 wait complete. 2026-02-20T13:27:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.892+0000 7ff4ba7f2640 1 Processor -- start 2026-02-20T13:27:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4ba7f2640 1 -- start start 2026-02-20T13:27:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4ba7f2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4b410d240 0x7ff4b4060f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4ba7f2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4b410dc30 0x7ff4b4061450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4ba7f2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4b4113430 0x7ff4b4061990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4ba7f2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b4163e90 con 0x7ff4b410d240 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4ba7f2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b4164000 con 0x7ff4b410dc30 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4ba7f2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b41641c0 con 0x7ff4b4113430 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b97f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4b410d240 0x7ff4b4060f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b8fef640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4b410dc30 0x7ff4b4061450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b97f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4b410d240 0x7ff4b4060f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48990/0 (socket says 10.20.193.28:48990) 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b97f0640 1 -- 10.20.193.28:0/798543776 learned_addr learned my addr 10.20.193.28:0/798543776 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b9ff1640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4b4113430 0x7ff4b4061990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b97f0640 1 -- 10.20.193.28:0/798543776 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4b4113430 msgr2=0x7ff4b4061990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4b4113430 0x7ff4b4061990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b97f0640 1 -- 10.20.193.28:0/798543776 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4b410dc30 msgr2=0x7ff4b4061450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4b410dc30 0x7ff4b4061450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b97f0640 1 -- 10.20.193.28:0/798543776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b000a650 con 0x7ff4b410d240 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.893+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4b410dc30 0x7ff4b4061450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.894+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4b410d240 0x7ff4b4060f10 secure :-1 s=READY pgs=1185 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a4009480 tx=0x7ff4a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.894+0000 7ff4a27fc640 1 -- 10.20.193.28:0/798543776 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a400cd30 con 0x7ff4b410d240 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.894+0000 7ff4a27fc640 1 -- 10.20.193.28:0/798543776 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4a400ce90 con 0x7ff4b410d240 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.894+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/798543776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b41644a0 con 0x7ff4b410d240 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.894+0000 7ff4a27fc640 1 -- 10.20.193.28:0/798543776 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a40106b0 con 0x7ff4b410d240 2026-02-20T13:27:57.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.894+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/798543776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b41649c0 con 0x7ff4b410d240 2026-02-20T13:27:57.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.897+0000 7ff4a27fc640 1 -- 10.20.193.28:0/798543776 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff4a401f060 con 0x7ff4b410d240 2026-02-20T13:27:57.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.898+0000 7ff4a27fc640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4900b5760 0x7ff4900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.898+0000 7ff4a27fc640 1 -- 10.20.193.28:0/798543776 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff4a4014070 con 0x7ff4b410d240 2026-02-20T13:27:57.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.899+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4900b5760 0x7ff4900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.899+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4900b5760 0x7ff4900d5c10 secure :-1 s=READY pgs=509 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a8005970 tx=0x7ff4a8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.899+0000 7ff4bda75e00 1 Processor -- start 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.899+0000 7ff4bda75e00 1 -- start start 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17e550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55783c0947d0 con 0x55783c17ea90 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55783c090500 con 0x55783c1c3940 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55783c08a4a0 con 0x55783c17e180 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b8fef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b8fef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49002/0 (socket says 10.20.193.28:49002) 2026-02-20T13:27:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b8fef640 1 -- 10.20.193.28:0/458902148 learned_addr learned my addr 10.20.193.28:0/458902148 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17e550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b9ff1640 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b8fef640 1 -- 10.20.193.28:0/458902148 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 msgr2=0x55783c17e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17e550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b8fef640 1 -- 10.20.193.28:0/458902148 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 msgr2=0x55783c1e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b8fef640 1 -- 10.20.193.28:0/458902148 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783c035d80 con 0x55783c17ea90 2026-02-20T13:27:57.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b9ff1640 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:57.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.900+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17e550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:57.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3400 secure :-1 s=READY pgs=1186 gs=1 cs=0 l=1 c_cookie=13031714316853489560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a8004630 tx=0x7ff4a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d9f3204e6caf98 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff481ce5640 1 -- 10.20.193.28:0/458902148 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a801d410 con 0x55783c17ea90 2026-02-20T13:27:57.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff481ce5640 1 -- 10.20.193.28:0/458902148 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4a801da50 con 0x55783c17ea90 2026-02-20T13:27:57.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff481ce5640 1 -- 10.20.193.28:0/458902148 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a8010ac0 con 0x55783c17ea90 2026-02-20T13:27:57.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff4bda75e00 1 -- 10.20.193.28:0/458902148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 msgr2=0x55783c1c3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3400 secure :-1 s=READY pgs=1186 gs=1 cs=0 l=1 c_cookie=13031714316853489560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a8004630 tx=0x7ff4a8012000 comp rx=0 tx=0).stop 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff4bda75e00 1 -- 10.20.193.28:0/458902148 shutdown_connections 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3400 unknown :-1 s=CLOSED pgs=1186 gs=1 cs=0 l=1 c_cookie=13031714316853489560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/458902148 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17e550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.901+0000 7ff4bda75e00 1 -- 10.20.193.28:0/458902148 >> 10.20.193.28:0/458902148 conn(0x55783c15c680 msgr2=0x55783c17ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.902+0000 7ff4bda75e00 1 -- 10.20.193.28:0/458902148 shutdown_connections 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.902+0000 7ff4bda75e00 1 -- 10.20.193.28:0/458902148 wait complete. 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.903+0000 7ff4bda75e00 1 -- start start 2026-02-20T13:27:57.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.903+0000 7ff4bda75e00 1 Processor -- start 2026-02-20T13:27:57.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.903+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c17e180 0x55783c17f550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c17fa90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c1c3940 0x55783c1a4400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55783c1a4940 con 0x55783c17ea90 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55783c1a4ab0 con 0x55783c17e180 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55783c1a4c70 con 0x55783c1c3940 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b97f0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c17e180 0x55783c17f550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b97f0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c17e180 0x55783c17f550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51576/0 (socket says 10.20.193.28:51576) 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b97f0640 1 -- 10.20.193.28:0/1899067427 learned_addr learned my addr 10.20.193.28:0/1899067427 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b9ff1640 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c1c3940 0x55783c1a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c17fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b97f0640 1 -- 10.20.193.28:0/1899067427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c1c3940 msgr2=0x55783c1a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c1c3940 0x55783c1a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b97f0640 1 -- 10.20.193.28:0/1899067427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 msgr2=0x55783c17fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c17fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b97f0640 1 -- 10.20.193.28:0/1899067427 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783c00e350 con 0x55783c17e180 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.904+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c17fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c17e180 0x55783c17f550 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=6529606058701568147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a40aa190 tx=0x7ff4a40acfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a9dd21d74253893 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff46effd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff46effd640 1 -- 10.20.193.28:0/1899067427 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a40d0e00 con 0x55783c17e180 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff46effd640 1 -- 10.20.193.28:0/1899067427 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4a40050b0 con 0x55783c17e180 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff46effd640 1 -- 10.20.193.28:0/1899067427 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a40720b0 con 0x55783c17e180 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a800f9d0 con 0x55783c17e180 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff46effd640 1 -- 10.20.193.28:0/1899067427 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff4a4072210 con 0x55783c17e180 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff4bda75e00 10 client.29282 _ll_register_callbacks cb 0x55783c00b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:57.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55783bd206f0 con 0x55783c17e180 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff46effd640 1 -- 10.20.193.28:0/1899067427 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4a40b8060 con 0x55783c17e180 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff4bda75e00 10 client.29282 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.905+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55783c020150 con 0x55783c17e180 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff46effd640 1 -- 10.20.193.28:0/1899067427 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4a40aaf00 con 0x55783c17e180 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff4bda75e00 10 client.29282 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff4bda75e00 10 client.29282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff4bda75e00 20 client.29282 populate_metadata read hostname 'trial028' 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55783c1ba830 0x55783c1baca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff4bda75e00 4 client.29282 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55783c097d60 con 0x55783c1ba830 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55783c1ba830 0x55783c1baca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55783c1ba830 0x55783c1baca0 crc :-1 s=READY pgs=314 gs=4 cs=0 l=0 c_cookie=277563041986964129 s_cookie=10291788849407806936 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da1a1db868eaa1 server_cookie=8ed3c76e28474dd8 in_seq=0 out_seq=0 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.906+0000 7ff46effd640 10 client.29282 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff46effd640 1 -- 10.20.193.28:0/1899067427 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55783c097d60 con 0x55783c1ba830 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff46effd640 10 client.29282 handle_command_reply: tid=0 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 client.29282 shutdown 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c17e180 msgr2=0x55783c17f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c17e180 0x55783c17f550 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=6529606058701568147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a40aa190 tx=0x7ff4a40acfd0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 shutdown_connections 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55783c1ba830 0x55783c1baca0 crc :-1 s=READY pgs=314 gs=4 cs=0 l=0 c_cookie=277563041986964129 s_cookie=10291788849407806936 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c17fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c1c3940 0x55783c1a4400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff46effd640 0 client.29282 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/1899067427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c17e180 0x55783c17f550 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=6529606058701568147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 >> 10.20.193.28:0/1899067427 conn(0x55783c15c680 msgr2=0x55783c17ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 shutdown_connections 2026-02-20T13:27:57.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.907+0000 7ff4bda75e00 1 -- 10.20.193.28:0/1899067427 wait complete. 2026-02-20T13:27:57.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.908+0000 7ff4bda75e00 20 client.29282 trim_cache size 0 max 16384 2026-02-20T13:27:57.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.918+0000 7ff4bda75e00 1 Processor -- start 2026-02-20T13:27:57.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.918+0000 7ff4bda75e00 1 -- start start 2026-02-20T13:27:57.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.918+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17fab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.918+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.918+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.918+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55783c0880d0 con 0x55783c17ea90 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.918+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55783bd48700 con 0x55783c1c3940 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.918+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55783c159100 con 0x55783c17e180 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b9ff1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49014/0 (socket says 10.20.193.28:49014) 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 -- 10.20.193.28:0/3204849890 learned_addr learned my addr 10.20.193.28:0/3204849890 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 -- 10.20.193.28:0/3204849890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 msgr2=0x55783c17fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 -- 10.20.193.28:0/3204849890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 msgr2=0x55783c1e3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 -- 10.20.193.28:0/3204849890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783c1c4370 con 0x55783c17ea90 2026-02-20T13:27:57.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17fab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:57.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b9ff1640 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:27:57.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.919+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3d10 secure :-1 s=READY pgs=1187 gs=1 cs=0 l=1 c_cookie=17349103576770596495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a8011cb0 tx=0x7ff4a8011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c465c898dece8f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4814e4640 1 -- 10.20.193.28:0/3204849890 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a8038160 con 0x55783c17ea90 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4814e4640 1 -- 10.20.193.28:0/3204849890 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4a801dbc0 con 0x55783c17ea90 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4814e4640 1 -- 10.20.193.28:0/3204849890 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a8038de0 con 0x55783c17ea90 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3204849890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 msgr2=0x55783c1c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3d10 secure :-1 s=READY pgs=1187 gs=1 cs=0 l=1 c_cookie=17349103576770596495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a8011cb0 tx=0x7ff4a8011de0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3204849890 shutdown_connections 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17ea90 0x55783c1c3d10 unknown :-1 s=CLOSED pgs=1187 gs=1 cs=0 l=1 c_cookie=17349103576770596495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1e3000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3204849890 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17e180 0x55783c17fab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3204849890 >> 10.20.193.28:0/3204849890 conn(0x55783c15c680 msgr2=0x55783c17f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3204849890 shutdown_connections 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.920+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3204849890 wait complete. 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4bda75e00 1 -- start start 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4bda75e00 1 Processor -- start 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17e180 0x55783c2436d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17ea90 0x55783c243c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4bda75e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1be480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55783c1beb80 con 0x55783c17e180 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55783c1becf0 con 0x55783c1c3940 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4bda75e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55783c1beeb0 con 0x55783c17ea90 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4b97f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17e180 0x55783c2436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4b8fef640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17ea90 0x55783c243c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4b97f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17e180 0x55783c2436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49030/0 (socket says 10.20.193.28:49030) 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4b97f0640 1 -- 10.20.193.28:0/3024748442 learned_addr learned my addr 10.20.193.28:0/3024748442 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.921+0000 7ff4b9ff1640 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1be480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4b97f0640 1 -- 10.20.193.28:0/3024748442 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17ea90 msgr2=0x55783c243c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17ea90 0x55783c243c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4b97f0640 1 -- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 msgr2=0x55783c1be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1be480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4b97f0640 1 -- 10.20.193.28:0/3024748442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b4174670 con 0x55783c17e180 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4b9ff1640 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1be480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4b97f0640 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17e180 0x55783c2436d0 secure :-1 s=READY pgs=1188 gs=1 cs=0 l=1 c_cookie=8893729963526550441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a40a94a0 tx=0x7ff4a4071000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6ce047e43f73a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:27:57.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff46effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff46effd640 1 -- 10.20.193.28:0/3024748442 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a40722d0 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff46effd640 1 -- 10.20.193.28:0/3024748442 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55783bd206f0 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff46effd640 1 -- 10.20.193.28:0/3024748442 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a40b7bd0 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a800f9d0 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff46effd640 1 -- 10.20.193.28:0/3024748442 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff4a40b7d30 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4bda75e00 10 client.19335 _ll_register_callbacks cb 0x55783c00b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4a801da50 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff46effd640 1 -- 10.20.193.28:0/3024748442 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4a40d0df0 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4bda75e00 10 client.19335 fetch_fsmap learned FSMap version 28 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.922+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x7ff4a802e040 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff46effd640 1 -- 10.20.193.28:0/3024748442 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4a40aaf00 con 0x55783c17e180 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff4bda75e00 10 client.19335 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T13:27:57.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff4bda75e00 10 client.19335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff4bda75e00 20 client.19335 populate_metadata read hostname 'trial028' 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55783c28ad50 0x55783c2ab1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff4bda75e00 4 client.19335 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55783bd1df40 con 0x55783c28ad50 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55783c28ad50 0x55783c2ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff4b8fef640 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55783c28ad50 0x55783c2ab1b0 crc :-1 s=READY pgs=315 gs=4 cs=0 l=0 c_cookie=13235182015413511723 s_cookie=7607312517977121365 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7accfeb865c662b server_cookie=69929a6e0968a255 in_seq=0 out_seq=0 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.923+0000 7ff46effd640 10 client.19335 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff46effd640 1 -- 10.20.193.28:0/3024748442 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x55783bd1df40 con 0x55783c28ad50 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff46effd640 10 client.19335 handle_command_reply: tid=0 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 client.19335 shutdown 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17e180 msgr2=0x55783c2436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17e180 0x55783c2436d0 secure :-1 s=READY pgs=1188 gs=1 cs=0 l=1 c_cookie=8893729963526550441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a40a94a0 tx=0x7ff4a4071000 comp rx=0 tx=0).stop 2026-02-20T13:27:57.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 shutdown_connections 2026-02-20T13:27:57.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55783c28ad50 0x55783c2ab1b0 crc :-1 s=READY pgs=315 gs=4 cs=0 l=0 c_cookie=13235182015413511723 s_cookie=7607312517977121365 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55783c1c3940 0x55783c1be480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55783c17ea90 0x55783c243c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 --2- 10.20.193.28:0/3024748442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55783c17e180 0x55783c2436d0 unknown :-1 s=CLOSED pgs=1188 gs=1 cs=0 l=1 c_cookie=8893729963526550441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 >> 10.20.193.28:0/3024748442 conn(0x55783c15c680 msgr2=0x55783c1dff70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff46effd640 0 client.19335 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:27:57.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 shutdown_connections 2026-02-20T13:27:57.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 1 -- 10.20.193.28:0/3024748442 wait complete. 2026-02-20T13:27:57.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4bda75e00 20 client.19335 trim_cache size 0 max 16384 2026-02-20T13:27:57.933 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:27:57.933 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:27:57.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "e217eec4-719c-444b-96c3-95c9c672b821", 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.934 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:27:57.936 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.937 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.938 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.939 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:27:57.940 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.942 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.943 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.944 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:27:57.945 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4900b5760 msgr2=0x7ff4900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4900b5760 0x7ff4900d5c10 secure :-1 s=READY pgs=509 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a8005970 tx=0x7ff4a8005900 comp rx=0 tx=0).stop 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4b410d240 msgr2=0x7ff4b4060f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:27:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4b410d240 0x7ff4b4060f10 secure :-1 s=READY pgs=1185 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a4009480 tx=0x7ff4a400c2d0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/798543776 shutdown_connections 2026-02-20T13:27:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff4900b5760 0x7ff4900d5c10 unknown :-1 s=CLOSED pgs=509 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff4b4113430 0x7ff4b4061990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff4b410dc30 0x7ff4b4061450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 --2- 10.20.193.28:0/798543776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff4b410d240 0x7ff4b4060f10 unknown :-1 s=CLOSED pgs=1185 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:27:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.924+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/798543776 >> 10.20.193.28:0/798543776 conn(0x7ff4b40eaad0 msgr2=0x7ff4b410aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:27:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.925+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/798543776 shutdown_connections 2026-02-20T13:27:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:27:57.925+0000 7ff4ba7f2640 1 -- 10.20.193.28:0/798543776 wait complete. 2026-02-20T13:27:58.025 INFO:tasks.cephfs.filesystem:scrub status for tag:e217eec4-719c-444b-96c3-95c9c672b821 - {'path': '/', 'tag': 'e217eec4-719c-444b-96c3-95c9c672b821', 'options': 'recursive,force'} 2026-02-20T13:27:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:58 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:27:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:58 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:58 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:27:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:58 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:27:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:58 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:58 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:27:58 trial127 ceph-mon[43817]: pgmap v500: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 14 op/s 2026-02-20T13:27:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:58 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:27:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:58 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:58.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:58 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:27:58.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:58 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:27:58.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:58 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:58.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:58 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:58.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:27:58 trial034 ceph-mon[43332]: pgmap v500: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 14 op/s 2026-02-20T13:27:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:58 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:27:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:58 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:58 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:27:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:58 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:27:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:58 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:58 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:27:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:27:58 trial028 ceph-mon[37442]: pgmap v500: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 14 op/s 2026-02-20T13:28:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:00 trial127 ceph-mon[43817]: pgmap v501: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 13 op/s 2026-02-20T13:28:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:00 trial034 ceph-mon[43332]: pgmap v501: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 13 op/s 2026-02-20T13:28:01.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:00 trial028 ceph-mon[37442]: pgmap v501: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 13 op/s 2026-02-20T13:28:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:02 trial127 ceph-mon[43817]: pgmap v502: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:28:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:02 trial034 ceph-mon[43332]: pgmap v502: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:28:03.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:02 trial028 ceph-mon[37442]: pgmap v502: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:28:03.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:03 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:28:03.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:03 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:28:03.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:03 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:28:03.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:03 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:28:04.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:03 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:28:04.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:03 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:28:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:04 trial127 ceph-mon[43817]: pgmap v503: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 18 op/s 2026-02-20T13:28:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:04 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:28:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:04 trial034 ceph-mon[43332]: pgmap v503: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 18 op/s 2026-02-20T13:28:04.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:04 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:28:05.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:04 trial028 ceph-mon[37442]: pgmap v503: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 18 op/s 2026-02-20T13:28:05.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:04 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:28:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:06 trial127 ceph-mon[43817]: pgmap v504: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:28:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:06 trial034 ceph-mon[43332]: pgmap v504: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:28:07.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:06 trial028 ceph-mon[37442]: pgmap v504: 97 pgs: 97 active+clean; 1.8 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 17 op/s 2026-02-20T13:28:08.901 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:08 trial028 ceph-mon[37442]: pgmap v505: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 21 op/s 2026-02-20T13:28:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:08 trial127 ceph-mon[43817]: pgmap v505: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 21 op/s 2026-02-20T13:28:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:08 trial034 ceph-mon[43332]: pgmap v505: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 21 op/s 2026-02-20T13:28:10.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 -- 10.20.193.28:0/2070534092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 msgr2=0x7f93cc171280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/2070534092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 0x7f93cc171280 secure :-1 s=READY pgs=1189 gs=2 cs=0 l=1 c_cookie=10439639183209845384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c800aa30 tx=0x7f93c8030270 comp rx=0 tx=0).stop 2026-02-20T13:28:10.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 -- 10.20.193.28:0/2070534092 shutdown_connections 2026-02-20T13:28:10.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/2070534092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 0x7f93cc171280 unknown :-1 s=CLOSED pgs=1189 gs=2 cs=0 l=1 c_cookie=10439639183209845384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/2070534092 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93cc061510 0x7f93cc061980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/2070534092 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f93cc062a40 0x7f93cc060fd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 -- 10.20.193.28:0/2070534092 >> 10.20.193.28:0/2070534092 conn(0x7f93cc0ea490 msgr2=0x7f93cc10a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:10.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 -- 10.20.193.28:0/2070534092 shutdown_connections 2026-02-20T13:28:10.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.551+0000 7f93d2dbe640 1 -- 10.20.193.28:0/2070534092 wait complete. 2026-02-20T13:28:10.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.552+0000 7f93d2dbe640 1 Processor -- start 2026-02-20T13:28:10.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.552+0000 7f93d2dbe640 1 -- start start 2026-02-20T13:28:10.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.552+0000 7f93d2dbe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f93cc061510 0x7f93cc15c620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.552+0000 7f93d2dbe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93cc062a40 0x7f93cc15cc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.552+0000 7f93d2dbe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 0x7f93cc15d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.552+0000 7f93d2dbe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc15dfb0 con 0x7f93cc150e40 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.552+0000 7f93d2dbe640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc15e120 con 0x7f93cc061510 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.552+0000 7f93d2dbe640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc15e2e0 con 0x7f93cc062a40 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d15bb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93cc062a40 0x7f93cc15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d25bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 0x7f93cc15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d15bb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93cc062a40 0x7f93cc15cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40262/0 (socket says 10.20.193.28:40262) 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d15bb640 1 -- 10.20.193.28:0/3940378788 learned_addr learned my addr 10.20.193.28:0/3940378788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f93cc061510 0x7f93cc15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d25bd640 1 -- 10.20.193.28:0/3940378788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93cc062a40 msgr2=0x7f93cc15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d25bd640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93cc062a40 0x7f93cc15cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d25bd640 1 -- 10.20.193.28:0/3940378788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f93cc061510 msgr2=0x7f93cc15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d25bd640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f93cc061510 0x7f93cc15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d25bd640 1 -- 10.20.193.28:0/3940378788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c800a650 con 0x7f93cc150e40 2026-02-20T13:28:10.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d25bd640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 0x7f93cc15d870 secure :-1 s=READY pgs=1190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c8039820 tx=0x7f93c80039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:10.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93baffd640 1 -- 10.20.193.28:0/3940378788 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c803e070 con 0x7f93cc150e40 2026-02-20T13:28:10.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93baffd640 1 -- 10.20.193.28:0/3940378788 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f93c8006eb0 con 0x7f93cc150e40 2026-02-20T13:28:10.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93baffd640 1 -- 10.20.193.28:0/3940378788 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c8042a70 con 0x7f93cc150e40 2026-02-20T13:28:10.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d2dbe640 1 -- 10.20.193.28:0/3940378788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc15e560 con 0x7f93cc150e40 2026-02-20T13:28:10.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.553+0000 7f93d2dbe640 1 -- 10.20.193.28:0/3940378788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc15ea80 con 0x7f93cc150e40 2026-02-20T13:28:10.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.556+0000 7f93baffd640 1 -- 10.20.193.28:0/3940378788 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f93c8039b40 con 0x7f93cc150e40 2026-02-20T13:28:10.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.558+0000 7f93baffd640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93a80b5760 0x7f93a80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.558+0000 7f93d6630e00 1 Processor -- start 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.558+0000 7f93baffd640 1 -- 10.20.193.28:0/3940378788 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f93c810c860 con 0x7f93cc150e40 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.558+0000 7f93d6630e00 1 -- start start 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.558+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93a80b5760 0x7f93a80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.558+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca11658a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1165de0 0x558ca11861c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca11a6ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d6630e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558ca105afd0 con 0x558ca1186700 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d6630e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558ca1056d00 con 0x558ca11454c0 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d6630e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558ca1050ca0 con 0x558ca1165de0 2026-02-20T13:28:10.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca11a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca11a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37378/0 (socket says 10.20.193.28:37378) 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 -- 10.20.193.28:0/24099429 learned_addr learned my addr 10.20.193.28:0/24099429 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93a80b5760 0x7f93a80d5c10 secure :-1 s=READY pgs=510 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93bc004740 tx=0x7f93bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d15bb640 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1165de0 0x558ca11861c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca11658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 -- 10.20.193.28:0/24099429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1165de0 msgr2=0x558ca11861c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1165de0 0x558ca11861c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 -- 10.20.193.28:0/24099429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 msgr2=0x558ca11658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca11658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 -- 10.20.193.28:0/24099429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ca0ff38b0 con 0x558ca1186700 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f93d25bd640 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca11a6ae0 secure :-1 s=READY pgs=1191 gs=1 cs=0 l=1 c_cookie=11645203913161526191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c800a980 tx=0x7f93c800a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19c134294fb4baf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:10.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.559+0000 7f939a3ff640 1 -- 10.20.193.28:0/24099429 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c8039e20 con 0x558ca1186700 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f939a3ff640 1 -- 10.20.193.28:0/24099429 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f93c810a0b0 con 0x558ca1186700 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f939a3ff640 1 -- 10.20.193.28:0/24099429 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c80dd870 con 0x558ca1186700 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 -- 10.20.193.28:0/24099429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 msgr2=0x558ca11a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca11a6ae0 secure :-1 s=READY pgs=1191 gs=1 cs=0 l=1 c_cookie=11645203913161526191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c800a980 tx=0x7f93c800a390 comp rx=0 tx=0).stop 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 -- 10.20.193.28:0/24099429 shutdown_connections 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca11a6ae0 unknown :-1 s=CLOSED pgs=1191 gs=1 cs=0 l=1 c_cookie=11645203913161526191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1165de0 0x558ca11861c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 --2- 10.20.193.28:0/24099429 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca11658a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 -- 10.20.193.28:0/24099429 >> 10.20.193.28:0/24099429 conn(0x558ca10641c0 msgr2=0x558ca1143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 -- 10.20.193.28:0/24099429 shutdown_connections 2026-02-20T13:28:10.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.560+0000 7f93d6630e00 1 -- 10.20.193.28:0/24099429 wait complete. 2026-02-20T13:28:10.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.561+0000 7f93d6630e00 1 -- start start 2026-02-20T13:28:10.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.561+0000 7f93d6630e00 1 Processor -- start 2026-02-20T13:28:10.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca115e870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115eec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca115f920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d6630e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558ca115ff80 con 0x558ca1165de0 2026-02-20T13:28:10.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d6630e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558ca11600f0 con 0x558ca11454c0 2026-02-20T13:28:10.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d6630e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558ca11602b0 con 0x558ca1186700 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37390/0 (socket says 10.20.193.28:37390) 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 -- 10.20.193.28:0/650796391 learned_addr learned my addr 10.20.193.28:0/650796391 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca115e870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d25bd640 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca115f920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 -- 10.20.193.28:0/650796391 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 msgr2=0x558ca115f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca115f920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 -- 10.20.193.28:0/650796391 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 msgr2=0x558ca115e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca115e870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 -- 10.20.193.28:0/650796391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ca0ffc400 con 0x558ca1165de0 2026-02-20T13:28:10.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93d15bb640 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115eec0 secure :-1 s=READY pgs=1192 gs=1 cs=0 l=1 c_cookie=11055543515768228534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c0009690 tx=0x7f93c0002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996d2e40b83d0ab6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.562+0000 7f93877fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93877fe640 1 -- 10.20.193.28:0/650796391 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c0017070 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc15ea80 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 10 client.19347 _ll_register_callbacks cb 0x558ca0fdba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ca0cf0520 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93877fe640 1 -- 10.20.193.28:0/650796391 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x558ca0cf0520 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93877fe640 1 -- 10.20.193.28:0/650796391 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c001bde0 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93877fe640 1 -- 10.20.193.28:0/650796391 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f93c000f3c0 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93877fe640 1 -- 10.20.193.28:0/650796391 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f93c000f630 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 10 client.19347 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558ca0fd4da0 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93877fe640 1 -- 10.20.193.28:0/650796391 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f93c001b3c0 con 0x558ca1165de0 2026-02-20T13:28:10.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 10 client.19347 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 10 client.19347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 20 client.19347 populate_metadata read hostname 'trial028' 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558ca11630f0 0x558ca1163590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 4 client.19347 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.563+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ca1082630 con 0x558ca11630f0 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.564+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558ca11630f0 0x558ca1163590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.564+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558ca11630f0 0x558ca1163590 crc :-1 s=READY pgs=316 gs=4 cs=0 l=0 c_cookie=964897304834854368 s_cookie=2538184492395001384 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6400fc8b69cde0 server_cookie=23397159139bf628 in_seq=0 out_seq=0 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.564+0000 7f93877fe640 10 client.19347 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93877fe640 1 -- 10.20.193.28:0/650796391 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558ca1082630 con 0x558ca11630f0 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93877fe640 10 client.19347 handle_command_reply: tid=0 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 client.19347 shutdown 2026-02-20T13:28:10.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 msgr2=0x558ca115eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115eec0 secure :-1 s=READY pgs=1192 gs=1 cs=0 l=1 c_cookie=11055543515768228534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c0009690 tx=0x7f93c0002a70 comp rx=0 tx=0).stop 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 shutdown_connections 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558ca11630f0 0x558ca1163590 crc :-1 s=READY pgs=316 gs=4 cs=0 l=0 c_cookie=964897304834854368 s_cookie=2538184492395001384 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115eec0 unknown :-1 s=CLOSED pgs=1192 gs=1 cs=0 l=1 c_cookie=11055543515768228534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca115f920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 --2- 10.20.193.28:0/650796391 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca115e870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93877fe640 0 client.19347 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 >> 10.20.193.28:0/650796391 conn(0x558ca10641c0 msgr2=0x558ca1146790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 shutdown_connections 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 1 -- 10.20.193.28:0/650796391 wait complete. 2026-02-20T13:28:10.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.565+0000 7f93d6630e00 20 client.19347 trim_cache size 0 max 16384 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d6630e00 1 Processor -- start 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d6630e00 1 -- start start 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca115bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115c0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca11845c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d6630e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558ca104e8d0 con 0x558ca1165de0 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d6630e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558ca0d8ff10 con 0x558ca11454c0 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d6630e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558ca1056d00 con 0x558ca1186700 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d15bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d15bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37394/0 (socket says 10.20.193.28:37394) 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d15bb640 1 -- 10.20.193.28:0/1990488021 learned_addr learned my addr 10.20.193.28:0/1990488021 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.573+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca115bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d25bd640 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca11845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d15bb640 1 -- 10.20.193.28:0/1990488021 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 msgr2=0x558ca11845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d15bb640 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca11845c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d15bb640 1 -- 10.20.193.28:0/1990488021 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 msgr2=0x558ca115bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d15bb640 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca115bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d15bb640 1 -- 10.20.193.28:0/1990488021 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ca0fe6670 con 0x558ca1165de0 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d25bd640 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca11845c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d15bb640 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115c0e0 secure :-1 s=READY pgs=1193 gs=1 cs=0 l=1 c_cookie=6873254827922898293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c000fc70 tx=0x7f93c0009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f62b4d995153d75 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:10.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f9399bfe640 1 -- 10.20.193.28:0/1990488021 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c0017070 con 0x558ca1165de0 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f9399bfe640 1 -- 10.20.193.28:0/1990488021 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f93c002b070 con 0x558ca1165de0 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f9399bfe640 1 -- 10.20.193.28:0/1990488021 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c000e3c0 con 0x558ca1165de0 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 -- 10.20.193.28:0/1990488021 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 msgr2=0x558ca115c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115c0e0 secure :-1 s=READY pgs=1193 gs=1 cs=0 l=1 c_cookie=6873254827922898293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c000fc70 tx=0x7f93c0009550 comp rx=0 tx=0).stop 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 -- 10.20.193.28:0/1990488021 shutdown_connections 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1165de0 0x558ca115c0e0 unknown :-1 s=CLOSED pgs=1193 gs=1 cs=0 l=1 c_cookie=6873254827922898293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca1186700 0x558ca11845c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 --2- 10.20.193.28:0/1990488021 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca11454c0 0x558ca115bba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 -- 10.20.193.28:0/1990488021 >> 10.20.193.28:0/1990488021 conn(0x558ca10641c0 msgr2=0x558ca115e700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 -- 10.20.193.28:0/1990488021 shutdown_connections 2026-02-20T13:28:10.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.574+0000 7f93d6630e00 1 -- 10.20.193.28:0/1990488021 wait complete. 2026-02-20T13:28:10.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d6630e00 1 -- start start 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d6630e00 1 Processor -- start 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca11454c0 0x558ca1165890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca1165de0 0x558ca1166310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d6630e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca1166a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d6630e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558ca1120810 con 0x558ca1186700 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d6630e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558ca1167130 con 0x558ca1165de0 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d6630e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558ca11672f0 con 0x558ca11454c0 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.575+0000 7f93d25bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca1166a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d15bb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca1165de0 0x558ca1166310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d25bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca1166a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37396/0 (socket says 10.20.193.28:37396) 2026-02-20T13:28:10.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d25bd640 1 -- 10.20.193.28:0/2836429082 learned_addr learned my addr 10.20.193.28:0/2836429082 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca11454c0 0x558ca1165890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d25bd640 1 -- 10.20.193.28:0/2836429082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca11454c0 msgr2=0x558ca1165890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d25bd640 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca11454c0 0x558ca1165890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d25bd640 1 -- 10.20.193.28:0/2836429082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca1165de0 msgr2=0x558ca1166310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d25bd640 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca1165de0 0x558ca1166310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d25bd640 1 -- 10.20.193.28:0/2836429082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ca0fe10f0 con 0x558ca1186700 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d25bd640 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca1166a00 secure :-1 s=READY pgs=1194 gs=1 cs=0 l=1 c_cookie=13214374746083088475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c80cf240 tx=0x7f93c80dda80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b762e3d19d2cd85b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93877fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93877fe640 1 -- 10.20.193.28:0/2836429082 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c80ddd00 con 0x558ca1186700 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93877fe640 1 -- 10.20.193.28:0/2836429082 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f93c8039e20 con 0x558ca1186700 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93877fe640 1 -- 10.20.193.28:0/2836429082 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93c80d21e0 con 0x558ca1186700 2026-02-20T13:28:10.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ca0fd4da0 con 0x558ca1186700 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93877fe640 1 -- 10.20.193.28:0/2836429082 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f93c8091b60 con 0x558ca1186700 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93877fe640 10 client.19353 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d6630e00 10 client.19353 _ll_register_callbacks cb 0x558ca0fdba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.576+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ca1100ca0 con 0x558ca1186700 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93877fe640 1 -- 10.20.193.28:0/2836429082 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f93c80d88e0 con 0x558ca1186700 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d6630e00 10 client.19353 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558ca0fd50d0 con 0x558ca1186700 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93877fe640 1 -- 10.20.193.28:0/2836429082 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f93c80ce5c0 con 0x558ca1186700 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d6630e00 10 client.19353 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d6630e00 10 client.19353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d6630e00 20 client.19353 populate_metadata read hostname 'trial028' 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d6630e00 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558ca1168f50 0x558ca11693f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:10.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d6630e00 4 client.19353 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:28:10.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ca0d34640 con 0x558ca1168f50 2026-02-20T13:28:10.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.577+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558ca1168f50 0x558ca11693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:10.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.578+0000 7f93d1dbc640 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558ca1168f50 0x558ca11693f0 crc :-1 s=READY pgs=317 gs=4 cs=0 l=0 c_cookie=16818704053534090321 s_cookie=6182648422929571188 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9680a3a35526451 server_cookie=55cd2dfbcbd89d74 in_seq=0 out_seq=0 2026-02-20T13:28:10.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.578+0000 7f93877fe640 10 client.19353 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93877fe640 1 -- 10.20.193.28:0/2836429082 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ca0d34640 con 0x558ca1168f50 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93877fe640 10 client.19353 handle_command_reply: tid=0 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 client.19353 shutdown 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 msgr2=0x558ca1166a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca1166a00 secure :-1 s=READY pgs=1194 gs=1 cs=0 l=1 c_cookie=13214374746083088475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c80cf240 tx=0x7f93c80dda80 comp rx=0 tx=0).stop 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 shutdown_connections 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x558ca1168f50 0x558ca11693f0 crc :-1 s=READY pgs=317 gs=4 cs=0 l=0 c_cookie=16818704053534090321 s_cookie=6182648422929571188 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558ca1186700 0x558ca1166a00 unknown :-1 s=CLOSED pgs=1194 gs=1 cs=0 l=1 c_cookie=13214374746083088475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558ca1165de0 0x558ca1166310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 --2- 10.20.193.28:0/2836429082 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558ca11454c0 0x558ca1165890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 >> 10.20.193.28:0/2836429082 conn(0x558ca10641c0 msgr2=0x558ca115ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:10.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93877fe640 0 client.19353 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:10.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 shutdown_connections 2026-02-20T13:28:10.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 1 -- 10.20.193.28:0/2836429082 wait complete. 2026-02-20T13:28:10.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d6630e00 20 client.19353 trim_cache size 0 max 16384 2026-02-20T13:28:10.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:28:10.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:28:10.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:28:10.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:28:10.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d2dbe640 1 -- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93a80b5760 msgr2=0x7f93a80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93a80b5760 0x7f93a80d5c10 secure :-1 s=READY pgs=510 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93bc004740 tx=0x7f93bc005f90 comp rx=0 tx=0).stop 2026-02-20T13:28:10.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d2dbe640 1 -- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 msgr2=0x7f93cc15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.583+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 0x7f93cc15d870 secure :-1 s=READY pgs=1190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c8039820 tx=0x7f93c80039b0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.584+0000 7f93d2dbe640 1 -- 10.20.193.28:0/3940378788 shutdown_connections 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.584+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f93a80b5760 0x7f93a80d5c10 unknown :-1 s=CLOSED pgs=510 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.584+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93cc150e40 0x7f93cc15d870 unknown :-1 s=CLOSED pgs=1190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.584+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93cc062a40 0x7f93cc15cc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.584+0000 7f93d2dbe640 1 --2- 10.20.193.28:0/3940378788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f93cc061510 0x7f93cc15c620 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.584+0000 7f93d2dbe640 1 -- 10.20.193.28:0/3940378788 >> 10.20.193.28:0/3940378788 conn(0x7f93cc0ea490 msgr2=0x7f93cc10a870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.584+0000 7f93d2dbe640 1 -- 10.20.193.28:0/3940378788 shutdown_connections 2026-02-20T13:28:10.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:10.584+0000 7f93d2dbe640 1 -- 10.20.193.28:0/3940378788 wait complete. 2026-02-20T13:28:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:10 trial127 ceph-mon[43817]: pgmap v506: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:28:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:10 trial034 ceph-mon[43332]: pgmap v506: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:28:11.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:10 trial028 ceph-mon[37442]: pgmap v506: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:28:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:12 trial127 ceph-mon[43817]: pgmap v507: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:28:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:12 trial034 ceph-mon[43332]: pgmap v507: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:28:13.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:12 trial028 ceph-mon[37442]: pgmap v507: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2026-02-20T13:28:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:14 trial127 ceph-mon[43817]: pgmap v508: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:28:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:14 trial034 ceph-mon[43332]: pgmap v508: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:28:15.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:14 trial028 ceph-mon[37442]: pgmap v508: 97 pgs: 97 active+clean; 1.9 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 18 op/s 2026-02-20T13:28:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:16 trial127 ceph-mon[43817]: pgmap v509: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 17 op/s 2026-02-20T13:28:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:16 trial034 ceph-mon[43332]: pgmap v509: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 17 op/s 2026-02-20T13:28:17.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:16 trial028 ceph-mon[37442]: pgmap v509: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 17 op/s 2026-02-20T13:28:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:18 trial028 ceph-mon[37442]: pgmap v510: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 19 op/s 2026-02-20T13:28:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:18 trial127 ceph-mon[43817]: pgmap v510: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 19 op/s 2026-02-20T13:28:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:18 trial034 ceph-mon[43332]: pgmap v510: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 19 op/s 2026-02-20T13:28:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:20 trial127 ceph-mon[43817]: pgmap v511: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.6 KiB/s wr, 16 op/s 2026-02-20T13:28:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:20 trial034 ceph-mon[43332]: pgmap v511: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.6 KiB/s wr, 16 op/s 2026-02-20T13:28:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:20 trial028 ceph-mon[37442]: pgmap v511: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.6 KiB/s wr, 16 op/s 2026-02-20T13:28:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:22 trial127 ceph-mon[43817]: pgmap v512: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T13:28:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:22 trial034 ceph-mon[43332]: pgmap v512: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T13:28:23.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:22 trial028 ceph-mon[37442]: pgmap v512: 97 pgs: 97 active+clean; 1.9 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 -- 10.20.193.28:0/2767183100 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810b330 msgr2=0x7f7be810cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/2767183100 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810b330 0x7f7be810cf80 secure :-1 s=READY pgs=428 gs=2 cs=0 l=1 c_cookie=6382143037343764126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7be400afd0 tx=0x7f7be4030430 comp rx=0 tx=0).stop 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 -- 10.20.193.28:0/2767183100 shutdown_connections 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/2767183100 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810b330 0x7f7be810cf80 unknown :-1 s=CLOSED pgs=428 gs=2 cs=0 l=1 c_cookie=6382143037343764126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/2767183100 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be810a980 0x7f7be810adf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/2767183100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be810c030 0x7f7be810c420 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 -- 10.20.193.28:0/2767183100 >> 10.20.193.28:0/2767183100 conn(0x7f7be80e8640 msgr2=0x7f7be8108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 -- 10.20.193.28:0/2767183100 shutdown_connections 2026-02-20T13:28:23.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.656+0000 7f7bee5d2640 1 -- 10.20.193.28:0/2767183100 wait complete. 2026-02-20T13:28:23.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bee5d2640 1 Processor -- start 2026-02-20T13:28:23.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bee5d2640 1 -- start start 2026-02-20T13:28:23.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bee5d2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810a980 0x7f7be80f31c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bee5d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be810b330 0x7f7be80f3810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bee5d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be810c030 0x7f7be80f4410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bee5d2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7be80f4b50 con 0x7f7be810c030 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bee5d2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7be80f4cc0 con 0x7f7be810a980 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bee5d2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7be80f4e80 con 0x7f7be810b330 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7beddd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be810c030 0x7f7be80f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bed5d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810a980 0x7f7be80f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7becdcf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be810b330 0x7f7be80f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bed5d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810a980 0x7f7be80f31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39234/0 (socket says 10.20.193.28:39234) 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.657+0000 7f7bed5d0640 1 -- 10.20.193.28:0/1248407170 learned_addr learned my addr 10.20.193.28:0/1248407170 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:23.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7beddd1640 1 -- 10.20.193.28:0/1248407170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be810b330 msgr2=0x7f7be80f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7beddd1640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be810b330 0x7f7be80f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7beddd1640 1 -- 10.20.193.28:0/1248407170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810a980 msgr2=0x7f7be80f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7beddd1640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810a980 0x7f7be80f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7beddd1640 1 -- 10.20.193.28:0/1248407170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd80094b0 con 0x7f7be810c030 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7beddd1640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be810c030 0x7f7be80f4410 secure :-1 s=READY pgs=1195 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7be40070b0 tx=0x7f7be4005290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7bd67fc640 1 -- 10.20.193.28:0/1248407170 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7be4003e20 con 0x7f7be810c030 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7bd67fc640 1 -- 10.20.193.28:0/1248407170 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7be4008630 con 0x7f7be810c030 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7bd67fc640 1 -- 10.20.193.28:0/1248407170 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7be4039830 con 0x7f7be810c030 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7bee5d2640 1 -- 10.20.193.28:0/1248407170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be400ac70 con 0x7f7be810c030 2026-02-20T13:28:23.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.658+0000 7f7bee5d2640 1 -- 10.20.193.28:0/1248407170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be80f5480 con 0x7f7be810c030 2026-02-20T13:28:23.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.661+0000 7f7bd67fc640 1 -- 10.20.193.28:0/1248407170 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7be40087a0 con 0x7f7be810c030 2026-02-20T13:28:23.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.662+0000 7f7bd67fc640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bc40b5760 0x7f7bc40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.662+0000 7f7bd67fc640 1 -- 10.20.193.28:0/1248407170 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7be410c640 con 0x7f7be810c030 2026-02-20T13:28:23.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.662+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bc40b5760 0x7f7bc40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bc40b5760 0x7f7bc40d5c10 secure :-1 s=READY pgs=511 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd8005c70 tx=0x7f7bd8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:23.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bf1e80e00 1 Processor -- start 2026-02-20T13:28:23.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bf1e80e00 1 -- start start 2026-02-20T13:28:23.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b6c1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b8cae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8a40fd0 con 0x55a4a8b2b4c0 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8a3cd00 con 0x55a4a8b4bde0 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.663+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8a36ca0 con 0x55a4a8b6c700 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b6c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7bed5d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b6c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39236/0 (socket says 10.20.193.28:39236) 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 -- 10.20.193.28:0/2606322329 learned_addr learned my addr 10.20.193.28:0/2606322329 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7beddd1640 1 --2- 10.20.193.28:0/2606322329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b8cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 -- 10.20.193.28:0/2606322329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 msgr2=0x55a4a8b8cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 --2- 10.20.193.28:0/2606322329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b8cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 -- 10.20.193.28:0/2606322329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 msgr2=0x55a4a8b4b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 --2- 10.20.193.28:0/2606322329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 -- 10.20.193.28:0/2606322329 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a89d98b0 con 0x55a4a8b4bde0 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7becdcf640 1 --2- 10.20.193.28:0/2606322329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b6c1c0 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=13101616687120684659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bdc009d50 tx=0x7f7bdc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5d24af62b289673 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:23.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7bb5bfe640 1 -- 10.20.193.28:0/2606322329 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bdc004330 con 0x55a4a8b4bde0 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7bb5bfe640 1 -- 10.20.193.28:0/2606322329 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bdc004490 con 0x55a4a8b4bde0 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7bb5bfe640 1 -- 10.20.193.28:0/2606322329 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bdc019b30 con 0x55a4a8b4bde0 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2606322329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 msgr2=0x55a4a8b6c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.664+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/2606322329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b6c1c0 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=13101616687120684659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bdc009d50 tx=0x7f7bdc011810 comp rx=0 tx=0).stop 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.665+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2606322329 shutdown_connections 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.665+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/2606322329 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b8cae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.665+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/2606322329 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b6c1c0 unknown :-1 s=CLOSED pgs=429 gs=1 cs=0 l=1 c_cookie=13101616687120684659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.665+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/2606322329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4b8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.665+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2606322329 >> 10.20.193.28:0/2606322329 conn(0x55a4a8a4a1c0 msgr2=0x55a4a8b29da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.665+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2606322329 shutdown_connections 2026-02-20T13:28:23.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.665+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2606322329 wait complete. 2026-02-20T13:28:23.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.666+0000 7f7bf1e80e00 1 -- start start 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.666+0000 7f7bf1e80e00 1 Processor -- start 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.666+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b44b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.666+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b45180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.666+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b6c700 0x55a4a8b45be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.666+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8b46240 con 0x55a4a8b2b4c0 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.666+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8b463b0 con 0x55a4a8b6c700 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.666+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8b46570 con 0x55a4a8b4bde0 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b6c700 0x55a4a8b45be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b6c700 0x55a4a8b45be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39242/0 (socket says 10.20.193.28:39242) 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 -- 10.20.193.28:0/3943844810 learned_addr learned my addr 10.20.193.28:0/3943844810 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7becdcf640 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b45180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b44b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 -- 10.20.193.28:0/3943844810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b4bde0 msgr2=0x55a4a8b45180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b45180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 -- 10.20.193.28:0/3943844810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 msgr2=0x55a4a8b44b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b44b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 -- 10.20.193.28:0/3943844810 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a89e2400 con 0x55a4a8b6c700 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7beddd1640 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b6c700 0x55a4a8b45be0 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=7830696367669541290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7be40cf000 tx=0x7f7be40d2450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cac38db8ae279aa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7ba2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/3943844810 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7be40d2760 con 0x55a4a8b6c700 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/3943844810 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7be40d86c0 con 0x55a4a8b6c700 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc009940 con 0x55a4a8b6c700 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/3943844810 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7be40d38b0 con 0x55a4a8b6c700 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7bf1e80e00 10 client.29318 _ll_register_callbacks cb 0x55a4a89c1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4a86d6520 con 0x55a4a8b6c700 2026-02-20T13:28:23.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.667+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/3943844810 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7be40d4390 con 0x55a4a8b6c700 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/3943844810 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7be40d4590 con 0x55a4a8b6c700 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bf1e80e00 10 client.29318 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a4a89bada0 con 0x55a4a8b6c700 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/3943844810 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f7be40bab60 con 0x55a4a8b6c700 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bf1e80e00 10 client.29318 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bf1e80e00 10 client.29318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bf1e80e00 20 client.29318 populate_metadata read hostname 'trial028' 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a4a8b48f50 0x55a4a8b493f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bf1e80e00 4 client.29318 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4a8a68630 con 0x55a4a8b48f50 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.668+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a4a8b48f50 0x55a4a8b493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a4a8b48f50 0x55a4a8b493f0 crc :-1 s=READY pgs=318 gs=4 cs=0 l=0 c_cookie=10233319591163051637 s_cookie=13202766286353660319 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e040df32051be75 server_cookie=b739a5fc769cf99f in_seq=0 out_seq=0 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7ba2ffd640 10 client.29318 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/3943844810 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a4a8a68630 con 0x55a4a8b48f50 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7ba2ffd640 10 client.29318 handle_command_reply: tid=0 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 client.29318 shutdown 2026-02-20T13:28:23.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b6c700 msgr2=0x55a4a8b45be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b6c700 0x55a4a8b45be0 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=7830696367669541290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7be40cf000 tx=0x7f7be40d2450 comp rx=0 tx=0).stop 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 shutdown_connections 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a4a8b48f50 0x55a4a8b493f0 crc :-1 s=READY pgs=318 gs=4 cs=0 l=0 c_cookie=10233319591163051637 s_cookie=13202766286353660319 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b6c700 0x55a4a8b45be0 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=7830696367669541290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b45180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/3943844810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b44b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7ba2ffd640 0 client.29318 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.669+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 >> 10.20.193.28:0/3943844810 conn(0x55a4a8a4a1c0 msgr2=0x55a4a8b2c790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.670+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 shutdown_connections 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.670+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/3943844810 wait complete. 2026-02-20T13:28:23.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.670+0000 7f7bf1e80e00 20 client.29318 trim_cache size 0 max 16384 2026-02-20T13:28:23.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bf1e80e00 1 Processor -- start 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bf1e80e00 1 -- start start 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b41e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b423a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b6c700 0x55a4a8b6a5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8a348d0 con 0x55a4a8b6c700 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8775f10 con 0x55a4a8b4bde0 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8b06810 con 0x55a4a8b2b4c0 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bed5d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b41e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7bed5d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b41e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40396/0 (socket says 10.20.193.28:40396) 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bed5d0640 1 -- 10.20.193.28:0/2272085688 learned_addr learned my addr 10.20.193.28:0/2272085688 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.677+0000 7f7beddd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b6c700 0x55a4a8b6a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7becdcf640 1 --2- 10.20.193.28:0/2272085688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bed5d0640 1 -- 10.20.193.28:0/2272085688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 msgr2=0x55a4a8b423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:23.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/2272085688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bed5d0640 1 -- 10.20.193.28:0/2272085688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b6c700 msgr2=0x55a4a8b6a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/2272085688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b6c700 0x55a4a8b6a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bed5d0640 1 -- 10.20.193.28:0/2272085688 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a89cc670 con 0x55a4a8b2b4c0 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/2272085688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b41e60 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=17972982950764245486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd8011460 tx=0x7f7bd8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f96cdcc4ce7471ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bb53fd640 1 -- 10.20.193.28:0/2272085688 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd8021070 con 0x55a4a8b2b4c0 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bb53fd640 1 -- 10.20.193.28:0/2272085688 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bd8022040 con 0x55a4a8b2b4c0 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.678+0000 7f7bb53fd640 1 -- 10.20.193.28:0/2272085688 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd8029a60 con 0x55a4a8b2b4c0 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2272085688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b2b4c0 msgr2=0x55a4a8b41e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/2272085688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b41e60 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=17972982950764245486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd8011460 tx=0x7f7bd8014000 comp rx=0 tx=0).stop 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2272085688 shutdown_connections 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/2272085688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b6c700 0x55a4a8b6a5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/2272085688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b423a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/2272085688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b41e60 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=17972982950764245486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2272085688 >> 10.20.193.28:0/2272085688 conn(0x55a4a8a4a1c0 msgr2=0x55a4a8b449c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2272085688 shutdown_connections 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/2272085688 wait complete. 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 -- start start 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.679+0000 7f7bf1e80e00 1 Processor -- start 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b4dd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bf1e80e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b4e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8b4eb00 con 0x55a4a8b4bde0 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8b4ec70 con 0x55a4a8b2b4c0 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bf1e80e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a4a8b4ee30 con 0x55a4a8b6c700 2026-02-20T13:28:23.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bed5d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7beddd1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b4e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bed5d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39260/0 (socket says 10.20.193.28:39260) 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bed5d0640 1 -- 10.20.193.28:0/148493718 learned_addr learned my addr 10.20.193.28:0/148493718 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7becdcf640 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b4dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7beddd1640 1 -- 10.20.193.28:0/148493718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b2b4c0 msgr2=0x55a4a8b4d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7beddd1640 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7beddd1640 1 -- 10.20.193.28:0/148493718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b4bde0 msgr2=0x55a4a8b4dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7beddd1640 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b4dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7beddd1640 1 -- 10.20.193.28:0/148493718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a89c70f0 con 0x55a4a8b6c700 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7becdcf640 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b4dd50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7beddd1640 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b4e400 secure :-1 s=READY pgs=358 gs=2 cs=0 l=1 c_cookie=12110128127577463397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7be410b000 tx=0x7f7be4030430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a80fd15eacb89a65 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7ba2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/148493718 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7be40f1070 con 0x55a4a8b6c700 2026-02-20T13:28:23.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/148493718 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55a4a86d6520 con 0x55a4a8b6c700 2026-02-20T13:28:23.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/148493718 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7be40492c0 con 0x55a4a8b6c700 2026-02-20T13:28:23.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.680+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd8011590 con 0x55a4a8b6c700 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/148493718 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7be4008b80 con 0x55a4a8b6c700 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7ba2ffd640 10 client.29218 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 10 client.29218 _ll_register_callbacks cb 0x55a4a89c1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4a8ae6ca0 con 0x55a4a8b6c700 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/148493718 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7be40daca0 con 0x55a4a8b6c700 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 10 client.29218 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a4a89bb0d0 con 0x55a4a8b6c700 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/148493718 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f7be40d9870 con 0x55a4a8b6c700 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 10 client.29218 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:23.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 10 client.29218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:23.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 20 client.29218 populate_metadata read hostname 'trial028' 2026-02-20T13:28:23.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a4a8b50630 0x55a4a8b50ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:23.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 4 client.29218 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:28:23.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a4a871a640 con 0x55a4a8b50630 2026-02-20T13:28:23.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.681+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a4a8b50630 0x55a4a8b50ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:23.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.682+0000 7f7bed5d0640 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a4a8b50630 0x55a4a8b50ad0 crc :-1 s=READY pgs=319 gs=4 cs=0 l=0 c_cookie=1904207824675778025 s_cookie=17308376520589525362 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a6d1aed7851ade9 server_cookie=f033b4bde4734172 in_seq=0 out_seq=0 2026-02-20T13:28:23.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.682+0000 7f7ba2ffd640 10 client.29218 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7ba2ffd640 1 -- 10.20.193.28:0/148493718 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a4a871a640 con 0x55a4a8b50630 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7ba2ffd640 10 client.29218 handle_command_reply: tid=0 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 client.29218 shutdown 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 msgr2=0x55a4a8b4e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b4e400 secure :-1 s=READY pgs=358 gs=2 cs=0 l=1 c_cookie=12110128127577463397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7be410b000 tx=0x7f7be4030430 comp rx=0 tx=0).stop 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 shutdown_connections 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a4a8b50630 0x55a4a8b50ad0 crc :-1 s=READY pgs=319 gs=4 cs=0 l=0 c_cookie=1904207824675778025 s_cookie=17308376520589525362 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a8b4bde0 0x55a4a8b4dd50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a4a8b6c700 0x55a4a8b4e400 unknown :-1 s=CLOSED pgs=358 gs=2 cs=0 l=1 c_cookie=12110128127577463397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 --2- 10.20.193.28:0/148493718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a4a8b2b4c0 0x55a4a8b4d6d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7ba2ffd640 0 client.29218 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 >> 10.20.193.28:0/148493718 conn(0x55a4a8a4a1c0 msgr2=0x55a4a8b40e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 shutdown_connections 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 1 -- 10.20.193.28:0/148493718 wait complete. 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.686+0000 7f7bf1e80e00 20 client.29218 trim_cache size 0 max 16384 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:28:23.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 -- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bc40b5760 msgr2=0x7f7bc40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bc40b5760 0x7f7bc40d5c10 secure :-1 s=READY pgs=511 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd8005c70 tx=0x7f7bd8005f90 comp rx=0 tx=0).stop 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 -- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be810c030 msgr2=0x7f7be80f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be810c030 0x7f7be80f4410 secure :-1 s=READY pgs=1195 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7be40070b0 tx=0x7f7be4005290 comp rx=0 tx=0).stop 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 -- 10.20.193.28:0/1248407170 shutdown_connections 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7bc40b5760 0x7f7bc40d5c10 unknown :-1 s=CLOSED pgs=511 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7be810c030 0x7f7be80f4410 unknown :-1 s=CLOSED pgs=1195 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7be810b330 0x7f7be80f3810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 --2- 10.20.193.28:0/1248407170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7be810a980 0x7f7be80f31c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 -- 10.20.193.28:0/1248407170 >> 10.20.193.28:0/1248407170 conn(0x7f7be80e8640 msgr2=0x7f7be8109a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:23.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 -- 10.20.193.28:0/1248407170 shutdown_connections 2026-02-20T13:28:23.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:23.687+0000 7f7bee5d2640 1 -- 10.20.193.28:0/1248407170 wait complete. 2026-02-20T13:28:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:24 trial127 ceph-mon[43817]: pgmap v513: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:28:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:24 trial034 ceph-mon[43332]: pgmap v513: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:28:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:24 trial028 ceph-mon[37442]: pgmap v513: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:28:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:26 trial127 ceph-mon[43817]: pgmap v514: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 17 op/s 2026-02-20T13:28:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:26 trial034 ceph-mon[43332]: pgmap v514: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 17 op/s 2026-02-20T13:28:27.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:26 trial028 ceph-mon[37442]: pgmap v514: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 17 op/s 2026-02-20T13:28:28.026 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:28:28.216 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:28.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 -- 10.20.193.28:0/2455893720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f588010ffe0 msgr2=0x7f5880115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 --2- 10.20.193.28:0/2455893720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f588010ffe0 0x7f5880115030 secure :-1 s=READY pgs=1196 gs=1 cs=0 l=1 c_cookie=13656538298986447361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f586c009950 tx=0x7f586c02f190 comp rx=0 tx=0).stop 2026-02-20T13:28:28.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 -- 10.20.193.28:0/2455893720 shutdown_connections 2026-02-20T13:28:28.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 --2- 10.20.193.28:0/2455893720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f588010ffe0 0x7f5880115030 unknown :-1 s=CLOSED pgs=1196 gs=1 cs=0 l=1 c_cookie=13656538298986447361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 --2- 10.20.193.28:0/2455893720 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f58801157e0 0x7f58801761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 --2- 10.20.193.28:0/2455893720 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f588010f5f0 0x7f588010f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 -- 10.20.193.28:0/2455893720 >> 10.20.193.28:0/2455893720 conn(0x7f58800ecea0 msgr2=0x7f588010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 -- 10.20.193.28:0/2455893720 shutdown_connections 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.393+0000 7f5888999640 1 -- 10.20.193.28:0/2455893720 wait complete. 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5888999640 1 Processor -- start 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5888999640 1 -- start start 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5888999640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f588010f5f0 0x7f58800f4e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5888999640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f588010ffe0 0x7f58801760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5888999640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58801157e0 0x7f58800f5570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5888999640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58800fa780 con 0x7f58801157e0 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5888999640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f58800fa8f0 con 0x7f588010ffe0 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5888999640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f58800faab0 con 0x7f588010f5f0 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5886f0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58801157e0 0x7f58800f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5886f0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58801157e0 0x7f58800f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34696/0 (socket says 10.20.193.28:34696) 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5886f0f640 1 -- 10.20.193.28:0/618736142 learned_addr learned my addr 10.20.193.28:0/618736142 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f588670e640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f588010f5f0 0x7f58800f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.394+0000 7f5885f0d640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f588010ffe0 0x7f58801760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f5886f0f640 1 -- 10.20.193.28:0/618736142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f588010f5f0 msgr2=0x7f58800f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f5886f0f640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f588010f5f0 0x7f58800f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f5886f0f640 1 -- 10.20.193.28:0/618736142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f588010ffe0 msgr2=0x7f58801760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f5886f0f640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f588010ffe0 0x7f58801760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f5886f0f640 1 -- 10.20.193.28:0/618736142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c009570 con 0x7f58801157e0 2026-02-20T13:28:28.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f5886f0f640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58801157e0 0x7f58800f5570 secure :-1 s=READY pgs=1197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f587400b270 tx=0x7f587400de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:28.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f586b7fe640 1 -- 10.20.193.28:0/618736142 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5874008cf0 con 0x7f58801157e0 2026-02-20T13:28:28.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f586b7fe640 1 -- 10.20.193.28:0/618736142 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5874008e50 con 0x7f58801157e0 2026-02-20T13:28:28.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f586b7fe640 1 -- 10.20.193.28:0/618736142 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5874010740 con 0x7f58801157e0 2026-02-20T13:28:28.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f5888999640 1 -- 10.20.193.28:0/618736142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58800fad90 con 0x7f58801157e0 2026-02-20T13:28:28.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.395+0000 7f5888999640 1 -- 10.20.193.28:0/618736142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58800fb210 con 0x7f58801157e0 2026-02-20T13:28:28.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.398+0000 7f586b7fe640 1 -- 10.20.193.28:0/618736142 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5874003910 con 0x7f58801157e0 2026-02-20T13:28:28.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.399+0000 7f586b7fe640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f585c0b5760 0x7f585c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.399+0000 7f586b7fe640 1 -- 10.20.193.28:0/618736142 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f58740e7800 con 0x7f58801157e0 2026-02-20T13:28:28.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.400+0000 7f588670e640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f585c0b5760 0x7f585c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.400+0000 7f588670e640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f585c0b5760 0x7f585c0d5c10 secure :-1 s=READY pgs=512 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5878004740 tx=0x7f5878005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:28.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.400+0000 7f588a993e00 1 Processor -- start 2026-02-20T13:28:28.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.400+0000 7f588a993e00 1 -- start start 2026-02-20T13:28:28.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588a993e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73814550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588a993e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73859400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588a993e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73879d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588a993e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557f7372a7d0 con 0x557f73814180 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588a993e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557f73726500 con 0x557f73859940 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588a993e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557f737204a0 con 0x557f73814a90 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73814550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73814550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34710/0 (socket says 10.20.193.28:34710) 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 -- 10.20.193.28:0/2285227719 learned_addr learned my addr 10.20.193.28:0/2285227719 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f5886f0f640 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73879d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f5885f0d640 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73859400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 -- 10.20.193.28:0/2285227719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 msgr2=0x557f73859400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73859400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 -- 10.20.193.28:0/2285227719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 msgr2=0x557f73879d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73879d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 -- 10.20.193.28:0/2285227719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f736cbd80 con 0x557f73814180 2026-02-20T13:28:28.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f5885f0d640 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73859400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:28.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.401+0000 7f588670e640 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73814550 secure :-1 s=READY pgs=1198 gs=1 cs=0 l=1 c_cookie=7538873862543770566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5878005e30 tx=0x7f5878011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689f75d5d76603c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:28.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f5868cf3640 1 -- 10.20.193.28:0/2285227719 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5878004a70 con 0x557f73814180 2026-02-20T13:28:28.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f5868cf3640 1 -- 10.20.193.28:0/2285227719 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5878010e50 con 0x557f73814180 2026-02-20T13:28:28.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f5868cf3640 1 -- 10.20.193.28:0/2285227719 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f587801d740 con 0x557f73814180 2026-02-20T13:28:28.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 -- 10.20.193.28:0/2285227719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 msgr2=0x557f73814550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73814550 secure :-1 s=READY pgs=1198 gs=1 cs=0 l=1 c_cookie=7538873862543770566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5878005e30 tx=0x7f5878011000 comp rx=0 tx=0).stop 2026-02-20T13:28:28.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 -- 10.20.193.28:0/2285227719 shutdown_connections 2026-02-20T13:28:28.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73879d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73859400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 --2- 10.20.193.28:0/2285227719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73814550 unknown :-1 s=CLOSED pgs=1198 gs=1 cs=0 l=1 c_cookie=7538873862543770566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 -- 10.20.193.28:0/2285227719 >> 10.20.193.28:0/2285227719 conn(0x557f737f2680 msgr2=0x557f73812a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 -- 10.20.193.28:0/2285227719 shutdown_connections 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.402+0000 7f588a993e00 1 -- 10.20.193.28:0/2285227719 wait complete. 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.403+0000 7f588a993e00 1 -- start start 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.403+0000 7f588a993e00 1 Processor -- start 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588a993e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f7382c6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588a993e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f7382cc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588a993e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73831c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588a993e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557f73832150 con 0x557f73814180 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588a993e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557f738322c0 con 0x557f73859940 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588a993e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557f73832480 con 0x557f73814a90 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588670e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f7382c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f5885f0d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f7382cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588670e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f7382c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34724/0 (socket says 10.20.193.28:34724) 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588670e640 1 -- 10.20.193.28:0/843542775 learned_addr learned my addr 10.20.193.28:0/843542775 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f5886f0f640 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73831c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588670e640 1 -- 10.20.193.28:0/843542775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 msgr2=0x557f7382cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588670e640 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f7382cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588670e640 1 -- 10.20.193.28:0/843542775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 msgr2=0x557f73831c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:28.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588670e640 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73831c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.404+0000 7f588670e640 1 -- 10.20.193.28:0/843542775 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f736a4350 con 0x557f73814180 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.405+0000 7f5885f0d640 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f7382cc20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.405+0000 7f588670e640 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f7382c6e0 secure :-1 s=READY pgs=1199 gs=1 cs=0 l=1 c_cookie=64876493351719478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f587801d870 tx=0x7f5878004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67cd3b4809236 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.405+0000 7f5833fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.405+0000 7f5833fff640 1 -- 10.20.193.28:0/843542775 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f587801dd00 con 0x557f73814180 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.405+0000 7f5833fff640 1 -- 10.20.193.28:0/843542775 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5878004c10 con 0x557f73814180 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.405+0000 7f5833fff640 1 -- 10.20.193.28:0/843542775 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58780308f0 con 0x557f73814180 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.405+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587800eb10 con 0x557f73814180 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.405+0000 7f5833fff640 1 -- 10.20.193.28:0/843542775 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5878025400 con 0x557f73814180 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f5833fff640 10 client.19383 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 10 client.19383 _ll_register_callbacks cb 0x557f736a19a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:28.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f733b66f0 con 0x557f73814180 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f5833fff640 1 -- 10.20.193.28:0/843542775 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f587801de60 con 0x557f73814180 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 10 client.19383 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557f736b6150 con 0x557f73814180 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f5833fff640 1 -- 10.20.193.28:0/843542775 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f5878030b00 con 0x557f73814180 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 10 client.19383 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 10 client.19383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 20 client.19383 populate_metadata read hostname 'trial028' 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557f73856d40 0x557f738571e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 4 client.19383 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.406+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f7372dd60 con 0x557f73856d40 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.407+0000 7f5885f0d640 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557f73856d40 0x557f738571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.407+0000 7f5885f0d640 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557f73856d40 0x557f738571e0 crc :-1 s=READY pgs=320 gs=4 cs=0 l=0 c_cookie=11056261401547195063 s_cookie=1623417458877847947 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=996fbb2a871542b7 server_cookie=16878993de94d98b in_seq=0 out_seq=0 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.407+0000 7f5833fff640 10 client.19383 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f5833fff640 1 -- 10.20.193.28:0/843542775 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557f7372dd60 con 0x557f73856d40 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f5833fff640 10 client.19383 handle_command_reply: tid=0 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 client.19383 shutdown 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 msgr2=0x557f7382c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f7382c6e0 secure :-1 s=READY pgs=1199 gs=1 cs=0 l=1 c_cookie=64876493351719478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f587801d870 tx=0x7f5878004a20 comp rx=0 tx=0).stop 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 shutdown_connections 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557f73856d40 0x557f738571e0 crc :-1 s=READY pgs=320 gs=4 cs=0 l=0 c_cookie=11056261401547195063 s_cookie=1623417458877847947 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73831c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f7382cc20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 --2- 10.20.193.28:0/843542775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f7382c6e0 unknown :-1 s=CLOSED pgs=1199 gs=1 cs=0 l=1 c_cookie=64876493351719478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 >> 10.20.193.28:0/843542775 conn(0x557f737f2680 msgr2=0x557f73813250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:28.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f5833fff640 0 client.19383 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:28.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 shutdown_connections 2026-02-20T13:28:28.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 1 -- 10.20.193.28:0/843542775 wait complete. 2026-02-20T13:28:28.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.408+0000 7f588a993e00 20 client.19383 trim_cache size 0 max 16384 2026-02-20T13:28:28.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.417+0000 7f588a993e00 1 Processor -- start 2026-02-20T13:28:28.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.417+0000 7f588a993e00 1 -- start start 2026-02-20T13:28:28.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.417+0000 7f588a993e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73814180 0x557f7381e740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.417+0000 7f588a993e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814a90 0x557f73829b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.417+0000 7f588a993e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73859940 0x557f7382a070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.417+0000 7f588a993e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557f7371e0d0 con 0x557f73814a90 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.417+0000 7f588a993e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557f733de700 con 0x557f73814180 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.417+0000 7f588a993e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557f73825790 con 0x557f73859940 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814a90 0x557f73829b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814a90 0x557f73829b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34738/0 (socket says 10.20.193.28:34738) 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 -- 10.20.193.28:0/1049517183 learned_addr learned my addr 10.20.193.28:0/1049517183 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f588670e640 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73814180 0x557f7381e740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5886f0f640 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73859940 0x557f7382a070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 -- 10.20.193.28:0/1049517183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73859940 msgr2=0x557f7382a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73859940 0x557f7382a070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 -- 10.20.193.28:0/1049517183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73814180 msgr2=0x557f7381e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:28.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73814180 0x557f7381e740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 -- 10.20.193.28:0/1049517183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f7381a3d0 con 0x557f73814a90 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f5885f0d640 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814a90 0x557f73829b30 secure :-1 s=READY pgs=1200 gs=1 cs=0 l=1 c_cookie=15085950833218449638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f586c038820 tx=0x7f586c031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15c105aa0fe70e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f584e4e6640 1 -- 10.20.193.28:0/1049517183 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f586c0042e0 con 0x557f73814a90 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f584e4e6640 1 -- 10.20.193.28:0/1049517183 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f586c04c150 con 0x557f73814a90 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.418+0000 7f584e4e6640 1 -- 10.20.193.28:0/1049517183 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f586c038d30 con 0x557f73814a90 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 -- 10.20.193.28:0/1049517183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814a90 msgr2=0x557f73829b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814a90 0x557f73829b30 secure :-1 s=READY pgs=1200 gs=1 cs=0 l=1 c_cookie=15085950833218449638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f586c038820 tx=0x7f586c031040 comp rx=0 tx=0).stop 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 -- 10.20.193.28:0/1049517183 shutdown_connections 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814a90 0x557f73829b30 unknown :-1 s=CLOSED pgs=1200 gs=1 cs=0 l=1 c_cookie=15085950833218449638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73859940 0x557f7382a070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 --2- 10.20.193.28:0/1049517183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73814180 0x557f7381e740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 -- 10.20.193.28:0/1049517183 >> 10.20.193.28:0/1049517183 conn(0x557f737f2680 msgr2=0x557f73831260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:28.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 -- 10.20.193.28:0/1049517183 shutdown_connections 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 -- 10.20.193.28:0/1049517183 wait complete. 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 -- start start 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.419+0000 7f588a993e00 1 Processor -- start 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f588a993e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73838450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f588a993e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73838990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f588a993e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73832b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f588a993e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557f737f20c0 con 0x557f73814180 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f588a993e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557f738331e0 con 0x557f73859940 2026-02-20T13:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f588a993e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557f738333a0 con 0x557f73814a90 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f5885f0d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73838990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f5886f0f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73832b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f5885f0d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73838990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40456/0 (socket says 10.20.193.28:40456) 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f5885f0d640 1 -- 10.20.193.28:0/1452357627 learned_addr learned my addr 10.20.193.28:0/1452357627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.420+0000 7f588670e640 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73838450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5885f0d640 1 -- 10.20.193.28:0/1452357627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 msgr2=0x557f73832b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5885f0d640 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73832b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5885f0d640 1 -- 10.20.193.28:0/1452357627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 msgr2=0x557f73838450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5885f0d640 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73838450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5885f0d640 1 -- 10.20.193.28:0/1452357627 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f736b0bd0 con 0x557f73814a90 2026-02-20T13:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5886f0f640 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73832b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5885f0d640 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73838990 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=9113478374126881778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f586c009350 tx=0x7f586c005c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e79944bc6098bf2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5833fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5833fff640 1 -- 10.20.193.28:0/1452357627 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f586c038cb0 con 0x557f73814a90 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5833fff640 1 -- 10.20.193.28:0/1452357627 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f586c038e10 con 0x557f73814a90 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586c040040 con 0x557f73814a90 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5833fff640 1 -- 10.20.193.28:0/1452357627 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f586c04ccc0 con 0x557f73814a90 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f588a993e00 10 client.29230 _ll_register_callbacks cb 0x557f736a19a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f734784a0 con 0x557f73814a90 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5833fff640 1 -- 10.20.193.28:0/1452357627 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f586c046440 con 0x557f73814a90 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.421+0000 7f5833fff640 1 -- 10.20.193.28:0/1452357627 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f586c046640 con 0x557f73814a90 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588a993e00 10 client.29230 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557f736a4680 con 0x557f73814a90 2026-02-20T13:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f5833fff640 1 -- 10.20.193.28:0/1452357627 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f586c02f9f0 con 0x557f73814a90 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588a993e00 10 client.29230 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588a993e00 10 client.29230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588a993e00 20 client.29230 populate_metadata read hostname 'trial028' 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588a993e00 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557f73907690 0x557f73927b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588a993e00 4 client.29230 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5878010e50 con 0x557f73907690 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.422+0000 7f588670e640 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557f73907690 0x557f73927b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588670e640 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557f73907690 0x557f73927b10 crc :-1 s=READY pgs=321 gs=4 cs=0 l=0 c_cookie=15814504483906298496 s_cookie=2853670476813860664 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db78680a0e0ea280 server_cookie=279a462de4827f38 in_seq=0 out_seq=0 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f5833fff640 10 client.29230 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f5833fff640 1 -- 10.20.193.28:0/1452357627 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x7f5878010e50 con 0x557f73907690 2026-02-20T13:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f5833fff640 10 client.29230 handle_command_reply: tid=0 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 client.29230 shutdown 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 msgr2=0x557f73838990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73838990 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=9113478374126881778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f586c009350 tx=0x7f586c005c80 comp rx=0 tx=0).stop 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 shutdown_connections 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557f73907690 0x557f73927b10 crc :-1 s=READY pgs=321 gs=4 cs=0 l=0 c_cookie=15814504483906298496 s_cookie=2853670476813860664 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f73859940 0x557f73832b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f73814a90 0x557f73838990 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=9113478374126881778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 --2- 10.20.193.28:0/1452357627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f73814180 0x557f73838450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f5833fff640 0 client.29230 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 >> 10.20.193.28:0/1452357627 conn(0x557f737f2680 msgr2=0x557f7382f940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 shutdown_connections 2026-02-20T13:28:28.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.423+0000 7f588a993e00 1 -- 10.20.193.28:0/1452357627 wait complete. 2026-02-20T13:28:28.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f588a993e00 20 client.29230 trim_cache size 0 max 16384 2026-02-20T13:28:28.432 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:28:28.432 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:28:28.432 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:28:28.432 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.433 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.434 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.435 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.436 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:28:28.437 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.438 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.439 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.440 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.441 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.442 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.443 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:28.444 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 -- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f585c0b5760 msgr2=0x7f585c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f585c0b5760 0x7f585c0d5c10 secure :-1 s=READY pgs=512 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5878004740 tx=0x7f5878005f00 comp rx=0 tx=0).stop 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 -- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58801157e0 msgr2=0x7f58800f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58801157e0 0x7f58800f5570 secure :-1 s=READY pgs=1197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f587400b270 tx=0x7f587400de70 comp rx=0 tx=0).stop 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 -- 10.20.193.28:0/618736142 shutdown_connections 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f585c0b5760 0x7f585c0d5c10 unknown :-1 s=CLOSED pgs=512 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58801157e0 0x7f58800f5570 unknown :-1 s=CLOSED pgs=1197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f588010ffe0 0x7f58801760b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 --2- 10.20.193.28:0/618736142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f588010f5f0 0x7f58800f4e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.424+0000 7f5888999640 1 -- 10.20.193.28:0/618736142 >> 10.20.193.28:0/618736142 conn(0x7f58800ecea0 msgr2=0x7f588010db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.425+0000 7f5888999640 1 -- 10.20.193.28:0/618736142 shutdown_connections 2026-02-20T13:28:28.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.425+0000 7f5888999640 1 -- 10.20.193.28:0/618736142 wait complete. 2026-02-20T13:28:28.526 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:28:28.526 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:28:28.717 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:28.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 -- 10.20.193.28:0/2815794024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd00614f0 msgr2=0x7f8bd0061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 --2- 10.20.193.28:0/2815794024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd00614f0 0x7f8bd0061920 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=14096719116261444578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bb8009950 tx=0x7f8bb802f190 comp rx=0 tx=0).stop 2026-02-20T13:28:28.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 -- 10.20.193.28:0/2815794024 shutdown_connections 2026-02-20T13:28:28.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 --2- 10.20.193.28:0/2815794024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bd0159d80 0x7f8bd017a160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 --2- 10.20.193.28:0/2815794024 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd00614f0 0x7f8bd0061920 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=14096719116261444578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 --2- 10.20.193.28:0/2815794024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8bd0062ae0 0x7f8bd0060fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 -- 10.20.193.28:0/2815794024 >> 10.20.193.28:0/2815794024 conn(0x7f8bd00eab00 msgr2=0x7f8bd010af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:28.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 -- 10.20.193.28:0/2815794024 shutdown_connections 2026-02-20T13:28:28.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 -- 10.20.193.28:0/2815794024 wait complete. 2026-02-20T13:28:28.910 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:28 trial028 ceph-mon[37442]: pgmap v515: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:28:28.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.906+0000 7f8bd5ea0640 1 Processor -- start 2026-02-20T13:28:28.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd5ea0640 1 -- start start 2026-02-20T13:28:28.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd5ea0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bd00614f0 0x7f8bd00f2e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd5ea0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8bd0062ae0 0x7f8bd00f33b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd5ea0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd0159d80 0x7f8bd00f8780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd5ea0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd00f8da0 con 0x7f8bd00614f0 2026-02-20T13:28:28.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd5ea0640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd00f8f10 con 0x7f8bd0159d80 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd5ea0640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd00f90d0 con 0x7f8bd0062ae0 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd569f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd0159d80 0x7f8bd00f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd569f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd0159d80 0x7f8bd00f8780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39342/0 (socket says 10.20.193.28:39342) 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd569f640 1 -- 10.20.193.28:0/918501485 learned_addr learned my addr 10.20.193.28:0/918501485 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd4e9e640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bd00614f0 0x7f8bd00f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bc7fff640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8bd0062ae0 0x7f8bd00f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd569f640 1 -- 10.20.193.28:0/918501485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8bd0062ae0 msgr2=0x7f8bd00f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd569f640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8bd0062ae0 0x7f8bd00f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd569f640 1 -- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bd00614f0 msgr2=0x7f8bd00f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:28.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd569f640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bd00614f0 0x7f8bd00f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:28.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.907+0000 7f8bd569f640 1 -- 10.20.193.28:0/918501485 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb8009570 con 0x7f8bd0159d80 2026-02-20T13:28:28.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.908+0000 7f8bd569f640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd0159d80 0x7f8bd00f8780 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bcc00f8d0 tx=0x7f8bcc00fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:28.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.908+0000 7f8bc5ffb640 1 -- 10.20.193.28:0/918501485 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bcc00dce0 con 0x7f8bd0159d80 2026-02-20T13:28:28.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.908+0000 7f8bc5ffb640 1 -- 10.20.193.28:0/918501485 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8bcc00de40 con 0x7f8bd0159d80 2026-02-20T13:28:28.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.908+0000 7f8bc5ffb640 1 -- 10.20.193.28:0/918501485 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bcc0116b0 con 0x7f8bd0159d80 2026-02-20T13:28:28.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.908+0000 7f8bd5ea0640 1 -- 10.20.193.28:0/918501485 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd00f93b0 con 0x7f8bd0159d80 2026-02-20T13:28:28.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.908+0000 7f8bd5ea0640 1 -- 10.20.193.28:0/918501485 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd00f9a90 con 0x7f8bd0159d80 2026-02-20T13:28:28.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.909+0000 7f8b9f7fe640 1 -- 10.20.193.28:0/918501485 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd00f95d0 con 0x7f8bd0159d80 2026-02-20T13:28:28.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.911+0000 7f8bc5ffb640 1 -- 10.20.193.28:0/918501485 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8bcc020060 con 0x7f8bd0159d80 2026-02-20T13:28:28.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.912+0000 7f8bc5ffb640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8bac0b5760 0x7f8bac0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:28.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.912+0000 7f8bc5ffb640 1 -- 10.20.193.28:0/918501485 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8bcc015070 con 0x7f8bd0159d80 2026-02-20T13:28:28.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.913+0000 7f8bd4e9e640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8bac0b5760 0x7f8bac0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:28.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.913+0000 7f8bc5ffb640 1 -- 10.20.193.28:0/918501485 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8bcc120730 con 0x7f8bd0159d80 2026-02-20T13:28:28.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:28.913+0000 7f8bd4e9e640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8bac0b5760 0x7f8bac0d5c10 secure :-1 s=READY pgs=513 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bc0004740 tx=0x7f8bc0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:28 trial127 ceph-mon[43817]: pgmap v515: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:28:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:28 trial034 ceph-mon[43332]: pgmap v515: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:28:29.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.065+0000 7f8b9f7fe640 1 -- 10.20.193.28:0/918501485 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bd0060f60 con 0x7f8bd0159d80 2026-02-20T13:28:29.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.066+0000 7f8bc5ffb640 1 -- 10.20.193.28:0/918501485 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11997 (secure 0 0 0) 0x7f8bcc0aa710 con 0x7f8bd0159d80 2026-02-20T13:28:29.069 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:28:29.069 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T13:28:03:632229+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:28:03.346734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[3],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:28:29.070 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T13:28:29.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.067+0000 7f8b9f7fe640 1 -- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8bac0b5760 msgr2=0x7f8bac0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.067+0000 7f8b9f7fe640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8bac0b5760 0x7f8bac0d5c10 secure :-1 s=READY pgs=513 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bc0004740 tx=0x7f8bc0005f90 comp rx=0 tx=0).stop 2026-02-20T13:28:29.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.067+0000 7f8b9f7fe640 1 -- 10.20.193.28:0/918501485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd0159d80 msgr2=0x7f8bd00f8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.067+0000 7f8b9f7fe640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd0159d80 0x7f8bd00f8780 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bcc00f8d0 tx=0x7f8bcc00fda0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.068+0000 7f8b9f7fe640 1 -- 10.20.193.28:0/918501485 shutdown_connections 2026-02-20T13:28:29.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.068+0000 7f8b9f7fe640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8bac0b5760 0x7f8bac0d5c10 unknown :-1 s=CLOSED pgs=513 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.068+0000 7f8b9f7fe640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8bd0159d80 0x7f8bd00f8780 unknown :-1 s=CLOSED pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.068+0000 7f8b9f7fe640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8bd0062ae0 0x7f8bd00f33b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.068+0000 7f8b9f7fe640 1 --2- 10.20.193.28:0/918501485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bd00614f0 0x7f8bd00f2e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.068+0000 7f8b9f7fe640 1 -- 10.20.193.28:0/918501485 >> 10.20.193.28:0/918501485 conn(0x7f8bd00eab00 msgr2=0x7f8bd010fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:29.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.068+0000 7f8b9f7fe640 1 -- 10.20.193.28:0/918501485 shutdown_connections 2026-02-20T13:28:29.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.068+0000 7f8b9f7fe640 1 -- 10.20.193.28:0/918501485 wait complete. 2026-02-20T13:28:29.169 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:28:29.352 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:29.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/2207256360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 msgr2=0x7f8e68061320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/2207256360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 0x7f8e68061320 secure :-1 s=READY pgs=1201 gs=1 cs=0 l=1 c_cookie=766812814380701115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e58009950 tx=0x7f8e5802f190 comp rx=0 tx=0).stop 2026-02-20T13:28:29.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/2207256360 shutdown_connections 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/2207256360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e68155960 0x7f8e68175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/2207256360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e68061860 0x7f8e68155420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/2207256360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 0x7f8e68061320 unknown :-1 s=CLOSED pgs=1201 gs=1 cs=0 l=1 c_cookie=766812814380701115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/2207256360 >> 10.20.193.28:0/2207256360 conn(0x7f8e680eaad0 msgr2=0x7f8e6810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/2207256360 shutdown_connections 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.518+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/2207256360 wait complete. 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6e8ba640 1 Processor -- start 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6e8ba640 1 -- start start 2026-02-20T13:28:29.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6e8ba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 0x7f8e681620b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6e8ba640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e68061860 0x7f8e681625f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6e8ba640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e68155960 0x7f8e681679c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6e8ba640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68167fe0 con 0x7f8e68060f50 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6e8ba640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68168150 con 0x7f8e68061860 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6e8ba640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68168310 con 0x7f8e68155960 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e68061860 0x7f8e681625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6d8b8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 0x7f8e681620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e68061860 0x7f8e681625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39364/0 (socket says 10.20.193.28:39364) 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.519+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/1569287473 learned_addr learned my addr 10.20.193.28:0/1569287473 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:29.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6e0b9640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e68155960 0x7f8e681679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/1569287473 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e68155960 msgr2=0x7f8e681679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e68155960 0x7f8e681679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/1569287473 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e68061860 msgr2=0x7f8e681625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e68061860 0x7f8e681625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/1569287473 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e58009570 con 0x7f8e68060f50 2026-02-20T13:28:29.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 0x7f8e681620b0 secure :-1 s=READY pgs=1202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e5802f6a0 tx=0x7f8e58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:29.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e56ffd640 1 -- 10.20.193.28:0/1569287473 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e5803d070 con 0x7f8e68060f50 2026-02-20T13:28:29.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e56ffd640 1 -- 10.20.193.28:0/1569287473 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e58002ad0 con 0x7f8e68060f50 2026-02-20T13:28:29.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/1569287473 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e68168590 con 0x7f8e68060f50 2026-02-20T13:28:29.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e56ffd640 1 -- 10.20.193.28:0/1569287473 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e580418a0 con 0x7f8e68060f50 2026-02-20T13:28:29.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.520+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/1569287473 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e68151580 con 0x7f8e68060f50 2026-02-20T13:28:29.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.523+0000 7f8e56ffd640 1 -- 10.20.193.28:0/1569287473 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8e58038b40 con 0x7f8e68060f50 2026-02-20T13:28:29.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.525+0000 7f8e56ffd640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e440b5760 0x7f8e440d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.525+0000 7f8e56ffd640 1 -- 10.20.193.28:0/1569287473 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8e5810af50 con 0x7f8e68060f50 2026-02-20T13:28:29.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.525+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e440b5760 0x7f8e440d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.525+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e440b5760 0x7f8e440d5c10 secure :-1 s=READY pgs=514 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e68168a50 tx=0x7f8e5c00b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:29.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.526+0000 7f8e71b3de00 1 Processor -- start 2026-02-20T13:28:29.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e71b3de00 1 -- start start 2026-02-20T13:28:29.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0add3730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae185e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae38f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ace9780 con 0x55ae0add3360 2026-02-20T13:28:29.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ace54b0 con 0x55ae0add3c70 2026-02-20T13:28:29.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ae0acdf450 con 0x55ae0ae18b20 2026-02-20T13:28:29.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d8b8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0add3730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae185e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39368/0 (socket says 10.20.193.28:39368) 2026-02-20T13:28:29.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/541094197 learned_addr learned my addr 10.20.193.28:0/541094197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:29.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6e0b9640 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae38f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/541094197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 msgr2=0x55ae0ae38f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:29.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae38f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/541094197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 msgr2=0x55ae0ae185e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae185e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/541094197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ac8ad10 con 0x55ae0add3360 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6e0b9640 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae38f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.527+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0add3730 secure :-1 s=READY pgs=1203 gs=1 cs=0 l=1 c_cookie=3736761086219647448 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e58108a20 tx=0x7f8e580047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dba468e29ff9d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e364e6640 1 -- 10.20.193.28:0/541094197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e580d6fd0 con 0x55ae0add3360 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e364e6640 1 -- 10.20.193.28:0/541094197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e580d95b0 con 0x55ae0add3360 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e364e6640 1 -- 10.20.193.28:0/541094197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e580cf5a0 con 0x55ae0add3360 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 -- 10.20.193.28:0/541094197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 msgr2=0x55ae0add3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0add3730 secure :-1 s=READY pgs=1203 gs=1 cs=0 l=1 c_cookie=3736761086219647448 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e58108a20 tx=0x7f8e580047b0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 -- 10.20.193.28:0/541094197 shutdown_connections 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae38f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae185e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/541094197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0add3730 unknown :-1 s=CLOSED pgs=1203 gs=1 cs=0 l=1 c_cookie=3736761086219647448 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 -- 10.20.193.28:0/541094197 >> 10.20.193.28:0/541094197 conn(0x55ae0adb1860 msgr2=0x55ae0add1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:29.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 -- 10.20.193.28:0/541094197 shutdown_connections 2026-02-20T13:28:29.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.528+0000 7f8e71b3de00 1 -- 10.20.193.28:0/541094197 wait complete. 2026-02-20T13:28:29.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.529+0000 7f8e71b3de00 1 -- start start 2026-02-20T13:28:29.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.529+0000 7f8e71b3de00 1 Processor -- start 2026-02-20T13:28:29.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0ae30730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae30c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae32a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ae32f70 con 0x55ae0add3360 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ae330e0 con 0x55ae0add3c70 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ae332a0 con 0x55ae0ae18b20 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae30c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d8b8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0ae30730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae30c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39380/0 (socket says 10.20.193.28:39380) 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/121772514 learned_addr learned my addr 10.20.193.28:0/121772514 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6e0b9640 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae32a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/121772514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 msgr2=0x55ae0ae32a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae32a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/121772514 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 msgr2=0x55ae0ae30c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae30c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d8b8640 1 -- 10.20.193.28:0/121772514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ac633c0 con 0x55ae0add3360 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae30c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0ae30730 secure :-1 s=READY pgs=1204 gs=1 cs=0 l=1 c_cookie=5436277628854729823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e58032040 tx=0x7f8e580dc210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7189b36849fc5f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e237fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.530+0000 7f8e237fe640 1 -- 10.20.193.28:0/121772514 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e580d6fd0 con 0x55ae0add3360 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e237fe640 1 -- 10.20.193.28:0/121772514 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e580dc3f0 con 0x55ae0add3360 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e237fe640 1 -- 10.20.193.28:0/121772514 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e580cbe40 con 0x55ae0add3360 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e68151580 con 0x55ae0add3360 2026-02-20T13:28:29.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e237fe640 1 -- 10.20.193.28:0/121772514 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8e580d0650 con 0x55ae0add3360 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e237fe640 10 client.19407 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 10 client.19407 _ll_register_callbacks cb 0x55ae0ac60a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ae0a9756f0 con 0x55ae0add3360 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e237fe640 1 -- 10.20.193.28:0/121772514 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e58038920 con 0x55ae0add3360 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 10 client.19407 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ae0ac750e0 con 0x55ae0add3360 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e237fe640 1 -- 10.20.193.28:0/121772514 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8e580f0060 con 0x55ae0add3360 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 10 client.19407 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 10 client.19407 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 20 client.19407 populate_metadata read hostname 'trial028' 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55ae0ae159f0 0x55ae0ae15e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 4 client.19407 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:29.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.531+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae0ac81f80 con 0x55ae0ae159f0 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.532+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55ae0ae159f0 0x55ae0ae15e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.532+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55ae0ae159f0 0x55ae0ae15e60 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=2907342496073869892 s_cookie=14014789777081522971 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2858f498aee16a44 server_cookie=c27e890c78b85b1b in_seq=0 out_seq=0 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.532+0000 7f8e237fe640 10 client.19407 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e237fe640 1 -- 10.20.193.28:0/121772514 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ae0ac81f80 con 0x55ae0ae159f0 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e237fe640 10 client.19407 handle_command_reply: tid=0 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 client.19407 shutdown 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 msgr2=0x55ae0ae30730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0ae30730 secure :-1 s=READY pgs=1204 gs=1 cs=0 l=1 c_cookie=5436277628854729823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e58032040 tx=0x7f8e580dc210 comp rx=0 tx=0).stop 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 shutdown_connections 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55ae0ae159f0 0x55ae0ae15e60 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=2907342496073869892 s_cookie=14014789777081522971 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0ae18b20 0x55ae0ae32a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0add3c70 0x55ae0ae30c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/121772514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3360 0x55ae0ae30730 unknown :-1 s=CLOSED pgs=1204 gs=1 cs=0 l=1 c_cookie=5436277628854729823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 >> 10.20.193.28:0/121772514 conn(0x55ae0adb1860 msgr2=0x55ae0add1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:29.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e237fe640 0 client.19407 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:28:29.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 shutdown_connections 2026-02-20T13:28:29.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 1 -- 10.20.193.28:0/121772514 wait complete. 2026-02-20T13:28:29.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.533+0000 7f8e71b3de00 20 client.19407 trim_cache size 0 max 16384 2026-02-20T13:28:29.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e71b3de00 1 Processor -- start 2026-02-20T13:28:29.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e71b3de00 1 -- start start 2026-02-20T13:28:29.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 0x55ae0ae32990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae36230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 0x55ae0ae2d8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ae0acdd080 con 0x55ae0add3c70 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ae0a99d700 con 0x55ae0ae18b20 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ae295a0 con 0x55ae0add3360 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae36230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae36230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34806/0 (socket says 10.20.193.28:34806) 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.540+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/733128073 learned_addr learned my addr 10.20.193.28:0/733128073 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e6e0b9640 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 0x55ae0ae2d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 0x55ae0ae32990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/733128073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 msgr2=0x55ae0ae32990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 0x55ae0ae32990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/733128073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 msgr2=0x55ae0ae2d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:29.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 0x55ae0ae2d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/733128073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ac6fb60 con 0x55ae0add3c70 2026-02-20T13:28:29.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae36230 secure :-1 s=READY pgs=1205 gs=1 cs=0 l=1 c_cookie=2490363529247067093 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e5c010fe0 tx=0x7f8e5c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228f8c6f725c0bd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:29.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e35ce5640 1 -- 10.20.193.28:0/733128073 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e5c024050 con 0x55ae0add3c70 2026-02-20T13:28:29.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e35ce5640 1 -- 10.20.193.28:0/733128073 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e5c025040 con 0x55ae0add3c70 2026-02-20T13:28:29.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e35ce5640 1 -- 10.20.193.28:0/733128073 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e5c02a320 con 0x55ae0add3c70 2026-02-20T13:28:29.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e71b3de00 1 -- 10.20.193.28:0/733128073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 msgr2=0x55ae0ae36230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.541+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae36230 secure :-1 s=READY pgs=1205 gs=1 cs=0 l=1 c_cookie=2490363529247067093 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e5c010fe0 tx=0x7f8e5c013000 comp rx=0 tx=0).stop 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 -- 10.20.193.28:0/733128073 shutdown_connections 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae36230 unknown :-1 s=CLOSED pgs=1205 gs=1 cs=0 l=1 c_cookie=2490363529247067093 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 0x55ae0ae2d8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/733128073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 0x55ae0ae32990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 -- 10.20.193.28:0/733128073 >> 10.20.193.28:0/733128073 conn(0x55ae0adb1860 msgr2=0x55ae0ae35b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 -- 10.20.193.28:0/733128073 shutdown_connections 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 -- 10.20.193.28:0/733128073 wait complete. 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 -- start start 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 Processor -- start 2026-02-20T13:28:29.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 0x55ae0ae13df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.542+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae35e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e71b3de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 0x55ae0ae36360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ace54b0 con 0x55ae0add3c70 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ad41ae0 con 0x55ae0ae18b20 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e71b3de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ae36b10 con 0x55ae0add3360 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae35e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6e0b9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 0x55ae0ae36360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae35e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34816/0 (socket says 10.20.193.28:34816) 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/120221836 learned_addr learned my addr 10.20.193.28:0/120221836 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 0x55ae0ae13df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/120221836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 msgr2=0x55ae0ae13df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:29.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 0x55ae0ae13df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/120221836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 msgr2=0x55ae0ae36360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 0x55ae0ae36360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 -- 10.20.193.28:0/120221836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ac75340 con 0x55ae0add3c70 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e6d0b7640 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae35e20 secure :-1 s=READY pgs=1206 gs=2 cs=0 l=1 c_cookie=17150711201323980279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e5c02a410 tx=0x7f8e5c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0390f8203a95f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.543+0000 7f8e237fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e237fe640 1 -- 10.20.193.28:0/120221836 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e5c0038d0 con 0x55ae0add3c70 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e237fe640 1 -- 10.20.193.28:0/120221836 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e5c015070 con 0x55ae0add3c70 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e237fe640 1 -- 10.20.193.28:0/120221836 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e5c02acf0 con 0x55ae0add3c70 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0ac636f0 con 0x55ae0add3c70 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 10 client.19413 _ll_register_callbacks cb 0x55ae0ac60a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e580d95b0 con 0x55ae0add3c70 2026-02-20T13:28:29.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e237fe640 1 -- 10.20.193.28:0/120221836 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8e5c017070 con 0x55ae0add3c70 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e237fe640 1 -- 10.20.193.28:0/120221836 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e5c02aea0 con 0x55ae0add3c70 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 10 client.19413 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ae0adb6200 con 0x55ae0add3c70 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e237fe640 1 -- 10.20.193.28:0/120221836 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8e5c02a4f0 con 0x55ae0add3c70 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 10 client.19413 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 10 client.19413 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 20 client.19413 populate_metadata read hostname 'trial028' 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55ae0adb6890 0x55ae0adb6d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 4 client.19413 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.544+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae0a972f40 con 0x55ae0adb6890 2026-02-20T13:28:29.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55ae0adb6890 0x55ae0adb6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e6d8b8640 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55ae0adb6890 0x55ae0adb6d30 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=8363407829763869028 s_cookie=4598861510796426256 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7410cb1c24cbc964 server_cookie=3fd2702da23cbc10 in_seq=0 out_seq=0 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e237fe640 10 client.19413 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e237fe640 1 -- 10.20.193.28:0/120221836 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae0a972f40 con 0x55ae0adb6890 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e237fe640 10 client.19413 handle_command_reply: tid=0 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e71b3de00 1 client.19413 shutdown 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 msgr2=0x55ae0ae35e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae35e20 secure :-1 s=READY pgs=1206 gs=2 cs=0 l=1 c_cookie=17150711201323980279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e5c02a410 tx=0x7f8e5c00bf30 comp rx=0 tx=0).stop 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 shutdown_connections 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.545+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55ae0adb6890 0x55ae0adb6d30 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=8363407829763869028 s_cookie=4598861510796426256 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae0add3c70 0x55ae0ae35e20 unknown :-1 s=CLOSED pgs=1206 gs=2 cs=0 l=1 c_cookie=17150711201323980279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ae0ae18b20 0x55ae0ae36360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e71b3de00 1 --2- 10.20.193.28:0/120221836 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ae0add3360 0x55ae0ae13df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 >> 10.20.193.28:0/120221836 conn(0x55ae0adb1860 msgr2=0x55ae0add2050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:29.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e237fe640 0 client.19413 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:28:29.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 shutdown_connections 2026-02-20T13:28:29.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e71b3de00 1 -- 10.20.193.28:0/120221836 wait complete. 2026-02-20T13:28:29.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e71b3de00 20 client.19413 trim_cache size 0 max 16384 2026-02-20T13:28:29.554 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:28:29.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e440b5760 msgr2=0x7f8e440d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e440b5760 0x7f8e440d5c10 secure :-1 s=READY pgs=514 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e68168a50 tx=0x7f8e5c00b4a0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 msgr2=0x7f8e681620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:29.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 0x7f8e681620b0 secure :-1 s=READY pgs=1202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e5802f6a0 tx=0x7f8e58004270 comp rx=0 tx=0).stop 2026-02-20T13:28:29.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/1569287473 shutdown_connections 2026-02-20T13:28:29.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8e440b5760 0x7f8e440d5c10 unknown :-1 s=CLOSED pgs=514 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e68155960 0x7f8e681679c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e68061860 0x7f8e681625f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 --2- 10.20.193.28:0/1569287473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e68060f50 0x7f8e681620b0 unknown :-1 s=CLOSED pgs=1202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:29.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/1569287473 >> 10.20.193.28:0/1569287473 conn(0x7f8e680eaad0 msgr2=0x7f8e6810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:29.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/1569287473 shutdown_connections 2026-02-20T13:28:29.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:29.546+0000 7f8e6e8ba640 1 -- 10.20.193.28:0/1569287473 wait complete. 2026-02-20T13:28:29.646 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:28:29.694 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:29 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/918501485' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:28:29.829 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:29.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:29 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/918501485' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:28:29.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:29 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/918501485' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:28:30.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 -- 10.20.193.28:0/3143004652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac1157e0 msgr2=0x7f64ac1761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 --2- 10.20.193.28:0/3143004652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac1157e0 0x7f64ac1761b0 secure :-1 s=READY pgs=1207 gs=2 cs=0 l=1 c_cookie=2426307965188584056 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a800aa30 tx=0x7f64a8030280 comp rx=0 tx=0).stop 2026-02-20T13:28:30.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 -- 10.20.193.28:0/3143004652 shutdown_connections 2026-02-20T13:28:30.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 --2- 10.20.193.28:0/3143004652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac1157e0 0x7f64ac1761b0 unknown :-1 s=CLOSED pgs=1207 gs=2 cs=0 l=1 c_cookie=2426307965188584056 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 --2- 10.20.193.28:0/3143004652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f64ac10ffe0 0x7f64ac115030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 --2- 10.20.193.28:0/3143004652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f64ac10f5f0 0x7f64ac10f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 -- 10.20.193.28:0/3143004652 >> 10.20.193.28:0/3143004652 conn(0x7f64ac0ecea0 msgr2=0x7f64ac10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 -- 10.20.193.28:0/3143004652 shutdown_connections 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.016+0000 7f64b45bb640 1 -- 10.20.193.28:0/3143004652 wait complete. 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.017+0000 7f64b45bb640 1 Processor -- start 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.017+0000 7f64b45bb640 1 -- start start 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.017+0000 7f64b45bb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f64ac10f5f0 0x7f64ac11d510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.017+0000 7f64b45bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac10ffe0 0x7f64ac11da50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.017+0000 7f64b45bb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f64ac1157e0 0x7f64ac122e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.017+0000 7f64b45bb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac123440 con 0x7f64ac10ffe0 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.017+0000 7f64b45bb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac1235b0 con 0x7f64ac10f5f0 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.017+0000 7f64b45bb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac123770 con 0x7f64ac1157e0 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac10ffe0 0x7f64ac11da50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac10ffe0 0x7f64ac11da50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50430/0 (socket says 10.20.193.28:50430) 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 -- 10.20.193.28:0/860858445 learned_addr learned my addr 10.20.193.28:0/860858445 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b2330640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f64ac10f5f0 0x7f64ac11d510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 -- 10.20.193.28:0/860858445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f64ac1157e0 msgr2=0x7f64ac122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f64ac1157e0 0x7f64ac122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 -- 10.20.193.28:0/860858445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f64ac10f5f0 msgr2=0x7f64ac11d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f64ac10f5f0 0x7f64ac11d510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 -- 10.20.193.28:0/860858445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c0094b0 con 0x7f64ac10ffe0 2026-02-20T13:28:30.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b1b2f640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac10ffe0 0x7f64ac11da50 secure :-1 s=READY pgs=1208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a0009480 tx=0x7f64a000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64937fe640 1 -- 10.20.193.28:0/860858445 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a000cd40 con 0x7f64ac10ffe0 2026-02-20T13:28:30.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64937fe640 1 -- 10.20.193.28:0/860858445 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f64a0004d30 con 0x7f64ac10ffe0 2026-02-20T13:28:30.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64937fe640 1 -- 10.20.193.28:0/860858445 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a0010740 con 0x7f64ac10ffe0 2026-02-20T13:28:30.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b45bb640 1 -- 10.20.193.28:0/860858445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a800a650 con 0x7f64ac10ffe0 2026-02-20T13:28:30.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.018+0000 7f64b45bb640 1 -- 10.20.193.28:0/860858445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac163fb0 con 0x7f64ac10ffe0 2026-02-20T13:28:30.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.021+0000 7f64937fe640 1 -- 10.20.193.28:0/860858445 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f64a001f060 con 0x7f64ac10ffe0 2026-02-20T13:28:30.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.023+0000 7f64937fe640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64880b5760 0x7f64880d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.023+0000 7f64937fe640 1 -- 10.20.193.28:0/860858445 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f64a0014070 con 0x7f64ac10ffe0 2026-02-20T13:28:30.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.023+0000 7f64b2330640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64880b5760 0x7f64880d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b2330640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64880b5760 0x7f64880d5c10 secure :-1 s=READY pgs=515 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f649c004740 tx=0x7f649c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b65b5e00 1 Processor -- start 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b65b5e00 1 -- start start 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0bb730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 0x5646fc1005e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc120f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646fbfd1780 con 0x5646fc100b20 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646fbfcd4b0 con 0x5646fc0bb360 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.024+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646fbfc7450 con 0x5646fc0bbc70 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc120f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50440/0 (socket says 10.20.193.28:50440) 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 -- 10.20.193.28:0/3485912171 learned_addr learned my addr 10.20.193.28:0/3485912171 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b1b2f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 0x5646fc1005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2330640 1 --2- 10.20.193.28:0/3485912171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0bb730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 -- 10.20.193.28:0/3485912171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 msgr2=0x5646fc1005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 --2- 10.20.193.28:0/3485912171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 0x5646fc1005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 -- 10.20.193.28:0/3485912171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 msgr2=0x5646fc0bb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 --2- 10.20.193.28:0/3485912171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0bb730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 -- 10.20.193.28:0/3485912171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646fbf72d10 con 0x5646fc100b20 2026-02-20T13:28:30.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f64b2b31640 1 --2- 10.20.193.28:0/3485912171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc120f00 secure :-1 s=READY pgs=1209 gs=2 cs=0 l=1 c_cookie=17924401201220795085 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a800a980 tx=0x7f64a8005860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c043ecca59bacd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f6490b0a640 1 -- 10.20.193.28:0/3485912171 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a803e070 con 0x5646fc100b20 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f6490b0a640 1 -- 10.20.193.28:0/3485912171 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f64a8030ae0 con 0x5646fc100b20 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.025+0000 7f6490b0a640 1 -- 10.20.193.28:0/3485912171 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a80050c0 con 0x5646fc100b20 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 -- 10.20.193.28:0/3485912171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 msgr2=0x5646fc120f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/3485912171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc120f00 secure :-1 s=READY pgs=1209 gs=2 cs=0 l=1 c_cookie=17924401201220795085 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a800a980 tx=0x7f64a8005860 comp rx=0 tx=0).stop 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 -- 10.20.193.28:0/3485912171 shutdown_connections 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/3485912171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc120f00 unknown :-1 s=CLOSED pgs=1209 gs=2 cs=0 l=1 c_cookie=17924401201220795085 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/3485912171 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 0x5646fc1005e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/3485912171 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0bb730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 -- 10.20.193.28:0/3485912171 >> 10.20.193.28:0/3485912171 conn(0x5646fc099860 msgr2=0x5646fc0b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 -- 10.20.193.28:0/3485912171 shutdown_connections 2026-02-20T13:28:30.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.026+0000 7f64b65b5e00 1 -- 10.20.193.28:0/3485912171 wait complete. 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.027+0000 7f64b65b5e00 1 -- start start 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.027+0000 7f64b65b5e00 1 Processor -- start 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.027+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 0x5646fc118750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.027+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc0bbc70 0x5646fc118c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.027+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc100b20 0x5646fc11aa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.027+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646fc11af90 con 0x5646fc0bbc70 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.027+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646fc11b100 con 0x5646fc100b20 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.027+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646fc11b2c0 con 0x5646fc0bb360 2026-02-20T13:28:30.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc0bbc70 0x5646fc118c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc0bbc70 0x5646fc118c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50448/0 (socket says 10.20.193.28:50448) 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 -- 10.20.193.28:0/192460650 learned_addr learned my addr 10.20.193.28:0/192460650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b2330640 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 0x5646fc118750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b2b31640 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc100b20 0x5646fc11aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 -- 10.20.193.28:0/192460650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 msgr2=0x5646fc118750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 0x5646fc118750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 -- 10.20.193.28:0/192460650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc100b20 msgr2=0x5646fc11aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc100b20 0x5646fc11aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 -- 10.20.193.28:0/192460650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646fbf4b3c0 con 0x5646fc0bbc70 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b1b2f640 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc0bbc70 0x5646fc118c90 secure :-1 s=READY pgs=1210 gs=1 cs=0 l=1 c_cookie=13585349636077833916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a00aa3d0 tx=0x7f64a00ad210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc88db8407e6cebc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f645ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f645ffff640 1 -- 10.20.193.28:0/192460650 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a00ae010 con 0x5646fc0bbc70 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f645ffff640 1 -- 10.20.193.28:0/192460650 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f64a00adb60 con 0x5646fc0bbc70 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac176a20 con 0x5646fc0bbc70 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f645ffff640 1 -- 10.20.193.28:0/192460650 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a00722f0 con 0x5646fc0bbc70 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.028+0000 7f645ffff640 1 -- 10.20.193.28:0/192460650 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f64a0072450 con 0x5646fc0bbc70 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f645ffff640 10 client.19425 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 10 client.19425 _ll_register_callbacks cb 0x5646fbf48a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5646fbc5d6f0 con 0x5646fc0bbc70 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f645ffff640 1 -- 10.20.193.28:0/192460650 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f64a00b82a0 con 0x5646fc0bbc70 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 10 client.19425 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5646fbf5d0e0 con 0x5646fc0bbc70 2026-02-20T13:28:30.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f645ffff640 1 -- 10.20.193.28:0/192460650 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f64a00ab140 con 0x5646fc0bbc70 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 10 client.19425 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 10 client.19425 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 20 client.19425 populate_metadata read hostname 'trial028' 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5646fc120c10 0x5646fc0fe8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 4 client.19425 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.029+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646fbf69f80 con 0x5646fc120c10 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.030+0000 7f64b2330640 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5646fc120c10 0x5646fc0fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.030+0000 7f64b2330640 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5646fc120c10 0x5646fc0fe8a0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=3869075626496062421 s_cookie=6001516494327482677 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=35b1b7c8766b73d5 server_cookie=5349ab7446098935 in_seq=0 out_seq=0 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.030+0000 7f645ffff640 10 client.19425 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:28:30.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f645ffff640 1 -- 10.20.193.28:0/192460650 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5646fbf69f80 con 0x5646fc120c10 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f645ffff640 10 client.19425 handle_command_reply: tid=0 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 client.19425 shutdown 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc0bbc70 msgr2=0x5646fc118c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc0bbc70 0x5646fc118c90 secure :-1 s=READY pgs=1210 gs=1 cs=0 l=1 c_cookie=13585349636077833916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a00aa3d0 tx=0x7f64a00ad210 comp rx=0 tx=0).stop 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 shutdown_connections 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5646fc120c10 0x5646fc0fe8a0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=3869075626496062421 s_cookie=6001516494327482677 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc0bbc70 0x5646fc118c90 unknown :-1 s=CLOSED pgs=1210 gs=1 cs=0 l=1 c_cookie=13585349636077833916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc100b20 0x5646fc11aa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/192460650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 0x5646fc118750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 >> 10.20.193.28:0/192460650 conn(0x5646fc099860 msgr2=0x5646fc0b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f645ffff640 0 client.19425 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:28:30.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 shutdown_connections 2026-02-20T13:28:30.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 1 -- 10.20.193.28:0/192460650 wait complete. 2026-02-20T13:28:30.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.031+0000 7f64b65b5e00 20 client.19425 trim_cache size 0 max 16384 2026-02-20T13:28:30.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b65b5e00 1 Processor -- start 2026-02-20T13:28:30.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b65b5e00 1 -- start start 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 0x5646fc0ffe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bbc70 0x5646fc100360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc1158e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646fbfc5080 con 0x5646fc100b20 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646fbc85700 con 0x5646fc0bbc70 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646fc118e00 con 0x5646fc0bb360 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b1b2f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bbc70 0x5646fc100360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b1b2f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bbc70 0x5646fc100360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34342/0 (socket says 10.20.193.28:34342) 2026-02-20T13:28:30.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b1b2f640 1 -- 10.20.193.28:0/1497891757 learned_addr learned my addr 10.20.193.28:0/1497891757 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b2330640 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 0x5646fc0ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b2b31640 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc1158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b2b31640 1 -- 10.20.193.28:0/1497891757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 msgr2=0x5646fc0ffe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b2b31640 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 0x5646fc0ffe20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b2b31640 1 -- 10.20.193.28:0/1497891757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bbc70 msgr2=0x5646fc100360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b2b31640 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bbc70 0x5646fc100360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.039+0000 7f64b2b31640 1 -- 10.20.193.28:0/1497891757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646fc10a9f0 con 0x5646fc100b20 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b2b31640 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc1158e0 secure :-1 s=READY pgs=1211 gs=2 cs=0 l=1 c_cookie=16444884666044150234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a800a230 tx=0x7f64a8006f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e437f7799bd471da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f647a4e6640 1 -- 10.20.193.28:0/1497891757 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a803e040 con 0x5646fc100b20 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f647a4e6640 1 -- 10.20.193.28:0/1497891757 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f64a8030c50 con 0x5646fc100b20 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f647a4e6640 1 -- 10.20.193.28:0/1497891757 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a8005340 con 0x5646fc100b20 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 -- 10.20.193.28:0/1497891757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 msgr2=0x5646fc1158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc1158e0 secure :-1 s=READY pgs=1211 gs=2 cs=0 l=1 c_cookie=16444884666044150234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a800a230 tx=0x7f64a8006f70 comp rx=0 tx=0).stop 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 -- 10.20.193.28:0/1497891757 shutdown_connections 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc1158e0 unknown :-1 s=CLOSED pgs=1211 gs=2 cs=0 l=1 c_cookie=16444884666044150234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bbc70 0x5646fc100360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/1497891757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bb360 0x5646fc0ffe20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 -- 10.20.193.28:0/1497891757 >> 10.20.193.28:0/1497891757 conn(0x5646fc099860 msgr2=0x5646fc11d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 -- 10.20.193.28:0/1497891757 shutdown_connections 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.040+0000 7f64b65b5e00 1 -- 10.20.193.28:0/1497891757 wait complete. 2026-02-20T13:28:30.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b65b5e00 1 -- start start 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b65b5e00 1 Processor -- start 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0fa920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 0x5646fc0fae60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b65b5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc0fb4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646fc0fbbc0 con 0x5646fc100b20 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646fc0fbd30 con 0x5646fc0bb360 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b65b5e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646fc0fbef0 con 0x5646fc0bbc70 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b2b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc0fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b2b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc0fb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50468/0 (socket says 10.20.193.28:50468) 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.041+0000 7f64b2b31640 1 -- 10.20.193.28:0/225950061 learned_addr learned my addr 10.20.193.28:0/225950061 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b2330640 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b1b2f640 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 0x5646fc0fae60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b2b31640 1 -- 10.20.193.28:0/225950061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 msgr2=0x5646fc0fae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b2b31640 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 0x5646fc0fae60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b2b31640 1 -- 10.20.193.28:0/225950061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 msgr2=0x5646fc0fa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b2b31640 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0fa920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b2b31640 1 -- 10.20.193.28:0/225950061 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646fbf57b60 con 0x5646fc100b20 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b2330640 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0fa920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b2b31640 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc0fb4c0 secure :-1 s=READY pgs=1212 gs=1 cs=0 l=1 c_cookie=18060928241878559247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a8030790 tx=0x7f64a800a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa54e8b8afdea0f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f645ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f645ffff640 1 -- 10.20.193.28:0/225950061 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a80050c0 con 0x5646fc100b20 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f645ffff640 1 -- 10.20.193.28:0/225950061 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f64a8005700 con 0x5646fc100b20 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f645ffff640 1 -- 10.20.193.28:0/225950061 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64a8042410 con 0x5646fc100b20 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a8039e70 con 0x5646fc100b20 2026-02-20T13:28:30.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b65b5e00 10 client.19431 _ll_register_callbacks cb 0x5646fbf48a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f645ffff640 1 -- 10.20.193.28:0/225950061 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f64a8005220 con 0x5646fc100b20 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.042+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64a8030ae0 con 0x5646fc100b20 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f645ffff640 1 -- 10.20.193.28:0/225950061 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f64a80053e0 con 0x5646fc100b20 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b65b5e00 10 client.19431 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5646fbf4b6f0 con 0x5646fc100b20 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f645ffff640 1 -- 10.20.193.28:0/225950061 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f64a8049070 con 0x5646fc100b20 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b65b5e00 10 client.19431 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b65b5e00 10 client.19431 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b65b5e00 20 client.19431 populate_metadata read hostname 'trial028' 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5646fc09ef10 0x5646fc09f3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b65b5e00 4 client.19431 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646fbc5af40 con 0x5646fc09ef10 2026-02-20T13:28:30.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.043+0000 7f64b2330640 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5646fc09ef10 0x5646fc09f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.044+0000 7f64b2330640 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5646fc09ef10 0x5646fc09f3b0 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=12525615255904472602 s_cookie=11045704611444676385 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=add3ecb631664e1a server_cookie=994a39d24b0dd721 in_seq=0 out_seq=0 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.044+0000 7f645ffff640 10 client.19431 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.044+0000 7f645ffff640 1 -- 10.20.193.28:0/225950061 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646fbc5af40 con 0x5646fc09ef10 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.044+0000 7f645ffff640 10 client.19431 handle_command_reply: tid=0 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.044+0000 7f64b65b5e00 1 client.19431 shutdown 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.044+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 msgr2=0x5646fc0fb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.044+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc0fb4c0 secure :-1 s=READY pgs=1212 gs=1 cs=0 l=1 c_cookie=18060928241878559247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a8030790 tx=0x7f64a800a390 comp rx=0 tx=0).stop 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.044+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 shutdown_connections 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5646fc09ef10 0x5646fc09f3b0 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=12525615255904472602 s_cookie=11045704611444676385 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646fc100b20 0x5646fc0fb4c0 unknown :-1 s=CLOSED pgs=1212 gs=1 cs=0 l=1 c_cookie=18060928241878559247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646fc0bbc70 0x5646fc0fae60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b65b5e00 1 --2- 10.20.193.28:0/225950061 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646fc0bb360 0x5646fc0fa920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 >> 10.20.193.28:0/225950061 conn(0x5646fc099860 msgr2=0x5646fc11cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f645ffff640 0 client.19431 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:28:30.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 shutdown_connections 2026-02-20T13:28:30.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b65b5e00 1 -- 10.20.193.28:0/225950061 wait complete. 2026-02-20T13:28:30.054 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:28:30.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b65b5e00 20 client.19431 trim_cache size 0 max 16384 2026-02-20T13:28:30.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 -- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64880b5760 msgr2=0x7f64880d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64880b5760 0x7f64880d5c10 secure :-1 s=READY pgs=515 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f649c004740 tx=0x7f649c005f90 comp rx=0 tx=0).stop 2026-02-20T13:28:30.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 -- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac10ffe0 msgr2=0x7f64ac11da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac10ffe0 0x7f64ac11da50 secure :-1 s=READY pgs=1208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64a0009480 tx=0x7f64a000ee60 comp rx=0 tx=0).stop 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 -- 10.20.193.28:0/860858445 shutdown_connections 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64880b5760 0x7f64880d5c10 unknown :-1 s=CLOSED pgs=515 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64ac10ffe0 0x7f64ac11da50 unknown :-1 s=CLOSED pgs=1208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f64ac1157e0 0x7f64ac122e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 --2- 10.20.193.28:0/860858445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f64ac10f5f0 0x7f64ac11d510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 -- 10.20.193.28:0/860858445 >> 10.20.193.28:0/860858445 conn(0x7f64ac0ecea0 msgr2=0x7f64ac10d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 -- 10.20.193.28:0/860858445 shutdown_connections 2026-02-20T13:28:30.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.045+0000 7f64b45bb640 1 -- 10.20.193.28:0/860858445 wait complete. 2026-02-20T13:28:30.144 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:28:30.329 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.513+0000 7f6593fff640 1 -- 10.20.193.28:0/2610079432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65941156a0 msgr2=0x7f6594176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.513+0000 7f6593fff640 1 --2- 10.20.193.28:0/2610079432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65941156a0 0x7f6594176070 secure :-1 s=READY pgs=1213 gs=1 cs=0 l=1 c_cookie=12961638596054710589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658400aa30 tx=0x7f6584030270 comp rx=0 tx=0).stop 2026-02-20T13:28:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.514+0000 7f6593fff640 1 -- 10.20.193.28:0/2610079432 shutdown_connections 2026-02-20T13:28:30.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.514+0000 7f6593fff640 1 --2- 10.20.193.28:0/2610079432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65941156a0 0x7f6594176070 unknown :-1 s=CLOSED pgs=1213 gs=1 cs=0 l=1 c_cookie=12961638596054710589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.514+0000 7f6593fff640 1 --2- 10.20.193.28:0/2610079432 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f659410fea0 0x7f6594114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.514+0000 7f6593fff640 1 --2- 10.20.193.28:0/2610079432 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f659410f4b0 0x7f659410f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.514+0000 7f6593fff640 1 -- 10.20.193.28:0/2610079432 >> 10.20.193.28:0/2610079432 conn(0x7f65940ecda0 msgr2=0x7f659410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.514+0000 7f6593fff640 1 -- 10.20.193.28:0/2610079432 shutdown_connections 2026-02-20T13:28:30.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.514+0000 7f6593fff640 1 -- 10.20.193.28:0/2610079432 wait complete. 2026-02-20T13:28:30.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6593fff640 1 Processor -- start 2026-02-20T13:28:30.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6593fff640 1 -- start start 2026-02-20T13:28:30.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6593fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f659410f4b0 0x7f659411ddf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6593fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f659410fea0 0x7f659411e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6593fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f65941156a0 0x7f6594123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6593fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6594123d20 con 0x7f659410fea0 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6593fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6594123e90 con 0x7f65941156a0 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6593fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6594124050 con 0x7f659410f4b0 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f65927fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f659410fea0 0x7f659411e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f65927fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f659410fea0 0x7f659411e330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50492/0 (socket says 10.20.193.28:50492) 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f65927fc640 1 -- 10.20.193.28:0/270898073 learned_addr learned my addr 10.20.193.28:0/270898073 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.515+0000 7f6592ffd640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f659410f4b0 0x7f659411ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f65937fe640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f65941156a0 0x7f6594123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f65927fc640 1 -- 10.20.193.28:0/270898073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f659410f4b0 msgr2=0x7f659411ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f65927fc640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f659410f4b0 0x7f659411ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f65927fc640 1 -- 10.20.193.28:0/270898073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f65941156a0 msgr2=0x7f6594123700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f65927fc640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f65941156a0 0x7f6594123700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f65927fc640 1 -- 10.20.193.28:0/270898073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658400a650 con 0x7f659410fea0 2026-02-20T13:28:30.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f65927fc640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f659410fea0 0x7f659411e330 secure :-1 s=READY pgs=1214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f657c00d950 tx=0x7f657c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f6573fff640 1 -- 10.20.193.28:0/270898073 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f657c004540 con 0x7f659410fea0 2026-02-20T13:28:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f6573fff640 1 -- 10.20.193.28:0/270898073 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f657c009d00 con 0x7f659410fea0 2026-02-20T13:28:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f6573fff640 1 -- 10.20.193.28:0/270898073 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f657c0106e0 con 0x7f659410fea0 2026-02-20T13:28:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f6593fff640 1 -- 10.20.193.28:0/270898073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6594124330 con 0x7f659410fea0 2026-02-20T13:28:30.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.516+0000 7f6593fff640 1 -- 10.20.193.28:0/270898073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6594164a30 con 0x7f659410fea0 2026-02-20T13:28:30.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.519+0000 7f6573fff640 1 -- 10.20.193.28:0/270898073 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f657c0097c0 con 0x7f659410fea0 2026-02-20T13:28:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.521+0000 7f6573fff640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65680b5760 0x7f65680d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.521+0000 7f6573fff640 1 -- 10.20.193.28:0/270898073 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f657c0e66e0 con 0x7f659410fea0 2026-02-20T13:28:30.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.521+0000 7f6592ffd640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65680b5760 0x7f65680d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f6592ffd640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65680b5760 0x7f65680d5c10 secure :-1 s=READY pgs=516 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6588005970 tx=0x7f6588005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f659b33ee00 1 Processor -- start 2026-02-20T13:28:30.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f659b33ee00 1 -- start start 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426d4140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 0x564742718ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 0x564742739910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f659b33ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5647425e1780 con 0x5647426d3d70 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f659b33ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5647425dd4b0 con 0x5647426d4680 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f659b33ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5647425d7450 con 0x564742719530 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426d4140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50506/0 (socket says 10.20.193.28:50506) 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f6592ffd640 1 -- 10.20.193.28:0/2227634456 learned_addr learned my addr 10.20.193.28:0/2227634456 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f65937fe640 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 0x564742739910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.522+0000 7f65927fc640 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 0x564742718ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f6592ffd640 1 -- 10.20.193.28:0/2227634456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 msgr2=0x564742739910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 0x564742739910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f6592ffd640 1 -- 10.20.193.28:0/2227634456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 msgr2=0x564742718ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 0x564742718ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f6592ffd640 1 -- 10.20.193.28:0/2227634456 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564742582d10 con 0x5647426d3d70 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426d4140 secure :-1 s=READY pgs=1215 gs=1 cs=0 l=1 c_cookie=3723266620724762101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65880041c0 tx=0x7f6588012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33abb343cc5e55f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f655f7fe640 1 -- 10.20.193.28:0/2227634456 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f658801e680 con 0x5647426d3d70 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f655f7fe640 1 -- 10.20.193.28:0/2227634456 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f658800fe60 con 0x5647426d3d70 2026-02-20T13:28:30.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f655f7fe640 1 -- 10.20.193.28:0/2227634456 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6588010c10 con 0x5647426d3d70 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f659b33ee00 1 -- 10.20.193.28:0/2227634456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 msgr2=0x5647426d4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.523+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426d4140 secure :-1 s=READY pgs=1215 gs=1 cs=0 l=1 c_cookie=3723266620724762101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65880041c0 tx=0x7f6588012000 comp rx=0 tx=0).stop 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.524+0000 7f659b33ee00 1 -- 10.20.193.28:0/2227634456 shutdown_connections 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.524+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 0x564742739910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.524+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 0x564742718ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.524+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2227634456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426d4140 unknown :-1 s=CLOSED pgs=1215 gs=1 cs=0 l=1 c_cookie=3723266620724762101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.524+0000 7f659b33ee00 1 -- 10.20.193.28:0/2227634456 >> 10.20.193.28:0/2227634456 conn(0x5647426a9860 msgr2=0x5647426c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.524+0000 7f659b33ee00 1 -- 10.20.193.28:0/2227634456 shutdown_connections 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.524+0000 7f659b33ee00 1 -- 10.20.193.28:0/2227634456 wait complete. 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.525+0000 7f659b33ee00 1 -- start start 2026-02-20T13:28:30.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.525+0000 7f659b33ee00 1 Processor -- start 2026-02-20T13:28:30.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d3d70 0x564742731240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x564742731780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564742719530 0x564742733510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f659b33ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564742733a80 con 0x564742719530 2026-02-20T13:28:30.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f659b33ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564742733bf0 con 0x5647426d3d70 2026-02-20T13:28:30.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f659b33ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564742733db0 con 0x5647426d4680 2026-02-20T13:28:30.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d3d70 0x564742731240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f65927fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x564742731780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d3d70 0x564742731240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34378/0 (socket says 10.20.193.28:34378) 2026-02-20T13:28:30.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f6592ffd640 1 -- 10.20.193.28:0/2749129240 learned_addr learned my addr 10.20.193.28:0/2749129240 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f65937fe640 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564742719530 0x564742733510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f6592ffd640 1 -- 10.20.193.28:0/2749129240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 msgr2=0x564742731780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x564742731780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f6592ffd640 1 -- 10.20.193.28:0/2749129240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564742719530 msgr2=0x564742733510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564742719530 0x564742733510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.526+0000 7f6592ffd640 1 -- 10.20.193.28:0/2749129240 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474255b3c0 con 0x5647426d3d70 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d3d70 0x564742731240 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=1509222803717303509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658800fd60 tx=0x7f6588005730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14f1d624ce7d2cd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f655cff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f655cff9640 1 -- 10.20.193.28:0/2749129240 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f658801e460 con 0x5647426d3d70 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658800fa30 con 0x5647426d3d70 2026-02-20T13:28:30.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f655cff9640 1 -- 10.20.193.28:0/2749129240 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f658801eaa0 con 0x5647426d3d70 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f659b33ee00 10 client.29396 _ll_register_callbacks cb 0x564742558a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56474226d6f0 con 0x5647426d3d70 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f655cff9640 1 -- 10.20.193.28:0/2749129240 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6588028970 con 0x5647426d3d70 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f655cff9640 1 -- 10.20.193.28:0/2749129240 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6588028ad0 con 0x5647426d3d70 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f655cff9640 1 -- 10.20.193.28:0/2749129240 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6588028c90 con 0x5647426d3d70 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f659b33ee00 10 client.29396 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.527+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56474256d0e0 con 0x5647426d3d70 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.528+0000 7f655cff9640 1 -- 10.20.193.28:0/2749129240 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6588033030 con 0x5647426d3d70 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.528+0000 7f659b33ee00 10 client.29396 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.528+0000 7f659b33ee00 10 client.29396 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.528+0000 7f659b33ee00 20 client.29396 populate_metadata read hostname 'trial028' 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.528+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564742739710 0x5647427172b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.528+0000 7f659b33ee00 4 client.29396 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:30.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.528+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564742579f80 con 0x564742739710 2026-02-20T13:28:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.528+0000 7f65927fc640 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564742739710 0x5647427172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.529+0000 7f65927fc640 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564742739710 0x5647427172b0 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=7501561892580789338 s_cookie=8425395700928569262 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=681ae6cbdbe28c5a server_cookie=74ed04c015f35fae in_seq=0 out_seq=0 2026-02-20T13:28:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.529+0000 7f655cff9640 10 client.29396 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:28:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f655cff9640 1 -- 10.20.193.28:0/2749129240 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564742579f80 con 0x564742739710 2026-02-20T13:28:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f655cff9640 10 client.29396 handle_command_reply: tid=0 2026-02-20T13:28:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 client.29396 shutdown 2026-02-20T13:28:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d3d70 msgr2=0x564742731240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d3d70 0x564742731240 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=1509222803717303509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658800fd60 tx=0x7f6588005730 comp rx=0 tx=0).stop 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 shutdown_connections 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564742739710 0x5647427172b0 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=7501561892580789338 s_cookie=8425395700928569262 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564742719530 0x564742733510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x564742731780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2749129240 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d3d70 0x564742731240 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=1509222803717303509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f655cff9640 0 client.29396 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 >> 10.20.193.28:0/2749129240 conn(0x5647426a9860 msgr2=0x5647426c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 shutdown_connections 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 1 -- 10.20.193.28:0/2749129240 wait complete. 2026-02-20T13:28:30.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.530+0000 7f659b33ee00 20 client.29396 trim_cache size 0 max 16384 2026-02-20T13:28:30.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f659b33ee00 1 Processor -- start 2026-02-20T13:28:30.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f659b33ee00 1 -- start start 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647427334a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 0x56474272e3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 0x56474272e910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f659b33ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5647425d5080 con 0x5647426d3d70 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f659b33ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564742295700 con 0x5647426d4680 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f659b33ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5647427377a0 con 0x564742719530 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647427334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f65937fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 0x56474272e910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647427334a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50512/0 (socket says 10.20.193.28:50512) 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f6592ffd640 1 -- 10.20.193.28:0/1839855706 learned_addr learned my addr 10.20.193.28:0/1839855706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.538+0000 7f65927fc640 1 --2- 10.20.193.28:0/1839855706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 0x56474272e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f6592ffd640 1 -- 10.20.193.28:0/1839855706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 msgr2=0x56474272e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f6592ffd640 1 --2- 10.20.193.28:0/1839855706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 0x56474272e910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f6592ffd640 1 -- 10.20.193.28:0/1839855706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 msgr2=0x56474272e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f6592ffd640 1 --2- 10.20.193.28:0/1839855706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 0x56474272e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f6592ffd640 1 -- 10.20.193.28:0/1839855706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564742567b60 con 0x5647426d3d70 2026-02-20T13:28:30.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f6592ffd640 1 --2- 10.20.193.28:0/1839855706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647427334a0 secure :-1 s=READY pgs=1216 gs=1 cs=0 l=1 c_cookie=3513443525571210727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658801d4a0 tx=0x7f6588038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c2424580116de7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f655effd640 1 -- 10.20.193.28:0/1839855706 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f658801d500 con 0x5647426d3d70 2026-02-20T13:28:30.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f655effd640 1 -- 10.20.193.28:0/1839855706 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56474226d6f0 con 0x5647426d3d70 2026-02-20T13:28:30.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f655effd640 1 -- 10.20.193.28:0/1839855706 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6588019380 con 0x5647426d3d70 2026-02-20T13:28:30.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 -- 10.20.193.28:0/1839855706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 msgr2=0x5647427334a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 --2- 10.20.193.28:0/1839855706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647427334a0 secure :-1 s=READY pgs=1216 gs=1 cs=0 l=1 c_cookie=3513443525571210727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658801d4a0 tx=0x7f6588038000 comp rx=0 tx=0).stop 2026-02-20T13:28:30.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 -- 10.20.193.28:0/1839855706 shutdown_connections 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 --2- 10.20.193.28:0/1839855706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564742719530 0x56474272e910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 --2- 10.20.193.28:0/1839855706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5647426d4680 0x56474272e3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 --2- 10.20.193.28:0/1839855706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647427334a0 unknown :-1 s=CLOSED pgs=1216 gs=1 cs=0 l=1 c_cookie=3513443525571210727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 -- 10.20.193.28:0/1839855706 >> 10.20.193.28:0/1839855706 conn(0x5647426a9860 msgr2=0x564742736e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 -- 10.20.193.28:0/1839855706 shutdown_connections 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.539+0000 7f659b33ee00 1 -- 10.20.193.28:0/1839855706 wait complete. 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.540+0000 7f659b33ee00 1 -- start start 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.540+0000 7f659b33ee00 1 Processor -- start 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426a9de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x5647426aa320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f659b33ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564742719530 0x5647426aec80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f659b33ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5647426a92a0 con 0x5647426d3d70 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f659b33ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5647427382d0 con 0x564742719530 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f659b33ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5647426aa990 con 0x5647426d4680 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65927fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x5647426aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426a9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50524/0 (socket says 10.20.193.28:50524) 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f6592ffd640 1 -- 10.20.193.28:0/2995662041 learned_addr learned my addr 10.20.193.28:0/2995662041 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65927fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x5647426aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53212/0 (socket says 10.20.193.28:53212) 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65937fe640 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564742719530 0x5647426aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65927fc640 1 -- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564742719530 msgr2=0x5647426aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65927fc640 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564742719530 0x5647426aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65927fc640 1 -- 10.20.193.28:0/2995662041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 msgr2=0x5647426a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65927fc640 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65927fc640 1 -- 10.20.193.28:0/2995662041 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474255b6f0 con 0x5647426d4680 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426a9de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65937fe640 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564742719530 0x5647426aec80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f65927fc640 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x5647426aa320 secure :-1 s=READY pgs=360 gs=2 cs=0 l=1 c_cookie=12520175959381755432 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f657c0accb0 tx=0x7f657c002f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adc099b34855c628 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.541+0000 7f655cff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f655cff9640 1 -- 10.20.193.28:0/2995662041 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f657c0b2760 con 0x5647426d4680 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f655cff9640 1 -- 10.20.193.28:0/2995662041 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f657c0b4d40 con 0x5647426d4680 2026-02-20T13:28:30.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56474256d0e0 con 0x5647426d4680 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 10 client.29284 _ll_register_callbacks cb 0x564742558a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f658800fe60 con 0x5647426d4680 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f655cff9640 1 -- 10.20.193.28:0/2995662041 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f657c0ac800 con 0x5647426d4680 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f655cff9640 1 -- 10.20.193.28:0/2995662041 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f657c0ad6d0 con 0x5647426d4680 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f655cff9640 1 -- 10.20.193.28:0/2995662041 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f657c0ad890 con 0x5647426d4680 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 10 client.29284 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56474256d340 con 0x5647426d4680 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f655cff9640 1 -- 10.20.193.28:0/2995662041 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f657c0960b0 con 0x5647426d4680 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 10 client.29284 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:30.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 10 client.29284 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 20 client.29284 populate_metadata read hostname 'trial028' 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5647427c76e0 0x5647427e7b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 4 client.29284 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.542+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56474226af40 con 0x5647427c76e0 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.543+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5647427c76e0 0x5647427e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.543+0000 7f6592ffd640 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5647427c76e0 0x5647427e7b90 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=5637521919263105347 s_cookie=16161529153904952656 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e3c80511327e143 server_cookie=e0494923559fc550 in_seq=0 out_seq=0 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.543+0000 7f655cff9640 10 client.29284 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.543+0000 7f655cff9640 1 -- 10.20.193.28:0/2995662041 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56474226af40 con 0x5647427c76e0 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.543+0000 7f655cff9640 10 client.29284 handle_command_reply: tid=0 2026-02-20T13:28:30.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.543+0000 7f659b33ee00 1 client.29284 shutdown 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.543+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 msgr2=0x5647426aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.543+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x5647426aa320 secure :-1 s=READY pgs=360 gs=2 cs=0 l=1 c_cookie=12520175959381755432 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f657c0accb0 tx=0x7f657c002f90 comp rx=0 tx=0).stop 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 shutdown_connections 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5647427c76e0 0x5647427e7b90 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=5637521919263105347 s_cookie=16161529153904952656 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564742719530 0x5647426aec80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5647426d4680 0x5647426aa320 unknown :-1 s=CLOSED pgs=360 gs=2 cs=0 l=1 c_cookie=12520175959381755432 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 1 --2- 10.20.193.28:0/2995662041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5647426d3d70 0x5647426a9de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f655cff9640 0 client.29284 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 >> 10.20.193.28:0/2995662041 conn(0x5647426a9860 msgr2=0x5647427321d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 shutdown_connections 2026-02-20T13:28:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 1 -- 10.20.193.28:0/2995662041 wait complete. 2026-02-20T13:28:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f659b33ee00 20 client.29284 trim_cache size 0 max 16384 2026-02-20T13:28:30.554 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:28:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 -- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65680b5760 msgr2=0x7f65680d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65680b5760 0x7f65680d5c10 secure :-1 s=READY pgs=516 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6588005970 tx=0x7f6588005900 comp rx=0 tx=0).stop 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 -- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f659410fea0 msgr2=0x7f659411e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f659410fea0 0x7f659411e330 secure :-1 s=READY pgs=1214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f657c00d950 tx=0x7f657c00de20 comp rx=0 tx=0).stop 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 -- 10.20.193.28:0/270898073 shutdown_connections 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f65680b5760 0x7f65680d5c10 unknown :-1 s=CLOSED pgs=516 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f659410fea0 0x7f659411e330 unknown :-1 s=CLOSED pgs=1214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f65941156a0 0x7f6594123700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 --2- 10.20.193.28:0/270898073 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f659410f4b0 0x7f659411ddf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.544+0000 7f6593fff640 1 -- 10.20.193.28:0/270898073 >> 10.20.193.28:0/270898073 conn(0x7f65940ecda0 msgr2=0x7f659410d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.545+0000 7f6593fff640 1 -- 10.20.193.28:0/270898073 shutdown_connections 2026-02-20T13:28:30.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:30.545+0000 7f6593fff640 1 -- 10.20.193.28:0/270898073 wait complete. 2026-02-20T13:28:30.646 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:28:30.700 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:30 trial028 ceph-mon[37442]: pgmap v516: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:28:30.834 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:30 trial127 ceph-mon[43817]: pgmap v516: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:28:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:30 trial034 ceph-mon[43332]: pgmap v516: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2026-02-20T13:28:31.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.007+0000 7fb39064a640 1 -- 10.20.193.28:0/2374800798 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb38810c7f0 msgr2=0x7fb388111840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.007+0000 7fb39064a640 1 --2- 10.20.193.28:0/2374800798 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb38810c7f0 0x7fb388111840 secure :-1 s=READY pgs=1217 gs=1 cs=0 l=1 c_cookie=5735814891918327817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37c009950 tx=0x7fb37c02f190 comp rx=0 tx=0).stop 2026-02-20T13:28:31.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.008+0000 7fb39064a640 1 -- 10.20.193.28:0/2374800798 shutdown_connections 2026-02-20T13:28:31.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.008+0000 7fb39064a640 1 --2- 10.20.193.28:0/2374800798 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb38810c7f0 0x7fb388111840 unknown :-1 s=CLOSED pgs=1217 gs=1 cs=0 l=1 c_cookie=5735814891918327817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.008+0000 7fb39064a640 1 --2- 10.20.193.28:0/2374800798 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb388111ff0 0x7fb3881729c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.008+0000 7fb39064a640 1 --2- 10.20.193.28:0/2374800798 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb38810be00 0x7fb38810c1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.008+0000 7fb39064a640 1 -- 10.20.193.28:0/2374800798 >> 10.20.193.28:0/2374800798 conn(0x7fb3880e96d0 msgr2=0x7fb388109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.008+0000 7fb39064a640 1 -- 10.20.193.28:0/2374800798 shutdown_connections 2026-02-20T13:28:31.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.008+0000 7fb39064a640 1 -- 10.20.193.28:0/2374800798 wait complete. 2026-02-20T13:28:31.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.009+0000 7fb39064a640 1 Processor -- start 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.009+0000 7fb39064a640 1 -- start start 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.009+0000 7fb39064a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb38810be00 0x7fb3880f3990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.009+0000 7fb39064a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb38810c7f0 0x7fb3881728c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.009+0000 7fb39064a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb388111ff0 0x7fb3880f4090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.009+0000 7fb39064a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb3880f92a0 con 0x7fb388111ff0 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.009+0000 7fb39064a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb3880f9410 con 0x7fb38810be00 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.009+0000 7fb39064a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb3880f95d0 con 0x7fb38810c7f0 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb38810c7f0 0x7fb3881728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38ebc0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb388111ff0 0x7fb3880f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb38810c7f0 0x7fb3881728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53222/0 (socket says 10.20.193.28:53222) 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3839125652 learned_addr learned my addr 10.20.193.28:0/3839125652 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb38810be00 0x7fb3880f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3839125652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb38810be00 msgr2=0x7fb3880f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb38810be00 0x7fb3880f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb388111ff0 msgr2=0x7fb3880f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb388111ff0 0x7fb3880f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3839125652 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c009570 con 0x7fb38810c7f0 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.010+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb38810c7f0 0x7fb3881728c0 secure :-1 s=READY pgs=361 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37c038820 tx=0x7fb37c0043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.011+0000 7fb36f7fe640 1 -- 10.20.193.28:0/3839125652 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37c03d070 con 0x7fb38810c7f0 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.011+0000 7fb39064a640 1 -- 10.20.193.28:0/3839125652 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3880f9850 con 0x7fb38810c7f0 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.011+0000 7fb36f7fe640 1 -- 10.20.193.28:0/3839125652 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb37c038920 con 0x7fb38810c7f0 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.011+0000 7fb36f7fe640 1 -- 10.20.193.28:0/3839125652 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37c041960 con 0x7fb38810c7f0 2026-02-20T13:28:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.011+0000 7fb39064a640 1 -- 10.20.193.28:0/3839125652 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3880f9d10 con 0x7fb38810c7f0 2026-02-20T13:28:31.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.013+0000 7fb36f7fe640 1 -- 10.20.193.28:0/3839125652 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb37c038a90 con 0x7fb38810c7f0 2026-02-20T13:28:31.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.015+0000 7fb36f7fe640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3640b5750 0x7fb3640d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.015+0000 7fb36f7fe640 1 -- 10.20.193.28:0/3839125652 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb37c10b1e0 con 0x7fb38810c7f0 2026-02-20T13:28:31.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.015+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3640b5750 0x7fb3640d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.016+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3640b5750 0x7fb3640d5c00 secure :-1 s=READY pgs=517 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb378004740 tx=0x7fb37800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.016+0000 7fb392644e00 1 Processor -- start 2026-02-20T13:28:31.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb392644e00 1 -- start start 2026-02-20T13:28:31.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb392644e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494eeb730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb392644e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f305e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb392644e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f50f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb392644e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563494e01780 con 0x563494eeb360 2026-02-20T13:28:31.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb392644e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563494dfd4b0 con 0x563494f30b20 2026-02-20T13:28:31.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb392644e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563494df7450 con 0x563494eebc70 2026-02-20T13:28:31.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38dbbe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f305e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38e3bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494eeb730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38dbbe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f305e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53226/0 (socket says 10.20.193.28:53226) 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3749581471 learned_addr learned my addr 10.20.193.28:0/3749581471 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38ebc0640 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f50f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3749581471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 msgr2=0x563494f50f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f50f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3749581471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 msgr2=0x563494eeb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494eeb730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.017+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3749581471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563494da2d10 con 0x563494eebc70 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb38ebc0640 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f50f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:31.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494eeb730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f305e0 secure :-1 s=READY pgs=362 gs=2 cs=0 l=1 c_cookie=10100532141221846110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37c032040 tx=0x7fb37c02f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c2c4c77aff19c5e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb36cb0a640 1 -- 10.20.193.28:0/3749581471 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37c0d7260 con 0x563494eebc70 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb36cb0a640 1 -- 10.20.193.28:0/3749581471 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb37c0d9840 con 0x563494eebc70 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb36cb0a640 1 -- 10.20.193.28:0/3749581471 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37c0dc470 con 0x563494eebc70 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb392644e00 1 -- 10.20.193.28:0/3749581471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 msgr2=0x563494f305e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb392644e00 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f305e0 secure :-1 s=READY pgs=362 gs=2 cs=0 l=1 c_cookie=10100532141221846110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37c032040 tx=0x7fb37c02f190 comp rx=0 tx=0).stop 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb392644e00 1 -- 10.20.193.28:0/3749581471 shutdown_connections 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb392644e00 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f50f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb392644e00 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f305e0 unknown :-1 s=CLOSED pgs=362 gs=2 cs=0 l=1 c_cookie=10100532141221846110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb392644e00 1 --2- 10.20.193.28:0/3749581471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494eeb730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.018+0000 7fb392644e00 1 -- 10.20.193.28:0/3749581471 >> 10.20.193.28:0/3749581471 conn(0x563494ec9860 msgr2=0x563494ee9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.019+0000 7fb392644e00 1 -- 10.20.193.28:0/3749581471 shutdown_connections 2026-02-20T13:28:31.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.019+0000 7fb392644e00 1 -- 10.20.193.28:0/3749581471 wait complete. 2026-02-20T13:28:31.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb392644e00 1 -- start start 2026-02-20T13:28:31.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb392644e00 1 Processor -- start 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb392644e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f486d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb392644e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f48c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb392644e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f4dc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb392644e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563494f4e140 con 0x563494eeb360 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb392644e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563494f4e2b0 con 0x563494f30b20 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb392644e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563494f4e470 con 0x563494eebc70 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb38e3bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb38e3bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50560/0 (socket says 10.20.193.28:50560) 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.020+0000 7fb38e3bf640 1 -- 10.20.193.28:0/338017814 learned_addr learned my addr 10.20.193.28:0/338017814 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb38ebc0640 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f4dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f48c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb38e3bf640 1 -- 10.20.193.28:0/338017814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 msgr2=0x563494f48c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f48c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb38e3bf640 1 -- 10.20.193.28:0/338017814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 msgr2=0x563494f4dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f4dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb38e3bf640 1 -- 10.20.193.28:0/338017814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3880f9d10 con 0x563494eeb360 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f486d0 secure :-1 s=READY pgs=1218 gs=1 cs=0 l=1 c_cookie=5326917147539205797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3780119e0 tx=0x7fb3780047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ed02ec2702eea5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb33bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb33bfff640 1 -- 10.20.193.28:0/338017814 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37801fc00 con 0x563494eeb360 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb33bfff640 1 -- 10.20.193.28:0/338017814 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb378015070 con 0x563494eeb360 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb33bfff640 1 -- 10.20.193.28:0/338017814 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37801a690 con 0x563494eeb360 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.021+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37800bd10 con 0x563494eeb360 2026-02-20T13:28:31.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb33bfff640 1 -- 10.20.193.28:0/338017814 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb378017070 con 0x563494eeb360 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 10 client.19461 _ll_register_callbacks cb 0x563494d78a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563494a8d6f0 con 0x563494eeb360 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb33bfff640 1 -- 10.20.193.28:0/338017814 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb37801fd60 con 0x563494eeb360 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 10 client.19461 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563494d7b3c0 con 0x563494eeb360 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb33bfff640 1 -- 10.20.193.28:0/338017814 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fb37802f060 con 0x563494eeb360 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 10 client.19461 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 10 client.19461 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 20 client.19461 populate_metadata read hostname 'trial028' 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x563494f50ca0 0x563494f2e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 4 client.19461 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.022+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563494d99f80 con 0x563494f50ca0 2026-02-20T13:28:31.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.023+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x563494f50ca0 0x563494f2e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.023+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x563494f50ca0 0x563494f2e8a0 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=14611601576471295149 s_cookie=3309804727060079436 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cac6d637dd1bf4ad server_cookie=2deec9dcf853234c in_seq=0 out_seq=0 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.023+0000 7fb33bfff640 10 client.19461 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb33bfff640 1 -- 10.20.193.28:0/338017814 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563494d99f80 con 0x563494f50ca0 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb33bfff640 10 client.19461 handle_command_reply: tid=0 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 client.19461 shutdown 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 msgr2=0x563494f486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f486d0 secure :-1 s=READY pgs=1218 gs=1 cs=0 l=1 c_cookie=5326917147539205797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3780119e0 tx=0x7fb3780047e0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 shutdown_connections 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x563494f50ca0 0x563494f2e8a0 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=14611601576471295149 s_cookie=3309804727060079436 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f4dc00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f48c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 --2- 10.20.193.28:0/338017814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f486d0 unknown :-1 s=CLOSED pgs=1218 gs=1 cs=0 l=1 c_cookie=5326917147539205797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 >> 10.20.193.28:0/338017814 conn(0x563494ec9860 msgr2=0x563494ee9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb33bfff640 0 client.19461 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:28:31.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 shutdown_connections 2026-02-20T13:28:31.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 1 -- 10.20.193.28:0/338017814 wait complete. 2026-02-20T13:28:31.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.024+0000 7fb392644e00 20 client.19461 trim_cache size 0 max 16384 2026-02-20T13:28:31.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb392644e00 1 Processor -- start 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb392644e00 1 -- start start 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb392644e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f2b780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb392644e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f2bcc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb392644e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f2f8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb392644e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563494f4e000 con 0x563494eeb360 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb392644e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563494df5080 con 0x563494f30b20 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb392644e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563494ab5700 con 0x563494eebc70 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38e3bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f2b780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38e3bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f2b780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50562/0 (socket says 10.20.193.28:50562) 2026-02-20T13:28:31.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38e3bf640 1 -- 10.20.193.28:0/3600592006 learned_addr learned my addr 10.20.193.28:0/3600592006 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f2bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38ebc0640 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f2f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38e3bf640 1 -- 10.20.193.28:0/3600592006 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 msgr2=0x563494f2bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f2bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38e3bf640 1 -- 10.20.193.28:0/3600592006 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 msgr2=0x563494f2f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f2f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.032+0000 7fb38e3bf640 1 -- 10.20.193.28:0/3600592006 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563494d8d0e0 con 0x563494eeb360 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f2b780 secure :-1 s=READY pgs=1219 gs=1 cs=0 l=1 c_cookie=13793615288740252999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37801f800 tx=0x7fb37802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6cc405fdc28d47 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb3564e6640 1 -- 10.20.193.28:0/3600592006 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37801cd90 con 0x563494eeb360 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb3564e6640 1 -- 10.20.193.28:0/3600592006 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb378015040 con 0x563494eeb360 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb3564e6640 1 -- 10.20.193.28:0/3600592006 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37801ae50 con 0x563494eeb360 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 -- 10.20.193.28:0/3600592006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 msgr2=0x563494f2b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f2b780 secure :-1 s=READY pgs=1219 gs=1 cs=0 l=1 c_cookie=13793615288740252999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37801f800 tx=0x7fb37802d000 comp rx=0 tx=0).stop 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 -- 10.20.193.28:0/3600592006 shutdown_connections 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494f2f8b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eebc70 0x563494f2bcc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 --2- 10.20.193.28:0/3600592006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eeb360 0x563494f2b780 unknown :-1 s=CLOSED pgs=1219 gs=1 cs=0 l=1 c_cookie=13793615288740252999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 -- 10.20.193.28:0/3600592006 >> 10.20.193.28:0/3600592006 conn(0x563494ec9860 msgr2=0x563494f3a130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 -- 10.20.193.28:0/3600592006 shutdown_connections 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.033+0000 7fb392644e00 1 -- 10.20.193.28:0/3600592006 wait complete. 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb392644e00 1 -- start start 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb392644e00 1 Processor -- start 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb392644e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eeb360 0x563494ecb100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb392644e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eebc70 0x563494ecb640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb392644e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494ecbb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb392644e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563494f7f000 con 0x563494eebc70 2026-02-20T13:28:31.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb392644e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563494f7f170 con 0x563494f30b20 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb392644e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563494f7f330 con 0x563494eeb360 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb38dbbe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eebc70 0x563494ecb640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb38dbbe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eebc70 0x563494ecb640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50576/0 (socket says 10.20.193.28:50576) 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.034+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3119029259 learned_addr learned my addr 10.20.193.28:0/3119029259 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eeb360 0x563494ecb100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3119029259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eeb360 msgr2=0x563494ecb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eeb360 0x563494ecb100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3119029259 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 msgr2=0x563494ecbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494ecbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb38dbbe640 1 -- 10.20.193.28:0/3119029259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563494d87b60 con 0x563494eebc70 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eeb360 0x563494ecb100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:28:31.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb38dbbe640 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eebc70 0x563494ecb640 secure :-1 s=READY pgs=1220 gs=1 cs=0 l=1 c_cookie=6276545539467250070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37c108d10 tx=0x7fb37c041c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571ac4e9e0820996 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb33bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb33bfff640 1 -- 10.20.193.28:0/3119029259 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37c0dc680 con 0x563494eebc70 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb33bfff640 1 -- 10.20.193.28:0/3119029259 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb37c0cd860 con 0x563494eebc70 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb33bfff640 1 -- 10.20.193.28:0/3119029259 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37c0d2f30 con 0x563494eebc70 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563494d7b3c0 con 0x563494eebc70 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb33bfff640 1 -- 10.20.193.28:0/3119029259 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb37c0d30c0 con 0x563494eebc70 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb33bfff640 10 client.19467 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb392644e00 10 client.19467 _ll_register_callbacks cb 0x563494d78a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563494b4f4a0 con 0x563494eebc70 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb33bfff640 1 -- 10.20.193.28:0/3119029259 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb37c0d0af0 con 0x563494eebc70 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb392644e00 10 client.19467 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:31.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.035+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563494d7b6f0 con 0x563494eebc70 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb33bfff640 1 -- 10.20.193.28:0/3119029259 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fb37c0dc1f0 con 0x563494eebc70 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb392644e00 10 client.19467 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb392644e00 10 client.19467 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb392644e00 20 client.19467 populate_metadata read hostname 'trial028' 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb392644e00 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x563494f80be0 0x563494f81080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb392644e00 4 client.19467 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb37c0d9840 con 0x563494f80be0 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x563494f80be0 0x563494f81080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb38e3bf640 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x563494f80be0 0x563494f81080 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=3582153352329263195 s_cookie=8756940760308468139 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31b65d7eb08f785b server_cookie=7986e739a95349ab in_seq=0 out_seq=0 2026-02-20T13:28:31.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.036+0000 7fb33bfff640 10 client.19467 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:28:31.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb33bfff640 1 -- 10.20.193.28:0/3119029259 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb37c0d9840 con 0x563494f80be0 2026-02-20T13:28:31.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb33bfff640 10 client.19467 handle_command_reply: tid=0 2026-02-20T13:28:31.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 client.19467 shutdown 2026-02-20T13:28:31.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eebc70 msgr2=0x563494ecb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eebc70 0x563494ecb640 secure :-1 s=READY pgs=1220 gs=1 cs=0 l=1 c_cookie=6276545539467250070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37c108d10 tx=0x7fb37c041c00 comp rx=0 tx=0).stop 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 shutdown_connections 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x563494f80be0 0x563494f81080 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=3582153352329263195 s_cookie=8756940760308468139 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563494eebc70 0x563494ecb640 unknown :-1 s=CLOSED pgs=1220 gs=1 cs=0 l=1 c_cookie=6276545539467250070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563494f30b20 0x563494ecbb80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 --2- 10.20.193.28:0/3119029259 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563494eeb360 0x563494ecb100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 >> 10.20.193.28:0/3119029259 conn(0x563494ec9860 msgr2=0x563494f2a770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb33bfff640 0 client.19467 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 shutdown_connections 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 1 -- 10.20.193.28:0/3119029259 wait complete. 2026-02-20T13:28:31.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.037+0000 7fb392644e00 20 client.19467 trim_cache size 0 max 16384 2026-02-20T13:28:31.046 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 -- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3640b5750 msgr2=0x7fb3640d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3640b5750 0x7fb3640d5c00 secure :-1 s=READY pgs=517 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb378004740 tx=0x7fb37800b410 comp rx=0 tx=0).stop 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 -- 10.20.193.28:0/3839125652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb38810c7f0 msgr2=0x7fb3881728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb38810c7f0 0x7fb3881728c0 secure :-1 s=READY pgs=361 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37c038820 tx=0x7fb37c0043d0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 -- 10.20.193.28:0/3839125652 shutdown_connections 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb3640b5750 0x7fb3640d5c00 unknown :-1 s=CLOSED pgs=517 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb388111ff0 0x7fb3880f4090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb38810c7f0 0x7fb3881728c0 unknown :-1 s=CLOSED pgs=361 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 --2- 10.20.193.28:0/3839125652 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb38810be00 0x7fb3880f3990 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 -- 10.20.193.28:0/3839125652 >> 10.20.193.28:0/3839125652 conn(0x7fb3880e96d0 msgr2=0x7fb3881106a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 -- 10.20.193.28:0/3839125652 shutdown_connections 2026-02-20T13:28:31.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.038+0000 7fb39064a640 1 -- 10.20.193.28:0/3839125652 wait complete. 2026-02-20T13:28:31.140 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:28:31.325 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:31.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 -- 10.20.193.28:0/758762885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b30110140 msgr2=0x7f3b30173d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 --2- 10.20.193.28:0/758762885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b30110140 0x7f3b30173d50 secure :-1 s=READY pgs=1221 gs=1 cs=0 l=1 c_cookie=9549493575250419702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2400aa30 tx=0x7f3b24030270 comp rx=0 tx=0).stop 2026-02-20T13:28:31.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 -- 10.20.193.28:0/758762885 shutdown_connections 2026-02-20T13:28:31.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 --2- 10.20.193.28:0/758762885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b30110140 0x7f3b30173d50 unknown :-1 s=CLOSED pgs=1221 gs=1 cs=0 l=1 c_cookie=9549493575250419702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 --2- 10.20.193.28:0/758762885 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b3010c040 0x7f3b3010f990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 --2- 10.20.193.28:0/758762885 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b3010b650 0x7f3b3010ba20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 -- 10.20.193.28:0/758762885 >> 10.20.193.28:0/758762885 conn(0x7f3b300e9080 msgr2=0x7f3b30109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 -- 10.20.193.28:0/758762885 shutdown_connections 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.511+0000 7f3b356c0640 1 -- 10.20.193.28:0/758762885 wait complete. 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b356c0640 1 Processor -- start 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b356c0640 1 -- start start 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b356c0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b3010b650 0x7f3b3010dff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b356c0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3010c040 0x7f3b3010c570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b356c0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b30110140 0x7f3b3010cab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b356c0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3010d150 con 0x7f3b3010c040 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b356c0640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3010d2c0 con 0x7f3b30110140 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b356c0640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301686e0 con 0x7f3b3010b650 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3010c040 0x7f3b3010c570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b2ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b3010b650 0x7f3b3010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b34ebf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b30110140 0x7f3b3010cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b2ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b3010b650 0x7f3b3010dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53268/0 (socket says 10.20.193.28:53268) 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.512+0000 7f3b2ffff640 1 -- 10.20.193.28:0/2645480482 learned_addr learned my addr 10.20.193.28:0/2645480482 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/2645480482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b3010b650 msgr2=0x7f3b3010dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b3010b650 0x7f3b3010dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/2645480482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b30110140 msgr2=0x7f3b3010cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b30110140 0x7f3b3010cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/2645480482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2400a650 con 0x7f3b3010c040 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3010c040 0x7f3b3010c570 secure :-1 s=READY pgs=1222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2000d720 tx=0x7f3b2000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2d7fa640 1 -- 10.20.193.28:0/2645480482 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b20004500 con 0x7f3b3010c040 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b356c0640 1 -- 10.20.193.28:0/2645480482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b301689c0 con 0x7f3b3010c040 2026-02-20T13:28:31.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2d7fa640 1 -- 10.20.193.28:0/2645480482 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b20004d30 con 0x7f3b3010c040 2026-02-20T13:28:31.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b2d7fa640 1 -- 10.20.193.28:0/2645480482 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b20004500 con 0x7f3b3010c040 2026-02-20T13:28:31.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.513+0000 7f3b356c0640 1 -- 10.20.193.28:0/2645480482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b30168ee0 con 0x7f3b3010c040 2026-02-20T13:28:31.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.516+0000 7f3b2d7fa640 1 -- 10.20.193.28:0/2645480482 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3b20021070 con 0x7f3b3010c040 2026-02-20T13:28:31.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.518+0000 7f3b2d7fa640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b040b57c0 0x7f3b040d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.518+0000 7f3b2ffff640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b040b57c0 0x7f3b040d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.518+0000 7f3b2d7fa640 1 -- 10.20.193.28:0/2645480482 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3b200e5d90 con 0x7f3b3010c040 2026-02-20T13:28:31.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.518+0000 7f3b2ffff640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b040b57c0 0x7f3b040d5c70 secure :-1 s=READY pgs=518 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b1c00b2a0 tx=0x7f3b1c00b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b38943e00 1 Processor -- start 2026-02-20T13:28:31.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b38943e00 1 -- start start 2026-02-20T13:28:31.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d1f1730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1c70 0x555e0d2365e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d256f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b38943e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555e0d107780 con 0x555e0d236b20 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b38943e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555e0d1034b0 con 0x555e0d1f1c70 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b38943e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555e0d0fd450 con 0x555e0d1f1360 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b34ebf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d256f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b34ebf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d256f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50612/0 (socket says 10.20.193.28:50612) 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b34ebf640 1 -- 10.20.193.28:0/773713819 learned_addr learned my addr 10.20.193.28:0/773713819 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.519+0000 7f3b2ffff640 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d1f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1c70 0x555e0d2365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b34ebf640 1 -- 10.20.193.28:0/773713819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 msgr2=0x555e0d1f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b34ebf640 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d1f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b34ebf640 1 -- 10.20.193.28:0/773713819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1c70 msgr2=0x555e0d2365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b34ebf640 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1c70 0x555e0d2365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b34ebf640 1 -- 10.20.193.28:0/773713819 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0d0a8d10 con 0x555e0d236b20 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1c70 0x555e0d2365e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b34ebf640 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d256f00 secure :-1 s=READY pgs=1223 gs=1 cs=0 l=1 c_cookie=12791425517541548356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b24030780 tx=0x7f3b24003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18445bc7fee6144 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b00ce3640 1 -- 10.20.193.28:0/773713819 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b2403e050 con 0x555e0d236b20 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b00ce3640 1 -- 10.20.193.28:0/773713819 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b2403f040 con 0x555e0d236b20 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.520+0000 7f3b00ce3640 1 -- 10.20.193.28:0/773713819 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b240050c0 con 0x555e0d236b20 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 -- 10.20.193.28:0/773713819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 msgr2=0x555e0d256f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d256f00 secure :-1 s=READY pgs=1223 gs=1 cs=0 l=1 c_cookie=12791425517541548356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b24030780 tx=0x7f3b24003e60 comp rx=0 tx=0).stop 2026-02-20T13:28:31.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 -- 10.20.193.28:0/773713819 shutdown_connections 2026-02-20T13:28:31.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d256f00 unknown :-1 s=CLOSED pgs=1223 gs=1 cs=0 l=1 c_cookie=12791425517541548356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1c70 0x555e0d2365e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 --2- 10.20.193.28:0/773713819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d1f1730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 -- 10.20.193.28:0/773713819 >> 10.20.193.28:0/773713819 conn(0x555e0d1cf860 msgr2=0x555e0d1efc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 -- 10.20.193.28:0/773713819 shutdown_connections 2026-02-20T13:28:31.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.521+0000 7f3b38943e00 1 -- 10.20.193.28:0/773713819 wait complete. 2026-02-20T13:28:31.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.522+0000 7f3b38943e00 1 -- start start 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.522+0000 7f3b38943e00 1 Processor -- start 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d24e680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d24ebc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 0x555e0d2509c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b38943e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555e0d250f30 con 0x555e0d1f1c70 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b38943e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555e0d2510a0 con 0x555e0d236b20 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b38943e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555e0d251260 con 0x555e0d1f1360 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d24ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d24ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50626/0 (socket says 10.20.193.28:50626) 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/2583438661 learned_addr learned my addr 10.20.193.28:0/2583438661 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2ffff640 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d24e680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b34ebf640 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 0x555e0d2509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/2583438661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 msgr2=0x555e0d24e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d24e680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/2583438661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 msgr2=0x555e0d2509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 0x555e0d2509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.523+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/2583438661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0d0813c0 con 0x555e0d1f1c70 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d24ebc0 secure :-1 s=READY pgs=1224 gs=2 cs=0 l=1 c_cookie=17289214247343703215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b200040a0 tx=0x7f3b200abb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efefa0c17a8b44af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3af1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3af1ffb640 1 -- 10.20.193.28:0/2583438661 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b200b6fc0 con 0x555e0d1f1c70 2026-02-20T13:28:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3af1ffb640 1 -- 10.20.193.28:0/2583438661 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b200b43f0 con 0x555e0d1f1c70 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3af1ffb640 1 -- 10.20.193.28:0/2583438661 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b200b6040 con 0x555e0d1f1c70 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b301745c0 con 0x555e0d1f1c70 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3af1ffb640 1 -- 10.20.193.28:0/2583438661 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3b200b61d0 con 0x555e0d1f1c70 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3af1ffb640 10 client.19479 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3b38943e00 10 client.19479 _ll_register_callbacks cb 0x555e0d07ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e0cd936f0 con 0x555e0d1f1c70 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3af1ffb640 1 -- 10.20.193.28:0/2583438661 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b200b7230 con 0x555e0d1f1c70 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3b38943e00 10 client.19479 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.524+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555e0d0930e0 con 0x555e0d1f1c70 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.525+0000 7f3af1ffb640 1 -- 10.20.193.28:0/2583438661 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f3b200aa180 con 0x555e0d1f1c70 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.525+0000 7f3b38943e00 10 client.19479 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:31.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.525+0000 7f3b38943e00 10 client.19479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.525+0000 7f3b38943e00 20 client.19479 populate_metadata read hostname 'trial028' 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.525+0000 7f3b38943e00 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e0d256d70 0x555e0d2348a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.525+0000 7f3b38943e00 4 client.19479 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.525+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e0d09ff80 con 0x555e0d256d70 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.525+0000 7f3b2ffff640 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e0d256d70 0x555e0d2348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.526+0000 7f3b2ffff640 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e0d256d70 0x555e0d2348a0 crc :-1 s=READY pgs=322 gs=4 cs=0 l=0 c_cookie=15978485144586906628 s_cookie=11705588256475372754 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddbefb94d3f56c04 server_cookie=a2729a801a32dcd2 in_seq=0 out_seq=0 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.526+0000 7f3af1ffb640 10 client.19479 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3af1ffb640 1 -- 10.20.193.28:0/2583438661 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555e0d09ff80 con 0x555e0d256d70 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3af1ffb640 10 client.19479 handle_command_reply: tid=0 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 client.19479 shutdown 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 msgr2=0x555e0d24ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d24ebc0 secure :-1 s=READY pgs=1224 gs=2 cs=0 l=1 c_cookie=17289214247343703215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b200040a0 tx=0x7f3b200abb80 comp rx=0 tx=0).stop 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 shutdown_connections 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e0d256d70 0x555e0d2348a0 crc :-1 s=READY pgs=322 gs=4 cs=0 l=0 c_cookie=15978485144586906628 s_cookie=11705588256475372754 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d24ebc0 unknown :-1 s=CLOSED pgs=1224 gs=2 cs=0 l=1 c_cookie=17289214247343703215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 0x555e0d2509c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 --2- 10.20.193.28:0/2583438661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d24e680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3af1ffb640 0 client.19479 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 >> 10.20.193.28:0/2583438661 conn(0x555e0d1cf860 msgr2=0x555e0d1efc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 shutdown_connections 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.527+0000 7f3b38943e00 1 -- 10.20.193.28:0/2583438661 wait complete. 2026-02-20T13:28:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.528+0000 7f3b38943e00 20 client.19479 trim_cache size 0 max 16384 2026-02-20T13:28:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b38943e00 1 Processor -- start 2026-02-20T13:28:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b38943e00 1 -- start start 2026-02-20T13:28:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d253530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d250950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 0x555e0d235fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b38943e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555e0d0fb080 con 0x555e0d1f1c70 2026-02-20T13:28:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b38943e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555e0cdbb700 con 0x555e0d236b20 2026-02-20T13:28:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b38943e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555e0d1cf2a0 con 0x555e0d1f1360 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.535+0000 7f3b2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d250950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d250950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50632/0 (socket says 10.20.193.28:50632) 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/3707254857 learned_addr learned my addr 10.20.193.28:0/3707254857 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b34ebf640 1 --2- 10.20.193.28:0/3707254857 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 0x555e0d235fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/3707254857 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 msgr2=0x555e0d253530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/3707254857 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d253530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/3707254857 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 msgr2=0x555e0d235fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/3707254857 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 0x555e0d235fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b2f7fe640 1 -- 10.20.193.28:0/3707254857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0d240940 con 0x555e0d1f1c70 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b2f7fe640 1 --2- 10.20.193.28:0/3707254857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d250950 secure :-1 s=READY pgs=1225 gs=1 cs=0 l=1 c_cookie=4562803900143110458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b200a9410 tx=0x7f3b200ce000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5255f8efcc093a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3af3fff640 1 -- 10.20.193.28:0/3707254857 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b20071eb0 con 0x555e0d1f1c70 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3af3fff640 1 -- 10.20.193.28:0/3707254857 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555e0cd936f0 con 0x555e0d1f1c70 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3af3fff640 1 -- 10.20.193.28:0/3707254857 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b20071920 con 0x555e0d1f1c70 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b38943e00 1 -- 10.20.193.28:0/3707254857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 msgr2=0x555e0d250950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b38943e00 1 --2- 10.20.193.28:0/3707254857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d250950 secure :-1 s=READY pgs=1225 gs=1 cs=0 l=1 c_cookie=4562803900143110458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b200a9410 tx=0x7f3b200ce000 comp rx=0 tx=0).stop 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b38943e00 1 -- 10.20.193.28:0/3707254857 shutdown_connections 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b38943e00 1 --2- 10.20.193.28:0/3707254857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d1f1c70 0x555e0d250950 unknown :-1 s=CLOSED pgs=1225 gs=1 cs=0 l=1 c_cookie=4562803900143110458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b38943e00 1 --2- 10.20.193.28:0/3707254857 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d236b20 0x555e0d235fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b38943e00 1 --2- 10.20.193.28:0/3707254857 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1360 0x555e0d253530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b38943e00 1 -- 10.20.193.28:0/3707254857 >> 10.20.193.28:0/3707254857 conn(0x555e0d1cf860 msgr2=0x555e0d2521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.536+0000 7f3b38943e00 1 -- 10.20.193.28:0/3707254857 shutdown_connections 2026-02-20T13:28:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.537+0000 7f3b38943e00 1 -- 10.20.193.28:0/3707254857 wait complete. 2026-02-20T13:28:31.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.537+0000 7f3b38943e00 1 -- start start 2026-02-20T13:28:31.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.537+0000 7f3b38943e00 1 Processor -- start 2026-02-20T13:28:31.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1360 0x555e0d231780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1c70 0x555e0d231cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b38943e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d24a800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b38943e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555e0d0fb080 con 0x555e0d236b20 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b38943e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555e0cdbb700 con 0x555e0d1f1360 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b38943e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555e0d232380 con 0x555e0d1f1c70 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b2ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1360 0x555e0d231780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b2f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1c70 0x555e0d231cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b34ebf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d24a800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b2ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1360 0x555e0d231780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34502/0 (socket says 10.20.193.28:34502) 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b2ffff640 1 -- 10.20.193.28:0/1369545372 learned_addr learned my addr 10.20.193.28:0/1369545372 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b34ebf640 1 -- 10.20.193.28:0/1369545372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1c70 msgr2=0x555e0d231cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b34ebf640 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1c70 0x555e0d231cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b34ebf640 1 -- 10.20.193.28:0/1369545372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1360 msgr2=0x555e0d231780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b34ebf640 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1360 0x555e0d231780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.538+0000 7f3b34ebf640 1 -- 10.20.193.28:0/1369545372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0d08db60 con 0x555e0d236b20 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3b34ebf640 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d24a800 secure :-1 s=READY pgs=1226 gs=3 cs=0 l=1 c_cookie=7646509913880437474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2400a230 tx=0x7f3b24030dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1ddc40f458a2e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3af1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3af1ffb640 1 -- 10.20.193.28:0/1369545372 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b2403e040 con 0x555e0d236b20 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e0d0930e0 con 0x555e0d236b20 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3af1ffb640 1 -- 10.20.193.28:0/1369545372 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b24039e00 con 0x555e0d236b20 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3af1ffb640 1 -- 10.20.193.28:0/1369545372 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b24043660 con 0x555e0d236b20 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3b38943e00 10 client.19485 _ll_register_callbacks cb 0x555e0d07ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e0ce554a0 con 0x555e0d236b20 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3af1ffb640 1 -- 10.20.193.28:0/1369545372 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3b24039920 con 0x555e0d236b20 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3af1ffb640 1 -- 10.20.193.28:0/1369545372 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b24039ae0 con 0x555e0d236b20 2026-02-20T13:28:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3b38943e00 10 client.19485 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.539+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555e0d0816f0 con 0x555e0d236b20 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.540+0000 7f3af1ffb640 1 -- 10.20.193.28:0/1369545372 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f3b24005260 con 0x555e0d236b20 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.540+0000 7f3b38943e00 10 client.19485 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.540+0000 7f3b38943e00 10 client.19485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.540+0000 7f3b38943e00 20 client.19485 populate_metadata read hostname 'trial028' 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.540+0000 7f3b38943e00 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e0d1d3850 0x555e0d1d3cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.540+0000 7f3b38943e00 4 client.19485 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.540+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3b2403f040 con 0x555e0d1d3850 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.540+0000 7f3b2ffff640 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e0d1d3850 0x555e0d1d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b2ffff640 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e0d1d3850 0x555e0d1d3cf0 crc :-1 s=READY pgs=323 gs=4 cs=0 l=0 c_cookie=14816661676682323990 s_cookie=11678037215094478439 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd9f5b4afbcb2816 server_cookie=a210b8f9677f9667 in_seq=0 out_seq=0 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3af1ffb640 10 client.19485 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3af1ffb640 1 -- 10.20.193.28:0/1369545372 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3b2403f040 con 0x555e0d1d3850 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3af1ffb640 10 client.19485 handle_command_reply: tid=0 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 client.19485 shutdown 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 msgr2=0x555e0d24a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d24a800 secure :-1 s=READY pgs=1226 gs=3 cs=0 l=1 c_cookie=7646509913880437474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2400a230 tx=0x7f3b24030dc0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 shutdown_connections 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e0d1d3850 0x555e0d1d3cf0 crc :-1 s=READY pgs=323 gs=4 cs=0 l=0 c_cookie=14816661676682323990 s_cookie=11678037215094478439 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e0d236b20 0x555e0d24a800 unknown :-1 s=CLOSED pgs=1226 gs=3 cs=0 l=1 c_cookie=7646509913880437474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e0d1f1c70 0x555e0d231cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 --2- 10.20.193.28:0/1369545372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e0d1f1360 0x555e0d231780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.541+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 >> 10.20.193.28:0/1369545372 conn(0x555e0d1cf860 msgr2=0x555e0d253ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3af1ffb640 0 client.19485 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 shutdown_connections 2026-02-20T13:28:31.549 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b38943e00 1 -- 10.20.193.28:0/1369545372 wait complete. 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b38943e00 20 client.19485 trim_cache size 0 max 16384 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 -- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b040b57c0 msgr2=0x7f3b040d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b040b57c0 0x7f3b040d5c70 secure :-1 s=READY pgs=518 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b1c00b2a0 tx=0x7f3b1c00b480 comp rx=0 tx=0).stop 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 -- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3010c040 msgr2=0x7f3b3010c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3010c040 0x7f3b3010c570 secure :-1 s=READY pgs=1222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2000d720 tx=0x7f3b2000dbf0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 -- 10.20.193.28:0/2645480482 shutdown_connections 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3b040b57c0 0x7f3b040d5c70 unknown :-1 s=CLOSED pgs=518 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3010c040 0x7f3b3010c570 unknown :-1 s=CLOSED pgs=1222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3b30110140 0x7f3b3010cab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 --2- 10.20.193.28:0/2645480482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b3010b650 0x7f3b3010dff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 -- 10.20.193.28:0/2645480482 >> 10.20.193.28:0/2645480482 conn(0x7f3b300e9080 msgr2=0x7f3b30109460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 -- 10.20.193.28:0/2645480482 shutdown_connections 2026-02-20T13:28:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:31.542+0000 7f3b356c0640 1 -- 10.20.193.28:0/2645480482 wait complete. 2026-02-20T13:28:32.680 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:28:32.680 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:28:32.865 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:32.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:32 trial028 ceph-mon[37442]: pgmap v517: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.8 KiB/s wr, 17 op/s 2026-02-20T13:28:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:32 trial127 ceph-mon[43817]: pgmap v517: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.8 KiB/s wr, 17 op/s 2026-02-20T13:28:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:32 trial034 ceph-mon[43332]: pgmap v517: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.8 KiB/s wr, 17 op/s 2026-02-20T13:28:33.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 -- 10.20.193.28:0/2462765823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810c040 msgr2=0x7f61b810f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 --2- 10.20.193.28:0/2462765823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810c040 0x7f61b810f990 secure :-1 s=READY pgs=1227 gs=1 cs=0 l=1 c_cookie=10226954629602521570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a8009950 tx=0x7f61a802f190 comp rx=0 tx=0).stop 2026-02-20T13:28:33.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 -- 10.20.193.28:0/2462765823 shutdown_connections 2026-02-20T13:28:33.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 --2- 10.20.193.28:0/2462765823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810c040 0x7f61b810f990 unknown :-1 s=CLOSED pgs=1227 gs=1 cs=0 l=1 c_cookie=10226954629602521570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 --2- 10.20.193.28:0/2462765823 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f61b8110140 0x7f61b8173d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 --2- 10.20.193.28:0/2462765823 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f61b810b650 0x7f61b810ba20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 -- 10.20.193.28:0/2462765823 >> 10.20.193.28:0/2462765823 conn(0x7f61b80e9080 msgr2=0x7f61b8109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 -- 10.20.193.28:0/2462765823 shutdown_connections 2026-02-20T13:28:33.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 -- 10.20.193.28:0/2462765823 wait complete. 2026-02-20T13:28:33.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.050+0000 7f61bd42e640 1 Processor -- start 2026-02-20T13:28:33.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bd42e640 1 -- start start 2026-02-20T13:28:33.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bd42e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810b650 0x7f61b80f3c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bd42e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f61b810c040 0x7f61b8173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bd42e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f61b8110140 0x7f61b80f4370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bd42e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80f9580 con 0x7f61b810b650 2026-02-20T13:28:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bd42e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80f96f0 con 0x7f61b8110140 2026-02-20T13:28:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bd42e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80f98b0 con 0x7f61b810c040 2026-02-20T13:28:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810b650 0x7f61b80f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810b650 0x7f61b80f3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50668/0 (socket says 10.20.193.28:50668) 2026-02-20T13:28:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b7fff640 1 -- 10.20.193.28:0/1289256119 learned_addr learned my addr 10.20.193.28:0/1289256119 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bcc2d640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f61b8110140 0x7f61b80f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b77fe640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f61b810c040 0x7f61b8173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b7fff640 1 -- 10.20.193.28:0/1289256119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f61b810c040 msgr2=0x7f61b8173c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b7fff640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f61b810c040 0x7f61b8173c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b7fff640 1 -- 10.20.193.28:0/1289256119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f61b8110140 msgr2=0x7f61b80f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b7fff640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f61b8110140 0x7f61b80f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61b7fff640 1 -- 10.20.193.28:0/1289256119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a8009570 con 0x7f61b810b650 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.051+0000 7f61bcc2d640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f61b8110140 0x7f61b80f4370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.052+0000 7f61b7fff640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810b650 0x7f61b80f3c70 secure :-1 s=READY pgs=1228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a400c9b0 tx=0x7f61a400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.052+0000 7f61b57fa640 1 -- 10.20.193.28:0/1289256119 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a40044a0 con 0x7f61b810b650 2026-02-20T13:28:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.052+0000 7f61bd42e640 1 -- 10.20.193.28:0/1289256119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b80f9b90 con 0x7f61b810b650 2026-02-20T13:28:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.052+0000 7f61bd42e640 1 -- 10.20.193.28:0/1289256119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b80fa0b0 con 0x7f61b810b650 2026-02-20T13:28:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.054+0000 7f61b57fa640 1 -- 10.20.193.28:0/1289256119 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f61a4007da0 con 0x7f61b810b650 2026-02-20T13:28:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.054+0000 7f61b57fa640 1 -- 10.20.193.28:0/1289256119 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a400f6d0 con 0x7f61b810b650 2026-02-20T13:28:33.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.055+0000 7f61b57fa640 1 -- 10.20.193.28:0/1289256119 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f61a400f860 con 0x7f61b810b650 2026-02-20T13:28:33.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61b57fa640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f618c0b5760 0x7f618c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61b57fa640 1 -- 10.20.193.28:0/1289256119 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f61a40e6bf0 con 0x7f61b810b650 2026-02-20T13:28:33.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61c06b1e00 1 Processor -- start 2026-02-20T13:28:33.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61b77fe640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f618c0b5760 0x7f618c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61c06b1e00 1 -- start start 2026-02-20T13:28:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484410 0x55ab964847e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964c9480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964e9da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab9639aa20 con 0x55ab96484d20 2026-02-20T13:28:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab96396750 con 0x55ab96484410 2026-02-20T13:28:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.057+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab963906f0 con 0x55ab964c99c0 2026-02-20T13:28:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484410 0x55ab964847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50670/0 (socket says 10.20.193.28:50670) 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 -- 10.20.193.28:0/653225906 learned_addr learned my addr 10.20.193.28:0/653225906 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61bcc2d640 1 --2- 10.20.193.28:0/653225906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 -- 10.20.193.28:0/653225906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 msgr2=0x55ab964e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 --2- 10.20.193.28:0/653225906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 -- 10.20.193.28:0/653225906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484410 msgr2=0x55ab964847e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 --2- 10.20.193.28:0/653225906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484410 0x55ab964847e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 -- 10.20.193.28:0/653225906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab9633c120 con 0x55ab96484d20 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f618c0b5760 0x7f618c0d5c10 secure :-1 s=READY pgs=519 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a8009950 tx=0x7f61a8002f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.058+0000 7f61b77fe640 1 --2- 10.20.193.28:0/653225906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964c9480 secure :-1 s=READY pgs=1229 gs=2 cs=0 l=1 c_cookie=12051329490008211058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a8049000 tx=0x7f61a804a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73eec520b20fe72 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f6188ce3640 1 -- 10.20.193.28:0/653225906 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a8053b80 con 0x55ab96484d20 2026-02-20T13:28:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f6188ce3640 1 -- 10.20.193.28:0/653225906 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f61a8057070 con 0x55ab96484d20 2026-02-20T13:28:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f6188ce3640 1 -- 10.20.193.28:0/653225906 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a8048400 con 0x55ab96484d20 2026-02-20T13:28:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 -- 10.20.193.28:0/653225906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 msgr2=0x55ab964c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/653225906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964c9480 secure :-1 s=READY pgs=1229 gs=2 cs=0 l=1 c_cookie=12051329490008211058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a8049000 tx=0x7f61a804a000 comp rx=0 tx=0).stop 2026-02-20T13:28:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 -- 10.20.193.28:0/653225906 shutdown_connections 2026-02-20T13:28:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/653225906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964c9480 unknown :-1 s=CLOSED pgs=1229 gs=2 cs=0 l=1 c_cookie=12051329490008211058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/653225906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964e9da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/653225906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484410 0x55ab964847e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 -- 10.20.193.28:0/653225906 >> 10.20.193.28:0/653225906 conn(0x55ab96462910 msgr2=0x55ab96482cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 -- 10.20.193.28:0/653225906 shutdown_connections 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.059+0000 7f61c06b1e00 1 -- 10.20.193.28:0/653225906 wait complete. 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.060+0000 7f61c06b1e00 1 -- start start 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61c06b1e00 1 Processor -- start 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e1700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e1c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab964e6c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab964e7170 con 0x55ab96484d20 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab964e72e0 con 0x55ab964c99c0 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab964e74a0 con 0x55ab96484410 2026-02-20T13:28:33.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61b7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61bcc2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab964e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61b7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e1700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53316/0 (socket says 10.20.193.28:53316) 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.061+0000 7f61b7fff640 1 -- 10.20.193.28:0/38673958 learned_addr learned my addr 10.20.193.28:0/38673958 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61b7fff640 1 -- 10.20.193.28:0/38673958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 msgr2=0x55ab964e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61b7fff640 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab964e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61b77fe640 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61b7fff640 1 -- 10.20.193.28:0/38673958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 msgr2=0x55ab964e1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61b7fff640 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61b7fff640 1 -- 10.20.193.28:0/38673958 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab96314810 con 0x55ab96484410 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61b77fe640 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e1c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61b7fff640 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e1700 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=8757516649062481402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a4005fd0 tx=0x7f61a40ad870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7988f2fe35f03dfa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f6181ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f6181ffb640 1 -- 10.20.193.28:0/38673958 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a40b5480 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b81745c0 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.062+0000 7f61c06b1e00 10 client.29320 _ll_register_callbacks cb 0x55ab96347b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.063+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab960269d0 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.063+0000 7f6181ffb640 1 -- 10.20.193.28:0/38673958 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ab960269d0 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.063+0000 7f6181ffb640 1 -- 10.20.193.28:0/38673958 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a40aeeb0 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.063+0000 7f6181ffb640 1 -- 10.20.193.28:0/38673958 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f61a401e260 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.063+0000 7f6181ffb640 1 -- 10.20.193.28:0/38673958 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61a401e460 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.063+0000 7f61c06b1e00 10 client.29320 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.063+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ab963264f0 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.064+0000 7f6181ffb640 1 -- 10.20.193.28:0/38673958 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f61a4073130 con 0x55ab96484410 2026-02-20T13:28:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.064+0000 7f61c06b1e00 10 client.29320 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.064+0000 7f61c06b1e00 10 client.29320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.064+0000 7f61c06b1e00 20 client.29320 populate_metadata read hostname 'trial028' 2026-02-20T13:28:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.064+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab964e9d00 0x55ab964c76a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.064+0000 7f61c06b1e00 4 client.29320 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.064+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab9639ddf0 con 0x55ab964e9d00 2026-02-20T13:28:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.064+0000 7f61b77fe640 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab964e9d00 0x55ab964c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.065+0000 7f61b77fe640 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab964e9d00 0x55ab964c76a0 crc :-1 s=READY pgs=324 gs=4 cs=0 l=0 c_cookie=1618447124914088717 s_cookie=12954291997004560633 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1675e115d041ab0d server_cookie=b3c6e3efbe2478f9 in_seq=0 out_seq=0 2026-02-20T13:28:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.065+0000 7f6181ffb640 10 client.29320 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.065+0000 7f6181ffb640 1 -- 10.20.193.28:0/38673958 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ab9639ddf0 con 0x55ab964e9d00 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.065+0000 7f6181ffb640 10 client.29320 handle_command_reply: tid=0 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.065+0000 7f61c06b1e00 1 client.29320 shutdown 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 msgr2=0x55ab964e1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e1700 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=8757516649062481402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a4005fd0 tx=0x7f61a40ad870 comp rx=0 tx=0).stop 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 shutdown_connections 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab964e9d00 0x55ab964c76a0 crc :-1 s=READY pgs=324 gs=4 cs=0 l=0 c_cookie=1618447124914088717 s_cookie=12954291997004560633 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e1c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab964e6c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/38673958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e1700 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=8757516649062481402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 >> 10.20.193.28:0/38673958 conn(0x55ab96462910 msgr2=0x55ab96482cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f6181ffb640 0 client.29320 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 shutdown_connections 2026-02-20T13:28:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 1 -- 10.20.193.28:0/38673958 wait complete. 2026-02-20T13:28:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.066+0000 7f61c06b1e00 20 client.29320 trim_cache size 0 max 16384 2026-02-20T13:28:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61c06b1e00 1 Processor -- start 2026-02-20T13:28:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61c06b1e00 1 -- start start 2026-02-20T13:28:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484410 0x55ab964deac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484d20 0x55ab964df000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964c8c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab9638e320 con 0x55ab96484410 2026-02-20T13:28:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab9604e790 con 0x55ab96484d20 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab964e2220 con 0x55ab964c99c0 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484410 0x55ab964deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484d20 0x55ab964df000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484410 0x55ab964deac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50680/0 (socket says 10.20.193.28:50680) 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b7fff640 1 -- 10.20.193.28:0/4164172586 learned_addr learned my addr 10.20.193.28:0/4164172586 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61bcc2d640 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b7fff640 1 -- 10.20.193.28:0/4164172586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 msgr2=0x55ab964c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b7fff640 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b7fff640 1 -- 10.20.193.28:0/4164172586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484d20 msgr2=0x55ab964df000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b7fff640 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484d20 0x55ab964df000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b7fff640 1 -- 10.20.193.28:0/4164172586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab96462780 con 0x55ab96484410 2026-02-20T13:28:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61b77fe640 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484d20 0x55ab964df000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.075+0000 7f61bcc2d640 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964c8c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61b7fff640 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484410 0x55ab964deac0 secure :-1 s=READY pgs=1230 gs=1 cs=0 l=1 c_cookie=7985620733321733575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a40b0230 tx=0x7f61a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed29fbf50a2e5c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f6183fff640 1 -- 10.20.193.28:0/4164172586 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a40b3410 con 0x55ab96484410 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f6183fff640 1 -- 10.20.193.28:0/4164172586 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f61a40c4e90 con 0x55ab96484410 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f6183fff640 1 -- 10.20.193.28:0/4164172586 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a401ec50 con 0x55ab96484410 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 -- 10.20.193.28:0/4164172586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484410 msgr2=0x55ab964deac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484410 0x55ab964deac0 secure :-1 s=READY pgs=1230 gs=1 cs=0 l=1 c_cookie=7985620733321733575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a40b0230 tx=0x7f61a4019000 comp rx=0 tx=0).stop 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 -- 10.20.193.28:0/4164172586 shutdown_connections 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab964c99c0 0x55ab964c8c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab96484d20 0x55ab964df000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/4164172586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484410 0x55ab964deac0 unknown :-1 s=CLOSED pgs=1230 gs=1 cs=0 l=1 c_cookie=7985620733321733575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 -- 10.20.193.28:0/4164172586 >> 10.20.193.28:0/4164172586 conn(0x55ab96462910 msgr2=0x55ab964cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 -- 10.20.193.28:0/4164172586 shutdown_connections 2026-02-20T13:28:33.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.076+0000 7f61c06b1e00 1 -- 10.20.193.28:0/4164172586 wait complete. 2026-02-20T13:28:33.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.077+0000 7f61c06b1e00 1 -- start start 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.077+0000 7f61c06b1e00 1 Processor -- start 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.077+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e5ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.077+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e6410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.077+0000 7f61c06b1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab96462ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.077+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab9638e320 con 0x55ab96484d20 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.077+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab96463220 con 0x55ab964c99c0 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.077+0000 7f61c06b1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab964633e0 con 0x55ab96484410 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61bcc2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab96462ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e6410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61bcc2d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab96462ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34544/0 (socket says 10.20.193.28:34544) 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61bcc2d640 1 -- 10.20.193.28:0/1630369788 learned_addr learned my addr 10.20.193.28:0/1630369788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b77fe640 1 -- 10.20.193.28:0/1630369788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 msgr2=0x55ab964e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b77fe640 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b77fe640 1 -- 10.20.193.28:0/1630369788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 msgr2=0x55ab96462ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b77fe640 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab96462ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b77fe640 1 -- 10.20.193.28:0/1630369788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab963264f0 con 0x55ab96484d20 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b7fff640 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e5ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f61b77fe640 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e6410 secure :-1 s=READY pgs=1231 gs=2 cs=0 l=1 c_cookie=10072979714703176416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a8004820 tx=0x7f61a8002d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bca69ae7c9932e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.078+0000 7f6181ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f6181ffb640 1 -- 10.20.193.28:0/1630369788 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a8061040 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f6181ffb640 1 -- 10.20.193.28:0/1630369788 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f61a8038e00 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f6181ffb640 1 -- 10.20.193.28:0/1630369788 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a8068770 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab9633c120 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f6181ffb640 1 -- 10.20.193.28:0/1630369788 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f61a80688d0 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 10 client.19500 _ll_register_callbacks cb 0x55ab96347b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61a8057070 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f6181ffb640 1 -- 10.20.193.28:0/1630369788 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61a8038920 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 10 client.19500 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ab96320f70 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f6181ffb640 1 -- 10.20.193.28:0/1630369788 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f61a8053b80 con 0x55ab96484d20 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 10 client.19500 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 10 client.19500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 20 client.19500 populate_metadata read hostname 'trial028' 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab96587de0 0x55ab965a8290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 4 client.19500 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.079+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ab96024220 con 0x55ab96587de0 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.080+0000 7f61b7fff640 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab96587de0 0x55ab965a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.081+0000 7f61b7fff640 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab96587de0 0x55ab965a8290 crc :-1 s=READY pgs=325 gs=4 cs=0 l=0 c_cookie=4272440544265237762 s_cookie=5291354490642847404 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b4ac209e4e7f502 server_cookie=496eaadfdb6f56ac in_seq=0 out_seq=0 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.081+0000 7f6181ffb640 10 client.19500 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.081+0000 7f6181ffb640 1 -- 10.20.193.28:0/1630369788 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ab96024220 con 0x55ab96587de0 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.081+0000 7f6181ffb640 10 client.19500 handle_command_reply: tid=0 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.081+0000 7f61c06b1e00 1 client.19500 shutdown 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.081+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 msgr2=0x55ab964e6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.081+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e6410 secure :-1 s=READY pgs=1231 gs=2 cs=0 l=1 c_cookie=10072979714703176416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a8004820 tx=0x7f61a8002d30 comp rx=0 tx=0).stop 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 shutdown_connections 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab96587de0 0x55ab965a8290 crc :-1 s=READY pgs=325 gs=4 cs=0 l=0 c_cookie=4272440544265237762 s_cookie=5291354490642847404 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab96484d20 0x55ab964e6410 unknown :-1 s=CLOSED pgs=1231 gs=2 cs=0 l=1 c_cookie=10072979714703176416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab964c99c0 0x55ab96462ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 1 --2- 10.20.193.28:0/1630369788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab96484410 0x55ab964e5ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f6181ffb640 0 client.19500 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 >> 10.20.193.28:0/1630369788 conn(0x55ab96462910 msgr2=0x55ab964ddab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 shutdown_connections 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 1 -- 10.20.193.28:0/1630369788 wait complete. 2026-02-20T13:28:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.082+0000 7f61c06b1e00 20 client.19500 trim_cache size 0 max 16384 2026-02-20T13:28:33.090 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:28:33.090 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:28:33.090 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "10702b3a-12b5-4963-8b9c-fc9255732ea8", 2026-02-20T13:28:33.090 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:28:33.090 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:28:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 -- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f618c0b5760 msgr2=0x7f618c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f618c0b5760 0x7f618c0d5c10 secure :-1 s=READY pgs=519 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a8009950 tx=0x7f61a8002f90 comp rx=0 tx=0).stop 2026-02-20T13:28:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 -- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810b650 msgr2=0x7f61b80f3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810b650 0x7f61b80f3c70 secure :-1 s=READY pgs=1228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a400c9b0 tx=0x7f61a400ce80 comp rx=0 tx=0).stop 2026-02-20T13:28:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 -- 10.20.193.28:0/1289256119 shutdown_connections 2026-02-20T13:28:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f618c0b5760 0x7f618c0d5c10 unknown :-1 s=CLOSED pgs=519 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f61b8110140 0x7f61b80f4370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f61b810c040 0x7f61b8173c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 --2- 10.20.193.28:0/1289256119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61b810b650 0x7f61b80f3c70 unknown :-1 s=CLOSED pgs=1228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 -- 10.20.193.28:0/1289256119 >> 10.20.193.28:0/1289256119 conn(0x7f61b80e9080 msgr2=0x7f61b810a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 -- 10.20.193.28:0/1289256119 shutdown_connections 2026-02-20T13:28:33.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.083+0000 7f61bd42e640 1 -- 10.20.193.28:0/1289256119 wait complete. 2026-02-20T13:28:33.185 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:28:33.372 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.542+0000 7f70600fc640 1 -- 10.20.193.28:0/1194989178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f705810b200 msgr2=0x7f705810b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.542+0000 7f70600fc640 1 --2- 10.20.193.28:0/1194989178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f705810b200 0x7f705810b5d0 secure :-1 s=READY pgs=1232 gs=1 cs=0 l=1 c_cookie=5844422736602538062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7048009950 tx=0x7f704802f190 comp rx=0 tx=0).stop 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.543+0000 7f70600fc640 1 -- 10.20.193.28:0/1194989178 shutdown_connections 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.543+0000 7f70600fc640 1 --2- 10.20.193.28:0/1194989178 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7058111210 0x7f7058111bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.543+0000 7f70600fc640 1 --2- 10.20.193.28:0/1194989178 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f705810bbf0 0x7f7058110a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.543+0000 7f70600fc640 1 --2- 10.20.193.28:0/1194989178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f705810b200 0x7f705810b5d0 unknown :-1 s=CLOSED pgs=1232 gs=1 cs=0 l=1 c_cookie=5844422736602538062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.543+0000 7f70600fc640 1 -- 10.20.193.28:0/1194989178 >> 10.20.193.28:0/1194989178 conn(0x7f70580e8d70 msgr2=0x7f7058109180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.543+0000 7f70600fc640 1 -- 10.20.193.28:0/1194989178 shutdown_connections 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.543+0000 7f70600fc640 1 -- 10.20.193.28:0/1194989178 wait complete. 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.543+0000 7f70600fc640 1 Processor -- start 2026-02-20T13:28:33.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f70600fc640 1 -- start start 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f70600fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f705810b200 0x7f7058122a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f70600fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f705810bbf0 0x7f7058122f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f70600fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7058111210 0x7f7058128320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f70600fc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7058128940 con 0x7f7058111210 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f70600fc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7058128ab0 con 0x7f705810b200 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f70600fc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7058128c70 con 0x7f705810bbf0 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705e672640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7058111210 0x7f7058128320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705e672640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7058111210 0x7f7058128320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50702/0 (socket says 10.20.193.28:50702) 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705e672640 1 -- 10.20.193.28:0/2901373395 learned_addr learned my addr 10.20.193.28:0/2901373395 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705de71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f705810b200 0x7f7058122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705d670640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f705810bbf0 0x7f7058122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705de71640 1 -- 10.20.193.28:0/2901373395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f705810bbf0 msgr2=0x7f7058122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705de71640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f705810bbf0 0x7f7058122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705de71640 1 -- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7058111210 msgr2=0x7f7058128320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705de71640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7058111210 0x7f7058128320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705de71640 1 -- 10.20.193.28:0/2901373395 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7048009570 con 0x7f705810b200 2026-02-20T13:28:33.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.544+0000 7f705e672640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7058111210 0x7f7058128320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:33.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.545+0000 7f705de71640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f705810b200 0x7f7058122a10 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f704802f6a0 tx=0x7f7048004290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.545+0000 7f7046ffd640 1 -- 10.20.193.28:0/2901373395 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f704803d070 con 0x7f705810b200 2026-02-20T13:28:33.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.545+0000 7f7046ffd640 1 -- 10.20.193.28:0/2901373395 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7048002ad0 con 0x7f705810b200 2026-02-20T13:28:33.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.545+0000 7f7046ffd640 1 -- 10.20.193.28:0/2901373395 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7048041930 con 0x7f705810b200 2026-02-20T13:28:33.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.545+0000 7f70600fc640 1 -- 10.20.193.28:0/2901373395 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7058128ef0 con 0x7f705810b200 2026-02-20T13:28:33.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.545+0000 7f70600fc640 1 -- 10.20.193.28:0/2901373395 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70581694b0 con 0x7f705810b200 2026-02-20T13:28:33.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.548+0000 7f7046ffd640 1 -- 10.20.193.28:0/2901373395 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7048041ac0 con 0x7f705810b200 2026-02-20T13:28:33.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.549+0000 7f7046ffd640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70340b5760 0x7f70340d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.550+0000 7f7046ffd640 1 -- 10.20.193.28:0/2901373395 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f704810b070 con 0x7f705810b200 2026-02-20T13:28:33.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.550+0000 7f705d670640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70340b5760 0x7f70340d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.550+0000 7f705d670640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70340b5760 0x7f70340d5c10 secure :-1 s=READY pgs=520 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70581293b0 tx=0x7f704c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f70620f6e00 1 Processor -- start 2026-02-20T13:28:33.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f70620f6e00 1 -- start start 2026-02-20T13:28:33.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3cd550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce412400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce432d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f70620f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce2e37d0 con 0x55f6ce3cda90 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f70620f6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce2df500 con 0x55f6ce3cd180 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f70620f6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce2d94a0 con 0x55f6ce412940 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f705d670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce412400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f705d670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce412400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50718/0 (socket says 10.20.193.28:50718) 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f705d670640 1 -- 10.20.193.28:0/32214624 learned_addr learned my addr 10.20.193.28:0/32214624 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f705de71640 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.551+0000 7f705e672640 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce432d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f705d670640 1 -- 10.20.193.28:0/32214624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 msgr2=0x55f6ce432d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f705d670640 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce432d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f705d670640 1 -- 10.20.193.28:0/32214624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 msgr2=0x55f6ce3cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f705d670640 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f705d670640 1 -- 10.20.193.28:0/32214624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ce284d80 con 0x55f6ce3cda90 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f705d670640 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce412400 secure :-1 s=READY pgs=1233 gs=1 cs=0 l=1 c_cookie=1033635448533896900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f704c00b6d0 tx=0x7f704c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5835f6c91d4ec4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70264e6640 1 -- 10.20.193.28:0/32214624 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f704c01e640 con 0x55f6ce3cda90 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70264e6640 1 -- 10.20.193.28:0/32214624 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f704c015070 con 0x55f6ce3cda90 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70264e6640 1 -- 10.20.193.28:0/32214624 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f704c01cc20 con 0x55f6ce3cda90 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 -- 10.20.193.28:0/32214624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 msgr2=0x55f6ce412400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce412400 secure :-1 s=READY pgs=1233 gs=1 cs=0 l=1 c_cookie=1033635448533896900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f704c00b6d0 tx=0x7f704c013000 comp rx=0 tx=0).stop 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 -- 10.20.193.28:0/32214624 shutdown_connections 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce412400 unknown :-1 s=CLOSED pgs=1233 gs=1 cs=0 l=1 c_cookie=1033635448533896900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce432d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 --2- 10.20.193.28:0/32214624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3cd550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 -- 10.20.193.28:0/32214624 >> 10.20.193.28:0/32214624 conn(0x55f6ce3ab680 msgr2=0x55f6ce3cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 -- 10.20.193.28:0/32214624 shutdown_connections 2026-02-20T13:28:33.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.552+0000 7f70620f6e00 1 -- 10.20.193.28:0/32214624 wait complete. 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.554+0000 7f70620f6e00 1 -- start start 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.554+0000 7f70620f6e00 1 Processor -- start 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.554+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3e5700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.554+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.554+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce412940 0x55f6ce3eac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.554+0000 7f70620f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce3eb170 con 0x55f6ce412940 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.554+0000 7f70620f6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce3eb2e0 con 0x55f6ce3cd180 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.554+0000 7f70620f6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce3eb4a0 con 0x55f6ce3cda90 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705de71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705de71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3e5700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34576/0 (socket says 10.20.193.28:34576) 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705de71640 1 -- 10.20.193.28:0/2225111627 learned_addr learned my addr 10.20.193.28:0/2225111627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705d670640 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705e672640 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce412940 0x55f6ce3eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705e672640 1 -- 10.20.193.28:0/2225111627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce3cda90 msgr2=0x55f6ce3e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705e672640 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705e672640 1 -- 10.20.193.28:0/2225111627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 msgr2=0x55f6ce3e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705e672640 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705e672640 1 -- 10.20.193.28:0/2225111627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ce25d350 con 0x55f6ce412940 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f705e672640 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce412940 0x55f6ce3eac30 secure :-1 s=READY pgs=1234 gs=3 cs=0 l=1 c_cookie=7975419038861619806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7054006e90 tx=0x7f7054003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eae615c3a3bf25e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f70137fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f70137fe640 1 -- 10.20.193.28:0/2225111627 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7054003e70 con 0x55f6ce412940 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f70137fe640 1 -- 10.20.193.28:0/2225111627 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7054005600 con 0x55f6ce412940 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f70137fe640 1 -- 10.20.193.28:0/2225111627 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7054006570 con 0x55f6ce412940 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.555+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f704c00bd10 con 0x55f6ce412940 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70137fe640 1 -- 10.20.193.28:0/2225111627 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7054006700 con 0x55f6ce412940 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70137fe640 10 client.19512 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 10 client.19512 _ll_register_callbacks cb 0x55f6ce25a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6cdf6f6f0 con 0x55f6ce412940 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70137fe640 1 -- 10.20.193.28:0/2225111627 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7054006020 con 0x55f6ce412940 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 10 client.19512 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:33.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f6ce26f150 con 0x55f6ce412940 2026-02-20T13:28:33.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70137fe640 1 -- 10.20.193.28:0/2225111627 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f7054013a30 con 0x55f6ce412940 2026-02-20T13:28:33.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 10 client.19512 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:33.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 10 client.19512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:33.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 20 client.19512 populate_metadata read hostname 'trial028' 2026-02-20T13:28:33.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f6ce410030 0x55f6ce4104d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 4 client.19512 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:33.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.556+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6ce2e6d60 con 0x55f6ce410030 2026-02-20T13:28:33.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.557+0000 7f705de71640 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f6ce410030 0x55f6ce4104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f705de71640 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f6ce410030 0x55f6ce4104d0 crc :-1 s=READY pgs=326 gs=4 cs=0 l=0 c_cookie=3048731174959964689 s_cookie=9996765406809136273 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a4f44d9cb25e211 server_cookie=8abba52c1fc59c91 in_seq=0 out_seq=0 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70137fe640 10 client.19512 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70137fe640 1 -- 10.20.193.28:0/2225111627 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f6ce2e6d60 con 0x55f6ce410030 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70137fe640 10 client.19512 handle_command_reply: tid=0 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 client.19512 shutdown 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce412940 msgr2=0x55f6ce3eac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce412940 0x55f6ce3eac30 secure :-1 s=READY pgs=1234 gs=3 cs=0 l=1 c_cookie=7975419038861619806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7054006e90 tx=0x7f7054003b50 comp rx=0 tx=0).stop 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 shutdown_connections 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f6ce410030 0x55f6ce4104d0 crc :-1 s=READY pgs=326 gs=4 cs=0 l=0 c_cookie=3048731174959964689 s_cookie=9996765406809136273 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce412940 0x55f6ce3eac30 unknown :-1 s=CLOSED pgs=1234 gs=3 cs=0 l=1 c_cookie=7975419038861619806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 --2- 10.20.193.28:0/2225111627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3e5700 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.558+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 >> 10.20.193.28:0/2225111627 conn(0x55f6ce3ab680 msgr2=0x55f6ce3cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.559+0000 7f70137fe640 0 client.19512 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:33.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.559+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 shutdown_connections 2026-02-20T13:28:33.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.559+0000 7f70620f6e00 1 -- 10.20.193.28:0/2225111627 wait complete. 2026-02-20T13:28:33.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.559+0000 7f70620f6e00 20 client.19512 trim_cache size 0 max 16384 2026-02-20T13:28:33.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.567+0000 7f70620f6e00 1 Processor -- start 2026-02-20T13:28:33.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.567+0000 7f70620f6e00 1 -- start start 2026-02-20T13:28:33.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3d7770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce3e2a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f70620f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce2d70d0 con 0x55f6ce3cda90 2026-02-20T13:28:33.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f70620f6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f6cdf97700 con 0x55f6ce3cd180 2026-02-20T13:28:33.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f70620f6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce3d3020 con 0x55f6ce412940 2026-02-20T13:28:33.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705de71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3d7770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705de71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3d7770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34578/0 (socket says 10.20.193.28:34578) 2026-02-20T13:28:33.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705de71640 1 -- 10.20.193.28:0/3280476810 learned_addr learned my addr 10.20.193.28:0/3280476810 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705d670640 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705e672640 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce3e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705d670640 1 -- 10.20.193.28:0/3280476810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 msgr2=0x55f6ce3e2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705d670640 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce3e2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705d670640 1 -- 10.20.193.28:0/3280476810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 msgr2=0x55f6ce3d7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705d670640 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3d7770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705d670640 1 -- 10.20.193.28:0/3280476810 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ce3d7f40 con 0x55f6ce3cda90 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f705d670640 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5920 secure :-1 s=READY pgs=1235 gs=3 cs=0 l=1 c_cookie=1993851406393451794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55f6ce3ebcc0 tx=0x7f704c01c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bab954a4cfea512 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.568+0000 7f7025ce5640 1 -- 10.20.193.28:0/3280476810 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f704c005040 con 0x55f6ce3cda90 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f7025ce5640 1 -- 10.20.193.28:0/3280476810 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f704c02b040 con 0x55f6ce3cda90 2026-02-20T13:28:33.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f7025ce5640 1 -- 10.20.193.28:0/3280476810 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f704c004980 con 0x55f6ce3cda90 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 -- 10.20.193.28:0/3280476810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 msgr2=0x55f6ce3e5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5920 secure :-1 s=READY pgs=1235 gs=3 cs=0 l=1 c_cookie=1993851406393451794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55f6ce3ebcc0 tx=0x7f704c01c770 comp rx=0 tx=0).stop 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 -- 10.20.193.28:0/3280476810 shutdown_connections 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cda90 0x55f6ce3e5920 unknown :-1 s=CLOSED pgs=1235 gs=3 cs=0 l=1 c_cookie=1993851406393451794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce3e2a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 --2- 10.20.193.28:0/3280476810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cd180 0x55f6ce3d7770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 -- 10.20.193.28:0/3280476810 >> 10.20.193.28:0/3280476810 conn(0x55f6ce3ab680 msgr2=0x55f6ce3e2350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 -- 10.20.193.28:0/3280476810 shutdown_connections 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 -- 10.20.193.28:0/3280476810 wait complete. 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.569+0000 7f70620f6e00 1 -- start start 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f70620f6e00 1 Processor -- start 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cd180 0x55f6ce3f1620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cda90 0x55f6ce3ebcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f70620f6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce3ec230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f70620f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce3f1da0 con 0x55f6ce3cd180 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f70620f6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce3ec770 con 0x55f6ce3cda90 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f70620f6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f6ce3ec930 con 0x55f6ce412940 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705de71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cd180 0x55f6ce3f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705e672640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce3ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705de71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cd180 0x55f6ce3f1620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50750/0 (socket says 10.20.193.28:50750) 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705de71640 1 -- 10.20.193.28:0/1994029251 learned_addr learned my addr 10.20.193.28:0/1994029251 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705d670640 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cda90 0x55f6ce3ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705de71640 1 -- 10.20.193.28:0/1994029251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 msgr2=0x55f6ce3ec230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705de71640 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce3ec230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705de71640 1 -- 10.20.193.28:0/1994029251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cda90 msgr2=0x55f6ce3ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705de71640 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cda90 0x55f6ce3ebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.570+0000 7f705de71640 1 -- 10.20.193.28:0/1994029251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ce269bd0 con 0x55f6ce3cd180 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f705de71640 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cd180 0x55f6ce3f1620 secure :-1 s=READY pgs=1236 gs=3 cs=0 l=1 c_cookie=4428003969544768758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70480d1460 tx=0x7f7048038f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d736e2654bc4cf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70137fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:33.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70137fe640 1 -- 10.20.193.28:0/1994029251 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70480d70f0 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70137fe640 1 -- 10.20.193.28:0/1994029251 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f70480d96d0 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70137fe640 1 -- 10.20.193.28:0/1994029251 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70480dc300 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ce284d80 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70137fe640 1 -- 10.20.193.28:0/1994029251 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f70480cf460 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70137fe640 10 client.19518 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70620f6e00 10 client.19518 _ll_register_callbacks cb 0x55f6ce25a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6ce0314a0 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70137fe640 1 -- 10.20.193.28:0/1994029251 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f70480d12e0 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70620f6e00 10 client.19518 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f6ce25d680 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.571+0000 7f70137fe640 1 -- 10.20.193.28:0/1994029251 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f70480eb020 con 0x55f6ce3cd180 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.572+0000 7f70620f6e00 10 client.19518 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.572+0000 7f70620f6e00 10 client.19518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.572+0000 7f70620f6e00 20 client.19518 populate_metadata read hostname 'trial028' 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.572+0000 7f70620f6e00 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f6ce4c0a10 0x55f6ce4e0ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:33.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.572+0000 7f70620f6e00 4 client.19518 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:28:33.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.572+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f704c015070 con 0x55f6ce4c0a10 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.572+0000 7f705d670640 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f6ce4c0a10 0x55f6ce4e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f705d670640 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f6ce4c0a10 0x55f6ce4e0ec0 crc :-1 s=READY pgs=327 gs=4 cs=0 l=0 c_cookie=3818916786979835232 s_cookie=11267981074610933747 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34ff849592b58d60 server_cookie=9c5fe91648024ff3 in_seq=0 out_seq=0 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70137fe640 10 client.19518 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70137fe640 1 -- 10.20.193.28:0/1994029251 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x7f704c015070 con 0x55f6ce4c0a10 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70137fe640 10 client.19518 handle_command_reply: tid=0 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 client.19518 shutdown 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cd180 msgr2=0x55f6ce3f1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cd180 0x55f6ce3f1620 secure :-1 s=READY pgs=1236 gs=3 cs=0 l=1 c_cookie=4428003969544768758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70480d1460 tx=0x7f7048038f30 comp rx=0 tx=0).stop 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 shutdown_connections 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f6ce4c0a10 0x55f6ce4e0ec0 crc :-1 s=READY pgs=327 gs=4 cs=0 l=0 c_cookie=3818916786979835232 s_cookie=11267981074610933747 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f6ce412940 0x55f6ce3ec230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f6ce3cda90 0x55f6ce3ebcf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 --2- 10.20.193.28:0/1994029251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6ce3cd180 0x55f6ce3f1620 unknown :-1 s=CLOSED pgs=1236 gs=3 cs=0 l=1 c_cookie=4428003969544768758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70137fe640 0 client.19518 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 >> 10.20.193.28:0/1994029251 conn(0x55f6ce3ab680 msgr2=0x55f6ce3e2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 shutdown_connections 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 1 -- 10.20.193.28:0/1994029251 wait complete. 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.573+0000 7f70620f6e00 20 client.19518 trim_cache size 0 max 16384 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "10702b3a-12b5-4963-8b9c-fc9255732ea8", 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:28:33.580 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:28:33.581 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:28:33.582 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.583 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:28:33.584 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.585 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:28:33.586 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.587 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:28:33.588 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 -- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70340b5760 msgr2=0x7f70340d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70340b5760 0x7f70340d5c10 secure :-1 s=READY pgs=520 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70581293b0 tx=0x7f704c00b410 comp rx=0 tx=0).stop 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 -- 10.20.193.28:0/2901373395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f705810b200 msgr2=0x7f7058122a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f705810b200 0x7f7058122a10 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f704802f6a0 tx=0x7f7048004290 comp rx=0 tx=0).stop 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 -- 10.20.193.28:0/2901373395 shutdown_connections 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f70340b5760 0x7f70340d5c10 unknown :-1 s=CLOSED pgs=520 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7058111210 0x7f7058128320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f705810bbf0 0x7f7058122f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 --2- 10.20.193.28:0/2901373395 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f705810b200 0x7f7058122a10 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 -- 10.20.193.28:0/2901373395 >> 10.20.193.28:0/2901373395 conn(0x7f70580e8d70 msgr2=0x7f7058109150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 -- 10.20.193.28:0/2901373395 shutdown_connections 2026-02-20T13:28:33.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:33.574+0000 7f70600fc640 1 -- 10.20.193.28:0/2901373395 wait complete. 2026-02-20T13:28:33.678 INFO:tasks.cephfs.filesystem:scrub status for tag:10702b3a-12b5-4963-8b9c-fc9255732ea8 - {'path': '/', 'tag': '10702b3a-12b5-4963-8b9c-fc9255732ea8', 'options': 'recursive,force'} 2026-02-20T13:28:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:33 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:28:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:33 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:33 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:28:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:33 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:28:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:33 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:33.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:33 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:33 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:28:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:33 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:33 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:28:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:33 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:28:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:33 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:33.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:33 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:33 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:28:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:33 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:33 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:28:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:33 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:28:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:33 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:33.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:33 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:34 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:28:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:34 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:34 trial127 ceph-mon[43817]: pgmap v518: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:28:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:34 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:28:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:34 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:34 trial034 ceph-mon[43332]: pgmap v518: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:28:35.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:34 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:28:35.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:34 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:28:35.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:34 trial028 ceph-mon[37442]: pgmap v518: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:28:35.247 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.4 2026-02-20T13:28:35.247 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:28:35.434 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.618+0000 7fbffbd9f640 1 -- 10.20.193.28:0/651800406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410f230 msgr2=0x7fbff410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.618+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/651800406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410f230 0x7fbff410f600 secure :-1 s=READY pgs=1237 gs=1 cs=0 l=1 c_cookie=5610775035196909542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfe4009950 tx=0x7fbfe402f190 comp rx=0 tx=0).stop 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 -- 10.20.193.28:0/651800406 shutdown_connections 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/651800406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbff4115420 0x7fbff4175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/651800406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbff410fc20 0x7fbff4114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/651800406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410f230 0x7fbff410f600 unknown :-1 s=CLOSED pgs=1237 gs=1 cs=0 l=1 c_cookie=5610775035196909542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 -- 10.20.193.28:0/651800406 >> 10.20.193.28:0/651800406 conn(0x7fbff405f830 msgr2=0x7fbff410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 -- 10.20.193.28:0/651800406 shutdown_connections 2026-02-20T13:28:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 -- 10.20.193.28:0/651800406 wait complete. 2026-02-20T13:28:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 Processor -- start 2026-02-20T13:28:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.619+0000 7fbffbd9f640 1 -- start start 2026-02-20T13:28:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbffbd9f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbff410f230 0x7fbff411db40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbffbd9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410fc20 0x7fbff411e080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbffbd9f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbff4115420 0x7fbff4123450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbffbd9f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbff4123a70 con 0x7fbff410fc20 2026-02-20T13:28:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbffbd9f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbff4123be0 con 0x7fbff4115420 2026-02-20T13:28:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbffbd9f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbff4123da0 con 0x7fbff410f230 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9b14640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbff410f230 0x7fbff411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410fc20 0x7fbff411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410fc20 0x7fbff411e080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50760/0 (socket says 10.20.193.28:50760) 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 -- 10.20.193.28:0/486255254 learned_addr learned my addr 10.20.193.28:0/486255254 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbffa315640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbff4115420 0x7fbff4123450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 -- 10.20.193.28:0/486255254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbff410f230 msgr2=0x7fbff411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbff410f230 0x7fbff411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 -- 10.20.193.28:0/486255254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbff4115420 msgr2=0x7fbff4123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbff4115420 0x7fbff4123450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 -- 10.20.193.28:0/486255254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe4009570 con 0x7fbff410fc20 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.620+0000 7fbff9313640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410fc20 0x7fbff411e080 secure :-1 s=READY pgs=1238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfe8009480 tx=0x7fbfe800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.621+0000 7fbfe2ffd640 1 -- 10.20.193.28:0/486255254 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfe800cd40 con 0x7fbff410fc20 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.621+0000 7fbfe2ffd640 1 -- 10.20.193.28:0/486255254 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbfe8004d30 con 0x7fbff410fc20 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.621+0000 7fbfe2ffd640 1 -- 10.20.193.28:0/486255254 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfe80106b0 con 0x7fbff410fc20 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.621+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff4124080 con 0x7fbff410fc20 2026-02-20T13:28:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.621+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff4164780 con 0x7fbff410fc20 2026-02-20T13:28:35.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.621+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff41242a0 con 0x7fbff410fc20 2026-02-20T13:28:35.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.623+0000 7fbfe2ffd640 1 -- 10.20.193.28:0/486255254 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbfe801f060 con 0x7fbff410fc20 2026-02-20T13:28:35.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.625+0000 7fbfe2ffd640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfd00b5760 0x7fbfd00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:35.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.625+0000 7fbfe2ffd640 1 -- 10.20.193.28:0/486255254 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbfe8014070 con 0x7fbff410fc20 2026-02-20T13:28:35.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.625+0000 7fbfe2ffd640 1 -- 10.20.193.28:0/486255254 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fbfe811f730 con 0x7fbff410fc20 2026-02-20T13:28:35.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.625+0000 7fbff9b14640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfd00b5760 0x7fbfd00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:35.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.626+0000 7fbff9b14640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfd00b5760 0x7fbfd00d5c10 secure :-1 s=READY pgs=521 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfe40098a0 tx=0x7fbfe403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:35.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.768+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbff4110510 con 0x7fbff410fc20 2026-02-20T13:28:35.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.768+0000 7fbfe2ffd640 1 -- 10.20.193.28:0/486255254 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11997 (secure 0 0 0) 0x7fbfe80a9740 con 0x7fbff410fc20 2026-02-20T13:28:35.771 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:28:35.771 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T13:28:03:632229+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:28:03.346734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[3],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:28:35.771 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfd00b5760 msgr2=0x7fbfd00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfd00b5760 0x7fbfd00d5c10 secure :-1 s=READY pgs=521 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfe40098a0 tx=0x7fbfe403a040 comp rx=0 tx=0).stop 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410fc20 msgr2=0x7fbff411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410fc20 0x7fbff411e080 secure :-1 s=READY pgs=1238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfe8009480 tx=0x7fbfe800ee60 comp rx=0 tx=0).stop 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 shutdown_connections 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbfd00b5760 0x7fbfd00d5c10 unknown :-1 s=CLOSED pgs=521 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbff410fc20 0x7fbff411e080 unknown :-1 s=CLOSED pgs=1238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbff4115420 0x7fbff4123450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 --2- 10.20.193.28:0/486255254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbff410f230 0x7fbff411db40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 >> 10.20.193.28:0/486255254 conn(0x7fbff405f830 msgr2=0x7fbff410cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 shutdown_connections 2026-02-20T13:28:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:35.770+0000 7fbffbd9f640 1 -- 10.20.193.28:0/486255254 wait complete. 2026-02-20T13:28:35.909 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 147.4 --await-for 45.0' 2026-02-20T13:28:35.910 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 147.4 --await-for 45.0 2026-02-20T13:28:36.094 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 -- 10.20.193.28:0/1931748498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f648410fc20 msgr2=0x7f6484114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 --2- 10.20.193.28:0/1931748498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f648410fc20 0x7f6484114c70 secure :-1 s=READY pgs=1239 gs=2 cs=0 l=1 c_cookie=15481166203665548358 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6478009890 tx=0x7f647802f120 comp rx=0 tx=0).stop 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 -- 10.20.193.28:0/1931748498 shutdown_connections 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 --2- 10.20.193.28:0/1931748498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f648410fc20 0x7f6484114c70 unknown :-1 s=CLOSED pgs=1239 gs=2 cs=0 l=1 c_cookie=15481166203665548358 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 --2- 10.20.193.28:0/1931748498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6484115420 0x7f6484175df0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 --2- 10.20.193.28:0/1931748498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f648410f230 0x7f648410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 -- 10.20.193.28:0/1931748498 >> 10.20.193.28:0/1931748498 conn(0x7f648405f830 msgr2=0x7f648410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 -- 10.20.193.28:0/1931748498 shutdown_connections 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.278+0000 7f648bc0e640 1 -- 10.20.193.28:0/1931748498 wait complete. 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.279+0000 7f648bc0e640 1 Processor -- start 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.279+0000 7f648bc0e640 1 -- start start 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.279+0000 7f648bc0e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f648410f230 0x7f64840f5540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.279+0000 7f648bc0e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f648410fc20 0x7f6484175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.279+0000 7f648bc0e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6484115420 0x7f64840f5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.279+0000 7f648bc0e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f64840fae00 con 0x7f6484115420 2026-02-20T13:28:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.279+0000 7f648bc0e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f64840faf70 con 0x7f648410f230 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.279+0000 7f648bc0e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f64840fb130 con 0x7f648410fc20 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f648410f230 0x7f64840f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f648410f230 0x7f64840f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34614/0 (socket says 10.20.193.28:34614) 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 -- 10.20.193.28:0/4121886467 learned_addr learned my addr 10.20.193.28:0/4121886467 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f648a184640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6484115420 0x7f64840f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489182640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f648410fc20 0x7f6484175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 -- 10.20.193.28:0/4121886467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f648410fc20 msgr2=0x7f6484175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f648410fc20 0x7f6484175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 -- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6484115420 msgr2=0x7f64840f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6484115420 0x7f64840f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 -- 10.20.193.28:0/4121886467 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64780094b0 con 0x7f648410f230 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6489983640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f648410f230 0x7f64840f5540 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474009480 tx=0x7f647400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6472ffd640 1 -- 10.20.193.28:0/4121886467 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f647400cd40 con 0x7f648410f230 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6472ffd640 1 -- 10.20.193.28:0/4121886467 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6474004d30 con 0x7f648410f230 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f648bc0e640 1 -- 10.20.193.28:0/4121886467 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64840fb410 con 0x7f648410f230 2026-02-20T13:28:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.280+0000 7f6472ffd640 1 -- 10.20.193.28:0/4121886467 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6474010740 con 0x7f648410f230 2026-02-20T13:28:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.281+0000 7f648bc0e640 1 -- 10.20.193.28:0/4121886467 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64840fb8e0 con 0x7f648410f230 2026-02-20T13:28:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.284+0000 7f6472ffd640 1 -- 10.20.193.28:0/4121886467 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f647401f060 con 0x7f648410f230 2026-02-20T13:28:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.285+0000 7f6472ffd640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64600b57d0 0x7f64600d5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.285+0000 7f6472ffd640 1 -- 10.20.193.28:0/4121886467 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6474014070 con 0x7f648410f230 2026-02-20T13:28:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f6489182640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64600b57d0 0x7f64600d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f6489182640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64600b57d0 0x7f64600d5c80 secure :-1 s=READY pgs=522 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64780023d0 tx=0x7f647803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f648dc08e00 1 Processor -- start 2026-02-20T13:28:36.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f648dc08e00 1 -- start start 2026-02-20T13:28:36.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb2ec20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb738c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb941e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f648dc08e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55972ba43780 con 0x55972bb2e850 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f648dc08e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55972ba3f4b0 con 0x55972bb2f160 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.286+0000 7f648dc08e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55972ba39610 con 0x55972bb73e00 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb738c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34616/0 (socket says 10.20.193.28:34616) 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 -- 10.20.193.28:0/3512434422 learned_addr learned my addr 10.20.193.28:0/3512434422 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f648a184640 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb941e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489983640 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb2ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 -- 10.20.193.28:0/3512434422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 msgr2=0x55972bb941e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb941e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 -- 10.20.193.28:0/3512434422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 msgr2=0x55972bb2ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb2ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 -- 10.20.193.28:0/3512434422 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55972b9e4c50 con 0x55972bb2f160 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489983640 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb2ec20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f6489182640 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb738c0 secure :-1 s=READY pgs=436 gs=2 cs=0 l=1 c_cookie=17354891764806926663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6478009230 tx=0x7f647803e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0d8f61c24ab4147 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f64524e6640 1 -- 10.20.193.28:0/3512434422 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f647803d040 con 0x55972bb2f160 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f64524e6640 1 -- 10.20.193.28:0/3512434422 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6478049040 con 0x55972bb2f160 2026-02-20T13:28:36.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.287+0000 7f64524e6640 1 -- 10.20.193.28:0/3512434422 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6478043690 con 0x55972bb2f160 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 -- 10.20.193.28:0/3512434422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 msgr2=0x55972bb738c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb738c0 secure :-1 s=READY pgs=436 gs=2 cs=0 l=1 c_cookie=17354891764806926663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6478009230 tx=0x7f647803e000 comp rx=0 tx=0).stop 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 -- 10.20.193.28:0/3512434422 shutdown_connections 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb941e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb738c0 unknown :-1 s=CLOSED pgs=436 gs=2 cs=0 l=1 c_cookie=17354891764806926663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3512434422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb2ec20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 -- 10.20.193.28:0/3512434422 >> 10.20.193.28:0/3512434422 conn(0x55972ba4c110 msgr2=0x55972bb2d130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 -- 10.20.193.28:0/3512434422 shutdown_connections 2026-02-20T13:28:36.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.288+0000 7f648dc08e00 1 -- 10.20.193.28:0/3512434422 wait complete. 2026-02-20T13:28:36.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.289+0000 7f648dc08e00 1 -- start start 2026-02-20T13:28:36.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.289+0000 7f648dc08e00 1 Processor -- start 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb465c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb46b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb4baf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f648dc08e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55972bb4c030 con 0x55972bb2e850 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f648dc08e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55972bb4c1a0 con 0x55972bb2f160 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f648dc08e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55972bb4c360 con 0x55972bb73e00 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb46b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb46b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34626/0 (socket says 10.20.193.28:34626) 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 -- 10.20.193.28:0/2151880966 learned_addr learned my addr 10.20.193.28:0/2151880966 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f648a184640 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb4baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489983640 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 -- 10.20.193.28:0/2151880966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 msgr2=0x55972bb4baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb4baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 -- 10.20.193.28:0/2151880966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 msgr2=0x55972bb465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 -- 10.20.193.28:0/2151880966 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6484176660 con 0x55972bb2f160 2026-02-20T13:28:36.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f6489182640 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb46b00 secure :-1 s=READY pgs=437 gs=2 cs=0 l=1 c_cookie=14888386701451595974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6478038580 tx=0x7f6478038f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce9e2cd2aaac10c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.290+0000 7f643f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f643f7fe640 1 -- 10.20.193.28:0/2151880966 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f647803d040 con 0x55972bb2f160 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f643f7fe640 1 -- 10.20.193.28:0/2151880966 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6478038b00 con 0x55972bb2f160 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f643f7fe640 1 -- 10.20.193.28:0/2151880966 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6478056680 con 0x55972bb2f160 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64840fb8e0 con 0x55972bb2f160 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f643f7fe640 1 -- 10.20.193.28:0/2151880966 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6478056810 con 0x55972bb2f160 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f643f7fe640 10 client.29477 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f648dc08e00 10 client.29477 _ll_register_callbacks cb 0x55972b9ba320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55972b6cfeb0 con 0x55972bb2f160 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f643f7fe640 1 -- 10.20.193.28:0/2151880966 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f64780042e0 con 0x55972bb2f160 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f648dc08e00 10 client.29477 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:36.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.291+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55972b9bce60 con 0x55972bb2f160 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f643f7fe640 1 -- 10.20.193.28:0/2151880966 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f647804c070 con 0x55972bb2f160 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f648dc08e00 10 client.29477 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f648dc08e00 10 client.29477 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f648dc08e00 20 client.29477 populate_metadata read hostname 'trial028' 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55972bb70c00 0x55972bb71070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f648dc08e00 4 client.29477 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55972ba0b700 con 0x55972bb70c00 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f6489983640 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55972bb70c00 0x55972bb71070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f6489983640 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55972bb70c00 0x55972bb71070 crc :-1 s=READY pgs=328 gs=4 cs=0 l=0 c_cookie=6581743106915202082 s_cookie=1560605190206696484 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b570c7bf28e7422 server_cookie=15a86226ece6ac24 in_seq=0 out_seq=0 2026-02-20T13:28:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.292+0000 7f643f7fe640 10 client.29477 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f643f7fe640 1 -- 10.20.193.28:0/2151880966 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55972ba0b700 con 0x55972bb70c00 2026-02-20T13:28:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f643f7fe640 10 client.29477 handle_command_reply: tid=0 2026-02-20T13:28:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 client.29477 shutdown 2026-02-20T13:28:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 msgr2=0x55972bb46b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb46b00 secure :-1 s=READY pgs=437 gs=2 cs=0 l=1 c_cookie=14888386701451595974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6478038580 tx=0x7f6478038f70 comp rx=0 tx=0).stop 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 shutdown_connections 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55972bb70c00 0x55972bb71070 crc :-1 s=READY pgs=328 gs=4 cs=0 l=0 c_cookie=6581743106915202082 s_cookie=1560605190206696484 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb4baf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2f160 0x55972bb46b00 unknown :-1 s=CLOSED pgs=437 gs=2 cs=0 l=1 c_cookie=14888386701451595974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2151880966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb465c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f643f7fe640 0 client.29477 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 >> 10.20.193.28:0/2151880966 conn(0x55972ba4c110 msgr2=0x55972bb2d840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 shutdown_connections 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 1 -- 10.20.193.28:0/2151880966 wait complete. 2026-02-20T13:28:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.293+0000 7f648dc08e00 20 client.29477 trim_cache size 0 max 16384 2026-02-20T13:28:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648dc08e00 1 Processor -- start 2026-02-20T13:28:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648dc08e00 1 -- start start 2026-02-20T13:28:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb43bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb2f160 0x55972bb2ca30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb73e00 0x55972bb2cf70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648dc08e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55972bb39000 con 0x55972bb2e850 2026-02-20T13:28:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648dc08e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55972ba37240 con 0x55972bb73e00 2026-02-20T13:28:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648dc08e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55972b6f7ec0 con 0x55972bb2f160 2026-02-20T13:28:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb43bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb43bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50800/0 (socket says 10.20.193.28:50800) 2026-02-20T13:28:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 -- 10.20.193.28:0/2948437877 learned_addr learned my addr 10.20.193.28:0/2948437877 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648a184640 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb73e00 0x55972bb2cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489182640 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb2f160 0x55972bb2ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 -- 10.20.193.28:0/2948437877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb2f160 msgr2=0x55972bb2ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb2f160 0x55972bb2ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 -- 10.20.193.28:0/2948437877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb73e00 msgr2=0x55972bb2cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb73e00 0x55972bb2cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 -- 10.20.193.28:0/2948437877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55972bb39230 con 0x55972bb2e850 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f648a184640 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb73e00 0x55972bb2cf70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.303+0000 7f6489983640 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb43bc0 secure :-1 s=READY pgs=1240 gs=1 cs=0 l=1 c_cookie=16400136597802123016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64740a9790 tx=0x7f64740d2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e398fd5813e0ff08 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f6451ce5640 1 -- 10.20.193.28:0/2948437877 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64740adbc0 con 0x55972bb2e850 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f6451ce5640 1 -- 10.20.193.28:0/2948437877 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f64740b2ee0 con 0x55972bb2e850 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f6451ce5640 1 -- 10.20.193.28:0/2948437877 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64740af080 con 0x55972bb2e850 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 -- 10.20.193.28:0/2948437877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 msgr2=0x55972bb43bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb43bc0 secure :-1 s=READY pgs=1240 gs=1 cs=0 l=1 c_cookie=16400136597802123016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64740a9790 tx=0x7f64740d2040 comp rx=0 tx=0).stop 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 -- 10.20.193.28:0/2948437877 shutdown_connections 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb73e00 0x55972bb2cf70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb2f160 0x55972bb2ca30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 --2- 10.20.193.28:0/2948437877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2e850 0x55972bb43bc0 unknown :-1 s=CLOSED pgs=1240 gs=1 cs=0 l=1 c_cookie=16400136597802123016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 -- 10.20.193.28:0/2948437877 >> 10.20.193.28:0/2948437877 conn(0x55972ba4c110 msgr2=0x55972bb46460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 -- 10.20.193.28:0/2948437877 shutdown_connections 2026-02-20T13:28:36.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.304+0000 7f648dc08e00 1 -- 10.20.193.28:0/2948437877 wait complete. 2026-02-20T13:28:36.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.305+0000 7f648dc08e00 1 -- start start 2026-02-20T13:28:36.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.305+0000 7f648dc08e00 1 Processor -- start 2026-02-20T13:28:36.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.305+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2e850 0x55972bb4ff10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.305+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2f160 0x55972bb50450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.305+0000 7f648dc08e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb50990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.305+0000 7f648dc08e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55972bbd9330 con 0x55972bb2f160 2026-02-20T13:28:36.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.305+0000 7f648dc08e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55972bbd9470 con 0x55972bb2e850 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.305+0000 7f648dc08e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55972bbd9630 con 0x55972bb73e00 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489182640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2f160 0x55972bb50450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2e850 0x55972bb4ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2e850 0x55972bb4ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34646/0 (socket says 10.20.193.28:34646) 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 -- 10.20.193.28:0/3722421307 learned_addr learned my addr 10.20.193.28:0/3722421307 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 -- 10.20.193.28:0/3722421307 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 msgr2=0x55972bb50990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb50990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 -- 10.20.193.28:0/3722421307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2f160 msgr2=0x55972bb50450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2f160 0x55972bb50450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 -- 10.20.193.28:0/3722421307 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55972b9ced80 con 0x55972bb2e850 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489182640 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2f160 0x55972bb50450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f6489983640 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2e850 0x55972bb4ff10 secure :-1 s=READY pgs=438 gs=2 cs=0 l=1 c_cookie=6546325071289350521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64740ad1a0 tx=0x7f6474005610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad937f7ea6f7979 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f643f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f643f7fe640 1 -- 10.20.193.28:0/3722421307 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64740b8300 con 0x55972bb2e850 2026-02-20T13:28:36.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f643f7fe640 1 -- 10.20.193.28:0/3722421307 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f64740adbc0 con 0x55972bb2e850 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64840fb410 con 0x55972bb2e850 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f648dc08e00 10 client.29483 _ll_register_callbacks cb 0x55972b9ba320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.306+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6478049040 con 0x55972bb2e850 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f643f7fe640 1 -- 10.20.193.28:0/3722421307 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64740ae0d0 con 0x55972bb2e850 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f643f7fe640 1 -- 10.20.193.28:0/3722421307 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f64740b7e70 con 0x55972bb2e850 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f643f7fe640 1 -- 10.20.193.28:0/3722421307 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f64740b8070 con 0x55972bb2e850 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f648dc08e00 10 client.29483 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55972b9c9800 con 0x55972bb2e850 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f643f7fe640 1 -- 10.20.193.28:0/3722421307 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f64740cc070 con 0x55972bb2e850 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f648dc08e00 10 client.29483 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f648dc08e00 10 client.29483 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f648dc08e00 20 client.29483 populate_metadata read hostname 'trial028' 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55972bc211f0 0x55972bc416a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f648dc08e00 4 client.29483 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.4, "await_for": 45.0}] 2026-02-20T13:28:36.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.4, "await_for": 45.0}) -- 0x55972b718a60 con 0x55972bc211f0 2026-02-20T13:28:36.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.307+0000 7f6489182640 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55972bc211f0 0x55972bc416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.308+0000 7f6489182640 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55972bc211f0 0x55972bc416a0 crc :-1 s=READY pgs=329 gs=4 cs=0 l=0 c_cookie=2201572538840974585 s_cookie=5208301995840920049 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e8d8e8f44df04f9 server_cookie=48479b12090e59f1 in_seq=0 out_seq=0 2026-02-20T13:28:36.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.308+0000 7f643f7fe640 10 client.29483 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f643f7fe640 1 -- 10.20.193.28:0/3722421307 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55972b718a60 con 0x55972bc211f0 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f643f7fe640 10 client.29483 handle_command_reply: tid=0 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 client.29483 shutdown 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2e850 msgr2=0x55972bb4ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2e850 0x55972bb4ff10 secure :-1 s=READY pgs=438 gs=2 cs=0 l=1 c_cookie=6546325071289350521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64740ad1a0 tx=0x7f6474005610 comp rx=0 tx=0).stop 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 shutdown_connections 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55972bc211f0 0x55972bc416a0 crc :-1 s=READY pgs=329 gs=4 cs=0 l=0 c_cookie=2201572538840974585 s_cookie=5208301995840920049 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55972bb2f160 0x55972bb50450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55972bb73e00 0x55972bb50990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 --2- 10.20.193.28:0/3722421307 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55972bb2e850 0x55972bb4ff10 unknown :-1 s=CLOSED pgs=438 gs=2 cs=0 l=1 c_cookie=6546325071289350521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f643f7fe640 0 client.29483 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 >> 10.20.193.28:0/3722421307 conn(0x55972ba4c110 msgr2=0x55972bb42bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 shutdown_connections 2026-02-20T13:28:36.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 1 -- 10.20.193.28:0/3722421307 wait complete. 2026-02-20T13:28:36.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.312+0000 7f648dc08e00 20 client.29483 trim_cache size 0 max 16384 2026-02-20T13:28:36.316 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:28:36.316 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T13:28:36.316 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:28:36.316 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 38, 2026-02-20T13:28:36.316 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:28:36.316 INFO:teuthology.orchestra.run.trial028.stdout: "a00c1c5f": { 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "version": 38, 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 147.4, 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:28:36.317 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:28:36.318 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:28:36.318 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:36.318 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:36.318 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:36.318 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:36.318 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:28:36.318 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:28:36.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 -- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64600b57d0 msgr2=0x7f64600d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64600b57d0 0x7f64600d5c80 secure :-1 s=READY pgs=522 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64780023d0 tx=0x7f647803a040 comp rx=0 tx=0).stop 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 -- 10.20.193.28:0/4121886467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f648410f230 msgr2=0x7f64840f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f648410f230 0x7f64840f5540 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474009480 tx=0x7f647400ee60 comp rx=0 tx=0).stop 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 -- 10.20.193.28:0/4121886467 shutdown_connections 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f64600b57d0 0x7f64600d5c80 unknown :-1 s=CLOSED pgs=522 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6484115420 0x7f64840f5c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f648410fc20 0x7f6484175cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 --2- 10.20.193.28:0/4121886467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f648410f230 0x7f64840f5540 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 -- 10.20.193.28:0/4121886467 >> 10.20.193.28:0/4121886467 conn(0x7f648405f830 msgr2=0x7f6484111a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 -- 10.20.193.28:0/4121886467 shutdown_connections 2026-02-20T13:28:36.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:28:36.313+0000 7f648bc0e640 1 -- 10.20.193.28:0/4121886467 wait complete. 2026-02-20T13:28:36.452 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a00c1c5f', quiesce took 1.2 seconds. Will release after: 26.2 2026-02-20T13:28:36.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 -- 10.20.193.28:0/451249455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 msgr2=0x7f270410edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 --2- 10.20.193.28:0/451249455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 0x7f270410edb0 secure :-1 s=READY pgs=439 gs=2 cs=0 l=1 c_cookie=6695029414481586615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec009950 tx=0x7f26ec02f190 comp rx=0 tx=0).stop 2026-02-20T13:28:36.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 -- 10.20.193.28:0/451249455 shutdown_connections 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 --2- 10.20.193.28:0/451249455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f270410f2f0 0x7f2704171080 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 --2- 10.20.193.28:0/451249455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 0x7f270410edb0 unknown :-1 s=CLOSED pgs=439 gs=2 cs=0 l=1 c_cookie=6695029414481586615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 --2- 10.20.193.28:0/451249455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27041100b0 0x7f27041104a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 -- 10.20.193.28:0/451249455 >> 10.20.193.28:0/451249455 conn(0x7f27040ec320 msgr2=0x7f270410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 -- 10.20.193.28:0/451249455 shutdown_connections 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 -- 10.20.193.28:0/451249455 wait complete. 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 Processor -- start 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.759+0000 7f2703577640 1 -- start start 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2703577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 0x7f27040f8240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2703577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f270410f2f0 0x7f2704171060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2703577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27041100b0 0x7f27040f8a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2703577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27040f96e0 con 0x7f27041100b0 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2703577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f27040f9850 con 0x7f270410e940 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2703577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f27040f9a10 con 0x7f270410f2f0 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27041100b0 0x7f27040f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 0x7f27040f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 0x7f27040f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34650/0 (socket says 10.20.193.28:34650) 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702575640 1 -- 10.20.193.28:0/2699673942 learned_addr learned my addr 10.20.193.28:0/2699673942 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2701d74640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f270410f2f0 0x7f2704171060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702d76640 1 -- 10.20.193.28:0/2699673942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f270410f2f0 msgr2=0x7f2704171060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702d76640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f270410f2f0 0x7f2704171060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702d76640 1 -- 10.20.193.28:0/2699673942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 msgr2=0x7f27040f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702d76640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 0x7f27040f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702d76640 1 -- 10.20.193.28:0/2699673942 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f400a590 con 0x7f27041100b0 2026-02-20T13:28:36.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2702d76640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27041100b0 0x7f27040f8a80 secure :-1 s=READY pgs=1241 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f400aef0 tx=0x7f26f4003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f26eb7fe640 1 -- 10.20.193.28:0/2699673942 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26f400fb50 con 0x7f27041100b0 2026-02-20T13:28:36.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f26eb7fe640 1 -- 10.20.193.28:0/2699673942 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26f400fcb0 con 0x7f27041100b0 2026-02-20T13:28:36.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f26eb7fe640 1 -- 10.20.193.28:0/2699673942 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26f4010870 con 0x7f27041100b0 2026-02-20T13:28:36.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.760+0000 7f2703577640 1 -- 10.20.193.28:0/2699673942 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ec009570 con 0x7f27041100b0 2026-02-20T13:28:36.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.761+0000 7f2703577640 1 -- 10.20.193.28:0/2699673942 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27040f9fe0 con 0x7f27041100b0 2026-02-20T13:28:36.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.763+0000 7f26eb7fe640 1 -- 10.20.193.28:0/2699673942 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f26f4017070 con 0x7f27041100b0 2026-02-20T13:28:36.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.765+0000 7f26eb7fe640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26dc0b5760 0x7f26dc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.765+0000 7f26eb7fe640 1 -- 10.20.193.28:0/2699673942 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f26f40e7f90 con 0x7f27041100b0 2026-02-20T13:28:36.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.765+0000 7f2702575640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26dc0b5760 0x7f26dc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f2702575640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26dc0b5760 0x7f26dc0d5c10 secure :-1 s=READY pgs=523 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f80095b0 tx=0x7f26f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f270b419e00 1 Processor -- start 2026-02-20T13:28:36.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f270b419e00 1 -- start start 2026-02-20T13:28:36.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f270b419e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d574c0 0x560f69d778a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f270b419e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d77de0 0x560f69d981c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f270b419e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d98700 0x560f69db8ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f270b419e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f69c6cfd0 con 0x560f69d77de0 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f270b419e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560f69c68d00 con 0x560f69d574c0 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f270b419e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560f69c62ca0 con 0x560f69d98700 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f2701d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d77de0 0x560f69d981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f2702575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d574c0 0x560f69d778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f2701d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d77de0 0x560f69d981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50834/0 (socket says 10.20.193.28:50834) 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f2702575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d574c0 0x560f69d778a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:34664/0 (socket says 10.20.193.28:34664) 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.766+0000 7f2701d74640 1 -- 10.20.193.28:0/1939483503 learned_addr learned my addr 10.20.193.28:0/1939483503 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f2702d76640 1 --2- 10.20.193.28:0/1939483503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d98700 0x560f69db8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f2701d74640 1 -- 10.20.193.28:0/1939483503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d98700 msgr2=0x560f69db8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f2701d74640 1 --2- 10.20.193.28:0/1939483503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d98700 0x560f69db8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f2701d74640 1 -- 10.20.193.28:0/1939483503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d574c0 msgr2=0x560f69d778a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f2701d74640 1 --2- 10.20.193.28:0/1939483503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d574c0 0x560f69d778a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f2701d74640 1 -- 10.20.193.28:0/1939483503 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f69c058b0 con 0x560f69d77de0 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f2701d74640 1 --2- 10.20.193.28:0/1939483503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d77de0 0x560f69d981c0 secure :-1 s=READY pgs=1242 gs=2 cs=0 l=1 c_cookie=4715999792073109433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec005b30 tx=0x7f26ec0059a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417298d30f556fb9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f26e8bfe640 1 -- 10.20.193.28:0/1939483503 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26ec038690 con 0x560f69d77de0 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f26e8bfe640 1 -- 10.20.193.28:0/1939483503 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26ec005dd0 con 0x560f69d77de0 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f26e8bfe640 1 -- 10.20.193.28:0/1939483503 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26ec02fe60 con 0x560f69d77de0 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f270b419e00 1 -- 10.20.193.28:0/1939483503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d77de0 msgr2=0x560f69d981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f270b419e00 1 --2- 10.20.193.28:0/1939483503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d77de0 0x560f69d981c0 secure :-1 s=READY pgs=1242 gs=2 cs=0 l=1 c_cookie=4715999792073109433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec005b30 tx=0x7f26ec0059a0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f270b419e00 1 -- 10.20.193.28:0/1939483503 shutdown_connections 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f270b419e00 1 --2- 10.20.193.28:0/1939483503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d77de0 0x560f69d981c0 unknown :-1 s=CLOSED pgs=1242 gs=2 cs=0 l=1 c_cookie=4715999792073109433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f270b419e00 1 --2- 10.20.193.28:0/1939483503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d98700 0x560f69db8ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f270b419e00 1 --2- 10.20.193.28:0/1939483503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d574c0 0x560f69d778a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.767+0000 7f270b419e00 1 -- 10.20.193.28:0/1939483503 >> 10.20.193.28:0/1939483503 conn(0x560f69c761c0 msgr2=0x560f69d55da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.768+0000 7f270b419e00 1 -- 10.20.193.28:0/1939483503 shutdown_connections 2026-02-20T13:28:36.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.768+0000 7f270b419e00 1 -- 10.20.193.28:0/1939483503 wait complete. 2026-02-20T13:28:36.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.769+0000 7f270b419e00 1 -- start start 2026-02-20T13:28:36.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.769+0000 7f270b419e00 1 Processor -- start 2026-02-20T13:28:36.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.769+0000 7f270b419e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d70b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.769+0000 7f270b419e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 0x560f69d71170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.769+0000 7f270b419e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d71bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f270b419e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f69d72230 con 0x560f69d98700 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f270b419e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560f69d723a0 con 0x560f69d77de0 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f270b419e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560f69d72560 con 0x560f69d574c0 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d71bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d70b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d71bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50846/0 (socket says 10.20.193.28:50846) 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 -- 10.20.193.28:0/3527531292 learned_addr learned my addr 10.20.193.28:0/3527531292 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2701d74640 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 0x560f69d71170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 -- 10.20.193.28:0/3527531292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 msgr2=0x560f69d70b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d70b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 -- 10.20.193.28:0/3527531292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 msgr2=0x560f69d71170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 0x560f69d71170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 -- 10.20.193.28:0/3527531292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f69c0e400 con 0x560f69d98700 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702575640 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d70b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f2702d76640 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d71bd0 secure :-1 s=READY pgs=1243 gs=3 cs=0 l=1 c_cookie=10813089943657009403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f40ae2d0 tx=0x7f26f40ae3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960fd003780650fb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f26b3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f26b3fff640 1 -- 10.20.193.28:0/3527531292 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26f406e030 con 0x560f69d98700 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f26b3fff640 1 -- 10.20.193.28:0/3527531292 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26f400fe20 con 0x560f69d98700 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2704171ae0 con 0x560f69d98700 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f26b3fff640 1 -- 10.20.193.28:0/3527531292 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26f40ae110 con 0x560f69d98700 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f270b419e00 10 client.19554 _ll_register_callbacks cb 0x560f69beda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f69902520 con 0x560f69d98700 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.770+0000 7f26b3fff640 1 -- 10.20.193.28:0/3527531292 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f26f406f070 con 0x560f69d98700 2026-02-20T13:28:36.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f26b3fff640 1 -- 10.20.193.28:0/3527531292 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f26f40b9430 con 0x560f69d98700 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f270b419e00 10 client.19554 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560f69be6da0 con 0x560f69d98700 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f26b3fff640 1 -- 10.20.193.28:0/3527531292 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f26f40aef80 con 0x560f69d98700 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f270b419e00 10 client.19554 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f270b419e00 10 client.19554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f270b419e00 20 client.19554 populate_metadata read hostname 'trial028' 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f270b419e00 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560f69d752f0 0x560f69d75790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f270b419e00 4 client.19554 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f69c94630 con 0x560f69d752f0 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.771+0000 7f2702575640 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560f69d752f0 0x560f69d75790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f2702575640 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560f69d752f0 0x560f69d75790 crc :-1 s=READY pgs=330 gs=4 cs=0 l=0 c_cookie=6018202894973368987 s_cookie=17495728321326538354 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5384f3a5ad1d7a9b server_cookie=f2cd50363f68de72 in_seq=0 out_seq=0 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f26b3fff640 10 client.19554 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f26b3fff640 1 -- 10.20.193.28:0/3527531292 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560f69c94630 con 0x560f69d752f0 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f26b3fff640 10 client.19554 handle_command_reply: tid=0 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 client.19554 shutdown 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 msgr2=0x560f69d71bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d71bd0 secure :-1 s=READY pgs=1243 gs=3 cs=0 l=1 c_cookie=10813089943657009403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f40ae2d0 tx=0x7f26f40ae3a0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 shutdown_connections 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560f69d752f0 0x560f69d75790 crc :-1 s=READY pgs=330 gs=4 cs=0 l=0 c_cookie=6018202894973368987 s_cookie=17495728321326538354 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d71bd0 unknown :-1 s=CLOSED pgs=1243 gs=3 cs=0 l=1 c_cookie=10813089943657009403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 0x560f69d71170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 --2- 10.20.193.28:0/3527531292 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d70b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f26b3fff640 0 client.19554 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:36.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.772+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 >> 10.20.193.28:0/3527531292 conn(0x560f69c761c0 msgr2=0x560f69d58790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.773+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 shutdown_connections 2026-02-20T13:28:36.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.773+0000 7f270b419e00 1 -- 10.20.193.28:0/3527531292 wait complete. 2026-02-20T13:28:36.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.773+0000 7f270b419e00 20 client.19554 trim_cache size 0 max 16384 2026-02-20T13:28:36.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.780+0000 7f270b419e00 1 Processor -- start 2026-02-20T13:28:36.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.780+0000 7f270b419e00 1 -- start start 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.780+0000 7f270b419e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d574c0 0x560f69d710a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.780+0000 7f270b419e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d77de0 0x560f69d6de40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.780+0000 7f270b419e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d98700 0x560f69d6e380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.780+0000 7f270b419e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f69c608d0 con 0x560f69d574c0 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.780+0000 7f270b419e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560f699a1f10 con 0x560f69d98700 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.780+0000 7f270b419e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560f69d5e580 con 0x560f69d77de0 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d574c0 0x560f69d710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d574c0 0x560f69d710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50850/0 (socket says 10.20.193.28:50850) 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 -- 10.20.193.28:0/858734170 learned_addr learned my addr 10.20.193.28:0/858734170 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2701d74640 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d77de0 0x560f69d6de40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702d76640 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d98700 0x560f69d6e380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 -- 10.20.193.28:0/858734170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d77de0 msgr2=0x560f69d6de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d77de0 0x560f69d6de40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 -- 10.20.193.28:0/858734170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d98700 msgr2=0x560f69d6e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d98700 0x560f69d6e380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 -- 10.20.193.28:0/858734170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f69bf8670 con 0x560f69d574c0 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2701d74640 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d77de0 0x560f69d6de40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f2702575640 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d574c0 0x560f69d710a0 secure :-1 s=READY pgs=1244 gs=1 cs=0 l=1 c_cookie=1265947058910102457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560f69d76040 tx=0x7f26f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11918c248ec983b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f26ce3ff640 1 -- 10.20.193.28:0/858734170 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26f802b1b0 con 0x560f69d574c0 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f26ce3ff640 1 -- 10.20.193.28:0/858734170 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26f8022040 con 0x560f69d574c0 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f26ce3ff640 1 -- 10.20.193.28:0/858734170 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26f8011930 con 0x560f69d574c0 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f270b419e00 1 -- 10.20.193.28:0/858734170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d574c0 msgr2=0x560f69d710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f270b419e00 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d574c0 0x560f69d710a0 secure :-1 s=READY pgs=1244 gs=1 cs=0 l=1 c_cookie=1265947058910102457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560f69d76040 tx=0x7f26f8014000 comp rx=0 tx=0).stop 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f270b419e00 1 -- 10.20.193.28:0/858734170 shutdown_connections 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f270b419e00 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d98700 0x560f69d6e380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f270b419e00 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d77de0 0x560f69d6de40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f270b419e00 1 --2- 10.20.193.28:0/858734170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d574c0 0x560f69d710a0 unknown :-1 s=CLOSED pgs=1244 gs=1 cs=0 l=1 c_cookie=1265947058910102457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.781+0000 7f270b419e00 1 -- 10.20.193.28:0/858734170 >> 10.20.193.28:0/858734170 conn(0x560f69c761c0 msgr2=0x560f69d70990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.782+0000 7f270b419e00 1 -- 10.20.193.28:0/858734170 shutdown_connections 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.782+0000 7f270b419e00 1 -- 10.20.193.28:0/858734170 wait complete. 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.782+0000 7f270b419e00 1 -- start start 2026-02-20T13:28:36.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.782+0000 7f270b419e00 1 Processor -- start 2026-02-20T13:28:36.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f270b419e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d77580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f270b419e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 0x560f69d781b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f270b419e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d786f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f270b419e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f69d78df0 con 0x560f69d98700 2026-02-20T13:28:36.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f270b419e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560f69d78f60 con 0x560f69d77de0 2026-02-20T13:28:36.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f270b419e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560f69d79120 con 0x560f69d574c0 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d77580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d786f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50864/0 (socket says 10.20.193.28:50864) 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 -- 10.20.193.28:0/1485036049 learned_addr learned my addr 10.20.193.28:0/1485036049 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2701d74640 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 0x560f69d781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 -- 10.20.193.28:0/1485036049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 msgr2=0x560f69d77580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d77580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 -- 10.20.193.28:0/1485036049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 msgr2=0x560f69d781b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 0x560f69d781b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 -- 10.20.193.28:0/1485036049 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f69bf30f0 con 0x560f69d98700 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f2702d76640 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d786f0 secure :-1 s=READY pgs=1245 gs=1 cs=0 l=1 c_cookie=9809624713956671799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f40ab560 tx=0x7f26f40aed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8822c9b42747c137 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:36.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f26b3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f26b3fff640 1 -- 10.20.193.28:0/1485036049 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26f406e070 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f26b3fff640 1 -- 10.20.193.28:0/1485036049 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560f69902520 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f26b3fff640 1 -- 10.20.193.28:0/1485036049 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26f40ad220 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.783+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f8003db0 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f26b3fff640 1 -- 10.20.193.28:0/1485036049 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f26f40ad380 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f26b3fff640 10 client.19560 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 10 client.19560 _ll_register_callbacks cb 0x560f69beda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f69d12ca0 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f26b3fff640 1 -- 10.20.193.28:0/1485036049 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f26f40adcd0 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 10 client.19560 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560f69be70d0 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f26b3fff640 1 -- 10.20.193.28:0/1485036049 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f26f4092020 con 0x560f69d98700 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 10 client.19560 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 10 client.19560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 20 client.19560 populate_metadata read hostname 'trial028' 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560f69d7a9e0 0x560f69d7ae80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 4 client.19560 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560f69946640 con 0x560f69d7a9e0 2026-02-20T13:28:36.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.784+0000 7f2702575640 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560f69d7a9e0 0x560f69d7ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.785+0000 7f2702575640 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560f69d7a9e0 0x560f69d7ae80 crc :-1 s=READY pgs=331 gs=4 cs=0 l=0 c_cookie=3032993011729152759 s_cookie=1462465304268766572 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a175b131e5bbaf7 server_cookie=144bb8721d45fd6c in_seq=0 out_seq=0 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.785+0000 7f26b3fff640 10 client.19560 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f26b3fff640 1 -- 10.20.193.28:0/1485036049 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560f69946640 con 0x560f69d7a9e0 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f26b3fff640 10 client.19560 handle_command_reply: tid=0 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 client.19560 shutdown 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 msgr2=0x560f69d786f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d786f0 secure :-1 s=READY pgs=1245 gs=1 cs=0 l=1 c_cookie=9809624713956671799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f40ab560 tx=0x7f26f40aed90 comp rx=0 tx=0).stop 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 shutdown_connections 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560f69d7a9e0 0x560f69d7ae80 crc :-1 s=READY pgs=331 gs=4 cs=0 l=0 c_cookie=3032993011729152759 s_cookie=1462465304268766572 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f69d98700 0x560f69d786f0 unknown :-1 s=CLOSED pgs=1245 gs=1 cs=0 l=1 c_cookie=9809624713956671799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560f69d77de0 0x560f69d781b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f26b3fff640 0 client.19560 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 --2- 10.20.193.28:0/1485036049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560f69d574c0 0x560f69d77580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 >> 10.20.193.28:0/1485036049 conn(0x560f69c761c0 msgr2=0x560f69d71000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 shutdown_connections 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 1 -- 10.20.193.28:0/1485036049 wait complete. 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.789+0000 7f270b419e00 20 client.19560 trim_cache size 0 max 16384 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 -- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26dc0b5760 msgr2=0x7f26dc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26dc0b5760 0x7f26dc0d5c10 secure :-1 s=READY pgs=523 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f80095b0 tx=0x7f26f8005f90 comp rx=0 tx=0).stop 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 -- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27041100b0 msgr2=0x7f27040f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27041100b0 0x7f27040f8a80 secure :-1 s=READY pgs=1241 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f400aef0 tx=0x7f26f4003b50 comp rx=0 tx=0).stop 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 -- 10.20.193.28:0/2699673942 shutdown_connections 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f26dc0b5760 0x7f26dc0d5c10 unknown :-1 s=CLOSED pgs=523 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27041100b0 0x7f27040f8a80 unknown :-1 s=CLOSED pgs=1241 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f270410f2f0 0x7f2704171060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 --2- 10.20.193.28:0/2699673942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f270410e940 0x7f27040f8240 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 -- 10.20.193.28:0/2699673942 >> 10.20.193.28:0/2699673942 conn(0x7f27040ec320 msgr2=0x7f27040ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 -- 10.20.193.28:0/2699673942 shutdown_connections 2026-02-20T13:28:36.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:36.790+0000 7f2703577640 1 -- 10.20.193.28:0/2699673942 wait complete. 2026-02-20T13:28:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:36 trial127 ceph-mon[43817]: pgmap v519: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 17 op/s 2026-02-20T13:28:36.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:36 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/486255254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:28:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:36 trial034 ceph-mon[43332]: pgmap v519: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 17 op/s 2026-02-20T13:28:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:36 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/486255254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:28:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:36 trial028 ceph-mon[37442]: pgmap v519: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 17 op/s 2026-02-20T13:28:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:36 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/486255254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:28:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:38 trial127 ceph-mon[43817]: pgmap v520: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:28:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:38 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:28:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:38 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:28:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:38 trial034 ceph-mon[43332]: pgmap v520: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:28:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:38 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:28:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:38 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:28:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:38 trial028 ceph-mon[37442]: pgmap v520: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:28:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:38 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:28:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:38 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:28:39.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:39 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:28:39.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:39 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:28:40.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:39 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:28:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:40 trial127 ceph-mon[43817]: pgmap v521: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:28:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:40 trial034 ceph-mon[43332]: pgmap v521: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:28:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:40 trial028 ceph-mon[37442]: pgmap v521: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:28:41.943 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:41 trial028 ceph-mon[37442]: pgmap v522: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2026-02-20T13:28:41.943 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:41 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:28:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:41 trial127 ceph-mon[43817]: pgmap v522: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2026-02-20T13:28:41.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:41 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:28:41.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:41 trial034 ceph-mon[43332]: pgmap v522: 97 pgs: 97 active+clean; 2.0 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2026-02-20T13:28:41.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:41 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:28:43.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.477 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:43 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:43 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:43 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:43 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:43 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:43 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:43 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:43 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:43 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:43 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:43 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:43.491 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:43 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:44.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:28:44.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:28:44.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:44.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:28:44.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:44 trial028 ceph-mon[37442]: pgmap v523: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 17 op/s 2026-02-20T13:28:44.392 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:28:44.392 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:28:44.392 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:44.392 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:28:44.392 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:44 trial034 ceph-mon[43332]: pgmap v523: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 17 op/s 2026-02-20T13:28:44.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:28:44.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:28:44.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:28:44.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:28:44.478 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:44 trial127 ceph-mon[43817]: pgmap v523: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 17 op/s 2026-02-20T13:28:46.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:46 trial028 ceph-mon[37442]: pgmap v524: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-20T13:28:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:46 trial127 ceph-mon[43817]: pgmap v524: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-20T13:28:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:46 trial034 ceph-mon[43332]: pgmap v524: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-20T13:28:48.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:48 trial028 ceph-mon[37442]: pgmap v525: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 5.0 KiB/s wr, 15 op/s 2026-02-20T13:28:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:48 trial127 ceph-mon[43817]: pgmap v525: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 5.0 KiB/s wr, 15 op/s 2026-02-20T13:28:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:48 trial034 ceph-mon[43332]: pgmap v525: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 5.0 KiB/s wr, 15 op/s 2026-02-20T13:28:49.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 -- 10.20.193.28:0/1377842132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a341152a0 msgr2=0x7f3a34115740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 --2- 10.20.193.28:0/1377842132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a341152a0 0x7f3a34115740 secure :-1 s=READY pgs=1246 gs=1 cs=0 l=1 c_cookie=9750984974240937836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a2800a970 tx=0x7f3a280301b0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 -- 10.20.193.28:0/1377842132 shutdown_connections 2026-02-20T13:28:49.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 --2- 10.20.193.28:0/1377842132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a341152a0 0x7f3a34115740 unknown :-1 s=CLOSED pgs=1246 gs=1 cs=0 l=1 c_cookie=9750984974240937836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 --2- 10.20.193.28:0/1377842132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a34114710 0x7f3a34114b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 --2- 10.20.193.28:0/1377842132 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a34113de0 0x7f3a341141d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 -- 10.20.193.28:0/1377842132 >> 10.20.193.28:0/1377842132 conn(0x7f3a3405be90 msgr2=0x7f3a3405c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 -- 10.20.193.28:0/1377842132 shutdown_connections 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.861+0000 7f3a395d2640 1 -- 10.20.193.28:0/1377842132 wait complete. 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a395d2640 1 Processor -- start 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a395d2640 1 -- start start 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a395d2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a34113de0 0x7f3a340fdcc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a395d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a34114710 0x7f3a340fe310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a395d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a341152a0 0x7f3a340fef10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a395d2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340ff650 con 0x7f3a341152a0 2026-02-20T13:28:49.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a395d2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340ff7c0 con 0x7f3a34113de0 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a395d2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340ff980 con 0x7f3a34114710 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a337fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a34114710 0x7f3a340fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a337fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a34114710 0x7f3a340fe310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:51622/0 (socket says 10.20.193.28:51622) 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a337fe640 1 -- 10.20.193.28:0/3805540659 learned_addr learned my addr 10.20.193.28:0/3805540659 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a33fff640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a34113de0 0x7f3a340fdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a38dd1640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a341152a0 0x7f3a340fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a337fe640 1 -- 10.20.193.28:0/3805540659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a34113de0 msgr2=0x7f3a340fdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a337fe640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a34113de0 0x7f3a340fdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a337fe640 1 -- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a341152a0 msgr2=0x7f3a340fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a337fe640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a341152a0 0x7f3a340fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.862+0000 7f3a337fe640 1 -- 10.20.193.28:0/3805540659 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a20009570 con 0x7f3a34114710 2026-02-20T13:28:49.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.863+0000 7f3a337fe640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a34114710 0x7f3a340fe310 secure :-1 s=READY pgs=364 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a24009480 tx=0x7f3a2400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:49.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.863+0000 7f3a317fa640 1 -- 10.20.193.28:0/3805540659 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a2400cd40 con 0x7f3a34114710 2026-02-20T13:28:49.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.863+0000 7f3a317fa640 1 -- 10.20.193.28:0/3805540659 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a24004d30 con 0x7f3a34114710 2026-02-20T13:28:49.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.863+0000 7f3a317fa640 1 -- 10.20.193.28:0/3805540659 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a24010740 con 0x7f3a34114710 2026-02-20T13:28:49.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.863+0000 7f3a395d2640 1 -- 10.20.193.28:0/3805540659 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2800a590 con 0x7f3a34114710 2026-02-20T13:28:49.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.863+0000 7f3a395d2640 1 -- 10.20.193.28:0/3805540659 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a34100120 con 0x7f3a34114710 2026-02-20T13:28:49.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.865+0000 7f3a317fa640 1 -- 10.20.193.28:0/3805540659 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3a2401f060 con 0x7f3a34114710 2026-02-20T13:28:49.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.867+0000 7f3a317fa640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3a080b56e0 0x7f3a080d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.867+0000 7f3a317fa640 1 -- 10.20.193.28:0/3805540659 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a24014070 con 0x7f3a34114710 2026-02-20T13:28:49.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.867+0000 7f3a33fff640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3a080b56e0 0x7f3a080d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a3ce88e00 1 Processor -- start 2026-02-20T13:28:49.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a33fff640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3a080b56e0 0x7f3a080d5b90 secure :-1 s=READY pgs=528 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a20005b30 tx=0x7f3a20009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:49.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a3ce88e00 1 -- start start 2026-02-20T13:28:49.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe584e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe584ede0 0x560fe586f1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 0x560fe588fae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560fe5743fd0 con 0x560fe582e4c0 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560fe573fd00 con 0x560fe584ede0 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560fe5739ca0 con 0x560fe586f700 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a337fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe584ede0 0x560fe586f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a33fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe584e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a337fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe584ede0 0x560fe586f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54692/0 (socket says 10.20.193.28:54692) 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a337fe640 1 -- 10.20.193.28:0/1995541956 learned_addr learned my addr 10.20.193.28:0/1995541956 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a38dd1640 1 --2- 10.20.193.28:0/1995541956 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 0x560fe588fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a337fe640 1 -- 10.20.193.28:0/1995541956 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 msgr2=0x560fe588fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:49.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a337fe640 1 --2- 10.20.193.28:0/1995541956 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 0x560fe588fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a337fe640 1 -- 10.20.193.28:0/1995541956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 msgr2=0x560fe584e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a337fe640 1 --2- 10.20.193.28:0/1995541956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe584e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.868+0000 7f3a337fe640 1 -- 10.20.193.28:0/1995541956 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe56dc8b0 con 0x560fe584ede0 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a337fe640 1 --2- 10.20.193.28:0/1995541956 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe584ede0 0x560fe586f1c0 secure :-1 s=READY pgs=440 gs=2 cs=0 l=1 c_cookie=12299751253643730817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a240a9760 tx=0x7f3a2400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aab17e992b199f81 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a04bfe640 1 -- 10.20.193.28:0/1995541956 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a240acb70 con 0x560fe584ede0 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a04bfe640 1 -- 10.20.193.28:0/1995541956 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a240ac990 con 0x560fe584ede0 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a04bfe640 1 -- 10.20.193.28:0/1995541956 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a240acfb0 con 0x560fe584ede0 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/1995541956 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe584ede0 msgr2=0x560fe586f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/1995541956 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe584ede0 0x560fe586f1c0 secure :-1 s=READY pgs=440 gs=2 cs=0 l=1 c_cookie=12299751253643730817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a240a9760 tx=0x7f3a2400cf20 comp rx=0 tx=0).stop 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/1995541956 shutdown_connections 2026-02-20T13:28:49.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/1995541956 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 0x560fe588fae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/1995541956 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe584ede0 0x560fe586f1c0 unknown :-1 s=CLOSED pgs=440 gs=2 cs=0 l=1 c_cookie=12299751253643730817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/1995541956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe584e8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/1995541956 >> 10.20.193.28:0/1995541956 conn(0x560fe574d1c0 msgr2=0x560fe582cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:49.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/1995541956 shutdown_connections 2026-02-20T13:28:49.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.869+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/1995541956 wait complete. 2026-02-20T13:28:49.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a3ce88e00 1 -- start start 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a3ce88e00 1 Processor -- start 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe582e4c0 0x560fe5847ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5848130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 0x560fe5848b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560fe58491f0 con 0x560fe584ede0 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560fe5849360 con 0x560fe586f700 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560fe5849520 con 0x560fe582e4c0 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a33fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe582e4c0 0x560fe5847ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a33fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe582e4c0 0x560fe5847ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:51632/0 (socket says 10.20.193.28:51632) 2026-02-20T13:28:49.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a33fff640 1 -- 10.20.193.28:0/4236259547 learned_addr learned my addr 10.20.193.28:0/4236259547 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a337fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5848130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a38dd1640 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 0x560fe5848b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a33fff640 1 -- 10.20.193.28:0/4236259547 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 msgr2=0x560fe5848b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a33fff640 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 0x560fe5848b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a33fff640 1 -- 10.20.193.28:0/4236259547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 msgr2=0x560fe5848130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a33fff640 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5848130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a33fff640 1 -- 10.20.193.28:0/4236259547 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe56e5400 con 0x560fe582e4c0 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.871+0000 7f3a337fe640 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5848130 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f3a33fff640 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe582e4c0 0x560fe5847ae0 secure :-1 s=READY pgs=365 gs=2 cs=0 l=1 c_cookie=3581855073106326501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a200092e0 tx=0x7f3a200047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b54e36256ef3e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f39f5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f39f5ffb640 1 -- 10.20.193.28:0/4236259547 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a2001fd80 con 0x560fe582e4c0 2026-02-20T13:28:49.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f39f5ffb640 1 -- 10.20.193.28:0/4236259547 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a20029950 con 0x560fe582e4c0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a34100120 con 0x560fe582e4c0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f39f5ffb640 1 -- 10.20.193.28:0/4236259547 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a200207e0 con 0x560fe582e4c0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f3a3ce88e00 10 client.29395 _ll_register_callbacks cb 0x560fe56c4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560fe53d9520 con 0x560fe582e4c0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f39f5ffb640 1 -- 10.20.193.28:0/4236259547 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a20020970 con 0x560fe582e4c0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f39f5ffb640 1 -- 10.20.193.28:0/4236259547 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a20020b90 con 0x560fe582e4c0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f3a3ce88e00 10 client.29395 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560fe56bdda0 con 0x560fe582e4c0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.872+0000 7f39f5ffb640 1 -- 10.20.193.28:0/4236259547 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f3a2001a040 con 0x560fe582e4c0 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f3a3ce88e00 10 client.29395 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f3a3ce88e00 10 client.29395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:49.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f3a3ce88e00 20 client.29395 populate_metadata read hostname 'trial028' 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560fe584c350 0x560fe584c7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f3a3ce88e00 4 client.29395 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fe576b630 con 0x560fe584c350 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f3a337fe640 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560fe584c350 0x560fe584c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f3a337fe640 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560fe584c350 0x560fe584c7f0 crc :-1 s=READY pgs=332 gs=4 cs=0 l=0 c_cookie=9910897109413067258 s_cookie=12487269043280774797 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=898a94692c02f9fa server_cookie=ad4bb108d37b868d in_seq=0 out_seq=0 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.873+0000 7f39f5ffb640 10 client.29395 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f39f5ffb640 1 -- 10.20.193.28:0/4236259547 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560fe576b630 con 0x560fe584c350 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f39f5ffb640 10 client.29395 handle_command_reply: tid=0 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 client.29395 shutdown 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe582e4c0 msgr2=0x560fe5847ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe582e4c0 0x560fe5847ae0 secure :-1 s=READY pgs=365 gs=2 cs=0 l=1 c_cookie=3581855073106326501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a200092e0 tx=0x7f3a200047e0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 shutdown_connections 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560fe584c350 0x560fe584c7f0 crc :-1 s=READY pgs=332 gs=4 cs=0 l=0 c_cookie=9910897109413067258 s_cookie=12487269043280774797 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5848130 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 0x560fe5848b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/4236259547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe582e4c0 0x560fe5847ae0 unknown :-1 s=CLOSED pgs=365 gs=2 cs=0 l=1 c_cookie=3581855073106326501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 >> 10.20.193.28:0/4236259547 conn(0x560fe574d1c0 msgr2=0x560fe582f790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f39f5ffb640 0 client.29395 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 shutdown_connections 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/4236259547 wait complete. 2026-02-20T13:28:49.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.874+0000 7f3a3ce88e00 20 client.29395 trim_cache size 0 max 16384 2026-02-20T13:28:49.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.881+0000 7f3a3ce88e00 1 Processor -- start 2026-02-20T13:28:49.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.881+0000 7f3a3ce88e00 1 -- start start 2026-02-20T13:28:49.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe582e4c0 0x560fe5844e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5845340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 0x560fe586d5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560fe57378d0 con 0x560fe584ede0 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560fe5478f10 con 0x560fe582e4c0 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560fe579f4f0 con 0x560fe586f700 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a33fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe582e4c0 0x560fe5844e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a337fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5845340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a38dd1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 0x560fe586d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a337fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5845340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44506/0 (socket says 10.20.193.28:44506) 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a337fe640 1 -- 10.20.193.28:0/3438254394 learned_addr learned my addr 10.20.193.28:0/3438254394 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a33fff640 1 -- 10.20.193.28:0/3438254394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 msgr2=0x560fe586d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a33fff640 1 --2- 10.20.193.28:0/3438254394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 0x560fe586d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a33fff640 1 -- 10.20.193.28:0/3438254394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 msgr2=0x560fe5845340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:49.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a33fff640 1 --2- 10.20.193.28:0/3438254394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5845340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a33fff640 1 -- 10.20.193.28:0/3438254394 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe56cf670 con 0x560fe582e4c0 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a337fe640 1 --2- 10.20.193.28:0/3438254394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5845340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.882+0000 7f3a33fff640 1 --2- 10.20.193.28:0/3438254394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe582e4c0 0x560fe5844e00 secure :-1 s=READY pgs=441 gs=3 cs=0 l=1 c_cookie=4941940125089952650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a200294c0 tx=0x7f3a20037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44954c5c393c738a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f39f7fff640 1 -- 10.20.193.28:0/3438254394 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a200275b0 con 0x560fe582e4c0 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f39f7fff640 1 -- 10.20.193.28:0/3438254394 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560fe53d9520 con 0x560fe582e4c0 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/3438254394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe582e4c0 msgr2=0x560fe5844e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/3438254394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe582e4c0 0x560fe5844e00 secure :-1 s=READY pgs=441 gs=3 cs=0 l=1 c_cookie=4941940125089952650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a200294c0 tx=0x7f3a20037000 comp rx=0 tx=0).stop 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/3438254394 shutdown_connections 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/3438254394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe584ede0 0x560fe5845340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/3438254394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe586f700 0x560fe586d5c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/3438254394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe582e4c0 0x560fe5844e00 unknown :-1 s=CLOSED pgs=441 gs=3 cs=0 l=1 c_cookie=4941940125089952650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/3438254394 >> 10.20.193.28:0/3438254394 conn(0x560fe574d1c0 msgr2=0x560fe5847160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/3438254394 shutdown_connections 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/3438254394 wait complete. 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 -- start start 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.883+0000 7f3a3ce88e00 1 Processor -- start 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe58504e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe584ede0 0x560fe5850a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a3ce88e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 0x560fe5851110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560fe5851810 con 0x560fe582e4c0 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560fe5851980 con 0x560fe586f700 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a3ce88e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560fe5851b40 con 0x560fe584ede0 2026-02-20T13:28:49.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe58504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe58504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44514/0 (socket says 10.20.193.28:44514) 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 -- 10.20.193.28:0/165728975 learned_addr learned my addr 10.20.193.28:0/165728975 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a337fe640 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe584ede0 0x560fe5850a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a38dd1640 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 0x560fe5851110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 -- 10.20.193.28:0/165728975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe584ede0 msgr2=0x560fe5850a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe584ede0 0x560fe5850a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 -- 10.20.193.28:0/165728975 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 msgr2=0x560fe5851110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 0x560fe5851110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 -- 10.20.193.28:0/165728975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a200297c0 con 0x560fe582e4c0 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a337fe640 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe584ede0 0x560fe5850a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:28:49.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f3a33fff640 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe58504e0 secure :-1 s=READY pgs=1247 gs=1 cs=0 l=1 c_cookie=1793569945665728785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a200041e0 tx=0x7f3a20012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e40a5ce338f111 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.884+0000 7f39f5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f39f5ffb640 1 -- 10.20.193.28:0/165728975 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a20027370 con 0x560fe582e4c0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f39f5ffb640 1 -- 10.20.193.28:0/165728975 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a20027550 con 0x560fe582e4c0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fe56dc8b0 con 0x560fe582e4c0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 10 client.19578 _ll_register_callbacks cb 0x560fe56c4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560fe546b250 con 0x560fe582e4c0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f39f5ffb640 1 -- 10.20.193.28:0/165728975 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a200119d0 con 0x560fe582e4c0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f39f5ffb640 1 -- 10.20.193.28:0/165728975 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a20027b40 con 0x560fe582e4c0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f39f5ffb640 1 -- 10.20.193.28:0/165728975 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a20027d00 con 0x560fe582e4c0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 10 client.19578 fetch_fsmap learned FSMap version 29 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560fe56ca0f0 con 0x560fe582e4c0 2026-02-20T13:28:49.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f39f5ffb640 1 -- 10.20.193.28:0/165728975 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f3a20042070 con 0x560fe582e4c0 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 10 client.19578 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 10 client.19578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 20 client.19578 populate_metadata read hostname 'trial028' 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560fe5853680 0x560fe5853b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 4 client.19578 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560fe57e9ca0 con 0x560fe5853680 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.885+0000 7f3a337fe640 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560fe5853680 0x560fe5853b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.886+0000 7f3a337fe640 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560fe5853680 0x560fe5853b20 crc :-1 s=READY pgs=333 gs=4 cs=0 l=0 c_cookie=17100457826690311577 s_cookie=17535399580384829343 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed5107ca906ca599 server_cookie=f35a4103075f1f9f in_seq=0 out_seq=0 2026-02-20T13:28:49.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.886+0000 7f39f5ffb640 10 client.19578 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f39f5ffb640 1 -- 10.20.193.28:0/165728975 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560fe57e9ca0 con 0x560fe5853680 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f39f5ffb640 10 client.19578 handle_command_reply: tid=0 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 client.19578 shutdown 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 msgr2=0x560fe58504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe58504e0 secure :-1 s=READY pgs=1247 gs=1 cs=0 l=1 c_cookie=1793569945665728785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a200041e0 tx=0x7f3a20012820 comp rx=0 tx=0).stop 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 shutdown_connections 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560fe5853680 0x560fe5853b20 crc :-1 s=READY pgs=333 gs=4 cs=0 l=0 c_cookie=17100457826690311577 s_cookie=17535399580384829343 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560fe586f700 0x560fe5851110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560fe584ede0 0x560fe5850a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 --2- 10.20.193.28:0/165728975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560fe582e4c0 0x560fe58504e0 unknown :-1 s=CLOSED pgs=1247 gs=1 cs=0 l=1 c_cookie=1793569945665728785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 >> 10.20.193.28:0/165728975 conn(0x560fe574d1c0 msgr2=0x560fe5843df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f39f5ffb640 0 client.19578 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 shutdown_connections 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 1 -- 10.20.193.28:0/165728975 wait complete. 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.890+0000 7f3a3ce88e00 20 client.19578 trim_cache size 0 max 16384 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:28:49.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:28:49.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:28:49.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 -- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3a080b56e0 msgr2=0x7f3a080d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3a080b56e0 0x7f3a080d5b90 secure :-1 s=READY pgs=528 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a20005b30 tx=0x7f3a20009310 comp rx=0 tx=0).stop 2026-02-20T13:28:49.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 -- 10.20.193.28:0/3805540659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a34114710 msgr2=0x7f3a340fe310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:28:49.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a34114710 0x7f3a340fe310 secure :-1 s=READY pgs=364 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a24009480 tx=0x7f3a2400ee60 comp rx=0 tx=0).stop 2026-02-20T13:28:49.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 -- 10.20.193.28:0/3805540659 shutdown_connections 2026-02-20T13:28:49.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f3a080b56e0 0x7f3a080d5b90 unknown :-1 s=CLOSED pgs=528 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a341152a0 0x7f3a340fef10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a34114710 0x7f3a340fe310 unknown :-1 s=CLOSED pgs=364 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 --2- 10.20.193.28:0/3805540659 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a34113de0 0x7f3a340fdcc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:28:49.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 -- 10.20.193.28:0/3805540659 >> 10.20.193.28:0/3805540659 conn(0x7f3a3405be90 msgr2=0x7f3a3405ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:28:49.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 -- 10.20.193.28:0/3805540659 shutdown_connections 2026-02-20T13:28:49.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:28:49.891+0000 7f3a395d2640 1 -- 10.20.193.28:0/3805540659 wait complete. 2026-02-20T13:28:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:50 trial028 ceph-mon[37442]: pgmap v526: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:28:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:50 trial127 ceph-mon[43817]: pgmap v526: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:28:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:50 trial034 ceph-mon[43332]: pgmap v526: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:28:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:52 trial028 ceph-mon[37442]: pgmap v527: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:28:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:52 trial127 ceph-mon[43817]: pgmap v527: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:28:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:52 trial034 ceph-mon[43332]: pgmap v527: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:28:54.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:54 trial028 ceph-mon[37442]: pgmap v528: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-20T13:28:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:54 trial127 ceph-mon[43817]: pgmap v528: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-20T13:28:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:54 trial034 ceph-mon[43332]: pgmap v528: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-20T13:28:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:56 trial028 ceph-mon[37442]: pgmap v529: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:28:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:56 trial127 ceph-mon[43817]: pgmap v529: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:28:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:56 trial034 ceph-mon[43332]: pgmap v529: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:28:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:28:58 trial028 ceph-mon[37442]: pgmap v530: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:28:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:28:58 trial127 ceph-mon[43817]: pgmap v530: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:28:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:28:58 trial034 ceph-mon[43332]: pgmap v530: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:29:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:00 trial028 ceph-mon[37442]: pgmap v531: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:29:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:00 trial127 ceph-mon[43817]: pgmap v531: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:29:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:00 trial034 ceph-mon[43332]: pgmap v531: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:29:02.653 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:29:02.845 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:02.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:02 trial028 ceph-mon[37442]: pgmap v532: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:29:02.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.962+0000 7f2b7a31c640 1 -- 10.20.193.28:0/2433673837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b7410ed70 msgr2=0x7f2b7410f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:02.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.962+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/2433673837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b7410ed70 0x7f2b7410f1e0 secure :-1 s=READY pgs=1248 gs=2 cs=0 l=1 c_cookie=11320787977608402413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b68009980 tx=0x7f2b6802f190 comp rx=0 tx=0).stop 2026-02-20T13:29:02.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.963+0000 7f2b7a31c640 1 -- 10.20.193.28:0/2433673837 shutdown_connections 2026-02-20T13:29:02.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.963+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/2433673837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b7410ed70 0x7f2b7410f1e0 unknown :-1 s=CLOSED pgs=1248 gs=2 cs=0 l=1 c_cookie=11320787977608402413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.963+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/2433673837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b7410f720 0x7f2b741714b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.963+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/2433673837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2b741104e0 0x7f2b741108d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.963+0000 7f2b7a31c640 1 -- 10.20.193.28:0/2433673837 >> 10.20.193.28:0/2433673837 conn(0x7f2b740ec710 msgr2=0x7f2b7410cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:02.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.963+0000 7f2b7a31c640 1 -- 10.20.193.28:0/2433673837 shutdown_connections 2026-02-20T13:29:02.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.963+0000 7f2b7a31c640 1 -- 10.20.193.28:0/2433673837 wait complete. 2026-02-20T13:29:02.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.963+0000 7f2b7a31c640 1 Processor -- start 2026-02-20T13:29:02.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7a31c640 1 -- start start 2026-02-20T13:29:02.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7a31c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b7410ed70 0x7f2b740fcb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7a31c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b7410f720 0x7f2b741714b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7a31c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2b741104e0 0x7f2b740fd3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7a31c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740fdf50 con 0x7f2b7410f720 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7a31c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740fe0c0 con 0x7f2b741104e0 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7a31c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740fe280 con 0x7f2b7410ed70 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7931a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b7410ed70 0x7f2b740fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7931a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b7410ed70 0x7f2b740fcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33750/0 (socket says 10.20.193.28:33750) 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7931a640 1 -- 10.20.193.28:0/456978367 learned_addr learned my addr 10.20.193.28:0/456978367 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b78b19640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b7410f720 0x7f2b741714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2b741104e0 0x7f2b740fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7931a640 1 -- 10.20.193.28:0/456978367 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2b741104e0 msgr2=0x7f2b740fd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7931a640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2b741104e0 0x7f2b740fd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7931a640 1 -- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b7410f720 msgr2=0x7f2b741714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7931a640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b7410f720 0x7f2b741714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.964+0000 7f2b7931a640 1 -- 10.20.193.28:0/456978367 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b68009570 con 0x7f2b7410ed70 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.965+0000 7f2b7931a640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b7410ed70 0x7f2b740fcb50 secure :-1 s=READY pgs=366 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64009480 tx=0x7f2b6400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.965+0000 7f2b627fc640 1 -- 10.20.193.28:0/456978367 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b6400cd40 con 0x7f2b7410ed70 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.965+0000 7f2b627fc640 1 -- 10.20.193.28:0/456978367 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2b64004d30 con 0x7f2b7410ed70 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.965+0000 7f2b7a31c640 1 -- 10.20.193.28:0/456978367 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b740fe560 con 0x7f2b7410ed70 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.965+0000 7f2b627fc640 1 -- 10.20.193.28:0/456978367 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b640106b0 con 0x7f2b7410ed70 2026-02-20T13:29:02.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.965+0000 7f2b7a31c640 1 -- 10.20.193.28:0/456978367 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b740fea30 con 0x7f2b7410ed70 2026-02-20T13:29:02.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.968+0000 7f2b627fc640 1 -- 10.20.193.28:0/456978367 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2b6401f060 con 0x7f2b7410ed70 2026-02-20T13:29:02.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.970+0000 7f2b627fc640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2b500b56e0 0x7f2b500d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.970+0000 7f2b627fc640 1 -- 10.20.193.28:0/456978367 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2b64014070 con 0x7f2b7410ed70 2026-02-20T13:29:02.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.970+0000 7f2b78b19640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2b500b56e0 0x7f2b500d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.970+0000 7f2b7dc73e00 1 Processor -- start 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.970+0000 7f2b7dc73e00 1 -- start start 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.970+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.970+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273dd1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273fdae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca272b1fd0 con 0x55ca2739c4c0 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ca272add00 con 0x55ca273bcde0 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ca272a7ca0 con 0x55ca273dd700 2026-02-20T13:29:02.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b78b19640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2b500b56e0 0x7f2b500d5b90 secure :-1 s=READY pgs=529 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b68005b30 tx=0x7f2b6803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b78b19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7931a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b78b19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273dd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56938/0 (socket says 10.20.193.28:56938) 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b78b19640 1 -- 10.20.193.28:0/1437765492 learned_addr learned my addr 10.20.193.28:0/1437765492 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/1437765492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273fdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7931a640 1 -- 10.20.193.28:0/1437765492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 msgr2=0x55ca273fdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7931a640 1 --2- 10.20.193.28:0/1437765492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273fdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7931a640 1 -- 10.20.193.28:0/1437765492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 msgr2=0x55ca273dd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7931a640 1 --2- 10.20.193.28:0/1437765492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273dd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7931a640 1 -- 10.20.193.28:0/1437765492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2724a8b0 con 0x55ca2739c4c0 2026-02-20T13:29:02.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b7931a640 1 --2- 10.20.193.28:0/1437765492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc8a0 secure :-1 s=READY pgs=1249 gs=1 cs=0 l=1 c_cookie=5967920421708562135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b640e4810 tx=0x7f2b640a96f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d250010fbcfed7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b417fe640 1 -- 10.20.193.28:0/1437765492 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b640aca80 con 0x55ca2739c4c0 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b417fe640 1 -- 10.20.193.28:0/1437765492 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2b640ac8a0 con 0x55ca2739c4c0 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.971+0000 7f2b417fe640 1 -- 10.20.193.28:0/1437765492 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b640add30 con 0x55ca2739c4c0 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1437765492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 msgr2=0x55ca273bc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/1437765492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc8a0 secure :-1 s=READY pgs=1249 gs=1 cs=0 l=1 c_cookie=5967920421708562135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b640e4810 tx=0x7f2b640a96f0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1437765492 shutdown_connections 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/1437765492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273fdae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/1437765492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273dd1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/1437765492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc8a0 unknown :-1 s=CLOSED pgs=1249 gs=1 cs=0 l=1 c_cookie=5967920421708562135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1437765492 >> 10.20.193.28:0/1437765492 conn(0x55ca272bb1c0 msgr2=0x55ca2739ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1437765492 shutdown_connections 2026-02-20T13:29:02.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.972+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1437765492 wait complete. 2026-02-20T13:29:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:02 trial127 ceph-mon[43817]: pgmap v532: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:29:02.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.973+0000 7f2b7dc73e00 1 -- start start 2026-02-20T13:29:02.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.973+0000 7f2b7dc73e00 1 Processor -- start 2026-02-20T13:29:02.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273bcde0 0x55ca273b6150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273dd700 0x55ca273b6bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca273b7210 con 0x55ca2739c4c0 2026-02-20T13:29:02.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ca273b7380 con 0x55ca273dd700 2026-02-20T13:29:02.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ca273b7540 con 0x55ca273bcde0 2026-02-20T13:29:02.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b79b1b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273dd700 0x55ca273b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b79b1b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273dd700 0x55ca273b6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56954/0 (socket says 10.20.193.28:56954) 2026-02-20T13:29:02.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b79b1b640 1 -- 10.20.193.28:0/670766143 learned_addr learned my addr 10.20.193.28:0/670766143 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:02.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b78b19640 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273bcde0 0x55ca273b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b7931a640 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b79b1b640 1 -- 10.20.193.28:0/670766143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273bcde0 msgr2=0x55ca273b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:02.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273bcde0 0x55ca273b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b79b1b640 1 -- 10.20.193.28:0/670766143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 msgr2=0x55ca273b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:02.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b79b1b640 1 -- 10.20.193.28:0/670766143 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca27253400 con 0x55ca273dd700 2026-02-20T13:29:02.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.974+0000 7f2b7931a640 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b5b00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:02.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273dd700 0x55ca273b6bb0 secure :-1 s=READY pgs=442 gs=2 cs=0 l=1 c_cookie=10110867498257655052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b70003d10 tx=0x7f2b7000aa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c51046b84b0a50c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:02.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b2e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:02.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/670766143 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b70017070 con 0x55ca273dd700 2026-02-20T13:29:02.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/670766143 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2b70012e10 con 0x55ca273dd700 2026-02-20T13:29:02.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/670766143 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b70010640 con 0x55ca273dd700 2026-02-20T13:29:02.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b740fea30 con 0x55ca273dd700 2026-02-20T13:29:02.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/670766143 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2b70011e40 con 0x55ca273dd700 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b2e7fc640 10 client.29531 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b7dc73e00 10 client.29531 _ll_register_callbacks cb 0x55ca27232a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca26f47520 con 0x55ca273dd700 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/670766143 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2b70012930 con 0x55ca273dd700 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b7dc73e00 10 client.29531 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.975+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ca2722bda0 con 0x55ca273dd700 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.976+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/670766143 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f2b70023070 con 0x55ca273dd700 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.976+0000 7f2b7dc73e00 10 client.29531 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:02.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.976+0000 7f2b7dc73e00 10 client.29531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:02.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.976+0000 7f2b7dc73e00 20 client.29531 populate_metadata read hostname 'trial028' 2026-02-20T13:29:02.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.976+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca273ba2d0 0x55ca273ba770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:02.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.976+0000 7f2b7dc73e00 4 client.29531 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:02.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.976+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca272d9630 con 0x55ca273ba2d0 2026-02-20T13:29:02.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.976+0000 7f2b7931a640 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca273ba2d0 0x55ca273ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:02.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.977+0000 7f2b7931a640 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca273ba2d0 0x55ca273ba770 crc :-1 s=READY pgs=334 gs=4 cs=0 l=0 c_cookie=16024931655904809211 s_cookie=5775649509188594869 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de63fe6ff41e50fb server_cookie=50273aa0be586cb5 in_seq=0 out_seq=0 2026-02-20T13:29:02.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.977+0000 7f2b2e7fc640 10 client.29531 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:02.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.977+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/670766143 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ca272d9630 con 0x55ca273ba2d0 2026-02-20T13:29:02.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.977+0000 7f2b2e7fc640 10 client.29531 handle_command_reply: tid=0 2026-02-20T13:29:02.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.977+0000 7f2b7dc73e00 1 client.29531 shutdown 2026-02-20T13:29:02.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.977+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273dd700 msgr2=0x55ca273b6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:02.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.977+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273dd700 0x55ca273b6bb0 secure :-1 s=READY pgs=442 gs=2 cs=0 l=1 c_cookie=10110867498257655052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b70003d10 tx=0x7f2b7000aa00 comp rx=0 tx=0).stop 2026-02-20T13:29:02.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.977+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 shutdown_connections 2026-02-20T13:29:02.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca273ba2d0 0x55ca273ba770 crc :-1 s=READY pgs=334 gs=4 cs=0 l=0 c_cookie=16024931655904809211 s_cookie=5775649509188594869 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273dd700 0x55ca273b6bb0 unknown :-1 s=CLOSED pgs=442 gs=2 cs=0 l=1 c_cookie=10110867498257655052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273bcde0 0x55ca273b6150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/670766143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b5b00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:02.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 >> 10.20.193.28:0/670766143 conn(0x55ca272bb1c0 msgr2=0x55ca2739d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:02.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b2e7fc640 0 client.29531 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:02.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 shutdown_connections 2026-02-20T13:29:02.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/670766143 wait complete. 2026-02-20T13:29:02.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.978+0000 7f2b7dc73e00 20 client.29531 trim_cache size 0 max 16384 2026-02-20T13:29:02.992 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:02 trial034 ceph-mon[43332]: pgmap v532: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:29:02.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7dc73e00 1 Processor -- start 2026-02-20T13:29:03.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7dc73e00 1 -- start start 2026-02-20T13:29:03.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273b3360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273db5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca272a58d0 con 0x55ca2739c4c0 2026-02-20T13:29:03.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ca26fe6f10 con 0x55ca273bcde0 2026-02-20T13:29:03.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ca27377810 con 0x55ca273dd700 2026-02-20T13:29:03.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b78b19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b78b19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56964/0 (socket says 10.20.193.28:56964) 2026-02-20T13:29:03.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b78b19640 1 -- 10.20.193.28:0/1763101522 learned_addr learned my addr 10.20.193.28:0/1763101522 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:03.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b7931a640 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b79b1b640 1 -- 10.20.193.28:0/1763101522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 msgr2=0x55ca273b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b79b1b640 1 -- 10.20.193.28:0/1763101522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 msgr2=0x55ca273b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.986+0000 7f2b79b1b640 1 -- 10.20.193.28:0/1763101522 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2723d670 con 0x55ca273dd700 2026-02-20T13:29:03.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b79b1b640 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273db5c0 secure :-1 s=READY pgs=367 gs=3 cs=0 l=1 c_cookie=4207832443372667384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b70011620 tx=0x7f2b70020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a6539502d9781f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b40ffd640 1 -- 10.20.193.28:0/1763101522 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b70017070 con 0x55ca273dd700 2026-02-20T13:29:03.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b40ffd640 1 -- 10.20.193.28:0/1763101522 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ca26f47520 con 0x55ca273dd700 2026-02-20T13:29:03.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b40ffd640 1 -- 10.20.193.28:0/1763101522 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b7000d2d0 con 0x55ca273dd700 2026-02-20T13:29:03.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1763101522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 msgr2=0x55ca273db5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273db5c0 secure :-1 s=READY pgs=367 gs=3 cs=0 l=1 c_cookie=4207832443372667384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b70011620 tx=0x7f2b70020000 comp rx=0 tx=0).stop 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1763101522 shutdown_connections 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273db5c0 unknown :-1 s=CLOSED pgs=367 gs=3 cs=0 l=1 c_cookie=4207832443372667384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273b3360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/1763101522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273b2e20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1763101522 >> 10.20.193.28:0/1763101522 conn(0x55ca272bb1c0 msgr2=0x55ca273b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1763101522 shutdown_connections 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.987+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/1763101522 wait complete. 2026-02-20T13:29:03.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7dc73e00 1 -- start start 2026-02-20T13:29:03.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7dc73e00 1 Processor -- start 2026-02-20T13:29:03.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273bd1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7dc73e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273bd6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca273bdcb0 con 0x55ca2739c4c0 2026-02-20T13:29:03.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ca273bde20 con 0x55ca273bcde0 2026-02-20T13:29:03.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7dc73e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ca273bdfe0 con 0x55ca273dd700 2026-02-20T13:29:03.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.988+0000 7f2b7931a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b79b1b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b78b19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b78b19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273bd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56972/0 (socket says 10.20.193.28:56972) 2026-02-20T13:29:03.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b78b19640 1 -- 10.20.193.28:0/3850256865 learned_addr learned my addr 10.20.193.28:0/3850256865 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:03.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7931a640 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41060/0 (socket says 10.20.193.28:41060) 2026-02-20T13:29:03.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7931a640 1 -- 10.20.193.28:0/3850256865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 msgr2=0x55ca273bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7931a640 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273bd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7931a640 1 -- 10.20.193.28:0/3850256865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 msgr2=0x55ca273bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7931a640 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273bd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7931a640 1 -- 10.20.193.28:0/3850256865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca272380f0 con 0x55ca2739c4c0 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7931a640 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc450 secure :-1 s=READY pgs=1250 gs=1 cs=0 l=1 c_cookie=18303691569455135904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b640ad310 tx=0x7f2b64009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe03c6815baf7ca0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b2e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/3850256865 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b640b7f70 con 0x55ca2739c4c0 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca2722bda0 con 0x55ca2739c4c0 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7dc73e00 10 client.19596 _ll_register_callbacks cb 0x55ca27232a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca27357ca0 con 0x55ca2739c4c0 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/3850256865 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ca27357ca0 con 0x55ca2739c4c0 2026-02-20T13:29:03.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.989+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/3850256865 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b640b7f70 con 0x55ca2739c4c0 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/3850256865 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2b640b81e0 con 0x55ca2739c4c0 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/3850256865 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2b640add30 con 0x55ca2739c4c0 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b7dc73e00 10 client.19596 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ca2722c0d0 con 0x55ca2739c4c0 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/3850256865 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f2b64072230 con 0x55ca2739c4c0 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b7dc73e00 10 client.19596 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b7dc73e00 10 client.19596 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b7dc73e00 20 client.19596 populate_metadata read hostname 'trial028' 2026-02-20T13:29:03.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca273bfac0 0x55ca273bff60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b7dc73e00 4 client.19596 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:29:03.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca26f8b640 con 0x55ca273bfac0 2026-02-20T13:29:03.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.990+0000 7f2b78b19640 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca273bfac0 0x55ca273bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.991+0000 7f2b78b19640 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca273bfac0 0x55ca273bff60 crc :-1 s=READY pgs=335 gs=4 cs=0 l=0 c_cookie=15076797883489645167 s_cookie=7160672865454292093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d13b8bcb73c2f26f server_cookie=635fd208422e7c7d in_seq=0 out_seq=0 2026-02-20T13:29:03.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.991+0000 7f2b2e7fc640 10 client.19596 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:03.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.994+0000 7f2b2e7fc640 1 -- 10.20.193.28:0/3850256865 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca26f8b640 con 0x55ca273bfac0 2026-02-20T13:29:03.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.994+0000 7f2b2e7fc640 10 client.19596 handle_command_reply: tid=0 2026-02-20T13:29:03.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.994+0000 7f2b7dc73e00 1 client.19596 shutdown 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.994+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 msgr2=0x55ca273bc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.994+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc450 secure :-1 s=READY pgs=1250 gs=1 cs=0 l=1 c_cookie=18303691569455135904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b640ad310 tx=0x7f2b64009f80 comp rx=0 tx=0).stop 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 shutdown_connections 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ca273bfac0 0x55ca273bff60 crc :-1 s=READY pgs=335 gs=4 cs=0 l=0 c_cookie=15076797883489645167 s_cookie=7160672865454292093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ca273dd700 0x55ca273bd6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ca273bcde0 0x55ca273bd1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 1 --2- 10.20.193.28:0/3850256865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca2739c4c0 0x55ca273bc450 unknown :-1 s=CLOSED pgs=1250 gs=1 cs=0 l=1 c_cookie=18303691569455135904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b2e7fc640 0 client.19596 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 >> 10.20.193.28:0/3850256865 conn(0x55ca272bb1c0 msgr2=0x55ca273b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 shutdown_connections 2026-02-20T13:29:03.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 1 -- 10.20.193.28:0/3850256865 wait complete. 2026-02-20T13:29:03.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7dc73e00 20 client.19596 trim_cache size 0 max 16384 2026-02-20T13:29:03.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:29:03.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:29:03.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:29:03.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:29:03.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 -- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2b500b56e0 msgr2=0x7f2b500d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2b500b56e0 0x7f2b500d5b90 secure :-1 s=READY pgs=529 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b68005b30 tx=0x7f2b6803a040 comp rx=0 tx=0).stop 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 -- 10.20.193.28:0/456978367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b7410ed70 msgr2=0x7f2b740fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b7410ed70 0x7f2b740fcb50 secure :-1 s=READY pgs=366 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64009480 tx=0x7f2b6400ee60 comp rx=0 tx=0).stop 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 -- 10.20.193.28:0/456978367 shutdown_connections 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2b500b56e0 0x7f2b500d5b90 unknown :-1 s=CLOSED pgs=529 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b7410f720 0x7f2b741714b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2b741104e0 0x7f2b740fd3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 --2- 10.20.193.28:0/456978367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b7410ed70 0x7f2b740fcb50 unknown :-1 s=CLOSED pgs=366 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.995+0000 7f2b7a31c640 1 -- 10.20.193.28:0/456978367 >> 10.20.193.28:0/456978367 conn(0x7f2b740ec710 msgr2=0x7f2b74063080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.996+0000 7f2b7a31c640 1 -- 10.20.193.28:0/456978367 shutdown_connections 2026-02-20T13:29:03.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:02.996+0000 7f2b7a31c640 1 -- 10.20.193.28:0/456978367 wait complete. 2026-02-20T13:29:03.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 -- 10.20.193.28:0/293292725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8061840 msgr2=0x7f58e8155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 --2- 10.20.193.28:0/293292725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8061840 0x7f58e8155440 secure :-1 s=READY pgs=1251 gs=1 cs=0 l=1 c_cookie=2657920894882374263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58d8009950 tx=0x7f58d802f190 comp rx=0 tx=0).stop 2026-02-20T13:29:03.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 -- 10.20.193.28:0/293292725 shutdown_connections 2026-02-20T13:29:03.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 --2- 10.20.193.28:0/293292725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8061840 0x7f58e8155440 unknown :-1 s=CLOSED pgs=1251 gs=1 cs=0 l=1 c_cookie=2657920894882374263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 --2- 10.20.193.28:0/293292725 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f58e8155980 0x7f58e8175d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 --2- 10.20.193.28:0/293292725 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f58e8060f30 0x7f58e8061300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 -- 10.20.193.28:0/293292725 >> 10.20.193.28:0/293292725 conn(0x7f58e80eaad0 msgr2=0x7f58e810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 -- 10.20.193.28:0/293292725 shutdown_connections 2026-02-20T13:29:03.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.023+0000 7f58ecf19640 1 -- 10.20.193.28:0/293292725 wait complete. 2026-02-20T13:29:03.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58ecf19640 1 Processor -- start 2026-02-20T13:29:03.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58ecf19640 1 -- start start 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58ecf19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8060f30 0x7f58e816abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58ecf19640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f58e8061840 0x7f58e816b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58ecf19640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f58e8155980 0x7f58e81704d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58ecf19640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8170a60 con 0x7f58e8060f30 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58ecf19640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8170bd0 con 0x7f58e8061840 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58ecf19640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8170d90 con 0x7f58e8155980 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8060f30 0x7f58e816abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58e6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f58e8061840 0x7f58e816b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8060f30 0x7f58e816abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41070/0 (socket says 10.20.193.28:41070) 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.024+0000 7f58e77fe640 1 -- 10.20.193.28:0/3135054762 learned_addr learned my addr 10.20.193.28:0/3135054762 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e7fff640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f58e8155980 0x7f58e81704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e77fe640 1 -- 10.20.193.28:0/3135054762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f58e8155980 msgr2=0x7f58e81704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e77fe640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f58e8155980 0x7f58e81704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e77fe640 1 -- 10.20.193.28:0/3135054762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f58e8061840 msgr2=0x7f58e816b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e77fe640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f58e8061840 0x7f58e816b100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e77fe640 1 -- 10.20.193.28:0/3135054762 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d8009570 con 0x7f58e8060f30 2026-02-20T13:29:03.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e77fe640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8060f30 0x7f58e816abc0 secure :-1 s=READY pgs=1252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58d400c9b0 tx=0x7f58d400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e4ff9640 1 -- 10.20.193.28:0/3135054762 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58d40044a0 con 0x7f58e8060f30 2026-02-20T13:29:03.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e4ff9640 1 -- 10.20.193.28:0/3135054762 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f58d4007da0 con 0x7f58e8060f30 2026-02-20T13:29:03.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58e4ff9640 1 -- 10.20.193.28:0/3135054762 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58d400f6d0 con 0x7f58e8060f30 2026-02-20T13:29:03.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e8171070 con 0x7f58e8060f30 2026-02-20T13:29:03.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.025+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e8171350 con 0x7f58e8060f30 2026-02-20T13:29:03.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.026+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e8062440 con 0x7f58e8060f30 2026-02-20T13:29:03.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.028+0000 7f58e4ff9640 1 -- 10.20.193.28:0/3135054762 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f58d4002880 con 0x7f58e8060f30 2026-02-20T13:29:03.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.029+0000 7f58e4ff9640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f58bc0b5760 0x7f58bc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.029+0000 7f58e4ff9640 1 -- 10.20.193.28:0/3135054762 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f58d40e6e10 con 0x7f58e8060f30 2026-02-20T13:29:03.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.029+0000 7f58e6ffd640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f58bc0b5760 0x7f58bc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.029+0000 7f58e4ff9640 1 -- 10.20.193.28:0/3135054762 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f58d40a97c0 con 0x7f58e8060f30 2026-02-20T13:29:03.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.030+0000 7f58e6ffd640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f58bc0b5760 0x7f58bc0d5c10 secure :-1 s=READY pgs=530 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58e8171560 tx=0x7f58d803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.171+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58e816bd20 con 0x7f58e8060f30 2026-02-20T13:29:03.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.172+0000 7f58e4ff9640 1 -- 10.20.193.28:0/3135054762 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11997 (secure 0 0 0) 0x7f58d40ac970 con 0x7f58e8060f30 2026-02-20T13:29:03.175 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:29:03.175 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T13:28:03:632229+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:28:03.346734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[3],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:29:03.176 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T13:29:03.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f58bc0b5760 msgr2=0x7f58bc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f58bc0b5760 0x7f58bc0d5c10 secure :-1 s=READY pgs=530 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58e8171560 tx=0x7f58d803a040 comp rx=0 tx=0).stop 2026-02-20T13:29:03.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8060f30 msgr2=0x7f58e816abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8060f30 0x7f58e816abc0 secure :-1 s=READY pgs=1252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58d400c9b0 tx=0x7f58d400ce80 comp rx=0 tx=0).stop 2026-02-20T13:29:03.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 shutdown_connections 2026-02-20T13:29:03.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f58bc0b5760 0x7f58bc0d5c10 unknown :-1 s=CLOSED pgs=530 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f58e8155980 0x7f58e81704d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f58e8061840 0x7f58e816b100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 --2- 10.20.193.28:0/3135054762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58e8060f30 0x7f58e816abc0 unknown :-1 s=CLOSED pgs=1252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 >> 10.20.193.28:0/3135054762 conn(0x7f58e80eaad0 msgr2=0x7f58e810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 shutdown_connections 2026-02-20T13:29:03.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.173+0000 7f58ecf19640 1 -- 10.20.193.28:0/3135054762 wait complete. 2026-02-20T13:29:03.276 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id a00c1c5f --release --await' 2026-02-20T13:29:03.277 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id a00c1c5f --release --await 2026-02-20T13:29:03.462 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:03.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 -- 10.20.193.28:0/3780600056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810fea0 msgr2=0x7fe958114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 --2- 10.20.193.28:0/3780600056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810fea0 0x7fe958114ef0 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=8684804822064983258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe94c009950 tx=0x7fe94c02f190 comp rx=0 tx=0).stop 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 -- 10.20.193.28:0/3780600056 shutdown_connections 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 --2- 10.20.193.28:0/3780600056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9581156a0 0x7fe958176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 --2- 10.20.193.28:0/3780600056 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810fea0 0x7fe958114ef0 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=8684804822064983258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 --2- 10.20.193.28:0/3780600056 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe95810f4b0 0x7fe95810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 -- 10.20.193.28:0/3780600056 >> 10.20.193.28:0/3780600056 conn(0x7fe9580ecda0 msgr2=0x7fe95810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 -- 10.20.193.28:0/3780600056 shutdown_connections 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 -- 10.20.193.28:0/3780600056 wait complete. 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.639+0000 7fe95ec57640 1 Processor -- start 2026-02-20T13:29:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95ec57640 1 -- start start 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95ec57640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810f4b0 0x7fe9580f57b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95ec57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe95810fea0 0x7fe958175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95ec57640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9581156a0 0x7fe9580f5eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95ec57640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580fb0c0 con 0x7fe95810fea0 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95ec57640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580fb230 con 0x7fe9581156a0 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95ec57640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580fb3f0 con 0x7fe95810f4b0 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810f4b0 0x7fe9580f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810f4b0 0x7fe9580f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33822/0 (socket says 10.20.193.28:33822) 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95dc55640 1 -- 10.20.193.28:0/772231011 learned_addr learned my addr 10.20.193.28:0/772231011 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95d454640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe95810fea0 0x7fe958175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95e456640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9581156a0 0x7fe9580f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95d454640 1 -- 10.20.193.28:0/772231011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810f4b0 msgr2=0x7fe9580f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95d454640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810f4b0 0x7fe9580f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95d454640 1 -- 10.20.193.28:0/772231011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9581156a0 msgr2=0x7fe9580f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95d454640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9581156a0 0x7fe9580f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95d454640 1 -- 10.20.193.28:0/772231011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c009570 con 0x7fe95810fea0 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.640+0000 7fe95dc55640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810f4b0 0x7fe9580f57b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.641+0000 7fe95d454640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe95810fea0 0x7fe958175f70 secure :-1 s=READY pgs=1253 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe94c02f6a0 tx=0x7fe94c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.641+0000 7fe946ffd640 1 -- 10.20.193.28:0/772231011 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe94c03d070 con 0x7fe95810fea0 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.641+0000 7fe946ffd640 1 -- 10.20.193.28:0/772231011 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe94c002ad0 con 0x7fe95810fea0 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.641+0000 7fe95ec57640 1 -- 10.20.193.28:0/772231011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9580fb670 con 0x7fe95810fea0 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.641+0000 7fe946ffd640 1 -- 10.20.193.28:0/772231011 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe94c0418c0 con 0x7fe95810fea0 2026-02-20T13:29:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.641+0000 7fe95ec57640 1 -- 10.20.193.28:0/772231011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9580fbb30 con 0x7fe95810fea0 2026-02-20T13:29:03.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.644+0000 7fe946ffd640 1 -- 10.20.193.28:0/772231011 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe94c041a50 con 0x7fe95810fea0 2026-02-20T13:29:03.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.646+0000 7fe946ffd640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9340b5750 0x7fe9340d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.646+0000 7fe946ffd640 1 -- 10.20.193.28:0/772231011 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe94c10b060 con 0x7fe95810fea0 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.646+0000 7fe95dc55640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9340b5750 0x7fe9340d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.646+0000 7fe961edae00 1 Processor -- start 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe95dc55640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9340b5750 0x7fe9340d5c00 secure :-1 s=READY pgs=531 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe94800b2c0 tx=0x7fe94800b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe961edae00 1 -- start start 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe961edae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f22300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe961edae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f66fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe961edae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f674e0 0x560327f878c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe961edae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560327e2ec70 con 0x560327f21f30 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe961edae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560327e2a9a0 con 0x560327f674e0 2026-02-20T13:29:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe961edae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560327e24b00 con 0x560327f22840 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f22300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe95d454640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f66fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f22300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41106/0 (socket says 10.20.193.28:41106) 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe95dc55640 1 -- 10.20.193.28:0/1779382566 learned_addr learned my addr 10.20.193.28:0/1779382566 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe95e456640 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f674e0 0x560327f878c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.647+0000 7fe95d454640 1 -- 10.20.193.28:0/1779382566 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f674e0 msgr2=0x560327f878c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe95d454640 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f674e0 0x560327f878c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe95d454640 1 -- 10.20.193.28:0/1779382566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 msgr2=0x560327f22300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe95d454640 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f22300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe95d454640 1 -- 10.20.193.28:0/1779382566 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560327dcff80 con 0x560327f22840 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe95dc55640 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f22300 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe95d454640 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f66fa0 secure :-1 s=READY pgs=369 gs=2 cs=0 l=1 c_cookie=15006593598281246445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe94c038fa0 tx=0x7fe94c0ce410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d042215e8a3466ed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe9264e6640 1 -- 10.20.193.28:0/1779382566 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe94c0d4510 con 0x560327f22840 2026-02-20T13:29:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe9264e6640 1 -- 10.20.193.28:0/1779382566 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe94c04a3f0 con 0x560327f22840 2026-02-20T13:29:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe9264e6640 1 -- 10.20.193.28:0/1779382566 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe94c0d0700 con 0x560327f22840 2026-02-20T13:29:03.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe961edae00 1 -- 10.20.193.28:0/1779382566 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 msgr2=0x560327f66fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe961edae00 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f66fa0 secure :-1 s=READY pgs=369 gs=2 cs=0 l=1 c_cookie=15006593598281246445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe94c038fa0 tx=0x7fe94c0ce410 comp rx=0 tx=0).stop 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe961edae00 1 -- 10.20.193.28:0/1779382566 shutdown_connections 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.648+0000 7fe961edae00 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f674e0 0x560327f878c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.649+0000 7fe961edae00 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f66fa0 unknown :-1 s=CLOSED pgs=369 gs=2 cs=0 l=1 c_cookie=15006593598281246445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.649+0000 7fe961edae00 1 --2- 10.20.193.28:0/1779382566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f22300 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.649+0000 7fe961edae00 1 -- 10.20.193.28:0/1779382566 >> 10.20.193.28:0/1779382566 conn(0x560327e37a60 msgr2=0x560327f17e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.649+0000 7fe961edae00 1 -- 10.20.193.28:0/1779382566 shutdown_connections 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.649+0000 7fe961edae00 1 -- 10.20.193.28:0/1779382566 wait complete. 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.650+0000 7fe961edae00 1 -- start start 2026-02-20T13:29:03.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.650+0000 7fe961edae00 1 Processor -- start 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.650+0000 7fe961edae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f21f30 0x560327f39d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.650+0000 7fe961edae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f3a2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.650+0000 7fe961edae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f674e0 0x560327f3f2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.650+0000 7fe961edae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560327f3f800 con 0x560327f674e0 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.650+0000 7fe961edae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560327f3f970 con 0x560327f21f30 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.650+0000 7fe961edae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560327f3fb30 con 0x560327f22840 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f674e0 0x560327f3f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95d454640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f3a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f674e0 0x560327f3f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41120/0 (socket says 10.20.193.28:41120) 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 -- 10.20.193.28:0/1979254922 learned_addr learned my addr 10.20.193.28:0/1979254922 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f21f30 0x560327f39d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 -- 10.20.193.28:0/1979254922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 msgr2=0x560327f3a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f3a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 -- 10.20.193.28:0/1979254922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f21f30 msgr2=0x560327f39d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f21f30 0x560327f39d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 -- 10.20.193.28:0/1979254922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9580fbb30 con 0x560327f674e0 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95d454640 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f3a2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe95e456640 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f674e0 0x560327f3f2c0 secure :-1 s=READY pgs=1254 gs=1 cs=0 l=1 c_cookie=17581795206679498091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe954003d80 tx=0x7fe95400aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ff15968fcc0d6b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.651+0000 7fe9137fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe9137fe640 1 -- 10.20.193.28:0/1979254922 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe954018070 con 0x560327f674e0 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe9137fe640 1 -- 10.20.193.28:0/1979254922 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe954013c10 con 0x560327f674e0 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe9137fe640 1 -- 10.20.193.28:0/1979254922 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe954011e20 con 0x560327f674e0 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9480115f0 con 0x560327f674e0 2026-02-20T13:29:03.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe9137fe640 1 -- 10.20.193.28:0/1979254922 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe95401c3c0 con 0x560327f674e0 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe961edae00 10 client.19614 _ll_register_callbacks cb 0x560327da5d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560327ababa0 con 0x560327f674e0 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe9137fe640 1 -- 10.20.193.28:0/1979254922 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe954013730 con 0x560327f674e0 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe961edae00 10 client.19614 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560327da8710 con 0x560327f674e0 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.652+0000 7fe9137fe640 1 -- 10.20.193.28:0/1979254922 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe9540138d0 con 0x560327f674e0 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.653+0000 7fe961edae00 10 client.19614 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.653+0000 7fe961edae00 10 client.19614 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.653+0000 7fe961edae00 20 client.19614 populate_metadata read hostname 'trial028' 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.653+0000 7fe961edae00 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560327f646b0 0x560327f64b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.653+0000 7fe961edae00 4 client.19614 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:03.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.653+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560327df7410 con 0x560327f646b0 2026-02-20T13:29:03.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.653+0000 7fe95dc55640 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560327f646b0 0x560327f64b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.654+0000 7fe95dc55640 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560327f646b0 0x560327f64b50 crc :-1 s=READY pgs=336 gs=4 cs=0 l=0 c_cookie=12555045338706855029 s_cookie=4463084396624387383 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3c7b37508bc475 server_cookie=3df00f9cbf629d37 in_seq=0 out_seq=0 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.654+0000 7fe9137fe640 10 client.19614 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.654+0000 7fe9137fe640 1 -- 10.20.193.28:0/1979254922 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560327df7410 con 0x560327f646b0 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.654+0000 7fe9137fe640 10 client.19614 handle_command_reply: tid=0 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.654+0000 7fe961edae00 1 client.19614 shutdown 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f674e0 msgr2=0x560327f3f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f674e0 0x560327f3f2c0 secure :-1 s=READY pgs=1254 gs=1 cs=0 l=1 c_cookie=17581795206679498091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe954003d80 tx=0x7fe95400aab0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 shutdown_connections 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560327f646b0 0x560327f64b50 crc :-1 s=READY pgs=336 gs=4 cs=0 l=0 c_cookie=12555045338706855029 s_cookie=4463084396624387383 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f674e0 0x560327f3f2c0 unknown :-1 s=CLOSED pgs=1254 gs=1 cs=0 l=1 c_cookie=17581795206679498091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f22840 0x560327f3a2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 --2- 10.20.193.28:0/1979254922 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f21f30 0x560327f39d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe9137fe640 0 client.19614 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:03.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 >> 10.20.193.28:0/1979254922 conn(0x560327e37a60 msgr2=0x560327f18510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 shutdown_connections 2026-02-20T13:29:03.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 1 -- 10.20.193.28:0/1979254922 wait complete. 2026-02-20T13:29:03.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.655+0000 7fe961edae00 20 client.19614 trim_cache size 0 max 16384 2026-02-20T13:29:03.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.664+0000 7fe961edae00 1 Processor -- start 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.664+0000 7fe961edae00 1 -- start start 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.664+0000 7fe961edae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f37250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.664+0000 7fe961edae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 0x560327f18710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.664+0000 7fe961edae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f18c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.664+0000 7fe961edae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560327e22730 con 0x560327f21f30 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.664+0000 7fe961edae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560327ae2960 con 0x560327f22840 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.664+0000 7fe961edae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560327e2ec70 con 0x560327f674e0 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f37250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f37250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41132/0 (socket says 10.20.193.28:41132) 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95dc55640 1 -- 10.20.193.28:0/1095825321 learned_addr learned my addr 10.20.193.28:0/1095825321 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:03.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95e456640 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f18c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95d454640 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 0x560327f18710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95e456640 1 -- 10.20.193.28:0/1095825321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 msgr2=0x560327f18710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95e456640 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 0x560327f18710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95e456640 1 -- 10.20.193.28:0/1095825321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 msgr2=0x560327f37250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95e456640 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f37250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95e456640 1 -- 10.20.193.28:0/1095825321 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560327f2c6a0 con 0x560327f674e0 2026-02-20T13:29:03.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95dc55640 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f37250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:03.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe95e456640 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f18c50 secure :-1 s=READY pgs=370 gs=3 cs=0 l=1 c_cookie=6828749616212099939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe954011790 tx=0x7fe954020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ec497987e684363 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.665+0000 7fe925ce5640 1 -- 10.20.193.28:0/1095825321 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe954018070 con 0x560327f674e0 2026-02-20T13:29:03.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe925ce5640 1 -- 10.20.193.28:0/1095825321 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560327ababa0 con 0x560327f674e0 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe925ce5640 1 -- 10.20.193.28:0/1095825321 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe95402c040 con 0x560327f674e0 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 -- 10.20.193.28:0/1095825321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 msgr2=0x560327f18c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f18c50 secure :-1 s=READY pgs=370 gs=3 cs=0 l=1 c_cookie=6828749616212099939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe954011790 tx=0x7fe954020000 comp rx=0 tx=0).stop 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 -- 10.20.193.28:0/1095825321 shutdown_connections 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f18c50 unknown :-1 s=CLOSED pgs=370 gs=3 cs=0 l=1 c_cookie=6828749616212099939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 0x560327f18710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 --2- 10.20.193.28:0/1095825321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f37250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 -- 10.20.193.28:0/1095825321 >> 10.20.193.28:0/1095825321 conn(0x560327e37a60 msgr2=0x560327f36b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 -- 10.20.193.28:0/1095825321 shutdown_connections 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.666+0000 7fe961edae00 1 -- 10.20.193.28:0/1095825321 wait complete. 2026-02-20T13:29:03.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe961edae00 1 -- start start 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe961edae00 1 Processor -- start 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe961edae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f45bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe961edae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 0x560327f46110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe961edae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f423b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe961edae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560327f42ab0 con 0x560327f21f30 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe961edae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560327f42c20 con 0x560327f22840 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe961edae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560327f42de0 con 0x560327f674e0 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f45bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe95e456640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe95dc55640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f45bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41146/0 (socket says 10.20.193.28:41146) 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe95dc55640 1 -- 10.20.193.28:0/4173060696 learned_addr learned my addr 10.20.193.28:0/4173060696 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.667+0000 7fe95d454640 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 0x560327f46110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe95dc55640 1 -- 10.20.193.28:0/4173060696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 msgr2=0x560327f423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe95dc55640 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe95dc55640 1 -- 10.20.193.28:0/4173060696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 msgr2=0x560327f46110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe95dc55640 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 0x560327f46110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe95dc55640 1 -- 10.20.193.28:0/4173060696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9540067b0 con 0x560327f21f30 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe95dc55640 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f45bd0 secure :-1 s=READY pgs=1255 gs=1 cs=0 l=1 c_cookie=6522171697750388634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe948011a90 tx=0x7fe9480047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a83689a6884af9a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe9137fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe9137fe640 1 -- 10.20.193.28:0/4173060696 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe948024040 con 0x560327f21f30 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe9137fe640 1 -- 10.20.193.28:0/4173060696 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe948025040 con 0x560327f21f30 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe948011de0 con 0x560327f21f30 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe9137fe640 1 -- 10.20.193.28:0/4173060696 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe94802a320 con 0x560327f21f30 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe9137fe640 1 -- 10.20.193.28:0/4173060696 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe948017070 con 0x560327f21f30 2026-02-20T13:29:03.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe9137fe640 10 client.19620 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe961edae00 10 client.19620 _ll_register_callbacks cb 0x560327da5d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.668+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560327b7c700 con 0x560327f21f30 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe9137fe640 1 -- 10.20.193.28:0/4173060696 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe948020d40 con 0x560327f21f30 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe961edae00 10 client.19620 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560327dba350 con 0x560327f21f30 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe9137fe640 1 -- 10.20.193.28:0/4173060696 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe948030020 con 0x560327f21f30 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe961edae00 10 client.19620 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe961edae00 10 client.19620 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe961edae00 20 client.19620 populate_metadata read hostname 'trial028' 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe961edae00 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560328015780 0x560328035c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:03.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe961edae00 4 client.19620 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a00c1c5f", "release": true, "await": true}] 2026-02-20T13:29:03.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.669+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a00c1c5f", "release": true, "await": true}) -- 0x7fe94c04a3f0 con 0x560328015780 2026-02-20T13:29:03.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.670+0000 7fe95d454640 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560328015780 0x560328035c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:03.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.670+0000 7fe95d454640 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560328015780 0x560328035c30 crc :-1 s=READY pgs=337 gs=4 cs=0 l=0 c_cookie=11900378792621988020 s_cookie=16409517766699085509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a526a37602d358b4 server_cookie=e3ba5177ab8f6ec5 in_seq=0 out_seq=0 2026-02-20T13:29:03.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.670+0000 7fe9137fe640 10 client.19620 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:03.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.671+0000 7fe9137fe640 1 -- 10.20.193.28:0/4173060696 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fe94c04a3f0 con 0x560328015780 2026-02-20T13:29:03.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.671+0000 7fe9137fe640 10 client.19620 handle_command_reply: tid=0 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 client.19620 shutdown 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 msgr2=0x560327f45bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f45bd0 secure :-1 s=READY pgs=1255 gs=1 cs=0 l=1 c_cookie=6522171697750388634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe948011a90 tx=0x7fe9480047e0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 shutdown_connections 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560328015780 0x560328035c30 crc :-1 s=READY pgs=337 gs=4 cs=0 l=0 c_cookie=11900378792621988020 s_cookie=16409517766699085509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560327f674e0 0x560327f423b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560327f22840 0x560327f46110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 --2- 10.20.193.28:0/4173060696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560327f21f30 0x560327f45bd0 unknown :-1 s=CLOSED pgs=1255 gs=1 cs=0 l=1 c_cookie=6522171697750388634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 >> 10.20.193.28:0/4173060696 conn(0x560327e37a60 msgr2=0x560327f37250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe9137fe640 0 client.19620 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 shutdown_connections 2026-02-20T13:29:03.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 1 -- 10.20.193.28:0/4173060696 wait complete. 2026-02-20T13:29:03.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.672+0000 7fe961edae00 20 client.19620 trim_cache size 0 max 16384 2026-02-20T13:29:03.680 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:29:03.680 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T13:29:03.680 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:29:03.680 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 40, 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "a00c1c5f": { 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "version": 40, 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 147.4, 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:29:03.681 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:03.682 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:29:03.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 -- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9340b5750 msgr2=0x7fe9340d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9340b5750 0x7fe9340d5c00 secure :-1 s=READY pgs=531 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe94800b2c0 tx=0x7fe94800b4a0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 -- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe95810fea0 msgr2=0x7fe958175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:03.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe95810fea0 0x7fe958175f70 secure :-1 s=READY pgs=1253 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe94c02f6a0 tx=0x7fe94c004270 comp rx=0 tx=0).stop 2026-02-20T13:29:03.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 -- 10.20.193.28:0/772231011 shutdown_connections 2026-02-20T13:29:03.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe9340b5750 0x7fe9340d5c00 unknown :-1 s=CLOSED pgs=531 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe95810fea0 0x7fe958175f70 unknown :-1 s=CLOSED pgs=1253 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe9581156a0 0x7fe9580f5eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 --2- 10.20.193.28:0/772231011 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe95810f4b0 0x7fe9580f57b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:03.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 -- 10.20.193.28:0/772231011 >> 10.20.193.28:0/772231011 conn(0x7fe9580ecda0 msgr2=0x7fe958111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:03.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 -- 10.20.193.28:0/772231011 shutdown_connections 2026-02-20T13:29:03.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:03.673+0000 7fe95ec57640 1 -- 10.20.193.28:0/772231011 wait complete. 2026-02-20T13:29:03.684 INFO:tasks.workunit.client.0.trial028.stdout:375/600: open fd = 3 2026-02-20T13:29:03.684 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.684 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:376/600: open fd = 3 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:377/600: open fd = 3 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:378/600: open fd = 3 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.685 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:379/600: open fd = 3 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:380/600: open fd = 3 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:381/600: open fd = 3 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:382/600: open fd = 3 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.686 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:383/600: open fd = 3 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:384/600: open fd = 3 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:385/600: open fd = 3 2026-02-20T13:29:03.687 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:386/600: open fd = 3 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:387/600: open fd = 3 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:388/600: open fd = 3 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.688 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:389/600: open fd = 3 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:390/600: open fd = 3 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:391/600: open fd = 3 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:392/600: open fd = 3 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.689 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:393/600: open fd = 3 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:394/600: open fd = 3 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:395/600: open fd = 3 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:396/600: open fd = 3 2026-02-20T13:29:03.690 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:397/600: open fd = 3 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:398/600: open fd = 3 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:399/600: open fd = 3 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:400/600: open fd = 3 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.691 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:401/600: open fd = 3 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:402/600: open fd = 3 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:403/600: open fd = 3 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:404/600: open fd = 3 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.692 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:405/600: open fd = 3 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:406/600: open fd = 3 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:407/600: open fd = 3 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:408/600: open fd = 3 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.693 INFO:tasks.workunit.client.0.trial028.stdout:409/600: open fd = 3 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:410/600: open fd = 3 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:411/600: open fd = 3 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:412/600: open fd = 3 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:413/600: open fd = 3 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.694 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:414/600: open fd = 3 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:415/600: open fd = 3 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:416/600: open fd = 3 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:417/600: open fd = 3 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout:418/600: open fd = 3 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:419/600: open fd = 3 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:420/600: open fd = 3 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:421/600: open fd = 3 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:422/600: open fd = 3 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.696 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:423/600: open fd = 3 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:424/600: open fd = 3 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:425/600: open fd = 3 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:426/600: open fd = 3 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:427/600: open fd = 3 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.697 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:428/600: open fd = 3 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:429/600: open fd = 3 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:430/600: open fd = 3 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:431/600: open fd = 3 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:432/600: open fd = 3 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.698 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:433/600: open fd = 3 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:434/600: open fd = 3 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:435/600: open fd = 3 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:436/600: open fd = 3 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:29:03.699 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:29:03.699 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:29:03.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:03 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3135054762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:03.815 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a00c1c5f', total seconds elapsed: 28.6 2026-02-20T13:29:03.893 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:03.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:03 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3135054762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:03.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:03 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3135054762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:04.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.069+0000 7f28c0f5b640 1 -- 10.20.193.28:0/1335799340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 msgr2=0x7f28bc10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.069+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/1335799340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 0x7f28bc10f880 secure :-1 s=READY pgs=1256 gs=1 cs=0 l=1 c_cookie=16474905070951073731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28a8009950 tx=0x7f28a802f190 comp rx=0 tx=0).stop 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.070+0000 7f28c0f5b640 1 -- 10.20.193.28:0/1335799340 shutdown_connections 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.070+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/1335799340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28bc1156a0 0x7f28bc176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.070+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/1335799340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28bc10fea0 0x7f28bc114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.070+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/1335799340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 0x7f28bc10f880 unknown :-1 s=CLOSED pgs=1256 gs=1 cs=0 l=1 c_cookie=16474905070951073731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.070+0000 7f28c0f5b640 1 -- 10.20.193.28:0/1335799340 >> 10.20.193.28:0/1335799340 conn(0x7f28bc0ecda0 msgr2=0x7f28bc10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.070+0000 7f28c0f5b640 1 -- 10.20.193.28:0/1335799340 shutdown_connections 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.070+0000 7f28c0f5b640 1 -- 10.20.193.28:0/1335799340 wait complete. 2026-02-20T13:29:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.070+0000 7f28c0f5b640 1 Processor -- start 2026-02-20T13:29:04.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28c0f5b640 1 -- start start 2026-02-20T13:29:04.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28c0f5b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 0x7f28bc11ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28c0f5b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28bc10fea0 0x7f28bc11e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28c0f5b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28bc1156a0 0x7f28bc1236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28c0f5b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc123d00 con 0x7f28bc10f4b0 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28c0f5b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc123e70 con 0x7f28bc10fea0 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28c0f5b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc124030 con 0x7f28bc1156a0 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28baffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28bc10fea0 0x7f28bc11e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28bbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28bc1156a0 0x7f28bc1236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28bbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28bc1156a0 0x7f28bc1236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33880/0 (socket says 10.20.193.28:33880) 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28bbfff640 1 -- 10.20.193.28:0/3053285322 learned_addr learned my addr 10.20.193.28:0/3053285322 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.071+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 0x7f28bc11ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28bb7fe640 1 -- 10.20.193.28:0/3053285322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28bc1156a0 msgr2=0x7f28bc1236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28bc1156a0 0x7f28bc1236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28bb7fe640 1 -- 10.20.193.28:0/3053285322 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28bc10fea0 msgr2=0x7f28bc11e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28bc10fea0 0x7f28bc11e310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28bb7fe640 1 -- 10.20.193.28:0/3053285322 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a8009570 con 0x7f28bc10f4b0 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28bbfff640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28bc1156a0 0x7f28bc1236e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 0x7f28bc11ddd0 secure :-1 s=READY pgs=1257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28a802f6a0 tx=0x7f28a8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28b8ff9640 1 -- 10.20.193.28:0/3053285322 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28a803d070 con 0x7f28bc10f4b0 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28b8ff9640 1 -- 10.20.193.28:0/3053285322 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f28a8002ad0 con 0x7f28bc10f4b0 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28b8ff9640 1 -- 10.20.193.28:0/3053285322 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28a8041820 con 0x7f28bc10f4b0 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28c0f5b640 1 -- 10.20.193.28:0/3053285322 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc1242b0 con 0x7f28bc10f4b0 2026-02-20T13:29:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.072+0000 7f28c0f5b640 1 -- 10.20.193.28:0/3053285322 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc164870 con 0x7f28bc10f4b0 2026-02-20T13:29:04.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.075+0000 7f28b8ff9640 1 -- 10.20.193.28:0/3053285322 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f28a802f9f0 con 0x7f28bc10f4b0 2026-02-20T13:29:04.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.077+0000 7f28b8ff9640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28900b5760 0x7f28900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.077+0000 7f28b8ff9640 1 -- 10.20.193.28:0/3053285322 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f28a810afa0 con 0x7f28bc10f4b0 2026-02-20T13:29:04.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.077+0000 7f28baffd640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28900b5760 0x7f28900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28baffd640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28900b5760 0x7f28900d5c10 secure :-1 s=READY pgs=532 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28bc124770 tx=0x7f28ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28c41dee00 1 Processor -- start 2026-02-20T13:29:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28c41dee00 1 -- start start 2026-02-20T13:29:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbd180 0x556cdbcbd550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 0x556cdbd02400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 0x556cdbd22d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28c41dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556cdbbd37d0 con 0x556cdbcbd180 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28c41dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556cdbbcf500 con 0x556cdbd02940 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28c41dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556cdbbc94a0 con 0x556cdbcbda90 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28bb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbd180 0x556cdbcbd550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28bb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbd180 0x556cdbcbd550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41184/0 (socket says 10.20.193.28:41184) 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28bb7fe640 1 -- 10.20.193.28:0/2726567479 learned_addr learned my addr 10.20.193.28:0/2726567479 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28bbfff640 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 0x556cdbd22d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.078+0000 7f28baffd640 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 0x556cdbd02400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28bb7fe640 1 -- 10.20.193.28:0/2726567479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 msgr2=0x556cdbd02400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 0x556cdbd02400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28bb7fe640 1 -- 10.20.193.28:0/2726567479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 msgr2=0x556cdbd22d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:04.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 0x556cdbd22d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28bb7fe640 1 -- 10.20.193.28:0/2726567479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdbb74d80 con 0x556cdbcbd180 2026-02-20T13:29:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbd180 0x556cdbcbd550 secure :-1 s=READY pgs=1258 gs=1 cs=0 l=1 c_cookie=11764226084915686741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28a80d1620 tx=0x7f28a8038e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a342ed4b70c8ad55 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f287ffff640 1 -- 10.20.193.28:0/2726567479 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28a80d0bb0 con 0x556cdbcbd180 2026-02-20T13:29:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f287ffff640 1 -- 10.20.193.28:0/2726567479 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f28a8048e80 con 0x556cdbcbd180 2026-02-20T13:29:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f287ffff640 1 -- 10.20.193.28:0/2726567479 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28a80dc230 con 0x556cdbcbd180 2026-02-20T13:29:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28c41dee00 1 -- 10.20.193.28:0/2726567479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbd180 msgr2=0x556cdbcbd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbd180 0x556cdbcbd550 secure :-1 s=READY pgs=1258 gs=1 cs=0 l=1 c_cookie=11764226084915686741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28a80d1620 tx=0x7f28a8038e20 comp rx=0 tx=0).stop 2026-02-20T13:29:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28c41dee00 1 -- 10.20.193.28:0/2726567479 shutdown_connections 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 0x556cdbd22d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 0x556cdbd02400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2726567479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbd180 0x556cdbcbd550 unknown :-1 s=CLOSED pgs=1258 gs=1 cs=0 l=1 c_cookie=11764226084915686741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.079+0000 7f28c41dee00 1 -- 10.20.193.28:0/2726567479 >> 10.20.193.28:0/2726567479 conn(0x556cdbc9b680 msgr2=0x556cdbcbba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.080+0000 7f28c41dee00 1 -- 10.20.193.28:0/2726567479 shutdown_connections 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.080+0000 7f28c41dee00 1 -- 10.20.193.28:0/2726567479 wait complete. 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.081+0000 7f28c41dee00 1 -- start start 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.081+0000 7f28c41dee00 1 Processor -- start 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbd180 0x556cdbcd5620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcd5b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 0x556cdbcdab50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28c41dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556cdbcdb090 con 0x556cdbcbda90 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28c41dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556cdbcdb200 con 0x556cdbd02940 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28c41dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556cdbcdb3c0 con 0x556cdbcbd180 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcd5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcd5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41186/0 (socket says 10.20.193.28:41186) 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 -- 10.20.193.28:0/2409937633 learned_addr learned my addr 10.20.193.28:0/2409937633 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28bbfff640 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 0x556cdbcdab50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbd180 0x556cdbcd5620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 -- 10.20.193.28:0/2409937633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbd180 msgr2=0x556cdbcd5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbd180 0x556cdbcd5620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 -- 10.20.193.28:0/2409937633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 msgr2=0x556cdbcdab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 0x556cdbcdab50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 -- 10.20.193.28:0/2409937633 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdbb4d350 con 0x556cdbcbda90 2026-02-20T13:29:04.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f28baffd640 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcd5b60 secure :-1 s=READY pgs=1259 gs=1 cs=0 l=1 c_cookie=10347974225888159116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28ac009480 tx=0x7f28ac0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9b63bb86f6258c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:04.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.082+0000 7f287d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:04.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f287d7fa640 1 -- 10.20.193.28:0/2409937633 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28ac021070 con 0x556cdbcbda90 2026-02-20T13:29:04.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f287d7fa640 1 -- 10.20.193.28:0/2409937633 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f28ac01cd90 con 0x556cdbcbda90 2026-02-20T13:29:04.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f287d7fa640 1 -- 10.20.193.28:0/2409937633 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28ac025410 con 0x556cdbcbda90 2026-02-20T13:29:04.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc164870 con 0x556cdbcbda90 2026-02-20T13:29:04.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f28c41dee00 10 client.19632 _ll_register_callbacks cb 0x556cdbb4a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:04.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556cdb85f6f0 con 0x556cdbcbda90 2026-02-20T13:29:04.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f287d7fa640 1 -- 10.20.193.28:0/2409937633 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f28ac01c8b0 con 0x556cdbcbda90 2026-02-20T13:29:04.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f287d7fa640 1 -- 10.20.193.28:0/2409937633 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f28ac01ca70 con 0x556cdbcbda90 2026-02-20T13:29:04.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f28c41dee00 10 client.19632 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.083+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556cdbb5f150 con 0x556cdbcbda90 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.084+0000 7f287d7fa640 1 -- 10.20.193.28:0/2409937633 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f28ac01a450 con 0x556cdbcbda90 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.084+0000 7f28c41dee00 10 client.19632 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.084+0000 7f28c41dee00 10 client.19632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.084+0000 7f28c41dee00 20 client.19632 populate_metadata read hostname 'trial028' 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.084+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556cdbcfff40 0x556cdbd003e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.084+0000 7f28c41dee00 4 client.19632 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.084+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cdbbd6d60 con 0x556cdbcfff40 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.084+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556cdbcfff40 0x556cdbd003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.085+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556cdbcfff40 0x556cdbd003e0 crc :-1 s=READY pgs=338 gs=4 cs=0 l=0 c_cookie=1873976936806937833 s_cookie=9519646392025036091 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a01b41863a6f4e9 server_cookie=841c93f4cffb353b in_seq=0 out_seq=0 2026-02-20T13:29:04.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.085+0000 7f287d7fa640 10 client.19632 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.085+0000 7f287d7fa640 1 -- 10.20.193.28:0/2409937633 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556cdbbd6d60 con 0x556cdbcfff40 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.085+0000 7f287d7fa640 10 client.19632 handle_command_reply: tid=0 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.085+0000 7f28c41dee00 1 client.19632 shutdown 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.085+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 msgr2=0x556cdbcd5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.085+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcd5b60 secure :-1 s=READY pgs=1259 gs=1 cs=0 l=1 c_cookie=10347974225888159116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28ac009480 tx=0x7f28ac0047e0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 shutdown_connections 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556cdbcfff40 0x556cdbd003e0 crc :-1 s=READY pgs=338 gs=4 cs=0 l=0 c_cookie=1873976936806937833 s_cookie=9519646392025036091 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcd5b60 unknown :-1 s=CLOSED pgs=1259 gs=1 cs=0 l=1 c_cookie=10347974225888159116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbd02940 0x556cdbcdab50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 1 --2- 10.20.193.28:0/2409937633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbd180 0x556cdbcd5620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 >> 10.20.193.28:0/2409937633 conn(0x556cdbc9b680 msgr2=0x556cdbcbc250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:04.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f287d7fa640 0 client.19632 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:04.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 shutdown_connections 2026-02-20T13:29:04.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 1 -- 10.20.193.28:0/2409937633 wait complete. 2026-02-20T13:29:04.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.086+0000 7f28c41dee00 20 client.19632 trim_cache size 0 max 16384 2026-02-20T13:29:04.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28c41dee00 1 Processor -- start 2026-02-20T13:29:04.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28c41dee00 1 -- start start 2026-02-20T13:29:04.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 0x556cdbcfb690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcc7660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbd02940 0x556cdbd01ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28c41dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556cdbbc70d0 con 0x556cdbcbda90 2026-02-20T13:29:04.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28c41dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556cdb887700 con 0x556cdbcbd180 2026-02-20T13:29:04.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28c41dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556cdbc2c550 con 0x556cdbd02940 2026-02-20T13:29:04.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.095+0000 7f28baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcc7660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcc7660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41188/0 (socket says 10.20.193.28:41188) 2026-02-20T13:29:04.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28baffd640 1 -- 10.20.193.28:0/829110747 learned_addr learned my addr 10.20.193.28:0/829110747 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:04.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 0x556cdbcfb690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28bbfff640 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbd02940 0x556cdbd01ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28baffd640 1 -- 10.20.193.28:0/829110747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbd02940 msgr2=0x556cdbd01ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28baffd640 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbd02940 0x556cdbd01ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28baffd640 1 -- 10.20.193.28:0/829110747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 msgr2=0x556cdbcfb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28baffd640 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 0x556cdbcfb690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28baffd640 1 -- 10.20.193.28:0/829110747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdbb59bd0 con 0x556cdbcbda90 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28baffd640 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcc7660 secure :-1 s=READY pgs=1260 gs=1 cs=0 l=1 c_cookie=11403749510733642047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28ac016040 tx=0x7f28ac02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4241c2a6d0393f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f287f7fe640 1 -- 10.20.193.28:0/829110747 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28ac021040 con 0x556cdbcbda90 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f287f7fe640 1 -- 10.20.193.28:0/829110747 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x556cdb85f6f0 con 0x556cdbcbda90 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f287f7fe640 1 -- 10.20.193.28:0/829110747 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28ac01c040 con 0x556cdbcbda90 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28c41dee00 1 -- 10.20.193.28:0/829110747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 msgr2=0x556cdbcc7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28c41dee00 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcc7660 secure :-1 s=READY pgs=1260 gs=1 cs=0 l=1 c_cookie=11403749510733642047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28ac016040 tx=0x7f28ac02d000 comp rx=0 tx=0).stop 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.096+0000 7f28c41dee00 1 -- 10.20.193.28:0/829110747 shutdown_connections 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.097+0000 7f28c41dee00 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbcbda90 0x556cdbcc7660 unknown :-1 s=CLOSED pgs=1260 gs=1 cs=0 l=1 c_cookie=11403749510733642047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.097+0000 7f28c41dee00 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbd02940 0x556cdbd01ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.097+0000 7f28c41dee00 1 --2- 10.20.193.28:0/829110747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 0x556cdbcfb690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.097+0000 7f28c41dee00 1 -- 10.20.193.28:0/829110747 >> 10.20.193.28:0/829110747 conn(0x556cdbc9b680 msgr2=0x556cdbcf9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.097+0000 7f28c41dee00 1 -- 10.20.193.28:0/829110747 shutdown_connections 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.097+0000 7f28c41dee00 1 -- 10.20.193.28:0/829110747 wait complete. 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.097+0000 7f28c41dee00 1 -- start start 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.097+0000 7f28c41dee00 1 Processor -- start 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 0x556cdbcdd0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 0x556cdbcdd610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28c41dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbd02940 0x556cdbcddb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28c41dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556cdbd50860 con 0x556cdbd02940 2026-02-20T13:29:04.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28c41dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556cdbd509d0 con 0x556cdbcbd180 2026-02-20T13:29:04.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28c41dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x556cdbd50b90 con 0x556cdbcbda90 2026-02-20T13:29:04.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbd02940 0x556cdbcddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbd02940 0x556cdbcddb50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41204/0 (socket says 10.20.193.28:41204) 2026-02-20T13:29:04.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bbfff640 1 -- 10.20.193.28:0/3363488669 learned_addr learned my addr 10.20.193.28:0/3363488669 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:04.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 0x556cdbcdd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28baffd640 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 0x556cdbcdd610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bbfff640 1 -- 10.20.193.28:0/3363488669 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 msgr2=0x556cdbcdd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bbfff640 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 0x556cdbcdd610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bbfff640 1 -- 10.20.193.28:0/3363488669 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 msgr2=0x556cdbcdd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bbfff640 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 0x556cdbcdd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.098+0000 7f28bbfff640 1 -- 10.20.193.28:0/3363488669 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdbb4d680 con 0x556cdbd02940 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f28bbfff640 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbd02940 0x556cdbcddb50 secure :-1 s=READY pgs=1261 gs=2 cs=0 l=1 c_cookie=6667927675293003025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28b0011c50 tx=0x7f28b0010790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c893ce479d5ed11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f287d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f287d7fa640 1 -- 10.20.193.28:0/3363488669 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28b0018040 con 0x556cdbd02940 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f287d7fa640 1 -- 10.20.193.28:0/3363488669 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f28b0003c60 con 0x556cdbd02940 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f287d7fa640 1 -- 10.20.193.28:0/3363488669 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28b001da00 con 0x556cdbd02940 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cdbb5f150 con 0x556cdbd02940 2026-02-20T13:29:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f287d7fa640 1 -- 10.20.193.28:0/3363488669 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f28b001db90 con 0x556cdbd02940 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f28c41dee00 10 client.19638 _ll_register_callbacks cb 0x556cdbb4a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556cdb9214a0 con 0x556cdbd02940 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f287d7fa640 1 -- 10.20.193.28:0/3363488669 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f28b001d3b0 con 0x556cdbd02940 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f28c41dee00 10 client.19638 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.099+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556cdbb5f3b0 con 0x556cdbd02940 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f287d7fa640 1 -- 10.20.193.28:0/3363488669 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f28b0025060 con 0x556cdbd02940 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f28c41dee00 10 client.19638 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f28c41dee00 10 client.19638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f28c41dee00 20 client.19638 populate_metadata read hostname 'trial028' 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f28c41dee00 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556cdbd529f0 0x556cdbd52e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f28c41dee00 4 client.19638 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:29:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f28a8048e80 con 0x556cdbd529f0 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556cdbd529f0 0x556cdbd52e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f28bb7fe640 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556cdbd529f0 0x556cdbd52e90 crc :-1 s=READY pgs=339 gs=4 cs=0 l=0 c_cookie=3505621306710698531 s_cookie=11078590580826255264 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30a678013f882a23 server_cookie=99bf0f6fb6232fa0 in_seq=0 out_seq=0 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.100+0000 7f287d7fa640 10 client.19638 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f287d7fa640 1 -- 10.20.193.28:0/3363488669 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x7f28a8048e80 con 0x556cdbd529f0 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f287d7fa640 10 client.19638 handle_command_reply: tid=0 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 client.19638 shutdown 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbd02940 msgr2=0x556cdbcddb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbd02940 0x556cdbcddb50 secure :-1 s=READY pgs=1261 gs=2 cs=0 l=1 c_cookie=6667927675293003025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28b0011c50 tx=0x7f28b0010790 comp rx=0 tx=0).stop 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 shutdown_connections 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x556cdbd529f0 0x556cdbd52e90 crc :-1 s=READY pgs=339 gs=4 cs=0 l=0 c_cookie=3505621306710698531 s_cookie=11078590580826255264 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556cdbd02940 0x556cdbcddb50 unknown :-1 s=CLOSED pgs=1261 gs=2 cs=0 l=1 c_cookie=6667927675293003025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x556cdbcbda90 0x556cdbcdd610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 --2- 10.20.193.28:0/3363488669 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x556cdbcbd180 0x556cdbcdd0d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f287d7fa640 0 client.19638 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:04.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 >> 10.20.193.28:0/3363488669 conn(0x556cdbc9b680 msgr2=0x556cdbcfa760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:04.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 shutdown_connections 2026-02-20T13:29:04.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 1 -- 10.20.193.28:0/3363488669 wait complete. 2026-02-20T13:29:04.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c41dee00 20 client.19638 trim_cache size 0 max 16384 2026-02-20T13:29:04.109 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:29:04.109 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.110 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:29:04.112 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.115 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:29:04.117 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:29:04.120 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:29:04.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.101+0000 7f28c0f5b640 1 -- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28900b5760 msgr2=0x7f28900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28900b5760 0x7f28900d5c10 secure :-1 s=READY pgs=532 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28bc124770 tx=0x7f28ac005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 -- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 msgr2=0x7f28bc11ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 0x7f28bc11ddd0 secure :-1 s=READY pgs=1257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28a802f6a0 tx=0x7f28a8004290 comp rx=0 tx=0).stop 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 -- 10.20.193.28:0/3053285322 shutdown_connections 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f28900b5760 0x7f28900d5c10 unknown :-1 s=CLOSED pgs=532 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28bc1156a0 0x7f28bc1236e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f28bc10fea0 0x7f28bc11e310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 --2- 10.20.193.28:0/3053285322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28bc10f4b0 0x7f28bc11ddd0 unknown :-1 s=CLOSED pgs=1257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 -- 10.20.193.28:0/3053285322 >> 10.20.193.28:0/3053285322 conn(0x7f28bc0ecda0 msgr2=0x7f28bc10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 -- 10.20.193.28:0/3053285322 shutdown_connections 2026-02-20T13:29:04.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.102+0000 7f28c0f5b640 1 -- 10.20.193.28:0/3053285322 wait complete. 2026-02-20T13:29:04.202 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:29:04.202 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:29:04.389 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.559+0000 7fdd4284c640 1 -- 10.20.193.28:0/3803065619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c10f4b0 msgr2=0x7fdd3c10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.559+0000 7fdd4284c640 1 --2- 10.20.193.28:0/3803065619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c10f4b0 0x7fdd3c10f880 secure :-1 s=READY pgs=1262 gs=1 cs=0 l=1 c_cookie=10142854715077081224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd2c009950 tx=0x7fdd2c02f190 comp rx=0 tx=0).stop 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 -- 10.20.193.28:0/3803065619 shutdown_connections 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 --2- 10.20.193.28:0/3803065619 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd3c1156a0 0x7fdd3c176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 --2- 10.20.193.28:0/3803065619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd3c10fea0 0x7fdd3c114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 --2- 10.20.193.28:0/3803065619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c10f4b0 0x7fdd3c10f880 unknown :-1 s=CLOSED pgs=1262 gs=1 cs=0 l=1 c_cookie=10142854715077081224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 -- 10.20.193.28:0/3803065619 >> 10.20.193.28:0/3803065619 conn(0x7fdd3c0ecda0 msgr2=0x7fdd3c10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 -- 10.20.193.28:0/3803065619 shutdown_connections 2026-02-20T13:29:04.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 -- 10.20.193.28:0/3803065619 wait complete. 2026-02-20T13:29:04.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 Processor -- start 2026-02-20T13:29:04.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.560+0000 7fdd4284c640 1 -- start start 2026-02-20T13:29:04.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4284c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd3c10f4b0 0x7fdd3c11ddf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4284c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd3c10fea0 0x7fdd3c11e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4284c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c1156a0 0x7fdd3c123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4284c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c123d20 con 0x7fdd3c1156a0 2026-02-20T13:29:04.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4284c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c123e90 con 0x7fdd3c10fea0 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4284c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c124050 con 0x7fdd3c10f4b0 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c1156a0 0x7fdd3c123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c1156a0 0x7fdd3c123700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41214/0 (socket says 10.20.193.28:41214) 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 -- 10.20.193.28:0/2328111135 learned_addr learned my addr 10.20.193.28:0/2328111135 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd41049640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd3c10fea0 0x7fdd3c11e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4184a640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd3c10f4b0 0x7fdd3c11ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 -- 10.20.193.28:0/2328111135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd3c10f4b0 msgr2=0x7fdd3c11ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd3c10f4b0 0x7fdd3c11ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 -- 10.20.193.28:0/2328111135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd3c10fea0 msgr2=0x7fdd3c11e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd3c10fea0 0x7fdd3c11e330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 -- 10.20.193.28:0/2328111135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c009570 con 0x7fdd3c1156a0 2026-02-20T13:29:04.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd4204b640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c1156a0 0x7fdd3c123700 secure :-1 s=READY pgs=1263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd38006fd0 tx=0x7fdd3800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:04.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.561+0000 7fdd2affd640 1 -- 10.20.193.28:0/2328111135 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd380054a0 con 0x7fdd3c1156a0 2026-02-20T13:29:04.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.562+0000 7fdd2affd640 1 -- 10.20.193.28:0/2328111135 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdd38005600 con 0x7fdd3c1156a0 2026-02-20T13:29:04.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.562+0000 7fdd2affd640 1 -- 10.20.193.28:0/2328111135 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd380106d0 con 0x7fdd3c1156a0 2026-02-20T13:29:04.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.562+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c124330 con 0x7fdd3c1156a0 2026-02-20T13:29:04.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.562+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c164a30 con 0x7fdd3c1156a0 2026-02-20T13:29:04.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.562+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3c124550 con 0x7fdd3c1156a0 2026-02-20T13:29:04.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.564+0000 7fdd2affd640 1 -- 10.20.193.28:0/2328111135 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fdd38008860 con 0x7fdd3c1156a0 2026-02-20T13:29:04.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.566+0000 7fdd2affd640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd180b5760 0x7fdd180d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:04.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.566+0000 7fdd2affd640 1 -- 10.20.193.28:0/2328111135 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdd380e7ef0 con 0x7fdd3c1156a0 2026-02-20T13:29:04.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.566+0000 7fdd4184a640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd180b5760 0x7fdd180d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:04.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.566+0000 7fdd2affd640 1 -- 10.20.193.28:0/2328111135 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fdd380e8370 con 0x7fdd3c1156a0 2026-02-20T13:29:04.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.566+0000 7fdd4184a640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd180b5760 0x7fdd180d5c10 secure :-1 s=READY pgs=533 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd2c0098a0 tx=0x7fdd2c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:04.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.706+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd3c110790 con 0x7fdd3c1156a0 2026-02-20T13:29:04.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.707+0000 7fdd2affd640 1 -- 10.20.193.28:0/2328111135 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11997 (secure 0 0 0) 0x7fdd380aa8a0 con 0x7fdd3c1156a0 2026-02-20T13:29:04.710 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:29:04.710 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T13:28:03:632229+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:28:03.346734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[3],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:29:04.710 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T13:29:04.711 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:04 trial028 ceph-mon[37442]: pgmap v533: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:29:04.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd180b5760 msgr2=0x7fdd180d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd180b5760 0x7fdd180d5c10 secure :-1 s=READY pgs=533 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd2c0098a0 tx=0x7fdd2c031040 comp rx=0 tx=0).stop 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c1156a0 msgr2=0x7fdd3c123700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c1156a0 0x7fdd3c123700 secure :-1 s=READY pgs=1263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd38006fd0 tx=0x7fdd3800dde0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 shutdown_connections 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdd180b5760 0x7fdd180d5c10 unknown :-1 s=CLOSED pgs=533 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd3c1156a0 0x7fdd3c123700 unknown :-1 s=CLOSED pgs=1263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdd3c10fea0 0x7fdd3c11e330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 --2- 10.20.193.28:0/2328111135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdd3c10f4b0 0x7fdd3c11ddf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.708+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 >> 10.20.193.28:0/2328111135 conn(0x7fdd3c0ecda0 msgr2=0x7fdd3c10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.709+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 shutdown_connections 2026-02-20T13:29:04.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:04.709+0000 7fdd4284c640 1 -- 10.20.193.28:0/2328111135 wait complete. 2026-02-20T13:29:04.813 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:29:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:04 trial127 ceph-mon[43817]: pgmap v533: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:29:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:04 trial034 ceph-mon[43332]: pgmap v533: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:29:05.001 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:05.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.186+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3732928930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c10f5f0 msgr2=0x7f6c2c10f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.186+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3732928930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c10f5f0 0x7f6c2c10f9c0 secure :-1 s=READY pgs=1264 gs=1 cs=0 l=1 c_cookie=31238211611395221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c20009950 tx=0x7f6c2002f190 comp rx=0 tx=0).stop 2026-02-20T13:29:05.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.187+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3732928930 shutdown_connections 2026-02-20T13:29:05.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.187+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3732928930 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c2c1157e0 0x7f6c2c1761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.187+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3732928930 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c2c10ffe0 0x7f6c2c115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.187+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3732928930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c10f5f0 0x7f6c2c10f9c0 unknown :-1 s=CLOSED pgs=1264 gs=1 cs=0 l=1 c_cookie=31238211611395221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.187+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3732928930 >> 10.20.193.28:0/3732928930 conn(0x7f6c2c0ecea0 msgr2=0x7f6c2c10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.187+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3732928930 shutdown_connections 2026-02-20T13:29:05.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.187+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3732928930 wait complete. 2026-02-20T13:29:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.188+0000 7f6c30d1c640 1 Processor -- start 2026-02-20T13:29:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.188+0000 7f6c30d1c640 1 -- start start 2026-02-20T13:29:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.188+0000 7f6c30d1c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c2c10f5f0 0x7f6c2c11d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.188+0000 7f6c30d1c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c2c10ffe0 0x7f6c2c11dab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.188+0000 7f6c30d1c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c1157e0 0x7f6c2c122e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.188+0000 7f6c30d1c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1234a0 con 0x7f6c2c1157e0 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.188+0000 7f6c30d1c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c123610 con 0x7f6c2c10ffe0 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.188+0000 7f6c30d1c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1237d0 con 0x7f6c2c10f5f0 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c2c10f5f0 0x7f6c2c11d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c29d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c2c10ffe0 0x7f6c2c11dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c1157e0 0x7f6c2c122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c1157e0 0x7f6c2c122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41222/0 (socket says 10.20.193.28:41222) 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 -- 10.20.193.28:0/3328021569 learned_addr learned my addr 10.20.193.28:0/3328021569 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 -- 10.20.193.28:0/3328021569 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c2c10f5f0 msgr2=0x7f6c2c11d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c2c10f5f0 0x7f6c2c11d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 -- 10.20.193.28:0/3328021569 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c2c10ffe0 msgr2=0x7f6c2c11dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c2c10ffe0 0x7f6c2c11dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 -- 10.20.193.28:0/3328021569 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c20009570 con 0x7f6c2c1157e0 2026-02-20T13:29:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c2ad76640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c1157e0 0x7f6c2c122e80 secure :-1 s=READY pgs=1265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c1c00f8d0 tx=0x7f6c1c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c137fe640 1 -- 10.20.193.28:0/3328021569 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1c00dce0 con 0x7f6c2c1157e0 2026-02-20T13:29:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c137fe640 1 -- 10.20.193.28:0/3328021569 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c1c00de40 con 0x7f6c2c1157e0 2026-02-20T13:29:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c137fe640 1 -- 10.20.193.28:0/3328021569 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1c0116b0 con 0x7f6c2c1157e0 2026-02-20T13:29:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3328021569 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c123ab0 con 0x7f6c2c1157e0 2026-02-20T13:29:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.189+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3328021569 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c1641b0 con 0x7f6c2c1157e0 2026-02-20T13:29:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.192+0000 7f6c137fe640 1 -- 10.20.193.28:0/3328021569 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6c1c020060 con 0x7f6c2c1157e0 2026-02-20T13:29:05.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.194+0000 7f6c137fe640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c040b5760 0x7f6c040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.194+0000 7f6c137fe640 1 -- 10.20.193.28:0/3328021569 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6c1c015070 con 0x7f6c2c1157e0 2026-02-20T13:29:05.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.194+0000 7f6c2a575640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c040b5760 0x7f6c040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.194+0000 7f6c32d16e00 1 Processor -- start 2026-02-20T13:29:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c32d16e00 1 -- start start 2026-02-20T13:29:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c2a575640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c040b5760 0x7f6c040d5c10 secure :-1 s=READY pgs=534 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c200098a0 tx=0x7f6c2003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63360 0x558800d63730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800da85e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dc8f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558800c79780 con 0x558800da8b20 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558800c754b0 con 0x558800d63c70 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558800c6f450 con 0x558800d63360 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c2a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63360 0x558800d63730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c29d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800da85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c2a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63360 0x558800d63730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:33974/0 (socket says 10.20.193.28:33974) 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c2a575640 1 -- 10.20.193.28:0/603234180 learned_addr learned my addr 10.20.193.28:0/603234180 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c2ad76640 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dc8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c29d74640 1 -- 10.20.193.28:0/603234180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63360 msgr2=0x558800d63730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c29d74640 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63360 0x558800d63730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c29d74640 1 -- 10.20.193.28:0/603234180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 msgr2=0x558800dc8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c29d74640 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dc8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c29d74640 1 -- 10.20.193.28:0/603234180 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558800c1ad10 con 0x558800d63c70 2026-02-20T13:29:05.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.195+0000 7f6c2ad76640 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dc8f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c29d74640 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800da85e0 secure :-1 s=READY pgs=443 gs=2 cs=0 l=1 c_cookie=11977830653487148415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c14004740 tx=0x7f6c14002cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a639cd84a0e2ed7f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c10ff9640 1 -- 10.20.193.28:0/603234180 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1400fb60 con 0x558800d63c70 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c10ff9640 1 -- 10.20.193.28:0/603234180 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c1400fcc0 con 0x558800d63c70 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c10ff9640 1 -- 10.20.193.28:0/603234180 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c140197a0 con 0x558800d63c70 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 -- 10.20.193.28:0/603234180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 msgr2=0x558800da85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800da85e0 secure :-1 s=READY pgs=443 gs=2 cs=0 l=1 c_cookie=11977830653487148415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c14004740 tx=0x7f6c14002cc0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 -- 10.20.193.28:0/603234180 shutdown_connections 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dc8f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800da85e0 unknown :-1 s=CLOSED pgs=443 gs=2 cs=0 l=1 c_cookie=11977830653487148415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/603234180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63360 0x558800d63730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 -- 10.20.193.28:0/603234180 >> 10.20.193.28:0/603234180 conn(0x558800d41860 msgr2=0x558800d61c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 -- 10.20.193.28:0/603234180 shutdown_connections 2026-02-20T13:29:05.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.196+0000 7f6c32d16e00 1 -- 10.20.193.28:0/603234180 wait complete. 2026-02-20T13:29:05.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c32d16e00 1 -- start start 2026-02-20T13:29:05.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c32d16e00 1 Processor -- start 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d698e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63c70 0x558800d69e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 0x558800d675b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558800d67af0 con 0x558800d63c70 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558800d67c60 con 0x558800d63360 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558800d67e20 con 0x558800da8b20 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c2a575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c29d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63c70 0x558800d69e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c29d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63c70 0x558800d69e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41246/0 (socket says 10.20.193.28:41246) 2026-02-20T13:29:05.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c29d74640 1 -- 10.20.193.28:0/2539080196 learned_addr learned my addr 10.20.193.28:0/2539080196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.198+0000 7f6c2ad76640 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 0x558800d675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c29d74640 1 -- 10.20.193.28:0/2539080196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 msgr2=0x558800d675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c29d74640 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 0x558800d675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c29d74640 1 -- 10.20.193.28:0/2539080196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 msgr2=0x558800d698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c29d74640 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c29d74640 1 -- 10.20.193.28:0/2539080196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c140044c0 con 0x558800d63c70 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c29d74640 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63c70 0x558800d69e20 secure :-1 s=READY pgs=1266 gs=2 cs=0 l=1 c_cookie=17998454930383942010 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c14005de0 tx=0x7f6c14005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c75b663769b17a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6bd7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6bd7fff640 1 -- 10.20.193.28:0/2539080196 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1401f070 con 0x558800d63c70 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6bd7fff640 1 -- 10.20.193.28:0/2539080196 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c1400fb50 con 0x558800d63c70 2026-02-20T13:29:05.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6bd7fff640 1 -- 10.20.193.28:0/2539080196 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c14023690 con 0x558800d63c70 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c1641b0 con 0x558800d63c70 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6bd7fff640 1 -- 10.20.193.28:0/2539080196 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6c14011900 con 0x558800d63c70 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c32d16e00 10 client.19656 _ll_register_callbacks cb 0x558800bf0a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.199+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588009056f0 con 0x558800d63c70 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6bd7fff640 1 -- 10.20.193.28:0/2539080196 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c14011440 con 0x558800d63c70 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c32d16e00 10 client.19656 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558800bf33c0 con 0x558800d63c70 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6bd7fff640 1 -- 10.20.193.28:0/2539080196 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6c14017020 con 0x558800d63c70 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c32d16e00 10 client.19656 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c32d16e00 10 client.19656 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c32d16e00 20 client.19656 populate_metadata read hostname 'trial028' 2026-02-20T13:29:05.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558800d8e940 0x558800d8ede0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c32d16e00 4 client.19656 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558800c11f80 con 0x558800d8e940 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.200+0000 7f6c2a575640 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558800d8e940 0x558800d8ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.201+0000 7f6bd7fff640 10 client.19656 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.201+0000 7f6c2a575640 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558800d8e940 0x558800d8ede0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=13002533266793655631 s_cookie=4508970760366597193 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b472471da36f6d4f server_cookie=3e9315045a462449 in_seq=0 out_seq=0 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.201+0000 7f6bd7fff640 1 -- 10.20.193.28:0/2539080196 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558800c11f80 con 0x558800d8e940 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.201+0000 7f6bd7fff640 10 client.19656 handle_command_reply: tid=0 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 client.19656 shutdown 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63c70 msgr2=0x558800d69e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63c70 0x558800d69e20 secure :-1 s=READY pgs=1266 gs=2 cs=0 l=1 c_cookie=17998454930383942010 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c14005de0 tx=0x7f6c14005e10 comp rx=0 tx=0).stop 2026-02-20T13:29:05.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 shutdown_connections 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558800d8e940 0x558800d8ede0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=13002533266793655631 s_cookie=4508970760366597193 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63c70 0x558800d69e20 unknown :-1 s=CLOSED pgs=1266 gs=2 cs=0 l=1 c_cookie=17998454930383942010 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 0x558800d675b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2539080196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d698e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6bd7fff640 0 client.19656 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 >> 10.20.193.28:0/2539080196 conn(0x558800d41860 msgr2=0x558800d61c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 shutdown_connections 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2539080196 wait complete. 2026-02-20T13:29:05.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.202+0000 7f6c32d16e00 20 client.19656 trim_cache size 0 max 16384 2026-02-20T13:29:05.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.209+0000 7f6c32d16e00 1 Processor -- start 2026-02-20T13:29:05.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.209+0000 7f6c32d16e00 1 -- start start 2026-02-20T13:29:05.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.209+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d675a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63c70 0x558800da8370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dbd8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558800db2a20 con 0x558800da8b20 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558800c6d080 con 0x558800d63360 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55880092d700 con 0x558800d63c70 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c29d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63c70 0x558800da8370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c2a575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c2a575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57170/0 (socket says 10.20.193.28:57170) 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c2a575640 1 -- 10.20.193.28:0/2431226023 learned_addr learned my addr 10.20.193.28:0/2431226023 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c2ad76640 1 --2- 10.20.193.28:0/2431226023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dbd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c29d74640 1 -- 10.20.193.28:0/2431226023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 msgr2=0x558800d675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c29d74640 1 --2- 10.20.193.28:0/2431226023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d675a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c29d74640 1 -- 10.20.193.28:0/2431226023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 msgr2=0x558800dbd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c29d74640 1 --2- 10.20.193.28:0/2431226023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dbd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c29d74640 1 -- 10.20.193.28:0/2431226023 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558800c050e0 con 0x558800d63c70 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.210+0000 7f6c29d74640 1 --2- 10.20.193.28:0/2431226023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63c70 0x558800da8370 secure :-1 s=READY pgs=371 gs=2 cs=0 l=1 c_cookie=5967938711969920336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c14019980 tx=0x7f6c1402b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52d260a39844f550 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6bf64e6640 1 -- 10.20.193.28:0/2431226023 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1401f070 con 0x558800d63c70 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6bf64e6640 1 -- 10.20.193.28:0/2431226023 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c14033070 con 0x558800d63c70 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6bf64e6640 1 -- 10.20.193.28:0/2431226023 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1400dda0 con 0x558800d63c70 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2431226023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63c70 msgr2=0x558800da8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2431226023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63c70 0x558800da8370 secure :-1 s=READY pgs=371 gs=2 cs=0 l=1 c_cookie=5967938711969920336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c14019980 tx=0x7f6c1402b000 comp rx=0 tx=0).stop 2026-02-20T13:29:05.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2431226023 shutdown_connections 2026-02-20T13:29:05.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2431226023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800da8b20 0x558800dbd8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2431226023 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800d63c70 0x558800da8370 unknown :-1 s=CLOSED pgs=371 gs=2 cs=0 l=1 c_cookie=5967938711969920336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/2431226023 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63360 0x558800d675a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2431226023 >> 10.20.193.28:0/2431226023 conn(0x558800d41860 msgr2=0x558800da7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2431226023 shutdown_connections 2026-02-20T13:29:05.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 -- 10.20.193.28:0/2431226023 wait complete. 2026-02-20T13:29:05.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.211+0000 7f6c32d16e00 1 -- start start 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c32d16e00 1 Processor -- start 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63360 0x558800d947a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800d94ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c32d16e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 0x558800d934e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558800c6d080 con 0x558800d63360 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x558800d93a20 con 0x558800d63c70 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c32d16e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x558800d93be0 con 0x558800da8b20 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c2a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63360 0x558800d947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c2ad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 0x558800d934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c2a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63360 0x558800d947a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41254/0 (socket says 10.20.193.28:41254) 2026-02-20T13:29:05.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c2a575640 1 -- 10.20.193.28:0/3993009091 learned_addr learned my addr 10.20.193.28:0/3993009091 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c29d74640 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800d94ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.212+0000 7f6c2a575640 1 -- 10.20.193.28:0/3993009091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 msgr2=0x558800d934e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c2a575640 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 0x558800d934e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c2a575640 1 -- 10.20.193.28:0/3993009091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 msgr2=0x558800d94ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c2a575640 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800d94ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c2a575640 1 -- 10.20.193.28:0/3993009091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558800bffb60 con 0x558800d63360 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c29d74640 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800d94ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c2a575640 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63360 0x558800d947a0 secure :-1 s=READY pgs=1267 gs=1 cs=0 l=1 c_cookie=9919945488754813347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c2002f6a0 tx=0x7f6c20009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89aab9dd287829a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6bd7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6bd7fff640 1 -- 10.20.193.28:0/3993009091 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c20058070 con 0x558800d63360 2026-02-20T13:29:05.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558800bf33c0 con 0x558800d63360 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c32d16e00 10 client.19662 _ll_register_callbacks cb 0x558800bf0a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c1400fcc0 con 0x558800d63360 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6bd7fff640 1 -- 10.20.193.28:0/3993009091 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c2003e040 con 0x558800d63360 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6bd7fff640 1 -- 10.20.193.28:0/3993009091 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c20052690 con 0x558800d63360 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6bd7fff640 1 -- 10.20.193.28:0/3993009091 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6c200028c0 con 0x558800d63360 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6bd7fff640 1 -- 10.20.193.28:0/3993009091 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c20038e80 con 0x558800d63360 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c32d16e00 10 client.19662 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.213+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558800bf36f0 con 0x558800d63360 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6bd7fff640 1 -- 10.20.193.28:0/3993009091 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6c2004f040 con 0x558800d63360 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c32d16e00 10 client.19662 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:05.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c32d16e00 10 client.19662 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c32d16e00 20 client.19662 populate_metadata read hostname 'trial028' 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558800e5ec40 0x558800e7f0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c32d16e00 4 client.19662 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558800902f40 con 0x558800e5ec40 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c29d74640 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558800e5ec40 0x558800e7f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c29d74640 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558800e5ec40 0x558800e7f0f0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=8225331451281682197 s_cookie=16357951457533378543 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=72263f60117e2f15 server_cookie=e3031e2eb75c3fef in_seq=0 out_seq=0 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6bd7fff640 10 client.19662 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6bd7fff640 1 -- 10.20.193.28:0/3993009091 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558800902f40 con 0x558800e5ec40 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6bd7fff640 10 client.19662 handle_command_reply: tid=0 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.214+0000 7f6c32d16e00 1 client.19662 shutdown 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63360 msgr2=0x558800d947a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63360 0x558800d947a0 secure :-1 s=READY pgs=1267 gs=1 cs=0 l=1 c_cookie=9919945488754813347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c2002f6a0 tx=0x7f6c20009310 comp rx=0 tx=0).stop 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 shutdown_connections 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x558800e5ec40 0x558800e7f0f0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=8225331451281682197 s_cookie=16357951457533378543 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x558800da8b20 0x558800d934e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x558800d63c70 0x558800d94ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 --2- 10.20.193.28:0/3993009091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558800d63360 0x558800d947a0 unknown :-1 s=CLOSED pgs=1267 gs=1 cs=0 l=1 c_cookie=9919945488754813347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 >> 10.20.193.28:0/3993009091 conn(0x558800d41860 msgr2=0x558800d66590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6bd7fff640 0 client.19662 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 shutdown_connections 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 1 -- 10.20.193.28:0/3993009091 wait complete. 2026-02-20T13:29:05.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.215+0000 7f6c32d16e00 20 client.19662 trim_cache size 0 max 16384 2026-02-20T13:29:05.225 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:05.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c040b5760 msgr2=0x7f6c040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c040b5760 0x7f6c040d5c10 secure :-1 s=READY pgs=534 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c200098a0 tx=0x7f6c2003a040 comp rx=0 tx=0).stop 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c1157e0 msgr2=0x7f6c2c122e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c1157e0 0x7f6c2c122e80 secure :-1 s=READY pgs=1265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c1c00f8d0 tx=0x7f6c1c00fda0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3328021569 shutdown_connections 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6c040b5760 0x7f6c040d5c10 unknown :-1 s=CLOSED pgs=534 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c2c1157e0 0x7f6c2c122e80 unknown :-1 s=CLOSED pgs=1265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6c2c10ffe0 0x7f6c2c11dab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 --2- 10.20.193.28:0/3328021569 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6c2c10f5f0 0x7f6c2c11d570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3328021569 >> 10.20.193.28:0/3328021569 conn(0x7f6c2c0ecea0 msgr2=0x7f6c2c10d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3328021569 shutdown_connections 2026-02-20T13:29:05.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.216+0000 7f6c30d1c640 1 -- 10.20.193.28:0/3328021569 wait complete. 2026-02-20T13:29:05.317 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:29:05.506 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:05.571 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:05 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2328111135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:05.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.674+0000 7fd6d910f640 1 -- 10.20.193.28:0/491280586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410dd10 msgr2=0x7fd6d410e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.674+0000 7fd6d910f640 1 --2- 10.20.193.28:0/491280586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410dd10 0x7fd6d410e0e0 secure :-1 s=READY pgs=1268 gs=1 cs=0 l=1 c_cookie=5960085025785270331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c8009950 tx=0x7fd6c802f190 comp rx=0 tx=0).stop 2026-02-20T13:29:05.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.674+0000 7fd6d910f640 1 -- 10.20.193.28:0/491280586 shutdown_connections 2026-02-20T13:29:05.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.674+0000 7fd6d910f640 1 --2- 10.20.193.28:0/491280586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6d41532c0 0x7fd6d41736e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.674+0000 7fd6d910f640 1 --2- 10.20.193.28:0/491280586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6d410e700 0x7fd6d4152cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.674+0000 7fd6d910f640 1 --2- 10.20.193.28:0/491280586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410dd10 0x7fd6d410e0e0 unknown :-1 s=CLOSED pgs=1268 gs=1 cs=0 l=1 c_cookie=5960085025785270331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.674+0000 7fd6d910f640 1 -- 10.20.193.28:0/491280586 >> 10.20.193.28:0/491280586 conn(0x7fd6d40e96b0 msgr2=0x7fd6d4109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.674+0000 7fd6d910f640 1 -- 10.20.193.28:0/491280586 shutdown_connections 2026-02-20T13:29:05.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.675+0000 7fd6d910f640 1 -- 10.20.193.28:0/491280586 wait complete. 2026-02-20T13:29:05.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.675+0000 7fd6d910f640 1 Processor -- start 2026-02-20T13:29:05.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.675+0000 7fd6d910f640 1 -- start start 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d910f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6d410dd10 0x7fd6d41612e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d910f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410e700 0x7fd6d4161820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d910f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6d41532c0 0x7fd6d4166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d910f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d4167210 con 0x7fd6d410e700 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d910f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d4167380 con 0x7fd6d41532c0 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d910f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d4167540 con 0x7fd6d410dd10 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410e700 0x7fd6d4161820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6d410dd10 0x7fd6d41612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6d410dd10 0x7fd6d41612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34008/0 (socket says 10.20.193.28:34008) 2026-02-20T13:29:05.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2d76640 1 -- 10.20.193.28:0/3730204886 learned_addr learned my addr 10.20.193.28:0/3730204886 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410e700 0x7fd6d4161820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41280/0 (socket says 10.20.193.28:41280) 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d3577640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6d41532c0 0x7fd6d4166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2575640 1 -- 10.20.193.28:0/3730204886 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6d410dd10 msgr2=0x7fd6d41612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2575640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6d410dd10 0x7fd6d41612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2575640 1 -- 10.20.193.28:0/3730204886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6d41532c0 msgr2=0x7fd6d4166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2575640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6d41532c0 0x7fd6d4166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2575640 1 -- 10.20.193.28:0/3730204886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c8009570 con 0x7fd6d410e700 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.676+0000 7fd6d2575640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410e700 0x7fd6d4161820 secure :-1 s=READY pgs=1269 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6bc00e9c0 tx=0x7fd6bc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.677+0000 7fd6b3fff640 1 -- 10.20.193.28:0/3730204886 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6bc00ccb0 con 0x7fd6d410e700 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.677+0000 7fd6b3fff640 1 -- 10.20.193.28:0/3730204886 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6bc00ce10 con 0x7fd6d410e700 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.677+0000 7fd6b3fff640 1 -- 10.20.193.28:0/3730204886 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6bc0106b0 con 0x7fd6d410e700 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.677+0000 7fd6d910f640 1 -- 10.20.193.28:0/3730204886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d4167820 con 0x7fd6d410e700 2026-02-20T13:29:05.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.677+0000 7fd6d910f640 1 -- 10.20.193.28:0/3730204886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d414edb0 con 0x7fd6d410e700 2026-02-20T13:29:05.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.679+0000 7fd6b3fff640 1 -- 10.20.193.28:0/3730204886 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd6bc01f060 con 0x7fd6d410e700 2026-02-20T13:29:05.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.681+0000 7fd6b3fff640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6a80b5760 0x7fd6a80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.681+0000 7fd6b3fff640 1 -- 10.20.193.28:0/3730204886 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6bc014070 con 0x7fd6d410e700 2026-02-20T13:29:05.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.681+0000 7fd6d2d76640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6a80b5760 0x7fd6a80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.682+0000 7fd6d2d76640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6a80b5760 0x7fd6a80d5c10 secure :-1 s=READY pgs=535 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c80023d0 tx=0x7fd6c803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.682+0000 7fd6db109e00 1 Processor -- start 2026-02-20T13:29:05.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.682+0000 7fd6db109e00 1 -- start start 2026-02-20T13:29:05.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d29406f730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940b45e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d2940d4f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6db109e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d293f85780 con 0x55d29406f360 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6db109e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d293f814b0 con 0x55d29406fc70 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6db109e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d293f7b450 con 0x55d2940b4b20 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57212/0 (socket says 10.20.193.28:57212) 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d29406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d3577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d2940d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2575640 1 -- 10.20.193.28:0/3760295280 learned_addr learned my addr 10.20.193.28:0/3760295280 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2575640 1 -- 10.20.193.28:0/3760295280 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 msgr2=0x55d2940d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2575640 1 --2- 10.20.193.28:0/3760295280 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d2940d4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2575640 1 -- 10.20.193.28:0/3760295280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 msgr2=0x55d29406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2575640 1 --2- 10.20.193.28:0/3760295280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d29406f730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.683+0000 7fd6d2575640 1 -- 10.20.193.28:0/3760295280 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d293f26d10 con 0x55d29406fc70 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6d2575640 1 --2- 10.20.193.28:0/3760295280 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940b45e0 secure :-1 s=READY pgs=444 gs=2 cs=0 l=1 c_cookie=7563322165204979273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6bc0096b0 tx=0x7fd6bc0acfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f6516fe2e18e49 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd69f7fe640 1 -- 10.20.193.28:0/3760295280 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6bc0b2c40 con 0x55d29406fc70 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd69f7fe640 1 -- 10.20.193.28:0/3760295280 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6bc0b5220 con 0x55d29406fc70 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd69f7fe640 1 -- 10.20.193.28:0/3760295280 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6bc0a9320 con 0x55d29406fc70 2026-02-20T13:29:05.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 -- 10.20.193.28:0/3760295280 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 msgr2=0x55d2940b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 --2- 10.20.193.28:0/3760295280 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940b45e0 secure :-1 s=READY pgs=444 gs=2 cs=0 l=1 c_cookie=7563322165204979273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6bc0096b0 tx=0x7fd6bc0acfd0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 -- 10.20.193.28:0/3760295280 shutdown_connections 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 --2- 10.20.193.28:0/3760295280 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d2940d4f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 --2- 10.20.193.28:0/3760295280 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940b45e0 unknown :-1 s=CLOSED pgs=444 gs=2 cs=0 l=1 c_cookie=7563322165204979273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 --2- 10.20.193.28:0/3760295280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d29406f730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 -- 10.20.193.28:0/3760295280 >> 10.20.193.28:0/3760295280 conn(0x55d29404d860 msgr2=0x55d29406dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 -- 10.20.193.28:0/3760295280 shutdown_connections 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.684+0000 7fd6db109e00 1 -- 10.20.193.28:0/3760295280 wait complete. 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.685+0000 7fd6db109e00 1 -- start start 2026-02-20T13:29:05.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6db109e00 1 Processor -- start 2026-02-20T13:29:05.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d2940cc760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940ccca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d2940cea30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6db109e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d2940cefa0 con 0x55d29406f360 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6db109e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d2940cf110 con 0x55d29406fc70 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6db109e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d2940cf2d0 con 0x55d2940b4b20 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d2940cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d2940cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41302/0 (socket says 10.20.193.28:41302) 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2d76640 1 -- 10.20.193.28:0/241731894 learned_addr learned my addr 10.20.193.28:0/241731894 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d3577640 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d2940cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2575640 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2d76640 1 -- 10.20.193.28:0/241731894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 msgr2=0x55d2940cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2d76640 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d2940cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2d76640 1 -- 10.20.193.28:0/241731894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 msgr2=0x55d2940ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2d76640 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2d76640 1 -- 10.20.193.28:0/241731894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d293eff3c0 con 0x55d29406f360 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.686+0000 7fd6d2575640 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940ccca0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd6d2d76640 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d2940cc760 secure :-1 s=READY pgs=1270 gs=2 cs=0 l=1 c_cookie=12655003047270842576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c8002fd0 tx=0x7fd6c8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9f9a38f01080d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd69cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd69cff9640 1 -- 10.20.193.28:0/241731894 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6c8038d50 con 0x55d29406f360 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd69cff9640 1 -- 10.20.193.28:0/241731894 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6c803e040 con 0x55d29406f360 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d414edb0 con 0x55d29406f360 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd69cff9640 1 -- 10.20.193.28:0/241731894 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6c8050670 con 0x55d29406f360 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd6db109e00 10 client.19674 _ll_register_callbacks cb 0x55d293efca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:05.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d293c116f0 con 0x55d29406f360 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd69cff9640 1 -- 10.20.193.28:0/241731894 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6c8050800 con 0x55d29406f360 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd69cff9640 1 -- 10.20.193.28:0/241731894 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd6c8044410 con 0x55d29406f360 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd6db109e00 10 client.19674 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.687+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d293f110e0 con 0x55d29406f360 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.688+0000 7fd69cff9640 1 -- 10.20.193.28:0/241731894 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fd6c804f070 con 0x55d29406f360 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.688+0000 7fd6db109e00 10 client.19674 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.688+0000 7fd6db109e00 10 client.19674 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.688+0000 7fd6db109e00 20 client.19674 populate_metadata read hostname 'trial028' 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.688+0000 7fd6db109e00 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d2940d4d30 0x55d2940b28a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.688+0000 7fd6db109e00 4 client.19674 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.688+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d293f1df80 con 0x55d2940d4d30 2026-02-20T13:29:05.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.688+0000 7fd6d2575640 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d2940d4d30 0x55d2940b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.689+0000 7fd6d2575640 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d2940d4d30 0x55d2940b28a0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=9760887212647849861 s_cookie=15750337898369396265 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8775a3345a871f85 server_cookie=da9470dea4ae2e29 in_seq=0 out_seq=0 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.689+0000 7fd69cff9640 10 client.19674 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.689+0000 7fd69cff9640 1 -- 10.20.193.28:0/241731894 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d293f1df80 con 0x55d2940d4d30 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.689+0000 7fd69cff9640 10 client.19674 handle_command_reply: tid=0 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.689+0000 7fd6db109e00 1 client.19674 shutdown 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.689+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 msgr2=0x55d2940cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.689+0000 7fd6db109e00 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d2940cc760 secure :-1 s=READY pgs=1270 gs=2 cs=0 l=1 c_cookie=12655003047270842576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c8002fd0 tx=0x7fd6c8009310 comp rx=0 tx=0).stop 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 shutdown_connections 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d2940d4d30 0x55d2940b28a0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=9760887212647849861 s_cookie=15750337898369396265 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d2940cea30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d2940ccca0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 1 --2- 10.20.193.28:0/241731894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d2940cc760 unknown :-1 s=CLOSED pgs=1270 gs=2 cs=0 l=1 c_cookie=12655003047270842576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 >> 10.20.193.28:0/241731894 conn(0x55d29404d860 msgr2=0x55d29406dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd69cff9640 0 client.19674 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:29:05.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 shutdown_connections 2026-02-20T13:29:05.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 1 -- 10.20.193.28:0/241731894 wait complete. 2026-02-20T13:29:05.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.690+0000 7fd6db109e00 20 client.19674 trim_cache size 0 max 16384 2026-02-20T13:29:05.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6db109e00 1 Processor -- start 2026-02-20T13:29:05.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6db109e00 1 -- start start 2026-02-20T13:29:05.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406f360 0x55d2940ce9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d29406fc70 0x55d2940c98f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2940b4b20 0x55d2940c9e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6db109e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d293f79080 con 0x55d2940b4b20 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6db109e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d293c39700 con 0x55d29406f360 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6db109e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d2940d2cc0 con 0x55d29406fc70 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6d2d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406f360 0x55d2940ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6d3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2940b4b20 0x55d2940c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6d2d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406f360 0x55d2940ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57234/0 (socket says 10.20.193.28:57234) 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6d2d76640 1 -- 10.20.193.28:0/2398854530 learned_addr learned my addr 10.20.193.28:0/2398854530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.698+0000 7fd6d2575640 1 --2- 10.20.193.28:0/2398854530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d29406fc70 0x55d2940c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6d3577640 1 -- 10.20.193.28:0/2398854530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d29406fc70 msgr2=0x55d2940c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6d3577640 1 --2- 10.20.193.28:0/2398854530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d29406fc70 0x55d2940c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6d3577640 1 -- 10.20.193.28:0/2398854530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406f360 msgr2=0x55d2940ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6d3577640 1 --2- 10.20.193.28:0/2398854530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406f360 0x55d2940ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6d3577640 1 -- 10.20.193.28:0/2398854530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d293f0bb60 con 0x55d2940b4b20 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6d3577640 1 --2- 10.20.193.28:0/2398854530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2940b4b20 0x55d2940c9e30 secure :-1 s=READY pgs=1271 gs=3 cs=0 l=1 c_cookie=11281477129256154314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c4005740 tx=0x7fd6c400a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8fdbad5f01b4ca server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd69effd640 1 -- 10.20.193.28:0/2398854530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6c4017070 con 0x55d2940b4b20 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd69effd640 1 -- 10.20.193.28:0/2398854530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6c4018040 con 0x55d2940b4b20 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd69effd640 1 -- 10.20.193.28:0/2398854530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6c401c7a0 con 0x55d2940b4b20 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6db109e00 1 -- 10.20.193.28:0/2398854530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2940b4b20 msgr2=0x55d2940c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6db109e00 1 --2- 10.20.193.28:0/2398854530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2940b4b20 0x55d2940c9e30 secure :-1 s=READY pgs=1271 gs=3 cs=0 l=1 c_cookie=11281477129256154314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c4005740 tx=0x7fd6c400a310 comp rx=0 tx=0).stop 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6db109e00 1 -- 10.20.193.28:0/2398854530 shutdown_connections 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6db109e00 1 --2- 10.20.193.28:0/2398854530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2940b4b20 0x55d2940c9e30 unknown :-1 s=CLOSED pgs=1271 gs=3 cs=0 l=1 c_cookie=11281477129256154314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6db109e00 1 --2- 10.20.193.28:0/2398854530 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d29406fc70 0x55d2940c98f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6db109e00 1 --2- 10.20.193.28:0/2398854530 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406f360 0x55d2940ce9c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.699+0000 7fd6db109e00 1 -- 10.20.193.28:0/2398854530 >> 10.20.193.28:0/2398854530 conn(0x55d29404d860 msgr2=0x55d2940d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.700+0000 7fd6db109e00 1 -- 10.20.193.28:0/2398854530 shutdown_connections 2026-02-20T13:29:05.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.700+0000 7fd6db109e00 1 -- 10.20.193.28:0/2398854530 wait complete. 2026-02-20T13:29:05.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.700+0000 7fd6db109e00 1 -- start start 2026-02-20T13:29:05.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.700+0000 7fd6db109e00 1 Processor -- start 2026-02-20T13:29:05.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d29404dc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d29404e170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6db109e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d29404e6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6db109e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d29404d2a0 con 0x55d29406f360 2026-02-20T13:29:05.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6db109e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d2940d3820 con 0x55d29406fc70 2026-02-20T13:29:05.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6db109e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d29411b9f0 con 0x55d2940b4b20 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d29404e170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d29404dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d29404e170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57240/0 (socket says 10.20.193.28:57240) 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 -- 10.20.193.28:0/1514328570 learned_addr learned my addr 10.20.193.28:0/1514328570 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d3577640 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d29404e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 -- 10.20.193.28:0/1514328570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 msgr2=0x55d29404e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d29404e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 -- 10.20.193.28:0/1514328570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 msgr2=0x55d29404dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d29404dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 -- 10.20.193.28:0/1514328570 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d293eff6f0 con 0x55d29406fc70 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd6d2575640 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d29404e170 secure :-1 s=READY pgs=445 gs=2 cs=0 l=1 c_cookie=9501120869843582486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6bc0a94a0 tx=0x7fd6bc0aca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83dac3178f13be16 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.701+0000 7fd69cff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd69cff9640 1 -- 10.20.193.28:0/1514328570 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6bc070040 con 0x55d29406fc70 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd69cff9640 1 -- 10.20.193.28:0/1514328570 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6bc0d20e0 con 0x55d29406fc70 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c4005400 con 0x55d29406fc70 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 10 client.29618 _ll_register_callbacks cb 0x55d293efca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6bc0b5220 con 0x55d29406fc70 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd69cff9640 1 -- 10.20.193.28:0/1514328570 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6bc0addd0 con 0x55d29406fc70 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd69cff9640 1 -- 10.20.193.28:0/1514328570 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6bc0b7bd0 con 0x55d29406fc70 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd69cff9640 1 -- 10.20.193.28:0/1514328570 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd6bc0b7d90 con 0x55d29406fc70 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 10 client.29618 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:05.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d293f11340 con 0x55d29406fc70 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd69cff9640 1 -- 10.20.193.28:0/1514328570 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fd6bc0720b0 con 0x55d29406fc70 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 10 client.29618 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 10 client.29618 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 20 client.29618 populate_metadata read hostname 'trial028' 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d294162930 0x55d294182de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 4 client.29618 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.702+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d293c0ef40 con 0x55d294162930 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.703+0000 7fd6d2d76640 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d294162930 0x55d294182de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.703+0000 7fd6d2d76640 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d294162930 0x55d294182de0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=2398859971616943752 s_cookie=11227998677096976694 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=214a766f3a21ae88 server_cookie=9bd1dd4eeeebd136 in_seq=0 out_seq=0 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.703+0000 7fd69cff9640 10 client.29618 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:29:05.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd69cff9640 1 -- 10.20.193.28:0/1514328570 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d293c0ef40 con 0x55d294162930 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd69cff9640 10 client.29618 handle_command_reply: tid=0 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 client.29618 shutdown 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 msgr2=0x55d29404e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d29404e170 secure :-1 s=READY pgs=445 gs=2 cs=0 l=1 c_cookie=9501120869843582486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6bc0a94a0 tx=0x7fd6bc0aca00 comp rx=0 tx=0).stop 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 shutdown_connections 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55d294162930 0x55d294182de0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=2398859971616943752 s_cookie=11227998677096976694 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2940b4b20 0x55d29404e6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d29406fc70 0x55d29404e170 unknown :-1 s=CLOSED pgs=445 gs=2 cs=0 l=1 c_cookie=9501120869843582486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 --2- 10.20.193.28:0/1514328570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d29406f360 0x55d29404dc30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd69cff9640 0 client.29618 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 >> 10.20.193.28:0/1514328570 conn(0x55d29404d860 msgr2=0x55d29406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 shutdown_connections 2026-02-20T13:29:05.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 1 -- 10.20.193.28:0/1514328570 wait complete. 2026-02-20T13:29:05.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6db109e00 20 client.29618 trim_cache size 0 max 16384 2026-02-20T13:29:05.713 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6d910f640 1 -- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6a80b5760 msgr2=0x7fd6a80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6d910f640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6a80b5760 0x7fd6a80d5c10 secure :-1 s=READY pgs=535 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c80023d0 tx=0x7fd6c803a040 comp rx=0 tx=0).stop 2026-02-20T13:29:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6d910f640 1 -- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410e700 msgr2=0x7fd6d4161820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.704+0000 7fd6d910f640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410e700 0x7fd6d4161820 secure :-1 s=READY pgs=1269 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6bc00e9c0 tx=0x7fd6bc00ee90 comp rx=0 tx=0).stop 2026-02-20T13:29:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.705+0000 7fd6d910f640 1 -- 10.20.193.28:0/3730204886 shutdown_connections 2026-02-20T13:29:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.705+0000 7fd6d910f640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6a80b5760 0x7fd6a80d5c10 unknown :-1 s=CLOSED pgs=535 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.705+0000 7fd6d910f640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d410e700 0x7fd6d4161820 unknown :-1 s=CLOSED pgs=1269 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.705+0000 7fd6d910f640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6d41532c0 0x7fd6d4166bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.705+0000 7fd6d910f640 1 --2- 10.20.193.28:0/3730204886 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6d410dd10 0x7fd6d41612e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.705+0000 7fd6d910f640 1 -- 10.20.193.28:0/3730204886 >> 10.20.193.28:0/3730204886 conn(0x7fd6d40e96b0 msgr2=0x7fd6d4109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.705+0000 7fd6d910f640 1 -- 10.20.193.28:0/3730204886 shutdown_connections 2026-02-20T13:29:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:05.705+0000 7fd6d910f640 1 -- 10.20.193.28:0/3730204886 wait complete. 2026-02-20T13:29:05.803 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:29:05.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:05 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2328111135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:05.987 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:05.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:05 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2328111135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 -- 10.20.193.28:0/3469149003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3c062ae0 msgr2=0x7f6b3c060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 --2- 10.20.193.28:0/3469149003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3c062ae0 0x7f6b3c060fb0 secure :-1 s=READY pgs=1272 gs=1 cs=0 l=1 c_cookie=7901819671401850874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b2c009890 tx=0x7f6b2c02f120 comp rx=0 tx=0).stop 2026-02-20T13:29:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 -- 10.20.193.28:0/3469149003 shutdown_connections 2026-02-20T13:29:06.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 --2- 10.20.193.28:0/3469149003 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b3c159d80 0x7f6b3c17a160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 --2- 10.20.193.28:0/3469149003 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3c0614f0 0x7f6b3c061920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 --2- 10.20.193.28:0/3469149003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3c062ae0 0x7f6b3c060fb0 unknown :-1 s=CLOSED pgs=1272 gs=1 cs=0 l=1 c_cookie=7901819671401850874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 -- 10.20.193.28:0/3469149003 >> 10.20.193.28:0/3469149003 conn(0x7f6b3c0eab00 msgr2=0x7f6b3c10af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 -- 10.20.193.28:0/3469149003 shutdown_connections 2026-02-20T13:29:06.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.158+0000 7f6b42926640 1 -- 10.20.193.28:0/3469149003 wait complete. 2026-02-20T13:29:06.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42926640 1 Processor -- start 2026-02-20T13:29:06.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42926640 1 -- start start 2026-02-20T13:29:06.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42926640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b3c0614f0 0x7f6b3c0f2e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42926640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3c062ae0 0x7f6b3c0f33c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42926640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3c159d80 0x7f6b3c0f8790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42926640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c0f8db0 con 0x7f6b3c159d80 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42926640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c0f8f20 con 0x7f6b3c0614f0 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42926640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c0f90e0 con 0x7f6b3c062ae0 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b41924640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b3c0614f0 0x7f6b3c0f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b41123640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3c062ae0 0x7f6b3c0f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b41924640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b3c0614f0 0x7f6b3c0f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57248/0 (socket says 10.20.193.28:57248) 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b41924640 1 -- 10.20.193.28:0/2938664316 learned_addr learned my addr 10.20.193.28:0/2938664316 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b41123640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3c062ae0 0x7f6b3c0f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34058/0 (socket says 10.20.193.28:34058) 2026-02-20T13:29:06.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b42125640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3c159d80 0x7f6b3c0f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.159+0000 7f6b41924640 1 -- 10.20.193.28:0/2938664316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3c062ae0 msgr2=0x7f6b3c0f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b41924640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3c062ae0 0x7f6b3c0f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b41924640 1 -- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3c159d80 msgr2=0x7f6b3c0f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b41924640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3c159d80 0x7f6b3c0f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b41924640 1 -- 10.20.193.28:0/2938664316 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c0094b0 con 0x7f6b3c0614f0 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b41123640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3c062ae0 0x7f6b3c0f33c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b41924640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b3c0614f0 0x7f6b3c0f2e80 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b2c0023b0 tx=0x7f6b2c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b2affd640 1 -- 10.20.193.28:0/2938664316 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b2c03d070 con 0x7f6b3c0614f0 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b42926640 1 -- 10.20.193.28:0/2938664316 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3c0f9360 con 0x7f6b3c0614f0 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b2affd640 1 -- 10.20.193.28:0/2938664316 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6b2c02fcb0 con 0x7f6b3c0614f0 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b2affd640 1 -- 10.20.193.28:0/2938664316 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b2c041ae0 con 0x7f6b3c0614f0 2026-02-20T13:29:06.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.160+0000 7f6b42926640 1 -- 10.20.193.28:0/2938664316 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b3c0f9aa0 con 0x7f6b3c0614f0 2026-02-20T13:29:06.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.163+0000 7f6b2affd640 1 -- 10.20.193.28:0/2938664316 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6b2c0386b0 con 0x7f6b3c0614f0 2026-02-20T13:29:06.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.164+0000 7f6b2affd640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b180b56e0 0x7f6b180d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.164+0000 7f6b2affd640 1 -- 10.20.193.28:0/2938664316 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6b2c10b720 con 0x7f6b3c0614f0 2026-02-20T13:29:06.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.164+0000 7f6b41123640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b180b56e0 0x7f6b180d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.165+0000 7f6b41123640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b180b56e0 0x7f6b180d5b90 secure :-1 s=READY pgs=536 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b3c0f9820 tx=0x7f6b30009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.166+0000 7f6b45ba9e00 1 Processor -- start 2026-02-20T13:29:06.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.166+0000 7f6b45ba9e00 1 -- start start 2026-02-20T13:29:06.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.166+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb0c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.166+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb0cc70 0x56511bb515e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.166+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb51b20 0x56511bb71f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.166+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56511ba22780 con 0x56511bb51b20 2026-02-20T13:29:06.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.166+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56511ba1e4b0 con 0x56511bb0cc70 2026-02-20T13:29:06.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.166+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56511ba18450 con 0x56511bb0c360 2026-02-20T13:29:06.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb0c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb0c730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34064/0 (socket says 10.20.193.28:34064) 2026-02-20T13:29:06.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 -- 10.20.193.28:0/3157160616 learned_addr learned my addr 10.20.193.28:0/3157160616 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41123640 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb0cc70 0x56511bb515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b42125640 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb51b20 0x56511bb71f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 -- 10.20.193.28:0/3157160616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb0cc70 msgr2=0x56511bb515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb0cc70 0x56511bb515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 -- 10.20.193.28:0/3157160616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb51b20 msgr2=0x56511bb71f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb51b20 0x56511bb71f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 -- 10.20.193.28:0/3157160616 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511b9c3d10 con 0x56511bb0c360 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b41924640 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb0c730 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=13610201269389139171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b2c006010 tx=0x7f6b2c02f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bce125f1cf829ce3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b0a4e6640 1 -- 10.20.193.28:0/3157160616 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b2c0d1330 con 0x56511bb0c360 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.167+0000 7f6b0a4e6640 1 -- 10.20.193.28:0/3157160616 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6b2c0d77a0 con 0x56511bb0c360 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b0a4e6640 1 -- 10.20.193.28:0/3157160616 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b2c0dc9b0 con 0x56511bb0c360 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/3157160616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 msgr2=0x56511bb0c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb0c730 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=13610201269389139171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b2c006010 tx=0x7f6b2c02f120 comp rx=0 tx=0).stop 2026-02-20T13:29:06.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/3157160616 shutdown_connections 2026-02-20T13:29:06.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb51b20 0x56511bb71f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb0cc70 0x56511bb515e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/3157160616 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb0c730 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=13610201269389139171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/3157160616 >> 10.20.193.28:0/3157160616 conn(0x56511baea860 msgr2=0x56511bb0ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/3157160616 shutdown_connections 2026-02-20T13:29:06.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.168+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/3157160616 wait complete. 2026-02-20T13:29:06.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.169+0000 7f6b45ba9e00 1 -- start start 2026-02-20T13:29:06.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b45ba9e00 1 Processor -- start 2026-02-20T13:29:06.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb69640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb69b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bb6eb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56511bb6f0b0 con 0x56511bb0cc70 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56511bb6f220 con 0x56511bb51b20 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56511bb6f3e0 con 0x56511bb0c360 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41123640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb69b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41123640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb69b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41352/0 (socket says 10.20.193.28:41352) 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41123640 1 -- 10.20.193.28:0/2448281139 learned_addr learned my addr 10.20.193.28:0/2448281139 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41924640 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb69640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b42125640 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bb6eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41123640 1 -- 10.20.193.28:0/2448281139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 msgr2=0x56511bb69640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41123640 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb69640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41123640 1 -- 10.20.193.28:0/2448281139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 msgr2=0x56511bb6eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41123640 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bb6eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.170+0000 7f6b41123640 1 -- 10.20.193.28:0/2448281139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511b99c3c0 con 0x56511bb0cc70 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6b41123640 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb69b80 secure :-1 s=READY pgs=1273 gs=1 cs=0 l=1 c_cookie=12851787874745757105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b30011c40 tx=0x7f6b30013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25ab8fafae4adb1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6af77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6af77fe640 1 -- 10.20.193.28:0/2448281139 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b30021040 con 0x56511bb0cc70 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b3c0f9aa0 con 0x56511bb0cc70 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6b45ba9e00 10 client.19692 _ll_register_callbacks cb 0x56511b999a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56511b6ae6f0 con 0x56511bb0cc70 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6af77fe640 1 -- 10.20.193.28:0/2448281139 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56511b6ae6f0 con 0x56511bb0cc70 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6af77fe640 1 -- 10.20.193.28:0/2448281139 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b30026480 con 0x56511bb0cc70 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6af77fe640 1 -- 10.20.193.28:0/2448281139 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6b30026610 con 0x56511bb0cc70 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6af77fe640 1 -- 10.20.193.28:0/2448281139 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6b30026860 con 0x56511bb0cc70 2026-02-20T13:29:06.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6b45ba9e00 10 client.19692 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.171+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56511b9ae0e0 con 0x56511bb0cc70 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.172+0000 7f6af77fe640 1 -- 10.20.193.28:0/2448281139 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6b30005020 con 0x56511bb0cc70 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.172+0000 7f6b45ba9e00 10 client.19692 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.172+0000 7f6b45ba9e00 10 client.19692 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.172+0000 7f6b45ba9e00 20 client.19692 populate_metadata read hostname 'trial028' 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.172+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56511bb71ca0 0x56511bb4f8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.172+0000 7f6b45ba9e00 4 client.19692 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.172+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56511b9baf80 con 0x56511bb71ca0 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.172+0000 7f6b41924640 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56511bb71ca0 0x56511bb4f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.173+0000 7f6b41924640 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56511bb71ca0 0x56511bb4f8a0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=13787913043672068697 s_cookie=4661937922023330332 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf5881dc9a0c7259 server_cookie=40b287d70f1f921c in_seq=0 out_seq=0 2026-02-20T13:29:06.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.173+0000 7f6af77fe640 10 client.19692 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:29:06.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.173+0000 7f6af77fe640 1 -- 10.20.193.28:0/2448281139 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56511b9baf80 con 0x56511bb71ca0 2026-02-20T13:29:06.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.173+0000 7f6af77fe640 10 client.19692 handle_command_reply: tid=0 2026-02-20T13:29:06.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.173+0000 7f6b45ba9e00 1 client.19692 shutdown 2026-02-20T13:29:06.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 msgr2=0x56511bb69b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb69b80 secure :-1 s=READY pgs=1273 gs=1 cs=0 l=1 c_cookie=12851787874745757105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b30011c40 tx=0x7f6b30013040 comp rx=0 tx=0).stop 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 shutdown_connections 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56511bb71ca0 0x56511bb4f8a0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=13787913043672068697 s_cookie=4661937922023330332 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb69b80 unknown :-1 s=CLOSED pgs=1273 gs=1 cs=0 l=1 c_cookie=12851787874745757105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bb6eb70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/2448281139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb69640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6af77fe640 0 client.19692 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 >> 10.20.193.28:0/2448281139 conn(0x56511baea860 msgr2=0x56511bb0ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 shutdown_connections 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/2448281139 wait complete. 2026-02-20T13:29:06.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.174+0000 7f6b45ba9e00 20 client.19692 trim_cache size 0 max 16384 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b45ba9e00 1 Processor -- start 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b45ba9e00 1 -- start start 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb66f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb508b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bb50df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56511bb5b9c0 con 0x56511bb0cc70 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56511ba16080 con 0x56511bb51b20 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56511b6d6700 con 0x56511bb0c360 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b41924640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb66f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b41924640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb66f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34082/0 (socket says 10.20.193.28:34082) 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b41924640 1 -- 10.20.193.28:0/648679033 learned_addr learned my addr 10.20.193.28:0/648679033 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b42125640 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bb50df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.181+0000 7f6b41123640 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b41924640 1 -- 10.20.193.28:0/648679033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 msgr2=0x56511bb50df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b41924640 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bb50df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b41924640 1 -- 10.20.193.28:0/648679033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 msgr2=0x56511bb508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b41924640 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b41924640 1 -- 10.20.193.28:0/648679033 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511b9a8b60 con 0x56511bb0c360 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b41924640 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb66f50 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=13586410943686776458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b2c0d3d10 tx=0x7f6b2c03a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc8ca0c4f6ee168a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b09ce5640 1 -- 10.20.193.28:0/648679033 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b2c0d9d80 con 0x56511bb0c360 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b09ce5640 1 -- 10.20.193.28:0/648679033 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6b2c0bb0d0 con 0x56511bb0c360 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b09ce5640 1 -- 10.20.193.28:0/648679033 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b2c0dc9b0 con 0x56511bb0c360 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/648679033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 msgr2=0x56511bb66f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb66f50 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=13586410943686776458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b2c0d3d10 tx=0x7f6b2c03a040 comp rx=0 tx=0).stop 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/648679033 shutdown_connections 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511bb508b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bb50df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/648679033 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511bb66f50 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=13586410943686776458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/648679033 >> 10.20.193.28:0/648679033 conn(0x56511baea860 msgr2=0x56511bb65830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/648679033 shutdown_connections 2026-02-20T13:29:06.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.182+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/648679033 wait complete. 2026-02-20T13:29:06.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.183+0000 7f6b45ba9e00 1 -- start start 2026-02-20T13:29:06.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.183+0000 7f6b45ba9e00 1 Processor -- start 2026-02-20T13:29:06.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.183+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511baec6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.183+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511baecc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.183+0000 7f6b45ba9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bbb76a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.183+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56511b6d6700 con 0x56511bb0cc70 2026-02-20T13:29:06.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.183+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56511bb5b9c0 con 0x56511bb51b20 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.183+0000 7f6b45ba9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56511ba16080 con 0x56511bb0c360 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b42125640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bbb76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511baecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511baecc30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41370/0 (socket says 10.20.193.28:41370) 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 -- 10.20.193.28:0/1950470077 learned_addr learned my addr 10.20.193.28:0/1950470077 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41924640 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511baec6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 -- 10.20.193.28:0/1950470077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 msgr2=0x56511baec6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511baec6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 -- 10.20.193.28:0/1950470077 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 msgr2=0x56511bbb76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bbb76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 -- 10.20.193.28:0/1950470077 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511b99c6f0 con 0x56511bb0cc70 2026-02-20T13:29:06.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41924640 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511baec6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b41123640 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511baecc30 secure :-1 s=READY pgs=1274 gs=1 cs=0 l=1 c_cookie=17974168214246835641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b30005e70 tx=0x7f6b3000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97112c2774cc5b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6af77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6af77fe640 1 -- 10.20.193.28:0/1950470077 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b3003e070 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6af77fe640 1 -- 10.20.193.28:0/1950470077 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6b3000e3e0 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6af77fe640 1 -- 10.20.193.28:0/1950470077 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b30021070 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.184+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56511b9c3d10 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 10 client.19698 _ll_register_callbacks cb 0x56511b999a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b2c0d77a0 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6af77fe640 1 -- 10.20.193.28:0/1950470077 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6b3002f3e0 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6af77fe640 1 -- 10.20.193.28:0/1950470077 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6b30049050 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 10 client.19698 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56511b9ae340 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6af77fe640 1 -- 10.20.193.28:0/1950470077 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6b3000e820 con 0x56511bb0cc70 2026-02-20T13:29:06.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 10 client.19698 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 10 client.19698 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 20 client.19698 populate_metadata read hostname 'trial028' 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56511bbffb70 0x56511bc20020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 4 client.19698 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56511b6abf40 con 0x56511bbffb70 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.185+0000 7f6b41924640 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56511bbffb70 0x56511bc20020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b41924640 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56511bbffb70 0x56511bc20020 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=17105338358627627706 s_cookie=4007270656525794761 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed625e9bf4dcf2ba server_cookie=379caf6e4110fdc9 in_seq=0 out_seq=0 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6af77fe640 10 client.19698 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6af77fe640 1 -- 10.20.193.28:0/1950470077 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56511b6abf40 con 0x56511bbffb70 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6af77fe640 10 client.19698 handle_command_reply: tid=0 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 client.19698 shutdown 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 msgr2=0x56511baecc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511baecc30 secure :-1 s=READY pgs=1274 gs=1 cs=0 l=1 c_cookie=17974168214246835641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b30005e70 tx=0x7f6b3000ef30 comp rx=0 tx=0).stop 2026-02-20T13:29:06.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 shutdown_connections 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x56511bbffb70 0x56511bc20020 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=17105338358627627706 s_cookie=4007270656525794761 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56511bb0cc70 0x56511baecc30 unknown :-1 s=CLOSED pgs=1274 gs=1 cs=0 l=1 c_cookie=17974168214246835641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56511bb51b20 0x56511bbb76a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 --2- 10.20.193.28:0/1950470077 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56511bb0c360 0x56511baec6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6af77fe640 0 client.19698 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 >> 10.20.193.28:0/1950470077 conn(0x56511baea860 msgr2=0x56511bb66020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 shutdown_connections 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 1 -- 10.20.193.28:0/1950470077 wait complete. 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.186+0000 7f6b45ba9e00 20 client.19698 trim_cache size 0 max 16384 2026-02-20T13:29:06.195 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:06.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 -- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b180b56e0 msgr2=0x7f6b180d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b180b56e0 0x7f6b180d5b90 secure :-1 s=READY pgs=536 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b3c0f9820 tx=0x7f6b30009310 comp rx=0 tx=0).stop 2026-02-20T13:29:06.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 -- 10.20.193.28:0/2938664316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b3c0614f0 msgr2=0x7f6b3c0f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b3c0614f0 0x7f6b3c0f2e80 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b2c0023b0 tx=0x7f6b2c0028d0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 -- 10.20.193.28:0/2938664316 shutdown_connections 2026-02-20T13:29:06.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6b180b56e0 0x7f6b180d5b90 unknown :-1 s=CLOSED pgs=536 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b3c159d80 0x7f6b3c0f8790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6b3c062ae0 0x7f6b3c0f33c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 --2- 10.20.193.28:0/2938664316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6b3c0614f0 0x7f6b3c0f2e80 unknown :-1 s=CLOSED pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 -- 10.20.193.28:0/2938664316 >> 10.20.193.28:0/2938664316 conn(0x7f6b3c0eab00 msgr2=0x7f6b3c10fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 -- 10.20.193.28:0/2938664316 shutdown_connections 2026-02-20T13:29:06.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.187+0000 7f6b42926640 1 -- 10.20.193.28:0/2938664316 wait complete. 2026-02-20T13:29:06.284 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:29:06.469 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:06.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 -- 10.20.193.28:0/57062101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 msgr2=0x7f1c7010f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/57062101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 0x7f1c7010f880 secure :-1 s=READY pgs=1275 gs=1 cs=0 l=1 c_cookie=18072640876854979239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60009950 tx=0x7f1c6002f190 comp rx=0 tx=0).stop 2026-02-20T13:29:06.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 -- 10.20.193.28:0/57062101 shutdown_connections 2026-02-20T13:29:06.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/57062101 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c701156a0 0x7f1c70176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/57062101 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c7010fea0 0x7f1c70114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/57062101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 0x7f1c7010f880 unknown :-1 s=CLOSED pgs=1275 gs=1 cs=0 l=1 c_cookie=18072640876854979239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 -- 10.20.193.28:0/57062101 >> 10.20.193.28:0/57062101 conn(0x7f1c700ecda0 msgr2=0x7f1c7010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 -- 10.20.193.28:0/57062101 shutdown_connections 2026-02-20T13:29:06.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 -- 10.20.193.28:0/57062101 wait complete. 2026-02-20T13:29:06.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.654+0000 7f1c75ea4640 1 Processor -- start 2026-02-20T13:29:06.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c75ea4640 1 -- start start 2026-02-20T13:29:06.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c75ea4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 0x7f1c7011ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c75ea4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c7010fea0 0x7f1c7011e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c75ea4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c701156a0 0x7f1c701236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c75ea4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70123d00 con 0x7f1c7010f4b0 2026-02-20T13:29:06.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c75ea4640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70123e70 con 0x7f1c7010fea0 2026-02-20T13:29:06.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c75ea4640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70124030 con 0x7f1c701156a0 2026-02-20T13:29:06.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c756a3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c701156a0 0x7f1c701236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c74ea2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 0x7f1c7011ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c756a3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c701156a0 0x7f1c701236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34110/0 (socket says 10.20.193.28:34110) 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c756a3640 1 -- 10.20.193.28:0/2114691785 learned_addr learned my addr 10.20.193.28:0/2114691785 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c67fff640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c7010fea0 0x7f1c7011e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c756a3640 1 -- 10.20.193.28:0/2114691785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c7010fea0 msgr2=0x7f1c7011e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c756a3640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c7010fea0 0x7f1c7011e310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c756a3640 1 -- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 msgr2=0x7f1c7011ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c756a3640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 0x7f1c7011ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c756a3640 1 -- 10.20.193.28:0/2114691785 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c60009570 con 0x7f1c701156a0 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.655+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 0x7f1c7011ddd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.656+0000 7f1c756a3640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c701156a0 0x7f1c701236e0 secure :-1 s=READY pgs=374 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c006e90 tx=0x7f1c6c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.656+0000 7f1c65ffb640 1 -- 10.20.193.28:0/2114691785 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c005500 con 0x7f1c701156a0 2026-02-20T13:29:06.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.656+0000 7f1c65ffb640 1 -- 10.20.193.28:0/2114691785 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6c005e10 con 0x7f1c701156a0 2026-02-20T13:29:06.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.656+0000 7f1c75ea4640 1 -- 10.20.193.28:0/2114691785 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c70124310 con 0x7f1c701156a0 2026-02-20T13:29:06.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.656+0000 7f1c65ffb640 1 -- 10.20.193.28:0/2114691785 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c003a30 con 0x7f1c701156a0 2026-02-20T13:29:06.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.656+0000 7f1c75ea4640 1 -- 10.20.193.28:0/2114691785 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c70164a10 con 0x7f1c701156a0 2026-02-20T13:29:06.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.659+0000 7f1c65ffb640 1 -- 10.20.193.28:0/2114691785 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1c6c021070 con 0x7f1c701156a0 2026-02-20T13:29:06.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.660+0000 7f1c65ffb640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b56e0 0x7f1c4c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.660+0000 7f1c65ffb640 1 -- 10.20.193.28:0/2114691785 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c6c0e7550 con 0x7f1c701156a0 2026-02-20T13:29:06.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.661+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b56e0 0x7f1c4c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.661+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b56e0 0x7f1c4c0d5b90 secure :-1 s=READY pgs=537 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60038820 tx=0x7f1c6003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.661+0000 7f1c79127e00 1 Processor -- start 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c79127e00 1 -- start start 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272e360 0x55c0d272e730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272ec70 0x55c0d27735e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2793f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c79127e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2644780 con 0x55c0d272ec70 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c79127e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c0d26404b0 con 0x55c0d272e360 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c79127e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c0d263a450 con 0x55c0d2773b20 2026-02-20T13:29:06.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c756a3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2793f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c74ea2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272e360 0x55c0d272e730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c756a3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2793f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34124/0 (socket says 10.20.193.28:34124) 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c756a3640 1 -- 10.20.193.28:0/189852562 learned_addr learned my addr 10.20.193.28:0/189852562 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c67fff640 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272ec70 0x55c0d27735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c756a3640 1 -- 10.20.193.28:0/189852562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272e360 msgr2=0x55c0d272e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c756a3640 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272e360 0x55c0d272e730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c756a3640 1 -- 10.20.193.28:0/189852562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272ec70 msgr2=0x55c0d27735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c756a3640 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272ec70 0x55c0d27735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c756a3640 1 -- 10.20.193.28:0/189852562 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d25e5d10 con 0x55c0d2773b20 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272e360 0x55c0d272e730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:06.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.662+0000 7f1c67fff640 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272ec70 0x55c0d27735e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c756a3640 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2793f00 secure :-1 s=READY pgs=375 gs=2 cs=0 l=1 c_cookie=15687173585653949994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c0e5020 tx=0x7f1c6c00cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b409430ecb662a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c3d4e4640 1 -- 10.20.193.28:0/189852562 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c0ad0b0 con 0x55c0d2773b20 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c3d4e4640 1 -- 10.20.193.28:0/189852562 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6c0ae2b0 con 0x55c0d2773b20 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c3d4e4640 1 -- 10.20.193.28:0/189852562 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c0b6e60 con 0x55c0d2773b20 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 -- 10.20.193.28:0/189852562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 msgr2=0x55c0d2793f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2793f00 secure :-1 s=READY pgs=375 gs=2 cs=0 l=1 c_cookie=15687173585653949994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c0e5020 tx=0x7f1c6c00cce0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 -- 10.20.193.28:0/189852562 shutdown_connections 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272ec70 0x55c0d27735e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2793f00 unknown :-1 s=CLOSED pgs=375 gs=2 cs=0 l=1 c_cookie=15687173585653949994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 --2- 10.20.193.28:0/189852562 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272e360 0x55c0d272e730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 -- 10.20.193.28:0/189852562 >> 10.20.193.28:0/189852562 conn(0x55c0d270c860 msgr2=0x55c0d272cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 -- 10.20.193.28:0/189852562 shutdown_connections 2026-02-20T13:29:06.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.663+0000 7f1c79127e00 1 -- 10.20.193.28:0/189852562 wait complete. 2026-02-20T13:29:06.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.665+0000 7f1c79127e00 1 -- start start 2026-02-20T13:29:06.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.665+0000 7f1c79127e00 1 Processor -- start 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.665+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d278b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.665+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d272ec70 0x55c0d278bd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.665+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d2773b20 0x55c0d2790d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.665+0000 7f1c79127e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2791260 con 0x55c0d272e360 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.665+0000 7f1c79127e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c0d27913d0 con 0x55c0d2773b20 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.665+0000 7f1c79127e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2791590 con 0x55c0d272ec70 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d278b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d278b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41416/0 (socket says 10.20.193.28:41416) 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 -- 10.20.193.28:0/1505575041 learned_addr learned my addr 10.20.193.28:0/1505575041 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c756a3640 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d2773b20 0x55c0d2790d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 -- 10.20.193.28:0/1505575041 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d272ec70 msgr2=0x55c0d278bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d272ec70 0x55c0d278bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 -- 10.20.193.28:0/1505575041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d2773b20 msgr2=0x55c0d2790d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d2773b20 0x55c0d2790d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 -- 10.20.193.28:0/1505575041 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d25be3c0 con 0x55c0d272e360 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d278b7f0 secure :-1 s=READY pgs=1276 gs=1 cs=0 l=1 c_cookie=14511265207742398312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60002720 tx=0x7f1c6002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9625ed28cf87f68 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c2e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1505575041 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c60038e10 con 0x55c0d272e360 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1505575041 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6003e040 con 0x55c0d272e360 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1505575041 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c600448c0 con 0x55c0d272e360 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.666+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c70164a10 con 0x55c0d272e360 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1505575041 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c60044a50 con 0x55c0d272e360 2026-02-20T13:29:06.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 10 client.19710 _ll_register_callbacks cb 0x55c0d25bba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c0d22d06f0 con 0x55c0d272e360 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1505575041 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1c60044c10 con 0x55c0d272e360 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 10 client.19710 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c0d25d00e0 con 0x55c0d272e360 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1505575041 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1c6005c520 con 0x55c0d272e360 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 10 client.19710 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 10 client.19710 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 20 client.19710 populate_metadata read hostname 'trial028' 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c0d2793d70 0x55c0d27718a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 4 client.19710 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0d25dcf80 con 0x55c0d2793d70 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.667+0000 7f1c67fff640 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c0d2793d70 0x55c0d27718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.668+0000 7f1c67fff640 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c0d2793d70 0x55c0d27718a0 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=18313777979648414468 s_cookie=13747722381564162898 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe279c0abc509304 server_cookie=bec9b8aadfd1b352 in_seq=0 out_seq=0 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.668+0000 7f1c2e7fc640 10 client.19710 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.668+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1505575041 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c0d25dcf80 con 0x55c0d2793d70 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.668+0000 7f1c2e7fc640 10 client.19710 handle_command_reply: tid=0 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.668+0000 7f1c79127e00 1 client.19710 shutdown 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 msgr2=0x55c0d278b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d278b7f0 secure :-1 s=READY pgs=1276 gs=1 cs=0 l=1 c_cookie=14511265207742398312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60002720 tx=0x7f1c6002f190 comp rx=0 tx=0).stop 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 shutdown_connections 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c0d2793d70 0x55c0d27718a0 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=18313777979648414468 s_cookie=13747722381564162898 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d2773b20 0x55c0d2790d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d272ec70 0x55c0d278bd30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1505575041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d278b7f0 unknown :-1 s=CLOSED pgs=1276 gs=1 cs=0 l=1 c_cookie=14511265207742398312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c2e7fc640 0 client.19710 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:29:06.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 >> 10.20.193.28:0/1505575041 conn(0x55c0d270c860 msgr2=0x55c0d272cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 shutdown_connections 2026-02-20T13:29:06.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 1 -- 10.20.193.28:0/1505575041 wait complete. 2026-02-20T13:29:06.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.669+0000 7f1c79127e00 20 client.19710 trim_cache size 0 max 16384 2026-02-20T13:29:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c79127e00 1 Processor -- start 2026-02-20T13:29:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c79127e00 1 -- start start 2026-02-20T13:29:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d2790290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d27889c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2788f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c79127e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2638080 con 0x55c0d272e360 2026-02-20T13:29:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c79127e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c0d22f8700 con 0x55c0d272ec70 2026-02-20T13:29:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c79127e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2780120 con 0x55c0d2773b20 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c67fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d27889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c67fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d27889c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57300/0 (socket says 10.20.193.28:57300) 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c67fff640 1 -- 10.20.193.28:0/3076044233 learned_addr learned my addr 10.20.193.28:0/3076044233 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.676+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d2790290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c756a3640 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2788f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c74ea2640 1 -- 10.20.193.28:0/3076044233 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 msgr2=0x55c0d2788f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2788f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c74ea2640 1 -- 10.20.193.28:0/3076044233 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 msgr2=0x55c0d27889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d27889c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c74ea2640 1 -- 10.20.193.28:0/3076044233 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d25cab60 con 0x55c0d272e360 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d2790290 secure :-1 s=READY pgs=1277 gs=2 cs=0 l=1 c_cookie=14513868749244248193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6005cb10 tx=0x7f1c6005a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96b9ebacb58b081 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c3cce3640 1 -- 10.20.193.28:0/3076044233 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c60005dd0 con 0x55c0d272e360 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c3cce3640 1 -- 10.20.193.28:0/3076044233 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6003e070 con 0x55c0d272e360 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c3cce3640 1 -- 10.20.193.28:0/3076044233 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6004fd00 con 0x55c0d272e360 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c79127e00 1 -- 10.20.193.28:0/3076044233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 msgr2=0x55c0d2790290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.677+0000 7f1c79127e00 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d2790290 secure :-1 s=READY pgs=1277 gs=2 cs=0 l=1 c_cookie=14513868749244248193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6005cb10 tx=0x7f1c6005a000 comp rx=0 tx=0).stop 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 -- 10.20.193.28:0/3076044233 shutdown_connections 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2788f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d27889c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 --2- 10.20.193.28:0/3076044233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d2790290 unknown :-1 s=CLOSED pgs=1277 gs=2 cs=0 l=1 c_cookie=14513868749244248193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 -- 10.20.193.28:0/3076044233 >> 10.20.193.28:0/3076044233 conn(0x55c0d270c860 msgr2=0x55c0d278fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 -- 10.20.193.28:0/3076044233 shutdown_connections 2026-02-20T13:29:06.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 -- 10.20.193.28:0/3076044233 wait complete. 2026-02-20T13:29:06.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 -- start start 2026-02-20T13:29:06.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 Processor -- start 2026-02-20T13:29:06.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d270cde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d270d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2711c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2638080 con 0x55c0d272e360 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c0d270d8e0 con 0x55c0d272ec70 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.678+0000 7f1c79127e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c0d270daa0 con 0x55c0d2773b20 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c756a3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2711c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c756a3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2711c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34150/0 (socket says 10.20.193.28:34150) 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c756a3640 1 -- 10.20.193.28:0/1063697819 learned_addr learned my addr 10.20.193.28:0/1063697819 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c67fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d270d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d270cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c74ea2640 1 -- 10.20.193.28:0/1063697819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 msgr2=0x55c0d2711c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2711c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c74ea2640 1 -- 10.20.193.28:0/1063697819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 msgr2=0x55c0d270d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d270d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c74ea2640 1 -- 10.20.193.28:0/1063697819 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d25be6f0 con 0x55c0d272e360 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c67fff640 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d270d320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c74ea2640 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d270cde0 secure :-1 s=READY pgs=1278 gs=2 cs=0 l=1 c_cookie=10942177690555070317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60037470 tx=0x7f1c60005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97da6ca2aabd376d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c2e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1063697819 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c60058bf0 con 0x55c0d272e360 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0d25d00e0 con 0x55c0d272e360 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c79127e00 10 client.19716 _ll_register_callbacks cb 0x55c0d25bba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.679+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c6c0ae2b0 con 0x55c0d272e360 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1063697819 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6c0ae2b0 con 0x55c0d272e360 2026-02-20T13:29:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1063697819 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c60058760 con 0x55c0d272e360 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1063697819 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c60036760 con 0x55c0d272e360 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1063697819 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1c600369e0 con 0x55c0d272e360 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c79127e00 10 client.19716 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c0d25d0340 con 0x55c0d272e360 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1063697819 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1c60058d50 con 0x55c0d272e360 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c79127e00 10 client.19716 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c79127e00 10 client.19716 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c79127e00 20 client.19716 populate_metadata read hostname 'trial028' 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c0d2821730 0x55c0d2841be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c79127e00 4 client.19716 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c0d22cdf40 con 0x55c0d2821730 2026-02-20T13:29:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.680+0000 7f1c67fff640 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c0d2821730 0x55c0d2841be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.681+0000 7f1c2e7fc640 10 client.19716 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.681+0000 7f1c67fff640 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c0d2821730 0x55c0d2841be0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=11913104800849722335 s_cookie=5807715766909710965 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a553d9b2b2a5fbdf server_cookie=509926b82b16b275 in_seq=0 out_seq=0 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.681+0000 7f1c2e7fc640 1 -- 10.20.193.28:0/1063697819 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c0d22cdf40 con 0x55c0d2821730 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.681+0000 7f1c2e7fc640 10 client.19716 handle_command_reply: tid=0 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.681+0000 7f1c79127e00 1 client.19716 shutdown 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.681+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 msgr2=0x55c0d270cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.681+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d270cde0 secure :-1 s=READY pgs=1278 gs=2 cs=0 l=1 c_cookie=10942177690555070317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60037470 tx=0x7f1c60005e50 comp rx=0 tx=0).stop 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 shutdown_connections 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c0d2821730 0x55c0d2841be0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=11913104800849722335 s_cookie=5807715766909710965 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c0d2773b20 0x55c0d2711c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c0d272ec70 0x55c0d270d320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 1 --2- 10.20.193.28:0/1063697819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0d272e360 0x55c0d270cde0 unknown :-1 s=CLOSED pgs=1278 gs=2 cs=0 l=1 c_cookie=10942177690555070317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 >> 10.20.193.28:0/1063697819 conn(0x55c0d270c860 msgr2=0x55c0d27727a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c2e7fc640 0 client.19716 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:29:06.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 shutdown_connections 2026-02-20T13:29:06.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 1 -- 10.20.193.28:0/1063697819 wait complete. 2026-02-20T13:29:06.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c79127e00 20 client.19716 trim_cache size 0 max 16384 2026-02-20T13:29:06.690 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:06.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c75ea4640 1 -- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b56e0 msgr2=0x7f1c4c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b56e0 0x7f1c4c0d5b90 secure :-1 s=READY pgs=537 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60038820 tx=0x7f1c6003a040 comp rx=0 tx=0).stop 2026-02-20T13:29:06.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c75ea4640 1 -- 10.20.193.28:0/2114691785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c701156a0 msgr2=0x7f1c701236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:06.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.682+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c701156a0 0x7f1c701236e0 secure :-1 s=READY pgs=374 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c006e90 tx=0x7f1c6c00edf0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.683+0000 7f1c75ea4640 1 -- 10.20.193.28:0/2114691785 shutdown_connections 2026-02-20T13:29:06.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.683+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b56e0 0x7f1c4c0d5b90 unknown :-1 s=CLOSED pgs=537 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.683+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c701156a0 0x7f1c701236e0 unknown :-1 s=CLOSED pgs=374 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.683+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c7010fea0 0x7f1c7011e310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.683+0000 7f1c75ea4640 1 --2- 10.20.193.28:0/2114691785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c7010f4b0 0x7f1c7011ddd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:06.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.683+0000 7f1c75ea4640 1 -- 10.20.193.28:0/2114691785 >> 10.20.193.28:0/2114691785 conn(0x7f1c700ecda0 msgr2=0x7f1c7010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:06.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.683+0000 7f1c75ea4640 1 -- 10.20.193.28:0/2114691785 shutdown_connections 2026-02-20T13:29:06.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:06.683+0000 7f1c75ea4640 1 -- 10.20.193.28:0/2114691785 wait complete. 2026-02-20T13:29:06.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:06 trial028 ceph-mon[37442]: pgmap v534: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-20T13:29:06.783 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:29:06.970 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:06 trial127 ceph-mon[43817]: pgmap v534: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-20T13:29:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:06 trial034 ceph-mon[43332]: pgmap v534: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 -- 10.20.193.28:0/3593188892 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb83010dc30 msgr2=0x7fb830112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 --2- 10.20.193.28:0/3593188892 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb83010dc30 0x7fb830112c80 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=18205127496342709908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb824009950 tx=0x7fb82402f190 comp rx=0 tx=0).stop 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 -- 10.20.193.28:0/3593188892 shutdown_connections 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 --2- 10.20.193.28:0/3593188892 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb830113430 0x7fb830173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 --2- 10.20.193.28:0/3593188892 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb83010dc30 0x7fb830112c80 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=18205127496342709908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 --2- 10.20.193.28:0/3593188892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb83010d240 0x7fb83010d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 -- 10.20.193.28:0/3593188892 >> 10.20.193.28:0/3593188892 conn(0x7fb8300eaad0 msgr2=0x7fb83010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 -- 10.20.193.28:0/3593188892 shutdown_connections 2026-02-20T13:29:07.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.148+0000 7fb8366ab640 1 -- 10.20.193.28:0/3593188892 wait complete. 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8366ab640 1 Processor -- start 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8366ab640 1 -- start start 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8366ab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb83010d240 0x7fb8300f5720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8366ab640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb83010dc30 0x7fb830173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8366ab640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb830113430 0x7fb8300f5e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8366ab640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300fb030 con 0x7fb83010d240 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8366ab640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300fb1a0 con 0x7fb830113430 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8366ab640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300fb360 con 0x7fb83010dc30 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb834ea8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb83010dc30 0x7fb830173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb834ea8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb83010dc30 0x7fb830173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34156/0 (socket says 10.20.193.28:34156) 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb834ea8640 1 -- 10.20.193.28:0/2438716600 learned_addr learned my addr 10.20.193.28:0/2438716600 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb835eaa640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb830113430 0x7fb8300f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb8356a9640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb83010d240 0x7fb8300f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb834ea8640 1 -- 10.20.193.28:0/2438716600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb830113430 msgr2=0x7fb8300f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb834ea8640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb830113430 0x7fb8300f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.149+0000 7fb834ea8640 1 -- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb83010d240 msgr2=0x7fb8300f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.150+0000 7fb834ea8640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb83010d240 0x7fb8300f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.150+0000 7fb834ea8640 1 -- 10.20.193.28:0/2438716600 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb824009570 con 0x7fb83010dc30 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.150+0000 7fb834ea8640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb83010dc30 0x7fb830173d00 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb824038820 tx=0x7fb824004300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.150+0000 7fb81e7fc640 1 -- 10.20.193.28:0/2438716600 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb82403d070 con 0x7fb83010dc30 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.150+0000 7fb81e7fc640 1 -- 10.20.193.28:0/2438716600 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb824002ad0 con 0x7fb83010dc30 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.150+0000 7fb81e7fc640 1 -- 10.20.193.28:0/2438716600 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb824041930 con 0x7fb83010dc30 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.150+0000 7fb8366ab640 1 -- 10.20.193.28:0/2438716600 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8300fb5e0 con 0x7fb83010dc30 2026-02-20T13:29:07.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.150+0000 7fb8366ab640 1 -- 10.20.193.28:0/2438716600 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8300fbaa0 con 0x7fb83010dc30 2026-02-20T13:29:07.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.153+0000 7fb81e7fc640 1 -- 10.20.193.28:0/2438716600 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb82402f9f0 con 0x7fb83010dc30 2026-02-20T13:29:07.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.154+0000 7fb81e7fc640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb80c0b5750 0x7fb80c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.155+0000 7fb81e7fc640 1 -- 10.20.193.28:0/2438716600 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb82410b070 con 0x7fb83010dc30 2026-02-20T13:29:07.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.155+0000 7fb8356a9640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb80c0b5750 0x7fb80c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.155+0000 7fb8356a9640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb80c0b5750 0x7fb80c0d5c00 secure :-1 s=READY pgs=538 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb820004740 tx=0x7fb820005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:07.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.156+0000 7fb83992ee00 1 Processor -- start 2026-02-20T13:29:07.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.156+0000 7fb83992ee00 1 -- start start 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.156+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.156+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x561354126dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.156+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613541476e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.156+0000 7fb83992ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561353ff8780 con 0x5613540e2660 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.156+0000 7fb83992ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561353ff44b0 con 0x5613540e1d50 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.156+0000 7fb83992ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561353fee450 con 0x561354127300 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb8356a9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb835eaa640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613541476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb834ea8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x561354126dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb835eaa640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613541476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34166/0 (socket says 10.20.193.28:34166) 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb835eaa640 1 -- 10.20.193.28:0/460760135 learned_addr learned my addr 10.20.193.28:0/460760135 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb834ea8640 1 -- 10.20.193.28:0/460760135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 msgr2=0x5613541476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb834ea8640 1 --2- 10.20.193.28:0/460760135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613541476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb834ea8640 1 -- 10.20.193.28:0/460760135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 msgr2=0x5613540e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb834ea8640 1 --2- 10.20.193.28:0/460760135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb834ea8640 1 -- 10.20.193.28:0/460760135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561353f99d10 con 0x5613540e2660 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb835eaa640 1 --2- 10.20.193.28:0/460760135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613541476e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:07.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb834ea8640 1 --2- 10.20.193.28:0/460760135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x561354126dc0 secure :-1 s=READY pgs=1279 gs=3 cs=0 l=1 c_cookie=2475209445336996168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb824108c30 tx=0x7fb824041410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2259b5e05600d948 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.157+0000 7fb7fdce5640 1 -- 10.20.193.28:0/460760135 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8240d9710 con 0x5613540e2660 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb7fdce5640 1 -- 10.20.193.28:0/460760135 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8240dc550 con 0x5613540e2660 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb7fdce5640 1 -- 10.20.193.28:0/460760135 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8240dc0c0 con 0x5613540e2660 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 -- 10.20.193.28:0/460760135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 msgr2=0x561354126dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 --2- 10.20.193.28:0/460760135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x561354126dc0 secure :-1 s=READY pgs=1279 gs=3 cs=0 l=1 c_cookie=2475209445336996168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb824108c30 tx=0x7fb824041410 comp rx=0 tx=0).stop 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 -- 10.20.193.28:0/460760135 shutdown_connections 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 --2- 10.20.193.28:0/460760135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x561354126dc0 unknown :-1 s=CLOSED pgs=1279 gs=3 cs=0 l=1 c_cookie=2475209445336996168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 --2- 10.20.193.28:0/460760135 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613541476e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 --2- 10.20.193.28:0/460760135 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 -- 10.20.193.28:0/460760135 >> 10.20.193.28:0/460760135 conn(0x5613540c0250 msgr2=0x5613540e0630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 -- 10.20.193.28:0/460760135 shutdown_connections 2026-02-20T13:29:07.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.158+0000 7fb83992ee00 1 -- 10.20.193.28:0/460760135 wait complete. 2026-02-20T13:29:07.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.159+0000 7fb83992ee00 1 -- start start 2026-02-20T13:29:07.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb83992ee00 1 Processor -- start 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x5613540e3450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613540e5e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb83992ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5613540e6340 con 0x5613540e2660 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb83992ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5613540e64b0 con 0x5613540e1d50 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb83992ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5613540e6670 con 0x561354127300 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb8356a9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb8356a9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57354/0 (socket says 10.20.193.28:57354) 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb8356a9640 1 -- 10.20.193.28:0/2087493158 learned_addr learned my addr 10.20.193.28:0/2087493158 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb835eaa640 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613540e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb834ea8640 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x5613540e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb8356a9640 1 -- 10.20.193.28:0/2087493158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 msgr2=0x5613540e5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:07.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb8356a9640 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613540e5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb8356a9640 1 -- 10.20.193.28:0/2087493158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 msgr2=0x5613540e3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb8356a9640 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x5613540e3450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.160+0000 7fb8356a9640 1 -- 10.20.193.28:0/2087493158 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300fbaa0 con 0x5613540e1d50 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb8356a9640 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2f10 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=3198370456096986540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb820004040 tx=0x7fb820013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c62e4fbefc3d5ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb7eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb7eaffd640 1 -- 10.20.193.28:0/2087493158 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb820021040 con 0x5613540e1d50 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb7eaffd640 1 -- 10.20.193.28:0/2087493158 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb82001b780 con 0x5613540e1d50 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb7eaffd640 1 -- 10.20.193.28:0/2087493158 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8200054d0 con 0x5613540e1d50 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c0052d0 con 0x5613540e1d50 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb83992ee00 10 client.29666 _ll_register_callbacks cb 0x561353f6fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561353c846f0 con 0x5613540e1d50 2026-02-20T13:29:07.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.161+0000 7fb7eaffd640 1 -- 10.20.193.28:0/2087493158 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb8200056e0 con 0x5613540e1d50 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb7eaffd640 1 -- 10.20.193.28:0/2087493158 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb820004a70 con 0x5613540e1d50 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb83992ee00 10 client.29666 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561353f723c0 con 0x5613540e1d50 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb7eaffd640 1 -- 10.20.193.28:0/2087493158 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fb820004c90 con 0x5613540e1d50 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb83992ee00 10 client.29666 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb83992ee00 10 client.29666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb83992ee00 20 client.29666 populate_metadata read hostname 'trial028' 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb83992ee00 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56135410d2f0 0x56135410d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb83992ee00 4 client.29666 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561353f90f80 con 0x56135410d2f0 2026-02-20T13:29:07.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.162+0000 7fb834ea8640 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56135410d2f0 0x56135410d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.163+0000 7fb834ea8640 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56135410d2f0 0x56135410d790 crc :-1 s=READY pgs=340 gs=4 cs=0 l=0 c_cookie=6628766058894751155 s_cookie=2023841278138934537 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bfe1b9c1f9675b3 server_cookie=1c1620eb713e6509 in_seq=0 out_seq=0 2026-02-20T13:29:07.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.163+0000 7fb7eaffd640 10 client.29666 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:07.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.163+0000 7fb7eaffd640 1 -- 10.20.193.28:0/2087493158 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561353f90f80 con 0x56135410d2f0 2026-02-20T13:29:07.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.163+0000 7fb7eaffd640 10 client.29666 handle_command_reply: tid=0 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.163+0000 7fb83992ee00 1 client.29666 shutdown 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.163+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 msgr2=0x5613540e2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2f10 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=3198370456096986540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb820004040 tx=0x7fb820013040 comp rx=0 tx=0).stop 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 shutdown_connections 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56135410d2f0 0x56135410d790 crc :-1 s=READY pgs=340 gs=4 cs=0 l=0 c_cookie=6628766058894751155 s_cookie=2023841278138934537 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e2660 0x5613540e3450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561354127300 0x5613540e5e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 --2- 10.20.193.28:0/2087493158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e1d50 0x5613540e2f10 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=3198370456096986540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb7eaffd640 0 client.29666 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 >> 10.20.193.28:0/2087493158 conn(0x5613540c0250 msgr2=0x5613540e0630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 shutdown_connections 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 1 -- 10.20.193.28:0/2087493158 wait complete. 2026-02-20T13:29:07.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.164+0000 7fb83992ee00 20 client.29666 trim_cache size 0 max 16384 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb83992ee00 1 Processor -- start 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb83992ee00 1 -- start start 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e1d50 0x561354146e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e2660 0x561354147350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561354127300 0x5613540e2d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb83992ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561353fec080 con 0x5613540e1d50 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb83992ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561353cac700 con 0x561354127300 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb83992ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561353ff44b0 con 0x5613540e2660 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb8356a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e1d50 0x561354146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb8356a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e1d50 0x561354146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41464/0 (socket says 10.20.193.28:41464) 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb8356a9640 1 -- 10.20.193.28:0/3692183160 learned_addr learned my addr 10.20.193.28:0/3692183160 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb834ea8640 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e2660 0x561354147350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb835eaa640 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561354127300 0x5613540e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb8356a9640 1 -- 10.20.193.28:0/3692183160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e2660 msgr2=0x561354147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:07.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb8356a9640 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e2660 0x561354147350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb8356a9640 1 -- 10.20.193.28:0/3692183160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561354127300 msgr2=0x5613540e2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb8356a9640 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561354127300 0x5613540e2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.171+0000 7fb8356a9640 1 -- 10.20.193.28:0/3692183160 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561353f840e0 con 0x5613540e1d50 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb8356a9640 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e1d50 0x561354146e10 secure :-1 s=READY pgs=1280 gs=1 cs=0 l=1 c_cookie=13251941111097249342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb820016040 tx=0x7fb82001d030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e85a3a8f58ce3e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb7fd4e4640 1 -- 10.20.193.28:0/3692183160 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb820009690 con 0x5613540e1d50 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb7fd4e4640 1 -- 10.20.193.28:0/3692183160 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb820034070 con 0x5613540e1d50 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb7fd4e4640 1 -- 10.20.193.28:0/3692183160 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb82000fca0 con 0x5613540e1d50 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 -- 10.20.193.28:0/3692183160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e1d50 msgr2=0x561354146e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e1d50 0x561354146e10 secure :-1 s=READY pgs=1280 gs=1 cs=0 l=1 c_cookie=13251941111097249342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb820016040 tx=0x7fb82001d030 comp rx=0 tx=0).stop 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 -- 10.20.193.28:0/3692183160 shutdown_connections 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561354127300 0x5613540e2d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e2660 0x561354147350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 --2- 10.20.193.28:0/3692183160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613540e1d50 0x561354146e10 unknown :-1 s=CLOSED pgs=1280 gs=1 cs=0 l=1 c_cookie=13251941111097249342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 -- 10.20.193.28:0/3692183160 >> 10.20.193.28:0/3692183160 conn(0x5613540c0250 msgr2=0x561354139460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 -- 10.20.193.28:0/3692183160 shutdown_connections 2026-02-20T13:29:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.172+0000 7fb83992ee00 1 -- 10.20.193.28:0/3692183160 wait complete. 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb83992ee00 1 -- start start 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb83992ee00 1 Processor -- start 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e1d50 0x561354113c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e2660 0x5613541101f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb83992ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561354127300 0x5613541108c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb83992ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56135413f300 con 0x561354127300 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb83992ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561354110ff0 con 0x5613540e2660 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb83992ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5613541dbec0 con 0x5613540e1d50 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb8356a9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e1d50 0x561354113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb8356a9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e1d50 0x561354113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34182/0 (socket says 10.20.193.28:34182) 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb8356a9640 1 -- 10.20.193.28:0/1939644544 learned_addr learned my addr 10.20.193.28:0/1939644544 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.173+0000 7fb835eaa640 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561354127300 0x5613541108c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb834ea8640 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e2660 0x5613541101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb835eaa640 1 -- 10.20.193.28:0/1939644544 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e1d50 msgr2=0x561354113c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb835eaa640 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e1d50 0x561354113c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb835eaa640 1 -- 10.20.193.28:0/1939644544 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e2660 msgr2=0x5613541101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb835eaa640 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e2660 0x5613541101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb835eaa640 1 -- 10.20.193.28:0/1939644544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561353f7eb60 con 0x561354127300 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb835eaa640 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561354127300 0x5613541108c0 secure :-1 s=READY pgs=1281 gs=2 cs=0 l=1 c_cookie=6618345519105973515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb82c0050b0 tx=0x7fb82c00ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd9162f231c1d0b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb7eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb7eaffd640 1 -- 10.20.193.28:0/1939644544 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb82c018040 con 0x561354127300 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb7eaffd640 1 -- 10.20.193.28:0/1939644544 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb82c011dc0 con 0x561354127300 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb7eaffd640 1 -- 10.20.193.28:0/1939644544 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb82c00f890 con 0x561354127300 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.174+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb820025e70 con 0x561354127300 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb7eaffd640 1 -- 10.20.193.28:0/1939644544 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb82c00fa20 con 0x561354127300 2026-02-20T13:29:07.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 10 client.19734 _ll_register_callbacks cb 0x561353f6fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8240dc550 con 0x561354127300 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb7eaffd640 1 -- 10.20.193.28:0/1939644544 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb82c00fc20 con 0x561354127300 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 10 client.19734 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561353f726f0 con 0x561354127300 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb7eaffd640 1 -- 10.20.193.28:0/1939644544 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fb82c005850 con 0x561354127300 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 10 client.19734 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 10 client.19734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 20 client.19734 populate_metadata read hostname 'trial028' 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5613541ddca0 0x5613541fe120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 4 client.19734 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561353c81f40 con 0x5613541ddca0 2026-02-20T13:29:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.175+0000 7fb8356a9640 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5613541ddca0 0x5613541fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb8356a9640 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5613541ddca0 0x5613541fe120 crc :-1 s=READY pgs=341 gs=4 cs=0 l=0 c_cookie=6446741444419289662 s_cookie=16206227496773990659 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59776d2ff966823e server_cookie=e0e8160b4661b903 in_seq=0 out_seq=0 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb7eaffd640 10 client.19734 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb7eaffd640 1 -- 10.20.193.28:0/1939644544 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561353c81f40 con 0x5613541ddca0 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb7eaffd640 10 client.19734 handle_command_reply: tid=0 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 client.19734 shutdown 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561354127300 msgr2=0x5613541108c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561354127300 0x5613541108c0 secure :-1 s=READY pgs=1281 gs=2 cs=0 l=1 c_cookie=6618345519105973515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb82c0050b0 tx=0x7fb82c00ab80 comp rx=0 tx=0).stop 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 shutdown_connections 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5613541ddca0 0x5613541fe120 crc :-1 s=READY pgs=341 gs=4 cs=0 l=0 c_cookie=6446741444419289662 s_cookie=16206227496773990659 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561354127300 0x5613541108c0 unknown :-1 s=CLOSED pgs=1281 gs=2 cs=0 l=1 c_cookie=6618345519105973515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5613540e2660 0x5613541101f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 --2- 10.20.193.28:0/1939644544 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5613540e1d50 0x561354113c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb7eaffd640 0 client.19734 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 >> 10.20.193.28:0/1939644544 conn(0x5613540c0250 msgr2=0x5613540e2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 shutdown_connections 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.176+0000 7fb83992ee00 1 -- 10.20.193.28:0/1939644544 wait complete. 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb83992ee00 20 client.19734 trim_cache size 0 max 16384 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 -- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb80c0b5750 msgr2=0x7fb80c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb80c0b5750 0x7fb80c0d5c00 secure :-1 s=READY pgs=538 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb820004740 tx=0x7fb820005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 -- 10.20.193.28:0/2438716600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb83010dc30 msgr2=0x7fb830173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb83010dc30 0x7fb830173d00 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb824038820 tx=0x7fb824004300 comp rx=0 tx=0).stop 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 -- 10.20.193.28:0/2438716600 shutdown_connections 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb80c0b5750 0x7fb80c0d5c00 unknown :-1 s=CLOSED pgs=538 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb830113430 0x7fb8300f5e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb83010dc30 0x7fb830173d00 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 --2- 10.20.193.28:0/2438716600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb83010d240 0x7fb8300f5720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 -- 10.20.193.28:0/2438716600 >> 10.20.193.28:0/2438716600 conn(0x7fb8300eaad0 msgr2=0x7fb830111380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 -- 10.20.193.28:0/2438716600 shutdown_connections 2026-02-20T13:29:07.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:07.177+0000 7fb8366ab640 1 -- 10.20.193.28:0/2438716600 wait complete. 2026-02-20T13:29:08.281 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:29:08.281 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:29:08.467 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:08.584 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:08 trial028 ceph-mon[37442]: pgmap v535: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2026-02-20T13:29:08.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 -- 10.20.193.28:0/495831726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410bfb0 msgr2=0x7fe704113d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 --2- 10.20.193.28:0/495831726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410bfb0 0x7fe704113d50 secure :-1 s=READY pgs=1282 gs=1 cs=0 l=1 c_cookie=10196876602963426371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f8009890 tx=0x7fe6f802f120 comp rx=0 tx=0).stop 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 -- 10.20.193.28:0/495831726 shutdown_connections 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 --2- 10.20.193.28:0/495831726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410bfb0 0x7fe704113d50 unknown :-1 s=CLOSED pgs=1282 gs=1 cs=0 l=1 c_cookie=10196876602963426371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 --2- 10.20.193.28:0/495831726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7041144d0 0x7fe704176000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 --2- 10.20.193.28:0/495831726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe70410b610 0x7fe70410b9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 -- 10.20.193.28:0/495831726 >> 10.20.193.28:0/495831726 conn(0x7fe7040e9080 msgr2=0x7fe704109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 -- 10.20.193.28:0/495831726 shutdown_connections 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.657+0000 7fe70b095640 1 -- 10.20.193.28:0/495831726 wait complete. 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.658+0000 7fe70b095640 1 Processor -- start 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.658+0000 7fe70b095640 1 -- start start 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.658+0000 7fe70b095640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410b610 0x7fe70411ddb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.658+0000 7fe70b095640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe70410bfb0 0x7fe70411e2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.658+0000 7fe70b095640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7041144d0 0x7fe7041236c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.658+0000 7fe70b095640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe704123ce0 con 0x7fe70410b610 2026-02-20T13:29:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.658+0000 7fe70b095640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe704123e50 con 0x7fe7041144d0 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.658+0000 7fe70b095640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe704124010 con 0x7fe70410bfb0 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe70a093640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410b610 0x7fe70411ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe70410bfb0 0x7fe70411e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe70410bfb0 0x7fe70411e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34198/0 (socket says 10.20.193.28:34198) 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 -- 10.20.193.28:0/3366263927 learned_addr learned my addr 10.20.193.28:0/3366263927 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe70a894640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7041144d0 0x7fe7041236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 -- 10.20.193.28:0/3366263927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7041144d0 msgr2=0x7fe7041236c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7041144d0 0x7fe7041236c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 -- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410b610 msgr2=0x7fe70411ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410b610 0x7fe70411ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 -- 10.20.193.28:0/3366263927 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f80094b0 con 0x7fe70410bfb0 2026-02-20T13:29:08.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe70a093640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410b610 0x7fe70411ddb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:08.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe709892640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe70410bfb0 0x7fe70411e2f0 secure :-1 s=READY pgs=377 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f8002390 tx=0x7fe6f80028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:08.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe6eb7fe640 1 -- 10.20.193.28:0/3366263927 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f803d070 con 0x7fe70410bfb0 2026-02-20T13:29:08.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.659+0000 7fe6eb7fe640 1 -- 10.20.193.28:0/3366263927 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6f80044f0 con 0x7fe70410bfb0 2026-02-20T13:29:08.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.660+0000 7fe70b095640 1 -- 10.20.193.28:0/3366263927 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe704124290 con 0x7fe70410bfb0 2026-02-20T13:29:08.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.660+0000 7fe6eb7fe640 1 -- 10.20.193.28:0/3366263927 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f8041a00 con 0x7fe70410bfb0 2026-02-20T13:29:08.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.660+0000 7fe70b095640 1 -- 10.20.193.28:0/3366263927 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7041649f0 con 0x7fe70410bfb0 2026-02-20T13:29:08.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.662+0000 7fe6eb7fe640 1 -- 10.20.193.28:0/3366263927 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe6f8038c20 con 0x7fe70410bfb0 2026-02-20T13:29:08.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.664+0000 7fe6eb7fe640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6e00b56e0 0x7fe6e00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.664+0000 7fe70a093640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6e00b56e0 0x7fe6e00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.664+0000 7fe6eb7fe640 1 -- 10.20.193.28:0/3366263927 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe6f810b380 con 0x7fe70410bfb0 2026-02-20T13:29:08.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.664+0000 7fe70a093640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6e00b56e0 0x7fe6e00d5b90 secure :-1 s=READY pgs=540 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f4004740 tx=0x7fe6f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70e318e00 1 Processor -- start 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70e318e00 1 -- start start 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bc77e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7d20 0x561cc6c0c480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6c0c9c0 0x561cc6c2cda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70e318e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561cc6adda20 con 0x561cc6c0c9c0 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70e318e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561cc6ad9750 con 0x561cc6bc7d20 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70e318e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561cc6ad36f0 con 0x561cc6bc7410 2026-02-20T13:29:08.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a093640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bc77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a093640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bc77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34214/0 (socket says 10.20.193.28:34214) 2026-02-20T13:29:08.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a894640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6c0c9c0 0x561cc6c2cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a093640 1 -- 10.20.193.28:0/3100162234 learned_addr learned my addr 10.20.193.28:0/3100162234 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:08.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe709892640 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7d20 0x561cc6c0c480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a894640 1 -- 10.20.193.28:0/3100162234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 msgr2=0x561cc6bc77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:08.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a894640 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bc77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a894640 1 -- 10.20.193.28:0/3100162234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7d20 msgr2=0x561cc6c0c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:08.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a894640 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7d20 0x561cc6c0c480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe70a894640 1 -- 10.20.193.28:0/3100162234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc6a7f120 con 0x561cc6c0c9c0 2026-02-20T13:29:08.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.665+0000 7fe709892640 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7d20 0x561cc6c0c480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:29:08.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70a093640 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bc77e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:08.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70a894640 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6c0c9c0 0x561cc6c2cda0 secure :-1 s=READY pgs=1283 gs=2 cs=0 l=1 c_cookie=7465526272332129066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe700006f50 tx=0x7fe700003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679ae09733b3e32a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:08.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe6e8884640 1 -- 10.20.193.28:0/3100162234 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe70000aca0 con 0x561cc6c0c9c0 2026-02-20T13:29:08.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe6e8884640 1 -- 10.20.193.28:0/3100162234 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe70000ae00 con 0x561cc6c0c9c0 2026-02-20T13:29:08.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe6e8884640 1 -- 10.20.193.28:0/3100162234 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7000128f0 con 0x561cc6c0c9c0 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 -- 10.20.193.28:0/3100162234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6c0c9c0 msgr2=0x561cc6c2cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6c0c9c0 0x561cc6c2cda0 secure :-1 s=READY pgs=1283 gs=2 cs=0 l=1 c_cookie=7465526272332129066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe700006f50 tx=0x7fe700003c30 comp rx=0 tx=0).stop 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 -- 10.20.193.28:0/3100162234 shutdown_connections 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6c0c9c0 0x561cc6c2cda0 unknown :-1 s=CLOSED pgs=1283 gs=2 cs=0 l=1 c_cookie=7465526272332129066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7d20 0x561cc6c0c480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3100162234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bc77e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 -- 10.20.193.28:0/3100162234 >> 10.20.193.28:0/3100162234 conn(0x561cc6ba5910 msgr2=0x561cc6bc5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 -- 10.20.193.28:0/3100162234 shutdown_connections 2026-02-20T13:29:08.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.666+0000 7fe70e318e00 1 -- 10.20.193.28:0/3100162234 wait complete. 2026-02-20T13:29:08.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70e318e00 1 -- start start 2026-02-20T13:29:08.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70e318e00 1 Processor -- start 2026-02-20T13:29:08.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7410 0x561cc6bdfcc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be0200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6c0c9c0 0x561cc6be51f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70e318e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561cc6be5730 con 0x561cc6bc7d20 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70e318e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561cc6be58a0 con 0x561cc6bc7410 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70e318e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561cc6be5a60 con 0x561cc6c0c9c0 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70a894640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6c0c9c0 0x561cc6be51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe709892640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be0200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe70a093640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7410 0x561cc6bdfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe709892640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be0200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41510/0 (socket says 10.20.193.28:41510) 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe709892640 1 -- 10.20.193.28:0/787665755 learned_addr learned my addr 10.20.193.28:0/787665755 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe709892640 1 -- 10.20.193.28:0/787665755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6c0c9c0 msgr2=0x561cc6be51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.668+0000 7fe709892640 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6c0c9c0 0x561cc6be51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe709892640 1 -- 10.20.193.28:0/787665755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7410 msgr2=0x561cc6bdfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe709892640 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7410 0x561cc6bdfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe709892640 1 -- 10.20.193.28:0/787665755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7000051e0 con 0x561cc6bc7d20 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe709892640 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be0200 secure :-1 s=READY pgs=1284 gs=1 cs=0 l=1 c_cookie=8960690681230539915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f80d1950 tx=0x7fe6f8049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5ac4b2e4e63c8b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe6b7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:08.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe6b7fff640 1 -- 10.20.193.28:0/787665755 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f80d0ee0 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe6b7fff640 1 -- 10.20.193.28:0/787665755 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6f8005d40 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe6b7fff640 1 -- 10.20.193.28:0/787665755 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f80d25f0 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f4003db0 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe70e318e00 10 client.19746 _ll_register_callbacks cb 0x561cc6a8ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.669+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561cc67699d0 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe6b7fff640 1 -- 10.20.193.28:0/787665755 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe6f80d71c0 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe6b7fff640 1 -- 10.20.193.28:0/787665755 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe6f8002970 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70e318e00 10 client.19746 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561cc6a57810 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe6b7fff640 1 -- 10.20.193.28:0/787665755 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe6f80cf6c0 con 0x561cc6bc7d20 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70e318e00 10 client.19746 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70e318e00 10 client.19746 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70e318e00 20 client.19746 populate_metadata read hostname 'trial028' 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70e318e00 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561cc6c0a310 0x561cc6c0a7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70e318e00 4 client.19746 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cc67699d0 con 0x561cc6c0a310 2026-02-20T13:29:08.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.670+0000 7fe70a093640 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561cc6c0a310 0x561cc6c0a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.671+0000 7fe70a093640 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561cc6c0a310 0x561cc6c0a7b0 crc :-1 s=READY pgs=342 gs=4 cs=0 l=0 c_cookie=9099263282642435068 s_cookie=17530848719832088668 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e4713bedfa83bfc server_cookie=f34a16073cb4005c in_seq=0 out_seq=0 2026-02-20T13:29:08.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.671+0000 7fe6b7fff640 10 client.19746 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:08.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.671+0000 7fe6b7fff640 1 -- 10.20.193.28:0/787665755 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561cc67699d0 con 0x561cc6c0a310 2026-02-20T13:29:08.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.671+0000 7fe6b7fff640 10 client.19746 handle_command_reply: tid=0 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.671+0000 7fe70e318e00 1 client.19746 shutdown 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.671+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 msgr2=0x561cc6be0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.671+0000 7fe70e318e00 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be0200 secure :-1 s=READY pgs=1284 gs=1 cs=0 l=1 c_cookie=8960690681230539915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f80d1950 tx=0x7fe6f8049000 comp rx=0 tx=0).stop 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.671+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 shutdown_connections 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe70e318e00 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561cc6c0a310 0x561cc6c0a7b0 crc :-1 s=READY pgs=342 gs=4 cs=0 l=0 c_cookie=9099263282642435068 s_cookie=17530848719832088668 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe70e318e00 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be0200 unknown :-1 s=CLOSED pgs=1284 gs=1 cs=0 l=1 c_cookie=8960690681230539915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe70e318e00 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6c0c9c0 0x561cc6be51f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe70e318e00 1 --2- 10.20.193.28:0/787665755 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6bc7410 0x561cc6bdfcc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe6b7fff640 0 client.19746 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 >> 10.20.193.28:0/787665755 conn(0x561cc6ba5910 msgr2=0x561cc6bc64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 shutdown_connections 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe70e318e00 1 -- 10.20.193.28:0/787665755 wait complete. 2026-02-20T13:29:08.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.672+0000 7fe70e318e00 20 client.19746 trim_cache size 0 max 16384 2026-02-20T13:29:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.680+0000 7fe70e318e00 1 Processor -- start 2026-02-20T13:29:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70e318e00 1 -- start start 2026-02-20T13:29:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bdfee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6c0bf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6bdd070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70e318e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561cc6bd1e10 con 0x561cc6bc7d20 2026-02-20T13:29:08.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70e318e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561cc6ad1320 con 0x561cc6c0c9c0 2026-02-20T13:29:08.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70e318e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561cc6791790 con 0x561cc6bc7410 2026-02-20T13:29:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6c0bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70a093640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bdfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6c0bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41520/0 (socket says 10.20.193.28:41520) 2026-02-20T13:29:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 -- 10.20.193.28:0/1789205611 learned_addr learned my addr 10.20.193.28:0/1789205611 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70a894640 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6bdd070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 -- 10.20.193.28:0/1789205611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 msgr2=0x561cc6bdfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bdfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 -- 10.20.193.28:0/1789205611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 msgr2=0x561cc6bdd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6bdd070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 -- 10.20.193.28:0/1789205611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc6a694f0 con 0x561cc6bc7d20 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe70a894640 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6bdd070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe709892640 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6c0bf90 secure :-1 s=READY pgs=1285 gs=1 cs=0 l=1 c_cookie=10862838243364102517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f80cdcb0 tx=0x7fe6f803a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c08dd41c3ee175 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe6d24e6640 1 -- 10.20.193.28:0/1789205611 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f8002940 con 0x561cc6bc7d20 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe6d24e6640 1 -- 10.20.193.28:0/1789205611 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6f80d2130 con 0x561cc6bc7d20 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.681+0000 7fe6d24e6640 1 -- 10.20.193.28:0/1789205611 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f80d7400 con 0x561cc6bc7d20 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 -- 10.20.193.28:0/1789205611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 msgr2=0x561cc6c0bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6c0bf90 secure :-1 s=READY pgs=1285 gs=1 cs=0 l=1 c_cookie=10862838243364102517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f80cdcb0 tx=0x7fe6f803a030 comp rx=0 tx=0).stop 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 -- 10.20.193.28:0/1789205611 shutdown_connections 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6c0bf90 unknown :-1 s=CLOSED pgs=1285 gs=1 cs=0 l=1 c_cookie=10862838243364102517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6bdd070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 --2- 10.20.193.28:0/1789205611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6bdfee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 -- 10.20.193.28:0/1789205611 >> 10.20.193.28:0/1789205611 conn(0x561cc6ba5910 msgr2=0x561cc6c0b880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 -- 10.20.193.28:0/1789205611 shutdown_connections 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 -- 10.20.193.28:0/1789205611 wait complete. 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.682+0000 7fe70e318e00 1 -- start start 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70e318e00 1 Processor -- start 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6be7e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be83b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70e318e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6c51ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70e318e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561cc6791790 con 0x561cc6bc7d20 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70e318e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561cc6c52410 con 0x561cc6c0c9c0 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70e318e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561cc6c525d0 con 0x561cc6bc7410 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe709892640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe709892640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41526/0 (socket says 10.20.193.28:41526) 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe709892640 1 -- 10.20.193.28:0/3423822893 learned_addr learned my addr 10.20.193.28:0/3423822893 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70a894640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6c51ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe70a093640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6be7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe709892640 1 -- 10.20.193.28:0/3423822893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 msgr2=0x561cc6be7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe709892640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6be7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe709892640 1 -- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 msgr2=0x561cc6c51ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.683+0000 7fe709892640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6c51ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe709892640 1 -- 10.20.193.28:0/3423822893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc6a63f70 con 0x561cc6bc7d20 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe70a093640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6be7e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe70a894640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6c51ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe709892640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be83b0 secure :-1 s=READY pgs=1286 gs=1 cs=0 l=1 c_cookie=14215477048822365743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f8035ad0 tx=0x7fe6f802f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c547850f1fc67e2f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe6b7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe6b7fff640 1 -- 10.20.193.28:0/3423822893 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f80d7400 con 0x561cc6bc7d20 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe6b7fff640 1 -- 10.20.193.28:0/3423822893 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6f8005d40 con 0x561cc6bc7d20 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe6b7fff640 1 -- 10.20.193.28:0/3423822893 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6f8035c80 con 0x561cc6bc7d20 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc6a57810 con 0x561cc6bc7d20 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe6b7fff640 1 -- 10.20.193.28:0/3423822893 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe6f8035e10 con 0x561cc6bc7d20 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe6b7fff640 10 client.19752 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe70e318e00 10 client.19752 _ll_register_callbacks cb 0x561cc6a8ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:08.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe70000ae00 con 0x561cc6bc7d20 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe6b7fff640 1 -- 10.20.193.28:0/3423822893 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe6f80d3a00 con 0x561cc6bc7d20 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe70e318e00 10 client.19752 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.684+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561cc6a57b40 con 0x561cc6bc7d20 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe6b7fff640 1 -- 10.20.193.28:0/3423822893 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe6f80d2370 con 0x561cc6bc7d20 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe70e318e00 10 client.19752 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe70e318e00 10 client.19752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe70e318e00 20 client.19752 populate_metadata read hostname 'trial028' 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561cc6cb9e20 0x561cc6cda220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe70e318e00 4 client.19752 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561cc6ae0df0 con 0x561cc6cb9e20 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe70a093640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561cc6cb9e20 0x561cc6cda220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe70a093640 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561cc6cb9e20 0x561cc6cda220 crc :-1 s=READY pgs=343 gs=4 cs=0 l=0 c_cookie=15727348302570992268 s_cookie=15833840438398774277 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da42c3f44196328c server_cookie=dbbd19fcc8f96c05 in_seq=0 out_seq=0 2026-02-20T13:29:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.685+0000 7fe6b7fff640 10 client.19752 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe6b7fff640 1 -- 10.20.193.28:0/3423822893 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561cc6ae0df0 con 0x561cc6cb9e20 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe6b7fff640 10 client.19752 handle_command_reply: tid=0 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 client.19752 shutdown 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 msgr2=0x561cc6be83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be83b0 secure :-1 s=READY pgs=1286 gs=1 cs=0 l=1 c_cookie=14215477048822365743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f8035ad0 tx=0x7fe6f802f120 comp rx=0 tx=0).stop 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 shutdown_connections 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561cc6cb9e20 0x561cc6cda220 crc :-1 s=READY pgs=343 gs=4 cs=0 l=0 c_cookie=15727348302570992268 s_cookie=15833840438398774277 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cc6bc7d20 0x561cc6be83b0 unknown :-1 s=CLOSED pgs=1286 gs=1 cs=0 l=1 c_cookie=14215477048822365743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561cc6c0c9c0 0x561cc6c51ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 --2- 10.20.193.28:0/3423822893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561cc6bc7410 0x561cc6be7e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 >> 10.20.193.28:0/3423822893 conn(0x561cc6ba5910 msgr2=0x561cc6c0bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe6b7fff640 0 client.19752 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 shutdown_connections 2026-02-20T13:29:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.686+0000 7fe70e318e00 1 -- 10.20.193.28:0/3423822893 wait complete. 2026-02-20T13:29:08.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70e318e00 20 client.19752 trim_cache size 0 max 16384 2026-02-20T13:29:08.696 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:29:08.696 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:29:08.697 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "28b37070-4232-44fb-98df-3259633ee060", 2026-02-20T13:29:08.697 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:29:08.697 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:29:08.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 -- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6e00b56e0 msgr2=0x7fe6e00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6e00b56e0 0x7fe6e00d5b90 secure :-1 s=READY pgs=540 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f4004740 tx=0x7fe6f4005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 -- 10.20.193.28:0/3366263927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe70410bfb0 msgr2=0x7fe70411e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe70410bfb0 0x7fe70411e2f0 secure :-1 s=READY pgs=377 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6f8002390 tx=0x7fe6f80028d0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 -- 10.20.193.28:0/3366263927 shutdown_connections 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe6e00b56e0 0x7fe6e00d5b90 unknown :-1 s=CLOSED pgs=540 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7041144d0 0x7fe7041236c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe70410bfb0 0x7fe70411e2f0 unknown :-1 s=CLOSED pgs=377 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 --2- 10.20.193.28:0/3366263927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe70410b610 0x7fe70411ddb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 -- 10.20.193.28:0/3366263927 >> 10.20.193.28:0/3366263927 conn(0x7fe7040e9080 msgr2=0x7fe704109460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 -- 10.20.193.28:0/3366263927 shutdown_connections 2026-02-20T13:29:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:08.687+0000 7fe70b095640 1 -- 10.20.193.28:0/3366263927 wait complete. 2026-02-20T13:29:08.789 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:29:08.973 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:08 trial127 ceph-mon[43817]: pgmap v535: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2026-02-20T13:29:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:08 trial034 ceph-mon[43332]: pgmap v535: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2026-02-20T13:29:09.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.156+0000 7fb7bb577640 1 -- 10.20.193.28:0/787894113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 msgr2=0x7fb7bc10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.156+0000 7fb7bb577640 1 --2- 10.20.193.28:0/787894113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 0x7fb7bc10f880 secure :-1 s=READY pgs=1287 gs=1 cs=0 l=1 c_cookie=14946062348756394252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b0009950 tx=0x7fb7b002f190 comp rx=0 tx=0).stop 2026-02-20T13:29:09.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.157+0000 7fb7bb577640 1 -- 10.20.193.28:0/787894113 shutdown_connections 2026-02-20T13:29:09.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.157+0000 7fb7bb577640 1 --2- 10.20.193.28:0/787894113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7bc1156a0 0x7fb7bc176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.157+0000 7fb7bb577640 1 --2- 10.20.193.28:0/787894113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7bc10fea0 0x7fb7bc114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.157+0000 7fb7bb577640 1 --2- 10.20.193.28:0/787894113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 0x7fb7bc10f880 unknown :-1 s=CLOSED pgs=1287 gs=1 cs=0 l=1 c_cookie=14946062348756394252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.157+0000 7fb7bb577640 1 -- 10.20.193.28:0/787894113 >> 10.20.193.28:0/787894113 conn(0x7fb7bc0ecda0 msgr2=0x7fb7bc10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:09.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.157+0000 7fb7bb577640 1 -- 10.20.193.28:0/787894113 shutdown_connections 2026-02-20T13:29:09.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.157+0000 7fb7bb577640 1 -- 10.20.193.28:0/787894113 wait complete. 2026-02-20T13:29:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.158+0000 7fb7bb577640 1 Processor -- start 2026-02-20T13:29:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.158+0000 7fb7bb577640 1 -- start start 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.158+0000 7fb7bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 0x7fb7bc11de10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.158+0000 7fb7bb577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7bc10fea0 0x7fb7bc11e350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.158+0000 7fb7bb577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7bc1156a0 0x7fb7bc123720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.158+0000 7fb7bb577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc123d40 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.158+0000 7fb7bb577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc123eb0 con 0x7fb7bc10fea0 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.158+0000 7fb7bb577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc124070 con 0x7fb7bc1156a0 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 0x7fb7bc11de10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 0x7fb7bc11de10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41548/0 (socket says 10.20.193.28:41548) 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 -- 10.20.193.28:0/3286638711 learned_addr learned my addr 10.20.193.28:0/3286638711 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7bad76640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7bc1156a0 0x7fb7bc123720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7bc10fea0 0x7fb7bc11e350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 -- 10.20.193.28:0/3286638711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7bc1156a0 msgr2=0x7fb7bc123720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7bc1156a0 0x7fb7bc123720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 -- 10.20.193.28:0/3286638711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7bc10fea0 msgr2=0x7fb7bc11e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7bc10fea0 0x7fb7bc11e350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 -- 10.20.193.28:0/3286638711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b0009570 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.159+0000 7fb7ba575640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 0x7fb7bc11de10 secure :-1 s=READY pgs=1288 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b0038820 tx=0x7fb7b0004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.160+0000 7fb7a37fe640 1 -- 10.20.193.28:0/3286638711 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b003d070 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.160+0000 7fb7a37fe640 1 -- 10.20.193.28:0/3286638711 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7b0002ad0 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.160+0000 7fb7a37fe640 1 -- 10.20.193.28:0/3286638711 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b0041940 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.160+0000 7fb7bb577640 1 -- 10.20.193.28:0/3286638711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc1242f0 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.160+0000 7fb7bb577640 1 -- 10.20.193.28:0/3286638711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc1648b0 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.163+0000 7fb7a37fe640 1 -- 10.20.193.28:0/3286638711 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb7b0041ad0 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.164+0000 7fb7a37fe640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7940b5760 0x7fb7940d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.164+0000 7fb7a37fe640 1 -- 10.20.193.28:0/3286638711 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb7b010b080 con 0x7fb7bc10f4b0 2026-02-20T13:29:09.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.165+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7940b5760 0x7fb7940d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.165+0000 7fb7c2f52e00 1 Processor -- start 2026-02-20T13:29:09.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.165+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7940b5760 0x7fb7940d5c10 secure :-1 s=READY pgs=541 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7bc1247b0 tx=0x7fb7a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:09.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.165+0000 7fb7c2f52e00 1 -- start start 2026-02-20T13:29:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2b180 0x555904c2b550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c70400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c70940 0x555904c90d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555904b417d0 con 0x555904c2ba90 2026-02-20T13:29:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555904b3d500 con 0x555904c2b180 2026-02-20T13:29:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555904b374a0 con 0x555904c70940 2026-02-20T13:29:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c70400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c70400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41560/0 (socket says 10.20.193.28:41560) 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 -- 10.20.193.28:0/2725627482 learned_addr learned my addr 10.20.193.28:0/2725627482 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7bad76640 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c70940 0x555904c90d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7ba575640 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2b180 0x555904c2b550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 -- 10.20.193.28:0/2725627482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c70940 msgr2=0x555904c90d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c70940 0x555904c90d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 -- 10.20.193.28:0/2725627482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2b180 msgr2=0x555904c2b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2b180 0x555904c2b550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 -- 10.20.193.28:0/2725627482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555904ae2d80 con 0x555904c2ba90 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c70400 secure :-1 s=READY pgs=1289 gs=1 cs=0 l=1 c_cookie=10013033517316770437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a4011440 tx=0x7fb7a4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af570eec3bf0a85 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7a0ff9640 1 -- 10.20.193.28:0/2725627482 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7a401e640 con 0x555904c2ba90 2026-02-20T13:29:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7a0ff9640 1 -- 10.20.193.28:0/2725627482 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7a4015070 con 0x555904c2ba90 2026-02-20T13:29:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.166+0000 7fb7a0ff9640 1 -- 10.20.193.28:0/2725627482 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7a401ccd0 con 0x555904c2ba90 2026-02-20T13:29:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2725627482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 msgr2=0x555904c70400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c70400 secure :-1 s=READY pgs=1289 gs=1 cs=0 l=1 c_cookie=10013033517316770437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a4011440 tx=0x7fb7a4013000 comp rx=0 tx=0).stop 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2725627482 shutdown_connections 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c70400 unknown :-1 s=CLOSED pgs=1289 gs=1 cs=0 l=1 c_cookie=10013033517316770437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c70940 0x555904c90d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2725627482 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2b180 0x555904c2b550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2725627482 >> 10.20.193.28:0/2725627482 conn(0x555904c09680 msgr2=0x555904c29a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2725627482 shutdown_connections 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.167+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2725627482 wait complete. 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.168+0000 7fb7c2f52e00 1 -- start start 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.168+0000 7fb7c2f52e00 1 Processor -- start 2026-02-20T13:29:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c880a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2ba90 0x555904c885e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c70940 0x555904c8d5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555904c8db10 con 0x555904c70940 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555904c8dc80 con 0x555904c2ba90 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555904c8de40 con 0x555904c2b180 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7ba575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7ba575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c880a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34260/0 (socket says 10.20.193.28:34260) 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7ba575640 1 -- 10.20.193.28:0/2298787471 learned_addr learned my addr 10.20.193.28:0/2298787471 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2ba90 0x555904c885e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7ba575640 1 -- 10.20.193.28:0/2298787471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2ba90 msgr2=0x555904c885e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7ba575640 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2ba90 0x555904c885e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7ba575640 1 -- 10.20.193.28:0/2298787471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c70940 msgr2=0x555904c8d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7ba575640 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c70940 0x555904c8d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.169+0000 7fb7ba575640 1 -- 10.20.193.28:0/2298787471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555904abb350 con 0x555904c2b180 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb7ba575640 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c880a0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=17164944557299779754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b00023d0 tx=0x7fb7b00d0c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee3622218f20c8aa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb76bfff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb76bfff640 1 -- 10.20.193.28:0/2298787471 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b00dc2b0 con 0x555904c2b180 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb76bfff640 1 -- 10.20.193.28:0/2298787471 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7b00dc520 con 0x555904c2b180 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb76bfff640 1 -- 10.20.193.28:0/2298787471 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b00d3050 con 0x555904c2b180 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a400bd10 con 0x555904c2b180 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb7c2f52e00 10 client.29578 _ll_register_callbacks cb 0x555904ab89a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5559047cd6f0 con 0x555904c2b180 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb76bfff640 1 -- 10.20.193.28:0/2298787471 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb7b00cf6a0 con 0x555904c2b180 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb76bfff640 1 -- 10.20.193.28:0/2298787471 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb7b0035320 con 0x555904c2b180 2026-02-20T13:29:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb7c2f52e00 10 client.29578 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.170+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555904acd150 con 0x555904c2b180 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb76bfff640 1 -- 10.20.193.28:0/2298787471 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fb7b0106d20 con 0x555904c2b180 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb7c2f52e00 10 client.29578 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb7c2f52e00 10 client.29578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb7c2f52e00 20 client.29578 populate_metadata read hostname 'trial028' 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555904c6d950 0x555904c6ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb7c2f52e00 4 client.29578 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555904b44d60 con 0x555904c6d950 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555904c6d950 0x555904c6ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555904c6d950 0x555904c6ddc0 crc :-1 s=READY pgs=344 gs=4 cs=0 l=0 c_cookie=1723981887859852478 s_cookie=14860621221412967344 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ecd064991804be server_cookie=ce3b884413f393b0 in_seq=0 out_seq=0 2026-02-20T13:29:09.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.171+0000 7fb76bfff640 10 client.29578 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb76bfff640 1 -- 10.20.193.28:0/2298787471 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555904b44d60 con 0x555904c6d950 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb76bfff640 10 client.29578 handle_command_reply: tid=0 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 client.29578 shutdown 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 msgr2=0x555904c880a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c880a0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=17164944557299779754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b00023d0 tx=0x7fb7b00d0c90 comp rx=0 tx=0).stop 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 shutdown_connections 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555904c6d950 0x555904c6ddc0 crc :-1 s=READY pgs=344 gs=4 cs=0 l=0 c_cookie=1723981887859852478 s_cookie=14860621221412967344 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c70940 0x555904c8d5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c2ba90 0x555904c885e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2298787471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c880a0 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=17164944557299779754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 >> 10.20.193.28:0/2298787471 conn(0x555904c09680 msgr2=0x555904c29a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:09.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb76bfff640 0 client.29578 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:09.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 shutdown_connections 2026-02-20T13:29:09.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2298787471 wait complete. 2026-02-20T13:29:09.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.172+0000 7fb7c2f52e00 20 client.29578 trim_cache size 0 max 16384 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.181+0000 7fb7c2f52e00 1 Processor -- start 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.181+0000 7fb7c2f52e00 1 -- start start 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.181+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2b180 0x555904c7a100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.181+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2ba90 0x555904c6b5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.181+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c6bae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.181+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555904b350d0 con 0x555904c2b180 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.181+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5559047f5700 con 0x555904c70940 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.181+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555904c81150 con 0x555904c2ba90 2026-02-20T13:29:09.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2ba90 0x555904c6b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2ba90 0x555904c6b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:34264/0 (socket says 10.20.193.28:34264) 2026-02-20T13:29:09.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 -- 10.20.193.28:0/2371651080 learned_addr learned my addr 10.20.193.28:0/2371651080 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:09.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7bad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c6bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7ba575640 1 --2- 10.20.193.28:0/2371651080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2b180 0x555904c7a100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 -- 10.20.193.28:0/2371651080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 msgr2=0x555904c6bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:09.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2371651080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c6bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 -- 10.20.193.28:0/2371651080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2b180 msgr2=0x555904c7a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2371651080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2b180 0x555904c7a100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 -- 10.20.193.28:0/2371651080 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555904ac7bd0 con 0x555904c2ba90 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2371651080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2ba90 0x555904c6b5a0 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=3426417252980807828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a4011db0 tx=0x7fb7a4005900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f8d14567030d894 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7864e6640 1 -- 10.20.193.28:0/2371651080 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7a4035170 con 0x555904c2ba90 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7864e6640 1 -- 10.20.193.28:0/2371651080 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7a402b040 con 0x555904c2ba90 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.182+0000 7fb7864e6640 1 -- 10.20.193.28:0/2371651080 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7a4005710 con 0x555904c2ba90 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2371651080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2ba90 msgr2=0x555904c6b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2371651080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2ba90 0x555904c6b5a0 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=3426417252980807828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a4011db0 tx=0x7fb7a4005900 comp rx=0 tx=0).stop 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2371651080 shutdown_connections 2026-02-20T13:29:09.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2371651080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c6bae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2371651080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2ba90 0x555904c6b5a0 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=3426417252980807828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2371651080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2b180 0x555904c7a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2371651080 >> 10.20.193.28:0/2371651080 conn(0x555904c09680 msgr2=0x555904c8cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2371651080 shutdown_connections 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2371651080 wait complete. 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.183+0000 7fb7c2f52e00 1 -- start start 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7c2f52e00 1 Processor -- start 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c70000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c09a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7c2f52e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c09f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555904c092f0 con 0x555904c2ba90 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555904cd7510 con 0x555904c70940 2026-02-20T13:29:09.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7c2f52e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555904c0a550 con 0x555904c2b180 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7bad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c09f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7bad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c09f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57474/0 (socket says 10.20.193.28:57474) 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7bad76640 1 -- 10.20.193.28:0/2417937705 learned_addr learned my addr 10.20.193.28:0/2417937705 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7b9d74640 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c09a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.184+0000 7fb7ba575640 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c70000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7bad76640 1 -- 10.20.193.28:0/2417937705 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 msgr2=0x555904c70000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7bad76640 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c70000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7bad76640 1 -- 10.20.193.28:0/2417937705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 msgr2=0x555904c09a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7bad76640 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c09a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7bad76640 1 -- 10.20.193.28:0/2417937705 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555904abb680 con 0x555904c70940 2026-02-20T13:29:09.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7bad76640 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c09f90 secure :-1 s=READY pgs=449 gs=2 cs=0 l=1 c_cookie=5108282563818895570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7ac0055e0 tx=0x7fb7ac00aab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e443ed4cbf38d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb76bfff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb76bfff640 1 -- 10.20.193.28:0/2417937705 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7ac005cf0 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb76bfff640 1 -- 10.20.193.28:0/2417937705 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7ac019040 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555904ae2d80 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb76bfff640 1 -- 10.20.193.28:0/2417937705 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7ac011e00 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7c2f52e00 10 client.29705 _ll_register_callbacks cb 0x555904ab89a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55590488f4a0 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb76bfff640 1 -- 10.20.193.28:0/2417937705 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb7ac01f450 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb76bfff640 1 -- 10.20.193.28:0/2417937705 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb7ac01f670 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7c2f52e00 10 client.29705 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.185+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555904acd3b0 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb76bfff640 1 -- 10.20.193.28:0/2417937705 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fb7ac011550 con 0x555904c70940 2026-02-20T13:29:09.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7c2f52e00 10 client.29705 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7c2f52e00 10 client.29705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7c2f52e00 20 client.29705 populate_metadata read hostname 'trial028' 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555904d1e290 0x555904d3e740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7c2f52e00 4 client.29705 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb7a4015070 con 0x555904d1e290 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7ba575640 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555904d1e290 0x555904d3e740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7ba575640 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555904d1e290 0x555904d3e740 crc :-1 s=READY pgs=345 gs=4 cs=0 l=0 c_cookie=9850660713847946030 s_cookie=12718199334120516758 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88b493ba6bcd7b2e server_cookie=b0801ee914dcec96 in_seq=0 out_seq=0 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb76bfff640 10 client.29705 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb76bfff640 1 -- 10.20.193.28:0/2417937705 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6250 (crc 0 0 0) 0x7fb7a4015070 con 0x555904d1e290 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb76bfff640 10 client.29705 handle_command_reply: tid=0 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.186+0000 7fb7c2f52e00 1 client.29705 shutdown 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 msgr2=0x555904c09f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c09f90 secure :-1 s=READY pgs=449 gs=2 cs=0 l=1 c_cookie=5108282563818895570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7ac0055e0 tx=0x7fb7ac00aab0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 shutdown_connections 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555904d1e290 0x555904d3e740 crc :-1 s=READY pgs=345 gs=4 cs=0 l=0 c_cookie=9850660713847946030 s_cookie=12718199334120516758 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555904c2ba90 0x555904c09a50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555904c70940 0x555904c09f90 unknown :-1 s=CLOSED pgs=449 gs=2 cs=0 l=1 c_cookie=5108282563818895570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 --2- 10.20.193.28:0/2417937705 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555904c2b180 0x555904c70000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb76bfff640 0 client.29705 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 >> 10.20.193.28:0/2417937705 conn(0x555904c09680 msgr2=0x555904c85360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 shutdown_connections 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 1 -- 10.20.193.28:0/2417937705 wait complete. 2026-02-20T13:29:09.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.187+0000 7fb7c2f52e00 20 client.29705 trim_cache size 0 max 16384 2026-02-20T13:29:09.196 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:29:09.196 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:29:09.196 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:29:09.196 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "28b37070-4232-44fb-98df-3259633ee060", 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.197 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.198 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:29:09.199 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.200 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.201 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.202 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.203 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:29:09.204 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.205 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.206 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:09.207 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 -- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7940b5760 msgr2=0x7fb7940d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7940b5760 0x7fb7940d5c10 secure :-1 s=READY pgs=541 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7bc1247b0 tx=0x7fb7a400b410 comp rx=0 tx=0).stop 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 -- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 msgr2=0x7fb7bc11de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 0x7fb7bc11de10 secure :-1 s=READY pgs=1288 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b0038820 tx=0x7fb7b0004300 comp rx=0 tx=0).stop 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 -- 10.20.193.28:0/3286638711 shutdown_connections 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb7940b5760 0x7fb7940d5c10 unknown :-1 s=CLOSED pgs=541 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7bc1156a0 0x7fb7bc123720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb7bc10fea0 0x7fb7bc11e350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 --2- 10.20.193.28:0/3286638711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb7bc10f4b0 0x7fb7bc11de10 unknown :-1 s=CLOSED pgs=1288 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:09.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 -- 10.20.193.28:0/3286638711 >> 10.20.193.28:0/3286638711 conn(0x7fb7bc0ecda0 msgr2=0x7fb7bc10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:09.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 -- 10.20.193.28:0/3286638711 shutdown_connections 2026-02-20T13:29:09.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:09.188+0000 7fb7bb577640 1 -- 10.20.193.28:0/3286638711 wait complete. 2026-02-20T13:29:09.291 INFO:tasks.cephfs.filesystem:scrub status for tag:28b37070-4232-44fb-98df-3259633ee060 - {'path': '/', 'tag': '28b37070-4232-44fb-98df-3259633ee060', 'options': 'recursive,force'} 2026-02-20T13:29:09.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:09 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:29:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:09 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:09 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:29:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:09 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:29:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:09 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:09 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:29:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:09 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:09 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:09 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:29:09.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:09 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:09 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:29:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:09 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:29:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:09 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:09 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:29:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:09 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:09 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:09 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:29:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:09 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:09 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:29:09.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:09 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:29:09.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:09 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:09 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:29:09.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:09 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:09.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:09 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:10 trial028 ceph-mon[37442]: pgmap v536: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2026-02-20T13:29:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:10 trial127 ceph-mon[43817]: pgmap v536: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2026-02-20T13:29:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:10 trial034 ceph-mon[43332]: pgmap v536: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2026-02-20T13:29:12.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:12 trial028 ceph-mon[37442]: pgmap v537: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2026-02-20T13:29:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:12 trial127 ceph-mon[43817]: pgmap v537: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2026-02-20T13:29:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:12 trial034 ceph-mon[43332]: pgmap v537: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2026-02-20T13:29:14.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:14 trial028 ceph-mon[37442]: pgmap v538: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T13:29:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:14 trial127 ceph-mon[43817]: pgmap v538: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T13:29:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:14 trial034 ceph-mon[43332]: pgmap v538: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T13:29:16.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 -- 10.20.193.28:0/658112729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f156410bd40 msgr2=0x7f156410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 --2- 10.20.193.28:0/658112729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f156410bd40 0x7f156410c1b0 secure :-1 s=READY pgs=1290 gs=1 cs=0 l=1 c_cookie=13934025663057447770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1554009950 tx=0x7f155402f190 comp rx=0 tx=0).stop 2026-02-20T13:29:16.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 -- 10.20.193.28:0/658112729 shutdown_connections 2026-02-20T13:29:16.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 --2- 10.20.193.28:0/658112729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f156410bd40 0x7f156410c1b0 unknown :-1 s=CLOSED pgs=1290 gs=1 cs=0 l=1 c_cookie=13934025663057447770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 --2- 10.20.193.28:0/658112729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f156410c8d0 0x7f156410cd50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 --2- 10.20.193.28:0/658112729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1564060610 0x7f156410b720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 -- 10.20.193.28:0/658112729 >> 10.20.193.28:0/658112729 conn(0x7f15640e9380 msgr2=0x7f1564109790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 -- 10.20.193.28:0/658112729 shutdown_connections 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.069+0000 7f1568d04640 1 -- 10.20.193.28:0/658112729 wait complete. 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.070+0000 7f1568d04640 1 Processor -- start 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1568d04640 1 -- start start 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1568d04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1564060610 0x7f15640f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1568d04640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f156410bd40 0x7f15640f5210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1568d04640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f156410c8d0 0x7f15640f5e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1568d04640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f15640f6550 con 0x7f1564060610 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1568d04640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f15640f66c0 con 0x7f156410bd40 2026-02-20T13:29:16.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1568d04640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f15640f6880 con 0x7f156410c8d0 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1564060610 0x7f15640f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1562ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f156410bd40 0x7f15640f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1564060610 0x7f15640f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44414/0 (socket says 10.20.193.28:44414) 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 -- 10.20.193.28:0/3991465538 learned_addr learned my addr 10.20.193.28:0/3991465538 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1563fff640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f156410c8d0 0x7f15640f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 -- 10.20.193.28:0/3991465538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f156410c8d0 msgr2=0x7f15640f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f156410c8d0 0x7f15640f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 -- 10.20.193.28:0/3991465538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f156410bd40 msgr2=0x7f15640f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f156410bd40 0x7f15640f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 -- 10.20.193.28:0/3991465538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1554009570 con 0x7f1564060610 2026-02-20T13:29:16.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f15637fe640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1564060610 0x7f15640f4bc0 secure :-1 s=READY pgs=1291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1550009480 tx=0x7f155000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:16.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.071+0000 7f1560ff9640 1 -- 10.20.193.28:0/3991465538 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f155000cd40 con 0x7f1564060610 2026-02-20T13:29:16.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.072+0000 7f1560ff9640 1 -- 10.20.193.28:0/3991465538 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1550004d30 con 0x7f1564060610 2026-02-20T13:29:16.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.072+0000 7f1560ff9640 1 -- 10.20.193.28:0/3991465538 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15500106b0 con 0x7f1564060610 2026-02-20T13:29:16.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.072+0000 7f1568d04640 1 -- 10.20.193.28:0/3991465538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15640f6b60 con 0x7f1564060610 2026-02-20T13:29:16.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.072+0000 7f1568d04640 1 -- 10.20.193.28:0/3991465538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15640f7080 con 0x7f1564060610 2026-02-20T13:29:16.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.075+0000 7f1560ff9640 1 -- 10.20.193.28:0/3991465538 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f155001f060 con 0x7f1564060610 2026-02-20T13:29:16.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.076+0000 7f1560ff9640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f15380b5760 0x7f15380d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.076+0000 7f1560ff9640 1 -- 10.20.193.28:0/3991465538 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1550014070 con 0x7f1564060610 2026-02-20T13:29:16.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.076+0000 7f1562ffd640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f15380b5760 0x7f15380d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f1562ffd640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f15380b5760 0x7f15380d5c10 secure :-1 s=READY pgs=544 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15540098a0 tx=0x7f155403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f156c652e00 1 Processor -- start 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f156c652e00 1 -- start start 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f156c652e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f406fe94c0 0x55f4070098a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f156c652e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40702a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f156c652e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f40702a700 0x55f40704aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f156c652e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f406efefd0 con 0x55f407009de0 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f156c652e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f406efad00 con 0x55f406fe94c0 2026-02-20T13:29:16.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f156c652e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f406ef4ca0 con 0x55f40702a700 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f15637fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f406fe94c0 0x55f4070098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f1562ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40702a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f15637fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f406fe94c0 0x55f4070098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44836/0 (socket says 10.20.193.28:44836) 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f15637fe640 1 -- 10.20.193.28:0/801648268 learned_addr learned my addr 10.20.193.28:0/801648268 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f1563fff640 1 --2- 10.20.193.28:0/801648268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f40702a700 0x55f40704aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f15637fe640 1 -- 10.20.193.28:0/801648268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f40702a700 msgr2=0x55f40704aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f15637fe640 1 --2- 10.20.193.28:0/801648268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f40702a700 0x55f40704aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f15637fe640 1 -- 10.20.193.28:0/801648268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 msgr2=0x55f40702a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f15637fe640 1 --2- 10.20.193.28:0/801648268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40702a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.077+0000 7f15637fe640 1 -- 10.20.193.28:0/801648268 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f406e978b0 con 0x55f406fe94c0 2026-02-20T13:29:16.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f15637fe640 1 --2- 10.20.193.28:0/801648268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f406fe94c0 0x55f4070098a0 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=14482692235320884469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1550005000 tx=0x7f1550009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8fcdbdafd9bfcf5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f1527fff640 1 -- 10.20.193.28:0/801648268 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15500ac830 con 0x55f406fe94c0 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f1527fff640 1 -- 10.20.193.28:0/801648268 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f15500ada30 con 0x55f406fe94c0 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f1527fff640 1 -- 10.20.193.28:0/801648268 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15500adf40 con 0x55f406fe94c0 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 -- 10.20.193.28:0/801648268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f406fe94c0 msgr2=0x55f4070098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 --2- 10.20.193.28:0/801648268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f406fe94c0 0x55f4070098a0 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=14482692235320884469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1550005000 tx=0x7f1550009380 comp rx=0 tx=0).stop 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 -- 10.20.193.28:0/801648268 shutdown_connections 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 --2- 10.20.193.28:0/801648268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40702a1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 --2- 10.20.193.28:0/801648268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f40702a700 0x55f40704aae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 --2- 10.20.193.28:0/801648268 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f406fe94c0 0x55f4070098a0 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=14482692235320884469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 -- 10.20.193.28:0/801648268 >> 10.20.193.28:0/801648268 conn(0x55f406f081c0 msgr2=0x55f406fe7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 -- 10.20.193.28:0/801648268 shutdown_connections 2026-02-20T13:29:16.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.078+0000 7f156c652e00 1 -- 10.20.193.28:0/801648268 wait complete. 2026-02-20T13:29:16.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f156c652e00 1 -- start start 2026-02-20T13:29:16.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f156c652e00 1 Processor -- start 2026-02-20T13:29:16.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f156c652e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f406fe94c0 0x55f407002b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f156c652e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f407009de0 0x55f4070031b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f156c652e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f407003c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f156c652e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f407004270 con 0x55f406fe94c0 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f156c652e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f4070043e0 con 0x55f40702a700 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f156c652e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f4070045a0 con 0x55f407009de0 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f15637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f406fe94c0 0x55f407002b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.080+0000 7f1562ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f407009de0 0x55f4070031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f1562ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f407009de0 0x55f4070031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:40768/0 (socket says 10.20.193.28:40768) 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f1562ffd640 1 -- 10.20.193.28:0/3258960631 learned_addr learned my addr 10.20.193.28:0/3258960631 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f406fe94c0 0x55f407002b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44436/0 (socket says 10.20.193.28:44436) 2026-02-20T13:29:16.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f1563fff640 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f407003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15637fe640 1 -- 10.20.193.28:0/3258960631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f407009de0 msgr2=0x55f4070031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15637fe640 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f407009de0 0x55f4070031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15637fe640 1 -- 10.20.193.28:0/3258960631 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 msgr2=0x55f407003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15637fe640 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f407003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15637fe640 1 -- 10.20.193.28:0/3258960631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f406ea0400 con 0x55f406fe94c0 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15637fe640 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f406fe94c0 0x55f407002b60 secure :-1 s=READY pgs=1292 gs=1 cs=0 l=1 c_cookie=7785204751018117387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15500e4800 tx=0x7f1550005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0a9a79281e490b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15257fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15257fa640 1 -- 10.20.193.28:0/3258960631 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15500b7f00 con 0x55f406fe94c0 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15640f7080 con 0x55f406fe94c0 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f156c652e00 10 client.19776 _ll_register_callbacks cb 0x55f406e7fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f406b94520 con 0x55f406fe94c0 2026-02-20T13:29:16.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15257fa640 1 -- 10.20.193.28:0/3258960631 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f15500c4e90 con 0x55f406fe94c0 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15257fa640 1 -- 10.20.193.28:0/3258960631 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15500d2390 con 0x55f406fe94c0 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15257fa640 1 -- 10.20.193.28:0/3258960631 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f15500adcc0 con 0x55f406fe94c0 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f15257fa640 1 -- 10.20.193.28:0/3258960631 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15500ade80 con 0x55f406fe94c0 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f156c652e00 10 client.19776 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.081+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f406e78da0 con 0x55f406fe94c0 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f15257fa640 1 -- 10.20.193.28:0/3258960631 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f15500cb070 con 0x55f406fe94c0 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f156c652e00 10 client.19776 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f156c652e00 10 client.19776 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f156c652e00 20 client.19776 populate_metadata read hostname 'trial028' 2026-02-20T13:29:16.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f156c652e00 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f407006f80 0x55f4070073f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f156c652e00 4 client.19776 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f406f26630 con 0x55f407006f80 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f1562ffd640 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f407006f80 0x55f4070073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f15257fa640 10 client.19776 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.082+0000 7f1562ffd640 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f407006f80 0x55f4070073f0 crc :-1 s=READY pgs=346 gs=4 cs=0 l=0 c_cookie=902207306249511719 s_cookie=17449706465338230609 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8548c3d2c3a327 server_cookie=f229cf93e5528751 in_seq=0 out_seq=0 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f15257fa640 1 -- 10.20.193.28:0/3258960631 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f406f26630 con 0x55f407006f80 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f15257fa640 10 client.19776 handle_command_reply: tid=0 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 client.19776 shutdown 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f406fe94c0 msgr2=0x55f407002b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f406fe94c0 0x55f407002b60 secure :-1 s=READY pgs=1292 gs=1 cs=0 l=1 c_cookie=7785204751018117387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15500e4800 tx=0x7f1550005bd0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 shutdown_connections 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f407006f80 0x55f4070073f0 crc :-1 s=READY pgs=346 gs=4 cs=0 l=0 c_cookie=902207306249511719 s_cookie=17449706465338230609 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f407003c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f407009de0 0x55f4070031b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 --2- 10.20.193.28:0/3258960631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f406fe94c0 0x55f407002b60 unknown :-1 s=CLOSED pgs=1292 gs=1 cs=0 l=1 c_cookie=7785204751018117387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f15257fa640 0 client.19776 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 >> 10.20.193.28:0/3258960631 conn(0x55f406f081c0 msgr2=0x55f406fea790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 shutdown_connections 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.083+0000 7f156c652e00 1 -- 10.20.193.28:0/3258960631 wait complete. 2026-02-20T13:29:16.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.084+0000 7f156c652e00 20 client.19776 trim_cache size 0 max 16384 2026-02-20T13:29:16.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f156c652e00 1 Processor -- start 2026-02-20T13:29:16.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f156c652e00 1 -- start start 2026-02-20T13:29:16.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f156c652e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f4070029d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f156c652e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f407009de0 0x55f406ff49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f156c652e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f40702a700 0x55f4070285c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f156c652e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f406ef28d0 con 0x55f40702a700 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f156c652e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f406c33f10 con 0x55f407009de0 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f156c652e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f406ffa890 con 0x55f406fe94c0 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f15637fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f4070029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f1563fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f40702a700 0x55f4070285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f1563fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f40702a700 0x55f4070285c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44452/0 (socket says 10.20.193.28:44452) 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f1563fff640 1 -- 10.20.193.28:0/2306508811 learned_addr learned my addr 10.20.193.28:0/2306508811 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.091+0000 7f1562ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f407009de0 0x55f406ff49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f1563fff640 1 -- 10.20.193.28:0/2306508811 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 msgr2=0x55f4070029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f1563fff640 1 --2- 10.20.193.28:0/2306508811 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f4070029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f1563fff640 1 -- 10.20.193.28:0/2306508811 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f407009de0 msgr2=0x55f406ff49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:16.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f1563fff640 1 --2- 10.20.193.28:0/2306508811 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f407009de0 0x55f406ff49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f1563fff640 1 -- 10.20.193.28:0/2306508811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f406ff51c0 con 0x55f40702a700 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f1563fff640 1 --2- 10.20.193.28:0/2306508811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f40702a700 0x55f4070285c0 secure :-1 s=READY pgs=1293 gs=2 cs=0 l=1 c_cookie=11385309639460255894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1558005150 tx=0x7f1558013820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e00becb8ddbf896 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f15277fe640 1 -- 10.20.193.28:0/2306508811 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1558018070 con 0x55f40702a700 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f15277fe640 1 -- 10.20.193.28:0/2306508811 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f15580118b0 con 0x55f40702a700 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f15277fe640 1 -- 10.20.193.28:0/2306508811 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f155801ca80 con 0x55f40702a700 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 -- 10.20.193.28:0/2306508811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f40702a700 msgr2=0x55f4070285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 --2- 10.20.193.28:0/2306508811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f40702a700 0x55f4070285c0 secure :-1 s=READY pgs=1293 gs=2 cs=0 l=1 c_cookie=11385309639460255894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1558005150 tx=0x7f1558013820 comp rx=0 tx=0).stop 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 -- 10.20.193.28:0/2306508811 shutdown_connections 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 --2- 10.20.193.28:0/2306508811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f40702a700 0x55f4070285c0 unknown :-1 s=CLOSED pgs=1293 gs=2 cs=0 l=1 c_cookie=11385309639460255894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 --2- 10.20.193.28:0/2306508811 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f407009de0 0x55f406ff49f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 --2- 10.20.193.28:0/2306508811 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f4070029d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 -- 10.20.193.28:0/2306508811 >> 10.20.193.28:0/2306508811 conn(0x55f406f081c0 msgr2=0x55f406ffee70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:16.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 -- 10.20.193.28:0/2306508811 shutdown_connections 2026-02-20T13:29:16.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.092+0000 7f156c652e00 1 -- 10.20.193.28:0/2306508811 wait complete. 2026-02-20T13:29:16.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f156c652e00 1 -- start start 2026-02-20T13:29:16.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f156c652e00 1 Processor -- start 2026-02-20T13:29:16.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f156c652e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f40700d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f156c652e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40700d670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f156c652e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f40700e2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f156c652e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f40700e810 con 0x55f407009de0 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f156c652e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f40700e980 con 0x55f40702a700 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f156c652e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f40700eb40 con 0x55f406fe94c0 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f1563fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f40700e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f1562ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40700d670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f1562ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40700d670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44454/0 (socket says 10.20.193.28:44454) 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f1563fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f40700e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:44860/0 (socket says 10.20.193.28:44860) 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f1562ffd640 1 -- 10.20.193.28:0/4242621902 learned_addr learned my addr 10.20.193.28:0/4242621902 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.093+0000 7f15637fe640 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f40700d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f1563fff640 1 -- 10.20.193.28:0/4242621902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 msgr2=0x55f40700d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:16.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f1563fff640 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f40700d130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f1563fff640 1 -- 10.20.193.28:0/4242621902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 msgr2=0x55f40700d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f1563fff640 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40700d670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f1563fff640 1 -- 10.20.193.28:0/4242621902 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f406e8a670 con 0x55f40702a700 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f15637fe640 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f40700d130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f1562ffd640 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40700d670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f1563fff640 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f40700e2d0 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=6580699402367472781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1558005150 tx=0x7f155801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b53573d8bbd148d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f15257fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f15257fa640 1 -- 10.20.193.28:0/4242621902 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1558018070 con 0x55f40702a700 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f15257fa640 1 -- 10.20.193.28:0/4242621902 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f155801c3c0 con 0x55f40702a700 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f15257fa640 1 -- 10.20.193.28:0/4242621902 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1558006050 con 0x55f40702a700 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1558003860 con 0x55f40702a700 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f156c652e00 10 client.29723 _ll_register_callbacks cb 0x55f406e7fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.094+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f406fa4ca0 con 0x55f40702a700 2026-02-20T13:29:16.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f15257fa640 1 -- 10.20.193.28:0/4242621902 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f155801ce20 con 0x55f40702a700 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f15257fa640 1 -- 10.20.193.28:0/4242621902 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15580057c0 con 0x55f40702a700 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f156c652e00 10 client.29723 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f406e850f0 con 0x55f40702a700 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f15257fa640 1 -- 10.20.193.28:0/4242621902 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1558011a20 con 0x55f40702a700 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f156c652e00 10 client.29723 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f156c652e00 10 client.29723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f156c652e00 20 client.29723 populate_metadata read hostname 'trial028' 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f156c652e00 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f4070d76b0 0x55f4070f7b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f156c652e00 4 client.29723 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f406bd8640 con 0x55f4070d76b0 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.095+0000 7f15637fe640 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f4070d76b0 0x55f4070f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.096+0000 7f15637fe640 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f4070d76b0 0x55f4070f7b60 crc :-1 s=READY pgs=347 gs=4 cs=0 l=0 c_cookie=2910159271485716761 s_cookie=16143130761602816198 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2862f67050b73919 server_cookie=e007ebe5d00458c6 in_seq=0 out_seq=0 2026-02-20T13:29:16.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.096+0000 7f15257fa640 10 client.29723 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:16.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f15257fa640 1 -- 10.20.193.28:0/4242621902 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f406bd8640 con 0x55f4070d76b0 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f15257fa640 10 client.29723 handle_command_reply: tid=0 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 client.29723 shutdown 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 msgr2=0x55f40700e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f40700e2d0 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=6580699402367472781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1558005150 tx=0x7f155801ca10 comp rx=0 tx=0).stop 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 shutdown_connections 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f4070d76b0 0x55f4070f7b60 crc :-1 s=READY pgs=347 gs=4 cs=0 l=0 c_cookie=2910159271485716761 s_cookie=16143130761602816198 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f407009de0 0x55f40700d670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f40702a700 0x55f40700e2d0 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=6580699402367472781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 --2- 10.20.193.28:0/4242621902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f406fe94c0 0x55f40700d130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f15257fa640 0 client.29723 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 >> 10.20.193.28:0/4242621902 conn(0x55f406f081c0 msgr2=0x55f406ffee70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 shutdown_connections 2026-02-20T13:29:16.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 1 -- 10.20.193.28:0/4242621902 wait complete. 2026-02-20T13:29:16.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.100+0000 7f156c652e00 20 client.29723 trim_cache size 0 max 16384 2026-02-20T13:29:16.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:29:16.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:29:16.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:29:16.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 -- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f15380b5760 msgr2=0x7f15380d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f15380b5760 0x7f15380d5c10 secure :-1 s=READY pgs=544 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15540098a0 tx=0x7f155403a040 comp rx=0 tx=0).stop 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 -- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1564060610 msgr2=0x7f15640f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1564060610 0x7f15640f4bc0 secure :-1 s=READY pgs=1291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1550009480 tx=0x7f155000ee60 comp rx=0 tx=0).stop 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 -- 10.20.193.28:0/3991465538 shutdown_connections 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f15380b5760 0x7f15380d5c10 unknown :-1 s=CLOSED pgs=544 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f156410c8d0 0x7f15640f5e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f156410bd40 0x7f15640f5210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 --2- 10.20.193.28:0/3991465538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1564060610 0x7f15640f4bc0 unknown :-1 s=CLOSED pgs=1291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 -- 10.20.193.28:0/3991465538 >> 10.20.193.28:0/3991465538 conn(0x7f15640e9380 msgr2=0x7f15640eb030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:16.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 -- 10.20.193.28:0/3991465538 shutdown_connections 2026-02-20T13:29:16.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:16.101+0000 7f1568d04640 1 -- 10.20.193.28:0/3991465538 wait complete. 2026-02-20T13:29:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:16 trial028 ceph-mon[37442]: pgmap v539: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T13:29:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:16 trial127 ceph-mon[43817]: pgmap v539: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T13:29:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:16 trial034 ceph-mon[43332]: pgmap v539: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T13:29:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:18 trial028 ceph-mon[37442]: pgmap v540: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:29:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:18 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:29:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:18 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:29:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:18 trial127 ceph-mon[43817]: pgmap v540: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:29:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:18 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:29:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:18 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:29:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:18 trial034 ceph-mon[43332]: pgmap v540: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:29:18.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:18 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:29:18.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:18 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:29:19.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:19 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:29:19.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:19 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:29:19.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:19 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:29:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:20 trial028 ceph-mon[37442]: pgmap v541: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:29:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:20 trial127 ceph-mon[43817]: pgmap v541: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:29:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:20 trial034 ceph-mon[43332]: pgmap v541: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:29:22.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:22 trial028 ceph-mon[37442]: pgmap v542: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:29:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:22 trial127 ceph-mon[43817]: pgmap v542: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:29:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:22 trial034 ceph-mon[43332]: pgmap v542: 97 pgs: 97 active+clean; 2.1 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:29:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:24 trial028 ceph-mon[37442]: pgmap v543: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:29:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:24 trial127 ceph-mon[43817]: pgmap v543: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:29:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:24 trial034 ceph-mon[43332]: pgmap v543: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:29:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:26 trial028 ceph-mon[37442]: pgmap v544: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:29:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:26 trial127 ceph-mon[43817]: pgmap v544: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:29:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:26 trial034 ceph-mon[43332]: pgmap v544: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:29:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:28 trial028 ceph-mon[37442]: pgmap v545: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:29:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:28 trial127 ceph-mon[43817]: pgmap v545: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:29:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:28 trial034 ceph-mon[43332]: pgmap v545: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:29:29.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 -- 10.20.193.28:0/3025016253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 msgr2=0x7fe0e0061980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 --2- 10.20.193.28:0/3025016253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 0x7fe0e0061980 secure :-1 s=READY pgs=1294 gs=1 cs=0 l=1 c_cookie=11523551042614753510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0c8009950 tx=0x7fe0c802f190 comp rx=0 tx=0).stop 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 -- 10.20.193.28:0/3025016253 shutdown_connections 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 --2- 10.20.193.28:0/3025016253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 0x7fe0e0061980 unknown :-1 s=CLOSED pgs=1294 gs=1 cs=0 l=1 c_cookie=11523551042614753510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 --2- 10.20.193.28:0/3025016253 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0e0150e50 0x7fe0e0171290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 --2- 10.20.193.28:0/3025016253 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0e0062a40 0x7fe0e0060fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 -- 10.20.193.28:0/3025016253 >> 10.20.193.28:0/3025016253 conn(0x7fe0e00ea4c0 msgr2=0x7fe0e010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 -- 10.20.193.28:0/3025016253 shutdown_connections 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.174+0000 7fe0e594b640 1 -- 10.20.193.28:0/3025016253 wait complete. 2026-02-20T13:29:29.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e594b640 1 Processor -- start 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e594b640 1 -- start start 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e594b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 0x7fe0e015c6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e594b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0e0062a40 0x7fe0e015cd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e594b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0e0150e50 0x7fe0e015d900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e594b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e015e040 con 0x7fe0e0061510 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e594b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e015e1b0 con 0x7fe0e0062a40 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e594b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e015e370 con 0x7fe0e0150e50 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 0x7fe0e015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 0x7fe0e015c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45218/0 (socket says 10.20.193.28:45218) 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e4949640 1 -- 10.20.193.28:0/341873632 learned_addr learned my addr 10.20.193.28:0/341873632 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e514a640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0e0150e50 0x7fe0e015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0e0062a40 0x7fe0e015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e4949640 1 -- 10.20.193.28:0/341873632 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0e0150e50 msgr2=0x7fe0e015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e4949640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0e0150e50 0x7fe0e015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e4949640 1 -- 10.20.193.28:0/341873632 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0e0062a40 msgr2=0x7fe0e015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e4949640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0e0062a40 0x7fe0e015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.175+0000 7fe0e4949640 1 -- 10.20.193.28:0/341873632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c8009570 con 0x7fe0e0061510 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.176+0000 7fe0e4949640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 0x7fe0e015c6b0 secure :-1 s=READY pgs=1295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d00072a0 tx=0x7fe0d000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.176+0000 7fe0d5ffb640 1 -- 10.20.193.28:0/341873632 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0d0004500 con 0x7fe0e0061510 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.176+0000 7fe0d5ffb640 1 -- 10.20.193.28:0/341873632 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0d000bd20 con 0x7fe0e0061510 2026-02-20T13:29:29.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.176+0000 7fe0e594b640 1 -- 10.20.193.28:0/341873632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e015e650 con 0x7fe0e0061510 2026-02-20T13:29:29.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.176+0000 7fe0d5ffb640 1 -- 10.20.193.28:0/341873632 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0d0002ea0 con 0x7fe0e0061510 2026-02-20T13:29:29.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.176+0000 7fe0e594b640 1 -- 10.20.193.28:0/341873632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e015ebc0 con 0x7fe0e0061510 2026-02-20T13:29:29.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.179+0000 7fe0d5ffb640 1 -- 10.20.193.28:0/341873632 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe0d000b840 con 0x7fe0e0061510 2026-02-20T13:29:29.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.180+0000 7fe0d5ffb640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe0bc0b56e0 0x7fe0bc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.180+0000 7fe0d5ffb640 1 -- 10.20.193.28:0/341873632 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe0d00e6510 con 0x7fe0e0061510 2026-02-20T13:29:29.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.180+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe0bc0b56e0 0x7fe0bc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e91c4e00 1 Processor -- start 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe0bc0b56e0 0x7fe0bc0d5b90 secure :-1 s=READY pgs=545 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0c8002d80 tx=0x7fe0c803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e91c4e00 1 -- start start 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8ed8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 0x55eb4f90e1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f90e700 0x55eb4f92eae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f7e2fd0 con 0x55eb4f90e700 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f7ded00 con 0x55eb4f8edde0 2026-02-20T13:29:29.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f7d8ca0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e514a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f90e700 0x55eb4f92eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8ed8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42572/0 (socket says 10.20.193.28:42572) 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0e4949640 1 -- 10.20.193.28:0/2576413789 learned_addr learned my addr 10.20.193.28:0/2576413789 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.181+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/2576413789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 0x55eb4f90e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e514a640 1 -- 10.20.193.28:0/2576413789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f8cd4c0 msgr2=0x55eb4f8ed8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e514a640 1 --2- 10.20.193.28:0/2576413789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8ed8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e514a640 1 -- 10.20.193.28:0/2576413789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 msgr2=0x55eb4f90e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e514a640 1 --2- 10.20.193.28:0/2576413789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 0x55eb4f90e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e514a640 1 -- 10.20.193.28:0/2576413789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb4f77b8b0 con 0x55eb4f90e700 2026-02-20T13:29:29.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e514a640 1 --2- 10.20.193.28:0/2576413789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f90e700 0x55eb4f92eae0 secure :-1 s=READY pgs=1296 gs=1 cs=0 l=1 c_cookie=2813656805250806572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0dc003a00 tx=0x7fe0dc003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270c1df4fcd5b32c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0acffe640 1 -- 10.20.193.28:0/2576413789 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0dc011ca0 con 0x55eb4f90e700 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0acffe640 1 -- 10.20.193.28:0/2576413789 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0dc011e00 con 0x55eb4f90e700 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0acffe640 1 -- 10.20.193.28:0/2576413789 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0dc01a960 con 0x55eb4f90e700 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2576413789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f90e700 msgr2=0x55eb4f92eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/2576413789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f90e700 0x55eb4f92eae0 secure :-1 s=READY pgs=1296 gs=1 cs=0 l=1 c_cookie=2813656805250806572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0dc003a00 tx=0x7fe0dc003ed0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2576413789 shutdown_connections 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/2576413789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f90e700 0x55eb4f92eae0 unknown :-1 s=CLOSED pgs=1296 gs=1 cs=0 l=1 c_cookie=2813656805250806572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/2576413789 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 0x55eb4f90e1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/2576413789 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8ed8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2576413789 >> 10.20.193.28:0/2576413789 conn(0x55eb4f7ec1c0 msgr2=0x55eb4f8cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2576413789 shutdown_connections 2026-02-20T13:29:29.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.182+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2576413789 wait complete. 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0e91c4e00 1 -- start start 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0e91c4e00 1 Processor -- start 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e6ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e7120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8e7b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f8e81e0 con 0x55eb4f8edde0 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f8e8350 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f8e8510 con 0x55eb4f90e700 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.184+0000 7fe0d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0e514a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e7120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45234/0 (socket says 10.20.193.28:45234) 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0d7fff640 1 -- 10.20.193.28:0/3985373386 learned_addr learned my addr 10.20.193.28:0/3985373386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0d7fff640 1 -- 10.20.193.28:0/3985373386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 msgr2=0x55eb4f8e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8e7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0d7fff640 1 -- 10.20.193.28:0/3985373386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 msgr2=0x55eb4f8e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0d7fff640 1 -- 10.20.193.28:0/3985373386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb4f784400 con 0x55eb4f8edde0 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e7120 secure :-1 s=READY pgs=1297 gs=1 cs=0 l=1 c_cookie=16385844114696351092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0c802f6a0 tx=0x7fe0c8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36636680966ad74 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0a5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/3985373386 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0c8038d50 con 0x55eb4f8edde0 2026-02-20T13:29:29.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/3985373386 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0c803e040 con 0x55eb4f8edde0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/3985373386 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0c8050800 con 0x55eb4f8edde0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc005510 con 0x55eb4f8edde0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0e91c4e00 10 client.19794 _ll_register_callbacks cb 0x55eb4f763a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.185+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb4f478520 con 0x55eb4f8edde0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/3985373386 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe0c8044410 con 0x55eb4f8edde0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/3985373386 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe0c80445d0 con 0x55eb4f8edde0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e91c4e00 10 client.19794 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55eb4f75cda0 con 0x55eb4f8edde0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/3985373386 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe0c804f070 con 0x55eb4f8edde0 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e91c4e00 10 client.19794 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e91c4e00 10 client.19794 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:29.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e91c4e00 20 client.19794 populate_metadata read hostname 'trial028' 2026-02-20T13:29:29.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb4f8eb1b0 0x55eb4f8eb650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e91c4e00 4 client.19794 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:29.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb4f80a630 con 0x55eb4f8eb1b0 2026-02-20T13:29:29.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.186+0000 7fe0e4949640 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb4f8eb1b0 0x55eb4f8eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.187+0000 7fe0e4949640 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb4f8eb1b0 0x55eb4f8eb650 crc :-1 s=READY pgs=348 gs=4 cs=0 l=0 c_cookie=9357271116783173475 s_cookie=8719254612014023032 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81dbb480f6e23f63 server_cookie=790103df7f484178 in_seq=0 out_seq=0 2026-02-20T13:29:29.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.187+0000 7fe0a5ffb640 10 client.19794 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:29.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/3985373386 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55eb4f80a630 con 0x55eb4f8eb1b0 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0a5ffb640 10 client.19794 handle_command_reply: tid=0 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 client.19794 shutdown 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 msgr2=0x55eb4f8e7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e7120 secure :-1 s=READY pgs=1297 gs=1 cs=0 l=1 c_cookie=16385844114696351092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0c802f6a0 tx=0x7fe0c8009310 comp rx=0 tx=0).stop 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 shutdown_connections 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb4f8eb1b0 0x55eb4f8eb650 crc :-1 s=READY pgs=348 gs=4 cs=0 l=0 c_cookie=9357271116783173475 s_cookie=8719254612014023032 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e7120 unknown :-1 s=CLOSED pgs=1297 gs=1 cs=0 l=1 c_cookie=16385844114696351092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8e7b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/3985373386 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e6ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0a5ffb640 0 client.19794 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 >> 10.20.193.28:0/3985373386 conn(0x55eb4f7ec1c0 msgr2=0x55eb4f8ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:29.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 shutdown_connections 2026-02-20T13:29:29.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/3985373386 wait complete. 2026-02-20T13:29:29.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.188+0000 7fe0e91c4e00 20 client.19794 trim_cache size 0 max 16384 2026-02-20T13:29:29.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e91c4e00 1 Processor -- start 2026-02-20T13:29:29.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e91c4e00 1 -- start start 2026-02-20T13:29:29.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e7070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e3e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8e4340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f7d68d0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f517f10 con 0x55eb4f8edde0 2026-02-20T13:29:29.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f8d4020 con 0x55eb4f90e700 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e7070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45240/0 (socket says 10.20.193.28:45240) 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 -- 10.20.193.28:0/2901675503 learned_addr learned my addr 10.20.193.28:0/2901675503 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e514a640 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8e4340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 -- 10.20.193.28:0/2901675503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 msgr2=0x55eb4f8e4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8e4340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 -- 10.20.193.28:0/2901675503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 msgr2=0x55eb4f8e3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 -- 10.20.193.28:0/2901675503 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb4f76e670 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0e4949640 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e7070 secure :-1 s=READY pgs=1298 gs=2 cs=0 l=1 c_cookie=8904101836660062195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d00a9b90 tx=0x7fe0d00e3f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b91b971ca06b7f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0a7fff640 1 -- 10.20.193.28:0/2901675503 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0d00b4b70 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0a7fff640 1 -- 10.20.193.28:0/2901675503 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0d00b79b0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.196+0000 7fe0a7fff640 1 -- 10.20.193.28:0/2901675503 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0d00e60c0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2901675503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8cd4c0 msgr2=0x55eb4f8e7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e7070 secure :-1 s=READY pgs=1298 gs=2 cs=0 l=1 c_cookie=8904101836660062195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d00a9b90 tx=0x7fe0d00e3f40 comp rx=0 tx=0).stop 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2901675503 shutdown_connections 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8e4340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8edde0 0x55eb4f8e3e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/2901675503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8e7070 unknown :-1 s=CLOSED pgs=1298 gs=2 cs=0 l=1 c_cookie=8904101836660062195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2901675503 >> 10.20.193.28:0/2901675503 conn(0x55eb4f7ec1c0 msgr2=0x55eb4f8e6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2901675503 shutdown_connections 2026-02-20T13:29:29.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/2901675503 wait complete. 2026-02-20T13:29:29.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 -- start start 2026-02-20T13:29:29.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.197+0000 7fe0e91c4e00 1 Processor -- start 2026-02-20T13:29:29.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8f0760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8f0e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e91c4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8ef4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f8efb40 con 0x55eb4f8edde0 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f8efcb0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e91c4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f8efe70 con 0x55eb4f90e700 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:53328/0 (socket says 10.20.193.28:53328) 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 -- 10.20.193.28:0/129950357 learned_addr learned my addr 10.20.193.28:0/129950357 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e514a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 -- 10.20.193.28:0/129950357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 msgr2=0x55eb4f8ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 -- 10.20.193.28:0/129950357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 msgr2=0x55eb4f8f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:29.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 -- 10.20.193.28:0/129950357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb4f7690f0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0e4949640 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8f0760 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=6583254743221671883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d00040a0 tx=0x7fe0d0002b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b5c6b4f33a217cb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.198+0000 7fe0a5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/129950357 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0d00e4150 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/129950357 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0d00b4b70 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e015ebc0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 10 client.29741 _ll_register_callbacks cb 0x55eb4f763a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb4f888ca0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/129950357 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0d00b7740 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/129950357 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe0d00ac710 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/129950357 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe0d00d0120 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 10 client.29741 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55eb4f75d0d0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/129950357 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe0d001f2a0 con 0x55eb4f8cd4c0 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 10 client.29741 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 10 client.29741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 20 client.29741 populate_metadata read hostname 'trial028' 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb4f8f2c70 0x55eb4f8f3110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:29.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 4 client.29741 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:29:29.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb4f4bc640 con 0x55eb4f8f2c70 2026-02-20T13:29:29.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.199+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb4f8f2c70 0x55eb4f8f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:29.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.200+0000 7fe0a5ffb640 10 client.29741 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:29.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.200+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb4f8f2c70 0x55eb4f8f3110 crc :-1 s=READY pgs=349 gs=4 cs=0 l=0 c_cookie=2634409980463968186 s_cookie=7094445203472485946 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=248f4deb664c6fba server_cookie=6274885317738e3a in_seq=0 out_seq=0 2026-02-20T13:29:29.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0a5ffb640 1 -- 10.20.193.28:0/129950357 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb4f4bc640 con 0x55eb4f8f2c70 2026-02-20T13:29:29.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0a5ffb640 10 client.29741 handle_command_reply: tid=0 2026-02-20T13:29:29.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 client.29741 shutdown 2026-02-20T13:29:29.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 msgr2=0x55eb4f8f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8f0760 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=6583254743221671883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d00040a0 tx=0x7fe0d0002b30 comp rx=0 tx=0).stop 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 shutdown_connections 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55eb4f8f2c70 0x55eb4f8f3110 crc :-1 s=READY pgs=349 gs=4 cs=0 l=0 c_cookie=2634409980463968186 s_cookie=7094445203472485946 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eb4f8edde0 0x55eb4f8f0e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55eb4f90e700 0x55eb4f8ef4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 --2- 10.20.193.28:0/129950357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55eb4f8cd4c0 0x55eb4f8f0760 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=6583254743221671883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0a5ffb640 0 client.29741 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 >> 10.20.193.28:0/129950357 conn(0x55eb4f7ec1c0 msgr2=0x55eb4f8e2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 shutdown_connections 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 1 -- 10.20.193.28:0/129950357 wait complete. 2026-02-20T13:29:29.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e91c4e00 20 client.29741 trim_cache size 0 max 16384 2026-02-20T13:29:29.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:29:29.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:29:29.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:29:29.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:29:29.213 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e594b640 1 -- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe0bc0b56e0 msgr2=0x7fe0bc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.213 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e594b640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe0bc0b56e0 0x7fe0bc0d5b90 secure :-1 s=READY pgs=545 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0c8002d80 tx=0x7fe0c803a040 comp rx=0 tx=0).stop 2026-02-20T13:29:29.213 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e594b640 1 -- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 msgr2=0x7fe0e015c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:29.213 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.204+0000 7fe0e594b640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 0x7fe0e015c6b0 secure :-1 s=READY pgs=1295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d00072a0 tx=0x7fe0d000ddf0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.213 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.205+0000 7fe0e594b640 1 -- 10.20.193.28:0/341873632 shutdown_connections 2026-02-20T13:29:29.213 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.205+0000 7fe0e594b640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe0bc0b56e0 0x7fe0bc0d5b90 unknown :-1 s=CLOSED pgs=545 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.213 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.205+0000 7fe0e594b640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0e0150e50 0x7fe0e015d900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.213 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.205+0000 7fe0e594b640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe0e0062a40 0x7fe0e015cd00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.214 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.205+0000 7fe0e594b640 1 --2- 10.20.193.28:0/341873632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0e0061510 0x7fe0e015c6b0 unknown :-1 s=CLOSED pgs=1295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:29.214 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.205+0000 7fe0e594b640 1 -- 10.20.193.28:0/341873632 >> 10.20.193.28:0/341873632 conn(0x7fe0e00ea4c0 msgr2=0x7fe0e010a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:29.214 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.205+0000 7fe0e594b640 1 -- 10.20.193.28:0/341873632 shutdown_connections 2026-02-20T13:29:29.214 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:29.205+0000 7fe0e594b640 1 -- 10.20.193.28:0/341873632 wait complete. 2026-02-20T13:29:30.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:30 trial028 ceph-mon[37442]: pgmap v546: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2026-02-20T13:29:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:30 trial127 ceph-mon[43817]: pgmap v546: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2026-02-20T13:29:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:30 trial034 ceph-mon[43332]: pgmap v546: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2026-02-20T13:29:32.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:32 trial028 ceph-mon[37442]: pgmap v547: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2026-02-20T13:29:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:32 trial127 ceph-mon[43817]: pgmap v547: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2026-02-20T13:29:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:32 trial034 ceph-mon[43332]: pgmap v547: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2026-02-20T13:29:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:34 trial028 ceph-mon[37442]: pgmap v548: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.3 KiB/s wr, 17 op/s 2026-02-20T13:29:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:34 trial127 ceph-mon[43817]: pgmap v548: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.3 KiB/s wr, 17 op/s 2026-02-20T13:29:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:34 trial034 ceph-mon[43332]: pgmap v548: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.3 KiB/s wr, 17 op/s 2026-02-20T13:29:36.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:36 trial028 ceph-mon[37442]: pgmap v549: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:29:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:36 trial127 ceph-mon[43817]: pgmap v549: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:29:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:36 trial034 ceph-mon[43332]: pgmap v549: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:29:38.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:38 trial028 ceph-mon[37442]: pgmap v550: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:38 trial127 ceph-mon[43817]: pgmap v550: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:38 trial034 ceph-mon[43332]: pgmap v550: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:39.292 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:29:39.479 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:39.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 -- 10.20.193.28:0/588400893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468060010 msgr2=0x7f64680603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 --2- 10.20.193.28:0/588400893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468060010 0x7f64680603e0 secure :-1 s=READY pgs=1299 gs=2 cs=0 l=1 c_cookie=9531832179333797826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6454009950 tx=0x7f645402f190 comp rx=0 tx=0).stop 2026-02-20T13:29:39.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 -- 10.20.193.28:0/588400893 shutdown_connections 2026-02-20T13:29:39.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 --2- 10.20.193.28:0/588400893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6468113000 0x7f64681739d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 --2- 10.20.193.28:0/588400893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6468060a00 0x7f6468112850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 --2- 10.20.193.28:0/588400893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468060010 0x7f64680603e0 unknown :-1 s=CLOSED pgs=1299 gs=2 cs=0 l=1 c_cookie=9531832179333797826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 -- 10.20.193.28:0/588400893 >> 10.20.193.28:0/588400893 conn(0x7f64680e95a0 msgr2=0x7f64681099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:39.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 -- 10.20.193.28:0/588400893 shutdown_connections 2026-02-20T13:29:39.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 -- 10.20.193.28:0/588400893 wait complete. 2026-02-20T13:29:39.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.656+0000 7f646d7a9640 1 Processor -- start 2026-02-20T13:29:39.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646d7a9640 1 -- start start 2026-02-20T13:29:39.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646d7a9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6468060010 0x7f646810ba80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646d7a9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6468060a00 0x7f646810bfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646d7a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468113000 0x7f646810c500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646d7a9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6468163aa0 con 0x7f6468113000 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646d7a9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6468163c10 con 0x7f6468060010 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646d7a9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6468163dd0 con 0x7f6468060a00 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f6467fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6468060010 0x7f646810ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646cfa8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468113000 0x7f646810c500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f6467fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6468060010 0x7f646810ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54620/0 (socket says 10.20.193.28:54620) 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f6467fff640 1 -- 10.20.193.28:0/3868645282 learned_addr learned my addr 10.20.193.28:0/3868645282 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f64677fe640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6468060a00 0x7f646810bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646cfa8640 1 -- 10.20.193.28:0/3868645282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6468060a00 msgr2=0x7f646810bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646cfa8640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6468060a00 0x7f646810bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646cfa8640 1 -- 10.20.193.28:0/3868645282 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6468060010 msgr2=0x7f646810ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646cfa8640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6468060010 0x7f646810ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f646cfa8640 1 -- 10.20.193.28:0/3868645282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6454009570 con 0x7f6468113000 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.657+0000 7f6467fff640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6468060010 0x7f646810ba80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.658+0000 7f646cfa8640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468113000 0x7f646810c500 secure :-1 s=READY pgs=1300 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f645c00f940 tx=0x7f645c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.658+0000 7f64657fa640 1 -- 10.20.193.28:0/3868645282 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f645c00dce0 con 0x7f6468113000 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.658+0000 7f64657fa640 1 -- 10.20.193.28:0/3868645282 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f645c00de40 con 0x7f6468113000 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.658+0000 7f64657fa640 1 -- 10.20.193.28:0/3868645282 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f645c0116b0 con 0x7f6468113000 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.658+0000 7f646d7a9640 1 -- 10.20.193.28:0/3868645282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64681640b0 con 0x7f6468113000 2026-02-20T13:29:39.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.658+0000 7f646d7a9640 1 -- 10.20.193.28:0/3868645282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6468164530 con 0x7f6468113000 2026-02-20T13:29:39.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.661+0000 7f64657fa640 1 -- 10.20.193.28:0/3868645282 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f645c020060 con 0x7f6468113000 2026-02-20T13:29:39.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.663+0000 7f64657fa640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f643c0b5760 0x7f643c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.663+0000 7f64657fa640 1 -- 10.20.193.28:0/3868645282 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f645c015070 con 0x7f6468113000 2026-02-20T13:29:39.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.663+0000 7f6467fff640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f643c0b5760 0x7f643c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.663+0000 7f6470a2ce00 1 Processor -- start 2026-02-20T13:29:39.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.663+0000 7f6470a2ce00 1 -- start start 2026-02-20T13:29:39.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f643c0b5760 0x7f643c0d5c10 secure :-1 s=READY pgs=547 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64540023d0 tx=0x7f6454031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51180 0x55e82dd51550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51a90 0x55e82dd96400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd96940 0x55e82ddb6d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e82dc677d0 con 0x55e82dd51180 2026-02-20T13:29:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e82dc63500 con 0x55e82dd51a90 2026-02-20T13:29:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e82dc5d4a0 con 0x55e82dd96940 2026-02-20T13:29:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51180 0x55e82dd51550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51180 0x55e82dd51550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50524/0 (socket says 10.20.193.28:50524) 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 -- 10.20.193.28:0/3855142334 learned_addr learned my addr 10.20.193.28:0/3855142334 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f64677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51a90 0x55e82dd96400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f646cfa8640 1 --2- 10.20.193.28:0/3855142334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd96940 0x55e82ddb6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 -- 10.20.193.28:0/3855142334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd96940 msgr2=0x55e82ddb6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 --2- 10.20.193.28:0/3855142334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd96940 0x55e82ddb6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 -- 10.20.193.28:0/3855142334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51a90 msgr2=0x55e82dd96400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 --2- 10.20.193.28:0/3855142334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51a90 0x55e82dd96400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 -- 10.20.193.28:0/3855142334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82dc08d80 con 0x55e82dd51180 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.664+0000 7f6467fff640 1 --2- 10.20.193.28:0/3855142334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51180 0x55e82dd51550 secure :-1 s=READY pgs=1301 gs=1 cs=0 l=1 c_cookie=4480668209792143728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6454005b00 tx=0x7f6454040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2e87ff490bd170 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6438ce3640 1 -- 10.20.193.28:0/3855142334 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f645402f9f0 con 0x55e82dd51180 2026-02-20T13:29:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6438ce3640 1 -- 10.20.193.28:0/3855142334 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6454038e00 con 0x55e82dd51180 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6438ce3640 1 -- 10.20.193.28:0/3855142334 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f645404fa80 con 0x55e82dd51180 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 -- 10.20.193.28:0/3855142334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51180 msgr2=0x55e82dd51550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/3855142334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51180 0x55e82dd51550 secure :-1 s=READY pgs=1301 gs=1 cs=0 l=1 c_cookie=4480668209792143728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6454005b00 tx=0x7f6454040000 comp rx=0 tx=0).stop 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 -- 10.20.193.28:0/3855142334 shutdown_connections 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/3855142334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd96940 0x55e82ddb6d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/3855142334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51a90 0x55e82dd96400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/3855142334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51180 0x55e82dd51550 unknown :-1 s=CLOSED pgs=1301 gs=1 cs=0 l=1 c_cookie=4480668209792143728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 -- 10.20.193.28:0/3855142334 >> 10.20.193.28:0/3855142334 conn(0x55e82dd2f680 msgr2=0x55e82dd4fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 -- 10.20.193.28:0/3855142334 shutdown_connections 2026-02-20T13:29:39.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.665+0000 7f6470a2ce00 1 -- 10.20.193.28:0/3855142334 wait complete. 2026-02-20T13:29:39.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6470a2ce00 1 -- start start 2026-02-20T13:29:39.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6470a2ce00 1 Processor -- start 2026-02-20T13:29:39.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51180 0x55e82ddae120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51a90 0x55e82ddae660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd96940 0x55e82ddb3650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e82ddb3b90 con 0x55e82dd96940 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e82ddb3d00 con 0x55e82dd51180 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e82ddb3ec0 con 0x55e82dd51a90 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f646cfa8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd96940 0x55e82ddb3650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f6467fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51180 0x55e82ddae120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f646cfa8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd96940 0x55e82ddb3650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50534/0 (socket says 10.20.193.28:50534) 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.667+0000 7f646cfa8640 1 -- 10.20.193.28:0/119620354 learned_addr learned my addr 10.20.193.28:0/119620354 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f646cfa8640 1 -- 10.20.193.28:0/119620354 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51a90 msgr2=0x55e82ddae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:39.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f646cfa8640 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51a90 0x55e82ddae660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f646cfa8640 1 -- 10.20.193.28:0/119620354 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51180 msgr2=0x55e82ddae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f646cfa8640 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51180 0x55e82ddae120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f646cfa8640 1 -- 10.20.193.28:0/119620354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82dbe1350 con 0x55e82dd96940 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f646cfa8640 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd96940 0x55e82ddb3650 secure :-1 s=READY pgs=1302 gs=2 cs=0 l=1 c_cookie=12226503913048236263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f645c0a98f0 tx=0x7f645c0ad8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ad4487b629e0e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6429ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6429ffb640 1 -- 10.20.193.28:0/119620354 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f645c0b6310 con 0x55e82dd96940 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6429ffb640 1 -- 10.20.193.28:0/119620354 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f645c097040 con 0x55e82dd96940 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6468174240 con 0x55e82dd96940 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6429ffb640 1 -- 10.20.193.28:0/119620354 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f645c0b8cc0 con 0x55e82dd96940 2026-02-20T13:29:39.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6470a2ce00 10 client.19812 _ll_register_callbacks cb 0x55e82dbde9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e82d8f36f0 con 0x55e82dd96940 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6429ffb640 1 -- 10.20.193.28:0/119620354 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f645c0b8e50 con 0x55e82dd96940 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6429ffb640 1 -- 10.20.193.28:0/119620354 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f645c0731a0 con 0x55e82dd96940 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6470a2ce00 10 client.19812 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e82dbf3150 con 0x55e82dd96940 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6429ffb640 1 -- 10.20.193.28:0/119620354 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f645c0adbb0 con 0x55e82dd96940 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6470a2ce00 10 client.19812 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.668+0000 7f6470a2ce00 10 client.19812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.669+0000 7f6470a2ce00 20 client.19812 populate_metadata read hostname 'trial028' 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.669+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e82dd93a00 0x55e82dd93ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.669+0000 7f6470a2ce00 4 client.19812 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.669+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e82dc6ad60 con 0x55e82dd93a00 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.669+0000 7f6467fff640 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e82dd93a00 0x55e82dd93ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.669+0000 7f6467fff640 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e82dd93a00 0x55e82dd93ea0 crc :-1 s=READY pgs=350 gs=4 cs=0 l=0 c_cookie=13820192200293094307 s_cookie=14980151319974321872 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfcb2f956a1813a3 server_cookie=cfe43041dcab1ed0 in_seq=0 out_seq=0 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.669+0000 7f6429ffb640 10 client.19812 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6429ffb640 1 -- 10.20.193.28:0/119620354 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e82dc6ad60 con 0x55e82dd93a00 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6429ffb640 10 client.19812 handle_command_reply: tid=0 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 client.19812 shutdown 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd96940 msgr2=0x55e82ddb3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd96940 0x55e82ddb3650 secure :-1 s=READY pgs=1302 gs=2 cs=0 l=1 c_cookie=12226503913048236263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f645c0a98f0 tx=0x7f645c0ad8e0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 shutdown_connections 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e82dd93a00 0x55e82dd93ea0 crc :-1 s=READY pgs=350 gs=4 cs=0 l=0 c_cookie=13820192200293094307 s_cookie=14980151319974321872 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd96940 0x55e82ddb3650 unknown :-1 s=CLOSED pgs=1302 gs=2 cs=0 l=1 c_cookie=12226503913048236263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51a90 0x55e82ddae660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/119620354 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd51180 0x55e82ddae120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 >> 10.20.193.28:0/119620354 conn(0x55e82dd2f680 msgr2=0x55e82dd4fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:39.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6429ffb640 0 client.19812 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:39.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 shutdown_connections 2026-02-20T13:29:39.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 1 -- 10.20.193.28:0/119620354 wait complete. 2026-02-20T13:29:39.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.670+0000 7f6470a2ce00 20 client.19812 trim_cache size 0 max 16384 2026-02-20T13:29:39.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.680+0000 7f6470a2ce00 1 Processor -- start 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.680+0000 7f6470a2ce00 1 -- start start 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 0x55e82ddab520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82ddaba60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd95570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e82dc5b0d0 con 0x55e82dd51a90 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e82d91b700 con 0x55e82dd96940 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e82ddb5350 con 0x55e82dd51180 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82ddaba60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82ddaba60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50550/0 (socket says 10.20.193.28:50550) 2026-02-20T13:29:39.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 -- 10.20.193.28:0/2893148650 learned_addr learned my addr 10.20.193.28:0/2893148650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f6467fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 0x55e82ddab520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f646cfa8640 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd95570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 -- 10.20.193.28:0/2893148650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 msgr2=0x55e82ddab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 0x55e82ddab520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 -- 10.20.193.28:0/2893148650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 msgr2=0x55e82dd95570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd95570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 -- 10.20.193.28:0/2893148650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82dda08f0 con 0x55e82dd51a90 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f646cfa8640 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd95570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:39.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.681+0000 7f64677fe640 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82ddaba60 secure :-1 s=READY pgs=1303 gs=1 cs=0 l=1 c_cookie=13922462839860146317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6458004560 tx=0x7f6458009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13686304070b08d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:39.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f642bfff640 1 -- 10.20.193.28:0/2893148650 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6458016070 con 0x55e82dd51a90 2026-02-20T13:29:39.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f642bfff640 1 -- 10.20.193.28:0/2893148650 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6458002d20 con 0x55e82dd51a90 2026-02-20T13:29:39.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f642bfff640 1 -- 10.20.193.28:0/2893148650 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f645800e930 con 0x55e82dd51a90 2026-02-20T13:29:39.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 -- 10.20.193.28:0/2893148650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 msgr2=0x55e82ddaba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82ddaba60 secure :-1 s=READY pgs=1303 gs=1 cs=0 l=1 c_cookie=13922462839860146317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6458004560 tx=0x7f6458009c80 comp rx=0 tx=0).stop 2026-02-20T13:29:39.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 -- 10.20.193.28:0/2893148650 shutdown_connections 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82ddaba60 unknown :-1 s=CLOSED pgs=1303 gs=1 cs=0 l=1 c_cookie=13922462839860146317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd95570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/2893148650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 0x55e82ddab520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 -- 10.20.193.28:0/2893148650 >> 10.20.193.28:0/2893148650 conn(0x55e82dd2f680 msgr2=0x55e82dd93a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 -- 10.20.193.28:0/2893148650 shutdown_connections 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.682+0000 7f6470a2ce00 1 -- 10.20.193.28:0/2893148650 wait complete. 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6470a2ce00 1 -- start start 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6470a2ce00 1 Processor -- start 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 0x55e82dd354f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82dd30d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6470a2ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd312c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e82dd2c100 con 0x55e82dd51a90 2026-02-20T13:29:39.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55e82dd31860 con 0x55e82dd96940 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6470a2ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55e82dd31a20 con 0x55e82dd51180 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f64677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82dd30d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f6467fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 0x55e82dd354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f646cfa8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f64677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82dd30d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50564/0 (socket says 10.20.193.28:50564) 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.683+0000 7f64677fe640 1 -- 10.20.193.28:0/612724761 learned_addr learned my addr 10.20.193.28:0/612724761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f64677fe640 1 -- 10.20.193.28:0/612724761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 msgr2=0x55e82dd354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f64677fe640 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 0x55e82dd354f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f64677fe640 1 -- 10.20.193.28:0/612724761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 msgr2=0x55e82dd312c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f64677fe640 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd312c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f64677fe640 1 -- 10.20.193.28:0/612724761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82dbedbd0 con 0x55e82dd51a90 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f64677fe640 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82dd30d80 secure :-1 s=READY pgs=1304 gs=1 cs=0 l=1 c_cookie=4354489973818008388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6458002390 tx=0x7f6458010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6e418f636c2344 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:39.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6429ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6429ffb640 1 -- 10.20.193.28:0/612724761 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6458016070 con 0x55e82dd51a90 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6429ffb640 1 -- 10.20.193.28:0/612724761 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6458002e90 con 0x55e82dd51a90 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6458004200 con 0x55e82dd51a90 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6429ffb640 1 -- 10.20.193.28:0/612724761 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6458010ab0 con 0x55e82dd51a90 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6470a2ce00 10 client.19818 _ll_register_callbacks cb 0x55e82dbde9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6454038e00 con 0x55e82dd51a90 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6429ffb640 1 -- 10.20.193.28:0/612724761 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f64580046e0 con 0x55e82dd51a90 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6429ffb640 1 -- 10.20.193.28:0/612724761 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6458004900 con 0x55e82dd51a90 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6470a2ce00 10 client.19818 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.684+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e82dbe1680 con 0x55e82dd51a90 2026-02-20T13:29:39.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6429ffb640 1 -- 10.20.193.28:0/612724761 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f645801b420 con 0x55e82dd51a90 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6470a2ce00 10 client.19818 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6470a2ce00 10 client.19818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6470a2ce00 20 client.19818 populate_metadata read hostname 'trial028' 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e82de43ee0 0x55e82de64390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6470a2ce00 4 client.19818 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e82d8f0f40 con 0x55e82de43ee0 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6467fff640 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e82de43ee0 0x55e82de64390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6467fff640 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e82de43ee0 0x55e82de64390 crc :-1 s=READY pgs=351 gs=4 cs=0 l=0 c_cookie=4749057024615815062 s_cookie=5238554272814272121 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e80a33ca4c9796 server_cookie=48b3155b27b30e79 in_seq=0 out_seq=0 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.685+0000 7f6429ffb640 10 client.19818 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6429ffb640 1 -- 10.20.193.28:0/612724761 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x55e82d8f0f40 con 0x55e82de43ee0 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6429ffb640 10 client.19818 handle_command_reply: tid=0 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 client.19818 shutdown 2026-02-20T13:29:39.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 msgr2=0x55e82dd30d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82dd30d80 secure :-1 s=READY pgs=1304 gs=1 cs=0 l=1 c_cookie=4354489973818008388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6458002390 tx=0x7f6458010cf0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 shutdown_connections 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55e82de43ee0 0x55e82de64390 crc :-1 s=READY pgs=351 gs=4 cs=0 l=0 c_cookie=4749057024615815062 s_cookie=5238554272814272121 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e82dd51a90 0x55e82dd30d80 unknown :-1 s=CLOSED pgs=1304 gs=1 cs=0 l=1 c_cookie=4354489973818008388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55e82dd96940 0x55e82dd312c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 --2- 10.20.193.28:0/612724761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55e82dd51180 0x55e82dd354f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6429ffb640 0 client.19818 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 >> 10.20.193.28:0/612724761 conn(0x55e82dd2f680 msgr2=0x55e82ddaa510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 shutdown_connections 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 1 -- 10.20.193.28:0/612724761 wait complete. 2026-02-20T13:29:39.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.686+0000 7f6470a2ce00 20 client.19818 trim_cache size 0 max 16384 2026-02-20T13:29:39.695 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:29:39.695 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:29:39.695 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:29:39.695 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:29:39.695 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.696 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.698 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:29:39.699 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.700 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.701 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.702 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.703 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.705 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.706 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:29:39.707 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:39.708 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 -- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f643c0b5760 msgr2=0x7f643c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f643c0b5760 0x7f643c0d5c10 secure :-1 s=READY pgs=547 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64540023d0 tx=0x7f6454031040 comp rx=0 tx=0).stop 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 -- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468113000 msgr2=0x7f646810c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468113000 0x7f646810c500 secure :-1 s=READY pgs=1300 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f645c00f940 tx=0x7f645c00fe10 comp rx=0 tx=0).stop 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 -- 10.20.193.28:0/3868645282 shutdown_connections 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f643c0b5760 0x7f643c0d5c10 unknown :-1 s=CLOSED pgs=547 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6468113000 0x7f646810c500 unknown :-1 s=CLOSED pgs=1300 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6468060a00 0x7f646810bfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 --2- 10.20.193.28:0/3868645282 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6468060010 0x7f646810ba80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:39.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 -- 10.20.193.28:0/3868645282 >> 10.20.193.28:0/3868645282 conn(0x7f64680e95a0 msgr2=0x7f6468109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:39.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 -- 10.20.193.28:0/3868645282 shutdown_connections 2026-02-20T13:29:39.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:39.687+0000 7f646d7a9640 1 -- 10.20.193.28:0/3868645282 wait complete. 2026-02-20T13:29:39.831 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:29:39.831 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:29:40.015 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:40.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 -- 10.20.193.28:0/3804338753 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7c010d240 msgr2=0x7fe7c010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/3804338753 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7c010d240 0x7fe7c010d610 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=11757077481112302479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7b0009950 tx=0x7fe7b002f190 comp rx=0 tx=0).stop 2026-02-20T13:29:40.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 -- 10.20.193.28:0/3804338753 shutdown_connections 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/3804338753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7c0113430 0x7fe7c0173e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/3804338753 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7c010dc30 0x7fe7c0112c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/3804338753 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7c010d240 0x7fe7c010d610 unknown :-1 s=CLOSED pgs=453 gs=1 cs=0 l=1 c_cookie=11757077481112302479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 -- 10.20.193.28:0/3804338753 >> 10.20.193.28:0/3804338753 conn(0x7fe7c00eaad0 msgr2=0x7fe7c010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 -- 10.20.193.28:0/3804338753 shutdown_connections 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.185+0000 7fe7c72bf640 1 -- 10.20.193.28:0/3804338753 wait complete. 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.186+0000 7fe7c72bf640 1 Processor -- start 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.186+0000 7fe7c72bf640 1 -- start start 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.186+0000 7fe7c72bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7c010d240 0x7fe7c011a890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.186+0000 7fe7c72bf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7c010dc30 0x7fe7c011add0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.186+0000 7fe7c72bf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7c0113430 0x7fe7c01201a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.186+0000 7fe7c72bf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c01207c0 con 0x7fe7c010d240 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.186+0000 7fe7c72bf640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0120930 con 0x7fe7c010dc30 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.186+0000 7fe7c72bf640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0120af0 con 0x7fe7c0113430 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7c010d240 0x7fe7c011a890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7c010d240 0x7fe7c011a890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54734/0 (socket says 10.20.193.28:54734) 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 -- 10.20.193.28:0/1340799113 learned_addr learned my addr 10.20.193.28:0/1340799113 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c6abe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7c0113430 0x7fe7c01201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c5abc640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7c010dc30 0x7fe7c011add0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 -- 10.20.193.28:0/1340799113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7c0113430 msgr2=0x7fe7c01201a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7c0113430 0x7fe7c01201a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 -- 10.20.193.28:0/1340799113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7c010dc30 msgr2=0x7fe7c011add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7c010dc30 0x7fe7c011add0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 -- 10.20.193.28:0/1340799113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b0009570 con 0x7fe7c010d240 2026-02-20T13:29:40.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c62bd640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7c010d240 0x7fe7c011a890 secure :-1 s=READY pgs=1305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7b00023d0 tx=0x7fe7b0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:40.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7a77fe640 1 -- 10.20.193.28:0/1340799113 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7b00026a0 con 0x7fe7c010d240 2026-02-20T13:29:40.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7a77fe640 1 -- 10.20.193.28:0/1340799113 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7b0002800 con 0x7fe7c010d240 2026-02-20T13:29:40.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7a77fe640 1 -- 10.20.193.28:0/1340799113 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7b004b690 con 0x7fe7c010d240 2026-02-20T13:29:40.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c0120d70 con 0x7fe7c010d240 2026-02-20T13:29:40.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.187+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c0176b00 con 0x7fe7c010d240 2026-02-20T13:29:40.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.188+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c010e520 con 0x7fe7c010d240 2026-02-20T13:29:40.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.190+0000 7fe7a77fe640 1 -- 10.20.193.28:0/1340799113 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe7b0002970 con 0x7fe7c010d240 2026-02-20T13:29:40.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.192+0000 7fe7a77fe640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe79c0b5760 0x7fe79c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.192+0000 7fe7a77fe640 1 -- 10.20.193.28:0/1340799113 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe7b0114060 con 0x7fe7c010d240 2026-02-20T13:29:40.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.192+0000 7fe7c5abc640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe79c0b5760 0x7fe79c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.193+0000 7fe7c5abc640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe79c0b5760 0x7fe79c0d5c10 secure :-1 s=READY pgs=548 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7c0121230 tx=0x7fe7b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:40.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.194+0000 7fe7a77fe640 1 -- 10.20.193.28:0/1340799113 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe7b00d6a10 con 0x7fe7c010d240 2026-02-20T13:29:40.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.333+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7c011b9f0 con 0x7fe7c010d240 2026-02-20T13:29:40.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.333+0000 7fe7a77fe640 1 -- 10.20.193.28:0/1340799113 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11997 (secure 0 0 0) 0x7fe7b0038e60 con 0x7fe7c010d240 2026-02-20T13:29:40.335 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:29:40.335 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T13:28:03:632229+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:28:03.346734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[3],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:29:40.336 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T13:29:40.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe79c0b5760 msgr2=0x7fe79c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe79c0b5760 0x7fe79c0d5c10 secure :-1 s=READY pgs=548 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7c0121230 tx=0x7fe7b4005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:40.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7c010d240 msgr2=0x7fe7c011a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7c010d240 0x7fe7c011a890 secure :-1 s=READY pgs=1305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7b00023d0 tx=0x7fe7b0004290 comp rx=0 tx=0).stop 2026-02-20T13:29:40.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 shutdown_connections 2026-02-20T13:29:40.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe79c0b5760 0x7fe79c0d5c10 unknown :-1 s=CLOSED pgs=548 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7c0113430 0x7fe7c01201a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7c010dc30 0x7fe7c011add0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 --2- 10.20.193.28:0/1340799113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe7c010d240 0x7fe7c011a890 unknown :-1 s=CLOSED pgs=1305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 >> 10.20.193.28:0/1340799113 conn(0x7fe7c00eaad0 msgr2=0x7fe7c010aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:40.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.334+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 shutdown_connections 2026-02-20T13:29:40.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.335+0000 7fe7c72bf640 1 -- 10.20.193.28:0/1340799113 wait complete. 2026-02-20T13:29:40.437 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:29:40.621 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:40.668 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:40 trial028 ceph-mon[37442]: pgmap v551: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:29:40.668 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:40 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1340799113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1645382164 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 msgr2=0x7f95b410be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1645382164 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 0x7f95b410be50 secure :-1 s=READY pgs=454 gs=2 cs=0 l=1 c_cookie=17873017848356198260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a8009980 tx=0x7f95a802f190 comp rx=0 tx=0).stop 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1645382164 shutdown_connections 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1645382164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95b410c470 0x7f95b4110a40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1645382164 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95b4111060 0x7f95b4111500 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1645382164 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 0x7f95b410be50 unknown :-1 s=CLOSED pgs=454 gs=2 cs=0 l=1 c_cookie=17873017848356198260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1645382164 >> 10.20.193.28:0/1645382164 conn(0x7f95b40e96b0 msgr2=0x7f95b4109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1645382164 shutdown_connections 2026-02-20T13:29:40.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.796+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1645382164 wait complete. 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.797+0000 7f95b9a5d640 1 Processor -- start 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.797+0000 7f95b9a5d640 1 -- start start 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.797+0000 7f95b9a5d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 0x7f95b4121a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.797+0000 7f95b9a5d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95b410c470 0x7f95b4121f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b9a5d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95b4111060 0x7f95b4127340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b9a5d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f95b4127960 con 0x7f95b4111060 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b9a5d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f95b4127ad0 con 0x7f95b410ba80 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b9a5d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f95b4127c90 con 0x7f95b410c470 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b2ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 0x7f95b4121a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95b4111060 0x7f95b4127340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b27fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95b410c470 0x7f95b4121f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b2ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 0x7f95b4121a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:37944/0 (socket says 10.20.193.28:37944) 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b2ffd640 1 -- 10.20.193.28:0/1780481207 learned_addr learned my addr 10.20.193.28:0/1780481207 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b2ffd640 1 -- 10.20.193.28:0/1780481207 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95b410c470 msgr2=0x7f95b4121f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95b410c470 0x7f95b4121f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b2ffd640 1 -- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95b4111060 msgr2=0x7f95b4127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95b4111060 0x7f95b4127340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b2ffd640 1 -- 10.20.193.28:0/1780481207 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a8009570 con 0x7f95b410ba80 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.798+0000 7f95b37fe640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95b4111060 0x7f95b4127340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.799+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 0x7f95b4121a30 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a8004820 tx=0x7f95a8004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.799+0000 7f95b8a5b640 1 -- 10.20.193.28:0/1780481207 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a803d070 con 0x7f95b410ba80 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.799+0000 7f95b8a5b640 1 -- 10.20.193.28:0/1780481207 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f95a80043e0 con 0x7f95b410ba80 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.799+0000 7f95b8a5b640 1 -- 10.20.193.28:0/1780481207 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a80418a0 con 0x7f95b410ba80 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.799+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1780481207 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b4127f70 con 0x7f95b410ba80 2026-02-20T13:29:40.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.799+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1780481207 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b4168670 con 0x7f95b410ba80 2026-02-20T13:29:40.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.802+0000 7f95b8a5b640 1 -- 10.20.193.28:0/1780481207 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f95a802f9f0 con 0x7f95b410ba80 2026-02-20T13:29:40.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.803+0000 7f95b8a5b640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95880b5760 0x7f95880d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.803+0000 7f95b8a5b640 1 -- 10.20.193.28:0/1780481207 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f95a810ae70 con 0x7f95b410ba80 2026-02-20T13:29:40.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.804+0000 7f95b27fc640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95880b5760 0x7f95880d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.804+0000 7f95b27fc640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95880b5760 0x7f95880d5c10 secure :-1 s=READY pgs=549 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95b41283d0 tx=0x7f959c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:40.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.804+0000 7f95bba57e00 1 Processor -- start 2026-02-20T13:29:40.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95bba57e00 1 -- start start 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f0e730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f535e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f73f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95bba57e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c29e24780 con 0x555c29f53b20 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95bba57e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555c29e204b0 con 0x555c29f0ec70 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95bba57e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555c29e1a450 con 0x555c29f0e360 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f0e730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f73f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f73f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54764/0 (socket says 10.20.193.28:54764) 2026-02-20T13:29:40.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f0e730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41566/0 (socket says 10.20.193.28:41566) 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 -- 10.20.193.28:0/3091367808 learned_addr learned my addr 10.20.193.28:0/3091367808 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b27fc640 1 --2- 10.20.193.28:0/3091367808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 -- 10.20.193.28:0/3091367808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 msgr2=0x555c29f0e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 --2- 10.20.193.28:0/3091367808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f0e730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 -- 10.20.193.28:0/3091367808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 msgr2=0x555c29f535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 --2- 10.20.193.28:0/3091367808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 -- 10.20.193.28:0/3091367808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c29dc5d10 con 0x555c29f53b20 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.805+0000 7f95b37fe640 1 --2- 10.20.193.28:0/3091367808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f73f00 secure :-1 s=READY pgs=1306 gs=3 cs=0 l=1 c_cookie=17189935488227968854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a400afd0 tx=0x7f95a40056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8eeb4017b58756 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f9577fff640 1 -- 10.20.193.28:0/3091367808 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a401b440 con 0x555c29f53b20 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f9577fff640 1 -- 10.20.193.28:0/3091367808 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f95a401ba80 con 0x555c29f53b20 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f9577fff640 1 -- 10.20.193.28:0/3091367808 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a4011c70 con 0x555c29f53b20 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 -- 10.20.193.28:0/3091367808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 msgr2=0x555c29f73f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 --2- 10.20.193.28:0/3091367808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f73f00 secure :-1 s=READY pgs=1306 gs=3 cs=0 l=1 c_cookie=17189935488227968854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a400afd0 tx=0x7f95a40056c0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 -- 10.20.193.28:0/3091367808 shutdown_connections 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 --2- 10.20.193.28:0/3091367808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f73f00 unknown :-1 s=CLOSED pgs=1306 gs=3 cs=0 l=1 c_cookie=17189935488227968854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 --2- 10.20.193.28:0/3091367808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f535e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 --2- 10.20.193.28:0/3091367808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f0e730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 -- 10.20.193.28:0/3091367808 >> 10.20.193.28:0/3091367808 conn(0x555c29eec860 msgr2=0x555c29f0cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 -- 10.20.193.28:0/3091367808 shutdown_connections 2026-02-20T13:29:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.806+0000 7f95bba57e00 1 -- 10.20.193.28:0/3091367808 wait complete. 2026-02-20T13:29:40.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.807+0000 7f95bba57e00 1 -- start start 2026-02-20T13:29:40.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.807+0000 7f95bba57e00 1 Processor -- start 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0e360 0x555c29f6b710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0ec70 0x555c29f6bc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f53b20 0x555c29f6d9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95bba57e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c29f6df50 con 0x555c29f0ec70 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95bba57e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555c29f6e0c0 con 0x555c29f0e360 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95bba57e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555c29f6e280 con 0x555c29f53b20 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f53b20 0x555c29f6d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0ec70 0x555c29f6bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b2ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0e360 0x555c29f6b710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f53b20 0x555c29f6d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41580/0 (socket says 10.20.193.28:41580) 2026-02-20T13:29:40.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b37fe640 1 -- 10.20.193.28:0/115022839 learned_addr learned my addr 10.20.193.28:0/115022839 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b27fc640 1 -- 10.20.193.28:0/115022839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f53b20 msgr2=0x555c29f6d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b27fc640 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f53b20 0x555c29f6d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b27fc640 1 -- 10.20.193.28:0/115022839 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0e360 msgr2=0x555c29f6b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b27fc640 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0e360 0x555c29f6b710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.808+0000 7f95b27fc640 1 -- 10.20.193.28:0/115022839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c29d9e3c0 con 0x555c29f0ec70 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0e360 0x555c29f6b710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95b27fc640 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0ec70 0x555c29f6bc50 secure :-1 s=READY pgs=1307 gs=3 cs=0 l=1 c_cookie=17418755443257432791 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959c0116c0 tx=0x7f959c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bbd9c980c2dad7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95757fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95757fa640 1 -- 10.20.193.28:0/115022839 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f959c021070 con 0x555c29f0ec70 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95757fa640 1 -- 10.20.193.28:0/115022839 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f959c011e70 con 0x555c29f0ec70 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95757fa640 1 -- 10.20.193.28:0/115022839 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f959c026420 con 0x555c29f0ec70 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a400ae40 con 0x555c29f0ec70 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95757fa640 1 -- 10.20.193.28:0/115022839 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f959c0265b0 con 0x555c29f0ec70 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95bba57e00 10 client.19836 _ll_register_callbacks cb 0x555c29d9ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c29ab06f0 con 0x555c29f0ec70 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95757fa640 1 -- 10.20.193.28:0/115022839 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f959c01cb20 con 0x555c29f0ec70 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95bba57e00 10 client.19836 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.809+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555c29db00e0 con 0x555c29f0ec70 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.810+0000 7f95757fa640 1 -- 10.20.193.28:0/115022839 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f959c01ccc0 con 0x555c29f0ec70 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.810+0000 7f95bba57e00 10 client.19836 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.810+0000 7f95bba57e00 10 client.19836 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.810+0000 7f95bba57e00 20 client.19836 populate_metadata read hostname 'trial028' 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.810+0000 7f95bba57e00 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x555c29f73c40 0x555c29f518a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.810+0000 7f95bba57e00 4 client.19836 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.810+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c29dbcf80 con 0x555c29f73c40 2026-02-20T13:29:40.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.810+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x555c29f73c40 0x555c29f518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.811+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x555c29f73c40 0x555c29f518a0 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=10194226340441721022 s_cookie=622519011914106223 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8d792ad865f588be server_cookie=8a3a1be3b11456f in_seq=0 out_seq=0 2026-02-20T13:29:40.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.811+0000 7f95757fa640 10 client.19836 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:29:40.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.811+0000 7f95757fa640 1 -- 10.20.193.28:0/115022839 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555c29dbcf80 con 0x555c29f73c40 2026-02-20T13:29:40.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.811+0000 7f95757fa640 10 client.19836 handle_command_reply: tid=0 2026-02-20T13:29:40.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.811+0000 7f95bba57e00 1 client.19836 shutdown 2026-02-20T13:29:40.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.811+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0ec70 msgr2=0x555c29f6bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.811+0000 7f95bba57e00 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0ec70 0x555c29f6bc50 secure :-1 s=READY pgs=1307 gs=3 cs=0 l=1 c_cookie=17418755443257432791 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959c0116c0 tx=0x7f959c0047e0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 shutdown_connections 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x555c29f73c40 0x555c29f518a0 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=10194226340441721022 s_cookie=622519011914106223 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0ec70 0x555c29f6bc50 unknown :-1 s=CLOSED pgs=1307 gs=3 cs=0 l=1 c_cookie=17418755443257432791 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f53b20 0x555c29f6d9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 1 --2- 10.20.193.28:0/115022839 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0e360 0x555c29f6b710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95757fa640 0 client.19836 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 >> 10.20.193.28:0/115022839 conn(0x555c29eec860 msgr2=0x555c29f0cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 shutdown_connections 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 1 -- 10.20.193.28:0/115022839 wait complete. 2026-02-20T13:29:40.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.812+0000 7f95bba57e00 20 client.19836 trim_cache size 0 max 16384 2026-02-20T13:29:40.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95bba57e00 1 Processor -- start 2026-02-20T13:29:40.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95bba57e00 1 -- start start 2026-02-20T13:29:40.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0e360 0x555c29f6d970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0ec70 0x555c29f711a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f53b20 0x555c29f716e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95bba57e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c29e18080 con 0x555c29f0e360 2026-02-20T13:29:40.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95bba57e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555c29ad8700 con 0x555c29f53b20 2026-02-20T13:29:40.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95bba57e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555c29f72750 con 0x555c29f0ec70 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95b2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0e360 0x555c29f6d970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95b2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0e360 0x555c29f6d970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54784/0 (socket says 10.20.193.28:54784) 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.819+0000 7f95b2ffd640 1 -- 10.20.193.28:0/3523091849 learned_addr learned my addr 10.20.193.28:0/3523091849 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95b27fc640 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0ec70 0x555c29f711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95b37fe640 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f53b20 0x555c29f716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95b2ffd640 1 -- 10.20.193.28:0/3523091849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0ec70 msgr2=0x555c29f711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0ec70 0x555c29f711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95b2ffd640 1 -- 10.20.193.28:0/3523091849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f53b20 msgr2=0x555c29f716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f53b20 0x555c29f716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95b2ffd640 1 -- 10.20.193.28:0/3523091849 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c29f5d9b0 con 0x555c29f0e360 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0e360 0x555c29f6d970 secure :-1 s=READY pgs=1308 gs=1 cs=0 l=1 c_cookie=11910588044136179090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a8038e50 tx=0x7f95a8108040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54ae8b89cc06592 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95777fe640 1 -- 10.20.193.28:0/3523091849 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a80d0a80 con 0x555c29f0e360 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95777fe640 1 -- 10.20.193.28:0/3523091849 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f95a80f4e90 con 0x555c29f0e360 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95777fe640 1 -- 10.20.193.28:0/3523091849 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a80d0a80 con 0x555c29f0e360 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 -- 10.20.193.28:0/3523091849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0e360 msgr2=0x555c29f6d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0e360 0x555c29f6d970 secure :-1 s=READY pgs=1308 gs=1 cs=0 l=1 c_cookie=11910588044136179090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a8038e50 tx=0x7f95a8108040 comp rx=0 tx=0).stop 2026-02-20T13:29:40.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 -- 10.20.193.28:0/3523091849 shutdown_connections 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f53b20 0x555c29f716e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0ec70 0x555c29f711a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 --2- 10.20.193.28:0/3523091849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f0e360 0x555c29f6d970 unknown :-1 s=CLOSED pgs=1308 gs=1 cs=0 l=1 c_cookie=11910588044136179090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 -- 10.20.193.28:0/3523091849 >> 10.20.193.28:0/3523091849 conn(0x555c29eec860 msgr2=0x555c29f6fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 -- 10.20.193.28:0/3523091849 shutdown_connections 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.820+0000 7f95bba57e00 1 -- 10.20.193.28:0/3523091849 wait complete. 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.821+0000 7f95bba57e00 1 -- start start 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.821+0000 7f95bba57e00 1 Processor -- start 2026-02-20T13:29:40.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f717d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f6edf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95bba57e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f6f470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95bba57e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c29e18080 con 0x555c29f53b20 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95bba57e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555c29f6fba0 con 0x555c29f0ec70 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95bba57e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555c29eefc60 con 0x555c29f0e360 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f6edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f6edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:37972/0 (socket says 10.20.193.28:37972) 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 -- 10.20.193.28:0/2903957365 learned_addr learned my addr 10.20.193.28:0/2903957365 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b2ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b37fe640 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f6f470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 -- 10.20.193.28:0/2903957365 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 msgr2=0x555c29f717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 -- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 msgr2=0x555c29f6f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f6f470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 -- 10.20.193.28:0/2903957365 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c29daab60 con 0x555c29f0ec70 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b37fe640 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f6f470 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95b27fc640 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f6edf0 secure :-1 s=READY pgs=456 gs=2 cs=0 l=1 c_cookie=8597413098584957472 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959c016040 tx=0x7f959c02efa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775025a980726220 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95757fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95757fa640 1 -- 10.20.193.28:0/2903957365 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f959c021040 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.822+0000 7f95757fa640 1 -- 10.20.193.28:0/2903957365 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555c29ab06f0 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b4168670 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95757fa640 1 -- 10.20.193.28:0/2903957365 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f959c0193d0 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 10 client.29783 _ll_register_callbacks cb 0x555c29d9ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95a401ba80 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95757fa640 1 -- 10.20.193.28:0/2903957365 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f959c00e850 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95757fa640 1 -- 10.20.193.28:0/2903957365 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f959c02e660 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 10 client.29783 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555c29d9e6f0 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95757fa640 1 -- 10.20.193.28:0/2903957365 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f959c00ea10 con 0x555c29f0ec70 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 10 client.29783 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 10 client.29783 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 20 client.29783 populate_metadata read hostname 'trial028' 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x555c29ef1920 0x555c29ef1d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 4 client.29783 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:40.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c29aadf40 con 0x555c29ef1920 2026-02-20T13:29:40.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.823+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x555c29ef1920 0x555c29ef1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:40.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95b2ffd640 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x555c29ef1920 0x555c29ef1d90 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=1609514399209238943 s_cookie=6418957001951661042 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=165624d189be319f server_cookie=5914b76259d5cbf2 in_seq=0 out_seq=0 2026-02-20T13:29:40.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95757fa640 10 client.29783 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:29:40.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95757fa640 1 -- 10.20.193.28:0/2903957365 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c29aadf40 con 0x555c29ef1920 2026-02-20T13:29:40.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95757fa640 10 client.29783 handle_command_reply: tid=0 2026-02-20T13:29:40.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 client.29783 shutdown 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 msgr2=0x555c29f6edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f6edf0 secure :-1 s=READY pgs=456 gs=2 cs=0 l=1 c_cookie=8597413098584957472 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959c016040 tx=0x7f959c02efa0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 shutdown_connections 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x555c29ef1920 0x555c29ef1d90 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=1609514399209238943 s_cookie=6418957001951661042 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c29f53b20 0x555c29f6f470 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555c29f0ec70 0x555c29f6edf0 unknown :-1 s=CLOSED pgs=456 gs=2 cs=0 l=1 c_cookie=8597413098584957472 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 --2- 10.20.193.28:0/2903957365 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555c29f0e360 0x555c29f717d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 >> 10.20.193.28:0/2903957365 conn(0x555c29eec860 msgr2=0x555c29f0d840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95757fa640 0 client.29783 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 shutdown_connections 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 1 -- 10.20.193.28:0/2903957365 wait complete. 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.824+0000 7f95bba57e00 20 client.29783 trim_cache size 0 max 16384 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95880b5760 msgr2=0x7f95880d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95880b5760 0x7f95880d5c10 secure :-1 s=READY pgs=549 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95b41283d0 tx=0x7f959c005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1780481207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 msgr2=0x7f95b4121a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 0x7f95b4121a30 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a8004820 tx=0x7f95a8004270 comp rx=0 tx=0).stop 2026-02-20T13:29:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1780481207 shutdown_connections 2026-02-20T13:29:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95880b5760 0x7f95880d5c10 unknown :-1 s=CLOSED pgs=549 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95b4111060 0x7f95b4127340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f95b410c470 0x7f95b4121f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 --2- 10.20.193.28:0/1780481207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f95b410ba80 0x7f95b4121a30 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1780481207 >> 10.20.193.28:0/1780481207 conn(0x7f95b40e96b0 msgr2=0x7f95b4109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1780481207 shutdown_connections 2026-02-20T13:29:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:40.825+0000 7f95b9a5d640 1 -- 10.20.193.28:0/1780481207 wait complete. 2026-02-20T13:29:40.923 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:29:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:40 trial127 ceph-mon[43817]: pgmap v551: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:29:40.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:40 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1340799113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:40 trial034 ceph-mon[43332]: pgmap v551: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:29:40.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:40 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1340799113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:41.109 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:41.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.279+0000 7f570615b640 1 -- 10.20.193.28:0/1328868824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700062ae0 msgr2=0x7f5700060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.279+0000 7f570615b640 1 --2- 10.20.193.28:0/1328868824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700062ae0 0x7f5700060fb0 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=1786926266463888401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f0009950 tx=0x7f56f002f1b0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.280+0000 7f570615b640 1 -- 10.20.193.28:0/1328868824 shutdown_connections 2026-02-20T13:29:41.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.280+0000 7f570615b640 1 --2- 10.20.193.28:0/1328868824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57000614f0 0x7f5700061920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.280+0000 7f570615b640 1 --2- 10.20.193.28:0/1328868824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5700159d80 0x7f570017a160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.280+0000 7f570615b640 1 --2- 10.20.193.28:0/1328868824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700062ae0 0x7f5700060fb0 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=1786926266463888401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.280+0000 7f570615b640 1 -- 10.20.193.28:0/1328868824 >> 10.20.193.28:0/1328868824 conn(0x7f57000eab00 msgr2=0x7f570010af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.280+0000 7f570615b640 1 -- 10.20.193.28:0/1328868824 shutdown_connections 2026-02-20T13:29:41.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.280+0000 7f570615b640 1 -- 10.20.193.28:0/1328868824 wait complete. 2026-02-20T13:29:41.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.280+0000 7f570615b640 1 Processor -- start 2026-02-20T13:29:41.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570615b640 1 -- start start 2026-02-20T13:29:41.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570615b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57000614f0 0x7f57000f2e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570615b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5700062ae0 0x7f57000f33b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570615b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700159d80 0x7f57000f8780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570615b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57000f8da0 con 0x7f57000614f0 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570615b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f57000f8f10 con 0x7f5700159d80 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570615b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f57000f90d0 con 0x7f5700062ae0 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57000614f0 0x7f57000f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57000614f0 0x7f57000f2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54818/0 (socket says 10.20.193.28:54818) 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 -- 10.20.193.28:0/863812978 learned_addr learned my addr 10.20.193.28:0/863812978 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5704958640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5700062ae0 0x7f57000f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570595a640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700159d80 0x7f57000f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 -- 10.20.193.28:0/863812978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5700062ae0 msgr2=0x7f57000f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5700062ae0 0x7f57000f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 -- 10.20.193.28:0/863812978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700159d80 msgr2=0x7f57000f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700159d80 0x7f57000f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 -- 10.20.193.28:0/863812978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f0009570 con 0x7f57000614f0 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5704958640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5700062ae0 0x7f57000f33b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f570595a640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700159d80 0x7f57000f8780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.281+0000 7f5705159640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57000614f0 0x7f57000f2e70 secure :-1 s=READY pgs=1309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f002f6c0 tx=0x7f56f0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.282+0000 7f56ee7fc640 1 -- 10.20.193.28:0/863812978 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f003d070 con 0x7f57000614f0 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.282+0000 7f56ee7fc640 1 -- 10.20.193.28:0/863812978 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56f0002b80 con 0x7f57000614f0 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.282+0000 7f56ee7fc640 1 -- 10.20.193.28:0/863812978 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f00418c0 con 0x7f57000614f0 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.282+0000 7f570615b640 1 -- 10.20.193.28:0/863812978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57000f9350 con 0x7f57000614f0 2026-02-20T13:29:41.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.282+0000 7f570615b640 1 -- 10.20.193.28:0/863812978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57000f9a90 con 0x7f57000614f0 2026-02-20T13:29:41.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.285+0000 7f56ee7fc640 1 -- 10.20.193.28:0/863812978 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f56f00026a0 con 0x7f57000614f0 2026-02-20T13:29:41.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.286+0000 7f56ee7fc640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56dc0b56e0 0x7f56dc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.287+0000 7f56ee7fc640 1 -- 10.20.193.28:0/863812978 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56f010b150 con 0x7f57000614f0 2026-02-20T13:29:41.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.287+0000 7f5704958640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56dc0b56e0 0x7f56dc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.287+0000 7f5704958640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56dc0b56e0 0x7f56dc0d5b90 secure :-1 s=READY pgs=550 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57000f9810 tx=0x7f56f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.287+0000 7f57093dee00 1 Processor -- start 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.287+0000 7f57093dee00 1 -- start start 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f57093dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957f8d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f57093dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fd25e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f57093dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957ff2f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f57093dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561957ea3780 con 0x561957f8dc70 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f57093dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561957e9f4b0 con 0x561957fd2b20 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f57093dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561957e99450 con 0x561957f8d360 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f5705159640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957f8d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957ff2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957ff2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38006/0 (socket says 10.20.193.28:38006) 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 -- 10.20.193.28:0/3052919729 learned_addr learned my addr 10.20.193.28:0/3052919729 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f5704958640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fd25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 -- 10.20.193.28:0/3052919729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 msgr2=0x561957f8d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 --2- 10.20.193.28:0/3052919729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957f8d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 -- 10.20.193.28:0/3052919729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 msgr2=0x561957fd25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 --2- 10.20.193.28:0/3052919729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fd25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 -- 10.20.193.28:0/3052919729 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561957e44d10 con 0x561957fd2b20 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f5704958640 1 --2- 10.20.193.28:0/3052919729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fd25e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:41.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f570595a640 1 --2- 10.20.193.28:0/3052919729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957ff2f00 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=14034233164579144177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56fc005730 tx=0x7f56fc003d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c39cb4e5bf01f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f56cdce5640 1 -- 10.20.193.28:0/3052919729 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56fc00add0 con 0x561957fd2b20 2026-02-20T13:29:41.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.288+0000 7f56cdce5640 1 -- 10.20.193.28:0/3052919729 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56fc01b950 con 0x561957fd2b20 2026-02-20T13:29:41.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f56cdce5640 1 -- 10.20.193.28:0/3052919729 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56fc012b30 con 0x561957fd2b20 2026-02-20T13:29:41.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 -- 10.20.193.28:0/3052919729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 msgr2=0x561957ff2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 --2- 10.20.193.28:0/3052919729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957ff2f00 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=14034233164579144177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56fc005730 tx=0x7f56fc003d00 comp rx=0 tx=0).stop 2026-02-20T13:29:41.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 -- 10.20.193.28:0/3052919729 shutdown_connections 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 --2- 10.20.193.28:0/3052919729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fd25e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 --2- 10.20.193.28:0/3052919729 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957ff2f00 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=14034233164579144177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 --2- 10.20.193.28:0/3052919729 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957f8d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 -- 10.20.193.28:0/3052919729 >> 10.20.193.28:0/3052919729 conn(0x561957f6b860 msgr2=0x561957f8bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 -- 10.20.193.28:0/3052919729 shutdown_connections 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.289+0000 7f57093dee00 1 -- 10.20.193.28:0/3052919729 wait complete. 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.290+0000 7f57093dee00 1 -- start start 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.290+0000 7f57093dee00 1 Processor -- start 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f57093dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957fea680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f57093dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957feabc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f57093dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957fefbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f57093dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561957ff00f0 con 0x561957f8dc70 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f57093dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561957ff0260 con 0x561957fd2b20 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f57093dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561957ff0420 con 0x561957f8d360 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f570595a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957fefbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f5704958640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957feabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f5705159640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957fea680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f570595a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957fefbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38014/0 (socket says 10.20.193.28:38014) 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f5704958640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957feabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54836/0 (socket says 10.20.193.28:54836) 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f570595a640 1 -- 10.20.193.28:0/2051722810 learned_addr learned my addr 10.20.193.28:0/2051722810 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f570595a640 1 -- 10.20.193.28:0/2051722810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 msgr2=0x561957fea680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f570595a640 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957fea680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f570595a640 1 -- 10.20.193.28:0/2051722810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 msgr2=0x561957feabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f570595a640 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957feabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f570595a640 1 -- 10.20.193.28:0/2051722810 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56fc005350 con 0x561957fd2b20 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f5705159640 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957fea680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.291+0000 7f5704958640 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957feabc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f570595a640 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957fefbb0 secure :-1 s=READY pgs=459 gs=3 cs=0 l=1 c_cookie=15944607721491137197 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56fc005070 tx=0x7f56fc00ade0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd46a03e9a6e02ad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f56baffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f56baffd640 1 -- 10.20.193.28:0/2051722810 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56fc012440 con 0x561957fd2b20 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f56baffd640 1 -- 10.20.193.28:0/2051722810 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56fc021040 con 0x561957fd2b20 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f56baffd640 1 -- 10.20.193.28:0/2051722810 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56fc005e50 con 0x561957fd2b20 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f4009c40 con 0x561957fd2b20 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f56baffd640 1 -- 10.20.193.28:0/2051722810 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56fc006050 con 0x561957fd2b20 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f57093dee00 10 client.29795 _ll_register_callbacks cb 0x561957e1aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:41.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561957b2f6f0 con 0x561957fd2b20 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f56baffd640 1 -- 10.20.193.28:0/2051722810 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f56fc005a40 con 0x561957fd2b20 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f57093dee00 10 client.29795 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.292+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561957e1d3c0 con 0x561957fd2b20 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f56baffd640 1 -- 10.20.193.28:0/2051722810 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f56fc012720 con 0x561957fd2b20 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f57093dee00 10 client.29795 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f57093dee00 10 client.29795 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f57093dee00 20 client.29795 populate_metadata read hostname 'trial028' 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f57093dee00 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x561957ff2a70 0x561957fd08a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f57093dee00 4 client.29795 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:41.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561957e3bf80 con 0x561957ff2a70 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f5705159640 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x561957ff2a70 0x561957fd08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f5705159640 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x561957ff2a70 0x561957fd08a0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=1238469485667222531 s_cookie=13805468748206395725 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=112fed6f7e5b0403 server_cookie=bf96e0ae9699514d in_seq=0 out_seq=0 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.293+0000 7f56baffd640 10 client.29795 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f56baffd640 1 -- 10.20.193.28:0/2051722810 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561957e3bf80 con 0x561957ff2a70 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f56baffd640 10 client.29795 handle_command_reply: tid=0 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 client.29795 shutdown 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 msgr2=0x561957fefbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957fefbb0 secure :-1 s=READY pgs=459 gs=3 cs=0 l=1 c_cookie=15944607721491137197 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56fc005070 tx=0x7f56fc00ade0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 shutdown_connections 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x561957ff2a70 0x561957fd08a0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=1238469485667222531 s_cookie=13805468748206395725 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957feabc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957fefbb0 unknown :-1 s=CLOSED pgs=459 gs=3 cs=0 l=1 c_cookie=15944607721491137197 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 --2- 10.20.193.28:0/2051722810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957fea680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f56baffd640 0 client.29795 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.294+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 >> 10.20.193.28:0/2051722810 conn(0x561957f6b860 msgr2=0x561957f8bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.295+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 shutdown_connections 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.295+0000 7f57093dee00 1 -- 10.20.193.28:0/2051722810 wait complete. 2026-02-20T13:29:41.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.295+0000 7f57093dee00 20 client.29795 trim_cache size 0 max 16384 2026-02-20T13:29:41.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f57093dee00 1 Processor -- start 2026-02-20T13:29:41.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f57093dee00 1 -- start start 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f57093dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957f8d360 0x561957fe7850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f57093dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fe7d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f57093dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957fd2b20 0x561957fd18b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f57093dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561957e97080 con 0x561957f8dc70 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f57093dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561957b57700 con 0x561957f8d360 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f57093dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561957fdefb0 con 0x561957fd2b20 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5704958640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fe7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5704958640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fe7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54852/0 (socket says 10.20.193.28:54852) 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5704958640 1 -- 10.20.193.28:0/196624875 learned_addr learned my addr 10.20.193.28:0/196624875 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5705159640 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957f8d360 0x561957fe7850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f570595a640 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957fd2b20 0x561957fd18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5704958640 1 -- 10.20.193.28:0/196624875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957fd2b20 msgr2=0x561957fd18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5704958640 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957fd2b20 0x561957fd18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5704958640 1 -- 10.20.193.28:0/196624875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957f8d360 msgr2=0x561957fe7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5704958640 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957f8d360 0x561957fe7850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.302+0000 7f5704958640 1 -- 10.20.193.28:0/196624875 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561957e2f0e0 con 0x561957f8dc70 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f5704958640 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fe7d90 secure :-1 s=READY pgs=1310 gs=1 cs=0 l=1 c_cookie=624362945998188691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f4004360 tx=0x7f56f4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa2eca97237093 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f56cd4e4640 1 -- 10.20.193.28:0/196624875 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f4018040 con 0x561957f8dc70 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f56cd4e4640 1 -- 10.20.193.28:0/196624875 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56f4004560 con 0x561957f8dc70 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f56cd4e4640 1 -- 10.20.193.28:0/196624875 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f4022970 con 0x561957f8dc70 2026-02-20T13:29:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 -- 10.20.193.28:0/196624875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 msgr2=0x561957fe7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fe7d90 secure :-1 s=READY pgs=1310 gs=1 cs=0 l=1 c_cookie=624362945998188691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f4004360 tx=0x7f56f4013000 comp rx=0 tx=0).stop 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 -- 10.20.193.28:0/196624875 shutdown_connections 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957fe7d90 unknown :-1 s=CLOSED pgs=1310 gs=1 cs=0 l=1 c_cookie=624362945998188691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957fd2b20 0x561957fd18b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 --2- 10.20.193.28:0/196624875 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957f8d360 0x561957fe7850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 -- 10.20.193.28:0/196624875 >> 10.20.193.28:0/196624875 conn(0x561957f6b860 msgr2=0x561957fd4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 -- 10.20.193.28:0/196624875 shutdown_connections 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.303+0000 7f57093dee00 1 -- 10.20.193.28:0/196624875 wait complete. 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f57093dee00 1 -- start start 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f57093dee00 1 Processor -- start 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f57093dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957f71960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f57093dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957f6ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f57093dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957f6d560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f57093dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561957f6dc60 con 0x561957f8dc70 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f57093dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5619580389a0 con 0x561957fd2b20 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f57093dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561958038b60 con 0x561957f8d360 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f5704958640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957f6ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f570595a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957f6d560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f5704958640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957f6ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54866/0 (socket says 10.20.193.28:54866) 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f5704958640 1 -- 10.20.193.28:0/2716793451 learned_addr learned my addr 10.20.193.28:0/2716793451 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.304+0000 7f5705159640 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957f71960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f570595a640 1 -- 10.20.193.28:0/2716793451 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 msgr2=0x561957f71960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f570595a640 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957f71960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f570595a640 1 -- 10.20.193.28:0/2716793451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 msgr2=0x561957f6ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f570595a640 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957f6ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f570595a640 1 -- 10.20.193.28:0/2716793451 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561957e29b60 con 0x561957fd2b20 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f570595a640 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957f6d560 secure :-1 s=READY pgs=460 gs=2 cs=0 l=1 c_cookie=8053640372761645502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56fc006f10 tx=0x7f56fc003780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc4473fbf33d1be server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f56baffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f56baffd640 1 -- 10.20.193.28:0/2716793451 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56fc00fed0 con 0x561957fd2b20 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f4004030 con 0x561957fd2b20 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f56baffd640 1 -- 10.20.193.28:0/2716793451 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56fc021070 con 0x561957fd2b20 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f56baffd640 1 -- 10.20.193.28:0/2716793451 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56fc025610 con 0x561957fd2b20 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f57093dee00 10 client.29801 _ll_register_callbacks cb 0x561957e1aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56fc01b950 con 0x561957fd2b20 2026-02-20T13:29:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f56baffd640 1 -- 10.20.193.28:0/2716793451 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f56fc0257a0 con 0x561957fd2b20 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f56baffd640 1 -- 10.20.193.28:0/2716793451 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f56fc0259a0 con 0x561957fd2b20 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f57093dee00 10 client.29801 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.305+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561957e1d6f0 con 0x561957fd2b20 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f56baffd640 1 -- 10.20.193.28:0/2716793451 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f56fc025d20 con 0x561957fd2b20 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f57093dee00 10 client.29801 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f57093dee00 10 client.29801 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f57093dee00 20 client.29801 populate_metadata read hostname 'trial028' 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f57093dee00 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5619580807d0 0x5619580a0c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f57093dee00 4 client.29801 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561957b2cf40 con 0x5619580807d0 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f5705159640 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5619580807d0 0x5619580a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f5705159640 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5619580807d0 0x5619580a0c80 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=14386428057883739613 s_cookie=15462494316443203279 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c7a6dc1898df85dd server_cookie=d695d0a83117f6cf in_seq=0 out_seq=0 2026-02-20T13:29:41.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.306+0000 7f56baffd640 10 client.29801 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f56baffd640 1 -- 10.20.193.28:0/2716793451 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561957b2cf40 con 0x5619580807d0 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f56baffd640 10 client.29801 handle_command_reply: tid=0 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 client.29801 shutdown 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 msgr2=0x561957f6d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957f6d560 secure :-1 s=READY pgs=460 gs=2 cs=0 l=1 c_cookie=8053640372761645502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56fc006f10 tx=0x7f56fc003780 comp rx=0 tx=0).stop 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 shutdown_connections 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x5619580807d0 0x5619580a0c80 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=14386428057883739613 s_cookie=15462494316443203279 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561957f8dc70 0x561957f6ce90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561957fd2b20 0x561957f6d560 unknown :-1 s=CLOSED pgs=460 gs=2 cs=0 l=1 c_cookie=8053640372761645502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 --2- 10.20.193.28:0/2716793451 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561957f8d360 0x561957f71960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f56baffd640 0 client.29801 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 >> 10.20.193.28:0/2716793451 conn(0x561957f6b860 msgr2=0x561957fe6840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 shutdown_connections 2026-02-20T13:29:41.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 1 -- 10.20.193.28:0/2716793451 wait complete. 2026-02-20T13:29:41.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f57093dee00 20 client.29801 trim_cache size 0 max 16384 2026-02-20T13:29:41.316 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f570615b640 1 -- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56dc0b56e0 msgr2=0x7f56dc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f570615b640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56dc0b56e0 0x7f56dc0d5b90 secure :-1 s=READY pgs=550 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57000f9810 tx=0x7f56f4005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f570615b640 1 -- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57000614f0 msgr2=0x7f57000f2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.307+0000 7f570615b640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57000614f0 0x7f57000f2e70 secure :-1 s=READY pgs=1309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f002f6c0 tx=0x7f56f0004290 comp rx=0 tx=0).stop 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.308+0000 7f570615b640 1 -- 10.20.193.28:0/863812978 shutdown_connections 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.308+0000 7f570615b640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f56dc0b56e0 0x7f56dc0d5b90 unknown :-1 s=CLOSED pgs=550 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.308+0000 7f570615b640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5700159d80 0x7f57000f8780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.308+0000 7f570615b640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5700062ae0 0x7f57000f33b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.308+0000 7f570615b640 1 --2- 10.20.193.28:0/863812978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57000614f0 0x7f57000f2e70 unknown :-1 s=CLOSED pgs=1309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.308+0000 7f570615b640 1 -- 10.20.193.28:0/863812978 >> 10.20.193.28:0/863812978 conn(0x7f57000eab00 msgr2=0x7f570010fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.308+0000 7f570615b640 1 -- 10.20.193.28:0/863812978 shutdown_connections 2026-02-20T13:29:41.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.308+0000 7f570615b640 1 -- 10.20.193.28:0/863812978 wait complete. 2026-02-20T13:29:41.407 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:29:41.590 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:41.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 -- 10.20.193.28:0/4003900269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 msgr2=0x7f36f410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 --2- 10.20.193.28:0/4003900269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 0x7f36f410c1b0 secure :-1 s=READY pgs=1311 gs=2 cs=0 l=1 c_cookie=6721133910294741559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36e4009950 tx=0x7f36e402f190 comp rx=0 tx=0).stop 2026-02-20T13:29:41.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 -- 10.20.193.28:0/4003900269 shutdown_connections 2026-02-20T13:29:41.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 --2- 10.20.193.28:0/4003900269 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f36f4111fd0 0x7f36f41729a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 --2- 10.20.193.28:0/4003900269 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f36f410c7d0 0x7f36f4111820 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 --2- 10.20.193.28:0/4003900269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 0x7f36f410c1b0 unknown :-1 s=CLOSED pgs=1311 gs=2 cs=0 l=1 c_cookie=6721133910294741559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 -- 10.20.193.28:0/4003900269 >> 10.20.193.28:0/4003900269 conn(0x7f36f40e9670 msgr2=0x7f36f4109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 -- 10.20.193.28:0/4003900269 shutdown_connections 2026-02-20T13:29:41.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 -- 10.20.193.28:0/4003900269 wait complete. 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.781+0000 7f36fbd72640 1 Processor -- start 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36fbd72640 1 -- start start 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36fbd72640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 0x7f36f40f4a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36fbd72640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f36f410c7d0 0x7f36f41728a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36fbd72640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f36f4111fd0 0x7f36f40f5160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36fbd72640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f36f40fa370 con 0x7f36f410bde0 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36fbd72640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f36f40fa4e0 con 0x7f36f4111fd0 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36fbd72640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f36f40fa6a0 con 0x7f36f410c7d0 2026-02-20T13:29:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 0x7f36f40f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36fa2e8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f36f4111fd0 0x7f36f40f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 0x7f36f40f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54878/0 (socket says 10.20.193.28:54878) 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 -- 10.20.193.28:0/705516230 learned_addr learned my addr 10.20.193.28:0/705516230 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f92e6640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f36f410c7d0 0x7f36f41728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 -- 10.20.193.28:0/705516230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f36f410c7d0 msgr2=0x7f36f41728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f36f410c7d0 0x7f36f41728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 -- 10.20.193.28:0/705516230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f36f4111fd0 msgr2=0x7f36f40f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f36f4111fd0 0x7f36f40f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 -- 10.20.193.28:0/705516230 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e4009570 con 0x7f36f410bde0 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.782+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 0x7f36f40f4a60 secure :-1 s=READY pgs=1312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36e40023d0 tx=0x7f36e4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.783+0000 7f36e2ffd640 1 -- 10.20.193.28:0/705516230 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36e403d070 con 0x7f36f410bde0 2026-02-20T13:29:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.783+0000 7f36e2ffd640 1 -- 10.20.193.28:0/705516230 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f36e4002ad0 con 0x7f36f410bde0 2026-02-20T13:29:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.783+0000 7f36e2ffd640 1 -- 10.20.193.28:0/705516230 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36e40418a0 con 0x7f36f410bde0 2026-02-20T13:29:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.783+0000 7f36fbd72640 1 -- 10.20.193.28:0/705516230 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f40fa920 con 0x7f36f410bde0 2026-02-20T13:29:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.783+0000 7f36fbd72640 1 -- 10.20.193.28:0/705516230 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f40fad40 con 0x7f36f410bde0 2026-02-20T13:29:41.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.786+0000 7f36e2ffd640 1 -- 10.20.193.28:0/705516230 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f36e4041a30 con 0x7f36f410bde0 2026-02-20T13:29:41.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.787+0000 7f36e2ffd640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f36d00b5750 0x7f36d00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.787+0000 7f36e2ffd640 1 -- 10.20.193.28:0/705516230 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f36e410afe0 con 0x7f36f410bde0 2026-02-20T13:29:41.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.788+0000 7f36f92e6640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f36d00b5750 0x7f36d00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.788+0000 7f36fdd6ce00 1 Processor -- start 2026-02-20T13:29:41.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.788+0000 7f36fdd6ce00 1 -- start start 2026-02-20T13:29:41.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.788+0000 7f36f92e6640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f36d00b5750 0x7f36d00d5c00 secure :-1 s=READY pgs=551 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f40fb400 tx=0x7f36e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.788+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba9686730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686c70 0x564ba96cb5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba96cbb20 0x564ba96ebf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ba959c780 con 0x564ba9686360 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564ba95984b0 con 0x564ba9686c70 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564ba9592450 con 0x564ba96cbb20 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba9686730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba9686730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54884/0 (socket says 10.20.193.28:54884) 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 -- 10.20.193.28:0/2539317080 learned_addr learned my addr 10.20.193.28:0/2539317080 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba96cbb20 0x564ba96ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f92e6640 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686c70 0x564ba96cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 -- 10.20.193.28:0/2539317080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba96cbb20 msgr2=0x564ba96ebf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba96cbb20 0x564ba96ebf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 -- 10.20.193.28:0/2539317080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686c70 msgr2=0x564ba96cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686c70 0x564ba96cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 -- 10.20.193.28:0/2539317080 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba953dd10 con 0x564ba9686360 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba96cbb20 0x564ba96ebf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba9686730 secure :-1 s=READY pgs=1313 gs=1 cs=0 l=1 c_cookie=11148390384324297824 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36e40d16a0 tx=0x7f36e4038ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab709fce307c460 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36c24e6640 1 -- 10.20.193.28:0/2539317080 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36e4048e80 con 0x564ba9686360 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36c24e6640 1 -- 10.20.193.28:0/2539317080 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f36e4038920 con 0x564ba9686360 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.789+0000 7f36c24e6640 1 -- 10.20.193.28:0/2539317080 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36e402fc70 con 0x564ba9686360 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2539317080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 msgr2=0x564ba9686730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba9686730 secure :-1 s=READY pgs=1313 gs=1 cs=0 l=1 c_cookie=11148390384324297824 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36e40d16a0 tx=0x7f36e4038ef0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2539317080 shutdown_connections 2026-02-20T13:29:41.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba96cbb20 0x564ba96ebf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686c70 0x564ba96cb5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2539317080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba9686730 unknown :-1 s=CLOSED pgs=1313 gs=1 cs=0 l=1 c_cookie=11148390384324297824 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2539317080 >> 10.20.193.28:0/2539317080 conn(0x564ba9664860 msgr2=0x564ba9684c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2539317080 shutdown_connections 2026-02-20T13:29:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.790+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2539317080 wait complete. 2026-02-20T13:29:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.791+0000 7f36fdd6ce00 1 -- start start 2026-02-20T13:29:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.791+0000 7f36fdd6ce00 1 Processor -- start 2026-02-20T13:29:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba96e3770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 0x564ba96e3cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e5a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ba96e5fb0 con 0x564ba9686360 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564ba96e6120 con 0x564ba96cbb20 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564ba96e62e0 con 0x564ba9686c70 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba96e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba96e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54898/0 (socket says 10.20.193.28:54898) 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 -- 10.20.193.28:0/2361187713 learned_addr learned my addr 10.20.193.28:0/2361187713 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f92e6640 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 0x564ba96e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 -- 10.20.193.28:0/2361187713 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 msgr2=0x564ba96e3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 0x564ba96e3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 -- 10.20.193.28:0/2361187713 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 msgr2=0x564ba96e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 -- 10.20.193.28:0/2361187713 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba95163c0 con 0x564ba9686360 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba96e3770 secure :-1 s=READY pgs=1314 gs=1 cs=0 l=1 c_cookie=2983512264808514815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36e4108b50 tx=0x7f36e4038d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29679098f6eec4ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36af7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36af7fe640 1 -- 10.20.193.28:0/2361187713 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36e4048e80 con 0x564ba9686360 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36af7fe640 1 -- 10.20.193.28:0/2361187713 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f36e40d9680 con 0x564ba9686360 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36af7fe640 1 -- 10.20.193.28:0/2361187713 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36e40d2ff0 con 0x564ba9686360 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.792+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f40fad40 con 0x564ba9686360 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 10 client.19872 _ll_register_callbacks cb 0x564ba9513a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564ba92286f0 con 0x564ba9686360 2026-02-20T13:29:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36af7fe640 1 -- 10.20.193.28:0/2361187713 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f36e40d70a0 con 0x564ba9686360 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36af7fe640 1 -- 10.20.193.28:0/2361187713 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36e40cf6e0 con 0x564ba9686360 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 10 client.19872 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x564ba95280e0 con 0x564ba9686360 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36af7fe640 1 -- 10.20.193.28:0/2361187713 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f36e40dc030 con 0x564ba9686360 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 10 client.19872 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 10 client.19872 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 20 client.19872 populate_metadata read hostname 'trial028' 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564ba96c8c70 0x564ba96c9110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 4 client.19872 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ba9534f80 con 0x564ba96c8c70 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.793+0000 7f36f92e6640 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564ba96c8c70 0x564ba96c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.794+0000 7f36f92e6640 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564ba96c8c70 0x564ba96c9110 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=7174724654561774518 s_cookie=894369363390665851 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6391be0f5c644bb6 server_cookie=c6970328ae4947b in_seq=0 out_seq=0 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.794+0000 7f36af7fe640 10 client.19872 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36af7fe640 1 -- 10.20.193.28:0/2361187713 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564ba9534f80 con 0x564ba96c8c70 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36af7fe640 10 client.19872 handle_command_reply: tid=0 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 client.19872 shutdown 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 msgr2=0x564ba96e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba96e3770 secure :-1 s=READY pgs=1314 gs=1 cs=0 l=1 c_cookie=2983512264808514815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36e4108b50 tx=0x7f36e4038d30 comp rx=0 tx=0).stop 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 shutdown_connections 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564ba96c8c70 0x564ba96c9110 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=7174724654561774518 s_cookie=894369363390665851 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e5a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 0x564ba96e3cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/2361187713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686360 0x564ba96e3770 unknown :-1 s=CLOSED pgs=1314 gs=1 cs=0 l=1 c_cookie=2983512264808514815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 >> 10.20.193.28:0/2361187713 conn(0x564ba9664860 msgr2=0x564ba9684c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36af7fe640 0 client.19872 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:29:41.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 shutdown_connections 2026-02-20T13:29:41.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/2361187713 wait complete. 2026-02-20T13:29:41.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.795+0000 7f36fdd6ce00 20 client.19872 trim_cache size 0 max 16384 2026-02-20T13:29:41.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.803+0000 7f36fdd6ce00 1 Processor -- start 2026-02-20T13:29:41.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.803+0000 7f36fdd6ce00 1 -- start start 2026-02-20T13:29:41.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.803+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686360 0x564ba96c90d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.803+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686c70 0x564ba96e59d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.803+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e0900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.803+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ba9590080 con 0x564ba9686c70 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.803+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564ba9250700 con 0x564ba96cbb20 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.803+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564ba959c780 con 0x564ba9686360 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e0900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38068/0 (socket says 10.20.193.28:38068) 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 -- 10.20.193.28:0/1720206153 learned_addr learned my addr 10.20.193.28:0/1720206153 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686360 0x564ba96c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36f92e6640 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686c70 0x564ba96e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 -- 10.20.193.28:0/1720206153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686360 msgr2=0x564ba96c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686360 0x564ba96c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 -- 10.20.193.28:0/1720206153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686c70 msgr2=0x564ba96e59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686c70 0x564ba96e59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 -- 10.20.193.28:0/1720206153 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba9522b60 con 0x564ba96cbb20 2026-02-20T13:29:41.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e0900 secure :-1 s=READY pgs=461 gs=2 cs=0 l=1 c_cookie=2622913942383271386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f00055a0 tx=0x7f36f0004c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24667655742c9dda server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.804+0000 7f36c1ce5640 1 -- 10.20.193.28:0/1720206153 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36f000ade0 con 0x564ba96cbb20 2026-02-20T13:29:41.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36c1ce5640 1 -- 10.20.193.28:0/1720206153 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f36f0019040 con 0x564ba96cbb20 2026-02-20T13:29:41.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36c1ce5640 1 -- 10.20.193.28:0/1720206153 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36f001d7e0 con 0x564ba96cbb20 2026-02-20T13:29:41.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/1720206153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 msgr2=0x564ba96e0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e0900 secure :-1 s=READY pgs=461 gs=2 cs=0 l=1 c_cookie=2622913942383271386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f00055a0 tx=0x7f36f0004c40 comp rx=0 tx=0).stop 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/1720206153 shutdown_connections 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba9686c70 0x564ba96e59d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba96cbb20 0x564ba96e0900 unknown :-1 s=CLOSED pgs=461 gs=2 cs=0 l=1 c_cookie=2622913942383271386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/1720206153 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686360 0x564ba96c90d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/1720206153 >> 10.20.193.28:0/1720206153 conn(0x564ba9664860 msgr2=0x564ba96e82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/1720206153 shutdown_connections 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.805+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/1720206153 wait complete. 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fdd6ce00 1 -- start start 2026-02-20T13:29:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fdd6ce00 1 Processor -- start 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686360 0x564ba96e6900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 0x564ba96e6e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fdd6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba96cbb20 0x564ba9667c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ba96d0ba0 con 0x564ba96cbb20 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564ba96e7720 con 0x564ba9686360 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fdd6ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564ba96681a0 con 0x564ba9686c70 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fa2e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba96cbb20 0x564ba9667c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fa2e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba96cbb20 0x564ba9667c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54920/0 (socket says 10.20.193.28:54920) 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.806+0000 7f36fa2e8640 1 -- 10.20.193.28:0/4082300099 learned_addr learned my addr 10.20.193.28:0/4082300099 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686360 0x564ba96e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36f92e6640 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 0x564ba96e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fa2e8640 1 -- 10.20.193.28:0/4082300099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 msgr2=0x564ba96e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 0x564ba96e6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fa2e8640 1 -- 10.20.193.28:0/4082300099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686360 msgr2=0x564ba96e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686360 0x564ba96e6900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fa2e8640 1 -- 10.20.193.28:0/4082300099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba95166f0 con 0x564ba96cbb20 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fa2e8640 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba96cbb20 0x564ba9667c60 secure :-1 s=READY pgs=1315 gs=2 cs=0 l=1 c_cookie=17641014756485072495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f0020040 tx=0x7f36f0011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d1797475b7866f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36af7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36af7fe640 1 -- 10.20.193.28:0/4082300099 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36f0004e40 con 0x564ba96cbb20 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36af7fe640 1 -- 10.20.193.28:0/4082300099 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f36f001de50 con 0x564ba96cbb20 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f0005240 con 0x564ba96cbb20 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fdd6ce00 10 client.19878 _ll_register_callbacks cb 0x564ba9513a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36e4038920 con 0x564ba96cbb20 2026-02-20T13:29:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.807+0000 7f36af7fe640 1 -- 10.20.193.28:0/4082300099 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36f00266b0 con 0x564ba96cbb20 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36af7fe640 1 -- 10.20.193.28:0/4082300099 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f36f001d970 con 0x564ba96cbb20 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36af7fe640 1 -- 10.20.193.28:0/4082300099 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36f001db30 con 0x564ba96cbb20 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36fdd6ce00 10 client.19878 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x564ba9528340 con 0x564ba96cbb20 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36af7fe640 1 -- 10.20.193.28:0/4082300099 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f36f002d070 con 0x564ba96cbb20 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36fdd6ce00 10 client.19878 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36fdd6ce00 10 client.19878 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36fdd6ce00 20 client.19878 populate_metadata read hostname 'trial028' 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564ba9669ef0 0x564ba966a360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36fdd6ce00 4 client.19878 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ba9225f40 con 0x564ba9669ef0 2026-02-20T13:29:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.808+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564ba9669ef0 0x564ba966a360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.809+0000 7f36f9ae7640 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564ba9669ef0 0x564ba966a360 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=7688927095868129503 s_cookie=8833884193998845813 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ab48e74bd1880df server_cookie=7a9842deda3d3775 in_seq=0 out_seq=0 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.809+0000 7f36af7fe640 10 client.19878 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.809+0000 7f36af7fe640 1 -- 10.20.193.28:0/4082300099 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ba9225f40 con 0x564ba9669ef0 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.809+0000 7f36af7fe640 10 client.19878 handle_command_reply: tid=0 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.809+0000 7f36fdd6ce00 1 client.19878 shutdown 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.809+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba96cbb20 msgr2=0x564ba9667c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.809+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba96cbb20 0x564ba9667c60 secure :-1 s=READY pgs=1315 gs=2 cs=0 l=1 c_cookie=17641014756485072495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f0020040 tx=0x7f36f0011c20 comp rx=0 tx=0).stop 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 shutdown_connections 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564ba9669ef0 0x564ba966a360 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=7688927095868129503 s_cookie=8833884193998845813 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564ba96cbb20 0x564ba9667c60 unknown :-1 s=CLOSED pgs=1315 gs=2 cs=0 l=1 c_cookie=17641014756485072495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564ba9686c70 0x564ba96e6e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 1 --2- 10.20.193.28:0/4082300099 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564ba9686360 0x564ba96e6900 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36af7fe640 0 client.19878 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:29:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 >> 10.20.193.28:0/4082300099 conn(0x564ba9664860 msgr2=0x564ba9685050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 shutdown_connections 2026-02-20T13:29:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 1 -- 10.20.193.28:0/4082300099 wait complete. 2026-02-20T13:29:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fdd6ce00 20 client.19878 trim_cache size 0 max 16384 2026-02-20T13:29:41.818 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 -- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f36d00b5750 msgr2=0x7f36d00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f36d00b5750 0x7f36d00d5c00 secure :-1 s=READY pgs=551 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f40fb400 tx=0x7f36e8005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 -- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 msgr2=0x7f36f40f4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 0x7f36f40f4a60 secure :-1 s=READY pgs=1312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36e40023d0 tx=0x7f36e4004290 comp rx=0 tx=0).stop 2026-02-20T13:29:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 -- 10.20.193.28:0/705516230 shutdown_connections 2026-02-20T13:29:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f36d00b5750 0x7f36d00d5c00 unknown :-1 s=CLOSED pgs=551 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f36f4111fd0 0x7f36f40f5160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f36f410c7d0 0x7f36f41728a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 --2- 10.20.193.28:0/705516230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36f410bde0 0x7f36f40f4a60 unknown :-1 s=CLOSED pgs=1312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:41.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 -- 10.20.193.28:0/705516230 >> 10.20.193.28:0/705516230 conn(0x7f36f40e9670 msgr2=0x7f36f4110680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:41.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 -- 10.20.193.28:0/705516230 shutdown_connections 2026-02-20T13:29:41.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:41.810+0000 7f36fbd72640 1 -- 10.20.193.28:0/705516230 wait complete. 2026-02-20T13:29:41.909 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:29:42.093 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:42.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 -- 10.20.193.28:0/43485719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 msgr2=0x7f6900114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 --2- 10.20.193.28:0/43485719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 0x7f6900114ef0 secure :-1 s=READY pgs=1316 gs=1 cs=0 l=1 c_cookie=1678887726297302521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f4009950 tx=0x7f68f402f190 comp rx=0 tx=0).stop 2026-02-20T13:29:42.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 -- 10.20.193.28:0/43485719 shutdown_connections 2026-02-20T13:29:42.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 --2- 10.20.193.28:0/43485719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 0x7f6900114ef0 unknown :-1 s=CLOSED pgs=1316 gs=1 cs=0 l=1 c_cookie=1678887726297302521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 --2- 10.20.193.28:0/43485719 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f69001156a0 0x7f6900176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 --2- 10.20.193.28:0/43485719 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f690010f4b0 0x7f690010f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 -- 10.20.193.28:0/43485719 >> 10.20.193.28:0/43485719 conn(0x7f69000ecda0 msgr2=0x7f690010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 -- 10.20.193.28:0/43485719 shutdown_connections 2026-02-20T13:29:42.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.262+0000 7f690685d640 1 -- 10.20.193.28:0/43485719 wait complete. 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.263+0000 7f690685d640 1 Processor -- start 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.263+0000 7f690685d640 1 -- start start 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.263+0000 7f690685d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f690010f4b0 0x7f69000f57c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690685d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 0x7f6900175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690685d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f69001156a0 0x7f69000f5ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690685d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f69000fb0d0 con 0x7f690010fea0 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690685d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f69000fb240 con 0x7f690010f4b0 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690685d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f69000fb400 con 0x7f69001156a0 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 0x7f6900175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 0x7f6900175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54934/0 (socket says 10.20.193.28:54934) 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 -- 10.20.193.28:0/2442554710 learned_addr learned my addr 10.20.193.28:0/2442554710 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690605c640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f69001156a0 0x7f69000f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 -- 10.20.193.28:0/2442554710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f69001156a0 msgr2=0x7f69000f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f69001156a0 0x7f69000f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 -- 10.20.193.28:0/2442554710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f690010f4b0 msgr2=0x7f69000f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f690010f4b0 0x7f69000f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 -- 10.20.193.28:0/2442554710 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f4009570 con 0x7f690010fea0 2026-02-20T13:29:42.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f690505a640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 0x7f6900175f70 secure :-1 s=READY pgs=1317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f4038820 tx=0x7f68f40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.264+0000 7f68eeffd640 1 -- 10.20.193.28:0/2442554710 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68f403d070 con 0x7f690010fea0 2026-02-20T13:29:42.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.265+0000 7f68eeffd640 1 -- 10.20.193.28:0/2442554710 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68f4038920 con 0x7f690010fea0 2026-02-20T13:29:42.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.265+0000 7f68eeffd640 1 -- 10.20.193.28:0/2442554710 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68f4041960 con 0x7f690010fea0 2026-02-20T13:29:42.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.265+0000 7f690685d640 1 -- 10.20.193.28:0/2442554710 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69000fb680 con 0x7f690010fea0 2026-02-20T13:29:42.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.265+0000 7f690685d640 1 -- 10.20.193.28:0/2442554710 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69000fbaa0 con 0x7f690010fea0 2026-02-20T13:29:42.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.268+0000 7f68eeffd640 1 -- 10.20.193.28:0/2442554710 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f68f4048020 con 0x7f690010fea0 2026-02-20T13:29:42.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.270+0000 7f68eeffd640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68dc0b5750 0x7f68dc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.270+0000 7f68eeffd640 1 -- 10.20.193.28:0/2442554710 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f68f410af30 con 0x7f690010fea0 2026-02-20T13:29:42.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.270+0000 7f690585b640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68dc0b5750 0x7f68dc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.270+0000 7f6909ae0e00 1 Processor -- start 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f6909ae0e00 1 -- start start 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690585b640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68dc0b5750 0x7f68dc0d5c00 secure :-1 s=READY pgs=552 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f0005970 tx=0x7f68f0005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521360 0x5596a0521730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521c70 0x5596a05665e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0586f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596a0437780 con 0x5596a0566b20 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596a04334b0 con 0x5596a0521c70 2026-02-20T13:29:42.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596a042d450 con 0x5596a0521360 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690605c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0586f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690605c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0586f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54938/0 (socket says 10.20.193.28:54938) 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690605c640 1 -- 10.20.193.28:0/3236174620 learned_addr learned my addr 10.20.193.28:0/3236174620 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690505a640 1 --2- 10.20.193.28:0/3236174620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521c70 0x5596a05665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690605c640 1 -- 10.20.193.28:0/3236174620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521360 msgr2=0x5596a0521730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690605c640 1 --2- 10.20.193.28:0/3236174620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521360 0x5596a0521730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690605c640 1 -- 10.20.193.28:0/3236174620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521c70 msgr2=0x5596a05665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690605c640 1 --2- 10.20.193.28:0/3236174620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521c70 0x5596a05665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.271+0000 7f690605c640 1 -- 10.20.193.28:0/3236174620 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a03d8d10 con 0x5596a0566b20 2026-02-20T13:29:42.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f690605c640 1 --2- 10.20.193.28:0/3236174620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0586f00 secure :-1 s=READY pgs=1318 gs=1 cs=0 l=1 c_cookie=640801956739389854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68fc006d50 tx=0x7f68fc003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e495fc0ad3999e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f68ce4e6640 1 -- 10.20.193.28:0/3236174620 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68fc010c50 con 0x5596a0566b20 2026-02-20T13:29:42.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f68ce4e6640 1 -- 10.20.193.28:0/3236174620 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68fc010db0 con 0x5596a0566b20 2026-02-20T13:29:42.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f68ce4e6640 1 -- 10.20.193.28:0/3236174620 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68fc0119c0 con 0x5596a0566b20 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 -- 10.20.193.28:0/3236174620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 msgr2=0x5596a0586f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/3236174620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0586f00 secure :-1 s=READY pgs=1318 gs=1 cs=0 l=1 c_cookie=640801956739389854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68fc006d50 tx=0x7f68fc003ea0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 -- 10.20.193.28:0/3236174620 shutdown_connections 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/3236174620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0586f00 unknown :-1 s=CLOSED pgs=1318 gs=1 cs=0 l=1 c_cookie=640801956739389854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/3236174620 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521c70 0x5596a05665e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/3236174620 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521360 0x5596a0521730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 -- 10.20.193.28:0/3236174620 >> 10.20.193.28:0/3236174620 conn(0x5596a04ff860 msgr2=0x5596a051fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 -- 10.20.193.28:0/3236174620 shutdown_connections 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.272+0000 7f6909ae0e00 1 -- 10.20.193.28:0/3236174620 wait complete. 2026-02-20T13:29:42.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.273+0000 7f6909ae0e00 1 -- start start 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f6909ae0e00 1 Processor -- start 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 0x5596a05278e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0527e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a05255b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596a0525af0 con 0x5596a0566b20 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596a0525c60 con 0x5596a0521360 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596a0525e20 con 0x5596a0521c70 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f690505a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0527e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f690505a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0527e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41712/0 (socket says 10.20.193.28:41712) 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f690505a640 1 -- 10.20.193.28:0/2341636338 learned_addr learned my addr 10.20.193.28:0/2341636338 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f690585b640 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 0x5596a05278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.274+0000 7f690605c640 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a05255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.275+0000 7f690505a640 1 -- 10.20.193.28:0/2341636338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 msgr2=0x5596a05278e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.275+0000 7f690505a640 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 0x5596a05278e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.275+0000 7f690505a640 1 -- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 msgr2=0x5596a05255b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.275+0000 7f690505a640 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a05255b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.275+0000 7f690505a640 1 -- 10.20.193.28:0/2341636338 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a03b13c0 con 0x5596a0521c70 2026-02-20T13:29:42.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.275+0000 7f690605c640 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a05255b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.276+0000 7f690505a640 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0527e20 secure :-1 s=READY pgs=380 gs=2 cs=0 l=1 c_cookie=15142456500801381762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f40ce500 tx=0x7f68f402f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d224cff595122582 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.276+0000 7f68bb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.276+0000 7f68bb7fe640 1 -- 10.20.193.28:0/2341636338 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68f4108ea0 con 0x5596a0521c70 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.276+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68fc005550 con 0x5596a0521c70 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.276+0000 7f6909ae0e00 10 client.29701 _ll_register_callbacks cb 0x5596a03aea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.276+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596a00c36f0 con 0x5596a0521c70 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.276+0000 7f68bb7fe640 1 -- 10.20.193.28:0/2341636338 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68f40d1c90 con 0x5596a0521c70 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.276+0000 7f68bb7fe640 1 -- 10.20.193.28:0/2341636338 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68f40dc1c0 con 0x5596a0521c70 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f68bb7fe640 1 -- 10.20.193.28:0/2341636338 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f68f40eb050 con 0x5596a0521c70 2026-02-20T13:29:42.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f68bb7fe640 1 -- 10.20.193.28:0/2341636338 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68f4092070 con 0x5596a0521c70 2026-02-20T13:29:42.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f6909ae0e00 10 client.29701 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:42.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5596a03c30e0 con 0x5596a0521c70 2026-02-20T13:29:42.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f68bb7fe640 1 -- 10.20.193.28:0/2341636338 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f68f4095030 con 0x5596a0521c70 2026-02-20T13:29:42.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f6909ae0e00 10 client.29701 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:42.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.277+0000 7fcdbffff640 1 -- 10.20.193.28:0/1744324918 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdcc0396f0 con 0x7fcdd0110ce0 2026-02-20T13:29:42.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f6909ae0e00 10 client.29701 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:29:42.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f6909ae0e00 20 client.29701 populate_metadata read hostname 'trial028' 2026-02-20T13:29:42.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5596a054c7f0 0x5596a054cc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f6909ae0e00 4 client.29701 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:42.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.277+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596a03cff80 con 0x5596a054c7f0 2026-02-20T13:29:42.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.278+0000 7f690585b640 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5596a054c7f0 0x5596a054cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 -- 10.20.193.28:0/1744324918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd0110ce0 msgr2=0x7fcdd0171670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/1744324918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd0110ce0 0x7fcdd0171670 secure :-1 s=READY pgs=381 gs=3 cs=0 l=1 c_cookie=1596576366114262679 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdcc00a970 tx=0x7fcdcc0301b0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 -- 10.20.193.28:0/1744324918 shutdown_connections 2026-02-20T13:29:42.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/1744324918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd0110ce0 0x7fcdd0171670 unknown :-1 s=CLOSED pgs=381 gs=3 cs=0 l=1 c_cookie=1596576366114262679 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/1744324918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdd0110330 0x7fcdd01107a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/1744324918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdd010f1a0 0x7fcdd010f590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 -- 10.20.193.28:0/1744324918 >> 10.20.193.28:0/1744324918 conn(0x7fcdd00ec8f0 msgr2=0x7fcdd010cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 -- 10.20.193.28:0/1744324918 shutdown_connections 2026-02-20T13:29:42.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.278+0000 7fcdd72cc640 1 -- 10.20.193.28:0/1744324918 wait complete. 2026-02-20T13:29:42.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.278+0000 7f690585b640 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5596a054c7f0 0x5596a054cc90 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=4637730491602948723 s_cookie=11795860345003159192 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=405c874f73fdd273 server_cookie=a3b3507c9407ae98 in_seq=0 out_seq=0 2026-02-20T13:29:42.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.278+0000 7f68bb7fe640 10 client.29701 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:29:42.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd72cc640 1 Processor -- start 2026-02-20T13:29:42.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd72cc640 1 -- start start 2026-02-20T13:29:42.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.279+0000 7f68bb7fe640 1 -- 10.20.193.28:0/2341636338 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5596a03cff80 con 0x5596a054c7f0 2026-02-20T13:29:42.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd72cc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd010f1a0 0x7fcdd00f8840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd72cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdd0110330 0x7fcdd0171670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd72cc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdd0110ce0 0x7fcdd00f90a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd72cc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00f9c90 con 0x7fcdd0110330 2026-02-20T13:29:42.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd72cc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00f9e00 con 0x7fcdd0110ce0 2026-02-20T13:29:42.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd72cc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00f9fc0 con 0x7fcdd010f1a0 2026-02-20T13:29:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.279+0000 7f68bb7fe640 10 client.29701 handle_command_reply: tid=0 2026-02-20T13:29:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.279+0000 7f6909ae0e00 1 client.29701 shutdown 2026-02-20T13:29:42.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd5041640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd010f1a0 0x7fcdd00f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd4840640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdd0110330 0x7fcdd0171670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd5842640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdd0110ce0 0x7fcdd00f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd5041640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd010f1a0 0x7fcdd00f8840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41732/0 (socket says 10.20.193.28:41732) 2026-02-20T13:29:42.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.279+0000 7fcdd5041640 1 -- 10.20.193.28:0/358638952 learned_addr learned my addr 10.20.193.28:0/358638952 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.279+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 msgr2=0x5596a0527e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.279+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0527e20 secure :-1 s=READY pgs=380 gs=2 cs=0 l=1 c_cookie=15142456500801381762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f40ce500 tx=0x7f68f402f190 comp rx=0 tx=0).stop 2026-02-20T13:29:42.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd5041640 1 -- 10.20.193.28:0/358638952 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdd0110ce0 msgr2=0x7fcdd00f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd5041640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdd0110ce0 0x7fcdd00f90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd5041640 1 -- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdd0110330 msgr2=0x7fcdd0171670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd5041640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdd0110330 0x7fcdd0171670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd5041640 1 -- 10.20.193.28:0/358638952 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc0009570 con 0x7fcdd010f1a0 2026-02-20T13:29:42.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd4840640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdd0110330 0x7fcdd0171670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:42.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 shutdown_connections 2026-02-20T13:29:42.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5596a054c7f0 0x5596a054cc90 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=4637730491602948723 s_cookie=11795860345003159192 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a05255b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0527e20 unknown :-1 s=CLOSED pgs=380 gs=2 cs=0 l=1 c_cookie=15142456500801381762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2341636338 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 0x5596a05278e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f68bb7fe640 0 client.29701 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:29:42.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 >> 10.20.193.28:0/2341636338 conn(0x5596a04ff860 msgr2=0x5596a051fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 shutdown_connections 2026-02-20T13:29:42.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd5041640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd010f1a0 0x7fcdd00f8840 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc0005b30 tx=0x7fcdc0002c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2341636338 wait complete. 2026-02-20T13:29:42.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.280+0000 7f6909ae0e00 20 client.29701 trim_cache size 0 max 16384 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdbe7fc640 1 -- 10.20.193.28:0/358638952 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc000ed60 con 0x7fcdd010f1a0 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd72cc640 1 -- 10.20.193.28:0/358638952 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc00a590 con 0x7fcdd010f1a0 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdbe7fc640 1 -- 10.20.193.28:0/358638952 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdc0002e70 con 0x7fcdd010f1a0 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdd72cc640 1 -- 10.20.193.28:0/358638952 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd00fa630 con 0x7fcdd010f1a0 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.280+0000 7fcdbe7fc640 1 -- 10.20.193.28:0/358638952 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc000f810 con 0x7fcdd010f1a0 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.283+0000 7fcdbe7fc640 1 -- 10.20.193.28:0/358638952 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcdc001f060 con 0x7fcdd010f1a0 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.285+0000 7fcdbe7fc640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdac0b56e0 0x7fcdac0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.285+0000 7fcdbe7fc640 1 -- 10.20.193.28:0/358638952 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdc00e6ed0 con 0x7fcdd010f1a0 2026-02-20T13:29:42.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.285+0000 7fcdd4840640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdac0b56e0 0x7fcdac0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd98c4e00 1 Processor -- start 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd98c4e00 1 -- start start 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af638a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af841c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af84700 0x56002afa4ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56002ae58fd0 con 0x56002af434c0 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56002ae54d00 con 0x56002af84700 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56002ae4eca0 con 0x56002af63de0 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd4840640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdac0b56e0 0x7fcdac0d5b90 secure :-1 s=READY pgs=553 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc4004740 tx=0x7fcdc4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5041640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5842640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af84700 0x56002afa4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5842640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af84700 0x56002afa4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38154/0 (socket says 10.20.193.28:38154) 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5842640 1 -- 10.20.193.28:0/1431609743 learned_addr learned my addr 10.20.193.28:0/1431609743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd4840640 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5842640 1 -- 10.20.193.28:0/1431609743 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 msgr2=0x56002af841c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5842640 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af841c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5842640 1 -- 10.20.193.28:0/1431609743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 msgr2=0x56002af638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5842640 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5842640 1 -- 10.20.193.28:0/1431609743 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002adf18b0 con 0x56002af84700 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.286+0000 7fcdd5041640 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af638a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd5842640 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af84700 0x56002afa4ae0 secure :-1 s=READY pgs=462 gs=2 cs=0 l=1 c_cookie=16247061670277674238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdcc006a40 tx=0x7fcdcc003e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e17928822cc3f4fe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcd9d7fe640 1 -- 10.20.193.28:0/1431609743 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdcc03e070 con 0x56002af84700 2026-02-20T13:29:42.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcd9d7fe640 1 -- 10.20.193.28:0/1431609743 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdcc03f040 con 0x56002af84700 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcd9d7fe640 1 -- 10.20.193.28:0/1431609743 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdcc005050 con 0x56002af84700 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/1431609743 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af84700 msgr2=0x56002afa4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af84700 0x56002afa4ae0 secure :-1 s=READY pgs=462 gs=2 cs=0 l=1 c_cookie=16247061670277674238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdcc006a40 tx=0x7fcdcc003e40 comp rx=0 tx=0).stop 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/1431609743 shutdown_connections 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af84700 0x56002afa4ae0 unknown :-1 s=CLOSED pgs=462 gs=2 cs=0 l=1 c_cookie=16247061670277674238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af841c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/1431609743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af638a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/1431609743 >> 10.20.193.28:0/1431609743 conn(0x56002ae621c0 msgr2=0x56002af41da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/1431609743 shutdown_connections 2026-02-20T13:29:42.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.287+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/1431609743 wait complete. 2026-02-20T13:29:42.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f6909ae0e00 1 Processor -- start 2026-02-20T13:29:42.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.289+0000 7fcdd98c4e00 1 -- start start 2026-02-20T13:29:42.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f6909ae0e00 1 -- start start 2026-02-20T13:29:42.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.289+0000 7fcdd98c4e00 1 Processor -- start 2026-02-20T13:29:42.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 0x5596a05255a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0565f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0566490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596a042b080 con 0x5596a0566b20 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596a00eb700 con 0x5596a0521360 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596a0528420 con 0x5596a0521c70 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690605c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0566490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690505a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0565f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690505a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0565f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41756/0 (socket says 10.20.193.28:41756) 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690585b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 0x5596a05255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690505a640 1 -- 10.20.193.28:0/2848484996 learned_addr learned my addr 10.20.193.28:0/2848484996 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690605c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0566490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54994/0 (socket says 10.20.193.28:54994) 2026-02-20T13:29:42.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.289+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af5c830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.289+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af63de0 0x56002af5ce80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.289+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 0x56002af5d8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.289+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56002af5df40 con 0x56002af63de0 2026-02-20T13:29:42.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.289+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56002af5e0b0 con 0x56002af434c0 2026-02-20T13:29:42.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.289+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56002af5e270 con 0x56002af84700 2026-02-20T13:29:42.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690505a640 1 -- 10.20.193.28:0/2848484996 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 msgr2=0x5596a05255a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690505a640 1 --2- 10.20.193.28:0/2848484996 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 0x5596a05255a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690505a640 1 -- 10.20.193.28:0/2848484996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 msgr2=0x5596a0566490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.289+0000 7f690505a640 1 --2- 10.20.193.28:0/2848484996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0566490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.290+0000 7f690505a640 1 -- 10.20.193.28:0/2848484996 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a03bdb60 con 0x5596a0521c70 2026-02-20T13:29:42.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.290+0000 7f690605c640 1 --2- 10.20.193.28:0/2848484996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0566490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:42.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af5c830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af5c830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38166/0 (socket says 10.20.193.28:38166) 2026-02-20T13:29:42.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 -- 10.20.193.28:0/3227202333 learned_addr learned my addr 10.20.193.28:0/3227202333 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5842640 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 0x56002af5d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd4840640 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af63de0 0x56002af5ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.290+0000 7f690505a640 1 --2- 10.20.193.28:0/2848484996 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0565f50 secure :-1 s=READY pgs=383 gs=2 cs=0 l=1 c_cookie=8773041866148357046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f40d1500 tx=0x7f68f410a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79c01b187f6723b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 -- 10.20.193.28:0/3227202333 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 msgr2=0x56002af5d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 0x56002af5d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 -- 10.20.193.28:0/3227202333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af63de0 msgr2=0x56002af5ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af63de0 0x56002af5ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 -- 10.20.193.28:0/3227202333 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002adfa400 con 0x56002af434c0 2026-02-20T13:29:42.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd5041640 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af5c830 secure :-1 s=READY pgs=463 gs=3 cs=0 l=1 c_cookie=14105176015995888624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc00041e0 tx=0x7fcdc00af440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bfa6daa7cb63f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcd8a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:42.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/3227202333 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc005b280 con 0x56002af434c0 2026-02-20T13:29:42.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd0171fc0 con 0x56002af434c0 2026-02-20T13:29:42.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd98c4e00 10 client.29843 _ll_register_callbacks cb 0x56002add9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:42.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/3227202333 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdc00c8070 con 0x56002af434c0 2026-02-20T13:29:42.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56002aaee520 con 0x56002af434c0 2026-02-20T13:29:42.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/3227202333 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc00ad050 con 0x56002af434c0 2026-02-20T13:29:42.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.290+0000 7f68cdce5640 1 -- 10.20.193.28:0/2848484996 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68f4108ea0 con 0x5596a0521c70 2026-02-20T13:29:42.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.290+0000 7f68cdce5640 1 -- 10.20.193.28:0/2848484996 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5596a00c36f0 con 0x5596a0521c70 2026-02-20T13:29:42.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.290+0000 7f68cdce5640 1 -- 10.20.193.28:0/2848484996 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68f40d7040 con 0x5596a0521c70 2026-02-20T13:29:42.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.290+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/3227202333 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdc00e4e40 con 0x56002af434c0 2026-02-20T13:29:42.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.290+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2848484996 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 msgr2=0x5596a0565f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.290+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2848484996 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0565f50 secure :-1 s=READY pgs=383 gs=2 cs=0 l=1 c_cookie=8773041866148357046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f40d1500 tx=0x7f68f410a000 comp rx=0 tx=0).stop 2026-02-20T13:29:42.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.291+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2848484996 shutdown_connections 2026-02-20T13:29:42.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.291+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2848484996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0566b20 0x5596a0566490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.291+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2848484996 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a0565f50 unknown :-1 s=CLOSED pgs=383 gs=2 cs=0 l=1 c_cookie=8773041866148357046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.291+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/2848484996 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0521360 0x5596a05255a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.291+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2848484996 >> 10.20.193.28:0/2848484996 conn(0x5596a04ff860 msgr2=0x5596a0578cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.291+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2848484996 shutdown_connections 2026-02-20T13:29:42.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.291+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/3227202333 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcdc00b83e0 con 0x56002af434c0 2026-02-20T13:29:42.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.291+0000 7fcdd98c4e00 10 client.29843 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:42.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.291+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56002add2da0 con 0x56002af434c0 2026-02-20T13:29:42.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.291+0000 7f6909ae0e00 1 -- 10.20.193.28:0/2848484996 wait complete. 2026-02-20T13:29:42.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.291+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/3227202333 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fcdc0016070 con 0x56002af434c0 2026-02-20T13:29:42.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.292+0000 7fcdd98c4e00 10 client.29843 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:42.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.292+0000 7fcdd98c4e00 10 client.29843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:42.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.292+0000 7fcdd98c4e00 20 client.29843 populate_metadata read hostname 'trial028' 2026-02-20T13:29:42.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.292+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56002af62da0 0x56002af63240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.292+0000 7fcdd98c4e00 4 client.29843 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:42.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.292+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56002ae80630 con 0x56002af62da0 2026-02-20T13:29:42.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f6909ae0e00 1 -- start start 2026-02-20T13:29:42.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.292+0000 7fcdd4840640 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56002af62da0 0x56002af63240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f6909ae0e00 1 Processor -- start 2026-02-20T13:29:42.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0521360 0x5596a055f220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a055f780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f6909ae0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0566b20 0x5596a0559bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596a057ff90 con 0x5596a0521360 2026-02-20T13:29:42.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596a055a300 con 0x5596a0566b20 2026-02-20T13:29:42.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f6909ae0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596a055a4c0 con 0x5596a0521c70 2026-02-20T13:29:42.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f690585b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0521360 0x5596a055f220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f690585b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0521360 0x5596a055f220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55008/0 (socket says 10.20.193.28:55008) 2026-02-20T13:29:42.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.292+0000 7f690585b640 1 -- 10.20.193.28:0/295118661 learned_addr learned my addr 10.20.193.28:0/295118661 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f690505a640 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a055f780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.293+0000 7fcdd4840640 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56002af62da0 0x56002af63240 crc :-1 s=READY pgs=352 gs=4 cs=0 l=0 c_cookie=8047358422831142956 s_cookie=11582893575476287124 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fadf5d94d19182c server_cookie=a0beb4568d6b1694 in_seq=0 out_seq=0 2026-02-20T13:29:42.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.293+0000 7fcd8a7fc640 10 client.29843 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:42.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f690605c640 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0566b20 0x5596a0559bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f690585b640 1 -- 10.20.193.28:0/295118661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 msgr2=0x5596a055f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f690585b640 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a055f780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f690585b640 1 -- 10.20.193.28:0/295118661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0566b20 msgr2=0x5596a0559bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f690585b640 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0566b20 0x5596a0559bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f690585b640 1 -- 10.20.193.28:0/295118661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a03c30e0 con 0x5596a0521360 2026-02-20T13:29:42.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f690585b640 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0521360 0x5596a055f220 secure :-1 s=READY pgs=1319 gs=1 cs=0 l=1 c_cookie=2930360705168309661 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f00044a0 tx=0x7f68f000dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28aabb891f51fd9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.293+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/3227202333 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56002ae80630 con 0x56002af62da0 2026-02-20T13:29:42.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.293+0000 7fcd8a7fc640 10 client.29843 handle_command_reply: tid=0 2026-02-20T13:29:42.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.293+0000 7fcdd98c4e00 1 client.29843 shutdown 2026-02-20T13:29:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f68bb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f68bb7fe640 1 -- 10.20.193.28:0/295118661 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68f0015040 con 0x5596a0521360 2026-02-20T13:29:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a03d8d10 con 0x5596a0521360 2026-02-20T13:29:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f68bb7fe640 1 -- 10.20.193.28:0/295118661 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68f0025040 con 0x5596a0521360 2026-02-20T13:29:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f6909ae0e00 10 client.19908 _ll_register_callbacks cb 0x5596a03aea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68fc010db0 con 0x5596a0521360 2026-02-20T13:29:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.293+0000 7f68bb7fe640 1 -- 10.20.193.28:0/295118661 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68f0010da0 con 0x5596a0521360 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 msgr2=0x56002af5c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af5c830 secure :-1 s=READY pgs=463 gs=3 cs=0 l=1 c_cookie=14105176015995888624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc00041e0 tx=0x7fcdc00af440 comp rx=0 tx=0).stop 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 shutdown_connections 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56002af62da0 0x56002af63240 crc :-1 s=READY pgs=352 gs=4 cs=0 l=0 c_cookie=8047358422831142956 s_cookie=11582893575476287124 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af63de0 0x56002af5ce80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 0x56002af5d8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/3227202333 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af5c830 unknown :-1 s=CLOSED pgs=463 gs=3 cs=0 l=1 c_cookie=14105176015995888624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcd8a7fc640 0 client.29843 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 >> 10.20.193.28:0/3227202333 conn(0x56002ae621c0 msgr2=0x56002af44790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 shutdown_connections 2026-02-20T13:29:42.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f68bb7fe640 1 -- 10.20.193.28:0/295118661 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f68f00028c0 con 0x5596a0521360 2026-02-20T13:29:42.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f68bb7fe640 1 -- 10.20.193.28:0/295118661 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68f0002ac0 con 0x5596a0521360 2026-02-20T13:29:42.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f6909ae0e00 10 client.19908 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:42.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5596a03b16f0 con 0x5596a0521360 2026-02-20T13:29:42.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f68bb7fe640 1 -- 10.20.193.28:0/295118661 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f68f001b040 con 0x5596a0521360 2026-02-20T13:29:42.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f6909ae0e00 10 client.19908 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:42.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f6909ae0e00 10 client.19908 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:29:42.319 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/3227202333 wait complete. 2026-02-20T13:29:42.319 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.294+0000 7fcdd98c4e00 20 client.29843 trim_cache size 0 max 16384 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f6909ae0e00 20 client.19908 populate_metadata read hostname 'trial028' 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5596a061d0c0 0x5596a063d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.294+0000 7f690505a640 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5596a061d0c0 0x5596a063d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 4 client.19908 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596a00c0f40 con 0x5596a061d0c0 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f690505a640 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5596a061d0c0 0x5596a063d570 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=2771039918605954649 s_cookie=13016096387878040194 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2674b61fd6ef6e59 server_cookie=b4a276b3d9b73282 in_seq=0 out_seq=0 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f68bb7fe640 10 client.19908 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f68bb7fe640 1 -- 10.20.193.28:0/295118661 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596a00c0f40 con 0x5596a061d0c0 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f68bb7fe640 10 client.19908 handle_command_reply: tid=0 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 client.19908 shutdown 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0521360 msgr2=0x5596a055f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0521360 0x5596a055f220 secure :-1 s=READY pgs=1319 gs=1 cs=0 l=1 c_cookie=2930360705168309661 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f00044a0 tx=0x7f68f000dc20 comp rx=0 tx=0).stop 2026-02-20T13:29:42.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 shutdown_connections 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5596a061d0c0 0x5596a063d570 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=2771039918605954649 s_cookie=13016096387878040194 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5596a0566b20 0x5596a0559bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5596a0521c70 0x5596a055f780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 --2- 10.20.193.28:0/295118661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596a0521360 0x5596a055f220 unknown :-1 s=CLOSED pgs=1319 gs=1 cs=0 l=1 c_cookie=2930360705168309661 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f68bb7fe640 0 client.19908 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.295+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 >> 10.20.193.28:0/295118661 conn(0x5596a04ff860 msgr2=0x5596a0565f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.296+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 shutdown_connections 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.296+0000 7f6909ae0e00 1 -- 10.20.193.28:0/295118661 wait complete. 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.296+0000 7f6909ae0e00 20 client.19908 trim_cache size 0 max 16384 2026-02-20T13:29:42.321 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.296+0000 7f690685d640 1 -- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68dc0b5750 msgr2=0x7f68dc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.296+0000 7f690685d640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68dc0b5750 0x7f68dc0d5c00 secure :-1 s=READY pgs=552 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f0005970 tx=0x7f68f0005900 comp rx=0 tx=0).stop 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.296+0000 7f690685d640 1 -- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 msgr2=0x7f6900175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.296+0000 7f690685d640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 0x7f6900175f70 secure :-1 s=READY pgs=1317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68f4038820 tx=0x7f68f40043d0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.297+0000 7f690685d640 1 -- 10.20.193.28:0/2442554710 shutdown_connections 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.297+0000 7f690685d640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f68dc0b5750 0x7f68dc0d5c00 unknown :-1 s=CLOSED pgs=552 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.297+0000 7f690685d640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f690010fea0 0x7f6900175f70 unknown :-1 s=CLOSED pgs=1317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.297+0000 7f690685d640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f69001156a0 0x7f69000f5ec0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.297+0000 7f690685d640 1 --2- 10.20.193.28:0/2442554710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f690010f4b0 0x7f69000f57c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.297+0000 7f690685d640 1 -- 10.20.193.28:0/2442554710 >> 10.20.193.28:0/2442554710 conn(0x7f69000ecda0 msgr2=0x7f690010d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.297+0000 7f690685d640 1 -- 10.20.193.28:0/2442554710 shutdown_connections 2026-02-20T13:29:42.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.297+0000 7f690685d640 1 -- 10.20.193.28:0/2442554710 wait complete. 2026-02-20T13:29:42.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.302+0000 7fcdd98c4e00 1 Processor -- start 2026-02-20T13:29:42.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.302+0000 7fcdd98c4e00 1 -- start start 2026-02-20T13:29:42.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.302+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af4e6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.302+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af63de0 0x56002af5c5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.302+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 0x56002af59b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.302+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56002ae4c8d0 con 0x56002af434c0 2026-02-20T13:29:42.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.302+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56002ab8df10 con 0x56002af63de0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.302+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56002af5db10 con 0x56002af84700 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af4e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af4e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55018/0 (socket says 10.20.193.28:55018) 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 -- 10.20.193.28:0/2274130840 learned_addr learned my addr 10.20.193.28:0/2274130840 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd4840640 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af63de0 0x56002af5c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5842640 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 0x56002af59b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 -- 10.20.193.28:0/2274130840 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 msgr2=0x56002af59b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 0x56002af59b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 -- 10.20.193.28:0/2274130840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af63de0 msgr2=0x56002af5c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af63de0 0x56002af5c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 -- 10.20.193.28:0/2274130840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002af4eea0 con 0x56002af434c0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcdd5041640 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af4e6d0 secure :-1 s=READY pgs=1320 gs=1 cs=0 l=1 c_cookie=12100637457632402434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc00ad4a0 tx=0x7fcdc00d0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ee19a7e1f71c02 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcd9cffd640 1 -- 10.20.193.28:0/2274130840 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc005b280 con 0x56002af434c0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcd9cffd640 1 -- 10.20.193.28:0/2274130840 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdc00c8070 con 0x56002af434c0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.303+0000 7fcd9cffd640 1 -- 10.20.193.28:0/2274130840 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdc00abf90 con 0x56002af434c0 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2274130840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 msgr2=0x56002af4e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af4e6d0 secure :-1 s=READY pgs=1320 gs=1 cs=0 l=1 c_cookie=12100637457632402434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc00ad4a0 tx=0x7fcdc00d0000 comp rx=0 tx=0).stop 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2274130840 shutdown_connections 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af84700 0x56002af59b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af63de0 0x56002af5c5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2274130840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af434c0 0x56002af4e6d0 unknown :-1 s=CLOSED pgs=1320 gs=1 cs=0 l=1 c_cookie=12100637457632402434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2274130840 >> 10.20.193.28:0/2274130840 conn(0x56002ae621c0 msgr2=0x56002af5bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2274130840 shutdown_connections 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.304+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2274130840 wait complete. 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd98c4e00 1 -- start start 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd98c4e00 1 Processor -- start 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af38de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af39480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd98c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af84700 0x56002af39e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56002af3a540 con 0x56002af84700 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56002af3a6b0 con 0x56002af434c0 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd98c4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56002af3a870 con 0x56002af63de0 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd5842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af84700 0x56002af39e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd4840640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af39480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd5842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af84700 0x56002af39e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55020/0 (socket says 10.20.193.28:55020) 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd4840640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af39480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41784/0 (socket says 10.20.193.28:41784) 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd5842640 1 -- 10.20.193.28:0/2301750662 learned_addr learned my addr 10.20.193.28:0/2301750662 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.305+0000 7fcdd5041640 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af38de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd5842640 1 -- 10.20.193.28:0/2301750662 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 msgr2=0x56002af39480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd5842640 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af39480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd5842640 1 -- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 msgr2=0x56002af38de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd5842640 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af38de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd5842640 1 -- 10.20.193.28:0/2301750662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002ade4670 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd5041640 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af38de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd5842640 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af84700 0x56002af39e90 secure :-1 s=READY pgs=1321 gs=3 cs=0 l=1 c_cookie=6336215527492858030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdcc0034b0 tx=0x7fcdcc00a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eec2739886b0ae server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcd8a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/2301750662 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdcc03e040 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/2301750662 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcdcc005530 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/2301750662 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdcc043c60 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002add2da0 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/2301750662 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcdcc043dc0 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcd8a7fc640 10 client.19914 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd98c4e00 10 client.19914 _ll_register_callbacks cb 0x56002add9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.306+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56002aefeca0 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.307+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/2301750662 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcdcc0056a0 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.307+0000 7fcdd98c4e00 10 client.19914 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.307+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56002addf0f0 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.308+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/2301750662 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fcdcc05d060 con 0x56002af84700 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.308+0000 7fcdd98c4e00 10 client.19914 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:42.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.308+0000 7fcdd98c4e00 10 client.19914 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.308+0000 7fcdd98c4e00 20 client.19914 populate_metadata read hostname 'trial028' 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.308+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56002af3c500 0x56002b05ad10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.308+0000 7fcdd98c4e00 4 client.19914 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.308+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56002ab32640 con 0x56002af3c500 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.308+0000 7fcdd5041640 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56002af3c500 0x56002b05ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.309+0000 7fcdd5041640 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56002af3c500 0x56002b05ad10 crc :-1 s=READY pgs=353 gs=4 cs=0 l=0 c_cookie=7704215544586560538 s_cookie=4105839958801823812 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aeadf38181fe41a server_cookie=38fadfb058fcb844 in_seq=0 out_seq=0 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.309+0000 7fcd8a7fc640 10 client.19914 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcd8a7fc640 1 -- 10.20.193.28:0/2301750662 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56002ab32640 con 0x56002af3c500 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcd8a7fc640 10 client.19914 handle_command_reply: tid=0 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcdd98c4e00 1 client.19914 shutdown 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af84700 msgr2=0x56002af39e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af84700 0x56002af39e90 secure :-1 s=READY pgs=1321 gs=3 cs=0 l=1 c_cookie=6336215527492858030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdcc0034b0 tx=0x7fcdcc00a310 comp rx=0 tx=0).stop 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 shutdown_connections 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56002af3c500 0x56002b05ad10 crc :-1 s=READY pgs=353 gs=4 cs=0 l=0 c_cookie=7704215544586560538 s_cookie=4105839958801823812 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002af84700 0x56002af39e90 unknown :-1 s=CLOSED pgs=1321 gs=3 cs=0 l=1 c_cookie=6336215527492858030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56002af63de0 0x56002af39480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.313+0000 7fcdd98c4e00 1 --2- 10.20.193.28:0/2301750662 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56002af434c0 0x56002af38de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 >> 10.20.193.28:0/2301750662 conn(0x56002ae621c0 msgr2=0x56002af5c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcd8a7fc640 0 client.19914 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 shutdown_connections 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcdd98c4e00 1 -- 10.20.193.28:0/2301750662 wait complete. 2026-02-20T13:29:42.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcdd98c4e00 20 client.19914 trim_cache size 0 max 16384 2026-02-20T13:29:42.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:29:42.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:29:42.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:29:42.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:29:42.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcdd72cc640 1 -- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdac0b56e0 msgr2=0x7fcdac0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdac0b56e0 0x7fcdac0d5b90 secure :-1 s=READY pgs=553 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc4004740 tx=0x7fcdc4005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:42.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcdd72cc640 1 -- 10.20.193.28:0/358638952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd010f1a0 msgr2=0x7fcdd00f8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.314+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd010f1a0 0x7fcdd00f8840 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdc0005b30 tx=0x7fcdc0002c10 comp rx=0 tx=0).stop 2026-02-20T13:29:42.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.315+0000 7fcdd72cc640 1 -- 10.20.193.28:0/358638952 shutdown_connections 2026-02-20T13:29:42.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.315+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcdac0b56e0 0x7fcdac0d5b90 unknown :-1 s=CLOSED pgs=553 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.315+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcdd0110330 0x7fcdd0171670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.315+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcdd0110ce0 0x7fcdd00f90a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.315+0000 7fcdd72cc640 1 --2- 10.20.193.28:0/358638952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcdd010f1a0 0x7fcdd00f8840 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.315+0000 7fcdd72cc640 1 -- 10.20.193.28:0/358638952 >> 10.20.193.28:0/358638952 conn(0x7fcdd00ec8f0 msgr2=0x7fcdd00eee90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.315+0000 7fcdd72cc640 1 -- 10.20.193.28:0/358638952 shutdown_connections 2026-02-20T13:29:42.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:42.315+0000 7fcdd72cc640 1 -- 10.20.193.28:0/358638952 wait complete. 2026-02-20T13:29:42.398 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:29:42.624 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:42.755 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:42 trial028 ceph-mon[37442]: pgmap v552: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2026-02-20T13:29:42.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 -- 10.20.193.28:0/479571966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 msgr2=0x7f1c9410bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 --2- 10.20.193.28:0/479571966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 0x7f1c9410bb80 secure :-1 s=READY pgs=1322 gs=1 cs=0 l=1 c_cookie=18252838082262344099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c80009950 tx=0x7f1c8002f1b0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 -- 10.20.193.28:0/479571966 shutdown_connections 2026-02-20T13:29:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 --2- 10.20.193.28:0/479571966 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c941119a0 0x7f1c94172370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 --2- 10.20.193.28:0/479571966 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9410c1a0 0x7f1c941111f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 --2- 10.20.193.28:0/479571966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 0x7f1c9410bb80 unknown :-1 s=CLOSED pgs=1322 gs=1 cs=0 l=1 c_cookie=18252838082262344099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 -- 10.20.193.28:0/479571966 >> 10.20.193.28:0/479571966 conn(0x7f1c940e9080 msgr2=0x7f1c94109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 -- 10.20.193.28:0/479571966 shutdown_connections 2026-02-20T13:29:42.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.802+0000 7f1c997f0640 1 -- 10.20.193.28:0/479571966 wait complete. 2026-02-20T13:29:42.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c997f0640 1 Processor -- start 2026-02-20T13:29:42.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c997f0640 1 -- start start 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c997f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 0x7f1c940f5fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c997f0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9410c1a0 0x7f1c94172270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c997f0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c941119a0 0x7f1c940f66a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c997f0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c940fb8b0 con 0x7f1c9410b7b0 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c997f0640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1c940fba20 con 0x7f1c941119a0 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c997f0640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1c940fbbe0 con 0x7f1c9410c1a0 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c93fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 0x7f1c940f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c98fef640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c941119a0 0x7f1c940f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c98fef640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c941119a0 0x7f1c940f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:38224/0 (socket says 10.20.193.28:38224) 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c98fef640 1 -- 10.20.193.28:0/2902331859 learned_addr learned my addr 10.20.193.28:0/2902331859 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.803+0000 7f1c937fe640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9410c1a0 0x7f1c94172270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c93fff640 1 -- 10.20.193.28:0/2902331859 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9410c1a0 msgr2=0x7f1c94172270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c93fff640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9410c1a0 0x7f1c94172270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c93fff640 1 -- 10.20.193.28:0/2902331859 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c941119a0 msgr2=0x7f1c940f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c93fff640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c941119a0 0x7f1c940f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c93fff640 1 -- 10.20.193.28:0/2902331859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c80009570 con 0x7f1c9410b7b0 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c937fe640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9410c1a0 0x7f1c94172270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c93fff640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 0x7f1c940f5fa0 secure :-1 s=READY pgs=1323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c80009950 tx=0x7f1c80004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c917fa640 1 -- 10.20.193.28:0/2902331859 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c8003d070 con 0x7f1c9410b7b0 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c917fa640 1 -- 10.20.193.28:0/2902331859 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c80038960 con 0x7f1c9410b7b0 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c917fa640 1 -- 10.20.193.28:0/2902331859 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c800418c0 con 0x7f1c9410b7b0 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c997f0640 1 -- 10.20.193.28:0/2902331859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c940fbe60 con 0x7f1c9410b7b0 2026-02-20T13:29:42.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.804+0000 7f1c997f0640 1 -- 10.20.193.28:0/2902331859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c940fc280 con 0x7f1c9410b7b0 2026-02-20T13:29:42.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.807+0000 7f1c917fa640 1 -- 10.20.193.28:0/2902331859 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1c80038ad0 con 0x7f1c9410b7b0 2026-02-20T13:29:42.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.809+0000 7f1c917fa640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c680b56d0 0x7f1c680d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.809+0000 7f1c917fa640 1 -- 10.20.193.28:0/2902331859 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c8010aff0 con 0x7f1c9410b7b0 2026-02-20T13:29:42.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.809+0000 7f1c937fe640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c680b56d0 0x7f1c680d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.809+0000 7f1c937fe640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c680b56d0 0x7f1c680d5b80 secure :-1 s=READY pgs=554 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c84005970 tx=0x7f1c84005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.809+0000 7f1c9ca73e00 1 Processor -- start 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c9ca73e00 1 -- start start 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081360 0x563ece081730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0c65e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece0c6b20 0x563ece0e6f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563ecdf97780 con 0x563ece081c70 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563ecdf934b0 con 0x563ece081360 2026-02-20T13:29:42.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563ecdf8d450 con 0x563ece0c6b20 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c93fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081360 0x563ece081730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55050/0 (socket says 10.20.193.28:55050) 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c937fe640 1 -- 10.20.193.28:0/2914100750 learned_addr learned my addr 10.20.193.28:0/2914100750 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c98fef640 1 --2- 10.20.193.28:0/2914100750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece0c6b20 0x563ece0e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c937fe640 1 -- 10.20.193.28:0/2914100750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece0c6b20 msgr2=0x563ece0e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c937fe640 1 --2- 10.20.193.28:0/2914100750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece0c6b20 0x563ece0e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c937fe640 1 -- 10.20.193.28:0/2914100750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081360 msgr2=0x563ece081730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c937fe640 1 --2- 10.20.193.28:0/2914100750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081360 0x563ece081730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.810+0000 7f1c937fe640 1 -- 10.20.193.28:0/2914100750 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ecdf38d10 con 0x563ece081c70 2026-02-20T13:29:42.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c937fe640 1 --2- 10.20.193.28:0/2914100750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0c65e0 secure :-1 s=READY pgs=1324 gs=2 cs=0 l=1 c_cookie=13147803885611370233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c84004630 tx=0x7f1c84012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67661f9525dc6f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c64ce3640 1 -- 10.20.193.28:0/2914100750 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c8401d410 con 0x563ece081c70 2026-02-20T13:29:42.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c64ce3640 1 -- 10.20.193.28:0/2914100750 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c8401da50 con 0x563ece081c70 2026-02-20T13:29:42.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c64ce3640 1 -- 10.20.193.28:0/2914100750 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c84010ac0 con 0x563ece081c70 2026-02-20T13:29:42.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/2914100750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 msgr2=0x563ece0c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/2914100750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0c65e0 secure :-1 s=READY pgs=1324 gs=2 cs=0 l=1 c_cookie=13147803885611370233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c84004630 tx=0x7f1c84012000 comp rx=0 tx=0).stop 2026-02-20T13:29:42.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/2914100750 shutdown_connections 2026-02-20T13:29:42.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/2914100750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0c65e0 unknown :-1 s=CLOSED pgs=1324 gs=2 cs=0 l=1 c_cookie=13147803885611370233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/2914100750 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece0c6b20 0x563ece0e6f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/2914100750 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081360 0x563ece081730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/2914100750 >> 10.20.193.28:0/2914100750 conn(0x563ece05f860 msgr2=0x563ece07fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/2914100750 shutdown_connections 2026-02-20T13:29:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.811+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/2914100750 wait complete. 2026-02-20T13:29:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.813+0000 7f1c9ca73e00 1 -- start start 2026-02-20T13:29:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.813+0000 7f1c9ca73e00 1 Processor -- start 2026-02-20T13:29:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.813+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0de760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.813+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081c70 0x563ece0deca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.813+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece0c6b20 0x563ece0e0a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.813+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563ece0e0fa0 con 0x563ece0c6b20 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.813+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563ece0e1110 con 0x563ece081c70 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.813+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563ece0e12d0 con 0x563ece081360 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece0c6b20 0x563ece0e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece0c6b20 0x563ece0e0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55062/0 (socket says 10.20.193.28:55062) 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 -- 10.20.193.28:0/3390674917 learned_addr learned my addr 10.20.193.28:0/3390674917 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c93fff640 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0de760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 -- 10.20.193.28:0/3390674917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 msgr2=0x563ece0de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0de760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 -- 10.20.193.28:0/3390674917 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081c70 msgr2=0x563ece0deca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081c70 0x563ece0deca0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 -- 10.20.193.28:0/3390674917 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ecdf113c0 con 0x563ece0c6b20 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c98fef640 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece0c6b20 0x563ece0e0a30 secure :-1 s=READY pgs=1325 gs=1 cs=0 l=1 c_cookie=6847753305139469848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c8800ea10 tx=0x7f1c8800eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f081b599e585e18 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.814+0000 7f1c55ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3390674917 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c8801d070 con 0x563ece0c6b20 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3390674917 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c8800ee30 con 0x563ece0c6b20 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3390674917 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c88013040 con 0x563ece0c6b20 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8400f9d0 con 0x563ece0c6b20 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c9ca73e00 10 client.19926 _ll_register_callbacks cb 0x563ecdf0ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ecdc236f0 con 0x563ece0c6b20 2026-02-20T13:29:42.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3390674917 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c88003a30 con 0x563ece0c6b20 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3390674917 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1c88003c10 con 0x563ece0c6b20 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c9ca73e00 10 client.19926 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563ecdf230e0 con 0x563ece0c6b20 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.815+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3390674917 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1c8800b830 con 0x563ece0c6b20 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.816+0000 7f1c9ca73e00 10 client.19926 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.816+0000 7f1c9ca73e00 10 client.19926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.816+0000 7f1c9ca73e00 20 client.19926 populate_metadata read hostname 'trial028' 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.816+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563ece0e6cf0 0x563ece0c48a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.816+0000 7f1c9ca73e00 4 client.19926 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.816+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ecdf2ff80 con 0x563ece0e6cf0 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.816+0000 7f1c93fff640 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563ece0e6cf0 0x563ece0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c93fff640 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563ece0e6cf0 0x563ece0c48a0 crc :-1 s=READY pgs=354 gs=3 cs=0 l=0 c_cookie=11211667333438503945 s_cookie=9071176351850981874 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b97d809ad73fc09 server_cookie=7de34ad4b30069f2 in_seq=0 out_seq=0 2026-02-20T13:29:42.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c55ffb640 10 client.19926 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:42.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3390674917 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563ecdf2ff80 con 0x563ece0e6cf0 2026-02-20T13:29:42.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c55ffb640 10 client.19926 handle_command_reply: tid=0 2026-02-20T13:29:42.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c9ca73e00 1 client.19926 shutdown 2026-02-20T13:29:42.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece0c6b20 msgr2=0x563ece0e0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece0c6b20 0x563ece0e0a30 secure :-1 s=READY pgs=1325 gs=1 cs=0 l=1 c_cookie=6847753305139469848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c8800ea10 tx=0x7f1c8800eb10 comp rx=0 tx=0).stop 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 shutdown_connections 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563ece0e6cf0 0x563ece0c48a0 crc :-1 s=READY pgs=354 gs=3 cs=0 l=0 c_cookie=11211667333438503945 s_cookie=9071176351850981874 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece0c6b20 0x563ece0e0a30 unknown :-1 s=CLOSED pgs=1325 gs=1 cs=0 l=1 c_cookie=6847753305139469848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece081c70 0x563ece0deca0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.817+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3390674917 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0de760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.818+0000 7f1c55ffb640 0 client.19926 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.818+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 >> 10.20.193.28:0/3390674917 conn(0x563ece05f860 msgr2=0x563ece07fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.818+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 shutdown_connections 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.818+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3390674917 wait complete. 2026-02-20T13:29:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.818+0000 7f1c9ca73e00 20 client.19926 trim_cache size 0 max 16384 2026-02-20T13:29:42.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c9ca73e00 1 Processor -- start 2026-02-20T13:29:42.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c9ca73e00 1 -- start start 2026-02-20T13:29:42.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0e09c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0db8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece0dbe30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563ecdf8b080 con 0x563ece081c70 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563ecdc4b700 con 0x563ece0c6b20 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563ece0d60d0 con 0x563ece081360 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c93fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c93fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0e09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41836/0 (socket says 10.20.193.28:41836) 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.825+0000 7f1c93fff640 1 -- 10.20.193.28:0/3831803856 learned_addr learned my addr 10.20.193.28:0/3831803856 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c937fe640 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c98fef640 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece0dbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c93fff640 1 -- 10.20.193.28:0/3831803856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 msgr2=0x563ece0dbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c93fff640 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece0dbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c93fff640 1 -- 10.20.193.28:0/3831803856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 msgr2=0x563ece0db8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c93fff640 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0db8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c93fff640 1 -- 10.20.193.28:0/3831803856 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ecdf1db60 con 0x563ece081360 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c98fef640 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece0dbe30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c93fff640 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0e09c0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=5259876557850867894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c80108010 tx=0x7f1c80108040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48fed5dc811af8b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c57fff640 1 -- 10.20.193.28:0/3831803856 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c800d0b70 con 0x563ece081360 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c57fff640 1 -- 10.20.193.28:0/3831803856 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c800d1d70 con 0x563ece081360 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.826+0000 7f1c57fff640 1 -- 10.20.193.28:0/3831803856 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c800d0f10 con 0x563ece081360 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3831803856 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 msgr2=0x563ece0e09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0e09c0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=5259876557850867894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c80108010 tx=0x7f1c80108040 comp rx=0 tx=0).stop 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3831803856 shutdown_connections 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0db8f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece0dbe30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3831803856 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece0e09c0 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=5259876557850867894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3831803856 >> 10.20.193.28:0/3831803856 conn(0x563ece05f860 msgr2=0x563ece0e4340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3831803856 shutdown_connections 2026-02-20T13:29:42.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3831803856 wait complete. 2026-02-20T13:29:42.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.827+0000 7f1c9ca73e00 1 -- start start 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c9ca73e00 1 Processor -- start 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece064ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0653e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c9ca73e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece063c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563ece065970 con 0x563ece081c70 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563ece065ae0 con 0x563ece0c6b20 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c9ca73e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563ece0641b0 con 0x563ece081360 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55074/0 (socket says 10.20.193.28:55074) 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c937fe640 1 -- 10.20.193.28:0/3532605196 learned_addr learned my addr 10.20.193.28:0/3532605196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:42.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c93fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece064ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c98fef640 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece063c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c937fe640 1 -- 10.20.193.28:0/3532605196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 msgr2=0x563ece064ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c937fe640 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece064ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c937fe640 1 -- 10.20.193.28:0/3532605196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 msgr2=0x563ece063c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c937fe640 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece063c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.828+0000 7f1c937fe640 1 -- 10.20.193.28:0/3532605196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ecdf116f0 con 0x563ece081c70 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c937fe640 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0653e0 secure :-1 s=READY pgs=1326 gs=1 cs=0 l=1 c_cookie=707935844584925148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c84004360 tx=0x7f1c84004110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d317e65c4027dc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c55ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3532605196 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c8401d630 con 0x563ece081c70 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3532605196 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c8402e040 con 0x563ece081c70 2026-02-20T13:29:42.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3532605196 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c84004a30 con 0x563ece081c70 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c940fc280 con 0x563ece081c70 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3532605196 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c84004bc0 con 0x563ece081c70 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c55ffb640 10 client.19932 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c9ca73e00 10 client.19932 _ll_register_callbacks cb 0x563ecdf0ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c8401da50 con 0x563ece081c70 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3532605196 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1c8401ddd0 con 0x563ece081c70 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c9ca73e00 10 client.19932 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.829+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563ecdf23340 con 0x563ece081c70 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.830+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3532605196 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1c8403a060 con 0x563ece081c70 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.830+0000 7f1c9ca73e00 10 client.19932 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.830+0000 7f1c9ca73e00 10 client.19932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.830+0000 7f1c9ca73e00 20 client.19932 populate_metadata read hostname 'trial028' 2026-02-20T13:29:42.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.830+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563ece175140 0x563ece1955f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.830+0000 7f1c9ca73e00 4 client.19932 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.830+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ecdc20f40 con 0x563ece175140 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.830+0000 7f1c93fff640 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563ece175140 0x563ece1955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c93fff640 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563ece175140 0x563ece1955f0 crc :-1 s=READY pgs=355 gs=4 cs=0 l=0 c_cookie=17467552327248781085 s_cookie=11177608530306956875 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f269364b69361f1d server_cookie=9b1ed7bc9f527e4b in_seq=0 out_seq=0 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c55ffb640 10 client.19932 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c55ffb640 1 -- 10.20.193.28:0/3532605196 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ecdc20f40 con 0x563ece175140 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c55ffb640 10 client.19932 handle_command_reply: tid=0 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 client.19932 shutdown 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 msgr2=0x563ece0653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0653e0 secure :-1 s=READY pgs=1326 gs=1 cs=0 l=1 c_cookie=707935844584925148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c84004360 tx=0x7f1c84004110 comp rx=0 tx=0).stop 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 shutdown_connections 2026-02-20T13:29:42.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563ece175140 0x563ece1955f0 crc :-1 s=READY pgs=355 gs=4 cs=0 l=0 c_cookie=17467552327248781085 s_cookie=11177608530306956875 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563ece081c70 0x563ece0653e0 unknown :-1 s=CLOSED pgs=1326 gs=1 cs=0 l=1 c_cookie=707935844584925148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563ece0c6b20 0x563ece063c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 --2- 10.20.193.28:0/3532605196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563ece081360 0x563ece064ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 >> 10.20.193.28:0/3532605196 conn(0x563ece05f860 msgr2=0x563ece080050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c55ffb640 0 client.19932 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:42.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 shutdown_connections 2026-02-20T13:29:42.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.831+0000 7f1c9ca73e00 1 -- 10.20.193.28:0/3532605196 wait complete. 2026-02-20T13:29:42.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c9ca73e00 20 client.19932 trim_cache size 0 max 16384 2026-02-20T13:29:42.841 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:29:42.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 -- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c680b56d0 msgr2=0x7f1c680d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c680b56d0 0x7f1c680d5b80 secure :-1 s=READY pgs=554 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c84005970 tx=0x7f1c84005900 comp rx=0 tx=0).stop 2026-02-20T13:29:42.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 -- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 msgr2=0x7f1c940f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:42.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 0x7f1c940f5fa0 secure :-1 s=READY pgs=1323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c80009950 tx=0x7f1c80004300 comp rx=0 tx=0).stop 2026-02-20T13:29:42.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 -- 10.20.193.28:0/2902331859 shutdown_connections 2026-02-20T13:29:42.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c680b56d0 0x7f1c680d5b80 unknown :-1 s=CLOSED pgs=554 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c941119a0 0x7f1c940f66a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c9410c1a0 0x7f1c94172270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 --2- 10.20.193.28:0/2902331859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c9410b7b0 0x7f1c940f5fa0 unknown :-1 s=CLOSED pgs=1323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:42.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 -- 10.20.193.28:0/2902331859 >> 10.20.193.28:0/2902331859 conn(0x7f1c940e9080 msgr2=0x7f1c9410f000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:42.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 -- 10.20.193.28:0/2902331859 shutdown_connections 2026-02-20T13:29:42.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:42.832+0000 7f1c997f0640 1 -- 10.20.193.28:0/2902331859 wait complete. 2026-02-20T13:29:42.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:42 trial127 ceph-mon[43817]: pgmap v552: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2026-02-20T13:29:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:42 trial034 ceph-mon[43332]: pgmap v552: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2026-02-20T13:29:43.934 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:29:43.934 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:29:43.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:43 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:29:43.987 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:43 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:29:43.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:43 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:29:44.123 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:44.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.296+0000 7f27c720d640 1 -- 10.20.193.28:0/1290944648 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f27c010c230 msgr2=0x7f27c0155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.296+0000 7f27c720d640 1 --2- 10.20.193.28:0/1290944648 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f27c010c230 0x7f27c0155110 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=16512095296965873936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b4009950 tx=0x7f27b402f190 comp rx=0 tx=0).stop 2026-02-20T13:29:44.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.296+0000 7f27c720d640 1 -- 10.20.193.28:0/1290944648 shutdown_connections 2026-02-20T13:29:44.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.296+0000 7f27c720d640 1 --2- 10.20.193.28:0/1290944648 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27c0155650 0x7f27c0175a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.296+0000 7f27c720d640 1 --2- 10.20.193.28:0/1290944648 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f27c010c230 0x7f27c0155110 unknown :-1 s=CLOSED pgs=464 gs=1 cs=0 l=1 c_cookie=16512095296965873936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.296+0000 7f27c720d640 1 --2- 10.20.193.28:0/1290944648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27c010b920 0x7f27c010bcf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.296+0000 7f27c720d640 1 -- 10.20.193.28:0/1290944648 >> 10.20.193.28:0/1290944648 conn(0x7f27c00e95a0 msgr2=0x7f27c01099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.297+0000 7f27c720d640 1 -- 10.20.193.28:0/1290944648 shutdown_connections 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.297+0000 7f27c720d640 1 -- 10.20.193.28:0/1290944648 wait complete. 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.297+0000 7f27c720d640 1 Processor -- start 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.297+0000 7f27c720d640 1 -- start start 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c720d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27c010b920 0x7f27c0160d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c720d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f27c010c230 0x7f27c0161240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c720d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27c0155650 0x7f27c0166610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c720d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27c0166c30 con 0x7f27c010b920 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c720d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f27c0166da0 con 0x7f27c010c230 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c720d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f27c0166f60 con 0x7f27c0155650 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27c010b920 0x7f27c0160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27c010b920 0x7f27c0160d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55096/0 (socket says 10.20.193.28:55096) 2026-02-20T13:29:44.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 -- 10.20.193.28:0/1946791883 learned_addr learned my addr 10.20.193.28:0/1946791883 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f27c010c230 0x7f27c0161240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c6a0c640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27c0155650 0x7f27c0166610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 -- 10.20.193.28:0/1946791883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27c0155650 msgr2=0x7f27c0166610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27c0155650 0x7f27c0166610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 -- 10.20.193.28:0/1946791883 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f27c010c230 msgr2=0x7f27c0161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f27c010c230 0x7f27c0161240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 -- 10.20.193.28:0/1946791883 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b00094b0 con 0x7f27c010b920 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c6a0c640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27c0155650 0x7f27c0166610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:29:44.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.298+0000 7f27c620b640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27c010b920 0x7f27c0160d00 secure :-1 s=READY pgs=1327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b0009fd0 tx=0x7f27b0002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.299+0000 7f27a77fe640 1 -- 10.20.193.28:0/1946791883 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b000ed60 con 0x7f27c010b920 2026-02-20T13:29:44.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.299+0000 7f27a77fe640 1 -- 10.20.193.28:0/1946791883 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f27b0002e20 con 0x7f27c010b920 2026-02-20T13:29:44.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.299+0000 7f27a77fe640 1 -- 10.20.193.28:0/1946791883 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b00189f0 con 0x7f27c010b920 2026-02-20T13:29:44.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.299+0000 7f27c720d640 1 -- 10.20.193.28:0/1946791883 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b4009570 con 0x7f27c010b920 2026-02-20T13:29:44.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.299+0000 7f27c720d640 1 -- 10.20.193.28:0/1946791883 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c01520e0 con 0x7f27c010b920 2026-02-20T13:29:44.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.301+0000 7f27a77fe640 1 -- 10.20.193.28:0/1946791883 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f27b0016020 con 0x7f27c010b920 2026-02-20T13:29:44.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.303+0000 7f27a77fe640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f279c0b5760 0x7f279c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.303+0000 7f27a77fe640 1 -- 10.20.193.28:0/1946791883 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f27b00e6ce0 con 0x7f27c010b920 2026-02-20T13:29:44.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.303+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f279c0b5760 0x7f279c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27ca490e00 1 Processor -- start 2026-02-20T13:29:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f279c0b5760 0x7f279c0d5c10 secure :-1 s=READY pgs=555 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b40023d0 tx=0x7f27b4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27ca490e00 1 -- start start 2026-02-20T13:29:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebaa7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebef480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ec0fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27ca490e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c23eac0a20 con 0x55c23ebaa410 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27ca490e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c23eabc750 con 0x55c23ebef9c0 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27ca490e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c23eab66f0 con 0x55c23ebaad20 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c620b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebaa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c620b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebaa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55108/0 (socket says 10.20.193.28:55108) 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c620b640 1 -- 10.20.193.28:0/3093601163 learned_addr learned my addr 10.20.193.28:0/3093601163 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c6a0c640 1 --2- 10.20.193.28:0/3093601163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ec0fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c620b640 1 -- 10.20.193.28:0/3093601163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 msgr2=0x55c23ebef480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c620b640 1 --2- 10.20.193.28:0/3093601163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebef480 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c620b640 1 -- 10.20.193.28:0/3093601163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 msgr2=0x55c23ec0fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c620b640 1 --2- 10.20.193.28:0/3093601163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ec0fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.304+0000 7f27c620b640 1 -- 10.20.193.28:0/3093601163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c23ea62120 con 0x55c23ebaa410 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27c620b640 1 --2- 10.20.193.28:0/3093601163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebaa7e0 secure :-1 s=READY pgs=1328 gs=1 cs=0 l=1 c_cookie=2198016797785697733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b00a9610 tx=0x7f27b0010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e80eca1ca5badc5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27a4a6d640 1 -- 10.20.193.28:0/3093601163 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b00ada40 con 0x55c23ebaa410 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27a4a6d640 1 -- 10.20.193.28:0/3093601163 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f27b00b2d60 con 0x55c23ebaa410 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27a4a6d640 1 -- 10.20.193.28:0/3093601163 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b00adf50 con 0x55c23ebaa410 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 -- 10.20.193.28:0/3093601163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 msgr2=0x55c23ebaa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3093601163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebaa7e0 secure :-1 s=READY pgs=1328 gs=1 cs=0 l=1 c_cookie=2198016797785697733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b00a9610 tx=0x7f27b0010b30 comp rx=0 tx=0).stop 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 -- 10.20.193.28:0/3093601163 shutdown_connections 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3093601163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ec0fda0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3093601163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebef480 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3093601163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebaa7e0 unknown :-1 s=CLOSED pgs=1328 gs=1 cs=0 l=1 c_cookie=2198016797785697733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 -- 10.20.193.28:0/3093601163 >> 10.20.193.28:0/3093601163 conn(0x55c23eb88910 msgr2=0x55c23eba8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 -- 10.20.193.28:0/3093601163 shutdown_connections 2026-02-20T13:29:44.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.305+0000 7f27ca490e00 1 -- 10.20.193.28:0/3093601163 wait complete. 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27ca490e00 1 -- start start 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27ca490e00 1 Processor -- start 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc2d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebc3290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebc8280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27ca490e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c23ebc87c0 con 0x55c23ebaa410 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27ca490e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c23ebc8930 con 0x55c23ebef9c0 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27ca490e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c23ebc8af0 con 0x55c23ebaad20 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27c620b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27c6a0c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebc8280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27c620b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55112/0 (socket says 10.20.193.28:55112) 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27c620b640 1 -- 10.20.193.28:0/3197867758 learned_addr learned my addr 10.20.193.28:0/3197867758 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.307+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebc3290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27c620b640 1 -- 10.20.193.28:0/3197867758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 msgr2=0x55c23ebc3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27c620b640 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebc3290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27c620b640 1 -- 10.20.193.28:0/3197867758 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 msgr2=0x55c23ebc8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27c620b640 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebc8280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27c620b640 1 -- 10.20.193.28:0/3197867758 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c23ea3a810 con 0x55c23ebaa410 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27c620b640 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc2d50 secure :-1 s=READY pgs=1329 gs=1 cs=0 l=1 c_cookie=17777983574493560070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b00e6040 tx=0x7f27b0002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b815de846afd06 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f2773fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f2773fff640 1 -- 10.20.193.28:0/3197867758 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b00ca070 con 0x55c23ebaa410 2026-02-20T13:29:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f2773fff640 1 -- 10.20.193.28:0/3197867758 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f27b0009260 con 0x55c23ebaa410 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f2773fff640 1 -- 10.20.193.28:0/3197867758 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b00c4ea0 con 0x55c23ebaa410 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c01520e0 con 0x55c23ebaa410 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f2773fff640 1 -- 10.20.193.28:0/3197867758 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f27b00d20c0 con 0x55c23ebaa410 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f2773fff640 10 client.19944 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27ca490e00 10 client.19944 _ll_register_callbacks cb 0x55c23ea6db10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c23e74c9d0 con 0x55c23ebaa410 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f2773fff640 1 -- 10.20.193.28:0/3197867758 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27b0072480 con 0x55c23ebaa410 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27ca490e00 10 client.19944 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.308+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c23ea4c4f0 con 0x55c23ebaa410 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.309+0000 7f2773fff640 1 -- 10.20.193.28:0/3197867758 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f27b00aea30 con 0x55c23ebaa410 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.309+0000 7f27ca490e00 10 client.19944 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.309+0000 7f27ca490e00 10 client.19944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.309+0000 7f27ca490e00 20 client.19944 populate_metadata read hostname 'trial028' 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.309+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c23ebed160 0x55c23ebed600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.309+0000 7f27ca490e00 4 client.19944 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.309+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c23eac3df0 con 0x55c23ebed160 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.309+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c23ebed160 0x55c23ebed600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c23ebed160 0x55c23ebed600 crc :-1 s=READY pgs=356 gs=4 cs=0 l=0 c_cookie=8265346207332465054 s_cookie=5936111612784269844 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72b4689579ac799e server_cookie=52614e0f9b13da14 in_seq=0 out_seq=0 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f2773fff640 10 client.19944 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f2773fff640 1 -- 10.20.193.28:0/3197867758 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c23eac3df0 con 0x55c23ebed160 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f2773fff640 10 client.19944 handle_command_reply: tid=0 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 client.19944 shutdown 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 msgr2=0x55c23ebc2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc2d50 secure :-1 s=READY pgs=1329 gs=1 cs=0 l=1 c_cookie=17777983574493560070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b00e6040 tx=0x7f27b0002390 comp rx=0 tx=0).stop 2026-02-20T13:29:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 shutdown_connections 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c23ebed160 0x55c23ebed600 crc :-1 s=READY pgs=356 gs=4 cs=0 l=0 c_cookie=8265346207332465054 s_cookie=5936111612784269844 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebc8280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebc3290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3197867758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc2d50 unknown :-1 s=CLOSED pgs=1329 gs=1 cs=0 l=1 c_cookie=17777983574493560070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f2773fff640 0 client.19944 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.310+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 >> 10.20.193.28:0/3197867758 conn(0x55c23eb88910 msgr2=0x55c23eba94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.311+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 shutdown_connections 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.311+0000 7f27ca490e00 1 -- 10.20.193.28:0/3197867758 wait complete. 2026-02-20T13:29:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.311+0000 7f27ca490e00 20 client.19944 trim_cache size 0 max 16384 2026-02-20T13:29:44.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27ca490e00 1 Processor -- start 2026-02-20T13:29:44.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27ca490e00 1 -- start start 2026-02-20T13:29:44.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc77f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebeecd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebef210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27ca490e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c23eab4320 con 0x55c23ebaa410 2026-02-20T13:29:44.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27ca490e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c23e774790 con 0x55c23ebef9c0 2026-02-20T13:29:44.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27ca490e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c23ebaffb0 con 0x55c23ebaad20 2026-02-20T13:29:44.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27c5a0a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebeecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27c620b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27c5a0a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebeecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:41908/0 (socket says 10.20.193.28:41908) 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27c5a0a640 1 -- 10.20.193.28:0/3432274281 learned_addr learned my addr 10.20.193.28:0/3432274281 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.320+0000 7f27c6a0c640 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebef210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27c620b640 1 -- 10.20.193.28:0/3432274281 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 msgr2=0x55c23ebeecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27c620b640 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebeecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27c620b640 1 -- 10.20.193.28:0/3432274281 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 msgr2=0x55c23ebef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27c620b640 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebef210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27c620b640 1 -- 10.20.193.28:0/3432274281 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c23ea46f70 con 0x55c23ebaa410 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27c6a0c640 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebef210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27c620b640 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc77f0 secure :-1 s=READY pgs=1330 gs=2 cs=0 l=1 c_cookie=12381166378135165674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b00a8920 tx=0x7f27b00b2030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd2bd3901c19aea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f278e4e6640 1 -- 10.20.193.28:0/3432274281 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b00ca040 con 0x55c23ebaa410 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f278e4e6640 1 -- 10.20.193.28:0/3432274281 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c23e74c9d0 con 0x55c23ebaa410 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f278e4e6640 1 -- 10.20.193.28:0/3432274281 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b00c4ea0 con 0x55c23ebaa410 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 -- 10.20.193.28:0/3432274281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 msgr2=0x55c23ebc77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc77f0 secure :-1 s=READY pgs=1330 gs=2 cs=0 l=1 c_cookie=12381166378135165674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b00a8920 tx=0x7f27b00b2030 comp rx=0 tx=0).stop 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 -- 10.20.193.28:0/3432274281 shutdown_connections 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebef210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaad20 0x55c23ebeecd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 --2- 10.20.193.28:0/3432274281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaa410 0x55c23ebc77f0 unknown :-1 s=CLOSED pgs=1330 gs=2 cs=0 l=1 c_cookie=12381166378135165674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 -- 10.20.193.28:0/3432274281 >> 10.20.193.28:0/3432274281 conn(0x55c23eb88910 msgr2=0x55c23ebc70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 -- 10.20.193.28:0/3432274281 shutdown_connections 2026-02-20T13:29:44.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.321+0000 7f27ca490e00 1 -- 10.20.193.28:0/3432274281 wait complete. 2026-02-20T13:29:44.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.322+0000 7f27ca490e00 1 -- start start 2026-02-20T13:29:44.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.322+0000 7f27ca490e00 1 Processor -- start 2026-02-20T13:29:44.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.322+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaa410 0x55c23ebc9170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.322+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaad20 0x55c23ebc96b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.322+0000 7f27ca490e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebce230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.322+0000 7f27ca490e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c23eab4320 con 0x55c23ebaad20 2026-02-20T13:29:44.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.322+0000 7f27ca490e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c23e774790 con 0x55c23ebef9c0 2026-02-20T13:29:44.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.322+0000 7f27ca490e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c23ebce770 con 0x55c23ebaa410 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaad20 0x55c23ebc96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaad20 0x55c23ebc96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55132/0 (socket says 10.20.193.28:55132) 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 -- 10.20.193.28:0/860449015 learned_addr learned my addr 10.20.193.28:0/860449015 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c6a0c640 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebce230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c620b640 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaa410 0x55c23ebc9170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 -- 10.20.193.28:0/860449015 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaa410 msgr2=0x55c23ebc9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaa410 0x55c23ebc9170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 -- 10.20.193.28:0/860449015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 msgr2=0x55c23ebce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebce230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 -- 10.20.193.28:0/860449015 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c23ea3ab40 con 0x55c23ebaad20 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27c5a0a640 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaad20 0x55c23ebc96b0 secure :-1 s=READY pgs=1331 gs=3 cs=0 l=1 c_cookie=5376852537485781077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b402f6a0 tx=0x7f27b402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9e6ae5227f6855 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f2773fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f2773fff640 1 -- 10.20.193.28:0/860449015 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b4002ad0 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c23ea4c4f0 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27ca490e00 10 client.19950 _ll_register_callbacks cb 0x55c23ea6db10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b00b2d60 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f2773fff640 1 -- 10.20.193.28:0/860449015 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f27b4038920 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.323+0000 7f2773fff640 1 -- 10.20.193.28:0/860449015 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27b4054a20 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f2773fff640 1 -- 10.20.193.28:0/860449015 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f27b4054bb0 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f2773fff640 1 -- 10.20.193.28:0/860449015 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27b4054db0 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27ca490e00 10 client.19950 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c23ea4c750 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f2773fff640 1 -- 10.20.193.28:0/860449015 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f27b4038a90 con 0x55c23ebaad20 2026-02-20T13:29:44.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27ca490e00 10 client.19950 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27ca490e00 10 client.19950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27ca490e00 20 client.19950 populate_metadata read hostname 'trial028' 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27ca490e00 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c23eca6070 0x55c23ecc6520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27ca490e00 4 client.19950 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c23e74a220 con 0x55c23eca6070 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.324+0000 7f27c620b640 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c23eca6070 0x55c23ecc6520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.325+0000 7f27c620b640 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c23eca6070 0x55c23ecc6520 crc :-1 s=READY pgs=357 gs=4 cs=0 l=0 c_cookie=7293300260039218271 s_cookie=12066647748180430186 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=653701f1e7e6d45f server_cookie=a7755831f40fcd6a in_seq=0 out_seq=0 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.325+0000 7f2773fff640 10 client.19950 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f2773fff640 1 -- 10.20.193.28:0/860449015 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c23e74a220 con 0x55c23eca6070 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f2773fff640 10 client.19950 handle_command_reply: tid=0 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 client.19950 shutdown 2026-02-20T13:29:44.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaad20 msgr2=0x55c23ebc96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaad20 0x55c23ebc96b0 secure :-1 s=READY pgs=1331 gs=3 cs=0 l=1 c_cookie=5376852537485781077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b402f6a0 tx=0x7f27b402f190 comp rx=0 tx=0).stop 2026-02-20T13:29:44.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 shutdown_connections 2026-02-20T13:29:44.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55c23eca6070 0x55c23ecc6520 crc :-1 s=READY pgs=357 gs=4 cs=0 l=0 c_cookie=7293300260039218271 s_cookie=12066647748180430186 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c23ebaad20 0x55c23ebc96b0 unknown :-1 s=CLOSED pgs=1331 gs=3 cs=0 l=1 c_cookie=5376852537485781077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c23ebef9c0 0x55c23ebce230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 --2- 10.20.193.28:0/860449015 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c23ebaa410 0x55c23ebc9170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.334 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:29:44.334 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:29:44.335 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "83957d65-b14a-4c38-b410-12bc5129367e", 2026-02-20T13:29:44.335 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:29:44.335 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:29:44.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f2773fff640 0 client.19950 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 >> 10.20.193.28:0/860449015 conn(0x55c23eb88910 msgr2=0x55c23ebbf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 shutdown_connections 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 1 -- 10.20.193.28:0/860449015 wait complete. 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.326+0000 7f27ca490e00 20 client.19950 trim_cache size 0 max 16384 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 -- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f279c0b5760 msgr2=0x7f279c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f279c0b5760 0x7f279c0d5c10 secure :-1 s=READY pgs=555 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b40023d0 tx=0x7f27b4031040 comp rx=0 tx=0).stop 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 -- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27c010b920 msgr2=0x7f27c0160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27c010b920 0x7f27c0160d00 secure :-1 s=READY pgs=1327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27b0009fd0 tx=0x7f27b0002bc0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 -- 10.20.193.28:0/1946791883 shutdown_connections 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f279c0b5760 0x7f279c0d5c10 unknown :-1 s=CLOSED pgs=555 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27c0155650 0x7f27c0166610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f27c010c230 0x7f27c0161240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 --2- 10.20.193.28:0/1946791883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27c010b920 0x7f27c0160d00 unknown :-1 s=CLOSED pgs=1327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 -- 10.20.193.28:0/1946791883 >> 10.20.193.28:0/1946791883 conn(0x7f27c00e95a0 msgr2=0x7f27c0109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 -- 10.20.193.28:0/1946791883 shutdown_connections 2026-02-20T13:29:44.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.327+0000 7f27c720d640 1 -- 10.20.193.28:0/1946791883 wait complete. 2026-02-20T13:29:44.467 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:29:44.653 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:44.768 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: pgmap v553: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:29:44.768 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:29:44.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:29:44.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:29:44.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:29:44.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:29:44.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:29:44.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:29:44.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:44 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 -- 10.20.193.28:0/183855588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810d230 msgr2=0x7f136810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 --2- 10.20.193.28:0/183855588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810d230 0x7f136810d600 secure :-1 s=READY pgs=1332 gs=2 cs=0 l=1 c_cookie=6842541929282347733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1354009890 tx=0x7f135402f120 comp rx=0 tx=0).stop 2026-02-20T13:29:44.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 -- 10.20.193.28:0/183855588 shutdown_connections 2026-02-20T13:29:44.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 --2- 10.20.193.28:0/183855588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1368113420 0x7f1368173df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 --2- 10.20.193.28:0/183855588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f136810dc20 0x7f1368112c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 --2- 10.20.193.28:0/183855588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810d230 0x7f136810d600 unknown :-1 s=CLOSED pgs=1332 gs=2 cs=0 l=1 c_cookie=6842541929282347733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 -- 10.20.193.28:0/183855588 >> 10.20.193.28:0/183855588 conn(0x7f13680eab00 msgr2=0x7f136810af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 -- 10.20.193.28:0/183855588 shutdown_connections 2026-02-20T13:29:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.833+0000 7f136ccd7640 1 -- 10.20.193.28:0/183855588 wait complete. 2026-02-20T13:29:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f136ccd7640 1 Processor -- start 2026-02-20T13:29:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f136ccd7640 1 -- start start 2026-02-20T13:29:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f136ccd7640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f136810d230 0x7f13680f5790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f136ccd7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810dc20 0x7f1368173cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f136ccd7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1368113420 0x7f13680f5e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f136ccd7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f13680fb050 con 0x7f136810dc20 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f136ccd7640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f13680fb1c0 con 0x7f1368113420 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f136ccd7640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f13680fb380 con 0x7f136810d230 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f1366ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810dc20 0x7f1368173cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f13677fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f136810d230 0x7f13680f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f1367fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1368113420 0x7f13680f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f1366ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810dc20 0x7f1368173cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55164/0 (socket says 10.20.193.28:55164) 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.834+0000 7f1366ffd640 1 -- 10.20.193.28:0/112725637 learned_addr learned my addr 10.20.193.28:0/112725637 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1366ffd640 1 -- 10.20.193.28:0/112725637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f136810d230 msgr2=0x7f13680f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1366ffd640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f136810d230 0x7f13680f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1366ffd640 1 -- 10.20.193.28:0/112725637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1368113420 msgr2=0x7f13680f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1366ffd640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1368113420 0x7f13680f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1366ffd640 1 -- 10.20.193.28:0/112725637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1358009570 con 0x7f136810dc20 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1366ffd640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810dc20 0x7f1368173cf0 secure :-1 s=READY pgs=1333 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1358005b30 tx=0x7f1358002c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1364ff9640 1 -- 10.20.193.28:0/112725637 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f135800ed60 con 0x7f136810dc20 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1364ff9640 1 -- 10.20.193.28:0/112725637 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1358002e70 con 0x7f136810dc20 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f1364ff9640 1 -- 10.20.193.28:0/112725637 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f135800f870 con 0x7f136810dc20 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f136ccd7640 1 -- 10.20.193.28:0/112725637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13540094b0 con 0x7f136810dc20 2026-02-20T13:29:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.835+0000 7f136ccd7640 1 -- 10.20.193.28:0/112725637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13680fb950 con 0x7f136810dc20 2026-02-20T13:29:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.838+0000 7f1364ff9640 1 -- 10.20.193.28:0/112725637 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f135801f060 con 0x7f136810dc20 2026-02-20T13:29:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.839+0000 7f1364ff9640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f133c0b5750 0x7f133c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.839+0000 7f1364ff9640 1 -- 10.20.193.28:0/112725637 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f13580e6f50 con 0x7f136810dc20 2026-02-20T13:29:44.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.839+0000 7f13677fe640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f133c0b5750 0x7f133c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.840+0000 7f13677fe640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f133c0b5750 0x7f133c0d5c00 secure :-1 s=READY pgs=556 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13540097e0 tx=0x7f135403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f136ff5ae00 1 Processor -- start 2026-02-20T13:29:44.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f136ff5ae00 1 -- start start 2026-02-20T13:29:44.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e75550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90eba400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90edad20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe90d8b7d0 con 0x55fe90e75a90 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fe90d87500 con 0x55fe90eba940 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fe90d814a0 con 0x55fe90e75180 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f1366ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90eba400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f1366ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90eba400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55166/0 (socket says 10.20.193.28:55166) 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f1367fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90edad20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f13677fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e75550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.841+0000 7f1366ffd640 1 -- 10.20.193.28:0/2647776518 learned_addr learned my addr 10.20.193.28:0/2647776518 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f1366ffd640 1 -- 10.20.193.28:0/2647776518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 msgr2=0x55fe90e75550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f1366ffd640 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e75550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f1366ffd640 1 -- 10.20.193.28:0/2647776518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 msgr2=0x55fe90edad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f1366ffd640 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90edad20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f1366ffd640 1 -- 10.20.193.28:0/2647776518 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe90d2cd80 con 0x55fe90e75a90 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f13677fe640 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e75550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f1367fff640 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90edad20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f1366ffd640 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90eba400 secure :-1 s=READY pgs=1334 gs=1 cs=0 l=1 c_cookie=16875064631691416859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1358010d90 tx=0x7f1358020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3045dfe5b9951b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f132bfff640 1 -- 10.20.193.28:0/2647776518 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13580acab0 con 0x55fe90e75a90 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f132bfff640 1 -- 10.20.193.28:0/2647776518 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f13580adcb0 con 0x55fe90e75a90 2026-02-20T13:29:44.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.842+0000 7f132bfff640 1 -- 10.20.193.28:0/2647776518 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13580ad0d0 con 0x55fe90e75a90 2026-02-20T13:29:44.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2647776518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 msgr2=0x55fe90eba400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90eba400 secure :-1 s=READY pgs=1334 gs=1 cs=0 l=1 c_cookie=16875064631691416859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1358010d90 tx=0x7f1358020000 comp rx=0 tx=0).stop 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2647776518 shutdown_connections 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90eba400 unknown :-1 s=CLOSED pgs=1334 gs=1 cs=0 l=1 c_cookie=16875064631691416859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90edad20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2647776518 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e75550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2647776518 >> 10.20.193.28:0/2647776518 conn(0x55fe90e53680 msgr2=0x55fe90e73a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2647776518 shutdown_connections 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.843+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2647776518 wait complete. 2026-02-20T13:29:44.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.844+0000 7f136ff5ae00 1 -- start start 2026-02-20T13:29:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.844+0000 7f136ff5ae00 1 Processor -- start 2026-02-20T13:29:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e8d840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90e8dd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90e92d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe90e932b0 con 0x55fe90e75a90 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fe90e93420 con 0x55fe90eba940 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fe90e935e0 con 0x55fe90e75180 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1366ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90e8dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1366ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90e8dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55178/0 (socket says 10.20.193.28:55178) 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1366ffd640 1 -- 10.20.193.28:0/3114283507 learned_addr learned my addr 10.20.193.28:0/3114283507 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1367fff640 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90e92d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f13677fe640 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e8d840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1366ffd640 1 -- 10.20.193.28:0/3114283507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 msgr2=0x55fe90e8d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1366ffd640 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e8d840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1366ffd640 1 -- 10.20.193.28:0/3114283507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 msgr2=0x55fe90e92d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1366ffd640 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90e92d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.845+0000 7f1366ffd640 1 -- 10.20.193.28:0/3114283507 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13680fb950 con 0x55fe90e75a90 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f1366ffd640 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90e8dd80 secure :-1 s=READY pgs=1335 gs=1 cs=0 l=1 c_cookie=136273616276806086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13580e6040 tx=0x7f13580ad460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e42421ca6fd9c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f13297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f13297fa640 1 -- 10.20.193.28:0/3114283507 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13580b8180 con 0x55fe90e75a90 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f13297fa640 1 -- 10.20.193.28:0/3114283507 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1358077070 con 0x55fe90e75a90 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f13297fa640 1 -- 10.20.193.28:0/3114283507 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13580ae1c0 con 0x55fe90e75a90 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c0051e0 con 0x55fe90e75a90 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f13297fa640 1 -- 10.20.193.28:0/3114283507 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f13580b55b0 con 0x55fe90e75a90 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f136ff5ae00 10 client.19962 _ll_register_callbacks cb 0x55fe90d029a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:44.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe90a176f0 con 0x55fe90e75a90 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f13297fa640 1 -- 10.20.193.28:0/3114283507 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f13580b83f0 con 0x55fe90e75a90 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f136ff5ae00 10 client.19962 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.846+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fe90d05350 con 0x55fe90e75a90 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.847+0000 7f13297fa640 1 -- 10.20.193.28:0/3114283507 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1358016070 con 0x55fe90e75a90 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.847+0000 7f136ff5ae00 10 client.19962 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.847+0000 7f136ff5ae00 10 client.19962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.847+0000 7f136ff5ae00 20 client.19962 populate_metadata read hostname 'trial028' 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.847+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fe90eb7940 0x55fe90eb7de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.847+0000 7f136ff5ae00 4 client.19962 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.847+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe90d8ed60 con 0x55fe90eb7940 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.847+0000 7f13677fe640 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fe90eb7940 0x55fe90eb7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.848+0000 7f13677fe640 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fe90eb7940 0x55fe90eb7de0 crc :-1 s=READY pgs=358 gs=4 cs=0 l=0 c_cookie=8812197675705400810 s_cookie=15482913510966731285 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a4b3718d6f17dea server_cookie=d6de5bce6544a215 in_seq=0 out_seq=0 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.848+0000 7f13297fa640 10 client.19962 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.848+0000 7f13297fa640 1 -- 10.20.193.28:0/3114283507 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fe90d8ed60 con 0x55fe90eb7940 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.848+0000 7f13297fa640 10 client.19962 handle_command_reply: tid=0 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.848+0000 7f136ff5ae00 1 client.19962 shutdown 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.848+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 msgr2=0x55fe90e8dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.848+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90e8dd80 secure :-1 s=READY pgs=1335 gs=1 cs=0 l=1 c_cookie=136273616276806086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13580e6040 tx=0x7f13580ad460 comp rx=0 tx=0).stop 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 shutdown_connections 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fe90eb7940 0x55fe90eb7de0 crc :-1 s=READY pgs=358 gs=4 cs=0 l=0 c_cookie=8812197675705400810 s_cookie=15482913510966731285 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90e75a90 0x55fe90e8dd80 unknown :-1 s=CLOSED pgs=1335 gs=1 cs=0 l=1 c_cookie=136273616276806086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90eba940 0x55fe90e92d70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3114283507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e8d840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f13297fa640 0 client.19962 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 >> 10.20.193.28:0/3114283507 conn(0x55fe90e53680 msgr2=0x55fe90e74250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 shutdown_connections 2026-02-20T13:29:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3114283507 wait complete. 2026-02-20T13:29:44.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.849+0000 7f136ff5ae00 20 client.19962 trim_cache size 0 max 16384 2026-02-20T13:29:44.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.858+0000 7f136ff5ae00 1 Processor -- start 2026-02-20T13:29:44.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.858+0000 7f136ff5ae00 1 -- start start 2026-02-20T13:29:44.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.858+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e7f840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.858+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75a90 0x55fe90e90b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.858+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90e910c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.858+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe90d7f0d0 con 0x55fe90eba940 2026-02-20T13:29:44.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.858+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fe90a3f700 con 0x55fe90e75a90 2026-02-20T13:29:44.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.858+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fe90eb7f70 con 0x55fe90e75180 2026-02-20T13:29:44.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90e910c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90e910c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55188/0 (socket says 10.20.193.28:55188) 2026-02-20T13:29:44.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 -- 10.20.193.28:0/3535078393 learned_addr learned my addr 10.20.193.28:0/3535078393 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1366ffd640 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75a90 0x55fe90e90b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f13677fe640 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e7f840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 -- 10.20.193.28:0/3535078393 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 msgr2=0x55fe90e7f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e7f840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 -- 10.20.193.28:0/3535078393 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75a90 msgr2=0x55fe90e90b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75a90 0x55fe90e90b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 -- 10.20.193.28:0/3535078393 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe90e80010 con 0x55fe90eba940 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.859+0000 7f1367fff640 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90e910c0 secure :-1 s=READY pgs=1336 gs=1 cs=0 l=1 c_cookie=1670676923672287722 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f135c0049b0 tx=0x7f135c004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172f6fcf79edd9ea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f132b7fe640 1 -- 10.20.193.28:0/3535078393 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f135c00ae20 con 0x55fe90eba940 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f132b7fe640 1 -- 10.20.193.28:0/3535078393 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f135c019040 con 0x55fe90eba940 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f132b7fe640 1 -- 10.20.193.28:0/3535078393 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f135c01d9b0 con 0x55fe90eba940 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3535078393 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 msgr2=0x55fe90e910c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90e910c0 secure :-1 s=READY pgs=1336 gs=1 cs=0 l=1 c_cookie=1670676923672287722 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f135c0049b0 tx=0x7f135c004e80 comp rx=0 tx=0).stop 2026-02-20T13:29:44.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3535078393 shutdown_connections 2026-02-20T13:29:44.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90e910c0 unknown :-1 s=CLOSED pgs=1336 gs=1 cs=0 l=1 c_cookie=1670676923672287722 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75a90 0x55fe90e90b80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/3535078393 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75180 0x55fe90e7f840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3535078393 >> 10.20.193.28:0/3535078393 conn(0x55fe90e53680 msgr2=0x55fe90e89c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3535078393 shutdown_connections 2026-02-20T13:29:44.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.860+0000 7f136ff5ae00 1 -- 10.20.193.28:0/3535078393 wait complete. 2026-02-20T13:29:44.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f136ff5ae00 1 -- start start 2026-02-20T13:29:44.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f136ff5ae00 1 Processor -- start 2026-02-20T13:29:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75180 0x55fe90e979c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75a90 0x55fe90e97f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f136ff5ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90effed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe90e530c0 con 0x55fe90eba940 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fe90f00470 con 0x55fe90e75180 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f136ff5ae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fe90f00630 con 0x55fe90e75a90 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f13677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75180 0x55fe90e979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f1367fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90effed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f1367fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90effed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55200/0 (socket says 10.20.193.28:55200) 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f1367fff640 1 -- 10.20.193.28:0/2321115862 learned_addr learned my addr 10.20.193.28:0/2321115862 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.861+0000 7f1366ffd640 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75a90 0x55fe90e97f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f1367fff640 1 -- 10.20.193.28:0/2321115862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75a90 msgr2=0x55fe90e97f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f1367fff640 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75a90 0x55fe90e97f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f1367fff640 1 -- 10.20.193.28:0/2321115862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75180 msgr2=0x55fe90e979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f1367fff640 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75180 0x55fe90e979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f1367fff640 1 -- 10.20.193.28:0/2321115862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe90d17150 con 0x55fe90eba940 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f1367fff640 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90effed0 secure :-1 s=READY pgs=1337 gs=2 cs=0 l=1 c_cookie=11977913418154607035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f135c005020 tx=0x7f135c01d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63a18cac77d81bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f13297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f13297fa640 1 -- 10.20.193.28:0/2321115862 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f135c005a00 con 0x55fe90eba940 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c0055a0 con 0x55fe90eba940 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f136ff5ae00 10 client.19968 _ll_register_callbacks cb 0x55fe90d029a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13580adcb0 con 0x55fe90eba940 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f13297fa640 1 -- 10.20.193.28:0/2321115862 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f135c006510 con 0x55fe90eba940 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f13297fa640 1 -- 10.20.193.28:0/2321115862 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f135c005a00 con 0x55fe90eba940 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f13297fa640 1 -- 10.20.193.28:0/2321115862 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f135c011430 con 0x55fe90eba940 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.862+0000 7f13297fa640 1 -- 10.20.193.28:0/2321115862 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f135c0115f0 con 0x55fe90eba940 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f136ff5ae00 10 client.19968 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:44.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fe90d11bd0 con 0x55fe90eba940 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f13297fa640 1 -- 10.20.193.28:0/2321115862 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f135c006680 con 0x55fe90eba940 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f136ff5ae00 10 client.19968 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f136ff5ae00 10 client.19968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f136ff5ae00 20 client.19968 populate_metadata read hostname 'trial028' 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fe90f68760 0x55fe90f88c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f136ff5ae00 4 client.19968 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fe90a14f40 con 0x55fe90f68760 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.863+0000 7f13677fe640 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fe90f68760 0x55fe90f88c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.864+0000 7f13677fe640 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fe90f68760 0x55fe90f88c10 crc :-1 s=READY pgs=359 gs=4 cs=0 l=0 c_cookie=4079918258227245034 s_cookie=14160416556701867170 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=389ec80a1e43efea server_cookie=c483e7d54dc65ca2 in_seq=0 out_seq=0 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.864+0000 7f13297fa640 10 client.19968 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.864+0000 7f13297fa640 1 -- 10.20.193.28:0/2321115862 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6534 (crc 0 0 0) 0x55fe90a14f40 con 0x55fe90f68760 2026-02-20T13:29:44.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.864+0000 7f13297fa640 10 client.19968 handle_command_reply: tid=0 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.864+0000 7f136ff5ae00 1 client.19968 shutdown 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 msgr2=0x55fe90effed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90effed0 secure :-1 s=READY pgs=1337 gs=2 cs=0 l=1 c_cookie=11977913418154607035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f135c005020 tx=0x7f135c01d940 comp rx=0 tx=0).stop 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 shutdown_connections 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fe90f68760 0x55fe90f88c10 crc :-1 s=READY pgs=359 gs=4 cs=0 l=0 c_cookie=4079918258227245034 s_cookie=14160416556701867170 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe90eba940 0x55fe90effed0 unknown :-1 s=CLOSED pgs=1337 gs=2 cs=0 l=1 c_cookie=11977913418154607035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fe90e75a90 0x55fe90e97f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 --2- 10.20.193.28:0/2321115862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fe90e75180 0x55fe90e979c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 >> 10.20.193.28:0/2321115862 conn(0x55fe90e53680 msgr2=0x55fe90e8a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f13297fa640 0 client.19968 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 shutdown_connections 2026-02-20T13:29:44.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 1 -- 10.20.193.28:0/2321115862 wait complete. 2026-02-20T13:29:44.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ff5ae00 20 client.19968 trim_cache size 0 max 16384 2026-02-20T13:29:44.873 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:29:44.873 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:29:44.873 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:29:44.873 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "83957d65-b14a-4c38-b410-12bc5129367e", 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.874 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.875 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.876 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:29:44.877 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.878 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:29:44.879 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.880 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.881 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.882 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:29:44.883 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:29:44.884 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.885 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:29:44.886 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ccd7640 1 -- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f133c0b5750 msgr2=0x7f133c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ccd7640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f133c0b5750 0x7f133c0d5c00 secure :-1 s=READY pgs=556 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13540097e0 tx=0x7f135403a040 comp rx=0 tx=0).stop 2026-02-20T13:29:44.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ccd7640 1 -- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810dc20 msgr2=0x7f1368173cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ccd7640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810dc20 0x7f1368173cf0 secure :-1 s=READY pgs=1333 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1358005b30 tx=0x7f1358002c10 comp rx=0 tx=0).stop 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.865+0000 7f136ccd7640 1 -- 10.20.193.28:0/112725637 shutdown_connections 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.866+0000 7f136ccd7640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f133c0b5750 0x7f133c0d5c00 unknown :-1 s=CLOSED pgs=556 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.866+0000 7f136ccd7640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f136810dc20 0x7f1368173cf0 unknown :-1 s=CLOSED pgs=1333 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.866+0000 7f136ccd7640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1368113420 0x7f13680f5e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.866+0000 7f136ccd7640 1 --2- 10.20.193.28:0/112725637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f136810d230 0x7f13680f5790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.866+0000 7f136ccd7640 1 -- 10.20.193.28:0/112725637 >> 10.20.193.28:0/112725637 conn(0x7f13680eab00 msgr2=0x7f1368110380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.867+0000 7f136ccd7640 1 -- 10.20.193.28:0/112725637 shutdown_connections 2026-02-20T13:29:44.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:44.867+0000 7f136ccd7640 1 -- 10.20.193.28:0/112725637 wait complete. 2026-02-20T13:29:44.888 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: pgmap v553: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.889 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:44 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.891 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: pgmap v553: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2026-02-20T13:29:44.891 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:29:44.891 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:29:44.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:29:44.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:29:44.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:29:44.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:29:44.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:29:44.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.892 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:44 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:44.966 INFO:tasks.cephfs.filesystem:scrub status for tag:83957d65-b14a-4c38-b410-12bc5129367e - {'path': '/', 'tag': '83957d65-b14a-4c38-b410-12bc5129367e', 'options': 'recursive,force'} 2026-02-20T13:29:45.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:45 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:29:45.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:45 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:45.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:45 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:29:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:45 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:45 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:29:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:45 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:29:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:46 trial127 ceph-mon[43817]: pgmap v554: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2026-02-20T13:29:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:46 trial034 ceph-mon[43332]: pgmap v554: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2026-02-20T13:29:47.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:46 trial028 ceph-mon[37442]: pgmap v554: 97 pgs: 97 active+clean; 2.2 MiB data, 332 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2026-02-20T13:29:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:48 trial127 ceph-mon[43817]: pgmap v555: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:48 trial034 ceph-mon[43332]: pgmap v555: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:49.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:48 trial028 ceph-mon[37442]: pgmap v555: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:50 trial127 ceph-mon[43817]: pgmap v556: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2026-02-20T13:29:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:50 trial034 ceph-mon[43332]: pgmap v556: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2026-02-20T13:29:51.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:50 trial028 ceph-mon[37442]: pgmap v556: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2026-02-20T13:29:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:52 trial127 ceph-mon[43817]: pgmap v557: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2026-02-20T13:29:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:52 trial034 ceph-mon[43332]: pgmap v557: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2026-02-20T13:29:53.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:52 trial028 ceph-mon[37442]: pgmap v557: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2026-02-20T13:29:53.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:53 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:29:53.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:53 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:29:53.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:53 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:29:53.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:53 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:29:54.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:53 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:29:54.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:53 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:29:54.702 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2026-02-20T13:29:54.702 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:29:54.890 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:54.933 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:54 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:29:54.933 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:54 trial028 ceph-mon[37442]: pgmap v558: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:54 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:29:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:54 trial127 ceph-mon[43817]: pgmap v558: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:54 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:29:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:54 trial034 ceph-mon[43332]: pgmap v558: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:29:55.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 -- 10.20.193.28:0/1960561310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010fea0 msgr2=0x7fec20114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 --2- 10.20.193.28:0/1960561310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010fea0 0x7fec20114ef0 secure :-1 s=READY pgs=1338 gs=1 cs=0 l=1 c_cookie=9163144115326559760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec08009890 tx=0x7fec0802f120 comp rx=0 tx=0).stop 2026-02-20T13:29:55.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 -- 10.20.193.28:0/1960561310 shutdown_connections 2026-02-20T13:29:55.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 --2- 10.20.193.28:0/1960561310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010fea0 0x7fec20114ef0 unknown :-1 s=CLOSED pgs=1338 gs=1 cs=0 l=1 c_cookie=9163144115326559760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 --2- 10.20.193.28:0/1960561310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec201156a0 0x7fec20176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 --2- 10.20.193.28:0/1960561310 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec2010f4b0 0x7fec2010f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 -- 10.20.193.28:0/1960561310 >> 10.20.193.28:0/1960561310 conn(0x7fec200ecda0 msgr2=0x7fec2010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 -- 10.20.193.28:0/1960561310 shutdown_connections 2026-02-20T13:29:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.057+0000 7fec1ffff640 1 -- 10.20.193.28:0/1960561310 wait complete. 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.058+0000 7fec1ffff640 1 Processor -- start 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.058+0000 7fec1ffff640 1 -- start start 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.058+0000 7fec1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010f4b0 0x7fec200f57e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.058+0000 7fec1ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec2010fea0 0x7fec20175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.058+0000 7fec1ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec201156a0 0x7fec200f5ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.058+0000 7fec1ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fec200fb0a0 con 0x7fec2010f4b0 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.058+0000 7fec1ffff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fec200fb210 con 0x7fec2010fea0 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.058+0000 7fec1ffff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fec200fb3d0 con 0x7fec201156a0 2026-02-20T13:29:55.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010f4b0 0x7fec200f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010f4b0 0x7fec200f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54080/0 (socket says 10.20.193.28:54080) 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 -- 10.20.193.28:0/4276899642 learned_addr learned my addr 10.20.193.28:0/4276899642 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1e7fc640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec2010fea0 0x7fec20175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1f7fe640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec201156a0 0x7fec200f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 -- 10.20.193.28:0/4276899642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec201156a0 msgr2=0x7fec200f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec201156a0 0x7fec200f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 -- 10.20.193.28:0/4276899642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec2010fea0 msgr2=0x7fec20175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec2010fea0 0x7fec20175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 -- 10.20.193.28:0/4276899642 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec080094b0 con 0x7fec2010f4b0 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1e7fc640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec2010fea0 0x7fec20175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:55.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1effd640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010f4b0 0x7fec200f57e0 secure :-1 s=READY pgs=1339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec14009480 tx=0x7fec1400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7febfffff640 1 -- 10.20.193.28:0/4276899642 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec1400cd40 con 0x7fec2010f4b0 2026-02-20T13:29:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7febfffff640 1 -- 10.20.193.28:0/4276899642 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fec14004d30 con 0x7fec2010f4b0 2026-02-20T13:29:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7febfffff640 1 -- 10.20.193.28:0/4276899642 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec140106b0 con 0x7fec2010f4b0 2026-02-20T13:29:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1ffff640 1 -- 10.20.193.28:0/4276899642 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec200fb6b0 con 0x7fec2010f4b0 2026-02-20T13:29:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.059+0000 7fec1ffff640 1 -- 10.20.193.28:0/4276899642 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec200fbb30 con 0x7fec2010f4b0 2026-02-20T13:29:55.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.060+0000 7febfdffb640 1 -- 10.20.193.28:0/4276899642 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec20110790 con 0x7fec2010f4b0 2026-02-20T13:29:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.062+0000 7febfffff640 1 -- 10.20.193.28:0/4276899642 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fec1401f060 con 0x7fec2010f4b0 2026-02-20T13:29:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.063+0000 7febfffff640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7febf40b5750 0x7febf40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.063+0000 7febfffff640 1 -- 10.20.193.28:0/4276899642 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fec14014070 con 0x7fec2010f4b0 2026-02-20T13:29:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.064+0000 7febfffff640 1 -- 10.20.193.28:0/4276899642 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fec140e71c0 con 0x7fec2010f4b0 2026-02-20T13:29:55.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.064+0000 7fec1e7fc640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7febf40b5750 0x7febf40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.064+0000 7fec1e7fc640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7febf40b5750 0x7febf40d5c00 secure :-1 s=READY pgs=559 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec080023d0 tx=0x7fec0803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.205+0000 7febfdffb640 1 -- 10.20.193.28:0/4276899642 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec200f68f0 con 0x7fec2010f4b0 2026-02-20T13:29:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.206+0000 7febfffff640 1 -- 10.20.193.28:0/4276899642 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11997 (secure 0 0 0) 0x7fec140a98b0 con 0x7fec2010f4b0 2026-02-20T13:29:55.209 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:29:55.209 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T13:28:03:632229+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:28:03.346734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[3],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:29:55.210 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T13:29:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 -- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7febf40b5750 msgr2=0x7febf40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7febf40b5750 0x7febf40d5c00 secure :-1 s=READY pgs=559 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec080023d0 tx=0x7fec0803a040 comp rx=0 tx=0).stop 2026-02-20T13:29:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 -- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010f4b0 msgr2=0x7fec200f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010f4b0 0x7fec200f57e0 secure :-1 s=READY pgs=1339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec14009480 tx=0x7fec1400ee60 comp rx=0 tx=0).stop 2026-02-20T13:29:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 -- 10.20.193.28:0/4276899642 shutdown_connections 2026-02-20T13:29:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7febf40b5750 0x7febf40d5c00 unknown :-1 s=CLOSED pgs=559 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fec201156a0 0x7fec200f5ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fec2010fea0 0x7fec20175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 --2- 10.20.193.28:0/4276899642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec2010f4b0 0x7fec200f57e0 unknown :-1 s=CLOSED pgs=1339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 -- 10.20.193.28:0/4276899642 >> 10.20.193.28:0/4276899642 conn(0x7fec200ecda0 msgr2=0x7fec20111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 -- 10.20.193.28:0/4276899642 shutdown_connections 2026-02-20T13:29:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.207+0000 7febfdffb640 1 -- 10.20.193.28:0/4276899642 wait complete. 2026-02-20T13:29:55.313 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2026-02-20T13:29:55.313 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2026-02-20T13:29:55.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/197946540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd6810ed70 msgr2=0x7fcd6810f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/197946540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd6810ed70 0x7fcd6810f1e0 secure :-1 s=READY pgs=1340 gs=1 cs=0 l=1 c_cookie=2789900216780560489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd58009980 tx=0x7fcd5802f190 comp rx=0 tx=0).stop 2026-02-20T13:29:55.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/197946540 shutdown_connections 2026-02-20T13:29:55.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/197946540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd6810ed70 0x7fcd6810f1e0 unknown :-1 s=CLOSED pgs=1340 gs=1 cs=0 l=1 c_cookie=2789900216780560489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/197946540 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd6810f720 0x7fcd681714b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/197946540 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd681104e0 0x7fcd681108d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/197946540 >> 10.20.193.28:0/197946540 conn(0x7fcd680ec710 msgr2=0x7fcd6810cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/197946540 shutdown_connections 2026-02-20T13:29:55.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.387+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/197946540 wait complete. 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6d1d2640 1 Processor -- start 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6d1d2640 1 -- start start 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6d1d2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd6810ed70 0x7fcd680f8660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6d1d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd6810f720 0x7fcd681714b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6d1d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd681104e0 0x7fcd680f8ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6d1d2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcd680f9ab0 con 0x7fcd681104e0 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6d1d2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcd680f9c20 con 0x7fcd6810ed70 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6d1d2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcd680f9de0 con 0x7fcd6810f720 2026-02-20T13:29:55.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6c9d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd681104e0 0x7fcd680f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd6810ed70 0x7fcd680f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd6810ed70 0x7fcd680f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40802/0 (socket says 10.20.193.28:40802) 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd67fff640 1 -- 10.20.193.28:0/1193179551 learned_addr learned my addr 10.20.193.28:0/1193179551 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd6c9d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd681104e0 0x7fcd680f8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54102/0 (socket says 10.20.193.28:54102) 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.388+0000 7fcd677fe640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd6810f720 0x7fcd681714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd6c9d1640 1 -- 10.20.193.28:0/1193179551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd6810f720 msgr2=0x7fcd681714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd6c9d1640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd6810f720 0x7fcd681714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd6c9d1640 1 -- 10.20.193.28:0/1193179551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd6810ed70 msgr2=0x7fcd680f8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd6c9d1640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd6810ed70 0x7fcd680f8660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd6c9d1640 1 -- 10.20.193.28:0/1193179551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd58009570 con 0x7fcd681104e0 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd6c9d1640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd681104e0 0x7fcd680f8ec0 secure :-1 s=READY pgs=1341 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd5c00e720 tx=0x7fcd5c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd657fa640 1 -- 10.20.193.28:0/1193179551 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd5c005500 con 0x7fcd681104e0 2026-02-20T13:29:55.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd657fa640 1 -- 10.20.193.28:0/1193179551 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcd5c005660 con 0x7fcd681104e0 2026-02-20T13:29:55.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/1193179551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd680fa0c0 con 0x7fcd681104e0 2026-02-20T13:29:55.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd657fa640 1 -- 10.20.193.28:0/1193179551 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd5c011460 con 0x7fcd681104e0 2026-02-20T13:29:55.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.389+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/1193179551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd680fa590 con 0x7fcd681104e0 2026-02-20T13:29:55.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.392+0000 7fcd657fa640 1 -- 10.20.193.28:0/1193179551 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcd5c00c7e0 con 0x7fcd681104e0 2026-02-20T13:29:55.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.394+0000 7fcd657fa640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd3c0b56e0 0x7fcd3c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.394+0000 7fcd657fa640 1 -- 10.20.193.28:0/1193179551 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcd5c0e7a40 con 0x7fcd681104e0 2026-02-20T13:29:55.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.394+0000 7fcd67fff640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd3c0b56e0 0x7fcd3c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.394+0000 7fcd67fff640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd3c0b56e0 0x7fcd3c0d5b90 secure :-1 s=READY pgs=560 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd54005c70 tx=0x7fcd54007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.394+0000 7fcd70a49e00 1 Processor -- start 2026-02-20T13:29:55.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd70a49e00 1 -- start start 2026-02-20T13:29:55.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efea8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7f00b1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7f02bae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561d7eedffd0 con 0x561d7efca4c0 2026-02-20T13:29:55.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561d7eedbd00 con 0x561d7efeade0 2026-02-20T13:29:55.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561d7eed5ca0 con 0x561d7f00b700 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7f00b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54106/0 (socket says 10.20.193.28:54106) 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd67fff640 1 -- 10.20.193.28:0/724747006 learned_addr learned my addr 10.20.193.28:0/724747006 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd6c9d1640 1 --2- 10.20.193.28:0/724747006 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7f02bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd677fe640 1 -- 10.20.193.28:0/724747006 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 msgr2=0x561d7f02bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd677fe640 1 --2- 10.20.193.28:0/724747006 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7f02bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd677fe640 1 -- 10.20.193.28:0/724747006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 msgr2=0x561d7efea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd677fe640 1 --2- 10.20.193.28:0/724747006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efea8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.395+0000 7fcd677fe640 1 -- 10.20.193.28:0/724747006 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d7ee788b0 con 0x561d7efeade0 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd677fe640 1 --2- 10.20.193.28:0/724747006 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7f00b1c0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=1018676248142435272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd58009950 tx=0x7fcd58002390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2310a687a853c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd2bfff640 1 -- 10.20.193.28:0/724747006 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd5803d070 con 0x561d7efeade0 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd2bfff640 1 -- 10.20.193.28:0/724747006 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcd5803e040 con 0x561d7efeade0 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd2bfff640 1 -- 10.20.193.28:0/724747006 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd5802fd00 con 0x561d7efeade0 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 -- 10.20.193.28:0/724747006 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 msgr2=0x561d7f00b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/724747006 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7f00b1c0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=1018676248142435272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd58009950 tx=0x7fcd58002390 comp rx=0 tx=0).stop 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 -- 10.20.193.28:0/724747006 shutdown_connections 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/724747006 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7f02bae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/724747006 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7f00b1c0 unknown :-1 s=CLOSED pgs=465 gs=1 cs=0 l=1 c_cookie=1018676248142435272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/724747006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efea8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 -- 10.20.193.28:0/724747006 >> 10.20.193.28:0/724747006 conn(0x561d7eee91c0 msgr2=0x561d7efc8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 -- 10.20.193.28:0/724747006 shutdown_connections 2026-02-20T13:29:55.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.396+0000 7fcd70a49e00 1 -- 10.20.193.28:0/724747006 wait complete. 2026-02-20T13:29:55.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.398+0000 7fcd70a49e00 1 -- start start 2026-02-20T13:29:55.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.398+0000 7fcd70a49e00 1 Processor -- start 2026-02-20T13:29:55.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.398+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efe3af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.398+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7efe4140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7efe4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561d7efe5200 con 0x561d7efca4c0 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561d7efe5370 con 0x561d7efeade0 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561d7efe5530 con 0x561d7f00b700 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7efe4140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efe3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7efe4140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40828/0 (socket says 10.20.193.28:40828) 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd677fe640 1 -- 10.20.193.28:0/2481731944 learned_addr learned my addr 10.20.193.28:0/2481731944 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd6c9d1640 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7efe4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd677fe640 1 -- 10.20.193.28:0/2481731944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 msgr2=0x561d7efe4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd677fe640 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7efe4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd677fe640 1 -- 10.20.193.28:0/2481731944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 msgr2=0x561d7efe3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd677fe640 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efe3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd677fe640 1 -- 10.20.193.28:0/2481731944 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d7ee81400 con 0x561d7efeade0 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.399+0000 7fcd67fff640 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efe3af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:55.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd677fe640 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7efe4140 secure :-1 s=READY pgs=466 gs=2 cs=0 l=1 c_cookie=5950844900423059972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd58009980 tx=0x7fcd580028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5295a5e873294a04 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd297fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd297fa640 1 -- 10.20.193.28:0/2481731944 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd5803d040 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd297fa640 1 -- 10.20.193.28:0/2481731944 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcd5802fe90 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd68171f10 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd297fa640 1 -- 10.20.193.28:0/2481731944 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd58043970 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 10 client.29915 _ll_register_callbacks cb 0x561d7ee60a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561d7eb75520 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd297fa640 1 -- 10.20.193.28:0/2481731944 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcd58043b00 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd297fa640 1 -- 10.20.193.28:0/2481731944 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd58043d20 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 10 client.29915 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561d7ee59da0 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd297fa640 1 -- 10.20.193.28:0/2481731944 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fcd58038920 con 0x561d7efeade0 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 10 client.29915 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 10 client.29915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:55.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 20 client.29915 populate_metadata read hostname 'trial028' 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561d7efe7f60 0x561d7efe83e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 4 client.29915 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.400+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d7ef07630 con 0x561d7efe7f60 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.401+0000 7fcd67fff640 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561d7efe7f60 0x561d7efe83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.401+0000 7fcd67fff640 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561d7efe7f60 0x561d7efe83e0 crc :-1 s=READY pgs=360 gs=4 cs=0 l=0 c_cookie=2057373153379296291 s_cookie=14188849681746381200 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c8d41fb89992423 server_cookie=c4e8eb9c1be84990 in_seq=0 out_seq=0 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.401+0000 7fcd297fa640 10 client.29915 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd297fa640 1 -- 10.20.193.28:0/2481731944 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561d7ef07630 con 0x561d7efe7f60 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd297fa640 10 client.29915 handle_command_reply: tid=0 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 client.29915 shutdown 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 msgr2=0x561d7efe4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7efe4140 secure :-1 s=READY pgs=466 gs=2 cs=0 l=1 c_cookie=5950844900423059972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd58009980 tx=0x7fcd580028d0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 shutdown_connections 2026-02-20T13:29:55.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561d7efe7f60 0x561d7efe83e0 crc :-1 s=READY pgs=360 gs=4 cs=0 l=0 c_cookie=2057373153379296291 s_cookie=14188849681746381200 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7efe4ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efeade0 0x561d7efe4140 unknown :-1 s=CLOSED pgs=466 gs=2 cs=0 l=1 c_cookie=5950844900423059972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/2481731944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efca4c0 0x561d7efe3af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 >> 10.20.193.28:0/2481731944 conn(0x561d7eee91c0 msgr2=0x561d7efcb790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd297fa640 0 client.29915 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:55.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 shutdown_connections 2026-02-20T13:29:55.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 1 -- 10.20.193.28:0/2481731944 wait complete. 2026-02-20T13:29:55.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.402+0000 7fcd70a49e00 20 client.29915 trim_cache size 0 max 16384 2026-02-20T13:29:55.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.410+0000 7fcd70a49e00 1 Processor -- start 2026-02-20T13:29:55.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.410+0000 7fcd70a49e00 1 -- start start 2026-02-20T13:29:55.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7efca4c0 0x561d7efe4090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efe0e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7f00b700 0x561d7efe1360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561d7eed38d0 con 0x561d7efeade0 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561d7ec14f10 con 0x561d7f00b700 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd70a49e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561d7efe5670 con 0x561d7efca4c0 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7efca4c0 0x561d7efe4090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7efca4c0 0x561d7efe4090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:52970/0 (socket says 10.20.193.28:52970) 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 -- 10.20.193.28:0/4039438642 learned_addr learned my addr 10.20.193.28:0/4039438642 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd677fe640 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efe0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd6c9d1640 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7f00b700 0x561d7efe1360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 -- 10.20.193.28:0/4039438642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7f00b700 msgr2=0x561d7efe1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7f00b700 0x561d7efe1360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 -- 10.20.193.28:0/4039438642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 msgr2=0x561d7efe0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efe0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 -- 10.20.193.28:0/4039438642 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d7ee6b670 con 0x561d7efca4c0 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd6c9d1640 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7f00b700 0x561d7efe1360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.411+0000 7fcd67fff640 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7efca4c0 0x561d7efe4090 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=13453539296695310160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd540046e0 tx=0x7fcd54013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab492b5df485750 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.412+0000 7fcd2b7fe640 1 -- 10.20.193.28:0/4039438642 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd54022040 con 0x561d7efca4c0 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.412+0000 7fcd2b7fe640 1 -- 10.20.193.28:0/4039438642 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcd54023040 con 0x561d7efca4c0 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.412+0000 7fcd2b7fe640 1 -- 10.20.193.28:0/4039438642 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd5401db00 con 0x561d7efca4c0 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.412+0000 7fcd70a49e00 1 -- 10.20.193.28:0/4039438642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7efca4c0 msgr2=0x561d7efe4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.412+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7efca4c0 0x561d7efe4090 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=13453539296695310160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd540046e0 tx=0x7fcd54013000 comp rx=0 tx=0).stop 2026-02-20T13:29:55.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 -- 10.20.193.28:0/4039438642 shutdown_connections 2026-02-20T13:29:55.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efe0e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7f00b700 0x561d7efe1360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/4039438642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7efca4c0 0x561d7efe4090 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=13453539296695310160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 -- 10.20.193.28:0/4039438642 >> 10.20.193.28:0/4039438642 conn(0x561d7eee91c0 msgr2=0x561d7efe3980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 -- 10.20.193.28:0/4039438642 shutdown_connections 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 -- 10.20.193.28:0/4039438642 wait complete. 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 -- start start 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.413+0000 7fcd70a49e00 1 Processor -- start 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efca4c0 0x561d7efebf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd70a49e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efec5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efca4c0 0x561d7efebf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efca4c0 0x561d7efebf50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40850/0 (socket says 10.20.193.28:40850) 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd67fff640 1 -- 10.20.193.28:0/1043231076 learned_addr learned my addr 10.20.193.28:0/1043231076 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7efed170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561d7efd1250 con 0x561d7efeade0 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561d7efed8a0 con 0x561d7efca4c0 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561d7efeda60 con 0x561d7f00b700 2026-02-20T13:29:55.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd677fe640 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd6c9d1640 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7efed170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd67fff640 1 -- 10.20.193.28:0/1043231076 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 msgr2=0x561d7efed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd67fff640 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7efed170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd67fff640 1 -- 10.20.193.28:0/1043231076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 msgr2=0x561d7efec5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd67fff640 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efec5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd67fff640 1 -- 10.20.193.28:0/1043231076 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d7ee660f0 con 0x561d7efca4c0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.414+0000 7fcd677fe640 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efec5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd67fff640 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efca4c0 0x561d7efebf50 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=1387817864245346937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd54007fa0 tx=0x7fcd5401d410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134284fe9b490279 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd297fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd297fa640 1 -- 10.20.193.28:0/1043231076 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd54022040 con 0x561d7efca4c0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd297fa640 1 -- 10.20.193.28:0/1043231076 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcd54015070 con 0x561d7efca4c0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd54011440 con 0x561d7efca4c0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd297fa640 1 -- 10.20.193.28:0/1043231076 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd540356b0 con 0x561d7efca4c0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 10 client.29921 _ll_register_callbacks cb 0x561d7ee60a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:55.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561d7ef85ca0 con 0x561d7efca4c0 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd297fa640 1 -- 10.20.193.28:0/1043231076 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcd5402ce10 con 0x561d7efca4c0 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd297fa640 1 -- 10.20.193.28:0/1043231076 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd54035840 con 0x561d7efca4c0 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 10 client.29921 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561d7ee5a0d0 con 0x561d7efca4c0 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd297fa640 1 -- 10.20.193.28:0/1043231076 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fcd5401d860 con 0x561d7efca4c0 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 10 client.29921 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 10 client.29921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 20 client.29921 populate_metadata read hostname 'trial028' 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561d7efef8e0 0x561d7efefd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.415+0000 7fcd70a49e00 4 client.29921 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.416+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d7ebb9640 con 0x561d7efef8e0 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.416+0000 7fcd677fe640 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561d7efef8e0 0x561d7efefd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.416+0000 7fcd677fe640 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561d7efef8e0 0x561d7efefd50 crc :-1 s=READY pgs=361 gs=4 cs=0 l=0 c_cookie=10615384456967837920 s_cookie=909770117792786974 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93516bebbfc558e0 server_cookie=ca0271a1a4dea1e in_seq=0 out_seq=0 2026-02-20T13:29:55.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.416+0000 7fcd297fa640 10 client.29921 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:55.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd297fa640 1 -- 10.20.193.28:0/1043231076 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d7ebb9640 con 0x561d7efef8e0 2026-02-20T13:29:55.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd297fa640 10 client.29921 handle_command_reply: tid=0 2026-02-20T13:29:55.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 client.29921 shutdown 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efca4c0 msgr2=0x561d7efebf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efca4c0 0x561d7efebf50 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=1387817864245346937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd54007fa0 tx=0x7fcd5401d410 comp rx=0 tx=0).stop 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 shutdown_connections 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561d7efef8e0 0x561d7efefd50 crc :-1 s=READY pgs=361 gs=4 cs=0 l=0 c_cookie=10615384456967837920 s_cookie=909770117792786974 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d7efeade0 0x561d7efec5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561d7f00b700 0x561d7efed170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 --2- 10.20.193.28:0/1043231076 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561d7efca4c0 0x561d7efebf50 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=1387817864245346937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd297fa640 0 client.29921 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 >> 10.20.193.28:0/1043231076 conn(0x561d7eee91c0 msgr2=0x561d7efe3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 shutdown_connections 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.420+0000 7fcd70a49e00 1 -- 10.20.193.28:0/1043231076 wait complete. 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd70a49e00 20 client.29921 trim_cache size 0 max 16384 2026-02-20T13:29:55.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:29:55.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:29:55.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:29:55.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:29:55.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd3c0b56e0 msgr2=0x7fcd3c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd3c0b56e0 0x7fcd3c0d5b90 secure :-1 s=READY pgs=560 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd54005c70 tx=0x7fcd54007480 comp rx=0 tx=0).stop 2026-02-20T13:29:55.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd681104e0 msgr2=0x7fcd680f8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd681104e0 0x7fcd680f8ec0 secure :-1 s=READY pgs=1341 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd5c00e720 tx=0x7fcd5c00ebf0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/1193179551 shutdown_connections 2026-02-20T13:29:55.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcd3c0b56e0 0x7fcd3c0d5b90 unknown :-1 s=CLOSED pgs=560 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd681104e0 0x7fcd680f8ec0 unknown :-1 s=CLOSED pgs=1341 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcd6810f720 0x7fcd681714b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 --2- 10.20.193.28:0/1193179551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcd6810ed70 0x7fcd680f8660 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/1193179551 >> 10.20.193.28:0/1193179551 conn(0x7fcd680ec710 msgr2=0x7fcd680eecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/1193179551 shutdown_connections 2026-02-20T13:29:55.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:29:55.421+0000 7fcd6d1d2640 1 -- 10.20.193.28:0/1193179551 wait complete. 2026-02-20T13:29:55.501 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:29:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 -- 10.20.193.28:0/3913751075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc113430 msgr2=0x7fcadc173e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 --2- 10.20.193.28:0/3913751075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc113430 0x7fcadc173e00 secure :-1 s=READY pgs=1342 gs=1 cs=0 l=1 c_cookie=4337303978666702546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcacc00aa30 tx=0x7fcacc030270 comp rx=0 tx=0).stop 2026-02-20T13:29:55.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 -- 10.20.193.28:0/3913751075 shutdown_connections 2026-02-20T13:29:55.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 --2- 10.20.193.28:0/3913751075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc113430 0x7fcadc173e00 unknown :-1 s=CLOSED pgs=1342 gs=1 cs=0 l=1 c_cookie=4337303978666702546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 --2- 10.20.193.28:0/3913751075 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcadc10dc30 0x7fcadc112c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 --2- 10.20.193.28:0/3913751075 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcadc10d240 0x7fcadc10d610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 -- 10.20.193.28:0/3913751075 >> 10.20.193.28:0/3913751075 conn(0x7fcadc0eaad0 msgr2=0x7fcadc10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 -- 10.20.193.28:0/3913751075 shutdown_connections 2026-02-20T13:29:55.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.682+0000 7fcadb577640 1 -- 10.20.193.28:0/3913751075 wait complete. 2026-02-20T13:29:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadb577640 1 Processor -- start 2026-02-20T13:29:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadb577640 1 -- start start 2026-02-20T13:29:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc10d240 0x7fcadc0f5720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadb577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcadc10dc30 0x7fcadc173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadb577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcadc113430 0x7fcadc0f5e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadb577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc0fb030 con 0x7fcadc10d240 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadb577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc0fb1a0 con 0x7fcadc10dc30 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadb577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc0fb360 con 0x7fcadc113430 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcada575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc10d240 0x7fcadc0f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcada575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc10d240 0x7fcadc0f5720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54134/0 (socket says 10.20.193.28:54134) 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcada575640 1 -- 10.20.193.28:0/4186022858 learned_addr learned my addr 10.20.193.28:0/4186022858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcad9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcadc10dc30 0x7fcadc173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.683+0000 7fcadad76640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcadc113430 0x7fcadc0f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcad9d74640 1 -- 10.20.193.28:0/4186022858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcadc113430 msgr2=0x7fcadc0f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcad9d74640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcadc113430 0x7fcadc0f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcad9d74640 1 -- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc10d240 msgr2=0x7fcadc0f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcad9d74640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc10d240 0x7fcadc0f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcad9d74640 1 -- 10.20.193.28:0/4186022858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc00a650 con 0x7fcadc10dc30 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcada575640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc10d240 0x7fcadc0f5720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcad9d74640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcadc10dc30 0x7fcadc173d00 secure :-1 s=READY pgs=468 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac400e940 tx=0x7fcac400ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcac37fe640 1 -- 10.20.193.28:0/4186022858 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcac400cce0 con 0x7fcadc10dc30 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcac37fe640 1 -- 10.20.193.28:0/4186022858 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcac400ce40 con 0x7fcadc10dc30 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcadb577640 1 -- 10.20.193.28:0/4186022858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcadc0fb640 con 0x7fcadc10dc30 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.684+0000 7fcadb577640 1 -- 10.20.193.28:0/4186022858 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcadc0fbb10 con 0x7fcadc10dc30 2026-02-20T13:29:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.685+0000 7fcac37fe640 1 -- 10.20.193.28:0/4186022858 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcac40106b0 con 0x7fcadc10dc30 2026-02-20T13:29:55.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.687+0000 7fcac37fe640 1 -- 10.20.193.28:0/4186022858 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcac401f060 con 0x7fcadc10dc30 2026-02-20T13:29:55.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.689+0000 7fcac37fe640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcab40b55e0 0x7fcab40d5a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.689+0000 7fcac37fe640 1 -- 10.20.193.28:0/4186022858 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcac4014070 con 0x7fcadc10dc30 2026-02-20T13:29:55.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.689+0000 7fcada575640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcab40b55e0 0x7fcab40d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.690+0000 7fcada575640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcab40b55e0 0x7fcab40d5a90 secure :-1 s=READY pgs=561 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad00095b0 tx=0x7fcad0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.690+0000 7fcae2bb1e00 1 Processor -- start 2026-02-20T13:29:55.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.690+0000 7fcae2bb1e00 1 -- start start 2026-02-20T13:29:55.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3660850 0x559cd3660c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd36a58c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd36a5e00 0x559cd36c61e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559cd3575780 con 0x559cd36a5e00 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559cd35714b0 con 0x559cd3661160 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559cd356b610 con 0x559cd3660850 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcada575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3660850 0x559cd3660c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcad9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd36a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcada575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3660850 0x559cd3660c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:53018/0 (socket says 10.20.193.28:53018) 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcada575640 1 -- 10.20.193.28:0/1539233087 learned_addr learned my addr 10.20.193.28:0/1539233087 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcadad76640 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd36a5e00 0x559cd36c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcada575640 1 -- 10.20.193.28:0/1539233087 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 msgr2=0x559cd36a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcada575640 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd36a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcada575640 1 -- 10.20.193.28:0/1539233087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd36a5e00 msgr2=0x559cd36c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcada575640 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd36a5e00 0x559cd36c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcada575640 1 -- 10.20.193.28:0/1539233087 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd3516c50 con 0x559cd3660850 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcad9d74640 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd36a58c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.691+0000 7fcadad76640 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd36a5e00 0x559cd36c61e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.692+0000 7fcada575640 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3660850 0x559cd3660c20 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=6989714980096467717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad0009e00 tx=0x7fcad0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=610074bdc5e06305 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.692+0000 7fcac0ff9640 1 -- 10.20.193.28:0/1539233087 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcad0004850 con 0x559cd3660850 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.692+0000 7fcac0ff9640 1 -- 10.20.193.28:0/1539233087 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcad0004e90 con 0x559cd3660850 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.692+0000 7fcac0ff9640 1 -- 10.20.193.28:0/1539233087 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcad001ca50 con 0x559cd3660850 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.692+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1539233087 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3660850 msgr2=0x559cd3660c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.692+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3660850 0x559cd3660c20 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=6989714980096467717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad0009e00 tx=0x7fcad0014000 comp rx=0 tx=0).stop 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.693+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1539233087 shutdown_connections 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.693+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd36a5e00 0x559cd36c61e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.693+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd36a58c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.693+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/1539233087 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3660850 0x559cd3660c20 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=6989714980096467717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.693+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1539233087 >> 10.20.193.28:0/1539233087 conn(0x559cd357e110 msgr2=0x559cd365f130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.693+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1539233087 shutdown_connections 2026-02-20T13:29:55.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.693+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1539233087 wait complete. 2026-02-20T13:29:55.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.694+0000 7fcae2bb1e00 1 -- start start 2026-02-20T13:29:55.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.694+0000 7fcae2bb1e00 1 Processor -- start 2026-02-20T13:29:55.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd36787f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd3678d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd367dd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559cd367e260 con 0x559cd3660850 2026-02-20T13:29:55.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559cd367e3d0 con 0x559cd3661160 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559cd367e590 con 0x559cd36a5e00 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcada575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd36787f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcada575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd36787f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54154/0 (socket says 10.20.193.28:54154) 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcada575640 1 -- 10.20.193.28:0/2891916072 learned_addr learned my addr 10.20.193.28:0/2891916072 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcad9d74640 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd3678d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcadad76640 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd367dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcada575640 1 -- 10.20.193.28:0/2891916072 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 msgr2=0x559cd367dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcada575640 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd367dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcada575640 1 -- 10.20.193.28:0/2891916072 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 msgr2=0x559cd3678d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcada575640 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd3678d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.695+0000 7fcada575640 1 -- 10.20.193.28:0/2891916072 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad0003e70 con 0x559cd3660850 2026-02-20T13:29:55.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fcada575640 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd36787f0 secure :-1 s=READY pgs=1343 gs=1 cs=0 l=1 c_cookie=13656041440396604951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad00046b0 tx=0x7fcad001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd84015654da7617 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fca8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fca8bfff640 1 -- 10.20.193.28:0/2891916072 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcad0032070 con 0x559cd3660850 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fca8bfff640 1 -- 10.20.193.28:0/2891916072 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcad0005670 con 0x559cd3660850 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcadc174670 con 0x559cd3660850 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fca8bfff640 1 -- 10.20.193.28:0/2891916072 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcad001ad50 con 0x559cd3660850 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fcae2bb1e00 10 client.20004 _ll_register_callbacks cb 0x559cd34ec320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559cd3201eb0 con 0x559cd3660850 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fca8bfff640 1 -- 10.20.193.28:0/2891916072 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcad002e430 con 0x559cd3660850 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fca8bfff640 1 -- 10.20.193.28:0/2891916072 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcad002e610 con 0x559cd3660850 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fcae2bb1e00 10 client.20004 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.696+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559cd34eee60 con 0x559cd3660850 2026-02-20T13:29:55.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.697+0000 7fca8bfff640 1 -- 10.20.193.28:0/2891916072 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fcad001a460 con 0x559cd3660850 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.697+0000 7fcae2bb1e00 10 client.20004 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.697+0000 7fcae2bb1e00 10 client.20004 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.697+0000 7fcae2bb1e00 20 client.20004 populate_metadata read hostname 'trial028' 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.697+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559cd36a2f40 0x559cd36a33e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.697+0000 7fcae2bb1e00 4 client.20004 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.697+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cd353d700 con 0x559cd36a2f40 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.697+0000 7fcad9d74640 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559cd36a2f40 0x559cd36a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.698+0000 7fcad9d74640 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559cd36a2f40 0x559cd36a33e0 crc :-1 s=READY pgs=362 gs=4 cs=0 l=0 c_cookie=7505079545568031782 s_cookie=4288181991024259135 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6827661544a1f426 server_cookie=3b82aecd133a703f in_seq=0 out_seq=0 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.698+0000 7fca8bfff640 10 client.20004 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.698+0000 7fca8bfff640 1 -- 10.20.193.28:0/2891916072 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559cd353d700 con 0x559cd36a2f40 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.698+0000 7fca8bfff640 10 client.20004 handle_command_reply: tid=0 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 client.20004 shutdown 2026-02-20T13:29:55.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 msgr2=0x559cd36787f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd36787f0 secure :-1 s=READY pgs=1343 gs=1 cs=0 l=1 c_cookie=13656041440396604951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad00046b0 tx=0x7fcad001c890 comp rx=0 tx=0).stop 2026-02-20T13:29:55.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 shutdown_connections 2026-02-20T13:29:55.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559cd36a2f40 0x559cd36a33e0 crc :-1 s=READY pgs=362 gs=4 cs=0 l=0 c_cookie=7505079545568031782 s_cookie=4288181991024259135 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd367dd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd3678d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/2891916072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd36787f0 unknown :-1 s=CLOSED pgs=1343 gs=1 cs=0 l=1 c_cookie=13656041440396604951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 >> 10.20.193.28:0/2891916072 conn(0x559cd357e110 msgr2=0x559cd365f840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fca8bfff640 0 client.20004 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:55.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 shutdown_connections 2026-02-20T13:29:55.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.699+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/2891916072 wait complete. 2026-02-20T13:29:55.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.700+0000 7fcae2bb1e00 20 client.20004 trim_cache size 0 max 16384 2026-02-20T13:29:55.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.708+0000 7fcae2bb1e00 1 Processor -- start 2026-02-20T13:29:55.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.708+0000 7fcae2bb1e00 1 -- start start 2026-02-20T13:29:55.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.708+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd369e200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.708+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd369e740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.708+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd36a4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.708+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559cd3569240 con 0x559cd3660850 2026-02-20T13:29:55.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.708+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559cd3229ec0 con 0x559cd3661160 2026-02-20T13:29:55.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.708+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559cd367e6d0 con 0x559cd36a5e00 2026-02-20T13:29:55.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd369e200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd369e200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54160/0 (socket says 10.20.193.28:54160) 2026-02-20T13:29:55.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcad9d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd369e740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 -- 10.20.193.28:0/1645145132 learned_addr learned my addr 10.20.193.28:0/1645145132 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcadad76640 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd36a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 -- 10.20.193.28:0/1645145132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 msgr2=0x559cd36a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd36a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 -- 10.20.193.28:0/1645145132 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 msgr2=0x559cd369e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd369e740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 -- 10.20.193.28:0/1645145132 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd366b460 con 0x559cd3660850 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcadad76640 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd36a4ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcada575640 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd369e200 secure :-1 s=READY pgs=1344 gs=1 cs=0 l=1 c_cookie=5377812697823387319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad0009480 tx=0x7fcad0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa1d427e2591eb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcaa64e6640 1 -- 10.20.193.28:0/1645145132 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcad0032040 con 0x559cd3660850 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcaa64e6640 1 -- 10.20.193.28:0/1645145132 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559cd3201eb0 con 0x559cd3660850 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcaa64e6640 1 -- 10.20.193.28:0/1645145132 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcad000e6d0 con 0x559cd3660850 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1645145132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 msgr2=0x559cd369e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.709+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd369e200 secure :-1 s=READY pgs=1344 gs=1 cs=0 l=1 c_cookie=5377812697823387319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad0009480 tx=0x7fcad0037000 comp rx=0 tx=0).stop 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.710+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1645145132 shutdown_connections 2026-02-20T13:29:55.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.710+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd36a5e00 0x559cd36a4ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.710+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd3661160 0x559cd369e740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.710+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/1645145132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd369e200 unknown :-1 s=CLOSED pgs=1344 gs=1 cs=0 l=1 c_cookie=5377812697823387319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.710+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1645145132 >> 10.20.193.28:0/1645145132 conn(0x559cd357e110 msgr2=0x559cd367d370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.710+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1645145132 shutdown_connections 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.710+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/1645145132 wait complete. 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.710+0000 7fcae2bb1e00 1 -- start start 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcae2bb1e00 1 Processor -- start 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd3682130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3661160 0x559cd3682670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcae2bb1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd36a5e00 0x559cd367ede0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559cd367dec0 con 0x559cd3660850 2026-02-20T13:29:55.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559cd35d3e30 con 0x559cd36a5e00 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcae2bb1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559cd367f350 con 0x559cd3661160 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcada575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd3682130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcada575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd3682130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54174/0 (socket says 10.20.193.28:54174) 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcad9d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3661160 0x559cd3682670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcada575640 1 -- 10.20.193.28:0/4270955284 learned_addr learned my addr 10.20.193.28:0/4270955284 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcadad76640 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd36a5e00 0x559cd367ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcada575640 1 -- 10.20.193.28:0/4270955284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3661160 msgr2=0x559cd3682670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcada575640 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3661160 0x559cd3682670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcada575640 1 -- 10.20.193.28:0/4270955284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd36a5e00 msgr2=0x559cd367ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcada575640 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd36a5e00 0x559cd367ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.711+0000 7fcada575640 1 -- 10.20.193.28:0/4270955284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd3500d80 con 0x559cd3660850 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fcada575640 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd3682130 secure :-1 s=READY pgs=1345 gs=1 cs=0 l=1 c_cookie=4498227816334793857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad0002d30 tx=0x7fcad0005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6cea5dc76a9c81 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fca8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fca8bfff640 1 -- 10.20.193.28:0/4270955284 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcad0005680 con 0x559cd3660850 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cd34eee60 con 0x559cd3660850 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fca8bfff640 1 -- 10.20.193.28:0/4270955284 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcad001cb80 con 0x559cd3660850 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fca8bfff640 1 -- 10.20.193.28:0/4270955284 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcad000eaa0 con 0x559cd3660850 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fcae2bb1e00 10 client.20010 _ll_register_callbacks cb 0x559cd34ec320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:29:55.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559cd31ff700 con 0x559cd3660850 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fca8bfff640 1 -- 10.20.193.28:0/4270955284 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcad001c630 con 0x559cd3660850 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fca8bfff640 1 -- 10.20.193.28:0/4270955284 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcad0040ed0 con 0x559cd3660850 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fcae2bb1e00 10 client.20010 fetch_fsmap learned FSMap version 29 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.712+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559cd34fb800 con 0x559cd3660850 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.713+0000 7fca8bfff640 1 -- 10.20.193.28:0/4270955284 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fcad001ccf0 con 0x559cd3660850 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.713+0000 7fcae2bb1e00 10 client.20010 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.713+0000 7fcae2bb1e00 10 client.20010 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.713+0000 7fcae2bb1e00 20 client.20010 populate_metadata read hostname 'trial028' 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.713+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559cd3753280 0x559cd3773700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.713+0000 7fcae2bb1e00 4 client.20010 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2026-02-20T13:29:55.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.713+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x7fcad0004e90 con 0x559cd3753280 2026-02-20T13:29:55.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.713+0000 7fcad9d74640 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559cd3753280 0x559cd3773700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:29:55.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.714+0000 7fcad9d74640 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559cd3753280 0x559cd3773700 crc :-1 s=READY pgs=363 gs=4 cs=0 l=0 c_cookie=8724307609712736397 s_cookie=15117971871022526913 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7912f78c342a388d server_cookie=d1cdd35178a531c1 in_seq=0 out_seq=0 2026-02-20T13:29:55.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.714+0000 7fca8bfff640 10 client.20010 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:55.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fca8bfff640 1 -- 10.20.193.28:0/4270955284 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fcad0004e90 con 0x559cd3753280 2026-02-20T13:29:55.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fca8bfff640 10 client.20010 handle_command_reply: tid=0 2026-02-20T13:29:55.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 client.20010 shutdown 2026-02-20T13:29:55.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 msgr2=0x559cd3682130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd3682130 secure :-1 s=READY pgs=1345 gs=1 cs=0 l=1 c_cookie=4498227816334793857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad0002d30 tx=0x7fcad0005540 comp rx=0 tx=0).stop 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 shutdown_connections 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559cd3753280 0x559cd3773700 crc :-1 s=READY pgs=363 gs=4 cs=0 l=0 c_cookie=8724307609712736397 s_cookie=15117971871022526913 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559cd36a5e00 0x559cd367ede0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559cd3661160 0x559cd3682670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 --2- 10.20.193.28:0/4270955284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559cd3660850 0x559cd3682130 unknown :-1 s=CLOSED pgs=1345 gs=1 cs=0 l=1 c_cookie=4498227816334793857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fca8bfff640 0 client.20010 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.718+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 >> 10.20.193.28:0/4270955284 conn(0x559cd357e110 msgr2=0x559cd367ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.719+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 shutdown_connections 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.719+0000 7fcae2bb1e00 1 -- 10.20.193.28:0/4270955284 wait complete. 2026-02-20T13:29:55.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.719+0000 7fcae2bb1e00 20 client.20010 trim_cache size 0 max 16384 2026-02-20T13:29:55.724 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:29:55.724 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T13:29:55.724 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:29:55.724 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 42, 2026-02-20T13:29:55.724 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:29:55.724 INFO:teuthology.orchestra.run.trial028.stdout: "82a1e66c": { 2026-02-20T13:29:55.724 INFO:teuthology.orchestra.run.trial028.stdout: "version": 42, 2026-02-20T13:29:55.724 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 130.0, 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:29:55.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:29:55.726 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:29:55.726 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:55.726 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:55.726 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:55.726 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:55.726 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:29:55.726 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:29:55.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.719+0000 7fcadb577640 1 -- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcab40b55e0 msgr2=0x7fcab40d5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.719+0000 7fcadb577640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcab40b55e0 0x7fcab40d5a90 secure :-1 s=READY pgs=561 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcad00095b0 tx=0x7fcad0005f90 comp rx=0 tx=0).stop 2026-02-20T13:29:55.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.719+0000 7fcadb577640 1 -- 10.20.193.28:0/4186022858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcadc10dc30 msgr2=0x7fcadc173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:29:55.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.719+0000 7fcadb577640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcadc10dc30 0x7fcadc173d00 secure :-1 s=READY pgs=468 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac400e940 tx=0x7fcac400ee10 comp rx=0 tx=0).stop 2026-02-20T13:29:55.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.720+0000 7fcadb577640 1 -- 10.20.193.28:0/4186022858 shutdown_connections 2026-02-20T13:29:55.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.720+0000 7fcadb577640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcab40b55e0 0x7fcab40d5a90 unknown :-1 s=CLOSED pgs=561 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.720+0000 7fcadb577640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcadc113430 0x7fcadc0f5e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.720+0000 7fcadb577640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcadc10dc30 0x7fcadc173d00 unknown :-1 s=CLOSED pgs=468 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.720+0000 7fcadb577640 1 --2- 10.20.193.28:0/4186022858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcadc10d240 0x7fcadc0f5720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:29:55.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.720+0000 7fcadb577640 1 -- 10.20.193.28:0/4186022858 >> 10.20.193.28:0/4186022858 conn(0x7fcadc0eaad0 msgr2=0x7fcadc111340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:29:55.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.720+0000 7fcadb577640 1 -- 10.20.193.28:0/4186022858 shutdown_connections 2026-02-20T13:29:55.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:29:55.720+0000 7fcadb577640 1 -- 10.20.193.28:0/4186022858 wait complete. 2026-02-20T13:29:55.819 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:55 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4276899642' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:55.821 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '82a1e66c', quiesce took 1.1 seconds. Will release after: 8.9 2026-02-20T13:29:55.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:55 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4276899642' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:55.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:55 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4276899642' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:29:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:56 trial127 ceph-mon[43817]: pgmap v559: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:29:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:56 trial034 ceph-mon[43332]: pgmap v559: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:29:57.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:56 trial028 ceph-mon[37442]: pgmap v559: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:29:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:29:58 trial127 ceph-mon[43817]: pgmap v560: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.9 KiB/s wr, 18 op/s 2026-02-20T13:29:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:29:58 trial034 ceph-mon[43332]: pgmap v560: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.9 KiB/s wr, 18 op/s 2026-02-20T13:29:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:29:58 trial028 ceph-mon[37442]: pgmap v560: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.9 KiB/s wr, 18 op/s 2026-02-20T13:30:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:00 trial127 ceph-mon[43817]: pgmap v561: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.0 KiB/s wr, 15 op/s 2026-02-20T13:30:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:00 trial127 ceph-mon[43817]: overall HEALTH_OK 2026-02-20T13:30:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:00 trial034 ceph-mon[43332]: pgmap v561: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.0 KiB/s wr, 15 op/s 2026-02-20T13:30:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:00 trial034 ceph-mon[43332]: overall HEALTH_OK 2026-02-20T13:30:01.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:00 trial028 ceph-mon[37442]: pgmap v561: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.0 KiB/s wr, 15 op/s 2026-02-20T13:30:01.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:00 trial028 ceph-mon[37442]: overall HEALTH_OK 2026-02-20T13:30:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:02 trial127 ceph-mon[43817]: pgmap v562: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2026-02-20T13:30:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:02 trial034 ceph-mon[43332]: pgmap v562: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2026-02-20T13:30:03.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:02 trial028 ceph-mon[37442]: pgmap v562: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2026-02-20T13:30:04.722 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:30:04.906 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:04.950 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:04 trial028 ceph-mon[37442]: pgmap v563: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2026-02-20T13:30:04.950 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:04 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:30:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:04 trial127 ceph-mon[43817]: pgmap v563: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2026-02-20T13:30:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:04 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:30:04.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:04 trial034 ceph-mon[43332]: pgmap v563: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2026-02-20T13:30:04.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:04 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:30:05.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1385849839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 msgr2=0x7f43a8111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1385849839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 0x7f43a8111550 secure :-1 s=READY pgs=1346 gs=1 cs=0 l=1 c_cookie=13631511330853156468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f439c00aa60 tx=0x7f439c0302b0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1385849839 shutdown_connections 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1385849839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 0x7f43a8111550 unknown :-1 s=CLOSED pgs=1346 gs=1 cs=0 l=1 c_cookie=13631511330853156468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1385849839 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43a810c4c0 0x7f43a8110a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1385849839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43a810bad0 0x7f43a810bea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1385849839 >> 10.20.193.28:0/1385849839 conn(0x7f43a80e9780 msgr2=0x7f43a8109b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1385849839 shutdown_connections 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.088+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1385849839 wait complete. 2026-02-20T13:30:05.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43ae3cf640 1 Processor -- start 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43ae3cf640 1 -- start start 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43ae3cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43a810bad0 0x7f43a8122470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43ae3cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43a810c4c0 0x7f43a81229b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43ae3cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 0x7f43a8127d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43ae3cf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8128350 con 0x7f43a81110b0 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43ae3cf640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81284c0 con 0x7f43a810c4c0 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43ae3cf640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8128680 con 0x7f43a810bad0 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.089+0000 7f43a77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43a810c4c0 0x7f43a81229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43a77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43a810c4c0 0x7f43a81229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:53818/0 (socket says 10.20.193.28:53818) 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43a7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43a810bad0 0x7f43a8122470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ac945640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 0x7f43a8127d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43a77fe640 1 -- 10.20.193.28:0/1814009420 learned_addr learned my addr 10.20.193.28:0/1814009420 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ac945640 1 -- 10.20.193.28:0/1814009420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43a810bad0 msgr2=0x7f43a8122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ac945640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43a810bad0 0x7f43a8122470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ac945640 1 -- 10.20.193.28:0/1814009420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43a810c4c0 msgr2=0x7f43a81229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ac945640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43a810c4c0 0x7f43a81229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ac945640 1 -- 10.20.193.28:0/1814009420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439c00a650 con 0x7f43a81110b0 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43a77fe640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43a810c4c0 0x7f43a81229b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ac945640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 0x7f43a8127d30 secure :-1 s=READY pgs=1347 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f439c00aa60 tx=0x7f439c006a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43a57fa640 1 -- 10.20.193.28:0/1814009420 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f439c03e070 con 0x7f43a81110b0 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43a57fa640 1 -- 10.20.193.28:0/1814009420 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f439c039e00 con 0x7f43a81110b0 2026-02-20T13:30:05.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43a57fa640 1 -- 10.20.193.28:0/1814009420 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f439c042930 con 0x7f43a81110b0 2026-02-20T13:30:05.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a8128960 con 0x7f43a81110b0 2026-02-20T13:30:05.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.090+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a8169060 con 0x7f43a81110b0 2026-02-20T13:30:05.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.091+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a8128b80 con 0x7f43a81110b0 2026-02-20T13:30:05.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.093+0000 7f43a57fa640 1 -- 10.20.193.28:0/1814009420 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f439c039920 con 0x7f43a81110b0 2026-02-20T13:30:05.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.094+0000 7f43a57fa640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f437c0b5760 0x7f437c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.094+0000 7f43a57fa640 1 -- 10.20.193.28:0/1814009420 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f439c10c890 con 0x7f43a81110b0 2026-02-20T13:30:05.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.094+0000 7f43a57fa640 1 -- 10.20.193.28:0/1814009420 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f439c0cf2f0 con 0x7f43a81110b0 2026-02-20T13:30:05.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.094+0000 7f43a7fff640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f437c0b5760 0x7f437c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.095+0000 7f43a7fff640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f437c0b5760 0x7f437c0d5c10 secure :-1 s=READY pgs=563 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4394004740 tx=0x7f439400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:05.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.236+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43a8123580 con 0x7f43a81110b0 2026-02-20T13:30:05.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.237+0000 7f43a57fa640 1 -- 10.20.193.28:0/1814009420 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f439c0d24a0 con 0x7f43a81110b0 2026-02-20T13:30:05.239 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:30:05.239 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:30:05.239 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:30:05.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.238+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f437c0b5760 msgr2=0x7f437c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.238+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f437c0b5760 0x7f437c0d5c10 secure :-1 s=READY pgs=563 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4394004740 tx=0x7f439400b410 comp rx=0 tx=0).stop 2026-02-20T13:30:05.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.238+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 msgr2=0x7f43a8127d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.238+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 0x7f43a8127d30 secure :-1 s=READY pgs=1347 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f439c00aa60 tx=0x7f439c006a70 comp rx=0 tx=0).stop 2026-02-20T13:30:05.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.239+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 shutdown_connections 2026-02-20T13:30:05.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.239+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f437c0b5760 0x7f437c0d5c10 unknown :-1 s=CLOSED pgs=563 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.239+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43a81110b0 0x7f43a8127d30 unknown :-1 s=CLOSED pgs=1347 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.239+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f43a810c4c0 0x7f43a81229b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.239+0000 7f43ae3cf640 1 --2- 10.20.193.28:0/1814009420 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f43a810bad0 0x7f43a8122470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.239+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 >> 10.20.193.28:0/1814009420 conn(0x7f43a80e9780 msgr2=0x7f43a8109b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:05.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.239+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 shutdown_connections 2026-02-20T13:30:05.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.239+0000 7f43ae3cf640 1 -- 10.20.193.28:0/1814009420 wait complete. 2026-02-20T13:30:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id 82a1e66c --release --await' 2026-02-20T13:30:05.347 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id 82a1e66c --release --await 2026-02-20T13:30:05.532 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:05.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 -- 10.20.193.28:0/3364822120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410fea0 msgr2=0x7fb884114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 --2- 10.20.193.28:0/3364822120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410fea0 0x7fb884114ef0 secure :-1 s=READY pgs=1348 gs=1 cs=0 l=1 c_cookie=18284840116834895971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb878009950 tx=0x7fb87802f190 comp rx=0 tx=0).stop 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 -- 10.20.193.28:0/3364822120 shutdown_connections 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 --2- 10.20.193.28:0/3364822120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410fea0 0x7fb884114ef0 unknown :-1 s=CLOSED pgs=1348 gs=1 cs=0 l=1 c_cookie=18284840116834895971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 --2- 10.20.193.28:0/3364822120 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb8841156a0 0x7fb884176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 --2- 10.20.193.28:0/3364822120 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb88410f4b0 0x7fb88410f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 -- 10.20.193.28:0/3364822120 >> 10.20.193.28:0/3364822120 conn(0x7fb8840ecda0 msgr2=0x7fb88410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 -- 10.20.193.28:0/3364822120 shutdown_connections 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.710+0000 7fb88adc8640 1 -- 10.20.193.28:0/3364822120 wait complete. 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb88adc8640 1 Processor -- start 2026-02-20T13:30:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb88adc8640 1 -- start start 2026-02-20T13:30:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb88adc8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410f4b0 0x7fb8840f5780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb88adc8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb88410fea0 0x7fb884175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb88adc8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb8841156a0 0x7fb8840f5e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb88adc8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb8840fb090 con 0x7fb88410f4b0 2026-02-20T13:30:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb88adc8640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb8840fb200 con 0x7fb8841156a0 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb88adc8640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb8840fb3c0 con 0x7fb88410fea0 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.711+0000 7fb889dc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410f4b0 0x7fb8840f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb889dc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410f4b0 0x7fb8840f5780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49166/0 (socket says 10.20.193.28:49166) 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb889dc6640 1 -- 10.20.193.28:0/2242640570 learned_addr learned my addr 10.20.193.28:0/2242640570 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb8895c5640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb88410fea0 0x7fb884175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb889dc6640 1 -- 10.20.193.28:0/2242640570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb88410fea0 msgr2=0x7fb884175f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb889dc6640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb88410fea0 0x7fb884175f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb889dc6640 1 -- 10.20.193.28:0/2242640570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb8841156a0 msgr2=0x7fb8840f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb889dc6640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb8841156a0 0x7fb8840f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb889dc6640 1 -- 10.20.193.28:0/2242640570 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb878009570 con 0x7fb88410f4b0 2026-02-20T13:30:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb889dc6640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410f4b0 0x7fb8840f5780 secure :-1 s=READY pgs=1349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb874009480 tx=0x7fb87400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb872ffd640 1 -- 10.20.193.28:0/2242640570 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb87400cd40 con 0x7fb88410f4b0 2026-02-20T13:30:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb872ffd640 1 -- 10.20.193.28:0/2242640570 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb874004d30 con 0x7fb88410f4b0 2026-02-20T13:30:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb872ffd640 1 -- 10.20.193.28:0/2242640570 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8740106b0 con 0x7fb88410f4b0 2026-02-20T13:30:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb88adc8640 1 -- 10.20.193.28:0/2242640570 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8840fb6a0 con 0x7fb88410f4b0 2026-02-20T13:30:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.712+0000 7fb88adc8640 1 -- 10.20.193.28:0/2242640570 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8840fbb20 con 0x7fb88410f4b0 2026-02-20T13:30:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.715+0000 7fb872ffd640 1 -- 10.20.193.28:0/2242640570 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb87401f060 con 0x7fb88410f4b0 2026-02-20T13:30:05.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.716+0000 7fb872ffd640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8600b5750 0x7fb8600d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.717+0000 7fb872ffd640 1 -- 10.20.193.28:0/2242640570 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb874014070 con 0x7fb88410f4b0 2026-02-20T13:30:05.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.717+0000 7fb8895c5640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8600b5750 0x7fb8600d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.717+0000 7fb8895c5640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8600b5750 0x7fb8600d5c00 secure :-1 s=READY pgs=564 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8780023d0 tx=0x7fb878031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:05.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.717+0000 7fb88e04be00 1 Processor -- start 2026-02-20T13:30:05.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb88e04be00 1 -- start start 2026-02-20T13:30:05.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787698f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787ae590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 0x55d2787ceeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb88e04be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d27867ec70 con 0x55d278769520 2026-02-20T13:30:05.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb88e04be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d27867a9a0 con 0x55d278769e30 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb88e04be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d278674b00 con 0x55d2787aead0 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49174/0 (socket says 10.20.193.28:49174) 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 -- 10.20.193.28:0/1064273406 learned_addr learned my addr 10.20.193.28:0/1064273406 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 -- 10.20.193.28:0/1064273406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 msgr2=0x55d2787ceeb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 --2- 10.20.193.28:0/1064273406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 0x55d2787ceeb0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 -- 10.20.193.28:0/1064273406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 msgr2=0x55d2787ae590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb8895c5640 1 --2- 10.20.193.28:0/1064273406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 --2- 10.20.193.28:0/1064273406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787ae590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 -- 10.20.193.28:0/1064273406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d27861ff80 con 0x55d278769520 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb889dc6640 1 --2- 10.20.193.28:0/1064273406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787698f0 secure :-1 s=READY pgs=1350 gs=1 cs=0 l=1 c_cookie=12625759816335392032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb874004f20 tx=0x7fb874009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af37b5a8a8127d20 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:05.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.718+0000 7fb8524e6640 1 -- 10.20.193.28:0/1064273406 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8740ac9b0 con 0x55d278769520 2026-02-20T13:30:05.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb8524e6640 1 -- 10.20.193.28:0/1064273406 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8740adbb0 con 0x55d278769520 2026-02-20T13:30:05.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb8524e6640 1 -- 10.20.193.28:0/1064273406 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8740ae0c0 con 0x55d278769520 2026-02-20T13:30:05.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 -- 10.20.193.28:0/1064273406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 msgr2=0x55d2787698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 --2- 10.20.193.28:0/1064273406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787698f0 secure :-1 s=READY pgs=1350 gs=1 cs=0 l=1 c_cookie=12625759816335392032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb874004f20 tx=0x7fb874009f90 comp rx=0 tx=0).stop 2026-02-20T13:30:05.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 -- 10.20.193.28:0/1064273406 shutdown_connections 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 --2- 10.20.193.28:0/1064273406 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 0x55d2787ceeb0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 --2- 10.20.193.28:0/1064273406 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787ae590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 --2- 10.20.193.28:0/1064273406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787698f0 unknown :-1 s=CLOSED pgs=1350 gs=1 cs=0 l=1 c_cookie=12625759816335392032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 -- 10.20.193.28:0/1064273406 >> 10.20.193.28:0/1064273406 conn(0x55d278687a60 msgr2=0x55d278767e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 -- 10.20.193.28:0/1064273406 shutdown_connections 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.719+0000 7fb88e04be00 1 -- 10.20.193.28:0/1064273406 wait complete. 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.720+0000 7fb88e04be00 1 -- start start 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.721+0000 7fb88e04be00 1 Processor -- start 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.721+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769520 0x55d278781640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.721+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 0x55d278781b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.721+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2787aead0 0x55d278786b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.721+0000 7fb88e04be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d2787870b0 con 0x55d2787aead0 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.721+0000 7fb88e04be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d278787220 con 0x55d278769520 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.721+0000 7fb88e04be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d2787873e0 con 0x55d278769e30 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2787aead0 0x55d278786b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb8895c5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 0x55d278781b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb889dc6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769520 0x55d278781640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2787aead0 0x55d278786b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49182/0 (socket says 10.20.193.28:49182) 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 -- 10.20.193.28:0/3387482465 learned_addr learned my addr 10.20.193.28:0/3387482465 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 -- 10.20.193.28:0/3387482465 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 msgr2=0x55d278781b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 0x55d278781b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 -- 10.20.193.28:0/3387482465 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769520 msgr2=0x55d278781640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769520 0x55d278781640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 -- 10.20.193.28:0/3387482465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2785f8710 con 0x55d2787aead0 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88a5c7640 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2787aead0 0x55d278786b70 secure :-1 s=READY pgs=1351 gs=1 cs=0 l=1 c_cookie=4763311769696126417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb880008c90 tx=0x7fb88000e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421aaed1432cc5d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb83b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3387482465 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8800052f0 con 0x55d2787aead0 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3387482465 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb880005450 con 0x55d2787aead0 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3387482465 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb880011b50 con 0x55d2787aead0 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8840fbb20 con 0x55d2787aead0 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3387482465 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb880011ce0 con 0x55d2787aead0 2026-02-20T13:30:05.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb83b7fe640 10 client.20028 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88e04be00 10 client.20028 _ll_register_callbacks cb 0x55d2785f5d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.722+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d27830aba0 con 0x55d2787aead0 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3387482465 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb880011ea0 con 0x55d2787aead0 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb88e04be00 10 client.20028 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d27860a350 con 0x55d2787aead0 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3387482465 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb880021020 con 0x55d2787aead0 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb88e04be00 10 client.20028 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb88e04be00 10 client.20028 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb88e04be00 20 client.20028 populate_metadata read hostname 'trial028' 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d2787abef0 0x55d2787ac390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb88e04be00 4 client.20028 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:05.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.723+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d278647410 con 0x55d2787abef0 2026-02-20T13:30:05.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.724+0000 7fb889dc6640 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d2787abef0 0x55d2787ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.724+0000 7fb889dc6640 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d2787abef0 0x55d2787ac390 crc :-1 s=READY pgs=364 gs=4 cs=0 l=0 c_cookie=5115415976204075310 s_cookie=4815245645039385669 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46fd9bba4c00812e server_cookie=42d33066e2d1bc45 in_seq=0 out_seq=0 2026-02-20T13:30:05.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.724+0000 7fb83b7fe640 10 client.20028 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:05.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3387482465 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d278647410 con 0x55d2787abef0 2026-02-20T13:30:05.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb83b7fe640 10 client.20028 handle_command_reply: tid=0 2026-02-20T13:30:05.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb88e04be00 1 client.20028 shutdown 2026-02-20T13:30:05.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2787aead0 msgr2=0x55d278786b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2787aead0 0x55d278786b70 secure :-1 s=READY pgs=1351 gs=1 cs=0 l=1 c_cookie=4763311769696126417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb880008c90 tx=0x7fb88000e6b0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 shutdown_connections 2026-02-20T13:30:05.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d2787abef0 0x55d2787ac390 crc :-1 s=READY pgs=364 gs=4 cs=0 l=0 c_cookie=5115415976204075310 s_cookie=4815245645039385669 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2787aead0 0x55d278786b70 unknown :-1 s=CLOSED pgs=1351 gs=1 cs=0 l=1 c_cookie=4763311769696126417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.726+0000 7fb83b7fe640 0 client.20028 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:05.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.725+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 0x55d278781b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.726+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3387482465 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769520 0x55d278781640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.726+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 >> 10.20.193.28:0/3387482465 conn(0x55d278687a60 msgr2=0x55d278768510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:05.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.726+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 shutdown_connections 2026-02-20T13:30:05.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.726+0000 7fb88e04be00 1 -- 10.20.193.28:0/3387482465 wait complete. 2026-02-20T13:30:05.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.726+0000 7fb88e04be00 20 client.20028 trim_cache size 0 max 16384 2026-02-20T13:30:05.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88e04be00 1 Processor -- start 2026-02-20T13:30:05.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88e04be00 1 -- start start 2026-02-20T13:30:05.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787a7050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787a7590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 0x55d278767700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88e04be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d278672730 con 0x55d278769520 2026-02-20T13:30:05.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88e04be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d278332960 con 0x55d278769e30 2026-02-20T13:30:05.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88e04be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d27876c480 con 0x55d2787aead0 2026-02-20T13:30:05.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb8895c5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787a7590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb8895c5640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787a7590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:53878/0 (socket says 10.20.193.28:53878) 2026-02-20T13:30:05.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb8895c5640 1 -- 10.20.193.28:0/2902340891 learned_addr learned my addr 10.20.193.28:0/2902340891 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:05.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb889dc6640 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.735+0000 7fb88a5c7640 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 0x55d278767700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb889dc6640 1 -- 10.20.193.28:0/2902340891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 msgr2=0x55d278767700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:05.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb889dc6640 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 0x55d278767700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb889dc6640 1 -- 10.20.193.28:0/2902340891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 msgr2=0x55d2787a7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:05.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb889dc6640 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787a7590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb889dc6640 1 -- 10.20.193.28:0/2902340891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d278773f50 con 0x55d278769520 2026-02-20T13:30:05.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb889dc6640 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787a7050 secure :-1 s=READY pgs=1352 gs=2 cs=0 l=1 c_cookie=105707518619738959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb87400c6a0 tx=0x7fb8740054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1778c6d996ae34f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:05.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb851ce5640 1 -- 10.20.193.28:0/2902340891 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8740b54b0 con 0x55d278769520 2026-02-20T13:30:05.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb851ce5640 1 -- 10.20.193.28:0/2902340891 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8740050b0 con 0x55d278769520 2026-02-20T13:30:05.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.736+0000 7fb851ce5640 1 -- 10.20.193.28:0/2902340891 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8740ae0c0 con 0x55d278769520 2026-02-20T13:30:05.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 -- 10.20.193.28:0/2902340891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 msgr2=0x55d2787a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787a7050 secure :-1 s=READY pgs=1352 gs=2 cs=0 l=1 c_cookie=105707518619738959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb87400c6a0 tx=0x7fb8740054e0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 -- 10.20.193.28:0/2902340891 shutdown_connections 2026-02-20T13:30:05.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d2787aead0 0x55d278767700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d278769e30 0x55d2787a7590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 --2- 10.20.193.28:0/2902340891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787a7050 unknown :-1 s=CLOSED pgs=1352 gs=2 cs=0 l=1 c_cookie=105707518619738959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 -- 10.20.193.28:0/2902340891 >> 10.20.193.28:0/2902340891 conn(0x55d278687a60 msgr2=0x55d27877dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:05.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 -- 10.20.193.28:0/2902340891 shutdown_connections 2026-02-20T13:30:05.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 -- 10.20.193.28:0/2902340891 wait complete. 2026-02-20T13:30:05.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 -- start start 2026-02-20T13:30:05.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.737+0000 7fb88e04be00 1 Processor -- start 2026-02-20T13:30:05.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787896d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 0x55d278789c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb88e04be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d2787aead0 0x55d278813ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb88e04be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d278814530 con 0x55d278769520 2026-02-20T13:30:05.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb88e04be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d2788146a0 con 0x55d2787aead0 2026-02-20T13:30:05.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb88e04be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d278814860 con 0x55d278769e30 2026-02-20T13:30:05.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb889dc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787896d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb889dc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787896d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49208/0 (socket says 10.20.193.28:49208) 2026-02-20T13:30:05.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb889dc6640 1 -- 10.20.193.28:0/3189872868 learned_addr learned my addr 10.20.193.28:0/3189872868 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:05.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb88a5c7640 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d2787aead0 0x55d278813ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb8895c5640 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 0x55d278789c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb889dc6640 1 -- 10.20.193.28:0/3189872868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 msgr2=0x55d278789c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:05.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb889dc6640 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 0x55d278789c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb889dc6640 1 -- 10.20.193.28:0/3189872868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d2787aead0 msgr2=0x55d278813ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:05.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb889dc6640 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d2787aead0 0x55d278813ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.738+0000 7fb889dc6640 1 -- 10.20.193.28:0/3189872868 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d278604dd0 con 0x55d278769520 2026-02-20T13:30:05.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb889dc6640 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787896d0 secure :-1 s=READY pgs=1353 gs=1 cs=0 l=1 c_cookie=13542928221366749024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8740b8430 tx=0x7fb874005580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf22576bd2d8760 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:05.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb83b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:05.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3189872868 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8740b8080 con 0x55d278769520 2026-02-20T13:30:05.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3189872868 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb874005220 con 0x55d278769520 2026-02-20T13:30:05.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3189872868 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8740724d0 con 0x55d278769520 2026-02-20T13:30:05.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d27861ff80 con 0x55d278769520 2026-02-20T13:30:05.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb88e04be00 10 client.20034 _ll_register_callbacks cb 0x55d2785f5d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:05.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8740adbb0 con 0x55d278769520 2026-02-20T13:30:05.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3189872868 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb874077070 con 0x55d278769520 2026-02-20T13:30:05.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3189872868 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb8740b54b0 con 0x55d278769520 2026-02-20T13:30:05.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb88e04be00 10 client.20034 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:05.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.739+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d2785f8a40 con 0x55d278769520 2026-02-20T13:30:05.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.740+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3189872868 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb8740ab190 con 0x55d278769520 2026-02-20T13:30:05.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.740+0000 7fb88e04be00 10 client.20034 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:05.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.740+0000 7fb88e04be00 10 client.20034 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:30:05.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.740+0000 7fb88e04be00 20 client.20034 populate_metadata read hostname 'trial028' 2026-02-20T13:30:05.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.740+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d27885c060 0x55d27887c4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:05.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.740+0000 7fb88e04be00 4 client.20034 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "82a1e66c", "release": true, "await": true}] 2026-02-20T13:30:05.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.740+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "82a1e66c", "release": true, "await": true}) -- 0x55d2783083f0 con 0x55d27885c060 2026-02-20T13:30:05.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.740+0000 7fb8895c5640 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d27885c060 0x55d27887c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:05.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.741+0000 7fb8895c5640 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d27885c060 0x55d27887c4e0 crc :-1 s=READY pgs=365 gs=4 cs=0 l=0 c_cookie=16741665116203550025 s_cookie=485270621559128037 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e85657b8d7dc8549 server_cookie=6bc070f29f6ffe5 in_seq=0 out_seq=0 2026-02-20T13:30:05.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.741+0000 7fb83b7fe640 10 client.20034 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:05.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb83b7fe640 1 -- 10.20.193.28:0/3189872868 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d2783083f0 con 0x55d27885c060 2026-02-20T13:30:05.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb83b7fe640 10 client.20034 handle_command_reply: tid=0 2026-02-20T13:30:05.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 client.20034 shutdown 2026-02-20T13:30:05.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 msgr2=0x55d2787896d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787896d0 secure :-1 s=READY pgs=1353 gs=1 cs=0 l=1 c_cookie=13542928221366749024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8740b8430 tx=0x7fb874005580 comp rx=0 tx=0).stop 2026-02-20T13:30:05.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 shutdown_connections 2026-02-20T13:30:05.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d27885c060 0x55d27887c4e0 crc :-1 s=READY pgs=365 gs=4 cs=0 l=0 c_cookie=16741665116203550025 s_cookie=485270621559128037 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d2787aead0 0x55d278813ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d278769e30 0x55d278789c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 --2- 10.20.193.28:0/3189872868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d278769520 0x55d2787896d0 unknown :-1 s=CLOSED pgs=1353 gs=1 cs=0 l=1 c_cookie=13542928221366749024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb83b7fe640 0 client.20034 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:05.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 >> 10.20.193.28:0/3189872868 conn(0x55d278687a60 msgr2=0x55d27877e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:05.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 shutdown_connections 2026-02-20T13:30:05.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.742+0000 7fb88e04be00 1 -- 10.20.193.28:0/3189872868 wait complete. 2026-02-20T13:30:05.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88e04be00 20 client.20034 trim_cache size 0 max 16384 2026-02-20T13:30:05.759 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 44, 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "82a1e66c": { 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "version": 44, 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:30:05.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 130.0, 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:05.761 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:05.762 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:05.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 -- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8600b5750 msgr2=0x7fb8600d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8600b5750 0x7fb8600d5c00 secure :-1 s=READY pgs=564 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8780023d0 tx=0x7fb878031040 comp rx=0 tx=0).stop 2026-02-20T13:30:05.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 -- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410f4b0 msgr2=0x7fb8840f5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410f4b0 0x7fb8840f5780 secure :-1 s=READY pgs=1349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb874009480 tx=0x7fb87400ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 -- 10.20.193.28:0/2242640570 shutdown_connections 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8600b5750 0x7fb8600d5c00 unknown :-1 s=CLOSED pgs=564 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb8841156a0 0x7fb8840f5e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb88410fea0 0x7fb884175f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 --2- 10.20.193.28:0/2242640570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb88410f4b0 0x7fb8840f5780 unknown :-1 s=CLOSED pgs=1349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 -- 10.20.193.28:0/2242640570 >> 10.20.193.28:0/2242640570 conn(0x7fb8840ecda0 msgr2=0x7fb884111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 -- 10.20.193.28:0/2242640570 shutdown_connections 2026-02-20T13:30:05.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:05.743+0000 7fb88adc8640 1 -- 10.20.193.28:0/2242640570 wait complete. 2026-02-20T13:30:05.841 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:05 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1814009420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:05.844 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '82a1e66c', total seconds elapsed: 11.1 2026-02-20T13:30:05.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:05 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1814009420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:05.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:05 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1814009420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:06 trial127 ceph-mon[43817]: pgmap v564: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:30:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:06 trial034 ceph-mon[43332]: pgmap v564: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:30:07.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:06 trial028 ceph-mon[37442]: pgmap v564: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:30:08.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 -- 10.20.193.28:0/79482203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 msgr2=0x7f53141104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 --2- 10.20.193.28:0/79482203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 0x7f53141104a0 secure :-1 s=READY pgs=1354 gs=1 cs=0 l=1 c_cookie=11722087646339310465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5308009980 tx=0x7f530802f190 comp rx=0 tx=0).stop 2026-02-20T13:30:08.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 -- 10.20.193.28:0/79482203 shutdown_connections 2026-02-20T13:30:08.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 --2- 10.20.193.28:0/79482203 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f531410f2f0 0x7f5314171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 --2- 10.20.193.28:0/79482203 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f531410e940 0x7f531410edb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 --2- 10.20.193.28:0/79482203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 0x7f53141104a0 unknown :-1 s=CLOSED pgs=1354 gs=1 cs=0 l=1 c_cookie=11722087646339310465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 -- 10.20.193.28:0/79482203 >> 10.20.193.28:0/79482203 conn(0x7f53140ec320 msgr2=0x7f531410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 -- 10.20.193.28:0/79482203 shutdown_connections 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.495+0000 7f5313577640 1 -- 10.20.193.28:0/79482203 wait complete. 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5313577640 1 Processor -- start 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5313577640 1 -- start start 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5313577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f531410e940 0x7f53140f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5313577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f531410f2f0 0x7f5314171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5313577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 0x7f53140f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5313577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53140f96a0 con 0x7f53141100b0 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5313577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f53140f9810 con 0x7f531410e940 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5313577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f53140f99d0 con 0x7f531410f2f0 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5312d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 0x7f53140f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5312575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f531410e940 0x7f53140f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5312d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 0x7f53140f8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49224/0 (socket says 10.20.193.28:49224) 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5312d76640 1 -- 10.20.193.28:0/2256002051 learned_addr learned my addr 10.20.193.28:0/2256002051 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.496+0000 7f5311d74640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f531410f2f0 0x7f5314171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f5312d76640 1 -- 10.20.193.28:0/2256002051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f531410f2f0 msgr2=0x7f5314171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f5312d76640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f531410f2f0 0x7f5314171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f5312d76640 1 -- 10.20.193.28:0/2256002051 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f531410e940 msgr2=0x7f53140f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f5312d76640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f531410e940 0x7f53140f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f5312d76640 1 -- 10.20.193.28:0/2256002051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5308009570 con 0x7f53141100b0 2026-02-20T13:30:08.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f5312d76640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 0x7f53140f8ab0 secure :-1 s=READY pgs=1355 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5304006e90 tx=0x7f530400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:08.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f52fb7fe640 1 -- 10.20.193.28:0/2256002051 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5304005500 con 0x7f53141100b0 2026-02-20T13:30:08.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f52fb7fe640 1 -- 10.20.193.28:0/2256002051 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5304005e10 con 0x7f53141100b0 2026-02-20T13:30:08.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f5313577640 1 -- 10.20.193.28:0/2256002051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53140f9cb0 con 0x7f53141100b0 2026-02-20T13:30:08.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f52fb7fe640 1 -- 10.20.193.28:0/2256002051 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5304003a90 con 0x7f53141100b0 2026-02-20T13:30:08.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.497+0000 7f5313577640 1 -- 10.20.193.28:0/2256002051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53140fa1d0 con 0x7f53141100b0 2026-02-20T13:30:08.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.499+0000 7f52fb7fe640 1 -- 10.20.193.28:0/2256002051 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f530400c840 con 0x7f53141100b0 2026-02-20T13:30:08.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.501+0000 7f52fb7fe640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f52ec0b5760 0x7f52ec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.501+0000 7f52fb7fe640 1 -- 10.20.193.28:0/2256002051 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f53040e7770 con 0x7f53141100b0 2026-02-20T13:30:08.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.501+0000 7f5312575640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f52ec0b5760 0x7f52ec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.502+0000 7f5312575640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f52ec0b5760 0x7f52ec0d5c10 secure :-1 s=READY pgs=565 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5308002d80 tx=0x7f530803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:08.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.502+0000 7f531b5dae00 1 Processor -- start 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.502+0000 7f531b5dae00 1 -- start start 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c5a4c0 0x55b176c7a8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c9b1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c9b700 0x55b176cbbae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f531b5dae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b176b6ffd0 con 0x55b176c7ade0 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f531b5dae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b176b6bd00 con 0x55b176c9b700 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f531b5dae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b176b65ca0 con 0x55b176c5a4c0 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c9b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5312575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c5a4c0 0x55b176c7a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c9b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49232/0 (socket says 10.20.193.28:49232) 2026-02-20T13:30:08.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 -- 10.20.193.28:0/3936915963 learned_addr learned my addr 10.20.193.28:0/3936915963 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5312d76640 1 --2- 10.20.193.28:0/3936915963 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c9b700 0x55b176cbbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 -- 10.20.193.28:0/3936915963 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c5a4c0 msgr2=0x55b176c7a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 --2- 10.20.193.28:0/3936915963 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c5a4c0 0x55b176c7a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 -- 10.20.193.28:0/3936915963 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c9b700 msgr2=0x55b176cbbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 --2- 10.20.193.28:0/3936915963 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c9b700 0x55b176cbbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 -- 10.20.193.28:0/3936915963 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b176b088b0 con 0x55b176c7ade0 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f5311d74640 1 --2- 10.20.193.28:0/3936915963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c9b1c0 secure :-1 s=READY pgs=1356 gs=2 cs=0 l=1 c_cookie=8493125730604890062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52fc009d20 tx=0x7f52fc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dda4da7d6f37ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f52f8ff9640 1 -- 10.20.193.28:0/3936915963 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52fc004110 con 0x55b176c7ade0 2026-02-20T13:30:08.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f52f8ff9640 1 -- 10.20.193.28:0/3936915963 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f52fc002b80 con 0x55b176c7ade0 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.503+0000 7f52f8ff9640 1 -- 10.20.193.28:0/3936915963 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52fc01a8f0 con 0x55b176c7ade0 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 -- 10.20.193.28:0/3936915963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 msgr2=0x55b176c9b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 --2- 10.20.193.28:0/3936915963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c9b1c0 secure :-1 s=READY pgs=1356 gs=2 cs=0 l=1 c_cookie=8493125730604890062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52fc009d20 tx=0x7f52fc011810 comp rx=0 tx=0).stop 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 -- 10.20.193.28:0/3936915963 shutdown_connections 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 --2- 10.20.193.28:0/3936915963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c9b1c0 unknown :-1 s=CLOSED pgs=1356 gs=2 cs=0 l=1 c_cookie=8493125730604890062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 --2- 10.20.193.28:0/3936915963 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c9b700 0x55b176cbbae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 --2- 10.20.193.28:0/3936915963 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c5a4c0 0x55b176c7a8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 -- 10.20.193.28:0/3936915963 >> 10.20.193.28:0/3936915963 conn(0x55b176b791c0 msgr2=0x55b176c58da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 -- 10.20.193.28:0/3936915963 shutdown_connections 2026-02-20T13:30:08.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.504+0000 7f531b5dae00 1 -- 10.20.193.28:0/3936915963 wait complete. 2026-02-20T13:30:08.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.505+0000 7f531b5dae00 1 -- start start 2026-02-20T13:30:08.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.505+0000 7f531b5dae00 1 Processor -- start 2026-02-20T13:30:08.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c73ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c74130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c74b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f531b5dae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b176c751f0 con 0x55b176c9b700 2026-02-20T13:30:08.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f531b5dae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b176c75360 con 0x55b176c5a4c0 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f531b5dae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b176c75520 con 0x55b176c7ade0 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c74b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5311d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c74130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c74b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49246/0 (socket says 10.20.193.28:49246) 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 -- 10.20.193.28:0/785390536 learned_addr learned my addr 10.20.193.28:0/785390536 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312575640 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c73ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 -- 10.20.193.28:0/785390536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 msgr2=0x55b176c74130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c74130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 -- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 msgr2=0x55b176c73ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c73ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 -- 10.20.193.28:0/785390536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b176b11400 con 0x55b176c9b700 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5311d74640 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c74130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312575640 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c73ae0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f5312d76640 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c74b90 secure :-1 s=READY pgs=1357 gs=3 cs=0 l=1 c_cookie=10583893364293082426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53040e5210 tx=0x7f53040adc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e18af05f4d9d3a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f52c3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.506+0000 7f52c3fff640 1 -- 10.20.193.28:0/785390536 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53040ad940 con 0x55b176c9b700 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f52c3fff640 1 -- 10.20.193.28:0/785390536 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53040b37f0 con 0x55b176c9b700 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f52c3fff640 1 -- 10.20.193.28:0/785390536 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53040abde0 con 0x55b176c9b700 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52fc009940 con 0x55b176c9b700 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 10 client.20046 _ll_register_callbacks cb 0x55b176af0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b176805520 con 0x55b176c9b700 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f52c3fff640 1 -- 10.20.193.28:0/785390536 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5304097300 con 0x55b176c9b700 2026-02-20T13:30:08.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f52c3fff640 1 -- 10.20.193.28:0/785390536 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f53040b89d0 con 0x55b176c9b700 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 10 client.20046 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b176ae9da0 con 0x55b176c9b700 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f52c3fff640 1 -- 10.20.193.28:0/785390536 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f53040af4c0 con 0x55b176c9b700 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 10 client.20046 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 10 client.20046 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 20 client.20046 populate_metadata read hostname 'trial028' 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b176c78180 0x55b176c78620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 4 client.20046 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.507+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b176b97630 con 0x55b176c78180 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.508+0000 7f5312575640 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b176c78180 0x55b176c78620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.508+0000 7f52c3fff640 10 client.20046 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:08.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.508+0000 7f5312575640 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b176c78180 0x55b176c78620 crc :-1 s=READY pgs=366 gs=4 cs=0 l=0 c_cookie=2478602618460480467 s_cookie=7731437382737978153 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2265c3f304b0a3d3 server_cookie=6b4b95563145e329 in_seq=0 out_seq=0 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f52c3fff640 1 -- 10.20.193.28:0/785390536 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b176b97630 con 0x55b176c78180 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f52c3fff640 10 client.20046 handle_command_reply: tid=0 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 client.20046 shutdown 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 msgr2=0x55b176c74b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c74b90 secure :-1 s=READY pgs=1357 gs=3 cs=0 l=1 c_cookie=10583893364293082426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53040e5210 tx=0x7f53040adc30 comp rx=0 tx=0).stop 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 shutdown_connections 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b176c78180 0x55b176c78620 crc :-1 s=READY pgs=366 gs=4 cs=0 l=0 c_cookie=2478602618460480467 s_cookie=7731437382737978153 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c74b90 unknown :-1 s=CLOSED pgs=1357 gs=3 cs=0 l=1 c_cookie=10583893364293082426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c74130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 --2- 10.20.193.28:0/785390536 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c73ae0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 >> 10.20.193.28:0/785390536 conn(0x55b176b791c0 msgr2=0x55b176c5b790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:08.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f52c3fff640 0 client.20046 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:08.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 shutdown_connections 2026-02-20T13:30:08.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 1 -- 10.20.193.28:0/785390536 wait complete. 2026-02-20T13:30:08.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.509+0000 7f531b5dae00 20 client.20046 trim_cache size 0 max 16384 2026-02-20T13:30:08.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f531b5dae00 1 Processor -- start 2026-02-20T13:30:08.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f531b5dae00 1 -- start start 2026-02-20T13:30:08.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c60df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c78ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c79400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f531b5dae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b176b638d0 con 0x55b176c9b700 2026-02-20T13:30:08.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f531b5dae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b1768a4f10 con 0x55b176c5a4c0 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f531b5dae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b176bcb4f0 con 0x55b176c7ade0 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f5312d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c79400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f5311d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c78ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f5312575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c60df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f5312d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c79400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49254/0 (socket says 10.20.193.28:49254) 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.517+0000 7f5312d76640 1 -- 10.20.193.28:0/2338284054 learned_addr learned my addr 10.20.193.28:0/2338284054 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f5312d76640 1 -- 10.20.193.28:0/2338284054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 msgr2=0x55b176c78ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f5312d76640 1 --2- 10.20.193.28:0/2338284054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c78ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f5312d76640 1 -- 10.20.193.28:0/2338284054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 msgr2=0x55b176c60df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f5312d76640 1 --2- 10.20.193.28:0/2338284054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c60df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f5312d76640 1 -- 10.20.193.28:0/2338284054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b176afb670 con 0x55b176c9b700 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f5312d76640 1 --2- 10.20.193.28:0/2338284054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c79400 secure :-1 s=READY pgs=1358 gs=2 cs=0 l=1 c_cookie=2479665510924740517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53040b8c60 tx=0x7f530401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22698aa4f474e7a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f52de3ff640 1 -- 10.20.193.28:0/2338284054 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53040e5110 con 0x55b176c9b700 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f52de3ff640 1 -- 10.20.193.28:0/2338284054 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55b176805520 con 0x55b176c9b700 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f52de3ff640 1 -- 10.20.193.28:0/2338284054 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53040abb60 con 0x55b176c9b700 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 -- 10.20.193.28:0/2338284054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 msgr2=0x55b176c79400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 --2- 10.20.193.28:0/2338284054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c79400 secure :-1 s=READY pgs=1358 gs=2 cs=0 l=1 c_cookie=2479665510924740517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53040b8c60 tx=0x7f530401a000 comp rx=0 tx=0).stop 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 -- 10.20.193.28:0/2338284054 shutdown_connections 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 --2- 10.20.193.28:0/2338284054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c9b700 0x55b176c79400 unknown :-1 s=CLOSED pgs=1358 gs=2 cs=0 l=1 c_cookie=2479665510924740517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 --2- 10.20.193.28:0/2338284054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c7ade0 0x55b176c78ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 --2- 10.20.193.28:0/2338284054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c60df0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 -- 10.20.193.28:0/2338284054 >> 10.20.193.28:0/2338284054 conn(0x55b176b791c0 msgr2=0x55b176c995c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 -- 10.20.193.28:0/2338284054 shutdown_connections 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.518+0000 7f531b5dae00 1 -- 10.20.193.28:0/2338284054 wait complete. 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.519+0000 7f531b5dae00 1 -- start start 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.519+0000 7f531b5dae00 1 Processor -- start 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.519+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c7c970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.519+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c7cfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.519+0000 7f531b5dae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c9b700 0x55b176c7dae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.519+0000 7f531b5dae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b176c7e0f0 con 0x55b176c7ade0 2026-02-20T13:30:08.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.519+0000 7f531b5dae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b176c7e260 con 0x55b176c5a4c0 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.519+0000 7f531b5dae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b176c7e420 con 0x55b176c9b700 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c7cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5312d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c9b700 0x55b176c7dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5312575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c7c970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c7cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49268/0 (socket says 10.20.193.28:49268) 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5312d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c9b700 0x55b176c7dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:44702/0 (socket says 10.20.193.28:44702) 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 -- 10.20.193.28:0/1062935320 learned_addr learned my addr 10.20.193.28:0/1062935320 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 -- 10.20.193.28:0/1062935320 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c9b700 msgr2=0x55b176c7dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c9b700 0x55b176c7dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 -- 10.20.193.28:0/1062935320 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 msgr2=0x55b176c7c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:08.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c7c970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 -- 10.20.193.28:0/1062935320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b176af60f0 con 0x55b176c7ade0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f5311d74640 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c7cfd0 secure :-1 s=READY pgs=1359 gs=2 cs=0 l=1 c_cookie=1593871741766073282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55b176c1e450 tx=0x7f52fc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161e91e7897ffbc2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f52c3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f52c3fff640 1 -- 10.20.193.28:0/1062935320 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52fc009600 con 0x55b176c7ade0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f52c3fff640 1 -- 10.20.193.28:0/1062935320 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f52fc0055f0 con 0x55b176c7ade0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f52c3fff640 1 -- 10.20.193.28:0/1062935320 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52fc002d20 con 0x55b176c7ade0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5304071070 con 0x55b176c7ade0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f52c3fff640 1 -- 10.20.193.28:0/1062935320 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f52fc021070 con 0x55b176c7ade0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f531b5dae00 10 client.20052 _ll_register_callbacks cb 0x55b176af0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.520+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b176c15ca0 con 0x55b176c7ade0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f52c3fff640 1 -- 10.20.193.28:0/1062935320 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f52fc0026a0 con 0x55b176c7ade0 2026-02-20T13:30:08.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f531b5dae00 10 client.20052 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b176aea0d0 con 0x55b176c7ade0 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f52c3fff640 1 -- 10.20.193.28:0/1062935320 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f52fc004720 con 0x55b176c7ade0 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f531b5dae00 10 client.20052 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f531b5dae00 10 client.20052 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f531b5dae00 20 client.20052 populate_metadata read hostname 'trial028' 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f531b5dae00 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b176c80260 0x55b176c80700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f531b5dae00 4 client.20052 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b176849640 con 0x55b176c80260 2026-02-20T13:30:08.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.521+0000 7f5312575640 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b176c80260 0x55b176c80700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.522+0000 7f52c3fff640 10 client.20052 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.522+0000 7f5312575640 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b176c80260 0x55b176c80700 crc :-1 s=READY pgs=367 gs=4 cs=0 l=0 c_cookie=3842899494362796303 s_cookie=9133076804714725031 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3554b8bac505d10f server_cookie=7ebf34f6fb617ea7 in_seq=0 out_seq=0 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f52c3fff640 1 -- 10.20.193.28:0/1062935320 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b176849640 con 0x55b176c80260 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f52c3fff640 10 client.20052 handle_command_reply: tid=0 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 client.20052 shutdown 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 msgr2=0x55b176c7cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c7cfd0 secure :-1 s=READY pgs=1359 gs=2 cs=0 l=1 c_cookie=1593871741766073282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55b176c1e450 tx=0x7f52fc005270 comp rx=0 tx=0).stop 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 shutdown_connections 2026-02-20T13:30:08.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b176c80260 0x55b176c80700 crc :-1 s=READY pgs=367 gs=4 cs=0 l=0 c_cookie=3842899494362796303 s_cookie=9133076804714725031 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b176c7ade0 0x55b176c7cfd0 unknown :-1 s=CLOSED pgs=1359 gs=2 cs=0 l=1 c_cookie=1593871741766073282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b176c9b700 0x55b176c7dae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 --2- 10.20.193.28:0/1062935320 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b176c5a4c0 0x55b176c7c970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f52c3fff640 0 client.20052 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 >> 10.20.193.28:0/1062935320 conn(0x55b176b791c0 msgr2=0x55b176c99db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 shutdown_connections 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 1 -- 10.20.193.28:0/1062935320 wait complete. 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.526+0000 7f531b5dae00 20 client.20052 trim_cache size 0 max 16384 2026-02-20T13:30:08.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:30:08.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:30:08.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:30:08.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 -- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f52ec0b5760 msgr2=0x7f52ec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f52ec0b5760 0x7f52ec0d5c10 secure :-1 s=READY pgs=565 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5308002d80 tx=0x7f530803a040 comp rx=0 tx=0).stop 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 -- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 msgr2=0x7f53140f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 0x7f53140f8ab0 secure :-1 s=READY pgs=1355 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5304006e90 tx=0x7f530400edf0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 -- 10.20.193.28:0/2256002051 shutdown_connections 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f52ec0b5760 0x7f52ec0d5c10 unknown :-1 s=CLOSED pgs=565 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53141100b0 0x7f53140f8ab0 unknown :-1 s=CLOSED pgs=1355 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f531410f2f0 0x7f5314171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 --2- 10.20.193.28:0/2256002051 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f531410e940 0x7f53140f8250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 -- 10.20.193.28:0/2256002051 >> 10.20.193.28:0/2256002051 conn(0x7f53140ec320 msgr2=0x7f53140ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:08.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 -- 10.20.193.28:0/2256002051 shutdown_connections 2026-02-20T13:30:08.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:08.527+0000 7f5313577640 1 -- 10.20.193.28:0/2256002051 wait complete. 2026-02-20T13:30:08.901 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:08 trial028 ceph-mon[37442]: pgmap v565: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-20T13:30:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:08 trial127 ceph-mon[43817]: pgmap v565: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-20T13:30:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:08 trial034 ceph-mon[43332]: pgmap v565: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-20T13:30:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:10 trial127 ceph-mon[43817]: pgmap v566: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:30:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:10 trial034 ceph-mon[43332]: pgmap v566: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:30:11.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:10 trial028 ceph-mon[37442]: pgmap v566: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2026-02-20T13:30:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:12 trial127 ceph-mon[43817]: pgmap v567: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2026-02-20T13:30:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:12 trial034 ceph-mon[43332]: pgmap v567: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2026-02-20T13:30:13.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:12 trial028 ceph-mon[37442]: pgmap v567: 97 pgs: 97 active+clean; 2.3 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2026-02-20T13:30:14.967 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:30:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:14 trial127 ceph-mon[43817]: pgmap v568: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2026-02-20T13:30:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:14 trial034 ceph-mon[43332]: pgmap v568: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2026-02-20T13:30:15.017 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:14 trial028 ceph-mon[37442]: pgmap v568: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2026-02-20T13:30:15.153 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 -- 10.20.193.28:0/3627878113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c01156a0 msgr2=0x7fc8c0176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 --2- 10.20.193.28:0/3627878113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c01156a0 0x7fc8c0176070 secure :-1 s=READY pgs=1360 gs=1 cs=0 l=1 c_cookie=6219011633634851151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8bc00aa30 tx=0x7fc8bc030270 comp rx=0 tx=0).stop 2026-02-20T13:30:15.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 -- 10.20.193.28:0/3627878113 shutdown_connections 2026-02-20T13:30:15.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 --2- 10.20.193.28:0/3627878113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c01156a0 0x7fc8c0176070 unknown :-1 s=CLOSED pgs=1360 gs=1 cs=0 l=1 c_cookie=6219011633634851151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 --2- 10.20.193.28:0/3627878113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc8c010fea0 0x7fc8c0114ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 --2- 10.20.193.28:0/3627878113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8c010f4b0 0x7fc8c010f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 -- 10.20.193.28:0/3627878113 >> 10.20.193.28:0/3627878113 conn(0x7fc8c00ecda0 msgr2=0x7fc8c010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:15.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 -- 10.20.193.28:0/3627878113 shutdown_connections 2026-02-20T13:30:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.333+0000 7fc8c61af640 1 -- 10.20.193.28:0/3627878113 wait complete. 2026-02-20T13:30:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.334+0000 7fc8c61af640 1 Processor -- start 2026-02-20T13:30:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.334+0000 7fc8c61af640 1 -- start start 2026-02-20T13:30:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.334+0000 7fc8c61af640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8c010f4b0 0x7fc8c011ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.334+0000 7fc8c61af640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c010fea0 0x7fc8c011e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.334+0000 7fc8c61af640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc8c01156a0 0x7fc8c01236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.334+0000 7fc8c61af640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0123d00 con 0x7fc8c010fea0 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.334+0000 7fc8c61af640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0123e70 con 0x7fc8c010f4b0 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.334+0000 7fc8c61af640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0124030 con 0x7fc8c01156a0 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c51ad640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8c010f4b0 0x7fc8c011ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c010fea0 0x7fc8c011e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c010fea0 0x7fc8c011e310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57646/0 (socket says 10.20.193.28:57646) 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 -- 10.20.193.28:0/313566166 learned_addr learned my addr 10.20.193.28:0/313566166 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c59ae640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc8c01156a0 0x7fc8c01236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 -- 10.20.193.28:0/313566166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc8c01156a0 msgr2=0x7fc8c01236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc8c01156a0 0x7fc8c01236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 -- 10.20.193.28:0/313566166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8c010f4b0 msgr2=0x7fc8c011ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8c010f4b0 0x7fc8c011ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 -- 10.20.193.28:0/313566166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc00a650 con 0x7fc8c010fea0 2026-02-20T13:30:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c010fea0 0x7fc8c011e310 secure :-1 s=READY pgs=1361 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b40072a0 tx=0x7fc8b400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8ae7fc640 1 -- 10.20.193.28:0/313566166 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b4004500 con 0x7fc8c010fea0 2026-02-20T13:30:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8ae7fc640 1 -- 10.20.193.28:0/313566166 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8b400bca0 con 0x7fc8c010fea0 2026-02-20T13:30:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8ae7fc640 1 -- 10.20.193.28:0/313566166 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b40106e0 con 0x7fc8c010fea0 2026-02-20T13:30:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.335+0000 7fc8c61af640 1 -- 10.20.193.28:0/313566166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c0124310 con 0x7fc8c010fea0 2026-02-20T13:30:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.336+0000 7fc8c61af640 1 -- 10.20.193.28:0/313566166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c0164a10 con 0x7fc8c010fea0 2026-02-20T13:30:15.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.339+0000 7fc8ae7fc640 1 -- 10.20.193.28:0/313566166 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fc8b400b7c0 con 0x7fc8c010fea0 2026-02-20T13:30:15.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8ae7fc640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc89c0b5760 0x7fc89c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8ae7fc640 1 -- 10.20.193.28:0/313566166 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc8b40e6340 con 0x7fc8c010fea0 2026-02-20T13:30:15.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c9432e00 1 Processor -- start 2026-02-20T13:30:15.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc89c0b5760 0x7fc89c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c9432e00 1 -- start start 2026-02-20T13:30:15.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1a5cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1aa1e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1ac2730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5565d196a7d0 con 0x5565d1a5cb90 2026-02-20T13:30:15.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5565d1966500 con 0x5565d1aa2350 2026-02-20T13:30:15.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.341+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5565d19604a0 con 0x5565d1a5d4a0 2026-02-20T13:30:15.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1a5cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c59ae640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1ac2730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1a5cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57648/0 (socket says 10.20.193.28:57648) 2026-02-20T13:30:15.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 -- 10.20.193.28:0/1184864157 learned_addr learned my addr 10.20.193.28:0/1184864157 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/1184864157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1aa1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc89c0b5760 0x7fc89c0d5c10 secure :-1 s=READY pgs=566 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b0004740 tx=0x7fc8b00107a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 -- 10.20.193.28:0/1184864157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 msgr2=0x5565d1aa1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/1184864157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1aa1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 -- 10.20.193.28:0/1184864157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 msgr2=0x5565d1ac2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/1184864157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1ac2730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 -- 10.20.193.28:0/1184864157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565d190bd80 con 0x5565d1a5cb90 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/1184864157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1a5cf60 secure :-1 s=READY pgs=1362 gs=1 cs=0 l=1 c_cookie=17314032283010404479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b0007a00 tx=0x7fc8b001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f047cca0b27b107f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc88dce5640 1 -- 10.20.193.28:0/1184864157 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b00132f0 con 0x5565d1a5cb90 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc88dce5640 1 -- 10.20.193.28:0/1184864157 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8b0004d30 con 0x5565d1a5cb90 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.342+0000 7fc88dce5640 1 -- 10.20.193.28:0/1184864157 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b0011750 con 0x5565d1a5cb90 2026-02-20T13:30:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 -- 10.20.193.28:0/1184864157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 msgr2=0x5565d1a5cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/1184864157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1a5cf60 secure :-1 s=READY pgs=1362 gs=1 cs=0 l=1 c_cookie=17314032283010404479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b0007a00 tx=0x7fc8b001b000 comp rx=0 tx=0).stop 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 -- 10.20.193.28:0/1184864157 shutdown_connections 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/1184864157 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1ac2730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/1184864157 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1aa1e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/1184864157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1a5cf60 unknown :-1 s=CLOSED pgs=1362 gs=1 cs=0 l=1 c_cookie=17314032283010404479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 -- 10.20.193.28:0/1184864157 >> 10.20.193.28:0/1184864157 conn(0x5565d1a32680 msgr2=0x5565d1a52a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 -- 10.20.193.28:0/1184864157 shutdown_connections 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.343+0000 7fc8c9432e00 1 -- 10.20.193.28:0/1184864157 wait complete. 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.344+0000 7fc8c9432e00 1 -- start start 2026-02-20T13:30:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.344+0000 7fc8c9432e00 1 Processor -- start 2026-02-20T13:30:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.344+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1ab9b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.344+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1aba080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.344+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1abf070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.344+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5565d1abf5b0 con 0x5565d1a5cb90 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.344+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5565d1abf720 con 0x5565d1aa2350 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.344+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5565d1abf8e0 con 0x5565d1a5d4a0 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1ab9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1ab9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57650/0 (socket says 10.20.193.28:57650) 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 -- 10.20.193.28:0/3427643298 learned_addr learned my addr 10.20.193.28:0/3427643298 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c59ae640 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1abf070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1aba080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 -- 10.20.193.28:0/3427643298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 msgr2=0x5565d1aba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1aba080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 -- 10.20.193.28:0/3427643298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 msgr2=0x5565d1abf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1abf070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 -- 10.20.193.28:0/3427643298 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565d18e4350 con 0x5565d1a5cb90 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1ab9b40 secure :-1 s=READY pgs=1363 gs=1 cs=0 l=1 c_cookie=9574037630661809967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b0010cb0 tx=0x7fc8b0005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ddd07fe9d1d72f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc87affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc87affd640 1 -- 10.20.193.28:0/3427643298 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b002b070 con 0x5565d1a5cb90 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc87affd640 1 -- 10.20.193.28:0/3427643298 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8b00054c0 con 0x5565d1a5cb90 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc87affd640 1 -- 10.20.193.28:0/3427643298 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b0011c00 con 0x5565d1a5cb90 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.345+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b0018040 con 0x5565d1a5cb90 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc87affd640 1 -- 10.20.193.28:0/3427643298 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc8b0004b30 con 0x5565d1a5cb90 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc87affd640 10 client.20064 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 10 client.20064 _ll_register_callbacks cb 0x5565d18e19a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5565d15f66f0 con 0x5565d1a5cb90 2026-02-20T13:30:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc87affd640 1 -- 10.20.193.28:0/3427643298 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc8b0004770 con 0x5565d1a5cb90 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 10 client.20064 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5565d18f6150 con 0x5565d1a5cb90 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc87affd640 1 -- 10.20.193.28:0/3427643298 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc8b0037060 con 0x5565d1a5cb90 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 10 client.20064 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 10 client.20064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 20 client.20064 populate_metadata read hostname 'trial028' 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565d1a9f3c0 0x5565d1a9f860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 4 client.20064 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.346+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565d196dd60 con 0x5565d1a9f3c0 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.347+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565d1a9f3c0 0x5565d1a9f860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.347+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565d1a9f3c0 0x5565d1a9f860 crc :-1 s=READY pgs=368 gs=4 cs=0 l=0 c_cookie=14217135831859875104 s_cookie=8487967788854039493 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c54d69b6a57c4d20 server_cookie=75cb51bb979a53c5 in_seq=0 out_seq=0 2026-02-20T13:30:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.347+0000 7fc87affd640 10 client.20064 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc87affd640 1 -- 10.20.193.28:0/3427643298 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5565d196dd60 con 0x5565d1a9f3c0 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc87affd640 10 client.20064 handle_command_reply: tid=0 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 client.20064 shutdown 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 msgr2=0x5565d1ab9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1ab9b40 secure :-1 s=READY pgs=1363 gs=1 cs=0 l=1 c_cookie=9574037630661809967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b0010cb0 tx=0x7fc8b0005660 comp rx=0 tx=0).stop 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 shutdown_connections 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565d1a9f3c0 0x5565d1a9f860 crc :-1 s=READY pgs=368 gs=4 cs=0 l=0 c_cookie=14217135831859875104 s_cookie=8487967788854039493 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1abf070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1aba080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/3427643298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5cb90 0x5565d1ab9b40 unknown :-1 s=CLOSED pgs=1363 gs=1 cs=0 l=1 c_cookie=9574037630661809967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc87affd640 0 client.20064 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 >> 10.20.193.28:0/3427643298 conn(0x5565d1a32680 msgr2=0x5565d1a52a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:15.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.348+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 shutdown_connections 2026-02-20T13:30:15.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.349+0000 7fc8c9432e00 1 -- 10.20.193.28:0/3427643298 wait complete. 2026-02-20T13:30:15.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.349+0000 7fc8c9432e00 20 client.20064 trim_cache size 0 max 16384 2026-02-20T13:30:15.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.357+0000 7fc8c9432e00 1 Processor -- start 2026-02-20T13:30:15.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.357+0000 7fc8c9432e00 1 -- start start 2026-02-20T13:30:15.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5cb90 0x5565d1ab6f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5d4a0 0x5565d1ab7480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1a9cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5565d195e0d0 con 0x5565d1a5d4a0 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5565d161e700 con 0x5565d1aa2350 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5565d1aba660 con 0x5565d1a5cb90 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5d4a0 0x5565d1ab7480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5d4a0 0x5565d1ab7480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57664/0 (socket says 10.20.193.28:57664) 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 -- 10.20.193.28:0/618733688 learned_addr learned my addr 10.20.193.28:0/618733688 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5cb90 0x5565d1ab6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c59ae640 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1a9cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 -- 10.20.193.28:0/618733688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5cb90 msgr2=0x5565d1ab6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:15.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5cb90 0x5565d1ab6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 -- 10.20.193.28:0/618733688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 msgr2=0x5565d1a9cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1a9cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 -- 10.20.193.28:0/618733688 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565d18f0bd0 con 0x5565d1a5d4a0 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5d4a0 0x5565d1ab7480 secure :-1 s=READY pgs=1364 gs=1 cs=0 l=1 c_cookie=15217960505740538113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b4009fd0 tx=0x7fc8b4002ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3310e73a696b101 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.358+0000 7fc88d4e4640 1 -- 10.20.193.28:0/618733688 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b40b21e0 con 0x5565d1a5d4a0 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc88d4e4640 1 -- 10.20.193.28:0/618733688 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8b40b23c0 con 0x5565d1a5d4a0 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc88d4e4640 1 -- 10.20.193.28:0/618733688 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b40ac2f0 con 0x5565d1a5d4a0 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 -- 10.20.193.28:0/618733688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5d4a0 msgr2=0x5565d1ab7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5d4a0 0x5565d1ab7480 secure :-1 s=READY pgs=1364 gs=1 cs=0 l=1 c_cookie=15217960505740538113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b4009fd0 tx=0x7fc8b4002ba0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 -- 10.20.193.28:0/618733688 shutdown_connections 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1a5d4a0 0x5565d1ab7480 unknown :-1 s=CLOSED pgs=1364 gs=1 cs=0 l=1 c_cookie=15217960505740538113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1aa2350 0x5565d1a9cfb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/618733688 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5cb90 0x5565d1ab6f40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 -- 10.20.193.28:0/618733688 >> 10.20.193.28:0/618733688 conn(0x5565d1a32680 msgr2=0x5565d1aabb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 -- 10.20.193.28:0/618733688 shutdown_connections 2026-02-20T13:30:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.359+0000 7fc8c9432e00 1 -- 10.20.193.28:0/618733688 wait complete. 2026-02-20T13:30:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c9432e00 1 -- start start 2026-02-20T13:30:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c9432e00 1 Processor -- start 2026-02-20T13:30:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1a5cb90 0x5565d1a37cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1a38200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c9432e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1aa2350 0x5565d1a36a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5565d1abf180 con 0x5565d1aa2350 2026-02-20T13:30:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5565d1ac0b10 con 0x5565d1a5cb90 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c9432e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5565d1a38820 con 0x5565d1a5d4a0 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c59ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1aa2350 0x5565d1a36a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c59ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1aa2350 0x5565d1a36a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57672/0 (socket says 10.20.193.28:57672) 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c59ae640 1 -- 10.20.193.28:0/4071917948 learned_addr learned my addr 10.20.193.28:0/4071917948 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1a5cb90 0x5565d1a37cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.360+0000 7fc8c49ac640 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1a38200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c59ae640 1 -- 10.20.193.28:0/4071917948 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 msgr2=0x5565d1a38200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c59ae640 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1a38200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c59ae640 1 -- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1a5cb90 msgr2=0x5565d1a37cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c59ae640 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1a5cb90 0x5565d1a37cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c59ae640 1 -- 10.20.193.28:0/4071917948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565d18e4680 con 0x5565d1aa2350 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1a5cb90 0x5565d1a37cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c59ae640 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1aa2350 0x5565d1a36a90 secure :-1 s=READY pgs=1365 gs=2 cs=0 l=1 c_cookie=2895511402824961967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8bc00a230 tx=0x7fc8bc0397e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282eec47a0798faf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc87affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc87affd640 1 -- 10.20.193.28:0/4071917948 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8bc03e040 con 0x5565d1aa2350 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc87affd640 1 -- 10.20.193.28:0/4071917948 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8bc03f040 con 0x5565d1aa2350 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c0164a10 con 0x5565d1aa2350 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc87affd640 1 -- 10.20.193.28:0/4071917948 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8bc0466b0 con 0x5565d1aa2350 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c9432e00 10 client.20070 _ll_register_callbacks cb 0x5565d18e19a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8b0004d30 con 0x5565d1aa2350 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc87affd640 1 -- 10.20.193.28:0/4071917948 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc8bc046840 con 0x5565d1aa2350 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc87affd640 1 -- 10.20.193.28:0/4071917948 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc8bc046a20 con 0x5565d1aa2350 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c9432e00 10 client.20070 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:15.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.361+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5565d18f63b0 con 0x5565d1aa2350 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.362+0000 7fc87affd640 1 -- 10.20.193.28:0/4071917948 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc8bc044040 con 0x5565d1aa2350 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.362+0000 7fc8c9432e00 10 client.20070 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.362+0000 7fc8c9432e00 10 client.20070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.362+0000 7fc8c9432e00 20 client.20070 populate_metadata read hostname 'trial028' 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.362+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565d1b503b0 0x5565d1b70860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.362+0000 7fc8c9432e00 4 client.20070 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.362+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565d15f3f40 con 0x5565d1b503b0 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.362+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565d1b503b0 0x5565d1b70860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c51ad640 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565d1b503b0 0x5565d1b70860 crc :-1 s=READY pgs=369 gs=4 cs=0 l=0 c_cookie=361439655120283823 s_cookie=14181299321410715633 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50417738b2f28af server_cookie=c4ce1898da2c7ff1 in_seq=0 out_seq=0 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc87affd640 10 client.20070 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:15.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc87affd640 1 -- 10.20.193.28:0/4071917948 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6338 (crc 0 0 0) 0x5565d15f3f40 con 0x5565d1b503b0 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc87affd640 10 client.20070 handle_command_reply: tid=0 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 client.20070 shutdown 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1aa2350 msgr2=0x5565d1a36a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1aa2350 0x5565d1a36a90 secure :-1 s=READY pgs=1365 gs=2 cs=0 l=1 c_cookie=2895511402824961967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8bc00a230 tx=0x7fc8bc0397e0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 shutdown_connections 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5565d1b503b0 0x5565d1b70860 crc :-1 s=READY pgs=369 gs=4 cs=0 l=0 c_cookie=361439655120283823 s_cookie=14181299321410715633 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5565d1aa2350 0x5565d1a36a90 unknown :-1 s=CLOSED pgs=1365 gs=2 cs=0 l=1 c_cookie=2895511402824961967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5565d1a5d4a0 0x5565d1a38200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 --2- 10.20.193.28:0/4071917948 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5565d1a5cb90 0x5565d1a37cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc87affd640 0 client.20070 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 >> 10.20.193.28:0/4071917948 conn(0x5565d1a32680 msgr2=0x5565d1ab5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 shutdown_connections 2026-02-20T13:30:15.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.363+0000 7fc8c9432e00 1 -- 10.20.193.28:0/4071917948 wait complete. 2026-02-20T13:30:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c9432e00 20 client.20070 trim_cache size 0 max 16384 2026-02-20T13:30:15.372 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:15.372 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:30:15.372 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:30:15.372 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:30:15.373 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.374 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:30:15.375 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.376 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.377 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.378 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.379 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:30:15.380 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.381 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:30:15.382 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:30:15.383 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.383 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.383 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.383 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.383 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.383 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.383 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:30:15.384 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:30:15.384 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.384 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.384 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.384 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.384 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.384 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.385 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:30:15.385 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:30:15.385 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.385 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.385 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.385 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.385 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.386 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.386 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:30:15.386 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:30:15.386 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.386 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.386 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.386 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.386 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.387 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.387 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:30:15.387 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:30:15.387 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.387 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.387 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.387 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.387 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:15.388 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 -- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc89c0b5760 msgr2=0x7fc89c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc89c0b5760 0x7fc89c0d5c10 secure :-1 s=READY pgs=566 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b0004740 tx=0x7fc8b00107a0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 -- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c010fea0 msgr2=0x7fc8c011e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c010fea0 0x7fc8c011e310 secure :-1 s=READY pgs=1361 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b40072a0 tx=0x7fc8b400ddf0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 -- 10.20.193.28:0/313566166 shutdown_connections 2026-02-20T13:30:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc89c0b5760 0x7fc89c0d5c10 unknown :-1 s=CLOSED pgs=566 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8c010fea0 0x7fc8c011e310 unknown :-1 s=CLOSED pgs=1361 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc8c01156a0 0x7fc8c01236e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 --2- 10.20.193.28:0/313566166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc8c010f4b0 0x7fc8c011ddd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 -- 10.20.193.28:0/313566166 >> 10.20.193.28:0/313566166 conn(0x7fc8c00ecda0 msgr2=0x7fc8c010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 -- 10.20.193.28:0/313566166 shutdown_connections 2026-02-20T13:30:15.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.364+0000 7fc8c61af640 1 -- 10.20.193.28:0/313566166 wait complete. 2026-02-20T13:30:15.501 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:30:15.502 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:30:15.691 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:15.776 INFO:tasks.workunit.client.0.trial028.stdout:437/600: open fd = 3 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:438/600: open fd = 3 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:439/600: open fd = 3 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.777 INFO:tasks.workunit.client.0.trial028.stdout:440/600: open fd = 3 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:441/600: open fd = 3 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:442/600: open fd = 3 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:443/600: open fd = 3 2026-02-20T13:30:15.778 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:444/600: open fd = 3 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:445/600: open fd = 3 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:446/600: open fd = 3 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.779 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:447/600: open fd = 3 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:448/600: open fd = 3 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:449/600: open fd = 3 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.780 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:450/600: open fd = 3 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:451/600: open fd = 3 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:452/600: open fd = 3 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.781 INFO:tasks.workunit.client.0.trial028.stdout:453/600: open fd = 3 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:454/600: open fd = 3 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:455/600: open fd = 3 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:456/600: open fd = 3 2026-02-20T13:30:15.782 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:457/600: open fd = 3 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:458/600: open fd = 3 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:459/600: open fd = 3 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.783 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:460/600: open fd = 3 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:461/600: open fd = 3 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:462/600: open fd = 3 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.784 INFO:tasks.workunit.client.0.trial028.stdout:463/600: open fd = 3 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:464/600: open fd = 3 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:465/600: open fd = 3 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:466/600: open fd = 3 2026-02-20T13:30:15.785 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:467/600: open fd = 3 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:468/600: open fd = 3 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:469/600: open fd = 3 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.786 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:470/600: open fd = 3 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:471/600: open fd = 3 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:472/600: open fd = 3 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.787 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:473/600: open fd = 3 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:474/600: open fd = 3 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:475/600: open fd = 3 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:476/600: open fd = 3 2026-02-20T13:30:15.788 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:477/600: open fd = 3 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:478/600: open fd = 3 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:479/600: open fd = 3 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.789 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:480/600: open fd = 3 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:481/600: open fd = 3 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:482/600: open fd = 3 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.790 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:483/600: open fd = 3 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:484/600: open fd = 3 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:485/600: open fd = 3 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.791 INFO:tasks.workunit.client.0.trial028.stdout:486/600: open fd = 3 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:487/600: open fd = 3 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:488/600: open fd = 3 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:489/600: open fd = 3 2026-02-20T13:30:15.792 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:490/600: open fd = 3 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:491/600: open fd = 3 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:492/600: open fd = 3 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.793 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:493/600: open fd = 3 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:494/600: open fd = 3 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:495/600: open fd = 3 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.794 INFO:tasks.workunit.client.0.trial028.stdout:496/600: open fd = 3 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:497/600: open fd = 3 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:498/600: open fd = 3 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:30:15.795 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:30:15.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.870+0000 7f107e019640 1 -- 10.20.193.28:0/4280655665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810c230 msgr2=0x7f1078155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.870+0000 7f107e019640 1 --2- 10.20.193.28:0/4280655665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810c230 0x7f1078155110 secure :-1 s=READY pgs=1366 gs=1 cs=0 l=1 c_cookie=14061404098379823880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c009950 tx=0x7f106c02f190 comp rx=0 tx=0).stop 2026-02-20T13:30:15.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 -- 10.20.193.28:0/4280655665 shutdown_connections 2026-02-20T13:30:15.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 --2- 10.20.193.28:0/4280655665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810c230 0x7f1078155110 unknown :-1 s=CLOSED pgs=1366 gs=1 cs=0 l=1 c_cookie=14061404098379823880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 --2- 10.20.193.28:0/4280655665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1078155650 0x7f1078175a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 --2- 10.20.193.28:0/4280655665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f107810b920 0x7f107810bcf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 -- 10.20.193.28:0/4280655665 >> 10.20.193.28:0/4280655665 conn(0x7f10780e95a0 msgr2=0x7f10781099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 -- 10.20.193.28:0/4280655665 shutdown_connections 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 -- 10.20.193.28:0/4280655665 wait complete. 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 Processor -- start 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.871+0000 7f107e019640 1 -- start start 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107e019640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810b920 0x7f1078160d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107e019640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f107810c230 0x7f10781612c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107e019640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1078155650 0x7f1078166690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107e019640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1078166cb0 con 0x7f107810b920 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107e019640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1078166e20 con 0x7f1078155650 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107e019640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1078166fe0 con 0x7f107810c230 2026-02-20T13:30:15.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810b920 0x7f1078160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810b920 0x7f1078160d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57698/0 (socket says 10.20.193.28:57698) 2026-02-20T13:30:15.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 -- 10.20.193.28:0/1913526808 learned_addr learned my addr 10.20.193.28:0/1913526808 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:15.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107c816640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f107810c230 0x7f10781612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d818640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1078155650 0x7f1078166690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 -- 10.20.193.28:0/1913526808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f107810c230 msgr2=0x7f10781612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f107810c230 0x7f10781612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 -- 10.20.193.28:0/1913526808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1078155650 msgr2=0x7f1078166690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1078155650 0x7f1078166690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 -- 10.20.193.28:0/1913526808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106c009570 con 0x7f107810b920 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107c816640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f107810c230 0x7f10781612c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f107d017640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810b920 0x7f1078160d80 secure :-1 s=READY pgs=1367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1068009480 tx=0x7f106800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f10667fc640 1 -- 10.20.193.28:0/1913526808 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f106800cd40 con 0x7f107810b920 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f10667fc640 1 -- 10.20.193.28:0/1913526808 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1068004d30 con 0x7f107810b920 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.872+0000 7f10667fc640 1 -- 10.20.193.28:0/1913526808 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10680106b0 con 0x7f107810b920 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.873+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10781672c0 con 0x7f107810b920 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.873+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1078152280 con 0x7f107810b920 2026-02-20T13:30:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.873+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10781674e0 con 0x7f107810b920 2026-02-20T13:30:15.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.875+0000 7f10667fc640 1 -- 10.20.193.28:0/1913526808 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f106801f060 con 0x7f107810b920 2026-02-20T13:30:15.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.877+0000 7f10667fc640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f10540b5760 0x7f10540d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.877+0000 7f10667fc640 1 -- 10.20.193.28:0/1913526808 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1068014070 con 0x7f107810b920 2026-02-20T13:30:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.877+0000 7f10667fc640 1 -- 10.20.193.28:0/1913526808 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f10680e7130 con 0x7f107810b920 2026-02-20T13:30:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.877+0000 7f107c816640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f10540b5760 0x7f10540d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:15.878+0000 7f107c816640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f10540b5760 0x7f10540d5c10 secure :-1 s=READY pgs=567 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c0023d0 tx=0x7f106c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.017+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1078161ee0 con 0x7f107810b920 2026-02-20T13:30:16.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.018+0000 7f10667fc640 1 -- 10.20.193.28:0/1913526808 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f10680a98b0 con 0x7f107810b920 2026-02-20T13:30:16.020 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:30:16.020 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:30:16.020 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f10540b5760 msgr2=0x7f10540d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f10540b5760 0x7f10540d5c10 secure :-1 s=READY pgs=567 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c0023d0 tx=0x7f106c031040 comp rx=0 tx=0).stop 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810b920 msgr2=0x7f1078160d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810b920 0x7f1078160d80 secure :-1 s=READY pgs=1367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1068009480 tx=0x7f106800ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 shutdown_connections 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f10540b5760 0x7f10540d5c10 unknown :-1 s=CLOSED pgs=567 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1078155650 0x7f1078166690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f107810c230 0x7f10781612c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 --2- 10.20.193.28:0/1913526808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f107810b920 0x7f1078160d80 unknown :-1 s=CLOSED pgs=1367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 >> 10.20.193.28:0/1913526808 conn(0x7f10780e95a0 msgr2=0x7f1078109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 shutdown_connections 2026-02-20T13:30:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.019+0000 7f107e019640 1 -- 10.20.193.28:0/1913526808 wait complete. 2026-02-20T13:30:16.119 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:30:16.303 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:16.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 -- 10.20.193.28:0/2538218967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 msgr2=0x7f834c115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 --2- 10.20.193.28:0/2538218967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 0x7f834c115030 secure :-1 s=READY pgs=1368 gs=1 cs=0 l=1 c_cookie=17749395086381273302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8334009950 tx=0x7f833402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:16.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 -- 10.20.193.28:0/2538218967 shutdown_connections 2026-02-20T13:30:16.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 --2- 10.20.193.28:0/2538218967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 0x7f834c115030 unknown :-1 s=CLOSED pgs=1368 gs=1 cs=0 l=1 c_cookie=17749395086381273302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 --2- 10.20.193.28:0/2538218967 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f834c1157e0 0x7f834c1761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 --2- 10.20.193.28:0/2538218967 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f834c10f5f0 0x7f834c10f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 -- 10.20.193.28:0/2538218967 >> 10.20.193.28:0/2538218967 conn(0x7f834c0ecea0 msgr2=0x7f834c10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 -- 10.20.193.28:0/2538218967 shutdown_connections 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 -- 10.20.193.28:0/2538218967 wait complete. 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.471+0000 7f83531f1640 1 Processor -- start 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f83531f1640 1 -- start start 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f83531f1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f834c10f5f0 0x7f834c0f4eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f83531f1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 0x7f834c1760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f83531f1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f834c1157e0 0x7f834c0f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f83531f1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f834c0fa7c0 con 0x7f834c10ffe0 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f83531f1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f834c0fa930 con 0x7f834c1157e0 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f83531f1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f834c0faaf0 con 0x7f834c10f5f0 2026-02-20T13:30:16.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8343fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 0x7f834c1760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8343fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 0x7f834c1760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57714/0 (socket says 10.20.193.28:57714) 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8343fff640 1 -- 10.20.193.28:0/2302837245 learned_addr learned my addr 10.20.193.28:0/2302837245 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8350f66640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f834c10f5f0 0x7f834c0f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8351767640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f834c1157e0 0x7f834c0f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8343fff640 1 -- 10.20.193.28:0/2302837245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f834c10f5f0 msgr2=0x7f834c0f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8343fff640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f834c10f5f0 0x7f834c0f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8343fff640 1 -- 10.20.193.28:0/2302837245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f834c1157e0 msgr2=0x7f834c0f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8343fff640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f834c1157e0 0x7f834c0f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.472+0000 7f8343fff640 1 -- 10.20.193.28:0/2302837245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8334009570 con 0x7f834c10ffe0 2026-02-20T13:30:16.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.473+0000 7f8343fff640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 0x7f834c1760b0 secure :-1 s=READY pgs=1369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8334038820 tx=0x7f83340043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.473+0000 7f8341ffb640 1 -- 10.20.193.28:0/2302837245 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f833403d070 con 0x7f834c10ffe0 2026-02-20T13:30:16.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.473+0000 7f8341ffb640 1 -- 10.20.193.28:0/2302837245 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8334038920 con 0x7f834c10ffe0 2026-02-20T13:30:16.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.473+0000 7f8341ffb640 1 -- 10.20.193.28:0/2302837245 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8334041960 con 0x7f834c10ffe0 2026-02-20T13:30:16.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.473+0000 7f83531f1640 1 -- 10.20.193.28:0/2302837245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c0fad70 con 0x7f834c10ffe0 2026-02-20T13:30:16.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.473+0000 7f83531f1640 1 -- 10.20.193.28:0/2302837245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c0fb190 con 0x7f834c10ffe0 2026-02-20T13:30:16.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.476+0000 7f8341ffb640 1 -- 10.20.193.28:0/2302837245 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8334038a90 con 0x7f834c10ffe0 2026-02-20T13:30:16.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.477+0000 7f8341ffb640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f83280b5750 0x7f83280d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.477+0000 7f8341ffb640 1 -- 10.20.193.28:0/2302837245 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f833410b300 con 0x7f834c10ffe0 2026-02-20T13:30:16.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.478+0000 7f8350f66640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f83280b5750 0x7f83280d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.478+0000 7f8350f66640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f83280b5750 0x7f83280d5c00 secure :-1 s=READY pgs=568 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f833c004740 tx=0x7f833c004340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.479+0000 7f83551ebe00 1 Processor -- start 2026-02-20T13:30:16.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.479+0000 7f83551ebe00 1 -- start start 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.479+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abacf730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abb145e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb34f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f83551ebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5607ab9e5780 con 0x5607abb14b20 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f83551ebe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5607ab9e14b0 con 0x5607abacfc70 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f83551ebe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5607ab9db450 con 0x5607abacf360 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb34f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb34f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57720/0 (socket says 10.20.193.28:57720) 2026-02-20T13:30:16.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 -- 10.20.193.28:0/2399264592 learned_addr learned my addr 10.20.193.28:0/2399264592 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8350f66640 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abacf730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8343fff640 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abb145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 -- 10.20.193.28:0/2399264592 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 msgr2=0x5607abacf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abacf730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 -- 10.20.193.28:0/2399264592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 msgr2=0x5607abb145e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abb145e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 -- 10.20.193.28:0/2399264592 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ab986d10 con 0x5607abb14b20 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f8351767640 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb34f00 secure :-1 s=READY pgs=1370 gs=1 cs=0 l=1 c_cookie=579700515779226207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8348006a50 tx=0x7f8348003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b828c3721aa5f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f83194e4640 1 -- 10.20.193.28:0/2399264592 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8348010c20 con 0x5607abb14b20 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f83194e4640 1 -- 10.20.193.28:0/2399264592 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8348010d80 con 0x5607abb14b20 2026-02-20T13:30:16.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.480+0000 7f83194e4640 1 -- 10.20.193.28:0/2399264592 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f834801a8b0 con 0x5607abb14b20 2026-02-20T13:30:16.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 -- 10.20.193.28:0/2399264592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 msgr2=0x5607abb34f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb34f00 secure :-1 s=READY pgs=1370 gs=1 cs=0 l=1 c_cookie=579700515779226207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8348006a50 tx=0x7f8348003e70 comp rx=0 tx=0).stop 2026-02-20T13:30:16.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 -- 10.20.193.28:0/2399264592 shutdown_connections 2026-02-20T13:30:16.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb34f00 unknown :-1 s=CLOSED pgs=1370 gs=1 cs=0 l=1 c_cookie=579700515779226207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abb145e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 --2- 10.20.193.28:0/2399264592 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abacf730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 -- 10.20.193.28:0/2399264592 >> 10.20.193.28:0/2399264592 conn(0x5607abaad860 msgr2=0x5607abacdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 -- 10.20.193.28:0/2399264592 shutdown_connections 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.481+0000 7f83551ebe00 1 -- 10.20.193.28:0/2399264592 wait complete. 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.482+0000 7f83551ebe00 1 -- start start 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.482+0000 7f83551ebe00 1 Processor -- start 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abad37c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abad3d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abad1590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f83551ebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5607abad1ad0 con 0x5607abb14b20 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f83551ebe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5607abad1c40 con 0x5607abacfc70 2026-02-20T13:30:16.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f83551ebe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5607abad1e00 con 0x5607abacf360 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8350f66640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abad37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8351767640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abad1590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8350f66640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abad37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45334/0 (socket says 10.20.193.28:45334) 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8350f66640 1 -- 10.20.193.28:0/3297811202 learned_addr learned my addr 10.20.193.28:0/3297811202 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8343fff640 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abad3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8351767640 1 -- 10.20.193.28:0/3297811202 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 msgr2=0x5607abad37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8351767640 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abad37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8351767640 1 -- 10.20.193.28:0/3297811202 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 msgr2=0x5607abad3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8351767640 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abad3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8351767640 1 -- 10.20.193.28:0/3297811202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ab95f3c0 con 0x5607abb14b20 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8350f66640 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abad37c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.483+0000 7f8343fff640 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abad3d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:16.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.484+0000 7f8351767640 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abad1590 secure :-1 s=READY pgs=1371 gs=2 cs=0 l=1 c_cookie=9599305612770974662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8348006a50 tx=0x7f8348010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8537959873a09bc6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.484+0000 7f830a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:16.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.484+0000 7f830a7fc640 1 -- 10.20.193.28:0/3297811202 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f834801aa40 con 0x5607abb14b20 2026-02-20T13:30:16.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.484+0000 7f830a7fc640 1 -- 10.20.193.28:0/3297811202 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f834801f070 con 0x5607abb14b20 2026-02-20T13:30:16.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.484+0000 7f830a7fc640 1 -- 10.20.193.28:0/3297811202 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8348005ab0 con 0x5607abb14b20 2026-02-20T13:30:16.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.484+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83480055b0 con 0x5607abb14b20 2026-02-20T13:30:16.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.484+0000 7f830a7fc640 1 -- 10.20.193.28:0/3297811202 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8348005c40 con 0x5607abb14b20 2026-02-20T13:30:16.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 10 client.20088 _ll_register_callbacks cb 0x5607ab95ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:16.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5607ab6716f0 con 0x5607abb14b20 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f830a7fc640 1 -- 10.20.193.28:0/3297811202 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8348005e00 con 0x5607abb14b20 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 10 client.20088 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5607ab9710e0 con 0x5607abb14b20 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f830a7fc640 1 -- 10.20.193.28:0/3297811202 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8348018020 con 0x5607abb14b20 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 10 client.20088 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 10 client.20088 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 20 client.20088 populate_metadata read hostname 'trial028' 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5607abafa930 0x5607abafadd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 4 client.20088 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607ab97df80 con 0x5607abafa930 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.485+0000 7f8350f66640 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5607abafa930 0x5607abafadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.486+0000 7f8350f66640 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5607abafa930 0x5607abafadd0 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=6197668333158839126 s_cookie=18009287558329663532 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=56028a83299eb356 server_cookie=f9edd79df41a002c in_seq=0 out_seq=0 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.486+0000 7f830a7fc640 10 client.20088 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.486+0000 7f830a7fc640 1 -- 10.20.193.28:0/3297811202 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5607ab97df80 con 0x5607abafa930 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.486+0000 7f830a7fc640 10 client.20088 handle_command_reply: tid=0 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.486+0000 7f83551ebe00 1 client.20088 shutdown 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 msgr2=0x5607abad1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abad1590 secure :-1 s=READY pgs=1371 gs=2 cs=0 l=1 c_cookie=9599305612770974662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8348006a50 tx=0x7f8348010c30 comp rx=0 tx=0).stop 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 shutdown_connections 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5607abafa930 0x5607abafadd0 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=6197668333158839126 s_cookie=18009287558329663532 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abad1590 unknown :-1 s=CLOSED pgs=1371 gs=2 cs=0 l=1 c_cookie=9599305612770974662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacfc70 0x5607abad3d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3297811202 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacf360 0x5607abad37c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 >> 10.20.193.28:0/3297811202 conn(0x5607abaad860 msgr2=0x5607abacdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f830a7fc640 0 client.20088 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:30:16.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 shutdown_connections 2026-02-20T13:30:16.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 1 -- 10.20.193.28:0/3297811202 wait complete. 2026-02-20T13:30:16.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.487+0000 7f83551ebe00 20 client.20088 trim_cache size 0 max 16384 2026-02-20T13:30:16.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f83551ebe00 1 Processor -- start 2026-02-20T13:30:16.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f83551ebe00 1 -- start start 2026-02-20T13:30:16.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abaced40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacfc70 0x5607abb32350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb33e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f83551ebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5607ab9d9080 con 0x5607abb14b20 2026-02-20T13:30:16.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f83551ebe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5607ab699700 con 0x5607abacf360 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f83551ebe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5607abb29ad0 con 0x5607abacfc70 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f8351767640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb33e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f8351767640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb33e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57738/0 (socket says 10.20.193.28:57738) 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f8351767640 1 -- 10.20.193.28:0/3299313455 learned_addr learned my addr 10.20.193.28:0/3299313455 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f8343fff640 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacfc70 0x5607abb32350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.494+0000 7f8350f66640 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abaced40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8351767640 1 -- 10.20.193.28:0/3299313455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacfc70 msgr2=0x5607abb32350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8351767640 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacfc70 0x5607abb32350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8351767640 1 -- 10.20.193.28:0/3299313455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 msgr2=0x5607abaced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8351767640 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abaced40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8351767640 1 -- 10.20.193.28:0/3299313455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ab96bb60 con 0x5607abb14b20 2026-02-20T13:30:16.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8351767640 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb33e20 secure :-1 s=READY pgs=1372 gs=1 cs=0 l=1 c_cookie=8675240346824336785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f834802e6a0 tx=0x7f834802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7864a521cd99e591 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8318ce3640 1 -- 10.20.193.28:0/3299313455 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8348006de0 con 0x5607abb14b20 2026-02-20T13:30:16.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8318ce3640 1 -- 10.20.193.28:0/3299313455 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f834801f070 con 0x5607abb14b20 2026-02-20T13:30:16.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f8318ce3640 1 -- 10.20.193.28:0/3299313455 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f834801aaf0 con 0x5607abb14b20 2026-02-20T13:30:16.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 -- 10.20.193.28:0/3299313455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 msgr2=0x5607abb33e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb33e20 secure :-1 s=READY pgs=1372 gs=1 cs=0 l=1 c_cookie=8675240346824336785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f834802e6a0 tx=0x7f834802a000 comp rx=0 tx=0).stop 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 -- 10.20.193.28:0/3299313455 shutdown_connections 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abb14b20 0x5607abb33e20 unknown :-1 s=CLOSED pgs=1372 gs=1 cs=0 l=1 c_cookie=8675240346824336785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abacfc70 0x5607abb32350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 --2- 10.20.193.28:0/3299313455 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abaced40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 -- 10.20.193.28:0/3299313455 >> 10.20.193.28:0/3299313455 conn(0x5607abaad860 msgr2=0x5607abb14090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 -- 10.20.193.28:0/3299313455 shutdown_connections 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.495+0000 7f83551ebe00 1 -- 10.20.193.28:0/3299313455 wait complete. 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.496+0000 7f83551ebe00 1 -- start start 2026-02-20T13:30:16.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.496+0000 7f83551ebe00 1 Processor -- start 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.496+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abad5db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.496+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abacfc70 0x5607abad6310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.496+0000 7f83551ebe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abb14b20 0x5607abad46a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.496+0000 7f83551ebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5607abad4da0 con 0x5607abacfc70 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.496+0000 7f83551ebe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5607abad4f10 con 0x5607abacf360 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.496+0000 7f83551ebe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5607abad50d0 con 0x5607abb14b20 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abacfc70 0x5607abad6310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abacfc70 0x5607abad6310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57744/0 (socket says 10.20.193.28:57744) 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 -- 10.20.193.28:0/1977547457 learned_addr learned my addr 10.20.193.28:0/1977547457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8350f66640 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abad5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8351767640 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abb14b20 0x5607abad46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 -- 10.20.193.28:0/1977547457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abb14b20 msgr2=0x5607abad46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abb14b20 0x5607abad46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 -- 10.20.193.28:0/1977547457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 msgr2=0x5607abad5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abad5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 -- 10.20.193.28:0/1977547457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ab95f6f0 con 0x5607abacfc70 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8350f66640 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abad5db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f8343fff640 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abacfc70 0x5607abad6310 secure :-1 s=READY pgs=1373 gs=1 cs=0 l=1 c_cookie=6834720685387024393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8334005d80 tx=0x7f833402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed9ce405f820809 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f830a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f830a7fc640 1 -- 10.20.193.28:0/1977547457 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83340d1080 con 0x5607abacfc70 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f830a7fc640 1 -- 10.20.193.28:0/1977547457 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f83340d0ea0 con 0x5607abacfc70 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f830a7fc640 1 -- 10.20.193.28:0/1977547457 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83340cf900 con 0x5607abacfc70 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607ab9710e0 con 0x5607abacfc70 2026-02-20T13:30:16.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f83551ebe00 10 client.20094 _ll_register_callbacks cb 0x5607ab95ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.497+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8348010d80 con 0x5607abacfc70 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f830a7fc640 1 -- 10.20.193.28:0/1977547457 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f83340d20a0 con 0x5607abacfc70 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f830a7fc640 1 -- 10.20.193.28:0/1977547457 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f83340dc7e0 con 0x5607abacfc70 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f83551ebe00 10 client.20094 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5607ab971340 con 0x5607abacfc70 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f830a7fc640 1 -- 10.20.193.28:0/1977547457 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f833410a070 con 0x5607abacfc70 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f83551ebe00 10 client.20094 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f83551ebe00 10 client.20094 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f83551ebe00 20 client.20094 populate_metadata read hostname 'trial028' 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f83551ebe00 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5607abb0d2a0 0x5607abb0d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f83551ebe00 4 client.20094 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:16.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607ab66ef40 con 0x5607abb0d2a0 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.498+0000 7f8350f66640 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5607abb0d2a0 0x5607abb0d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f8350f66640 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5607abb0d2a0 0x5607abb0d740 crc :-1 s=READY pgs=72 gs=4 cs=0 l=0 c_cookie=7327365557212152019 s_cookie=1889023495369327048 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=65b00826f91000d3 server_cookie=1a3728dc4ddb01c8 in_seq=0 out_seq=0 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f830a7fc640 10 client.20094 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f830a7fc640 1 -- 10.20.193.28:0/1977547457 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607ab66ef40 con 0x5607abb0d2a0 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f830a7fc640 10 client.20094 handle_command_reply: tid=0 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 client.20094 shutdown 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abacfc70 msgr2=0x5607abad6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abacfc70 0x5607abad6310 secure :-1 s=READY pgs=1373 gs=1 cs=0 l=1 c_cookie=6834720685387024393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8334005d80 tx=0x7f833402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 shutdown_connections 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x5607abb0d2a0 0x5607abb0d740 crc :-1 s=READY pgs=72 gs=4 cs=0 l=0 c_cookie=7327365557212152019 s_cookie=1889023495369327048 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607abacfc70 0x5607abad6310 unknown :-1 s=CLOSED pgs=1373 gs=1 cs=0 l=1 c_cookie=6834720685387024393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607abb14b20 0x5607abad46a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 --2- 10.20.193.28:0/1977547457 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607abacf360 0x5607abad5db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 >> 10.20.193.28:0/1977547457 conn(0x5607abaad860 msgr2=0x5607abacdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f830a7fc640 0 client.20094 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:30:16.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 shutdown_connections 2026-02-20T13:30:16.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 1 -- 10.20.193.28:0/1977547457 wait complete. 2026-02-20T13:30:16.508 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:16.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.499+0000 7f83551ebe00 20 client.20094 trim_cache size 0 max 16384 2026-02-20T13:30:16.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 -- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f83280b5750 msgr2=0x7f83280d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f83280b5750 0x7f83280d5c00 secure :-1 s=READY pgs=568 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f833c004740 tx=0x7f833c004340 comp rx=0 tx=0).stop 2026-02-20T13:30:16.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 -- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 msgr2=0x7f834c1760b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 0x7f834c1760b0 secure :-1 s=READY pgs=1369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8334038820 tx=0x7f83340043d0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 -- 10.20.193.28:0/2302837245 shutdown_connections 2026-02-20T13:30:16.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f83280b5750 0x7f83280d5c00 unknown :-1 s=CLOSED pgs=568 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f834c10ffe0 0x7f834c1760b0 unknown :-1 s=CLOSED pgs=1369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f834c1157e0 0x7f834c0f55b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 --2- 10.20.193.28:0/2302837245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f834c10f5f0 0x7f834c0f4eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 -- 10.20.193.28:0/2302837245 >> 10.20.193.28:0/2302837245 conn(0x7f834c0ecea0 msgr2=0x7f834c113fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 -- 10.20.193.28:0/2302837245 shutdown_connections 2026-02-20T13:30:16.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.500+0000 7f83531f1640 1 -- 10.20.193.28:0/2302837245 wait complete. 2026-02-20T13:30:16.599 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:30:16.784 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:16 trial028 ceph-mon[37442]: pgmap v569: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2026-02-20T13:30:16.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:16 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1913526808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.974+0000 7f185cd91640 1 -- 10.20.193.28:0/4065658324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18581157e0 msgr2=0x7f18581761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.974+0000 7f185cd91640 1 --2- 10.20.193.28:0/4065658324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18581157e0 0x7f18581761b0 secure :-1 s=READY pgs=1374 gs=2 cs=0 l=1 c_cookie=6759684620796610354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184800aa30 tx=0x7f1848030270 comp rx=0 tx=0).stop 2026-02-20T13:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.974+0000 7f185cd91640 1 -- 10.20.193.28:0/4065658324 shutdown_connections 2026-02-20T13:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.974+0000 7f185cd91640 1 --2- 10.20.193.28:0/4065658324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18581157e0 0x7f18581761b0 unknown :-1 s=CLOSED pgs=1374 gs=2 cs=0 l=1 c_cookie=6759684620796610354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.974+0000 7f185cd91640 1 --2- 10.20.193.28:0/4065658324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f185810ffe0 0x7f1858115030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.974+0000 7f185cd91640 1 --2- 10.20.193.28:0/4065658324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f185810f5f0 0x7f185810f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.974+0000 7f185cd91640 1 -- 10.20.193.28:0/4065658324 >> 10.20.193.28:0/4065658324 conn(0x7f18580ecea0 msgr2=0x7f185810d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.974+0000 7f185cd91640 1 -- 10.20.193.28:0/4065658324 shutdown_connections 2026-02-20T13:30:16.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.975+0000 7f185cd91640 1 -- 10.20.193.28:0/4065658324 wait complete. 2026-02-20T13:30:16.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:16 trial127 ceph-mon[43817]: pgmap v569: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2026-02-20T13:30:16.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:16 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1913526808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.975+0000 7f185cd91640 1 Processor -- start 2026-02-20T13:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.975+0000 7f185cd91640 1 -- start start 2026-02-20T13:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f185cd91640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f185810f5f0 0x7f185811d510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f185cd91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f185810ffe0 0x7f185811da50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f185cd91640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18581157e0 0x7f1858122e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f185cd91640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1858123440 con 0x7f185810ffe0 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f185cd91640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f18581235b0 con 0x7f185810f5f0 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f185cd91640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1858123770 con 0x7f18581157e0 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f185810ffe0 0x7f185811da50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f185810ffe0 0x7f185811da50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57762/0 (socket says 10.20.193.28:57762) 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 -- 10.20.193.28:0/1232919384 learned_addr learned my addr 10.20.193.28:0/1232919384 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1856d76640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18581157e0 0x7f1858122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1856575640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f185810f5f0 0x7f185811d510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 -- 10.20.193.28:0/1232919384 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18581157e0 msgr2=0x7f1858122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18581157e0 0x7f1858122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 -- 10.20.193.28:0/1232919384 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f185810f5f0 msgr2=0x7f185811d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f185810f5f0 0x7f185811d510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 -- 10.20.193.28:0/1232919384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184800a650 con 0x7f185810ffe0 2026-02-20T13:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1856d76640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18581157e0 0x7f1858122e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.976+0000 7f1855d74640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f185810ffe0 0x7f185811da50 secure :-1 s=READY pgs=1375 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1840009480 tx=0x7f184000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.977+0000 7f183f7fe640 1 -- 10.20.193.28:0/1232919384 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f184000cd40 con 0x7f185810ffe0 2026-02-20T13:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.977+0000 7f185cd91640 1 -- 10.20.193.28:0/1232919384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1858123a50 con 0x7f185810ffe0 2026-02-20T13:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.977+0000 7f183f7fe640 1 -- 10.20.193.28:0/1232919384 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1840004d30 con 0x7f185810ffe0 2026-02-20T13:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.977+0000 7f183f7fe640 1 -- 10.20.193.28:0/1232919384 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18400106b0 con 0x7f185810ffe0 2026-02-20T13:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.977+0000 7f185cd91640 1 -- 10.20.193.28:0/1232919384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1858164150 con 0x7f185810ffe0 2026-02-20T13:30:16.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.980+0000 7f183f7fe640 1 -- 10.20.193.28:0/1232919384 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f184001f060 con 0x7f185810ffe0 2026-02-20T13:30:16.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.981+0000 7f183f7fe640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18300b5760 0x7f18300d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.982+0000 7f183f7fe640 1 -- 10.20.193.28:0/1232919384 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1840014070 con 0x7f185810ffe0 2026-02-20T13:30:16.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.982+0000 7f1856575640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18300b5760 0x7f18300d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.982+0000 7f1856575640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18300b5760 0x7f18300d5c10 secure :-1 s=READY pgs=570 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184c004740 tx=0x7f184c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.982+0000 7f185ed8be00 1 Processor -- start 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.982+0000 7f185ed8be00 1 -- start start 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4360 0x55888afb4730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888aff95e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888b019f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f185ed8be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55888aeca780 con 0x55888afb4c70 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f185ed8be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55888aec64b0 con 0x55888afb4360 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f185ed8be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55888aec0450 con 0x55888aff9b20 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888aff95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888aff95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57778/0 (socket says 10.20.193.28:57778) 2026-02-20T13:30:16.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 -- 10.20.193.28:0/2841080613 learned_addr learned my addr 10.20.193.28:0/2841080613 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1856d76640 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888b019f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1856575640 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4360 0x55888afb4730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 -- 10.20.193.28:0/2841080613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 msgr2=0x55888b019f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888b019f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 -- 10.20.193.28:0/2841080613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4360 msgr2=0x55888afb4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4360 0x55888afb4730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 -- 10.20.193.28:0/2841080613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888ae6bd10 con 0x55888afb4c70 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f1855d74640 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888aff95e0 secure :-1 s=READY pgs=1376 gs=1 cs=0 l=1 c_cookie=8916298490321099304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1840005000 tx=0x7f18400a9880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbd0e3c82f0da28 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f183cff9640 1 -- 10.20.193.28:0/2841080613 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18400ac930 con 0x55888afb4c70 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f183cff9640 1 -- 10.20.193.28:0/2841080613 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18400adb30 con 0x55888afb4c70 2026-02-20T13:30:16.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.983+0000 7f183cff9640 1 -- 10.20.193.28:0/2841080613 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18400addc0 con 0x55888afb4c70 2026-02-20T13:30:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 -- 10.20.193.28:0/2841080613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 msgr2=0x55888aff95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888aff95e0 secure :-1 s=READY pgs=1376 gs=1 cs=0 l=1 c_cookie=8916298490321099304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1840005000 tx=0x7f18400a9880 comp rx=0 tx=0).stop 2026-02-20T13:30:16.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 -- 10.20.193.28:0/2841080613 shutdown_connections 2026-02-20T13:30:16.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888aff95e0 unknown :-1 s=CLOSED pgs=1376 gs=1 cs=0 l=1 c_cookie=8916298490321099304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888b019f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 --2- 10.20.193.28:0/2841080613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4360 0x55888afb4730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 -- 10.20.193.28:0/2841080613 >> 10.20.193.28:0/2841080613 conn(0x55888af92860 msgr2=0x55888afb2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 -- 10.20.193.28:0/2841080613 shutdown_connections 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.984+0000 7f185ed8be00 1 -- 10.20.193.28:0/2841080613 wait complete. 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.985+0000 7f185ed8be00 1 -- start start 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.985+0000 7f185ed8be00 1 Processor -- start 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888afb4360 0x55888b0117d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888b011d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888aff9b20 0x55888b013aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f185ed8be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55888b014010 con 0x55888afb4c70 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f185ed8be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55888b014180 con 0x55888aff9b20 2026-02-20T13:30:16.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f185ed8be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55888b014340 con 0x55888afb4360 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1855d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888b011d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1855d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888b011d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57786/0 (socket says 10.20.193.28:57786) 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1855d74640 1 -- 10.20.193.28:0/1409326880 learned_addr learned my addr 10.20.193.28:0/1409326880 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1856d76640 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888aff9b20 0x55888b013aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1856575640 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888afb4360 0x55888b0117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1855d74640 1 -- 10.20.193.28:0/1409326880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888afb4360 msgr2=0x55888b0117d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1855d74640 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888afb4360 0x55888b0117d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1855d74640 1 -- 10.20.193.28:0/1409326880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888aff9b20 msgr2=0x55888b013aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1855d74640 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888aff9b20 0x55888b013aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.986+0000 7f1855d74640 1 -- 10.20.193.28:0/1409326880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888ae443c0 con 0x55888afb4c70 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f1855d74640 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888b011d10 secure :-1 s=READY pgs=1377 gs=2 cs=0 l=1 c_cookie=14548337319084766258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18400aa3a0 tx=0x7f18400adca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e613b6189b3432 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:16.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f1803fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f1803fff640 1 -- 10.20.193.28:0/1409326880 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18400ac930 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f1803fff640 1 -- 10.20.193.28:0/1409326880 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18400b2e50 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f1803fff640 1 -- 10.20.193.28:0/1409326880 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1840072540 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1858164150 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f185ed8be00 10 client.20106 _ll_register_callbacks cb 0x55888ae41a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55888ab566f0 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f1803fff640 1 -- 10.20.193.28:0/1409326880 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f18400b5430 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f1803fff640 1 -- 10.20.193.28:0/1409326880 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f18400ab110 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f185ed8be00 10 client.20106 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.987+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55888ae560e0 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.988+0000 7f1803fff640 1 -- 10.20.193.28:0/1409326880 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f18400ab270 con 0x55888afb4c70 2026-02-20T13:30:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.988+0000 7f185ed8be00 10 client.20106 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.988+0000 7f185ed8be00 10 client.20106 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.988+0000 7f185ed8be00 20 client.20106 populate_metadata read hostname 'trial028' 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.988+0000 7f185ed8be00 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55888b0199d0 0x55888b019e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.988+0000 7f185ed8be00 4 client.20106 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.988+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55888ae62f80 con 0x55888b0199d0 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.988+0000 7f1856575640 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55888b0199d0 0x55888b019e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.989+0000 7f1856575640 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55888b0199d0 0x55888b019e40 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=7432090639472068960 s_cookie=7736407385986667621 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6724170f483d0960 server_cookie=6b5d3d873f719465 in_seq=0 out_seq=0 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.989+0000 7f1803fff640 10 client.20106 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.989+0000 7f1803fff640 1 -- 10.20.193.28:0/1409326880 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55888ae62f80 con 0x55888b0199d0 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.989+0000 7f1803fff640 10 client.20106 handle_command_reply: tid=0 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.989+0000 7f185ed8be00 1 client.20106 shutdown 2026-02-20T13:30:16.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.989+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 msgr2=0x55888b011d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.989+0000 7f185ed8be00 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888b011d10 secure :-1 s=READY pgs=1377 gs=2 cs=0 l=1 c_cookie=14548337319084766258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18400aa3a0 tx=0x7f18400adca0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 shutdown_connections 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55888b0199d0 0x55888b019e40 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=7432090639472068960 s_cookie=7736407385986667621 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4c70 0x55888b011d10 unknown :-1 s=CLOSED pgs=1377 gs=2 cs=0 l=1 c_cookie=14548337319084766258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888aff9b20 0x55888b013aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 1 --2- 10.20.193.28:0/1409326880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888afb4360 0x55888b0117d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 >> 10.20.193.28:0/1409326880 conn(0x55888af92860 msgr2=0x55888afb2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f1803fff640 0 client.20106 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 shutdown_connections 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 1 -- 10.20.193.28:0/1409326880 wait complete. 2026-02-20T13:30:16.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.990+0000 7f185ed8be00 20 client.20106 trim_cache size 0 max 16384 2026-02-20T13:30:16.999 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:16 trial034 ceph-mon[43332]: pgmap v569: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2026-02-20T13:30:16.999 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:16 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1913526808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f185ed8be00 1 Processor -- start 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f185ed8be00 1 -- start start 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888b017bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 0x55888aff4780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888aff4cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f185ed8be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55888aebe080 con 0x55888afb4360 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f185ed8be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55888ab7e700 con 0x55888afb4c70 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f185ed8be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55888af924d0 con 0x55888aff9b20 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f1856575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888b017bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f1856d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888aff4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f1856575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888b017bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57800/0 (socket says 10.20.193.28:57800) 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.997+0000 7f1856575640 1 -- 10.20.193.28:0/4094051091 learned_addr learned my addr 10.20.193.28:0/4094051091 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f1855d74640 1 --2- 10.20.193.28:0/4094051091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 0x55888aff4780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f1856575640 1 -- 10.20.193.28:0/4094051091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 msgr2=0x55888aff4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f1856575640 1 --2- 10.20.193.28:0/4094051091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888aff4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f1856575640 1 -- 10.20.193.28:0/4094051091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 msgr2=0x55888aff4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f1856575640 1 --2- 10.20.193.28:0/4094051091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 0x55888aff4780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f1856575640 1 -- 10.20.193.28:0/4094051091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888ae50b60 con 0x55888afb4360 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f1856575640 1 --2- 10.20.193.28:0/4094051091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888b017bd0 secure :-1 s=READY pgs=1378 gs=1 cs=0 l=1 c_cookie=16450188139605699707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184c009da0 tx=0x7f184c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44acef4c58aac7b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f18224e6640 1 -- 10.20.193.28:0/4094051091 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f184c022070 con 0x55888afb4360 2026-02-20T13:30:17.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f18224e6640 1 -- 10.20.193.28:0/4094051091 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f184c023040 con 0x55888afb4360 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f18224e6640 1 -- 10.20.193.28:0/4094051091 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f184c011b30 con 0x55888afb4360 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f185ed8be00 1 -- 10.20.193.28:0/4094051091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 msgr2=0x55888b017bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f185ed8be00 1 --2- 10.20.193.28:0/4094051091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888b017bd0 secure :-1 s=READY pgs=1378 gs=1 cs=0 l=1 c_cookie=16450188139605699707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184c009da0 tx=0x7f184c014000 comp rx=0 tx=0).stop 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f185ed8be00 1 -- 10.20.193.28:0/4094051091 shutdown_connections 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f185ed8be00 1 --2- 10.20.193.28:0/4094051091 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888aff4cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f185ed8be00 1 --2- 10.20.193.28:0/4094051091 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 0x55888aff4780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f185ed8be00 1 --2- 10.20.193.28:0/4094051091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888b017bd0 unknown :-1 s=CLOSED pgs=1378 gs=1 cs=0 l=1 c_cookie=16450188139605699707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f185ed8be00 1 -- 10.20.193.28:0/4094051091 >> 10.20.193.28:0/4094051091 conn(0x55888af92860 msgr2=0x55888b012a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.998+0000 7f185ed8be00 1 -- 10.20.193.28:0/4094051091 shutdown_connections 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 -- 10.20.193.28:0/4094051091 wait complete. 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 -- start start 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 Processor -- start 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888af984b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 0x55888af98a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888aff8a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55888aff9180 con 0x55888afb4360 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55888aff92f0 con 0x55888afb4c70 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:16.999+0000 7f185ed8be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55888aff94b0 con 0x55888aff9b20 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888af984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888af984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57810/0 (socket says 10.20.193.28:57810) 2026-02-20T13:30:17.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 -- 10.20.193.28:0/3501941180 learned_addr learned my addr 10.20.193.28:0/3501941180 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1855d74640 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 0x55888af98a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856d76640 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888aff8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 -- 10.20.193.28:0/3501941180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 msgr2=0x55888aff8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888aff8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 -- 10.20.193.28:0/3501941180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 msgr2=0x55888af98a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 0x55888af98a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 -- 10.20.193.28:0/3501941180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888ae446f0 con 0x55888afb4360 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1856575640 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888af984b0 secure :-1 s=READY pgs=1379 gs=1 cs=0 l=1 c_cookie=17477113654253763460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184c02bde0 tx=0x7f184c009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28b2e4554ecbb84 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1803fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1803fff640 1 -- 10.20.193.28:0/3501941180 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f184c022070 con 0x55888afb4360 2026-02-20T13:30:17.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1803fff640 1 -- 10.20.193.28:0/3501941180 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f184c011890 con 0x55888afb4360 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f1803fff640 1 -- 10.20.193.28:0/3501941180 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f184c0366a0 con 0x55888afb4360 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.000+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184c009a20 con 0x55888afb4360 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f1803fff640 1 -- 10.20.193.28:0/3501941180 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f184c036830 con 0x55888afb4360 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 10 client.20112 _ll_register_callbacks cb 0x55888ae41a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18400adb30 con 0x55888afb4360 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f1803fff640 1 -- 10.20.193.28:0/3501941180 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f184c01dd50 con 0x55888afb4360 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 10 client.20112 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55888ae56340 con 0x55888afb4360 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f1803fff640 1 -- 10.20.193.28:0/3501941180 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f184c028040 con 0x55888afb4360 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 10 client.20112 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 10 client.20112 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 20 client.20112 populate_metadata read hostname 'trial028' 2026-02-20T13:30:17.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55888b049a50 0x55888b049ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 4 client.20112 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:17.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55888ab53f40 con 0x55888b049a50 2026-02-20T13:30:17.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.001+0000 7f1855d74640 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55888b049a50 0x55888b049ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f1855d74640 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55888b049a50 0x55888b049ef0 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=9714957974059095906 s_cookie=417719852335637765 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=86d276ce2ba41762 server_cookie=5cc09fe16182505 in_seq=0 out_seq=0 2026-02-20T13:30:17.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f1803fff640 10 client.20112 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:30:17.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f1803fff640 1 -- 10.20.193.28:0/3501941180 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55888ab53f40 con 0x55888b049a50 2026-02-20T13:30:17.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f1803fff640 10 client.20112 handle_command_reply: tid=0 2026-02-20T13:30:17.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 client.20112 shutdown 2026-02-20T13:30:17.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 msgr2=0x55888af984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888af984b0 secure :-1 s=READY pgs=1379 gs=1 cs=0 l=1 c_cookie=17477113654253763460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184c02bde0 tx=0x7f184c009940 comp rx=0 tx=0).stop 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 shutdown_connections 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55888b049a50 0x55888b049ef0 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=9714957974059095906 s_cookie=417719852335637765 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55888aff9b20 0x55888aff8a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55888afb4c70 0x55888af98a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 --2- 10.20.193.28:0/3501941180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55888afb4360 0x55888af984b0 unknown :-1 s=CLOSED pgs=1379 gs=1 cs=0 l=1 c_cookie=17477113654253763460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f1803fff640 0 client.20112 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 >> 10.20.193.28:0/3501941180 conn(0x55888af92860 msgr2=0x55888b0131a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 shutdown_connections 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.002+0000 7f185ed8be00 1 -- 10.20.193.28:0/3501941180 wait complete. 2026-02-20T13:30:17.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185ed8be00 20 client.20112 trim_cache size 0 max 16384 2026-02-20T13:30:17.013 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:17.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 -- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18300b5760 msgr2=0x7f18300d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18300b5760 0x7f18300d5c10 secure :-1 s=READY pgs=570 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184c004740 tx=0x7f184c005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 -- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f185810ffe0 msgr2=0x7f185811da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f185810ffe0 0x7f185811da50 secure :-1 s=READY pgs=1375 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1840009480 tx=0x7f184000ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 -- 10.20.193.28:0/1232919384 shutdown_connections 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f18300b5760 0x7f18300d5c10 unknown :-1 s=CLOSED pgs=570 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f185810ffe0 0x7f185811da50 unknown :-1 s=CLOSED pgs=1375 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18581157e0 0x7f1858122e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 --2- 10.20.193.28:0/1232919384 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f185810f5f0 0x7f185811d510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 -- 10.20.193.28:0/1232919384 >> 10.20.193.28:0/1232919384 conn(0x7f18580ecea0 msgr2=0x7f185810d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 -- 10.20.193.28:0/1232919384 shutdown_connections 2026-02-20T13:30:17.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.003+0000 7f185cd91640 1 -- 10.20.193.28:0/1232919384 wait complete. 2026-02-20T13:30:17.142 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:30:17.327 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 -- 10.20.193.28:0/2160713433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbee4060010 msgr2=0x7fbee40603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 --2- 10.20.193.28:0/2160713433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbee4060010 0x7fbee40603e0 secure :-1 s=READY pgs=1380 gs=1 cs=0 l=1 c_cookie=10580559359102095989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed4009950 tx=0x7fbed402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 -- 10.20.193.28:0/2160713433 shutdown_connections 2026-02-20T13:30:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 --2- 10.20.193.28:0/2160713433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbee4113000 0x7fbee41739d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 --2- 10.20.193.28:0/2160713433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee4060a00 0x7fbee4112850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 --2- 10.20.193.28:0/2160713433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbee4060010 0x7fbee40603e0 unknown :-1 s=CLOSED pgs=1380 gs=1 cs=0 l=1 c_cookie=10580559359102095989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 -- 10.20.193.28:0/2160713433 >> 10.20.193.28:0/2160713433 conn(0x7fbee40e95a0 msgr2=0x7fbee41099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 -- 10.20.193.28:0/2160713433 shutdown_connections 2026-02-20T13:30:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.506+0000 7fbeea180640 1 -- 10.20.193.28:0/2160713433 wait complete. 2026-02-20T13:30:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.507+0000 7fbeea180640 1 Processor -- start 2026-02-20T13:30:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.507+0000 7fbeea180640 1 -- start start 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.507+0000 7fbeea180640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbee4060010 0x7fbee40f4200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.507+0000 7fbeea180640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee4060a00 0x7fbee41738d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.507+0000 7fbeea180640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbee4113000 0x7fbee40f4900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.507+0000 7fbeea180640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbee40f9b10 con 0x7fbee4113000 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.507+0000 7fbeea180640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbee40f9c80 con 0x7fbee4060010 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.507+0000 7fbeea180640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbee40f9e40 con 0x7fbee4060a00 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee897d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee4060a00 0x7fbee41738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbee4060010 0x7fbee40f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee997f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbee4113000 0x7fbee40f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbee4060010 0x7fbee40f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55928/0 (socket says 10.20.193.28:55928) 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee897d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee4060a00 0x7fbee41738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45396/0 (socket says 10.20.193.28:45396) 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 -- 10.20.193.28:0/910241201 learned_addr learned my addr 10.20.193.28:0/910241201 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 -- 10.20.193.28:0/910241201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee4060a00 msgr2=0x7fbee41738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee4060a00 0x7fbee41738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 -- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbee4113000 msgr2=0x7fbee40f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbee4113000 0x7fbee40f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 -- 10.20.193.28:0/910241201 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed4009570 con 0x7fbee4060010 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbee917e640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbee4060010 0x7fbee40f4200 secure :-1 s=READY pgs=469 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed4038820 tx=0x7fbed4004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbed27fc640 1 -- 10.20.193.28:0/910241201 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed403d070 con 0x7fbee4060010 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbed27fc640 1 -- 10.20.193.28:0/910241201 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbed4002ad0 con 0x7fbee4060010 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbed27fc640 1 -- 10.20.193.28:0/910241201 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed4041930 con 0x7fbee4060010 2026-02-20T13:30:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbeea180640 1 -- 10.20.193.28:0/910241201 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee40fa0c0 con 0x7fbee4060010 2026-02-20T13:30:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.508+0000 7fbeea180640 1 -- 10.20.193.28:0/910241201 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee40fa4e0 con 0x7fbee4060010 2026-02-20T13:30:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.511+0000 7fbed27fc640 1 -- 10.20.193.28:0/910241201 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbed402f9f0 con 0x7fbee4060010 2026-02-20T13:30:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.512+0000 7fbed27fc640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbec00b56d0 0x7fbec00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.512+0000 7fbed27fc640 1 -- 10.20.193.28:0/910241201 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbed410b090 con 0x7fbee4060010 2026-02-20T13:30:17.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.513+0000 7fbee897d640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbec00b56d0 0x7fbec00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.513+0000 7fbee897d640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbec00b56d0 0x7fbec00d5b80 secure :-1 s=READY pgs=571 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee40faba0 tx=0x7fbed8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:17.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbeed403e00 1 Processor -- start 2026-02-20T13:30:17.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbeed403e00 1 -- start start 2026-02-20T13:30:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8360 0x55bac90f8730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac913db20 0x55bac915df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbeed403e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bac900e780 con 0x55bac913db20 2026-02-20T13:30:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbeed403e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bac900a4b0 con 0x55bac90f8360 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbeed403e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bac9004450 con 0x55bac90f8c70 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee917e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8360 0x55bac90f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee917e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8360 0x55bac90f8730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55938/0 (socket says 10.20.193.28:55938) 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee997f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac913db20 0x55bac915df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee917e640 1 -- 10.20.193.28:0/2656508198 learned_addr learned my addr 10.20.193.28:0/2656508198 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee897d640 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee997f640 1 -- 10.20.193.28:0/2656508198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 msgr2=0x55bac913d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee997f640 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee997f640 1 -- 10.20.193.28:0/2656508198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8360 msgr2=0x55bac90f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee997f640 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8360 0x55bac90f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.514+0000 7fbee997f640 1 -- 10.20.193.28:0/2656508198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac8fafd10 con 0x55bac913db20 2026-02-20T13:30:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbee997f640 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac913db20 0x55bac915df00 secure :-1 s=READY pgs=1381 gs=2 cs=0 l=1 c_cookie=70741211861693207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee0005540 tx=0x7fbee0003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb52c1e3ff3317 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbee917e640 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8360 0x55bac90f8730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeb1ce5640 1 -- 10.20.193.28:0/2656508198 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbee0003d70 con 0x55bac913db20 2026-02-20T13:30:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeb1ce5640 1 -- 10.20.193.28:0/2656508198 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbee000ace0 con 0x55bac913db20 2026-02-20T13:30:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeb1ce5640 1 -- 10.20.193.28:0/2656508198 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbee000f7d0 con 0x55bac913db20 2026-02-20T13:30:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 -- 10.20.193.28:0/2656508198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac913db20 msgr2=0x55bac915df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac913db20 0x55bac915df00 secure :-1 s=READY pgs=1381 gs=2 cs=0 l=1 c_cookie=70741211861693207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee0005540 tx=0x7fbee0003c30 comp rx=0 tx=0).stop 2026-02-20T13:30:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 -- 10.20.193.28:0/2656508198 shutdown_connections 2026-02-20T13:30:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac913db20 0x55bac915df00 unknown :-1 s=CLOSED pgs=1381 gs=2 cs=0 l=1 c_cookie=70741211861693207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 --2- 10.20.193.28:0/2656508198 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8360 0x55bac90f8730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 -- 10.20.193.28:0/2656508198 >> 10.20.193.28:0/2656508198 conn(0x55bac90d6860 msgr2=0x55bac90f6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 -- 10.20.193.28:0/2656508198 shutdown_connections 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.515+0000 7fbeed403e00 1 -- 10.20.193.28:0/2656508198 wait complete. 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.516+0000 7fbeed403e00 1 -- start start 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbeed403e00 1 Processor -- start 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac91556b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac9155bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac915abe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbeed403e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bac915b120 con 0x55bac90f8360 2026-02-20T13:30:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbeed403e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bac915b290 con 0x55bac913db20 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbeed403e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bac915b450 con 0x55bac90f8c70 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee917e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac91556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee997f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac915abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee917e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac91556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57832/0 (socket says 10.20.193.28:57832) 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee917e640 1 -- 10.20.193.28:0/1185150225 learned_addr learned my addr 10.20.193.28:0/1185150225 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee997f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac915abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55946/0 (socket says 10.20.193.28:55946) 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee897d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac9155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee917e640 1 -- 10.20.193.28:0/1185150225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 msgr2=0x55bac9155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee917e640 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac9155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee917e640 1 -- 10.20.193.28:0/1185150225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 msgr2=0x55bac915abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee917e640 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac915abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee917e640 1 -- 10.20.193.28:0/1185150225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee00051e0 con 0x55bac90f8360 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.517+0000 7fbee997f640 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac915abe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbee917e640 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac91556b0 secure :-1 s=READY pgs=1382 gs=1 cs=0 l=1 c_cookie=18236050044715001399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed4108b70 tx=0x7fbed402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1376e59d7be637 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbe9effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbe9effd640 1 -- 10.20.193.28:0/1185150225 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed40d9730 con 0x55bac90f8360 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbe9effd640 1 -- 10.20.193.28:0/1185150225 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbed40dc570 con 0x55bac90f8360 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee40fa4e0 con 0x55bac90f8360 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbe9effd640 1 -- 10.20.193.28:0/1185150225 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed40cf720 con 0x55bac90f8360 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 10 client.20124 _ll_register_callbacks cb 0x55bac8f85a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bac8c9a6f0 con 0x55bac90f8360 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbe9effd640 1 -- 10.20.193.28:0/1185150225 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbed40d2e20 con 0x55bac90f8360 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbe9effd640 1 -- 10.20.193.28:0/1185150225 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbed40d2fe0 con 0x55bac90f8360 2026-02-20T13:30:17.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 10 client.20124 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55bac8f883c0 con 0x55bac90f8360 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbe9effd640 1 -- 10.20.193.28:0/1185150225 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbed40d07d0 con 0x55bac90f8360 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 10 client.20124 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 10 client.20124 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 20 client.20124 populate_metadata read hostname 'trial028' 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bac913ae30 0x55bac913b2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 4 client.20124 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.518+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bac8fa6f80 con 0x55bac913ae30 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.519+0000 7fbee897d640 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bac913ae30 0x55bac913b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.519+0000 7fbee897d640 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bac913ae30 0x55bac913b2d0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=5858567581199666689 s_cookie=5592110178891047585 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=514dd02cd2068e01 server_cookie=4d9b2a9455a5a2a1 in_seq=0 out_seq=0 2026-02-20T13:30:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.519+0000 7fbe9effd640 10 client.20124 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:30:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbe9effd640 1 -- 10.20.193.28:0/1185150225 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bac8fa6f80 con 0x55bac913ae30 2026-02-20T13:30:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbe9effd640 10 client.20124 handle_command_reply: tid=0 2026-02-20T13:30:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 client.20124 shutdown 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 msgr2=0x55bac91556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac91556b0 secure :-1 s=READY pgs=1382 gs=1 cs=0 l=1 c_cookie=18236050044715001399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed4108b70 tx=0x7fbed402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 shutdown_connections 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bac913ae30 0x55bac913b2d0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=5858567581199666689 s_cookie=5592110178891047585 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac915abe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac9155bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1185150225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac91556b0 unknown :-1 s=CLOSED pgs=1382 gs=1 cs=0 l=1 c_cookie=18236050044715001399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 >> 10.20.193.28:0/1185150225 conn(0x55bac90d6860 msgr2=0x55bac90f6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbe9effd640 0 client.20124 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 shutdown_connections 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 1 -- 10.20.193.28:0/1185150225 wait complete. 2026-02-20T13:30:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.520+0000 7fbeed403e00 20 client.20124 trim_cache size 0 max 16384 2026-02-20T13:30:17.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.527+0000 7fbeed403e00 1 Processor -- start 2026-02-20T13:30:17.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbeed403e00 1 -- start start 2026-02-20T13:30:17.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913b290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8c70 0x55bac9138780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac913db20 0x55bac9138cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbeed403e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bac91479e0 con 0x55bac90f8360 2026-02-20T13:30:17.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbeed403e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bac9002080 con 0x55bac90f8c70 2026-02-20T13:30:17.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbeed403e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bac8cc2700 con 0x55bac913db20 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee897d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8c70 0x55bac9138780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee997f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac913db20 0x55bac9138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee897d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8c70 0x55bac9138780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55962/0 (socket says 10.20.193.28:55962) 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee917e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913b290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee897d640 1 -- 10.20.193.28:0/213525340 learned_addr learned my addr 10.20.193.28:0/213525340 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee997f640 1 -- 10.20.193.28:0/213525340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8c70 msgr2=0x55bac9138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee997f640 1 --2- 10.20.193.28:0/213525340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8c70 0x55bac9138780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee997f640 1 -- 10.20.193.28:0/213525340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 msgr2=0x55bac913b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee997f640 1 --2- 10.20.193.28:0/213525340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913b290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.528+0000 7fbee997f640 1 -- 10.20.193.28:0/213525340 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac8f9a0e0 con 0x55bac913db20 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbee917e640 1 --2- 10.20.193.28:0/213525340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913b290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:17.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbee997f640 1 --2- 10.20.193.28:0/213525340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac913db20 0x55bac9138cc0 secure :-1 s=READY pgs=387 gs=3 cs=0 l=1 c_cookie=2362419322045311803 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee0006a50 tx=0x7fbee0011eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20c8ffdb5507ab3b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:17.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeb14e4640 1 -- 10.20.193.28:0/213525340 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbee000ae50 con 0x55bac913db20 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeb14e4640 1 -- 10.20.193.28:0/213525340 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbee0020050 con 0x55bac913db20 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeb14e4640 1 -- 10.20.193.28:0/213525340 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbee000f6d0 con 0x55bac913db20 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeed403e00 1 -- 10.20.193.28:0/213525340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac913db20 msgr2=0x55bac9138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeed403e00 1 --2- 10.20.193.28:0/213525340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac913db20 0x55bac9138cc0 secure :-1 s=READY pgs=387 gs=3 cs=0 l=1 c_cookie=2362419322045311803 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee0006a50 tx=0x7fbee0011eb0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeed403e00 1 -- 10.20.193.28:0/213525340 shutdown_connections 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeed403e00 1 --2- 10.20.193.28:0/213525340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac913db20 0x55bac9138cc0 unknown :-1 s=CLOSED pgs=387 gs=3 cs=0 l=1 c_cookie=2362419322045311803 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeed403e00 1 --2- 10.20.193.28:0/213525340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac90f8c70 0x55bac9138780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeed403e00 1 --2- 10.20.193.28:0/213525340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913b290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.529+0000 7fbeed403e00 1 -- 10.20.193.28:0/213525340 >> 10.20.193.28:0/213525340 conn(0x55bac90d6860 msgr2=0x55bac915a230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.530+0000 7fbeed403e00 1 -- 10.20.193.28:0/213525340 shutdown_connections 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.530+0000 7fbeed403e00 1 -- 10.20.193.28:0/213525340 wait complete. 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.530+0000 7fbeed403e00 1 -- start start 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.530+0000 7fbeed403e00 1 Processor -- start 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913ce70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbeed403e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac90d6c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbeed403e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bac91a4b10 con 0x55bac90f8360 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbeed403e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bac90d7170 con 0x55bac913db20 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbeed403e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bac90d7330 con 0x55bac90f8c70 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee997f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac90d6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee997f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac90d6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55964/0 (socket says 10.20.193.28:55964) 2026-02-20T13:30:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee997f640 1 -- 10.20.193.28:0/1083695049 learned_addr learned my addr 10.20.193.28:0/1083695049 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee897d640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee917e640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee997f640 1 -- 10.20.193.28:0/1083695049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 msgr2=0x55bac913d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee997f640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee997f640 1 -- 10.20.193.28:0/1083695049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 msgr2=0x55bac913ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee997f640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee997f640 1 -- 10.20.193.28:0/1083695049 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac8fafd10 con 0x55bac913db20 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee897d640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.531+0000 7fbee917e640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913ce70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbee997f640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac90d6c30 secure :-1 s=READY pgs=470 gs=2 cs=0 l=1 c_cookie=6719077395140816621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee0005f20 tx=0x7fbee0005f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d3ef54aabb9aeed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbe9effd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbe9effd640 1 -- 10.20.193.28:0/1083695049 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbee0006260 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbe9effd640 1 -- 10.20.193.28:0/1083695049 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbee000ae50 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbe9effd640 1 -- 10.20.193.28:0/1083695049 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbee0011700 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac8f883c0 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbe9effd640 1 -- 10.20.193.28:0/1083695049 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbee0011890 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbeed403e00 10 client.30044 _ll_register_callbacks cb 0x55bac8f85a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee000ace0 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbe9effd640 1 -- 10.20.193.28:0/1083695049 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbee000f6d0 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbeed403e00 10 client.30044 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.532+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55bac8f94b60 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbe9effd640 1 -- 10.20.193.28:0/1083695049 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbee002c040 con 0x55bac913db20 2026-02-20T13:30:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbeed403e00 10 client.30044 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbeed403e00 10 client.30044 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:30:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbeed403e00 20 client.30044 populate_metadata read hostname 'trial028' 2026-02-20T13:30:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bac90dc930 0x55bac920b030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbeed403e00 4 client.30044 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bac8c97f40 con 0x55bac90dc930 2026-02-20T13:30:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbee917e640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bac90dc930 0x55bac920b030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbee917e640 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bac90dc930 0x55bac920b030 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=966095210652611334 s_cookie=2692435857175178487 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d684279ba27b306 server_cookie=255d74259f736cf7 in_seq=0 out_seq=0 2026-02-20T13:30:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.533+0000 7fbe9effd640 10 client.30044 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:30:17.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbe9effd640 1 -- 10.20.193.28:0/1083695049 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bac8c97f40 con 0x55bac90dc930 2026-02-20T13:30:17.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbe9effd640 10 client.30044 handle_command_reply: tid=0 2026-02-20T13:30:17.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 client.30044 shutdown 2026-02-20T13:30:17.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 msgr2=0x55bac90d6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac90d6c30 secure :-1 s=READY pgs=470 gs=2 cs=0 l=1 c_cookie=6719077395140816621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee0005f20 tx=0x7fbee0005f50 comp rx=0 tx=0).stop 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 shutdown_connections 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55bac90dc930 0x55bac920b030 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=966095210652611334 s_cookie=2692435857175178487 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bac913db20 0x55bac90d6c30 unknown :-1 s=CLOSED pgs=470 gs=2 cs=0 l=1 c_cookie=6719077395140816621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bac90f8c70 0x55bac913d3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 --2- 10.20.193.28:0/1083695049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bac90f8360 0x55bac913ce70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbe9effd640 0 client.30044 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 >> 10.20.193.28:0/1083695049 conn(0x55bac90d6860 msgr2=0x55bac9158910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 shutdown_connections 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 1 -- 10.20.193.28:0/1083695049 wait complete. 2026-02-20T13:30:17.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeed403e00 20 client.30044 trim_cache size 0 max 16384 2026-02-20T13:30:17.543 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 -- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbec00b56d0 msgr2=0x7fbec00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbec00b56d0 0x7fbec00d5b80 secure :-1 s=READY pgs=571 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee40faba0 tx=0x7fbed8005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 -- 10.20.193.28:0/910241201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbee4060010 msgr2=0x7fbee40f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbee4060010 0x7fbee40f4200 secure :-1 s=READY pgs=469 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed4038820 tx=0x7fbed4004300 comp rx=0 tx=0).stop 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 -- 10.20.193.28:0/910241201 shutdown_connections 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbec00b56d0 0x7fbec00d5b80 unknown :-1 s=CLOSED pgs=571 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbee4113000 0x7fbee40f4900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee4060a00 0x7fbee41738d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 --2- 10.20.193.28:0/910241201 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbee4060010 0x7fbee40f4200 unknown :-1 s=CLOSED pgs=469 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 -- 10.20.193.28:0/910241201 >> 10.20.193.28:0/910241201 conn(0x7fbee40e95a0 msgr2=0x7fbee410ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:17.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 -- 10.20.193.28:0/910241201 shutdown_connections 2026-02-20T13:30:17.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:17.534+0000 7fbeea180640 1 -- 10.20.193.28:0/910241201 wait complete. 2026-02-20T13:30:17.670 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:30:17.855 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:18.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 -- 10.20.193.28:0/2469543784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb018155980 msgr2=0x7fb018175d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2469543784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb018155980 0x7fb018175d60 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=8649061304827940046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb01400aa30 tx=0x7fb014030270 comp rx=0 tx=0).stop 2026-02-20T13:30:18.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 -- 10.20.193.28:0/2469543784 shutdown_connections 2026-02-20T13:30:18.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2469543784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb018061840 0x7fb018155440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2469543784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb018155980 0x7fb018175d60 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=8649061304827940046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2469543784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb018060f30 0x7fb018061300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 -- 10.20.193.28:0/2469543784 >> 10.20.193.28:0/2469543784 conn(0x7fb0180eaad0 msgr2=0x7fb01810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 -- 10.20.193.28:0/2469543784 shutdown_connections 2026-02-20T13:30:18.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.036+0000 7fb01de7e640 1 -- 10.20.193.28:0/2469543784 wait complete. 2026-02-20T13:30:18.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01de7e640 1 Processor -- start 2026-02-20T13:30:18.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01de7e640 1 -- start start 2026-02-20T13:30:18.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01de7e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb018060f30 0x7fb0181732e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01de7e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb018061840 0x7fb018173820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01de7e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb018155980 0x7fb018173d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01de7e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb018151600 con 0x7fb018061840 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01de7e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb018151770 con 0x7fb018155980 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01de7e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb018151930 con 0x7fb018060f30 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb00ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb018061840 0x7fb018173820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb00ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb018061840 0x7fb018173820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57880/0 (socket says 10.20.193.28:57880) 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb00ffff640 1 -- 10.20.193.28:0/2684315291 learned_addr learned my addr 10.20.193.28:0/2684315291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb018060f30 0x7fb0181732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb01d67d640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb018155980 0x7fb018173d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb00ffff640 1 -- 10.20.193.28:0/2684315291 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb018060f30 msgr2=0x7fb0181732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb00ffff640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb018060f30 0x7fb0181732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb00ffff640 1 -- 10.20.193.28:0/2684315291 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb018155980 msgr2=0x7fb018173d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb00ffff640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb018155980 0x7fb018173d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.037+0000 7fb00ffff640 1 -- 10.20.193.28:0/2684315291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01400a650 con 0x7fb018061840 2026-02-20T13:30:18.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.038+0000 7fb00ffff640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb018061840 0x7fb018173820 secure :-1 s=READY pgs=1383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000009480 tx=0x7fb00000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.038+0000 7fb00dffb640 1 -- 10.20.193.28:0/2684315291 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb00000cc00 con 0x7fb018061840 2026-02-20T13:30:18.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.038+0000 7fb00dffb640 1 -- 10.20.193.28:0/2684315291 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb000004500 con 0x7fb018061840 2026-02-20T13:30:18.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.038+0000 7fb01de7e640 1 -- 10.20.193.28:0/2684315291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb018151bb0 con 0x7fb018061840 2026-02-20T13:30:18.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.038+0000 7fb00dffb640 1 -- 10.20.193.28:0/2684315291 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb000010430 con 0x7fb018061840 2026-02-20T13:30:18.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.038+0000 7fb01de7e640 1 -- 10.20.193.28:0/2684315291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0181520d0 con 0x7fb018061840 2026-02-20T13:30:18.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.040+0000 7fb00dffb640 1 -- 10.20.193.28:0/2684315291 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb00001f060 con 0x7fb018061840 2026-02-20T13:30:18.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.042+0000 7fb00dffb640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faff40b5760 0x7faff40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.042+0000 7fb00dffb640 1 -- 10.20.193.28:0/2684315291 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb000014070 con 0x7fb018061840 2026-02-20T13:30:18.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.042+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faff40b5760 0x7faff40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.043+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faff40b5760 0x7faff40d5c10 secure :-1 s=READY pgs=572 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb008004740 tx=0x7fb008005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.043+0000 7fb021101e00 1 Processor -- start 2026-02-20T13:30:18.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.043+0000 7fb021101e00 1 -- start start 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb021101e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fd3730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb021101e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a0185e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb021101e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 0x55c09a038f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb021101e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c099ee9780 con 0x55c099fd3c70 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb021101e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c099ee54b0 con 0x55c099fd3360 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb021101e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c099edf450 con 0x55c09a018b20 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a0185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a0185e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57894/0 (socket says 10.20.193.28:57894) 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 -- 10.20.193.28:0/1536883732 learned_addr learned my addr 10.20.193.28:0/1536883732 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb01d67d640 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 0x55c09a038f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fd3730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 -- 10.20.193.28:0/1536883732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 msgr2=0x55c09a038f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 0x55c09a038f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 -- 10.20.193.28:0/1536883732 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 msgr2=0x55c099fd3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fd3730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 -- 10.20.193.28:0/1536883732 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c099e8ad10 con 0x55c099fd3c70 2026-02-20T13:30:18.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fb00ffff640 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a0185e0 secure :-1 s=READY pgs=1384 gs=1 cs=0 l=1 c_cookie=1644738865586758443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb00000c6a0 tx=0x7fb0000ace70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d34948b793e32b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fafe54e4640 1 -- 10.20.193.28:0/1536883732 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb00000cd60 con 0x55c099fd3c70 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fafe54e4640 1 -- 10.20.193.28:0/1536883732 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb0000ad7c0 con 0x55c099fd3c70 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.044+0000 7fafe54e4640 1 -- 10.20.193.28:0/1536883732 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0000e40d0 con 0x55c099fd3c70 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 -- 10.20.193.28:0/1536883732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 msgr2=0x55c09a0185e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a0185e0 secure :-1 s=READY pgs=1384 gs=1 cs=0 l=1 c_cookie=1644738865586758443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb00000c6a0 tx=0x7fb0000ace70 comp rx=0 tx=0).stop 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 -- 10.20.193.28:0/1536883732 shutdown_connections 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a0185e0 unknown :-1 s=CLOSED pgs=1384 gs=1 cs=0 l=1 c_cookie=1644738865586758443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 0x55c09a038f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 --2- 10.20.193.28:0/1536883732 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fd3730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 -- 10.20.193.28:0/1536883732 >> 10.20.193.28:0/1536883732 conn(0x55c099fb1860 msgr2=0x55c099fd1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 -- 10.20.193.28:0/1536883732 shutdown_connections 2026-02-20T13:30:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.045+0000 7fb021101e00 1 -- 10.20.193.28:0/1536883732 wait complete. 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.046+0000 7fb021101e00 1 -- start start 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.046+0000 7fb021101e00 1 Processor -- start 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.046+0000 7fb021101e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3360 0x55c09a0306c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.046+0000 7fb021101e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a030c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.046+0000 7fb021101e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c09a018b20 0x55c09a035bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb021101e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c09a036130 con 0x55c099fd3c70 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb021101e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c09a0362a0 con 0x55c09a018b20 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb021101e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c09a036460 con 0x55c099fd3360 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c09a018b20 0x55c09a035bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb00ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a030c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c09a018b20 0x55c09a035bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55980/0 (socket says 10.20.193.28:55980) 2026-02-20T13:30:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 -- 10.20.193.28:0/4113914216 learned_addr learned my addr 10.20.193.28:0/4113914216 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3360 0x55c09a0306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 -- 10.20.193.28:0/4113914216 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3360 msgr2=0x55c09a0306c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3360 0x55c09a0306c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 -- 10.20.193.28:0/4113914216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 msgr2=0x55c09a030c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a030c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 -- 10.20.193.28:0/4113914216 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c099e633c0 con 0x55c09a018b20 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb00ffff640 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a030c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb01d67d640 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c09a018b20 0x55c09a035bf0 secure :-1 s=READY pgs=472 gs=2 cs=0 l=1 c_cookie=12128827167795536208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb01400a230 tx=0x7fb0140396a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a852400c3e8f6150 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fafd67fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fafd67fc640 1 -- 10.20.193.28:0/4113914216 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb01403e070 con 0x55c09a018b20 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fafd67fc640 1 -- 10.20.193.28:0/4113914216 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb01403f040 con 0x55c09a018b20 2026-02-20T13:30:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.047+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0181520d0 con 0x55c09a018b20 2026-02-20T13:30:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fafd67fc640 1 -- 10.20.193.28:0/4113914216 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb014045440 con 0x55c09a018b20 2026-02-20T13:30:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fafd67fc640 1 -- 10.20.193.28:0/4113914216 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb0140455d0 con 0x55c09a018b20 2026-02-20T13:30:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 10 client.30056 _ll_register_callbacks cb 0x55c099e60a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c099b756f0 con 0x55c09a018b20 2026-02-20T13:30:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fafd67fc640 1 -- 10.20.193.28:0/4113914216 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb014003bb0 con 0x55c09a018b20 2026-02-20T13:30:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 10 client.30056 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c099e750e0 con 0x55c09a018b20 2026-02-20T13:30:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fafd67fc640 1 -- 10.20.193.28:0/4113914216 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb01404c030 con 0x55c09a018b20 2026-02-20T13:30:18.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 10 client.30056 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:18.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 10 client.30056 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 20 client.30056 populate_metadata read hostname 'trial028' 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c09a038b80 0x55c09a0168a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 4 client.30056 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.048+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c099e81f80 con 0x55c09a038b80 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.049+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c09a038b80 0x55c09a0168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.049+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c09a038b80 0x55c09a0168a0 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=8310678423615247773 s_cookie=16969368980887515390 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=735575fe9217159d server_cookie=eb7f4f2e385530fe in_seq=0 out_seq=0 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.049+0000 7fafd67fc640 10 client.30056 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fafd67fc640 1 -- 10.20.193.28:0/4113914216 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c099e81f80 con 0x55c09a038b80 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fafd67fc640 10 client.30056 handle_command_reply: tid=0 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 client.30056 shutdown 2026-02-20T13:30:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c09a018b20 msgr2=0x55c09a035bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c09a018b20 0x55c09a035bf0 secure :-1 s=READY pgs=472 gs=2 cs=0 l=1 c_cookie=12128827167795536208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb01400a230 tx=0x7fb0140396a0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 shutdown_connections 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c09a038b80 0x55c09a0168a0 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=8310678423615247773 s_cookie=16969368980887515390 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3c70 0x55c09a030c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c09a018b20 0x55c09a035bf0 unknown :-1 s=CLOSED pgs=472 gs=2 cs=0 l=1 c_cookie=12128827167795536208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 --2- 10.20.193.28:0/4113914216 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3360 0x55c09a0306c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 >> 10.20.193.28:0/4113914216 conn(0x55c099fb1860 msgr2=0x55c099fd1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fafd67fc640 0 client.30056 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 shutdown_connections 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 1 -- 10.20.193.28:0/4113914216 wait complete. 2026-02-20T13:30:18.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.050+0000 7fb021101e00 20 client.30056 trim_cache size 0 max 16384 2026-02-20T13:30:18.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.057+0000 7fb021101e00 1 Processor -- start 2026-02-20T13:30:18.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.057+0000 7fb021101e00 1 -- start start 2026-02-20T13:30:18.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.057+0000 7fb021101e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3360 0x55c09a02dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.057+0000 7fb021101e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3c70 0x55c09a0178b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.057+0000 7fb021101e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 0x55c09a017df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.057+0000 7fb021101e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c099edd080 con 0x55c099fd3360 2026-02-20T13:30:18.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.057+0000 7fb021101e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c099b9d700 con 0x55c099fd3c70 2026-02-20T13:30:18.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.057+0000 7fb021101e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c09a025030 con 0x55c09a018b20 2026-02-20T13:30:18.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3360 0x55c09a02dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3360 0x55c09a02dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57908/0 (socket says 10.20.193.28:57908) 2026-02-20T13:30:18.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 -- 10.20.193.28:0/803524535 learned_addr learned my addr 10.20.193.28:0/803524535 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb00ffff640 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3c70 0x55c09a0178b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01d67d640 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 0x55c09a017df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 -- 10.20.193.28:0/803524535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 msgr2=0x55c09a017df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 0x55c09a017df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 -- 10.20.193.28:0/803524535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3c70 msgr2=0x55c09a0178b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3c70 0x55c09a0178b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 -- 10.20.193.28:0/803524535 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09a0229e0 con 0x55c099fd3360 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3360 0x55c09a02dfc0 secure :-1 s=READY pgs=1385 gs=1 cs=0 l=1 c_cookie=7143246850619838994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0080046d0 tx=0x7fb008014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6321e92a021f9212 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fafe4ce3640 1 -- 10.20.193.28:0/803524535 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb008021040 con 0x55c099fd3360 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fafe4ce3640 1 -- 10.20.193.28:0/803524535 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb008022040 con 0x55c099fd3360 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.058+0000 7fafe4ce3640 1 -- 10.20.193.28:0/803524535 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb00801a6f0 con 0x55c099fd3360 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 -- 10.20.193.28:0/803524535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3360 msgr2=0x55c09a02dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3360 0x55c09a02dfc0 secure :-1 s=READY pgs=1385 gs=1 cs=0 l=1 c_cookie=7143246850619838994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0080046d0 tx=0x7fb008014000 comp rx=0 tx=0).stop 2026-02-20T13:30:18.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 -- 10.20.193.28:0/803524535 shutdown_connections 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c09a018b20 0x55c09a017df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3c70 0x55c09a0178b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 --2- 10.20.193.28:0/803524535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c099fd3360 0x55c09a02dfc0 unknown :-1 s=CLOSED pgs=1385 gs=1 cs=0 l=1 c_cookie=7143246850619838994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 -- 10.20.193.28:0/803524535 >> 10.20.193.28:0/803524535 conn(0x55c099fb1860 msgr2=0x55c09a02c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 -- 10.20.193.28:0/803524535 shutdown_connections 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 -- 10.20.193.28:0/803524535 wait complete. 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 -- start start 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.059+0000 7fb021101e00 1 Processor -- start 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb021101e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fb3190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb021101e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3c70 0x55c099fb36d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb021101e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c09a018b20 0x55c099fb3c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb021101e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c09a0673a0 con 0x55c09a018b20 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb021101e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c09a067510 con 0x55c099fd3360 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb021101e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c09a0676d0 con 0x55c099fd3c70 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fb3190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fb3190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:55994/0 (socket says 10.20.193.28:55994) 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 -- 10.20.193.28:0/3679368177 learned_addr learned my addr 10.20.193.28:0/3679368177 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb00ffff640 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3c70 0x55c099fb36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 -- 10.20.193.28:0/3679368177 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3c70 msgr2=0x55c099fb36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3c70 0x55c099fb36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 -- 10.20.193.28:0/3679368177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c09a018b20 msgr2=0x55c099fb3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01d67d640 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c09a018b20 0x55c099fb3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c09a018b20 0x55c099fb3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 -- 10.20.193.28:0/3679368177 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c099e6fb60 con 0x55c099fd3360 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fb01ce7c640 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fb3190 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=6337292239122549941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb008009bf0 tx=0x7fb008009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57f295b70ebd4cb5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.060+0000 7fafd67fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fafd67fc640 1 -- 10.20.193.28:0/3679368177 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb008021050 con 0x55c099fd3360 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fafd67fc640 1 -- 10.20.193.28:0/3679368177 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb00801a680 con 0x55c099fd3360 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb008009ca0 con 0x55c099fd3360 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 10 client.30062 _ll_register_callbacks cb 0x55c099e60a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fafd67fc640 1 -- 10.20.193.28:0/3679368177 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb00802b840 con 0x55c099fd3360 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0000ad7c0 con 0x55c099fd3360 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fafd67fc640 1 -- 10.20.193.28:0/3679368177 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb00802b9d0 con 0x55c099fd3360 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fafd67fc640 1 -- 10.20.193.28:0/3679368177 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb00802bbf0 con 0x55c099fd3360 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 10 client.30062 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c099e636f0 con 0x55c099fd3360 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fafd67fc640 1 -- 10.20.193.28:0/3679368177 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb00801a880 con 0x55c099fd3360 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 10 client.30062 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 10 client.30062 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 20 client.30062 populate_metadata read hostname 'trial028' 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c09a069330 0x55c09a0697d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 4 client.30062 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.061+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c099b72f40 con 0x55c09a069330 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb00ffff640 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c09a069330 0x55c09a0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb00ffff640 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c09a069330 0x55c09a0697d0 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=3568422837879568188 s_cookie=5179885120932333870 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=318595aa2c33f73c server_cookie=47e2a612c280c92e in_seq=0 out_seq=0 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fafd67fc640 10 client.30062 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fafd67fc640 1 -- 10.20.193.28:0/3679368177 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c099b72f40 con 0x55c09a069330 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fafd67fc640 10 client.30062 handle_command_reply: tid=0 2026-02-20T13:30:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 client.30062 shutdown 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 msgr2=0x55c099fb3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fb3190 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=6337292239122549941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb008009bf0 tx=0x7fb008009900 comp rx=0 tx=0).stop 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 shutdown_connections 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55c09a069330 0x55c09a0697d0 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=3568422837879568188 s_cookie=5179885120932333870 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c09a018b20 0x55c099fb3c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fafd67fc640 0 client.30062 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c099fd3c70 0x55c099fb36d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 --2- 10.20.193.28:0/3679368177 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c099fd3360 0x55c099fb3190 unknown :-1 s=CLOSED pgs=473 gs=1 cs=0 l=1 c_cookie=6337292239122549941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.062+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 >> 10.20.193.28:0/3679368177 conn(0x55c099fb1860 msgr2=0x55c09a02d090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 shutdown_connections 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb021101e00 1 -- 10.20.193.28:0/3679368177 wait complete. 2026-02-20T13:30:18.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb021101e00 20 client.30062 trim_cache size 0 max 16384 2026-02-20T13:30:18.072 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 -- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faff40b5760 msgr2=0x7faff40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faff40b5760 0x7faff40d5c10 secure :-1 s=READY pgs=572 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb008004740 tx=0x7fb008005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 -- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb018061840 msgr2=0x7fb018173820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb018061840 0x7fb018173820 secure :-1 s=READY pgs=1383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000009480 tx=0x7fb00000ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 -- 10.20.193.28:0/2684315291 shutdown_connections 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faff40b5760 0x7faff40d5c10 unknown :-1 s=CLOSED pgs=572 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb018061840 0x7fb018173820 unknown :-1 s=CLOSED pgs=1383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb018155980 0x7fb018173d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 --2- 10.20.193.28:0/2684315291 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb018060f30 0x7fb0181732e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 -- 10.20.193.28:0/2684315291 >> 10.20.193.28:0/2684315291 conn(0x7fb0180eaad0 msgr2=0x7fb01810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 -- 10.20.193.28:0/2684315291 shutdown_connections 2026-02-20T13:30:18.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.063+0000 7fb01de7e640 1 -- 10.20.193.28:0/2684315291 wait complete. 2026-02-20T13:30:18.170 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:30:18.355 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 -- 10.20.193.28:0/2385553025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a2010ffe0 msgr2=0x7f3a20115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 --2- 10.20.193.28:0/2385553025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a2010ffe0 0x7f3a20115030 secure :-1 s=READY pgs=474 gs=2 cs=0 l=1 c_cookie=16437006895641903028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a08009950 tx=0x7f3a0802f190 comp rx=0 tx=0).stop 2026-02-20T13:30:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 -- 10.20.193.28:0/2385553025 shutdown_connections 2026-02-20T13:30:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 --2- 10.20.193.28:0/2385553025 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a201157e0 0x7f3a201761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 --2- 10.20.193.28:0/2385553025 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a2010ffe0 0x7f3a20115030 unknown :-1 s=CLOSED pgs=474 gs=2 cs=0 l=1 c_cookie=16437006895641903028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 --2- 10.20.193.28:0/2385553025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a2010f5f0 0x7f3a2010f9c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 -- 10.20.193.28:0/2385553025 >> 10.20.193.28:0/2385553025 conn(0x7f3a200ecea0 msgr2=0x7f3a2010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 -- 10.20.193.28:0/2385553025 shutdown_connections 2026-02-20T13:30:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.530+0000 7f3a257dc640 1 -- 10.20.193.28:0/2385553025 wait complete. 2026-02-20T13:30:18.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a257dc640 1 Processor -- start 2026-02-20T13:30:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a257dc640 1 -- start start 2026-02-20T13:30:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a257dc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a2010f5f0 0x7f3a200f4e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a257dc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a2010ffe0 0x7f3a201760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a257dc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a201157e0 0x7f3a200f5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a257dc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3a200fa750 con 0x7f3a2010ffe0 2026-02-20T13:30:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a257dc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3a200fa8c0 con 0x7f3a201157e0 2026-02-20T13:30:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a257dc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3a200faa80 con 0x7f3a2010f5f0 2026-02-20T13:30:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a1f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a201157e0 0x7f3a200f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a1f7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a201157e0 0x7f3a200f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56020/0 (socket says 10.20.193.28:56020) 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a1f7fe640 1 -- 10.20.193.28:0/1052238309 learned_addr learned my addr 10.20.193.28:0/1052238309 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a1effd640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a2010f5f0 0x7f3a200f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.531+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a2010ffe0 0x7f3a201760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f3a1f7fe640 1 -- 10.20.193.28:0/1052238309 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a2010f5f0 msgr2=0x7f3a200f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a2010f5f0 0x7f3a200f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f3a1f7fe640 1 -- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a2010ffe0 msgr2=0x7f3a201760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a2010ffe0 0x7f3a201760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f3a1f7fe640 1 -- 10.20.193.28:0/1052238309 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a140094b0 con 0x7f3a201157e0 2026-02-20T13:30:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a201157e0 0x7f3a200f5590 secure :-1 s=READY pgs=475 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1000f8d0 tx=0x7f3a1000fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f39fffff640 1 -- 10.20.193.28:0/1052238309 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1000dce0 con 0x7f3a201157e0 2026-02-20T13:30:18.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f39fffff640 1 -- 10.20.193.28:0/1052238309 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a1000de40 con 0x7f3a201157e0 2026-02-20T13:30:18.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f39fffff640 1 -- 10.20.193.28:0/1052238309 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a100116b0 con 0x7f3a201157e0 2026-02-20T13:30:18.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f3a257dc640 1 -- 10.20.193.28:0/1052238309 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a08009570 con 0x7f3a201157e0 2026-02-20T13:30:18.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.532+0000 7f3a257dc640 1 -- 10.20.193.28:0/1052238309 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a200fb050 con 0x7f3a201157e0 2026-02-20T13:30:18.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.535+0000 7f39fffff640 1 -- 10.20.193.28:0/1052238309 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3a10020060 con 0x7f3a201157e0 2026-02-20T13:30:18.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.537+0000 7f39fffff640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39f40b5750 0x7f39f40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.537+0000 7f39fffff640 1 -- 10.20.193.28:0/1052238309 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a10015070 con 0x7f3a201157e0 2026-02-20T13:30:18.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.537+0000 7f3a1effd640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39f40b5750 0x7f39f40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.537+0000 7f3a1effd640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39f40b5750 0x7f39f40d5c00 secure :-1 s=READY pgs=573 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a14004740 tx=0x7f3a14005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a277d6e00 1 Processor -- start 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a277d6e00 1 -- start start 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b45b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4a05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4c0f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55596b371780 con 0x55596b45bc70 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55596b36d4b0 con 0x55596b45b360 2026-02-20T13:30:18.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55596b367450 con 0x55596b4a0b20 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57956/0 (socket says 10.20.193.28:57956) 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1e7fc640 1 -- 10.20.193.28:0/992262693 learned_addr learned my addr 10.20.193.28:0/992262693 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1f7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1effd640 1 --2- 10.20.193.28:0/992262693 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b45b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1e7fc640 1 -- 10.20.193.28:0/992262693 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 msgr2=0x55596b4c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/992262693 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1e7fc640 1 -- 10.20.193.28:0/992262693 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 msgr2=0x55596b45b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/992262693 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b45b730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.538+0000 7f3a1e7fc640 1 -- 10.20.193.28:0/992262693 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55596b312d10 con 0x55596b45bc70 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/992262693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4a05e0 secure :-1 s=READY pgs=1386 gs=3 cs=0 l=1 c_cookie=13616072582873004063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a08009950 tx=0x7f3a08002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf601df8214b81f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f39eb7fe640 1 -- 10.20.193.28:0/992262693 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a0803d070 con 0x55596b45bc70 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f39eb7fe640 1 -- 10.20.193.28:0/992262693 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a0803e040 con 0x55596b45bc70 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f39eb7fe640 1 -- 10.20.193.28:0/992262693 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a0802fc70 con 0x55596b45bc70 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 -- 10.20.193.28:0/992262693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 msgr2=0x55596b4a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/992262693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4a05e0 secure :-1 s=READY pgs=1386 gs=3 cs=0 l=1 c_cookie=13616072582873004063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a08009950 tx=0x7f3a08002390 comp rx=0 tx=0).stop 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 -- 10.20.193.28:0/992262693 shutdown_connections 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/992262693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4a05e0 unknown :-1 s=CLOSED pgs=1386 gs=3 cs=0 l=1 c_cookie=13616072582873004063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/992262693 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4c0f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/992262693 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b45b730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 -- 10.20.193.28:0/992262693 >> 10.20.193.28:0/992262693 conn(0x55596b439860 msgr2=0x55596b459c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 -- 10.20.193.28:0/992262693 shutdown_connections 2026-02-20T13:30:18.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.539+0000 7f3a277d6e00 1 -- 10.20.193.28:0/992262693 wait complete. 2026-02-20T13:30:18.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a277d6e00 1 -- start start 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a277d6e00 1 Processor -- start 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4b8780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b8cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4baa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55596b4bafc0 con 0x55596b45bc70 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55596b4bb130 con 0x55596b45b360 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55596b4bb2f0 con 0x55596b4a0b20 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a1effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a1effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4b8780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56028/0 (socket says 10.20.193.28:56028) 2026-02-20T13:30:18.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a1effd640 1 -- 10.20.193.28:0/226970363 learned_addr learned my addr 10.20.193.28:0/226970363 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.541+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4baa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a1f7fe640 1 -- 10.20.193.28:0/226970363 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 msgr2=0x55596b4b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a1f7fe640 1 -- 10.20.193.28:0/226970363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 msgr2=0x55596b4b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a1f7fe640 1 -- 10.20.193.28:0/226970363 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55596b2eb3c0 con 0x55596b4a0b20 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b8cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4baa50 secure :-1 s=READY pgs=388 gs=2 cs=0 l=1 c_cookie=7823337940186879404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a100ae010 tx=0x7f3a100ad830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c92146822acd5ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f39e8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f39e8ff9640 1 -- 10.20.193.28:0/226970363 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a100b6330 con 0x55596b4a0b20 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a20176a20 con 0x55596b4a0b20 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a277d6e00 10 client.29956 _ll_register_callbacks cb 0x55596b2e8a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55596affd6f0 con 0x55596b4a0b20 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f39e8ff9640 1 -- 10.20.193.28:0/226970363 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a10073e90 con 0x55596b4a0b20 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f39e8ff9640 1 -- 10.20.193.28:0/226970363 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a100b8ce0 con 0x55596b4a0b20 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.542+0000 7f39e8ff9640 1 -- 10.20.193.28:0/226970363 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a100b8e40 con 0x55596b4a0b20 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f39e8ff9640 1 -- 10.20.193.28:0/226970363 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a10073130 con 0x55596b4a0b20 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a277d6e00 10 client.29956 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55596b2fd0e0 con 0x55596b4a0b20 2026-02-20T13:30:18.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f39e8ff9640 1 -- 10.20.193.28:0/226970363 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3a100adbd0 con 0x55596b4a0b20 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a277d6e00 10 client.29956 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a277d6e00 10 client.29956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a277d6e00 20 client.29956 populate_metadata read hostname 'trial028' 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55596b4c0a90 0x55596b49e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a277d6e00 4 client.29956 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55596b309f80 con 0x55596b4c0a90 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.543+0000 7f3a1effd640 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55596b4c0a90 0x55596b49e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a1effd640 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55596b4c0a90 0x55596b49e8a0 crc :-1 s=READY pgs=370 gs=4 cs=0 l=0 c_cookie=816726435115184334 s_cookie=13348815075583058066 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b55985d93b630ce server_cookie=b94084961081e092 in_seq=0 out_seq=0 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f39e8ff9640 10 client.29956 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:18.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f39e8ff9640 1 -- 10.20.193.28:0/226970363 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55596b309f80 con 0x55596b4c0a90 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f39e8ff9640 10 client.29956 handle_command_reply: tid=0 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 client.29956 shutdown 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 msgr2=0x55596b4baa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4baa50 secure :-1 s=READY pgs=388 gs=2 cs=0 l=1 c_cookie=7823337940186879404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a100ae010 tx=0x7f3a100ad830 comp rx=0 tx=0).stop 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 shutdown_connections 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55596b4c0a90 0x55596b49e8a0 crc :-1 s=READY pgs=370 gs=4 cs=0 l=0 c_cookie=816726435115184334 s_cookie=13348815075583058066 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b8cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4baa50 unknown :-1 s=CLOSED pgs=388 gs=2 cs=0 l=1 c_cookie=7823337940186879404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/226970363 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4b8780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 >> 10.20.193.28:0/226970363 conn(0x55596b439860 msgr2=0x55596b459c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f39e8ff9640 0 client.29956 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:18.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.544+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 shutdown_connections 2026-02-20T13:30:18.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.545+0000 7f3a277d6e00 1 -- 10.20.193.28:0/226970363 wait complete. 2026-02-20T13:30:18.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.545+0000 7f3a277d6e00 20 client.29956 trim_cache size 0 max 16384 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a277d6e00 1 Processor -- start 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a277d6e00 1 -- start start 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4ba9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b5910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4b5e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55596b365080 con 0x55596b45bc70 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55596b025700 con 0x55596b45b360 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55596b4392a0 con 0x55596b4a0b20 2026-02-20T13:30:18.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4ba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4ba9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56044/0 (socket says 10.20.193.28:56044) 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1effd640 1 -- 10.20.193.28:0/2023519856 learned_addr learned my addr 10.20.193.28:0/2023519856 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1effd640 1 -- 10.20.193.28:0/2023519856 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 msgr2=0x55596b4b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1effd640 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1effd640 1 -- 10.20.193.28:0/2023519856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 msgr2=0x55596b4b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1effd640 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1effd640 1 -- 10.20.193.28:0/2023519856 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55596b2f7b60 con 0x55596b45b360 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.552+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b5910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:30:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a1effd640 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4ba9e0 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=6579312810717397070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55596b4c12a0 tx=0x7f3a14013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b4e6a2484fcc04e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f39eaffd640 1 -- 10.20.193.28:0/2023519856 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a14026070 con 0x55596b45b360 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f39eaffd640 1 -- 10.20.193.28:0/2023519856 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a14011920 con 0x55596b45b360 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f39eaffd640 1 -- 10.20.193.28:0/2023519856 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1402aac0 con 0x55596b45b360 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 -- 10.20.193.28:0/2023519856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 msgr2=0x55596b4ba9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4ba9e0 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=6579312810717397070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55596b4c12a0 tx=0x7f3a14013000 comp rx=0 tx=0).stop 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 -- 10.20.193.28:0/2023519856 shutdown_connections 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45bc70 0x55596b4b5910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b4a0b20 0x55596b4b5e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/2023519856 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b45b360 0x55596b4ba9e0 unknown :-1 s=CLOSED pgs=476 gs=1 cs=0 l=1 c_cookie=6579312810717397070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 -- 10.20.193.28:0/2023519856 >> 10.20.193.28:0/2023519856 conn(0x55596b439860 msgr2=0x55596b4be360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 -- 10.20.193.28:0/2023519856 shutdown_connections 2026-02-20T13:30:18.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.553+0000 7f3a277d6e00 1 -- 10.20.193.28:0/2023519856 wait complete. 2026-02-20T13:30:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a277d6e00 1 -- start start 2026-02-20T13:30:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a277d6e00 1 Processor -- start 2026-02-20T13:30:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45b360 0x55596b439c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b45bc70 0x55596b43a170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a277d6e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b4a0b20 0x55596b43ecf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55596b43aaa0 con 0x55596b45b360 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55596b43f230 con 0x55596b4a0b20 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a277d6e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55596b43f3c0 con 0x55596b45bc70 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a1e7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b45bc70 0x55596b43a170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45b360 0x55596b439c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a1e7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b45bc70 0x55596b43a170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45502/0 (socket says 10.20.193.28:45502) 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.554+0000 7f3a1e7fc640 1 -- 10.20.193.28:0/916647837 learned_addr learned my addr 10.20.193.28:0/916647837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a1f7fe640 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b4a0b20 0x55596b43ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a1e7fc640 1 -- 10.20.193.28:0/916647837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b4a0b20 msgr2=0x55596b43ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b4a0b20 0x55596b43ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a1e7fc640 1 -- 10.20.193.28:0/916647837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45b360 msgr2=0x55596b439c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45b360 0x55596b439c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a1e7fc640 1 -- 10.20.193.28:0/916647837 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55596b2eb6f0 con 0x55596b45bc70 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a1e7fc640 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b45bc70 0x55596b43a170 secure :-1 s=READY pgs=389 gs=2 cs=0 l=1 c_cookie=4607120144699030724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a080046e0 tx=0x7f3a0802fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fefc75cae54fcc4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f39e8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f39e8ff9640 1 -- 10.20.193.28:0/916647837 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a0803d050 con 0x55596b45bc70 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f39e8ff9640 1 -- 10.20.193.28:0/916647837 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a08005ec0 con 0x55596b45bc70 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a140214e0 con 0x55596b45bc70 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a277d6e00 10 client.29962 _ll_register_callbacks cb 0x55596b2e8a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a0803e040 con 0x55596b45bc70 2026-02-20T13:30:18.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f39e8ff9640 1 -- 10.20.193.28:0/916647837 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a080538c0 con 0x55596b45bc70 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.555+0000 7f39e8ff9640 1 -- 10.20.193.28:0/916647837 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a080026a0 con 0x55596b45bc70 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f39e8ff9640 1 -- 10.20.193.28:0/916647837 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a08002860 con 0x55596b45bc70 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a277d6e00 10 client.29962 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55596b2fd340 con 0x55596b45bc70 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f39e8ff9640 1 -- 10.20.193.28:0/916647837 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3a08038a90 con 0x55596b45bc70 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a277d6e00 10 client.29962 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a277d6e00 10 client.29962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a277d6e00 20 client.29962 populate_metadata read hostname 'trial028' 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55596b4f11d0 0x55596b4f1670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a277d6e00 4 client.29962 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55596affaf40 con 0x55596b4f11d0 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a1effd640 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55596b4f11d0 0x55596b4f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f3a1effd640 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55596b4f11d0 0x55596b4f1670 crc :-1 s=READY pgs=371 gs=4 cs=0 l=0 c_cookie=16324636065371199166 s_cookie=8563619299156827861 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28cc20283fb16be server_cookie=76d816616dec1ed5 in_seq=0 out_seq=0 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.556+0000 7f39e8ff9640 10 client.29962 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f39e8ff9640 1 -- 10.20.193.28:0/916647837 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55596affaf40 con 0x55596b4f11d0 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f39e8ff9640 10 client.29962 handle_command_reply: tid=0 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 client.29962 shutdown 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b45bc70 msgr2=0x55596b43a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b45bc70 0x55596b43a170 secure :-1 s=READY pgs=389 gs=2 cs=0 l=1 c_cookie=4607120144699030724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a080046e0 tx=0x7f3a0802fc20 comp rx=0 tx=0).stop 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 shutdown_connections 2026-02-20T13:30:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55596b4f11d0 0x55596b4f1670 crc :-1 s=READY pgs=371 gs=4 cs=0 l=0 c_cookie=16324636065371199166 s_cookie=8563619299156827861 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55596b4a0b20 0x55596b43ecf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f39e8ff9640 0 client.29962 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:18.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55596b45bc70 0x55596b43a170 unknown :-1 s=CLOSED pgs=389 gs=2 cs=0 l=1 c_cookie=4607120144699030724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 --2- 10.20.193.28:0/916647837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55596b45b360 0x55596b439c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 >> 10.20.193.28:0/916647837 conn(0x55596b439860 msgr2=0x55596b4b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 shutdown_connections 2026-02-20T13:30:18.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 1 -- 10.20.193.28:0/916647837 wait complete. 2026-02-20T13:30:18.567 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a277d6e00 20 client.29962 trim_cache size 0 max 16384 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a257dc640 1 -- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39f40b5750 msgr2=0x7f39f40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a257dc640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39f40b5750 0x7f39f40d5c00 secure :-1 s=READY pgs=573 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a14004740 tx=0x7f3a14005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a257dc640 1 -- 10.20.193.28:0/1052238309 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a201157e0 msgr2=0x7f3a200f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.557+0000 7f3a257dc640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a201157e0 0x7f3a200f5590 secure :-1 s=READY pgs=475 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1000f8d0 tx=0x7f3a1000fda0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.558+0000 7f3a257dc640 1 -- 10.20.193.28:0/1052238309 shutdown_connections 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.558+0000 7f3a257dc640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39f40b5750 0x7f39f40d5c00 unknown :-1 s=CLOSED pgs=573 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.558+0000 7f3a257dc640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a2010ffe0 0x7f3a201760b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.558+0000 7f3a257dc640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a201157e0 0x7f3a200f5590 unknown :-1 s=CLOSED pgs=475 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.558+0000 7f3a257dc640 1 --2- 10.20.193.28:0/1052238309 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a2010f5f0 0x7f3a200f4e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:18.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.558+0000 7f3a257dc640 1 -- 10.20.193.28:0/1052238309 >> 10.20.193.28:0/1052238309 conn(0x7f3a200ecea0 msgr2=0x7f3a2010db00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:18.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.558+0000 7f3a257dc640 1 -- 10.20.193.28:0/1052238309 shutdown_connections 2026-02-20T13:30:18.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:18.558+0000 7f3a257dc640 1 -- 10.20.193.28:0/1052238309 wait complete. 2026-02-20T13:30:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:18 trial028 ceph-mon[37442]: pgmap v570: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 18 op/s 2026-02-20T13:30:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:18 trial127 ceph-mon[43817]: pgmap v570: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 18 op/s 2026-02-20T13:30:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:18 trial034 ceph-mon[43332]: pgmap v570: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 18 op/s 2026-02-20T13:30:19.656 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:30:19.657 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:30:19.842 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:20.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.034+0000 7f911f8ff640 1 -- 10.20.193.28:0/4221596963 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 msgr2=0x7f9118112a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.034+0000 7f911f8ff640 1 --2- 10.20.193.28:0/4221596963 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 0x7f9118112a90 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=7202456017260706337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f910c009950 tx=0x7f910c02f190 comp rx=0 tx=0).stop 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.035+0000 7f911f8ff640 1 -- 10.20.193.28:0/4221596963 shutdown_connections 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.035+0000 7f911f8ff640 1 --2- 10.20.193.28:0/4221596963 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9118113240 0x7f9118173c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.035+0000 7f911f8ff640 1 --2- 10.20.193.28:0/4221596963 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 0x7f9118112a90 unknown :-1 s=CLOSED pgs=390 gs=1 cs=0 l=1 c_cookie=7202456017260706337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.035+0000 7f911f8ff640 1 --2- 10.20.193.28:0/4221596963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9118060010 0x7f91180603e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.035+0000 7f911f8ff640 1 -- 10.20.193.28:0/4221596963 >> 10.20.193.28:0/4221596963 conn(0x7f91180e97e0 msgr2=0x7f9118109bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.035+0000 7f911f8ff640 1 -- 10.20.193.28:0/4221596963 shutdown_connections 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.035+0000 7f911f8ff640 1 -- 10.20.193.28:0/4221596963 wait complete. 2026-02-20T13:30:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.035+0000 7f911f8ff640 1 Processor -- start 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911f8ff640 1 -- start start 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911f8ff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9118060010 0x7f91180f44f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911f8ff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 0x7f9118173b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911f8ff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9118113240 0x7f91180f4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911f8ff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f91180f9e00 con 0x7f9118060010 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911f8ff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f91180f9f70 con 0x7f9118113240 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911f8ff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f91180fa130 con 0x7f9118060a00 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911ce73640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 0x7f9118173b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911ce73640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 0x7f9118173b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57886/0 (socket says 10.20.193.28:57886) 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911d674640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9118060010 0x7f91180f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911ce73640 1 -- 10.20.193.28:0/495866737 learned_addr learned my addr 10.20.193.28:0/495866737 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911de75640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9118113240 0x7f91180f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911ce73640 1 -- 10.20.193.28:0/495866737 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9118113240 msgr2=0x7f91180f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911ce73640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9118113240 0x7f91180f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911ce73640 1 -- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9118060010 msgr2=0x7f91180f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911ce73640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9118060010 0x7f91180f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911ce73640 1 -- 10.20.193.28:0/495866737 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91080094b0 con 0x7f9118060a00 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.036+0000 7f911de75640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9118113240 0x7f91180f4bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.037+0000 7f911ce73640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 0x7f9118173b10 secure :-1 s=READY pgs=391 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f910c0023d0 tx=0x7f910c004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.037+0000 7f91067fc640 1 -- 10.20.193.28:0/495866737 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f910c03d070 con 0x7f9118060a00 2026-02-20T13:30:20.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.037+0000 7f91067fc640 1 -- 10.20.193.28:0/495866737 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f910c002ad0 con 0x7f9118060a00 2026-02-20T13:30:20.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.037+0000 7f91067fc640 1 -- 10.20.193.28:0/495866737 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f910c0418a0 con 0x7f9118060a00 2026-02-20T13:30:20.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.037+0000 7f911f8ff640 1 -- 10.20.193.28:0/495866737 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c009570 con 0x7f9118060a00 2026-02-20T13:30:20.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.037+0000 7f911f8ff640 1 -- 10.20.193.28:0/495866737 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91180fa690 con 0x7f9118060a00 2026-02-20T13:30:20.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.039+0000 7f91067fc640 1 -- 10.20.193.28:0/495866737 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f910c041a30 con 0x7f9118060a00 2026-02-20T13:30:20.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.041+0000 7f91067fc640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f90f40b56d0 0x7f90f40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.041+0000 7f91067fc640 1 -- 10.20.193.28:0/495866737 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f910c10b150 con 0x7f9118060a00 2026-02-20T13:30:20.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.041+0000 7f911d674640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f90f40b56d0 0x7f90f40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.042+0000 7f911d674640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f90f40b56d0 0x7f90f40d5b80 secure :-1 s=READY pgs=574 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9108004740 tx=0x7f9108005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.042+0000 7f91218f9e00 1 Processor -- start 2026-02-20T13:30:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.042+0000 7f91218f9e00 1 -- start start 2026-02-20T13:30:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785b410 0x559f5785b7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f578a0480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f578c0da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f91218f9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f57771a20 con 0x559f5785bd20 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f91218f9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f5776d750 con 0x559f5785b410 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f91218f9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f577676f0 con 0x559f578a09c0 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785b410 0x559f5785b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785b410 0x559f5785b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:49974/0 (socket says 10.20.193.28:49974) 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 -- 10.20.193.28:0/1663325123 learned_addr learned my addr 10.20.193.28:0/1663325123 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911ce73640 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f578a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911de75640 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f578c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 -- 10.20.193.28:0/1663325123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 msgr2=0x559f578c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f578c0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 -- 10.20.193.28:0/1663325123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 msgr2=0x559f578a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f578a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 -- 10.20.193.28:0/1663325123 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f57713120 con 0x559f5785b410 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911de75640 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f578c0da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.043+0000 7f911d674640 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785b410 0x559f5785b7e0 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=1567648407572850224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9108009460 tx=0x7f9108014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c167ebc2162630 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f90e5ce5640 1 -- 10.20.193.28:0/1663325123 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9108011e60 con 0x559f5785b410 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f90e5ce5640 1 -- 10.20.193.28:0/1663325123 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9108025960 con 0x559f5785b410 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f90e5ce5640 1 -- 10.20.193.28:0/1663325123 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f910801ac60 con 0x559f5785b410 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 -- 10.20.193.28:0/1663325123 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785b410 msgr2=0x559f5785b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785b410 0x559f5785b7e0 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=1567648407572850224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9108009460 tx=0x7f9108014000 comp rx=0 tx=0).stop 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 -- 10.20.193.28:0/1663325123 shutdown_connections 2026-02-20T13:30:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f578a0480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f578c0da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 --2- 10.20.193.28:0/1663325123 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785b410 0x559f5785b7e0 unknown :-1 s=CLOSED pgs=477 gs=1 cs=0 l=1 c_cookie=1567648407572850224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 -- 10.20.193.28:0/1663325123 >> 10.20.193.28:0/1663325123 conn(0x559f57839910 msgr2=0x559f57859cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 -- 10.20.193.28:0/1663325123 shutdown_connections 2026-02-20T13:30:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.044+0000 7f91218f9e00 1 -- 10.20.193.28:0/1663325123 wait complete. 2026-02-20T13:30:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.045+0000 7f91218f9e00 1 -- start start 2026-02-20T13:30:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.045+0000 7f91218f9e00 1 Processor -- start 2026-02-20T13:30:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57873bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f57874110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 0x559f57879100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f91218f9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f57879640 con 0x559f5785bd20 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f91218f9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f578797b0 con 0x559f578a09c0 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f91218f9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f57879970 con 0x559f5785b410 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911ce73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f57874110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911d674640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57873bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911d674640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57873bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57906/0 (socket says 10.20.193.28:57906) 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911d674640 1 -- 10.20.193.28:0/3666738161 learned_addr learned my addr 10.20.193.28:0/3666738161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911de75640 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 0x559f57879100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911d674640 1 -- 10.20.193.28:0/3666738161 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 msgr2=0x559f57879100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911d674640 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 0x559f57879100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911d674640 1 -- 10.20.193.28:0/3666738161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 msgr2=0x559f57874110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911d674640 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f57874110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911d674640 1 -- 10.20.193.28:0/3666738161 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f576eb810 con 0x559f5785b410 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.046+0000 7f911ce73640 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f57874110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f911d674640 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57873bd0 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=12115706934319609259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9108009430 tx=0x7f9108009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a823a343d6db75ab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f90d2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f90d2ffd640 1 -- 10.20.193.28:0/3666738161 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f910801a570 con 0x559f5785b410 2026-02-20T13:30:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f90d2ffd640 1 -- 10.20.193.28:0/3666738161 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9108025ce0 con 0x559f5785b410 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9108009e20 con 0x559f5785b410 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f90d2ffd640 1 -- 10.20.193.28:0/3666738161 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f910802fbc0 con 0x559f5785b410 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f90d2ffd640 1 -- 10.20.193.28:0/3666738161 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f910801b3f0 con 0x559f5785b410 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f90d2ffd640 10 client.29974 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f91218f9e00 10 client.29974 _ll_register_callbacks cb 0x559f5771eb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f573fd9d0 con 0x559f5785b410 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f90d2ffd640 1 -- 10.20.193.28:0/3666738161 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f910802f440 con 0x559f5785b410 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f91218f9e00 10 client.29974 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.047+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559f576fd4f0 con 0x559f5785b410 2026-02-20T13:30:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.048+0000 7f90d2ffd640 1 -- 10.20.193.28:0/3666738161 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f910802f6b0 con 0x559f5785b410 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.048+0000 7f91218f9e00 10 client.29974 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.048+0000 7f91218f9e00 10 client.29974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.048+0000 7f91218f9e00 20 client.29974 populate_metadata read hostname 'trial028' 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.048+0000 7f91218f9e00 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f5789e2d0 0x559f5789e770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.048+0000 7f91218f9e00 4 client.29974 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.048+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f57774df0 con 0x559f5789e2d0 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.048+0000 7f911ce73640 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f5789e2d0 0x559f5789e770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f911ce73640 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f5789e2d0 0x559f5789e770 crc :-1 s=READY pgs=372 gs=4 cs=0 l=0 c_cookie=11331555867005484603 s_cookie=9763457607480224493 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d41c6061d5afe3b server_cookie=877ec4f70971aaed in_seq=0 out_seq=0 2026-02-20T13:30:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f90d2ffd640 10 client.29974 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f90d2ffd640 1 -- 10.20.193.28:0/3666738161 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559f57774df0 con 0x559f5789e2d0 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f90d2ffd640 10 client.29974 handle_command_reply: tid=0 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 client.29974 shutdown 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 msgr2=0x559f57873bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57873bd0 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=12115706934319609259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9108009430 tx=0x7f9108009260 comp rx=0 tx=0).stop 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 shutdown_connections 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f5789e2d0 0x559f5789e770 crc :-1 s=READY pgs=372 gs=4 cs=0 l=0 c_cookie=11331555867005484603 s_cookie=9763457607480224493 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f57874110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 0x559f57879100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 --2- 10.20.193.28:0/3666738161 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57873bd0 unknown :-1 s=CLOSED pgs=392 gs=1 cs=0 l=1 c_cookie=12115706934319609259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f90d2ffd640 0 client.29974 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:20.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 >> 10.20.193.28:0/3666738161 conn(0x559f57839910 msgr2=0x559f5785a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.049+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 shutdown_connections 2026-02-20T13:30:20.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.050+0000 7f91218f9e00 1 -- 10.20.193.28:0/3666738161 wait complete. 2026-02-20T13:30:20.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.050+0000 7f91218f9e00 20 client.29974 trim_cache size 0 max 16384 2026-02-20T13:30:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f91218f9e00 1 Processor -- start 2026-02-20T13:30:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f91218f9e00 1 -- start start 2026-02-20T13:30:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57878670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f5789fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 0x559f578a0380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f91218f9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f57765320 con 0x559f5785bd20 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f91218f9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f57425790 con 0x559f578a09c0 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f91218f9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f57860eb0 con 0x559f5785b410 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911d674640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57878670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911d674640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57878670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57912/0 (socket says 10.20.193.28:57912) 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911d674640 1 -- 10.20.193.28:0/1078865815 learned_addr learned my addr 10.20.193.28:0/1078865815 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911ce73640 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f5789fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911de75640 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 0x559f578a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911d674640 1 -- 10.20.193.28:0/1078865815 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 msgr2=0x559f578a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911d674640 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 0x559f578a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911d674640 1 -- 10.20.193.28:0/1078865815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 msgr2=0x559f5789fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911d674640 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f5789fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.059+0000 7f911d674640 1 -- 10.20.193.28:0/1078865815 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f57865ed0 con 0x559f5785b410 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f911d674640 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57878670 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=1888084696218743603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f910801a780 tx=0x7f91080258c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a33d30717f83333 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f90e54e4640 1 -- 10.20.193.28:0/1078865815 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9108025ce0 con 0x559f5785b410 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f90e54e4640 1 -- 10.20.193.28:0/1078865815 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559f573fd9d0 con 0x559f5785b410 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f90e54e4640 1 -- 10.20.193.28:0/1078865815 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f910800fc50 con 0x559f5785b410 2026-02-20T13:30:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 -- 10.20.193.28:0/1078865815 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 msgr2=0x559f57878670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57878670 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=1888084696218743603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f910801a780 tx=0x7f91080258c0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 -- 10.20.193.28:0/1078865815 shutdown_connections 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785bd20 0x559f5789fe40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f578a09c0 0x559f578a0380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 --2- 10.20.193.28:0/1078865815 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f5785b410 0x559f57878670 unknown :-1 s=CLOSED pgs=393 gs=1 cs=0 l=1 c_cookie=1888084696218743603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 -- 10.20.193.28:0/1078865815 >> 10.20.193.28:0/1078865815 conn(0x559f57839910 msgr2=0x559f57877f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 -- 10.20.193.28:0/1078865815 shutdown_connections 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.060+0000 7f91218f9e00 1 -- 10.20.193.28:0/1078865815 wait complete. 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f91218f9e00 1 -- start start 2026-02-20T13:30:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f91218f9e00 1 Processor -- start 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785b410 0x559f5787a0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785bd20 0x559f5787a610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f91218f9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f5787f120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f91218f9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f5787af60 con 0x559f5785b410 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f91218f9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f5787f660 con 0x559f5785bd20 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f91218f9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f5787f820 con 0x559f578a09c0 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f911ce73640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785bd20 0x559f5787a610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f911ce73640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785bd20 0x559f5787a610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:49996/0 (socket says 10.20.193.28:49996) 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f911ce73640 1 -- 10.20.193.28:0/2290522765 learned_addr learned my addr 10.20.193.28:0/2290522765 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f911d674640 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785b410 0x559f5787a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.061+0000 7f911de75640 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f5787f120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f911d674640 1 -- 10.20.193.28:0/2290522765 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 msgr2=0x559f5787f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f911d674640 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f5787f120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f911d674640 1 -- 10.20.193.28:0/2290522765 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785bd20 msgr2=0x559f5787a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f911d674640 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785bd20 0x559f5787a610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f911d674640 1 -- 10.20.193.28:0/2290522765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f576f7f70 con 0x559f5785b410 2026-02-20T13:30:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f911d674640 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785b410 0x559f5787a0d0 secure :-1 s=READY pgs=1387 gs=1 cs=0 l=1 c_cookie=17446500313734213980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9108025930 tx=0x7f9108004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21e6b998dde715c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f90d2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f90d2ffd640 1 -- 10.20.193.28:0/2290522765 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f910800fc50 con 0x559f5785b410 2026-02-20T13:30:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f576fd4f0 con 0x559f5785b410 2026-02-20T13:30:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f90d2ffd640 1 -- 10.20.193.28:0/2290522765 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9108025ce0 con 0x559f5785b410 2026-02-20T13:30:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f90d2ffd640 1 -- 10.20.193.28:0/2290522765 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f910800f7c0 con 0x559f5785b410 2026-02-20T13:30:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f91218f9e00 10 client.20178 _ll_register_callbacks cb 0x559f5771eb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9108025960 con 0x559f5785b410 2026-02-20T13:30:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.062+0000 7f90d2ffd640 1 -- 10.20.193.28:0/2290522765 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9108024c20 con 0x559f5785b410 2026-02-20T13:30:20.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f90d2ffd640 1 -- 10.20.193.28:0/2290522765 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9108024de0 con 0x559f5785b410 2026-02-20T13:30:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f91218f9e00 10 client.20178 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559f576ebb40 con 0x559f5785b410 2026-02-20T13:30:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f90d2ffd640 1 -- 10.20.193.28:0/2290522765 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f91080375c0 con 0x559f5785b410 2026-02-20T13:30:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f91218f9e00 10 client.20178 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f91218f9e00 10 client.20178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:20.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f91218f9e00 20 client.20178 populate_metadata read hostname 'trial028' 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f91218f9e00 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f578f03c0 0x559f578f0860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f91218f9e00 4 client.20178 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559f573fb220 con 0x559f578f03c0 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.063+0000 7f911ce73640 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f578f03c0 0x559f578f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.064+0000 7f911ce73640 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f578f03c0 0x559f578f0860 crc :-1 s=READY pgs=373 gs=4 cs=0 l=0 c_cookie=4459584640905920241 s_cookie=17023686038416141287 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de3a09a5efc3ef1 server_cookie=ec404841af922be7 in_seq=0 out_seq=0 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.064+0000 7f90d2ffd640 10 client.20178 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f90d2ffd640 1 -- 10.20.193.28:0/2290522765 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559f573fb220 con 0x559f578f03c0 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f90d2ffd640 10 client.20178 handle_command_reply: tid=0 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 client.20178 shutdown 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785b410 msgr2=0x559f5787a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785b410 0x559f5787a0d0 secure :-1 s=READY pgs=1387 gs=1 cs=0 l=1 c_cookie=17446500313734213980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9108025930 tx=0x7f9108004170 comp rx=0 tx=0).stop 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 shutdown_connections 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f578f03c0 0x559f578f0860 crc :-1 s=READY pgs=373 gs=4 cs=0 l=0 c_cookie=4459584640905920241 s_cookie=17023686038416141287 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f578a09c0 0x559f5787f120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f5785bd20 0x559f5787a610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 --2- 10.20.193.28:0/2290522765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f5785b410 0x559f5787a0d0 unknown :-1 s=CLOSED pgs=1387 gs=1 cs=0 l=1 c_cookie=17446500313734213980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f90d2ffd640 0 client.20178 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 >> 10.20.193.28:0/2290522765 conn(0x559f57839910 msgr2=0x559f57870770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 shutdown_connections 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 1 -- 10.20.193.28:0/2290522765 wait complete. 2026-02-20T13:30:20.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.065+0000 7f91218f9e00 20 client.20178 trim_cache size 0 max 16384 2026-02-20T13:30:20.076 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:20.076 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:30:20.076 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1", 2026-02-20T13:30:20.076 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:30:20.076 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:20.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 -- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f90f40b56d0 msgr2=0x7f90f40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f90f40b56d0 0x7f90f40d5b80 secure :-1 s=READY pgs=574 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9108004740 tx=0x7f9108005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:20.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 -- 10.20.193.28:0/495866737 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 msgr2=0x7f9118173b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 0x7f9118173b10 secure :-1 s=READY pgs=391 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f910c0023d0 tx=0x7f910c004290 comp rx=0 tx=0).stop 2026-02-20T13:30:20.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 -- 10.20.193.28:0/495866737 shutdown_connections 2026-02-20T13:30:20.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f90f40b56d0 0x7f90f40d5b80 unknown :-1 s=CLOSED pgs=574 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9118113240 0x7f91180f4bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9118060a00 0x7f9118173b10 unknown :-1 s=CLOSED pgs=391 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 --2- 10.20.193.28:0/495866737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9118060010 0x7f91180f44f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 -- 10.20.193.28:0/495866737 >> 10.20.193.28:0/495866737 conn(0x7f91180e97e0 msgr2=0x7f911810f850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 -- 10.20.193.28:0/495866737 shutdown_connections 2026-02-20T13:30:20.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.066+0000 7f911f8ff640 1 -- 10.20.193.28:0/495866737 wait complete. 2026-02-20T13:30:20.205 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:30:20.389 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.558+0000 7fe776b7f640 1 -- 10.20.193.28:0/1258517402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010ffe0 msgr2=0x7fe770115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.558+0000 7fe776b7f640 1 --2- 10.20.193.28:0/1258517402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010ffe0 0x7fe770115030 secure :-1 s=READY pgs=1388 gs=1 cs=0 l=1 c_cookie=14029511165420286220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe758009950 tx=0x7fe75802f190 comp rx=0 tx=0).stop 2026-02-20T13:30:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.558+0000 7fe776b7f640 1 -- 10.20.193.28:0/1258517402 shutdown_connections 2026-02-20T13:30:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.558+0000 7fe776b7f640 1 --2- 10.20.193.28:0/1258517402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010ffe0 0x7fe770115030 unknown :-1 s=CLOSED pgs=1388 gs=1 cs=0 l=1 c_cookie=14029511165420286220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.558+0000 7fe776b7f640 1 --2- 10.20.193.28:0/1258517402 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7701157e0 0x7fe7701761b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.558+0000 7fe776b7f640 1 --2- 10.20.193.28:0/1258517402 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77010f5f0 0x7fe77010f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.558+0000 7fe776b7f640 1 -- 10.20.193.28:0/1258517402 >> 10.20.193.28:0/1258517402 conn(0x7fe7700ecea0 msgr2=0x7fe77010d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.558+0000 7fe776b7f640 1 -- 10.20.193.28:0/1258517402 shutdown_connections 2026-02-20T13:30:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.559+0000 7fe776b7f640 1 -- 10.20.193.28:0/1258517402 wait complete. 2026-02-20T13:30:20.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.559+0000 7fe776b7f640 1 Processor -- start 2026-02-20T13:30:20.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.559+0000 7fe776b7f640 1 -- start start 2026-02-20T13:30:20.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe776b7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010f5f0 0x7fe7700f4e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe776b7f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77010ffe0 0x7fe7701760b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe776b7f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7701157e0 0x7fe7700f5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe776b7f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe7700fa750 con 0x7fe77010f5f0 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe776b7f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe7700fa8c0 con 0x7fe7701157e0 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe776b7f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe7700faa80 con 0x7fe77010ffe0 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010f5f0 0x7fe7700f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010f5f0 0x7fe7700f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33026/0 (socket says 10.20.193.28:33026) 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 -- 10.20.193.28:0/85768546 learned_addr learned my addr 10.20.193.28:0/85768546 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe767fff640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77010ffe0 0x7fe7701760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7750f5640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7701157e0 0x7fe7700f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 -- 10.20.193.28:0/85768546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77010ffe0 msgr2=0x7fe7701760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77010ffe0 0x7fe7701760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 -- 10.20.193.28:0/85768546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7701157e0 msgr2=0x7fe7700f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7701157e0 0x7fe7700f5590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 -- 10.20.193.28:0/85768546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe758009570 con 0x7fe77010f5f0 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe767fff640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77010ffe0 0x7fe7701760b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe7748f4640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010f5f0 0x7fe7700f4e90 secure :-1 s=READY pgs=1389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe760009480 tx=0x7fe76000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.560+0000 7fe765ffb640 1 -- 10.20.193.28:0/85768546 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe76000cd40 con 0x7fe77010f5f0 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.561+0000 7fe765ffb640 1 -- 10.20.193.28:0/85768546 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe760004d30 con 0x7fe77010f5f0 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.561+0000 7fe765ffb640 1 -- 10.20.193.28:0/85768546 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe760010740 con 0x7fe77010f5f0 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.561+0000 7fe776b7f640 1 -- 10.20.193.28:0/85768546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7700fad60 con 0x7fe77010f5f0 2026-02-20T13:30:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.561+0000 7fe776b7f640 1 -- 10.20.193.28:0/85768546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7700fb1e0 con 0x7fe77010f5f0 2026-02-20T13:30:20.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.564+0000 7fe765ffb640 1 -- 10.20.193.28:0/85768546 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe76001f060 con 0x7fe77010f5f0 2026-02-20T13:30:20.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.565+0000 7fe765ffb640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe74c0b5750 0x7fe74c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.565+0000 7fe765ffb640 1 -- 10.20.193.28:0/85768546 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe760014070 con 0x7fe77010f5f0 2026-02-20T13:30:20.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe767fff640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe74c0b5750 0x7fe74c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe778b79e00 1 Processor -- start 2026-02-20T13:30:20.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe778b79e00 1 -- start start 2026-02-20T13:30:20.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe767fff640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe74c0b5750 0x7fe74c0d5c00 secure :-1 s=READY pgs=575 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7580023d0 tx=0x7fe758031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29b1f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29f6e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a2a17730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe778b79e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5636a28bf7d0 con 0x5636a29b1b90 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe778b79e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5636a28bb500 con 0x5636a29b24a0 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe778b79e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5636a28b54a0 con 0x5636a29f7350 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.566+0000 7fe7748f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7748f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33038/0 (socket says 10.20.193.28:33038) 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7748f4640 1 -- 10.20.193.28:0/2034656969 learned_addr learned my addr 10.20.193.28:0/2034656969 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7750f5640 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a2a17730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe767fff640 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7748f4640 1 -- 10.20.193.28:0/2034656969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 msgr2=0x5636a2a17730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a2a17730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7748f4640 1 -- 10.20.193.28:0/2034656969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 msgr2=0x5636a29f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7748f4640 1 -- 10.20.193.28:0/2034656969 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a2860d80 con 0x5636a29b1b90 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe767fff640 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29f6e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29b1f60 secure :-1 s=READY pgs=1390 gs=1 cs=0 l=1 c_cookie=13859576918365958313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe760004f50 tx=0x7fe76000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0571bc6ac67f0a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe73d4e4640 1 -- 10.20.193.28:0/2034656969 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7600e4ea0 con 0x5636a29b1b90 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe73d4e4640 1 -- 10.20.193.28:0/2034656969 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe760075070 con 0x5636a29b1b90 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe73d4e4640 1 -- 10.20.193.28:0/2034656969 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe760004110 con 0x5636a29b1b90 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe778b79e00 1 -- 10.20.193.28:0/2034656969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 msgr2=0x5636a29b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29b1f60 secure :-1 s=READY pgs=1390 gs=1 cs=0 l=1 c_cookie=13859576918365958313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe760004f50 tx=0x7fe76000cf70 comp rx=0 tx=0).stop 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe778b79e00 1 -- 10.20.193.28:0/2034656969 shutdown_connections 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a2a17730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29f6e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2034656969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29b1f60 unknown :-1 s=CLOSED pgs=1390 gs=1 cs=0 l=1 c_cookie=13859576918365958313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.567+0000 7fe778b79e00 1 -- 10.20.193.28:0/2034656969 >> 10.20.193.28:0/2034656969 conn(0x5636a2990090 msgr2=0x5636a29b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.568+0000 7fe778b79e00 1 -- 10.20.193.28:0/2034656969 shutdown_connections 2026-02-20T13:30:20.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.568+0000 7fe778b79e00 1 -- 10.20.193.28:0/2034656969 wait complete. 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.569+0000 7fe778b79e00 1 -- start start 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.569+0000 7fe778b79e00 1 Processor -- start 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.569+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29ca1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.569+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29ca700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.569+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29cf6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.569+0000 7fe778b79e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5636a29cfc30 con 0x5636a29b24a0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.569+0000 7fe778b79e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5636a29cfda0 con 0x5636a29b1b90 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.569+0000 7fe778b79e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5636a29cff60 con 0x5636a29f7350 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe7750f5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33048/0 (socket says 10.20.193.28:33048) 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 -- 10.20.193.28:0/180351699 learned_addr learned my addr 10.20.193.28:0/180351699 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe7748f4640 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 -- 10.20.193.28:0/180351699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 msgr2=0x5636a29cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 -- 10.20.193.28:0/180351699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 msgr2=0x5636a29ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 -- 10.20.193.28:0/180351699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a2839350 con 0x5636a29b24a0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe767fff640 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29ca700 secure :-1 s=READY pgs=1391 gs=1 cs=0 l=1 c_cookie=7437080541459955926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75802f6a0 tx=0x7fe75802f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6735d1595fb0c0d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.570+0000 7fe72e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe72e7fc640 1 -- 10.20.193.28:0/180351699 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe758038d50 con 0x5636a29b24a0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7700fb1e0 con 0x5636a29b24a0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe72e7fc640 1 -- 10.20.193.28:0/180351699 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe758002e10 con 0x5636a29b24a0 2026-02-20T13:30:20.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe72e7fc640 1 -- 10.20.193.28:0/180351699 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe758043680 con 0x5636a29b24a0 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 10 client.20190 _ll_register_callbacks cb 0x5636a28369a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5636a254b6f0 con 0x5636a29b24a0 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe72e7fc640 1 -- 10.20.193.28:0/180351699 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe758043810 con 0x5636a29b24a0 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe72e7fc640 1 -- 10.20.193.28:0/180351699 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe7580439f0 con 0x5636a29b24a0 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 10 client.20190 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5636a284b150 con 0x5636a29b24a0 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe72e7fc640 1 -- 10.20.193.28:0/180351699 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe758043b90 con 0x5636a29b24a0 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 10 client.20190 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 10 client.20190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 20 client.20190 populate_metadata read hostname 'trial028' 2026-02-20T13:30:20.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636a29f49a0 0x5636a29f4e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 4 client.20190 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.571+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636a28c2d60 con 0x5636a29f49a0 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.572+0000 7fe7748f4640 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636a29f49a0 0x5636a29f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.572+0000 7fe7748f4640 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636a29f49a0 0x5636a29f4e40 crc :-1 s=READY pgs=374 gs=4 cs=0 l=0 c_cookie=5856927043326006016 s_cookie=11224200347948010797 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5147fc1d54d35300 server_cookie=9bc45ebf8341cd2d in_seq=0 out_seq=0 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.572+0000 7fe72e7fc640 10 client.20190 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.572+0000 7fe72e7fc640 1 -- 10.20.193.28:0/180351699 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5636a28c2d60 con 0x5636a29f49a0 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.572+0000 7fe72e7fc640 10 client.20190 handle_command_reply: tid=0 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.572+0000 7fe778b79e00 1 client.20190 shutdown 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 msgr2=0x5636a29ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29ca700 secure :-1 s=READY pgs=1391 gs=1 cs=0 l=1 c_cookie=7437080541459955926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe75802f6a0 tx=0x7fe75802f190 comp rx=0 tx=0).stop 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 shutdown_connections 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636a29f49a0 0x5636a29f4e40 crc :-1 s=READY pgs=374 gs=4 cs=0 l=0 c_cookie=5856927043326006016 s_cookie=11224200347948010797 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29ca700 unknown :-1 s=CLOSED pgs=1391 gs=1 cs=0 l=1 c_cookie=7437080541459955926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29cf6f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 --2- 10.20.193.28:0/180351699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29ca1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe72e7fc640 0 client.20190 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:20.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 >> 10.20.193.28:0/180351699 conn(0x5636a2990090 msgr2=0x5636a29b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 shutdown_connections 2026-02-20T13:30:20.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 1 -- 10.20.193.28:0/180351699 wait complete. 2026-02-20T13:30:20.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.573+0000 7fe778b79e00 20 client.20190 trim_cache size 0 max 16384 2026-02-20T13:30:20.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe778b79e00 1 Processor -- start 2026-02-20T13:30:20.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe778b79e00 1 -- start start 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29c75a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29c7ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29ef8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe778b79e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5636a28b30d0 con 0x5636a29b1b90 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe778b79e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5636a2573700 con 0x5636a29b24a0 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe778b79e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5636a29f3120 con 0x5636a29f7350 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7748f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7748f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33054/0 (socket says 10.20.193.28:33054) 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7748f4640 1 -- 10.20.193.28:0/2309110639 learned_addr learned my addr 10.20.193.28:0/2309110639 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7750f5640 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe767fff640 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7748f4640 1 -- 10.20.193.28:0/2309110639 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 msgr2=0x5636a29ef8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29ef8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7748f4640 1 -- 10.20.193.28:0/2309110639 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 msgr2=0x5636a29c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.583+0000 7fe7748f4640 1 -- 10.20.193.28:0/2309110639 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a2845bd0 con 0x5636a29b1b90 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29c75a0 secure :-1 s=READY pgs=1392 gs=1 cs=0 l=1 c_cookie=4141311709856506262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7600af520 tx=0x7fe760005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3978e50efa29a196 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe73cce3640 1 -- 10.20.193.28:0/2309110639 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7600e4ea0 con 0x5636a29b1b90 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe73cce3640 1 -- 10.20.193.28:0/2309110639 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7600aca90 con 0x5636a29b1b90 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe73cce3640 1 -- 10.20.193.28:0/2309110639 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe760004190 con 0x5636a29b1b90 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 -- 10.20.193.28:0/2309110639 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 msgr2=0x5636a29c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29c75a0 secure :-1 s=READY pgs=1392 gs=1 cs=0 l=1 c_cookie=4141311709856506262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7600af520 tx=0x7fe760005610 comp rx=0 tx=0).stop 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 -- 10.20.193.28:0/2309110639 shutdown_connections 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29ef8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b24a0 0x5636a29c7ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2309110639 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b1b90 0x5636a29c75a0 unknown :-1 s=CLOSED pgs=1392 gs=1 cs=0 l=1 c_cookie=4141311709856506262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 -- 10.20.193.28:0/2309110639 >> 10.20.193.28:0/2309110639 conn(0x5636a2990090 msgr2=0x5636a29b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 -- 10.20.193.28:0/2309110639 shutdown_connections 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.584+0000 7fe778b79e00 1 -- 10.20.193.28:0/2309110639 wait complete. 2026-02-20T13:30:20.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.585+0000 7fe778b79e00 1 -- start start 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.585+0000 7fe778b79e00 1 Processor -- start 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.585+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29d1b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.585+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29d2050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.585+0000 7fe778b79e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29d25b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.585+0000 7fe778b79e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5636a29f1270 con 0x5636a29b24a0 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.585+0000 7fe778b79e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5636a2a5ca30 con 0x5636a29b1b90 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.585+0000 7fe778b79e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5636a2a5cbf0 con 0x5636a29f7350 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7750f5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7750f5640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29d25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57950/0 (socket says 10.20.193.28:57950) 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29d1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50048/0 (socket says 10.20.193.28:50048) 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 -- 10.20.193.28:0/2311415689 learned_addr learned my addr 10.20.193.28:0/2311415689 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:20.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe767fff640 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 -- 10.20.193.28:0/2311415689 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 msgr2=0x5636a29d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29d25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 -- 10.20.193.28:0/2311415689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 msgr2=0x5636a29d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 -- 10.20.193.28:0/2311415689 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a2839680 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe7748f4640 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29d1b10 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=4933722527773504559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7600ad500 tx=0x7fe7600a9200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44781a7fc048342f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.586+0000 7fe72e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe72e7fc640 1 -- 10.20.193.28:0/2311415689 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7600e4ea0 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe72e7fc640 1 -- 10.20.193.28:0/2311415689 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe7600c7030 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe72e7fc640 1 -- 10.20.193.28:0/2311415689 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7600adf20 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636a2860d80 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe72e7fc640 1 -- 10.20.193.28:0/2311415689 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe7600ae0b0 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe72e7fc640 10 client.30116 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 10 client.30116 _ll_register_callbacks cb 0x5636a28369a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe760075070 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe72e7fc640 1 -- 10.20.193.28:0/2311415689 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe7600adc90 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 10 client.30116 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5636a284b3b0 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe72e7fc640 1 -- 10.20.193.28:0/2311415689 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe7600b7f40 con 0x5636a29b1b90 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 10 client.30116 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 10 client.30116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 20 client.30116 populate_metadata read hostname 'trial028' 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636a2aa47c0 0x5636a2ac4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 4 client.30116 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:30:20.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.587+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5636a2548f40 con 0x5636a2aa47c0 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.588+0000 7fe767fff640 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636a2aa47c0 0x5636a2ac4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.588+0000 7fe767fff640 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636a2aa47c0 0x5636a2ac4c40 crc :-1 s=READY pgs=375 gs=4 cs=0 l=0 c_cookie=15396759580977893293 s_cookie=10103583258325642504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5ac47436c478fad server_cookie=8c3723713f156d08 in_seq=0 out_seq=0 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.588+0000 7fe72e7fc640 10 client.30116 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.588+0000 7fe72e7fc640 1 -- 10.20.193.28:0/2311415689 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6818 (crc 0 0 0) 0x5636a2548f40 con 0x5636a2aa47c0 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.588+0000 7fe72e7fc640 10 client.30116 handle_command_reply: tid=0 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.588+0000 7fe778b79e00 1 client.30116 shutdown 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 msgr2=0x5636a29d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29d1b10 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=4933722527773504559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7600ad500 tx=0x7fe7600a9200 comp rx=0 tx=0).stop 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 shutdown_connections 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5636a2aa47c0 0x5636a2ac4c40 crc :-1 s=READY pgs=375 gs=4 cs=0 l=0 c_cookie=15396759580977893293 s_cookie=10103583258325642504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5636a29b24a0 0x5636a29d2050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5636a29f7350 0x5636a29d25b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 --2- 10.20.193.28:0/2311415689 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5636a29b1b90 0x5636a29d1b10 unknown :-1 s=CLOSED pgs=478 gs=1 cs=0 l=1 c_cookie=4933722527773504559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 >> 10.20.193.28:0/2311415689 conn(0x5636a2990090 msgr2=0x5636a29c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe72e7fc640 0 client.30116 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:20.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 shutdown_connections 2026-02-20T13:30:20.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 1 -- 10.20.193.28:0/2311415689 wait complete. 2026-02-20T13:30:20.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.589+0000 7fe778b79e00 20 client.30116 trim_cache size 0 max 16384 2026-02-20T13:30:20.593 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:20.593 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1", 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:30:20.594 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:30:20.595 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.596 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:30:20.598 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.599 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:30:20.600 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.602 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.603 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.604 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:30:20.605 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.606 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:20.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.590+0000 7fe776b7f640 1 -- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe74c0b5750 msgr2=0x7fe74c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.590+0000 7fe776b7f640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe74c0b5750 0x7fe74c0d5c00 secure :-1 s=READY pgs=575 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7580023d0 tx=0x7fe758031040 comp rx=0 tx=0).stop 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.590+0000 7fe776b7f640 1 -- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010f5f0 msgr2=0x7fe7700f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.590+0000 7fe776b7f640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010f5f0 0x7fe7700f4e90 secure :-1 s=READY pgs=1389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe760009480 tx=0x7fe76000ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.591+0000 7fe776b7f640 1 -- 10.20.193.28:0/85768546 shutdown_connections 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.591+0000 7fe776b7f640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe74c0b5750 0x7fe74c0d5c00 unknown :-1 s=CLOSED pgs=575 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.591+0000 7fe776b7f640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe7701157e0 0x7fe7700f5590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.591+0000 7fe776b7f640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe77010ffe0 0x7fe7701760b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.591+0000 7fe776b7f640 1 --2- 10.20.193.28:0/85768546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe77010f5f0 0x7fe7700f4e90 unknown :-1 s=CLOSED pgs=1389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.591+0000 7fe776b7f640 1 -- 10.20.193.28:0/85768546 >> 10.20.193.28:0/85768546 conn(0x7fe7700ecea0 msgr2=0x7fe77010db00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.591+0000 7fe776b7f640 1 -- 10.20.193.28:0/85768546 shutdown_connections 2026-02-20T13:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:20.591+0000 7fe776b7f640 1 -- 10.20.193.28:0/85768546 wait complete. 2026-02-20T13:30:20.693 INFO:tasks.cephfs.filesystem:scrub status for tag:cd6edbbf-4ed4-428f-a6b8-f9eee80308d1 - {'path': '/', 'tag': 'cd6edbbf-4ed4-428f-a6b8-f9eee80308d1', 'options': 'recursive,force'} 2026-02-20T13:30:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: pgmap v571: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2026-02-20T13:30:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:30:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:30:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:30:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:30:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:20 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: pgmap v571: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2026-02-20T13:30:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:30:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:30:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:30:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:30:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:20 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: pgmap v571: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2026-02-20T13:30:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:30:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:30:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:30:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:30:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:20 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:21.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 -- 10.20.193.28:0/1784846415 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 msgr2=0x7fa13c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 --2- 10.20.193.28:0/1784846415 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 0x7fa13c0619a0 secure :-1 s=READY pgs=479 gs=2 cs=0 l=1 c_cookie=5728198152343676826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa130009950 tx=0x7fa13002f190 comp rx=0 tx=0).stop 2026-02-20T13:30:21.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 -- 10.20.193.28:0/1784846415 shutdown_connections 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 --2- 10.20.193.28:0/1784846415 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa13c150e20 0x7fa13c171280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 --2- 10.20.193.28:0/1784846415 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 0x7fa13c0619a0 unknown :-1 s=CLOSED pgs=479 gs=2 cs=0 l=1 c_cookie=5728198152343676826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 --2- 10.20.193.28:0/1784846415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa13c062a60 0x7fa13c060ff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 -- 10.20.193.28:0/1784846415 >> 10.20.193.28:0/1784846415 conn(0x7fa13c0ea490 msgr2=0x7fa13c10a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 -- 10.20.193.28:0/1784846415 shutdown_connections 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.599+0000 7fa142e43640 1 -- 10.20.193.28:0/1784846415 wait complete. 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142e43640 1 Processor -- start 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142e43640 1 -- start start 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142e43640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 0x7fa13c15c670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142e43640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa13c062a60 0x7fa13c15ccc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142e43640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa13c150e20 0x7fa13c15d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142e43640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c15e000 con 0x7fa13c062a60 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142e43640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c15e170 con 0x7fa13c061530 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142e43640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c15e330 con 0x7fa13c150e20 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141640640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa13c062a60 0x7fa13c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141e41640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 0x7fa13c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141e41640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 0x7fa13c15c670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50068/0 (socket says 10.20.193.28:50068) 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141e41640 1 -- 10.20.193.28:0/302033180 learned_addr learned my addr 10.20.193.28:0/302033180 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa142642640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa13c150e20 0x7fa13c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141640640 1 -- 10.20.193.28:0/302033180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa13c150e20 msgr2=0x7fa13c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141640640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa13c150e20 0x7fa13c15d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141640640 1 -- 10.20.193.28:0/302033180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 msgr2=0x7fa13c15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141640640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 0x7fa13c15c670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.600+0000 7fa141640640 1 -- 10.20.193.28:0/302033180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa130009570 con 0x7fa13c062a60 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.601+0000 7fa141640640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa13c062a60 0x7fa13c15ccc0 secure :-1 s=READY pgs=1393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa13002f6a0 tx=0x7fa1300028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:21.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.601+0000 7fa12affd640 1 -- 10.20.193.28:0/302033180 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa13003d070 con 0x7fa13c062a60 2026-02-20T13:30:21.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.601+0000 7fa142e43640 1 -- 10.20.193.28:0/302033180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c15e5b0 con 0x7fa13c062a60 2026-02-20T13:30:21.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.601+0000 7fa12affd640 1 -- 10.20.193.28:0/302033180 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa1300043d0 con 0x7fa13c062a60 2026-02-20T13:30:21.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.601+0000 7fa12affd640 1 -- 10.20.193.28:0/302033180 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa130041ba0 con 0x7fa13c062a60 2026-02-20T13:30:21.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.601+0000 7fa142e43640 1 -- 10.20.193.28:0/302033180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c15ead0 con 0x7fa13c062a60 2026-02-20T13:30:21.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.604+0000 7fa12affd640 1 -- 10.20.193.28:0/302033180 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa130038920 con 0x7fa13c062a60 2026-02-20T13:30:21.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.605+0000 7fa12affd640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa1180b5760 0x7fa1180d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.605+0000 7fa1467bfe00 1 Processor -- start 2026-02-20T13:30:21.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa12affd640 1 -- 10.20.193.28:0/302033180 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa13010b490 con 0x7fa13c062a60 2026-02-20T13:30:21.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa141e41640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa1180b5760 0x7fa1180d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa1467bfe00 1 -- start start 2026-02-20T13:30:21.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8c2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddcacbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddccd4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5634ddb78fd0 con 0x5634ddc8c7f0 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5634ddb74d00 con 0x5634ddcad110 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5634ddb6eca0 con 0x5634ddc6bed0 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa142642640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddccd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa142642640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddccd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50082/0 (socket says 10.20.193.28:50082) 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa142642640 1 -- 10.20.193.28:0/354091872 learned_addr learned my addr 10.20.193.28:0/354091872 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa141640640 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddcacbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.606+0000 7fa141e41640 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa141640640 1 -- 10.20.193.28:0/354091872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 msgr2=0x5634ddc8c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa141640640 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa141640640 1 -- 10.20.193.28:0/354091872 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 msgr2=0x5634ddccd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa141640640 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddccd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa141640640 1 -- 10.20.193.28:0/354091872 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ddb118b0 con 0x5634ddc8c7f0 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa142642640 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddccd4f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa141640640 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddcacbd0 secure :-1 s=READY pgs=1394 gs=3 cs=0 l=1 c_cookie=1093486436487702318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa130108f60 tx=0x7fa1300415b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cd81ed58ea72e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa141e41640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa1180b5760 0x7fa1180d5c10 secure :-1 s=READY pgs=576 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c0095d0 tx=0x7fa12c009bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa10a3ff640 1 -- 10.20.193.28:0/354091872 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa130108040 con 0x5634ddc8c7f0 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa10a3ff640 1 -- 10.20.193.28:0/354091872 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa1300d1950 con 0x5634ddc8c7f0 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa10a3ff640 1 -- 10.20.193.28:0/354091872 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa130035320 con 0x5634ddc8c7f0 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 -- 10.20.193.28:0/354091872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 msgr2=0x5634ddcacbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddcacbd0 secure :-1 s=READY pgs=1394 gs=3 cs=0 l=1 c_cookie=1093486436487702318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa130108f60 tx=0x7fa1300415b0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 -- 10.20.193.28:0/354091872 shutdown_connections 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddcacbd0 unknown :-1 s=CLOSED pgs=1394 gs=3 cs=0 l=1 c_cookie=1093486436487702318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddccd4f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/354091872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8c2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 -- 10.20.193.28:0/354091872 >> 10.20.193.28:0/354091872 conn(0x5634ddb821c0 msgr2=0x5634ddc6a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:21.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 -- 10.20.193.28:0/354091872 shutdown_connections 2026-02-20T13:30:21.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.607+0000 7fa1467bfe00 1 -- 10.20.193.28:0/354091872 wait complete. 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.609+0000 7fa1467bfe00 1 -- start start 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.609+0000 7fa1467bfe00 1 Processor -- start 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.609+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc84b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.609+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 0x5634ddc85160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.609+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc85bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.609+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc86220 con 0x5634ddcad110 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.609+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc86390 con 0x5634ddc8c7f0 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.609+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc86550 con 0x5634ddc6bed0 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc84b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc84b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:57990/0 (socket says 10.20.193.28:57990) 2026-02-20T13:30:21.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 -- 10.20.193.28:0/2379134989 learned_addr learned my addr 10.20.193.28:0/2379134989 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141640640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 0x5634ddc85160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa142642640 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc85bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 -- 10.20.193.28:0/2379134989 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 msgr2=0x5634ddc85160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 0x5634ddc85160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 -- 10.20.193.28:0/2379134989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 msgr2=0x5634ddc85bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc85bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 -- 10.20.193.28:0/2379134989 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ddb1a400 con 0x5634ddc6bed0 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa142642640 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc85bc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa141e41640 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc84b10 secure :-1 s=READY pgs=394 gs=2 cs=0 l=1 c_cookie=11249418819434214771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c0095a0 tx=0x7fa12c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c1df6d075f87573 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa0f77fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:21.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa0f77fe640 1 -- 10.20.193.28:0/2379134989 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12c012760 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa0f77fe640 1 -- 10.20.193.28:0/2379134989 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa12c012da0 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa0f77fe640 1 -- 10.20.193.28:0/2379134989 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12c00f3c0 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c15ead0 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa1467bfe00 10 client.30010 _ll_register_callbacks cb 0x5634ddaf9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.610+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634dd80e520 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa0f77fe640 1 -- 10.20.193.28:0/2379134989 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa12c00f550 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa0f77fe640 1 -- 10.20.193.28:0/2379134989 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa12c00f750 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa1467bfe00 10 client.30010 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5634ddaf2da0 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa0f77fe640 1 -- 10.20.193.28:0/2379134989 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa12c02f060 con 0x5634ddc6bed0 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa1467bfe00 10 client.30010 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa1467bfe00 10 client.30010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:21.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa1467bfe00 20 client.30010 populate_metadata read hostname 'trial028' 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5634ddc89990 0x5634ddc89e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa1467bfe00 4 client.30010 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634ddba0630 con 0x5634ddc89990 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.611+0000 7fa141640640 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5634ddc89990 0x5634ddc89e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa141640640 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5634ddc89990 0x5634ddc89e30 crc :-1 s=READY pgs=376 gs=4 cs=0 l=0 c_cookie=1234913102509310232 s_cookie=7230680510488694158 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11234aec838b0118 server_cookie=6458899d5004cd8e in_seq=0 out_seq=0 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa0f77fe640 10 client.30010 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa0f77fe640 1 -- 10.20.193.28:0/2379134989 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5634ddba0630 con 0x5634ddc89990 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa0f77fe640 10 client.30010 handle_command_reply: tid=0 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa1467bfe00 1 client.30010 shutdown 2026-02-20T13:30:21.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 msgr2=0x5634ddc84b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc84b10 secure :-1 s=READY pgs=394 gs=2 cs=0 l=1 c_cookie=11249418819434214771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c0095a0 tx=0x7fa12c0047e0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 shutdown_connections 2026-02-20T13:30:21.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5634ddc89990 0x5634ddc89e30 crc :-1 s=READY pgs=376 gs=4 cs=0 l=0 c_cookie=1234913102509310232 s_cookie=7230680510488694158 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc85bc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 0x5634ddc85160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/2379134989 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc84b10 unknown :-1 s=CLOSED pgs=394 gs=2 cs=0 l=1 c_cookie=11249418819434214771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.612+0000 7fa0f77fe640 0 client.30010 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:21.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.613+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 >> 10.20.193.28:0/2379134989 conn(0x5634ddb821c0 msgr2=0x5634ddc6ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:21.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.613+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 shutdown_connections 2026-02-20T13:30:21.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.613+0000 7fa1467bfe00 1 -- 10.20.193.28:0/2379134989 wait complete. 2026-02-20T13:30:21.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.613+0000 7fa1467bfe00 20 client.30010 trim_cache size 0 max 16384 2026-02-20T13:30:21.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.620+0000 7fa1467bfe00 1 Processor -- start 2026-02-20T13:30:21.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.620+0000 7fa1467bfe00 1 -- start start 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc849a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddc71f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddcaafd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5634ddb6c8d0 con 0x5634ddc8c7f0 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5634dd8adf10 con 0x5634ddcad110 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5634ddb74d00 con 0x5634ddc6bed0 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddcaafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddcaafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50094/0 (socket says 10.20.193.28:50094) 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 -- 10.20.193.28:0/1378697102 learned_addr learned my addr 10.20.193.28:0/1378697102 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa141640640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddc71f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa141e41640 1 --2- 10.20.193.28:0/1378697102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc849a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 -- 10.20.193.28:0/1378697102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 msgr2=0x5634ddc849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 --2- 10.20.193.28:0/1378697102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc849a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 -- 10.20.193.28:0/1378697102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 msgr2=0x5634ddc71f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 --2- 10.20.193.28:0/1378697102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddc71f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 -- 10.20.193.28:0/1378697102 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ddb04670 con 0x5634ddcad110 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa142642640 1 --2- 10.20.193.28:0/1378697102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddcaafd0 secure :-1 s=READY pgs=480 gs=2 cs=0 l=1 c_cookie=8927323454849926477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa138004cc0 tx=0x7fa13800a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7be439621957c54d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.621+0000 7fa109bfe640 1 -- 10.20.193.28:0/1378697102 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa138018070 con 0x5634ddcad110 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa109bfe640 1 -- 10.20.193.28:0/1378697102 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa138019040 con 0x5634ddcad110 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa109bfe640 1 -- 10.20.193.28:0/1378697102 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa138011d10 con 0x5634ddcad110 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 -- 10.20.193.28:0/1378697102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 msgr2=0x5634ddcaafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/1378697102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddcaafd0 secure :-1 s=READY pgs=480 gs=2 cs=0 l=1 c_cookie=8927323454849926477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa138004cc0 tx=0x7fa13800a310 comp rx=0 tx=0).stop 2026-02-20T13:30:21.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 -- 10.20.193.28:0/1378697102 shutdown_connections 2026-02-20T13:30:21.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/1378697102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddc8c7f0 0x5634ddc71f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/1378697102 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddcad110 0x5634ddcaafd0 unknown :-1 s=CLOSED pgs=480 gs=2 cs=0 l=1 c_cookie=8927323454849926477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/1378697102 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc849a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 -- 10.20.193.28:0/1378697102 >> 10.20.193.28:0/1378697102 conn(0x5634ddb821c0 msgr2=0x5634ddc80e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:21.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 -- 10.20.193.28:0/1378697102 shutdown_connections 2026-02-20T13:30:21.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 -- 10.20.193.28:0/1378697102 wait complete. 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.622+0000 7fa1467bfe00 1 -- start start 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa1467bfe00 1 Processor -- start 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8e290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 0x5634ddc8e930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa1467bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc8f480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc8fb30 con 0x5634ddcad110 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc8fca0 con 0x5634ddc8c7f0 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa1467bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5634ddc8fe60 con 0x5634ddc6bed0 2026-02-20T13:30:21.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141e41640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8e290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa142642640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc8f480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141e41640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8e290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58002/0 (socket says 10.20.193.28:58002) 2026-02-20T13:30:21.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141e41640 1 -- 10.20.193.28:0/3649117234 learned_addr learned my addr 10.20.193.28:0/3649117234 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:21.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141640640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 0x5634ddc8e930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141e41640 1 -- 10.20.193.28:0/3649117234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 msgr2=0x5634ddc8e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:21.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141e41640 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 0x5634ddc8e930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141e41640 1 -- 10.20.193.28:0/3649117234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 msgr2=0x5634ddc8f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:21.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141e41640 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc8f480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.623+0000 7fa141e41640 1 -- 10.20.193.28:0/3649117234 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ddaff0f0 con 0x5634ddc6bed0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa141e41640 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8e290 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=9903769443739099746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c0092d0 tx=0x7fa12c012c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=897141d62f6fe262 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa0f77fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa0f77fe640 1 -- 10.20.193.28:0/3649117234 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12c00ee60 con 0x5634ddc6bed0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa0f77fe640 1 -- 10.20.193.28:0/3649117234 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5634dd80e520 con 0x5634ddc6bed0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa138004960 con 0x5634ddc6bed0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa0f77fe640 1 -- 10.20.193.28:0/3649117234 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12c030f10 con 0x5634ddc6bed0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa0f77fe640 1 -- 10.20.193.28:0/3649117234 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa12c030820 con 0x5634ddc6bed0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 10 client.30016 _ll_register_callbacks cb 0x5634ddaf9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634ddc1eca0 con 0x5634ddc6bed0 2026-02-20T13:30:21.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa0f77fe640 1 -- 10.20.193.28:0/3649117234 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa12c026d80 con 0x5634ddc6bed0 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 10 client.30016 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5634ddaf30d0 con 0x5634ddc6bed0 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa0f77fe640 1 -- 10.20.193.28:0/3649117234 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa12c01d030 con 0x5634ddc6bed0 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 10 client.30016 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 10 client.30016 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 20 client.30016 populate_metadata read hostname 'trial028' 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5634ddc91f20 0x5634ddc92390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 4 client.30016 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.624+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5634dd852640 con 0x5634ddc91f20 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.625+0000 7fa141640640 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5634ddc91f20 0x5634ddc92390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:21.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.625+0000 7fa141640640 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5634ddc91f20 0x5634ddc92390 crc :-1 s=READY pgs=377 gs=4 cs=0 l=0 c_cookie=18417862836188246719 s_cookie=5213681276168460422 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff9964aae0de72bf server_cookie=485ab77f56205886 in_seq=0 out_seq=0 2026-02-20T13:30:21.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.625+0000 7fa0f77fe640 10 client.30016 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:21.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa0f77fe640 1 -- 10.20.193.28:0/3649117234 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5634dd852640 con 0x5634ddc91f20 2026-02-20T13:30:21.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa0f77fe640 10 client.30016 handle_command_reply: tid=0 2026-02-20T13:30:21.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 client.30016 shutdown 2026-02-20T13:30:21.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 msgr2=0x5634ddc8e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8e290 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=9903769443739099746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c0092d0 tx=0x7fa12c012c50 comp rx=0 tx=0).stop 2026-02-20T13:30:21.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 shutdown_connections 2026-02-20T13:30:21.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5634ddc91f20 0x5634ddc92390 crc :-1 s=READY pgs=377 gs=4 cs=0 l=0 c_cookie=18417862836188246719 s_cookie=5213681276168460422 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5634ddcad110 0x5634ddc8f480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5634ddc8c7f0 0x5634ddc8e930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 --2- 10.20.193.28:0/3649117234 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5634ddc6bed0 0x5634ddc8e290 unknown :-1 s=CLOSED pgs=395 gs=1 cs=0 l=1 c_cookie=9903769443739099746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa0f77fe640 0 client.30016 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:21.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 >> 10.20.193.28:0/3649117234 conn(0x5634ddb821c0 msgr2=0x5634ddc80e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:21.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.629+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 shutdown_connections 2026-02-20T13:30:21.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa1467bfe00 1 -- 10.20.193.28:0/3649117234 wait complete. 2026-02-20T13:30:21.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa1467bfe00 20 client.30016 trim_cache size 0 max 16384 2026-02-20T13:30:21.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:30:21.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:30:21.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:30:21.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:30:21.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 -- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa1180b5760 msgr2=0x7fa1180d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa1180b5760 0x7fa1180d5c10 secure :-1 s=READY pgs=576 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c0095d0 tx=0x7fa12c009bd0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 -- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa13c062a60 msgr2=0x7fa13c15ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa13c062a60 0x7fa13c15ccc0 secure :-1 s=READY pgs=1393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa13002f6a0 tx=0x7fa1300028d0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 -- 10.20.193.28:0/302033180 shutdown_connections 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa1180b5760 0x7fa1180d5c10 unknown :-1 s=CLOSED pgs=576 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa13c062a60 0x7fa13c15ccc0 unknown :-1 s=CLOSED pgs=1393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa13c150e20 0x7fa13c15d8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 --2- 10.20.193.28:0/302033180 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa13c061530 0x7fa13c15c670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 -- 10.20.193.28:0/302033180 >> 10.20.193.28:0/302033180 conn(0x7fa13c0ea490 msgr2=0x7fa13c10a870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 -- 10.20.193.28:0/302033180 shutdown_connections 2026-02-20T13:30:21.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:21.630+0000 7fa142e43640 1 -- 10.20.193.28:0/302033180 wait complete. 2026-02-20T13:30:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:22 trial127 ceph-mon[43817]: pgmap v572: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2026-02-20T13:30:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:22 trial034 ceph-mon[43332]: pgmap v572: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2026-02-20T13:30:23.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:22 trial028 ceph-mon[37442]: pgmap v572: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2026-02-20T13:30:24.416 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2026-02-20T13:30:24.416 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:30:24.602 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:24.734 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:24 trial028 ceph-mon[37442]: pgmap v573: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 17 op/s 2026-02-20T13:30:24.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 -- 10.20.193.28:0/1153844281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6da410d3a0 msgr2=0x7f6da4111ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:24.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/1153844281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6da410d3a0 0x7f6da4111ce0 secure :-1 s=READY pgs=1395 gs=1 cs=0 l=1 c_cookie=10889424518018918905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d94009950 tx=0x7f6d9402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:24.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 -- 10.20.193.28:0/1153844281 shutdown_connections 2026-02-20T13:30:24.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/1153844281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6da410d3a0 0x7f6da4111ce0 unknown :-1 s=CLOSED pgs=1395 gs=1 cs=0 l=1 c_cookie=10889424518018918905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/1153844281 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6da4112490 0x7f6da4172e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/1153844281 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6da410c9b0 0x7f6da410cd80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 -- 10.20.193.28:0/1153844281 >> 10.20.193.28:0/1153844281 conn(0x7f6da40e9310 msgr2=0x7f6da4109720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:24.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 -- 10.20.193.28:0/1153844281 shutdown_connections 2026-02-20T13:30:24.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 -- 10.20.193.28:0/1153844281 wait complete. 2026-02-20T13:30:24.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.768+0000 7f6daa5cf640 1 Processor -- start 2026-02-20T13:30:24.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6daa5cf640 1 -- start start 2026-02-20T13:30:24.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6daa5cf640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6da410c9b0 0x7f6da40f1620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6daa5cf640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6da410d3a0 0x7f6da4172d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6daa5cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6da4112490 0x7f6da40f1d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6daa5cf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40f6f30 con 0x7f6da4112490 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6daa5cf640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40f70a0 con 0x7f6da410d3a0 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6daa5cf640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40f7260 con 0x7f6da410c9b0 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6da410d3a0 0x7f6da4172d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6da410d3a0 0x7f6da4172d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50124/0 (socket says 10.20.193.28:50124) 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da37fe640 1 -- 10.20.193.28:0/4144374685 learned_addr learned my addr 10.20.193.28:0/4144374685 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da8b45640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6da4112490 0x7f6da40f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:24.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da3fff640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6da410c9b0 0x7f6da40f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da37fe640 1 -- 10.20.193.28:0/4144374685 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6da410c9b0 msgr2=0x7f6da40f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da37fe640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6da410c9b0 0x7f6da40f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da37fe640 1 -- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6da4112490 msgr2=0x7f6da40f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da37fe640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6da4112490 0x7f6da40f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.769+0000 7f6da37fe640 1 -- 10.20.193.28:0/4144374685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d94009570 con 0x7f6da410d3a0 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.770+0000 7f6da37fe640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6da410d3a0 0x7f6da4172d60 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d94005b30 tx=0x7f6d94004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.770+0000 7f6da17fa640 1 -- 10.20.193.28:0/4144374685 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d9403d070 con 0x7f6da410d3a0 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.770+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da40f74e0 con 0x7f6da410d3a0 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.770+0000 7f6da17fa640 1 -- 10.20.193.28:0/4144374685 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6d94038920 con 0x7f6da410d3a0 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.770+0000 7f6da17fa640 1 -- 10.20.193.28:0/4144374685 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d940418a0 con 0x7f6da410d3a0 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.770+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da40f79a0 con 0x7f6da410d3a0 2026-02-20T13:30:24.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.770+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da405fa90 con 0x7f6da410d3a0 2026-02-20T13:30:24.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.773+0000 7f6da17fa640 1 -- 10.20.193.28:0/4144374685 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6d94048020 con 0x7f6da410d3a0 2026-02-20T13:30:24.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.775+0000 7f6da17fa640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6d780b5750 0x7f6d780d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:24.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.775+0000 7f6da17fa640 1 -- 10.20.193.28:0/4144374685 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6d9410b1b0 con 0x7f6da410d3a0 2026-02-20T13:30:24.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.775+0000 7f6da3fff640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6d780b5750 0x7f6d780d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:24.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.775+0000 7f6da17fa640 1 -- 10.20.193.28:0/4144374685 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f6d9410b630 con 0x7f6da410d3a0 2026-02-20T13:30:24.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.776+0000 7f6da3fff640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6d780b5750 0x7f6d780d5c00 secure :-1 s=READY pgs=577 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90004740 tx=0x7f6d9000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:24.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.915+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6da40f2780 con 0x7f6da410d3a0 2026-02-20T13:30:24.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.916+0000 7f6da17fa640 1 -- 10.20.193.28:0/4144374685 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f6d940cdc10 con 0x7f6da410d3a0 2026-02-20T13:30:24.919 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:30:24.919 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:30:24.920 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:30:24.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6d780b5750 msgr2=0x7f6d780d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6d780b5750 0x7f6d780d5c00 secure :-1 s=READY pgs=577 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90004740 tx=0x7f6d9000b410 comp rx=0 tx=0).stop 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6da410d3a0 msgr2=0x7f6da4172d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6da410d3a0 0x7f6da4172d60 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d94005b30 tx=0x7f6d94004340 comp rx=0 tx=0).stop 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 shutdown_connections 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6d780b5750 0x7f6d780d5c00 unknown :-1 s=CLOSED pgs=577 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6da4112490 0x7f6da40f1d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6da410d3a0 0x7f6da4172d60 unknown :-1 s=CLOSED pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 --2- 10.20.193.28:0/4144374685 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6da410c9b0 0x7f6da40f1620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 >> 10.20.193.28:0/4144374685 conn(0x7f6da40e9310 msgr2=0x7f6da4110f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:24.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 shutdown_connections 2026-02-20T13:30:24.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:24.917+0000 7f6daa5cf640 1 -- 10.20.193.28:0/4144374685 wait complete. 2026-02-20T13:30:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:24 trial127 ceph-mon[43817]: pgmap v573: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 17 op/s 2026-02-20T13:30:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:24 trial034 ceph-mon[43332]: pgmap v573: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 17 op/s 2026-02-20T13:30:25.016 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2026-02-20T13:30:25.016 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2026-02-20T13:30:25.200 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:25.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 -- 10.20.193.28:0/2874423773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66441188a0 msgr2=0x7f664411d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 --2- 10.20.193.28:0/2874423773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66441188a0 0x7f664411d8f0 secure :-1 s=READY pgs=1396 gs=1 cs=0 l=1 c_cookie=12195892123024030655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f662c009890 tx=0x7f662c02f120 comp rx=0 tx=0).stop 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 -- 10.20.193.28:0/2874423773 shutdown_connections 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 --2- 10.20.193.28:0/2874423773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66441188a0 0x7f664411d8f0 unknown :-1 s=CLOSED pgs=1396 gs=1 cs=0 l=1 c_cookie=12195892123024030655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 --2- 10.20.193.28:0/2874423773 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f664411e0a0 0x7f664417ea70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 --2- 10.20.193.28:0/2874423773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6644117eb0 0x7f6644118280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 -- 10.20.193.28:0/2874423773 >> 10.20.193.28:0/2874423773 conn(0x7f66440f5780 msgr2=0x7f6644115b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 -- 10.20.193.28:0/2874423773 shutdown_connections 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.381+0000 7f6648935640 1 -- 10.20.193.28:0/2874423773 wait complete. 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.382+0000 7f6648935640 1 Processor -- start 2026-02-20T13:30:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.382+0000 7f6648935640 1 -- start start 2026-02-20T13:30:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.382+0000 7f6648935640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6644117eb0 0x7f6644126820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.382+0000 7f6648935640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66441188a0 0x7f6644126d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.382+0000 7f6648935640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f664411e0a0 0x7f664412c130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.382+0000 7f6648935640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f664412c750 con 0x7f66441188a0 2026-02-20T13:30:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.382+0000 7f6648935640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f664412c8c0 con 0x7f664411e0a0 2026-02-20T13:30:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.382+0000 7f6648935640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f664412ca80 con 0x7f6644117eb0 2026-02-20T13:30:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6644117eb0 0x7f6644126820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66441188a0 0x7f6644126d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6644117eb0 0x7f6644126820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58042/0 (socket says 10.20.193.28:58042) 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 -- 10.20.193.28:0/1693609158 learned_addr learned my addr 10.20.193.28:0/1693609158 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6643577640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f664411e0a0 0x7f664412c130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 -- 10.20.193.28:0/1693609158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f664411e0a0 msgr2=0x7f664412c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f664411e0a0 0x7f664412c130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 -- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66441188a0 msgr2=0x7f6644126d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66441188a0 0x7f6644126d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 -- 10.20.193.28:0/1693609158 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c0094b0 con 0x7f6644117eb0 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6642d76640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6644117eb0 0x7f6644126820 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6638005940 tx=0x7f663800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6623fff640 1 -- 10.20.193.28:0/1693609158 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f663800cd10 con 0x7f6644117eb0 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6623fff640 1 -- 10.20.193.28:0/1693609158 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f663800ce70 con 0x7f6644117eb0 2026-02-20T13:30:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6648935640 1 -- 10.20.193.28:0/1693609158 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664412cd60 con 0x7f6644117eb0 2026-02-20T13:30:25.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6623fff640 1 -- 10.20.193.28:0/1693609158 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66380053c0 con 0x7f6644117eb0 2026-02-20T13:30:25.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.383+0000 7f6648935640 1 -- 10.20.193.28:0/1693609158 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f664416d460 con 0x7f6644117eb0 2026-02-20T13:30:25.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.386+0000 7f6623fff640 1 -- 10.20.193.28:0/1693609158 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6638005550 con 0x7f6644117eb0 2026-02-20T13:30:25.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.388+0000 7f6623fff640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66180b56e0 0x7f66180d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.388+0000 7f6623fff640 1 -- 10.20.193.28:0/1693609158 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6638014070 con 0x7f6644117eb0 2026-02-20T13:30:25.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.388+0000 7f6642575640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66180b56e0 0x7f66180d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f6642575640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66180b56e0 0x7f66180d5b90 secure :-1 s=READY pgs=578 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f664412d1c0 tx=0x7f662c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:25.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f664b130e00 1 Processor -- start 2026-02-20T13:30:25.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f664b130e00 1 -- start start 2026-02-20T13:30:25.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f664b130e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398c9c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f664b130e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f3990e8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f664b130e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f3992f1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f664b130e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f397de780 con 0x559f398ca160 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f664b130e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f397da4b0 con 0x559f3990ee00 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f664b130e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f397d4610 con 0x559f398c9850 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.389+0000 7f6642575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f3990e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f3990e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33192/0 (socket says 10.20.193.28:33192) 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642575640 1 -- 10.20.193.28:0/4096055265 learned_addr learned my addr 10.20.193.28:0/4096055265 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6643577640 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f3992f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642d76640 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642575640 1 -- 10.20.193.28:0/4096055265 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 msgr2=0x559f398c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642575640 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642575640 1 -- 10.20.193.28:0/4096055265 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 msgr2=0x559f3992f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642575640 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f3992f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642575640 1 -- 10.20.193.28:0/4096055265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3977fc50 con 0x559f398ca160 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f6642575640 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f3990e8c0 secure :-1 s=READY pgs=1397 gs=1 cs=0 l=1 c_cookie=13492971687130713506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f662c002d00 tx=0x7f662c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb40aa42b7d44da2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f660f7fe640 1 -- 10.20.193.28:0/4096055265 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f662c0042e0 con 0x559f398ca160 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f660f7fe640 1 -- 10.20.193.28:0/4096055265 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f662c03e040 con 0x559f398ca160 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f660f7fe640 1 -- 10.20.193.28:0/4096055265 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f662c04e8a0 con 0x559f398ca160 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f664b130e00 1 -- 10.20.193.28:0/4096055265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 msgr2=0x559f3990e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.390+0000 7f664b130e00 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f3990e8c0 secure :-1 s=READY pgs=1397 gs=1 cs=0 l=1 c_cookie=13492971687130713506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f662c002d00 tx=0x7f662c040000 comp rx=0 tx=0).stop 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.391+0000 7f664b130e00 1 -- 10.20.193.28:0/4096055265 shutdown_connections 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.391+0000 7f664b130e00 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f3990e8c0 unknown :-1 s=CLOSED pgs=1397 gs=1 cs=0 l=1 c_cookie=13492971687130713506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.391+0000 7f664b130e00 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f3992f1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.391+0000 7f664b130e00 1 --2- 10.20.193.28:0/4096055265 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398c9c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.391+0000 7f664b130e00 1 -- 10.20.193.28:0/4096055265 >> 10.20.193.28:0/4096055265 conn(0x559f397e7110 msgr2=0x559f398c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:25.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.391+0000 7f664b130e00 1 -- 10.20.193.28:0/4096055265 shutdown_connections 2026-02-20T13:30:25.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.391+0000 7f664b130e00 1 -- 10.20.193.28:0/4096055265 wait complete. 2026-02-20T13:30:25.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.392+0000 7f664b130e00 1 -- start start 2026-02-20T13:30:25.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.392+0000 7f664b130e00 1 Processor -- start 2026-02-20T13:30:25.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.392+0000 7f664b130e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398ea970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.392+0000 7f664b130e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f398eaeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.392+0000 7f664b130e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398ef810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.392+0000 7f664b130e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f398efd50 con 0x559f398ca160 2026-02-20T13:30:25.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.392+0000 7f664b130e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f398efec0 con 0x559f3990ee00 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.392+0000 7f664b130e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f398f0080 con 0x559f398c9850 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f398eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f398eaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33204/0 (socket says 10.20.193.28:33204) 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642575640 1 -- 10.20.193.28:0/465071774 learned_addr learned my addr 10.20.193.28:0/465071774 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6643577640 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642d76640 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642575640 1 -- 10.20.193.28:0/465071774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 msgr2=0x559f398ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642575640 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398ea970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642575640 1 -- 10.20.193.28:0/465071774 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 msgr2=0x559f398ef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642575640 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398ef810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.393+0000 7f6642575640 1 -- 10.20.193.28:0/465071774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f39757e60 con 0x559f398ca160 2026-02-20T13:30:25.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f6642575640 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f398eaeb0 secure :-1 s=READY pgs=1398 gs=1 cs=0 l=1 c_cookie=14280819620639917975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f662c04e990 tx=0x7f662c002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62fa9c82dabc797 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f660cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f660cff9640 1 -- 10.20.193.28:0/465071774 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f662c04ea30 con 0x559f398ca160 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f664417f2e0 con 0x559f398ca160 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f660cff9640 1 -- 10.20.193.28:0/465071774 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f662c0045a0 con 0x559f398ca160 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f660cff9640 1 -- 10.20.193.28:0/465071774 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f662c0619b0 con 0x559f398ca160 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f664b130e00 10 client.20232 _ll_register_callbacks cb 0x559f39755320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f3946aeb0 con 0x559f398ca160 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.394+0000 7f660cff9640 1 -- 10.20.193.28:0/465071774 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f662c061b40 con 0x559f398ca160 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f660cff9640 1 -- 10.20.193.28:0/465071774 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f662c061d20 con 0x559f398ca160 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f664b130e00 10 client.20232 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559f39769d80 con 0x559f398ca160 2026-02-20T13:30:25.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f660cff9640 1 -- 10.20.193.28:0/465071774 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f662c04eb90 con 0x559f398ca160 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f664b130e00 10 client.20232 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f664b130e00 10 client.20232 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f664b130e00 20 client.20232 populate_metadata read hostname 'trial028' 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f664b130e00 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f398f4690 0x559f398f4b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f664b130e00 4 client.20232 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f397a6700 con 0x559f398f4690 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.395+0000 7f6642d76640 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f398f4690 0x559f398f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f6642d76640 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f398f4690 0x559f398f4b30 crc :-1 s=READY pgs=378 gs=4 cs=0 l=0 c_cookie=8712325886487037340 s_cookie=14705120687831702906 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78e8663bdf80059c server_cookie=cc13155ac174dd7a in_seq=0 out_seq=0 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f660cff9640 10 client.20232 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f660cff9640 1 -- 10.20.193.28:0/465071774 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559f397a6700 con 0x559f398f4690 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f660cff9640 10 client.20232 handle_command_reply: tid=0 2026-02-20T13:30:25.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 client.20232 shutdown 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 msgr2=0x559f398eaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f398eaeb0 secure :-1 s=READY pgs=1398 gs=1 cs=0 l=1 c_cookie=14280819620639917975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f662c04e990 tx=0x7f662c002390 comp rx=0 tx=0).stop 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 shutdown_connections 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f398f4690 0x559f398f4b30 crc :-1 s=READY pgs=378 gs=4 cs=0 l=0 c_cookie=8712325886487037340 s_cookie=14705120687831702906 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398ca160 0x559f398eaeb0 unknown :-1 s=CLOSED pgs=1398 gs=1 cs=0 l=1 c_cookie=14280819620639917975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398ef810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f660cff9640 0 client.20232 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 --2- 10.20.193.28:0/465071774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398ea970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.396+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 >> 10.20.193.28:0/465071774 conn(0x559f397e7110 msgr2=0x559f398b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.397+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 shutdown_connections 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.397+0000 7f664b130e00 1 -- 10.20.193.28:0/465071774 wait complete. 2026-02-20T13:30:25.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.397+0000 7f664b130e00 20 client.20232 trim_cache size 0 max 16384 2026-02-20T13:30:25.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.405+0000 7f664b130e00 1 Processor -- start 2026-02-20T13:30:25.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f664b130e00 1 -- start start 2026-02-20T13:30:25.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f664b130e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398c9850 0x559f398b4260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f664b130e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398ca160 0x559f398b47a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f664b130e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398c5f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f664b130e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f397d2240 con 0x559f398c9850 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f664b130e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f39492ec0 con 0x559f3990ee00 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f664b130e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f398f01c0 con 0x559f398ca160 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398c9850 0x559f398b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398c9850 0x559f398b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33220/0 (socket says 10.20.193.28:33220) 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 -- 10.20.193.28:0/2369648873 learned_addr learned my addr 10.20.193.28:0/2369648873 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6643577640 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642575640 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398ca160 0x559f398b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 -- 10.20.193.28:0/2369648873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398ca160 msgr2=0x559f398b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398ca160 0x559f398b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 -- 10.20.193.28:0/2369648873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 msgr2=0x559f398c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 -- 10.20.193.28:0/2369648873 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f398bbee0 con 0x559f398c9850 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6643577640 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398c5f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.406+0000 7f6642d76640 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398c9850 0x559f398b4260 secure :-1 s=READY pgs=1399 gs=1 cs=0 l=1 c_cookie=16801419917612065573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6638005520 tx=0x7f66380e4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92aa265b770a325 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f660effd640 1 -- 10.20.193.28:0/2369648873 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66380ad8b0 con 0x559f398c9850 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f660effd640 1 -- 10.20.193.28:0/2369648873 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66380b2bd0 con 0x559f398c9850 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f660effd640 1 -- 10.20.193.28:0/2369648873 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66380e4790 con 0x559f398c9850 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 -- 10.20.193.28:0/2369648873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398c9850 msgr2=0x559f398b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398c9850 0x559f398b4260 secure :-1 s=READY pgs=1399 gs=1 cs=0 l=1 c_cookie=16801419917612065573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6638005520 tx=0x7f66380e4040 comp rx=0 tx=0).stop 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 -- 10.20.193.28:0/2369648873 shutdown_connections 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f3990ee00 0x559f398c5f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398ca160 0x559f398b47a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 --2- 10.20.193.28:0/2369648873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f398c9850 0x559f398b4260 unknown :-1 s=CLOSED pgs=1399 gs=1 cs=0 l=1 c_cookie=16801419917612065573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 -- 10.20.193.28:0/2369648873 >> 10.20.193.28:0/2369648873 conn(0x559f397e7110 msgr2=0x559f398c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 -- 10.20.193.28:0/2369648873 shutdown_connections 2026-02-20T13:30:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.407+0000 7f664b130e00 1 -- 10.20.193.28:0/2369648873 wait complete. 2026-02-20T13:30:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f664b130e00 1 -- start start 2026-02-20T13:30:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f664b130e00 1 Processor -- start 2026-02-20T13:30:25.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f664b130e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398f7920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f664b130e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f398ca160 0x559f398f7e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f664b130e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f3990ee00 0x559f398f83a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f664b130e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559f398eb4b0 con 0x559f3990ee00 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f664b130e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559f399c3560 con 0x559f398ca160 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f664b130e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559f399c3720 con 0x559f398c9850 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f6642575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f398ca160 0x559f398f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f6642575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f398ca160 0x559f398f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50166/0 (socket says 10.20.193.28:50166) 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f6642575640 1 -- 10.20.193.28:0/1944431361 learned_addr learned my addr 10.20.193.28:0/1944431361 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f6642d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.408+0000 7f6643577640 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f3990ee00 0x559f398f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f6642d76640 1 -- 10.20.193.28:0/1944431361 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f398ca160 msgr2=0x559f398f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f6642d76640 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f398ca160 0x559f398f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f6642d76640 1 -- 10.20.193.28:0/1944431361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f3990ee00 msgr2=0x559f398f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f6642d76640 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f3990ee00 0x559f398f83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f6642d76640 1 -- 10.20.193.28:0/1944431361 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f39764800 con 0x559f398c9850 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f6643577640 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f3990ee00 0x559f398f83a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f6642d76640 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398f7920 secure :-1 s=READY pgs=397 gs=2 cs=0 l=1 c_cookie=8059455013708572530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6638005520 tx=0x7f6638004e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fd8efa257572772 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f660cff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f660cff9640 1 -- 10.20.193.28:0/1944431361 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66380047e0 con 0x559f398c9850 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f660cff9640 1 -- 10.20.193.28:0/1944431361 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66380ad8b0 con 0x559f398c9850 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f660cff9640 1 -- 10.20.193.28:0/1944431361 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66380aca50 con 0x559f398c9850 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f664416d460 con 0x559f398c9850 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f660cff9640 1 -- 10.20.193.28:0/1944431361 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f66380acbe0 con 0x559f398c9850 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f664b130e00 10 client.30040 _ll_register_callbacks cb 0x559f39755320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.409+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f662c03e040 con 0x559f398c9850 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f660cff9640 1 -- 10.20.193.28:0/1944431361 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f66380adb40 con 0x559f398c9850 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f664b130e00 10 client.30040 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559f39758190 con 0x559f398c9850 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f660cff9640 1 -- 10.20.193.28:0/1944431361 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f66380b2070 con 0x559f398c9850 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f664b130e00 10 client.30040 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f664b130e00 10 client.30040 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f664b130e00 20 client.30040 populate_metadata read hostname 'trial028' 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f664b130e00 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f399c4fa0 0x559f399e5450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f664b130e00 4 client.30040 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x559f394b3a60 con 0x559f399c4fa0 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.410+0000 7f6642575640 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f399c4fa0 0x559f399e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:25.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.411+0000 7f6642575640 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f399c4fa0 0x559f399e5450 crc :-1 s=READY pgs=379 gs=4 cs=0 l=0 c_cookie=6426167419408084456 s_cookie=9223634633210319903 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=592e55387d01ede8 server_cookie=8000eed47a7dd41f in_seq=0 out_seq=0 2026-02-20T13:30:25.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.411+0000 7f660cff9640 10 client.30040 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f660cff9640 1 -- 10.20.193.28:0/1944431361 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559f394b3a60 con 0x559f399c4fa0 2026-02-20T13:30:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f660cff9640 10 client.30040 handle_command_reply: tid=0 2026-02-20T13:30:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 client.30040 shutdown 2026-02-20T13:30:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 msgr2=0x559f398f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398f7920 secure :-1 s=READY pgs=397 gs=2 cs=0 l=1 c_cookie=8059455013708572530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6638005520 tx=0x7f6638004e10 comp rx=0 tx=0).stop 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 shutdown_connections 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559f399c4fa0 0x559f399e5450 crc :-1 s=READY pgs=379 gs=4 cs=0 l=0 c_cookie=6426167419408084456 s_cookie=9223634633210319903 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559f3990ee00 0x559f398f83a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559f398ca160 0x559f398f7e60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 --2- 10.20.193.28:0/1944431361 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559f398c9850 0x559f398f7920 unknown :-1 s=CLOSED pgs=397 gs=2 cs=0 l=1 c_cookie=8059455013708572530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 >> 10.20.193.28:0/1944431361 conn(0x559f397e7110 msgr2=0x559f398c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f660cff9640 0 client.30040 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 shutdown_connections 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 1 -- 10.20.193.28:0/1944431361 wait complete. 2026-02-20T13:30:25.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.415+0000 7f664b130e00 20 client.30040 trim_cache size 0 max 16384 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 46, 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout: "a436efaf": { 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout: "version": 46, 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:30:25.422 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 130.0, 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:30:25.423 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:25.424 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:25.424 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:25.424 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:25.424 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:25.424 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 -- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66180b56e0 msgr2=0x7f66180d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66180b56e0 0x7f66180d5b90 secure :-1 s=READY pgs=578 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f664412d1c0 tx=0x7f662c03a040 comp rx=0 tx=0).stop 2026-02-20T13:30:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 -- 10.20.193.28:0/1693609158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6644117eb0 msgr2=0x7f6644126820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6644117eb0 0x7f6644126820 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6638005940 tx=0x7f663800ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 -- 10.20.193.28:0/1693609158 shutdown_connections 2026-02-20T13:30:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66180b56e0 0x7f66180d5b90 unknown :-1 s=CLOSED pgs=578 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66441188a0 0x7f6644126d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f664411e0a0 0x7f664412c130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 --2- 10.20.193.28:0/1693609158 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6644117eb0 0x7f6644126820 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:25.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 -- 10.20.193.28:0/1693609158 >> 10.20.193.28:0/1693609158 conn(0x7f66440f5780 msgr2=0x7f6644115b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:25.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 -- 10.20.193.28:0/1693609158 shutdown_connections 2026-02-20T13:30:25.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:25.416+0000 7f6648935640 1 -- 10.20.193.28:0/1693609158 wait complete. 2026-02-20T13:30:25.519 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a436efaf', quiesce took 1.1 seconds. Will release after: 8.9 2026-02-20T13:30:25.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:25 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4144374685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:25.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:25 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4144374685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:25.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:25 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4144374685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:26 trial127 ceph-mon[43817]: pgmap v574: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:30:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:26 trial034 ceph-mon[43332]: pgmap v574: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:30:27.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:26 trial028 ceph-mon[37442]: pgmap v574: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:30:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:28 trial127 ceph-mon[43817]: pgmap v575: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.4 KiB/s wr, 19 op/s 2026-02-20T13:30:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:28 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:30:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:28 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:30:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:28 trial034 ceph-mon[43332]: pgmap v575: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.4 KiB/s wr, 19 op/s 2026-02-20T13:30:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:28 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:30:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:28 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:30:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:28 trial028 ceph-mon[37442]: pgmap v575: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 9.4 KiB/s wr, 19 op/s 2026-02-20T13:30:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:28 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:30:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:28 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:30:29.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:29 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:30:29.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:29 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:30:30.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:29 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:30:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:30 trial127 ceph-mon[43817]: pgmap v576: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:30:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:30 trial034 ceph-mon[43332]: pgmap v576: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:30:31.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:30 trial028 ceph-mon[37442]: pgmap v576: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:30:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:32 trial127 ceph-mon[43817]: pgmap v577: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:30:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:32 trial034 ceph-mon[43332]: pgmap v577: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:30:33.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:32 trial028 ceph-mon[37442]: pgmap v577: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:30:34.420 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:30:34.606 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 -- 10.20.193.28:0/730279466 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa03c10d340 msgr2=0x7fa03c10d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 --2- 10.20.193.28:0/730279466 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa03c10d340 0x7fa03c10d730 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=16467755631770013252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa030009950 tx=0x7fa03002f190 comp rx=0 tx=0).stop 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 -- 10.20.193.28:0/730279466 shutdown_connections 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 --2- 10.20.193.28:0/730279466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa03c10dd00 0x7fa03c10aec0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 --2- 10.20.193.28:0/730279466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa03c10b510 0x7fa03c10b9b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 --2- 10.20.193.28:0/730279466 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa03c10d340 0x7fa03c10d730 unknown :-1 s=CLOSED pgs=398 gs=1 cs=0 l=1 c_cookie=16467755631770013252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 -- 10.20.193.28:0/730279466 >> 10.20.193.28:0/730279466 conn(0x7fa03c0e8a80 msgr2=0x7fa03c108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 -- 10.20.193.28:0/730279466 shutdown_connections 2026-02-20T13:30:34.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.702+0000 7fa03b577640 1 -- 10.20.193.28:0/730279466 wait complete. 2026-02-20T13:30:34.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.703+0000 7fa03b577640 1 Processor -- start 2026-02-20T13:30:34.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.703+0000 7fa03b577640 1 -- start start 2026-02-20T13:30:34.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.703+0000 7fa03b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa03c10b510 0x7fa03c0f4470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.703+0000 7fa03b577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa03c10d340 0x7fa03c0f4ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.703+0000 7fa03b577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa03c10dd00 0x7fa03c0f56c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.703+0000 7fa03b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0f5e00 con 0x7fa03c10b510 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.703+0000 7fa03b577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0f5f70 con 0x7fa03c10d340 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.703+0000 7fa03b577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0f6130 con 0x7fa03c10dd00 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa03c10b510 0x7fa03c0f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa03c10b510 0x7fa03c0f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33264/0 (socket says 10.20.193.28:33264) 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 -- 10.20.193.28:0/1477761183 learned_addr learned my addr 10.20.193.28:0/1477761183 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03ad76640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa03c10dd00 0x7fa03c0f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa039d74640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa03c10d340 0x7fa03c0f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 -- 10.20.193.28:0/1477761183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa03c10dd00 msgr2=0x7fa03c0f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa03c10dd00 0x7fa03c0f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 -- 10.20.193.28:0/1477761183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa03c10d340 msgr2=0x7fa03c0f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa03c10d340 0x7fa03c0f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 -- 10.20.193.28:0/1477761183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0240094b0 con 0x7fa03c10b510 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03a575640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa03c10b510 0x7fa03c0f4470 secure :-1 s=READY pgs=1400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa030002d80 tx=0x7fa0300028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa0237fe640 1 -- 10.20.193.28:0/1477761183 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa03003d070 con 0x7fa03c10b510 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa0237fe640 1 -- 10.20.193.28:0/1477761183 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa030002a40 con 0x7fa03c10b510 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa0237fe640 1 -- 10.20.193.28:0/1477761183 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa030041cf0 con 0x7fa03c10b510 2026-02-20T13:30:34.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03b577640 1 -- 10.20.193.28:0/1477761183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa030009570 con 0x7fa03c10b510 2026-02-20T13:30:34.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.704+0000 7fa03b577640 1 -- 10.20.193.28:0/1477761183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03c10e2a0 con 0x7fa03c10b510 2026-02-20T13:30:34.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.707+0000 7fa0237fe640 1 -- 10.20.193.28:0/1477761183 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa030038920 con 0x7fa03c10b510 2026-02-20T13:30:34.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.709+0000 7fa0237fe640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa0140b5760 0x7fa0140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.709+0000 7fa0237fe640 1 -- 10.20.193.28:0/1477761183 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa03010b5a0 con 0x7fa03c10b510 2026-02-20T13:30:34.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.709+0000 7fa039d74640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa0140b5760 0x7fa0140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.709+0000 7fa0433dee00 1 Processor -- start 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa0433dee00 1 -- start start 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa0140b5760 0x7fa0140d5c10 secure :-1 s=READY pgs=580 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa024004740 tx=0x7fa024005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715578a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x5642715781c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x564271598ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa0433dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56427144cfd0 con 0x564271557de0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa0433dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564271448d00 con 0x5642715374c0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa0433dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564271442ca0 con 0x564271578700 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x5642715781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x5642715781c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33278/0 (socket says 10.20.193.28:33278) 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 -- 10.20.193.28:0/3672196340 learned_addr learned my addr 10.20.193.28:0/3672196340 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa03ad76640 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x564271598ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa03a575640 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 -- 10.20.193.28:0/3672196340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 msgr2=0x564271598ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x564271598ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 -- 10.20.193.28:0/3672196340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 msgr2=0x5642715578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 -- 10.20.193.28:0/3672196340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642713e58b0 con 0x564271557de0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa03ad76640 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x564271598ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.710+0000 7fa039d74640 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x5642715781c0 secure :-1 s=READY pgs=1401 gs=1 cs=0 l=1 c_cookie=6961908931626781464 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa024009dd0 tx=0x7fa024014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609dab499c3bcb18 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:34.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa020ff9640 1 -- 10.20.193.28:0/3672196340 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa024012bf0 con 0x564271557de0 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa020ff9640 1 -- 10.20.193.28:0/3672196340 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa024016070 con 0x564271557de0 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa020ff9640 1 -- 10.20.193.28:0/3672196340 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa02401e820 con 0x564271557de0 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 -- 10.20.193.28:0/3672196340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 msgr2=0x5642715781c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x5642715781c0 secure :-1 s=READY pgs=1401 gs=1 cs=0 l=1 c_cookie=6961908931626781464 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa024009dd0 tx=0x7fa024014000 comp rx=0 tx=0).stop 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 -- 10.20.193.28:0/3672196340 shutdown_connections 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x5642715781c0 unknown :-1 s=CLOSED pgs=1401 gs=1 cs=0 l=1 c_cookie=6961908931626781464 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x564271598ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3672196340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715578a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 -- 10.20.193.28:0/3672196340 >> 10.20.193.28:0/3672196340 conn(0x5642714561c0 msgr2=0x564271535da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 -- 10.20.193.28:0/3672196340 shutdown_connections 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.711+0000 7fa0433dee00 1 -- 10.20.193.28:0/3672196340 wait complete. 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.712+0000 7fa0433dee00 1 -- start start 2026-02-20T13:30:34.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.712+0000 7fa0433dee00 1 Processor -- start 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x564271550ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271557de0 0x564271551100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271578700 0x564271551b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa0433dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5642715521c0 con 0x564271578700 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa0433dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564271552330 con 0x5642715374c0 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa0433dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5642715524f0 con 0x564271557de0 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271578700 0x564271551b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271578700 0x564271551b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33288/0 (socket says 10.20.193.28:33288) 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03ad76640 1 -- 10.20.193.28:0/3366198283 learned_addr learned my addr 10.20.193.28:0/3366198283 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa039d74640 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271557de0 0x564271551100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03a575640 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x564271550ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03ad76640 1 -- 10.20.193.28:0/3366198283 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271557de0 msgr2=0x564271551100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03ad76640 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271557de0 0x564271551100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03ad76640 1 -- 10.20.193.28:0/3366198283 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 msgr2=0x564271550ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03ad76640 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x564271550ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa03ad76640 1 -- 10.20.193.28:0/3366198283 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642713ee400 con 0x564271578700 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.713+0000 7fa039d74640 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271557de0 0x564271551100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7fa03ad76640 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271578700 0x564271551b60 secure :-1 s=READY pgs=1402 gs=3 cs=0 l=1 c_cookie=10852641690020090036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa02c005050 tx=0x7fa02c0127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969c541e083e10b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7f9fe7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7f9fe7fff640 1 -- 10.20.193.28:0/3366198283 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa02c01c690 con 0x564271578700 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7f9fe7fff640 1 -- 10.20.193.28:0/3366198283 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa02c01ccd0 con 0x564271578700 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7f9fe7fff640 1 -- 10.20.193.28:0/3366198283 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa02c0103d0 con 0x564271578700 2026-02-20T13:30:34.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa024002e20 con 0x564271578700 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7f9fe7fff640 1 -- 10.20.193.28:0/3366198283 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa02c010560 con 0x564271578700 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7f9fe7fff640 10 client.20250 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7fa0433dee00 10 client.20250 _ll_register_callbacks cb 0x5642713cda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.714+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642710e2520 con 0x564271578700 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7f9fe7fff640 1 -- 10.20.193.28:0/3366198283 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa02c01ce40 con 0x564271578700 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa0433dee00 10 client.20250 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5642713c6da0 con 0x564271578700 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7f9fe7fff640 1 -- 10.20.193.28:0/3366198283 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa02c01c7f0 con 0x564271578700 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa0433dee00 10 client.20250 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa0433dee00 10 client.20250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa0433dee00 20 client.20250 populate_metadata read hostname 'trial028' 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5642715551e0 0x564271555650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa0433dee00 4 client.20250 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564271474630 con 0x5642715551e0 2026-02-20T13:30:34.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.715+0000 7fa03a575640 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5642715551e0 0x564271555650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.716+0000 7fa03a575640 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5642715551e0 0x564271555650 crc :-1 s=READY pgs=380 gs=4 cs=0 l=0 c_cookie=12140083819705736192 s_cookie=14846151318262253113 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a87a3de9c1071c00 server_cookie=ce081ff736b80639 in_seq=0 out_seq=0 2026-02-20T13:30:34.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.716+0000 7f9fe7fff640 10 client.20250 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7f9fe7fff640 1 -- 10.20.193.28:0/3366198283 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564271474630 con 0x5642715551e0 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7f9fe7fff640 10 client.20250 handle_command_reply: tid=0 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 client.20250 shutdown 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271578700 msgr2=0x564271551b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271578700 0x564271551b60 secure :-1 s=READY pgs=1402 gs=3 cs=0 l=1 c_cookie=10852641690020090036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa02c005050 tx=0x7fa02c0127b0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 shutdown_connections 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5642715551e0 0x564271555650 crc :-1 s=READY pgs=380 gs=4 cs=0 l=0 c_cookie=12140083819705736192 s_cookie=14846151318262253113 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271578700 0x564271551b60 unknown :-1 s=CLOSED pgs=1402 gs=3 cs=0 l=1 c_cookie=10852641690020090036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271557de0 0x564271551100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 --2- 10.20.193.28:0/3366198283 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x564271550ab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 >> 10.20.193.28:0/3366198283 conn(0x5642714561c0 msgr2=0x564271538790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7f9fe7fff640 0 client.20250 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 shutdown_connections 2026-02-20T13:30:34.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.718+0000 7fa0433dee00 1 -- 10.20.193.28:0/3366198283 wait complete. 2026-02-20T13:30:34.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.719+0000 7fa0433dee00 20 client.20250 trim_cache size 0 max 16384 2026-02-20T13:30:34.722 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:34 trial028 ceph-mon[37442]: pgmap v578: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2026-02-20T13:30:34.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.726+0000 7fa0433dee00 1 Processor -- start 2026-02-20T13:30:34.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.726+0000 7fa0433dee00 1 -- start start 2026-02-20T13:30:34.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x56427153b8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x56427154dde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x56427154e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa0433dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5642714408d0 con 0x564271557de0 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa0433dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564271181f10 con 0x5642715374c0 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa0433dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564271549bb0 con 0x564271578700 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x56427154dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x56427154dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33294/0 (socket says 10.20.193.28:33294) 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 -- 10.20.193.28:0/4052138643 learned_addr learned my addr 10.20.193.28:0/4052138643 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa03a575640 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x56427153b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa03ad76640 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x56427154e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 -- 10.20.193.28:0/4052138643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 msgr2=0x56427154e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x56427154e320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 -- 10.20.193.28:0/4052138643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 msgr2=0x56427153b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x56427153b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 -- 10.20.193.28:0/4052138643 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642713d8670 con 0x564271557de0 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa039d74640 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x56427154dde0 secure :-1 s=READY pgs=1403 gs=1 cs=0 l=1 c_cookie=16716294573767767762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa024009dd0 tx=0x7fa024002da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fc35591e37b6d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.727+0000 7fa0063ff640 1 -- 10.20.193.28:0/4052138643 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa024012bf0 con 0x564271557de0 2026-02-20T13:30:34.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0063ff640 1 -- 10.20.193.28:0/4052138643 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa024016050 con 0x564271557de0 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0063ff640 1 -- 10.20.193.28:0/4052138643 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa02401d7b0 con 0x564271557de0 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 -- 10.20.193.28:0/4052138643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 msgr2=0x56427154dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x56427154dde0 secure :-1 s=READY pgs=1403 gs=1 cs=0 l=1 c_cookie=16716294573767767762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa024009dd0 tx=0x7fa024002da0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 -- 10.20.193.28:0/4052138643 shutdown_connections 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x56427154dde0 unknown :-1 s=CLOSED pgs=1403 gs=1 cs=0 l=1 c_cookie=16716294573767767762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x56427154e320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 --2- 10.20.193.28:0/4052138643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x56427153b8b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 -- 10.20.193.28:0/4052138643 >> 10.20.193.28:0/4052138643 conn(0x5642714561c0 msgr2=0x564271550920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 -- 10.20.193.28:0/4052138643 shutdown_connections 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 -- 10.20.193.28:0/4052138643 wait complete. 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.728+0000 7fa0433dee00 1 -- start start 2026-02-20T13:30:34.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa0433dee00 1 Processor -- start 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715596d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x564271559c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa0433dee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x56427155a380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa03a575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa0433dee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56427155aa80 con 0x564271557de0 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa0433dee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56427155abf0 con 0x5642715374c0 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa0433dee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56427155adb0 con 0x564271578700 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa039d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x564271559c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa03a575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50966/0 (socket says 10.20.193.28:50966) 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.729+0000 7fa03a575640 1 -- 10.20.193.28:0/1409057992 learned_addr learned my addr 10.20.193.28:0/1409057992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa03ad76640 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x56427155a380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa039d74640 1 -- 10.20.193.28:0/1409057992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 msgr2=0x56427155a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa039d74640 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x56427155a380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa039d74640 1 -- 10.20.193.28:0/1409057992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 msgr2=0x5642715596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa039d74640 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa039d74640 1 -- 10.20.193.28:0/1409057992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642713d30f0 con 0x564271557de0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa039d74640 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x564271559c90 secure :-1 s=READY pgs=1404 gs=2 cs=0 l=1 c_cookie=10051685630642529439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa024009dd0 tx=0x7fa024009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7ec2d33058a49f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7f9fe7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7f9fe7fff640 1 -- 10.20.193.28:0/1409057992 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa02403f070 con 0x564271557de0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7f9fe7fff640 1 -- 10.20.193.28:0/1409057992 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa024012db0 con 0x564271557de0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7f9fe7fff640 1 -- 10.20.193.28:0/1409057992 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa02403b6b0 con 0x564271557de0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642713e58b0 con 0x564271557de0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7f9fe7fff640 1 -- 10.20.193.28:0/1409057992 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa02403b840 con 0x564271557de0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa0433dee00 10 client.20256 _ll_register_callbacks cb 0x5642713cda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:34.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.730+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642714f2ca0 con 0x564271557de0 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7f9fe7fff640 1 -- 10.20.193.28:0/1409057992 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa02401e5e0 con 0x564271557de0 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa0433dee00 10 client.20256 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5642713c70d0 con 0x564271557de0 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7f9fe7fff640 1 -- 10.20.193.28:0/1409057992 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa02401d940 con 0x564271557de0 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa0433dee00 10 client.20256 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa0433dee00 10 client.20256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa0433dee00 20 client.20256 populate_metadata read hostname 'trial028' 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa0433dee00 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56427155c800 0x56427155cca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa0433dee00 4 client.20256 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564271126640 con 0x56427155c800 2026-02-20T13:30:34.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.731+0000 7fa03a575640 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56427155c800 0x56427155cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.732+0000 7fa03a575640 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56427155c800 0x56427155cca0 crc :-1 s=READY pgs=381 gs=4 cs=0 l=0 c_cookie=1606066093306641581 s_cookie=10606586712403978267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1649e49a41577cad server_cookie=93322a6b3837a81b in_seq=0 out_seq=0 2026-02-20T13:30:34.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.732+0000 7f9fe7fff640 10 client.20256 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:34.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7f9fe7fff640 1 -- 10.20.193.28:0/1409057992 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564271126640 con 0x56427155c800 2026-02-20T13:30:34.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7f9fe7fff640 10 client.20256 handle_command_reply: tid=0 2026-02-20T13:30:34.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 client.20256 shutdown 2026-02-20T13:30:34.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 msgr2=0x564271559c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x564271559c90 secure :-1 s=READY pgs=1404 gs=2 cs=0 l=1 c_cookie=10051685630642529439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa024009dd0 tx=0x7fa024009fa0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 shutdown_connections 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56427155c800 0x56427155cca0 crc :-1 s=READY pgs=381 gs=4 cs=0 l=0 c_cookie=1606066093306641581 s_cookie=10606586712403978267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564271557de0 0x564271559c90 unknown :-1 s=CLOSED pgs=1404 gs=2 cs=0 l=1 c_cookie=10051685630642529439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564271578700 0x56427155a380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7f9fe7fff640 0 client.20256 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 --2- 10.20.193.28:0/1409057992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5642715374c0 0x5642715596d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.736+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 >> 10.20.193.28:0/1409057992 conn(0x5642714561c0 msgr2=0x56427154cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.737+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 shutdown_connections 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.737+0000 7fa0433dee00 1 -- 10.20.193.28:0/1409057992 wait complete. 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.737+0000 7fa0433dee00 20 client.20256 trim_cache size 0 max 16384 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.737+0000 7fa03b577640 1 -- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa0140b5760 msgr2=0x7fa0140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.737+0000 7fa03b577640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa0140b5760 0x7fa0140d5c10 secure :-1 s=READY pgs=580 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa024004740 tx=0x7fa024005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.737+0000 7fa03b577640 1 -- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa03c10b510 msgr2=0x7fa03c0f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.737+0000 7fa03b577640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa03c10b510 0x7fa03c0f4470 secure :-1 s=READY pgs=1400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa030002d80 tx=0x7fa0300028d0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.738+0000 7fa03b577640 1 -- 10.20.193.28:0/1477761183 shutdown_connections 2026-02-20T13:30:34.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.738+0000 7fa03b577640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa0140b5760 0x7fa0140d5c10 unknown :-1 s=CLOSED pgs=580 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.738+0000 7fa03b577640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa03c10dd00 0x7fa03c0f56c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.738+0000 7fa03b577640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa03c10d340 0x7fa03c0f4ac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.738+0000 7fa03b577640 1 --2- 10.20.193.28:0/1477761183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa03c10b510 0x7fa03c0f4470 unknown :-1 s=CLOSED pgs=1400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.738+0000 7fa03b577640 1 -- 10.20.193.28:0/1477761183 >> 10.20.193.28:0/1477761183 conn(0x7fa03c0e8a80 msgr2=0x7fa03c0ea730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:34.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.738+0000 7fa03b577640 1 -- 10.20.193.28:0/1477761183 shutdown_connections 2026-02-20T13:30:34.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:34.738+0000 7fa03b577640 1 -- 10.20.193.28:0/1477761183 wait complete. 2026-02-20T13:30:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.797+0000 7fdb721c9640 1 -- 10.20.193.28:0/801952551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10dc30 msgr2=0x7fdb6c112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.797+0000 7fdb721c9640 1 --2- 10.20.193.28:0/801952551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10dc30 0x7fdb6c112c80 secure :-1 s=READY pgs=1405 gs=1 cs=0 l=1 c_cookie=6939931422726937249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb60009950 tx=0x7fdb6002f190 comp rx=0 tx=0).stop 2026-02-20T13:30:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 -- 10.20.193.28:0/801952551 shutdown_connections 2026-02-20T13:30:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 --2- 10.20.193.28:0/801952551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10dc30 0x7fdb6c112c80 unknown :-1 s=CLOSED pgs=1405 gs=1 cs=0 l=1 c_cookie=6939931422726937249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 --2- 10.20.193.28:0/801952551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6c113430 0x7fdb6c173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 --2- 10.20.193.28:0/801952551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb6c10d240 0x7fdb6c10d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 -- 10.20.193.28:0/801952551 >> 10.20.193.28:0/801952551 conn(0x7fdb6c0eaad0 msgr2=0x7fdb6c10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:34.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 -- 10.20.193.28:0/801952551 shutdown_connections 2026-02-20T13:30:34.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 -- 10.20.193.28:0/801952551 wait complete. 2026-02-20T13:30:34.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 Processor -- start 2026-02-20T13:30:34.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.798+0000 7fdb721c9640 1 -- start start 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb721c9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10d240 0x7fdb6c0f5730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb721c9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6c10dc30 0x7fdb6c173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb721c9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb6c113430 0x7fdb6c0f5e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb721c9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c0fb040 con 0x7fdb6c10d240 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb721c9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c0fb1b0 con 0x7fdb6c113430 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb721c9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c0fb370 con 0x7fdb6c10dc30 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10d240 0x7fdb6c0f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb719c8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb6c113430 0x7fdb6c0f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10d240 0x7fdb6c0f5730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33320/0 (socket says 10.20.193.28:33320) 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 -- 10.20.193.28:0/321804469 learned_addr learned my addr 10.20.193.28:0/321804469 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb709c6640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6c10dc30 0x7fdb6c173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 -- 10.20.193.28:0/321804469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6c10dc30 msgr2=0x7fdb6c173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6c10dc30 0x7fdb6c173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 -- 10.20.193.28:0/321804469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb6c113430 msgr2=0x7fdb6c0f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb6c113430 0x7fdb6c0f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 -- 10.20.193.28:0/321804469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb60009570 con 0x7fdb6c10d240 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb711c7640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10d240 0x7fdb6c0f5730 secure :-1 s=READY pgs=1406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb5c00d950 tx=0x7fdb5c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb5a7fc640 1 -- 10.20.193.28:0/321804469 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb5c004540 con 0x7fdb6c10d240 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb5a7fc640 1 -- 10.20.193.28:0/321804469 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb5c009d00 con 0x7fdb6c10d240 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb5a7fc640 1 -- 10.20.193.28:0/321804469 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb5c0106e0 con 0x7fdb6c10d240 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.799+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c0fb650 con 0x7fdb6c10d240 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.800+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c0fbb70 con 0x7fdb6c10d240 2026-02-20T13:30:34.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.800+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb34005300 con 0x7fdb6c10d240 2026-02-20T13:30:34.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.802+0000 7fdb5a7fc640 1 -- 10.20.193.28:0/321804469 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fdb5c0097c0 con 0x7fdb6c10d240 2026-02-20T13:30:34.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.804+0000 7fdb5a7fc640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb480b5750 0x7fdb480d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:34.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.804+0000 7fdb5a7fc640 1 -- 10.20.193.28:0/321804469 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdb5c0e7250 con 0x7fdb6c10d240 2026-02-20T13:30:34.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.804+0000 7fdb709c6640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb480b5750 0x7fdb480d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:34.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.805+0000 7fdb5a7fc640 1 -- 10.20.193.28:0/321804469 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fdb5c0e76d0 con 0x7fdb6c10d240 2026-02-20T13:30:34.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.805+0000 7fdb709c6640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb480b5750 0x7fdb480d5c00 secure :-1 s=READY pgs=581 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb600023d0 tx=0x7fdb60031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.944+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb34005950 con 0x7fdb6c10d240 2026-02-20T13:30:34.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.944+0000 7fdb5a7fc640 1 -- 10.20.193.28:0/321804469 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7fdb5c0a9c00 con 0x7fdb6c10d240 2026-02-20T13:30:34.947 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:30:34.947 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:30:34.947 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:30:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb480b5750 msgr2=0x7fdb480d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb480b5750 0x7fdb480d5c00 secure :-1 s=READY pgs=581 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb600023d0 tx=0x7fdb60031040 comp rx=0 tx=0).stop 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10d240 msgr2=0x7fdb6c0f5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10d240 0x7fdb6c0f5730 secure :-1 s=READY pgs=1406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb5c00d950 tx=0x7fdb5c00de20 comp rx=0 tx=0).stop 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 shutdown_connections 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdb480b5750 0x7fdb480d5c00 unknown :-1 s=CLOSED pgs=581 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdb6c113430 0x7fdb6c0f5e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb6c10dc30 0x7fdb6c173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 --2- 10.20.193.28:0/321804469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10d240 0x7fdb6c0f5730 unknown :-1 s=CLOSED pgs=1406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 >> 10.20.193.28:0/321804469 conn(0x7fdb6c0eaad0 msgr2=0x7fdb6c111320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 shutdown_connections 2026-02-20T13:30:34.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:34.945+0000 7fdb721c9640 1 -- 10.20.193.28:0/321804469 wait complete. 2026-02-20T13:30:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:34 trial127 ceph-mon[43817]: pgmap v578: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2026-02-20T13:30:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:34 trial034 ceph-mon[43332]: pgmap v578: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2026-02-20T13:30:35.050 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id a436efaf --release --await' 2026-02-20T13:30:35.050 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id a436efaf --release --await 2026-02-20T13:30:35.273 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:35.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 -- 10.20.193.28:0/2065145264 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c0115420 msgr2=0x7f16c0175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 --2- 10.20.193.28:0/2065145264 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c0115420 0x7f16c0175df0 secure :-1 s=READY pgs=1407 gs=1 cs=0 l=1 c_cookie=1425574996019765506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16bc00aa30 tx=0x7f16bc030270 comp rx=0 tx=0).stop 2026-02-20T13:30:35.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 -- 10.20.193.28:0/2065145264 shutdown_connections 2026-02-20T13:30:35.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 --2- 10.20.193.28:0/2065145264 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c0115420 0x7f16c0175df0 unknown :-1 s=CLOSED pgs=1407 gs=1 cs=0 l=1 c_cookie=1425574996019765506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 --2- 10.20.193.28:0/2065145264 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16c010fc20 0x7f16c0114c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 --2- 10.20.193.28:0/2065145264 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16c010f230 0x7f16c010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 -- 10.20.193.28:0/2065145264 >> 10.20.193.28:0/2065145264 conn(0x7f16c005f830 msgr2=0x7f16c010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:35.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 -- 10.20.193.28:0/2065145264 shutdown_connections 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.467+0000 7f16c755e640 1 -- 10.20.193.28:0/2065145264 wait complete. 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c755e640 1 Processor -- start 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c755e640 1 -- start start 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c755e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16c010f230 0x7f16c011db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c755e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c010fc20 0x7f16c011e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c755e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16c0115420 0x7f16c0123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c755e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01239d0 con 0x7f16c010fc20 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c755e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0123b40 con 0x7f16c0115420 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c755e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0123d00 con 0x7f16c010f230 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c4ad2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c010fc20 0x7f16c011e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c4ad2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c010fc20 0x7f16c011e070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33348/0 (socket says 10.20.193.28:33348) 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.468+0000 7f16c4ad2640 1 -- 10.20.193.28:0/156887242 learned_addr learned my addr 10.20.193.28:0/156887242 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c52d3640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16c010f230 0x7f16c011db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c5ad4640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16c0115420 0x7f16c0123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c4ad2640 1 -- 10.20.193.28:0/156887242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16c010f230 msgr2=0x7f16c011db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16c010f230 0x7f16c011db30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c4ad2640 1 -- 10.20.193.28:0/156887242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16c0115420 msgr2=0x7f16c0123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16c0115420 0x7f16c0123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c4ad2640 1 -- 10.20.193.28:0/156887242 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc00a650 con 0x7f16c010fc20 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c010fc20 0x7f16c011e070 secure :-1 s=READY pgs=1408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b400c9b0 tx=0x7f16b400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16ae7fc640 1 -- 10.20.193.28:0/156887242 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16b40044a0 con 0x7f16c010fc20 2026-02-20T13:30:35.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16ae7fc640 1 -- 10.20.193.28:0/156887242 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16b4007da0 con 0x7f16c010fc20 2026-02-20T13:30:35.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16ae7fc640 1 -- 10.20.193.28:0/156887242 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16b400f6d0 con 0x7f16c010fc20 2026-02-20T13:30:35.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c755e640 1 -- 10.20.193.28:0/156887242 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c0123fe0 con 0x7f16c010fc20 2026-02-20T13:30:35.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.469+0000 7f16c755e640 1 -- 10.20.193.28:0/156887242 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c01242c0 con 0x7f16c010fc20 2026-02-20T13:30:35.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.472+0000 7f16ae7fc640 1 -- 10.20.193.28:0/156887242 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f16b4002880 con 0x7f16c010fc20 2026-02-20T13:30:35.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.474+0000 7f16ae7fc640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f169c0b5760 0x7f169c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.474+0000 7f16ae7fc640 1 -- 10.20.193.28:0/156887242 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f16b40e6b40 con 0x7f16c010fc20 2026-02-20T13:30:35.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.474+0000 7f16c52d3640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f169c0b5760 0x7f169c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c9558e00 1 Processor -- start 2026-02-20T13:30:35.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c52d3640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f169c0b5760 0x7f169c0d5c10 secure :-1 s=READY pgs=582 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b0004740 tx=0x7f16b0004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:35.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c9558e00 1 -- start start 2026-02-20T13:30:35.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd6362f8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 0x55fd63674590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd63674ad0 0x55fd63694eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c9558e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd63544c70 con 0x55fd63674ad0 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c9558e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fd635409a0 con 0x55fd6362fe30 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c9558e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fd6353ab00 con 0x55fd6362f520 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c52d3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd6362f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c5ad4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd63674ad0 0x55fd63694eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c52d3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd6362f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58708/0 (socket says 10.20.193.28:58708) 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c52d3640 1 -- 10.20.193.28:0/3282615533 learned_addr learned my addr 10.20.193.28:0/3282615533 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/3282615533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 0x55fd63674590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c5ad4640 1 -- 10.20.193.28:0/3282615533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 msgr2=0x55fd6362f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c5ad4640 1 --2- 10.20.193.28:0/3282615533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd6362f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c5ad4640 1 -- 10.20.193.28:0/3282615533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 msgr2=0x55fd63674590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c5ad4640 1 --2- 10.20.193.28:0/3282615533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 0x55fd63674590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.475+0000 7f16c5ad4640 1 -- 10.20.193.28:0/3282615533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd634e5f80 con 0x55fd63674ad0 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c5ad4640 1 --2- 10.20.193.28:0/3282615533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd63674ad0 0x55fd63694eb0 secure :-1 s=READY pgs=1409 gs=2 cs=0 l=1 c_cookie=13574384507354145488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16bc005900 tx=0x7f16bc006f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc61e6ca0d68e2d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f168dce5640 1 -- 10.20.193.28:0/3282615533 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16bc03e040 con 0x55fd63674ad0 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f168dce5640 1 -- 10.20.193.28:0/3282615533 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16bc039470 con 0x55fd63674ad0 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f168dce5640 1 -- 10.20.193.28:0/3282615533 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16bc0050c0 con 0x55fd63674ad0 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 -- 10.20.193.28:0/3282615533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd63674ad0 msgr2=0x55fd63694eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 --2- 10.20.193.28:0/3282615533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd63674ad0 0x55fd63694eb0 secure :-1 s=READY pgs=1409 gs=2 cs=0 l=1 c_cookie=13574384507354145488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16bc005900 tx=0x7f16bc006f80 comp rx=0 tx=0).stop 2026-02-20T13:30:35.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 -- 10.20.193.28:0/3282615533 shutdown_connections 2026-02-20T13:30:35.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 --2- 10.20.193.28:0/3282615533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd63674ad0 0x55fd63694eb0 unknown :-1 s=CLOSED pgs=1409 gs=2 cs=0 l=1 c_cookie=13574384507354145488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 --2- 10.20.193.28:0/3282615533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 0x55fd63674590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 --2- 10.20.193.28:0/3282615533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd6362f8f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 -- 10.20.193.28:0/3282615533 >> 10.20.193.28:0/3282615533 conn(0x55fd6354da60 msgr2=0x55fd6362de00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:35.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 -- 10.20.193.28:0/3282615533 shutdown_connections 2026-02-20T13:30:35.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.476+0000 7f16c9558e00 1 -- 10.20.193.28:0/3282615533 wait complete. 2026-02-20T13:30:35.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.477+0000 7f16c9558e00 1 -- start start 2026-02-20T13:30:35.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c9558e00 1 Processor -- start 2026-02-20T13:30:35.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd63647390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd636478d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd63674ad0 0x55fd6364c8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c9558e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd6364ce00 con 0x55fd6362fe30 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c9558e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fd6364cf70 con 0x55fd63674ad0 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c9558e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fd6364d130 con 0x55fd6362f520 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c4ad2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd636478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c4ad2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd636478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33352/0 (socket says 10.20.193.28:33352) 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c4ad2640 1 -- 10.20.193.28:0/259428684 learned_addr learned my addr 10.20.193.28:0/259428684 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c5ad4640 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd63674ad0 0x55fd6364c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c52d3640 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd63647390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c4ad2640 1 -- 10.20.193.28:0/259428684 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 msgr2=0x55fd63647390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd63647390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c4ad2640 1 -- 10.20.193.28:0/259428684 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd63674ad0 msgr2=0x55fd6364c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:35.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd63674ad0 0x55fd6364c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c4ad2640 1 -- 10.20.193.28:0/259428684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd634be710 con 0x55fd6362fe30 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.478+0000 7f16c52d3640 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd63647390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd636478d0 secure :-1 s=READY pgs=1410 gs=3 cs=0 l=1 c_cookie=12762846225026201334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b4002c30 tx=0x7f16b40acf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11ebd056d9f36f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f167affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f167affd640 1 -- 10.20.193.28:0/259428684 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16b40b7d70 con 0x55fd6362fe30 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f167affd640 1 -- 10.20.193.28:0/259428684 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16b40026a0 con 0x55fd6362fe30 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f167affd640 1 -- 10.20.193.28:0/259428684 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16b40aae80 con 0x55fd6362fe30 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c0176660 con 0x55fd6362fe30 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f167affd640 1 -- 10.20.193.28:0/259428684 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f16b40aafe0 con 0x55fd6362fe30 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f167affd640 10 client.20274 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:35.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c9558e00 10 client.20274 _ll_register_callbacks cb 0x55fd634bbd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd631d0ba0 con 0x55fd6362fe30 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f167affd640 1 -- 10.20.193.28:0/259428684 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f16b40b51a0 con 0x55fd6362fe30 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c9558e00 10 client.20274 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55fd634d0350 con 0x55fd6362fe30 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f167affd640 1 -- 10.20.193.28:0/259428684 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f16b40b2070 con 0x55fd6362fe30 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c9558e00 10 client.20274 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c9558e00 10 client.20274 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.479+0000 7f16c9558e00 20 client.20274 populate_metadata read hostname 'trial028' 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.480+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fd63671b40 0x55fd63671fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.480+0000 7f16c9558e00 4 client.20274 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.480+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd6350d410 con 0x55fd63671b40 2026-02-20T13:30:35.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.480+0000 7f16c52d3640 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fd63671b40 0x55fd63671fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c52d3640 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fd63671b40 0x55fd63671fe0 crc :-1 s=READY pgs=382 gs=4 cs=0 l=0 c_cookie=3619627445691460011 s_cookie=16040243394265653031 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323b7ffbf7b1a9ab server_cookie=de9a6461da029f27 in_seq=0 out_seq=0 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f167affd640 10 client.20274 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f167affd640 1 -- 10.20.193.28:0/259428684 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fd6350d410 con 0x55fd63671b40 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f167affd640 10 client.20274 handle_command_reply: tid=0 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 client.20274 shutdown 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 msgr2=0x55fd636478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd636478d0 secure :-1 s=READY pgs=1410 gs=3 cs=0 l=1 c_cookie=12762846225026201334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b4002c30 tx=0x7f16b40acf50 comp rx=0 tx=0).stop 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 shutdown_connections 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fd63671b40 0x55fd63671fe0 crc :-1 s=READY pgs=382 gs=4 cs=0 l=0 c_cookie=3619627445691460011 s_cookie=16040243394265653031 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd636478d0 unknown :-1 s=CLOSED pgs=1410 gs=3 cs=0 l=1 c_cookie=12762846225026201334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd63674ad0 0x55fd6364c8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f167affd640 0 client.20274 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:35.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259428684 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6362f520 0x55fd63647390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.481+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 >> 10.20.193.28:0/259428684 conn(0x55fd6354da60 msgr2=0x55fd6362e510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:35.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.482+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 shutdown_connections 2026-02-20T13:30:35.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.482+0000 7f16c9558e00 1 -- 10.20.193.28:0/259428684 wait complete. 2026-02-20T13:30:35.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.482+0000 7f16c9558e00 20 client.20274 trim_cache size 0 max 16384 2026-02-20T13:30:35.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.490+0000 7f16c9558e00 1 Processor -- start 2026-02-20T13:30:35.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.490+0000 7f16c9558e00 1 -- start start 2026-02-20T13:30:35.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6362ec70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362f520 0x55fd6366ccf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 0x55fd6366d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c9558e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd636327b0 con 0x55fd6362f520 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c9558e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fd63538730 con 0x55fd6362fe30 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c9558e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fd631f8960 con 0x55fd6354da60 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6362ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c4ad2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362f520 0x55fd6366ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6362ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:58734/0 (socket says 10.20.193.28:58734) 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 -- 10.20.193.28:0/3971218712 learned_addr learned my addr 10.20.193.28:0/3971218712 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c5ad4640 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 0x55fd6366d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 -- 10.20.193.28:0/3971218712 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 msgr2=0x55fd6366d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 0x55fd6366d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 -- 10.20.193.28:0/3971218712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362f520 msgr2=0x55fd6366ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362f520 0x55fd6366ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 -- 10.20.193.28:0/3971218712 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd634cadd0 con 0x55fd6354da60 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362f520 0x55fd6366ccf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f16c52d3640 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6362ec70 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=6946560851115771525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b0004290 tx=0x7f16b000b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6067244a25640685 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.491+0000 7f168d4e4640 1 -- 10.20.193.28:0/3971218712 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16b0025040 con 0x55fd6354da60 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f168d4e4640 1 -- 10.20.193.28:0/3971218712 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16b000fc10 con 0x55fd6354da60 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f168d4e4640 1 -- 10.20.193.28:0/3971218712 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16b00299f0 con 0x55fd6354da60 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 -- 10.20.193.28:0/3971218712 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 msgr2=0x55fd6362ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6362ec70 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=6946560851115771525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b0004290 tx=0x7f16b000b000 comp rx=0 tx=0).stop 2026-02-20T13:30:35.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 -- 10.20.193.28:0/3971218712 shutdown_connections 2026-02-20T13:30:35.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362f520 0x55fd6366ccf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362fe30 0x55fd6366d230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 --2- 10.20.193.28:0/3971218712 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6362ec70 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=6946560851115771525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 -- 10.20.193.28:0/3971218712 >> 10.20.193.28:0/3971218712 conn(0x55fd63644ee0 msgr2=0x55fd6362e560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:35.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 -- 10.20.193.28:0/3971218712 shutdown_connections 2026-02-20T13:30:35.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 -- 10.20.193.28:0/3971218712 wait complete. 2026-02-20T13:30:35.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 -- start start 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.492+0000 7f16c9558e00 1 Processor -- start 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6364feb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362f520 0x55fd636503f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c9558e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd63650930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c9558e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd63634dd0 con 0x55fd6362fe30 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c9558e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fd63644da0 con 0x55fd6362f520 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c9558e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fd637215a0 con 0x55fd6354da60 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c4ad2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362f520 0x55fd636503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c52d3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6364feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c4ad2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362f520 0x55fd636503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51024/0 (socket says 10.20.193.28:51024) 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c4ad2640 1 -- 10.20.193.28:0/259606942 learned_addr learned my addr 10.20.193.28:0/259606942 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c5ad4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd63650930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c52d3640 1 -- 10.20.193.28:0/259606942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362f520 msgr2=0x55fd636503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c52d3640 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362f520 0x55fd636503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c52d3640 1 -- 10.20.193.28:0/259606942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 msgr2=0x55fd63650930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c52d3640 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd63650930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c52d3640 1 -- 10.20.193.28:0/259606942 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b00214e0 con 0x55fd6354da60 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362f520 0x55fd636503f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.493+0000 7f16c5ad4640 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd63650930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f16c52d3640 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6364feb0 secure :-1 s=READY pgs=400 gs=3 cs=0 l=1 c_cookie=17466149341580247172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b0013010 tx=0x7f16b0005d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2643a495ad04084 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f167affd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:35.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f167affd640 1 -- 10.20.193.28:0/259606942 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16b0029da0 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f167affd640 1 -- 10.20.193.28:0/259606942 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16b0005520 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd634d0350 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f16c9558e00 10 client.30073 _ll_register_callbacks cb 0x55fd634bbd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16bc039470 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f167affd640 1 -- 10.20.193.28:0/259606942 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16b0011440 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f167affd640 1 -- 10.20.193.28:0/259606942 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f16b00115d0 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f167affd640 1 -- 10.20.193.28:0/259606942 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f16b00117b0 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f16c9558e00 10 client.30073 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.494+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55fd634bea40 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.495+0000 7f167affd640 1 -- 10.20.193.28:0/259606942 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f16b0004770 con 0x55fd6354da60 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.495+0000 7f16c9558e00 10 client.30073 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:35.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.495+0000 7f16c9558e00 10 client.30073 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.495+0000 7f16c9558e00 20 client.30073 populate_metadata read hostname 'trial028' 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.495+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fd63674ad0 0x55fd63743380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.495+0000 7f16c9558e00 4 client.30073 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a436efaf", "release": true, "await": true}] 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.495+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a436efaf", "release": true, "await": true}) -- 0x55fd631ce3f0 con 0x55fd63674ad0 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.495+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fd63674ad0 0x55fd63743380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.496+0000 7f16c4ad2640 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fd63674ad0 0x55fd63743380 crc :-1 s=READY pgs=383 gs=4 cs=0 l=0 c_cookie=18355522446381668370 s_cookie=4190748920500460537 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=febbea69cb49d812 server_cookie=3a2887f08d481bf9 in_seq=0 out_seq=0 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.496+0000 7f167affd640 10 client.30073 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f167affd640 1 -- 10.20.193.28:0/259606942 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fd631ce3f0 con 0x55fd63674ad0 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f167affd640 10 client.30073 handle_command_reply: tid=0 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 client.30073 shutdown 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 msgr2=0x55fd6364feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6364feb0 secure :-1 s=READY pgs=400 gs=3 cs=0 l=1 c_cookie=17466149341580247172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b0013010 tx=0x7f16b0005d70 comp rx=0 tx=0).stop 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 shutdown_connections 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fd63674ad0 0x55fd63743380 crc :-1 s=READY pgs=383 gs=4 cs=0 l=0 c_cookie=18355522446381668370 s_cookie=4190748920500460537 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6362fe30 0x55fd63650930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fd6362f520 0x55fd636503f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 --2- 10.20.193.28:0/259606942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fd6354da60 0x55fd6364feb0 unknown :-1 s=CLOSED pgs=400 gs=3 cs=0 l=1 c_cookie=17466149341580247172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 >> 10.20.193.28:0/259606942 conn(0x55fd63644ee0 msgr2=0x55fd6366bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f167affd640 0 client.30073 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 shutdown_connections 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 1 -- 10.20.193.28:0/259606942 wait complete. 2026-02-20T13:30:35.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.497+0000 7f16c9558e00 20 client.30073 trim_cache size 0 max 16384 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 48, 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout: "a436efaf": { 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout: "version": 48, 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:30:35.506 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 130.0, 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:30:35.507 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:35.508 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:35.508 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:35.508 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:35.508 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:35.508 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.498+0000 7f16c755e640 1 -- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f169c0b5760 msgr2=0x7f169c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.498+0000 7f16c755e640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f169c0b5760 0x7f169c0d5c10 secure :-1 s=READY pgs=582 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b0004740 tx=0x7f16b0004420 comp rx=0 tx=0).stop 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.498+0000 7f16c755e640 1 -- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c010fc20 msgr2=0x7f16c011e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.498+0000 7f16c755e640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c010fc20 0x7f16c011e070 secure :-1 s=READY pgs=1408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b400c9b0 tx=0x7f16b400ce80 comp rx=0 tx=0).stop 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.499+0000 7f16c755e640 1 -- 10.20.193.28:0/156887242 shutdown_connections 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.499+0000 7f16c755e640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f169c0b5760 0x7f169c0d5c10 unknown :-1 s=CLOSED pgs=582 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.499+0000 7f16c755e640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16c010fc20 0x7f16c011e070 unknown :-1 s=CLOSED pgs=1408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.499+0000 7f16c755e640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f16c0115420 0x7f16c0123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.499+0000 7f16c755e640 1 --2- 10.20.193.28:0/156887242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16c010f230 0x7f16c011db30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:35.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.499+0000 7f16c755e640 1 -- 10.20.193.28:0/156887242 >> 10.20.193.28:0/156887242 conn(0x7f16c005f830 msgr2=0x7f16c010cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:35.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.499+0000 7f16c755e640 1 -- 10.20.193.28:0/156887242 shutdown_connections 2026-02-20T13:30:35.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:35.499+0000 7f16c755e640 1 -- 10.20.193.28:0/156887242 wait complete. 2026-02-20T13:30:35.598 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a436efaf', total seconds elapsed: 11.2 2026-02-20T13:30:35.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:35 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/321804469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:35.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:35 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/321804469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:35.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:35 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/321804469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:36 trial127 ceph-mon[43817]: pgmap v579: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2026-02-20T13:30:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:36 trial034 ceph-mon[43332]: pgmap v579: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2026-02-20T13:30:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:36 trial028 ceph-mon[37442]: pgmap v579: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.6 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2026-02-20T13:30:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:38 trial127 ceph-mon[43817]: pgmap v580: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2026-02-20T13:30:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:38 trial034 ceph-mon[43332]: pgmap v580: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2026-02-20T13:30:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:38 trial028 ceph-mon[37442]: pgmap v580: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2026-02-20T13:30:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:40 trial127 ceph-mon[43817]: pgmap v581: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2026-02-20T13:30:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:40 trial034 ceph-mon[43332]: pgmap v581: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2026-02-20T13:30:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:40 trial028 ceph-mon[37442]: pgmap v581: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2026-02-20T13:30:42.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:42 trial127 ceph-mon[43817]: pgmap v582: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2026-02-20T13:30:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:42 trial034 ceph-mon[43332]: pgmap v582: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2026-02-20T13:30:43.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:42 trial028 ceph-mon[37442]: pgmap v582: 97 pgs: 97 active+clean; 2.4 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2026-02-20T13:30:43.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:43 trial127 ceph-mon[43817]: pgmap v583: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2026-02-20T13:30:43.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:43 trial034 ceph-mon[43332]: pgmap v583: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2026-02-20T13:30:44.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:43 trial028 ceph-mon[37442]: pgmap v583: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2026-02-20T13:30:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:44 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:30:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:44 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:30:45.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:44 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:30:45.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:30:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:30:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:30:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:30:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:45 trial127 ceph-mon[43817]: pgmap v584: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2026-02-20T13:30:45.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:30:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:30:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:30:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:30:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:45 trial034 ceph-mon[43332]: pgmap v584: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2026-02-20T13:30:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:30:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:30:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:30:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:30:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:45 trial028 ceph-mon[37442]: pgmap v584: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2026-02-20T13:30:47.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 -- 10.20.193.28:0/2259906715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 msgr2=0x7feff8060fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 --2- 10.20.193.28:0/2259906715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 0x7feff8060fd0 secure :-1 s=READY pgs=1411 gs=1 cs=0 l=1 c_cookie=6561544488605719871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe4009950 tx=0x7fefe402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:47.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 -- 10.20.193.28:0/2259906715 shutdown_connections 2026-02-20T13:30:47.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 --2- 10.20.193.28:0/2259906715 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feff8150e40 0x7feff8171280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 --2- 10.20.193.28:0/2259906715 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feff8061510 0x7feff8061980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 --2- 10.20.193.28:0/2259906715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 0x7feff8060fd0 unknown :-1 s=CLOSED pgs=1411 gs=1 cs=0 l=1 c_cookie=6561544488605719871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 -- 10.20.193.28:0/2259906715 >> 10.20.193.28:0/2259906715 conn(0x7feff80ea490 msgr2=0x7feff810a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:47.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 -- 10.20.193.28:0/2259906715 shutdown_connections 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.810+0000 7feffd426640 1 -- 10.20.193.28:0/2259906715 wait complete. 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffd426640 1 Processor -- start 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffd426640 1 -- start start 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffd426640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feff8061510 0x7feff815c680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffd426640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 0x7feff815ccd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffd426640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feff8150e40 0x7feff815d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffd426640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feff815e010 con 0x7feff8062a40 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffd426640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7feff815e180 con 0x7feff8061510 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffd426640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7feff815e340 con 0x7feff8150e40 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 0x7feff815ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feffcc25640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feff8150e40 0x7feff815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 0x7feff815ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48716/0 (socket says 10.20.193.28:48716) 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 -- 10.20.193.28:0/491895898 learned_addr learned my addr 10.20.193.28:0/491895898 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff7fff640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feff8061510 0x7feff815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 -- 10.20.193.28:0/491895898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feff8150e40 msgr2=0x7feff815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feff8150e40 0x7feff815d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 -- 10.20.193.28:0/491895898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feff8061510 msgr2=0x7feff815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feff8061510 0x7feff815c680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 -- 10.20.193.28:0/491895898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe4009570 con 0x7feff8062a40 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.811+0000 7feff77fe640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 0x7feff815ccd0 secure :-1 s=READY pgs=1412 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe8009480 tx=0x7fefe800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.812+0000 7feff57fa640 1 -- 10.20.193.28:0/491895898 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe800cd40 con 0x7feff8062a40 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.812+0000 7feff57fa640 1 -- 10.20.193.28:0/491895898 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefe8004d30 con 0x7feff8062a40 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.812+0000 7feff57fa640 1 -- 10.20.193.28:0/491895898 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe80106b0 con 0x7feff8062a40 2026-02-20T13:30:47.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.812+0000 7feffd426640 1 -- 10.20.193.28:0/491895898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff815e620 con 0x7feff8062a40 2026-02-20T13:30:47.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.812+0000 7feffd426640 1 -- 10.20.193.28:0/491895898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff815eae0 con 0x7feff8062a40 2026-02-20T13:30:47.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.815+0000 7feff57fa640 1 -- 10.20.193.28:0/491895898 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fefe80050b0 con 0x7feff8062a40 2026-02-20T13:30:47.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.816+0000 7feff57fa640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefcc0b5760 0x7fefcc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.816+0000 7feff57fa640 1 -- 10.20.193.28:0/491895898 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fefe8014070 con 0x7feff8062a40 2026-02-20T13:30:47.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7feff7fff640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefcc0b5760 0x7fefcc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7ff000c99e00 1 Processor -- start 2026-02-20T13:30:47.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7ff000c99e00 1 -- start start 2026-02-20T13:30:47.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9df8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641eca001c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641eca20ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7ff000c99e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5641ec8d4fd0 con 0x5641ec9bf4c0 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7ff000c99e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5641ec8d0d00 con 0x5641eca00700 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7ff000c99e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5641ec8caca0 con 0x5641ec9dfde0 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7feff7fff640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefcc0b5760 0x7fefcc0d5c10 secure :-1 s=READY pgs=585 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe40023d0 tx=0x7fefe4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7feff7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7feffcc25640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641eca20ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7feff77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641eca001c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7feff7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9df8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48726/0 (socket says 10.20.193.28:48726) 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.817+0000 7feff7fff640 1 -- 10.20.193.28:0/185054022 learned_addr learned my addr 10.20.193.28:0/185054022 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:47.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7feff7fff640 1 -- 10.20.193.28:0/185054022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 msgr2=0x5641eca001c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7feff7fff640 1 --2- 10.20.193.28:0/185054022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641eca001c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7feff7fff640 1 -- 10.20.193.28:0/185054022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 msgr2=0x5641eca20ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7feff7fff640 1 --2- 10.20.193.28:0/185054022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641eca20ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7feff7fff640 1 -- 10.20.193.28:0/185054022 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ec86d8b0 con 0x5641ec9bf4c0 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7feff7fff640 1 --2- 10.20.193.28:0/185054022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9df8a0 secure :-1 s=READY pgs=1413 gs=2 cs=0 l=1 c_cookie=4943441588686776590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe4005f70 tx=0x7fefe4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449aa1eef591690e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7fefbbfff640 1 -- 10.20.193.28:0/185054022 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe4002a00 con 0x5641ec9bf4c0 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7fefbbfff640 1 -- 10.20.193.28:0/185054022 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefe4038920 con 0x5641ec9bf4c0 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7fefbbfff640 1 -- 10.20.193.28:0/185054022 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe404f950 con 0x5641ec9bf4c0 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 -- 10.20.193.28:0/185054022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 msgr2=0x5641ec9df8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 --2- 10.20.193.28:0/185054022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9df8a0 secure :-1 s=READY pgs=1413 gs=2 cs=0 l=1 c_cookie=4943441588686776590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe4005f70 tx=0x7fefe4040000 comp rx=0 tx=0).stop 2026-02-20T13:30:47.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 -- 10.20.193.28:0/185054022 shutdown_connections 2026-02-20T13:30:47.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 --2- 10.20.193.28:0/185054022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641eca20ae0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 --2- 10.20.193.28:0/185054022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641eca001c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 --2- 10.20.193.28:0/185054022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9df8a0 unknown :-1 s=CLOSED pgs=1413 gs=2 cs=0 l=1 c_cookie=4943441588686776590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 -- 10.20.193.28:0/185054022 >> 10.20.193.28:0/185054022 conn(0x5641ec8de1c0 msgr2=0x5641ec9bdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:47.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 -- 10.20.193.28:0/185054022 shutdown_connections 2026-02-20T13:30:47.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.818+0000 7ff000c99e00 1 -- 10.20.193.28:0/185054022 wait complete. 2026-02-20T13:30:47.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.820+0000 7ff000c99e00 1 -- start start 2026-02-20T13:30:47.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.820+0000 7ff000c99e00 1 Processor -- start 2026-02-20T13:30:47.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.820+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9d8a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.820+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641ec9dfde0 0x5641ec9d90c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.820+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641eca00700 0x5641ec9d9b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.820+0000 7ff000c99e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5641ec9da180 con 0x5641eca00700 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.820+0000 7ff000c99e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5641ec9da2f0 con 0x5641ec9dfde0 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.820+0000 7ff000c99e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5641ec9da4b0 con 0x5641ec9bf4c0 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641ec9dfde0 0x5641ec9d90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9d8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49402/0 (socket says 10.20.193.28:49402) 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 -- 10.20.193.28:0/3026050561 learned_addr learned my addr 10.20.193.28:0/3026050561 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feffcc25640 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641eca00700 0x5641ec9d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 -- 10.20.193.28:0/3026050561 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641ec9dfde0 msgr2=0x5641ec9d90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:47.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641ec9dfde0 0x5641ec9d90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 -- 10.20.193.28:0/3026050561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641eca00700 msgr2=0x5641ec9d9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641eca00700 0x5641ec9d9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 -- 10.20.193.28:0/3026050561 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ec876400 con 0x5641ec9bf4c0 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7feff7fff640 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9d8a70 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=4422884708572077625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe4002a10 tx=0x7fefe4038fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d613e3580f21e39 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7fefb97fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7fefb97fa640 1 -- 10.20.193.28:0/3026050561 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe402fe20 con 0x5641ec9bf4c0 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff8171f00 con 0x5641ec9bf4c0 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7fefb97fa640 1 -- 10.20.193.28:0/3026050561 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefe4038e00 con 0x5641ec9bf4c0 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.821+0000 7fefb97fa640 1 -- 10.20.193.28:0/3026050561 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe405ae60 con 0x5641ec9bf4c0 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7fefb97fa640 1 -- 10.20.193.28:0/3026050561 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fefe4063410 con 0x5641ec9bf4c0 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7fefb97fa640 10 client.30085 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:47.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 10 client.30085 _ll_register_callbacks cb 0x5641ec855a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641ec56a520 con 0x5641ec9bf4c0 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7fefb97fa640 1 -- 10.20.193.28:0/3026050561 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fefe4038920 con 0x5641ec9bf4c0 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 10 client.30085 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5641ec84eda0 con 0x5641ec9bf4c0 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7fefb97fa640 1 -- 10.20.193.28:0/3026050561 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fefe4038a80 con 0x5641ec9bf4c0 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 10 client.30085 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 10 client.30085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 20 client.30085 populate_metadata read hostname 'trial028' 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5641ec9dce90 0x5641ec9dd330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 4 client.30085 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641ec8fc630 con 0x5641ec9dce90 2026-02-20T13:30:47.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.822+0000 7feff77fe640 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5641ec9dce90 0x5641ec9dd330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.823+0000 7fefb97fa640 10 client.30085 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.823+0000 7feff77fe640 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5641ec9dce90 0x5641ec9dd330 crc :-1 s=READY pgs=384 gs=4 cs=0 l=0 c_cookie=3946477562270691472 s_cookie=17385539564118744981 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c4b46efd31b090 server_cookie=f145d81efbcc1f95 in_seq=0 out_seq=0 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.823+0000 7fefb97fa640 1 -- 10.20.193.28:0/3026050561 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5641ec8fc630 con 0x5641ec9dce90 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.823+0000 7fefb97fa640 10 client.30085 handle_command_reply: tid=0 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.823+0000 7ff000c99e00 1 client.30085 shutdown 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.823+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 msgr2=0x5641ec9d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.823+0000 7ff000c99e00 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9d8a70 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=4422884708572077625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe4002a10 tx=0x7fefe4038fd0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 shutdown_connections 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5641ec9dce90 0x5641ec9dd330 crc :-1 s=READY pgs=384 gs=4 cs=0 l=0 c_cookie=3946477562270691472 s_cookie=17385539564118744981 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641eca00700 0x5641ec9d9b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641ec9dfde0 0x5641ec9d90c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 1 --2- 10.20.193.28:0/3026050561 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9d8a70 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=4422884708572077625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7fefb97fa640 0 client.30085 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:47.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 >> 10.20.193.28:0/3026050561 conn(0x5641ec8de1c0 msgr2=0x5641ec9c0790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:47.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 shutdown_connections 2026-02-20T13:30:47.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 1 -- 10.20.193.28:0/3026050561 wait complete. 2026-02-20T13:30:47.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.824+0000 7ff000c99e00 20 client.30085 trim_cache size 0 max 16384 2026-02-20T13:30:47.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7ff000c99e00 1 Processor -- start 2026-02-20T13:30:47.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7ff000c99e00 1 -- start start 2026-02-20T13:30:47.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9c3d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641ec9fe5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9feb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7ff000c99e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5641ec8c88d0 con 0x5641ec9bf4c0 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7ff000c99e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5641ec609f10 con 0x5641eca00700 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7ff000c99e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5641ec99a810 con 0x5641ec9dfde0 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7feff7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7feff77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641ec9fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7feff77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641ec9fe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:49418/0 (socket says 10.20.193.28:49418) 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.831+0000 7feff77fe640 1 -- 10.20.193.28:0/1838353559 learned_addr learned my addr 10.20.193.28:0/1838353559 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7feffcc25640 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7feff7fff640 1 -- 10.20.193.28:0/1838353559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 msgr2=0x5641ec9fe5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7feff7fff640 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641ec9fe5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7feff7fff640 1 -- 10.20.193.28:0/1838353559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 msgr2=0x5641ec9feb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7feff7fff640 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9feb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7feff7fff640 1 -- 10.20.193.28:0/1838353559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ec9cb100 con 0x5641ec9bf4c0 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7feff77fe640 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641ec9fe5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7feff7fff640 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9c3d10 secure :-1 s=READY pgs=1414 gs=1 cs=0 l=1 c_cookie=18134468069888268754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe405a750 tx=0x7fefe4050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbaa92a1085a99d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7fefbb7fe640 1 -- 10.20.193.28:0/1838353559 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe404f9c0 con 0x5641ec9bf4c0 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7fefbb7fe640 1 -- 10.20.193.28:0/1838353559 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefe4068020 con 0x5641ec9bf4c0 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7fefbb7fe640 1 -- 10.20.193.28:0/1838353559 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe4059c10 con 0x5641ec9bf4c0 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 -- 10.20.193.28:0/1838353559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 msgr2=0x5641ec9c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9c3d10 secure :-1 s=READY pgs=1414 gs=1 cs=0 l=1 c_cookie=18134468069888268754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe405a750 tx=0x7fefe4050000 comp rx=0 tx=0).stop 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 -- 10.20.193.28:0/1838353559 shutdown_connections 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9feb00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9dfde0 0x5641ec9fe5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 --2- 10.20.193.28:0/1838353559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9bf4c0 0x5641ec9c3d10 unknown :-1 s=CLOSED pgs=1414 gs=1 cs=0 l=1 c_cookie=18134468069888268754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 -- 10.20.193.28:0/1838353559 >> 10.20.193.28:0/1838353559 conn(0x5641ec8de1c0 msgr2=0x5641ec9d4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 -- 10.20.193.28:0/1838353559 shutdown_connections 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.832+0000 7ff000c99e00 1 -- 10.20.193.28:0/1838353559 wait complete. 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.833+0000 7ff000c99e00 1 -- start start 2026-02-20T13:30:47.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.833+0000 7ff000c99e00 1 Processor -- start 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.833+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9e3340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.833+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9dfde0 0x5641ec9e3880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.833+0000 7ff000c99e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9e4440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.833+0000 7ff000c99e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5641ec609f10 con 0x5641ec9dfde0 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.833+0000 7ff000c99e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5641ec9e4980 con 0x5641eca00700 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.833+0000 7ff000c99e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5641ec9e4b40 con 0x5641ec9bf4c0 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9e4440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:35740/0 (socket says 10.20.193.28:35740) 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 -- 10.20.193.28:0/4224838582 learned_addr learned my addr 10.20.193.28:0/4224838582 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:47.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feff7fff640 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 -- 10.20.193.28:0/4224838582 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 msgr2=0x5641ec9e3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9e3340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 -- 10.20.193.28:0/4224838582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9dfde0 msgr2=0x5641ec9e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9dfde0 0x5641ec9e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 -- 10.20.193.28:0/4224838582 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ec84eda0 con 0x5641eca00700 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7feffcc25640 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9e4440 secure :-1 s=READY pgs=482 gs=2 cs=0 l=1 c_cookie=8393389590400157596 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefec004d20 tx=0x7fefec00aab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=747b4f5cc543479c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7fefb97fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7fefb97fa640 1 -- 10.20.193.28:0/4224838582 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefec018040 con 0x5641eca00700 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7fefb97fa640 1 -- 10.20.193.28:0/4224838582 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefec011e00 con 0x5641eca00700 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff815eae0 con 0x5641eca00700 2026-02-20T13:30:47.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7ff000c99e00 10 client.30215 _ll_register_callbacks cb 0x5641ec855a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641ec97aca0 con 0x5641eca00700 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.834+0000 7fefb97fa640 1 -- 10.20.193.28:0/4224838582 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefec00f3e0 con 0x5641eca00700 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7fefb97fa640 1 -- 10.20.193.28:0/4224838582 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fefec00f570 con 0x5641eca00700 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7fefb97fa640 1 -- 10.20.193.28:0/4224838582 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fefec011920 con 0x5641eca00700 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7ff000c99e00 10 client.30215 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5641ec860670 con 0x5641eca00700 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7fefb97fa640 1 -- 10.20.193.28:0/4224838582 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fefec011ac0 con 0x5641eca00700 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7ff000c99e00 10 client.30215 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7ff000c99e00 10 client.30215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7ff000c99e00 20 client.30215 populate_metadata read hostname 'trial028' 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7ff000c99e00 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5641ecaad5c0 0x5641ecacda70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7ff000c99e00 4 client.30215 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:30:47.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5641ec5ae640 con 0x5641ecaad5c0 2026-02-20T13:30:47.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.835+0000 7feff7fff640 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5641ecaad5c0 0x5641ecacda70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:47.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.836+0000 7feff7fff640 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5641ecaad5c0 0x5641ecacda70 crc :-1 s=READY pgs=385 gs=4 cs=0 l=0 c_cookie=8873821122485711497 s_cookie=1860785674753527909 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b26254b9e1e7289 server_cookie=19d2d6b65ad1d065 in_seq=0 out_seq=0 2026-02-20T13:30:47.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.836+0000 7fefb97fa640 10 client.30215 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:47.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7fefb97fa640 1 -- 10.20.193.28:0/4224838582 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5641ec5ae640 con 0x5641ecaad5c0 2026-02-20T13:30:47.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7fefb97fa640 10 client.30215 handle_command_reply: tid=0 2026-02-20T13:30:47.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 client.30215 shutdown 2026-02-20T13:30:47.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 msgr2=0x5641ec9e4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9e4440 secure :-1 s=READY pgs=482 gs=2 cs=0 l=1 c_cookie=8393389590400157596 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefec004d20 tx=0x7fefec00aab0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 shutdown_connections 2026-02-20T13:30:47.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5641ecaad5c0 0x5641ecacda70 crc :-1 s=READY pgs=385 gs=4 cs=0 l=0 c_cookie=8873821122485711497 s_cookie=1860785674753527909 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5641ec9dfde0 0x5641ec9e3880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5641eca00700 0x5641ec9e4440 unknown :-1 s=CLOSED pgs=482 gs=2 cs=0 l=1 c_cookie=8393389590400157596 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 --2- 10.20.193.28:0/4224838582 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5641ec9bf4c0 0x5641ec9e3340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7fefb97fa640 0 client.30215 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 >> 10.20.193.28:0/4224838582 conn(0x5641ec8de1c0 msgr2=0x5641ec9d55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 shutdown_connections 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 1 -- 10.20.193.28:0/4224838582 wait complete. 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7ff000c99e00 20 client.30215 trim_cache size 0 max 16384 2026-02-20T13:30:47.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:30:47.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:30:47.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:30:47.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 -- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefcc0b5760 msgr2=0x7fefcc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefcc0b5760 0x7fefcc0d5c10 secure :-1 s=READY pgs=585 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe40023d0 tx=0x7fefe4031040 comp rx=0 tx=0).stop 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 -- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 msgr2=0x7feff815ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 0x7feff815ccd0 secure :-1 s=READY pgs=1412 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe8009480 tx=0x7fefe800ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 -- 10.20.193.28:0/491895898 shutdown_connections 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefcc0b5760 0x7fefcc0d5c10 unknown :-1 s=CLOSED pgs=585 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff8062a40 0x7feff815ccd0 unknown :-1 s=CLOSED pgs=1412 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feff8150e40 0x7feff815d8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 --2- 10.20.193.28:0/491895898 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feff8061510 0x7feff815c680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.840+0000 7feffd426640 1 -- 10.20.193.28:0/491895898 >> 10.20.193.28:0/491895898 conn(0x7feff80ea490 msgr2=0x7feff810a870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:47.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.841+0000 7feffd426640 1 -- 10.20.193.28:0/491895898 shutdown_connections 2026-02-20T13:30:47.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:30:47.841+0000 7feffd426640 1 -- 10.20.193.28:0/491895898 wait complete. 2026-02-20T13:30:48.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:48 trial028 ceph-mon[37442]: pgmap v585: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-20T13:30:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:48 trial127 ceph-mon[43817]: pgmap v585: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-20T13:30:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:48 trial034 ceph-mon[43332]: pgmap v585: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-20T13:30:50.694 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:30:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:50 trial028 ceph-mon[37442]: pgmap v586: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2026-02-20T13:30:50.881 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:50 trial127 ceph-mon[43817]: pgmap v586: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2026-02-20T13:30:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:50 trial034 ceph-mon[43332]: pgmap v586: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2026-02-20T13:30:51.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 -- 10.20.193.28:0/180565270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6014113570 msgr2=0x7f6014173f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 --2- 10.20.193.28:0/180565270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6014113570 0x7f6014173f40 secure :-1 s=READY pgs=1415 gs=2 cs=0 l=1 c_cookie=14079343818945189980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f600800aa30 tx=0x7f6008030270 comp rx=0 tx=0).stop 2026-02-20T13:30:51.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 -- 10.20.193.28:0/180565270 shutdown_connections 2026-02-20T13:30:51.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 --2- 10.20.193.28:0/180565270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6014113570 0x7f6014173f40 unknown :-1 s=CLOSED pgs=1415 gs=2 cs=0 l=1 c_cookie=14079343818945189980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 --2- 10.20.193.28:0/180565270 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f601410dd70 0x7f6014112dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 --2- 10.20.193.28:0/180565270 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f601410d380 0x7f601410d750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 -- 10.20.193.28:0/180565270 >> 10.20.193.28:0/180565270 conn(0x7f60140eac10 msgr2=0x7f601410b020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:51.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 -- 10.20.193.28:0/180565270 shutdown_connections 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.069+0000 7f6019dbd640 1 -- 10.20.193.28:0/180565270 wait complete. 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.070+0000 7f6019dbd640 1 Processor -- start 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.070+0000 7f6019dbd640 1 -- start start 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6019dbd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f601410d380 0x7f60140ee5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6019dbd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601410dd70 0x7f6014173e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6019dbd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6014113570 0x7f60140eecd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6019dbd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f60140f3e90 con 0x7f601410dd70 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6019dbd640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f60140f4000 con 0x7f601410d380 2026-02-20T13:30:51.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6019dbd640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f60140f41c0 con 0x7f6014113570 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601410dd70 0x7f6014173e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601410dd70 0x7f6014173e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49474/0 (socket says 10.20.193.28:49474) 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 -- 10.20.193.28:0/1034982404 learned_addr learned my addr 10.20.193.28:0/1034982404 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f60137fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f601410d380 0x7f60140ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6013fff640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6014113570 0x7f60140eecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 -- 10.20.193.28:0/1034982404 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6014113570 msgr2=0x7f60140eecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6014113570 0x7f60140eecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 -- 10.20.193.28:0/1034982404 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f601410d380 msgr2=0x7f60140ee5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f601410d380 0x7f60140ee5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 -- 10.20.193.28:0/1034982404 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600800a650 con 0x7f601410dd70 2026-02-20T13:30:51.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.071+0000 7f6012ffd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601410dd70 0x7f6014173e40 secure :-1 s=READY pgs=1416 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6004009480 tx=0x7f600400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:51.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.072+0000 7f6010ff9640 1 -- 10.20.193.28:0/1034982404 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f600400ccc0 con 0x7f601410dd70 2026-02-20T13:30:51.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.072+0000 7f6010ff9640 1 -- 10.20.193.28:0/1034982404 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f600400ce20 con 0x7f601410dd70 2026-02-20T13:30:51.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.072+0000 7f6010ff9640 1 -- 10.20.193.28:0/1034982404 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60040106b0 con 0x7f601410dd70 2026-02-20T13:30:51.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.072+0000 7f6019dbd640 1 -- 10.20.193.28:0/1034982404 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60140f44a0 con 0x7f601410dd70 2026-02-20T13:30:51.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.072+0000 7f6019dbd640 1 -- 10.20.193.28:0/1034982404 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60140f4920 con 0x7f601410dd70 2026-02-20T13:30:51.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.075+0000 7f6010ff9640 1 -- 10.20.193.28:0/1034982404 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f600401f060 con 0x7f601410dd70 2026-02-20T13:30:51.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.076+0000 7f6010ff9640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5fe80b5750 0x7f5fe80d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.076+0000 7f6010ff9640 1 -- 10.20.193.28:0/1034982404 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6004014070 con 0x7f601410dd70 2026-02-20T13:30:51.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f60137fe640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5fe80b5750 0x7f5fe80d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f601bdb7e00 1 Processor -- start 2026-02-20T13:30:51.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f60137fe640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5fe80b5750 0x7f5fe80d5c00 secure :-1 s=READY pgs=586 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6000004740 tx=0x7f6000005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:51.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f601bdb7e00 1 -- start start 2026-02-20T13:30:51.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fce550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd07013400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd07033d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd06ee47d0 con 0x55bd07013940 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bd06ee0500 con 0x55bd06fcea90 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.077+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bd06eda4a0 con 0x55bd06fce180 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd07013400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd07013400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57680/0 (socket says 10.20.193.28:57680) 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 -- 10.20.193.28:0/1949031757 learned_addr learned my addr 10.20.193.28:0/1949031757 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6013fff640 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd07033d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f60137fe640 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fce550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 -- 10.20.193.28:0/1949031757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 msgr2=0x55bd06fce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fce550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 -- 10.20.193.28:0/1949031757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 msgr2=0x55bd07033d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd07033d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 -- 10.20.193.28:0/1949031757 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd06e85d80 con 0x55bd06fcea90 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f6012ffd640 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd07013400 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=370396157950132407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60040058d0 tx=0x7f60040054e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=523e957dcc980b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f5fd7fff640 1 -- 10.20.193.28:0/1949031757 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60040b2950 con 0x55bd06fcea90 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f5fd7fff640 1 -- 10.20.193.28:0/1949031757 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f60040b4f30 con 0x55bd06fcea90 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.078+0000 7f5fd7fff640 1 -- 10.20.193.28:0/1949031757 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60040b7b60 con 0x55bd06fcea90 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 -- 10.20.193.28:0/1949031757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 msgr2=0x55bd07013400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd07013400 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=370396157950132407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60040058d0 tx=0x7f60040054e0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 -- 10.20.193.28:0/1949031757 shutdown_connections 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd07033d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd07013400 unknown :-1 s=CLOSED pgs=483 gs=1 cs=0 l=1 c_cookie=370396157950132407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/1949031757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fce550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 -- 10.20.193.28:0/1949031757 >> 10.20.193.28:0/1949031757 conn(0x55bd06fac680 msgr2=0x55bd06fcca60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 -- 10.20.193.28:0/1949031757 shutdown_connections 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.079+0000 7f601bdb7e00 1 -- 10.20.193.28:0/1949031757 wait complete. 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.080+0000 7f601bdb7e00 1 -- start start 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.080+0000 7f601bdb7e00 1 Processor -- start 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe66e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fe6c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd06febc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd06fec150 con 0x55bd07013940 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bd06fec2c0 con 0x55bd06fcea90 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bd06fec480 con 0x55bd06fce180 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6013fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd06febc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6012ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fe6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6013fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd06febc10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49490/0 (socket says 10.20.193.28:49490) 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6013fff640 1 -- 10.20.193.28:0/3895466087 learned_addr learned my addr 10.20.193.28:0/3895466087 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f60137fe640 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6012ffd640 1 -- 10.20.193.28:0/3895466087 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 msgr2=0x55bd06fe66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6012ffd640 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6012ffd640 1 -- 10.20.193.28:0/3895466087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 msgr2=0x55bd06febc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6012ffd640 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd06febc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6012ffd640 1 -- 10.20.193.28:0/3895466087 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd06e5e350 con 0x55bd06fcea90 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f6012ffd640 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fe6c20 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=8211010174489836449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f600400c6a0 tx=0x7f60040e4300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f35e3ff995bba1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.081+0000 7f5fd57fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f5fd57fa640 1 -- 10.20.193.28:0/3895466087 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60040e4110 con 0x55bd06fcea90 2026-02-20T13:30:51.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f5fd57fa640 1 -- 10.20.193.28:0/3895466087 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f60040b2950 con 0x55bd06fcea90 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60140f4920 con 0x55bd06fcea90 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f5fd57fa640 1 -- 10.20.193.28:0/3895466087 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60040aae90 con 0x55bd06fcea90 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f5fd57fa640 1 -- 10.20.193.28:0/3895466087 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f60040ae620 con 0x55bd06fcea90 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 10 client.30227 _ll_register_callbacks cb 0x55bd06e5b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bd06b706f0 con 0x55bd06fcea90 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f5fd57fa640 1 -- 10.20.193.28:0/3895466087 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f60040aac10 con 0x55bd06fcea90 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 10 client.30227 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55bd06e70150 con 0x55bd06fcea90 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f5fd57fa640 1 -- 10.20.193.28:0/3895466087 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f60040ad8c0 con 0x55bd06fcea90 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 10 client.30227 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 10 client.30227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:51.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 20 client.30227 populate_metadata read hostname 'trial028' 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.082+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bd07010c00 0x55bd070110a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.083+0000 7f601bdb7e00 4 client.30227 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.083+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd06ee7d60 con 0x55bd07010c00 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.083+0000 7f60137fe640 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bd07010c00 0x55bd070110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.083+0000 7f60137fe640 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bd07010c00 0x55bd070110a0 crc :-1 s=READY pgs=386 gs=4 cs=0 l=0 c_cookie=594429538482116677 s_cookie=4345732250072590843 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83fd6840d39d845 server_cookie=3c4f2474ee8929fb in_seq=0 out_seq=0 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.083+0000 7f5fd57fa640 10 client.30227 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f5fd57fa640 1 -- 10.20.193.28:0/3895466087 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bd06ee7d60 con 0x55bd07010c00 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f5fd57fa640 10 client.30227 handle_command_reply: tid=0 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 client.30227 shutdown 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 msgr2=0x55bd06fe6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fe6c20 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=8211010174489836449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f600400c6a0 tx=0x7f60040e4300 comp rx=0 tx=0).stop 2026-02-20T13:30:51.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 shutdown_connections 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bd07010c00 0x55bd070110a0 crc :-1 s=READY pgs=386 gs=4 cs=0 l=0 c_cookie=594429538482116677 s_cookie=4345732250072590843 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd07013940 0x55bd06febc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fe6c20 unknown :-1 s=CLOSED pgs=484 gs=1 cs=0 l=1 c_cookie=8211010174489836449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3895466087 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe66e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f5fd57fa640 0 client.30227 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 >> 10.20.193.28:0/3895466087 conn(0x55bd06fac680 msgr2=0x55bd06fcd250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 shutdown_connections 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3895466087 wait complete. 2026-02-20T13:30:51.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.084+0000 7f601bdb7e00 20 client.30227 trim_cache size 0 max 16384 2026-02-20T13:30:51.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.093+0000 7f601bdb7e00 1 Processor -- start 2026-02-20T13:30:51.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.093+0000 7f601bdb7e00 1 -- start start 2026-02-20T13:30:51.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe3a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fcea90 0x55bd06fe3f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd07013940 0x55bd07012990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd06ed80d0 con 0x55bd06fcea90 2026-02-20T13:30:51.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bd06b98700 con 0x55bd07013940 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bd0700d3c0 con 0x55bd06fce180 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd07013940 0x55bd07012990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd07013940 0x55bd07012990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57696/0 (socket says 10.20.193.28:57696) 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 -- 10.20.193.28:0/3651144131 learned_addr learned my addr 10.20.193.28:0/3651144131 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6012ffd640 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fcea90 0x55bd06fe3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f60137fe640 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 -- 10.20.193.28:0/3651144131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 msgr2=0x55bd06fe3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 -- 10.20.193.28:0/3651144131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fcea90 msgr2=0x55bd06fe3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fcea90 0x55bd06fe3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 -- 10.20.193.28:0/3651144131 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd06e6abd0 con 0x55bd07013940 2026-02-20T13:30:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f60137fe640 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe3a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6012ffd640 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fcea90 0x55bd06fe3f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.094+0000 7f6013fff640 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd07013940 0x55bd07012990 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=16867029799548521786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6008003e90 tx=0x7f6008003ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea13ba3cc2048d3a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f5fd77fe640 1 -- 10.20.193.28:0/3651144131 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f600803e040 con 0x55bd07013940 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f5fd77fe640 1 -- 10.20.193.28:0/3651144131 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f600803f040 con 0x55bd07013940 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f5fd77fe640 1 -- 10.20.193.28:0/3651144131 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6008005340 con 0x55bd07013940 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3651144131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd07013940 msgr2=0x55bd07012990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd07013940 0x55bd07012990 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=16867029799548521786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6008003e90 tx=0x7f6008003ec0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3651144131 shutdown_connections 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fcea90 0x55bd06fe3f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd07013940 0x55bd07012990 unknown :-1 s=CLOSED pgs=485 gs=1 cs=0 l=1 c_cookie=16867029799548521786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/3651144131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd06fce180 0x55bd06fe3a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3651144131 >> 10.20.193.28:0/3651144131 conn(0x55bd06fac680 msgr2=0x55bd06fd13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:51.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3651144131 shutdown_connections 2026-02-20T13:30:51.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.095+0000 7f601bdb7e00 1 -- 10.20.193.28:0/3651144131 wait complete. 2026-02-20T13:30:51.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f601bdb7e00 1 -- start start 2026-02-20T13:30:51.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f601bdb7e00 1 Processor -- start 2026-02-20T13:30:51.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fce180 0x55bd06fee360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fee8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f601bdb7e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd07013940 0x55bd07078e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd06fef090 con 0x55bd06fce180 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55bd06fef200 con 0x55bd06fcea90 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f601bdb7e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55bd070793f0 con 0x55bd07013940 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f60137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fce180 0x55bd06fee360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f6012ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f6012ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fee8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57710/0 (socket says 10.20.193.28:57710) 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f6012ffd640 1 -- 10.20.193.28:0/323582360 learned_addr learned my addr 10.20.193.28:0/323582360 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.096+0000 7f6013fff640 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd07013940 0x55bd07078e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f6012ffd640 1 -- 10.20.193.28:0/323582360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd07013940 msgr2=0x55bd07078e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:51.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f6012ffd640 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd07013940 0x55bd07078e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f6012ffd640 1 -- 10.20.193.28:0/323582360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fce180 msgr2=0x55bd06fee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f6012ffd640 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fce180 0x55bd06fee360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f6012ffd640 1 -- 10.20.193.28:0/323582360 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd06e5e680 con 0x55bd06fcea90 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f60137fe640 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fce180 0x55bd06fee360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f6012ffd640 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fee8a0 secure :-1 s=READY pgs=486 gs=2 cs=0 l=1 c_cookie=1794855694989532522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60040aeec0 tx=0x7f60040092e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e89bbebaf01d6a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f5fd57fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f5fd57fa640 1 -- 10.20.193.28:0/323582360 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6004004500 con 0x55bd06fcea90 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f5fd57fa640 1 -- 10.20.193.28:0/323582360 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55bd06b706f0 con 0x55bd06fcea90 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60141747b0 con 0x55bd06fcea90 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f5fd57fa640 1 -- 10.20.193.28:0/323582360 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60040b3d80 con 0x55bd06fcea90 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f5fd57fa640 1 -- 10.20.193.28:0/323582360 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f60040050b0 con 0x55bd06fcea90 2026-02-20T13:30:51.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f5fd57fa640 10 client.30233 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f601bdb7e00 10 client.30233 _ll_register_callbacks cb 0x55bd06e5b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60040b4f30 con 0x55bd06fcea90 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f5fd57fa640 1 -- 10.20.193.28:0/323582360 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f60040b3ee0 con 0x55bd06fcea90 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f601bdb7e00 10 client.30233 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.097+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55bd06e703b0 con 0x55bd06fcea90 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.098+0000 7f5fd57fa640 1 -- 10.20.193.28:0/323582360 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f60040ca020 con 0x55bd06fcea90 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.098+0000 7f601bdb7e00 10 client.30233 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.098+0000 7f601bdb7e00 10 client.30233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.098+0000 7f601bdb7e00 20 client.30233 populate_metadata read hostname 'trial028' 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.098+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bd070c0cd0 0x55bd070e1130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.098+0000 7f601bdb7e00 4 client.30233 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:30:51.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.098+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bd06b6df40 con 0x55bd070c0cd0 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.098+0000 7f60137fe640 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bd070c0cd0 0x55bd070e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f5fd57fa640 10 client.30233 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f60137fe640 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bd070c0cd0 0x55bd070e1130 crc :-1 s=READY pgs=387 gs=4 cs=0 l=0 c_cookie=6158061737486671614 s_cookie=5296538771486737212 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5575d485ffd15efe server_cookie=498115f34d8d033c in_seq=0 out_seq=0 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f5fd57fa640 1 -- 10.20.193.28:0/323582360 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6622 (crc 0 0 0) 0x55bd06b6df40 con 0x55bd070c0cd0 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f5fd57fa640 10 client.30233 handle_command_reply: tid=0 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 client.30233 shutdown 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 msgr2=0x55bd06fee8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fee8a0 secure :-1 s=READY pgs=486 gs=2 cs=0 l=1 c_cookie=1794855694989532522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60040aeec0 tx=0x7f60040092e0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 shutdown_connections 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55bd070c0cd0 0x55bd070e1130 crc :-1 s=READY pgs=387 gs=4 cs=0 l=0 c_cookie=6158061737486671614 s_cookie=5296538771486737212 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55bd07013940 0x55bd07078e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55bd06fcea90 0x55bd06fee8a0 unknown :-1 s=CLOSED pgs=486 gs=2 cs=0 l=1 c_cookie=1794855694989532522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 --2- 10.20.193.28:0/323582360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd06fce180 0x55bd06fee360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 >> 10.20.193.28:0/323582360 conn(0x55bd06fac680 msgr2=0x55bd06fe2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:51.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f5fd57fa640 0 client.30233 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:51.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 shutdown_connections 2026-02-20T13:30:51.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 1 -- 10.20.193.28:0/323582360 wait complete. 2026-02-20T13:30:51.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.099+0000 7f601bdb7e00 20 client.30233 trim_cache size 0 max 16384 2026-02-20T13:30:51.109 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:51.110 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:30:51.110 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:30:51.110 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:30:51.110 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:30:51.110 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:30:51.110 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.110 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.110 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.111 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:30:51.111 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:30:51.111 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.111 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.112 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.112 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:30:51.112 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:30:51.112 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.112 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.113 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.113 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:30:51.113 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:30:51.113 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.113 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.114 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.115 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.116 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:30:51.117 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.118 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:30:51.120 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.124 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.126 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:51.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 -- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5fe80b5750 msgr2=0x7f5fe80d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5fe80b5750 0x7f5fe80d5c00 secure :-1 s=READY pgs=586 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6000004740 tx=0x7f6000005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 -- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601410dd70 msgr2=0x7f6014173e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601410dd70 0x7f6014173e40 secure :-1 s=READY pgs=1416 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6004009480 tx=0x7f600400ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:51.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 -- 10.20.193.28:0/1034982404 shutdown_connections 2026-02-20T13:30:51.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5fe80b5750 0x7f5fe80d5c00 unknown :-1 s=CLOSED pgs=586 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601410dd70 0x7f6014173e40 unknown :-1 s=CLOSED pgs=1416 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6014113570 0x7f60140eecd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 --2- 10.20.193.28:0/1034982404 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f601410d380 0x7f60140ee5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 -- 10.20.193.28:0/1034982404 >> 10.20.193.28:0/1034982404 conn(0x7f60140eac10 msgr2=0x7f601410eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:51.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 -- 10.20.193.28:0/1034982404 shutdown_connections 2026-02-20T13:30:51.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.100+0000 7f6019dbd640 1 -- 10.20.193.28:0/1034982404 wait complete. 2026-02-20T13:30:51.242 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:30:51.243 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:30:51.428 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:51.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.598+0000 7f6069c8e640 1 -- 10.20.193.28:0/1756589001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064061840 msgr2=0x7f6064155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.598+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1756589001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064061840 0x7f6064155440 secure :-1 s=READY pgs=1417 gs=1 cs=0 l=1 c_cookie=1350453856051388613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f604c009950 tx=0x7f604c02f1b0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.598+0000 7f6069c8e640 1 -- 10.20.193.28:0/1756589001 shutdown_connections 2026-02-20T13:30:51.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.598+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1756589001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064061840 0x7f6064155440 unknown :-1 s=CLOSED pgs=1417 gs=1 cs=0 l=1 c_cookie=1350453856051388613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.598+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1756589001 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6064155980 0x7f6064175d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.598+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1756589001 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6064060f30 0x7f6064061300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.598+0000 7f6069c8e640 1 -- 10.20.193.28:0/1756589001 >> 10.20.193.28:0/1756589001 conn(0x7f60640eaad0 msgr2=0x7f606410aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:51.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.598+0000 7f6069c8e640 1 -- 10.20.193.28:0/1756589001 shutdown_connections 2026-02-20T13:30:51.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.599+0000 7f6069c8e640 1 -- 10.20.193.28:0/1756589001 wait complete. 2026-02-20T13:30:51.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6069c8e640 1 Processor -- start 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6069c8e640 1 -- start start 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6069c8e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6064060f30 0x7f60641620f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6069c8e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6064061840 0x7f6064162630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6069c8e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064155980 0x7f6064167a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6069c8e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6064168020 con 0x7f6064155980 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6069c8e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6064168190 con 0x7f6064060f30 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6069c8e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6064168350 con 0x7f6064061840 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6068c8c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6064060f30 0x7f60641620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6068c8c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6064060f30 0x7f60641620f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57726/0 (socket says 10.20.193.28:57726) 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f6068c8c640 1 -- 10.20.193.28:0/1044497463 learned_addr learned my addr 10.20.193.28:0/1044497463 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f605bfff640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6064061840 0x7f6064162630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.600+0000 7f606948d640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064155980 0x7f6064167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f606948d640 1 -- 10.20.193.28:0/1044497463 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6064061840 msgr2=0x7f6064162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f606948d640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6064061840 0x7f6064162630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f606948d640 1 -- 10.20.193.28:0/1044497463 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6064060f30 msgr2=0x7f60641620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f606948d640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6064060f30 0x7f60641620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f606948d640 1 -- 10.20.193.28:0/1044497463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c009570 con 0x7f6064155980 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f606948d640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064155980 0x7f6064167a00 secure :-1 s=READY pgs=1418 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f606000e720 tx=0x7f606000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:51.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f6059ffb640 1 -- 10.20.193.28:0/1044497463 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6060005500 con 0x7f6064155980 2026-02-20T13:30:51.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f6059ffb640 1 -- 10.20.193.28:0/1044497463 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6060005660 con 0x7f6064155980 2026-02-20T13:30:51.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6064168630 con 0x7f6064155980 2026-02-20T13:30:51.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f6059ffb640 1 -- 10.20.193.28:0/1044497463 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6060011460 con 0x7f6064155980 2026-02-20T13:30:51.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.601+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641515a0 con 0x7f6064155980 2026-02-20T13:30:51.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.602+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602c005300 con 0x7f6064155980 2026-02-20T13:30:51.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.604+0000 7f6059ffb640 1 -- 10.20.193.28:0/1044497463 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f606000c7e0 con 0x7f6064155980 2026-02-20T13:30:51.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.606+0000 7f6059ffb640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60400b56e0 0x7f60400d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:51.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.606+0000 7f6059ffb640 1 -- 10.20.193.28:0/1044497463 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f60600e7980 con 0x7f6064155980 2026-02-20T13:30:51.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.606+0000 7f6059ffb640 1 -- 10.20.193.28:0/1044497463 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f6060120730 con 0x7f6064155980 2026-02-20T13:30:51.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.606+0000 7f6068c8c640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60400b56e0 0x7f60400d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:51.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.606+0000 7f6068c8c640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60400b56e0 0x7f60400d5b90 secure :-1 s=READY pgs=587 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6054005c70 tx=0x7f6054007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:51.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.748+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f602c005950 con 0x7f6064155980 2026-02-20T13:30:51.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.748+0000 7f6059ffb640 1 -- 10.20.193.28:0/1044497463 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f60600aa3e0 con 0x7f6064155980 2026-02-20T13:30:51.752 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:30:51.752 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:30:51.753 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:30:51.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60400b56e0 msgr2=0x7f60400d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60400b56e0 0x7f60400d5b90 secure :-1 s=READY pgs=587 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6054005c70 tx=0x7f6054007480 comp rx=0 tx=0).stop 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064155980 msgr2=0x7f6064167a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064155980 0x7f6064167a00 secure :-1 s=READY pgs=1418 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f606000e720 tx=0x7f606000ebf0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 shutdown_connections 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f60400b56e0 0x7f60400d5b90 unknown :-1 s=CLOSED pgs=587 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6064155980 0x7f6064167a00 unknown :-1 s=CLOSED pgs=1418 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6064061840 0x7f6064162630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 --2- 10.20.193.28:0/1044497463 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6064060f30 0x7f60641620f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 >> 10.20.193.28:0/1044497463 conn(0x7f60640eaad0 msgr2=0x7f606410aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 shutdown_connections 2026-02-20T13:30:51.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:51.750+0000 7f6069c8e640 1 -- 10.20.193.28:0/1044497463 wait complete. 2026-02-20T13:30:51.854 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:30:52.039 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:52.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.213+0000 7feeaca4b640 1 -- 10.20.193.28:0/88498596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea810b230 msgr2=0x7feea810b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.213+0000 7feeaca4b640 1 --2- 10.20.193.28:0/88498596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea810b230 0x7feea810b600 secure :-1 s=READY pgs=1419 gs=2 cs=0 l=1 c_cookie=4617791791715811267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94009950 tx=0x7fee9402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 -- 10.20.193.28:0/88498596 shutdown_connections 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 --2- 10.20.193.28:0/88498596 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feea8155850 0x7feea8175ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 --2- 10.20.193.28:0/88498596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feea810bb40 0x7feea81551e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 --2- 10.20.193.28:0/88498596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea810b230 0x7feea810b600 unknown :-1 s=CLOSED pgs=1419 gs=2 cs=0 l=1 c_cookie=4617791791715811267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 -- 10.20.193.28:0/88498596 >> 10.20.193.28:0/88498596 conn(0x7feea80e8ce0 msgr2=0x7feea81090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 -- 10.20.193.28:0/88498596 shutdown_connections 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 -- 10.20.193.28:0/88498596 wait complete. 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 Processor -- start 2026-02-20T13:30:52.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.214+0000 7feeaca4b640 1 -- start start 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feeaca4b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feea810b230 0x7feea8160140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feeaca4b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feea810bb40 0x7feea8160680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feeaca4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea8155850 0x7feea8165a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feeaca4b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feea8166070 con 0x7feea8155850 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feeaca4b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7feea81661e0 con 0x7feea810bb40 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feeaca4b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7feea81663a0 con 0x7feea810b230 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feea810b230 0x7feea8160140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea8155850 0x7feea8165a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feea810b230 0x7feea8160140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37778/0 (socket says 10.20.193.28:37778) 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea77fe640 1 -- 10.20.193.28:0/690456573 learned_addr learned my addr 10.20.193.28:0/690456573 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea6ffd640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feea810bb40 0x7feea8160680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea7fff640 1 -- 10.20.193.28:0/690456573 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feea810b230 msgr2=0x7feea8160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea7fff640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feea810b230 0x7feea8160140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea7fff640 1 -- 10.20.193.28:0/690456573 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feea810bb40 msgr2=0x7feea8160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea7fff640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feea810bb40 0x7feea8160680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea7fff640 1 -- 10.20.193.28:0/690456573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee94009570 con 0x7feea8155850 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.215+0000 7feea77fe640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feea810b230 0x7feea8160140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.216+0000 7feea7fff640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea8155850 0x7feea8165a50 secure :-1 s=READY pgs=1420 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9c00f940 tx=0x7fee9c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.216+0000 7feea4ff9640 1 -- 10.20.193.28:0/690456573 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee9c00dce0 con 0x7feea8155850 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.216+0000 7feea4ff9640 1 -- 10.20.193.28:0/690456573 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee9c00de40 con 0x7feea8155850 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.216+0000 7feea4ff9640 1 -- 10.20.193.28:0/690456573 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee9c0116b0 con 0x7feea8155850 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.216+0000 7feeaca4b640 1 -- 10.20.193.28:0/690456573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea8166680 con 0x7feea8155850 2026-02-20T13:30:52.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.216+0000 7feeaca4b640 1 -- 10.20.193.28:0/690456573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea8153360 con 0x7feea8155850 2026-02-20T13:30:52.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.219+0000 7feea4ff9640 1 -- 10.20.193.28:0/690456573 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fee9c020060 con 0x7feea8155850 2026-02-20T13:30:52.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.221+0000 7feea4ff9640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fee7c0b5760 0x7fee7c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.221+0000 7feea4ff9640 1 -- 10.20.193.28:0/690456573 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fee9c015070 con 0x7feea8155850 2026-02-20T13:30:52.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.221+0000 7feea77fe640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fee7c0b5760 0x7fee7c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.221+0000 7feeafccee00 1 Processor -- start 2026-02-20T13:30:52.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.221+0000 7feea77fe640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fee7c0b5760 0x7fee7c0d5c10 secure :-1 s=READY pgs=588 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94038820 tx=0x7fee9403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.221+0000 7feeafccee00 1 -- start start 2026-02-20T13:30:52.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feeafccee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dbec730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feeafccee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc315e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feeafccee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc51f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feeafccee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fa7db02780 con 0x55fa7dbec360 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feeafccee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fa7dafe4b0 con 0x55fa7dbecc70 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feeafccee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fa7daf8450 con 0x55fa7dc31b20 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dbec730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dbec730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49564/0 (socket says 10.20.193.28:49564) 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 -- 10.20.193.28:0/525779824 learned_addr learned my addr 10.20.193.28:0/525779824 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea6ffd640 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea7fff640 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc51f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 -- 10.20.193.28:0/525779824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 msgr2=0x55fa7dc51f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc51f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 -- 10.20.193.28:0/525779824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 msgr2=0x55fa7dc315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc315e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 -- 10.20.193.28:0/525779824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7daa3d10 con 0x55fa7dbec360 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.222+0000 7feea77fe640 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dbec730 secure :-1 s=READY pgs=1421 gs=1 cs=0 l=1 c_cookie=13291237008551360461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94002de0 tx=0x7fee94040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b873f5a3a83ab7cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7fee6bfff640 1 -- 10.20.193.28:0/525779824 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee9402fc10 con 0x55fa7dbec360 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7fee6bfff640 1 -- 10.20.193.28:0/525779824 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee9403e040 con 0x55fa7dbec360 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7fee6bfff640 1 -- 10.20.193.28:0/525779824 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee94044ba0 con 0x55fa7dbec360 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 -- 10.20.193.28:0/525779824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 msgr2=0x55fa7dbec730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dbec730 secure :-1 s=READY pgs=1421 gs=1 cs=0 l=1 c_cookie=13291237008551360461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94002de0 tx=0x7fee94040000 comp rx=0 tx=0).stop 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 -- 10.20.193.28:0/525779824 shutdown_connections 2026-02-20T13:30:52.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc51f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc315e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 --2- 10.20.193.28:0/525779824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dbec730 unknown :-1 s=CLOSED pgs=1421 gs=1 cs=0 l=1 c_cookie=13291237008551360461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 -- 10.20.193.28:0/525779824 >> 10.20.193.28:0/525779824 conn(0x55fa7dbca860 msgr2=0x55fa7dbeac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 -- 10.20.193.28:0/525779824 shutdown_connections 2026-02-20T13:30:52.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.223+0000 7feeafccee00 1 -- 10.20.193.28:0/525779824 wait complete. 2026-02-20T13:30:52.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.225+0000 7feeafccee00 1 -- start start 2026-02-20T13:30:52.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.225+0000 7feeafccee00 1 Processor -- start 2026-02-20T13:30:52.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.225+0000 7feeafccee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbec360 0x55fa7dc49780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.225+0000 7feeafccee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbecc70 0x55fa7dc49cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.225+0000 7feeafccee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc4ba50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.225+0000 7feeafccee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fa7dc4bfc0 con 0x55fa7dbecc70 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.225+0000 7feeafccee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fa7dc4c130 con 0x55fa7dbec360 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.225+0000 7feeafccee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fa7dc4c2f0 con 0x55fa7dc31b20 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbec360 0x55fa7dc49780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbec360 0x55fa7dc49780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57748/0 (socket says 10.20.193.28:57748) 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea77fe640 1 -- 10.20.193.28:0/1586331903 learned_addr learned my addr 10.20.193.28:0/1586331903 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea6ffd640 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbecc70 0x55fa7dc49cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea7fff640 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc4ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea77fe640 1 -- 10.20.193.28:0/1586331903 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 msgr2=0x55fa7dc4ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea77fe640 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc4ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea77fe640 1 -- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbecc70 msgr2=0x55fa7dc49cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea77fe640 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbecc70 0x55fa7dc49cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea77fe640 1 -- 10.20.193.28:0/1586331903 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7da7c3c0 con 0x55fa7dbec360 2026-02-20T13:30:52.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.226+0000 7feea6ffd640 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbecc70 0x55fa7dc49cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feea77fe640 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbec360 0x55fa7dc49780 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=7213704128561604740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94047020 tx=0x7fee94044410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=641c39af61aee884 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7fee697fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7fee697fa640 1 -- 10.20.193.28:0/1586331903 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee940444b0 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea81768c0 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7fee697fa640 1 -- 10.20.193.28:0/1586331903 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee94038e00 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7fee697fa640 1 -- 10.20.193.28:0/1586331903 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee94059d60 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 10 client.30251 _ll_register_callbacks cb 0x55fa7da79a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa7d78e6f0 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7fee697fa640 1 -- 10.20.193.28:0/1586331903 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fee94065460 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7fee697fa640 1 -- 10.20.193.28:0/1586331903 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fee94065640 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 10 client.30251 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55fa7da8e0e0 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7fee697fa640 1 -- 10.20.193.28:0/1586331903 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fee94059410 con 0x55fa7dbec360 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 10 client.30251 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:52.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 10 client.30251 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 20 client.30251 populate_metadata read hostname 'trial028' 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55fa7dc2ee80 0x55fa7dc2f320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 4 client.30251 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.227+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa7da9af80 con 0x55fa7dc2ee80 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.228+0000 7feea6ffd640 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55fa7dc2ee80 0x55fa7dc2f320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.228+0000 7feea6ffd640 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55fa7dc2ee80 0x55fa7dc2f320 crc :-1 s=READY pgs=73 gs=4 cs=0 l=0 c_cookie=6433049578535247296 s_cookie=17437968777621525919 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5946c8820711ddc0 server_cookie=f2001c36827bd59f in_seq=0 out_seq=0 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.228+0000 7fee697fa640 10 client.30251 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7fee697fa640 1 -- 10.20.193.28:0/1586331903 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fa7da9af80 con 0x55fa7dc2ee80 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7fee697fa640 10 client.30251 handle_command_reply: tid=0 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 client.30251 shutdown 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbec360 msgr2=0x55fa7dc49780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbec360 0x55fa7dc49780 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=7213704128561604740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94047020 tx=0x7fee94044410 comp rx=0 tx=0).stop 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 shutdown_connections 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55fa7dc2ee80 0x55fa7dc2f320 crc :-1 s=READY pgs=73 gs=4 cs=0 l=0 c_cookie=6433049578535247296 s_cookie=17437968777621525919 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbecc70 0x55fa7dc49cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc4ba50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 --2- 10.20.193.28:0/1586331903 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbec360 0x55fa7dc49780 unknown :-1 s=CLOSED pgs=487 gs=1 cs=0 l=1 c_cookie=7213704128561604740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7fee697fa640 0 client.30251 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 >> 10.20.193.28:0/1586331903 conn(0x55fa7dbca860 msgr2=0x55fa7dbeac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 shutdown_connections 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 1 -- 10.20.193.28:0/1586331903 wait complete. 2026-02-20T13:30:52.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.229+0000 7feeafccee00 20 client.30251 trim_cache size 0 max 16384 2026-02-20T13:30:52.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.236+0000 7feeafccee00 1 Processor -- start 2026-02-20T13:30:52.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feeafccee00 1 -- start start 2026-02-20T13:30:52.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feeafccee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dbec360 0x55fa7dc4b9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feeafccee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc46910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feeafccee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dc31b20 0x55fa7dc46e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feeafccee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fa7daf6080 con 0x55fa7dc31b20 2026-02-20T13:30:52.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feeafccee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fa7d7b6700 con 0x55fa7dbecc70 2026-02-20T13:30:52.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feeafccee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fa7db5aae0 con 0x55fa7dbec360 2026-02-20T13:30:52.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feea7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dc31b20 0x55fa7dc46e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feea6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc46910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feea7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dc31b20 0x55fa7dc46e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49586/0 (socket says 10.20.193.28:49586) 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feea7fff640 1 -- 10.20.193.28:0/3974409263 learned_addr learned my addr 10.20.193.28:0/3974409263 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feea77fe640 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dbec360 0x55fa7dc4b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.237+0000 7feea7fff640 1 -- 10.20.193.28:0/3974409263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dbec360 msgr2=0x55fa7dc4b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feea7fff640 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dbec360 0x55fa7dc4b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feea7fff640 1 -- 10.20.193.28:0/3974409263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 msgr2=0x55fa7dc46910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feea7fff640 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc46910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feea7fff640 1 -- 10.20.193.28:0/3974409263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7dc37100 con 0x55fa7dc31b20 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feea77fe640 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dbec360 0x55fa7dc4b9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feea7fff640 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dc31b20 0x55fa7dc46e50 secure :-1 s=READY pgs=1422 gs=2 cs=0 l=1 c_cookie=13163241375156240374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9c00a4e0 tx=0x7fee9c006020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ad3a49f2e97ff6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7fee6b7fe640 1 -- 10.20.193.28:0/3974409263 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee9c0b6240 con 0x55fa7dc31b20 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7fee6b7fe640 1 -- 10.20.193.28:0/3974409263 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee9c0b9080 con 0x55fa7dc31b20 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7fee6b7fe640 1 -- 10.20.193.28:0/3974409263 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee9c0adae0 con 0x55fa7dc31b20 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feeafccee00 1 -- 10.20.193.28:0/3974409263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dc31b20 msgr2=0x55fa7dc46e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feeafccee00 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dc31b20 0x55fa7dc46e50 secure :-1 s=READY pgs=1422 gs=2 cs=0 l=1 c_cookie=13163241375156240374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9c00a4e0 tx=0x7fee9c006020 comp rx=0 tx=0).stop 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feeafccee00 1 -- 10.20.193.28:0/3974409263 shutdown_connections 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feeafccee00 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dc31b20 0x55fa7dc46e50 unknown :-1 s=CLOSED pgs=1422 gs=2 cs=0 l=1 c_cookie=13163241375156240374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feeafccee00 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc46910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feeafccee00 1 --2- 10.20.193.28:0/3974409263 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dbec360 0x55fa7dc4b9e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.238+0000 7feeafccee00 1 -- 10.20.193.28:0/3974409263 >> 10.20.193.28:0/3974409263 conn(0x55fa7dbca860 msgr2=0x55fa7dc4f360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.239+0000 7feeafccee00 1 -- 10.20.193.28:0/3974409263 shutdown_connections 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.239+0000 7feeafccee00 1 -- 10.20.193.28:0/3974409263 wait complete. 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.239+0000 7feeafccee00 1 -- start start 2026-02-20T13:30:52.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.239+0000 7feeafccee00 1 Processor -- start 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feeafccee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dc30ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feeafccee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc31440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feeafccee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc2fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feeafccee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fa7dbca2a0 con 0x55fa7dbec360 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feeafccee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fa7dc30420 con 0x55fa7dbecc70 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feeafccee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fa7dc305e0 con 0x55fa7dc31b20 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dc30ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dc30ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49602/0 (socket says 10.20.193.28:49602) 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea77fe640 1 -- 10.20.193.28:0/3086414154 learned_addr learned my addr 10.20.193.28:0/3086414154 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea77fe640 1 -- 10.20.193.28:0/3086414154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 msgr2=0x55fa7dc2fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea77fe640 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc2fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea6ffd640 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc31440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea77fe640 1 -- 10.20.193.28:0/3086414154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 msgr2=0x55fa7dc31440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea77fe640 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc31440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea77fe640 1 -- 10.20.193.28:0/3086414154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7da88b60 con 0x55fa7dbec360 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.240+0000 7feea6ffd640 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc31440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:30:52.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7feea77fe640 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dc30ee0 secure :-1 s=READY pgs=1423 gs=1 cs=0 l=1 c_cookie=15655289330743742907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee940023d0 tx=0x7fee94038920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d942c2b376f191bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7fee697fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:52.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7fee697fa640 1 -- 10.20.193.28:0/3086414154 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee94063eb0 con 0x55fa7dbec360 2026-02-20T13:30:52.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7fee697fa640 1 -- 10.20.193.28:0/3086414154 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55fa7d78e6f0 con 0x55fa7dbec360 2026-02-20T13:30:52.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7fee697fa640 1 -- 10.20.193.28:0/3086414154 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee94063a20 con 0x55fa7dbec360 2026-02-20T13:30:52.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea8153360 con 0x55fa7dbec360 2026-02-20T13:30:52.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7fee697fa640 1 -- 10.20.193.28:0/3086414154 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fee9404e670 con 0x55fa7dbec360 2026-02-20T13:30:52.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7feeafccee00 10 client.20337 _ll_register_callbacks cb 0x55fa7da79a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee9403e040 con 0x55fa7dbec360 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7fee697fa640 1 -- 10.20.193.28:0/3086414154 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fee94063bb0 con 0x55fa7dbec360 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7feeafccee00 10 client.20337 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.241+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55fa7da7c6f0 con 0x55fa7dbec360 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7fee697fa640 1 -- 10.20.193.28:0/3086414154 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fee94078070 con 0x55fa7dbec360 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feeafccee00 10 client.20337 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feeafccee00 10 client.20337 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feeafccee00 20 client.20337 populate_metadata read hostname 'trial028' 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feeafccee00 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55fa7dbd0020 0x55fa7dbd04c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feeafccee00 4 client.20337 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa7d78bf40 con 0x55fa7dbd0020 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feea6ffd640 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55fa7dbd0020 0x55fa7dbd04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feea6ffd640 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55fa7dbd0020 0x55fa7dbd04c0 crc :-1 s=READY pgs=74 gs=4 cs=0 l=0 c_cookie=5772619263641701182 s_cookie=6543614786129967016 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=501c76a2b8f0cb3e server_cookie=5acf96fa7a4537a8 in_seq=0 out_seq=0 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7fee697fa640 10 client.20337 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7fee697fa640 1 -- 10.20.193.28:0/3086414154 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa7d78bf40 con 0x55fa7dbd0020 2026-02-20T13:30:52.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7fee697fa640 10 client.20337 handle_command_reply: tid=0 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.242+0000 7feeafccee00 1 client.20337 shutdown 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 msgr2=0x55fa7dc30ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dc30ee0 secure :-1 s=READY pgs=1423 gs=1 cs=0 l=1 c_cookie=15655289330743742907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee940023d0 tx=0x7fee94038920 comp rx=0 tx=0).stop 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 shutdown_connections 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55fa7dbd0020 0x55fa7dbd04c0 crc :-1 s=READY pgs=74 gs=4 cs=0 l=0 c_cookie=5772619263641701182 s_cookie=6543614786129967016 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fa7dc31b20 0x55fa7dc2fcf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fa7dbecc70 0x55fa7dc31440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 --2- 10.20.193.28:0/3086414154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fa7dbec360 0x55fa7dc30ee0 unknown :-1 s=CLOSED pgs=1423 gs=1 cs=0 l=1 c_cookie=15655289330743742907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7fee697fa640 0 client.20337 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 >> 10.20.193.28:0/3086414154 conn(0x55fa7dbca860 msgr2=0x55fa7dc4e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 shutdown_connections 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 1 -- 10.20.193.28:0/3086414154 wait complete. 2026-02-20T13:30:52.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeafccee00 20 client.20337 trim_cache size 0 max 16384 2026-02-20T13:30:52.249 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:52.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeaca4b640 1 -- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fee7c0b5760 msgr2=0x7fee7c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeaca4b640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fee7c0b5760 0x7fee7c0d5c10 secure :-1 s=READY pgs=588 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94038820 tx=0x7fee9403a040 comp rx=0 tx=0).stop 2026-02-20T13:30:52.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeaca4b640 1 -- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea8155850 msgr2=0x7feea8165a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.243+0000 7feeaca4b640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea8155850 0x7feea8165a50 secure :-1 s=READY pgs=1420 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9c00f940 tx=0x7fee9c00fe10 comp rx=0 tx=0).stop 2026-02-20T13:30:52.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.244+0000 7feeaca4b640 1 -- 10.20.193.28:0/690456573 shutdown_connections 2026-02-20T13:30:52.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.244+0000 7feeaca4b640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fee7c0b5760 0x7fee7c0d5c10 unknown :-1 s=CLOSED pgs=588 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.244+0000 7feeaca4b640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feea8155850 0x7feea8165a50 unknown :-1 s=CLOSED pgs=1420 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.244+0000 7feeaca4b640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7feea810bb40 0x7feea8160680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.244+0000 7feeaca4b640 1 --2- 10.20.193.28:0/690456573 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7feea810b230 0x7feea8160140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.244+0000 7feeaca4b640 1 -- 10.20.193.28:0/690456573 >> 10.20.193.28:0/690456573 conn(0x7feea80e8ce0 msgr2=0x7feea81090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.244+0000 7feeaca4b640 1 -- 10.20.193.28:0/690456573 shutdown_connections 2026-02-20T13:30:52.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.244+0000 7feeaca4b640 1 -- 10.20.193.28:0/690456573 wait complete. 2026-02-20T13:30:52.381 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:30:52.566 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:52.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:52 trial028 ceph-mon[37442]: pgmap v587: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2026-02-20T13:30:52.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:52 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1044497463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:52.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.741+0000 7fd707fff640 1 -- 10.20.193.28:0/1599160784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 msgr2=0x7fd7081193f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.741+0000 7fd707fff640 1 --2- 10.20.193.28:0/1599160784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 0x7fd7081193f0 secure :-1 s=READY pgs=1424 gs=1 cs=0 l=1 c_cookie=11623677413716836030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f0009950 tx=0x7fd6f002f190 comp rx=0 tx=0).stop 2026-02-20T13:30:52.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 -- 10.20.193.28:0/1599160784 shutdown_connections 2026-02-20T13:30:52.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 --2- 10.20.193.28:0/1599160784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 0x7fd7081193f0 unknown :-1 s=CLOSED pgs=1424 gs=1 cs=0 l=1 c_cookie=11623677413716836030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 --2- 10.20.193.28:0/1599160784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd708119ba0 0x7fd70817a570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 --2- 10.20.193.28:0/1599160784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd708113fa0 0x7fd708114370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 -- 10.20.193.28:0/1599160784 >> 10.20.193.28:0/1599160784 conn(0x7fd708064a90 msgr2=0x7fd708064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 -- 10.20.193.28:0/1599160784 shutdown_connections 2026-02-20T13:30:52.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 -- 10.20.193.28:0/1599160784 wait complete. 2026-02-20T13:30:52.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 Processor -- start 2026-02-20T13:30:52.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.742+0000 7fd707fff640 1 -- start start 2026-02-20T13:30:52.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd707fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd708113fa0 0x7fd7080fbc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd707fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 0x7fd70817a470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd707fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd708119ba0 0x7fd7080fc350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd707fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd708101560 con 0x7fd708114990 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd707fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081016d0 con 0x7fd708113fa0 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd707fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd708101890 con 0x7fd708119ba0 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 0x7fd70817a470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd706ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd708113fa0 0x7fd7080fbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 0x7fd70817a470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49628/0 (socket says 10.20.193.28:49628) 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 -- 10.20.193.28:0/3122008377 learned_addr learned my addr 10.20.193.28:0/3122008377 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7077fe640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd708119ba0 0x7fd7080fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 -- 10.20.193.28:0/3122008377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd708119ba0 msgr2=0x7fd7080fc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd708119ba0 0x7fd7080fc350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 -- 10.20.193.28:0/3122008377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd708113fa0 msgr2=0x7fd7080fbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd708113fa0 0x7fd7080fbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 -- 10.20.193.28:0/3122008377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f0009570 con 0x7fd708114990 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd7067fc640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 0x7fd70817a470 secure :-1 s=READY pgs=1425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f0005b30 tx=0x7fd6f0004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.743+0000 7fd6e7fff640 1 -- 10.20.193.28:0/3122008377 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f003d070 con 0x7fd708114990 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.744+0000 7fd6e7fff640 1 -- 10.20.193.28:0/3122008377 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6f0038920 con 0x7fd708114990 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.744+0000 7fd6e7fff640 1 -- 10.20.193.28:0/3122008377 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f00418a0 con 0x7fd708114990 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.744+0000 7fd707fff640 1 -- 10.20.193.28:0/3122008377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd708101b10 con 0x7fd708114990 2026-02-20T13:30:52.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.744+0000 7fd707fff640 1 -- 10.20.193.28:0/3122008377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd708101f30 con 0x7fd708114990 2026-02-20T13:30:52.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.746+0000 7fd6e7fff640 1 -- 10.20.193.28:0/3122008377 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd6f0048020 con 0x7fd708114990 2026-02-20T13:30:52.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.748+0000 7fd6e7fff640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6dc0b5750 0x7fd6dc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.748+0000 7fd6e7fff640 1 -- 10.20.193.28:0/3122008377 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6f010af10 con 0x7fd708114990 2026-02-20T13:30:52.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.748+0000 7fd706ffd640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6dc0b5750 0x7fd6dc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd706ffd640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6dc0b5750 0x7fd6dc0d5c00 secure :-1 s=READY pgs=589 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6fc004740 tx=0x7fd6fc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd70f4f1e00 1 Processor -- start 2026-02-20T13:30:52.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd70f4f1e00 1 -- start start 2026-02-20T13:30:52.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4360 0x56106a4e4730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 0x56106a5295e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a549f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56106a3fa780 con 0x56106a529b20 2026-02-20T13:30:52.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56106a3f64b0 con 0x56106a4e4c70 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56106a3f0450 con 0x56106a4e4360 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd706ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4360 0x56106a4e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.749+0000 7fd7077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a549f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a549f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49640/0 (socket says 10.20.193.28:49640) 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7077fe640 1 -- 10.20.193.28:0/1671335137 learned_addr learned my addr 10.20.193.28:0/1671335137 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7067fc640 1 --2- 10.20.193.28:0/1671335137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 0x56106a5295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7077fe640 1 -- 10.20.193.28:0/1671335137 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4360 msgr2=0x56106a4e4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7077fe640 1 --2- 10.20.193.28:0/1671335137 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4360 0x56106a4e4730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7077fe640 1 -- 10.20.193.28:0/1671335137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 msgr2=0x56106a5295e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7077fe640 1 --2- 10.20.193.28:0/1671335137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 0x56106a5295e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7077fe640 1 -- 10.20.193.28:0/1671335137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106a39bd10 con 0x56106a529b20 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd7077fe640 1 --2- 10.20.193.28:0/1671335137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a549f00 secure :-1 s=READY pgs=1426 gs=2 cs=0 l=1 c_cookie=7721532906635594102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f8006a50 tx=0x7fd6f8003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b286544a5810976 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd6d37fe640 1 -- 10.20.193.28:0/1671335137 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f800ae30 con 0x56106a529b20 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd6d37fe640 1 -- 10.20.193.28:0/1671335137 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6f8003e90 con 0x56106a529b20 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd6d37fe640 1 -- 10.20.193.28:0/1671335137 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f8012a30 con 0x56106a529b20 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1671335137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 msgr2=0x56106a549f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/1671335137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a549f00 secure :-1 s=READY pgs=1426 gs=2 cs=0 l=1 c_cookie=7721532906635594102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f8006a50 tx=0x7fd6f8003c30 comp rx=0 tx=0).stop 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1671335137 shutdown_connections 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/1671335137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a549f00 unknown :-1 s=CLOSED pgs=1426 gs=2 cs=0 l=1 c_cookie=7721532906635594102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/1671335137 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 0x56106a5295e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/1671335137 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4360 0x56106a4e4730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1671335137 >> 10.20.193.28:0/1671335137 conn(0x56106a4c2860 msgr2=0x56106a4e2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.750+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1671335137 shutdown_connections 2026-02-20T13:30:52.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.751+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1671335137 wait complete. 2026-02-20T13:30:52.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.752+0000 7fd70f4f1e00 1 -- start start 2026-02-20T13:30:52.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.752+0000 7fd70f4f1e00 1 Processor -- start 2026-02-20T13:30:52.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.752+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4360 0x56106a5416e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.752+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a541c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.752+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a546c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.752+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56106a547150 con 0x56106a529b20 2026-02-20T13:30:52.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.752+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56106a5472c0 con 0x56106a4e4360 2026-02-20T13:30:52.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.752+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56106a547480 con 0x56106a4e4c70 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a541c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a546c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a541c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37850/0 (socket says 10.20.193.28:37850) 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7067fc640 1 -- 10.20.193.28:0/862659206 learned_addr learned my addr 10.20.193.28:0/862659206 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd706ffd640 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4360 0x56106a5416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7077fe640 1 -- 10.20.193.28:0/862659206 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 msgr2=0x56106a541c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7077fe640 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a541c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7077fe640 1 -- 10.20.193.28:0/862659206 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4360 msgr2=0x56106a5416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7077fe640 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4360 0x56106a5416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7077fe640 1 -- 10.20.193.28:0/862659206 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106a3743c0 con 0x56106a529b20 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd7077fe640 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a546c10 secure :-1 s=READY pgs=1427 gs=2 cs=0 l=1 c_cookie=1796418020896678129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f8005150 tx=0x7fd6f8012df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ee28ac13a820f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd6d0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/862659206 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f801bea0 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/862659206 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6f8021040 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/862659206 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f801baa0 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f8005350 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/862659206 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6f8006050 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd70f4f1e00 10 client.20349 _ll_register_callbacks cb 0x56106a371a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.753+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56106a0866f0 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/862659206 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd6f801b470 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd70f4f1e00 10 client.20349 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56106a3860e0 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/862659206 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd6f8006210 con 0x56106a529b20 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd70f4f1e00 10 client.20349 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:52.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd70f4f1e00 10 client.20349 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd70f4f1e00 20 client.20349 populate_metadata read hostname 'trial028' 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56106a526e30 0x56106a5272d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd70f4f1e00 4 client.20349 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56106a392f80 con 0x56106a526e30 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.754+0000 7fd706ffd640 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56106a526e30 0x56106a5272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd706ffd640 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56106a526e30 0x56106a5272d0 crc :-1 s=READY pgs=72 gs=4 cs=0 l=0 c_cookie=4645671016263433495 s_cookie=15706954321850282935 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4078bd2cebb5bd17 server_cookie=d9fa4fbc992c33b7 in_seq=0 out_seq=0 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd6d0ff9640 10 client.20349 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/862659206 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56106a392f80 con 0x56106a526e30 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd6d0ff9640 10 client.20349 handle_command_reply: tid=0 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 client.20349 shutdown 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 msgr2=0x56106a546c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a546c10 secure :-1 s=READY pgs=1427 gs=2 cs=0 l=1 c_cookie=1796418020896678129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f8005150 tx=0x7fd6f8012df0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 shutdown_connections 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56106a526e30 0x56106a5272d0 crc :-1 s=READY pgs=72 gs=4 cs=0 l=0 c_cookie=4645671016263433495 s_cookie=15706954321850282935 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a529b20 0x56106a546c10 unknown :-1 s=CLOSED pgs=1427 gs=2 cs=0 l=1 c_cookie=1796418020896678129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a541c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/862659206 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4360 0x56106a5416e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd6d0ff9640 0 client.20349 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.755+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 >> 10.20.193.28:0/862659206 conn(0x56106a4c2860 msgr2=0x56106a4e2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.756+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 shutdown_connections 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.756+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/862659206 wait complete. 2026-02-20T13:30:52.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.756+0000 7fd70f4f1e00 20 client.20349 trim_cache size 0 max 16384 2026-02-20T13:30:52.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd70f4f1e00 1 Processor -- start 2026-02-20T13:30:52.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd70f4f1e00 1 -- start start 2026-02-20T13:30:52.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a53ee10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a524780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a529b20 0x56106a524cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56106a533a10 con 0x56106a4e4360 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56106a3ee080 con 0x56106a529b20 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56106a0ae700 con 0x56106a4e4c70 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd7077fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a529b20 0x56106a524cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd706ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a53ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd7077fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a529b20 0x56106a524cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57802/0 (socket says 10.20.193.28:57802) 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd7077fe640 1 -- 10.20.193.28:0/1681331300 learned_addr learned my addr 10.20.193.28:0/1681331300 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.763+0000 7fd7067fc640 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a524780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd7077fe640 1 -- 10.20.193.28:0/1681331300 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 msgr2=0x56106a524780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd7077fe640 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a524780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd7077fe640 1 -- 10.20.193.28:0/1681331300 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 msgr2=0x56106a53ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd7077fe640 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a53ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd7077fe640 1 -- 10.20.193.28:0/1681331300 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106a380b60 con 0x56106a529b20 2026-02-20T13:30:52.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd706ffd640 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a53ee10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:52.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd7077fe640 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a529b20 0x56106a524cc0 secure :-1 s=READY pgs=488 gs=2 cs=0 l=1 c_cookie=10201860045269967519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f8005680 tx=0x7fd6f8014020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9449a8ce91229f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd6d2ffd640 1 -- 10.20.193.28:0/1681331300 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f8010e70 con 0x56106a529b20 2026-02-20T13:30:52.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd6d2ffd640 1 -- 10.20.193.28:0/1681331300 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6f8021070 con 0x56106a529b20 2026-02-20T13:30:52.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd6d2ffd640 1 -- 10.20.193.28:0/1681331300 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6f8005780 con 0x56106a529b20 2026-02-20T13:30:52.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1681331300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a529b20 msgr2=0x56106a524cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a529b20 0x56106a524cc0 secure :-1 s=READY pgs=488 gs=2 cs=0 l=1 c_cookie=10201860045269967519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f8005680 tx=0x7fd6f8014020 comp rx=0 tx=0).stop 2026-02-20T13:30:52.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1681331300 shutdown_connections 2026-02-20T13:30:52.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a529b20 0x56106a524cc0 unknown :-1 s=CLOSED pgs=488 gs=2 cs=0 l=1 c_cookie=10201860045269967519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a4e4c70 0x56106a524780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/1681331300 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a53ee10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.764+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1681331300 >> 10.20.193.28:0/1681331300 conn(0x56106a4c2860 msgr2=0x56106a53e700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.765+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1681331300 shutdown_connections 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.765+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/1681331300 wait complete. 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.765+0000 7fd70f4f1e00 1 -- start start 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.765+0000 7fd70f4f1e00 1 Processor -- start 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a4c49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 0x56106a4c4f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a529b20 0x56106a56f9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56106a52ef60 con 0x56106a4e4360 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56106a4c56a0 con 0x56106a4e4c70 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56106a56ff20 con 0x56106a529b20 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a4c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a4c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49664/0 (socket says 10.20.193.28:49664) 2026-02-20T13:30:52.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 -- 10.20.193.28:0/829525910 learned_addr learned my addr 10.20.193.28:0/829525910 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd7077fe640 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a529b20 0x56106a56f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd7067fc640 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 0x56106a4c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 -- 10.20.193.28:0/829525910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a529b20 msgr2=0x56106a56f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a529b20 0x56106a56f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 -- 10.20.193.28:0/829525910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 msgr2=0x56106a4c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 0x56106a4c4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 -- 10.20.193.28:0/829525910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106a3860e0 con 0x56106a4e4360 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd706ffd640 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a4c49f0 secure :-1 s=READY pgs=1428 gs=1 cs=0 l=1 c_cookie=8736008701874204708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x56106a527b80 tx=0x7fd6fc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793c89a105eef024 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd6d0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/829525910 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6fc024040 con 0x56106a4e4360 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6fc00be10 con 0x56106a4e4360 2026-02-20T13:30:52.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/829525910 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6fc015070 con 0x56106a4e4360 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/829525910 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6fc02a320 con 0x56106a4e4360 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 10 client.20355 _ll_register_callbacks cb 0x56106a371a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.766+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f8003e90 con 0x56106a4e4360 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/829525910 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6fc017070 con 0x56106a4e4360 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/829525910 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd6fc01eea0 con 0x56106a4e4360 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd70f4f1e00 10 client.20355 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56106a3746f0 con 0x56106a4e4360 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/829525910 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd6fc01e420 con 0x56106a4e4360 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd70f4f1e00 10 client.20355 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd70f4f1e00 10 client.20355 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd70f4f1e00 20 client.20355 populate_metadata read hostname 'trial028' 2026-02-20T13:30:52.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56106a5d82c0 0x56106a5f8770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd70f4f1e00 4 client.20355 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56106a083f40 con 0x56106a5d82c0 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.767+0000 7fd7067fc640 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56106a5d82c0 0x56106a5f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd7067fc640 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56106a5d82c0 0x56106a5f8770 crc :-1 s=READY pgs=73 gs=4 cs=0 l=0 c_cookie=6044669656932975019 s_cookie=6568070671615258460 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=53e2fb06e61281ab server_cookie=5b26797a0949ef5c in_seq=0 out_seq=0 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd6d0ff9640 10 client.20355 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd6d0ff9640 1 -- 10.20.193.28:0/829525910 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56106a083f40 con 0x56106a5d82c0 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd6d0ff9640 10 client.20355 handle_command_reply: tid=0 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 client.20355 shutdown 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 msgr2=0x56106a4c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a4c49f0 secure :-1 s=READY pgs=1428 gs=1 cs=0 l=1 c_cookie=8736008701874204708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x56106a527b80 tx=0x7fd6fc0047e0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 shutdown_connections 2026-02-20T13:30:52.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x56106a5d82c0 0x56106a5f8770 crc :-1 s=READY pgs=73 gs=4 cs=0 l=0 c_cookie=6044669656932975019 s_cookie=6568070671615258460 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56106a529b20 0x56106a56f9b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56106a4e4c70 0x56106a4c4f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 --2- 10.20.193.28:0/829525910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106a4e4360 0x56106a4c49f0 unknown :-1 s=CLOSED pgs=1428 gs=1 cs=0 l=1 c_cookie=8736008701874204708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 >> 10.20.193.28:0/829525910 conn(0x56106a4c2860 msgr2=0x56106a53ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd6d0ff9640 0 client.20355 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 shutdown_connections 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 1 -- 10.20.193.28:0/829525910 wait complete. 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.768+0000 7fd70f4f1e00 20 client.20355 trim_cache size 0 max 16384 2026-02-20T13:30:52.776 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 -- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6dc0b5750 msgr2=0x7fd6dc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6dc0b5750 0x7fd6dc0d5c00 secure :-1 s=READY pgs=589 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6fc004740 tx=0x7fd6fc00b410 comp rx=0 tx=0).stop 2026-02-20T13:30:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 -- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 msgr2=0x7fd70817a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 0x7fd70817a470 secure :-1 s=READY pgs=1425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6f0005b30 tx=0x7fd6f0004340 comp rx=0 tx=0).stop 2026-02-20T13:30:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 -- 10.20.193.28:0/3122008377 shutdown_connections 2026-02-20T13:30:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6dc0b5750 0x7fd6dc0d5c00 unknown :-1 s=CLOSED pgs=589 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd708114990 0x7fd70817a470 unknown :-1 s=CLOSED pgs=1425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd708119ba0 0x7fd7080fc350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 --2- 10.20.193.28:0/3122008377 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd708113fa0 0x7fd7080fbc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 -- 10.20.193.28:0/3122008377 >> 10.20.193.28:0/3122008377 conn(0x7fd708064a90 msgr2=0x7fd708065980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 -- 10.20.193.28:0/3122008377 shutdown_connections 2026-02-20T13:30:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:52.769+0000 7fd707fff640 1 -- 10.20.193.28:0/3122008377 wait complete. 2026-02-20T13:30:52.871 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:30:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:52 trial127 ceph-mon[43817]: pgmap v587: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2026-02-20T13:30:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:52 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1044497463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:52 trial034 ceph-mon[43332]: pgmap v587: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2026-02-20T13:30:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:52 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1044497463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:53.056 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:53.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.229+0000 7f5ac978e640 1 -- 10.20.193.28:0/1572681919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410dc30 msgr2=0x7f5ac4112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.229+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1572681919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410dc30 0x7f5ac4112c80 secure :-1 s=READY pgs=1429 gs=2 cs=0 l=1 c_cookie=6156239302029640935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab4009950 tx=0x7f5ab402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:53.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 -- 10.20.193.28:0/1572681919 shutdown_connections 2026-02-20T13:30:53.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1572681919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410dc30 0x7f5ac4112c80 unknown :-1 s=CLOSED pgs=1429 gs=2 cs=0 l=1 c_cookie=6156239302029640935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1572681919 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ac4113430 0x7f5ac4173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1572681919 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ac410d240 0x7f5ac410d610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 -- 10.20.193.28:0/1572681919 >> 10.20.193.28:0/1572681919 conn(0x7f5ac40eaad0 msgr2=0x7f5ac410aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 -- 10.20.193.28:0/1572681919 shutdown_connections 2026-02-20T13:30:53.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 -- 10.20.193.28:0/1572681919 wait complete. 2026-02-20T13:30:53.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 Processor -- start 2026-02-20T13:30:53.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.230+0000 7f5ac978e640 1 -- start start 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac978e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410d240 0x7f5ac40f56f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac978e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ac410dc30 0x7f5ac4173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac978e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ac4113430 0x7f5ac40f5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac978e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac40fb000 con 0x7f5ac410d240 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac978e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac40fb170 con 0x7f5ac4113430 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac978e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac40fb330 con 0x7f5ac410dc30 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410d240 0x7f5ac40f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ac410dc30 0x7f5ac4173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410d240 0x7f5ac40f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49678/0 (socket says 10.20.193.28:49678) 2026-02-20T13:30:53.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 -- 10.20.193.28:0/1679801054 learned_addr learned my addr 10.20.193.28:0/1679801054 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac8f8d640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ac4113430 0x7f5ac40f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 -- 10.20.193.28:0/1679801054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ac410dc30 msgr2=0x7f5ac4173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ac410dc30 0x7f5ac4173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 -- 10.20.193.28:0/1679801054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ac4113430 msgr2=0x7f5ac40f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ac4113430 0x7f5ac40f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 -- 10.20.193.28:0/1679801054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab4009570 con 0x7f5ac410d240 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.231+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410d240 0x7f5ac40f56f0 secure :-1 s=READY pgs=1430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab0009480 tx=0x7f5ab000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.232+0000 7f5ac17fa640 1 -- 10.20.193.28:0/1679801054 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab000cd40 con 0x7f5ac410d240 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.232+0000 7f5ac17fa640 1 -- 10.20.193.28:0/1679801054 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ab0004d30 con 0x7f5ac410d240 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.232+0000 7f5ac17fa640 1 -- 10.20.193.28:0/1679801054 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab00106b0 con 0x7f5ac410d240 2026-02-20T13:30:53.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.232+0000 7f5ac978e640 1 -- 10.20.193.28:0/1679801054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac40fb610 con 0x7f5ac410d240 2026-02-20T13:30:53.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.232+0000 7f5ac978e640 1 -- 10.20.193.28:0/1679801054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac40fba90 con 0x7f5ac410d240 2026-02-20T13:30:53.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.234+0000 7f5ac17fa640 1 -- 10.20.193.28:0/1679801054 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f5ab001f060 con 0x7f5ac410d240 2026-02-20T13:30:53.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.236+0000 7f5ac17fa640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a980b5750 0x7f5a980d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.236+0000 7f5ac17fa640 1 -- 10.20.193.28:0/1679801054 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5ab0014070 con 0x7f5ac410d240 2026-02-20T13:30:53.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.236+0000 7f5ac37fe640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a980b5750 0x7f5a980d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.237+0000 7f5ac37fe640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a980b5750 0x7f5a980d5c00 secure :-1 s=READY pgs=590 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ac40fc090 tx=0x7f5ab403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.237+0000 7f5acca11e00 1 Processor -- start 2026-02-20T13:30:53.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.237+0000 7f5acca11e00 1 -- start start 2026-02-20T13:30:53.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8360 0x55aca88c8730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca890d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca890db20 0x55aca892df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5acca11e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aca87de780 con 0x55aca890db20 2026-02-20T13:30:53.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5acca11e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55aca87da4b0 con 0x55aca88c8c70 2026-02-20T13:30:53.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5acca11e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55aca87d4450 con 0x55aca88c8360 2026-02-20T13:30:53.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca890d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac3fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8360 0x55aca88c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac8f8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca890db20 0x55aca892df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca890d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57850/0 (socket says 10.20.193.28:57850) 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac37fe640 1 -- 10.20.193.28:0/578159638 learned_addr learned my addr 10.20.193.28:0/578159638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac8f8d640 1 -- 10.20.193.28:0/578159638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8360 msgr2=0x55aca88c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac8f8d640 1 --2- 10.20.193.28:0/578159638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8360 0x55aca88c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac8f8d640 1 -- 10.20.193.28:0/578159638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 msgr2=0x55aca890d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac8f8d640 1 --2- 10.20.193.28:0/578159638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca890d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac8f8d640 1 -- 10.20.193.28:0/578159638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca877fd10 con 0x55aca890db20 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5ac8f8d640 1 --2- 10.20.193.28:0/578159638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca890db20 0x55aca892df00 secure :-1 s=READY pgs=1431 gs=2 cs=0 l=1 c_cookie=9055316721699530552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab80055c0 tx=0x7f5ab8003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daaf294cd8e2738 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5a94ce3640 1 -- 10.20.193.28:0/578159638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab800ac10 con 0x55aca890db20 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5a94ce3640 1 -- 10.20.193.28:0/578159638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ab800ad70 con 0x55aca890db20 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.238+0000 7f5a94ce3640 1 -- 10.20.193.28:0/578159638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab8012970 con 0x55aca890db20 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 -- 10.20.193.28:0/578159638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca890db20 msgr2=0x55aca892df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 --2- 10.20.193.28:0/578159638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca890db20 0x55aca892df00 secure :-1 s=READY pgs=1431 gs=2 cs=0 l=1 c_cookie=9055316721699530552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab80055c0 tx=0x7f5ab8003c30 comp rx=0 tx=0).stop 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 -- 10.20.193.28:0/578159638 shutdown_connections 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 --2- 10.20.193.28:0/578159638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca890db20 0x55aca892df00 unknown :-1 s=CLOSED pgs=1431 gs=2 cs=0 l=1 c_cookie=9055316721699530552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 --2- 10.20.193.28:0/578159638 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca890d5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 --2- 10.20.193.28:0/578159638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8360 0x55aca88c8730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 -- 10.20.193.28:0/578159638 >> 10.20.193.28:0/578159638 conn(0x55aca88a6860 msgr2=0x55aca88c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 -- 10.20.193.28:0/578159638 shutdown_connections 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.239+0000 7f5acca11e00 1 -- 10.20.193.28:0/578159638 wait complete. 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.240+0000 7f5acca11e00 1 -- start start 2026-02-20T13:30:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.240+0000 7f5acca11e00 1 Processor -- start 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca8925770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8925cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8927a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5acca11e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aca8927fb0 con 0x55aca88c8360 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5acca11e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55aca8928120 con 0x55aca890db20 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5acca11e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55aca89282e0 con 0x55aca88c8c70 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac8f8d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8927a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8925cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac8f8d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8927a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57860/0 (socket says 10.20.193.28:57860) 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac8f8d640 1 -- 10.20.193.28:0/1421072588 learned_addr learned my addr 10.20.193.28:0/1421072588 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca8925770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac37fe640 1 -- 10.20.193.28:0/1421072588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 msgr2=0x55aca8927a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac37fe640 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8927a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac37fe640 1 -- 10.20.193.28:0/1421072588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 msgr2=0x55aca8925770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac37fe640 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca8925770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac37fe640 1 -- 10.20.193.28:0/1421072588 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca87583c0 con 0x55aca88c8c70 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.241+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca8925770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5ac37fe640 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8925cb0 secure :-1 s=READY pgs=402 gs=3 cs=0 l=1 c_cookie=12630850073166964947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab4009950 tx=0x7f5ab4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af49cb386e5568d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5a85ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1421072588 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab4002ea0 con 0x55aca88c8c70 2026-02-20T13:30:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab8005260 con 0x55aca88c8c70 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1421072588 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ab403e040 con 0x55aca88c8c70 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1421072588 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab405cba0 con 0x55aca88c8c70 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5acca11e00 10 client.30148 _ll_register_callbacks cb 0x55aca8755a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aca846a6f0 con 0x55aca88c8c70 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1421072588 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5ab405cd30 con 0x55aca88c8c70 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1421072588 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5ab4038920 con 0x55aca88c8c70 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5acca11e00 10 client.30148 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.242+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55aca876a0e0 con 0x55aca88c8c70 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1421072588 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5ab405c5b0 con 0x55aca88c8c70 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5acca11e00 10 client.30148 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5acca11e00 10 client.30148 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5acca11e00 20 client.30148 populate_metadata read hostname 'trial028' 2026-02-20T13:30:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55aca892dca0 0x55aca890b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5acca11e00 4 client.30148 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aca8776f80 con 0x55aca892dca0 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55aca892dca0 0x55aca890b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55aca892dca0 0x55aca890b8a0 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=12046371441894543441 s_cookie=9944660238239727123 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a72d4f008288d051 server_cookie=8a0287cc303afe13 in_seq=0 out_seq=0 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.243+0000 7f5a85ffb640 10 client.30148 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1421072588 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55aca8776f80 con 0x55aca892dca0 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5a85ffb640 10 client.30148 handle_command_reply: tid=0 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 client.30148 shutdown 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 msgr2=0x55aca8925cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8925cb0 secure :-1 s=READY pgs=402 gs=3 cs=0 l=1 c_cookie=12630850073166964947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab4009950 tx=0x7f5ab4009310 comp rx=0 tx=0).stop 2026-02-20T13:30:53.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 shutdown_connections 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55aca892dca0 0x55aca890b8a0 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=12046371441894543441 s_cookie=9944660238239727123 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8927a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8925cb0 unknown :-1 s=CLOSED pgs=402 gs=3 cs=0 l=1 c_cookie=12630850073166964947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1421072588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca8925770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5a85ffb640 0 client.30148 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 >> 10.20.193.28:0/1421072588 conn(0x55aca88a6860 msgr2=0x55aca88c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 shutdown_connections 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 1 -- 10.20.193.28:0/1421072588 wait complete. 2026-02-20T13:30:53.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.244+0000 7f5acca11e00 20 client.30148 trim_cache size 0 max 16384 2026-02-20T13:30:53.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.252+0000 7f5acca11e00 1 Processor -- start 2026-02-20T13:30:53.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.252+0000 7f5acca11e00 1 -- start start 2026-02-20T13:30:53.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.252+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca89279d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.252+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8922900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.252+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8922e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.252+0000 7f5acca11e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aca87d2080 con 0x55aca88c8360 2026-02-20T13:30:53.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.252+0000 7f5acca11e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55aca8492700 con 0x55aca890db20 2026-02-20T13:30:53.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.252+0000 7f5acca11e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55aca88a64d0 con 0x55aca88c8c70 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac8f8d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8922e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca89279d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8922900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac37fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8922900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37902/0 (socket says 10.20.193.28:37902) 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac37fe640 1 -- 10.20.193.28:0/3116973192 learned_addr learned my addr 10.20.193.28:0/3116973192 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac3fff640 1 -- 10.20.193.28:0/3116973192 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 msgr2=0x55aca8922900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/3116973192 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8922900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac3fff640 1 -- 10.20.193.28:0/3116973192 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 msgr2=0x55aca8922e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/3116973192 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8922e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac3fff640 1 -- 10.20.193.28:0/3116973192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca8764b60 con 0x55aca88c8360 2026-02-20T13:30:53.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/3116973192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca89279d0 secure :-1 s=READY pgs=1432 gs=3 cs=0 l=1 c_cookie=11114782889150484581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab00058d0 tx=0x7f5ab00e6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3fa42627679065 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5a87fff640 1 -- 10.20.193.28:0/3116973192 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab00b2de0 con 0x55aca88c8360 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5a87fff640 1 -- 10.20.193.28:0/3116973192 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ab00b53c0 con 0x55aca88c8360 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5a87fff640 1 -- 10.20.193.28:0/3116973192 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab00acc60 con 0x55aca88c8360 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5acca11e00 1 -- 10.20.193.28:0/3116973192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 msgr2=0x55aca89279d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.253+0000 7f5acca11e00 1 --2- 10.20.193.28:0/3116973192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca89279d0 secure :-1 s=READY pgs=1432 gs=3 cs=0 l=1 c_cookie=11114782889150484581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab00058d0 tx=0x7f5ab00e6040 comp rx=0 tx=0).stop 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 -- 10.20.193.28:0/3116973192 shutdown_connections 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 --2- 10.20.193.28:0/3116973192 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca890db20 0x55aca8922e40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 --2- 10.20.193.28:0/3116973192 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca88c8c70 0x55aca8922900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 --2- 10.20.193.28:0/3116973192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca89279d0 unknown :-1 s=CLOSED pgs=1432 gs=3 cs=0 l=1 c_cookie=11114782889150484581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 -- 10.20.193.28:0/3116973192 >> 10.20.193.28:0/3116973192 conn(0x55aca88a6860 msgr2=0x55aca892b350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 -- 10.20.193.28:0/3116973192 shutdown_connections 2026-02-20T13:30:53.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 -- 10.20.193.28:0/3116973192 wait complete. 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 -- start start 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.254+0000 7f5acca11e00 1 Processor -- start 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca88ac7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca88a6d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5acca11e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca890db20 0x55aca88a72a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5acca11e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aca8974ae0 con 0x55aca88c8360 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5acca11e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55aca88a77e0 con 0x55aca88c8c70 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5acca11e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55aca88a79a0 con 0x55aca890db20 2026-02-20T13:30:53.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac8f8d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca890db20 0x55aca88a72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac37fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca88a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac8f8d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca890db20 0x55aca88a72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37912/0 (socket says 10.20.193.28:37912) 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca88ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac8f8d640 1 -- 10.20.193.28:0/1985898418 learned_addr learned my addr 10.20.193.28:0/1985898418 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac3fff640 1 -- 10.20.193.28:0/1985898418 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca890db20 msgr2=0x55aca88a72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca890db20 0x55aca88a72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac3fff640 1 -- 10.20.193.28:0/1985898418 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 msgr2=0x55aca88a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca88a6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac3fff640 1 -- 10.20.193.28:0/1985898418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca87586f0 con 0x55aca88c8360 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac37fe640 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca88a6d60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5ac3fff640 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca88ac7a0 secure :-1 s=READY pgs=1433 gs=3 cs=0 l=1 c_cookie=16587636865982954163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab000c6a0 tx=0x7f5ab00e4a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6331fd834167ab3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.255+0000 7f5a85ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1985898418 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab00b2e60 con 0x55aca88c8360 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1985898418 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ab00b8200 con 0x55aca88c8360 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac40fba90 con 0x55aca88c8360 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1985898418 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ab00b7d70 con 0x55aca88c8360 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 10 client.20373 _ll_register_callbacks cb 0x55aca8755a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ab800ad70 con 0x55aca88c8360 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1985898418 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f5ab00b7ed0 con 0x55aca88c8360 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1985898418 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5ab00721c0 con 0x55aca88c8360 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 10 client.20373 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:53.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55aca876a340 con 0x55aca88c8360 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1985898418 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5ab00050b0 con 0x55aca88c8360 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 10 client.20373 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 10 client.20373 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 20 client.20373 populate_metadata read hostname 'trial028' 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55aca89bc3d0 0x55aca89dc850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 4 client.20373 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aca8467f40 con 0x55aca89bc3d0 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.256+0000 7f5ac37fe640 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55aca89bc3d0 0x55aca89dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5ac37fe640 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55aca89bc3d0 0x55aca89dc850 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=11610393839208953448 s_cookie=9007472722314253736 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a12067aea86ef668 server_cookie=7d00f8b7a18fd5a8 in_seq=0 out_seq=0 2026-02-20T13:30:53.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5a85ffb640 10 client.20373 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5a85ffb640 1 -- 10.20.193.28:0/1985898418 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aca8467f40 con 0x55aca89bc3d0 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5a85ffb640 10 client.20373 handle_command_reply: tid=0 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 client.20373 shutdown 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 msgr2=0x55aca88ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca88ac7a0 secure :-1 s=READY pgs=1433 gs=3 cs=0 l=1 c_cookie=16587636865982954163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab000c6a0 tx=0x7f5ab00e4a10 comp rx=0 tx=0).stop 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 shutdown_connections 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55aca89bc3d0 0x55aca89dc850 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=11610393839208953448 s_cookie=9007472722314253736 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55aca890db20 0x55aca88a72a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55aca88c8c70 0x55aca88a6d60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 --2- 10.20.193.28:0/1985898418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aca88c8360 0x55aca88ac7a0 unknown :-1 s=CLOSED pgs=1433 gs=3 cs=0 l=1 c_cookie=16587636865982954163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5a85ffb640 0 client.20373 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:30:53.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 >> 10.20.193.28:0/1985898418 conn(0x55aca88a6860 msgr2=0x55aca88c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 shutdown_connections 2026-02-20T13:30:53.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 1 -- 10.20.193.28:0/1985898418 wait complete. 2026-02-20T13:30:53.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.257+0000 7f5acca11e00 20 client.20373 trim_cache size 0 max 16384 2026-02-20T13:30:53.267 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:53.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 -- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a980b5750 msgr2=0x7f5a980d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a980b5750 0x7f5a980d5c00 secure :-1 s=READY pgs=590 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ac40fc090 tx=0x7f5ab403a040 comp rx=0 tx=0).stop 2026-02-20T13:30:53.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 -- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410d240 msgr2=0x7f5ac40f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410d240 0x7f5ac40f56f0 secure :-1 s=READY pgs=1430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ab0009480 tx=0x7f5ab000ee60 comp rx=0 tx=0).stop 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 -- 10.20.193.28:0/1679801054 shutdown_connections 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f5a980b5750 0x7f5a980d5c00 unknown :-1 s=CLOSED pgs=590 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f5ac4113430 0x7f5ac40f5df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5ac410dc30 0x7f5ac4173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 --2- 10.20.193.28:0/1679801054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ac410d240 0x7f5ac40f56f0 unknown :-1 s=CLOSED pgs=1430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 -- 10.20.193.28:0/1679801054 >> 10.20.193.28:0/1679801054 conn(0x7f5ac40eaad0 msgr2=0x7f5ac410fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 -- 10.20.193.28:0/1679801054 shutdown_connections 2026-02-20T13:30:53.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.258+0000 7f5ac978e640 1 -- 10.20.193.28:0/1679801054 wait complete. 2026-02-20T13:30:53.361 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:30:53.546 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:53.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 -- 10.20.193.28:0/3320226944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 msgr2=0x7fcc1c173f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 --2- 10.20.193.28:0/3320226944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 0x7fcc1c173f40 secure :-1 s=READY pgs=403 gs=3 cs=0 l=1 c_cookie=13219710071371373650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1800aa30 tx=0x7fcc18030270 comp rx=0 tx=0).stop 2026-02-20T13:30:53.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 -- 10.20.193.28:0/3320226944 shutdown_connections 2026-02-20T13:30:53.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 --2- 10.20.193.28:0/3320226944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc1c10dd70 0x7fcc1c112dc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 --2- 10.20.193.28:0/3320226944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 0x7fcc1c173f40 unknown :-1 s=CLOSED pgs=403 gs=3 cs=0 l=1 c_cookie=13219710071371373650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 --2- 10.20.193.28:0/3320226944 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc1c10d380 0x7fcc1c10d750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 -- 10.20.193.28:0/3320226944 >> 10.20.193.28:0/3320226944 conn(0x7fcc1c0eac10 msgr2=0x7fcc1c10b020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 -- 10.20.193.28:0/3320226944 shutdown_connections 2026-02-20T13:30:53.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.714+0000 7fcc2357c640 1 -- 10.20.193.28:0/3320226944 wait complete. 2026-02-20T13:30:53.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.715+0000 7fcc2357c640 1 Processor -- start 2026-02-20T13:30:53.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.715+0000 7fcc2357c640 1 -- start start 2026-02-20T13:30:53.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc2357c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc1c10d380 0x7fcc1c0f93b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc2357c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc1c10dd70 0x7fcc1c173e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc2357c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 0x7fcc1c0f9ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc2357c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0fec20 con 0x7fcc1c10dd70 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc2357c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0fed90 con 0x7fcc1c10d380 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc2357c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0fef50 con 0x7fcc1c113570 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc20af0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc1c10dd70 0x7fcc1c173e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc21af2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 0x7fcc1c0f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc21af2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 0x7fcc1c0f9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37928/0 (socket says 10.20.193.28:37928) 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc21af2640 1 -- 10.20.193.28:0/1582497814 learned_addr learned my addr 10.20.193.28:0/1582497814 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.716+0000 7fcc212f1640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc1c10d380 0x7fcc1c0f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.717+0000 7fcc21af2640 1 -- 10.20.193.28:0/1582497814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc1c10d380 msgr2=0x7fcc1c0f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.717+0000 7fcc21af2640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc1c10d380 0x7fcc1c0f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.717+0000 7fcc21af2640 1 -- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc1c10dd70 msgr2=0x7fcc1c173e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.717+0000 7fcc21af2640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc1c10dd70 0x7fcc1c173e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.717+0000 7fcc21af2640 1 -- 10.20.193.28:0/1582497814 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100094b0 con 0x7fcc1c113570 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.717+0000 7fcc20af0640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc1c10dd70 0x7fcc1c173e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.717+0000 7fcc21af2640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 0x7fcc1c0f9ab0 secure :-1 s=READY pgs=404 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc18006a50 tx=0x7fcc180039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.718+0000 7fcc0a7fc640 1 -- 10.20.193.28:0/1582497814 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1803e070 con 0x7fcc1c113570 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.718+0000 7fcc0a7fc640 1 -- 10.20.193.28:0/1582497814 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc180055a0 con 0x7fcc1c113570 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.718+0000 7fcc0a7fc640 1 -- 10.20.193.28:0/1582497814 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc18042960 con 0x7fcc1c113570 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.718+0000 7fcc2357c640 1 -- 10.20.193.28:0/1582497814 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1800a650 con 0x7fcc1c113570 2026-02-20T13:30:53.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.718+0000 7fcc2357c640 1 -- 10.20.193.28:0/1582497814 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1c0ff460 con 0x7fcc1c113570 2026-02-20T13:30:53.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.721+0000 7fcc0a7fc640 1 -- 10.20.193.28:0/1582497814 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fcc18049020 con 0x7fcc1c113570 2026-02-20T13:30:53.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.722+0000 7fcc0a7fc640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcbf80b56d0 0x7fcbf80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.722+0000 7fcc0a7fc640 1 -- 10.20.193.28:0/1582497814 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcc1810c210 con 0x7fcc1c113570 2026-02-20T13:30:53.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.722+0000 7fcc212f1640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcbf80b56d0 0x7fcbf80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.723+0000 7fcc212f1640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcbf80b56d0 0x7fcbf80d5b80 secure :-1 s=READY pgs=591 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc0c004740 tx=0x7fcc0c004340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.723+0000 7fcc25576e00 1 Processor -- start 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.723+0000 7fcc25576e00 1 -- start start 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.723+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbf360 0x5557acbbf730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.723+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc045e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acc04b20 0x5557acc24f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc25576e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5557acad5780 con 0x5557acbbf360 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc25576e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5557acad14b0 con 0x5557acbbfc70 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc25576e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5557acacb450 con 0x5557acc04b20 2026-02-20T13:30:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57906/0 (socket says 10.20.193.28:57906) 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 -- 10.20.193.28:0/3638034911 learned_addr learned my addr 10.20.193.28:0/3638034911 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc21af2640 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acc04b20 0x5557acc24f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc212f1640 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbf360 0x5557acbbf730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 -- 10.20.193.28:0/3638034911 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acc04b20 msgr2=0x5557acc24f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acc04b20 0x5557acc24f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 -- 10.20.193.28:0/3638034911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbf360 msgr2=0x5557acbbf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbf360 0x5557acbbf730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 -- 10.20.193.28:0/3638034911 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557aca76d10 con 0x5557acbbfc70 2026-02-20T13:30:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc212f1640 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbf360 0x5557acbbf730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.724+0000 7fcc20af0640 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc045e0 secure :-1 s=READY pgs=489 gs=2 cs=0 l=1 c_cookie=17969886184243319671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc10005c70 tx=0x7fcc10002a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f961dc46aa05d377 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcbe9ce5640 1 -- 10.20.193.28:0/3638034911 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1001a440 con 0x5557acbbfc70 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcbe9ce5640 1 -- 10.20.193.28:0/3638034911 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc10010910 con 0x5557acbbfc70 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcbe9ce5640 1 -- 10.20.193.28:0/3638034911 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1000ebc0 con 0x5557acbbfc70 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 -- 10.20.193.28:0/3638034911 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 msgr2=0x5557acc045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc045e0 secure :-1 s=READY pgs=489 gs=2 cs=0 l=1 c_cookie=17969886184243319671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc10005c70 tx=0x7fcc10002a70 comp rx=0 tx=0).stop 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 -- 10.20.193.28:0/3638034911 shutdown_connections 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acc04b20 0x5557acc24f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc045e0 unknown :-1 s=CLOSED pgs=489 gs=2 cs=0 l=1 c_cookie=17969886184243319671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 --2- 10.20.193.28:0/3638034911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbf360 0x5557acbbf730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 -- 10.20.193.28:0/3638034911 >> 10.20.193.28:0/3638034911 conn(0x5557acb9d860 msgr2=0x5557acbbdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 -- 10.20.193.28:0/3638034911 shutdown_connections 2026-02-20T13:30:53.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.725+0000 7fcc25576e00 1 -- 10.20.193.28:0/3638034911 wait complete. 2026-02-20T13:30:53.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.726+0000 7fcc25576e00 1 -- start start 2026-02-20T13:30:53.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc25576e00 1 Processor -- start 2026-02-20T13:30:53.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acc1c710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc1cc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acc04b20 0x5557acc21c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc25576e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5557acc22180 con 0x5557acc04b20 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc25576e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5557acc222f0 con 0x5557acbbfc70 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc25576e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5557acc224b0 con 0x5557acbbf360 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc212f1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acc1c710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc20af0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc1cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc20af0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc1cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57912/0 (socket says 10.20.193.28:57912) 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc20af0640 1 -- 10.20.193.28:0/33651425 learned_addr learned my addr 10.20.193.28:0/33651425 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.727+0000 7fcc21af2640 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acc04b20 0x5557acc21c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc20af0640 1 -- 10.20.193.28:0/33651425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 msgr2=0x5557acc1c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc20af0640 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acc1c710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc20af0640 1 -- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acc04b20 msgr2=0x5557acc21c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc20af0640 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acc04b20 0x5557acc21c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc20af0640 1 -- 10.20.193.28:0/33651425 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557aca4f3c0 con 0x5557acbbfc70 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc21af2640 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acc04b20 0x5557acc21c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc20af0640 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc1cc50 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=12138049571984008411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc10009fd0 tx=0x7fcc1000ef80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a87303c68c3064db server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcbd6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/33651425 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1001e030 con 0x5557acbbfc70 2026-02-20T13:30:53.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/33651425 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc1001f040 con 0x5557acbbfc70 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc100097e0 con 0x5557acbbfc70 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/33651425 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc10004910 con 0x5557acbbfc70 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc25576e00 10 client.30302 _ll_register_callbacks cb 0x5557aca4ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557ac7616f0 con 0x5557acbbfc70 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.728+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/33651425 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcc100056e0 con 0x5557acbbfc70 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/33651425 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcc1000e7b0 con 0x5557acbbfc70 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc25576e00 10 client.30302 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5557aca610e0 con 0x5557acbbfc70 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/33651425 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fcc10005040 con 0x5557acbbfc70 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc25576e00 10 client.30302 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:53.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc25576e00 10 client.30302 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc25576e00 20 client.30302 populate_metadata read hostname 'trial028' 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc25576e00 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5557acc24b50 0x5557acc028a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc25576e00 4 client.30302 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557aca6df80 con 0x5557acc24b50 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.729+0000 7fcc212f1640 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5557acc24b50 0x5557acc028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc212f1640 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5557acc24b50 0x5557acc028a0 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=11064037419082978223 s_cookie=15397016600274626498 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=998b5b69b21213af server_cookie=d5ad3105642967c2 in_seq=0 out_seq=0 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcbd6ffd640 10 client.30302 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/33651425 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5557aca6df80 con 0x5557acc24b50 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcbd6ffd640 10 client.30302 handle_command_reply: tid=0 2026-02-20T13:30:53.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 client.30302 shutdown 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 msgr2=0x5557acc1cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc1cc50 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=12138049571984008411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc10009fd0 tx=0x7fcc1000ef80 comp rx=0 tx=0).stop 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 shutdown_connections 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5557acc24b50 0x5557acc028a0 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=11064037419082978223 s_cookie=15397016600274626498 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acc04b20 0x5557acc21c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acbbfc70 0x5557acc1cc50 unknown :-1 s=CLOSED pgs=490 gs=1 cs=0 l=1 c_cookie=12138049571984008411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 --2- 10.20.193.28:0/33651425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acc1c710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcbd6ffd640 0 client.30302 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.730+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 >> 10.20.193.28:0/33651425 conn(0x5557acb9d860 msgr2=0x5557acbbdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.731+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 shutdown_connections 2026-02-20T13:30:53.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.731+0000 7fcc25576e00 1 -- 10.20.193.28:0/33651425 wait complete. 2026-02-20T13:30:53.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.731+0000 7fcc25576e00 20 client.30302 trim_cache size 0 max 16384 2026-02-20T13:30:53.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc25576e00 1 Processor -- start 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc25576e00 1 -- start start 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acbffce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acc038b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc03df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc25576e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5557acac9080 con 0x5557acbbfc70 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc25576e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5557ac789700 con 0x5557acc04b20 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc25576e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5557acc1d7b0 con 0x5557acbbf360 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc212f1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acbffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.739+0000 7fcc212f1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acbffce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37972/0 (socket says 10.20.193.28:37972) 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc212f1640 1 -- 10.20.193.28:0/2830891022 learned_addr learned my addr 10.20.193.28:0/2830891022 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc21af2640 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc03df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc20af0640 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acc038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc212f1640 1 -- 10.20.193.28:0/2830891022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 msgr2=0x5557acc03df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc212f1640 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc03df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc212f1640 1 -- 10.20.193.28:0/2830891022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 msgr2=0x5557acc038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc212f1640 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acc038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc212f1640 1 -- 10.20.193.28:0/2830891022 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557aca5bb60 con 0x5557acbbf360 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc21af2640 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc03df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.740+0000 7fcc20af0640 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acc038b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc212f1640 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acbffce0 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=5890237019492042927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc0c00ff20 tx=0x7fcc0c00b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51be535c85adc8af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcbe94e4640 1 -- 10.20.193.28:0/2830891022 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc0c020c40 con 0x5557acbbf360 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcbe94e4640 1 -- 10.20.193.28:0/2830891022 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc0c020da0 con 0x5557acbbf360 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcbe94e4640 1 -- 10.20.193.28:0/2830891022 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc0c01f9c0 con 0x5557acbbf360 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 -- 10.20.193.28:0/2830891022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 msgr2=0x5557acbffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acbffce0 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=5890237019492042927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc0c00ff20 tx=0x7fcc0c00b000 comp rx=0 tx=0).stop 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 -- 10.20.193.28:0/2830891022 shutdown_connections 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acc038b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc03df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 --2- 10.20.193.28:0/2830891022 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acbffce0 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=5890237019492042927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 -- 10.20.193.28:0/2830891022 >> 10.20.193.28:0/2830891022 conn(0x5557acb9d860 msgr2=0x5557acbff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 -- 10.20.193.28:0/2830891022 shutdown_connections 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.741+0000 7fcc25576e00 1 -- 10.20.193.28:0/2830891022 wait complete. 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.742+0000 7fcc25576e00 1 -- start start 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.742+0000 7fcc25576e00 1 Processor -- start 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.742+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acba1440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.742+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acba1980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.742+0000 7fcc25576e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc6a7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.742+0000 7fcc25576e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5557acba22d0 con 0x5557acbbfc70 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.742+0000 7fcc25576e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5557acc6ad20 con 0x5557acc04b20 2026-02-20T13:30:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.742+0000 7fcc25576e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5557acc6aee0 con 0x5557acbbf360 2026-02-20T13:30:53.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc212f1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acba1440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc20af0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acba1980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc212f1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acba1440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37978/0 (socket says 10.20.193.28:37978) 2026-02-20T13:30:53.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc212f1640 1 -- 10.20.193.28:0/427053730 learned_addr learned my addr 10.20.193.28:0/427053730 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:53.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc21af2640 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc6a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc20af0640 1 -- 10.20.193.28:0/427053730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 msgr2=0x5557acba1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc20af0640 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acba1440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc20af0640 1 -- 10.20.193.28:0/427053730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 msgr2=0x5557acc6a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc20af0640 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc6a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc20af0640 1 -- 10.20.193.28:0/427053730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c00fca0 con 0x5557acbbfc70 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcc20af0640 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acba1980 secure :-1 s=READY pgs=1434 gs=1 cs=0 l=1 c_cookie=464146290966806157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc100107b0 tx=0x7fcc10005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670fa97ace43e8d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.743+0000 7fcbd6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/427053730 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1001e070 con 0x5557acbbfc70 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/427053730 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc1001f040 con 0x5557acbbfc70 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/427053730 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc1002e670 con 0x5557acbbfc70 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557aca610e0 con 0x5557acbbfc70 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/427053730 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fcc1002ea30 con 0x5557acbbfc70 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcc25576e00 10 client.20391 _ll_register_callbacks cb 0x5557aca4ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:53.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc10010910 con 0x5557acbbfc70 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/427053730 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcc10010640 con 0x5557acbbfc70 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcc25576e00 10 client.20391 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5557aca4f6f0 con 0x5557acbbfc70 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.744+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/427053730 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fcc1002ebf0 con 0x5557acbbfc70 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcc25576e00 10 client.20391 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcc25576e00 10 client.20391 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcc25576e00 20 client.20391 populate_metadata read hostname 'trial028' 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcc25576e00 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5557accb2730 0x5557accd2be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcc25576e00 4 client.20391 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557ac75ef40 con 0x5557accb2730 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcc212f1640 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5557accb2730 0x5557accd2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcbd6ffd640 10 client.20391 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:30:53.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcc212f1640 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5557accb2730 0x5557accd2be0 crc :-1 s=READY pgs=72 gs=4 cs=0 l=0 c_cookie=15405599515335652584 s_cookie=15904359622336115460 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5cbaf230782f4e8 server_cookie=dcb7a2cfc568f304 in_seq=0 out_seq=0 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcbd6ffd640 1 -- 10.20.193.28:0/427053730 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557ac75ef40 con 0x5557accb2730 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.745+0000 7fcbd6ffd640 10 client.20391 handle_command_reply: tid=0 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 client.20391 shutdown 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 msgr2=0x5557acba1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acba1980 secure :-1 s=READY pgs=1434 gs=1 cs=0 l=1 c_cookie=464146290966806157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc100107b0 tx=0x7fcc10005900 comp rx=0 tx=0).stop 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 shutdown_connections 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5557accb2730 0x5557accd2be0 crc :-1 s=READY pgs=72 gs=4 cs=0 l=0 c_cookie=15405599515335652584 s_cookie=15904359622336115460 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5557acbbfc70 0x5557acba1980 unknown :-1 s=CLOSED pgs=1434 gs=1 cs=0 l=1 c_cookie=464146290966806157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5557acc04b20 0x5557acc6a7e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 --2- 10.20.193.28:0/427053730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5557acbbf360 0x5557acba1440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 >> 10.20.193.28:0/427053730 conn(0x5557acb9d860 msgr2=0x5557acbffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcbd6ffd640 0 client.20391 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:30:53.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 shutdown_connections 2026-02-20T13:30:53.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 1 -- 10.20.193.28:0/427053730 wait complete. 2026-02-20T13:30:53.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc25576e00 20 client.20391 trim_cache size 0 max 16384 2026-02-20T13:30:53.756 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc2357c640 1 -- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcbf80b56d0 msgr2=0x7fcbf80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc2357c640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcbf80b56d0 0x7fcbf80d5b80 secure :-1 s=READY pgs=591 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc0c004740 tx=0x7fcc0c004340 comp rx=0 tx=0).stop 2026-02-20T13:30:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc2357c640 1 -- 10.20.193.28:0/1582497814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 msgr2=0x7fcc1c0f9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.746+0000 7fcc2357c640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 0x7fcc1c0f9ab0 secure :-1 s=READY pgs=404 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc18006a50 tx=0x7fcc180039b0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.747+0000 7fcc2357c640 1 -- 10.20.193.28:0/1582497814 shutdown_connections 2026-02-20T13:30:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.747+0000 7fcc2357c640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fcbf80b56d0 0x7fcbf80d5b80 unknown :-1 s=CLOSED pgs=591 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.747+0000 7fcc2357c640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcc1c10dd70 0x7fcc1c173e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.747+0000 7fcc2357c640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc1c113570 0x7fcc1c0f9ab0 unknown :-1 s=CLOSED pgs=404 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.747+0000 7fcc2357c640 1 --2- 10.20.193.28:0/1582497814 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fcc1c10d380 0x7fcc1c0f93b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.747+0000 7fcc2357c640 1 -- 10.20.193.28:0/1582497814 >> 10.20.193.28:0/1582497814 conn(0x7fcc1c0eac10 msgr2=0x7fcc1c10eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.747+0000 7fcc2357c640 1 -- 10.20.193.28:0/1582497814 shutdown_connections 2026-02-20T13:30:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:53.747+0000 7fcc2357c640 1 -- 10.20.193.28:0/1582497814 wait complete. 2026-02-20T13:30:53.883 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:30:54.067 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:54.170 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-20T13:30:54.171 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.75 2026-02-20T13:30:54.171 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:30:54.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.244+0000 7fa9cc970640 1 -- 10.20.193.28:0/3792019348 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 msgr2=0x7fa9c80603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.244+0000 7fa9cc970640 1 --2- 10.20.193.28:0/3792019348 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 0x7fa9c80603e0 secure :-1 s=READY pgs=406 gs=2 cs=0 l=1 c_cookie=2567896930704444704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b4009950 tx=0x7fa9b402f190 comp rx=0 tx=0).stop 2026-02-20T13:30:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.244+0000 7fa9cc970640 1 -- 10.20.193.28:0/3792019348 shutdown_connections 2026-02-20T13:30:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.244+0000 7fa9cc970640 1 --2- 10.20.193.28:0/3792019348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9c8060a00 0x7fa9c8112850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.244+0000 7fa9cc970640 1 --2- 10.20.193.28:0/3792019348 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9c8113000 0x7fa9c81739d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.244+0000 7fa9cc970640 1 --2- 10.20.193.28:0/3792019348 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 0x7fa9c80603e0 unknown :-1 s=CLOSED pgs=406 gs=2 cs=0 l=1 c_cookie=2567896930704444704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.244+0000 7fa9cc970640 1 -- 10.20.193.28:0/3792019348 >> 10.20.193.28:0/3792019348 conn(0x7fa9c80e95a0 msgr2=0x7fa9c81099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.245+0000 7fa9cc970640 1 -- 10.20.193.28:0/3792019348 shutdown_connections 2026-02-20T13:30:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.245+0000 7fa9cc970640 1 -- 10.20.193.28:0/3792019348 wait complete. 2026-02-20T13:30:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.245+0000 7fa9cc970640 1 Processor -- start 2026-02-20T13:30:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9cc970640 1 -- start start 2026-02-20T13:30:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9cc970640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 0x7fa9c80f4240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9cc970640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9c8060a00 0x7fa9c81738d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9cc970640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9c8113000 0x7fa9c80f4940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9cc970640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c80f9b00 con 0x7fa9c8113000 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9cc970640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c80f9c70 con 0x7fa9c8060a00 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9cc970640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c80f9e30 con 0x7fa9c8060010 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9c77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 0x7fa9c80f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9c77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 0x7fa9c80f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37994/0 (socket says 10.20.193.28:37994) 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9c77fe640 1 -- 10.20.193.28:0/2561773060 learned_addr learned my addr 10.20.193.28:0/2561773060 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9c8113000 0x7fa9c80f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9c77fe640 1 -- 10.20.193.28:0/2561773060 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9c8060a00 msgr2=0x7fa9c81738d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9c8060a00 0x7fa9c81738d0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9c77fe640 1 -- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9c8113000 msgr2=0x7fa9c80f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.246+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9c8113000 0x7fa9c80f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.247+0000 7fa9c77fe640 1 -- 10.20.193.28:0/2561773060 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b4009570 con 0x7fa9c8060010 2026-02-20T13:30:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.247+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9c8113000 0x7fa9c80f4940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.247+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 0x7fa9c80f4240 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b4005b30 tx=0x7fa9b4004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.247+0000 7fa9c4ff9640 1 -- 10.20.193.28:0/2561773060 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9b403d070 con 0x7fa9c8060010 2026-02-20T13:30:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.247+0000 7fa9c4ff9640 1 -- 10.20.193.28:0/2561773060 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9b4038920 con 0x7fa9c8060010 2026-02-20T13:30:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.247+0000 7fa9c4ff9640 1 -- 10.20.193.28:0/2561773060 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9b40418a0 con 0x7fa9c8060010 2026-02-20T13:30:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.247+0000 7fa9cc970640 1 -- 10.20.193.28:0/2561773060 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c80fa0b0 con 0x7fa9c8060010 2026-02-20T13:30:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.247+0000 7fa9cc970640 1 -- 10.20.193.28:0/2561773060 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c80fa4d0 con 0x7fa9c8060010 2026-02-20T13:30:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.250+0000 7fa9c4ff9640 1 -- 10.20.193.28:0/2561773060 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa9b4038a90 con 0x7fa9c8060010 2026-02-20T13:30:54.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.252+0000 7fa9c4ff9640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa99c0b5750 0x7fa99c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.252+0000 7fa9c4ff9640 1 -- 10.20.193.28:0/2561773060 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa9b410b010 con 0x7fa9c8060010 2026-02-20T13:30:54.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.252+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa99c0b5750 0x7fa99c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa99c0b5750 0x7fa99c0d5c00 secure :-1 s=READY pgs=592 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9c80fab90 tx=0x7fa9b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:54.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9cfbf3e00 1 Processor -- start 2026-02-20T13:30:54.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9cfbf3e00 1 -- start start 2026-02-20T13:30:54.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caaa3360 0x5626caaa3730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caae85e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caae8b20 0x5626cab08f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626ca9b9780 con 0x5626caaa3360 2026-02-20T13:30:54.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5626ca9b54b0 con 0x5626caaa3c70 2026-02-20T13:30:54.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5626ca9af450 con 0x5626caae8b20 2026-02-20T13:30:54.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9c77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caaa3360 0x5626caaa3730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9c77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caaa3360 0x5626caaa3730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49808/0 (socket says 10.20.193.28:49808) 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9c77fe640 1 -- 10.20.193.28:0/731202493 learned_addr learned my addr 10.20.193.28:0/731202493 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.253+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caae85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caae8b20 0x5626cab08f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9c77fe640 1 -- 10.20.193.28:0/731202493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caae8b20 msgr2=0x5626cab08f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caae8b20 0x5626cab08f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9c77fe640 1 -- 10.20.193.28:0/731202493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 msgr2=0x5626caae85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caae85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9c77fe640 1 -- 10.20.193.28:0/731202493 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ca95ad10 con 0x5626caaa3360 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caaa3360 0x5626caaa3730 secure :-1 s=READY pgs=1435 gs=1 cs=0 l=1 c_cookie=17674047404442592180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b4108b20 tx=0x7fa9b4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f546d479253723b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa98bfff640 1 -- 10.20.193.28:0/731202493 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9b40d1db0 con 0x5626caaa3360 2026-02-20T13:30:54.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa98bfff640 1 -- 10.20.193.28:0/731202493 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9b40d70d0 con 0x5626caaa3360 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa98bfff640 1 -- 10.20.193.28:0/731202493 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9b40d22c0 con 0x5626caaa3360 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/731202493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caaa3360 msgr2=0x5626caaa3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.254+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caaa3360 0x5626caaa3730 secure :-1 s=READY pgs=1435 gs=1 cs=0 l=1 c_cookie=17674047404442592180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b4108b20 tx=0x7fa9b4009310 comp rx=0 tx=0).stop 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.255+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/731202493 shutdown_connections 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.255+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caae8b20 0x5626cab08f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.255+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caae85e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.255+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/731202493 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caaa3360 0x5626caaa3730 unknown :-1 s=CLOSED pgs=1435 gs=1 cs=0 l=1 c_cookie=17674047404442592180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.255+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/731202493 >> 10.20.193.28:0/731202493 conn(0x5626caa81860 msgr2=0x5626caaa1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.255+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/731202493 shutdown_connections 2026-02-20T13:30:54.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.255+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/731202493 wait complete. 2026-02-20T13:30:54.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.256+0000 7fa9cfbf3e00 1 -- start start 2026-02-20T13:30:54.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.256+0000 7fa9cfbf3e00 1 Processor -- start 2026-02-20T13:30:54.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3360 0x5626cab00730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3c70 0x5626cab00c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626cab05c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626cab061a0 con 0x5626caae8b20 2026-02-20T13:30:54.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5626cab06310 con 0x5626caaa3360 2026-02-20T13:30:54.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5626cab064d0 con 0x5626caaa3c70 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3360 0x5626cab00730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3360 0x5626cab00730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57950/0 (socket says 10.20.193.28:57950) 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 -- 10.20.193.28:0/4249863047 learned_addr learned my addr 10.20.193.28:0/4249863047 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626cab05c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3c70 0x5626cab00c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 -- 10.20.193.28:0/4249863047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3c70 msgr2=0x5626cab00c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3c70 0x5626cab00c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 -- 10.20.193.28:0/4249863047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 msgr2=0x5626cab05c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626cab05c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 -- 10.20.193.28:0/4249863047 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ca9333c0 con 0x5626caaa3360 2026-02-20T13:30:54.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3c70 0x5626cab00c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626cab05c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3360 0x5626cab00730 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=15306119539722473029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b4004050 tx=0x7fa9b40cd830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d46a42a046d2ce45 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9897fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.257+0000 7fa9897fa640 1 -- 10.20.193.28:0/4249863047 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9b40d96b0 con 0x5626caaa3360 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9897fa640 1 -- 10.20.193.28:0/4249863047 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9b40dc4f0 con 0x5626caaa3360 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9897fa640 1 -- 10.20.193.28:0/4249863047 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9b4048590 con 0x5626caaa3360 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c80fa4d0 con 0x5626caaa3360 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9cfbf3e00 10 client.30317 _ll_register_callbacks cb 0x5626ca930a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5626ca6456f0 con 0x5626caaa3360 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9897fa640 1 -- 10.20.193.28:0/4249863047 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa9b40d1db0 con 0x5626caaa3360 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9897fa640 1 -- 10.20.193.28:0/4249863047 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9b40d2040 con 0x5626caaa3360 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9cfbf3e00 10 client.30317 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:54.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5626ca9450e0 con 0x5626caaa3360 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9897fa640 1 -- 10.20.193.28:0/4249863047 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa9b40eb020 con 0x5626caaa3360 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.258+0000 7fa9cfbf3e00 10 client.30317 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.259+0000 7fa9cfbf3e00 10 client.30317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.259+0000 7fa9cfbf3e00 20 client.30317 populate_metadata read hostname 'trial028' 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.259+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5626caae5b00 0x5626caae5fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.259+0000 7fa9cfbf3e00 4 client.30317 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.259+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626ca951f80 con 0x5626caae5b00 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.259+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5626caae5b00 0x5626caae5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.260+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5626caae5b00 0x5626caae5fa0 crc :-1 s=READY pgs=388 gs=4 cs=0 l=0 c_cookie=14358782962425505257 s_cookie=10581632765728590733 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c744a5073a4da5e9 server_cookie=92d982efc0e30b8d in_seq=0 out_seq=0 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.260+0000 7fa9897fa640 10 client.30317 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.260+0000 7fa9897fa640 1 -- 10.20.193.28:0/4249863047 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5626ca951f80 con 0x5626caae5b00 2026-02-20T13:30:54.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.260+0000 7fa9897fa640 10 client.30317 handle_command_reply: tid=0 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.260+0000 7fa9cfbf3e00 1 client.30317 shutdown 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.260+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3360 msgr2=0x5626cab00730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3360 0x5626cab00730 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=15306119539722473029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b4004050 tx=0x7fa9b40cd830 comp rx=0 tx=0).stop 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 shutdown_connections 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5626caae5b00 0x5626caae5fa0 crc :-1 s=READY pgs=388 gs=4 cs=0 l=0 c_cookie=14358782962425505257 s_cookie=10581632765728590733 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626cab05c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3c70 0x5626cab00c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/4249863047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3360 0x5626cab00730 unknown :-1 s=CLOSED pgs=491 gs=1 cs=0 l=1 c_cookie=15306119539722473029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9897fa640 0 client.30317 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 >> 10.20.193.28:0/4249863047 conn(0x5626caa81860 msgr2=0x5626caaa1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 shutdown_connections 2026-02-20T13:30:54.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.261+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/4249863047 wait complete. 2026-02-20T13:30:54.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.262+0000 7fa9cfbf3e00 20 client.30317 trim_cache size 0 max 16384 2026-02-20T13:30:54.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.269+0000 7fa9cfbf3e00 1 Processor -- start 2026-02-20T13:30:54.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.269+0000 7fa9cfbf3e00 1 -- start start 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626cab051d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caae3780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caae3cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626caaf2a60 con 0x5626caae8b20 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5626ca9ad080 con 0x5626caaa3c70 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9cfbf3e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5626ca66d700 con 0x5626caaa3360 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caae3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caae3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49832/0 (socket says 10.20.193.28:49832) 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 -- 10.20.193.28:0/1339951169 learned_addr learned my addr 10.20.193.28:0/1339951169 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:54.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626cab051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caae3780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 -- 10.20.193.28:0/1339951169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 msgr2=0x5626cab051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:54.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626cab051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 -- 10.20.193.28:0/1339951169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 msgr2=0x5626caae3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:54.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caae3780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 -- 10.20.193.28:0/1339951169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ca93fb60 con 0x5626caae8b20 2026-02-20T13:30:54.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.270+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caae3cc0 secure :-1 s=READY pgs=1436 gs=1 cs=0 l=1 c_cookie=10457578444210097736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9bc003c40 tx=0x7fa9bc014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9120c83039ecce48 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:54.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa98b7fe640 1 -- 10.20.193.28:0/1339951169 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9bc003d40 con 0x5626caae8b20 2026-02-20T13:30:54.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa98b7fe640 1 -- 10.20.193.28:0/1339951169 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9bc012930 con 0x5626caae8b20 2026-02-20T13:30:54.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa98b7fe640 1 -- 10.20.193.28:0/1339951169 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9bc010a50 con 0x5626caae8b20 2026-02-20T13:30:54.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/1339951169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 msgr2=0x5626caae3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caae3cc0 secure :-1 s=READY pgs=1436 gs=1 cs=0 l=1 c_cookie=10457578444210097736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9bc003c40 tx=0x7fa9bc014830 comp rx=0 tx=0).stop 2026-02-20T13:30:54.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/1339951169 shutdown_connections 2026-02-20T13:30:54.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caae3cc0 unknown :-1 s=CLOSED pgs=1436 gs=1 cs=0 l=1 c_cookie=10457578444210097736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caae3780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/1339951169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626cab051d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/1339951169 >> 10.20.193.28:0/1339951169 conn(0x5626caa81860 msgr2=0x5626cab04ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/1339951169 shutdown_connections 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.271+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/1339951169 wait complete. 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.272+0000 7fa9cfbf3e00 1 -- start start 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.272+0000 7fa9cfbf3e00 1 Processor -- start 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.272+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626caa81de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.272+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caa82320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.272+0000 7fa9cfbf3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caa86c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626caa81de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626caa81de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:38032/0 (socket says 10.20.193.28:38032) 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caa82320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caa82320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57958/0 (socket says 10.20.193.28:57958) 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626cab09220 con 0x5626caae8b20 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c77fe640 1 -- 10.20.193.28:0/524468103 learned_addr learned my addr 10.20.193.28:0/524468103 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5626caaedc00 con 0x5626caaa3c70 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5626caa815d0 con 0x5626caaa3360 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c7fff640 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caa86c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c77fe640 1 -- 10.20.193.28:0/524468103 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 msgr2=0x5626caa82320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caa82320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c77fe640 1 -- 10.20.193.28:0/524468103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 msgr2=0x5626caa86c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caa86c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.273+0000 7fa9c77fe640 1 -- 10.20.193.28:0/524468103 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ca9336f0 con 0x5626caaa3360 2026-02-20T13:30:54.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9c77fe640 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626caa81de0 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=5795579311981372352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b40d3640 tx=0x7fa9b4108070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=506e08ad8e40a3c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9897fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9897fa640 1 -- 10.20.193.28:0/524468103 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9b40d2310 con 0x5626caaa3360 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9897fa640 1 -- 10.20.193.28:0/524468103 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5626ca6456f0 con 0x5626caaa3360 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9897fa640 1 -- 10.20.193.28:0/524468103 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9b40cf390 con 0x5626caaa3360 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc003860 con 0x5626caaa3360 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9897fa640 1 -- 10.20.193.28:0/524468103 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa9b402f9f0 con 0x5626caaa3360 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9cfbf3e00 10 client.30187 _ll_register_callbacks cb 0x5626ca930a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b40d70d0 con 0x5626caaa3360 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9897fa640 1 -- 10.20.193.28:0/524468103 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9b40dc4f0 con 0x5626caaa3360 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9cfbf3e00 10 client.30187 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5626ca945340 con 0x5626caaa3360 2026-02-20T13:30:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.274+0000 7fa9897fa640 1 -- 10.20.193.28:0/524468103 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa9b40b4020 con 0x5626caaa3360 2026-02-20T13:30:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.275+0000 7fa9cfbf3e00 10 client.30187 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.275+0000 7fa9cfbf3e00 10 client.30187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.275+0000 7fa9cfbf3e00 20 client.30187 populate_metadata read hostname 'trial028' 2026-02-20T13:30:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.275+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5626cab389b0 0x5626cab38e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.275+0000 7fa9cfbf3e00 4 client.30187 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:30:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.275+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5626ca642f40 con 0x5626cab389b0 2026-02-20T13:30:54.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.275+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5626cab389b0 0x5626cab38e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9c6ffd640 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5626cab389b0 0x5626cab38e50 crc :-1 s=READY pgs=389 gs=4 cs=0 l=0 c_cookie=1888296497745921634 s_cookie=4134856291281894929 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3493a8fac28662 server_cookie=3961f5e3b7257e11 in_seq=0 out_seq=0 2026-02-20T13:30:54.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9897fa640 10 client.30187 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9897fa640 1 -- 10.20.193.28:0/524468103 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5626ca642f40 con 0x5626cab389b0 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9897fa640 10 client.30187 handle_command_reply: tid=0 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 client.30187 shutdown 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 msgr2=0x5626caa81de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626caa81de0 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=5795579311981372352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b40d3640 tx=0x7fa9b4108070 comp rx=0 tx=0).stop 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 shutdown_connections 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5626cab389b0 0x5626cab38e50 crc :-1 s=READY pgs=389 gs=4 cs=0 l=0 c_cookie=1888296497745921634 s_cookie=4134856291281894929 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626caae8b20 0x5626caa86c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5626caaa3c70 0x5626caa82320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 --2- 10.20.193.28:0/524468103 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5626caaa3360 0x5626caa81de0 unknown :-1 s=CLOSED pgs=408 gs=1 cs=0 l=1 c_cookie=5795579311981372352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9897fa640 0 client.30187 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 >> 10.20.193.28:0/524468103 conn(0x5626caa81860 msgr2=0x5626cab052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 shutdown_connections 2026-02-20T13:30:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 1 -- 10.20.193.28:0/524468103 wait complete. 2026-02-20T13:30:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.276+0000 7fa9cfbf3e00 20 client.30187 trim_cache size 0 max 16384 2026-02-20T13:30:54.284 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:30:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 -- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa99c0b5750 msgr2=0x7fa99c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa99c0b5750 0x7fa99c0d5c00 secure :-1 s=READY pgs=592 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9c80fab90 tx=0x7fa9b8005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 -- 10.20.193.28:0/2561773060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 msgr2=0x7fa9c80f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 0x7fa9c80f4240 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9b4005b30 tx=0x7fa9b4004340 comp rx=0 tx=0).stop 2026-02-20T13:30:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 -- 10.20.193.28:0/2561773060 shutdown_connections 2026-02-20T13:30:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa99c0b5750 0x7fa99c0d5c00 unknown :-1 s=CLOSED pgs=592 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9c8113000 0x7fa9c80f4940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa9c8060a00 0x7fa9c81738d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 --2- 10.20.193.28:0/2561773060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa9c8060010 0x7fa9c80f4240 unknown :-1 s=CLOSED pgs=407 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 -- 10.20.193.28:0/2561773060 >> 10.20.193.28:0/2561773060 conn(0x7fa9c80e95a0 msgr2=0x7fa9c810a160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 -- 10.20.193.28:0/2561773060 shutdown_connections 2026-02-20T13:30:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.277+0000 7fa9cc970640 1 -- 10.20.193.28:0/2561773060 wait complete. 2026-02-20T13:30:54.359 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:54.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.528+0000 7ff10535b640 1 -- 10.20.193.28:0/378969664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10010fc20 msgr2=0x7ff100114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.528+0000 7ff10535b640 1 --2- 10.20.193.28:0/378969664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10010fc20 0x7ff100114c70 secure :-1 s=READY pgs=1437 gs=1 cs=0 l=1 c_cookie=3276594446455072597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0e8009950 tx=0x7ff0e802f190 comp rx=0 tx=0).stop 2026-02-20T13:30:54.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.528+0000 7ff10535b640 1 -- 10.20.193.28:0/378969664 shutdown_connections 2026-02-20T13:30:54.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.528+0000 7ff10535b640 1 --2- 10.20.193.28:0/378969664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10010fc20 0x7ff100114c70 unknown :-1 s=CLOSED pgs=1437 gs=1 cs=0 l=1 c_cookie=3276594446455072597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.528+0000 7ff10535b640 1 --2- 10.20.193.28:0/378969664 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff100115420 0x7ff100175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.528+0000 7ff10535b640 1 --2- 10.20.193.28:0/378969664 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff10010f230 0x7ff10010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.528+0000 7ff10535b640 1 -- 10.20.193.28:0/378969664 >> 10.20.193.28:0/378969664 conn(0x7ff10005f830 msgr2=0x7ff10010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:54.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.528+0000 7ff10535b640 1 -- 10.20.193.28:0/378969664 shutdown_connections 2026-02-20T13:30:54.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.529+0000 7ff10535b640 1 -- 10.20.193.28:0/378969664 wait complete. 2026-02-20T13:30:54.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.529+0000 7ff10535b640 1 Processor -- start 2026-02-20T13:30:54.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.529+0000 7ff10535b640 1 -- start start 2026-02-20T13:30:54.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff10535b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff10010f230 0x7ff1000f5560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff10535b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff10010fc20 0x7ff100175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff10535b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff100115420 0x7ff1000f5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff10535b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff1000fae70 con 0x7ff100115420 2026-02-20T13:30:54.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff10535b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff1000fafe0 con 0x7ff10010f230 2026-02-20T13:30:54.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff10535b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff1000fb1a0 con 0x7ff10010fc20 2026-02-20T13:30:54.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff100115420 0x7ff1000f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff100115420 0x7ff1000f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49856/0 (socket says 10.20.193.28:49856) 2026-02-20T13:30:54.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 -- 10.20.193.28:0/576418093 learned_addr learned my addr 10.20.193.28:0/576418093 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:54.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0feffd640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff10010f230 0x7ff1000f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0fe7fc640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff10010fc20 0x7ff100175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 -- 10.20.193.28:0/576418093 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff10010fc20 msgr2=0x7ff100175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff10010fc20 0x7ff100175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 -- 10.20.193.28:0/576418093 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff10010f230 msgr2=0x7ff1000f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff10010f230 0x7ff1000f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 -- 10.20.193.28:0/576418093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e8009570 con 0x7ff100115420 2026-02-20T13:30:54.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.530+0000 7ff0ff7fe640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff100115420 0x7ff1000f5c60 secure :-1 s=READY pgs=1438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f000b270 tx=0x7ff0f000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:54.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.531+0000 7ff0dffff640 1 -- 10.20.193.28:0/576418093 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0f0008cf0 con 0x7ff100115420 2026-02-20T13:30:54.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.531+0000 7ff0dffff640 1 -- 10.20.193.28:0/576418093 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff0f0008e50 con 0x7ff100115420 2026-02-20T13:30:54.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.531+0000 7ff0dffff640 1 -- 10.20.193.28:0/576418093 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0f00106b0 con 0x7ff100115420 2026-02-20T13:30:54.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.531+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1000fb480 con 0x7ff100115420 2026-02-20T13:30:54.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.531+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1000fb900 con 0x7ff100115420 2026-02-20T13:30:54.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.531+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff100110510 con 0x7ff100115420 2026-02-20T13:30:54.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.533+0000 7ff0dffff640 1 -- 10.20.193.28:0/576418093 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff0f00050b0 con 0x7ff100115420 2026-02-20T13:30:54.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.535+0000 7ff0dffff640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0d40b5830 0x7ff0d40d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:54.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.535+0000 7ff0dffff640 1 -- 10.20.193.28:0/576418093 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff0f00e7e30 con 0x7ff100115420 2026-02-20T13:30:54.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.535+0000 7ff0dffff640 1 -- 10.20.193.28:0/576418093 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7ff0f00e82b0 con 0x7ff100115420 2026-02-20T13:30:54.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.535+0000 7ff0feffd640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0d40b5830 0x7ff0d40d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:54.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.536+0000 7ff0feffd640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0d40b5830 0x7ff0d40d5ce0 secure :-1 s=READY pgs=593 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f4004740 tx=0x7ff0f4004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.678+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff10010f600 con 0x7ff100115420 2026-02-20T13:30:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.679+0000 7ff0dffff640 1 -- 10.20.193.28:0/576418093 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7ff0f00aa7e0 con 0x7ff100115420 2026-02-20T13:30:54.681 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:30:54.681 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:30:54.681 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0d40b5830 msgr2=0x7ff0d40d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0d40b5830 0x7ff0d40d5ce0 secure :-1 s=READY pgs=593 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f4004740 tx=0x7ff0f4004420 comp rx=0 tx=0).stop 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff100115420 msgr2=0x7ff1000f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff100115420 0x7ff1000f5c60 secure :-1 s=READY pgs=1438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f000b270 tx=0x7ff0f000de70 comp rx=0 tx=0).stop 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 shutdown_connections 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff0d40b5830 0x7ff0d40d5ce0 unknown :-1 s=CLOSED pgs=593 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff100115420 0x7ff1000f5c60 unknown :-1 s=CLOSED pgs=1438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff10010fc20 0x7ff100175cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 --2- 10.20.193.28:0/576418093 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff10010f230 0x7ff1000f5560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 >> 10.20.193.28:0/576418093 conn(0x7ff10005f830 msgr2=0x7ff100111a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 shutdown_connections 2026-02-20T13:30:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:54.680+0000 7ff10535b640 1 -- 10.20.193.28:0/576418093 wait complete. 2026-02-20T13:30:54.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:54 trial028 ceph-mon[37442]: pgmap v588: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:30:54.816 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 147.75 --await-for 45.0' 2026-02-20T13:30:54.817 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 147.75 --await-for 45.0 2026-02-20T13:30:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:54 trial127 ceph-mon[43817]: pgmap v588: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:30:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:54 trial034 ceph-mon[43332]: pgmap v588: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:30:55.004 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:55.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 -- 10.20.193.28:0/1627427335 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c81156a0 msgr2=0x7f01c8176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 --2- 10.20.193.28:0/1627427335 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c81156a0 0x7f01c8176070 secure :-1 s=READY pgs=409 gs=3 cs=0 l=1 c_cookie=10513930002865521674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01bc00aa30 tx=0x7f01bc030270 comp rx=0 tx=0).stop 2026-02-20T13:30:55.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 -- 10.20.193.28:0/1627427335 shutdown_connections 2026-02-20T13:30:55.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 --2- 10.20.193.28:0/1627427335 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c81156a0 0x7f01c8176070 unknown :-1 s=CLOSED pgs=409 gs=3 cs=0 l=1 c_cookie=10513930002865521674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 --2- 10.20.193.28:0/1627427335 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f01c810fea0 0x7f01c8114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 --2- 10.20.193.28:0/1627427335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01c810f4b0 0x7f01c810f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 -- 10.20.193.28:0/1627427335 >> 10.20.193.28:0/1627427335 conn(0x7f01c80ecd60 msgr2=0x7f01c810d170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 -- 10.20.193.28:0/1627427335 shutdown_connections 2026-02-20T13:30:55.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 -- 10.20.193.28:0/1627427335 wait complete. 2026-02-20T13:30:55.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.191+0000 7f01cd380640 1 Processor -- start 2026-02-20T13:30:55.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01cd380640 1 -- start start 2026-02-20T13:30:55.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01cd380640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f01c810f4b0 0x7f01c811ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01cd380640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c810fea0 0x7f01c811e300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01cd380640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01c81156a0 0x7f01c81236d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01cd380640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8123cf0 con 0x7f01c81156a0 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01cd380640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8123e60 con 0x7f01c810f4b0 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01cd380640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8124020 con 0x7f01c810fea0 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f01c810f4b0 0x7f01c811ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f01c810f4b0 0x7f01c811ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57986/0 (socket says 10.20.193.28:57986) 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c7fff640 1 -- 10.20.193.28:0/1170085048 learned_addr learned my addr 10.20.193.28:0/1170085048 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c810fea0 0x7f01c811e300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01ccb7f640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01c81156a0 0x7f01c81236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c7fff640 1 -- 10.20.193.28:0/1170085048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c810fea0 msgr2=0x7f01c811e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c810fea0 0x7f01c811e300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c7fff640 1 -- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01c81156a0 msgr2=0x7f01c81236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01c81156a0 0x7f01c81236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c7fff640 1 -- 10.20.193.28:0/1170085048 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b40094b0 con 0x7f01c810f4b0 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01ccb7f640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01c81156a0 0x7f01c81236d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.192+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c810fea0 0x7f01c811e300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.193+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f01c810f4b0 0x7f01c811ddc0 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b4009fd0 tx=0x7f01b4002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.193+0000 7f01c57fa640 1 -- 10.20.193.28:0/1170085048 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b400ed60 con 0x7f01c810f4b0 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.193+0000 7f01c57fa640 1 -- 10.20.193.28:0/1170085048 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f01b4002e20 con 0x7f01c810f4b0 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.193+0000 7f01cd380640 1 -- 10.20.193.28:0/1170085048 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01bc00a650 con 0x7f01c810f4b0 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.193+0000 7f01c57fa640 1 -- 10.20.193.28:0/1170085048 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b4018950 con 0x7f01c810f4b0 2026-02-20T13:30:55.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.193+0000 7f01cd380640 1 -- 10.20.193.28:0/1170085048 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c8164860 con 0x7f01c810f4b0 2026-02-20T13:30:55.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.196+0000 7f01c57fa640 1 -- 10.20.193.28:0/1170085048 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f01b4016020 con 0x7f01c810f4b0 2026-02-20T13:30:55.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.197+0000 7f01c57fa640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f019c0b56e0 0x7f019c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.197+0000 7f01c57fa640 1 -- 10.20.193.28:0/1170085048 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f01b40e6de0 con 0x7f01c810f4b0 2026-02-20T13:30:55.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.198+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f019c0b56e0 0x7f019c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.198+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f019c0b56e0 0x7f019c0d5b90 secure :-1 s=READY pgs=594 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01c8124760 tx=0x7f01b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.198+0000 7f01d0603e00 1 Processor -- start 2026-02-20T13:30:55.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.198+0000 7f01d0603e00 1 -- start start 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f0f100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f53fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f748d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01d0603e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab08e251a0 con 0x55ab08f0ed30 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01d0603e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab08e20ed0 con 0x55ab08f544f0 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01d0603e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab08e1b030 con 0x55ab08f0f640 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f53fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f0f100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f53fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:38078/0 (socket says 10.20.193.28:38078) 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c77fe640 1 -- 10.20.193.28:0/1427876441 learned_addr learned my addr 10.20.193.28:0/1427876441 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01ccb7f640 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c77fe640 1 -- 10.20.193.28:0/1427876441 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 msgr2=0x55ab08f748d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f748d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c77fe640 1 -- 10.20.193.28:0/1427876441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 msgr2=0x55ab08f0f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f0f100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c77fe640 1 -- 10.20.193.28:0/1427876441 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab08dc64c0 con 0x55ab08f0f640 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.199+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f0f100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f53fb0 secure :-1 s=READY pgs=410 gs=2 cs=0 l=1 c_cookie=3514707593730440976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b8003010 tx=0x7f01b8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c6bfef4dabbf10 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f0198ce3640 1 -- 10.20.193.28:0/1427876441 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b8011e60 con 0x55ab08f0f640 2026-02-20T13:30:55.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f0198ce3640 1 -- 10.20.193.28:0/1427876441 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f01b801d940 con 0x55ab08f0f640 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f0198ce3640 1 -- 10.20.193.28:0/1427876441 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b801abf0 con 0x55ab08f0f640 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 -- 10.20.193.28:0/1427876441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 msgr2=0x55ab08f53fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f53fb0 secure :-1 s=READY pgs=410 gs=2 cs=0 l=1 c_cookie=3514707593730440976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b8003010 tx=0x7f01b8013000 comp rx=0 tx=0).stop 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 -- 10.20.193.28:0/1427876441 shutdown_connections 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f748d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f53fb0 unknown :-1 s=CLOSED pgs=410 gs=2 cs=0 l=1 c_cookie=3514707593730440976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1427876441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f0f100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 -- 10.20.193.28:0/1427876441 >> 10.20.193.28:0/1427876441 conn(0x55ab08e2dd60 msgr2=0x55ab08f0d610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 -- 10.20.193.28:0/1427876441 shutdown_connections 2026-02-20T13:30:55.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.200+0000 7f01d0603e00 1 -- 10.20.193.28:0/1427876441 wait complete. 2026-02-20T13:30:55.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01d0603e00 1 -- start start 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01d0603e00 1 Processor -- start 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f27180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f276c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f2c6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01d0603e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab08f2cbf0 con 0x55ab08f0ed30 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01d0603e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab08f2cd60 con 0x55ab08f544f0 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01d0603e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab08f2cf20 con 0x55ab08f0f640 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f27180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01ccb7f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f2c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f27180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49896/0 (socket says 10.20.193.28:49896) 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01c77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01ccb7f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f2c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58002/0 (socket says 10.20.193.28:58002) 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01ccb7f640 1 -- 10.20.193.28:0/3651686711 learned_addr learned my addr 10.20.193.28:0/3651686711 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.202+0000 7f01c77fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f276c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:38094/0 (socket says 10.20.193.28:38094) 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01c7fff640 1 -- 10.20.193.28:0/3651686711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 msgr2=0x55ab08f276c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01c7fff640 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f276c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01c7fff640 1 -- 10.20.193.28:0/3651686711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 msgr2=0x55ab08f2c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01c7fff640 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f2c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01c7fff640 1 -- 10.20.193.28:0/3651686711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b8002dd0 con 0x55ab08f0ed30 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01c7fff640 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f27180 secure :-1 s=READY pgs=1439 gs=1 cs=0 l=1 c_cookie=5933018232871558410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b4010f30 tx=0x7f01b40af300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525650a5f8399d0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f0189ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f0189ffb640 1 -- 10.20.193.28:0/3651686711 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b40ac940 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c8164860 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01d0603e00 10 client.20427 _ll_register_callbacks cb 0x55ab08da5dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f0189ffb640 1 -- 10.20.193.28:0/3651686711 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f01b40adb40 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f0189ffb640 1 -- 10.20.193.28:0/3651686711 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b40ab120 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab08af9a60 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f0189ffb640 1 -- 10.20.193.28:0/3651686711 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f01b40ab280 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f0189ffb640 1 -- 10.20.193.28:0/3651686711 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f01b40aeb30 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01d0603e00 10 client.20427 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.203+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ab08d9ec20 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.204+0000 7f0189ffb640 1 -- 10.20.193.28:0/3651686711 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f01b40aec90 con 0x55ab08f0ed30 2026-02-20T13:30:55.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.204+0000 7f01d0603e00 10 client.20427 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.204+0000 7f01d0603e00 10 client.20427 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:30:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.204+0000 7f01d0603e00 20 client.20427 populate_metadata read hostname 'trial028' 2026-02-20T13:30:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.204+0000 7f01d0603e00 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab08f51940 0x55ab08f51de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.204+0000 7f01d0603e00 4 client.20427 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.204+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab08ded5d0 con 0x55ab08f51940 2026-02-20T13:30:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.204+0000 7f01c77fe640 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab08f51940 0x55ab08f51de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.205+0000 7f01c77fe640 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab08f51940 0x55ab08f51de0 crc :-1 s=READY pgs=390 gs=4 cs=0 l=0 c_cookie=13851057945139610 s_cookie=9749759994884969899 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313576bc95599a server_cookie=874e1b0f146ed5ab in_seq=0 out_seq=0 2026-02-20T13:30:55.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.205+0000 7f0189ffb640 10 client.20427 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:55.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f0189ffb640 1 -- 10.20.193.28:0/3651686711 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ab08ded5d0 con 0x55ab08f51940 2026-02-20T13:30:55.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f0189ffb640 10 client.20427 handle_command_reply: tid=0 2026-02-20T13:30:55.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 client.20427 shutdown 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 msgr2=0x55ab08f27180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f27180 secure :-1 s=READY pgs=1439 gs=1 cs=0 l=1 c_cookie=5933018232871558410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b4010f30 tx=0x7f01b40af300 comp rx=0 tx=0).stop 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 shutdown_connections 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab08f51940 0x55ab08f51de0 crc :-1 s=READY pgs=390 gs=4 cs=0 l=0 c_cookie=13851057945139610 s_cookie=9749759994884969899 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f2c6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0f640 0x55ab08f276c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 --2- 10.20.193.28:0/3651686711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0ed30 0x55ab08f27180 unknown :-1 s=CLOSED pgs=1439 gs=1 cs=0 l=1 c_cookie=5933018232871558410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 >> 10.20.193.28:0/3651686711 conn(0x55ab08e2dd60 msgr2=0x55ab08f0dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f0189ffb640 0 client.20427 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 shutdown_connections 2026-02-20T13:30:55.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 1 -- 10.20.193.28:0/3651686711 wait complete. 2026-02-20T13:30:55.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.206+0000 7f01d0603e00 20 client.20427 trim_cache size 0 max 16384 2026-02-20T13:30:55.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.215+0000 7f01d0603e00 1 Processor -- start 2026-02-20T13:30:55.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.215+0000 7f01d0603e00 1 -- start start 2026-02-20T13:30:55.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.215+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f51da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.215+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f0f640 0x55ab08f536d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.215+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f544f0 0x55ab08f53c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.216+0000 7f01d0603e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab08e18c60 con 0x55ab08f544f0 2026-02-20T13:30:55.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.216+0000 7f01d0603e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab08ad8ef0 con 0x55ab08f0f640 2026-02-20T13:30:55.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.216+0000 7f01d0603e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab08f14a00 con 0x55ab08f0ed30 2026-02-20T13:30:55.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.216+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f51da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.216+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f51da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:38100/0 (socket says 10.20.193.28:38100) 2026-02-20T13:30:55.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.216+0000 7f01c7fff640 1 -- 10.20.193.28:0/1092677571 learned_addr learned my addr 10.20.193.28:0/1092677571 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.216+0000 7f01ccb7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f544f0 0x55ab08f53c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.216+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f0f640 0x55ab08f536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01c7fff640 1 -- 10.20.193.28:0/1092677571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f0f640 msgr2=0x55ab08f536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f0f640 0x55ab08f536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01c7fff640 1 -- 10.20.193.28:0/1092677571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f544f0 msgr2=0x55ab08f53c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f544f0 0x55ab08f53c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01c7fff640 1 -- 10.20.193.28:0/1092677571 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab08db05f0 con 0x55ab08f0ed30 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01ccb7f640 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f544f0 0x55ab08f53c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f51da0 secure :-1 s=READY pgs=411 gs=2 cs=0 l=1 c_cookie=9846911362741811704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b400e720 tx=0x7f01b406e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a741b696fbb9f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f018bfff640 1 -- 10.20.193.28:0/1092677571 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b40ac940 con 0x55ab08f0ed30 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f018bfff640 1 -- 10.20.193.28:0/1092677571 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f01b40ca060 con 0x55ab08f0ed30 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f018bfff640 1 -- 10.20.193.28:0/1092677571 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b40b5440 con 0x55ab08f0ed30 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01d0603e00 1 -- 10.20.193.28:0/1092677571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 msgr2=0x55ab08f51da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.217+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f51da0 secure :-1 s=READY pgs=411 gs=2 cs=0 l=1 c_cookie=9846911362741811704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b400e720 tx=0x7f01b406e000 comp rx=0 tx=0).stop 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.218+0000 7f01d0603e00 1 -- 10.20.193.28:0/1092677571 shutdown_connections 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.218+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f544f0 0x55ab08f53c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.218+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f0f640 0x55ab08f536d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.218+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1092677571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f51da0 unknown :-1 s=CLOSED pgs=411 gs=2 cs=0 l=1 c_cookie=9846911362741811704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.218+0000 7f01d0603e00 1 -- 10.20.193.28:0/1092677571 >> 10.20.193.28:0/1092677571 conn(0x55ab08e2dd60 msgr2=0x55ab08f2bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.218+0000 7f01d0603e00 1 -- 10.20.193.28:0/1092677571 shutdown_connections 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.218+0000 7f01d0603e00 1 -- 10.20.193.28:0/1092677571 wait complete. 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.218+0000 7f01d0603e00 1 -- start start 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01d0603e00 1 Processor -- start 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f2d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0f640 0x55ab08f2de60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01d0603e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f327c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01d0603e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ab08f14a00 con 0x55ab08f0f640 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01d0603e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ab08e18c60 con 0x55ab08f544f0 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01d0603e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ab08f32d00 con 0x55ab08f0ed30 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0f640 0x55ab08f2de60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f2d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c7fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f2d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:38116/0 (socket says 10.20.193.28:38116) 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c7fff640 1 -- 10.20.193.28:0/1380405027 learned_addr learned my addr 10.20.193.28:0/1380405027 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01ccb7f640 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c7fff640 1 -- 10.20.193.28:0/1380405027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 msgr2=0x55ab08f327c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f327c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c7fff640 1 -- 10.20.193.28:0/1380405027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0f640 msgr2=0x55ab08f2de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0f640 0x55ab08f2de60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.219+0000 7f01c7fff640 1 -- 10.20.193.28:0/1380405027 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab08d9ec20 con 0x55ab08f0ed30 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f01c7fff640 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f2d920 secure :-1 s=READY pgs=412 gs=2 cs=0 l=1 c_cookie=16430058398078246565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b40ad120 tx=0x7f01b4018400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4034b1018609ea5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f0189ffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f0189ffb640 1 -- 10.20.193.28:0/1380405027 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b40ac940 con 0x55ab08f0ed30 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f0189ffb640 1 -- 10.20.193.28:0/1380405027 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f01b40ca070 con 0x55ab08f0ed30 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c81768e0 con 0x55ab08f0ed30 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f0189ffb640 1 -- 10.20.193.28:0/1380405027 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01b40b54b0 con 0x55ab08f0ed30 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f0189ffb640 1 -- 10.20.193.28:0/1380405027 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f01b408d030 con 0x55ab08f0ed30 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f0189ffb640 10 client.30208 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f01d0603e00 10 client.30208 _ll_register_callbacks cb 0x55ab08da5dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.220+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab08b72aa0 con 0x55ab08f0ed30 2026-02-20T13:30:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f0189ffb640 1 -- 10.20.193.28:0/1380405027 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f01b40b4220 con 0x55ab08f0ed30 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01d0603e00 10 client.30208 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ab08dab150 con 0x55ab08f0ed30 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f0189ffb640 1 -- 10.20.193.28:0/1380405027 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f01b40722d0 con 0x55ab08f0ed30 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01d0603e00 10 client.30208 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01d0603e00 10 client.30208 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01d0603e00 20 client.30208 populate_metadata read hostname 'trial028' 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab08fa3c00 0x55ab08fa40a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01d0603e00 4 client.30208 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.75, "await_for": 45.0}] 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.75, "await_for": 45.0}) -- 0x55ab08e28050 con 0x55ab08fa3c00 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.221+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab08fa3c00 0x55ab08fa40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.222+0000 7f01c77fe640 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab08fa3c00 0x55ab08fa40a0 crc :-1 s=READY pgs=391 gs=4 cs=0 l=0 c_cookie=12989302484289409148 s_cookie=15842429113056015309 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44345ca082b507c server_cookie=dbdb9d576f02b3cd in_seq=0 out_seq=0 2026-02-20T13:30:55.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.222+0000 7f0189ffb640 10 client.30208 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:55.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f0189ffb640 1 -- 10.20.193.28:0/1380405027 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55ab08e28050 con 0x55ab08fa3c00 2026-02-20T13:30:55.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f0189ffb640 10 client.30208 handle_command_reply: tid=0 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 client.30208 shutdown 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 msgr2=0x55ab08f2d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f2d920 secure :-1 s=READY pgs=412 gs=2 cs=0 l=1 c_cookie=16430058398078246565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b40ad120 tx=0x7f01b4018400 comp rx=0 tx=0).stop 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 shutdown_connections 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55ab08fa3c00 0x55ab08fa40a0 crc :-1 s=READY pgs=391 gs=4 cs=0 l=0 c_cookie=12989302484289409148 s_cookie=15842429113056015309 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ab08f0f640 0x55ab08f2de60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ab08f544f0 0x55ab08f327c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 --2- 10.20.193.28:0/1380405027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ab08f0ed30 0x55ab08f2d920 unknown :-1 s=CLOSED pgs=412 gs=2 cs=0 l=1 c_cookie=16430058398078246565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 >> 10.20.193.28:0/1380405027 conn(0x55ab08e2dd60 msgr2=0x55ab08f2a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f0189ffb640 0 client.30208 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:55.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.227+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 shutdown_connections 2026-02-20T13:30:55.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01d0603e00 1 -- 10.20.193.28:0/1380405027 wait complete. 2026-02-20T13:30:55.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01d0603e00 20 client.30208 trim_cache size 0 max 16384 2026-02-20T13:30:55.233 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:55.233 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T13:30:55.233 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:30:55.233 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 50, 2026-02-20T13:30:55.233 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "e2e0aae": { 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "version": 50, 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 147.8, 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:30:55.234 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:55.235 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:55.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 -- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f019c0b56e0 msgr2=0x7f019c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f019c0b56e0 0x7f019c0d5b90 secure :-1 s=READY pgs=594 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01c8124760 tx=0x7f01b8005f90 comp rx=0 tx=0).stop 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 -- 10.20.193.28:0/1170085048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f01c810f4b0 msgr2=0x7f01c811ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f01c810f4b0 0x7f01c811ddc0 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01b4009fd0 tx=0x7f01b4002bc0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 -- 10.20.193.28:0/1170085048 shutdown_connections 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f019c0b56e0 0x7f019c0d5b90 unknown :-1 s=CLOSED pgs=594 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01c81156a0 0x7f01c81236d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01c810fea0 0x7f01c811e300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 --2- 10.20.193.28:0/1170085048 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f01c810f4b0 0x7f01c811ddc0 unknown :-1 s=CLOSED pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 -- 10.20.193.28:0/1170085048 >> 10.20.193.28:0/1170085048 conn(0x7f01c80ecd60 msgr2=0x7f01c810d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 -- 10.20.193.28:0/1170085048 shutdown_connections 2026-02-20T13:30:55.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.228+0000 7f01cd380640 1 -- 10.20.193.28:0/1170085048 wait complete. 2026-02-20T13:30:55.330 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e2e0aae', quiesce took 1.2 seconds. Will release after: 26.55 2026-02-20T13:30:55.379 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:30:55.379 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:30:55.568 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:55.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 -- 10.20.193.28:0/976882971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78159d80 msgr2=0x7f1a7817a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/976882971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78159d80 0x7f1a7817a160 secure :-1 s=READY pgs=1440 gs=1 cs=0 l=1 c_cookie=986152766099837334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6800aa30 tx=0x7f1a68030270 comp rx=0 tx=0).stop 2026-02-20T13:30:55.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 -- 10.20.193.28:0/976882971 shutdown_connections 2026-02-20T13:30:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/976882971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78159d80 0x7f1a7817a160 unknown :-1 s=CLOSED pgs=1440 gs=1 cs=0 l=1 c_cookie=986152766099837334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/976882971 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1a780614f0 0x7f1a78061920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/976882971 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1a78062ae0 0x7f1a78060fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 -- 10.20.193.28:0/976882971 >> 10.20.193.28:0/976882971 conn(0x7f1a780eab00 msgr2=0x7f1a7810af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 -- 10.20.193.28:0/976882971 shutdown_connections 2026-02-20T13:30:55.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.757+0000 7f1a7c98a640 1 -- 10.20.193.28:0/976882971 wait complete. 2026-02-20T13:30:55.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.758+0000 7f1a7c98a640 1 Processor -- start 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.758+0000 7f1a7c98a640 1 -- start start 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.758+0000 7f1a7c98a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1a780614f0 0x7f1a7816b560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.758+0000 7f1a7c98a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78062ae0 0x7f1a7816baa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.758+0000 7f1a7c98a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1a78159d80 0x7f1a781705b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.758+0000 7f1a7c98a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7816c3f0 con 0x7f1a78062ae0 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.758+0000 7f1a7c98a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78111350 con 0x7f1a780614f0 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.758+0000 7f1a7c98a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78111510 con 0x7f1a78159d80 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78062ae0 0x7f1a7816baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78062ae0 0x7f1a7816baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49928/0 (socket says 10.20.193.28:49928) 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 -- 10.20.193.28:0/1632214385 learned_addr learned my addr 10.20.193.28:0/1632214385 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76d76640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1a780614f0 0x7f1a7816b560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a77577640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1a78159d80 0x7f1a781705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 -- 10.20.193.28:0/1632214385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1a78159d80 msgr2=0x7f1a781705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1a78159d80 0x7f1a781705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 -- 10.20.193.28:0/1632214385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1a780614f0 msgr2=0x7f1a7816b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1a780614f0 0x7f1a7816b560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 -- 10.20.193.28:0/1632214385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6800a650 con 0x7f1a78062ae0 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a76575640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78062ae0 0x7f1a7816baa0 secure :-1 s=READY pgs=1441 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6000d950 tx=0x7f1a6000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a57fff640 1 -- 10.20.193.28:0/1632214385 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a60004540 con 0x7f1a78062ae0 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a57fff640 1 -- 10.20.193.28:0/1632214385 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1a60009d00 con 0x7f1a78062ae0 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a57fff640 1 -- 10.20.193.28:0/1632214385 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a600106e0 con 0x7f1a78062ae0 2026-02-20T13:30:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a7c98a640 1 -- 10.20.193.28:0/1632214385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a781117f0 con 0x7f1a78062ae0 2026-02-20T13:30:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.759+0000 7f1a7c98a640 1 -- 10.20.193.28:0/1632214385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a78111d10 con 0x7f1a78062ae0 2026-02-20T13:30:55.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.762+0000 7f1a57fff640 1 -- 10.20.193.28:0/1632214385 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1a600097c0 con 0x7f1a78062ae0 2026-02-20T13:30:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.764+0000 7f1a57fff640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a4c0b5760 0x7f1a4c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.764+0000 7f1a57fff640 1 -- 10.20.193.28:0/1632214385 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1a600e66c0 con 0x7f1a78062ae0 2026-02-20T13:30:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.764+0000 7f1a76d76640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a4c0b5760 0x7f1a4c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a76d76640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a4c0b5760 0x7f1a4c0d5c10 secure :-1 s=READY pgs=595 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6c005970 tx=0x7f1a6c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a7f185e00 1 Processor -- start 2026-02-20T13:30:55.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a7f185e00 1 -- start start 2026-02-20T13:30:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98edf57e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee3a480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 0x55b98ee5ada0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b98ed0ba20 con 0x55b98edf5d20 2026-02-20T13:30:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b98ed07750 con 0x55b98ee3a9c0 2026-02-20T13:30:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.765+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b98ed016f0 con 0x55b98edf5410 2026-02-20T13:30:55.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee3a480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98edf57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee3a480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49942/0 (socket says 10.20.193.28:49942) 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 -- 10.20.193.28:0/102921927 learned_addr learned my addr 10.20.193.28:0/102921927 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a77577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 0x55b98ee5ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 -- 10.20.193.28:0/102921927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 msgr2=0x55b98edf57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 --2- 10.20.193.28:0/102921927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98edf57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 -- 10.20.193.28:0/102921927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 msgr2=0x55b98ee5ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 --2- 10.20.193.28:0/102921927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 0x55b98ee5ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 -- 10.20.193.28:0/102921927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98ecad120 con 0x55b98edf5d20 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a76575640 1 --2- 10.20.193.28:0/102921927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee3a480 secure :-1 s=READY pgs=1442 gs=2 cs=0 l=1 c_cookie=12242019758442151821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a600a9c90 tx=0x7f1a60002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e4641bfb41ff8d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a437fe640 1 -- 10.20.193.28:0/102921927 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a600ac400 con 0x55b98edf5d20 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a437fe640 1 -- 10.20.193.28:0/102921927 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1a600ac220 con 0x55b98edf5d20 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a437fe640 1 -- 10.20.193.28:0/102921927 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a600a8c90 con 0x55b98edf5d20 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a7f185e00 1 -- 10.20.193.28:0/102921927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 msgr2=0x55b98ee3a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.766+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/102921927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee3a480 secure :-1 s=READY pgs=1442 gs=2 cs=0 l=1 c_cookie=12242019758442151821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a600a9c90 tx=0x7f1a60002390 comp rx=0 tx=0).stop 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.767+0000 7f1a7f185e00 1 -- 10.20.193.28:0/102921927 shutdown_connections 2026-02-20T13:30:55.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.767+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/102921927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee3a480 unknown :-1 s=CLOSED pgs=1442 gs=2 cs=0 l=1 c_cookie=12242019758442151821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.767+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/102921927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 0x55b98ee5ada0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.767+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/102921927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98edf57e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.767+0000 7f1a7f185e00 1 -- 10.20.193.28:0/102921927 >> 10.20.193.28:0/102921927 conn(0x55b98edd3910 msgr2=0x55b98edf3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.767+0000 7f1a7f185e00 1 -- 10.20.193.28:0/102921927 shutdown_connections 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.767+0000 7f1a7f185e00 1 -- 10.20.193.28:0/102921927 wait complete. 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a7f185e00 1 -- start start 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a7f185e00 1 Processor -- start 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0dd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5d20 0x55b98ee0e260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee13250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b98ee13790 con 0x55b98ee3a9c0 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b98ee13900 con 0x55b98edf5d20 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b98ee13ac0 con 0x55b98edf5410 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a76575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5d20 0x55b98ee0e260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a77577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee13250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a76575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5d20 0x55b98ee0e260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58064/0 (socket says 10.20.193.28:58064) 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.768+0000 7f1a76575640 1 -- 10.20.193.28:0/120609918 learned_addr learned my addr 10.20.193.28:0/120609918 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a76d76640 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a76575640 1 -- 10.20.193.28:0/120609918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 msgr2=0x55b98ee0dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a76575640 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a76575640 1 -- 10.20.193.28:0/120609918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 msgr2=0x55b98ee13250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a76575640 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee13250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a76575640 1 -- 10.20.193.28:0/120609918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98ec85810 con 0x55b98edf5d20 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a77577640 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee13250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a76575640 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5d20 0x55b98ee0e260 secure :-1 s=READY pgs=493 gs=1 cs=0 l=1 c_cookie=2023781871833903198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a60009610 tx=0x7f1a60005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c15eae3d588f05e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a40ff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:55.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a40ff9640 1 -- 10.20.193.28:0/120609918 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a600b4d20 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a40ff9640 1 -- 10.20.193.28:0/120609918 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1a600b7b60 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a40ff9640 1 -- 10.20.193.28:0/120609918 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a600b7910 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a78111d10 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a7f185e00 10 client.30359 _ll_register_callbacks cb 0x55b98ecb8b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.769+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b98e9979d0 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a40ff9640 1 -- 10.20.193.28:0/120609918 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1a600ad420 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a40ff9640 1 -- 10.20.193.28:0/120609918 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a600ad940 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a7f185e00 10 client.30359 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b98ec974f0 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a40ff9640 1 -- 10.20.193.28:0/120609918 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1a60071bb0 con 0x55b98edf5d20 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a7f185e00 10 client.30359 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a7f185e00 10 client.30359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a7f185e00 20 client.30359 populate_metadata read hostname 'trial028' 2026-02-20T13:30:55.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b98ee37fb0 0x55b98ee38450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a7f185e00 4 client.30359 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:55.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b98ed0edf0 con 0x55b98ee37fb0 2026-02-20T13:30:55.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.770+0000 7f1a76d76640 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b98ee37fb0 0x55b98ee38450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.771+0000 7f1a76d76640 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b98ee37fb0 0x55b98ee38450 crc :-1 s=READY pgs=392 gs=4 cs=0 l=0 c_cookie=16492494044562418635 s_cookie=18312265308246726321 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4e11bf3da636bcb server_cookie=fe223c467ac156b1 in_seq=0 out_seq=0 2026-02-20T13:30:55.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.771+0000 7f1a40ff9640 10 client.30359 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:55.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.771+0000 7f1a40ff9640 1 -- 10.20.193.28:0/120609918 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b98ed0edf0 con 0x55b98ee37fb0 2026-02-20T13:30:55.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.771+0000 7f1a40ff9640 10 client.30359 handle_command_reply: tid=0 2026-02-20T13:30:55.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.771+0000 7f1a7f185e00 1 client.30359 shutdown 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.771+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5d20 msgr2=0x55b98ee0e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.771+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5d20 0x55b98ee0e260 secure :-1 s=READY pgs=493 gs=1 cs=0 l=1 c_cookie=2023781871833903198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a60009610 tx=0x7f1a60005a20 comp rx=0 tx=0).stop 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 shutdown_connections 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b98ee37fb0 0x55b98ee38450 crc :-1 s=READY pgs=392 gs=4 cs=0 l=0 c_cookie=16492494044562418635 s_cookie=18312265308246726321 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee13250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5d20 0x55b98ee0e260 unknown :-1 s=CLOSED pgs=493 gs=1 cs=0 l=1 c_cookie=2023781871833903198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/120609918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0dd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 >> 10.20.193.28:0/120609918 conn(0x55b98edd3910 msgr2=0x55b98edf44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a40ff9640 0 client.30359 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 shutdown_connections 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 1 -- 10.20.193.28:0/120609918 wait complete. 2026-02-20T13:30:55.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.772+0000 7f1a7f185e00 20 client.30359 trim_cache size 0 max 16384 2026-02-20T13:30:55.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a7f185e00 1 Processor -- start 2026-02-20T13:30:55.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a7f185e00 1 -- start start 2026-02-20T13:30:55.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee0b530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 0x55b98ee39d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b98edffe10 con 0x55b98edf5d20 2026-02-20T13:30:55.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b98ecff320 con 0x55b98ee3a9c0 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b98e9bf790 con 0x55b98edf5410 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.781+0000 7f1a76d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:38154/0 (socket says 10.20.193.28:38154) 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76d76640 1 -- 10.20.193.28:0/369968334 learned_addr learned my addr 10.20.193.28:0/369968334 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee0b530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a77577640 1 --2- 10.20.193.28:0/369968334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 0x55b98ee39d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76d76640 1 -- 10.20.193.28:0/369968334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 msgr2=0x55b98ee39d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76d76640 1 --2- 10.20.193.28:0/369968334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 0x55b98ee39d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76d76640 1 -- 10.20.193.28:0/369968334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 msgr2=0x55b98ee0b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76d76640 1 --2- 10.20.193.28:0/369968334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee0b530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76d76640 1 -- 10.20.193.28:0/369968334 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98ee00040 con 0x55b98edf5410 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a76d76640 1 --2- 10.20.193.28:0/369968334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0aff0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=10926687503496567203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6c004740 tx=0x7f1a6c00b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a36464719cd9a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a42ffd640 1 -- 10.20.193.28:0/369968334 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a6c024020 con 0x55b98edf5410 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a42ffd640 1 -- 10.20.193.28:0/369968334 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55b98ed0edf0 con 0x55b98edf5410 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a42ffd640 1 -- 10.20.193.28:0/369968334 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a6c02a320 con 0x55b98edf5410 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a7f185e00 1 -- 10.20.193.28:0/369968334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 msgr2=0x55b98ee0aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.782+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/369968334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0aff0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=10926687503496567203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6c004740 tx=0x7f1a6c00b000 comp rx=0 tx=0).stop 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 -- 10.20.193.28:0/369968334 shutdown_connections 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/369968334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98edf5d20 0x55b98ee0b530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/369968334 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98ee3a9c0 0x55b98ee39d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/369968334 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5410 0x55b98ee0aff0 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=10926687503496567203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 -- 10.20.193.28:0/369968334 >> 10.20.193.28:0/369968334 conn(0x55b98edd3910 msgr2=0x55b98ee0a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 -- 10.20.193.28:0/369968334 shutdown_connections 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 -- 10.20.193.28:0/369968334 wait complete. 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 -- start start 2026-02-20T13:30:55.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.783+0000 7f1a7f185e00 1 Processor -- start 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5410 0x55b98ee16840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5d20 0x55b98ee16d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a7f185e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee172c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b98edffcd0 con 0x55b98ee3a9c0 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b98edfaff0 con 0x55b98edf5410 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a7f185e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b98edd0390 con 0x55b98edf5d20 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5410 0x55b98ee16840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5410 0x55b98ee16840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58082/0 (socket says 10.20.193.28:58082) 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 -- 10.20.193.28:0/3092929613 learned_addr learned my addr 10.20.193.28:0/3092929613 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76575640 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5d20 0x55b98ee16d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a77577640 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 -- 10.20.193.28:0/3092929613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5d20 msgr2=0x55b98ee16d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5d20 0x55b98ee16d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 -- 10.20.193.28:0/3092929613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 msgr2=0x55b98ee172c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee172c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 -- 10.20.193.28:0/3092929613 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98ec91f70 con 0x55b98edf5410 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a77577640 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee172c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a76d76640 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5410 0x55b98ee16840 secure :-1 s=READY pgs=494 gs=1 cs=0 l=1 c_cookie=1918081326148151937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6c00fb10 tx=0x7f1a6c005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9e64cdbf5eea81 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.784+0000 7f1a40ff9640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a40ff9640 1 -- 10.20.193.28:0/3092929613 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a6c024070 con 0x55b98edf5410 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a40ff9640 1 -- 10.20.193.28:0/3092929613 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1a6c011d20 con 0x55b98edf5410 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a40ff9640 1 -- 10.20.193.28:0/3092929613 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a6c01f6c0 con 0x55b98edf5410 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c00fe00 con 0x55b98edf5410 2026-02-20T13:30:55.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a40ff9640 1 -- 10.20.193.28:0/3092929613 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1a6c01f850 con 0x55b98edf5410 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 10 client.30365 _ll_register_callbacks cb 0x55b98ecb8b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a600ac220 con 0x55b98edf5410 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a40ff9640 1 -- 10.20.193.28:0/3092929613 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a6c01ee80 con 0x55b98edf5410 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 10 client.30365 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b98ec85b40 con 0x55b98edf5410 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a40ff9640 1 -- 10.20.193.28:0/3092929613 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1a6c01e870 con 0x55b98edf5410 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 10 client.30365 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 10 client.30365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 20 client.30365 populate_metadata read hostname 'trial028' 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b98eee8eb0 0x55b98ef09360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 4 client.30365 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.785+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b98e995220 con 0x55b98eee8eb0 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.786+0000 7f1a76575640 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b98eee8eb0 0x55b98ef09360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.786+0000 7f1a76575640 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b98eee8eb0 0x55b98ef09360 crc :-1 s=READY pgs=393 gs=4 cs=0 l=0 c_cookie=11576331219969101397 s_cookie=424048396583485858 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0a763e91885ce55 server_cookie=5e285c51deec1a2 in_seq=0 out_seq=0 2026-02-20T13:30:55.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.786+0000 7f1a40ff9640 10 client.30365 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a40ff9640 1 -- 10.20.193.28:0/3092929613 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b98e995220 con 0x55b98eee8eb0 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a40ff9640 10 client.30365 handle_command_reply: tid=0 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 client.30365 shutdown 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5410 msgr2=0x55b98ee16840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5410 0x55b98ee16840 secure :-1 s=READY pgs=494 gs=1 cs=0 l=1 c_cookie=1918081326148151937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6c00fb10 tx=0x7f1a6c005780 comp rx=0 tx=0).stop 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 shutdown_connections 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55b98eee8eb0 0x55b98ef09360 crc :-1 s=READY pgs=393 gs=4 cs=0 l=0 c_cookie=11576331219969101397 s_cookie=424048396583485858 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b98ee3a9c0 0x55b98ee172c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b98edf5d20 0x55b98ee16d80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 --2- 10.20.193.28:0/3092929613 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b98edf5410 0x55b98ee16840 unknown :-1 s=CLOSED pgs=494 gs=1 cs=0 l=1 c_cookie=1918081326148151937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a40ff9640 0 client.30365 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 >> 10.20.193.28:0/3092929613 conn(0x55b98edd3910 msgr2=0x55b98ee0aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 shutdown_connections 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 1 -- 10.20.193.28:0/3092929613 wait complete. 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.787+0000 7f1a7f185e00 20 client.30365 trim_cache size 0 max 16384 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "07bb91cb-dd88-47e7-8303-84c9b1588bc6", 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:30:55.790 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 -- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a4c0b5760 msgr2=0x7f1a4c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a4c0b5760 0x7f1a4c0d5c10 secure :-1 s=READY pgs=595 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6c005970 tx=0x7f1a6c005900 comp rx=0 tx=0).stop 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 -- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78062ae0 msgr2=0x7f1a7816baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78062ae0 0x7f1a7816baa0 secure :-1 s=READY pgs=1441 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a6000d950 tx=0x7f1a6000de20 comp rx=0 tx=0).stop 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 -- 10.20.193.28:0/1632214385 shutdown_connections 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1a4c0b5760 0x7f1a4c0d5c10 unknown :-1 s=CLOSED pgs=595 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78062ae0 0x7f1a7816baa0 unknown :-1 s=CLOSED pgs=1441 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1a78159d80 0x7f1a781705b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 --2- 10.20.193.28:0/1632214385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1a780614f0 0x7f1a7816b560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 -- 10.20.193.28:0/1632214385 >> 10.20.193.28:0/1632214385 conn(0x7f1a780eab00 msgr2=0x7f1a7810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 -- 10.20.193.28:0/1632214385 shutdown_connections 2026-02-20T13:30:55.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:55.788+0000 7f1a7c98a640 1 -- 10.20.193.28:0/1632214385 wait complete. 2026-02-20T13:30:55.830 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:55 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/576418093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:55.887 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:30:55.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:55 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/576418093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:55.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:55 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/576418093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:30:56.071 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:30:56.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 -- 10.20.193.28:0/310443020 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f959c10c430 msgr2=0x7f959c110a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 --2- 10.20.193.28:0/310443020 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f959c10c430 0x7f959c110a00 secure :-1 s=READY pgs=495 gs=1 cs=0 l=1 c_cookie=7466790638993922282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95840098c0 tx=0x7f958402f0e0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 -- 10.20.193.28:0/310443020 shutdown_connections 2026-02-20T13:30:56.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 --2- 10.20.193.28:0/310443020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f959c111020 0x7f959c1114c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 --2- 10.20.193.28:0/310443020 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f959c10c430 0x7f959c110a00 unknown :-1 s=CLOSED pgs=495 gs=1 cs=0 l=1 c_cookie=7466790638993922282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 --2- 10.20.193.28:0/310443020 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f959c10ba40 0x7f959c10be10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 -- 10.20.193.28:0/310443020 >> 10.20.193.28:0/310443020 conn(0x7f959c0e9670 msgr2=0x7f959c109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:56.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 -- 10.20.193.28:0/310443020 shutdown_connections 2026-02-20T13:30:56.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 -- 10.20.193.28:0/310443020 wait complete. 2026-02-20T13:30:56.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.246+0000 7f95a18df640 1 Processor -- start 2026-02-20T13:30:56.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f95a18df640 1 -- start start 2026-02-20T13:30:56.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f95a18df640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f959c10ba40 0x7f959c121a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f95a18df640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f959c10c430 0x7f959c121f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f95a18df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f959c111020 0x7f959c127320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f95a18df640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f959c127940 con 0x7f959c111020 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f95a18df640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f959c127ab0 con 0x7f959c10c430 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f95a18df640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f959c127c70 con 0x7f959c10ba40 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959affd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f959c10ba40 0x7f959c121a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f959c111020 0x7f959c127320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f959c111020 0x7f959c127320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49996/0 (socket says 10.20.193.28:49996) 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 -- 10.20.193.28:0/880296802 learned_addr learned my addr 10.20.193.28:0/880296802 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959a7fc640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f959c10c430 0x7f959c121f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 -- 10.20.193.28:0/880296802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f959c10ba40 msgr2=0x7f959c121a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f959c10ba40 0x7f959c121a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 -- 10.20.193.28:0/880296802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f959c10c430 msgr2=0x7f959c121f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f959c10c430 0x7f959c121f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 -- 10.20.193.28:0/880296802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95840094b0 con 0x7f959c111020 2026-02-20T13:30:56.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.247+0000 7f959b7fe640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f959c111020 0x7f959c127320 secure :-1 s=READY pgs=1443 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f958c006e90 tx=0x7f958c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:56.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.248+0000 7f95a08dd640 1 -- 10.20.193.28:0/880296802 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f958c005500 con 0x7f959c111020 2026-02-20T13:30:56.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.248+0000 7f95a18df640 1 -- 10.20.193.28:0/880296802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c127f50 con 0x7f959c111020 2026-02-20T13:30:56.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.248+0000 7f95a18df640 1 -- 10.20.193.28:0/880296802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c168650 con 0x7f959c111020 2026-02-20T13:30:56.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.248+0000 7f95a08dd640 1 -- 10.20.193.28:0/880296802 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f958c005e10 con 0x7f959c111020 2026-02-20T13:30:56.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.248+0000 7f95a08dd640 1 -- 10.20.193.28:0/880296802 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f958c003a90 con 0x7f959c111020 2026-02-20T13:30:56.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.250+0000 7f95a08dd640 1 -- 10.20.193.28:0/880296802 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f958c00c840 con 0x7f959c111020 2026-02-20T13:30:56.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.252+0000 7f95a08dd640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95700b5760 0x7f95700d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.252+0000 7f95a08dd640 1 -- 10.20.193.28:0/880296802 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f958c0e7770 con 0x7f959c111020 2026-02-20T13:30:56.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.252+0000 7f959affd640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95700b5760 0x7f95700d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.253+0000 7f959affd640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95700b5760 0x7f95700d5c10 secure :-1 s=READY pgs=596 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9590005b30 tx=0x7f9590009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:56.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.253+0000 7f95a38d9e00 1 Processor -- start 2026-02-20T13:30:56.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.253+0000 7f95a38d9e00 1 -- start start 2026-02-20T13:30:56.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.253+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8180 0x5572563b8550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.253+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572563fd400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 0x55725641dd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572562ce7d0 con 0x5572563b8180 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5572562ca500 con 0x5572563b8a90 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5572562c44a0 con 0x5572563fd940 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8180 0x5572563b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572563fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572563fd400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58098/0 (socket says 10.20.193.28:58098) 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959a7fc640 1 -- 10.20.193.28:0/2596591864 learned_addr learned my addr 10.20.193.28:0/2596591864 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959b7fe640 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 0x55725641dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959affd640 1 -- 10.20.193.28:0/2596591864 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 msgr2=0x55725641dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:56.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959affd640 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 0x55725641dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959affd640 1 -- 10.20.193.28:0/2596591864 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 msgr2=0x5572563fd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959affd640 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572563fd400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959affd640 1 -- 10.20.193.28:0/2596591864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55725626fd80 con 0x5572563b8180 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959a7fc640 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572563fd400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.254+0000 7f959affd640 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8180 0x5572563b8550 secure :-1 s=READY pgs=1444 gs=1 cs=0 l=1 c_cookie=16302921996794425820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95900043e0 tx=0x7f9590004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23f9d2df3d571dc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f955ffff640 1 -- 10.20.193.28:0/2596591864 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9590011990 con 0x5572563b8180 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f955ffff640 1 -- 10.20.193.28:0/2596591864 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9590002860 con 0x5572563b8180 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f955ffff640 1 -- 10.20.193.28:0/2596591864 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9590003620 con 0x5572563b8180 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2596591864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8180 msgr2=0x5572563b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8180 0x5572563b8550 secure :-1 s=READY pgs=1444 gs=1 cs=0 l=1 c_cookie=16302921996794425820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95900043e0 tx=0x7f9590004050 comp rx=0 tx=0).stop 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2596591864 shutdown_connections 2026-02-20T13:30:56.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 0x55725641dd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572563fd400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2596591864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8180 0x5572563b8550 unknown :-1 s=CLOSED pgs=1444 gs=1 cs=0 l=1 c_cookie=16302921996794425820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2596591864 >> 10.20.193.28:0/2596591864 conn(0x557256396680 msgr2=0x5572563b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:56.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2596591864 shutdown_connections 2026-02-20T13:30:56.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.255+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2596591864 wait complete. 2026-02-20T13:30:56.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.256+0000 7f95a38d9e00 1 -- start start 2026-02-20T13:30:56.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f95a38d9e00 1 Processor -- start 2026-02-20T13:30:56.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x5572564150c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8a90 0x557256415600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x55725641a5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55725641ab30 con 0x5572563fd940 2026-02-20T13:30:56.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55725641aca0 con 0x5572563b8180 2026-02-20T13:30:56.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55725641ae60 con 0x5572563b8a90 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x5572564150c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8a90 0x557256415600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8a90 0x557256415600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:38202/0 (socket says 10.20.193.28:38202) 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959a7fc640 1 -- 10.20.193.28:0/1013383149 learned_addr learned my addr 10.20.193.28:0/1013383149 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959b7fe640 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x55725641a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959b7fe640 1 -- 10.20.193.28:0/1013383149 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8a90 msgr2=0x557256415600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959b7fe640 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8a90 0x557256415600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959b7fe640 1 -- 10.20.193.28:0/1013383149 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 msgr2=0x5572564150c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959b7fe640 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x5572564150c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.257+0000 7f959b7fe640 1 -- 10.20.193.28:0/1013383149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9590003910 con 0x5572563fd940 2026-02-20T13:30:56.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f959b7fe640 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x55725641a5f0 secure :-1 s=READY pgs=1445 gs=3 cs=0 l=1 c_cookie=12208119584726566502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f958c0addf0 tx=0x7f958c0afd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96bf414b71dc666 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f955d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f955d7fa640 1 -- 10.20.193.28:0/1013383149 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f958c0b89a0 con 0x5572563fd940 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f955d7fa640 1 -- 10.20.193.28:0/1013383149 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f958c0ad380 con 0x5572563fd940 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f955d7fa640 1 -- 10.20.193.28:0/1013383149 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f958c0abb60 con 0x5572563fd940 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c17ab90 con 0x5572563fd940 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f955d7fa640 1 -- 10.20.193.28:0/1013383149 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f958c0abcc0 con 0x5572563fd940 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f955d7fa640 10 client.20463 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f95a38d9e00 10 client.20463 _ll_register_callbacks cb 0x5572562459a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557255f5a6f0 con 0x5572563fd940 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f955d7fa640 1 -- 10.20.193.28:0/1013383149 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f958c0e5110 con 0x5572563fd940 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f95a38d9e00 10 client.20463 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:56.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.258+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557256248350 con 0x5572563fd940 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.259+0000 7f955d7fa640 1 -- 10.20.193.28:0/1013383149 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f958c0af4c0 con 0x5572563fd940 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.259+0000 7f95a38d9e00 10 client.20463 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.259+0000 7f95a38d9e00 10 client.20463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.259+0000 7f95a38d9e00 20 client.20463 populate_metadata read hostname 'trial028' 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.259+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5572563fa9c0 0x5572563fae30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.259+0000 7f95a38d9e00 4 client.20463 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.259+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572562d1d60 con 0x5572563fa9c0 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.259+0000 7f959affd640 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5572563fa9c0 0x5572563fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.260+0000 7f959affd640 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5572563fa9c0 0x5572563fae30 crc :-1 s=READY pgs=394 gs=4 cs=0 l=0 c_cookie=5241101000044137434 s_cookie=2559430566935504287 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48bc21974b934bda server_cookie=2384ec8a4977a59f in_seq=0 out_seq=0 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.260+0000 7f955d7fa640 10 client.20463 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.260+0000 7f955d7fa640 1 -- 10.20.193.28:0/1013383149 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5572562d1d60 con 0x5572563fa9c0 2026-02-20T13:30:56.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.260+0000 7f955d7fa640 10 client.20463 handle_command_reply: tid=0 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.260+0000 7f95a38d9e00 1 client.20463 shutdown 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 msgr2=0x55725641a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x55725641a5f0 secure :-1 s=READY pgs=1445 gs=3 cs=0 l=1 c_cookie=12208119584726566502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f958c0addf0 tx=0x7f958c0afd10 comp rx=0 tx=0).stop 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 shutdown_connections 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5572563fa9c0 0x5572563fae30 crc :-1 s=READY pgs=394 gs=4 cs=0 l=0 c_cookie=5241101000044137434 s_cookie=2559430566935504287 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x55725641a5f0 unknown :-1 s=CLOSED pgs=1445 gs=3 cs=0 l=1 c_cookie=12208119584726566502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8a90 0x557256415600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/1013383149 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x5572564150c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 >> 10.20.193.28:0/1013383149 conn(0x557256396680 msgr2=0x5572563b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f955d7fa640 0 client.20463 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 shutdown_connections 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 1 -- 10.20.193.28:0/1013383149 wait complete. 2026-02-20T13:30:56.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.261+0000 7f95a38d9e00 20 client.20463 trim_cache size 0 max 16384 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f95a38d9e00 1 Processor -- start 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f95a38d9e00 1 -- start start 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8180 0x5572564123b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572564128f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x5572563f85a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572562c20d0 con 0x5572563fd940 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557255f82700 con 0x5572563b8a90 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5572563b8790 con 0x5572563b8180 2026-02-20T13:30:56.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f959b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x5572563f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f959b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x5572563f85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50014/0 (socket says 10.20.193.28:50014) 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f959b7fe640 1 -- 10.20.193.28:0/3307868715 learned_addr learned my addr 10.20.193.28:0/3307868715 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.270+0000 7f959a7fc640 1 --2- 10.20.193.28:0/3307868715 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572564128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f959b7fe640 1 -- 10.20.193.28:0/3307868715 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8180 msgr2=0x5572564123b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f959b7fe640 1 --2- 10.20.193.28:0/3307868715 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8180 0x5572564123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f959b7fe640 1 -- 10.20.193.28:0/3307868715 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 msgr2=0x5572564128f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f959b7fe640 1 --2- 10.20.193.28:0/3307868715 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572564128f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f959b7fe640 1 -- 10.20.193.28:0/3307868715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557256407890 con 0x5572563fd940 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f959b7fe640 1 --2- 10.20.193.28:0/3307868715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x5572563f85a0 secure :-1 s=READY pgs=1446 gs=1 cs=0 l=1 c_cookie=1576048956895390744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f958c006df0 tx=0x7f958c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15df402d105fec18 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f955f7fe640 1 -- 10.20.193.28:0/3307868715 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f958c0e5110 con 0x5572563fd940 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f955f7fe640 1 -- 10.20.193.28:0/3307868715 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557255f5a6f0 con 0x5572563fd940 2026-02-20T13:30:56.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f955f7fe640 1 -- 10.20.193.28:0/3307868715 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f958c0b3630 con 0x5572563fd940 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 -- 10.20.193.28:0/3307868715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 msgr2=0x5572563f85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/3307868715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x5572563f85a0 secure :-1 s=READY pgs=1446 gs=1 cs=0 l=1 c_cookie=1576048956895390744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f958c006df0 tx=0x7f958c005040 comp rx=0 tx=0).stop 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 -- 10.20.193.28:0/3307868715 shutdown_connections 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/3307868715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563fd940 0x5572563f85a0 unknown :-1 s=CLOSED pgs=1446 gs=1 cs=0 l=1 c_cookie=1576048956895390744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/3307868715 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8a90 0x5572564128f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/3307868715 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563b8180 0x5572564123b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 -- 10.20.193.28:0/3307868715 >> 10.20.193.28:0/3307868715 conn(0x557256396680 msgr2=0x557256411ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 -- 10.20.193.28:0/3307868715 shutdown_connections 2026-02-20T13:30:56.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.271+0000 7f95a38d9e00 1 -- 10.20.193.28:0/3307868715 wait complete. 2026-02-20T13:30:56.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f95a38d9e00 1 -- start start 2026-02-20T13:30:56.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f95a38d9e00 1 Processor -- start 2026-02-20T13:30:56.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x557256398930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8a90 0x557256398e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f95a38d9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 0x557256454860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572562c20d0 con 0x5572563b8a90 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557255f82700 con 0x5572563b8180 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f95a38d9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557256454e80 con 0x5572563fd940 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f959affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x557256398930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f959affd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x557256398930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:58122/0 (socket says 10.20.193.28:58122) 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f959affd640 1 -- 10.20.193.28:0/2333800163 learned_addr learned my addr 10.20.193.28:0/2333800163 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.272+0000 7f959b7fe640 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 0x557256454860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f959a7fc640 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8a90 0x557256398e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f959affd640 1 -- 10.20.193.28:0/2333800163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 msgr2=0x557256454860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:56.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f959affd640 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 0x557256454860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f959affd640 1 -- 10.20.193.28:0/2333800163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8a90 msgr2=0x557256398e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f959affd640 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8a90 0x557256398e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f959affd640 1 -- 10.20.193.28:0/2333800163 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55725625a150 con 0x5572563b8180 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f959affd640 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x557256398930 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=11320244067283634773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9590004020 tx=0x7f9590002720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d199600812a0a55 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f955d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.273+0000 7f955d7fa640 1 -- 10.20.193.28:0/2333800163 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f959002a040 con 0x5572563b8180 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f955d7fa640 1 -- 10.20.193.28:0/2333800163 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f959002b040 con 0x5572563b8180 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f955d7fa640 1 -- 10.20.193.28:0/2333800163 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95900054f0 con 0x5572563b8180 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557256248350 con 0x5572563b8180 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 10 client.30383 _ll_register_callbacks cb 0x5572562459a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:30:56.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9590002860 con 0x5572563b8180 2026-02-20T13:30:56.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f955d7fa640 1 -- 10.20.193.28:0/2333800163 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9590005680 con 0x5572563b8180 2026-02-20T13:30:56.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f955d7fa640 1 -- 10.20.193.28:0/2333800163 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f95900330d0 con 0x5572563b8180 2026-02-20T13:30:56.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 10 client.30383 fetch_fsmap learned FSMap version 30 2026-02-20T13:30:56.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557256254bd0 con 0x5572563b8180 2026-02-20T13:30:56.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f955d7fa640 1 -- 10.20.193.28:0/2333800163 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f959003a020 con 0x5572563b8180 2026-02-20T13:30:56.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 10 client.30383 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:30:56.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 10 client.30383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:30:56.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 20 client.30383 populate_metadata read hostname 'trial028' 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557256456b20 0x557256456fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 4 client.30383 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.274+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557255f57f40 con 0x557256456b20 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.275+0000 7f959a7fc640 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557256456b20 0x557256456fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.275+0000 7f959a7fc640 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557256456b20 0x557256456fc0 crc :-1 s=READY pgs=395 gs=4 cs=0 l=0 c_cookie=1869490131897709242 s_cookie=10673219998566364766 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19f1c35eb6dc72ba server_cookie=941ee50a2024b65e in_seq=0 out_seq=0 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.275+0000 7f955d7fa640 10 client.30383 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.275+0000 7f955d7fa640 1 -- 10.20.193.28:0/2333800163 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7102 (crc 0 0 0) 0x557255f57f40 con 0x557256456b20 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.275+0000 7f955d7fa640 10 client.30383 handle_command_reply: tid=0 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 client.30383 shutdown 2026-02-20T13:30:56.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 msgr2=0x557256398930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x557256398930 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=11320244067283634773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9590004020 tx=0x7f9590002720 comp rx=0 tx=0).stop 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 shutdown_connections 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557256456b20 0x557256456fc0 crc :-1 s=READY pgs=395 gs=4 cs=0 l=0 c_cookie=1869490131897709242 s_cookie=10673219998566364766 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572563b8a90 0x557256398e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5572563fd940 0x557256454860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 --2- 10.20.193.28:0/2333800163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5572563b8180 0x557256398930 unknown :-1 s=CLOSED pgs=496 gs=1 cs=0 l=1 c_cookie=11320244067283634773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f955d7fa640 0 client.30383 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 >> 10.20.193.28:0/2333800163 conn(0x557256396680 msgr2=0x5572564123b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 shutdown_connections 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 1 -- 10.20.193.28:0/2333800163 wait complete. 2026-02-20T13:30:56.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.276+0000 7f95a38d9e00 20 client.30383 trim_cache size 0 max 16384 2026-02-20T13:30:56.285 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:30:56.285 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:30:56.285 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:30:56.285 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "07bb91cb-dd88-47e7-8303-84c9b1588bc6", 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.286 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.287 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:30:56.288 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.291 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:55.786578+0000", 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.292 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.293 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.294 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.295 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.296 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.297 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:30:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.277+0000 7f95a18df640 1 -- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95700b5760 msgr2=0x7f95700d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.277+0000 7f95a18df640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95700b5760 0x7f95700d5c10 secure :-1 s=READY pgs=596 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9590005b30 tx=0x7f9590009310 comp rx=0 tx=0).stop 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.277+0000 7f95a18df640 1 -- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f959c111020 msgr2=0x7f959c127320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.277+0000 7f95a18df640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f959c111020 0x7f959c127320 secure :-1 s=READY pgs=1443 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f958c006e90 tx=0x7f958c00edf0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.278+0000 7f95a18df640 1 -- 10.20.193.28:0/880296802 shutdown_connections 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.279+0000 7f95a18df640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f95700b5760 0x7f95700d5c10 unknown :-1 s=CLOSED pgs=596 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.279+0000 7f95a18df640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f959c111020 0x7f959c127320 unknown :-1 s=CLOSED pgs=1443 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.279+0000 7f95a18df640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f959c10c430 0x7f959c121f50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.279+0000 7f95a18df640 1 --2- 10.20.193.28:0/880296802 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f959c10ba40 0x7f959c121a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.279+0000 7f95a18df640 1 -- 10.20.193.28:0/880296802 >> 10.20.193.28:0/880296802 conn(0x7f959c0e9670 msgr2=0x7f959c109a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.279+0000 7f95a18df640 1 -- 10.20.193.28:0/880296802 shutdown_connections 2026-02-20T13:30:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:30:56.279+0000 7f95a18df640 1 -- 10.20.193.28:0/880296802 wait complete. 2026-02-20T13:30:56.377 INFO:tasks.cephfs.filesystem:scrub status for tag:07bb91cb-dd88-47e7-8303-84c9b1588bc6 - {'path': '/', 'tag': '07bb91cb-dd88-47e7-8303-84c9b1588bc6', 'options': 'recursive,force'} 2026-02-20T13:30:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: pgmap v589: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:30:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:30:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:30:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:30:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:30:56.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:56 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: pgmap v589: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:30:56.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:30:56.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:30:56.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:30:56.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:30:56.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:56 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: pgmap v589: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:30:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:30:56.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:30:56.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:30:56.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:30:56.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:56.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:56 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:30:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:30:58 trial028 ceph-mon[37442]: pgmap v590: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 18 op/s 2026-02-20T13:30:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:30:58 trial127 ceph-mon[43817]: pgmap v590: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 18 op/s 2026-02-20T13:30:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:30:58 trial034 ceph-mon[43332]: pgmap v590: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 18 op/s 2026-02-20T13:31:00.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:00 trial028 ceph-mon[37442]: pgmap v591: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 -- 10.20.193.28:0/2903103727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d810b900 msgr2=0x7ff1d810bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 --2- 10.20.193.28:0/2903103727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d810b900 0x7ff1d810bd70 secure :-1 s=READY pgs=1447 gs=1 cs=0 l=1 c_cookie=16618779004866583522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1c0009950 tx=0x7ff1c002f190 comp rx=0 tx=0).stop 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 -- 10.20.193.28:0/2903103727 shutdown_connections 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 --2- 10.20.193.28:0/2903103727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d810b900 0x7ff1d810bd70 unknown :-1 s=CLOSED pgs=1447 gs=1 cs=0 l=1 c_cookie=16618779004866583522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 --2- 10.20.193.28:0/2903103727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff1d810c490 0x7ff1d810c910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 --2- 10.20.193.28:0/2903103727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1d80609a0 0x7ff1d810b2e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 -- 10.20.193.28:0/2903103727 >> 10.20.193.28:0/2903103727 conn(0x7ff1d80e8f40 msgr2=0x7ff1d8109350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 -- 10.20.193.28:0/2903103727 shutdown_connections 2026-02-20T13:31:00.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.912+0000 7ff1dd883640 1 -- 10.20.193.28:0/2903103727 wait complete. 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd883640 1 Processor -- start 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd883640 1 -- start start 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd883640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d80609a0 0x7ff1d80f47e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd883640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff1d810b900 0x7ff1d80f4e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd883640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1d810c490 0x7ff1d80f59e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd883640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80f6120 con 0x7ff1d80609a0 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd883640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80f6290 con 0x7ff1d810b900 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd883640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80f6450 con 0x7ff1d810c490 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dc881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d80609a0 0x7ff1d80f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dc881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d80609a0 0x7ff1d80f47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42242/0 (socket says 10.20.193.28:42242) 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dc881640 1 -- 10.20.193.28:0/1013193213 learned_addr learned my addr 10.20.193.28:0/1013193213 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:00.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1cffff640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff1d810b900 0x7ff1d80f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dd082640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1d810c490 0x7ff1d80f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dc881640 1 -- 10.20.193.28:0/1013193213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1d810c490 msgr2=0x7ff1d80f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dc881640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1d810c490 0x7ff1d80f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dc881640 1 -- 10.20.193.28:0/1013193213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff1d810b900 msgr2=0x7ff1d80f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dc881640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff1d810b900 0x7ff1d80f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.913+0000 7ff1dc881640 1 -- 10.20.193.28:0/1013193213 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c0009570 con 0x7ff1d80609a0 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.914+0000 7ff1dc881640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d80609a0 0x7ff1d80f47e0 secure :-1 s=READY pgs=1448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1c8009480 tx=0x7ff1c800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.914+0000 7ff1cdffb640 1 -- 10.20.193.28:0/1013193213 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1c800cd40 con 0x7ff1d80609a0 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.914+0000 7ff1cdffb640 1 -- 10.20.193.28:0/1013193213 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff1c8004d30 con 0x7ff1d80609a0 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.914+0000 7ff1cdffb640 1 -- 10.20.193.28:0/1013193213 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1c8010740 con 0x7ff1d80609a0 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.914+0000 7ff1dd883640 1 -- 10.20.193.28:0/1013193213 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d80f6730 con 0x7ff1d80609a0 2026-02-20T13:31:00.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.914+0000 7ff1dd883640 1 -- 10.20.193.28:0/1013193213 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d80f6c50 con 0x7ff1d80609a0 2026-02-20T13:31:00.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.917+0000 7ff1cdffb640 1 -- 10.20.193.28:0/1013193213 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff1c801f060 con 0x7ff1d80609a0 2026-02-20T13:31:00.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.918+0000 7ff1cdffb640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff1b40b5760 0x7ff1b40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.918+0000 7ff1cdffb640 1 -- 10.20.193.28:0/1013193213 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff1c8014070 con 0x7ff1d80609a0 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1e11d9e00 1 Processor -- start 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1cffff640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff1b40b5760 0x7ff1b40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1e11d9e00 1 -- start start 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060e18a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 0x55fb061021c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb06122ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fb05fd6fd0 con 0x55fb06102700 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fb05fd2d00 con 0x55fb060e1de0 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fb05fccca0 con 0x55fb060c14c0 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1dc881640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060e18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1dd082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb06122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1cffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 0x55fb061021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1dc881640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060e18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35042/0 (socket says 10.20.193.28:35042) 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1dc881640 1 -- 10.20.193.28:0/4105737981 learned_addr learned my addr 10.20.193.28:0/4105737981 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.919+0000 7ff1cffff640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff1b40b5760 0x7ff1b40d5c10 secure :-1 s=READY pgs=598 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1c0002d80 tx=0x7ff1c003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1dd082640 1 -- 10.20.193.28:0/4105737981 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 msgr2=0x55fb060e18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1dd082640 1 --2- 10.20.193.28:0/4105737981 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060e18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1dd082640 1 -- 10.20.193.28:0/4105737981 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 msgr2=0x55fb061021c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1dd082640 1 --2- 10.20.193.28:0/4105737981 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 0x55fb061021c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1dd082640 1 -- 10.20.193.28:0/4105737981 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb05f6f8b0 con 0x55fb06102700 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1dc881640 1 --2- 10.20.193.28:0/4105737981 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060e18a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1dd082640 1 --2- 10.20.193.28:0/4105737981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb06122ae0 secure :-1 s=READY pgs=1449 gs=2 cs=0 l=1 c_cookie=557579313329070856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d4005540 tx=0x7ff1d4003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bceb6e6915e308 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1a4ffe640 1 -- 10.20.193.28:0/4105737981 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1d4003d70 con 0x55fb06102700 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1a4ffe640 1 -- 10.20.193.28:0/4105737981 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff1d400ace0 con 0x55fb06102700 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1a4ffe640 1 -- 10.20.193.28:0/4105737981 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1d40118e0 con 0x55fb06102700 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/4105737981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 msgr2=0x55fb06122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/4105737981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb06122ae0 secure :-1 s=READY pgs=1449 gs=2 cs=0 l=1 c_cookie=557579313329070856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d4005540 tx=0x7ff1d4003c30 comp rx=0 tx=0).stop 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/4105737981 shutdown_connections 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/4105737981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb06122ae0 unknown :-1 s=CLOSED pgs=1449 gs=2 cs=0 l=1 c_cookie=557579313329070856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/4105737981 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 0x55fb061021c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/4105737981 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060e18a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/4105737981 >> 10.20.193.28:0/4105737981 conn(0x55fb05fe01c0 msgr2=0x55fb060bfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/4105737981 shutdown_connections 2026-02-20T13:31:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.920+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/4105737981 wait complete. 2026-02-20T13:31:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1e11d9e00 1 -- start start 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1e11d9e00 1 Processor -- start 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060daad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 0x55fb060db120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060dbb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fb060dc1e0 con 0x55fb06102700 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fb060dc350 con 0x55fb060e1de0 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fb060dc510 con 0x55fb060c14c0 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1cffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 0x55fb060db120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1dd082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1dc881640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1dd082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060dbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42268/0 (socket says 10.20.193.28:42268) 2026-02-20T13:31:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.922+0000 7ff1dd082640 1 -- 10.20.193.28:0/1391162206 learned_addr learned my addr 10.20.193.28:0/1391162206 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1dd082640 1 -- 10.20.193.28:0/1391162206 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 msgr2=0x55fb060daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1dd082640 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1dd082640 1 -- 10.20.193.28:0/1391162206 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 msgr2=0x55fb060db120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1dd082640 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 0x55fb060db120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1dd082640 1 -- 10.20.193.28:0/1391162206 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb05f78400 con 0x55fb06102700 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1dd082640 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060dbb80 secure :-1 s=READY pgs=1450 gs=2 cs=0 l=1 c_cookie=1612343969428801592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d4011450 tx=0x7ff1d40037f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1660324c318c0838 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff19dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff19dffb640 1 -- 10.20.193.28:0/1391162206 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1d401bd70 con 0x55fb06102700 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff19dffb640 1 -- 10.20.193.28:0/1391162206 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff1d4020040 con 0x55fb06102700 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d40051e0 con 0x55fb06102700 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff19dffb640 1 -- 10.20.193.28:0/1391162206 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1d4005dd0 con 0x55fb06102700 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1e11d9e00 10 client.20481 _ll_register_callbacks cb 0x55fb05f57a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb05c6c520 con 0x55fb06102700 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff19dffb640 1 -- 10.20.193.28:0/1391162206 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff1d401b440 con 0x55fb06102700 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff19dffb640 1 -- 10.20.193.28:0/1391162206 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff1d401b600 con 0x55fb06102700 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1e11d9e00 10 client.20481 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.923+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55fb05f50da0 con 0x55fb06102700 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff19dffb640 1 -- 10.20.193.28:0/1391162206 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff1d4011c80 con 0x55fb06102700 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff1e11d9e00 10 client.20481 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff1e11d9e00 10 client.20481 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff1e11d9e00 20 client.20481 populate_metadata read hostname 'trial028' 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fb060df100 0x55fb060df5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff1e11d9e00 4 client.20481 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb05ffe630 con 0x55fb060df100 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff1dc881640 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fb060df100 0x55fb060df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff1dc881640 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fb060df100 0x55fb060df5a0 crc :-1 s=READY pgs=396 gs=4 cs=0 l=0 c_cookie=5970510178405021015 s_cookie=5523509266913469918 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52db835fc7af7557 server_cookie=4ca77269d7f4a5de in_seq=0 out_seq=0 2026-02-20T13:31:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.924+0000 7ff19dffb640 10 client.20481 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff19dffb640 1 -- 10.20.193.28:0/1391162206 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fb05ffe630 con 0x55fb060df100 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff19dffb640 10 client.20481 handle_command_reply: tid=0 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 client.20481 shutdown 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 msgr2=0x55fb060dbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060dbb80 secure :-1 s=READY pgs=1450 gs=2 cs=0 l=1 c_cookie=1612343969428801592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d4011450 tx=0x7ff1d40037f0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 shutdown_connections 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fb060df100 0x55fb060df5a0 crc :-1 s=READY pgs=396 gs=4 cs=0 l=0 c_cookie=5970510178405021015 s_cookie=5523509266913469918 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060dbb80 unknown :-1 s=CLOSED pgs=1450 gs=2 cs=0 l=1 c_cookie=1612343969428801592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060e1de0 0x55fb060db120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1391162206 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060c14c0 0x55fb060daad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 >> 10.20.193.28:0/1391162206 conn(0x55fb05fe01c0 msgr2=0x55fb060c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff19dffb640 0 client.20481 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 shutdown_connections 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1391162206 wait complete. 2026-02-20T13:31:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.925+0000 7ff1e11d9e00 20 client.20481 trim_cache size 0 max 16384 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1e11d9e00 1 Processor -- start 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1e11d9e00 1 -- start start 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060cc970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 0x55fb060d7e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060d8340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fb05fca8d0 con 0x55fb06102700 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fb05d0bf10 con 0x55fb060c14c0 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fb060bfcc0 con 0x55fb060e1de0 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dc881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dd082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060d8340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dc881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:56006/0 (socket says 10.20.193.28:56006) 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1cffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 0x55fb060d7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dc881640 1 -- 10.20.193.28:0/3917220075 learned_addr learned my addr 10.20.193.28:0/3917220075 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dc881640 1 -- 10.20.193.28:0/3917220075 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 msgr2=0x55fb060d7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:00.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dc881640 1 --2- 10.20.193.28:0/3917220075 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 0x55fb060d7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dc881640 1 -- 10.20.193.28:0/3917220075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 msgr2=0x55fb060d8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dc881640 1 --2- 10.20.193.28:0/3917220075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060d8340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dc881640 1 -- 10.20.193.28:0/3917220075 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb060cd140 con 0x55fb060c14c0 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.933+0000 7ff1dd082640 1 --2- 10.20.193.28:0/3917220075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060d8340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1dc881640 1 --2- 10.20.193.28:0/3917220075 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060cc970 secure :-1 s=READY pgs=497 gs=1 cs=0 l=1 c_cookie=6364866862205918649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1c80093c0 tx=0x7ff1c8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58548cb04c705db9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff19ffff640 1 -- 10.20.193.28:0/3917220075 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1c80b2db0 con 0x55fb060c14c0 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff19ffff640 1 -- 10.20.193.28:0/3917220075 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff1c80b5390 con 0x55fb060c14c0 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff19ffff640 1 -- 10.20.193.28:0/3917220075 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1c80af1d0 con 0x55fb060c14c0 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/3917220075 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 msgr2=0x55fb060cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/3917220075 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060cc970 secure :-1 s=READY pgs=497 gs=1 cs=0 l=1 c_cookie=6364866862205918649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1c80093c0 tx=0x7ff1c8004040 comp rx=0 tx=0).stop 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/3917220075 shutdown_connections 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/3917220075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060d8340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/3917220075 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 0x55fb060d7e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/3917220075 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060cc970 unknown :-1 s=CLOSED pgs=497 gs=1 cs=0 l=1 c_cookie=6364866862205918649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/3917220075 >> 10.20.193.28:0/3917220075 conn(0x55fb05fe01c0 msgr2=0x55fb060da960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/3917220075 shutdown_connections 2026-02-20T13:31:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.934+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/3917220075 wait complete. 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1e11d9e00 1 -- start start 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1e11d9e00 1 Processor -- start 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060e3740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 0x55fb060e3de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1e11d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060e49b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fb060e50b0 con 0x55fb06102700 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55fb060e5220 con 0x55fb060c14c0 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1e11d9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55fb060e53e0 con 0x55fb060e1de0 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1dd082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1dd082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060e49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42278/0 (socket says 10.20.193.28:42278) 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1dd082640 1 -- 10.20.193.28:0/1266993817 learned_addr learned my addr 10.20.193.28:0/1266993817 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1dc881640 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.935+0000 7ff1cffff640 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 0x55fb060e3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1dd082640 1 -- 10.20.193.28:0/1266993817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 msgr2=0x55fb060e3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1dd082640 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 0x55fb060e3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1dd082640 1 -- 10.20.193.28:0/1266993817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 msgr2=0x55fb060e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1dd082640 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060e3740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1dd082640 1 -- 10.20.193.28:0/1266993817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d80f6730 con 0x55fb06102700 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1dd082640 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060e49b0 secure :-1 s=READY pgs=1451 gs=1 cs=0 l=1 c_cookie=11791588908619361065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d4005540 tx=0x7ff1d402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a423a34bb16b29 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff19dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff19dffb640 1 -- 10.20.193.28:0/1266993817 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1d401b660 con 0x55fb06102700 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff19dffb640 1 -- 10.20.193.28:0/1266993817 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff1d4020040 con 0x55fb06102700 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb05f50da0 con 0x55fb06102700 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 10 client.20487 _ll_register_callbacks cb 0x55fb05f57a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff19dffb640 1 -- 10.20.193.28:0/1266993817 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1d400f640 con 0x55fb06102700 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb0607cca0 con 0x55fb06102700 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff19dffb640 1 -- 10.20.193.28:0/1266993817 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff1d402d7a0 con 0x55fb06102700 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff19dffb640 1 -- 10.20.193.28:0/1266993817 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff1d402d980 con 0x55fb06102700 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 10 client.20487 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:00.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55fb05f62670 con 0x55fb06102700 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff19dffb640 1 -- 10.20.193.28:0/1266993817 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff1d4042060 con 0x55fb06102700 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 10 client.20487 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 10 client.20487 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 20 client.20487 populate_metadata read hostname 'trial028' 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.936+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fb060e6da0 0x55fb060e7240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.937+0000 7ff1e11d9e00 4 client.20487 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.937+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fb05cb0640 con 0x55fb060e6da0 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.937+0000 7ff1dc881640 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fb060e6da0 0x55fb060e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.937+0000 7ff1dc881640 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fb060e6da0 0x55fb060e7240 crc :-1 s=READY pgs=397 gs=4 cs=0 l=0 c_cookie=7450121639544189825 s_cookie=4607220095812614703 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67642628a27b7381 server_cookie=3ff022445cf3ba2f in_seq=0 out_seq=0 2026-02-20T13:31:00.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.937+0000 7ff19dffb640 10 client.20487 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:00.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.941+0000 7ff19dffb640 1 -- 10.20.193.28:0/1266993817 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fb05cb0640 con 0x55fb060e6da0 2026-02-20T13:31:00.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.941+0000 7ff19dffb640 10 client.20487 handle_command_reply: tid=0 2026-02-20T13:31:00.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.941+0000 7ff1e11d9e00 1 client.20487 shutdown 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 msgr2=0x55fb060e49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060e49b0 secure :-1 s=READY pgs=1451 gs=1 cs=0 l=1 c_cookie=11791588908619361065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d4005540 tx=0x7ff1d402c000 comp rx=0 tx=0).stop 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 shutdown_connections 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55fb060e6da0 0x55fb060e7240 crc :-1 s=READY pgs=397 gs=4 cs=0 l=0 c_cookie=7450121639544189825 s_cookie=4607220095812614703 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb06102700 0x55fb060e49b0 unknown :-1 s=CLOSED pgs=1451 gs=1 cs=0 l=1 c_cookie=11791588908619361065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55fb060e1de0 0x55fb060e3de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff19dffb640 0 client.20487 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 --2- 10.20.193.28:0/1266993817 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55fb060c14c0 0x55fb060e3740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 >> 10.20.193.28:0/1266993817 conn(0x55fb05fe01c0 msgr2=0x55fb060d6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 shutdown_connections 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 1 -- 10.20.193.28:0/1266993817 wait complete. 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1e11d9e00 20 client.20487 trim_cache size 0 max 16384 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:31:00.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 -- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff1b40b5760 msgr2=0x7ff1b40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff1b40b5760 0x7ff1b40d5c10 secure :-1 s=READY pgs=598 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1c0002d80 tx=0x7ff1c003a040 comp rx=0 tx=0).stop 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 -- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d80609a0 msgr2=0x7ff1d80f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d80609a0 0x7ff1d80f47e0 secure :-1 s=READY pgs=1448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1c8009480 tx=0x7ff1c800ee60 comp rx=0 tx=0).stop 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 -- 10.20.193.28:0/1013193213 shutdown_connections 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff1b40b5760 0x7ff1b40d5c10 unknown :-1 s=CLOSED pgs=598 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1d810c490 0x7ff1d80f59e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff1d810b900 0x7ff1d80f4e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 --2- 10.20.193.28:0/1013193213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1d80609a0 0x7ff1d80f47e0 unknown :-1 s=CLOSED pgs=1448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 -- 10.20.193.28:0/1013193213 >> 10.20.193.28:0/1013193213 conn(0x7ff1d80e8f40 msgr2=0x7ff1d80eabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 -- 10.20.193.28:0/1013193213 shutdown_connections 2026-02-20T13:31:00.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:00.942+0000 7ff1dd883640 1 -- 10.20.193.28:0/1013193213 wait complete. 2026-02-20T13:31:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:00 trial127 ceph-mon[43817]: pgmap v591: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2026-02-20T13:31:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:00 trial034 ceph-mon[43332]: pgmap v591: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2026-02-20T13:31:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:02 trial028 ceph-mon[37442]: pgmap v592: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2026-02-20T13:31:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:02 trial127 ceph-mon[43817]: pgmap v592: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2026-02-20T13:31:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:02 trial034 ceph-mon[43332]: pgmap v592: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2026-02-20T13:31:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:04 trial028 ceph-mon[37442]: pgmap v593: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2026-02-20T13:31:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:04 trial127 ceph-mon[43817]: pgmap v593: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2026-02-20T13:31:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:04 trial034 ceph-mon[43332]: pgmap v593: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2026-02-20T13:31:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:06 trial028 ceph-mon[37442]: pgmap v594: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2026-02-20T13:31:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:06 trial127 ceph-mon[43817]: pgmap v594: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2026-02-20T13:31:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:06 trial034 ceph-mon[43332]: pgmap v594: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2026-02-20T13:31:08.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:08 trial028 ceph-mon[37442]: pgmap v595: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2026-02-20T13:31:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:08 trial127 ceph-mon[43817]: pgmap v595: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2026-02-20T13:31:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:08 trial034 ceph-mon[43332]: pgmap v595: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2026-02-20T13:31:10.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:10 trial028 ceph-mon[37442]: pgmap v596: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:31:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:10 trial127 ceph-mon[43817]: pgmap v596: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:31:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:10 trial034 ceph-mon[43332]: pgmap v596: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2026-02-20T13:31:12.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:12 trial028 ceph-mon[37442]: pgmap v597: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:31:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:12 trial127 ceph-mon[43817]: pgmap v597: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:31:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:12 trial034 ceph-mon[43332]: pgmap v597: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 -- 10.20.193.28:0/4126012483 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 msgr2=0x7f54041104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 --2- 10.20.193.28:0/4126012483 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 0x7f54041104a0 secure :-1 s=READY pgs=1452 gs=2 cs=0 l=1 c_cookie=6430393668087350557 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f0009980 tx=0x7f53f002f190 comp rx=0 tx=0).stop 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 -- 10.20.193.28:0/4126012483 shutdown_connections 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 --2- 10.20.193.28:0/4126012483 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f540410f2f0 0x7f5404171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 --2- 10.20.193.28:0/4126012483 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f540410e940 0x7f540410edb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 --2- 10.20.193.28:0/4126012483 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 0x7f54041104a0 unknown :-1 s=CLOSED pgs=1452 gs=2 cs=0 l=1 c_cookie=6430393668087350557 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 -- 10.20.193.28:0/4126012483 >> 10.20.193.28:0/4126012483 conn(0x7f54040ec320 msgr2=0x7f540410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 -- 10.20.193.28:0/4126012483 shutdown_connections 2026-02-20T13:31:14.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.015+0000 7f5409643640 1 -- 10.20.193.28:0/4126012483 wait complete. 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5409643640 1 Processor -- start 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5409643640 1 -- start start 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5409643640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f540410e940 0x7f54040f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5409643640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f540410f2f0 0x7f5404171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5409643640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 0x7f54040f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5409643640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f54040f96a0 con 0x7f54041100b0 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5409643640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f54040f9810 con 0x7f540410e940 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5409643640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f54040f99d0 con 0x7f540410f2f0 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5403fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f540410e940 0x7f54040f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5408e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 0x7f54040f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f54037fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f540410f2f0 0x7f5404171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5408e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 0x7f54040f8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47874/0 (socket says 10.20.193.28:47874) 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5408e42640 1 -- 10.20.193.28:0/566644110 learned_addr learned my addr 10.20.193.28:0/566644110 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5408e42640 1 -- 10.20.193.28:0/566644110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f540410f2f0 msgr2=0x7f5404171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5408e42640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f540410f2f0 0x7f5404171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5408e42640 1 -- 10.20.193.28:0/566644110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f540410e940 msgr2=0x7f54040f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5408e42640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f540410e940 0x7f54040f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.016+0000 7f5408e42640 1 -- 10.20.193.28:0/566644110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f0009570 con 0x7f54041100b0 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.017+0000 7f5408e42640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 0x7f54040f8ab0 secure :-1 s=READY pgs=1453 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f8006e90 tx=0x7f53f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.017+0000 7f54017fa640 1 -- 10.20.193.28:0/566644110 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f8005500 con 0x7f54041100b0 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.017+0000 7f54017fa640 1 -- 10.20.193.28:0/566644110 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53f8005e10 con 0x7f54041100b0 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.017+0000 7f5409643640 1 -- 10.20.193.28:0/566644110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54040f9cb0 con 0x7f54041100b0 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.017+0000 7f54017fa640 1 -- 10.20.193.28:0/566644110 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f8003a90 con 0x7f54041100b0 2026-02-20T13:31:14.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.017+0000 7f5409643640 1 -- 10.20.193.28:0/566644110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54040fa1d0 con 0x7f54041100b0 2026-02-20T13:31:14.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.020+0000 7f54017fa640 1 -- 10.20.193.28:0/566644110 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f53f800c840 con 0x7f54041100b0 2026-02-20T13:31:14.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.022+0000 7f54017fa640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53d80b5760 0x7f53d80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.022+0000 7f54017fa640 1 -- 10.20.193.28:0/566644110 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f53f80e7740 con 0x7f54041100b0 2026-02-20T13:31:14.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.022+0000 7f5403fff640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53d80b5760 0x7f53d80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.022+0000 7f540cfcce00 1 Processor -- start 2026-02-20T13:31:14.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.022+0000 7f5403fff640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53d80b5760 0x7f53d80d5c10 secure :-1 s=READY pgs=600 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f0002d80 tx=0x7f53f003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:14.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.022+0000 7f540cfcce00 1 -- start start 2026-02-20T13:31:14.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.022+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a1f4c0 0x561f26a3f8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a601c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a80ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f540cfcce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561f26934fd0 con 0x561f26a3fde0 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f540cfcce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561f26930d00 con 0x561f26a1f4c0 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f540cfcce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561f2692aca0 con 0x561f26a60700 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47880/0 (socket says 10.20.193.28:47880) 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 -- 10.20.193.28:0/733461169 learned_addr learned my addr 10.20.193.28:0/733461169 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f5403fff640 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a1f4c0 0x561f26a3f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f5408e42640 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a80ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 -- 10.20.193.28:0/733461169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 msgr2=0x561f26a80ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a80ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 -- 10.20.193.28:0/733461169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a1f4c0 msgr2=0x561f26a3f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a1f4c0 0x561f26a3f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 -- 10.20.193.28:0/733461169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f268cd8b0 con 0x561f26a3fde0 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f5403fff640 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a1f4c0 0x561f26a3f8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f54037fe640 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a601c0 secure :-1 s=READY pgs=1454 gs=2 cs=0 l=1 c_cookie=16840302045416361305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f4007cb0 tx=0x7f53f40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b4c57c8f538d59 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f53d4bfe640 1 -- 10.20.193.28:0/733461169 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f40040d0 con 0x561f26a3fde0 2026-02-20T13:31:14.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.023+0000 7f53d4bfe640 1 -- 10.20.193.28:0/733461169 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53f4002b80 con 0x561f26a3fde0 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f53d4bfe640 1 -- 10.20.193.28:0/733461169 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f40118f0 con 0x561f26a3fde0 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 -- 10.20.193.28:0/733461169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 msgr2=0x561f26a601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a601c0 secure :-1 s=READY pgs=1454 gs=2 cs=0 l=1 c_cookie=16840302045416361305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f4007cb0 tx=0x7f53f40107a0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 -- 10.20.193.28:0/733461169 shutdown_connections 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a601c0 unknown :-1 s=CLOSED pgs=1454 gs=2 cs=0 l=1 c_cookie=16840302045416361305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a80ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 --2- 10.20.193.28:0/733461169 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a1f4c0 0x561f26a3f8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 -- 10.20.193.28:0/733461169 >> 10.20.193.28:0/733461169 conn(0x561f2693e1c0 msgr2=0x561f26a1dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 -- 10.20.193.28:0/733461169 shutdown_connections 2026-02-20T13:31:14.026 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.024+0000 7f540cfcce00 1 -- 10.20.193.28:0/733461169 wait complete. 2026-02-20T13:31:14.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.025+0000 7f540cfcce00 1 -- start start 2026-02-20T13:31:14.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f540cfcce00 1 Processor -- start 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a38b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a39190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a39bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f540cfcce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561f26a3a250 con 0x561f26a3fde0 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f540cfcce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561f26a3a3c0 con 0x561f26a60700 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f540cfcce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561f26a3a580 con 0x561f26a1f4c0 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f54037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a39190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f5403fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a38b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f5403fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a38b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:39356/0 (socket says 10.20.193.28:39356) 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f5403fff640 1 -- 10.20.193.28:0/256286749 learned_addr learned my addr 10.20.193.28:0/256286749 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f54037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a39190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47894/0 (socket says 10.20.193.28:47894) 2026-02-20T13:31:14.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f5408e42640 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a39bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f54037fe640 1 -- 10.20.193.28:0/256286749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 msgr2=0x561f26a38b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f54037fe640 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a38b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f54037fe640 1 -- 10.20.193.28:0/256286749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 msgr2=0x561f26a39bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f54037fe640 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a39bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.026+0000 7f54037fe640 1 -- 10.20.193.28:0/256286749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f268d6400 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f54037fe640 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a39190 secure :-1 s=READY pgs=1455 gs=2 cs=0 l=1 c_cookie=17599835694408620310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f4011480 tx=0x7f53f40075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43f2d50ee775916 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f53c5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f53c5ffb640 1 -- 10.20.193.28:0/256286749 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f4021070 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f53c5ffb640 1 -- 10.20.193.28:0/256286749 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53f40040d0 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f40078d0 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f53c5ffb640 1 -- 10.20.193.28:0/256286749 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f4002d90 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 10 client.20499 _ll_register_callbacks cb 0x561f268b5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f265ca520 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f53c5ffb640 1 -- 10.20.193.28:0/256286749 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f53f4026420 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f53c5ffb640 1 -- 10.20.193.28:0/256286749 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f53f4026620 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 10 client.20499 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561f268aeda0 con 0x561f26a3fde0 2026-02-20T13:31:14.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f53c5ffb640 1 -- 10.20.193.28:0/256286749 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f53f402d060 con 0x561f26a3fde0 2026-02-20T13:31:14.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 10 client.20499 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:14.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 10 client.20499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:14.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 20 client.20499 populate_metadata read hostname 'trial028' 2026-02-20T13:31:14.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561f26a3d160 0x561f26a3d600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 4 client.20499 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:14.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.027+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f2695c630 con 0x561f26a3d160 2026-02-20T13:31:14.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.028+0000 7f5403fff640 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561f26a3d160 0x561f26a3d600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.029+0000 7f53c5ffb640 10 client.20499 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:14.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.029+0000 7f5403fff640 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561f26a3d160 0x561f26a3d600 crc :-1 s=READY pgs=398 gs=4 cs=0 l=0 c_cookie=18176834197200207967 s_cookie=9913012399506907159 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc411665b94a805f server_cookie=8992184186a6e017 in_seq=0 out_seq=0 2026-02-20T13:31:14.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.029+0000 7f53c5ffb640 1 -- 10.20.193.28:0/256286749 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561f2695c630 con 0x561f26a3d160 2026-02-20T13:31:14.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.029+0000 7f53c5ffb640 10 client.20499 handle_command_reply: tid=0 2026-02-20T13:31:14.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.029+0000 7f540cfcce00 1 client.20499 shutdown 2026-02-20T13:31:14.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.029+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 msgr2=0x561f26a39190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.029+0000 7f540cfcce00 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a39190 secure :-1 s=READY pgs=1455 gs=2 cs=0 l=1 c_cookie=17599835694408620310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f4011480 tx=0x7f53f40075d0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 shutdown_connections 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561f26a3d160 0x561f26a3d600 crc :-1 s=READY pgs=398 gs=4 cs=0 l=0 c_cookie=18176834197200207967 s_cookie=9913012399506907159 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a39190 unknown :-1 s=CLOSED pgs=1455 gs=2 cs=0 l=1 c_cookie=17599835694408620310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f53c5ffb640 0 client.20499 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a39bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 1 --2- 10.20.193.28:0/256286749 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a38b40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 >> 10.20.193.28:0/256286749 conn(0x561f2693e1c0 msgr2=0x561f26a20790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 shutdown_connections 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 1 -- 10.20.193.28:0/256286749 wait complete. 2026-02-20T13:31:14.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.030+0000 7f540cfcce00 20 client.20499 trim_cache size 0 max 16384 2026-02-20T13:31:14.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.037+0000 7f540cfcce00 1 Processor -- start 2026-02-20T13:31:14.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.037+0000 7f540cfcce00 1 -- start start 2026-02-20T13:31:14.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.037+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a1f4c0 0x561f26a390c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.037+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a3fde0 0x561f26a35e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.037+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a363a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.037+0000 7f540cfcce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561f269288d0 con 0x561f26a1f4c0 2026-02-20T13:31:14.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.037+0000 7f540cfcce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561f26669f10 con 0x561f26a3fde0 2026-02-20T13:31:14.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.037+0000 7f540cfcce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561f26a26580 con 0x561f26a60700 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a1f4c0 0x561f26a390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f54037fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a3fde0 0x561f26a35e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a1f4c0 0x561f26a390c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47900/0 (socket says 10.20.193.28:47900) 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 -- 10.20.193.28:0/3858721643 learned_addr learned my addr 10.20.193.28:0/3858721643 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5408e42640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a363a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 -- 10.20.193.28:0/3858721643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 msgr2=0x561f26a363a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a363a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 -- 10.20.193.28:0/3858721643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a3fde0 msgr2=0x561f26a35e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a3fde0 0x561f26a35e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 -- 10.20.193.28:0/3858721643 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f268c0670 con 0x561f26a1f4c0 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f54037fe640 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a3fde0 0x561f26a35e60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5408e42640 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a363a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f5403fff640 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a1f4c0 0x561f26a390c0 secure :-1 s=READY pgs=1456 gs=3 cs=0 l=1 c_cookie=16773271254772590441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f0009980 tx=0x7f53f0043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c6a1566dfda769 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f53c7fff640 1 -- 10.20.193.28:0/3858721643 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f0057040 con 0x561f26a1f4c0 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f53c7fff640 1 -- 10.20.193.28:0/3858721643 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53f003e040 con 0x561f26a1f4c0 2026-02-20T13:31:14.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f53c7fff640 1 -- 10.20.193.28:0/3858721643 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f005b6b0 con 0x561f26a1f4c0 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f540cfcce00 1 -- 10.20.193.28:0/3858721643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a1f4c0 msgr2=0x561f26a390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.038+0000 7f540cfcce00 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a1f4c0 0x561f26a390c0 secure :-1 s=READY pgs=1456 gs=3 cs=0 l=1 c_cookie=16773271254772590441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f0009980 tx=0x7f53f0043000 comp rx=0 tx=0).stop 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 -- 10.20.193.28:0/3858721643 shutdown_connections 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a60700 0x561f26a363a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a3fde0 0x561f26a35e60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 --2- 10.20.193.28:0/3858721643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a1f4c0 0x561f26a390c0 unknown :-1 s=CLOSED pgs=1456 gs=3 cs=0 l=1 c_cookie=16773271254772590441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 -- 10.20.193.28:0/3858721643 >> 10.20.193.28:0/3858721643 conn(0x561f2693e1c0 msgr2=0x561f26a389b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 -- 10.20.193.28:0/3858721643 shutdown_connections 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 -- 10.20.193.28:0/3858721643 wait complete. 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 -- start start 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 Processor -- start 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a1c6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a1cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a40460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561f26a40b60 con 0x561f26a3fde0 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561f26a40cd0 con 0x561f26a60700 2026-02-20T13:31:14.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.039+0000 7f540cfcce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561f26a40e90 con 0x561f26a1f4c0 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a1cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a1cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47910/0 (socket says 10.20.193.28:47910) 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 -- 10.20.193.28:0/1736782428 learned_addr learned my addr 10.20.193.28:0/1736782428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f5408e42640 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a40460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f5403fff640 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a1c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 -- 10.20.193.28:0/1736782428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 msgr2=0x561f26a1c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a1c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 -- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 msgr2=0x561f26a40460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a40460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 -- 10.20.193.28:0/1736782428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f268bb0f0 con 0x561f26a3fde0 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f5408e42640 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a40460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f54037fe640 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a1cd90 secure :-1 s=READY pgs=1457 gs=1 cs=0 l=1 c_cookie=11058864766954024604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f4024720 tx=0x7f53f4005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9978fae9c560ae9c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f53c5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:14.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f53c5ffb640 1 -- 10.20.193.28:0/1736782428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f4021040 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f53c5ffb640 1 -- 10.20.193.28:0/1736782428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53f4033020 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f0004150 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f53c5ffb640 1 -- 10.20.193.28:0/1736782428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53f4021040 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f540cfcce00 10 client.20505 _ll_register_callbacks cb 0x561f268b5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f269daca0 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.040+0000 7f53c5ffb640 1 -- 10.20.193.28:0/1736782428 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f53f4034030 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f53c5ffb640 1 -- 10.20.193.28:0/1736782428 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f53f40116a0 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f540cfcce00 10 client.20505 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561f268af0d0 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f53c5ffb640 1 -- 10.20.193.28:0/1736782428 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f53f4024370 con 0x561f26a3fde0 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f540cfcce00 10 client.20505 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f540cfcce00 10 client.20505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f540cfcce00 20 client.20505 populate_metadata read hostname 'trial028' 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f540cfcce00 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561f26a42870 0x561f26a42d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f540cfcce00 4 client.20505 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561f2660e640 con 0x561f26a42870 2026-02-20T13:31:14.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.041+0000 7f5403fff640 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561f26a42870 0x561f26a42d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:14.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.042+0000 7f53c5ffb640 10 client.20505 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:14.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.042+0000 7f5403fff640 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561f26a42870 0x561f26a42d10 crc :-1 s=READY pgs=399 gs=4 cs=0 l=0 c_cookie=10191529743450224939 s_cookie=2768281471453911713 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d6f964dfc2db92b server_cookie=266ae954d04e5aa1 in_seq=0 out_seq=0 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f53c5ffb640 1 -- 10.20.193.28:0/1736782428 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561f2660e640 con 0x561f26a42870 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f53c5ffb640 10 client.20505 handle_command_reply: tid=0 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 client.20505 shutdown 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 msgr2=0x561f26a1cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a1cd90 secure :-1 s=READY pgs=1457 gs=1 cs=0 l=1 c_cookie=11058864766954024604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f4024720 tx=0x7f53f4005710 comp rx=0 tx=0).stop 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 shutdown_connections 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x561f26a42870 0x561f26a42d10 crc :-1 s=READY pgs=399 gs=4 cs=0 l=0 c_cookie=10191529743450224939 s_cookie=2768281471453911713 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561f26a3fde0 0x561f26a1cd90 unknown :-1 s=CLOSED pgs=1457 gs=1 cs=0 l=1 c_cookie=11058864766954024604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561f26a60700 0x561f26a40460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 --2- 10.20.193.28:0/1736782428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561f26a1f4c0 0x561f26a1c6f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 >> 10.20.193.28:0/1736782428 conn(0x561f2693e1c0 msgr2=0x561f26a38fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f53c5ffb640 0 client.20505 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 shutdown_connections 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 1 -- 10.20.193.28:0/1736782428 wait complete. 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f540cfcce00 20 client.20505 trim_cache size 0 max 16384 2026-02-20T13:31:14.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f5409643640 1 -- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53d80b5760 msgr2=0x7f53d80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f5409643640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53d80b5760 0x7f53d80d5c10 secure :-1 s=READY pgs=600 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f0002d80 tx=0x7f53f003a040 comp rx=0 tx=0).stop 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f5409643640 1 -- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 msgr2=0x7f54040f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.046+0000 7f5409643640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 0x7f54040f8ab0 secure :-1 s=READY pgs=1453 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f8006e90 tx=0x7f53f800edf0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.047+0000 7f5409643640 1 -- 10.20.193.28:0/566644110 shutdown_connections 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.047+0000 7f5409643640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f53d80b5760 0x7f53d80d5c10 unknown :-1 s=CLOSED pgs=600 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.047+0000 7f5409643640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f54041100b0 0x7f54040f8ab0 unknown :-1 s=CLOSED pgs=1453 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.047+0000 7f5409643640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f540410f2f0 0x7f5404171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.047+0000 7f5409643640 1 --2- 10.20.193.28:0/566644110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f540410e940 0x7f54040f8250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.047+0000 7f5409643640 1 -- 10.20.193.28:0/566644110 >> 10.20.193.28:0/566644110 conn(0x7f54040ec320 msgr2=0x7f54040ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.047+0000 7f5409643640 1 -- 10.20.193.28:0/566644110 shutdown_connections 2026-02-20T13:31:14.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:14.047+0000 7f5409643640 1 -- 10.20.193.28:0/566644110 wait complete. 2026-02-20T13:31:14.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:14 trial028 ceph-mon[37442]: pgmap v598: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:31:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:14 trial127 ceph-mon[43817]: pgmap v598: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:31:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:14 trial034 ceph-mon[43332]: pgmap v598: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2026-02-20T13:31:16.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:16 trial028 ceph-mon[37442]: pgmap v599: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 12 op/s 2026-02-20T13:31:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:16 trial127 ceph-mon[43817]: pgmap v599: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 12 op/s 2026-02-20T13:31:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:16 trial034 ceph-mon[43332]: pgmap v599: 97 pgs: 97 active+clean; 2.5 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 12 op/s 2026-02-20T13:31:18.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:18 trial028 ceph-mon[37442]: pgmap v600: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2026-02-20T13:31:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:18 trial127 ceph-mon[43817]: pgmap v600: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2026-02-20T13:31:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:18 trial034 ceph-mon[43332]: pgmap v600: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2026-02-20T13:31:20.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:20 trial028 ceph-mon[37442]: pgmap v601: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:20 trial127 ceph-mon[43817]: pgmap v601: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:20 trial034 ceph-mon[43332]: pgmap v601: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:21.882 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:31:22.070 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 -- 10.20.193.28:0/2382477226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c155980 msgr2=0x7f762c175d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 --2- 10.20.193.28:0/2382477226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c155980 0x7f762c175d60 secure :-1 s=READY pgs=1458 gs=1 cs=0 l=1 c_cookie=13856673858533393551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f762800aa30 tx=0x7f7628030270 comp rx=0 tx=0).stop 2026-02-20T13:31:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 -- 10.20.193.28:0/2382477226 shutdown_connections 2026-02-20T13:31:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 --2- 10.20.193.28:0/2382477226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c155980 0x7f762c175d60 unknown :-1 s=CLOSED pgs=1458 gs=1 cs=0 l=1 c_cookie=13856673858533393551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 --2- 10.20.193.28:0/2382477226 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f762c061840 0x7f762c155440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 --2- 10.20.193.28:0/2382477226 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f762c060f30 0x7f762c061300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 -- 10.20.193.28:0/2382477226 >> 10.20.193.28:0/2382477226 conn(0x7f762c0eaad0 msgr2=0x7f762c10aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 -- 10.20.193.28:0/2382477226 shutdown_connections 2026-02-20T13:31:22.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.253+0000 7f7632dee640 1 -- 10.20.193.28:0/2382477226 wait complete. 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7632dee640 1 Processor -- start 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7632dee640 1 -- start start 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7632dee640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c060f30 0x7f762c1620c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7632dee640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f762c061840 0x7f762c162600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7632dee640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f762c155980 0x7f762c1679d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7632dee640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f762c167ff0 con 0x7f762c060f30 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7632dee640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f762c168160 con 0x7f762c155980 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7632dee640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f762c168320 con 0x7f762c061840 2026-02-20T13:31:22.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7631dec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c060f30 0x7f762c1620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7631dec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c060f30 0x7f762c1620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36296/0 (socket says 10.20.193.28:36296) 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f76315eb640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f762c061840 0x7f762c162600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7631dec640 1 -- 10.20.193.28:0/3643903768 learned_addr learned my addr 10.20.193.28:0/3643903768 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f76325ed640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f762c155980 0x7f762c1679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7631dec640 1 -- 10.20.193.28:0/3643903768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f762c061840 msgr2=0x7f762c162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7631dec640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f762c061840 0x7f762c162600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7631dec640 1 -- 10.20.193.28:0/3643903768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f762c155980 msgr2=0x7f762c1679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.254+0000 7f7631dec640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f762c155980 0x7f762c1679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.255+0000 7f7631dec640 1 -- 10.20.193.28:0/3643903768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762800a650 con 0x7f762c060f30 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.255+0000 7f7631dec640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c060f30 0x7f762c1620c0 secure :-1 s=READY pgs=1459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f761c00d950 tx=0x7f761c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.255+0000 7f761affd640 1 -- 10.20.193.28:0/3643903768 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f761c004540 con 0x7f762c060f30 2026-02-20T13:31:22.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.255+0000 7f761affd640 1 -- 10.20.193.28:0/3643903768 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f761c009d00 con 0x7f762c060f30 2026-02-20T13:31:22.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.255+0000 7f761affd640 1 -- 10.20.193.28:0/3643903768 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f761c0106e0 con 0x7f762c060f30 2026-02-20T13:31:22.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.255+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c168600 con 0x7f762c060f30 2026-02-20T13:31:22.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.255+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c1515a0 con 0x7f762c060f30 2026-02-20T13:31:22.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.256+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c168820 con 0x7f762c060f30 2026-02-20T13:31:22.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.258+0000 7f761affd640 1 -- 10.20.193.28:0/3643903768 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f761c0097c0 con 0x7f762c060f30 2026-02-20T13:31:22.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.260+0000 7f761affd640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76080b5760 0x7f76080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.260+0000 7f761affd640 1 -- 10.20.193.28:0/3643903768 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f761c0e70a0 con 0x7f762c060f30 2026-02-20T13:31:22.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.260+0000 7f761affd640 1 -- 10.20.193.28:0/3643903768 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f761c0e7590 con 0x7f762c060f30 2026-02-20T13:31:22.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.260+0000 7f76315eb640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76080b5760 0x7f76080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.260+0000 7f76315eb640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76080b5760 0x7f76080d5c10 secure :-1 s=READY pgs=605 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f762c168a60 tx=0x7f7620005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:22.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.400+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f762c061360 con 0x7f762c060f30 2026-02-20T13:31:22.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.401+0000 7f761affd640 1 -- 10.20.193.28:0/3643903768 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f761c0a9a90 con 0x7f762c060f30 2026-02-20T13:31:22.404 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:31:22.404 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:31:22.405 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:31:22.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76080b5760 msgr2=0x7f76080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76080b5760 0x7f76080d5c10 secure :-1 s=READY pgs=605 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f762c168a60 tx=0x7f7620005f90 comp rx=0 tx=0).stop 2026-02-20T13:31:22.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c060f30 msgr2=0x7f762c1620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c060f30 0x7f762c1620c0 secure :-1 s=READY pgs=1459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f761c00d950 tx=0x7f761c00de20 comp rx=0 tx=0).stop 2026-02-20T13:31:22.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 shutdown_connections 2026-02-20T13:31:22.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f76080b5760 0x7f76080d5c10 unknown :-1 s=CLOSED pgs=605 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f762c155980 0x7f762c1679d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f762c061840 0x7f762c162600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 --2- 10.20.193.28:0/3643903768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f762c060f30 0x7f762c1620c0 unknown :-1 s=CLOSED pgs=1459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 >> 10.20.193.28:0/3643903768 conn(0x7f762c0eaad0 msgr2=0x7f762c10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:22.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 shutdown_connections 2026-02-20T13:31:22.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.402+0000 7f7632dee640 1 -- 10.20.193.28:0/3643903768 wait complete. 2026-02-20T13:31:22.505 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id e2e0aae --release --await' 2026-02-20T13:31:22.505 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id e2e0aae --release --await 2026-02-20T13:31:22.690 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:22.736 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:22 trial028 ceph-mon[37442]: pgmap v602: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:22.736 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:22 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3643903768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:22.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 -- 10.20.193.28:0/2067612112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010dc30 msgr2=0x7f7cb0112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 --2- 10.20.193.28:0/2067612112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010dc30 0x7f7cb0112c80 secure :-1 s=READY pgs=1460 gs=1 cs=0 l=1 c_cookie=3598667246411277274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca4009890 tx=0x7f7ca402f120 comp rx=0 tx=0).stop 2026-02-20T13:31:22.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 -- 10.20.193.28:0/2067612112 shutdown_connections 2026-02-20T13:31:22.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 --2- 10.20.193.28:0/2067612112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010dc30 0x7f7cb0112c80 unknown :-1 s=CLOSED pgs=1460 gs=1 cs=0 l=1 c_cookie=3598667246411277274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 --2- 10.20.193.28:0/2067612112 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7cb0113430 0x7f7cb0173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 --2- 10.20.193.28:0/2067612112 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7cb010d240 0x7f7cb010d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 -- 10.20.193.28:0/2067612112 >> 10.20.193.28:0/2067612112 conn(0x7f7cb00eaad0 msgr2=0x7f7cb010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:22.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 -- 10.20.193.28:0/2067612112 shutdown_connections 2026-02-20T13:31:22.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.868+0000 7f7cb6519640 1 -- 10.20.193.28:0/2067612112 wait complete. 2026-02-20T13:31:22.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.869+0000 7f7cb6519640 1 Processor -- start 2026-02-20T13:31:22.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.869+0000 7f7cb6519640 1 -- start start 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.869+0000 7f7cb6519640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010d240 0x7f7cb00f5790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.869+0000 7f7cb6519640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7cb010dc30 0x7f7cb0173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.869+0000 7f7cb6519640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7cb0113430 0x7f7cb00f5e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb6519640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00fb0a0 con 0x7f7cb010d240 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb6519640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00fb210 con 0x7f7cb010dc30 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb6519640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00fb3d0 con 0x7f7cb0113430 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010d240 0x7f7cb00f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010d240 0x7f7cb00f5790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36312/0 (socket says 10.20.193.28:36312) 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 -- 10.20.193.28:0/1563439604 learned_addr learned my addr 10.20.193.28:0/1563439604 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7cb0113430 0x7f7cb00f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb4d16640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7cb010dc30 0x7f7cb0173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 -- 10.20.193.28:0/1563439604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7cb0113430 msgr2=0x7f7cb00f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7cb0113430 0x7f7cb00f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 -- 10.20.193.28:0/1563439604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7cb010dc30 msgr2=0x7f7cb0173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7cb010dc30 0x7f7cb0173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 -- 10.20.193.28:0/1563439604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca40094b0 con 0x7f7cb010d240 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb5517640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010d240 0x7f7cb00f5790 secure :-1 s=READY pgs=1461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca000e9c0 tx=0x7f7ca000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7c9e7fc640 1 -- 10.20.193.28:0/1563439604 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ca000cd70 con 0x7f7cb010d240 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7c9e7fc640 1 -- 10.20.193.28:0/1563439604 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7ca0004d30 con 0x7f7cb010d240 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7c9e7fc640 1 -- 10.20.193.28:0/1563439604 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ca00106b0 con 0x7f7cb010d240 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb6519640 1 -- 10.20.193.28:0/1563439604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb00fb6b0 con 0x7f7cb010d240 2026-02-20T13:31:22.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.870+0000 7f7cb6519640 1 -- 10.20.193.28:0/1563439604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb00fbb30 con 0x7f7cb010d240 2026-02-20T13:31:22.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.874+0000 7f7c9e7fc640 1 -- 10.20.193.28:0/1563439604 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f7ca001f060 con 0x7f7cb010d240 2026-02-20T13:31:22.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.875+0000 7f7c9e7fc640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c8c0b5750 0x7f7c8c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.875+0000 7f7c9e7fc640 1 -- 10.20.193.28:0/1563439604 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7ca0014070 con 0x7f7cb010d240 2026-02-20T13:31:22.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb4d16640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c8c0b5750 0x7f7c8c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb979ce00 1 Processor -- start 2026-02-20T13:31:22.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb979ce00 1 -- start start 2026-02-20T13:31:22.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb4d16640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c8c0b5750 0x7f7c8c0d5c00 secure :-1 s=READY pgs=606 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca40023d0 tx=0x7f7ca403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:22.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f8148748f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f8148b9590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f8148d9eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f814789c70 con 0x55f8148b9ad0 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f8147859a0 con 0x55f814874520 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f81477fb00 con 0x55f814874e30 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb5d18640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f8148d9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.876+0000 7f7cb5517640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f8148748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb5d18640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f8148d9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36326/0 (socket says 10.20.193.28:36326) 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb5d18640 1 -- 10.20.193.28:0/2762348106 learned_addr learned my addr 10.20.193.28:0/2762348106 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb4d16640 1 --2- 10.20.193.28:0/2762348106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f8148b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb5d18640 1 -- 10.20.193.28:0/2762348106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 msgr2=0x55f8148b9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:22.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/2762348106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f8148b9590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb5d18640 1 -- 10.20.193.28:0/2762348106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 msgr2=0x55f8148748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/2762348106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f8148748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb5d18640 1 -- 10.20.193.28:0/2762348106 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81472af80 con 0x55f8148b9ad0 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/2762348106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f8148d9eb0 secure :-1 s=READY pgs=1462 gs=2 cs=0 l=1 c_cookie=12516361837514474979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cac005630 tx=0x7f7cac003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb30cc6d54e45e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7c7dce5640 1 -- 10.20.193.28:0/2762348106 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cac00ac10 con 0x55f8148b9ad0 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7c7dce5640 1 -- 10.20.193.28:0/2762348106 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7cac016070 con 0x55f8148b9ad0 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7c7dce5640 1 -- 10.20.193.28:0/2762348106 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cac011800 con 0x55f8148b9ad0 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2762348106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 msgr2=0x55f8148d9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2762348106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f8148d9eb0 secure :-1 s=READY pgs=1462 gs=2 cs=0 l=1 c_cookie=12516361837514474979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cac005630 tx=0x7f7cac003c30 comp rx=0 tx=0).stop 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.877+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2762348106 shutdown_connections 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.878+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2762348106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f8148d9eb0 unknown :-1 s=CLOSED pgs=1462 gs=2 cs=0 l=1 c_cookie=12516361837514474979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.878+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2762348106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f8148b9590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.878+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2762348106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f8148748f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.878+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2762348106 >> 10.20.193.28:0/2762348106 conn(0x55f814792a60 msgr2=0x55f814872e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:22.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.878+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2762348106 shutdown_connections 2026-02-20T13:31:22.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.878+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2762348106 wait complete. 2026-02-20T13:31:22.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.879+0000 7f7cb979ce00 1 -- start start 2026-02-20T13:31:22.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.879+0000 7f7cb979ce00 1 Processor -- start 2026-02-20T13:31:22.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f81488c5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f81488cae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814891ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f814892010 con 0x55f8148b9ad0 2026-02-20T13:31:22.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f814892180 con 0x55f814874520 2026-02-20T13:31:22.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f814892340 con 0x55f814874e30 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5517640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f81488c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5517640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f81488c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33222/0 (socket says 10.20.193.28:33222) 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5517640 1 -- 10.20.193.28:0/2609868973 learned_addr learned my addr 10.20.193.28:0/2609868973 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb4d16640 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f81488cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814891ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5517640 1 -- 10.20.193.28:0/2609868973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 msgr2=0x55f81488cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5517640 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f81488cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5517640 1 -- 10.20.193.28:0/2609868973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 msgr2=0x55f814891ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5517640 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814891ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.880+0000 7f7cb5517640 1 -- 10.20.193.28:0/2609868973 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f814703710 con 0x55f814874520 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb5517640 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f81488c5a0 secure :-1 s=READY pgs=498 gs=1 cs=0 l=1 c_cookie=9742589510199470020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca0009fd0 tx=0x7f7ca00a9840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8734a18a83e2e7c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:22.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7c6affd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7c6affd640 1 -- 10.20.193.28:0/2609868973 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ca00adae0 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cac0052d0 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7c6affd640 1 -- 10.20.193.28:0/2609868973 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7ca00b2e00 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7c6affd640 1 -- 10.20.193.28:0/2609868973 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ca00ab0c0 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 10 client.30437 _ll_register_callbacks cb 0x55f814700d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f814415ba0 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7c6affd640 1 -- 10.20.193.28:0/2609868973 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7ca00ab250 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7c6affd640 1 -- 10.20.193.28:0/2609868973 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7ca00b7040 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 10 client.30437 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f814715350 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7c6affd640 1 -- 10.20.193.28:0/2609868973 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7ca00b71a0 con 0x55f814874520 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 10 client.30437 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:22.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 10 client.30437 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 20 client.30437 populate_metadata read hostname 'trial028' 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f8148b6cb0 0x55f8148b7150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 4 client.30437 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.881+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f814752410 con 0x55f8148b6cb0 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.882+0000 7f7cb4d16640 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f8148b6cb0 0x55f8148b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.882+0000 7f7cb4d16640 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f8148b6cb0 0x55f8148b7150 crc :-1 s=READY pgs=400 gs=4 cs=0 l=0 c_cookie=2820885025485985356 s_cookie=6812551168471660642 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2725cbfc284f964c server_cookie=5e8b0b317aecf862 in_seq=0 out_seq=0 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.882+0000 7f7c6affd640 10 client.30437 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7c6affd640 1 -- 10.20.193.28:0/2609868973 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f814752410 con 0x55f8148b6cb0 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7c6affd640 10 client.30437 handle_command_reply: tid=0 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 client.30437 shutdown 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 msgr2=0x55f81488c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f81488c5a0 secure :-1 s=READY pgs=498 gs=1 cs=0 l=1 c_cookie=9742589510199470020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca0009fd0 tx=0x7f7ca00a9840 comp rx=0 tx=0).stop 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 shutdown_connections 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f8148b6cb0 0x55f8148b7150 crc :-1 s=READY pgs=400 gs=4 cs=0 l=0 c_cookie=2820885025485985356 s_cookie=6812551168471660642 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814891ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f81488cae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2609868973 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874520 0x55f81488c5a0 unknown :-1 s=CLOSED pgs=498 gs=1 cs=0 l=1 c_cookie=9742589510199470020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7c6affd640 0 client.30437 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 >> 10.20.193.28:0/2609868973 conn(0x55f814792a60 msgr2=0x55f814873510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 shutdown_connections 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2609868973 wait complete. 2026-02-20T13:31:22.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.883+0000 7f7cb979ce00 20 client.30437 trim_cache size 0 max 16384 2026-02-20T13:31:22.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.892+0000 7f7cb979ce00 1 Processor -- start 2026-02-20T13:31:22.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb979ce00 1 -- start start 2026-02-20T13:31:22.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f814874520 0x55f814891040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f8148b1f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8148b9ad0 0x55f8148b2440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f814891ed0 con 0x55f814874520 2026-02-20T13:31:22.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f81477d730 con 0x55f8148b9ad0 2026-02-20T13:31:22.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f81443d960 con 0x55f814874e30 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5517640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f814874520 0x55f814891040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb4d16640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f8148b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5517640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f814874520 0x55f814891040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36340/0 (socket says 10.20.193.28:36340) 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5517640 1 -- 10.20.193.28:0/2546148734 learned_addr learned my addr 10.20.193.28:0/2546148734 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/2546148734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8148b9ad0 0x55f8148b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5517640 1 -- 10.20.193.28:0/2546148734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 msgr2=0x55f8148b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5517640 1 --2- 10.20.193.28:0/2546148734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f8148b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5517640 1 -- 10.20.193.28:0/2546148734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8148b9ad0 msgr2=0x55f8148b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5517640 1 --2- 10.20.193.28:0/2546148734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8148b9ad0 0x55f8148b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.893+0000 7f7cb5517640 1 -- 10.20.193.28:0/2546148734 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81470fdd0 con 0x55f814874520 2026-02-20T13:31:22.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb5517640 1 --2- 10.20.193.28:0/2546148734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f814874520 0x55f814891040 secure :-1 s=READY pgs=1463 gs=1 cs=0 l=1 c_cookie=1420204151073987711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca00787b0 tx=0x7f7ca0074000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b594269d4cdc7f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7c7d4e4640 1 -- 10.20.193.28:0/2546148734 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ca00ab0c0 con 0x55f814874520 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7c7d4e4640 1 -- 10.20.193.28:0/2546148734 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f814415ba0 con 0x55f814874520 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7c7d4e4640 1 -- 10.20.193.28:0/2546148734 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ca00b5470 con 0x55f814874520 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2546148734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f814874520 msgr2=0x55f814891040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2546148734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f814874520 0x55f814891040 secure :-1 s=READY pgs=1463 gs=1 cs=0 l=1 c_cookie=1420204151073987711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca00787b0 tx=0x7f7ca0074000 comp rx=0 tx=0).stop 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2546148734 shutdown_connections 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2546148734 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f8148b9ad0 0x55f8148b2440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2546148734 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874e30 0x55f8148b1f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2546148734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f814874520 0x55f814891040 unknown :-1 s=CLOSED pgs=1463 gs=1 cs=0 l=1 c_cookie=1420204151073987711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2546148734 >> 10.20.193.28:0/2546148734 conn(0x55f814792a60 msgr2=0x55f814890930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:22.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2546148734 shutdown_connections 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.894+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2546148734 wait complete. 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.895+0000 7f7cb979ce00 1 -- start start 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.895+0000 7f7cb979ce00 1 Processor -- start 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.895+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874520 0x55f814892c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.895+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874e30 0x55f8148931b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.895+0000 7f7cb979ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814897b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.895+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f814898050 con 0x55f8148b9ad0 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.895+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55f8148981c0 con 0x55f814874e30 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.895+0000 7f7cb979ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55f814898380 con 0x55f814874520 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5517640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874520 0x55f814892c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814897b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814897b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36346/0 (socket says 10.20.193.28:36346) 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 -- 10.20.193.28:0/2146056243 learned_addr learned my addr 10.20.193.28:0/2146056243 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb4d16640 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874e30 0x55f8148931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 -- 10.20.193.28:0/2146056243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874520 msgr2=0x55f814892c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874520 0x55f814892c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 -- 10.20.193.28:0/2146056243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874e30 msgr2=0x55f8148931b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874e30 0x55f8148931b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 -- 10.20.193.28:0/2146056243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f814703a40 con 0x55f8148b9ad0 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb5d18640 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814897b10 secure :-1 s=READY pgs=1464 gs=3 cs=0 l=1 c_cookie=15245059289968498375 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cac005630 tx=0x7f7cac006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39154a7065756c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7c6affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7c6affd640 1 -- 10.20.193.28:0/2146056243 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cac0128f0 con 0x55f8148b9ad0 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7c6affd640 1 -- 10.20.193.28:0/2146056243 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7cac024040 con 0x55f8148b9ad0 2026-02-20T13:31:22.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7c6affd640 1 -- 10.20.193.28:0/2146056243 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cac011460 con 0x55f8148b9ad0 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.896+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca0076020 con 0x55f8148b9ad0 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7c6affd640 1 -- 10.20.193.28:0/2146056243 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f7cac0115f0 con 0x55f8148b9ad0 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 10 client.20529 _ll_register_callbacks cb 0x55f814700d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cac016070 con 0x55f8148b9ad0 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7c6affd640 1 -- 10.20.193.28:0/2146056243 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7cac012a50 con 0x55f8148b9ad0 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 10 client.20529 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f8147155b0 con 0x55f8148b9ad0 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7c6affd640 1 -- 10.20.193.28:0/2146056243 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7cac012bb0 con 0x55f8148b9ad0 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 10 client.20529 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 10 client.20529 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 20 client.20529 populate_metadata read hostname 'trial028' 2026-02-20T13:31:22.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f814909d20 0x55f81490a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:22.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 4 client.20529 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e2e0aae", "release": true, "await": true}] 2026-02-20T13:31:22.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e2e0aae", "release": true, "await": true}) -- 0x55f8144133f0 con 0x55f814909d20 2026-02-20T13:31:22.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.897+0000 7f7cb5517640 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f814909d20 0x55f81490a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:22.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.898+0000 7f7cb5517640 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f814909d20 0x55f81490a1c0 crc :-1 s=READY pgs=401 gs=4 cs=0 l=0 c_cookie=16042562505775004421 s_cookie=12151709594731333693 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea2a19a13b83b05 server_cookie=a8a38b7e6faac83d in_seq=0 out_seq=0 2026-02-20T13:31:22.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.898+0000 7f7c6affd640 10 client.20529 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:22.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7c6affd640 1 -- 10.20.193.28:0/2146056243 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55f8144133f0 con 0x55f814909d20 2026-02-20T13:31:22.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7c6affd640 10 client.20529 handle_command_reply: tid=0 2026-02-20T13:31:22.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 client.20529 shutdown 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 msgr2=0x55f814897b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814897b10 secure :-1 s=READY pgs=1464 gs=3 cs=0 l=1 c_cookie=15245059289968498375 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cac005630 tx=0x7f7cac006900 comp rx=0 tx=0).stop 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 shutdown_connections 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55f814909d20 0x55f81490a1c0 crc :-1 s=READY pgs=401 gs=4 cs=0 l=0 c_cookie=16042562505775004421 s_cookie=12151709594731333693 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8148b9ad0 0x55f814897b10 unknown :-1 s=CLOSED pgs=1464 gs=3 cs=0 l=1 c_cookie=15245059289968498375 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55f814874e30 0x55f8148931b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 --2- 10.20.193.28:0/2146056243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55f814874520 0x55f814892c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 >> 10.20.193.28:0/2146056243 conn(0x55f814792a60 msgr2=0x55f814872ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7c6affd640 0 client.20529 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 shutdown_connections 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.899+0000 7f7cb979ce00 1 -- 10.20.193.28:0/2146056243 wait complete. 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:31:22.907 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 52, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "e2e0aae": { 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "version": 52, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 147.8, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb979ce00 20 client.20529 trim_cache size 0 max 16384 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 -- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c8c0b5750 msgr2=0x7f7c8c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c8c0b5750 0x7f7c8c0d5c00 secure :-1 s=READY pgs=606 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca40023d0 tx=0x7f7ca403a040 comp rx=0 tx=0).stop 2026-02-20T13:31:22.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 -- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010d240 msgr2=0x7f7cb00f5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010d240 0x7f7cb00f5790 secure :-1 s=READY pgs=1461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ca000e9c0 tx=0x7f7ca000ee90 comp rx=0 tx=0).stop 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 -- 10.20.193.28:0/1563439604 shutdown_connections 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f7c8c0b5750 0x7f7c8c0d5c00 unknown :-1 s=CLOSED pgs=606 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7cb0113430 0x7f7cb00f5e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f7cb010dc30 0x7f7cb0173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 --2- 10.20.193.28:0/1563439604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cb010d240 0x7f7cb00f5790 unknown :-1 s=CLOSED pgs=1461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 -- 10.20.193.28:0/1563439604 >> 10.20.193.28:0/1563439604 conn(0x7f7cb00eaad0 msgr2=0x7f7cb010bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 -- 10.20.193.28:0/1563439604 shutdown_connections 2026-02-20T13:31:22.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:22.900+0000 7f7cb6519640 1 -- 10.20.193.28:0/1563439604 wait complete. 2026-02-20T13:31:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:22 trial127 ceph-mon[43817]: pgmap v602: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:22 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3643903768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:22 trial034 ceph-mon[43332]: pgmap v602: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:22 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3643903768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:22.999 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e2e0aae', total seconds elapsed: 28.8 2026-02-20T13:31:22.999 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.75 2026-02-20T13:31:22.999 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:31:23.183 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:23.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 -- 10.20.193.28:0/2324101962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c10f4b0 msgr2=0x7fed6c10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 --2- 10.20.193.28:0/2324101962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c10f4b0 0x7fed6c10f880 secure :-1 s=READY pgs=1465 gs=1 cs=0 l=1 c_cookie=3590116885309601409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed60009890 tx=0x7fed6002f120 comp rx=0 tx=0).stop 2026-02-20T13:31:23.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 -- 10.20.193.28:0/2324101962 shutdown_connections 2026-02-20T13:31:23.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 --2- 10.20.193.28:0/2324101962 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed6c1156a0 0x7fed6c176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 --2- 10.20.193.28:0/2324101962 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed6c10fea0 0x7fed6c114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 --2- 10.20.193.28:0/2324101962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c10f4b0 0x7fed6c10f880 unknown :-1 s=CLOSED pgs=1465 gs=1 cs=0 l=1 c_cookie=3590116885309601409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 -- 10.20.193.28:0/2324101962 >> 10.20.193.28:0/2324101962 conn(0x7fed6c0ecda0 msgr2=0x7fed6c10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:23.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 -- 10.20.193.28:0/2324101962 shutdown_connections 2026-02-20T13:31:23.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.359+0000 7fed6b577640 1 -- 10.20.193.28:0/2324101962 wait complete. 2026-02-20T13:31:23.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6b577640 1 Processor -- start 2026-02-20T13:31:23.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6b577640 1 -- start start 2026-02-20T13:31:23.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6b577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed6c10f4b0 0x7fed6c11de50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6b577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed6c10fea0 0x7fed6c11e390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c1156a0 0x7fed6c123760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c123d80 con 0x7fed6c1156a0 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6b577640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c123ef0 con 0x7fed6c10fea0 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6b577640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c1240b0 con 0x7fed6c10f4b0 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed6c10f4b0 0x7fed6c11de50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed6c10f4b0 0x7fed6c11de50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43060/0 (socket says 10.20.193.28:43060) 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6a575640 1 -- 10.20.193.28:0/3171917192 learned_addr learned my addr 10.20.193.28:0/3171917192 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed6ad76640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c1156a0 0x7fed6c123760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.360+0000 7fed69d74640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed6c10fea0 0x7fed6c11e390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6ad76640 1 -- 10.20.193.28:0/3171917192 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed6c10f4b0 msgr2=0x7fed6c11de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6ad76640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed6c10f4b0 0x7fed6c11de50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6ad76640 1 -- 10.20.193.28:0/3171917192 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed6c10fea0 msgr2=0x7fed6c11e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6ad76640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed6c10fea0 0x7fed6c11e390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6ad76640 1 -- 10.20.193.28:0/3171917192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed600094b0 con 0x7fed6c1156a0 2026-02-20T13:31:23.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6a575640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed6c10f4b0 0x7fed6c11de50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:23.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6ad76640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c1156a0 0x7fed6c123760 secure :-1 s=READY pgs=1466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed5c00f940 tx=0x7fed5c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:23.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed537fe640 1 -- 10.20.193.28:0/3171917192 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed5c00dce0 con 0x7fed6c1156a0 2026-02-20T13:31:23.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed537fe640 1 -- 10.20.193.28:0/3171917192 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fed5c00de40 con 0x7fed6c1156a0 2026-02-20T13:31:23.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed537fe640 1 -- 10.20.193.28:0/3171917192 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed5c0116b0 con 0x7fed6c1156a0 2026-02-20T13:31:23.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6c124390 con 0x7fed6c1156a0 2026-02-20T13:31:23.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.361+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6c063220 con 0x7fed6c1156a0 2026-02-20T13:31:23.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.362+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6c1245b0 con 0x7fed6c1156a0 2026-02-20T13:31:23.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.364+0000 7fed537fe640 1 -- 10.20.193.28:0/3171917192 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fed5c020060 con 0x7fed6c1156a0 2026-02-20T13:31:23.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.366+0000 7fed537fe640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed440b5760 0x7fed440d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.366+0000 7fed537fe640 1 -- 10.20.193.28:0/3171917192 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fed5c015070 con 0x7fed6c1156a0 2026-02-20T13:31:23.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.366+0000 7fed537fe640 1 -- 10.20.193.28:0/3171917192 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fed5c120730 con 0x7fed6c1156a0 2026-02-20T13:31:23.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.366+0000 7fed6a575640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed440b5760 0x7fed440d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.367+0000 7fed6a575640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed440b5760 0x7fed440d5c10 secure :-1 s=READY pgs=609 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed600097e0 tx=0x7fed6003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:23.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.507+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed6c10f880 con 0x7fed6c1156a0 2026-02-20T13:31:23.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.508+0000 7fed537fe640 1 -- 10.20.193.28:0/3171917192 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7fed5c0aa6a0 con 0x7fed6c1156a0 2026-02-20T13:31:23.511 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:31:23.511 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:31:23.512 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:31:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed440b5760 msgr2=0x7fed440d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed440b5760 0x7fed440d5c10 secure :-1 s=READY pgs=609 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed600097e0 tx=0x7fed6003a040 comp rx=0 tx=0).stop 2026-02-20T13:31:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c1156a0 msgr2=0x7fed6c123760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c1156a0 0x7fed6c123760 secure :-1 s=READY pgs=1466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed5c00f940 tx=0x7fed5c00fe10 comp rx=0 tx=0).stop 2026-02-20T13:31:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 shutdown_connections 2026-02-20T13:31:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fed440b5760 0x7fed440d5c10 unknown :-1 s=CLOSED pgs=609 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed6c1156a0 0x7fed6c123760 unknown :-1 s=CLOSED pgs=1466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fed6c10fea0 0x7fed6c11e390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 --2- 10.20.193.28:0/3171917192 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed6c10f4b0 0x7fed6c11de50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 >> 10.20.193.28:0/3171917192 conn(0x7fed6c0ecda0 msgr2=0x7fed6c10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 shutdown_connections 2026-02-20T13:31:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.509+0000 7fed6b577640 1 -- 10.20.193.28:0/3171917192 wait complete. 2026-02-20T13:31:23.612 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db / --timeout 90 --expiration 147.75 --await-for 45.0' 2026-02-20T13:31:23.613 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db / --timeout 90 --expiration 147.75 --await-for 45.0 2026-02-20T13:31:23.798 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:23.841 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:23 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3171917192' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:23.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:23 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3171917192' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:23.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 -- 10.20.193.28:0/239390560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 msgr2=0x7fda1c114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 --2- 10.20.193.28:0/239390560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 0x7fda1c114c70 secure :-1 s=READY pgs=1467 gs=2 cs=0 l=1 c_cookie=2151619981775778023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda04009950 tx=0x7fda0402f190 comp rx=0 tx=0).stop 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 -- 10.20.193.28:0/239390560 shutdown_connections 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 --2- 10.20.193.28:0/239390560 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 0x7fda1c114c70 unknown :-1 s=CLOSED pgs=1467 gs=2 cs=0 l=1 c_cookie=2151619981775778023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 --2- 10.20.193.28:0/239390560 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda1c115420 0x7fda1c175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 --2- 10.20.193.28:0/239390560 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fda1c10f230 0x7fda1c10f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 -- 10.20.193.28:0/239390560 >> 10.20.193.28:0/239390560 conn(0x7fda1c05f830 msgr2=0x7fda1c10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 -- 10.20.193.28:0/239390560 shutdown_connections 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.978+0000 7fda20c9d640 1 -- 10.20.193.28:0/239390560 wait complete. 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda20c9d640 1 Processor -- start 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda20c9d640 1 -- start start 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda20c9d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda1c10f230 0x7fda1c0f54e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda20c9d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 0x7fda1c175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda20c9d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fda1c115420 0x7fda1c0f5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda20c9d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c0fadf0 con 0x7fda1c10fc20 2026-02-20T13:31:23.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda20c9d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c0faf60 con 0x7fda1c115420 2026-02-20T13:31:23.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda20c9d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c0fb120 con 0x7fda1c10f230 2026-02-20T13:31:23.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda1a575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda1c10f230 0x7fda1c0f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda1ad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fda1c115420 0x7fda1c0f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda1ad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fda1c115420 0x7fda1c0f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33280/0 (socket says 10.20.193.28:33280) 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.979+0000 7fda1ad76640 1 -- 10.20.193.28:0/995668160 learned_addr learned my addr 10.20.193.28:0/995668160 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda19d74640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 0x7fda1c175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda1ad76640 1 -- 10.20.193.28:0/995668160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda1c10f230 msgr2=0x7fda1c0f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda1ad76640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda1c10f230 0x7fda1c0f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda1ad76640 1 -- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 msgr2=0x7fda1c175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda1ad76640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 0x7fda1c175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda1ad76640 1 -- 10.20.193.28:0/995668160 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda100094b0 con 0x7fda1c115420 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda19d74640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 0x7fda1c175cf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda1ad76640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fda1c115420 0x7fda1c0f5be0 secure :-1 s=READY pgs=499 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0c00f8d0 tx=0x7fda0c00fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda037fe640 1 -- 10.20.193.28:0/995668160 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0c00dce0 con 0x7fda1c115420 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda037fe640 1 -- 10.20.193.28:0/995668160 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fda0c00de40 con 0x7fda1c115420 2026-02-20T13:31:23.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda037fe640 1 -- 10.20.193.28:0/995668160 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0c0116b0 con 0x7fda1c115420 2026-02-20T13:31:23.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.980+0000 7fda20c9d640 1 -- 10.20.193.28:0/995668160 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda04009570 con 0x7fda1c115420 2026-02-20T13:31:23.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.981+0000 7fda20c9d640 1 -- 10.20.193.28:0/995668160 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c0fb6f0 con 0x7fda1c115420 2026-02-20T13:31:23.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.984+0000 7fda037fe640 1 -- 10.20.193.28:0/995668160 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fda0c020060 con 0x7fda1c115420 2026-02-20T13:31:23.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.986+0000 7fda037fe640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd9f40b5750 0x7fd9f40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.986+0000 7fda22c97e00 1 Processor -- start 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.986+0000 7fda037fe640 1 -- 10.20.193.28:0/995668160 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fda0c015070 con 0x7fda1c115420 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.986+0000 7fda22c97e00 1 -- start start 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.986+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.986+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73b640 0x55649a77ffb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a7804f0 0x55649a7a08d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda22c97e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55649a6511a0 con 0x55649a73ad30 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda22c97e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55649a64ced0 con 0x55649a7804f0 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda22c97e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55649a647030 con 0x55649a73b640 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1a575640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd9f40b5750 0x7fd9f40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1ad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a7804f0 0x55649a7a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1ad76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a7804f0 0x55649a7a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33294/0 (socket says 10.20.193.28:33294) 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1ad76640 1 -- 10.20.193.28:0/2606752299 learned_addr learned my addr 10.20.193.28:0/2606752299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda19d74640 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73b640 0x55649a77ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1ad76640 1 -- 10.20.193.28:0/2606752299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73b640 msgr2=0x55649a77ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1ad76640 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73b640 0x55649a77ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1ad76640 1 -- 10.20.193.28:0/2606752299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 msgr2=0x55649a73b100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1a575640 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1ad76640 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73b100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1ad76640 1 -- 10.20.193.28:0/2606752299 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649a5f24c0 con 0x55649a7804f0 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.987+0000 7fda1a575640 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73b100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda1ad76640 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a7804f0 0x55649a7a08d0 secure :-1 s=READY pgs=500 gs=1 cs=0 l=1 c_cookie=5868559703238039029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0c0aa5f0 tx=0x7fda0c00a4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51714ff506acd5f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:23.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda1a575640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd9f40b5750 0x7fd9f40d5c00 secure :-1 s=READY pgs=610 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda10004740 tx=0x7fda10004300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda00ff9640 1 -- 10.20.193.28:0/2606752299 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0c0aea20 con 0x55649a7804f0 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda00ff9640 1 -- 10.20.193.28:0/2606752299 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fda0c0b3d40 con 0x55649a7804f0 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda00ff9640 1 -- 10.20.193.28:0/2606752299 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0c0ade40 con 0x55649a7804f0 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 -- 10.20.193.28:0/2606752299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a7804f0 msgr2=0x55649a7a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a7804f0 0x55649a7a08d0 secure :-1 s=READY pgs=500 gs=1 cs=0 l=1 c_cookie=5868559703238039029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0c0aa5f0 tx=0x7fda0c00a4a0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 -- 10.20.193.28:0/2606752299 shutdown_connections 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a7804f0 0x55649a7a08d0 unknown :-1 s=CLOSED pgs=500 gs=1 cs=0 l=1 c_cookie=5868559703238039029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73b640 0x55649a77ffb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 --2- 10.20.193.28:0/2606752299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73b100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 -- 10.20.193.28:0/2606752299 >> 10.20.193.28:0/2606752299 conn(0x55649a659d60 msgr2=0x55649a739610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:23.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 -- 10.20.193.28:0/2606752299 shutdown_connections 2026-02-20T13:31:23.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.988+0000 7fda22c97e00 1 -- 10.20.193.28:0/2606752299 wait complete. 2026-02-20T13:31:23.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:23 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3171917192' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.989+0000 7fda22c97e00 1 -- start start 2026-02-20T13:31:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda22c97e00 1 Processor -- start 2026-02-20T13:31:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73ad30 0x55649a797880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73b640 0x55649a797dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a79cdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda22c97e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55649a79d2f0 con 0x55649a73b640 2026-02-20T13:31:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda22c97e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55649a79d460 con 0x55649a73ad30 2026-02-20T13:31:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda22c97e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55649a79d620 con 0x55649a7804f0 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda1a575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73ad30 0x55649a797880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda1ad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a79cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda1ad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a79cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43088/0 (socket says 10.20.193.28:43088) 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda1ad76640 1 -- 10.20.193.28:0/1077441139 learned_addr learned my addr 10.20.193.28:0/1077441139 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda19d74640 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73b640 0x55649a797dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda1ad76640 1 -- 10.20.193.28:0/1077441139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73ad30 msgr2=0x55649a797880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda1ad76640 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73ad30 0x55649a797880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda1ad76640 1 -- 10.20.193.28:0/1077441139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73b640 msgr2=0x55649a797dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.990+0000 7fda1ad76640 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73b640 0x55649a797dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fda1ad76640 1 -- 10.20.193.28:0/1077441139 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649a5cac20 con 0x55649a7804f0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fda1ad76640 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a79cdb0 secure :-1 s=READY pgs=414 gs=2 cs=0 l=1 c_cookie=15293649236521177877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0c0aa5a0 tx=0x7fda0c006510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d43df4f38e44d315 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fd9cbfff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1077441139 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0c0aeed0 con 0x55649a7804f0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1077441139 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fda0c0addd0 con 0x55649a7804f0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1077441139 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0c0733a0 con 0x55649a7804f0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c0fb6f0 con 0x55649a7804f0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1077441139 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fda0c0ac000 con 0x55649a7804f0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fd9cbfff640 10 client.30319 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fda22c97e00 10 client.30319 _ll_register_callbacks cb 0x55649a5d1dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55649a325a60 con 0x55649a7804f0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1077441139 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fda0c0b8f60 con 0x55649a7804f0 2026-02-20T13:31:24.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.991+0000 7fda22c97e00 10 client.30319 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55649a5dc5f0 con 0x55649a7804f0 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1077441139 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fda0c0afa10 con 0x55649a7804f0 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fda22c97e00 10 client.30319 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fda22c97e00 10 client.30319 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fda22c97e00 20 client.30319 populate_metadata read hostname 'trial028' 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55649a77d0f0 0x55649a77d590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fda22c97e00 4 client.30319 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55649a6195d0 con 0x55649a77d0f0 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.992+0000 7fda1a575640 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55649a77d0f0 0x55649a77d590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda1a575640 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55649a77d0f0 0x55649a77d590 crc :-1 s=READY pgs=402 gs=4 cs=0 l=0 c_cookie=12382045227677759 s_cookie=18308000844796915891 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bfd678f63783f server_cookie=fe1315c4b5abf0b3 in_seq=0 out_seq=0 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fd9cbfff640 10 client.30319 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:24.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1077441139 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55649a6195d0 con 0x55649a77d0f0 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fd9cbfff640 10 client.30319 handle_command_reply: tid=0 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 client.30319 shutdown 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 msgr2=0x55649a79cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a79cdb0 secure :-1 s=READY pgs=414 gs=2 cs=0 l=1 c_cookie=15293649236521177877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0c0aa5a0 tx=0x7fda0c006510 comp rx=0 tx=0).stop 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 shutdown_connections 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55649a77d0f0 0x55649a77d590 crc :-1 s=READY pgs=402 gs=4 cs=0 l=0 c_cookie=12382045227677759 s_cookie=18308000844796915891 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73b640 0x55649a797dc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a79cdb0 unknown :-1 s=CLOSED pgs=414 gs=2 cs=0 l=1 c_cookie=15293649236521177877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1077441139 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73ad30 0x55649a797880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 >> 10.20.193.28:0/1077441139 conn(0x55649a659d60 msgr2=0x55649a738e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fd9cbfff640 0 client.30319 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:24.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 shutdown_connections 2026-02-20T13:31:24.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.993+0000 7fda22c97e00 1 -- 10.20.193.28:0/1077441139 wait complete. 2026-02-20T13:31:24.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:23.994+0000 7fda22c97e00 20 client.30319 trim_cache size 0 max 16384 2026-02-20T13:31:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.002+0000 7fda22c97e00 1 Processor -- start 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.002+0000 7fda22c97e00 1 -- start start 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.002+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.002+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a77b150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.002+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a77b690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.002+0000 7fda22c97e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55649a644c60 con 0x55649a73ad30 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.002+0000 7fda22c97e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55649a304ef0 con 0x55649a73b640 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.002+0000 7fda22c97e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55649a7908a0 con 0x55649a7804f0 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a77b150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda1ad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a77b690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a77b150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33300/0 (socket says 10.20.193.28:33300) 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda1ad76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a77b690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43104/0 (socket says 10.20.193.28:43104) 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 -- 10.20.193.28:0/3631483595 learned_addr learned my addr 10.20.193.28:0/3631483595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda1a575640 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 -- 10.20.193.28:0/3631483595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 msgr2=0x55649a77b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a77b690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 -- 10.20.193.28:0/3631483595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 msgr2=0x55649a73a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 -- 10.20.193.28:0/3631483595 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649a5d7150 con 0x55649a73b640 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda1a575640 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73a240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.003+0000 7fda19d74640 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a77b150 secure :-1 s=READY pgs=501 gs=3 cs=0 l=1 c_cookie=8429938862692202738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0402f6a0 tx=0x7fda0403a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74fd28bb5d0778f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fd9e64e6640 1 -- 10.20.193.28:0/3631483595 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0403d070 con 0x55649a73b640 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fd9e64e6640 1 -- 10.20.193.28:0/3631483595 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fda040026a0 con 0x55649a73b640 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fd9e64e6640 1 -- 10.20.193.28:0/3631483595 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda04038920 con 0x55649a73b640 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 -- 10.20.193.28:0/3631483595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 msgr2=0x55649a77b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a77b150 secure :-1 s=READY pgs=501 gs=3 cs=0 l=1 c_cookie=8429938862692202738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0402f6a0 tx=0x7fda0403a040 comp rx=0 tx=0).stop 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 -- 10.20.193.28:0/3631483595 shutdown_connections 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a7804f0 0x55649a77b690 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a77b150 unknown :-1 s=CLOSED pgs=501 gs=3 cs=0 l=1 c_cookie=8429938862692202738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 --2- 10.20.193.28:0/3631483595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a73ad30 0x55649a73a240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 -- 10.20.193.28:0/3631483595 >> 10.20.193.28:0/3631483595 conn(0x55649a659d60 msgr2=0x55649a7810b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 -- 10.20.193.28:0/3631483595 shutdown_connections 2026-02-20T13:31:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.004+0000 7fda22c97e00 1 -- 10.20.193.28:0/3631483595 wait complete. 2026-02-20T13:31:24.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda22c97e00 1 -- start start 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda22c97e00 1 Processor -- start 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73ad30 0x55649a71a4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a71aa00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda22c97e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a7804f0 0x55649a71af40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda22c97e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55649a7ee940 con 0x55649a7804f0 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda22c97e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55649a7eeab0 con 0x55649a73b640 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda22c97e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55649a7eec70 con 0x55649a73ad30 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda19d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a71aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda19d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a71aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33312/0 (socket says 10.20.193.28:33312) 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda19d74640 1 -- 10.20.193.28:0/1243686360 learned_addr learned my addr 10.20.193.28:0/1243686360 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:24.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda1ad76640 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a7804f0 0x55649a71af40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.005+0000 7fda1a575640 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73ad30 0x55649a71a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda1ad76640 1 -- 10.20.193.28:0/1243686360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73ad30 msgr2=0x55649a71a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda1ad76640 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73ad30 0x55649a71a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda1ad76640 1 -- 10.20.193.28:0/1243686360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 msgr2=0x55649a71aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda1ad76640 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a71aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda1ad76640 1 -- 10.20.193.28:0/1243686360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c176660 con 0x55649a7804f0 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda19d74640 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a71aa00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda1ad76640 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a7804f0 0x55649a71af40 secure :-1 s=READY pgs=1468 gs=3 cs=0 l=1 c_cookie=18392446987935407515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0c0ae290 tx=0x7fda0c0b92e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3f19169217dd9b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fd9cbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1243686360 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0c00c360 con 0x55649a7804f0 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1243686360 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55649a325a60 con 0x55649a7804f0 2026-02-20T13:31:24.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1243686360 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0c0aea20 con 0x55649a7804f0 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda10017070 con 0x55649a7804f0 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1243686360 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fda0c079300 con 0x55649a7804f0 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fd9cbfff640 10 client.20550 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda22c97e00 10 client.20550 _ll_register_callbacks cb 0x55649a5d1dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.006+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55649a654050 con 0x55649a7804f0 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1243686360 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fda0c0addd0 con 0x55649a7804f0 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda22c97e00 10 client.20550 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55649a5caf50 con 0x55649a7804f0 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1243686360 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fda0c0b50c0 con 0x55649a7804f0 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda22c97e00 10 client.20550 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda22c97e00 10 client.20550 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda22c97e00 20 client.20550 populate_metadata read hostname 'trial028' 2026-02-20T13:31:24.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55649a836650 0x55649a856b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:24.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda22c97e00 4 client.20550 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.75, "await_for": 45.0}] 2026-02-20T13:31:24.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.75, "await_for": 45.0}) -- 0x55649a2da730 con 0x55649a836650 2026-02-20T13:31:24.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda1a575640 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55649a836650 0x55649a856b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:24.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fda1a575640 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55649a836650 0x55649a856b00 crc :-1 s=READY pgs=403 gs=4 cs=0 l=0 c_cookie=16687266528820225983 s_cookie=3786943857480922869 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e795147eba9867bf server_cookie=348ded5fd17f76f5 in_seq=0 out_seq=0 2026-02-20T13:31:24.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.007+0000 7fd9cbfff640 10 client.20550 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.012+0000 7fd9cbfff640 1 -- 10.20.193.28:0/1243686360 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55649a2da730 con 0x55649a836650 2026-02-20T13:31:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.012+0000 7fd9cbfff640 10 client.20550 handle_command_reply: tid=0 2026-02-20T13:31:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.012+0000 7fda22c97e00 1 client.20550 shutdown 2026-02-20T13:31:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.012+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a7804f0 msgr2=0x55649a71af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.012+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a7804f0 0x55649a71af40 secure :-1 s=READY pgs=1468 gs=3 cs=0 l=1 c_cookie=18392446987935407515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0c0ae290 tx=0x7fda0c0b92e0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.012+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 shutdown_connections 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.012+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55649a836650 0x55649a856b00 crc :-1 s=READY pgs=403 gs=4 cs=0 l=0 c_cookie=16687266528820225983 s_cookie=3786943857480922869 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fd9cbfff640 0 client.20550 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55649a7804f0 0x55649a71af40 unknown :-1 s=CLOSED pgs=1468 gs=3 cs=0 l=1 c_cookie=18392446987935407515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55649a73b640 0x55649a71aa00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda22c97e00 1 --2- 10.20.193.28:0/1243686360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55649a73ad30 0x55649a71a4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 >> 10.20.193.28:0/1243686360 conn(0x55649a659d60 msgr2=0x55649a739230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 shutdown_connections 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda22c97e00 1 -- 10.20.193.28:0/1243686360 wait complete. 2026-02-20T13:31:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda22c97e00 20 client.20550 trim_cache size 0 max 16384 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 54, 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "8d1442de": { 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "version": 54, 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:31:24.019 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 147.8, 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:24.020 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:24.021 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:24.021 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:24.021 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:24.021 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:31:24.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 -- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd9f40b5750 msgr2=0x7fd9f40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:24.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd9f40b5750 0x7fd9f40d5c00 secure :-1 s=READY pgs=610 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda10004740 tx=0x7fda10004300 comp rx=0 tx=0).stop 2026-02-20T13:31:24.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 -- 10.20.193.28:0/995668160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fda1c115420 msgr2=0x7fda1c0f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:24.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fda1c115420 0x7fda1c0f5be0 secure :-1 s=READY pgs=499 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda0c00f8d0 tx=0x7fda0c00fda0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 -- 10.20.193.28:0/995668160 shutdown_connections 2026-02-20T13:31:24.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd9f40b5750 0x7fd9f40d5c00 unknown :-1 s=CLOSED pgs=610 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda1c10fc20 0x7fda1c175cf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fda1c115420 0x7fda1c0f5be0 unknown :-1 s=CLOSED pgs=499 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 --2- 10.20.193.28:0/995668160 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda1c10f230 0x7fda1c0f54e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:24.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 -- 10.20.193.28:0/995668160 >> 10.20.193.28:0/995668160 conn(0x7fda1c05f830 msgr2=0x7fda1c111a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:24.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 -- 10.20.193.28:0/995668160 shutdown_connections 2026-02-20T13:31:24.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:24.013+0000 7fda20c9d640 1 -- 10.20.193.28:0/995668160 wait complete. 2026-02-20T13:31:24.118 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8d1442de', quiesce took 1.1 seconds. Will release after: 26.65 2026-02-20T13:31:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:24 trial028 ceph-mon[37442]: pgmap v603: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:24.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:24 trial127 ceph-mon[43817]: pgmap v603: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:24.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:24 trial034 ceph-mon[43332]: pgmap v603: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:26.378 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:31:26.564 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:26.695 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:26 trial028 ceph-mon[37442]: pgmap v604: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:26.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 -- 10.20.193.28:0/655276009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 msgr2=0x7f915410e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 --2- 10.20.193.28:0/655276009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 0x7f915410e0b0 secure :-1 s=READY pgs=1469 gs=1 cs=0 l=1 c_cookie=14055211003428064662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9144009890 tx=0x7f914402f120 comp rx=0 tx=0).stop 2026-02-20T13:31:26.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 -- 10.20.193.28:0/655276009 shutdown_connections 2026-02-20T13:31:26.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 --2- 10.20.193.28:0/655276009 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9154153290 0x7f91541736b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 --2- 10.20.193.28:0/655276009 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f915410e6d0 0x7f9154152d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 --2- 10.20.193.28:0/655276009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 0x7f915410e0b0 unknown :-1 s=CLOSED pgs=1469 gs=1 cs=0 l=1 c_cookie=14055211003428064662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 -- 10.20.193.28:0/655276009 >> 10.20.193.28:0/655276009 conn(0x7f91540e9670 msgr2=0x7f9154109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:26.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 -- 10.20.193.28:0/655276009 shutdown_connections 2026-02-20T13:31:26.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.739+0000 7f915c421640 1 -- 10.20.193.28:0/655276009 wait complete. 2026-02-20T13:31:26.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915c421640 1 Processor -- start 2026-02-20T13:31:26.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915c421640 1 -- start start 2026-02-20T13:31:26.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915c421640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 0x7f915410d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915c421640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f915410e6d0 0x7f915410ba50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915c421640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9154153290 0x7f915410bf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915c421640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f915410c630 con 0x7f915410dce0 2026-02-20T13:31:26.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915c421640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f915410c7a0 con 0x7f915410e6d0 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915c421640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f915414ed10 con 0x7f9154153290 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915a196640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 0x7f915410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f9159995640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f915410e6d0 0x7f915410ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915a196640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 0x7f915410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36420/0 (socket says 10.20.193.28:36420) 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915a196640 1 -- 10.20.193.28:0/2376561298 learned_addr learned my addr 10.20.193.28:0/2376561298 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.740+0000 7f915a997640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9154153290 0x7f915410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f915a196640 1 -- 10.20.193.28:0/2376561298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9154153290 msgr2=0x7f915410bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f915a196640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9154153290 0x7f915410bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f915a196640 1 -- 10.20.193.28:0/2376561298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f915410e6d0 msgr2=0x7f915410ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f915a196640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f915410e6d0 0x7f915410ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f915a196640 1 -- 10.20.193.28:0/2376561298 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91440094b0 con 0x7f915410dce0 2026-02-20T13:31:26.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f915a196640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 0x7f915410d4d0 secure :-1 s=READY pgs=1470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91440023b0 tx=0x7f91440028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:26.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f913b7fe640 1 -- 10.20.193.28:0/2376561298 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f914403d070 con 0x7f915410dce0 2026-02-20T13:31:26.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f913b7fe640 1 -- 10.20.193.28:0/2376561298 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91440044f0 con 0x7f915410dce0 2026-02-20T13:31:26.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.741+0000 7f913b7fe640 1 -- 10.20.193.28:0/2376561298 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9144041a00 con 0x7f915410dce0 2026-02-20T13:31:26.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.742+0000 7f915c421640 1 -- 10.20.193.28:0/2376561298 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915414ef90 con 0x7f915410dce0 2026-02-20T13:31:26.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.742+0000 7f915c421640 1 -- 10.20.193.28:0/2376561298 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915414f380 con 0x7f915410dce0 2026-02-20T13:31:26.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.745+0000 7f913b7fe640 1 -- 10.20.193.28:0/2376561298 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9144048020 con 0x7f915410dce0 2026-02-20T13:31:26.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.746+0000 7f913b7fe640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91300b5760 0x7f91300d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.746+0000 7f913b7fe640 1 -- 10.20.193.28:0/2376561298 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f914410ac10 con 0x7f915410dce0 2026-02-20T13:31:26.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.746+0000 7f9159995640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91300b5760 0x7f91300d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f9159995640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91300b5760 0x7f91300d5c10 secure :-1 s=READY pgs=614 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9154163030 tx=0x7f9148009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:26.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f915e41be00 1 Processor -- start 2026-02-20T13:31:26.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f915e41be00 1 -- start start 2026-02-20T13:31:26.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f915e41be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cbee550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f915e41be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cbeea90 0x56549cc33400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f915e41be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cc33940 0x56549cc53d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f915e41be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56549cb047d0 con 0x56549cbee180 2026-02-20T13:31:26.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f915e41be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56549cb00500 con 0x56549cbeea90 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.747+0000 7f915e41be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56549cafa4a0 con 0x56549cc33940 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cbee550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f9159995640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cbeea90 0x56549cc33400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cbee550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36432/0 (socket says 10.20.193.28:36432) 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 -- 10.20.193.28:0/3255630795 learned_addr learned my addr 10.20.193.28:0/3255630795 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a997640 1 --2- 10.20.193.28:0/3255630795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cc33940 0x56549cc53d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 -- 10.20.193.28:0/3255630795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cc33940 msgr2=0x56549cc53d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 --2- 10.20.193.28:0/3255630795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cc33940 0x56549cc53d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 -- 10.20.193.28:0/3255630795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cbeea90 msgr2=0x56549cc33400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 --2- 10.20.193.28:0/3255630795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cbeea90 0x56549cc33400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 -- 10.20.193.28:0/3255630795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56549caa5d80 con 0x56549cbee180 2026-02-20T13:31:26.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915a196640 1 --2- 10.20.193.28:0/3255630795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cbee550 secure :-1 s=READY pgs=1471 gs=1 cs=0 l=1 c_cookie=14183542499451549396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91440ce290 tx=0x7f91440414b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d610c1707736d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f9138884640 1 -- 10.20.193.28:0/3255630795 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91440d0820 con 0x56549cbee180 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f9138884640 1 -- 10.20.193.28:0/3255630795 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9144005d40 con 0x56549cbee180 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f9138884640 1 -- 10.20.193.28:0/3255630795 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91440f60c0 con 0x56549cbee180 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915e41be00 1 -- 10.20.193.28:0/3255630795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 msgr2=0x56549cbee550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.748+0000 7f915e41be00 1 --2- 10.20.193.28:0/3255630795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cbee550 secure :-1 s=READY pgs=1471 gs=1 cs=0 l=1 c_cookie=14183542499451549396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91440ce290 tx=0x7f91440414b0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.749+0000 7f915e41be00 1 -- 10.20.193.28:0/3255630795 shutdown_connections 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.749+0000 7f915e41be00 1 --2- 10.20.193.28:0/3255630795 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cc33940 0x56549cc53d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.749+0000 7f915e41be00 1 --2- 10.20.193.28:0/3255630795 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cbeea90 0x56549cc33400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.749+0000 7f915e41be00 1 --2- 10.20.193.28:0/3255630795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cbee550 unknown :-1 s=CLOSED pgs=1471 gs=1 cs=0 l=1 c_cookie=14183542499451549396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.749+0000 7f915e41be00 1 -- 10.20.193.28:0/3255630795 >> 10.20.193.28:0/3255630795 conn(0x56549cbcc680 msgr2=0x56549cbeca60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:26.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.749+0000 7f915e41be00 1 -- 10.20.193.28:0/3255630795 shutdown_connections 2026-02-20T13:31:26.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.749+0000 7f915e41be00 1 -- 10.20.193.28:0/3255630795 wait complete. 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.750+0000 7f915e41be00 1 -- start start 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.750+0000 7f915e41be00 1 Processor -- start 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915e41be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc06490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915e41be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc069d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915e41be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc0b9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915e41be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56549cc0bf00 con 0x56549cbee180 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915e41be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56549cc0c070 con 0x56549cc33940 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915e41be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56549cc0c230 con 0x56549cbeea90 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc06490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc06490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36438/0 (socket says 10.20.193.28:36438) 2026-02-20T13:31:26.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 -- 10.20.193.28:0/3777863107 learned_addr learned my addr 10.20.193.28:0/3777863107 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a997640 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc0b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f9159995640 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 -- 10.20.193.28:0/3777863107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 msgr2=0x56549cc069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 -- 10.20.193.28:0/3777863107 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 msgr2=0x56549cc0b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc0b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 -- 10.20.193.28:0/3777863107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56549ca7e350 con 0x56549cbee180 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f915a196640 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc06490 secure :-1 s=READY pgs=1472 gs=1 cs=0 l=1 c_cookie=6288857097287542203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f914402fdb0 tx=0x7f91440046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57468235cf04a5bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f9107fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.751+0000 7f9107fff640 1 -- 10.20.193.28:0/3777863107 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9144096440 con 0x56549cbee180 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f9107fff640 1 -- 10.20.193.28:0/3777863107 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9144038e30 con 0x56549cbee180 2026-02-20T13:31:26.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f9107fff640 1 -- 10.20.193.28:0/3777863107 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91440dbc20 con 0x56549cbee180 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915414f380 con 0x56549cbee180 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f9107fff640 1 -- 10.20.193.28:0/3777863107 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f91440dbd80 con 0x56549cbee180 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 10 client.20562 _ll_register_callbacks cb 0x56549ca7b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56549c7906f0 con 0x56549cbee180 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f9107fff640 1 -- 10.20.193.28:0/3777863107 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f91440d6c90 con 0x56549cbee180 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 10 client.20562 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56549ca90150 con 0x56549cbee180 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f9107fff640 1 -- 10.20.193.28:0/3777863107 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f91440ef060 con 0x56549cbee180 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 10 client.20562 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 10 client.20562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 20 client.20562 populate_metadata read hostname 'trial028' 2026-02-20T13:31:26.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56549cc30670 0x56549cc30b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 4 client.20562 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.752+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56549cb07d60 con 0x56549cc30670 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.753+0000 7f9159995640 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56549cc30670 0x56549cc30b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.753+0000 7f9107fff640 10 client.20562 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.753+0000 7f9159995640 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56549cc30670 0x56549cc30b10 crc :-1 s=READY pgs=404 gs=4 cs=0 l=0 c_cookie=8001540362488341264 s_cookie=16129711456476285398 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f0b2e90d2116310 server_cookie=dfd83f1c5cd149d6 in_seq=0 out_seq=0 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f9107fff640 1 -- 10.20.193.28:0/3777863107 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56549cb07d60 con 0x56549cc30670 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f9107fff640 10 client.20562 handle_command_reply: tid=0 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 client.20562 shutdown 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 msgr2=0x56549cc06490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc06490 secure :-1 s=READY pgs=1472 gs=1 cs=0 l=1 c_cookie=6288857097287542203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f914402fdb0 tx=0x7f91440046e0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 shutdown_connections 2026-02-20T13:31:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56549cc30670 0x56549cc30b10 crc :-1 s=READY pgs=404 gs=4 cs=0 l=0 c_cookie=8001540362488341264 s_cookie=16129711456476285398 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc0b9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc069d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 --2- 10.20.193.28:0/3777863107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc06490 unknown :-1 s=CLOSED pgs=1472 gs=1 cs=0 l=1 c_cookie=6288857097287542203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 >> 10.20.193.28:0/3777863107 conn(0x56549cbcc680 msgr2=0x56549cbed250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f9107fff640 0 client.20562 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 shutdown_connections 2026-02-20T13:31:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.754+0000 7f915e41be00 1 -- 10.20.193.28:0/3777863107 wait complete. 2026-02-20T13:31:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.755+0000 7f915e41be00 20 client.20562 trim_cache size 0 max 16384 2026-02-20T13:31:26.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915e41be00 1 Processor -- start 2026-02-20T13:31:26.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915e41be00 1 -- start start 2026-02-20T13:31:26.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915e41be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbee180 0x56549cbf13b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915e41be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbeea90 0x56549cc0af30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915e41be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc03890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915e41be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56549caf80d0 con 0x56549cbeea90 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915e41be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56549c7b8700 con 0x56549cc33940 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915e41be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56549cbcc2f0 con 0x56549cbee180 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f9159995640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbeea90 0x56549cc0af30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a997640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc03890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a997640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc03890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33352/0 (socket says 10.20.193.28:33352) 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a997640 1 -- 10.20.193.28:0/228063673 learned_addr learned my addr 10.20.193.28:0/228063673 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a196640 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbee180 0x56549cbf13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a997640 1 -- 10.20.193.28:0/228063673 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbee180 msgr2=0x56549cbf13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:26.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a997640 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbee180 0x56549cbf13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a997640 1 -- 10.20.193.28:0/228063673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbeea90 msgr2=0x56549cc0af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a997640 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbeea90 0x56549cc0af30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a997640 1 -- 10.20.193.28:0/228063673 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56549ca8abd0 con 0x56549cc33940 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f915a196640 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbee180 0x56549cbf13b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.763+0000 7f9159995640 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbeea90 0x56549cc0af30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915a997640 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc03890 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=8589760474277720045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9150006f60 tx=0x7f9150004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7734f5a40f03afed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f91224e6640 1 -- 10.20.193.28:0/228063673 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915000ade0 con 0x56549cc33940 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f91224e6640 1 -- 10.20.193.28:0/228063673 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9150019040 con 0x56549cc33940 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f91224e6640 1 -- 10.20.193.28:0/228063673 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915001d8c0 con 0x56549cc33940 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 -- 10.20.193.28:0/228063673 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 msgr2=0x56549cc03890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc03890 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=8589760474277720045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9150006f60 tx=0x7f9150004d10 comp rx=0 tx=0).stop 2026-02-20T13:31:26.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 -- 10.20.193.28:0/228063673 shutdown_connections 2026-02-20T13:31:26.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbeea90 0x56549cc0af30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc03890 unknown :-1 s=CLOSED pgs=502 gs=1 cs=0 l=1 c_cookie=8589760474277720045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 --2- 10.20.193.28:0/228063673 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbee180 0x56549cbf13b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 -- 10.20.193.28:0/228063673 >> 10.20.193.28:0/228063673 conn(0x56549cbcc680 msgr2=0x56549cc0a820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:26.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 -- 10.20.193.28:0/228063673 shutdown_connections 2026-02-20T13:31:26.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.764+0000 7f915e41be00 1 -- 10.20.193.28:0/228063673 wait complete. 2026-02-20T13:31:26.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.765+0000 7f915e41be00 1 -- start start 2026-02-20T13:31:26.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.765+0000 7f915e41be00 1 Processor -- start 2026-02-20T13:31:26.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.765+0000 7f915e41be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc0dc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.765+0000 7f915e41be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc0e1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.765+0000 7f915e41be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc0e6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.765+0000 7f915e41be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56549cc98e60 con 0x56549cbee180 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.765+0000 7f915e41be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56549cc98fd0 con 0x56549cc33940 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.765+0000 7f915e41be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56549cc99190 con 0x56549cbeea90 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915a196640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc0dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f9159995640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc0e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f9159995640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc0e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43172/0 (socket says 10.20.193.28:43172) 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f9159995640 1 -- 10.20.193.28:0/761167304 learned_addr learned my addr 10.20.193.28:0/761167304 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915a997640 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc0e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915a196640 1 -- 10.20.193.28:0/761167304 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 msgr2=0x56549cc0e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915a196640 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc0e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915a196640 1 -- 10.20.193.28:0/761167304 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 msgr2=0x56549cc0e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915a196640 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc0e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915a196640 1 -- 10.20.193.28:0/761167304 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91500053a0 con 0x56549cbee180 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915a196640 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc0dc70 secure :-1 s=READY pgs=1473 gs=1 cs=0 l=1 c_cookie=11088062387127337075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91440dbf90 tx=0x7f91440dbfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e0b5fe78184073 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f9107fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f9107fff640 1 -- 10.20.193.28:0/761167304 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91440d6c90 con 0x56549cbee180 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f9107fff640 1 -- 10.20.193.28:0/761167304 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56549c7906f0 con 0x56549cbee180 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f9107fff640 1 -- 10.20.193.28:0/761167304 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9144096480 con 0x56549cbee180 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.766+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91480038f0 con 0x56549cbee180 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f9107fff640 1 -- 10.20.193.28:0/761167304 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f91440d9270 con 0x56549cbee180 2026-02-20T13:31:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 10 client.20568 _ll_register_callbacks cb 0x56549ca7b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56549c8524a0 con 0x56549cbee180 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f9107fff640 1 -- 10.20.193.28:0/761167304 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f91440b8050 con 0x56549cbee180 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 10 client.20568 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56549ca7e680 con 0x56549cbee180 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f9107fff640 1 -- 10.20.193.28:0/761167304 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f91440ef070 con 0x56549cbee180 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 10 client.20568 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 10 client.20568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 20 client.20568 populate_metadata read hostname 'trial028' 2026-02-20T13:31:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56549cce0b50 0x56549cd01000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 4 client.20568 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9144005d40 con 0x56549cce0b50 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.767+0000 7f9159995640 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56549cce0b50 0x56549cd01000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f9159995640 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56549cce0b50 0x56549cd01000 crc :-1 s=READY pgs=405 gs=4 cs=0 l=0 c_cookie=13334628189369577864 s_cookie=11576841992214378794 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b90e1db03748b188 server_cookie=a0a9347486c3792a in_seq=0 out_seq=0 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f9107fff640 10 client.20568 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f9107fff640 1 -- 10.20.193.28:0/761167304 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7102 (crc 0 0 0) 0x7f9144005d40 con 0x56549cce0b50 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f9107fff640 10 client.20568 handle_command_reply: tid=0 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 client.20568 shutdown 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 msgr2=0x56549cc0dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc0dc70 secure :-1 s=READY pgs=1473 gs=1 cs=0 l=1 c_cookie=11088062387127337075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91440dbf90 tx=0x7f91440dbfc0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 shutdown_connections 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56549cce0b50 0x56549cd01000 crc :-1 s=READY pgs=405 gs=4 cs=0 l=0 c_cookie=13334628189369577864 s_cookie=11576841992214378794 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56549cc33940 0x56549cc0e6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56549cbeea90 0x56549cc0e1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 --2- 10.20.193.28:0/761167304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56549cbee180 0x56549cc0dc70 unknown :-1 s=CLOSED pgs=1473 gs=1 cs=0 l=1 c_cookie=11088062387127337075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f9107fff640 0 client.20568 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 >> 10.20.193.28:0/761167304 conn(0x56549cbcc680 msgr2=0x56549cc0b010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 shutdown_connections 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 1 -- 10.20.193.28:0/761167304 wait complete. 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.768+0000 7f915e41be00 20 client.20568 trim_cache size 0 max 16384 2026-02-20T13:31:26.779 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "07bb91cb-dd88-47e7-8303-84c9b1588bc6", 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:31:26.780 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.781 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.782 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.783 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.784 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.785 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:55.786578+0000", 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:31:26.786 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:31:26.787 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.788 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.789 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:31:26.791 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:26.792 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 -- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91300b5760 msgr2=0x7f91300d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91300b5760 0x7f91300d5c10 secure :-1 s=READY pgs=614 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9154163030 tx=0x7f9148009310 comp rx=0 tx=0).stop 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 -- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 msgr2=0x7f915410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 0x7f915410d4d0 secure :-1 s=READY pgs=1470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91440023b0 tx=0x7f91440028d0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 -- 10.20.193.28:0/2376561298 shutdown_connections 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f91300b5760 0x7f91300d5c10 unknown :-1 s=CLOSED pgs=614 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9154153290 0x7f915410bf90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f915410e6d0 0x7f915410ba50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 --2- 10.20.193.28:0/2376561298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f915410dce0 0x7f915410d4d0 unknown :-1 s=CLOSED pgs=1470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 -- 10.20.193.28:0/2376561298 >> 10.20.193.28:0/2376561298 conn(0x7f91540e9670 msgr2=0x7f9154109a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:26.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 -- 10.20.193.28:0/2376561298 shutdown_connections 2026-02-20T13:31:26.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:26.769+0000 7f915c421640 1 -- 10.20.193.28:0/2376561298 wait complete. 2026-02-20T13:31:26.910 INFO:tasks.cephfs.filesystem:scrub status for tag:07bb91cb-dd88-47e7-8303-84c9b1588bc6 - {'path': '/', 'tag': '07bb91cb-dd88-47e7-8303-84c9b1588bc6', 'options': 'recursive,force'} 2026-02-20T13:31:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:26 trial127 ceph-mon[43817]: pgmap v604: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:26 trial034 ceph-mon[43332]: pgmap v604: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:31:27.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 -- 10.20.193.28:0/2995874993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 msgr2=0x7fae44060fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/2995874993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 0x7fae44060fd0 secure :-1 s=READY pgs=1474 gs=1 cs=0 l=1 c_cookie=1572436882608230796 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c009950 tx=0x7fae3c02f1b0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 -- 10.20.193.28:0/2995874993 shutdown_connections 2026-02-20T13:31:27.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/2995874993 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fae44150e50 0x7fae44171290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/2995874993 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fae44061510 0x7fae44061980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/2995874993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 0x7fae44060fd0 unknown :-1 s=CLOSED pgs=1474 gs=1 cs=0 l=1 c_cookie=1572436882608230796 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 -- 10.20.193.28:0/2995874993 >> 10.20.193.28:0/2995874993 conn(0x7fae440ea4c0 msgr2=0x7fae4410a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:27.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 -- 10.20.193.28:0/2995874993 shutdown_connections 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.117+0000 7fae4b5d2640 1 -- 10.20.193.28:0/2995874993 wait complete. 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4b5d2640 1 Processor -- start 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4b5d2640 1 -- start start 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4b5d2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fae44061510 0x7fae4415c690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4b5d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 0x7fae4415cce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4b5d2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fae44150e50 0x7fae4415d8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4b5d2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fae4415e020 con 0x7fae44062a40 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4b5d2640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fae4415e190 con 0x7fae44061510 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4b5d2640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fae4415e350 con 0x7fae44150e50 2026-02-20T13:31:27.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fae44061510 0x7fae4415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fae44061510 0x7fae4415c690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33368/0 (socket says 10.20.193.28:33368) 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae49dcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 0x7fae4415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1639246008 learned_addr learned my addr 10.20.193.28:0/1639246008 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.118+0000 7fae4add1640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fae44150e50 0x7fae4415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1639246008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fae44150e50 msgr2=0x7fae4415d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fae44150e50 0x7fae4415d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 msgr2=0x7fae4415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 0x7fae4415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1639246008 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c009570 con 0x7fae44061510 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae49dcf640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 0x7fae4415cce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fae44061510 0x7fae4415c690 secure :-1 s=READY pgs=503 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c02f6c0 tx=0x7fae3c0043d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae2f7fe640 1 -- 10.20.193.28:0/1639246008 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae3c03d070 con 0x7fae44061510 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae2f7fe640 1 -- 10.20.193.28:0/1639246008 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae3c038960 con 0x7fae44061510 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae2f7fe640 1 -- 10.20.193.28:0/1639246008 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae3c041a00 con 0x7fae44061510 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae4b5d2640 1 -- 10.20.193.28:0/1639246008 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4415e5d0 con 0x7fae44061510 2026-02-20T13:31:27.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.119+0000 7fae4b5d2640 1 -- 10.20.193.28:0/1639246008 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae4415eaf0 con 0x7fae44061510 2026-02-20T13:31:27.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.122+0000 7fae2f7fe640 1 -- 10.20.193.28:0/1639246008 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fae3c041b90 con 0x7fae44061510 2026-02-20T13:31:27.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.123+0000 7fae2f7fe640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fae200b5760 0x7fae200d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.124+0000 7fae2f7fe640 1 -- 10.20.193.28:0/1639246008 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fae3c10b150 con 0x7fae44061510 2026-02-20T13:31:27.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.124+0000 7fae49dcf640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fae200b5760 0x7fae200d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.124+0000 7fae49dcf640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fae200b5760 0x7fae200d5c10 secure :-1 s=READY pgs=616 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae30004740 tx=0x7fae30005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:27.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.124+0000 7fae4ee87e00 1 Processor -- start 2026-02-20T13:31:27.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.124+0000 7fae4ee87e00 1 -- start start 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b574c0 0x563898b778a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b981c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 0x563898bb8ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563898a6cfd0 con 0x563898b574c0 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563898a68d00 con 0x563898b77de0 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563898a62ca0 con 0x563898b98700 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b574c0 0x563898b778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b574c0 0x563898b778a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36496/0 (socket says 10.20.193.28:36496) 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1564118279 learned_addr learned my addr 10.20.193.28:0/1564118279 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae49dcf640 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4add1640 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 0x563898bb8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1564118279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 msgr2=0x563898bb8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:27.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 0x563898bb8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1564118279 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 msgr2=0x563898b981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1564118279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563898a058b0 con 0x563898b574c0 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b574c0 0x563898b778a0 secure :-1 s=READY pgs=1475 gs=1 cs=0 l=1 c_cookie=15228521307373919801 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c032040 tx=0x7fae3c041410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3569371e47d5e39 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae2cbfe640 1 -- 10.20.193.28:0/1564118279 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae3c0d71d0 con 0x563898b574c0 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae2cbfe640 1 -- 10.20.193.28:0/1564118279 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae3c0d97b0 con 0x563898b574c0 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae2cbfe640 1 -- 10.20.193.28:0/1564118279 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae3c0dc3e0 con 0x563898b574c0 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1564118279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b574c0 msgr2=0x563898b778a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.125+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b574c0 0x563898b778a0 secure :-1 s=READY pgs=1475 gs=1 cs=0 l=1 c_cookie=15228521307373919801 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c032040 tx=0x7fae3c041410 comp rx=0 tx=0).stop 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.126+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1564118279 shutdown_connections 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.126+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 0x563898bb8ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.126+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b981c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.126+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/1564118279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b574c0 0x563898b778a0 unknown :-1 s=CLOSED pgs=1475 gs=1 cs=0 l=1 c_cookie=15228521307373919801 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.126+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1564118279 >> 10.20.193.28:0/1564118279 conn(0x563898a761c0 msgr2=0x563898b55da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:27.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.126+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1564118279 shutdown_connections 2026-02-20T13:31:27.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.126+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1564118279 wait complete. 2026-02-20T13:31:27.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.127+0000 7fae4ee87e00 1 -- start start 2026-02-20T13:31:27.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.127+0000 7fae4ee87e00 1 Processor -- start 2026-02-20T13:31:27.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.127+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b70930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.127+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b70f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.127+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b98700 0x563898b71940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.127+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563898b71fa0 con 0x563898b98700 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.127+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563898b72110 con 0x563898b77de0 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.127+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563898b722d0 con 0x563898b574c0 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b70930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b70930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43214/0 (socket says 10.20.193.28:43214) 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 -- 10.20.193.28:0/2860591430 learned_addr learned my addr 10.20.193.28:0/2860591430 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae49dcf640 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b70f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4add1640 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b98700 0x563898b71940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 -- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 msgr2=0x563898b70f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b70f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 -- 10.20.193.28:0/2860591430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b98700 msgr2=0x563898b71940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b98700 0x563898b71940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 -- 10.20.193.28:0/2860591430 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563898a0e400 con 0x563898b574c0 2026-02-20T13:31:27.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae49dcf640 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b70f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b70930 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=3314881912056378134 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c0d14f0 tx=0x7fae3c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e00d389387cf316 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fadf7fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fadf7fff640 1 -- 10.20.193.28:0/2860591430 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae3c0dc5f0 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae4415eaf0 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fadf7fff640 1 -- 10.20.193.28:0/2860591430 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae3c0cd9d0 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fadf7fff640 1 -- 10.20.193.28:0/2860591430 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae3c0d0850 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4ee87e00 10 client.30355 _ll_register_callbacks cb 0x5638989eda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.128+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563898702520 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fadf7fff640 1 -- 10.20.193.28:0/2860591430 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fae3c0d0a20 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fadf7fff640 1 -- 10.20.193.28:0/2860591430 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fae3c0d02c0 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae4ee87e00 10 client.30355 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5638989e6da0 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fadf7fff640 1 -- 10.20.193.28:0/2860591430 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fae3c0d0460 con 0x563898b574c0 2026-02-20T13:31:27.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae4ee87e00 10 client.30355 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae4ee87e00 10 client.30355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae4ee87e00 20 client.30355 populate_metadata read hostname 'trial028' 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563898b74cb0 0x563898b75150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae4ee87e00 4 client.30355 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563898a94630 con 0x563898b74cb0 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.129+0000 7fae49dcf640 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563898b74cb0 0x563898b75150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae49dcf640 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563898b74cb0 0x563898b75150 crc :-1 s=READY pgs=406 gs=4 cs=0 l=0 c_cookie=12333925409762127588 s_cookie=5347851222476377789 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab2ae7cfef092ee4 server_cookie=4a37625a4b57cebd in_seq=0 out_seq=0 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fadf7fff640 10 client.30355 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fadf7fff640 1 -- 10.20.193.28:0/2860591430 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563898a94630 con 0x563898b74cb0 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fadf7fff640 10 client.30355 handle_command_reply: tid=0 2026-02-20T13:31:27.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 client.30355 shutdown 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 msgr2=0x563898b70930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b70930 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=3314881912056378134 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c0d14f0 tx=0x7fae3c009310 comp rx=0 tx=0).stop 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 shutdown_connections 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563898b74cb0 0x563898b75150 crc :-1 s=READY pgs=406 gs=4 cs=0 l=0 c_cookie=12333925409762127588 s_cookie=5347851222476377789 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b98700 0x563898b71940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b77de0 0x563898b70f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fadf7fff640 0 client.30355 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/2860591430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b70930 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=3314881912056378134 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 >> 10.20.193.28:0/2860591430 conn(0x563898a761c0 msgr2=0x563898b58790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 shutdown_connections 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.130+0000 7fae4ee87e00 1 -- 10.20.193.28:0/2860591430 wait complete. 2026-02-20T13:31:27.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.131+0000 7fae4ee87e00 20 client.30355 trim_cache size 0 max 16384 2026-02-20T13:31:27.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4ee87e00 1 Processor -- start 2026-02-20T13:31:27.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4ee87e00 1 -- start start 2026-02-20T13:31:27.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b707c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b627d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b98700 0x563898b965c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563898a608d0 con 0x563898b77de0 2026-02-20T13:31:27.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5638987a1f10 con 0x563898b98700 2026-02-20T13:31:27.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563898a68d00 con 0x563898b574c0 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae49dcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43220/0 (socket says 10.20.193.28:43220) 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1813042241 learned_addr learned my addr 10.20.193.28:0/1813042241 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4add1640 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b98700 0x563898b965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1813042241 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b98700 msgr2=0x563898b965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b98700 0x563898b965c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1813042241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 msgr2=0x563898b627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae4a5d0640 1 -- 10.20.193.28:0/1813042241 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563898b62fa0 con 0x563898b574c0 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.139+0000 7fae49dcf640 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b627d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:27.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b707c0 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=13366952127817566689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c005b30 tx=0x7fae3c0ea000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b980f4239c37c9e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae123ff640 1 -- 10.20.193.28:0/1813042241 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae3c0d0850 con 0x563898b574c0 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae123ff640 1 -- 10.20.193.28:0/1813042241 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae3c0f0030 con 0x563898b574c0 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae123ff640 1 -- 10.20.193.28:0/1813042241 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae3c0cd860 con 0x563898b574c0 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1813042241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 msgr2=0x563898b707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b707c0 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=13366952127817566689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c005b30 tx=0x7fae3c0ea000 comp rx=0 tx=0).stop 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1813042241 shutdown_connections 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b627d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b98700 0x563898b965c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/1813042241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b574c0 0x563898b707c0 unknown :-1 s=CLOSED pgs=416 gs=1 cs=0 l=1 c_cookie=13366952127817566689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1813042241 >> 10.20.193.28:0/1813042241 conn(0x563898a761c0 msgr2=0x563898b6cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1813042241 shutdown_connections 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.140+0000 7fae4ee87e00 1 -- 10.20.193.28:0/1813042241 wait complete. 2026-02-20T13:31:27.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4ee87e00 1 -- start start 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4ee87e00 1 Processor -- start 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b574c0 0x563898b7ad20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b7b260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4ee87e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 0x563898b7bfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563898b55ce0 con 0x563898b77de0 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563898b7c510 con 0x563898b574c0 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4ee87e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563898b7c6d0 con 0x563898b98700 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae49dcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b7b260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4a5d0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b574c0 0x563898b7ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae4add1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 0x563898b7bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae49dcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b7b260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36528/0 (socket says 10.20.193.28:36528) 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.141+0000 7fae49dcf640 1 -- 10.20.193.28:0/3000451525 learned_addr learned my addr 10.20.193.28:0/3000451525 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae49dcf640 1 -- 10.20.193.28:0/3000451525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 msgr2=0x563898b7bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae49dcf640 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 0x563898b7bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae49dcf640 1 -- 10.20.193.28:0/3000451525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b574c0 msgr2=0x563898b7ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae49dcf640 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b574c0 0x563898b7ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae49dcf640 1 -- 10.20.193.28:0/3000451525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638989e6da0 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae49dcf640 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b7b260 secure :-1 s=READY pgs=1476 gs=1 cs=0 l=1 c_cookie=17150742980035683773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae300118e0 tx=0x7fae300047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee03addf2f0d25bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fadf7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fadf7fff640 1 -- 10.20.193.28:0/3000451525 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae30021030 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fadf7fff640 1 -- 10.20.193.28:0/3000451525 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae30022040 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae30003de0 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae4ee87e00 10 client.20586 _ll_register_callbacks cb 0x5638989eda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fadf7fff640 1 -- 10.20.193.28:0/3000451525 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae30005430 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563898b12ca0 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fadf7fff640 1 -- 10.20.193.28:0/3000451525 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fae300055c0 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fadf7fff640 1 -- 10.20.193.28:0/3000451525 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fae30029b50 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae4ee87e00 10 client.20586 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.142+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5638989f8670 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.143+0000 7fadf7fff640 1 -- 10.20.193.28:0/3000451525 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fae30004850 con 0x563898b77de0 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.143+0000 7fae4ee87e00 10 client.20586 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.143+0000 7fae4ee87e00 10 client.20586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.143+0000 7fae4ee87e00 20 client.20586 populate_metadata read hostname 'trial028' 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.143+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563898c45240 0x563898c656d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.143+0000 7fae4ee87e00 4 client.20586 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:31:27.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.143+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563898746640 con 0x563898c45240 2026-02-20T13:31:27.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.143+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563898c45240 0x563898c656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:27.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.144+0000 7fae4a5d0640 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563898c45240 0x563898c656d0 crc :-1 s=READY pgs=407 gs=4 cs=0 l=0 c_cookie=13706410522354698099 s_cookie=16636359837303711103 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be36f3c01aa0c773 server_cookie=e6e03920fa10257f in_seq=0 out_seq=0 2026-02-20T13:31:27.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.144+0000 7fadf7fff640 10 client.20586 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:27.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fadf7fff640 1 -- 10.20.193.28:0/3000451525 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563898746640 con 0x563898c45240 2026-02-20T13:31:27.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fadf7fff640 10 client.20586 handle_command_reply: tid=0 2026-02-20T13:31:27.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 client.20586 shutdown 2026-02-20T13:31:27.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 msgr2=0x563898b7b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b7b260 secure :-1 s=READY pgs=1476 gs=1 cs=0 l=1 c_cookie=17150742980035683773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae300118e0 tx=0x7fae300047e0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 shutdown_connections 2026-02-20T13:31:27.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563898c45240 0x563898c656d0 crc :-1 s=READY pgs=407 gs=4 cs=0 l=0 c_cookie=13706410522354698099 s_cookie=16636359837303711103 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563898b77de0 0x563898b7b260 unknown :-1 s=CLOSED pgs=1476 gs=1 cs=0 l=1 c_cookie=17150742980035683773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563898b98700 0x563898b7bfd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 --2- 10.20.193.28:0/3000451525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563898b574c0 0x563898b7ad20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fadf7fff640 0 client.20586 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 >> 10.20.193.28:0/3000451525 conn(0x563898a761c0 msgr2=0x563898b6cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 shutdown_connections 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 1 -- 10.20.193.28:0/3000451525 wait complete. 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.147+0000 7fae4ee87e00 20 client.20586 trim_cache size 0 max 16384 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 -- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fae200b5760 msgr2=0x7fae200d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fae200b5760 0x7fae200d5c10 secure :-1 s=READY pgs=616 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae30004740 tx=0x7fae30005f90 comp rx=0 tx=0).stop 2026-02-20T13:31:27.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 -- 10.20.193.28:0/1639246008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fae44061510 msgr2=0x7fae4415c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fae44061510 0x7fae4415c690 secure :-1 s=READY pgs=503 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae3c02f6c0 tx=0x7fae3c0043d0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 -- 10.20.193.28:0/1639246008 shutdown_connections 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fae200b5760 0x7fae200d5c10 unknown :-1 s=CLOSED pgs=616 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae44062a40 0x7fae4415cce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fae44150e50 0x7fae4415d8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 --2- 10.20.193.28:0/1639246008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fae44061510 0x7fae4415c690 unknown :-1 s=CLOSED pgs=503 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 -- 10.20.193.28:0/1639246008 >> 10.20.193.28:0/1639246008 conn(0x7fae440ea4c0 msgr2=0x7fae4410a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 -- 10.20.193.28:0/1639246008 shutdown_connections 2026-02-20T13:31:27.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:27.148+0000 7fae4b5d2640 1 -- 10.20.193.28:0/1639246008 wait complete. 2026-02-20T13:31:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:28 trial127 ceph-mon[43817]: pgmap v605: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:31:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:28 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:31:28.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:28 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:31:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:28 trial034 ceph-mon[43332]: pgmap v605: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:31:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:28 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:31:28.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:28 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:31:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:28 trial028 ceph-mon[37442]: pgmap v605: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2026-02-20T13:31:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:28 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:31:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:28 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:31:29.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:29 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:31:29.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:29 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:31:30.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:29 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:31:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:30 trial127 ceph-mon[43817]: pgmap v606: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2026-02-20T13:31:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:30 trial034 ceph-mon[43332]: pgmap v606: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2026-02-20T13:31:31.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:30 trial028 ceph-mon[37442]: pgmap v606: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2026-02-20T13:31:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:32 trial127 ceph-mon[43817]: pgmap v607: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:31:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:32 trial034 ceph-mon[43332]: pgmap v607: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:31:33.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:32 trial028 ceph-mon[37442]: pgmap v607: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:31:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:34 trial127 ceph-mon[43817]: pgmap v608: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2026-02-20T13:31:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:34 trial034 ceph-mon[43332]: pgmap v608: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2026-02-20T13:31:35.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:34 trial028 ceph-mon[37442]: pgmap v608: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2026-02-20T13:31:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:36 trial127 ceph-mon[43817]: pgmap v609: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2026-02-20T13:31:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:36 trial034 ceph-mon[43332]: pgmap v609: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2026-02-20T13:31:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:36 trial028 ceph-mon[37442]: pgmap v609: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2026-02-20T13:31:38.902 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:38 trial028 ceph-mon[37442]: pgmap v610: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2026-02-20T13:31:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:38 trial127 ceph-mon[43817]: pgmap v610: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2026-02-20T13:31:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:38 trial034 ceph-mon[43332]: pgmap v610: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2026-02-20T13:31:40.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 -- 10.20.193.28:0/1782501739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010d4b0 msgr2=0x7f08c016f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1782501739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010d4b0 0x7f08c016f240 secure :-1 s=READY pgs=504 gs=3 cs=0 l=1 c_cookie=10369149965493825363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc00a970 tx=0x7f08bc0301b0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 -- 10.20.193.28:0/1782501739 shutdown_connections 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1782501739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010cb00 0x7f08c010cf70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1782501739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010d4b0 0x7f08c016f240 unknown :-1 s=CLOSED pgs=504 gs=3 cs=0 l=1 c_cookie=10369149965493825363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1782501739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010e270 0x7f08c010e660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 -- 10.20.193.28:0/1782501739 >> 10.20.193.28:0/1782501739 conn(0x7f08c00ea4c0 msgr2=0x7f08c010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 -- 10.20.193.28:0/1782501739 shutdown_connections 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.223+0000 7f08c5a83640 1 -- 10.20.193.28:0/1782501739 wait complete. 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c5a83640 1 Processor -- start 2026-02-20T13:31:40.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c5a83640 1 -- start start 2026-02-20T13:31:40.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c5a83640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010cb00 0x7f08c00f9050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c5a83640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010d4b0 0x7f08c016f220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c5a83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010e270 0x7f08c00f9890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c5a83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f08c00fa4f0 con 0x7f08c010e270 2026-02-20T13:31:40.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c5a83640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f08c00fa660 con 0x7f08c010cb00 2026-02-20T13:31:40.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c5a83640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f08c00fa820 con 0x7f08c010d4b0 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.224+0000 7f08c4a81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010cb00 0x7f08c00f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5282640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010e270 0x7f08c00f9890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c4a81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010cb00 0x7f08c00f9050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50962/0 (socket says 10.20.193.28:50962) 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c4a81640 1 -- 10.20.193.28:0/1167127425 learned_addr learned my addr 10.20.193.28:0/1167127425 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08b7fff640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010d4b0 0x7f08c016f220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5282640 1 -- 10.20.193.28:0/1167127425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010d4b0 msgr2=0x7f08c016f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5282640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010d4b0 0x7f08c016f220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5282640 1 -- 10.20.193.28:0/1167127425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010cb00 msgr2=0x7f08c00f9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5282640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010cb00 0x7f08c00f9050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5282640 1 -- 10.20.193.28:0/1167127425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc00a590 con 0x7f08c010e270 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c4a81640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010cb00 0x7f08c00f9050 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:40.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5282640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010e270 0x7f08c00f9890 secure :-1 s=READY pgs=1477 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc00a970 tx=0x7f08bc003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:40.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08b5ffb640 1 -- 10.20.193.28:0/1167127425 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08bc03e070 con 0x7f08c010e270 2026-02-20T13:31:40.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08b5ffb640 1 -- 10.20.193.28:0/1167127425 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f08bc005510 con 0x7f08c010e270 2026-02-20T13:31:40.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5a83640 1 -- 10.20.193.28:0/1167127425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c00faaa0 con 0x7f08c010e270 2026-02-20T13:31:40.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08b5ffb640 1 -- 10.20.193.28:0/1167127425 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08bc0429b0 con 0x7f08c010e270 2026-02-20T13:31:40.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.225+0000 7f08c5a83640 1 -- 10.20.193.28:0/1167127425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c00faec0 con 0x7f08c010e270 2026-02-20T13:31:40.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.228+0000 7f08b5ffb640 1 -- 10.20.193.28:0/1167127425 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f08bc04a060 con 0x7f08c010e270 2026-02-20T13:31:40.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.230+0000 7f08b5ffb640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b56e0 0x7f089c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.230+0000 7f08b5ffb640 1 -- 10.20.193.28:0/1167127425 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f08bc10c3f0 con 0x7f08c010e270 2026-02-20T13:31:40.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.230+0000 7f08c4a81640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b56e0 0x7f089c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.230+0000 7f08c9437e00 1 Processor -- start 2026-02-20T13:31:40.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.230+0000 7f08c9437e00 1 -- start start 2026-02-20T13:31:40.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e1843f8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e184601c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18480ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c9437e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564e18334fd0 con 0x564e1841f4c0 2026-02-20T13:31:40.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c9437e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564e18330d00 con 0x564e18460700 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c9437e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564e1832aca0 con 0x564e1843fde0 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b56e0 0x7f089c0d5b90 secure :-1 s=READY pgs=619 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b00095b0 tx=0x7f08b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e1843f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e1843f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33046/0 (socket says 10.20.193.28:33046) 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 -- 10.20.193.28:0/4055346351 learned_addr learned my addr 10.20.193.28:0/4055346351 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08b7fff640 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e184601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c5282640 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18480ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 -- 10.20.193.28:0/4055346351 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 msgr2=0x564e184601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e184601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 -- 10.20.193.28:0/4055346351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 msgr2=0x564e18480ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:40.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18480ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 -- 10.20.193.28:0/4055346351 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e182cd8b0 con 0x564e1841f4c0 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c5282640 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18480ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f08c4a81640 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e1843f8a0 secure :-1 s=READY pgs=1478 gs=1 cs=0 l=1 c_cookie=571007030214859251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b0009e00 tx=0x7f08b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec9fde603519f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f088cffe640 1 -- 10.20.193.28:0/4055346351 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b0004850 con 0x564e1841f4c0 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f088cffe640 1 -- 10.20.193.28:0/4055346351 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f08b0004e90 con 0x564e1841f4c0 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.231+0000 7f088cffe640 1 -- 10.20.193.28:0/4055346351 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b001ca70 con 0x564e1841f4c0 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 -- 10.20.193.28:0/4055346351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 msgr2=0x564e1843f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e1843f8a0 secure :-1 s=READY pgs=1478 gs=1 cs=0 l=1 c_cookie=571007030214859251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b0009e00 tx=0x7f08b0014000 comp rx=0 tx=0).stop 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 -- 10.20.193.28:0/4055346351 shutdown_connections 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18480ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e184601c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4055346351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e1843f8a0 unknown :-1 s=CLOSED pgs=1478 gs=1 cs=0 l=1 c_cookie=571007030214859251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 -- 10.20.193.28:0/4055346351 >> 10.20.193.28:0/4055346351 conn(0x564e1833e1c0 msgr2=0x564e1841dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:40.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 -- 10.20.193.28:0/4055346351 shutdown_connections 2026-02-20T13:31:40.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.232+0000 7f08c9437e00 1 -- 10.20.193.28:0/4055346351 wait complete. 2026-02-20T13:31:40.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.233+0000 7f08c9437e00 1 -- start start 2026-02-20T13:31:40.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.233+0000 7f08c9437e00 1 Processor -- start 2026-02-20T13:31:40.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18438aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e184390f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18439b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c9437e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564e1843a1b0 con 0x564e1841f4c0 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c9437e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564e1843a320 con 0x564e18460700 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c9437e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564e1843a4e0 con 0x564e1843fde0 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18439b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18439b50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:50986/0 (socket says 10.20.193.28:50986) 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 -- 10.20.193.28:0/3819480665 learned_addr learned my addr 10.20.193.28:0/3819480665 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c4a81640 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18438aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08b7fff640 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e184390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 -- 10.20.193.28:0/3819480665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 msgr2=0x564e184390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e184390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 -- 10.20.193.28:0/3819480665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 msgr2=0x564e18438aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18438aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 -- 10.20.193.28:0/3819480665 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e182aeda0 con 0x564e18460700 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c5282640 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18439b50 secure :-1 s=READY pgs=505 gs=2 cs=0 l=1 c_cookie=1707843555099610816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc0cf9c0 tx=0x7f08bc00a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b37aaa31a70ec0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f0885ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f0885ffb640 1 -- 10.20.193.28:0/3819480665 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08bc0d8070 con 0x564e18460700 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f0885ffb640 1 -- 10.20.193.28:0/3819480665 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f08bc0d2130 con 0x564e18460700 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f0885ffb640 1 -- 10.20.193.28:0/3819480665 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08bc0dd680 con 0x564e18460700 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.234+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e182d6400 con 0x564e18460700 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f0885ffb640 1 -- 10.20.193.28:0/3819480665 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f08bc0dd890 con 0x564e18460700 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 10 client.30515 _ll_register_callbacks cb 0x564e182b5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e17fca520 con 0x564e18460700 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f0885ffb640 1 -- 10.20.193.28:0/3819480665 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f08bc006c40 con 0x564e18460700 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 10 client.30515 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:40.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564e182c0670 con 0x564e18460700 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f0885ffb640 1 -- 10.20.193.28:0/3819480665 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f08bc0d33e0 con 0x564e18460700 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 10 client.30515 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 10 client.30515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 20 client.30515 populate_metadata read hostname 'trial028' 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e1843cec0 0x564e1843d360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 4 client.30515 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e1835c630 con 0x564e1843cec0 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.235+0000 7f08c4a81640 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e1843cec0 0x564e1843d360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.236+0000 7f08c4a81640 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e1843cec0 0x564e1843d360 crc :-1 s=READY pgs=409 gs=4 cs=0 l=0 c_cookie=9796330204376482541 s_cookie=15235473925990945571 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87f38e6aee4a42ed server_cookie=d36f46d08f6a9323 in_seq=0 out_seq=0 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.236+0000 7f0885ffb640 10 client.30515 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.236+0000 7f0885ffb640 1 -- 10.20.193.28:0/3819480665 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564e1835c630 con 0x564e1843cec0 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.236+0000 7f0885ffb640 10 client.30515 handle_command_reply: tid=0 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.236+0000 7f08c9437e00 1 client.30515 shutdown 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.236+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 msgr2=0x564e18439b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.236+0000 7f08c9437e00 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18439b50 secure :-1 s=READY pgs=505 gs=2 cs=0 l=1 c_cookie=1707843555099610816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc0cf9c0 tx=0x7f08bc00a310 comp rx=0 tx=0).stop 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 shutdown_connections 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e1843cec0 0x564e1843d360 crc :-1 s=READY pgs=409 gs=4 cs=0 l=0 c_cookie=9796330204376482541 s_cookie=15235473925990945571 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e18439b50 unknown :-1 s=CLOSED pgs=505 gs=2 cs=0 l=1 c_cookie=1707843555099610816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e184390f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 1 --2- 10.20.193.28:0/3819480665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18438aa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f0885ffb640 0 client.30515 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:40.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 >> 10.20.193.28:0/3819480665 conn(0x564e1833e1c0 msgr2=0x564e18420790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:40.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 shutdown_connections 2026-02-20T13:31:40.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 1 -- 10.20.193.28:0/3819480665 wait complete. 2026-02-20T13:31:40.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.237+0000 7f08c9437e00 20 client.30515 trim_cache size 0 max 16384 2026-02-20T13:31:40.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.244+0000 7f08c9437e00 1 Processor -- start 2026-02-20T13:31:40.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.244+0000 7f08c9437e00 1 -- start start 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.244+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18435dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.244+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e18436310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.244+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e1845e5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.244+0000 7f08c9437e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564e183288d0 con 0x564e1841f4c0 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.244+0000 7f08c9437e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564e18069f10 con 0x564e18460700 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.244+0000 7f08c9437e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564e18431b80 con 0x564e1843fde0 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c4a81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18435dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c5282640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e1845e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c4a81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18435dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33054/0 (socket says 10.20.193.28:33054) 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c4a81640 1 -- 10.20.193.28:0/490074680 learned_addr learned my addr 10.20.193.28:0/490074680 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:40.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08b7fff640 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e18436310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c5282640 1 -- 10.20.193.28:0/490074680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 msgr2=0x564e18436310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c5282640 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e18436310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c5282640 1 -- 10.20.193.28:0/490074680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 msgr2=0x564e18435dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c5282640 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18435dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c5282640 1 -- 10.20.193.28:0/490074680 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e182bb0f0 con 0x564e18460700 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c4a81640 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18435dd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c5282640 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e1845e5c0 secure :-1 s=READY pgs=506 gs=3 cs=0 l=1 c_cookie=10923986905711727181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc109f20 tx=0x7f08bc032050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9799cc3685f7524d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f0887fff640 1 -- 10.20.193.28:0/490074680 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08bc0d8040 con 0x564e18460700 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f0887fff640 1 -- 10.20.193.28:0/490074680 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564e17fca520 con 0x564e18460700 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c9437e00 1 -- 10.20.193.28:0/490074680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 msgr2=0x564e1845e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.245+0000 7f08c9437e00 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e1845e5c0 secure :-1 s=READY pgs=506 gs=3 cs=0 l=1 c_cookie=10923986905711727181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc109f20 tx=0x7f08bc032050 comp rx=0 tx=0).stop 2026-02-20T13:31:40.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 -- 10.20.193.28:0/490074680 shutdown_connections 2026-02-20T13:31:40.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e18460700 0x564e1845e5c0 unknown :-1 s=CLOSED pgs=506 gs=3 cs=0 l=1 c_cookie=10923986905711727181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e1843fde0 0x564e18436310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 --2- 10.20.193.28:0/490074680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1841f4c0 0x564e18435dd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 -- 10.20.193.28:0/490074680 >> 10.20.193.28:0/490074680 conn(0x564e1833e1c0 msgr2=0x564e18438910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:40.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 -- 10.20.193.28:0/490074680 shutdown_connections 2026-02-20T13:31:40.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 -- 10.20.193.28:0/490074680 wait complete. 2026-02-20T13:31:40.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 -- start start 2026-02-20T13:31:40.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 Processor -- start 2026-02-20T13:31:40.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e1841f4c0 0x564e184414e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1843fde0 0x564e18441a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e18460700 0x564e18442110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564e18439320 con 0x564e1843fde0 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564e18442840 con 0x564e1841f4c0 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.246+0000 7f08c9437e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564e18442a00 con 0x564e18460700 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e1841f4c0 0x564e184414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e1841f4c0 0x564e184414e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:51000/0 (socket says 10.20.193.28:51000) 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 -- 10.20.193.28:0/4182000799 learned_addr learned my addr 10.20.193.28:0/4182000799 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c5282640 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e18460700 0x564e18442110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08b7fff640 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1843fde0 0x564e18441a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 -- 10.20.193.28:0/4182000799 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e18460700 msgr2=0x564e18442110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e18460700 0x564e18442110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 -- 10.20.193.28:0/4182000799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1843fde0 msgr2=0x564e18441a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1843fde0 0x564e18441a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 -- 10.20.193.28:0/4182000799 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e182d6400 con 0x564e1841f4c0 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c4a81640 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e1841f4c0 0x564e184414e0 secure :-1 s=READY pgs=507 gs=1 cs=0 l=1 c_cookie=1259540150223223941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b001c790 tx=0x7f08b001c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117ac917e265bc85 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f0885ffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f0885ffb640 1 -- 10.20.193.28:0/4182000799 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b0038070 con 0x564e1841f4c0 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f0885ffb640 1 -- 10.20.193.28:0/4182000799 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f08b001c860 con 0x564e1841f4c0 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e182cd8b0 con 0x564e1841f4c0 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f0885ffb640 1 -- 10.20.193.28:0/4182000799 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08b0030740 con 0x564e1841f4c0 2026-02-20T13:31:40.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.247+0000 7f0885ffb640 1 -- 10.20.193.28:0/4182000799 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f08b00308a0 con 0x564e1841f4c0 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 10 client.30521 _ll_register_callbacks cb 0x564e182b5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e183daca0 con 0x564e1841f4c0 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f0885ffb640 1 -- 10.20.193.28:0/4182000799 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f08b001c9d0 con 0x564e1841f4c0 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 10 client.30521 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564e182af0d0 con 0x564e1841f4c0 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f0885ffb640 1 -- 10.20.193.28:0/4182000799 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f08b0030aa0 con 0x564e1841f4c0 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 10 client.30521 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 10 client.30521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 20 client.30521 populate_metadata read hostname 'trial028' 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e18444920 0x564e18444dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 4 client.30521 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:31:40.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e1800e640 con 0x564e18444920 2026-02-20T13:31:40.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.248+0000 7f08b7fff640 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e18444920 0x564e18444dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:40.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.249+0000 7f08b7fff640 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e18444920 0x564e18444dc0 crc :-1 s=READY pgs=410 gs=4 cs=0 l=0 c_cookie=544936570136383904 s_cookie=14937270838386349658 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79000ec601951a0 server_cookie=cf4bd8afbbd1d65a in_seq=0 out_seq=0 2026-02-20T13:31:40.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.249+0000 7f0885ffb640 10 client.30521 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:40.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f0885ffb640 1 -- 10.20.193.28:0/4182000799 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e1800e640 con 0x564e18444920 2026-02-20T13:31:40.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f0885ffb640 10 client.30521 handle_command_reply: tid=0 2026-02-20T13:31:40.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 client.30521 shutdown 2026-02-20T13:31:40.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e1841f4c0 msgr2=0x564e184414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e1841f4c0 0x564e184414e0 secure :-1 s=READY pgs=507 gs=1 cs=0 l=1 c_cookie=1259540150223223941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b001c790 tx=0x7f08b001c7c0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 shutdown_connections 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x564e18444920 0x564e18444dc0 crc :-1 s=READY pgs=410 gs=4 cs=0 l=0 c_cookie=544936570136383904 s_cookie=14937270838386349658 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564e1843fde0 0x564e18441a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x564e18460700 0x564e18442110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 --2- 10.20.193.28:0/4182000799 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x564e1841f4c0 0x564e184414e0 unknown :-1 s=CLOSED pgs=507 gs=1 cs=0 l=1 c_cookie=1259540150223223941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f0885ffb640 0 client.30521 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 >> 10.20.193.28:0/4182000799 conn(0x564e1833e1c0 msgr2=0x564e18434dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 shutdown_connections 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 1 -- 10.20.193.28:0/4182000799 wait complete. 2026-02-20T13:31:40.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c9437e00 20 client.30521 trim_cache size 0 max 16384 2026-02-20T13:31:40.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:31:40.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:31:40.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:31:40.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c5a83640 1 -- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b56e0 msgr2=0x7f089c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b56e0 0x7f089c0d5b90 secure :-1 s=READY pgs=619 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08b00095b0 tx=0x7f08b0005f90 comp rx=0 tx=0).stop 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c5a83640 1 -- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010e270 msgr2=0x7f08c00f9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.253+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010e270 0x7f08c00f9890 secure :-1 s=READY pgs=1477 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08bc00a970 tx=0x7f08bc003780 comp rx=0 tx=0).stop 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.254+0000 7f08c5a83640 1 -- 10.20.193.28:0/1167127425 shutdown_connections 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.254+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f089c0b56e0 0x7f089c0d5b90 unknown :-1 s=CLOSED pgs=619 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.254+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f08c010e270 0x7f08c00f9890 unknown :-1 s=CLOSED pgs=1477 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.254+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f08c010d4b0 0x7f08c016f220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.254+0000 7f08c5a83640 1 --2- 10.20.193.28:0/1167127425 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f08c010cb00 0x7f08c00f9050 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:40.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.254+0000 7f08c5a83640 1 -- 10.20.193.28:0/1167127425 >> 10.20.193.28:0/1167127425 conn(0x7f08c00ea4c0 msgr2=0x7f08c00ec960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:40.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.254+0000 7f08c5a83640 1 -- 10.20.193.28:0/1167127425 shutdown_connections 2026-02-20T13:31:40.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:40.254+0000 7f08c5a83640 1 -- 10.20.193.28:0/1167127425 wait complete. 2026-02-20T13:31:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:40 trial127 ceph-mon[43817]: pgmap v611: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-20T13:31:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:40 trial034 ceph-mon[43332]: pgmap v611: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-20T13:31:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:40 trial028 ceph-mon[37442]: pgmap v611: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-20T13:31:42.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:42 trial127 ceph-mon[43817]: pgmap v612: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2026-02-20T13:31:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:42 trial034 ceph-mon[43332]: pgmap v612: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2026-02-20T13:31:43.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:42 trial028 ceph-mon[37442]: pgmap v612: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2026-02-20T13:31:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:44 trial127 ceph-mon[43817]: pgmap v613: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-20T13:31:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:44 trial034 ceph-mon[43332]: pgmap v613: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-20T13:31:45.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:44 trial028 ceph-mon[37442]: pgmap v613: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-20T13:31:45.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:31:45.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:31:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:31:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:31:45.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:31:45.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:31:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:31:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:31:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:31:45.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:31:46.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:31:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:31:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:31:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:31:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:31:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:46 trial127 ceph-mon[43817]: pgmap v614: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:31:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:46 trial034 ceph-mon[43332]: pgmap v614: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:31:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:46 trial028 ceph-mon[37442]: pgmap v614: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2026-02-20T13:31:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:48 trial127 ceph-mon[43817]: pgmap v615: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:31:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:48 trial034 ceph-mon[43332]: pgmap v615: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:31:49.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:48 trial028 ceph-mon[37442]: pgmap v615: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2026-02-20T13:31:50.769 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:31:50.954 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:50 trial127 ceph-mon[43817]: pgmap v616: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:31:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:50 trial034 ceph-mon[43332]: pgmap v616: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:31:50.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:50 trial028 ceph-mon[37442]: pgmap v616: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/4041241730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 msgr2=0x7f0a98114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/4041241730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 0x7f0a98114ef0 secure :-1 s=READY pgs=1479 gs=1 cs=0 l=1 c_cookie=1439410491029105418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a88009950 tx=0x7f0a8802f190 comp rx=0 tx=0).stop 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/4041241730 shutdown_connections 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/4041241730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 0x7f0a98114ef0 unknown :-1 s=CLOSED pgs=1479 gs=1 cs=0 l=1 c_cookie=1439410491029105418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/4041241730 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a981156a0 0x7f0a98176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/4041241730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a9810f4b0 0x7f0a9810f880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/4041241730 >> 10.20.193.28:0/4041241730 conn(0x7f0a980ecda0 msgr2=0x7f0a9810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/4041241730 shutdown_connections 2026-02-20T13:31:51.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.147+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/4041241730 wait complete. 2026-02-20T13:31:51.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a9c9ea640 1 Processor -- start 2026-02-20T13:31:51.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a9c9ea640 1 -- start start 2026-02-20T13:31:51.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a9c9ea640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a9810f4b0 0x7f0a980f57a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a9c9ea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 0x7f0a98175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a9c9ea640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a981156a0 0x7f0a980f5ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a9c9ea640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980fb0b0 con 0x7f0a9810fea0 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a9c9ea640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980fb220 con 0x7f0a9810f4b0 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a9c9ea640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980fb3e0 con 0x7f0a981156a0 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a96ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 0x7f0a98175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a96ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 0x7f0a98175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40744/0 (socket says 10.20.193.28:40744) 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a96ffd640 1 -- 10.20.193.28:0/2572357946 learned_addr learned my addr 10.20.193.28:0/2572357946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a977fe640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a9810f4b0 0x7f0a980f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.148+0000 7f0a97fff640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a981156a0 0x7f0a980f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a96ffd640 1 -- 10.20.193.28:0/2572357946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a981156a0 msgr2=0x7f0a980f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a96ffd640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a981156a0 0x7f0a980f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a96ffd640 1 -- 10.20.193.28:0/2572357946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a9810f4b0 msgr2=0x7f0a980f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a96ffd640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a9810f4b0 0x7f0a980f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a96ffd640 1 -- 10.20.193.28:0/2572357946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a88009570 con 0x7f0a9810fea0 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a96ffd640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 0x7f0a98175f70 secure :-1 s=READY pgs=1480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a88038820 tx=0x7f0a88004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a94ff9640 1 -- 10.20.193.28:0/2572357946 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a8803d070 con 0x7f0a9810fea0 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a94ff9640 1 -- 10.20.193.28:0/2572357946 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0a88002ad0 con 0x7f0a9810fea0 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a94ff9640 1 -- 10.20.193.28:0/2572357946 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a88041930 con 0x7f0a9810fea0 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a980fb660 con 0x7f0a9810fea0 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.149+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a980fba80 con 0x7f0a9810fea0 2026-02-20T13:31:51.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.150+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a98110790 con 0x7f0a9810fea0 2026-02-20T13:31:51.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.152+0000 7f0a94ff9640 1 -- 10.20.193.28:0/2572357946 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0a8802f9f0 con 0x7f0a9810fea0 2026-02-20T13:31:51.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.153+0000 7f0a94ff9640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a6c0b5750 0x7f0a6c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.153+0000 7f0a94ff9640 1 -- 10.20.193.28:0/2572357946 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0a8810b480 con 0x7f0a9810fea0 2026-02-20T13:31:51.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.154+0000 7f0a977fe640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a6c0b5750 0x7f0a6c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.154+0000 7f0a94ff9640 1 -- 10.20.193.28:0/2572357946 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f0a880d1270 con 0x7f0a9810fea0 2026-02-20T13:31:51.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.154+0000 7f0a977fe640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a6c0b5750 0x7f0a6c0d5c00 secure :-1 s=READY pgs=620 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a84004740 tx=0x7f0a84005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:51.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.297+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a980f6900 con 0x7f0a9810fea0 2026-02-20T13:31:51.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.297+0000 7f0a94ff9640 1 -- 10.20.193.28:0/2572357946 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f0a880d1460 con 0x7f0a9810fea0 2026-02-20T13:31:51.300 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:31:51.300 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:31:51.300 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a6c0b5750 msgr2=0x7f0a6c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a6c0b5750 0x7f0a6c0d5c00 secure :-1 s=READY pgs=620 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a84004740 tx=0x7f0a84005f90 comp rx=0 tx=0).stop 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 msgr2=0x7f0a98175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 0x7f0a98175f70 secure :-1 s=READY pgs=1480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a88038820 tx=0x7f0a88004300 comp rx=0 tx=0).stop 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 shutdown_connections 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0a6c0b5750 0x7f0a6c0d5c00 unknown :-1 s=CLOSED pgs=620 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a9810fea0 0x7f0a98175f70 unknown :-1 s=CLOSED pgs=1480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a981156a0 0x7f0a980f5ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 --2- 10.20.193.28:0/2572357946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a9810f4b0 0x7f0a980f57a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 >> 10.20.193.28:0/2572357946 conn(0x7f0a980ecda0 msgr2=0x7f0a9810d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 shutdown_connections 2026-02-20T13:31:51.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.299+0000 7f0a9c9ea640 1 -- 10.20.193.28:0/2572357946 wait complete. 2026-02-20T13:31:51.401 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --set-id 8d1442de --release --await' 2026-02-20T13:31:51.401 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --set-id 8d1442de --release --await 2026-02-20T13:31:51.586 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:51.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/340531486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2f810f230 msgr2=0x7ff2f810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/340531486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2f810f230 0x7ff2f810f600 secure :-1 s=READY pgs=1481 gs=2 cs=0 l=1 c_cookie=28609037544138332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2e8009950 tx=0x7ff2e802f190 comp rx=0 tx=0).stop 2026-02-20T13:31:51.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/340531486 shutdown_connections 2026-02-20T13:31:51.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/340531486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2f8115420 0x7ff2f8175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/340531486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2f810fc20 0x7ff2f8114c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/340531486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2f810f230 0x7ff2f810f600 unknown :-1 s=CLOSED pgs=1481 gs=2 cs=0 l=1 c_cookie=28609037544138332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/340531486 >> 10.20.193.28:0/340531486 conn(0x7ff2f805f830 msgr2=0x7ff2f810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/340531486 shutdown_connections 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.781+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/340531486 wait complete. 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.782+0000 7ff2ff7c1640 1 Processor -- start 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.782+0000 7ff2ff7c1640 1 -- start start 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.782+0000 7ff2ff7c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2f810f230 0x7ff2f8066f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.782+0000 7ff2ff7c1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2f810fc20 0x7ff2f80631a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.782+0000 7ff2ff7c1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2f8115420 0x7ff2f8063850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.782+0000 7ff2ff7c1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8063fe0 con 0x7ff2f810f230 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.782+0000 7ff2ff7c1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f81682d0 con 0x7ff2f8115420 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.782+0000 7ff2ff7c1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8168490 con 0x7ff2f810fc20 2026-02-20T13:31:51.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2f8115420 0x7ff2f8063850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fd536640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2f810f230 0x7ff2f8066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2f8115420 0x7ff2f8063850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54330/0 (socket says 10.20.193.28:54330) 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fcd35640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2f810fc20 0x7ff2f80631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 -- 10.20.193.28:0/2998178271 learned_addr learned my addr 10.20.193.28:0/2998178271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 -- 10.20.193.28:0/2998178271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2f810fc20 msgr2=0x7ff2f80631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2f810fc20 0x7ff2f80631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 -- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2f810f230 msgr2=0x7ff2f8066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2f810f230 0x7ff2f8066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 -- 10.20.193.28:0/2998178271 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e8009570 con 0x7ff2f8115420 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2f810fc20 0x7ff2f80631a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:51.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.783+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2f8115420 0x7ff2f8063850 secure :-1 s=READY pgs=508 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f400f8d0 tx=0x7ff2f400fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:51.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.784+0000 7ff2e67fc640 1 -- 10.20.193.28:0/2998178271 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2f400dce0 con 0x7ff2f8115420 2026-02-20T13:31:51.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.784+0000 7ff2e67fc640 1 -- 10.20.193.28:0/2998178271 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2f400de40 con 0x7ff2f8115420 2026-02-20T13:31:51.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.784+0000 7ff2e67fc640 1 -- 10.20.193.28:0/2998178271 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2f40116b0 con 0x7ff2f8115420 2026-02-20T13:31:51.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.784+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/2998178271 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f8168710 con 0x7ff2f8115420 2026-02-20T13:31:51.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.784+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/2998178271 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f8168be0 con 0x7ff2f8115420 2026-02-20T13:31:51.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.786+0000 7ff2e67fc640 1 -- 10.20.193.28:0/2998178271 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff2f4020060 con 0x7ff2f8115420 2026-02-20T13:31:51.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.788+0000 7ff2e67fc640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2d40b5760 0x7ff2d40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.788+0000 7ff2e67fc640 1 -- 10.20.193.28:0/2998178271 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff2f4015070 con 0x7ff2f8115420 2026-02-20T13:31:51.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.788+0000 7ff2fd536640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2d40b5760 0x7ff2d40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.789+0000 7ff2fd536640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2d40b5760 0x7ff2d40d5c10 secure :-1 s=READY pgs=621 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2e80098a0 tx=0x7ff2e803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:51.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff3017bbe00 1 Processor -- start 2026-02-20T13:31:51.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff3017bbe00 1 -- start start 2026-02-20T13:31:51.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5dc8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a621590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a641eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c6a4f1c70 con 0x557c6a5dce30 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557c6a4ed9a0 con 0x557c6a621ad0 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557c6a4e7b00 con 0x557c6a5dc520 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff2fd536640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a641eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a641eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54340/0 (socket says 10.20.193.28:54340) 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff2fd536640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5dc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42512/0 (socket says 10.20.193.28:42512) 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff2fdd37640 1 -- 10.20.193.28:0/507483775 learned_addr learned my addr 10.20.193.28:0/507483775 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:51.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.790+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a621590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2fcd35640 1 -- 10.20.193.28:0/507483775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 msgr2=0x557c6a5dc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5dc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2fcd35640 1 -- 10.20.193.28:0/507483775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 msgr2=0x557c6a641eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a641eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2fcd35640 1 -- 10.20.193.28:0/507483775 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6a492f80 con 0x557c6a5dce30 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a641eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a621590 secure :-1 s=READY pgs=1482 gs=1 cs=0 l=1 c_cookie=5343189078450145848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2ec004740 tx=0x7ff2ec002c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a26d2284cc48a38 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2c5ce5640 1 -- 10.20.193.28:0/507483775 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2ec009cd0 con 0x557c6a5dce30 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2c5ce5640 1 -- 10.20.193.28:0/507483775 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2ec002e80 con 0x557c6a5dce30 2026-02-20T13:31:51.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff2c5ce5640 1 -- 10.20.193.28:0/507483775 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2ec0108f0 con 0x557c6a5dce30 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff3017bbe00 1 -- 10.20.193.28:0/507483775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 msgr2=0x557c6a621590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a621590 secure :-1 s=READY pgs=1482 gs=1 cs=0 l=1 c_cookie=5343189078450145848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2ec004740 tx=0x7ff2ec002c20 comp rx=0 tx=0).stop 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff3017bbe00 1 -- 10.20.193.28:0/507483775 shutdown_connections 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.791+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a621590 unknown :-1 s=CLOSED pgs=1482 gs=1 cs=0 l=1 c_cookie=5343189078450145848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.792+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a641eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.792+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/507483775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5dc8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.792+0000 7ff3017bbe00 1 -- 10.20.193.28:0/507483775 >> 10.20.193.28:0/507483775 conn(0x557c6a4faa60 msgr2=0x557c6a5dae00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.792+0000 7ff3017bbe00 1 -- 10.20.193.28:0/507483775 shutdown_connections 2026-02-20T13:31:51.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.792+0000 7ff3017bbe00 1 -- 10.20.193.28:0/507483775 wait complete. 2026-02-20T13:31:51.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.793+0000 7ff3017bbe00 1 -- start start 2026-02-20T13:31:51.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.793+0000 7ff3017bbe00 1 Processor -- start 2026-02-20T13:31:51.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.793+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5f4550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.793+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a5dce30 0x557c6a5f4a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.793+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a621ad0 0x557c6a5f9a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.793+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c6a5f9fc0 con 0x557c6a621ad0 2026-02-20T13:31:51.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.793+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557c6a5fa130 con 0x557c6a5dce30 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.793+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557c6a5fa2f0 con 0x557c6a5dc520 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a621ad0 0x557c6a5f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fd536640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a621ad0 0x557c6a5f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40766/0 (socket says 10.20.193.28:40766) 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 -- 10.20.193.28:0/3879249058 learned_addr learned my addr 10.20.193.28:0/3879249058 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a5dce30 0x557c6a5f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 -- 10.20.193.28:0/3879249058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 msgr2=0x557c6a5f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 -- 10.20.193.28:0/3879249058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a5dce30 msgr2=0x557c6a5f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a5dce30 0x557c6a5f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 -- 10.20.193.28:0/3879249058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec0042e0 con 0x557c6a621ad0 2026-02-20T13:31:51.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a621ad0 0x557c6a5f9a80 secure :-1 s=READY pgs=1483 gs=3 cs=0 l=1 c_cookie=4059552263732422391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f4021000 tx=0x7ff2f4006400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38566d4682e766f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2b2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/3879249058 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2f40add50 con 0x557c6a621ad0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/3879249058 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2f40ae990 con 0x557c6a621ad0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/3879249058 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2f40aeea0 con 0x557c6a621ad0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f8168be0 con 0x557c6a621ad0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.794+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/3879249058 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff2f40b8c40 con 0x557c6a621ad0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff2b2ffd640 10 client.20622 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 10 client.20622 _ll_register_callbacks cb 0x557c6a468d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c6a23f700 con 0x557c6a621ad0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/3879249058 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff2f40b0060 con 0x557c6a621ad0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 10 client.20622 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557c6a46b710 con 0x557c6a621ad0 2026-02-20T13:31:51.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/3879249058 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff2f40cc020 con 0x557c6a621ad0 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 10 client.20622 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 10 client.20622 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 20 client.20622 populate_metadata read hostname 'trial028' 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557c6a61ed00 0x557c6a61f1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 4 client.20622 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.795+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c6a4dd540 con 0x557c6a61ed00 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.796+0000 7ff2fd536640 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557c6a61ed00 0x557c6a61f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.796+0000 7ff2fd536640 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557c6a61ed00 0x557c6a61f1a0 crc :-1 s=READY pgs=411 gs=4 cs=0 l=0 c_cookie=11956796069086257858 s_cookie=11713246771376352760 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5ef12accdac62c2 server_cookie=a28dcfe10e60edf8 in_seq=0 out_seq=0 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.796+0000 7ff2b2ffd640 10 client.20622 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/3879249058 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557c6a4dd540 con 0x557c6a61ed00 2026-02-20T13:31:51.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff2b2ffd640 10 client.20622 handle_command_reply: tid=0 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 client.20622 shutdown 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a621ad0 msgr2=0x557c6a5f9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a621ad0 0x557c6a5f9a80 secure :-1 s=READY pgs=1483 gs=3 cs=0 l=1 c_cookie=4059552263732422391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f4021000 tx=0x7ff2f4006400 comp rx=0 tx=0).stop 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 shutdown_connections 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557c6a61ed00 0x557c6a61f1a0 crc :-1 s=READY pgs=411 gs=4 cs=0 l=0 c_cookie=11956796069086257858 s_cookie=11713246771376352760 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a621ad0 0x557c6a5f9a80 unknown :-1 s=CLOSED pgs=1483 gs=3 cs=0 l=1 c_cookie=4059552263732422391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a5dce30 0x557c6a5f4a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/3879249058 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5f4550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff2b2ffd640 0 client.20622 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 >> 10.20.193.28:0/3879249058 conn(0x557c6a4faa60 msgr2=0x557c6a5db510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 shutdown_connections 2026-02-20T13:31:51.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 1 -- 10.20.193.28:0/3879249058 wait complete. 2026-02-20T13:31:51.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.797+0000 7ff3017bbe00 20 client.20622 trim_cache size 0 max 16384 2026-02-20T13:31:51.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.806+0000 7ff3017bbe00 1 Processor -- start 2026-02-20T13:31:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.806+0000 7ff3017bbe00 1 -- start start 2026-02-20T13:31:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.806+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dc520 0x557c6a5f1b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.806+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dce30 0x557c6a619f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.806+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a61a4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.806+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c6a4e5730 con 0x557c6a5dc520 2026-02-20T13:31:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557c6a1a5960 con 0x557c6a621ad0 2026-02-20T13:31:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557c6a54be10 con 0x557c6a5dce30 2026-02-20T13:31:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fd536640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dc520 0x557c6a5f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a61a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fcd35640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dce30 0x557c6a619f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a61a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54354/0 (socket says 10.20.193.28:54354) 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 -- 10.20.193.28:0/2170653511 learned_addr learned my addr 10.20.193.28:0/2170653511 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fd536640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dc520 0x557c6a5f1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40778/0 (socket says 10.20.193.28:40778) 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 -- 10.20.193.28:0/2170653511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dce30 msgr2=0x557c6a619f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/2170653511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dce30 0x557c6a619f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 -- 10.20.193.28:0/2170653511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dc520 msgr2=0x557c6a5f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/2170653511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dc520 0x557c6a5f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 -- 10.20.193.28:0/2170653511 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6a5e6e60 con 0x557c6a621ad0 2026-02-20T13:31:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fd536640 1 --2- 10.20.193.28:0/2170653511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dc520 0x557c6a5f1b20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/2170653511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a61a4a0 secure :-1 s=READY pgs=509 gs=3 cs=0 l=1 c_cookie=2003064864095036799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f40e5760 tx=0x7ff2f40cb000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bcc50e19673657f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2c54e4640 1 -- 10.20.193.28:0/2170653511 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2f40b8c40 con 0x557c6a621ad0 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2c54e4640 1 -- 10.20.193.28:0/2170653511 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557c6a23f700 con 0x557c6a621ad0 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.807+0000 7ff2c54e4640 1 -- 10.20.193.28:0/2170653511 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2f40b0060 con 0x557c6a621ad0 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2170653511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 msgr2=0x557c6a61a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2170653511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a61a4a0 secure :-1 s=READY pgs=509 gs=3 cs=0 l=1 c_cookie=2003064864095036799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f40e5760 tx=0x7ff2f40cb000 comp rx=0 tx=0).stop 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2170653511 shutdown_connections 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2170653511 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a61a4a0 unknown :-1 s=CLOSED pgs=509 gs=3 cs=0 l=1 c_cookie=2003064864095036799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2170653511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dce30 0x557c6a619f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2170653511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dc520 0x557c6a5f1b20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2170653511 >> 10.20.193.28:0/2170653511 conn(0x557c6a4faa60 msgr2=0x557c6a5f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2170653511 shutdown_connections 2026-02-20T13:31:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2170653511 wait complete. 2026-02-20T13:31:51.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.808+0000 7ff3017bbe00 1 -- start start 2026-02-20T13:31:51.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff3017bbe00 1 Processor -- start 2026-02-20T13:31:51.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5fc100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a5fc640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff3017bbe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a5fcb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c6a4e5730 con 0x557c6a5dce30 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557c6a686ff0 con 0x557c6a621ad0 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff3017bbe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557c6a6871b0 con 0x557c6a5dc520 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff2fd536640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff2fd536640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5fc100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42548/0 (socket says 10.20.193.28:42548) 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff2fcd35640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a5fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff2fdd37640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a5fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff2fcd35640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a5fc640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40782/0 (socket says 10.20.193.28:40782) 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.809+0000 7ff2fcd35640 1 -- 10.20.193.28:0/2188936887 learned_addr learned my addr 10.20.193.28:0/2188936887 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2fd536640 1 -- 10.20.193.28:0/2188936887 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 msgr2=0x557c6a5fcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2fd536640 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a5fcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2fd536640 1 -- 10.20.193.28:0/2188936887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 msgr2=0x557c6a5fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2fd536640 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a5fc640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2fd536640 1 -- 10.20.193.28:0/2188936887 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6a46b710 con 0x557c6a5dc520 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2fdd37640 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a5fcb80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a5fc640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2fd536640 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5fc100 secure :-1 s=READY pgs=417 gs=2 cs=0 l=1 c_cookie=2042862759107557551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2e8005f70 tx=0x7ff2e802f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c59b4db197af8af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2b2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/2188936887 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2e8002ad0 con 0x557c6a5dc520 2026-02-20T13:31:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f8176660 con 0x557c6a5dc520 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff3017bbe00 10 client.30403 _ll_register_callbacks cb 0x557c6a468d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c6a4ba410 con 0x557c6a5dc520 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/2188936887 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2e8058040 con 0x557c6a5dc520 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/2188936887 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2e8052720 con 0x557c6a5dc520 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.810+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/2188936887 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff2e8052880 con 0x557c6a5dc520 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/2188936887 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff2e8052a40 con 0x557c6a5dc520 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff3017bbe00 10 client.30403 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557c6a5df9e0 con 0x557c6a5dc520 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/2188936887 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff2e8052be0 con 0x557c6a5dc520 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff3017bbe00 10 client.30403 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff3017bbe00 10 client.30403 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:31:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff3017bbe00 20 client.30403 populate_metadata read hostname 'trial028' 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557c6a6cf0d0 0x557c6a6ef580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff3017bbe00 4 client.30403 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8d1442de", "release": true, "await": true}] 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8d1442de", "release": true, "await": true}) -- 0x557c6a2243c0 con 0x557c6a6cf0d0 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.811+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557c6a6cf0d0 0x557c6a6ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.812+0000 7ff2fcd35640 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557c6a6cf0d0 0x557c6a6ef580 crc :-1 s=READY pgs=412 gs=4 cs=0 l=0 c_cookie=24696987508683820 s_cookie=5289956362620321371 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57bdc77f7a342c server_cookie=4969b348cf4d3e5b in_seq=0 out_seq=0 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.812+0000 7ff2b2ffd640 10 client.30403 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.813+0000 7ff2b2ffd640 1 -- 10.20.193.28:0/2188936887 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557c6a2243c0 con 0x557c6a6cf0d0 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.813+0000 7ff2b2ffd640 10 client.30403 handle_command_reply: tid=0 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.813+0000 7ff3017bbe00 1 client.30403 shutdown 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 msgr2=0x557c6a5fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5fc100 secure :-1 s=READY pgs=417 gs=2 cs=0 l=1 c_cookie=2042862759107557551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2e8005f70 tx=0x7ff2e802f190 comp rx=0 tx=0).stop 2026-02-20T13:31:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 shutdown_connections 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557c6a6cf0d0 0x557c6a6ef580 crc :-1 s=READY pgs=412 gs=4 cs=0 l=0 c_cookie=24696987508683820 s_cookie=5289956362620321371 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c6a5dce30 0x557c6a5fc640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557c6a621ad0 0x557c6a5fcb80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 --2- 10.20.193.28:0/2188936887 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557c6a5dc520 0x557c6a5fc100 unknown :-1 s=CLOSED pgs=417 gs=2 cs=0 l=1 c_cookie=2042862759107557551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff2b2ffd640 0 client.30403 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 >> 10.20.193.28:0/2188936887 conn(0x557c6a4faa60 msgr2=0x557c6a5f0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 shutdown_connections 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 1 -- 10.20.193.28:0/2188936887 wait complete. 2026-02-20T13:31:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.814+0000 7ff3017bbe00 20 client.30403 trim_cache size 0 max 16384 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 56, 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "8d1442de": { 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "version": 56, 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:31:51.823 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 147.8, 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:51.824 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:51.825 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:51.825 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:51.825 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:31:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2d40b5760 msgr2=0x7ff2d40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2d40b5760 0x7ff2d40d5c10 secure :-1 s=READY pgs=621 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2e80098a0 tx=0x7ff2e803a040 comp rx=0 tx=0).stop 2026-02-20T13:31:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/2998178271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2f8115420 msgr2=0x7ff2f8063850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2f8115420 0x7ff2f8063850 secure :-1 s=READY pgs=508 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f400f8d0 tx=0x7ff2f400fda0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/2998178271 shutdown_connections 2026-02-20T13:31:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2d40b5760 0x7ff2d40d5c10 unknown :-1 s=CLOSED pgs=621 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2f8115420 0x7ff2f8063850 unknown :-1 s=CLOSED pgs=508 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2f810fc20 0x7ff2f80631a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 --2- 10.20.193.28:0/2998178271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2f810f230 0x7ff2f8066f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/2998178271 >> 10.20.193.28:0/2998178271 conn(0x7ff2f805f830 msgr2=0x7ff2f810cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/2998178271 shutdown_connections 2026-02-20T13:31:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:51.815+0000 7ff2ff7c1640 1 -- 10.20.193.28:0/2998178271 wait complete. 2026-02-20T13:31:51.887 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:51 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2572357946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:51.915 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8d1442de', total seconds elapsed: 28.9 2026-02-20T13:31:51.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:51 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2572357946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:51.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:51 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2572357946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:52 trial127 ceph-mon[43817]: pgmap v617: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:31:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:52 trial034 ceph-mon[43332]: pgmap v617: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:31:53.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:52 trial028 ceph-mon[37442]: pgmap v617: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:31:53.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 -- 10.20.193.28:0/3297957747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2988110330 msgr2=0x7f29881107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 --2- 10.20.193.28:0/3297957747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2988110330 0x7f29881107a0 secure :-1 s=READY pgs=1484 gs=1 cs=0 l=1 c_cookie=12272601552180029925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f297c009950 tx=0x7f297c02f190 comp rx=0 tx=0).stop 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 -- 10.20.193.28:0/3297957747 shutdown_connections 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 --2- 10.20.193.28:0/3297957747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2988110330 0x7f29881107a0 unknown :-1 s=CLOSED pgs=1484 gs=1 cs=0 l=1 c_cookie=12272601552180029925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 --2- 10.20.193.28:0/3297957747 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2988110ce0 0x7f2988171670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 --2- 10.20.193.28:0/3297957747 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f298810f1a0 0x7f298810f590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 -- 10.20.193.28:0/3297957747 >> 10.20.193.28:0/3297957747 conn(0x7f29880ec8f0 msgr2=0x7f298810cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 -- 10.20.193.28:0/3297957747 shutdown_connections 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.327+0000 7f298fac3640 1 -- 10.20.193.28:0/3297957747 wait complete. 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.328+0000 7f298fac3640 1 Processor -- start 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.328+0000 7f298fac3640 1 -- start start 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.328+0000 7f298fac3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f298810f1a0 0x7f29880f88a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.328+0000 7f298fac3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2988110330 0x7f2988171650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.328+0000 7f298fac3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2988110ce0 0x7f29880f90e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.328+0000 7f298fac3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f29880f9d40 con 0x7f298810f1a0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.328+0000 7f298fac3640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f29880f9eb0 con 0x7f2988110330 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.328+0000 7f298fac3640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f29880fa070 con 0x7f2988110ce0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f298810f1a0 0x7f29880f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f298810f1a0 0x7f29880f88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40794/0 (socket says 10.20.193.28:40794) 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 -- 10.20.193.28:0/3593730228 learned_addr learned my addr 10.20.193.28:0/3593730228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298e039640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2988110ce0 0x7f29880f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d037640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2988110330 0x7f2988171650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 -- 10.20.193.28:0/3593730228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2988110ce0 msgr2=0x7f29880f90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2988110ce0 0x7f29880f90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 -- 10.20.193.28:0/3593730228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2988110330 msgr2=0x7f2988171650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2988110330 0x7f2988171650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 -- 10.20.193.28:0/3593730228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c009570 con 0x7f298810f1a0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298d838640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f298810f1a0 0x7f29880f88a0 secure :-1 s=READY pgs=1485 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2978009480 tx=0x7f297800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f2976ffd640 1 -- 10.20.193.28:0/3593730228 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f297800cd40 con 0x7f298810f1a0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f2976ffd640 1 -- 10.20.193.28:0/3593730228 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2978004d30 con 0x7f298810f1a0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f2976ffd640 1 -- 10.20.193.28:0/3593730228 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29780106b0 con 0x7f298810f1a0 2026-02-20T13:31:53.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298fac3640 1 -- 10.20.193.28:0/3593730228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29880fa350 con 0x7f298810f1a0 2026-02-20T13:31:53.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.329+0000 7f298fac3640 1 -- 10.20.193.28:0/3593730228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29880fa7d0 con 0x7f298810f1a0 2026-02-20T13:31:53.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.332+0000 7f2976ffd640 1 -- 10.20.193.28:0/3593730228 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f297801f060 con 0x7f298810f1a0 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f29920ace00 1 Processor -- start 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f29920ace00 1 -- start start 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f2976ffd640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29640b5760 0x7f29640d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f29920ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x5607553418a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f29920ace00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x5607553621c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f29920ace00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x560755382ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f29920ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560755236fd0 con 0x5607553214c0 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f29920ace00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560755232d00 con 0x560755341de0 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f29920ace00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56075522cca0 con 0x560755362700 2026-02-20T13:31:53.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f2976ffd640 1 -- 10.20.193.28:0/3593730228 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2978014070 con 0x7f298810f1a0 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.334+0000 7f298e039640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29640b5760 0x7f29640d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x5607553621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x5607553621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54404/0 (socket says 10.20.193.28:54404) 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 -- 10.20.193.28:0/306314396 learned_addr learned my addr 10.20.193.28:0/306314396 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298e039640 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x560755382ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d838640 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x5607553418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 -- 10.20.193.28:0/306314396 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 msgr2=0x560755382ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x560755382ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 -- 10.20.193.28:0/306314396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 msgr2=0x5607553418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x5607553418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 -- 10.20.193.28:0/306314396 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607551cf8b0 con 0x560755341de0 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d838640 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x5607553418a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298e039640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29640b5760 0x7f29640d5c10 secure :-1 s=READY pgs=622 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2984006e90 tx=0x7f29840157e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:53.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.335+0000 7f298d037640 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x5607553621c0 secure :-1 s=READY pgs=510 gs=1 cs=0 l=1 c_cookie=4185719665566772346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f297c005b30 tx=0x7f297c005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a16a9dbe3796c7a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f2955bfe640 1 -- 10.20.193.28:0/306314396 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f297c038690 con 0x560755341de0 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f2955bfe640 1 -- 10.20.193.28:0/306314396 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f297c002e20 con 0x560755341de0 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 -- 10.20.193.28:0/306314396 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 msgr2=0x5607553621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x5607553621c0 secure :-1 s=READY pgs=510 gs=1 cs=0 l=1 c_cookie=4185719665566772346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f297c005b30 tx=0x7f297c005900 comp rx=0 tx=0).stop 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 -- 10.20.193.28:0/306314396 shutdown_connections 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x560755382ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x5607553621c0 unknown :-1 s=CLOSED pgs=510 gs=1 cs=0 l=1 c_cookie=4185719665566772346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 --2- 10.20.193.28:0/306314396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x5607553418a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 -- 10.20.193.28:0/306314396 >> 10.20.193.28:0/306314396 conn(0x5607552401c0 msgr2=0x56075531fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 -- 10.20.193.28:0/306314396 shutdown_connections 2026-02-20T13:31:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.336+0000 7f29920ace00 1 -- 10.20.193.28:0/306314396 wait complete. 2026-02-20T13:31:53.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.337+0000 7f29920ace00 1 -- start start 2026-02-20T13:31:53.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.337+0000 7f29920ace00 1 Processor -- start 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f29920ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x56075533a8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f29920ace00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x56075533af10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f29920ace00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x56075533b970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f29920ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56075533bfd0 con 0x5607553214c0 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f29920ace00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56075533c140 con 0x560755341de0 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f29920ace00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56075533c300 con 0x560755362700 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d838640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x56075533a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d838640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x56075533a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40820/0 (socket says 10.20.193.28:40820) 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d838640 1 -- 10.20.193.28:0/2275662246 learned_addr learned my addr 10.20.193.28:0/2275662246 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d037640 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x56075533af10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298e039640 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x56075533b970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d838640 1 -- 10.20.193.28:0/2275662246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 msgr2=0x56075533b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d838640 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x56075533b970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d838640 1 -- 10.20.193.28:0/2275662246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 msgr2=0x56075533af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d838640 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x56075533af10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298d838640 1 -- 10.20.193.28:0/2275662246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607551d8400 con 0x5607553214c0 2026-02-20T13:31:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.338+0000 7f298e039640 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x56075533b970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f298d838640 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x56075533a8c0 secure :-1 s=READY pgs=1486 gs=2 cs=0 l=1 c_cookie=7443669128685175048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29780aa310 tx=0x7f29780ad150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674d39a260d24108 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f2942ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f2942ffd640 1 -- 10.20.193.28:0/2275662246 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29780adf50 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f2942ffd640 1 -- 10.20.193.28:0/2275662246 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f29780adaa0 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f2942ffd640 1 -- 10.20.193.28:0/2275662246 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29780724b0 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2988171fc0 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f2942ffd640 1 -- 10.20.193.28:0/2275662246 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f29780ab080 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f2942ffd640 10 client.20640 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f29920ace00 10 client.20640 _ll_register_callbacks cb 0x5607551b7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560754ecc520 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f2942ffd640 1 -- 10.20.193.28:0/2275662246 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f29780b2dc0 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f29920ace00 10 client.20640 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.339+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5607551b0da0 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.340+0000 7f2942ffd640 1 -- 10.20.193.28:0/2275662246 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f29780aea90 con 0x5607553214c0 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.340+0000 7f29920ace00 10 client.20640 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.340+0000 7f29920ace00 10 client.20640 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:53.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.340+0000 7f29920ace00 20 client.20640 populate_metadata read hostname 'trial028' 2026-02-20T13:31:53.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.340+0000 7f29920ace00 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56075533f010 0x56075533f480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.340+0000 7f29920ace00 4 client.20640 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:53.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.340+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56075525e630 con 0x56075533f010 2026-02-20T13:31:53.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.340+0000 7f298d037640 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56075533f010 0x56075533f480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f298d037640 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56075533f010 0x56075533f480 crc :-1 s=READY pgs=413 gs=4 cs=0 l=0 c_cookie=2468245449262570404 s_cookie=10432912732898045021 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2240f828a5c51ba4 server_cookie=90c926dac909ac5d in_seq=0 out_seq=0 2026-02-20T13:31:53.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f2942ffd640 10 client.20640 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:53.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f2942ffd640 1 -- 10.20.193.28:0/2275662246 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56075525e630 con 0x56075533f010 2026-02-20T13:31:53.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f2942ffd640 10 client.20640 handle_command_reply: tid=0 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 client.20640 shutdown 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 msgr2=0x56075533a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x56075533a8c0 secure :-1 s=READY pgs=1486 gs=2 cs=0 l=1 c_cookie=7443669128685175048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29780aa310 tx=0x7f29780ad150 comp rx=0 tx=0).stop 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 shutdown_connections 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56075533f010 0x56075533f480 crc :-1 s=READY pgs=413 gs=4 cs=0 l=0 c_cookie=2468245449262570404 s_cookie=10432912732898045021 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755362700 0x56075533b970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755341de0 0x56075533af10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 --2- 10.20.193.28:0/2275662246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5607553214c0 0x56075533a8c0 unknown :-1 s=CLOSED pgs=1486 gs=2 cs=0 l=1 c_cookie=7443669128685175048 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f2942ffd640 0 client.20640 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 >> 10.20.193.28:0/2275662246 conn(0x5607552401c0 msgr2=0x560755322790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 shutdown_connections 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.341+0000 7f29920ace00 1 -- 10.20.193.28:0/2275662246 wait complete. 2026-02-20T13:31:53.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.342+0000 7f29920ace00 20 client.20640 trim_cache size 0 max 16384 2026-02-20T13:31:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f29920ace00 1 Processor -- start 2026-02-20T13:31:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f29920ace00 1 -- start start 2026-02-20T13:31:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f29920ace00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607553214c0 0x56075533a730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f29920ace00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755341de0 0x56075532c750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f29920ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755362700 0x5607553605c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f29920ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56075522a8d0 con 0x560755362700 2026-02-20T13:31:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f29920ace00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560754f6bf10 con 0x5607553214c0 2026-02-20T13:31:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f29920ace00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560755290490 con 0x560755341de0 2026-02-20T13:31:53.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f298d838640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607553214c0 0x56075533a730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f298e039640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755362700 0x5607553605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f298d838640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607553214c0 0x56075533a730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54424/0 (socket says 10.20.193.28:54424) 2026-02-20T13:31:53.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f298d037640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755341de0 0x56075532c750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.349+0000 7f298d838640 1 -- 10.20.193.28:0/133726034 learned_addr learned my addr 10.20.193.28:0/133726034 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f298d838640 1 -- 10.20.193.28:0/133726034 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755341de0 msgr2=0x56075532c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f298d838640 1 --2- 10.20.193.28:0/133726034 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755341de0 0x56075532c750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f298d838640 1 -- 10.20.193.28:0/133726034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755362700 msgr2=0x5607553605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f298d838640 1 --2- 10.20.193.28:0/133726034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755362700 0x5607553605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f298d838640 1 -- 10.20.193.28:0/133726034 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075532cf20 con 0x5607553214c0 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f298d037640 1 --2- 10.20.193.28:0/133726034 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755341de0 0x56075532c750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f298d838640 1 --2- 10.20.193.28:0/133726034 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607553214c0 0x56075533a730 secure :-1 s=READY pgs=511 gs=1 cs=0 l=1 c_cookie=11953831365253189731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29780ad310 tx=0x7f29780e6070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5e48a4ae6d6d063 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29553fd640 1 -- 10.20.193.28:0/133726034 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2978072490 con 0x5607553214c0 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29553fd640 1 -- 10.20.193.28:0/133726034 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560754ecc520 con 0x5607553214c0 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29553fd640 1 -- 10.20.193.28:0/133726034 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2978072230 con 0x5607553214c0 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 -- 10.20.193.28:0/133726034 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607553214c0 msgr2=0x56075533a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 --2- 10.20.193.28:0/133726034 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607553214c0 0x56075533a730 secure :-1 s=READY pgs=511 gs=1 cs=0 l=1 c_cookie=11953831365253189731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29780ad310 tx=0x7f29780e6070 comp rx=0 tx=0).stop 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 -- 10.20.193.28:0/133726034 shutdown_connections 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 --2- 10.20.193.28:0/133726034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755362700 0x5607553605c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 --2- 10.20.193.28:0/133726034 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560755341de0 0x56075532c750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 --2- 10.20.193.28:0/133726034 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5607553214c0 0x56075533a730 unknown :-1 s=CLOSED pgs=511 gs=1 cs=0 l=1 c_cookie=11953831365253189731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 -- 10.20.193.28:0/133726034 >> 10.20.193.28:0/133726034 conn(0x5607552401c0 msgr2=0x560755336bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 -- 10.20.193.28:0/133726034 shutdown_connections 2026-02-20T13:31:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.350+0000 7f29920ace00 1 -- 10.20.193.28:0/133726034 wait complete. 2026-02-20T13:31:53.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f29920ace00 1 -- start start 2026-02-20T13:31:53.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f29920ace00 1 Processor -- start 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f29920ace00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607553214c0 0x560755343710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f29920ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755341de0 0x560755343db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f29920ace00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755362700 0x5607553446d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f29920ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560754f6bf10 con 0x560755341de0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f29920ace00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560755344db0 con 0x560755362700 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f29920ace00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560755344f70 con 0x5607553214c0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f298d037640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755341de0 0x560755343db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f298d037640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755341de0 0x560755343db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40846/0 (socket says 10.20.193.28:40846) 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f298d037640 1 -- 10.20.193.28:0/3066519594 learned_addr learned my addr 10.20.193.28:0/3066519594 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f298e039640 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755362700 0x5607553446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f298d838640 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607553214c0 0x560755343710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f298d037640 1 -- 10.20.193.28:0/3066519594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607553214c0 msgr2=0x560755343710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.351+0000 7f298d037640 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607553214c0 0x560755343710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f298d037640 1 -- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755362700 msgr2=0x5607553446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f298d037640 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755362700 0x5607553446d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f298d037640 1 -- 10.20.193.28:0/3066519594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075531fd20 con 0x560755341de0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f298e039640 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755362700 0x5607553446d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f298d037640 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755341de0 0x560755343db0 secure :-1 s=READY pgs=1487 gs=1 cs=0 l=1 c_cookie=17910326732361028527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f297c002c50 tx=0x7f297c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88e4345258fd3af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f2942ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f2942ffd640 1 -- 10.20.193.28:0/3066519594 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f297c004210 con 0x560755341de0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f2942ffd640 1 -- 10.20.193.28:0/3066519594 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f297c03c040 con 0x560755341de0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f2942ffd640 1 -- 10.20.193.28:0/3066519594 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f297c038d30 con 0x560755341de0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607551b0da0 con 0x560755341de0 2026-02-20T13:31:53.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f29920ace00 10 client.20646 _ll_register_callbacks cb 0x5607551b7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5607552dcca0 con 0x560755341de0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f2942ffd640 1 -- 10.20.193.28:0/3066519594 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f297c004370 con 0x560755341de0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f2942ffd640 1 -- 10.20.193.28:0/3066519594 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f297c002630 con 0x560755341de0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f29920ace00 10 client.20646 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.352+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5607551c2670 con 0x560755341de0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.353+0000 7f2942ffd640 1 -- 10.20.193.28:0/3066519594 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f297c05f060 con 0x560755341de0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.353+0000 7f29920ace00 10 client.20646 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.353+0000 7f29920ace00 10 client.20646 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.353+0000 7f29920ace00 20 client.20646 populate_metadata read hostname 'trial028' 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.353+0000 7f29920ace00 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560755346cc0 0x560755347160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.353+0000 7f29920ace00 4 client.20646 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.353+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560754f10640 con 0x560755346cc0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.353+0000 7f298d838640 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560755346cc0 0x560755347160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.354+0000 7f298d838640 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560755346cc0 0x560755347160 crc :-1 s=READY pgs=414 gs=4 cs=0 l=0 c_cookie=8582997793485777119 s_cookie=5121596463180691771 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=771cef04bcae68df server_cookie=471390d90ec8393b in_seq=0 out_seq=0 2026-02-20T13:31:53.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.354+0000 7f2942ffd640 10 client.20646 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:53.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f2942ffd640 1 -- 10.20.193.28:0/3066519594 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560754f10640 con 0x560755346cc0 2026-02-20T13:31:53.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f2942ffd640 10 client.20646 handle_command_reply: tid=0 2026-02-20T13:31:53.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 client.20646 shutdown 2026-02-20T13:31:53.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755341de0 msgr2=0x560755343db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755341de0 0x560755343db0 secure :-1 s=READY pgs=1487 gs=1 cs=0 l=1 c_cookie=17910326732361028527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f297c002c50 tx=0x7f297c009310 comp rx=0 tx=0).stop 2026-02-20T13:31:53.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 shutdown_connections 2026-02-20T13:31:53.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x560755346cc0 0x560755347160 crc :-1 s=READY pgs=414 gs=4 cs=0 l=0 c_cookie=8582997793485777119 s_cookie=5121596463180691771 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560755341de0 0x560755343db0 unknown :-1 s=CLOSED pgs=1487 gs=1 cs=0 l=1 c_cookie=17910326732361028527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560755362700 0x5607553446d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 --2- 10.20.193.28:0/3066519594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5607553214c0 0x560755343710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f2942ffd640 0 client.20646 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 >> 10.20.193.28:0/3066519594 conn(0x5607552401c0 msgr2=0x560755336bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 shutdown_connections 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 1 -- 10.20.193.28:0/3066519594 wait complete. 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.357+0000 7f29920ace00 20 client.20646 trim_cache size 0 max 16384 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 -- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29640b5760 msgr2=0x7f29640d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29640b5760 0x7f29640d5c10 secure :-1 s=READY pgs=622 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2984006e90 tx=0x7f29840157e0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 -- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f298810f1a0 msgr2=0x7f29880f88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f298810f1a0 0x7f29880f88a0 secure :-1 s=READY pgs=1485 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2978009480 tx=0x7f297800ee60 comp rx=0 tx=0).stop 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 -- 10.20.193.28:0/3593730228 shutdown_connections 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f29640b5760 0x7f29640d5c10 unknown :-1 s=CLOSED pgs=622 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2988110ce0 0x7f29880f90e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2988110330 0x7f2988171650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 --2- 10.20.193.28:0/3593730228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f298810f1a0 0x7f29880f88a0 unknown :-1 s=CLOSED pgs=1485 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 -- 10.20.193.28:0/3593730228 >> 10.20.193.28:0/3593730228 conn(0x7f29880ec8f0 msgr2=0x7f29880eee90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 -- 10.20.193.28:0/3593730228 shutdown_connections 2026-02-20T13:31:53.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:31:53.358+0000 7f298fac3640 1 -- 10.20.193.28:0/3593730228 wait complete. 2026-02-20T13:31:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:54 trial127 ceph-mon[43817]: pgmap v618: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:31:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:54 trial034 ceph-mon[43332]: pgmap v618: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:31:55.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:54 trial028 ceph-mon[37442]: pgmap v618: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-20T13:31:56.911 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:31:56.962 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:56 trial028 ceph-mon[37442]: pgmap v619: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2026-02-20T13:31:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:56 trial127 ceph-mon[43817]: pgmap v619: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2026-02-20T13:31:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:56 trial034 ceph-mon[43332]: pgmap v619: 97 pgs: 97 active+clean; 2.6 MiB data, 333 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2026-02-20T13:31:57.097 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:57.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 -- 10.20.193.28:0/2925296320 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810c320 msgr2=0x7fd0c81108f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/2925296320 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810c320 0x7fd0c81108f0 secure :-1 s=READY pgs=512 gs=2 cs=0 l=1 c_cookie=15662638588399470483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b80098c0 tx=0x7fd0b802f0c0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 -- 10.20.193.28:0/2925296320 shutdown_connections 2026-02-20T13:31:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/2925296320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c8110f10 0x7fd0c81113b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/2925296320 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810c320 0x7fd0c81108f0 unknown :-1 s=CLOSED pgs=512 gs=2 cs=0 l=1 c_cookie=15662638588399470483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/2925296320 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0c810b930 0x7fd0c810bd00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 -- 10.20.193.28:0/2925296320 >> 10.20.193.28:0/2925296320 conn(0x7fd0c80e95c0 msgr2=0x7fd0c81099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 -- 10.20.193.28:0/2925296320 shutdown_connections 2026-02-20T13:31:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.287+0000 7fd0ccdff640 1 -- 10.20.193.28:0/2925296320 wait complete. 2026-02-20T13:31:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0ccdff640 1 Processor -- start 2026-02-20T13:31:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0ccdff640 1 -- start start 2026-02-20T13:31:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0ccdff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810b930 0x7fd0c8122430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0ccdff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c810c320 0x7fd0c8122970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0ccdff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0c8110f10 0x7fd0c8127d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0ccdff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8128360 con 0x7fd0c810c320 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0ccdff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c81284d0 con 0x7fd0c810b930 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0ccdff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8128690 con 0x7fd0c8110f10 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0c6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c810c320 0x7fd0c8122970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810b930 0x7fd0c8122430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810b930 0x7fd0c8122430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54452/0 (socket says 10.20.193.28:54452) 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.288+0000 7fd0c77fe640 1 -- 10.20.193.28:0/620653451 learned_addr learned my addr 10.20.193.28:0/620653451 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0c8110f10 0x7fd0c8127d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c6ffd640 1 -- 10.20.193.28:0/620653451 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0c8110f10 msgr2=0x7fd0c8127d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c6ffd640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0c8110f10 0x7fd0c8127d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c6ffd640 1 -- 10.20.193.28:0/620653451 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810b930 msgr2=0x7fd0c8122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c6ffd640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810b930 0x7fd0c8122430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c6ffd640 1 -- 10.20.193.28:0/620653451 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc00a650 con 0x7fd0c810c320 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c6ffd640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c810c320 0x7fd0c8122970 secure :-1 s=READY pgs=1488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b8009230 tx=0x7fd0b802fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c4ff9640 1 -- 10.20.193.28:0/620653451 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0b803d070 con 0x7fd0c810c320 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0ccdff640 1 -- 10.20.193.28:0/620653451 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b80094b0 con 0x7fd0c810c320 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0ccdff640 1 -- 10.20.193.28:0/620653451 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c8168ed0 con 0x7fd0c810c320 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c4ff9640 1 -- 10.20.193.28:0/620653451 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0b8005d40 con 0x7fd0c810c320 2026-02-20T13:31:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.289+0000 7fd0c4ff9640 1 -- 10.20.193.28:0/620653451 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0b80417b0 con 0x7fd0c810c320 2026-02-20T13:31:57.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.292+0000 7fd0c4ff9640 1 -- 10.20.193.28:0/620653451 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd0b804b440 con 0x7fd0c810c320 2026-02-20T13:31:57.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.293+0000 7fd0c4ff9640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd09c0b5760 0x7fd09c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.293+0000 7fd0c4ff9640 1 -- 10.20.193.28:0/620653451 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd0b810b2b0 con 0x7fd0c810c320 2026-02-20T13:31:57.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.293+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd09c0b5760 0x7fd09c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.294+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd09c0b5760 0x7fd09c0d5c10 secure :-1 s=READY pgs=623 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b40095b0 tx=0x7fd0b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:57.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0d0082e00 1 Processor -- start 2026-02-20T13:31:57.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0d0082e00 1 -- start start 2026-02-20T13:31:57.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 0x563a6417f550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 0x563a641c4400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e4d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563a640957d0 con 0x563a641c4940 2026-02-20T13:31:57.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563a64091500 con 0x563a6417f180 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563a6408b4a0 con 0x563a6417fa90 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0c77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 0x563a6417f550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40870/0 (socket says 10.20.193.28:40870) 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.295+0000 7fd0c7fff640 1 -- 10.20.193.28:0/1850704128 learned_addr learned my addr 10.20.193.28:0/1850704128 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd0c6ffd640 1 --2- 10.20.193.28:0/1850704128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 0x563a641c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd0c7fff640 1 -- 10.20.193.28:0/1850704128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 msgr2=0x563a641c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/1850704128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 0x563a641c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd0c7fff640 1 -- 10.20.193.28:0/1850704128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 msgr2=0x563a6417f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/1850704128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 0x563a6417f550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd0c7fff640 1 -- 10.20.193.28:0/1850704128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a64036d80 con 0x563a641c4940 2026-02-20T13:31:57.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/1850704128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e4d20 secure :-1 s=READY pgs=1489 gs=2 cs=0 l=1 c_cookie=13234147622427763436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0bc00a620 tx=0x7fd0bc00ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a9232523e322ec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd08bfff640 1 -- 10.20.193.28:0/1850704128 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0bc00ae50 con 0x563a641c4940 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd08bfff640 1 -- 10.20.193.28:0/1850704128 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0bc013930 con 0x563a641c4940 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.296+0000 7fd08bfff640 1 -- 10.20.193.28:0/1850704128 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0bc012a60 con 0x563a641c4940 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1850704128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 msgr2=0x563a641e4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/1850704128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e4d20 secure :-1 s=READY pgs=1489 gs=2 cs=0 l=1 c_cookie=13234147622427763436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0bc00a620 tx=0x7fd0bc00ac50 comp rx=0 tx=0).stop 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1850704128 shutdown_connections 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/1850704128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e4d20 unknown :-1 s=CLOSED pgs=1489 gs=2 cs=0 l=1 c_cookie=13234147622427763436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/1850704128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 0x563a641c4400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/1850704128 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 0x563a6417f550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1850704128 >> 10.20.193.28:0/1850704128 conn(0x563a6415d680 msgr2=0x563a6417da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1850704128 shutdown_connections 2026-02-20T13:31:57.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.297+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1850704128 wait complete. 2026-02-20T13:31:57.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.298+0000 7fd0d0082e00 1 -- start start 2026-02-20T13:31:57.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.298+0000 7fd0d0082e00 1 Processor -- start 2026-02-20T13:31:57.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 0x563a641dc110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417fa90 0x563a641dc650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e1640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563a641e1b80 con 0x563a641c4940 2026-02-20T13:31:57.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563a641e1cf0 con 0x563a6417fa90 2026-02-20T13:31:57.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563a641e1eb0 con 0x563a6417f180 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e1640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c6ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417fa90 0x563a641dc650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e1640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40874/0 (socket says 10.20.193.28:40874) 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 -- 10.20.193.28:0/3416728484 learned_addr learned my addr 10.20.193.28:0/3416728484 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 0x563a641dc110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 -- 10.20.193.28:0/3416728484 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 msgr2=0x563a641dc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 0x563a641dc110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 -- 10.20.193.28:0/3416728484 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417fa90 msgr2=0x563a641dc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417fa90 0x563a641dc650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 -- 10.20.193.28:0/3416728484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6400f350 con 0x563a641c4940 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e1640 secure :-1 s=READY pgs=1490 gs=2 cs=0 l=1 c_cookie=5279526030229478051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0bc006a50 tx=0x7fd0bc012580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4944a4f3ce419aa3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:57.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0897fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0897fa640 1 -- 10.20.193.28:0/3416728484 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0bc022070 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0897fa640 1 -- 10.20.193.28:0/3416728484 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0bc012650 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0897fa640 1 -- 10.20.193.28:0/3416728484 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0bc027b90 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.299+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0bc0051a0 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0897fa640 1 -- 10.20.193.28:0/3416728484 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd0bc01c450 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 10 client.20658 _ll_register_callbacks cb 0x563a6400c9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563a63d216f0 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0897fa640 1 -- 10.20.193.28:0/3416728484 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd0bc027470 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 10 client.20658 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x563a64021150 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0897fa640 1 -- 10.20.193.28:0/3416728484 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd0bc027d20 con 0x563a641c4940 2026-02-20T13:31:57.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 10 client.20658 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 10 client.20658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 20 client.20658 populate_metadata read hostname 'trial028' 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563a641c1920 0x563a641c1dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 4 client.20658 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.300+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a64098d60 con 0x563a641c1920 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.301+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563a641c1920 0x563a641c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.301+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563a641c1920 0x563a641c1dc0 crc :-1 s=READY pgs=415 gs=4 cs=0 l=0 c_cookie=18003641783933391318 s_cookie=14351450517550824218 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9d9c8d0aabad1d6 server_cookie=c72a98355e367b1a in_seq=0 out_seq=0 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.301+0000 7fd0897fa640 10 client.20658 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0897fa640 1 -- 10.20.193.28:0/3416728484 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563a64098d60 con 0x563a641c1920 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0897fa640 10 client.20658 handle_command_reply: tid=0 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 client.20658 shutdown 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 msgr2=0x563a641e1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e1640 secure :-1 s=READY pgs=1490 gs=2 cs=0 l=1 c_cookie=5279526030229478051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0bc006a50 tx=0x7fd0bc012580 comp rx=0 tx=0).stop 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 shutdown_connections 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563a641c1920 0x563a641c1dc0 crc :-1 s=READY pgs=415 gs=4 cs=0 l=0 c_cookie=18003641783933391318 s_cookie=14351450517550824218 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641e1640 unknown :-1 s=CLOSED pgs=1490 gs=2 cs=0 l=1 c_cookie=5279526030229478051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417fa90 0x563a641dc650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/3416728484 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 0x563a641dc110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 >> 10.20.193.28:0/3416728484 conn(0x563a6415d680 msgr2=0x563a6417da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0897fa640 0 client.20658 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 shutdown_connections 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 1 -- 10.20.193.28:0/3416728484 wait complete. 2026-02-20T13:31:57.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.302+0000 7fd0d0082e00 20 client.20658 trim_cache size 0 max 16384 2026-02-20T13:31:57.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0d0082e00 1 Processor -- start 2026-02-20T13:31:57.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0d0082e00 1 -- start start 2026-02-20T13:31:57.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 0x563a641c36b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 0x563a641c3bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641c4130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563a640890d0 con 0x563a641c4940 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563a63d49700 con 0x563a6417f180 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563a6417f790 con 0x563a6417fa90 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40878/0 (socket says 10.20.193.28:40878) 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c7fff640 1 -- 10.20.193.28:0/1457665447 learned_addr learned my addr 10.20.193.28:0/1457665447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/1457665447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 0x563a641c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c7fff640 1 -- 10.20.193.28:0/1457665447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 msgr2=0x563a641c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:57.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/1457665447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 0x563a641c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c7fff640 1 -- 10.20.193.28:0/1457665447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 msgr2=0x563a641c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:57.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/1457665447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 0x563a641c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.312+0000 7fd0c7fff640 1 -- 10.20.193.28:0/1457665447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a641ce8e0 con 0x563a641c4940 2026-02-20T13:31:57.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/1457665447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641c4130 secure :-1 s=READY pgs=1491 gs=1 cs=0 l=1 c_cookie=10826942043139868717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0bc030a00 tx=0x7fd0bc01f030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9641066cb518082d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:57.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd08b7fe640 1 -- 10.20.193.28:0/1457665447 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0bc022040 con 0x563a641c4940 2026-02-20T13:31:57.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd08b7fe640 1 -- 10.20.193.28:0/1457665447 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0bc037070 con 0x563a641c4940 2026-02-20T13:31:57.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd08b7fe640 1 -- 10.20.193.28:0/1457665447 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0bc0125f0 con 0x563a641c4940 2026-02-20T13:31:57.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1457665447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 msgr2=0x563a641c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/1457665447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641c4130 secure :-1 s=READY pgs=1491 gs=1 cs=0 l=1 c_cookie=10826942043139868717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0bc030a00 tx=0x7fd0bc01f030 comp rx=0 tx=0).stop 2026-02-20T13:31:57.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1457665447 shutdown_connections 2026-02-20T13:31:57.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/1457665447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a641c4940 0x563a641c4130 unknown :-1 s=CLOSED pgs=1491 gs=1 cs=0 l=1 c_cookie=10826942043139868717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/1457665447 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417fa90 0x563a641c3bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/1457665447 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a6417f180 0x563a641c36b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1457665447 >> 10.20.193.28:0/1457665447 conn(0x563a6415d680 msgr2=0x563a641d8500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1457665447 shutdown_connections 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.313+0000 7fd0d0082e00 1 -- 10.20.193.28:0/1457665447 wait complete. 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.314+0000 7fd0d0082e00 1 -- start start 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.314+0000 7fd0d0082e00 1 Processor -- start 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.314+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 0x563a64163810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.314+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a6417fa90 0x563a6415ed80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.314+0000 7fd0d0082e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a641c4940 0x563a6415f510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.314+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563a641e5120 con 0x563a6417fa90 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.314+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x563a640890d0 con 0x563a641c4940 2026-02-20T13:31:57.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.314+0000 7fd0d0082e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x563a63d49700 con 0x563a6417f180 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a641c4940 0x563a6415f510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a641c4940 0x563a6415f510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54488/0 (socket says 10.20.193.28:54488) 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 -- 10.20.193.28:0/331845546 learned_addr learned my addr 10.20.193.28:0/331845546 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c6ffd640 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a6417fa90 0x563a6415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 0x563a64163810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 -- 10.20.193.28:0/331845546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 msgr2=0x563a64163810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 0x563a64163810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 -- 10.20.193.28:0/331845546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a6417fa90 msgr2=0x563a6415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a6417fa90 0x563a6415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 -- 10.20.193.28:0/331845546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6401bbd0 con 0x563a641c4940 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c6ffd640 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a6417fa90 0x563a6415ed80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:57.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0c7fff640 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a641c4940 0x563a6415f510 secure :-1 s=READY pgs=513 gs=1 cs=0 l=1 c_cookie=10475764704269986401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0bc00ac90 tx=0x7fd0bc006b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9161647edc966a61 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0897fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0897fa640 1 -- 10.20.193.28:0/331845546 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0bc022040 con 0x563a641c4940 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a64021150 con 0x563a641c4940 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0d0082e00 10 client.30581 _ll_register_callbacks cb 0x563a6400c9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.315+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0bc013930 con 0x563a641c4940 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0897fa640 1 -- 10.20.193.28:0/331845546 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0bc013930 con 0x563a641c4940 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0897fa640 1 -- 10.20.193.28:0/331845546 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0bc026670 con 0x563a641c4940 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0897fa640 1 -- 10.20.193.28:0/331845546 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd0bc0104e0 con 0x563a641c4940 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0897fa640 1 -- 10.20.193.28:0/331845546 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd0bc010710 con 0x563a641c4940 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0d0082e00 10 client.30581 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x563a6400f680 con 0x563a641c4940 2026-02-20T13:31:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0897fa640 1 -- 10.20.193.28:0/331845546 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd0bc027d20 con 0x563a641c4940 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0d0082e00 10 client.30581 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0d0082e00 10 client.30581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0d0082e00 20 client.30581 populate_metadata read hostname 'trial028' 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563a64271a20 0x563a64291eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0d0082e00 4 client.30581 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.316+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a63d1ef40 con 0x563a64271a20 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.317+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563a64271a20 0x563a64291eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.317+0000 7fd0c77fe640 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563a64271a20 0x563a64291eb0 crc :-1 s=READY pgs=416 gs=4 cs=0 l=0 c_cookie=2024929584123572195 s_cookie=11048947448798931613 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c19feba6cdd6fe3 server_cookie=9955bf2a339e6a9d in_seq=0 out_seq=0 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.317+0000 7fd0897fa640 10 client.30581 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0897fa640 1 -- 10.20.193.28:0/331845546 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6906 (crc 0 0 0) 0x563a63d1ef40 con 0x563a64271a20 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0897fa640 10 client.30581 handle_command_reply: tid=0 2026-02-20T13:31:57.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 client.30581 shutdown 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a641c4940 msgr2=0x563a6415f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a641c4940 0x563a6415f510 secure :-1 s=READY pgs=513 gs=1 cs=0 l=1 c_cookie=10475764704269986401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0bc00ac90 tx=0x7fd0bc006b00 comp rx=0 tx=0).stop 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 shutdown_connections 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x563a64271a20 0x563a64291eb0 crc :-1 s=READY pgs=416 gs=4 cs=0 l=0 c_cookie=2024929584123572195 s_cookie=11048947448798931613 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a6417fa90 0x563a6415ed80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x563a641c4940 0x563a6415f510 unknown :-1 s=CLOSED pgs=513 gs=1 cs=0 l=1 c_cookie=10475764704269986401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 --2- 10.20.193.28:0/331845546 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x563a6417f180 0x563a64163810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0897fa640 0 client.30581 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 >> 10.20.193.28:0/331845546 conn(0x563a6415d680 msgr2=0x563a641d8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 shutdown_connections 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 1 -- 10.20.193.28:0/331845546 wait complete. 2026-02-20T13:31:57.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.318+0000 7fd0d0082e00 20 client.30581 trim_cache size 0 max 16384 2026-02-20T13:31:57.328 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:31:57.328 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:31:57.328 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:31:57.328 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:31:57.328 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:31:57.328 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:31:57.328 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.329 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:31:57.330 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.331 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.332 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.333 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:55.786578+0000", 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.337 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:31:57.339 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.340 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.341 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:31:57.342 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 -- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd09c0b5760 msgr2=0x7fd09c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd09c0b5760 0x7fd09c0d5c10 secure :-1 s=READY pgs=623 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b40095b0 tx=0x7fd0b4005f90 comp rx=0 tx=0).stop 2026-02-20T13:31:57.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 -- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c810c320 msgr2=0x7fd0c8122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c810c320 0x7fd0c8122970 secure :-1 s=READY pgs=1488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b8009230 tx=0x7fd0b802fb50 comp rx=0 tx=0).stop 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 -- 10.20.193.28:0/620653451 shutdown_connections 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd09c0b5760 0x7fd09c0d5c10 unknown :-1 s=CLOSED pgs=623 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c810c320 0x7fd0c8122970 unknown :-1 s=CLOSED pgs=1488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0c8110f10 0x7fd0c8127d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 --2- 10.20.193.28:0/620653451 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd0c810b930 0x7fd0c8122430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 -- 10.20.193.28:0/620653451 >> 10.20.193.28:0/620653451 conn(0x7fd0c80e95c0 msgr2=0x7fd0c81099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 -- 10.20.193.28:0/620653451 shutdown_connections 2026-02-20T13:31:57.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.319+0000 7fd0ccdff640 1 -- 10.20.193.28:0/620653451 wait complete. 2026-02-20T13:31:57.457 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:31:57.458 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:31:57.642 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 -- 10.20.193.28:0/562599227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e08113430 msgr2=0x7f8e08173e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/562599227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e08113430 0x7f8e08173e00 secure :-1 s=READY pgs=1492 gs=2 cs=0 l=1 c_cookie=13867836151421189168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8dfc00aa30 tx=0x7f8dfc030270 comp rx=0 tx=0).stop 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 -- 10.20.193.28:0/562599227 shutdown_connections 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/562599227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e08113430 0x7f8e08173e00 unknown :-1 s=CLOSED pgs=1492 gs=2 cs=0 l=1 c_cookie=13867836151421189168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/562599227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e0810dc30 0x7f8e08112c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/562599227 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e0810d240 0x7f8e0810d610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 -- 10.20.193.28:0/562599227 >> 10.20.193.28:0/562599227 conn(0x7f8e080eaad0 msgr2=0x7f8e0810aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 -- 10.20.193.28:0/562599227 shutdown_connections 2026-02-20T13:31:57.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.812+0000 7f8e0c88e640 1 -- 10.20.193.28:0/562599227 wait complete. 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.813+0000 7f8e0c88e640 1 Processor -- start 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.813+0000 7f8e0c88e640 1 -- start start 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.813+0000 7f8e0c88e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e0810d240 0x7f8e080f57e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.813+0000 7f8e0c88e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e0810dc30 0x7f8e08173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.813+0000 7f8e0c88e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e08113430 0x7f8e080f5ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.813+0000 7f8e0c88e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e080fb0f0 con 0x7f8e0810d240 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.813+0000 7f8e0c88e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8e080fb260 con 0x7f8e08113430 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.813+0000 7f8e0c88e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8e080fb420 con 0x7f8e0810dc30 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e0810d240 0x7f8e080f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e06ffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e0810dc30 0x7f8e08173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e0810d240 0x7f8e080f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40904/0 (socket says 10.20.193.28:40904) 2026-02-20T13:31:57.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 -- 10.20.193.28:0/4020847655 learned_addr learned my addr 10.20.193.28:0/4020847655 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e07fff640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e08113430 0x7f8e080f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 -- 10.20.193.28:0/4020847655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e0810dc30 msgr2=0x7f8e08173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e0810dc30 0x7f8e08173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 -- 10.20.193.28:0/4020847655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e08113430 msgr2=0x7f8e080f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e08113430 0x7f8e080f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 -- 10.20.193.28:0/4020847655 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc00a650 con 0x7f8e0810d240 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.814+0000 7f8e077fe640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e0810d240 0x7f8e080f57e0 secure :-1 s=READY pgs=1493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8df400d950 tx=0x7f8df400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.815+0000 7f8e04ff9640 1 -- 10.20.193.28:0/4020847655 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8df4004540 con 0x7f8e0810d240 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.815+0000 7f8e04ff9640 1 -- 10.20.193.28:0/4020847655 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8df4009c80 con 0x7f8e0810d240 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.815+0000 7f8e04ff9640 1 -- 10.20.193.28:0/4020847655 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8df40106e0 con 0x7f8e0810d240 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.815+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e080fb700 con 0x7f8e0810d240 2026-02-20T13:31:57.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.815+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e080fbb50 con 0x7f8e0810d240 2026-02-20T13:31:57.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.815+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dcc005300 con 0x7f8e0810d240 2026-02-20T13:31:57.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.818+0000 7f8e04ff9640 1 -- 10.20.193.28:0/4020847655 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8df40097a0 con 0x7f8e0810d240 2026-02-20T13:31:57.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.820+0000 7f8e04ff9640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ddc0b5750 0x7f8ddc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:57.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.820+0000 7f8e04ff9640 1 -- 10.20.193.28:0/4020847655 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8df40e6ae0 con 0x7f8e0810d240 2026-02-20T13:31:57.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.820+0000 7f8e04ff9640 1 -- 10.20.193.28:0/4020847655 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8df411f730 con 0x7f8e0810d240 2026-02-20T13:31:57.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.820+0000 7f8e06ffd640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ddc0b5750 0x7f8ddc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:57.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.821+0000 7f8e06ffd640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ddc0b5750 0x7f8ddc0d5c00 secure :-1 s=READY pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e080fc180 tx=0x7f8df8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.962+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dcc005950 con 0x7f8e0810d240 2026-02-20T13:31:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.962+0000 7f8e04ff9640 1 -- 10.20.193.28:0/4020847655 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f8df40b7030 con 0x7f8e0810d240 2026-02-20T13:31:57.965 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:31:57.965 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:31:57.965 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:31:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ddc0b5750 msgr2=0x7f8ddc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ddc0b5750 0x7f8ddc0d5c00 secure :-1 s=READY pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e080fc180 tx=0x7f8df8005f90 comp rx=0 tx=0).stop 2026-02-20T13:31:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e0810d240 msgr2=0x7f8e080f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e0810d240 0x7f8e080f57e0 secure :-1 s=READY pgs=1493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8df400d950 tx=0x7f8df400de20 comp rx=0 tx=0).stop 2026-02-20T13:31:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 shutdown_connections 2026-02-20T13:31:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8ddc0b5750 0x7f8ddc0d5c00 unknown :-1 s=CLOSED pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8e08113430 0x7f8e080f5ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e0810dc30 0x7f8e08173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 --2- 10.20.193.28:0/4020847655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e0810d240 0x7f8e080f57e0 unknown :-1 s=CLOSED pgs=1493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 >> 10.20.193.28:0/4020847655 conn(0x7f8e080eaad0 msgr2=0x7f8e0810b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.963+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 shutdown_connections 2026-02-20T13:31:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:57.964+0000 7f8e0c88e640 1 -- 10.20.193.28:0/4020847655 wait complete. 2026-02-20T13:31:58.100 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:31:58.285 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:58.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 -- 10.20.193.28:0/2349960049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668062ae0 msgr2=0x7f6668060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 --2- 10.20.193.28:0/2349960049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668062ae0 0x7f6668060fb0 secure :-1 s=READY pgs=1494 gs=1 cs=0 l=1 c_cookie=1836327296020210532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6658009950 tx=0x7f665802f190 comp rx=0 tx=0).stop 2026-02-20T13:31:58.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 -- 10.20.193.28:0/2349960049 shutdown_connections 2026-02-20T13:31:58.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 --2- 10.20.193.28:0/2349960049 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6668159ed0 0x7f666817a2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 --2- 10.20.193.28:0/2349960049 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66680614f0 0x7f6668061920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 --2- 10.20.193.28:0/2349960049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668062ae0 0x7f6668060fb0 unknown :-1 s=CLOSED pgs=1494 gs=1 cs=0 l=1 c_cookie=1836327296020210532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 -- 10.20.193.28:0/2349960049 >> 10.20.193.28:0/2349960049 conn(0x7f66680eac10 msgr2=0x7f666810b020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:58.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 -- 10.20.193.28:0/2349960049 shutdown_connections 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.456+0000 7f666f54f640 1 -- 10.20.193.28:0/2349960049 wait complete. 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666f54f640 1 Processor -- start 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666f54f640 1 -- start start 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666f54f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66680614f0 0x7f666805d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666f54f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6668062ae0 0x7f666805db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666f54f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668159ed0 0x7f666816fa30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666f54f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6668170050 con 0x7f6668159ed0 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666f54f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f66681701c0 con 0x7f6668062ae0 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666f54f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6668170380 con 0x7f66680614f0 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666dac5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668159ed0 0x7f666816fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666dac5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668159ed0 0x7f666816fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40918/0 (socket says 10.20.193.28:40918) 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666dac5640 1 -- 10.20.193.28:0/4028581607 learned_addr learned my addr 10.20.193.28:0/4028581607 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666cac3640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6668062ae0 0x7f666805db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666d2c4640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66680614f0 0x7f666805d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666dac5640 1 -- 10.20.193.28:0/4028581607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66680614f0 msgr2=0x7f666805d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666dac5640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66680614f0 0x7f666805d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666dac5640 1 -- 10.20.193.28:0/4028581607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6668062ae0 msgr2=0x7f666805db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666dac5640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6668062ae0 0x7f666805db30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.457+0000 7f666dac5640 1 -- 10.20.193.28:0/4028581607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6658009570 con 0x7f6668159ed0 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.458+0000 7f666dac5640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668159ed0 0x7f666816fa30 secure :-1 s=READY pgs=1495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666400f8d0 tx=0x7f666400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.458+0000 7f66567fc640 1 -- 10.20.193.28:0/4028581607 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f666400dce0 con 0x7f6668159ed0 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.458+0000 7f66567fc640 1 -- 10.20.193.28:0/4028581607 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f666400de40 con 0x7f6668159ed0 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.458+0000 7f66567fc640 1 -- 10.20.193.28:0/4028581607 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66640116b0 con 0x7f6668159ed0 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.458+0000 7f666f54f640 1 -- 10.20.193.28:0/4028581607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6668170660 con 0x7f6668159ed0 2026-02-20T13:31:58.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.458+0000 7f666f54f640 1 -- 10.20.193.28:0/4028581607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6668170d40 con 0x7f6668159ed0 2026-02-20T13:31:58.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.461+0000 7f66567fc640 1 -- 10.20.193.28:0/4028581607 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6664020060 con 0x7f6668159ed0 2026-02-20T13:31:58.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.463+0000 7f66567fc640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66440b56e0 0x7f66440d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.463+0000 7f66567fc640 1 -- 10.20.193.28:0/4028581607 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6664015070 con 0x7f6668159ed0 2026-02-20T13:31:58.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.463+0000 7f666d2c4640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66440b56e0 0x7f66440d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.463+0000 7f666d2c4640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66440b56e0 0x7f66440d5b90 secure :-1 s=READY pgs=625 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66580023d0 tx=0x7f6658031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:58.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.463+0000 7f6671549e00 1 Processor -- start 2026-02-20T13:31:58.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.463+0000 7f6671549e00 1 -- start start 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f6671549e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed507a730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f6671549e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507ac70 0x559ed50bf5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f6671549e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50dff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f6671549e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ed4f90780 con 0x559ed507ac70 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f6671549e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559ed4f8c4b0 con 0x559ed50bfb20 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f6671549e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559ed4f86450 con 0x559ed507a360 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507ac70 0x559ed50bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666d2c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed507a730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507ac70 0x559ed50bf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40934/0 (socket says 10.20.193.28:40934) 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 -- 10.20.193.28:0/2910524427 learned_addr learned my addr 10.20.193.28:0/2910524427 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:58.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666dac5640 1 --2- 10.20.193.28:0/2910524427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 -- 10.20.193.28:0/2910524427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 msgr2=0x559ed507a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 --2- 10.20.193.28:0/2910524427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed507a730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 -- 10.20.193.28:0/2910524427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 msgr2=0x559ed50dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 --2- 10.20.193.28:0/2910524427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50dff00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 -- 10.20.193.28:0/2910524427 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed4f31d10 con 0x559ed507ac70 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.464+0000 7f666cac3640 1 --2- 10.20.193.28:0/2910524427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507ac70 0x559ed50bf5e0 secure :-1 s=READY pgs=1496 gs=1 cs=0 l=1 c_cookie=8914037137983948608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f665c002b60 tx=0x7f665c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb5058c642c4740 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6635ce5640 1 -- 10.20.193.28:0/2910524427 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f665c002e80 con 0x559ed507ac70 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6635ce5640 1 -- 10.20.193.28:0/2910524427 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f665c00fe50 con 0x559ed507ac70 2026-02-20T13:31:58.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6635ce5640 1 -- 10.20.193.28:0/2910524427 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f665c010920 con 0x559ed507ac70 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 -- 10.20.193.28:0/2910524427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507ac70 msgr2=0x559ed50bf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 --2- 10.20.193.28:0/2910524427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507ac70 0x559ed50bf5e0 secure :-1 s=READY pgs=1496 gs=1 cs=0 l=1 c_cookie=8914037137983948608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f665c002b60 tx=0x7f665c00f730 comp rx=0 tx=0).stop 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 -- 10.20.193.28:0/2910524427 shutdown_connections 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 --2- 10.20.193.28:0/2910524427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507ac70 0x559ed50bf5e0 unknown :-1 s=CLOSED pgs=1496 gs=1 cs=0 l=1 c_cookie=8914037137983948608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 --2- 10.20.193.28:0/2910524427 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50dff00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 --2- 10.20.193.28:0/2910524427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed507a730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 -- 10.20.193.28:0/2910524427 >> 10.20.193.28:0/2910524427 conn(0x559ed5058860 msgr2=0x559ed5078c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 -- 10.20.193.28:0/2910524427 shutdown_connections 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.465+0000 7f6671549e00 1 -- 10.20.193.28:0/2910524427 wait complete. 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.466+0000 7f6671549e00 1 -- start start 2026-02-20T13:31:58.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f6671549e00 1 Processor -- start 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f6671549e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d76f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f6671549e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 0x559ed50d7c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f6671549e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50dcc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f6671549e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ed50dd160 con 0x559ed507a360 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f6671549e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559ed50dd2d0 con 0x559ed50bfb20 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f6671549e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559ed50dd490 con 0x559ed507ac70 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f666d2c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f666d2c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40948/0 (socket says 10.20.193.28:40948) 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f666d2c4640 1 -- 10.20.193.28:0/1196176121 learned_addr learned my addr 10.20.193.28:0/1196176121 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f666cac3640 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 0x559ed50d7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f666dac5640 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f666d2c4640 1 -- 10.20.193.28:0/1196176121 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 msgr2=0x559ed50d7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.467+0000 7f666d2c4640 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 0x559ed50d7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f666d2c4640 1 -- 10.20.193.28:0/1196176121 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 msgr2=0x559ed50dcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f666d2c4640 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50dcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f666d2c4640 1 -- 10.20.193.28:0/1196176121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed4f0a3c0 con 0x559ed507a360 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f666d2c4640 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d76f0 secure :-1 s=READY pgs=1497 gs=1 cs=0 l=1 c_cookie=15053249385665811137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66580043a0 tx=0x7f6658009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e7e28f8bfa52c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6622ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6622ffd640 1 -- 10.20.193.28:0/1196176121 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6658038d50 con 0x559ed507a360 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6622ffd640 1 -- 10.20.193.28:0/1196176121 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66580438e0 con 0x559ed507a360 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6622ffd640 1 -- 10.20.193.28:0/1196176121 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6658050650 con 0x559ed507a360 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c002780 con 0x559ed507a360 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6622ffd640 1 -- 10.20.193.28:0/1196176121 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f66580507b0 con 0x559ed507a360 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6671549e00 10 client.20682 _ll_register_callbacks cb 0x559ed4f07a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ed4c1c6f0 con 0x559ed507a360 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6622ffd640 1 -- 10.20.193.28:0/1196176121 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6658043400 con 0x559ed507a360 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6671549e00 10 client.20682 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:58.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.468+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559ed4f1c0e0 con 0x559ed507a360 2026-02-20T13:31:58.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.469+0000 7f6622ffd640 1 -- 10.20.193.28:0/1196176121 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f665804f070 con 0x559ed507a360 2026-02-20T13:31:58.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.469+0000 7f6671549e00 10 client.20682 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:58.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.469+0000 7f6671549e00 10 client.20682 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:31:58.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.469+0000 7f6671549e00 20 client.20682 populate_metadata read hostname 'trial028' 2026-02-20T13:31:58.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.469+0000 7f6671549e00 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559ed50dfbd0 0x559ed50bd8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.469+0000 7f6671549e00 4 client.20682 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.469+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ed4f28f80 con 0x559ed50dfbd0 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.469+0000 7f666cac3640 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559ed50dfbd0 0x559ed50bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6622ffd640 10 client.20682 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f666cac3640 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559ed50dfbd0 0x559ed50bd8a0 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=3213413836358705315 s_cookie=10360984543848383360 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2c9856dbd87c60a3 server_cookie=8fc99c8c3b654380 in_seq=0 out_seq=0 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6622ffd640 1 -- 10.20.193.28:0/1196176121 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559ed4f28f80 con 0x559ed50dfbd0 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6622ffd640 10 client.20682 handle_command_reply: tid=0 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6671549e00 1 client.20682 shutdown 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 msgr2=0x559ed50d76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6671549e00 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d76f0 secure :-1 s=READY pgs=1497 gs=1 cs=0 l=1 c_cookie=15053249385665811137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66580043a0 tx=0x7f6658009310 comp rx=0 tx=0).stop 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 shutdown_connections 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6671549e00 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559ed50dfbd0 0x559ed50bd8a0 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=3213413836358705315 s_cookie=10360984543848383360 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6671549e00 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50dcc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6671549e00 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 0x559ed50d7c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6671549e00 1 --2- 10.20.193.28:0/1196176121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d76f0 unknown :-1 s=CLOSED pgs=1497 gs=1 cs=0 l=1 c_cookie=15053249385665811137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.470+0000 7f6622ffd640 0 client.20682 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.471+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 >> 10.20.193.28:0/1196176121 conn(0x559ed5058860 msgr2=0x559ed5078c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:58.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.471+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 shutdown_connections 2026-02-20T13:31:58.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.471+0000 7f6671549e00 1 -- 10.20.193.28:0/1196176121 wait complete. 2026-02-20T13:31:58.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.471+0000 7f6671549e00 20 client.20682 trim_cache size 0 max 16384 2026-02-20T13:31:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.478+0000 7f6671549e00 1 Processor -- start 2026-02-20T13:31:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.478+0000 7f6671549e00 1 -- start start 2026-02-20T13:31:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.478+0000 7f6671549e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d4910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.478+0000 7f6671549e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 0x559ed50d4e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.478+0000 7f6671549e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50ba780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f6671549e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ed4f84080 con 0x559ed507a360 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f6671549e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559ed4c44700 con 0x559ed50bfb20 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f6671549e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559ed507b040 con 0x559ed507ac70 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d4910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40958/0 (socket says 10.20.193.28:40958) 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 -- 10.20.193.28:0/3242189533 learned_addr learned my addr 10.20.193.28:0/3242189533 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666dac5640 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50ba780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666cac3640 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 0x559ed50d4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 -- 10.20.193.28:0/3242189533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 msgr2=0x559ed50d4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 0x559ed50d4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 -- 10.20.193.28:0/3242189533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 msgr2=0x559ed50ba780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50ba780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 -- 10.20.193.28:0/3242189533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed4f16b60 con 0x559ed507a360 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666dac5640 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50ba780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f666d2c4640 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d4910 secure :-1 s=READY pgs=1498 gs=1 cs=0 l=1 c_cookie=5526518430448416504 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6658059000 tx=0x7f665805a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb2233b5386f6f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:58.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f66354e4640 1 -- 10.20.193.28:0/3242189533 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6658063e20 con 0x559ed507a360 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f66354e4640 1 -- 10.20.193.28:0/3242189533 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6658048070 con 0x559ed507a360 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.479+0000 7f66354e4640 1 -- 10.20.193.28:0/3242189533 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6658043960 con 0x559ed507a360 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 -- 10.20.193.28:0/3242189533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 msgr2=0x559ed50d4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d4910 secure :-1 s=READY pgs=1498 gs=1 cs=0 l=1 c_cookie=5526518430448416504 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6658059000 tx=0x7f665805a000 comp rx=0 tx=0).stop 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 -- 10.20.193.28:0/3242189533 shutdown_connections 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed50bfb20 0x559ed50ba780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507ac70 0x559ed50d4e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 --2- 10.20.193.28:0/3242189533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed507a360 0x559ed50d4910 unknown :-1 s=CLOSED pgs=1498 gs=1 cs=0 l=1 c_cookie=5526518430448416504 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 -- 10.20.193.28:0/3242189533 >> 10.20.193.28:0/3242189533 conn(0x559ed5058860 msgr2=0x559ed50c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 -- 10.20.193.28:0/3242189533 shutdown_connections 2026-02-20T13:31:58.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.480+0000 7f6671549e00 1 -- 10.20.193.28:0/3242189533 wait complete. 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f6671549e00 1 -- start start 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f6671549e00 1 Processor -- start 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f6671549e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed505e5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f6671549e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed507ac70 0x559ed50db970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f6671549e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed50bfb20 0x559ed50dbeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f666cac3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed507ac70 0x559ed50db970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f666cac3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed507ac70 0x559ed50db970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54572/0 (socket says 10.20.193.28:54572) 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f666dac5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed50bfb20 0x559ed50dbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f666dac5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed50bfb20 0x559ed50dbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40960/0 (socket says 10.20.193.28:40960) 2026-02-20T13:31:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f666d2c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed505e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.481+0000 7f666d2c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed505e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42736/0 (socket says 10.20.193.28:42736) 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f6671549e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ed505ec00 con 0x559ed50bfb20 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f6671549e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559ed505ed70 con 0x559ed507ac70 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559ed50dc3f0 con 0x559ed507a360 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f666cac3640 1 -- 10.20.193.28:0/2552539166 learned_addr learned my addr 10.20.193.28:0/2552539166 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f666cac3640 1 -- 10.20.193.28:0/2552539166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 msgr2=0x559ed505e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f666cac3640 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed505e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f666cac3640 1 -- 10.20.193.28:0/2552539166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed50bfb20 msgr2=0x559ed50dbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f666cac3640 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed50bfb20 0x559ed50dbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f666cac3640 1 -- 10.20.193.28:0/2552539166 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed4f0a6f0 con 0x559ed507ac70 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f666dac5640 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed50bfb20 0x559ed50dbeb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f666cac3640 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed507ac70 0x559ed50db970 secure :-1 s=READY pgs=514 gs=2 cs=0 l=1 c_cookie=3038551683507051293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f665c005940 tx=0x7f665c010470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a2b1aa83f1a5b1d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f6622ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f6622ffd640 1 -- 10.20.193.28:0/2552539166 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f665c021040 con 0x559ed507ac70 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f6622ffd640 1 -- 10.20.193.28:0/2552539166 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f665c022040 con 0x559ed507ac70 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f6622ffd640 1 -- 10.20.193.28:0/2552539166 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f665c02a880 con 0x559ed507ac70 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.482+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed4f1c0e0 con 0x559ed507ac70 2026-02-20T13:31:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6622ffd640 1 -- 10.20.193.28:0/2552539166 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f665c02aa10 con 0x559ed507ac70 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 10 client.30605 _ll_register_callbacks cb 0x559ed4f07a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f665c00fe50 con 0x559ed507ac70 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6622ffd640 1 -- 10.20.193.28:0/2552539166 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f665c02abd0 con 0x559ed507ac70 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 10 client.30605 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559ed4f1c340 con 0x559ed507ac70 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6622ffd640 1 -- 10.20.193.28:0/2552539166 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f665c005360 con 0x559ed507ac70 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 10 client.30605 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 10 client.30605 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 20 client.30605 populate_metadata read hostname 'trial028' 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559ed516d4d0 0x559ed518d980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 4 client.30605 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559ed4c19f40 con 0x559ed516d4d0 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.483+0000 7f666d2c4640 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559ed516d4d0 0x559ed518d980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f666d2c4640 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559ed516d4d0 0x559ed518d980 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=4281228008744428904 s_cookie=386898202124646832 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3b69fa30e7aa2568 server_cookie=55e89dd6de079b0 in_seq=0 out_seq=0 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6622ffd640 10 client.30605 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6622ffd640 1 -- 10.20.193.28:0/2552539166 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559ed4c19f40 con 0x559ed516d4d0 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6622ffd640 10 client.30605 handle_command_reply: tid=0 2026-02-20T13:31:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 client.30605 shutdown 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed507ac70 msgr2=0x559ed50db970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed507ac70 0x559ed50db970 secure :-1 s=READY pgs=514 gs=2 cs=0 l=1 c_cookie=3038551683507051293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f665c005940 tx=0x7f665c010470 comp rx=0 tx=0).stop 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 shutdown_connections 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x559ed516d4d0 0x559ed518d980 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=4281228008744428904 s_cookie=386898202124646832 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ed50bfb20 0x559ed50dbeb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559ed507ac70 0x559ed50db970 unknown :-1 s=CLOSED pgs=514 gs=2 cs=0 l=1 c_cookie=3038551683507051293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 --2- 10.20.193.28:0/2552539166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559ed507a360 0x559ed505e5c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6622ffd640 0 client.30605 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 >> 10.20.193.28:0/2552539166 conn(0x559ed5058860 msgr2=0x559ed50d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 shutdown_connections 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 1 -- 10.20.193.28:0/2552539166 wait complete. 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.484+0000 7f6671549e00 20 client.30605 trim_cache size 0 max 16384 2026-02-20T13:31:58.490 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 -- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66440b56e0 msgr2=0x7f66440d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66440b56e0 0x7f66440d5b90 secure :-1 s=READY pgs=625 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66580023d0 tx=0x7f6658031040 comp rx=0 tx=0).stop 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 -- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668159ed0 msgr2=0x7f666816fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668159ed0 0x7f666816fa30 secure :-1 s=READY pgs=1495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666400f8d0 tx=0x7f666400fda0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 -- 10.20.193.28:0/4028581607 shutdown_connections 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f66440b56e0 0x7f66440d5b90 unknown :-1 s=CLOSED pgs=625 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6668159ed0 0x7f666816fa30 unknown :-1 s=CLOSED pgs=1495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6668062ae0 0x7f666805db30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 --2- 10.20.193.28:0/4028581607 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f66680614f0 0x7f666805d5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 -- 10.20.193.28:0/4028581607 >> 10.20.193.28:0/4028581607 conn(0x7f66680eac10 msgr2=0x7f666810aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 -- 10.20.193.28:0/4028581607 shutdown_connections 2026-02-20T13:31:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.485+0000 7f666f54f640 1 -- 10.20.193.28:0/4028581607 wait complete. 2026-02-20T13:31:58.621 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:31:58.806 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:58 trial028 ceph-mon[37442]: pgmap v620: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:31:58.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:31:58 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4020847655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:58 trial127 ceph-mon[43817]: pgmap v620: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:31:58.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:31:58 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4020847655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.985+0000 7fa83f53c640 1 -- 10.20.193.28:0/253658627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa83810ba80 msgr2=0x7fa83810be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.985+0000 7fa83f53c640 1 --2- 10.20.193.28:0/253658627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa83810ba80 0x7fa83810be50 secure :-1 s=READY pgs=1499 gs=2 cs=0 l=1 c_cookie=15237022660367740947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8280098c0 tx=0x7fa82802f0c0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.985+0000 7fa83f53c640 1 -- 10.20.193.28:0/253658627 shutdown_connections 2026-02-20T13:31:58.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.985+0000 7fa83f53c640 1 --2- 10.20.193.28:0/253658627 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa838111060 0x7fa838111500 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.985+0000 7fa83f53c640 1 --2- 10.20.193.28:0/253658627 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa83810c470 0x7fa838110a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.985+0000 7fa83f53c640 1 --2- 10.20.193.28:0/253658627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa83810ba80 0x7fa83810be50 unknown :-1 s=CLOSED pgs=1499 gs=2 cs=0 l=1 c_cookie=15237022660367740947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.985+0000 7fa83f53c640 1 -- 10.20.193.28:0/253658627 >> 10.20.193.28:0/253658627 conn(0x7fa8380e96b0 msgr2=0x7fa838109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.986+0000 7fa83f53c640 1 -- 10.20.193.28:0/253658627 shutdown_connections 2026-02-20T13:31:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.986+0000 7fa83f53c640 1 -- 10.20.193.28:0/253658627 wait complete. 2026-02-20T13:31:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.986+0000 7fa83f53c640 1 Processor -- start 2026-02-20T13:31:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.986+0000 7fa83f53c640 1 -- start start 2026-02-20T13:31:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83f53c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa83810ba80 0x7fa838121a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83f53c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa83810c470 0x7fa838121f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83f53c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa838111060 0x7fa838127360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83f53c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa838127980 con 0x7fa838111060 2026-02-20T13:31:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83f53c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa838127af0 con 0x7fa83810ba80 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83f53c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa838127cb0 con 0x7fa83810c470 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83cab0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa83810c470 0x7fa838121f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83d2b1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa83810ba80 0x7fa838121a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83cab0640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa83810c470 0x7fa838121f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42760/0 (socket says 10.20.193.28:42760) 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83cab0640 1 -- 10.20.193.28:0/3921905220 learned_addr learned my addr 10.20.193.28:0/3921905220 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83dab2640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa838111060 0x7fa838127360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83cab0640 1 -- 10.20.193.28:0/3921905220 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa83810ba80 msgr2=0x7fa838121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83cab0640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa83810ba80 0x7fa838121a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83cab0640 1 -- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa838111060 msgr2=0x7fa838127360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83cab0640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa838111060 0x7fa838127360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83cab0640 1 -- 10.20.193.28:0/3921905220 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8280094b0 con 0x7fa83810c470 2026-02-20T13:31:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.987+0000 7fa83dab2640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa838111060 0x7fa838127360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.988+0000 7fa83cab0640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa83810c470 0x7fa838121f90 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa82c00d950 tx=0x7fa82c00de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.988+0000 7fa8267fc640 1 -- 10.20.193.28:0/3921905220 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa82c004540 con 0x7fa83810c470 2026-02-20T13:31:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.988+0000 7fa8267fc640 1 -- 10.20.193.28:0/3921905220 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa82c009d00 con 0x7fa83810c470 2026-02-20T13:31:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.988+0000 7fa8267fc640 1 -- 10.20.193.28:0/3921905220 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa82c0106e0 con 0x7fa83810c470 2026-02-20T13:31:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.988+0000 7fa83f53c640 1 -- 10.20.193.28:0/3921905220 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa838127f90 con 0x7fa83810c470 2026-02-20T13:31:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.988+0000 7fa83f53c640 1 -- 10.20.193.28:0/3921905220 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa838168690 con 0x7fa83810c470 2026-02-20T13:31:58.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:58 trial034 ceph-mon[43332]: pgmap v620: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:31:58.994 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:31:58 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4020847655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:31:58.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.991+0000 7fa8267fc640 1 -- 10.20.193.28:0/3921905220 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa82c009820 con 0x7fa83810c470 2026-02-20T13:31:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.992+0000 7fa8267fc640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8140b5760 0x7fa8140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.992+0000 7fa8267fc640 1 -- 10.20.193.28:0/3921905220 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa82c0e5f30 con 0x7fa83810c470 2026-02-20T13:31:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.992+0000 7fa83d2b1640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8140b5760 0x7fa8140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.993+0000 7fa83d2b1640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8140b5760 0x7fa8140d5c10 secure :-1 s=READY pgs=626 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8280097e0 tx=0x7fa82803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.993+0000 7fa841536e00 1 Processor -- start 2026-02-20T13:31:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.993+0000 7fa841536e00 1 -- start start 2026-02-20T13:31:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa841536e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af3462730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa841536e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a75e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa841536e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c7f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa841536e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557af3378780 con 0x557af3462c70 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa841536e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557af33744b0 con 0x557af34a7b20 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa841536e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557af336e450 con 0x557af3462360 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83d2b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af3462730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83cab0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83d2b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af3462730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42770/0 (socket says 10.20.193.28:42770) 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83d2b1640 1 -- 10.20.193.28:0/491477141 learned_addr learned my addr 10.20.193.28:0/491477141 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83dab2640 1 --2- 10.20.193.28:0/491477141 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83cab0640 1 -- 10.20.193.28:0/491477141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 msgr2=0x557af3462730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83cab0640 1 --2- 10.20.193.28:0/491477141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af3462730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83cab0640 1 -- 10.20.193.28:0/491477141 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 msgr2=0x557af34c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83cab0640 1 --2- 10.20.193.28:0/491477141 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83cab0640 1 -- 10.20.193.28:0/491477141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af3319d10 con 0x557af3462c70 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa83cab0640 1 --2- 10.20.193.28:0/491477141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a75e0 secure :-1 s=READY pgs=1500 gs=1 cs=0 l=1 c_cookie=18035532397592439738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa82c005aa0 tx=0x7fa82c002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4b1528c58bebba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.994+0000 7fa805ce5640 1 -- 10.20.193.28:0/491477141 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa82c0e3ea0 con 0x557af3462c70 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa805ce5640 1 -- 10.20.193.28:0/491477141 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa82c0abd20 con 0x557af3462c70 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa805ce5640 1 -- 10.20.193.28:0/491477141 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa82c0b6f40 con 0x557af3462c70 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 -- 10.20.193.28:0/491477141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 msgr2=0x557af34a75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 --2- 10.20.193.28:0/491477141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a75e0 secure :-1 s=READY pgs=1500 gs=1 cs=0 l=1 c_cookie=18035532397592439738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa82c005aa0 tx=0x7fa82c002390 comp rx=0 tx=0).stop 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 -- 10.20.193.28:0/491477141 shutdown_connections 2026-02-20T13:31:59.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 --2- 10.20.193.28:0/491477141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a75e0 unknown :-1 s=CLOSED pgs=1500 gs=1 cs=0 l=1 c_cookie=18035532397592439738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 --2- 10.20.193.28:0/491477141 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c7f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 --2- 10.20.193.28:0/491477141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af3462730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 -- 10.20.193.28:0/491477141 >> 10.20.193.28:0/491477141 conn(0x557af3440860 msgr2=0x557af3460c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 -- 10.20.193.28:0/491477141 shutdown_connections 2026-02-20T13:31:59.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.995+0000 7fa841536e00 1 -- 10.20.193.28:0/491477141 wait complete. 2026-02-20T13:31:59.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.996+0000 7fa841536e00 1 -- start start 2026-02-20T13:31:59.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.996+0000 7fa841536e00 1 Processor -- start 2026-02-20T13:31:59.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa841536e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34bf6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa841536e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34bfc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa841536e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c4c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa841536e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557af34c51a0 con 0x557af3462c70 2026-02-20T13:31:59.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa841536e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557af34c5310 con 0x557af34a7b20 2026-02-20T13:31:59.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa841536e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557af34c54d0 con 0x557af3462360 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83d2b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83d2b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34bf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42784/0 (socket says 10.20.193.28:42784) 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83d2b1640 1 -- 10.20.193.28:0/2160565531 learned_addr learned my addr 10.20.193.28:0/2160565531 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83dab2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83cab0640 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83dab2640 1 -- 10.20.193.28:0/2160565531 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 msgr2=0x557af34bf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83dab2640 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34bf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83dab2640 1 -- 10.20.193.28:0/2160565531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 msgr2=0x557af34bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83dab2640 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34bfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83dab2640 1 -- 10.20.193.28:0/2160565531 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af32f23c0 con 0x557af34a7b20 2026-02-20T13:31:59.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.997+0000 7fa83cab0640 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34bfc00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa83dab2640 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c4c60 secure :-1 s=READY pgs=515 gs=3 cs=0 l=1 c_cookie=2693444694905552880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa834005820 tx=0x7fa834003ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=256109adf6017ff0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa7f2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2160565531 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa834017070 con 0x557af34a7b20 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2160565531 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa834005e10 con 0x557af34a7b20 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa838168690 con 0x557af34a7b20 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2160565531 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8340103c0 con 0x557af34a7b20 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 10 client.30617 _ll_register_callbacks cb 0x557af32efa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557af30046f0 con 0x557af34a7b20 2026-02-20T13:31:59.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2160565531 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa834010550 con 0x557af34a7b20 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2160565531 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa834010770 con 0x557af34a7b20 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 10 client.30617 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557af33040e0 con 0x557af34a7b20 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2160565531 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa834022060 con 0x557af34a7b20 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 10 client.30617 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 10 client.30617 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 20 client.30617 populate_metadata read hostname 'trial028' 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557af34c7ce0 0x557af34a58a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 4 client.30617 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:59.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.998+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557af3310f80 con 0x557af34c7ce0 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.999+0000 7fa83d2b1640 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557af34c7ce0 0x557af34a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.999+0000 7fa83d2b1640 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557af34c7ce0 0x557af34a58a0 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=15292592629790726952 s_cookie=13384681925918617521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d43a33f9216edb28 server_cookie=b9bff14be9f86fb1 in_seq=0 out_seq=0 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:58.999+0000 7fa7f2ffd640 10 client.30617 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2160565531 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557af3310f80 con 0x557af34c7ce0 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa7f2ffd640 10 client.30617 handle_command_reply: tid=0 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 client.30617 shutdown 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 msgr2=0x557af34c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c4c60 secure :-1 s=READY pgs=515 gs=3 cs=0 l=1 c_cookie=2693444694905552880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa834005820 tx=0x7fa834003ea0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 shutdown_connections 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557af34c7ce0 0x557af34a58a0 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=15292592629790726952 s_cookie=13384681925918617521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34bfc00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34c4c60 unknown :-1 s=CLOSED pgs=515 gs=3 cs=0 l=1 c_cookie=2693444694905552880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 --2- 10.20.193.28:0/2160565531 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34bf6c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 >> 10.20.193.28:0/2160565531 conn(0x557af3440860 msgr2=0x557af3460c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa7f2ffd640 0 client.30617 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:31:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 shutdown_connections 2026-02-20T13:31:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 1 -- 10.20.193.28:0/2160565531 wait complete. 2026-02-20T13:31:59.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.000+0000 7fa841536e00 20 client.30617 trim_cache size 0 max 16384 2026-02-20T13:31:59.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa841536e00 1 Processor -- start 2026-02-20T13:31:59.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa841536e00 1 -- start start 2026-02-20T13:31:59.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa841536e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34a6ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa841536e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a7420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa841536e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34a2780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa841536e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557af336c080 con 0x557af3462c70 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa841536e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557af302c700 con 0x557af34a7b20 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa841536e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557af34c8300 con 0x557af3462360 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa83cab0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.007+0000 7fa83d2b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34a2780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54622/0 (socket says 10.20.193.28:54622) 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 -- 10.20.193.28:0/4000932784 learned_addr learned my addr 10.20.193.28:0/4000932784 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 -- 10.20.193.28:0/4000932784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 msgr2=0x557af34a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 --2- 10.20.193.28:0/4000932784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 -- 10.20.193.28:0/4000932784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 msgr2=0x557af34a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 --2- 10.20.193.28:0/4000932784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a7420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 -- 10.20.193.28:0/4000932784 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af32feb60 con 0x557af34a7b20 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83cab0640 1 --2- 10.20.193.28:0/4000932784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a7420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa83dab2640 1 --2- 10.20.193.28:0/4000932784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34a2780 secure :-1 s=READY pgs=516 gs=3 cs=0 l=1 c_cookie=14531862221745952883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83400fc50 tx=0x7fa834020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9ab8bb294161873 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa8054e4640 1 -- 10.20.193.28:0/4000932784 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa834017050 con 0x557af34a7b20 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa8054e4640 1 -- 10.20.193.28:0/4000932784 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa834028020 con 0x557af34a7b20 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.008+0000 7fa8054e4640 1 -- 10.20.193.28:0/4000932784 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa834023d30 con 0x557af34a7b20 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 -- 10.20.193.28:0/4000932784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 msgr2=0x557af34a2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 --2- 10.20.193.28:0/4000932784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34a2780 secure :-1 s=READY pgs=516 gs=3 cs=0 l=1 c_cookie=14531862221745952883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83400fc50 tx=0x7fa834020000 comp rx=0 tx=0).stop 2026-02-20T13:31:59.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 -- 10.20.193.28:0/4000932784 shutdown_connections 2026-02-20T13:31:59.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 --2- 10.20.193.28:0/4000932784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462c70 0x557af34a7420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 --2- 10.20.193.28:0/4000932784 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af34a7b20 0x557af34a2780 unknown :-1 s=CLOSED pgs=516 gs=3 cs=0 l=1 c_cookie=14531862221745952883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 --2- 10.20.193.28:0/4000932784 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af3462360 0x557af34a6ee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 -- 10.20.193.28:0/4000932784 >> 10.20.193.28:0/4000932784 conn(0x557af3440860 msgr2=0x557af34a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 -- 10.20.193.28:0/4000932784 shutdown_connections 2026-02-20T13:31:59.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 -- 10.20.193.28:0/4000932784 wait complete. 2026-02-20T13:31:59.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 -- start start 2026-02-20T13:31:59.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.009+0000 7fa841536e00 1 Processor -- start 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa841536e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462360 0x557af34426c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa841536e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af3462c70 0x557af3442c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa841536e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af34a7b20 0x557af350d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa841536e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557af34c7590 con 0x557af3462360 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa841536e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557af34b4030 con 0x557af3462c70 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa841536e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557af350dd10 con 0x557af34a7b20 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83cab0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af3462c70 0x557af3442c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83cab0640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af3462c70 0x557af3442c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54636/0 (socket says 10.20.193.28:54636) 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83d2b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462360 0x557af34426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83cab0640 1 -- 10.20.193.28:0/2722423901 learned_addr learned my addr 10.20.193.28:0/2722423901 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:59.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83dab2640 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af34a7b20 0x557af350d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83cab0640 1 -- 10.20.193.28:0/2722423901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af34a7b20 msgr2=0x557af350d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83cab0640 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af34a7b20 0x557af350d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83cab0640 1 -- 10.20.193.28:0/2722423901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462360 msgr2=0x557af34426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83cab0640 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462360 0x557af34426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83cab0640 1 -- 10.20.193.28:0/2722423901 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af33040e0 con 0x557af3462c70 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.010+0000 7fa83d2b1640 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462360 0x557af34426c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa83cab0640 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af3462c70 0x557af3442c00 secure :-1 s=READY pgs=517 gs=2 cs=0 l=1 c_cookie=5306398147932107810 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa82c002bd0 tx=0x7fa82c002a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a41d004448b422 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa7f2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2722423901 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa82c0e3ea0 con 0x557af3462c70 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2722423901 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa82c0b1fb0 con 0x557af3462c70 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2722423901 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa82c0aa5a0 con 0x557af3462c70 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557af3319d10 con 0x557af3462c70 2026-02-20T13:31:59.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 10 client.30623 _ll_register_callbacks cb 0x557af32efa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557af30c64a0 con 0x557af3462c70 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2722423901 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa82c0c6020 con 0x557af3462c70 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2722423901 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa82c018540 con 0x557af3462c70 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 10 client.30623 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557af32f26f0 con 0x557af3462c70 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2722423901 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa82c0adc80 con 0x557af3462c70 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 10 client.30623 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 10 client.30623 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 20 client.30623 populate_metadata read hostname 'trial028' 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557af3555ac0 0x557af3575f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 4 client.30623 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa82c0abd20 con 0x557af3555ac0 2026-02-20T13:31:59.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.011+0000 7fa83d2b1640 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557af3555ac0 0x557af3575f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa83d2b1640 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557af3555ac0 0x557af3575f40 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=13305161296261930564 s_cookie=17753133678510138098 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b8a56db486f7de44 server_cookie=f65fcd053d9ee2f2 in_seq=0 out_seq=0 2026-02-20T13:31:59.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa7f2ffd640 10 client.30623 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:31:59.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa7f2ffd640 1 -- 10.20.193.28:0/2722423901 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa82c0abd20 con 0x557af3555ac0 2026-02-20T13:31:59.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa7f2ffd640 10 client.30623 handle_command_reply: tid=0 2026-02-20T13:31:59.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa841536e00 1 client.30623 shutdown 2026-02-20T13:31:59.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af3462c70 msgr2=0x557af3442c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa841536e00 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af3462c70 0x557af3442c00 secure :-1 s=READY pgs=517 gs=2 cs=0 l=1 c_cookie=5306398147932107810 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa82c002bd0 tx=0x7fa82c002a80 comp rx=0 tx=0).stop 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 shutdown_connections 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa841536e00 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557af3555ac0 0x557af3575f40 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=13305161296261930564 s_cookie=17753133678510138098 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa841536e00 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557af34a7b20 0x557af350d7d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa841536e00 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557af3462c70 0x557af3442c00 unknown :-1 s=CLOSED pgs=517 gs=2 cs=0 l=1 c_cookie=5306398147932107810 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.012+0000 7fa841536e00 1 --2- 10.20.193.28:0/2722423901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557af3462360 0x557af34426c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa7f2ffd640 0 client.30623 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 >> 10.20.193.28:0/2722423901 conn(0x557af3440860 msgr2=0x557af34a5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 shutdown_connections 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa841536e00 1 -- 10.20.193.28:0/2722423901 wait complete. 2026-02-20T13:31:59.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa841536e00 20 client.30623 trim_cache size 0 max 16384 2026-02-20T13:31:59.024 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:31:59.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 -- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8140b5760 msgr2=0x7fa8140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8140b5760 0x7fa8140d5c10 secure :-1 s=READY pgs=626 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8280097e0 tx=0x7fa82803a040 comp rx=0 tx=0).stop 2026-02-20T13:31:59.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 -- 10.20.193.28:0/3921905220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa83810c470 msgr2=0x7fa838121f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa83810c470 0x7fa838121f90 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa82c00d950 tx=0x7fa82c00de20 comp rx=0 tx=0).stop 2026-02-20T13:31:59.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 -- 10.20.193.28:0/3921905220 shutdown_connections 2026-02-20T13:31:59.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa8140b5760 0x7fa8140d5c10 unknown :-1 s=CLOSED pgs=626 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa838111060 0x7fa838127360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa83810c470 0x7fa838121f90 unknown :-1 s=CLOSED pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 --2- 10.20.193.28:0/3921905220 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa83810ba80 0x7fa838121a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 -- 10.20.193.28:0/3921905220 >> 10.20.193.28:0/3921905220 conn(0x7fa8380e96b0 msgr2=0x7fa838109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 -- 10.20.193.28:0/3921905220 shutdown_connections 2026-02-20T13:31:59.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.013+0000 7fa83f53c640 1 -- 10.20.193.28:0/3921905220 wait complete. 2026-02-20T13:31:59.110 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:31:59.292 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:31:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.463+0000 7fd53695b640 1 -- 10.20.193.28:0/32268637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5301156a0 msgr2=0x7fd530176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.463+0000 7fd53695b640 1 --2- 10.20.193.28:0/32268637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5301156a0 0x7fd530176070 secure :-1 s=READY pgs=1501 gs=1 cs=0 l=1 c_cookie=14645061639296508583 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd52c00aa30 tx=0x7fd52c030270 comp rx=0 tx=0).stop 2026-02-20T13:31:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.463+0000 7fd53695b640 1 -- 10.20.193.28:0/32268637 shutdown_connections 2026-02-20T13:31:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.463+0000 7fd53695b640 1 --2- 10.20.193.28:0/32268637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5301156a0 0x7fd530176070 unknown :-1 s=CLOSED pgs=1501 gs=1 cs=0 l=1 c_cookie=14645061639296508583 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.463+0000 7fd53695b640 1 --2- 10.20.193.28:0/32268637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd53010fea0 0x7fd530114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.463+0000 7fd53695b640 1 --2- 10.20.193.28:0/32268637 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd53010f4b0 0x7fd53010f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.463+0000 7fd53695b640 1 -- 10.20.193.28:0/32268637 >> 10.20.193.28:0/32268637 conn(0x7fd5300ecda0 msgr2=0x7fd53010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.464+0000 7fd53695b640 1 -- 10.20.193.28:0/32268637 shutdown_connections 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.464+0000 7fd53695b640 1 -- 10.20.193.28:0/32268637 wait complete. 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.464+0000 7fd53695b640 1 Processor -- start 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.464+0000 7fd53695b640 1 -- start start 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd53695b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd53010f4b0 0x7fd53011ddd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd53695b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd53010fea0 0x7fd53011e310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd53695b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd5301156a0 0x7fd5301236e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd53695b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd530123d00 con 0x7fd53010f4b0 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd53695b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd530123e70 con 0x7fd53010fea0 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd53695b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd530124030 con 0x7fd5301156a0 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535959640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd53010f4b0 0x7fd53011ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535158640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd53010fea0 0x7fd53011e310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535959640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd53010f4b0 0x7fd53011ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41016/0 (socket says 10.20.193.28:41016) 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535959640 1 -- 10.20.193.28:0/742962624 learned_addr learned my addr 10.20.193.28:0/742962624 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd53615a640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd5301156a0 0x7fd5301236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535959640 1 -- 10.20.193.28:0/742962624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd5301156a0 msgr2=0x7fd5301236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535959640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd5301156a0 0x7fd5301236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535959640 1 -- 10.20.193.28:0/742962624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd53010fea0 msgr2=0x7fd53011e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535959640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd53010fea0 0x7fd53011e310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.465+0000 7fd535959640 1 -- 10.20.193.28:0/742962624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c00a650 con 0x7fd53010f4b0 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.466+0000 7fd535959640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd53010f4b0 0x7fd53011ddd0 secure :-1 s=READY pgs=1502 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd52000d950 tx=0x7fd52000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.466+0000 7fd51effd640 1 -- 10.20.193.28:0/742962624 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd520004540 con 0x7fd53010f4b0 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.466+0000 7fd51effd640 1 -- 10.20.193.28:0/742962624 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd520009c80 con 0x7fd53010f4b0 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.466+0000 7fd51effd640 1 -- 10.20.193.28:0/742962624 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5200106e0 con 0x7fd53010f4b0 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.466+0000 7fd53695b640 1 -- 10.20.193.28:0/742962624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd530124310 con 0x7fd53010f4b0 2026-02-20T13:31:59.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.466+0000 7fd53695b640 1 -- 10.20.193.28:0/742962624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd530164a10 con 0x7fd53010f4b0 2026-02-20T13:31:59.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.469+0000 7fd51effd640 1 -- 10.20.193.28:0/742962624 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd520009740 con 0x7fd53010f4b0 2026-02-20T13:31:59.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.470+0000 7fd51effd640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd50c0b5760 0x7fd50c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.470+0000 7fd51effd640 1 -- 10.20.193.28:0/742962624 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd5200e6be0 con 0x7fd53010f4b0 2026-02-20T13:31:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.471+0000 7fd535158640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd50c0b5760 0x7fd50c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.471+0000 7fd535158640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd50c0b5760 0x7fd50c0d5c10 secure :-1 s=READY pgs=627 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd530124770 tx=0x7fd52400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.471+0000 7fd539bdee00 1 Processor -- start 2026-02-20T13:31:59.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.471+0000 7fd539bdee00 1 -- start start 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x56457087f140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087f680 0x5645708c3ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e4910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd539bdee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56457078c780 con 0x5645708c4530 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd539bdee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5645707884b0 con 0x56457087ed70 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd539bdee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x564570782450 con 0x56457087f680 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535158640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087f680 0x5645708c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535158640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087f680 0x5645708c3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42838/0 (socket says 10.20.193.28:42838) 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535158640 1 -- 10.20.193.28:0/3626683448 learned_addr learned my addr 10.20.193.28:0/3626683448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535959640 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x56457087f140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535158640 1 -- 10.20.193.28:0/3626683448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 msgr2=0x56457087f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd53615a640 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535158640 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x56457087f140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535158640 1 -- 10.20.193.28:0/3626683448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 msgr2=0x5645708e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535158640 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd535158640 1 -- 10.20.193.28:0/3626683448 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56457072dd10 con 0x56457087f680 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.472+0000 7fd53615a640 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e4910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd535158640 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087f680 0x5645708c3ff0 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=1391851456363956696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd524011440 tx=0x7fd524013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1350d98674af09d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd4fe4e6640 1 -- 10.20.193.28:0/3626683448 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd52401e640 con 0x56457087f680 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd4fe4e6640 1 -- 10.20.193.28:0/3626683448 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd524015070 con 0x56457087f680 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd4fe4e6640 1 -- 10.20.193.28:0/3626683448 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd52401ccd0 con 0x56457087f680 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd539bdee00 1 -- 10.20.193.28:0/3626683448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087f680 msgr2=0x5645708c3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087f680 0x5645708c3ff0 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=1391851456363956696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd524011440 tx=0x7fd524013000 comp rx=0 tx=0).stop 2026-02-20T13:31:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd539bdee00 1 -- 10.20.193.28:0/3626683448 shutdown_connections 2026-02-20T13:31:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e4910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087f680 0x5645708c3ff0 unknown :-1 s=CLOSED pgs=419 gs=1 cs=0 l=1 c_cookie=1391851456363956696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3626683448 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x56457087f140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.473+0000 7fd539bdee00 1 -- 10.20.193.28:0/3626683448 >> 10.20.193.28:0/3626683448 conn(0x56457085d270 msgr2=0x56457087d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.474+0000 7fd539bdee00 1 -- 10.20.193.28:0/3626683448 shutdown_connections 2026-02-20T13:31:59.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.474+0000 7fd539bdee00 1 -- 10.20.193.28:0/3626683448 wait complete. 2026-02-20T13:31:59.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.475+0000 7fd539bdee00 1 -- start start 2026-02-20T13:31:59.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.475+0000 7fd539bdee00 1 Processor -- start 2026-02-20T13:31:59.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.475+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dc0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.475+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708dc620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.475+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e1610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.475+0000 7fd539bdee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5645708e1b50 con 0x5645708c4530 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.475+0000 7fd539bdee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5645708e1cc0 con 0x56457087f680 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.475+0000 7fd539bdee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5645708e1e80 con 0x56457087ed70 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:42854/0 (socket says 10.20.193.28:42854) 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 -- 10.20.193.28:0/638366510 learned_addr learned my addr 10.20.193.28:0/638366510 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:59.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535158640 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708dc620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 -- 10.20.193.28:0/638366510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 msgr2=0x5645708dc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708dc620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 -- 10.20.193.28:0/638366510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 msgr2=0x5645708e1610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd53615a640 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e1610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 -- 10.20.193.28:0/638366510 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645707063c0 con 0x56457087ed70 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd535959640 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dc0e0 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=3762691763346119766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd520002b70 tx=0x7fd5200a8de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3437c43921889c56 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.476+0000 7fd4eb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/638366510 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5200ad940 con 0x56457087ed70 2026-02-20T13:31:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/638366510 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5200b2c60 con 0x56457087ed70 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52400bd10 con 0x56457087ed70 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/638366510 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5200b7bf0 con 0x56457087ed70 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/638366510 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd5200b7d80 con 0x56457087ed70 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd4eb7fe640 10 client.30487 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd539bdee00 10 client.30487 _ll_register_callbacks cb 0x564570703a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5645704186f0 con 0x56457087ed70 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/638366510 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd5200b8080 con 0x56457087ed70 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd539bdee00 10 client.30487 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5645707180e0 con 0x56457087ed70 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.477+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/638366510 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd5200adbd0 con 0x56457087ed70 2026-02-20T13:31:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.478+0000 7fd539bdee00 10 client.30487 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.478+0000 7fd539bdee00 10 client.30487 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.478+0000 7fd539bdee00 20 client.30487 populate_metadata read hostname 'trial028' 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.478+0000 7fd539bdee00 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5645708e4660 0x5645708c22b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.478+0000 7fd539bdee00 4 client.30487 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.478+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564570724f80 con 0x5645708e4660 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.478+0000 7fd535158640 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5645708e4660 0x5645708c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.479+0000 7fd535158640 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5645708e4660 0x5645708c22b0 crc :-1 s=READY pgs=78 gs=4 cs=0 l=0 c_cookie=2290206028688009409 s_cookie=9178222566418176478 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1fc8723fc26828c1 server_cookie=7f5f98cbbcd459de in_seq=0 out_seq=0 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.479+0000 7fd4eb7fe640 10 client.30487 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.479+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/638366510 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564570724f80 con 0x5645708e4660 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.479+0000 7fd4eb7fe640 10 client.30487 handle_command_reply: tid=0 2026-02-20T13:31:59.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.479+0000 7fd539bdee00 1 client.30487 shutdown 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.479+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 msgr2=0x5645708dc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.479+0000 7fd539bdee00 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dc0e0 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=3762691763346119766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd520002b70 tx=0x7fd5200a8de0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 shutdown_connections 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x5645708e4660 0x5645708c22b0 crc :-1 s=READY pgs=78 gs=4 cs=0 l=0 c_cookie=2290206028688009409 s_cookie=9178222566418176478 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708e1610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708dc620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 1 --2- 10.20.193.28:0/638366510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dc0e0 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=3762691763346119766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 >> 10.20.193.28:0/638366510 conn(0x56457085d270 msgr2=0x56457087d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd4eb7fe640 0 client.30487 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 shutdown_connections 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 1 -- 10.20.193.28:0/638366510 wait complete. 2026-02-20T13:31:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.480+0000 7fd539bdee00 20 client.30487 trim_cache size 0 max 16384 2026-02-20T13:31:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd539bdee00 1 Processor -- start 2026-02-20T13:31:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd539bdee00 1 -- start start 2026-02-20T13:31:59.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dfa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708c3860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708c3da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd539bdee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564570780080 con 0x5645708c4530 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd539bdee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x564570440700 con 0x56457087f680 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd539bdee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5645708d4f70 con 0x56457087ed70 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd53615a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd535158640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd535158640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54698/0 (socket says 10.20.193.28:54698) 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd535158640 1 -- 10.20.193.28:0/3579041349 learned_addr learned my addr 10.20.193.28:0/3579041349 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.487+0000 7fd535959640 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd535158640 1 -- 10.20.193.28:0/3579041349 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 msgr2=0x5645708dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd535158640 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd535158640 1 -- 10.20.193.28:0/3579041349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 msgr2=0x5645708c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd535158640 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd535158640 1 -- 10.20.193.28:0/3579041349 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564570712b60 con 0x56457087f680 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd53615a640 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708c3da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd535158640 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708c3860 secure :-1 s=READY pgs=518 gs=1 cs=0 l=1 c_cookie=660811270736439662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd52401c7f0 tx=0x7fd524005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92bac597fd1e96e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd4fdce5640 1 -- 10.20.193.28:0/3579041349 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5240361b0 con 0x56457087f680 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd4fdce5640 1 -- 10.20.193.28:0/3579041349 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd52401cd70 con 0x56457087f680 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.488+0000 7fd4fdce5640 1 -- 10.20.193.28:0/3579041349 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd524004980 con 0x56457087f680 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 -- 10.20.193.28:0/3579041349 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 msgr2=0x5645708c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708c3860 secure :-1 s=READY pgs=518 gs=1 cs=0 l=1 c_cookie=660811270736439662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd52401c7f0 tx=0x7fd524005900 comp rx=0 tx=0).stop 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 -- 10.20.193.28:0/3579041349 shutdown_connections 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5645708c4530 0x5645708c3da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087f680 0x5645708c3860 unknown :-1 s=CLOSED pgs=518 gs=1 cs=0 l=1 c_cookie=660811270736439662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3579041349 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56457087ed70 0x5645708dfa50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 -- 10.20.193.28:0/3579041349 >> 10.20.193.28:0/3579041349 conn(0x56457085d270 msgr2=0x5645708df340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 -- 10.20.193.28:0/3579041349 shutdown_connections 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 -- 10.20.193.28:0/3579041349 wait complete. 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 -- start start 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.489+0000 7fd539bdee00 1 Processor -- start 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x564570862ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56457087f680 0x564570863420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd539bdee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645708c4530 0x5645708bede0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd539bdee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5645708bf3f0 con 0x56457087f680 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd539bdee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5645708bf560 con 0x56457087ed70 2026-02-20T13:31:59.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd539bdee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5645708bf720 con 0x5645708c4530 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd53615a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645708c4530 0x5645708bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535959640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x564570862ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535959640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x564570862ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:54714/0 (socket says 10.20.193.28:54714) 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535959640 1 -- 10.20.193.28:0/3517728706 learned_addr learned my addr 10.20.193.28:0/3517728706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535158640 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56457087f680 0x564570863420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535959640 1 -- 10.20.193.28:0/3517728706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645708c4530 msgr2=0x5645708bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535959640 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645708c4530 0x5645708bede0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535959640 1 -- 10.20.193.28:0/3517728706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56457087f680 msgr2=0x564570863420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535959640 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56457087f680 0x564570863420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.490+0000 7fd535959640 1 -- 10.20.193.28:0/3517728706 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56457072dd10 con 0x56457087ed70 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd535959640 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x564570862ee0 secure :-1 s=READY pgs=519 gs=1 cs=0 l=1 c_cookie=16762823723050619044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5200af1d0 tx=0x7fd520002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a1835ce4ec50a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd4eb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/3517728706 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5200e4560 con 0x56457087ed70 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/3517728706 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5645704186f0 con 0x56457087ed70 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/3517728706 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5200b8080 con 0x56457087ed70 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52c041040 con 0x56457087ed70 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/3517728706 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd5200b7d80 con 0x56457087ed70 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd4eb7fe640 10 client.30638 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd539bdee00 10 client.30638 _ll_register_callbacks cb 0x564570703a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:31:59.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5645704da4a0 con 0x56457087ed70 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/3517728706 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd520072bf0 con 0x56457087ed70 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd539bdee00 10 client.30638 fetch_fsmap learned FSMap version 30 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.491+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5645707066f0 con 0x56457087ed70 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/3517728706 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd52008b070 con 0x56457087ed70 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd539bdee00 10 client.30638 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd539bdee00 10 client.30638 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd539bdee00 20 client.30638 populate_metadata read hostname 'trial028' 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564570972a50 0x564570992f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd539bdee00 4 client.30638 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd524015070 con 0x564570972a50 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd535158640 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564570972a50 0x564570992f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd535158640 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564570972a50 0x564570992f00 crc :-1 s=READY pgs=79 gs=4 cs=0 l=0 c_cookie=15069022273978964883 s_cookie=4507890271283608455 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d11febeb48f71b93 server_cookie=3e8f3e51624c7b87 in_seq=0 out_seq=0 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd4eb7fe640 10 client.30638 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:31:59.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.492+0000 7fd4eb7fe640 1 -- 10.20.193.28:0/3517728706 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd524015070 con 0x564570972a50 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd4eb7fe640 10 client.30638 handle_command_reply: tid=0 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 client.30638 shutdown 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 msgr2=0x564570862ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x564570862ee0 secure :-1 s=READY pgs=519 gs=1 cs=0 l=1 c_cookie=16762823723050619044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5200af1d0 tx=0x7fd520002bc0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 shutdown_connections 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x564570972a50 0x564570992f00 crc :-1 s=READY pgs=79 gs=4 cs=0 l=0 c_cookie=15069022273978964883 s_cookie=4507890271283608455 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56457087f680 0x564570863420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5645708c4530 0x5645708bede0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 --2- 10.20.193.28:0/3517728706 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56457087ed70 0x564570862ee0 unknown :-1 s=CLOSED pgs=519 gs=1 cs=0 l=1 c_cookie=16762823723050619044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd4eb7fe640 0 client.30638 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 >> 10.20.193.28:0/3517728706 conn(0x56457085d270 msgr2=0x5645708dfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 shutdown_connections 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 1 -- 10.20.193.28:0/3517728706 wait complete. 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.493+0000 7fd539bdee00 20 client.30638 trim_cache size 0 max 16384 2026-02-20T13:31:59.495 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 -- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd50c0b5760 msgr2=0x7fd50c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd50c0b5760 0x7fd50c0d5c10 secure :-1 s=READY pgs=627 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd530124770 tx=0x7fd52400b410 comp rx=0 tx=0).stop 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 -- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd53010f4b0 msgr2=0x7fd53011ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd53010f4b0 0x7fd53011ddd0 secure :-1 s=READY pgs=1502 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd52000d950 tx=0x7fd52000de20 comp rx=0 tx=0).stop 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 -- 10.20.193.28:0/742962624 shutdown_connections 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd50c0b5760 0x7fd50c0d5c10 unknown :-1 s=CLOSED pgs=627 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd5301156a0 0x7fd5301236e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd53010fea0 0x7fd53011e310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 --2- 10.20.193.28:0/742962624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd53010f4b0 0x7fd53011ddd0 unknown :-1 s=CLOSED pgs=1502 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 -- 10.20.193.28:0/742962624 >> 10.20.193.28:0/742962624 conn(0x7fd5300ecda0 msgr2=0x7fd53010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 -- 10.20.193.28:0/742962624 shutdown_connections 2026-02-20T13:31:59.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:31:59.494+0000 7fd53695b640 1 -- 10.20.193.28:0/742962624 wait complete. 2026-02-20T13:31:59.636 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:31:59.824 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:00.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4161953260 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab010dc20 msgr2=0x7f2ab0112c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4161953260 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab010dc20 0x7f2ab0112c70 secure :-1 s=READY pgs=520 gs=1 cs=0 l=1 c_cookie=15937977614492142967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa4009950 tx=0x7f2aa402f190 comp rx=0 tx=0).stop 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4161953260 shutdown_connections 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4161953260 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ab0113420 0x7f2ab0173df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4161953260 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab010dc20 0x7f2ab0112c70 unknown :-1 s=CLOSED pgs=520 gs=1 cs=0 l=1 c_cookie=15937977614492142967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4161953260 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ab010d230 0x7f2ab010d600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4161953260 >> 10.20.193.28:0/4161953260 conn(0x7f2ab00eab00 msgr2=0x7f2ab010af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4161953260 shutdown_connections 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.007+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4161953260 wait complete. 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.008+0000 7f2ab6be9640 1 Processor -- start 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.008+0000 7f2ab6be9640 1 -- start start 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.008+0000 7f2ab6be9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ab010d230 0x7f2ab00f57e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.008+0000 7f2ab6be9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ab010dc20 0x7f2ab0173cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.008+0000 7f2ab6be9640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab0113420 0x7f2ab00f5ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.008+0000 7f2ab6be9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00fb0f0 con 0x7f2ab010d230 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.008+0000 7f2ab6be9640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00fb260 con 0x7f2ab0113420 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.008+0000 7f2ab6be9640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00fb420 con 0x7f2ab010dc20 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab53e6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ab010dc20 0x7f2ab0173cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ab010d230 0x7f2ab00f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab63e8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab0113420 0x7f2ab00f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ab010d230 0x7f2ab00f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35534/0 (socket says 10.20.193.28:35534) 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab63e8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab0113420 0x7f2ab00f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33382/0 (socket says 10.20.193.28:33382) 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab5be7640 1 -- 10.20.193.28:0/4065795880 learned_addr learned my addr 10.20.193.28:0/4065795880 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab63e8640 1 -- 10.20.193.28:0/4065795880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ab010dc20 msgr2=0x7f2ab0173cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ab010dc20 0x7f2ab0173cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab63e8640 1 -- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ab010d230 msgr2=0x7f2ab00f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ab010d230 0x7f2ab00f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab63e8640 1 -- 10.20.193.28:0/4065795880 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac00a590 con 0x7f2ab0113420 2026-02-20T13:32:00.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab0113420 0x7f2ab00f5ee0 secure :-1 s=READY pgs=521 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aac00aef0 tx=0x7f2aac003b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2a9effd640 1 -- 10.20.193.28:0/4065795880 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aac00fb50 con 0x7f2ab0113420 2026-02-20T13:32:00.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2a9effd640 1 -- 10.20.193.28:0/4065795880 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2aac00fcb0 con 0x7f2ab0113420 2026-02-20T13:32:00.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2a9effd640 1 -- 10.20.193.28:0/4065795880 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aac010870 con 0x7f2ab0113420 2026-02-20T13:32:00.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4065795880 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa4009570 con 0x7f2ab0113420 2026-02-20T13:32:00.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.009+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4065795880 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab00fb9f0 con 0x7f2ab0113420 2026-02-20T13:32:00.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.012+0000 7f2a9effd640 1 -- 10.20.193.28:0/4065795880 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2aac017070 con 0x7f2ab0113420 2026-02-20T13:32:00.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.014+0000 7f2a9effd640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a8c0b5750 0x7f2a8c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.014+0000 7f2a9effd640 1 -- 10.20.193.28:0/4065795880 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2aac0e7f70 con 0x7f2ab0113420 2026-02-20T13:32:00.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.015+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a8c0b5750 0x7f2a8c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.015+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a8c0b5750 0x7f2a8c0d5c00 secure :-1 s=READY pgs=628 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa00095b0 tx=0x7f2aa0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.015+0000 7f2ab9e6ce00 1 Processor -- start 2026-02-20T13:32:00.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.015+0000 7f2ab9e6ce00 1 -- start start 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0a360 0x559698a0a730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0ac70 0x559698a4f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a4fb20 0x559698a6ff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559698920780 con 0x559698a0ac70 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55969891c4b0 con 0x559698a0a360 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559698916450 con 0x559698a4fb20 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0ac70 0x559698a4f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab5be7640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0a360 0x559698a0a730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0ac70 0x559698a4f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35550/0 (socket says 10.20.193.28:35550) 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 -- 10.20.193.28:0/1293291797 learned_addr learned my addr 10.20.193.28:0/1293291797 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/1293291797 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a4fb20 0x559698a6ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 -- 10.20.193.28:0/1293291797 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a4fb20 msgr2=0x559698a6ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/1293291797 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a4fb20 0x559698a6ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 -- 10.20.193.28:0/1293291797 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0a360 msgr2=0x559698a0a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/1293291797 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0a360 0x559698a0a730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 -- 10.20.193.28:0/1293291797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596988c1d10 con 0x559698a0ac70 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.016+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/1293291797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0ac70 0x559698a4f5e0 secure :-1 s=READY pgs=1503 gs=2 cs=0 l=1 c_cookie=10202991026383607193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa4005ad0 tx=0x7f2aa4002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d984e47de17d599 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2a7e4e6640 1 -- 10.20.193.28:0/1293291797 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa403d070 con 0x559698a0ac70 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2a7e4e6640 1 -- 10.20.193.28:0/1293291797 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2aa403e040 con 0x559698a0ac70 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2a7e4e6640 1 -- 10.20.193.28:0/1293291797 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa402fc70 con 0x559698a0ac70 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/1293291797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0ac70 msgr2=0x559698a4f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/1293291797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0ac70 0x559698a4f5e0 secure :-1 s=READY pgs=1503 gs=2 cs=0 l=1 c_cookie=10202991026383607193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa4005ad0 tx=0x7f2aa4002390 comp rx=0 tx=0).stop 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/1293291797 shutdown_connections 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/1293291797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0ac70 0x559698a4f5e0 unknown :-1 s=CLOSED pgs=1503 gs=2 cs=0 l=1 c_cookie=10202991026383607193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/1293291797 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a4fb20 0x559698a6ff00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/1293291797 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0a360 0x559698a0a730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/1293291797 >> 10.20.193.28:0/1293291797 conn(0x5596989e8860 msgr2=0x559698a08c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/1293291797 shutdown_connections 2026-02-20T13:32:00.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.017+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/1293291797 wait complete. 2026-02-20T13:32:00.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.018+0000 7f2ab9e6ce00 1 -- start start 2026-02-20T13:32:00.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.018+0000 7f2ab9e6ce00 1 Processor -- start 2026-02-20T13:32:00.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0a360 0x559698a67700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0ac70 0x559698a67c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a4fb20 0x559698a699d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559698a69f40 con 0x559698a4fb20 2026-02-20T13:32:00.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559698a6a0b0 con 0x559698a0ac70 2026-02-20T13:32:00.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559698a6a270 con 0x559698a0a360 2026-02-20T13:32:00.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab53e6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0ac70 0x559698a67c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab53e6640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0ac70 0x559698a67c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33406/0 (socket says 10.20.193.28:33406) 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab53e6640 1 -- 10.20.193.28:0/4058580394 learned_addr learned my addr 10.20.193.28:0/4058580394 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0a360 0x559698a67700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a4fb20 0x559698a699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab53e6640 1 -- 10.20.193.28:0/4058580394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0a360 msgr2=0x559698a67700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0a360 0x559698a67700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab53e6640 1 -- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a4fb20 msgr2=0x559698a699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a4fb20 0x559698a699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab53e6640 1 -- 10.20.193.28:0/4058580394 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969889a3c0 con 0x559698a0ac70 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0a360 0x559698a67700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.019+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a4fb20 0x559698a699d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.020+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0ac70 0x559698a67c40 secure :-1 s=READY pgs=522 gs=1 cs=0 l=1 c_cookie=9831177943339500451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa402fc20 tx=0x7f2aa4005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=886f5c406c6803a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.020+0000 7f2a6b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.020+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/4058580394 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa403d070 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.020+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/4058580394 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2aa4038680 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.020+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/4058580394 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa4043ab0 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.020+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab0174660 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.020+0000 7f2ab9e6ce00 10 client.30650 _ll_register_callbacks cb 0x559698897a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.020+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596985ac6f0 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/4058580394 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2aa40042e0 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/4058580394 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2aa4043460 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2ab9e6ce00 10 client.30650 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5596988ac0e0 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/4058580394 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2aa4038920 con 0x559698a0ac70 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2ab9e6ce00 10 client.30650 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2ab9e6ce00 10 client.30650 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2ab9e6ce00 20 client.30650 populate_metadata read hostname 'trial028' 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559698a4cd80 0x559698a4d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2ab9e6ce00 4 client.30650 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:00.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.021+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596988b8f80 con 0x559698a4cd80 2026-02-20T13:32:00.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.022+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559698a4cd80 0x559698a4d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.022+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559698a4cd80 0x559698a4d220 crc :-1 s=READY pgs=79 gs=4 cs=0 l=0 c_cookie=9610657328083727597 s_cookie=7783909114602228038 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=855fe9eba26f74ed server_cookie=6c0600194bca8946 in_seq=0 out_seq=0 2026-02-20T13:32:00.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.022+0000 7f2a6b7fe640 10 client.30650 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/4058580394 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5596988b8f80 con 0x559698a4cd80 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2a6b7fe640 10 client.30650 handle_command_reply: tid=0 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 client.30650 shutdown 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0ac70 msgr2=0x559698a67c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0ac70 0x559698a67c40 secure :-1 s=READY pgs=522 gs=1 cs=0 l=1 c_cookie=9831177943339500451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa402fc20 tx=0x7f2aa4005900 comp rx=0 tx=0).stop 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 shutdown_connections 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559698a4cd80 0x559698a4d220 crc :-1 s=READY pgs=79 gs=4 cs=0 l=0 c_cookie=9610657328083727597 s_cookie=7783909114602228038 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a4fb20 0x559698a699d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a0ac70 0x559698a67c40 unknown :-1 s=CLOSED pgs=522 gs=1 cs=0 l=1 c_cookie=9831177943339500451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/4058580394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0a360 0x559698a67700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 >> 10.20.193.28:0/4058580394 conn(0x5596989e8860 msgr2=0x559698a08c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2a6b7fe640 0 client.30650 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:32:00.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 shutdown_connections 2026-02-20T13:32:00.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/4058580394 wait complete. 2026-02-20T13:32:00.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.023+0000 7f2ab9e6ce00 20 client.30650 trim_cache size 0 max 16384 2026-02-20T13:32:00.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab9e6ce00 1 Processor -- start 2026-02-20T13:32:00.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab9e6ce00 1 -- start start 2026-02-20T13:32:00.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x559698a6d950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559698914080 con 0x559698a0a360 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596985d4700 con 0x559698a4fb20 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5596989e84d0 con 0x559698a0ac70 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab53e6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x559698a6d950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab53e6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60168/0 (socket says 10.20.193.28:60168) 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab53e6640 1 -- 10.20.193.28:0/2042592726 learned_addr learned my addr 10.20.193.28:0/2042592726 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.031+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab53e6640 1 -- 10.20.193.28:0/2042592726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 msgr2=0x559698a64dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab53e6640 1 -- 10.20.193.28:0/2042592726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 msgr2=0x559698a6d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x559698a6d950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab53e6640 1 -- 10.20.193.28:0/2042592726 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596988a6b60 con 0x559698a0ac70 2026-02-20T13:32:00.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64890 secure :-1 s=READY pgs=421 gs=2 cs=0 l=1 c_cookie=11748105499099188671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa4009950 tx=0x7f2aa403a070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a309a7b5119ecdbf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2a7dce5640 1 -- 10.20.193.28:0/2042592726 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa403d040 con 0x559698a0ac70 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2a7dce5640 1 -- 10.20.193.28:0/2042592726 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5596985ac6f0 con 0x559698a0ac70 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2a7dce5640 1 -- 10.20.193.28:0/2042592726 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa4004310 con 0x559698a0ac70 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2042592726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 msgr2=0x559698a64890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.032+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64890 secure :-1 s=READY pgs=421 gs=2 cs=0 l=1 c_cookie=11748105499099188671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa4009950 tx=0x7f2aa403a070 comp rx=0 tx=0).stop 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2042592726 shutdown_connections 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64890 unknown :-1 s=CLOSED pgs=421 gs=2 cs=0 l=1 c_cookie=11748105499099188671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2042592726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x559698a6d950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2042592726 >> 10.20.193.28:0/2042592726 conn(0x5596989e8860 msgr2=0x559698a69140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2042592726 shutdown_connections 2026-02-20T13:32:00.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2042592726 wait complete. 2026-02-20T13:32:00.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 -- start start 2026-02-20T13:32:00.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.033+0000 7f2ab9e6ce00 1 Processor -- start 2026-02-20T13:32:00.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x5596989ee620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab9e6ce00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559698914080 con 0x559698a0a360 2026-02-20T13:32:00.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5596989eec90 con 0x559698a4fb20 2026-02-20T13:32:00.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab9e6ce00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559698a64f90 con 0x559698a0ac70 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x5596989ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab53e6640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x5596989ee620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35578/0 (socket says 10.20.193.28:35578) 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 -- 10.20.193.28:0/2810689508 learned_addr learned my addr 10.20.193.28:0/2810689508 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab63e8640 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 -- 10.20.193.28:0/2810689508 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 msgr2=0x559698a64510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 -- 10.20.193.28:0/2810689508 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 msgr2=0x559698a64a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 -- 10.20.193.28:0/2810689508 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969889a6f0 con 0x559698a0a360 2026-02-20T13:32:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2ab5be7640 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x5596989ee620 secure :-1 s=READY pgs=1504 gs=1 cs=0 l=1 c_cookie=13151620361139163980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x559698a4dad0 tx=0x7f2aa00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b683f109c67e934c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2a6b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/2810689508 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa0024040 con 0x559698a0a360 2026-02-20T13:32:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.034+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/2810689508 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2aa0025040 con 0x559698a0a360 2026-02-20T13:32:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596988ac0e0 con 0x559698a0a360 2026-02-20T13:32:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/2810689508 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa002a320 con 0x559698a0a360 2026-02-20T13:32:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 10 client.20736 _ll_register_callbacks cb 0x559698897a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2aa403e040 con 0x559698a0a360 2026-02-20T13:32:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/2810689508 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2aa002abc0 con 0x559698a0a360 2026-02-20T13:32:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/2810689508 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2aa002adc0 con 0x559698a0a360 2026-02-20T13:32:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 10 client.20736 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5596988ac340 con 0x559698a0a360 2026-02-20T13:32:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/2810689508 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2aa002a480 con 0x559698a0a360 2026-02-20T13:32:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 10 client.20736 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 10 client.20736 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 20 client.20736 populate_metadata read hostname 'trial028' 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559698afd5d0 0x559698b1da80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 4 client.20736 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.035+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596985a9f40 con 0x559698afd5d0 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559698afd5d0 0x559698b1da80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab53e6640 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559698afd5d0 0x559698b1da80 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=2767297415878781746 s_cookie=14875552096273453902 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=26676a56854fab32 server_cookie=ce7093d14832534e in_seq=0 out_seq=0 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2a6b7fe640 10 client.20736 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2a6b7fe640 1 -- 10.20.193.28:0/2810689508 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596985a9f40 con 0x559698afd5d0 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2a6b7fe640 10 client.20736 handle_command_reply: tid=0 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 client.20736 shutdown 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 msgr2=0x5596989ee620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x5596989ee620 secure :-1 s=READY pgs=1504 gs=1 cs=0 l=1 c_cookie=13151620361139163980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x559698a4dad0 tx=0x7f2aa00047e0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 shutdown_connections 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x559698afd5d0 0x559698b1da80 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=2767297415878781746 s_cookie=14875552096273453902 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559698a4fb20 0x559698a64a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559698a0ac70 0x559698a64510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 --2- 10.20.193.28:0/2810689508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559698a0a360 0x5596989ee620 unknown :-1 s=CLOSED pgs=1504 gs=1 cs=0 l=1 c_cookie=13151620361139163980 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2a6b7fe640 0 client.20736 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 >> 10.20.193.28:0/2810689508 conn(0x5596989e8860 msgr2=0x559698a09050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.036+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 shutdown_connections 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab9e6ce00 1 -- 10.20.193.28:0/2810689508 wait complete. 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab9e6ce00 20 client.20736 trim_cache size 0 max 16384 2026-02-20T13:32:00.042 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:32:00.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a8c0b5750 msgr2=0x7f2a8c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a8c0b5750 0x7f2a8c0d5c00 secure :-1 s=READY pgs=628 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa00095b0 tx=0x7f2aa0005f90 comp rx=0 tx=0).stop 2026-02-20T13:32:00.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4065795880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab0113420 msgr2=0x7f2ab00f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab0113420 0x7f2ab00f5ee0 secure :-1 s=READY pgs=521 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aac00aef0 tx=0x7f2aac003b50 comp rx=0 tx=0).stop 2026-02-20T13:32:00.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4065795880 shutdown_connections 2026-02-20T13:32:00.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f2a8c0b5750 0x7f2a8c0d5c00 unknown :-1 s=CLOSED pgs=628 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2ab0113420 0x7f2ab00f5ee0 unknown :-1 s=CLOSED pgs=521 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2ab010dc20 0x7f2ab0173cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 --2- 10.20.193.28:0/4065795880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ab010d230 0x7f2ab00f57e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4065795880 >> 10.20.193.28:0/4065795880 conn(0x7f2ab00eab00 msgr2=0x7f2ab010fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4065795880 shutdown_connections 2026-02-20T13:32:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.037+0000 7f2ab6be9640 1 -- 10.20.193.28:0/4065795880 wait complete. 2026-02-20T13:32:00.171 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:32:00.358 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 -- 10.20.193.28:0/661144862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 msgr2=0x7fb938173d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 --2- 10.20.193.28:0/661144862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 0x7fb938173d50 secure :-1 s=READY pgs=1505 gs=1 cs=0 l=1 c_cookie=5194861458377410438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb93400a970 tx=0x7fb9340301b0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 -- 10.20.193.28:0/661144862 shutdown_connections 2026-02-20T13:32:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 --2- 10.20.193.28:0/661144862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 0x7fb938173d50 unknown :-1 s=CLOSED pgs=1505 gs=1 cs=0 l=1 c_cookie=5194861458377410438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 --2- 10.20.193.28:0/661144862 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb93810c040 0x7fb93810f990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 --2- 10.20.193.28:0/661144862 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb93810b650 0x7fb93810ba20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 -- 10.20.193.28:0/661144862 >> 10.20.193.28:0/661144862 conn(0x7fb9380e9080 msgr2=0x7fb938109490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 -- 10.20.193.28:0/661144862 shutdown_connections 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.538+0000 7fb93ec21640 1 -- 10.20.193.28:0/661144862 wait complete. 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93ec21640 1 Processor -- start 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93ec21640 1 -- start start 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93ec21640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb93810b650 0x7fb9380f3cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93ec21640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb93810c040 0x7fb938173c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93ec21640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 0x7fb9380f43f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93ec21640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb9380f95b0 con 0x7fb938110140 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93ec21640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb9380f9720 con 0x7fb93810c040 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93ec21640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb9380f98e0 con 0x7fb93810b650 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93d41e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb93810c040 0x7fb938173c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93e420640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 0x7fb9380f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93d41e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb93810c040 0x7fb938173c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33442/0 (socket says 10.20.193.28:33442) 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93d41e640 1 -- 10.20.193.28:0/1270140767 learned_addr learned my addr 10.20.193.28:0/1270140767 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.539+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb93810b650 0x7fb9380f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93e420640 1 -- 10.20.193.28:0/1270140767 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb93810b650 msgr2=0x7fb9380f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93e420640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb93810b650 0x7fb9380f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93e420640 1 -- 10.20.193.28:0/1270140767 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb93810c040 msgr2=0x7fb938173c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93e420640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb93810c040 0x7fb938173c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93e420640 1 -- 10.20.193.28:0/1270140767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93400a590 con 0x7fb938110140 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb93810b650 0x7fb9380f3cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93e420640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 0x7fb9380f43f0 secure :-1 s=READY pgs=1506 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9340306c0 tx=0x7fb934030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb926ffd640 1 -- 10.20.193.28:0/1270140767 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb93403e070 con 0x7fb938110140 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb926ffd640 1 -- 10.20.193.28:0/1270140767 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb934003ad0 con 0x7fb938110140 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93ec21640 1 -- 10.20.193.28:0/1270140767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9380f9b60 con 0x7fb938110140 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb926ffd640 1 -- 10.20.193.28:0/1270140767 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb934042870 con 0x7fb938110140 2026-02-20T13:32:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.540+0000 7fb93ec21640 1 -- 10.20.193.28:0/1270140767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9380f9fd0 con 0x7fb938110140 2026-02-20T13:32:00.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.543+0000 7fb926ffd640 1 -- 10.20.193.28:0/1270140767 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb93404a060 con 0x7fb938110140 2026-02-20T13:32:00.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.545+0000 7fb926ffd640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9140b5750 0x7fb9140d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.545+0000 7fb926ffd640 1 -- 10.20.193.28:0/1270140767 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb93410c3c0 con 0x7fb938110140 2026-02-20T13:32:00.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.545+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9140b5750 0x7fb9140d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.545+0000 7fb941ea4e00 1 Processor -- start 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb941ea4e00 1 -- start start 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9140b5750 0x7fb9140d5c00 secure :-1 s=READY pgs=629 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb928005b30 tx=0x7fb928009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64ab360 0x5646d64ab730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64abc70 0x5646d64f05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d6510f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646d63c1780 con 0x5646d64f0b20 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646d63bd4b0 con 0x5646d64ab360 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646d63b7450 con 0x5646d64abc70 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64ab360 0x5646d64ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64ab360 0x5646d64ab730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33446/0 (socket says 10.20.193.28:33446) 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93d41e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64abc70 0x5646d64f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 -- 10.20.193.28:0/2822795243 learned_addr learned my addr 10.20.193.28:0/2822795243 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93e420640 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d6510f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 -- 10.20.193.28:0/2822795243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64abc70 msgr2=0x5646d64f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64abc70 0x5646d64f05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 -- 10.20.193.28:0/2822795243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 msgr2=0x5646d6510f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d6510f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93dc1f640 1 -- 10.20.193.28:0/2822795243 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d6362d10 con 0x5646d64ab360 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.546+0000 7fb93e420640 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d6510f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64ab360 0x5646d64ab730 secure :-1 s=READY pgs=523 gs=1 cs=0 l=1 c_cookie=7544284889370524444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9280094f0 tx=0x7fb928013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68b2af22b346fb1c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb9064e6640 1 -- 10.20.193.28:0/2822795243 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb92801d460 con 0x5646d64ab360 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb9064e6640 1 -- 10.20.193.28:0/2822795243 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb92801daa0 con 0x5646d64ab360 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb9064e6640 1 -- 10.20.193.28:0/2822795243 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb92801abd0 con 0x5646d64ab360 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 -- 10.20.193.28:0/2822795243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64ab360 msgr2=0x5646d64ab730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64ab360 0x5646d64ab730 secure :-1 s=READY pgs=523 gs=1 cs=0 l=1 c_cookie=7544284889370524444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9280094f0 tx=0x7fb928013000 comp rx=0 tx=0).stop 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 -- 10.20.193.28:0/2822795243 shutdown_connections 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d6510f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64abc70 0x5646d64f05e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/2822795243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64ab360 0x5646d64ab730 unknown :-1 s=CLOSED pgs=523 gs=1 cs=0 l=1 c_cookie=7544284889370524444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 -- 10.20.193.28:0/2822795243 >> 10.20.193.28:0/2822795243 conn(0x5646d6489860 msgr2=0x5646d64a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 -- 10.20.193.28:0/2822795243 shutdown_connections 2026-02-20T13:32:00.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.547+0000 7fb941ea4e00 1 -- 10.20.193.28:0/2822795243 wait complete. 2026-02-20T13:32:00.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb941ea4e00 1 -- start start 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb941ea4e00 1 Processor -- start 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6508710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64abc70 0x5646d6508c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64f0b20 0x5646d650dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646d650e180 con 0x5646d64abc70 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646d650e2f0 con 0x5646d64f0b20 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646d650e4b0 con 0x5646d64ab360 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb93d41e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64abc70 0x5646d6508c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb93d41e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64abc70 0x5646d6508c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35602/0 (socket says 10.20.193.28:35602) 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb93d41e640 1 -- 10.20.193.28:0/3888676596 learned_addr learned my addr 10.20.193.28:0/3888676596 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6508710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.549+0000 7fb93e420640 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64f0b20 0x5646d650dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb93d41e640 1 -- 10.20.193.28:0/3888676596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 msgr2=0x5646d6508710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb93d41e640 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6508710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb93d41e640 1 -- 10.20.193.28:0/3888676596 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64f0b20 msgr2=0x5646d650dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb93d41e640 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64f0b20 0x5646d650dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb93d41e640 1 -- 10.20.193.28:0/3888676596 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d633b3c0 con 0x5646d64abc70 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb93d41e640 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64abc70 0x5646d6508c50 secure :-1 s=READY pgs=1507 gs=1 cs=0 l=1 c_cookie=546996755368599825 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb92c009550 tx=0x7fb92c002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79752a6a1096111 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb8f37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3888676596 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb92c016070 con 0x5646d64abc70 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb928009930 con 0x5646d64abc70 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3888676596 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb92c011770 con 0x5646d64abc70 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3888676596 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb92c0056a0 con 0x5646d64abc70 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb941ea4e00 10 client.20748 _ll_register_callbacks cb 0x5646d6338a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5646d604d6f0 con 0x5646d64abc70 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3888676596 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb92c01a410 con 0x5646d64abc70 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3888676596 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb92c01a5f0 con 0x5646d64abc70 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb941ea4e00 10 client.20748 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.550+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5646d634d0e0 con 0x5646d64abc70 2026-02-20T13:32:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.551+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3888676596 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb92c0118e0 con 0x5646d64abc70 2026-02-20T13:32:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.551+0000 7fb941ea4e00 10 client.20748 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.551+0000 7fb941ea4e00 10 client.20748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.551+0000 7fb941ea4e00 20 client.20748 populate_metadata read hostname 'trial028' 2026-02-20T13:32:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.551+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646d6510c00 0x5646d64ee8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.551+0000 7fb941ea4e00 4 client.20748 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.551+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646d6359f80 con 0x5646d6510c00 2026-02-20T13:32:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.551+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646d6510c00 0x5646d64ee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646d6510c00 0x5646d64ee8a0 crc :-1 s=READY pgs=417 gs=4 cs=0 l=0 c_cookie=765182288154152328 s_cookie=3738072380061339620 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e793ca9d94d88 server_cookie=33e04d0646414fe4 in_seq=0 out_seq=0 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb8f37fe640 10 client.20748 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb8f37fe640 1 -- 10.20.193.28:0/3888676596 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5646d6359f80 con 0x5646d6510c00 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb8f37fe640 10 client.20748 handle_command_reply: tid=0 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 client.20748 shutdown 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64abc70 msgr2=0x5646d6508c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64abc70 0x5646d6508c50 secure :-1 s=READY pgs=1507 gs=1 cs=0 l=1 c_cookie=546996755368599825 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb92c009550 tx=0x7fb92c002a70 comp rx=0 tx=0).stop 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 shutdown_connections 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646d6510c00 0x5646d64ee8a0 crc :-1 s=READY pgs=417 gs=4 cs=0 l=0 c_cookie=765182288154152328 s_cookie=3738072380061339620 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64abc70 0x5646d6508c50 unknown :-1 s=CLOSED pgs=1507 gs=1 cs=0 l=1 c_cookie=546996755368599825 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64f0b20 0x5646d650dc40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/3888676596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6508710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb8f37fe640 0 client.20748 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:00.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.552+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 >> 10.20.193.28:0/3888676596 conn(0x5646d6489860 msgr2=0x5646d64a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.553+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 shutdown_connections 2026-02-20T13:32:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.553+0000 7fb941ea4e00 1 -- 10.20.193.28:0/3888676596 wait complete. 2026-02-20T13:32:00.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.553+0000 7fb941ea4e00 20 client.20748 trim_cache size 0 max 16384 2026-02-20T13:32:00.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb941ea4e00 1 Processor -- start 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb941ea4e00 1 -- start start 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6506040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d64ef8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d64efdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646d63b5080 con 0x5646d64f0b20 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646d6075700 con 0x5646d64abc70 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646d650e5f0 con 0x5646d64ab360 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93dc1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6506040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93d41e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d64ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93e420640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d64efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93dc1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6506040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60220/0 (socket says 10.20.193.28:60220) 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93dc1f640 1 -- 10.20.193.28:0/4125759586 learned_addr learned my addr 10.20.193.28:0/4125759586 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93e420640 1 -- 10.20.193.28:0/4125759586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 msgr2=0x5646d6506040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93e420640 1 --2- 10.20.193.28:0/4125759586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6506040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93e420640 1 -- 10.20.193.28:0/4125759586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 msgr2=0x5646d64ef8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93e420640 1 --2- 10.20.193.28:0/4125759586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d64ef8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93e420640 1 -- 10.20.193.28:0/4125759586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d64faa60 con 0x5646d64f0b20 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.560+0000 7fb93d41e640 1 --2- 10.20.193.28:0/4125759586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d64ef8b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb93e420640 1 --2- 10.20.193.28:0/4125759586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d64efdf0 secure :-1 s=READY pgs=1508 gs=3 cs=0 l=1 c_cookie=2210251163702206781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9340cecf0 tx=0x7fb9340301b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eac63b914dd213d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb905ce5640 1 -- 10.20.193.28:0/4125759586 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9340d3120 con 0x5646d64f0b20 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb905ce5640 1 -- 10.20.193.28:0/4125759586 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9340d8440 con 0x5646d64f0b20 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb905ce5640 1 -- 10.20.193.28:0/4125759586 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9340d3630 con 0x5646d64f0b20 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 -- 10.20.193.28:0/4125759586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 msgr2=0x5646d64efdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/4125759586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d64efdf0 secure :-1 s=READY pgs=1508 gs=3 cs=0 l=1 c_cookie=2210251163702206781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9340cecf0 tx=0x7fb9340301b0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 -- 10.20.193.28:0/4125759586 shutdown_connections 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/4125759586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d64efdf0 unknown :-1 s=CLOSED pgs=1508 gs=3 cs=0 l=1 c_cookie=2210251163702206781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/4125759586 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d64ef8b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/4125759586 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d6506040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 -- 10.20.193.28:0/4125759586 >> 10.20.193.28:0/4125759586 conn(0x5646d6489860 msgr2=0x5646d6504920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 -- 10.20.193.28:0/4125759586 shutdown_connections 2026-02-20T13:32:00.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.561+0000 7fb941ea4e00 1 -- 10.20.193.28:0/4125759586 wait complete. 2026-02-20T13:32:00.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb941ea4e00 1 -- start start 2026-02-20T13:32:00.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb941ea4e00 1 Processor -- start 2026-02-20T13:32:00.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d648b910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d648be70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb941ea4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d653f390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5646d6419ae0 con 0x5646d64f0b20 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5646d64fd0b0 con 0x5646d64abc70 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb941ea4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5646d6509230 con 0x5646d64ab360 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb93e420640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d653f390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb93d41e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d648be70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb93d41e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d648be70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33464/0 (socket says 10.20.193.28:33464) 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb93e420640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d653f390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35624/0 (socket says 10.20.193.28:35624) 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb93d41e640 1 -- 10.20.193.28:0/1865060417 learned_addr learned my addr 10.20.193.28:0/1865060417 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.562+0000 7fb93dc1f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d648b910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb93e420640 1 -- 10.20.193.28:0/1865060417 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 msgr2=0x5646d648b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb93e420640 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d648b910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb93e420640 1 -- 10.20.193.28:0/1865060417 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 msgr2=0x5646d648be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:00.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb93e420640 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d648be70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb93e420640 1 -- 10.20.193.28:0/1865060417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9380f9fd0 con 0x5646d64f0b20 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb93d41e640 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d648be70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb93e420640 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d653f390 secure :-1 s=READY pgs=1509 gs=1 cs=0 l=1 c_cookie=13307476767758014119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb93400a8c0 tx=0x7fb934006960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ada79d3efad6a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb8f37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb8f37fe640 1 -- 10.20.193.28:0/1865060417 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb934039d60 con 0x5646d64f0b20 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb8f37fe640 1 -- 10.20.193.28:0/1865060417 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9340dd860 con 0x5646d64f0b20 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb8f37fe640 1 -- 10.20.193.28:0/1865060417 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb934097a40 con 0x5646d64f0b20 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d634d0e0 con 0x5646d64f0b20 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb8f37fe640 1 -- 10.20.193.28:0/1865060417 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb9340d0700 con 0x5646d64f0b20 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.563+0000 7fb8f37fe640 10 client.20754 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 10 client.20754 _ll_register_callbacks cb 0x5646d6338a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:00.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb92801daa0 con 0x5646d64f0b20 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb8f37fe640 1 -- 10.20.193.28:0/1865060417 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb9340d3640 con 0x5646d64f0b20 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 10 client.20754 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5646d6347b60 con 0x5646d64f0b20 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb8f37fe640 1 -- 10.20.193.28:0/1865060417 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb934097310 con 0x5646d64f0b20 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 10 client.20754 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 10 client.20754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 20 client.20754 populate_metadata read hostname 'trial028' 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646d6541050 0x5646d65414f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 4 client.20754 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646d604af40 con 0x5646d6541050 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.564+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646d6541050 0x5646d65414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:00.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb8f37fe640 10 client.20754 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb93dc1f640 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646d6541050 0x5646d65414f0 crc :-1 s=READY pgs=418 gs=4 cs=0 l=0 c_cookie=8780211876236256812 s_cookie=3778942141942530315 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d9942e8fba662c server_cookie=34717fdb3d3d010b in_seq=0 out_seq=0 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb8f37fe640 1 -- 10.20.193.28:0/1865060417 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646d604af40 con 0x5646d6541050 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb8f37fe640 10 client.20754 handle_command_reply: tid=0 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 client.20754 shutdown 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 msgr2=0x5646d653f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d653f390 secure :-1 s=READY pgs=1509 gs=1 cs=0 l=1 c_cookie=13307476767758014119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb93400a8c0 tx=0x7fb934006960 comp rx=0 tx=0).stop 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 shutdown_connections 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5646d6541050 0x5646d65414f0 crc :-1 s=READY pgs=418 gs=4 cs=0 l=0 c_cookie=8780211876236256812 s_cookie=3778942141942530315 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5646d64f0b20 0x5646d653f390 unknown :-1 s=CLOSED pgs=1509 gs=1 cs=0 l=1 c_cookie=13307476767758014119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5646d64abc70 0x5646d648be70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 --2- 10.20.193.28:0/1865060417 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5646d64ab360 0x5646d648b910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 >> 10.20.193.28:0/1865060417 conn(0x5646d6489860 msgr2=0x5646d6505110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb8f37fe640 0 client.20754 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:00.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 shutdown_connections 2026-02-20T13:32:00.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 1 -- 10.20.193.28:0/1865060417 wait complete. 2026-02-20T13:32:00.574 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.565+0000 7fb941ea4e00 20 client.20754 trim_cache size 0 max 16384 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 -- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9140b5750 msgr2=0x7fb9140d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9140b5750 0x7fb9140d5c00 secure :-1 s=READY pgs=629 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb928005b30 tx=0x7fb928009310 comp rx=0 tx=0).stop 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 -- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 msgr2=0x7fb9380f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 0x7fb9380f43f0 secure :-1 s=READY pgs=1506 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9340306c0 tx=0x7fb934030d70 comp rx=0 tx=0).stop 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 -- 10.20.193.28:0/1270140767 shutdown_connections 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb9140b5750 0x7fb9140d5c00 unknown :-1 s=CLOSED pgs=629 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938110140 0x7fb9380f43f0 unknown :-1 s=CLOSED pgs=1506 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb93810c040 0x7fb938173c50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 --2- 10.20.193.28:0/1270140767 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb93810b650 0x7fb9380f3cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:00.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 -- 10.20.193.28:0/1270140767 >> 10.20.193.28:0/1270140767 conn(0x7fb9380e9080 msgr2=0x7fb9381112d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:00.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 -- 10.20.193.28:0/1270140767 shutdown_connections 2026-02-20T13:32:00.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:00.566+0000 7fb93ec21640 1 -- 10.20.193.28:0/1270140767 wait complete. 2026-02-20T13:32:00.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:00 trial028 ceph-mon[37442]: pgmap v621: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:32:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:00 trial127 ceph-mon[43817]: pgmap v621: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:32:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:00 trial034 ceph-mon[43332]: pgmap v621: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2026-02-20T13:32:01.666 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:32:01.667 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:32:01.855 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 -- 10.20.193.28:0/3858124433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6de0113430 msgr2=0x7f6de0173e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 --2- 10.20.193.28:0/3858124433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6de0113430 0x7f6de0173e00 secure :-1 s=READY pgs=524 gs=1 cs=0 l=1 c_cookie=5863044030861710914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc00aa30 tx=0x7f6ddc030270 comp rx=0 tx=0).stop 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 -- 10.20.193.28:0/3858124433 shutdown_connections 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 --2- 10.20.193.28:0/3858124433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6de010dc30 0x7f6de0112c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 --2- 10.20.193.28:0/3858124433 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6de0113430 0x7f6de0173e00 unknown :-1 s=CLOSED pgs=524 gs=1 cs=0 l=1 c_cookie=5863044030861710914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 --2- 10.20.193.28:0/3858124433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6de010d240 0x7f6de010d610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 -- 10.20.193.28:0/3858124433 >> 10.20.193.28:0/3858124433 conn(0x7f6de00eaad0 msgr2=0x7f6de010aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 -- 10.20.193.28:0/3858124433 shutdown_connections 2026-02-20T13:32:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 -- 10.20.193.28:0/3858124433 wait complete. 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 Processor -- start 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.036+0000 7f6de707e640 1 -- start start 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de707e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6de010d240 0x7f6de00f56e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de707e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6de010dc30 0x7f6de0173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de707e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6de0113430 0x7f6de00f5de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de707e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6de00fafa0 con 0x7f6de0113430 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de707e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f6de00fb110 con 0x7f6de010dc30 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de707e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6de00fb2d0 con 0x7f6de010d240 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de607c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6de010d240 0x7f6de00f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de687d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6de0113430 0x7f6de00f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de607c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6de010d240 0x7f6de00f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60254/0 (socket says 10.20.193.28:60254) 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de607c640 1 -- 10.20.193.28:0/4147682251 learned_addr learned my addr 10.20.193.28:0/4147682251 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de587b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6de010dc30 0x7f6de0173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de687d640 1 -- 10.20.193.28:0/4147682251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6de010d240 msgr2=0x7f6de00f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de687d640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6de010d240 0x7f6de00f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de687d640 1 -- 10.20.193.28:0/4147682251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6de010dc30 msgr2=0x7f6de0173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de687d640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6de010dc30 0x7f6de0173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de687d640 1 -- 10.20.193.28:0/4147682251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd40094b0 con 0x7f6de0113430 2026-02-20T13:32:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.037+0000 7f6de687d640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6de0113430 0x7f6de00f5de0 secure :-1 s=READY pgs=1510 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc033040 tx=0x7f6ddc030dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.038+0000 7f6dc77fe640 1 -- 10.20.193.28:0/4147682251 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ddc03e070 con 0x7f6de0113430 2026-02-20T13:32:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.038+0000 7f6dc77fe640 1 -- 10.20.193.28:0/4147682251 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ddc039e00 con 0x7f6de0113430 2026-02-20T13:32:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.038+0000 7f6dc77fe640 1 -- 10.20.193.28:0/4147682251 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ddc042820 con 0x7f6de0113430 2026-02-20T13:32:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.038+0000 7f6de707e640 1 -- 10.20.193.28:0/4147682251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc00a650 con 0x7f6de0113430 2026-02-20T13:32:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.038+0000 7f6de707e640 1 -- 10.20.193.28:0/4147682251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de00fb7e0 con 0x7f6de0113430 2026-02-20T13:32:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.040+0000 7f6dc77fe640 1 -- 10.20.193.28:0/4147682251 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f6ddc0052c0 con 0x7f6de0113430 2026-02-20T13:32:02.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.042+0000 7f6dc77fe640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6dbc0b5750 0x7f6dbc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.042+0000 7f6dc77fe640 1 -- 10.20.193.28:0/4147682251 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6ddc10c2a0 con 0x7f6de0113430 2026-02-20T13:32:02.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.042+0000 7f6de607c640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6dbc0b5750 0x7f6dbc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.042+0000 7f6de607c640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6dbc0b5750 0x7f6dbc0d5c00 secure :-1 s=READY pgs=630 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dd00095b0 tx=0x7f6dd0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.044+0000 7f6dea301e00 1 Processor -- start 2026-02-20T13:32:02.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6dea301e00 1 -- start start 2026-02-20T13:32:02.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d627447e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 0x559d62789480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d627a9da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6dea301e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d6265aa20 con 0x559d62744410 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6dea301e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d62656750 con 0x559d627899c0 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6dea301e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d626506f0 con 0x559d62744d20 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de607c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d627447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de607c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d627447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35662/0 (socket says 10.20.193.28:35662) 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de607c640 1 -- 10.20.193.28:0/2829644902 learned_addr learned my addr 10.20.193.28:0/2829644902 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de687d640 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d627a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de587b640 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 0x559d62789480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de607c640 1 -- 10.20.193.28:0/2829644902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 msgr2=0x559d62789480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de607c640 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 0x559d62789480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de607c640 1 -- 10.20.193.28:0/2829644902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 msgr2=0x559d627a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de607c640 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d627a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de607c640 1 -- 10.20.193.28:0/2829644902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d625fc120 con 0x559d62744410 2026-02-20T13:32:02.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.045+0000 7f6de687d640 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d627a9da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:02.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6de607c640 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d627447e0 secure :-1 s=READY pgs=1511 gs=1 cs=0 l=1 c_cookie=6046050040159241107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dd0005970 tx=0x7f6dd0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e7e27a69ed8393 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dc4884640 1 -- 10.20.193.28:0/2829644902 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6dd0011a80 con 0x559d62744410 2026-02-20T13:32:02.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dc4884640 1 -- 10.20.193.28:0/2829644902 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6dd0011be0 con 0x559d62744410 2026-02-20T13:32:02.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dc4884640 1 -- 10.20.193.28:0/2829644902 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6dd001c690 con 0x559d62744410 2026-02-20T13:32:02.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 -- 10.20.193.28:0/2829644902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 msgr2=0x559d627447e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d627447e0 secure :-1 s=READY pgs=1511 gs=1 cs=0 l=1 c_cookie=6046050040159241107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dd0005970 tx=0x7f6dd0014000 comp rx=0 tx=0).stop 2026-02-20T13:32:02.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 -- 10.20.193.28:0/2829644902 shutdown_connections 2026-02-20T13:32:02.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d627a9da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 0x559d62789480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2829644902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d627447e0 unknown :-1 s=CLOSED pgs=1511 gs=1 cs=0 l=1 c_cookie=6046050040159241107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 -- 10.20.193.28:0/2829644902 >> 10.20.193.28:0/2829644902 conn(0x559d62722910 msgr2=0x559d62742cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 -- 10.20.193.28:0/2829644902 shutdown_connections 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.046+0000 7f6dea301e00 1 -- 10.20.193.28:0/2829644902 wait complete. 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.047+0000 7f6dea301e00 1 -- start start 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.047+0000 7f6dea301e00 1 Processor -- start 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744410 0x559d627656e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744d20 0x559d62765c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6276ac10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6dea301e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d6276b150 con 0x559d62744d20 2026-02-20T13:32:02.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6dea301e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d6276b2c0 con 0x559d627899c0 2026-02-20T13:32:02.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6dea301e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d6276b480 con 0x559d62744410 2026-02-20T13:32:02.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de607c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744410 0x559d627656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de607c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744410 0x559d627656e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60270/0 (socket says 10.20.193.28:60270) 2026-02-20T13:32:02.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de607c640 1 -- 10.20.193.28:0/2924942701 learned_addr learned my addr 10.20.193.28:0/2924942701 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de687d640 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6276ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de587b640 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744d20 0x559d62765c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de687d640 1 -- 10.20.193.28:0/2924942701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744410 msgr2=0x559d627656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de687d640 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744410 0x559d627656e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de687d640 1 -- 10.20.193.28:0/2924942701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744d20 msgr2=0x559d62765c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de687d640 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744d20 0x559d62765c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de687d640 1 -- 10.20.193.28:0/2924942701 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd0003de0 con 0x559d627899c0 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.048+0000 7f6de607c640 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744410 0x559d627656e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6de687d640 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6276ac10 secure :-1 s=READY pgs=525 gs=2 cs=0 l=1 c_cookie=11613836104192776521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc109d70 tx=0x7f6ddc0ce550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a12ca2676e045949 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6d93fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6d93fff640 1 -- 10.20.193.28:0/2924942701 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ddc0ccea0 con 0x559d627899c0 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de00fb7e0 con 0x559d627899c0 2026-02-20T13:32:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6dea301e00 10 client.30686 _ll_register_callbacks cb 0x559d62607b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d622e69d0 con 0x559d627899c0 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6d93fff640 1 -- 10.20.193.28:0/2924942701 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ddc0d1eb0 con 0x559d627899c0 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6d93fff640 1 -- 10.20.193.28:0/2924942701 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ddc0d4270 con 0x559d627899c0 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6d93fff640 1 -- 10.20.193.28:0/2924942701 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6ddc0d19a0 con 0x559d627899c0 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6d93fff640 1 -- 10.20.193.28:0/2924942701 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6ddc0d1bc0 con 0x559d627899c0 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6dea301e00 10 client.30686 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.049+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559d625d4810 con 0x559d627899c0 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.050+0000 7f6d93fff640 1 -- 10.20.193.28:0/2924942701 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6ddc039920 con 0x559d627899c0 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.050+0000 7f6dea301e00 10 client.30686 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.050+0000 7f6dea301e00 10 client.30686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.050+0000 7f6dea301e00 20 client.30686 populate_metadata read hostname 'trial028' 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.050+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d6276fc30 0x559d627700a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.050+0000 7f6dea301e00 4 client.30686 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.050+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d6265ddf0 con 0x559d6276fc30 2026-02-20T13:32:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.050+0000 7f6de607c640 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d6276fc30 0x559d627700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6de607c640 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d6276fc30 0x559d627700a0 crc :-1 s=READY pgs=419 gs=4 cs=0 l=0 c_cookie=891017398653390975 s_cookie=3773287386699346849 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5d879a6f6d907f server_cookie=345d68e2efad33a1 in_seq=0 out_seq=0 2026-02-20T13:32:02.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6d93fff640 10 client.30686 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:02.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6d93fff640 1 -- 10.20.193.28:0/2924942701 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559d6265ddf0 con 0x559d6276fc30 2026-02-20T13:32:02.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6d93fff640 10 client.30686 handle_command_reply: tid=0 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 client.30686 shutdown 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 msgr2=0x559d6276ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6276ac10 secure :-1 s=READY pgs=525 gs=2 cs=0 l=1 c_cookie=11613836104192776521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc109d70 tx=0x7f6ddc0ce550 comp rx=0 tx=0).stop 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 shutdown_connections 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d6276fc30 0x559d627700a0 crc :-1 s=READY pgs=419 gs=4 cs=0 l=0 c_cookie=891017398653390975 s_cookie=3773287386699346849 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744d20 0x559d62765c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6276ac10 unknown :-1 s=CLOSED pgs=525 gs=2 cs=0 l=1 c_cookie=11613836104192776521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2924942701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744410 0x559d627656e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6d93fff640 0 client.30686 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.051+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 >> 10.20.193.28:0/2924942701 conn(0x559d62722910 msgr2=0x559d6272bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.052+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 shutdown_connections 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.052+0000 7f6dea301e00 1 -- 10.20.193.28:0/2924942701 wait complete. 2026-02-20T13:32:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.052+0000 7f6dea301e00 20 client.30686 trim_cache size 0 max 16384 2026-02-20T13:32:02.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6dea301e00 1 Processor -- start 2026-02-20T13:32:02.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6dea301e00 1 -- start start 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62765ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d62744d20 0x559d62741b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d627899c0 0x559d62742050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6dea301e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d6264e320 con 0x559d62744410 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6dea301e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d6230e790 con 0x559d62744d20 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6dea301e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d62709520 con 0x559d627899c0 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6de607c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62765ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6de687d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d627899c0 0x559d62742050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6de607c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62765ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35672/0 (socket says 10.20.193.28:35672) 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6de687d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d627899c0 0x559d62742050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60272/0 (socket says 10.20.193.28:60272) 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.061+0000 7f6de687d640 1 -- 10.20.193.28:0/2287485807 learned_addr learned my addr 10.20.193.28:0/2287485807 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6de587b640 1 --2- 10.20.193.28:0/2287485807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d62744d20 0x559d62741b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6de687d640 1 -- 10.20.193.28:0/2287485807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d62744d20 msgr2=0x559d62741b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6de687d640 1 --2- 10.20.193.28:0/2287485807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d62744d20 0x559d62741b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6de687d640 1 -- 10.20.193.28:0/2287485807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 msgr2=0x559d62765ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6de687d640 1 --2- 10.20.193.28:0/2287485807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62765ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6de687d640 1 -- 10.20.193.28:0/2287485807 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d625e64f0 con 0x559d627899c0 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6de687d640 1 --2- 10.20.193.28:0/2287485807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d627899c0 0x559d62742050 secure :-1 s=READY pgs=422 gs=2 cs=0 l=1 c_cookie=5979204364054518843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc0cf920 tx=0x7f6ddc03b030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52fa66b09eef5c3b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6dae4e6640 1 -- 10.20.193.28:0/2287485807 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ddc0ccea0 con 0x559d627899c0 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6dae4e6640 1 -- 10.20.193.28:0/2287485807 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ddc095020 con 0x559d627899c0 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6dae4e6640 1 -- 10.20.193.28:0/2287485807 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ddc0d83b0 con 0x559d627899c0 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6dea301e00 1 -- 10.20.193.28:0/2287485807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d627899c0 msgr2=0x559d62742050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.062+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2287485807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d627899c0 0x559d62742050 secure :-1 s=READY pgs=422 gs=2 cs=0 l=1 c_cookie=5979204364054518843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc0cf920 tx=0x7f6ddc03b030 comp rx=0 tx=0).stop 2026-02-20T13:32:02.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.063+0000 7f6dea301e00 1 -- 10.20.193.28:0/2287485807 shutdown_connections 2026-02-20T13:32:02.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.063+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2287485807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d627899c0 0x559d62742050 unknown :-1 s=CLOSED pgs=422 gs=2 cs=0 l=1 c_cookie=5979204364054518843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.063+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2287485807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d62744d20 0x559d62741b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.063+0000 7f6dea301e00 1 --2- 10.20.193.28:0/2287485807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62765ba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.063+0000 7f6dea301e00 1 -- 10.20.193.28:0/2287485807 >> 10.20.193.28:0/2287485807 conn(0x559d62722910 msgr2=0x559d62765490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.063+0000 7f6dea301e00 1 -- 10.20.193.28:0/2287485807 shutdown_connections 2026-02-20T13:32:02.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.063+0000 7f6dea301e00 1 -- 10.20.193.28:0/2287485807 wait complete. 2026-02-20T13:32:02.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.063+0000 7f6dea301e00 1 -- start start 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6dea301e00 1 Processor -- start 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62782d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 0x559d6277f5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6dea301e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6277fd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6dea301e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d62780400 con 0x559d62744410 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6dea301e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559d6283df80 con 0x559d627899c0 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6dea301e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559d6283e0f0 con 0x559d62744d20 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de687d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6277fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de687d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6277fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33522/0 (socket says 10.20.193.28:33522) 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de687d640 1 -- 10.20.193.28:0/1510947918 learned_addr learned my addr 10.20.193.28:0/1510947918 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de607c640 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62782d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de687d640 1 -- 10.20.193.28:0/1510947918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 msgr2=0x559d6277f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de687d640 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 0x559d6277f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de687d640 1 -- 10.20.193.28:0/1510947918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 msgr2=0x559d62782d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de687d640 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62782d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.064+0000 7f6de687d640 1 -- 10.20.193.28:0/1510947918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d625e0f70 con 0x559d627899c0 2026-02-20T13:32:02.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6de607c640 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62782d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6de687d640 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6277fd00 secure :-1 s=READY pgs=526 gs=2 cs=0 l=1 c_cookie=10335326251384385462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc0dd790 tx=0x7f6ddc030940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f6e74777b892fb6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6d93fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6d93fff640 1 -- 10.20.193.28:0/1510947918 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ddc0ccea0 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6d93fff640 1 -- 10.20.193.28:0/1510947918 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559d622e69d0 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d625d4810 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6d93fff640 1 -- 10.20.193.28:0/1510947918 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ddc0f7750 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6d93fff640 1 -- 10.20.193.28:0/1510947918 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f6ddc096060 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6d93fff640 10 client.30692 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6dea301e00 10 client.30692 _ll_register_callbacks cb 0x559d62607b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dd0011be0 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6d93fff640 1 -- 10.20.193.28:0/1510947918 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6ddc0d1eb0 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6dea301e00 10 client.30692 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.065+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559d625d4b40 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6d93fff640 1 -- 10.20.193.28:0/1510947918 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6ddc0b5020 con 0x559d627899c0 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6dea301e00 10 client.30692 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6dea301e00 10 client.30692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6dea301e00 20 client.30692 populate_metadata read hostname 'trial028' 2026-02-20T13:32:02.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6dea301e00 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d6283f4d0 0x559d6285f980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6dea301e00 4 client.30692 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:32:02.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559d622e4220 con 0x559d6283f4d0 2026-02-20T13:32:02.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6de607c640 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d6283f4d0 0x559d6285f980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6de607c640 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d6283f4d0 0x559d6285f980 crc :-1 s=READY pgs=420 gs=4 cs=0 l=0 c_cookie=3666790212835502102 s_cookie=14426239254514066247 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32e30e4565f06816 server_cookie=c8344c2b221b6347 in_seq=0 out_seq=0 2026-02-20T13:32:02.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.066+0000 7f6d93fff640 10 client.30692 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:02.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6d93fff640 1 -- 10.20.193.28:0/1510947918 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559d622e4220 con 0x559d6283f4d0 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6d93fff640 10 client.30692 handle_command_reply: tid=0 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 client.30692 shutdown 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 msgr2=0x559d6277fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6277fd00 secure :-1 s=READY pgs=526 gs=2 cs=0 l=1 c_cookie=10335326251384385462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc0dd790 tx=0x7f6ddc030940 comp rx=0 tx=0).stop 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 shutdown_connections 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559d6283f4d0 0x559d6285f980 crc :-1 s=READY pgs=420 gs=4 cs=0 l=0 c_cookie=3666790212835502102 s_cookie=14426239254514066247 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559d627899c0 0x559d6277fd00 unknown :-1 s=CLOSED pgs=526 gs=2 cs=0 l=1 c_cookie=10335326251384385462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559d62744d20 0x559d6277f5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 --2- 10.20.193.28:0/1510947918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d62744410 0x559d62782d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6d93fff640 0 client.30692 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:02.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.067+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 >> 10.20.193.28:0/1510947918 conn(0x559d62722910 msgr2=0x559d62740b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 shutdown_connections 2026-02-20T13:32:02.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6dea301e00 1 -- 10.20.193.28:0/1510947918 wait complete. 2026-02-20T13:32:02.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6dea301e00 20 client.30692 trim_cache size 0 max 16384 2026-02-20T13:32:02.072 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:32:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:32:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "1c8316bb-7809-4c1a-a95f-688a16f4b82a", 2026-02-20T13:32:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:32:02.073 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:32:02.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 -- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6dbc0b5750 msgr2=0x7f6dbc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6dbc0b5750 0x7f6dbc0d5c00 secure :-1 s=READY pgs=630 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dd00095b0 tx=0x7f6dd0005f90 comp rx=0 tx=0).stop 2026-02-20T13:32:02.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 -- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6de0113430 msgr2=0x7f6de00f5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6de0113430 0x7f6de00f5de0 secure :-1 s=READY pgs=1510 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ddc033040 tx=0x7f6ddc030dd0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 -- 10.20.193.28:0/4147682251 shutdown_connections 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f6dbc0b5750 0x7f6dbc0d5c00 unknown :-1 s=CLOSED pgs=630 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6de0113430 0x7f6de00f5de0 unknown :-1 s=CLOSED pgs=1510 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f6de010dc30 0x7f6de0173d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 --2- 10.20.193.28:0/4147682251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6de010d240 0x7f6de00f56e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.068+0000 7f6de707e640 1 -- 10.20.193.28:0/4147682251 >> 10.20.193.28:0/4147682251 conn(0x7f6de00eaad0 msgr2=0x7f6de0111380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.069+0000 7f6de707e640 1 -- 10.20.193.28:0/4147682251 shutdown_connections 2026-02-20T13:32:02.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.069+0000 7f6de707e640 1 -- 10.20.193.28:0/4147682251 wait complete. 2026-02-20T13:32:02.204 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:32:02.388 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:02.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.564+0000 7f9f45e71640 1 -- 10.20.193.28:0/440854466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 msgr2=0x7f9f401551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.564+0000 7f9f45e71640 1 --2- 10.20.193.28:0/440854466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 0x7f9f401551e0 secure :-1 s=READY pgs=1512 gs=2 cs=0 l=1 c_cookie=8543890992036571268 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28009890 tx=0x7f9f2802f120 comp rx=0 tx=0).stop 2026-02-20T13:32:02.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.564+0000 7f9f45e71640 1 -- 10.20.193.28:0/440854466 shutdown_connections 2026-02-20T13:32:02.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.564+0000 7f9f45e71640 1 --2- 10.20.193.28:0/440854466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 0x7f9f401551e0 unknown :-1 s=CLOSED pgs=1512 gs=2 cs=0 l=1 c_cookie=8543890992036571268 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.564+0000 7f9f45e71640 1 --2- 10.20.193.28:0/440854466 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f40155850 0x7f9f40175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.564+0000 7f9f45e71640 1 --2- 10.20.193.28:0/440854466 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f4010b230 0x7f9f4010b600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.564+0000 7f9f45e71640 1 -- 10.20.193.28:0/440854466 >> 10.20.193.28:0/440854466 conn(0x7f9f400e8ce0 msgr2=0x7f9f401090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.565+0000 7f9f45e71640 1 -- 10.20.193.28:0/440854466 shutdown_connections 2026-02-20T13:32:02.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.565+0000 7f9f45e71640 1 -- 10.20.193.28:0/440854466 wait complete. 2026-02-20T13:32:02.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.565+0000 7f9f45e71640 1 Processor -- start 2026-02-20T13:32:02.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.565+0000 7f9f45e71640 1 -- start start 2026-02-20T13:32:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45e71640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f4010b230 0x7f9f401600e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45e71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 0x7f9f40160620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45e71640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f40155850 0x7f9f401659f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45e71640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9f40166010 con 0x7f9f4010bb40 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45e71640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9f40166180 con 0x7f9f40155850 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45e71640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9f40166340 con 0x7f9f4010b230 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f44e6f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f4010b230 0x7f9f401600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45670640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f40155850 0x7f9f401659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f37fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 0x7f9f40160620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45670640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f40155850 0x7f9f401659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33536/0 (socket says 10.20.193.28:33536) 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f45670640 1 -- 10.20.193.28:0/48536184 learned_addr learned my addr 10.20.193.28:0/48536184 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f37fff640 1 -- 10.20.193.28:0/48536184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f4010b230 msgr2=0x7f9f401600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f37fff640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f4010b230 0x7f9f401600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f37fff640 1 -- 10.20.193.28:0/48536184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f40155850 msgr2=0x7f9f401659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f37fff640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f40155850 0x7f9f401659f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f37fff640 1 -- 10.20.193.28:0/48536184 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c00a590 con 0x7f9f4010bb40 2026-02-20T13:32:02.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.566+0000 7f9f37fff640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 0x7f9f40160620 secure :-1 s=READY pgs=1513 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28009230 tx=0x7f9f280028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.567+0000 7f9f35ffb640 1 -- 10.20.193.28:0/48536184 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f2803d070 con 0x7f9f4010bb40 2026-02-20T13:32:02.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.567+0000 7f9f35ffb640 1 -- 10.20.193.28:0/48536184 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f2802fcb0 con 0x7f9f4010bb40 2026-02-20T13:32:02.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.567+0000 7f9f35ffb640 1 -- 10.20.193.28:0/48536184 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f28041820 con 0x7f9f4010bb40 2026-02-20T13:32:02.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.567+0000 7f9f45e71640 1 -- 10.20.193.28:0/48536184 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f280094b0 con 0x7f9f4010bb40 2026-02-20T13:32:02.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.567+0000 7f9f45e71640 1 -- 10.20.193.28:0/48536184 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f40166850 con 0x7f9f4010bb40 2026-02-20T13:32:02.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.570+0000 7f9f35ffb640 1 -- 10.20.193.28:0/48536184 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9f280386b0 con 0x7f9f4010bb40 2026-02-20T13:32:02.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f35ffb640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f1c0b5830 0x7f9f1c0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f35ffb640 1 -- 10.20.193.28:0/48536184 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f2810b200 con 0x7f9f4010bb40 2026-02-20T13:32:02.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f1c0b5830 0x7f9f1c0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f490f4e00 1 Processor -- start 2026-02-20T13:32:02.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f490f4e00 1 -- start start 2026-02-20T13:32:02.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 0x56253cf34f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf79e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf9a730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56253ce427d0 con 0x56253cf354a0 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56253ce3e500 con 0x56253cf34b90 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.572+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56253ce384a0 con 0x56253cf7a350 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f45670640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf9a730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f37fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf79e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f45670640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf9a730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60318/0 (socket says 10.20.193.28:60318) 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f45670640 1 -- 10.20.193.28:0/3443557097 learned_addr learned my addr 10.20.193.28:0/3443557097 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f1c0b5830 0x7f9f1c0d5ce0 secure :-1 s=READY pgs=631 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f30005b30 tx=0x7f9f30009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f37fff640 1 -- 10.20.193.28:0/3443557097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 msgr2=0x56253cf9a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f37fff640 1 --2- 10.20.193.28:0/3443557097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf9a730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f37fff640 1 -- 10.20.193.28:0/3443557097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 msgr2=0x56253cf34f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f37fff640 1 --2- 10.20.193.28:0/3443557097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 0x56253cf34f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f37fff640 1 -- 10.20.193.28:0/3443557097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56253cde3d80 con 0x56253cf354a0 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f37fff640 1 --2- 10.20.193.28:0/3443557097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf79e10 secure :-1 s=READY pgs=1514 gs=2 cs=0 l=1 c_cookie=1613115888466666054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28108d10 tx=0x7f9f280385a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1662f05a99982246 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f0d4e4640 1 -- 10.20.193.28:0/3443557097 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f280d0da0 con 0x56253cf354a0 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f0d4e4640 1 -- 10.20.193.28:0/3443557097 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f28038990 con 0x56253cf354a0 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.573+0000 7f9f0d4e4640 1 -- 10.20.193.28:0/3443557097 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f280dc4d0 con 0x56253cf354a0 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3443557097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 msgr2=0x56253cf79e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/3443557097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf79e10 secure :-1 s=READY pgs=1514 gs=2 cs=0 l=1 c_cookie=1613115888466666054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28108d10 tx=0x7f9f280385a0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3443557097 shutdown_connections 2026-02-20T13:32:02.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/3443557097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf79e10 unknown :-1 s=CLOSED pgs=1514 gs=2 cs=0 l=1 c_cookie=1613115888466666054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/3443557097 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf9a730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/3443557097 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 0x56253cf34f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3443557097 >> 10.20.193.28:0/3443557097 conn(0x56253cf0a680 msgr2=0x56253cf2aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3443557097 shutdown_connections 2026-02-20T13:32:02.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.574+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3443557097 wait complete. 2026-02-20T13:32:02.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.575+0000 7f9f490f4e00 1 -- start start 2026-02-20T13:32:02.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.575+0000 7f9f490f4e00 1 Processor -- start 2026-02-20T13:32:02.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 0x56253cf4d090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf354a0 0x56253cf4d5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf7a350 0x56253cf525c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56253cf52b00 con 0x56253cf7a350 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56253cf52c70 con 0x56253cf34b90 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56253cf52e30 con 0x56253cf354a0 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf7a350 0x56253cf525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f44e6f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 0x56253cf4d090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf7a350 0x56253cf525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35710/0 (socket says 10.20.193.28:35710) 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 -- 10.20.193.28:0/1044624163 learned_addr learned my addr 10.20.193.28:0/1044624163 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f37fff640 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf354a0 0x56253cf4d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 -- 10.20.193.28:0/1044624163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf354a0 msgr2=0x56253cf4d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf354a0 0x56253cf4d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 -- 10.20.193.28:0/1044624163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 msgr2=0x56253cf4d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 0x56253cf4d090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 -- 10.20.193.28:0/1044624163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56253cdbc350 con 0x56253cf7a350 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 0x56253cf4d090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9f45670640 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf7a350 0x56253cf525c0 secure :-1 s=READY pgs=1515 gs=3 cs=0 l=1 c_cookie=7085182630288040378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f3c003a00 tx=0x7f9f3c003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6253a010371621ba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.576+0000 7f9efe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1044624163 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f3c018070 con 0x56253cf7a350 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1044624163 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f3c0132e0 con 0x56253cf7a350 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1044624163 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f3c01d630 con 0x56253cf7a350 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f40166850 con 0x56253cf7a350 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1044624163 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f3c01d7c0 con 0x56253cf7a350 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 10 client.20784 _ll_register_callbacks cb 0x56253cdb99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:02.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56253cace6f0 con 0x56253cf7a350 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1044624163 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9f3c013b50 con 0x56253cf7a350 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 10 client.20784 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56253cdce150 con 0x56253cf7a350 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1044624163 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9f3c013cb0 con 0x56253cf7a350 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 10 client.20784 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 10 client.20784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 20 client.20784 populate_metadata read hostname 'trial028' 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56253cf77870 0x56253cf77d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 4 client.20784 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.577+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56253ce45d60 con 0x56253cf77870 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.578+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56253cf77870 0x56253cf77d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.578+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56253cf77870 0x56253cf77d10 crc :-1 s=READY pgs=421 gs=4 cs=0 l=0 c_cookie=708940907009486361 s_cookie=11897198423908410109 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d6a9ffb10b2e19 server_cookie=a51b56eeb765e2fd in_seq=0 out_seq=0 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.578+0000 7f9efe7fc640 10 client.20784 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1044624163 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56253ce45d60 con 0x56253cf77870 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9efe7fc640 10 client.20784 handle_command_reply: tid=0 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 client.20784 shutdown 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf7a350 msgr2=0x56253cf525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf7a350 0x56253cf525c0 secure :-1 s=READY pgs=1515 gs=3 cs=0 l=1 c_cookie=7085182630288040378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f3c003a00 tx=0x7f9f3c003ed0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 shutdown_connections 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56253cf77870 0x56253cf77d10 crc :-1 s=READY pgs=421 gs=4 cs=0 l=0 c_cookie=708940907009486361 s_cookie=11897198423908410109 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf7a350 0x56253cf525c0 unknown :-1 s=CLOSED pgs=1515 gs=3 cs=0 l=1 c_cookie=7085182630288040378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf354a0 0x56253cf4d5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1044624163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf34b90 0x56253cf4d090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 >> 10.20.193.28:0/1044624163 conn(0x56253cf0a680 msgr2=0x56253cf2b250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9efe7fc640 0 client.20784 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:02.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 shutdown_connections 2026-02-20T13:32:02.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1044624163 wait complete. 2026-02-20T13:32:02.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.579+0000 7f9f490f4e00 20 client.20784 trim_cache size 0 max 16384 2026-02-20T13:32:02.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.588+0000 7f9f490f4e00 1 Processor -- start 2026-02-20T13:32:02.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.588+0000 7f9f490f4e00 1 -- start start 2026-02-20T13:32:02.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf34b90 0x56253cf3a6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf354a0 0x56253cf4a490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf4a9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56253ce360d0 con 0x56253cf34b90 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56253caf6700 con 0x56253cf354a0 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56253cf740e0 con 0x56253cf7a350 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f37fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf354a0 0x56253cf4a490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f44e6f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf34b90 0x56253cf3a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f37fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf354a0 0x56253cf4a490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33556/0 (socket says 10.20.193.28:33556) 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f37fff640 1 -- 10.20.193.28:0/3222785807 learned_addr learned my addr 10.20.193.28:0/3222785807 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f45670640 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf4a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f44e6f640 1 -- 10.20.193.28:0/3222785807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 msgr2=0x56253cf4a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf4a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f44e6f640 1 -- 10.20.193.28:0/3222785807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf354a0 msgr2=0x56253cf4a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf354a0 0x56253cf4a490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f44e6f640 1 -- 10.20.193.28:0/3222785807 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56253cdc8bd0 con 0x56253cf34b90 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f37fff640 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf354a0 0x56253cf4a490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.589+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf34b90 0x56253cf3a6c0 secure :-1 s=READY pgs=1516 gs=1 cs=0 l=1 c_cookie=4224460079816157802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x56253cf785c0 tx=0x7f9f30013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa04c0f7942aa6a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f0cce3640 1 -- 10.20.193.28:0/3222785807 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f30033030 con 0x56253cf34b90 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f0cce3640 1 -- 10.20.193.28:0/3222785807 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f30034040 con 0x56253cf34b90 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f0cce3640 1 -- 10.20.193.28:0/3222785807 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f30039320 con 0x56253cf34b90 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3222785807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf34b90 msgr2=0x56253cf3a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf34b90 0x56253cf3a6c0 secure :-1 s=READY pgs=1516 gs=1 cs=0 l=1 c_cookie=4224460079816157802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x56253cf785c0 tx=0x7f9f30013070 comp rx=0 tx=0).stop 2026-02-20T13:32:02.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3222785807 shutdown_connections 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf7a350 0x56253cf4a9d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf354a0 0x56253cf4a490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/3222785807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf34b90 0x56253cf3a6c0 unknown :-1 s=CLOSED pgs=1516 gs=1 cs=0 l=1 c_cookie=4224460079816157802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3222785807 >> 10.20.193.28:0/3222785807 conn(0x56253cf0a680 msgr2=0x56253cf77870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3222785807 shutdown_connections 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.590+0000 7f9f490f4e00 1 -- 10.20.193.28:0/3222785807 wait complete. 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f490f4e00 1 -- start start 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f490f4e00 1 Processor -- start 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf34b90 0x56253cf31710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf31c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f490f4e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf7a350 0x56253cf2d4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56253cf2daf0 con 0x56253cf354a0 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x56253cf2dc60 con 0x56253cf7a350 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f490f4e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x56253cf2de20 con 0x56253cf34b90 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f45670640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf7a350 0x56253cf2d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f44e6f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf34b90 0x56253cf31710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f37fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf31c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f45670640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf7a350 0x56253cf2d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:33558/0 (socket says 10.20.193.28:33558) 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.591+0000 7f9f45670640 1 -- 10.20.193.28:0/1138559846 learned_addr learned my addr 10.20.193.28:0/1138559846 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f37fff640 1 -- 10.20.193.28:0/1138559846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf34b90 msgr2=0x56253cf31710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f37fff640 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf34b90 0x56253cf31710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f37fff640 1 -- 10.20.193.28:0/1138559846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf7a350 msgr2=0x56253cf2d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f37fff640 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf7a350 0x56253cf2d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f37fff640 1 -- 10.20.193.28:0/1138559846 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f30009940 con 0x56253cf354a0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f45670640 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf7a350 0x56253cf2d4b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f37fff640 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf31c70 secure :-1 s=READY pgs=1517 gs=1 cs=0 l=1 c_cookie=10152204856887515579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28108dc0 tx=0x7f9f28038eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce3e08755c699bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9efe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1138559846 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f280d0da0 con 0x56253cf354a0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1138559846 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f28005d40 con 0x56253cf354a0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1138559846 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f280cf800 con 0x56253cf354a0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56253cde3d80 con 0x56253cf354a0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f490f4e00 10 client.20790 _ll_register_callbacks cb 0x56253cdb99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f28038990 con 0x56253cf354a0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1138559846 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9f280d1fa0 con 0x56253cf354a0 2026-02-20T13:32:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1138559846 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9f280d98a0 con 0x56253cf354a0 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f490f4e00 10 client.20790 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.592+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56253cdbc680 con 0x56253cf354a0 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1138559846 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9f280d2f90 con 0x56253cf354a0 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9f490f4e00 10 client.20790 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9f490f4e00 10 client.20790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9f490f4e00 20 client.20790 populate_metadata read hostname 'trial028' 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56253cfd8bf0 0x56253cfd9090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9f490f4e00 4 client.20790 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56253cacbf40 con 0x56253cfd8bf0 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56253cfd8bf0 0x56253cfd9090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9f44e6f640 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56253cfd8bf0 0x56253cfd9090 crc :-1 s=READY pgs=422 gs=4 cs=0 l=0 c_cookie=17382397268440715113 s_cookie=7400134149089124312 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f13aae3842210f69 server_cookie=66b28ecd0eb1dfd8 in_seq=0 out_seq=0 2026-02-20T13:32:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.593+0000 7f9efe7fc640 10 client.20790 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9efe7fc640 1 -- 10.20.193.28:0/1138559846 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7386 (crc 0 0 0) 0x56253cacbf40 con 0x56253cfd8bf0 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9efe7fc640 10 client.20790 handle_command_reply: tid=0 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 client.20790 shutdown 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 msgr2=0x56253cf31c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf31c70 secure :-1 s=READY pgs=1517 gs=1 cs=0 l=1 c_cookie=10152204856887515579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28108dc0 tx=0x7f9f28038eb0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 shutdown_connections 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x56253cfd8bf0 0x56253cfd9090 crc :-1 s=READY pgs=422 gs=4 cs=0 l=0 c_cookie=17382397268440715113 s_cookie=7400134149089124312 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56253cf354a0 0x56253cf31c70 unknown :-1 s=CLOSED pgs=1517 gs=1 cs=0 l=1 c_cookie=10152204856887515579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x56253cf7a350 0x56253cf2d4b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 --2- 10.20.193.28:0/1138559846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x56253cf34b90 0x56253cf31710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 >> 10.20.193.28:0/1138559846 conn(0x56253cf0a680 msgr2=0x56253cf49480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9efe7fc640 0 client.20790 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:02.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 shutdown_connections 2026-02-20T13:32:02.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 1 -- 10.20.193.28:0/1138559846 wait complete. 2026-02-20T13:32:02.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f490f4e00 20 client.20790 trim_cache size 0 max 16384 2026-02-20T13:32:02.604 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:32:02.604 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:32:02.604 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:32:02.604 INFO:teuthology.orchestra.run.trial028.stdout: "1c8316bb-7809-4c1a-a95f-688a16f4b82a": { 2026-02-20T13:32:02.604 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.604 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "1c8316bb-7809-4c1a-a95f-688a16f4b82a", 2026-02-20T13:32:02.604 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:32:02.604 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.605 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.606 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.607 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.608 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:32:02.609 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.610 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:55.786578+0000", 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.611 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:32:02.612 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.613 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.614 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.615 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "1c8316bb-7809-4c1a-a95f-688a16f4b82a": { 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:32:02.067864+0000", 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:32:02.616 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:32:02.617 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:32:02.618 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:32:02.619 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f45e71640 1 -- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f1c0b5830 msgr2=0x7f9f1c0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f45e71640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f1c0b5830 0x7f9f1c0d5ce0 secure :-1 s=READY pgs=631 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f30005b30 tx=0x7f9f30009310 comp rx=0 tx=0).stop 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f45e71640 1 -- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 msgr2=0x7f9f40160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.594+0000 7f9f45e71640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 0x7f9f40160620 secure :-1 s=READY pgs=1513 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f28009230 tx=0x7f9f280028d0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.595+0000 7f9f45e71640 1 -- 10.20.193.28:0/48536184 shutdown_connections 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.595+0000 7f9f45e71640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9f1c0b5830 0x7f9f1c0d5ce0 unknown :-1 s=CLOSED pgs=631 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.595+0000 7f9f45e71640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f4010bb40 0x7f9f40160620 unknown :-1 s=CLOSED pgs=1513 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.595+0000 7f9f45e71640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9f40155850 0x7f9f401659f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.595+0000 7f9f45e71640 1 --2- 10.20.193.28:0/48536184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9f4010b230 0x7f9f401600e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.595+0000 7f9f45e71640 1 -- 10.20.193.28:0/48536184 >> 10.20.193.28:0/48536184 conn(0x7f9f400e8ce0 msgr2=0x7f9f401090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.596+0000 7f9f45e71640 1 -- 10.20.193.28:0/48536184 shutdown_connections 2026-02-20T13:32:02.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:02.596+0000 7f9f45e71640 1 -- 10.20.193.28:0/48536184 wait complete. 2026-02-20T13:32:02.694 INFO:tasks.cephfs.filesystem:scrub status for tag:1c8316bb-7809-4c1a-a95f-688a16f4b82a - {'path': '/', 'tag': '1c8316bb-7809-4c1a-a95f-688a16f4b82a', 'options': 'recursive,force'} 2026-02-20T13:32:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: pgmap v622: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:32:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:32:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:32:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:32:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:32:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:02 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: pgmap v622: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:32:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:32:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:32:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:32:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:32:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:02 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: pgmap v622: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2026-02-20T13:32:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:32:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:32:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:32:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:32:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:02 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:04 trial127 ceph-mon[43817]: pgmap v623: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 7.3 KiB/s wr, 15 op/s 2026-02-20T13:32:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:04 trial034 ceph-mon[43332]: pgmap v623: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 7.3 KiB/s wr, 15 op/s 2026-02-20T13:32:05.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:04 trial028 ceph-mon[37442]: pgmap v623: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 7.3 KiB/s wr, 15 op/s 2026-02-20T13:32:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 -- 10.20.193.28:0/469050039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70062a40 msgr2=0x7f1c70060fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 --2- 10.20.193.28:0/469050039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70062a40 0x7f1c70060fd0 secure :-1 s=READY pgs=1518 gs=1 cs=0 l=1 c_cookie=11877915327992101276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60009950 tx=0x7f1c6002f190 comp rx=0 tx=0).stop 2026-02-20T13:32:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 -- 10.20.193.28:0/469050039 shutdown_connections 2026-02-20T13:32:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 --2- 10.20.193.28:0/469050039 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c70150e50 0x7f1c70171290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 --2- 10.20.193.28:0/469050039 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c70061510 0x7f1c70061980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 --2- 10.20.193.28:0/469050039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70062a40 0x7f1c70060fd0 unknown :-1 s=CLOSED pgs=1518 gs=1 cs=0 l=1 c_cookie=11877915327992101276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 -- 10.20.193.28:0/469050039 >> 10.20.193.28:0/469050039 conn(0x7f1c700ea4c0 msgr2=0x7f1c7010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 -- 10.20.193.28:0/469050039 shutdown_connections 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.429+0000 7f1c76789640 1 -- 10.20.193.28:0/469050039 wait complete. 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c76789640 1 Processor -- start 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c76789640 1 -- start start 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c76789640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70061510 0x7f1c7015c670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c76789640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c70062a40 0x7f1c7015ccc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c76789640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c70150e50 0x7f1c7015d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c76789640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7015e000 con 0x7f1c70061510 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c76789640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7015e170 con 0x7f1c70062a40 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c76789640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7015e330 con 0x7f1c70150e50 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75787640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70061510 0x7f1c7015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75787640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70061510 0x7f1c7015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35746/0 (socket says 10.20.193.28:35746) 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75787640 1 -- 10.20.193.28:0/3050641736 learned_addr learned my addr 10.20.193.28:0/3050641736 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75f88640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c70150e50 0x7f1c7015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c74f86640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c70062a40 0x7f1c7015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75787640 1 -- 10.20.193.28:0/3050641736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c70150e50 msgr2=0x7f1c7015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75787640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c70150e50 0x7f1c7015d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75787640 1 -- 10.20.193.28:0/3050641736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c70062a40 msgr2=0x7f1c7015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75787640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c70062a40 0x7f1c7015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.430+0000 7f1c75787640 1 -- 10.20.193.28:0/3050641736 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c640094b0 con 0x7f1c70061510 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.431+0000 7f1c75787640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70061510 0x7f1c7015c670 secure :-1 s=READY pgs=1519 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60002d80 tx=0x7f1c60002e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.431+0000 7f1c5e7fc640 1 -- 10.20.193.28:0/3050641736 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6003d070 con 0x7f1c70061510 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.431+0000 7f1c5e7fc640 1 -- 10.20.193.28:0/3050641736 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c60038920 con 0x7f1c70061510 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.431+0000 7f1c5e7fc640 1 -- 10.20.193.28:0/3050641736 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c600419d0 con 0x7f1c70061510 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.431+0000 7f1c76789640 1 -- 10.20.193.28:0/3050641736 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c60009570 con 0x7f1c70061510 2026-02-20T13:32:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.431+0000 7f1c76789640 1 -- 10.20.193.28:0/3050641736 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c7015e930 con 0x7f1c70061510 2026-02-20T13:32:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.434+0000 7f1c5e7fc640 1 -- 10.20.193.28:0/3050641736 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f1c60038a90 con 0x7f1c70061510 2026-02-20T13:32:06.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.435+0000 7f1c5e7fc640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b5760 0x7f1c4c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.435+0000 7f1c5e7fc640 1 -- 10.20.193.28:0/3050641736 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c6010b1e0 con 0x7f1c70061510 2026-02-20T13:32:06.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.436+0000 7f1c74f86640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b5760 0x7f1c4c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.436+0000 7f1c74f86640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b5760 0x7f1c4c0d5c10 secure :-1 s=READY pgs=632 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c64004740 tx=0x7f1c64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:06.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c79ffae00 1 Processor -- start 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c79ffae00 1 -- start start 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd678a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 0x55dc2dd881c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dda8ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dc5cfd0 con 0x55dc2dd88700 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dc58d00 con 0x55dc2dd67de0 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dc52ca0 con 0x55dc2dd474c0 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75787640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c74f86640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 0x55dc2dd881c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75f88640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dda8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75787640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60378/0 (socket says 10.20.193.28:60378) 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75787640 1 -- 10.20.193.28:0/3876863677 learned_addr learned my addr 10.20.193.28:0/3876863677 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75f88640 1 -- 10.20.193.28:0/3876863677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 msgr2=0x55dc2dd678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75f88640 1 --2- 10.20.193.28:0/3876863677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd678a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75f88640 1 -- 10.20.193.28:0/3876863677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 msgr2=0x55dc2dd881c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75f88640 1 --2- 10.20.193.28:0/3876863677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 0x55dc2dd881c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75f88640 1 -- 10.20.193.28:0/3876863677 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2dbf58b0 con 0x55dc2dd88700 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.437+0000 7f1c75f88640 1 --2- 10.20.193.28:0/3876863677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dda8ae0 secure :-1 s=READY pgs=1520 gs=2 cs=0 l=1 c_cookie=14197227690904167032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c0055c0 tx=0x7f1c6c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c506af5d5faea278 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c3dbfe640 1 -- 10.20.193.28:0/3876863677 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c00ac10 con 0x55dc2dd88700 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c3dbfe640 1 -- 10.20.193.28:0/3876863677 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6c00ad70 con 0x55dc2dd88700 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c3dbfe640 1 -- 10.20.193.28:0/3876863677 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c012a30 con 0x55dc2dd88700 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3876863677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 msgr2=0x55dc2dda8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3876863677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dda8ae0 secure :-1 s=READY pgs=1520 gs=2 cs=0 l=1 c_cookie=14197227690904167032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c0055c0 tx=0x7f1c6c003c30 comp rx=0 tx=0).stop 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3876863677 shutdown_connections 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3876863677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dda8ae0 unknown :-1 s=CLOSED pgs=1520 gs=2 cs=0 l=1 c_cookie=14197227690904167032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3876863677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 0x55dc2dd881c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3876863677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd678a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3876863677 >> 10.20.193.28:0/3876863677 conn(0x55dc2dc661c0 msgr2=0x55dc2dd45da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3876863677 shutdown_connections 2026-02-20T13:32:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.438+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3876863677 wait complete. 2026-02-20T13:32:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.439+0000 7f1c79ffae00 1 -- start start 2026-02-20T13:32:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c79ffae00 1 Processor -- start 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd60af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd61140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd88700 0x55dc2dd61ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dd62200 con 0x55dc2dd67de0 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dd62370 con 0x55dc2dd88700 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dd62530 con 0x55dc2dd474c0 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c74f86640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd61140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c75f88640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd88700 0x55dc2dd61ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c74f86640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd61140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35764/0 (socket says 10.20.193.28:35764) 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c74f86640 1 -- 10.20.193.28:0/3170907725 learned_addr learned my addr 10.20.193.28:0/3170907725 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c75787640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd60af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c74f86640 1 -- 10.20.193.28:0/3170907725 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 msgr2=0x55dc2dd60af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c74f86640 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd60af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c74f86640 1 -- 10.20.193.28:0/3170907725 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd88700 msgr2=0x55dc2dd61ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c74f86640 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd88700 0x55dc2dd61ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c74f86640 1 -- 10.20.193.28:0/3170907725 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2dbfe400 con 0x55dc2dd67de0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.440+0000 7f1c75787640 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd60af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c74f86640 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd61140 secure :-1 s=READY pgs=1521 gs=2 cs=0 l=1 c_cookie=3761280037350742143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c64012750 tx=0x7f1c640047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3432c0440f0f187f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c2affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c2affd640 1 -- 10.20.193.28:0/3170907725 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6401e620 con 0x55dc2dd67de0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c2affd640 1 -- 10.20.193.28:0/3170907725 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c64016070 con 0x55dc2dd67de0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c2affd640 1 -- 10.20.193.28:0/3170907725 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c64028d60 con 0x55dc2dd67de0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c005260 con 0x55dc2dd67de0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c2affd640 1 -- 10.20.193.28:0/3170907725 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c6401d400 con 0x55dc2dd67de0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c79ffae00 10 client.20802 _ll_register_callbacks cb 0x55dc2dbdda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc2d8f2520 con 0x55dc2dd67de0 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c2affd640 1 -- 10.20.193.28:0/3170907725 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1c64028440 con 0x55dc2dd67de0 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c79ffae00 10 client.20802 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55dc2dbd6da0 con 0x55dc2dd67de0 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.441+0000 7f1c2affd640 1 -- 10.20.193.28:0/3170907725 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1c6401e780 con 0x55dc2dd67de0 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.442+0000 7f1c79ffae00 10 client.20802 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.442+0000 7f1c79ffae00 10 client.20802 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.442+0000 7f1c79ffae00 20 client.20802 populate_metadata read hostname 'trial028' 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.442+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dc2dd65230 0x55dc2dd656d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.442+0000 7f1c79ffae00 4 client.20802 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.442+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc2dc84630 con 0x55dc2dd65230 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.442+0000 7f1c75787640 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dc2dd65230 0x55dc2dd656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c75787640 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dc2dd65230 0x55dc2dd656d0 crc :-1 s=READY pgs=423 gs=4 cs=0 l=0 c_cookie=11523341747220604130 s_cookie=4124242777102393903 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9feb22440c8364e2 server_cookie=393c40f460a8a22f in_seq=0 out_seq=0 2026-02-20T13:32:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c2affd640 10 client.20802 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c2affd640 1 -- 10.20.193.28:0/3170907725 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dc2dc84630 con 0x55dc2dd65230 2026-02-20T13:32:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c2affd640 10 client.20802 handle_command_reply: tid=0 2026-02-20T13:32:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 client.20802 shutdown 2026-02-20T13:32:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 msgr2=0x55dc2dd61140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd61140 secure :-1 s=READY pgs=1521 gs=2 cs=0 l=1 c_cookie=3761280037350742143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c64012750 tx=0x7f1c640047e0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 shutdown_connections 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dc2dd65230 0x55dc2dd656d0 crc :-1 s=READY pgs=423 gs=4 cs=0 l=0 c_cookie=11523341747220604130 s_cookie=4124242777102393903 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd61140 unknown :-1 s=CLOSED pgs=1521 gs=2 cs=0 l=1 c_cookie=3761280037350742143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd88700 0x55dc2dd61ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/3170907725 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd60af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c2affd640 0 client.20802 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.443+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 >> 10.20.193.28:0/3170907725 conn(0x55dc2dc661c0 msgr2=0x55dc2dd48790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.444+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 shutdown_connections 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.444+0000 7f1c79ffae00 1 -- 10.20.193.28:0/3170907725 wait complete. 2026-02-20T13:32:06.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.444+0000 7f1c79ffae00 20 client.20802 trim_cache size 0 max 16384 2026-02-20T13:32:06.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c79ffae00 1 Processor -- start 2026-02-20T13:32:06.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c79ffae00 1 -- start start 2026-02-20T13:32:06.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd61090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 0x55dc2dd5de20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dd5e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dc508d0 con 0x55dc2dd88700 2026-02-20T13:32:06.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dc2d991f10 con 0x55dc2dd67de0 2026-02-20T13:32:06.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dcb84f0 con 0x55dc2dd474c0 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c75f88640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dd5e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c74f86640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 0x55dc2dd5de20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c75787640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd61090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c75787640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd61090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60408/0 (socket says 10.20.193.28:60408) 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c75f88640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dd5e360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35770/0 (socket says 10.20.193.28:35770) 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.451+0000 7f1c75787640 1 -- 10.20.193.28:0/1477756889 learned_addr learned my addr 10.20.193.28:0/1477756889 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c75f88640 1 -- 10.20.193.28:0/1477756889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 msgr2=0x55dc2dd61090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c75f88640 1 --2- 10.20.193.28:0/1477756889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd61090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c75f88640 1 -- 10.20.193.28:0/1477756889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 msgr2=0x55dc2dd5de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c75f88640 1 --2- 10.20.193.28:0/1477756889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 0x55dc2dd5de20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c75f88640 1 -- 10.20.193.28:0/1477756889 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2dbe8670 con 0x55dc2dd88700 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c75f88640 1 --2- 10.20.193.28:0/1477756889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dd5e360 secure :-1 s=READY pgs=1522 gs=2 cs=0 l=1 c_cookie=8561261433854301633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c012480 tx=0x7f1c6c0069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cfb5ea222315c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c3d3fd640 1 -- 10.20.193.28:0/1477756889 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c00ae30 con 0x55dc2dd88700 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c3d3fd640 1 -- 10.20.193.28:0/1477756889 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c6c005cc0 con 0x55dc2dd88700 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c3d3fd640 1 -- 10.20.193.28:0/1477756889 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6c0125c0 con 0x55dc2dd88700 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c79ffae00 1 -- 10.20.193.28:0/1477756889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 msgr2=0x55dc2dd5e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/1477756889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dd5e360 secure :-1 s=READY pgs=1522 gs=2 cs=0 l=1 c_cookie=8561261433854301633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c012480 tx=0x7f1c6c0069e0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c79ffae00 1 -- 10.20.193.28:0/1477756889 shutdown_connections 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/1477756889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd88700 0x55dc2dd5e360 unknown :-1 s=CLOSED pgs=1522 gs=2 cs=0 l=1 c_cookie=8561261433854301633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/1477756889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd67de0 0x55dc2dd5de20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/1477756889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd474c0 0x55dc2dd61090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.452+0000 7f1c79ffae00 1 -- 10.20.193.28:0/1477756889 >> 10.20.193.28:0/1477756889 conn(0x55dc2dc661c0 msgr2=0x55dc2dd60980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 -- 10.20.193.28:0/1477756889 shutdown_connections 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 -- 10.20.193.28:0/1477756889 wait complete. 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 -- start start 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 Processor -- start 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd474c0 0x55dc2dd69710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd69db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd88700 0x55dc2dd6a720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dd6add0 con 0x55dc2dd67de0 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dd6af40 con 0x55dc2dd474c0 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.453+0000 7f1c79ffae00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55dc2dd6b100 con 0x55dc2dd88700 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c74f86640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd69db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c75f88640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd88700 0x55dc2dd6a720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c75f88640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd88700 0x55dc2dd6a720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60422/0 (socket says 10.20.193.28:60422) 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c75f88640 1 -- 10.20.193.28:0/2039116681 learned_addr learned my addr 10.20.193.28:0/2039116681 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c74f86640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd69db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35780/0 (socket says 10.20.193.28:35780) 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c75787640 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd474c0 0x55dc2dd69710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c74f86640 1 -- 10.20.193.28:0/2039116681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd88700 msgr2=0x55dc2dd6a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c74f86640 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd88700 0x55dc2dd6a720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c74f86640 1 -- 10.20.193.28:0/2039116681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd474c0 msgr2=0x55dc2dd69710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c74f86640 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd474c0 0x55dc2dd69710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c74f86640 1 -- 10.20.193.28:0/2039116681 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2dbe30f0 con 0x55dc2dd67de0 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c74f86640 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd69db0 secure :-1 s=READY pgs=1523 gs=1 cs=0 l=1 c_cookie=17239152094740388251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c64005ca0 tx=0x7f1c64012de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3dc57e43ee999b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:06.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c2affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c2affd640 1 -- 10.20.193.28:0/2039116681 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c6400fe60 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c022040 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c79ffae00 10 client.20808 _ll_register_callbacks cb 0x55dc2dbdda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc2dd02ca0 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c2affd640 1 -- 10.20.193.28:0/2039116681 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c64016030 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c2affd640 1 -- 10.20.193.28:0/2039116681 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c640328e0 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c2affd640 1 -- 10.20.193.28:0/2039116681 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1c64032a70 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c2affd640 1 -- 10.20.193.28:0/2039116681 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1c64032c30 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.454+0000 7f1c79ffae00 10 client.20808 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55dc2dbd70d0 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c2affd640 1 -- 10.20.193.28:0/2039116681 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1c64043070 con 0x55dc2dd67de0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c79ffae00 10 client.20808 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c79ffae00 10 client.20808 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c79ffae00 20 client.20808 populate_metadata read hostname 'trial028' 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dc2dd6d1c0 0x55dc2dd6d660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c79ffae00 4 client.20808 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc2d936640 con 0x55dc2dd6d1c0 2026-02-20T13:32:06.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c75787640 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dc2dd6d1c0 0x55dc2dd6d660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:06.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c2affd640 10 client.20808 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:06.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.455+0000 7f1c75787640 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dc2dd6d1c0 0x55dc2dd6d660 crc :-1 s=READY pgs=424 gs=4 cs=0 l=0 c_cookie=539122362984565188 s_cookie=11998777737982064681 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77b58eec82a09c4 server_cookie=a68438c7cb493829 in_seq=0 out_seq=0 2026-02-20T13:32:06.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c2affd640 1 -- 10.20.193.28:0/2039116681 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc2d936640 con 0x55dc2dd6d1c0 2026-02-20T13:32:06.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c2affd640 10 client.20808 handle_command_reply: tid=0 2026-02-20T13:32:06.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 client.20808 shutdown 2026-02-20T13:32:06.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 msgr2=0x55dc2dd69db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd69db0 secure :-1 s=READY pgs=1523 gs=1 cs=0 l=1 c_cookie=17239152094740388251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c64005ca0 tx=0x7f1c64012de0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 shutdown_connections 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55dc2dd6d1c0 0x55dc2dd6d660 crc :-1 s=READY pgs=424 gs=4 cs=0 l=0 c_cookie=539122362984565188 s_cookie=11998777737982064681 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc2dd67de0 0x55dc2dd69db0 unknown :-1 s=CLOSED pgs=1523 gs=1 cs=0 l=1 c_cookie=17239152094740388251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55dc2dd88700 0x55dc2dd6a720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 --2- 10.20.193.28:0/2039116681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55dc2dd474c0 0x55dc2dd69710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 >> 10.20.193.28:0/2039116681 conn(0x55dc2dc661c0 msgr2=0x55dc2dd5ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c2affd640 0 client.20808 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 shutdown_connections 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 1 -- 10.20.193.28:0/2039116681 wait complete. 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.460+0000 7f1c79ffae00 20 client.20808 trim_cache size 0 max 16384 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:32:06.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 -- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b5760 msgr2=0x7f1c4c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b5760 0x7f1c4c0d5c10 secure :-1 s=READY pgs=632 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c64004740 tx=0x7f1c64005f90 comp rx=0 tx=0).stop 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 -- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70061510 msgr2=0x7f1c7015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70061510 0x7f1c7015c670 secure :-1 s=READY pgs=1519 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60002d80 tx=0x7f1c60002e20 comp rx=0 tx=0).stop 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 -- 10.20.193.28:0/3050641736 shutdown_connections 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f1c4c0b5760 0x7f1c4c0d5c10 unknown :-1 s=CLOSED pgs=632 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c70150e50 0x7f1c7015d8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f1c70062a40 0x7f1c7015ccc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 --2- 10.20.193.28:0/3050641736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c70061510 0x7f1c7015c670 unknown :-1 s=CLOSED pgs=1519 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 -- 10.20.193.28:0/3050641736 >> 10.20.193.28:0/3050641736 conn(0x7f1c700ea4c0 msgr2=0x7f1c7010a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 -- 10.20.193.28:0/3050641736 shutdown_connections 2026-02-20T13:32:06.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:06.461+0000 7f1c76789640 1 -- 10.20.193.28:0/3050641736 wait complete. 2026-02-20T13:32:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:06 trial127 ceph-mon[43817]: pgmap v624: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2026-02-20T13:32:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:06 trial034 ceph-mon[43332]: pgmap v624: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2026-02-20T13:32:07.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:06 trial028 ceph-mon[37442]: pgmap v624: 97 pgs: 97 active+clean; 2.6 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2026-02-20T13:32:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:08 trial127 ceph-mon[43817]: pgmap v625: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:32:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:32:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:08 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:32:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:08 trial034 ceph-mon[43332]: pgmap v625: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:32:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:32:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:08 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:32:09.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:08 trial028 ceph-mon[37442]: pgmap v625: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-20T13:32:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:32:09.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:08 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:32:09.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:09 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:32:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:09 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:32:10.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:09 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:32:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:10 trial127 ceph-mon[43817]: pgmap v626: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 16 op/s 2026-02-20T13:32:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:10 trial034 ceph-mon[43332]: pgmap v626: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 16 op/s 2026-02-20T13:32:11.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:10 trial028 ceph-mon[37442]: pgmap v626: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 16 op/s 2026-02-20T13:32:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:12 trial127 ceph-mon[43817]: pgmap v627: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:32:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:12 trial034 ceph-mon[43332]: pgmap v627: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:32:13.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:12 trial028 ceph-mon[37442]: pgmap v627: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:32:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:14 trial127 ceph-mon[43817]: pgmap v628: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:32:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:14 trial034 ceph-mon[43332]: pgmap v628: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:32:15.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:14 trial028 ceph-mon[37442]: pgmap v628: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:32:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:16 trial127 ceph-mon[43817]: pgmap v629: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:32:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:16 trial034 ceph-mon[43332]: pgmap v629: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:32:17.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:16 trial028 ceph-mon[37442]: pgmap v629: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 17 op/s 2026-02-20T13:32:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:18 trial127 ceph-mon[43817]: pgmap v630: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:32:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:18 trial034 ceph-mon[43332]: pgmap v630: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:32:19.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:18 trial028 ceph-mon[37442]: pgmap v630: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:32:19.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 -- 10.20.193.28:0/107691695 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410e940 msgr2=0x7f9d0410edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 --2- 10.20.193.28:0/107691695 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410e940 0x7f9d0410edb0 secure :-1 s=READY pgs=1524 gs=1 cs=0 l=1 c_cookie=6228625224358358187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cec009980 tx=0x7f9cec02f190 comp rx=0 tx=0).stop 2026-02-20T13:32:19.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 -- 10.20.193.28:0/107691695 shutdown_connections 2026-02-20T13:32:19.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 --2- 10.20.193.28:0/107691695 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410e940 0x7f9d0410edb0 unknown :-1 s=CLOSED pgs=1524 gs=1 cs=0 l=1 c_cookie=6228625224358358187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 --2- 10.20.193.28:0/107691695 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d0410f2f0 0x7f9d04171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 --2- 10.20.193.28:0/107691695 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9d041100b0 0x7f9d041104a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 -- 10.20.193.28:0/107691695 >> 10.20.193.28:0/107691695 conn(0x7f9d040ec320 msgr2=0x7f9d0410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:19.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 -- 10.20.193.28:0/107691695 shutdown_connections 2026-02-20T13:32:19.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.534+0000 7f9d0885a640 1 -- 10.20.193.28:0/107691695 wait complete. 2026-02-20T13:32:19.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d0885a640 1 Processor -- start 2026-02-20T13:32:19.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d0885a640 1 -- start start 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d0885a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d0410e940 0x7f9d040f8200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d0885a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410f2f0 0x7f9d04171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d0885a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9d041100b0 0x7f9d040f8a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d0885a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d040f9650 con 0x7f9d0410f2f0 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d0885a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9d040f97c0 con 0x7f9d041100b0 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d0885a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9d040f9980 con 0x7f9d0410e940 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410f2f0 0x7f9d04171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d02d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d0410e940 0x7f9d040f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d03577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9d041100b0 0x7f9d040f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410f2f0 0x7f9d04171080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34734/0 (socket says 10.20.193.28:34734) 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d03577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9d041100b0 0x7f9d040f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:53746/0 (socket says 10.20.193.28:53746) 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.535+0000 7f9d02575640 1 -- 10.20.193.28:0/1657534062 learned_addr learned my addr 10.20.193.28:0/1657534062 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9d02575640 1 -- 10.20.193.28:0/1657534062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d0410e940 msgr2=0x7f9d040f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9d02575640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d0410e940 0x7f9d040f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9d02575640 1 -- 10.20.193.28:0/1657534062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9d041100b0 msgr2=0x7f9d040f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9d02575640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9d041100b0 0x7f9d040f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9d02575640 1 -- 10.20.193.28:0/1657534062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf80094b0 con 0x7f9d0410f2f0 2026-02-20T13:32:19.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9d02575640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410f2f0 0x7f9d04171080 secure :-1 s=READY pgs=1525 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cec0028d0 tx=0x7f9cec002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:19.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9ce3fff640 1 -- 10.20.193.28:0/1657534062 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cec03d070 con 0x7f9d0410f2f0 2026-02-20T13:32:19.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9ce3fff640 1 -- 10.20.193.28:0/1657534062 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9cec002aa0 con 0x7f9d0410f2f0 2026-02-20T13:32:19.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9ce3fff640 1 -- 10.20.193.28:0/1657534062 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cec041a90 con 0x7f9d0410f2f0 2026-02-20T13:32:19.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9d0885a640 1 -- 10.20.193.28:0/1657534062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cec009570 con 0x7f9d0410f2f0 2026-02-20T13:32:19.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.536+0000 7f9d0885a640 1 -- 10.20.193.28:0/1657534062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d040f9f30 con 0x7f9d0410f2f0 2026-02-20T13:32:19.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.539+0000 7f9ce3fff640 1 -- 10.20.193.28:0/1657534062 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9cec038920 con 0x7f9d0410f2f0 2026-02-20T13:32:19.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9ce3fff640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9cd80b5760 0x7f9cd80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d0b675e00 1 Processor -- start 2026-02-20T13:32:19.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9ce3fff640 1 -- 10.20.193.28:0/1657534062 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9cec10b3c0 con 0x7f9d0410f2f0 2026-02-20T13:32:19.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d0b675e00 1 -- start start 2026-02-20T13:32:19.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d02d76640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9cd80b5760 0x7f9cd80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de9377e2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de9379ebd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de937bf4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55de9366afd0 con 0x55de9379f110 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55de93666d00 con 0x55de9375ded0 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55de93660ca0 con 0x55de9377e7f0 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d02d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de9377e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d03577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de937bf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d02575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de9379ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d03577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de937bf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34744/0 (socket says 10.20.193.28:34744) 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.541+0000 7f9d03577640 1 -- 10.20.193.28:0/3858129366 learned_addr learned my addr 10.20.193.28:0/3858129366 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d03577640 1 -- 10.20.193.28:0/3858129366 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 msgr2=0x55de9379ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:19.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d03577640 1 --2- 10.20.193.28:0/3858129366 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de9379ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d03577640 1 -- 10.20.193.28:0/3858129366 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 msgr2=0x55de9377e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d03577640 1 --2- 10.20.193.28:0/3858129366 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de9377e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d03577640 1 -- 10.20.193.28:0/3858129366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de936038b0 con 0x55de9379f110 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d02d76640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9cd80b5760 0x7f9cd80d5c10 secure :-1 s=READY pgs=633 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf8004740 tx=0x7f9cf8009df0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d03577640 1 --2- 10.20.193.28:0/3858129366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de937bf4f0 secure :-1 s=READY pgs=1526 gs=1 cs=0 l=1 c_cookie=3736358013269588454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf4005630 tx=0x7f9cf4003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33da35d1269e39e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9ce13fe640 1 -- 10.20.193.28:0/3858129366 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf4003e30 con 0x55de9379f110 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9ce13fe640 1 -- 10.20.193.28:0/3858129366 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9cf4011910 con 0x55de9379f110 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9ce13fe640 1 -- 10.20.193.28:0/3858129366 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf401ba80 con 0x55de9379f110 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3858129366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 msgr2=0x55de937bf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3858129366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de937bf4f0 secure :-1 s=READY pgs=1526 gs=1 cs=0 l=1 c_cookie=3736358013269588454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf4005630 tx=0x7f9cf4003c30 comp rx=0 tx=0).stop 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3858129366 shutdown_connections 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3858129366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de937bf4f0 unknown :-1 s=CLOSED pgs=1526 gs=1 cs=0 l=1 c_cookie=3736358013269588454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3858129366 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de9379ebd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3858129366 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de9377e2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3858129366 >> 10.20.193.28:0/3858129366 conn(0x55de936741c0 msgr2=0x55de93753da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3858129366 shutdown_connections 2026-02-20T13:32:19.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.542+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3858129366 wait complete. 2026-02-20T13:32:19.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.544+0000 7f9d0b675e00 1 -- start start 2026-02-20T13:32:19.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.544+0000 7f9d0b675e00 1 Processor -- start 2026-02-20T13:32:19.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.544+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9375ded0 0x55de937774e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.544+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de93777b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.544+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de93778590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.544+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55de93778bf0 con 0x55de9375ded0 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.544+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55de93778d60 con 0x55de9379f110 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.544+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55de93778f20 con 0x55de9377e7f0 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de93777b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d03577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de93778590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9375ded0 0x55de937774e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de93777b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45104/0 (socket says 10.20.193.28:45104) 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02575640 1 -- 10.20.193.28:0/3530737964 learned_addr learned my addr 10.20.193.28:0/3530737964 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02d76640 1 -- 10.20.193.28:0/3530737964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 msgr2=0x55de93777b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02d76640 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de93777b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02d76640 1 -- 10.20.193.28:0/3530737964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 msgr2=0x55de93778590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02d76640 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de93778590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02d76640 1 -- 10.20.193.28:0/3530737964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9360c400 con 0x55de9375ded0 2026-02-20T13:32:19.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02575640 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de93777b30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d03577640 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de93778590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d02d76640 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9375ded0 0x55de937774e0 secure :-1 s=READY pgs=1527 gs=2 cs=0 l=1 c_cookie=13363003718451925628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf801a000 tx=0x7f9cf80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b972ed14ea8d127c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9cccbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9cccbfc640 1 -- 10.20.193.28:0/3530737964 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf8011d30 con 0x55de9375ded0 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9cccbfc640 1 -- 10.20.193.28:0/3530737964 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9cf8011e90 con 0x55de9375ded0 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9cccbfc640 1 -- 10.20.193.28:0/3530737964 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf800f3c0 con 0x55de9375ded0 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.545+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf40052d0 con 0x55de9375ded0 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9cccbfc640 1 -- 10.20.193.28:0/3530737964 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9cf800f550 con 0x55de9375ded0 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9cccbfc640 10 client.20820 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 10 client.20820 _ll_register_callbacks cb 0x55de935eba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:19.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55de93300520 con 0x55de9375ded0 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9cccbfc640 1 -- 10.20.193.28:0/3530737964 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9cf800f750 con 0x55de9375ded0 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 10 client.20820 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55de935e4da0 con 0x55de9375ded0 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9cccbfc640 1 -- 10.20.193.28:0/3530737964 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9cf802e060 con 0x55de9375ded0 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 10 client.20820 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 10 client.20820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 20 client.20820 populate_metadata read hostname 'trial028' 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55de9377bc10 0x55de9377c0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 4 client.20820 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de93692630 con 0x55de9377bc10 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.546+0000 7f9d02575640 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55de9377bc10 0x55de9377c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.547+0000 7f9d02575640 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55de9377bc10 0x55de9377c0b0 crc :-1 s=READY pgs=425 gs=4 cs=0 l=0 c_cookie=575672157119237215 s_cookie=6442605257614038281 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fd32c6e02ccc5f server_cookie=5968bb58f0261509 in_seq=0 out_seq=0 2026-02-20T13:32:19.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.547+0000 7f9cccbfc640 10 client.20820 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:19.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9cccbfc640 1 -- 10.20.193.28:0/3530737964 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55de93692630 con 0x55de9377bc10 2026-02-20T13:32:19.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9cccbfc640 10 client.20820 handle_command_reply: tid=0 2026-02-20T13:32:19.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 client.20820 shutdown 2026-02-20T13:32:19.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9375ded0 msgr2=0x55de937774e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9375ded0 0x55de937774e0 secure :-1 s=READY pgs=1527 gs=2 cs=0 l=1 c_cookie=13363003718451925628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf801a000 tx=0x7f9cf80047e0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 shutdown_connections 2026-02-20T13:32:19.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55de9377bc10 0x55de9377c0b0 crc :-1 s=READY pgs=425 gs=4 cs=0 l=0 c_cookie=575672157119237215 s_cookie=6442605257614038281 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de93778590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de93777b30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/3530737964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9375ded0 0x55de937774e0 unknown :-1 s=CLOSED pgs=1527 gs=2 cs=0 l=1 c_cookie=13363003718451925628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9cccbfc640 0 client.20820 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:19.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 >> 10.20.193.28:0/3530737964 conn(0x55de936741c0 msgr2=0x55de9375f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:19.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 shutdown_connections 2026-02-20T13:32:19.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 1 -- 10.20.193.28:0/3530737964 wait complete. 2026-02-20T13:32:19.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.548+0000 7f9d0b675e00 20 client.20820 trim_cache size 0 max 16384 2026-02-20T13:32:19.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d0b675e00 1 Processor -- start 2026-02-20T13:32:19.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d0b675e00 1 -- start start 2026-02-20T13:32:19.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de93777370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de9379cfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de9379d510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55de93753d20 con 0x55de9379f110 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55de9365e8d0 con 0x55de9375ded0 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55de9339ff10 con 0x55de9377e7f0 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d02d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de93777370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d02d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de93777370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:53778/0 (socket says 10.20.193.28:53778) 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.556+0000 7f9d02d76640 1 -- 10.20.193.28:0/1829729815 learned_addr learned my addr 10.20.193.28:0/1829729815 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d02d76640 1 -- 10.20.193.28:0/1829729815 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 msgr2=0x55de9379cfd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d02d76640 1 --2- 10.20.193.28:0/1829729815 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de9379cfd0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d02d76640 1 -- 10.20.193.28:0/1829729815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 msgr2=0x55de9379d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d02d76640 1 --2- 10.20.193.28:0/1829729815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de9379d510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d02d76640 1 -- 10.20.193.28:0/1829729815 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de935f6670 con 0x55de9375ded0 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d02d76640 1 --2- 10.20.193.28:0/1829729815 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de93777370 secure :-1 s=READY pgs=527 gs=1 cs=0 l=1 c_cookie=4872945838274378543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf8002a70 tx=0x7f9cf802c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a02e6c040ffb2f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9ce0bfd640 1 -- 10.20.193.28:0/1829729815 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf800fb10 con 0x55de9375ded0 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9ce0bfd640 1 -- 10.20.193.28:0/1829729815 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9cf8015040 con 0x55de9375ded0 2026-02-20T13:32:19.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9ce0bfd640 1 -- 10.20.193.28:0/1829729815 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf800ec50 con 0x55de9375ded0 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1829729815 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 msgr2=0x55de93777370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1829729815 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de93777370 secure :-1 s=READY pgs=527 gs=1 cs=0 l=1 c_cookie=4872945838274378543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf8002a70 tx=0x7f9cf802c000 comp rx=0 tx=0).stop 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1829729815 shutdown_connections 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1829729815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9379f110 0x55de9379d510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1829729815 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9377e7f0 0x55de9379cfd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1829729815 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9375ded0 0x55de93777370 unknown :-1 s=CLOSED pgs=527 gs=1 cs=0 l=1 c_cookie=4872945838274378543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1829729815 >> 10.20.193.28:0/1829729815 conn(0x55de936741c0 msgr2=0x55de93773800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1829729815 shutdown_connections 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.557+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1829729815 wait complete. 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d0b675e00 1 -- start start 2026-02-20T13:32:19.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d0b675e00 1 Processor -- start 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9375ded0 0x55de93780120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9377e7f0 0x55de937807c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d0b675e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de937812e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55de93764f90 con 0x55de9377e7f0 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55de937819c0 con 0x55de9379f110 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d0b675e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55de93781b80 con 0x55de9375ded0 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9377e7f0 0x55de937807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d02d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9375ded0 0x55de93780120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d02d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9375ded0 0x55de93780120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:45132/0 (socket says 10.20.193.28:45132) 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d02d76640 1 -- 10.20.193.28:0/1845336161 learned_addr learned my addr 10.20.193.28:0/1845336161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.558+0000 7f9d03577640 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de937812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d02d76640 1 -- 10.20.193.28:0/1845336161 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 msgr2=0x55de937812e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:19.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d02d76640 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de937812e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d02d76640 1 -- 10.20.193.28:0/1845336161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9377e7f0 msgr2=0x55de937807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:19.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d02d76640 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9377e7f0 0x55de937807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d02d76640 1 -- 10.20.193.28:0/1845336161 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de935f10f0 con 0x55de9375ded0 2026-02-20T13:32:19.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d02d76640 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9375ded0 0x55de93780120 secure :-1 s=READY pgs=423 gs=3 cs=0 l=1 c_cookie=7642779188045732017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf80046e0 tx=0x7f9cf801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a109b2da836d8b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:19.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9cccbfc640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:32:19.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9cccbfc640 1 -- 10.20.193.28:0/1845336161 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf800ec50 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de935e4da0 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9cccbfc640 1 -- 10.20.193.28:0/1845336161 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55de93300520 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d0b675e00 10 client.30595 _ll_register_callbacks cb 0x55de935eba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55de93710ca0 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9cccbfc640 1 -- 10.20.193.28:0/1845336161 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf801dad0 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.559+0000 7f9cccbfc640 1 -- 10.20.193.28:0/1845336161 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9cf801dc30 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9cccbfc640 1 -- 10.20.193.28:0/1845336161 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9cf8026a50 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d0b675e00 10 client.30595 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55de935e50d0 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9cccbfc640 1 -- 10.20.193.28:0/1845336161 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9cf802e040 con 0x55de9375ded0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d0b675e00 10 client.30595 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d0b675e00 10 client.30595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d0b675e00 20 client.30595 populate_metadata read hostname 'trial028' 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55de937838b0 0x55de93783d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d0b675e00 4 client.30595 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de93344640 con 0x55de937838b0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d02575640 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55de937838b0 0x55de93783d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9d02575640 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55de937838b0 0x55de93783d50 crc :-1 s=READY pgs=426 gs=4 cs=0 l=0 c_cookie=2268230351606051603 s_cookie=9019178440191697809 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f7a5f7cb83cf313 server_cookie=7d2a8f01757ce391 in_seq=0 out_seq=0 2026-02-20T13:32:19.563 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.560+0000 7f9cccbfc640 10 client.30595 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.564+0000 7f9cccbfc640 1 -- 10.20.193.28:0/1845336161 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de93344640 con 0x55de937838b0 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.564+0000 7f9cccbfc640 10 client.30595 handle_command_reply: tid=0 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.564+0000 7f9d0b675e00 1 client.30595 shutdown 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9375ded0 msgr2=0x55de93780120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9375ded0 0x55de93780120 secure :-1 s=READY pgs=423 gs=3 cs=0 l=1 c_cookie=7642779188045732017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf80046e0 tx=0x7f9cf801b000 comp rx=0 tx=0).stop 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 shutdown_connections 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55de937838b0 0x55de93783d50 crc :-1 s=READY pgs=426 gs=4 cs=0 l=0 c_cookie=2268230351606051603 s_cookie=9019178440191697809 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55de9377e7f0 0x55de937807c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55de9379f110 0x55de937812e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 --2- 10.20.193.28:0/1845336161 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55de9375ded0 0x55de93780120 unknown :-1 s=CLOSED pgs=423 gs=3 cs=0 l=1 c_cookie=7642779188045732017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 >> 10.20.193.28:0/1845336161 conn(0x55de936741c0 msgr2=0x55de93773800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9cccbfc640 0 client.30595 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 shutdown_connections 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 1 -- 10.20.193.28:0/1845336161 wait complete. 2026-02-20T13:32:19.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0b675e00 20 client.30595 trim_cache size 0 max 16384 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 -- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9cd80b5760 msgr2=0x7f9cd80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9cd80b5760 0x7f9cd80d5c10 secure :-1 s=READY pgs=633 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf8004740 tx=0x7f9cf8009df0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 -- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410f2f0 msgr2=0x7f9d04171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410f2f0 0x7f9d04171080 secure :-1 s=READY pgs=1525 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cec0028d0 tx=0x7f9cec002900 comp rx=0 tx=0).stop 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 -- 10.20.193.28:0/1657534062 shutdown_connections 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9cd80b5760 0x7f9cd80d5c10 unknown :-1 s=CLOSED pgs=633 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410f2f0 0x7f9d04171080 unknown :-1 s=CLOSED pgs=1525 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9d041100b0 0x7f9d040f8a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 --2- 10.20.193.28:0/1657534062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d0410e940 0x7f9d040f8200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:19.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 -- 10.20.193.28:0/1657534062 >> 10.20.193.28:0/1657534062 conn(0x7f9d040ec320 msgr2=0x7f9d040ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:19.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 -- 10.20.193.28:0/1657534062 shutdown_connections 2026-02-20T13:32:19.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:19.565+0000 7f9d0885a640 1 -- 10.20.193.28:0/1657534062 wait complete. 2026-02-20T13:32:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:20 trial127 ceph-mon[43817]: pgmap v631: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2026-02-20T13:32:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:20 trial034 ceph-mon[43332]: pgmap v631: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2026-02-20T13:32:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:20 trial028 ceph-mon[37442]: pgmap v631: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2026-02-20T13:32:21.906 INFO:tasks.workunit.client.0.trial028.stdout:499/600: open fd = 3 2026-02-20T13:32:21.906 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.906 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.906 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:500/600: open fd = 3 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:501/600: open fd = 3 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:502/600: open fd = 3 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.907 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:503/600: open fd = 3 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:504/600: open fd = 3 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:505/600: open fd = 3 2026-02-20T13:32:21.908 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:506/600: open fd = 3 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:507/600: open fd = 3 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.909 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:508/600: open fd = 3 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:509/600: open fd = 3 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:510/600: open fd = 3 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.910 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:511/600: open fd = 3 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:512/600: open fd = 3 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:513/600: open fd = 3 2026-02-20T13:32:21.911 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:514/600: open fd = 3 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:515/600: open fd = 3 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.912 INFO:tasks.workunit.client.0.trial028.stdout:516/600: open fd = 3 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:517/600: open fd = 3 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:518/600: open fd = 3 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.913 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:519/600: open fd = 3 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:520/600: open fd = 3 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.914 INFO:tasks.workunit.client.0.trial028.stdout:521/600: open fd = 3 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:522/600: open fd = 3 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:523/600: open fd = 3 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:524/600: open fd = 3 2026-02-20T13:32:21.915 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:525/600: open fd = 3 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:526/600: open fd = 3 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:527/600: open fd = 3 2026-02-20T13:32:21.916 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:528/600: open fd = 3 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:529/600: open fd = 3 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.917 INFO:tasks.workunit.client.0.trial028.stdout:530/600: open fd = 3 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:531/600: open fd = 3 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:532/600: open fd = 3 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.918 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:533/600: open fd = 3 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:534/600: open fd = 3 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.919 INFO:tasks.workunit.client.0.trial028.stdout:535/600: open fd = 3 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:536/600: open fd = 3 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:537/600: open fd = 3 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.920 INFO:tasks.workunit.client.0.trial028.stdout:538/600: open fd = 3 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:539/600: open fd = 3 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:540/600: open fd = 3 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.921 INFO:tasks.workunit.client.0.trial028.stdout:541/600: open fd = 3 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:542/600: open fd = 3 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:543/600: open fd = 3 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.922 INFO:tasks.workunit.client.0.trial028.stdout:544/600: open fd = 3 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:545/600: open fd = 3 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:546/600: open fd = 3 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.923 INFO:tasks.workunit.client.0.trial028.stdout:547/600: open fd = 3 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:548/600: open fd = 3 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:549/600: open fd = 3 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.924 INFO:tasks.workunit.client.0.trial028.stdout:550/600: open fd = 3 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:551/600: open fd = 3 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:552/600: open fd = 3 2026-02-20T13:32:21.925 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:553/600: open fd = 3 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:554/600: open fd = 3 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.926 INFO:tasks.workunit.client.0.trial028.stdout:555/600: open fd = 3 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:556/600: open fd = 3 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:557/600: open fd = 3 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.927 INFO:tasks.workunit.client.0.trial028.stdout:558/600: open fd = 3 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:559/600: open fd = 3 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:560/600: open fd = 3 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:32:21.928 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:32:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:22 trial127 ceph-mon[43817]: pgmap v632: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:32:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:22 trial034 ceph-mon[43332]: pgmap v632: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:32:23.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:22 trial028 ceph-mon[37442]: pgmap v632: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 16 op/s 2026-02-20T13:32:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:24 trial127 ceph-mon[43817]: pgmap v633: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 17 op/s 2026-02-20T13:32:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:24 trial034 ceph-mon[43332]: pgmap v633: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 17 op/s 2026-02-20T13:32:25.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:24 trial028 ceph-mon[37442]: pgmap v633: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 17 op/s 2026-02-20T13:32:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:26 trial127 ceph-mon[43817]: pgmap v634: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:32:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:26 trial034 ceph-mon[43332]: pgmap v634: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:32:27.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:26 trial028 ceph-mon[37442]: pgmap v634: 97 pgs: 97 active+clean; 2.7 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2026-02-20T13:32:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:28 trial127 ceph-mon[43817]: pgmap v635: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:32:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:28 trial034 ceph-mon[43332]: pgmap v635: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:32:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:28 trial028 ceph-mon[37442]: pgmap v635: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:32:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:30 trial127 ceph-mon[43817]: pgmap v636: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:32:30.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:30 trial034 ceph-mon[43332]: pgmap v636: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:32:31.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:30 trial028 ceph-mon[37442]: pgmap v636: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:32:32.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 -- 10.20.193.28:0/2626927366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 msgr2=0x7fd220061980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 --2- 10.20.193.28:0/2626927366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 0x7fd220061980 secure :-1 s=READY pgs=1528 gs=1 cs=0 l=1 c_cookie=17078261242679238214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd208009950 tx=0x7fd20802f190 comp rx=0 tx=0).stop 2026-02-20T13:32:32.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 -- 10.20.193.28:0/2626927366 shutdown_connections 2026-02-20T13:32:32.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 --2- 10.20.193.28:0/2626927366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 0x7fd220061980 unknown :-1 s=CLOSED pgs=1528 gs=1 cs=0 l=1 c_cookie=17078261242679238214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 --2- 10.20.193.28:0/2626927366 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd220150e50 0x7fd220171290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 --2- 10.20.193.28:0/2626927366 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd220062a40 0x7fd220060fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 -- 10.20.193.28:0/2626927366 >> 10.20.193.28:0/2626927366 conn(0x7fd2200ea4c0 msgr2=0x7fd22010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:32.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 -- 10.20.193.28:0/2626927366 shutdown_connections 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.639+0000 7fd21ffff640 1 -- 10.20.193.28:0/2626927366 wait complete. 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21ffff640 1 Processor -- start 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21ffff640 1 -- start start 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 0x7fd22015c6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd220062a40 0x7fd22015cd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd220150e50 0x7fd22015d900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd22015e040 con 0x7fd220061510 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21ffff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd22015e1b0 con 0x7fd220150e50 2026-02-20T13:32:32.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21ffff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd22015e370 con 0x7fd220062a40 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 0x7fd22015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 0x7fd22015c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56420/0 (socket says 10.20.193.28:56420) 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21effd640 1 -- 10.20.193.28:0/934799939 learned_addr learned my addr 10.20.193.28:0/934799939 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd220062a40 0x7fd22015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21f7fe640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd220150e50 0x7fd22015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21effd640 1 -- 10.20.193.28:0/934799939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd220062a40 msgr2=0x7fd22015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21effd640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd220062a40 0x7fd22015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21effd640 1 -- 10.20.193.28:0/934799939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd220150e50 msgr2=0x7fd22015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21effd640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd220150e50 0x7fd22015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.640+0000 7fd21effd640 1 -- 10.20.193.28:0/934799939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd208009570 con 0x7fd220061510 2026-02-20T13:32:32.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.641+0000 7fd21effd640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 0x7fd22015c6b0 secure :-1 s=READY pgs=1529 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140072a0 tx=0x7fd21400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:32.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.641+0000 7fd224819640 1 -- 10.20.193.28:0/934799939 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd214004500 con 0x7fd220061510 2026-02-20T13:32:32.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.641+0000 7fd224819640 1 -- 10.20.193.28:0/934799939 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd21400bd20 con 0x7fd220061510 2026-02-20T13:32:32.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.641+0000 7fd224819640 1 -- 10.20.193.28:0/934799939 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd214002ea0 con 0x7fd220061510 2026-02-20T13:32:32.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.641+0000 7fd21ffff640 1 -- 10.20.193.28:0/934799939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22015e650 con 0x7fd220061510 2026-02-20T13:32:32.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.641+0000 7fd21ffff640 1 -- 10.20.193.28:0/934799939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22015eb70 con 0x7fd220061510 2026-02-20T13:32:32.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.644+0000 7fd224819640 1 -- 10.20.193.28:0/934799939 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd21400b840 con 0x7fd220061510 2026-02-20T13:32:32.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd224819640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1f40b5760 0x7fd1f40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd224819640 1 -- 10.20.193.28:0/934799939 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd2140e6af0 con 0x7fd220061510 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd227e0de00 1 Processor -- start 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1f40b5760 0x7fd1f40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd227e0de00 1 -- start start 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6ff8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd7201c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd740ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd227e0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589cd5f4fd0 con 0x5589cd6df4c0 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd227e0de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5589cd5f0d00 con 0x5589cd720700 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd227e0de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5589cd5eaca0 con 0x5589cd6ffde0 2026-02-20T13:32:32.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd21effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd21effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6ff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56424/0 (socket says 10.20.193.28:56424) 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd21effd640 1 -- 10.20.193.28:0/14001273 learned_addr learned my addr 10.20.193.28:0/14001273 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd21f7fe640 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd740ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1f40b5760 0x7fd1f40d5c10 secure :-1 s=READY pgs=634 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd208002d80 tx=0x7fd20803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.646+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd7201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd21effd640 1 -- 10.20.193.28:0/14001273 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 msgr2=0x5589cd7201c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd21effd640 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd7201c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd21effd640 1 -- 10.20.193.28:0/14001273 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 msgr2=0x5589cd740ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd21effd640 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd740ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd21effd640 1 -- 10.20.193.28:0/14001273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cd58d8b0 con 0x5589cd6df4c0 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd21f7fe640 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd740ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd21effd640 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6ff8a0 secure :-1 s=READY pgs=1530 gs=1 cs=0 l=1 c_cookie=5350915999830572522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140e45c0 tx=0x7fd214002bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4245c060dafdea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd1eb7fe640 1 -- 10.20.193.28:0/14001273 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2140ac8e0 con 0x5589cd6df4c0 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd1eb7fe640 1 -- 10.20.193.28:0/14001273 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd2140ac700 con 0x5589cd6df4c0 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd1eb7fe640 1 -- 10.20.193.28:0/14001273 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2140a9170 con 0x5589cd6df4c0 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 -- 10.20.193.28:0/14001273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 msgr2=0x5589cd6ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6ff8a0 secure :-1 s=READY pgs=1530 gs=1 cs=0 l=1 c_cookie=5350915999830572522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140e45c0 tx=0x7fd214002bd0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 -- 10.20.193.28:0/14001273 shutdown_connections 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd740ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd7201c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 --2- 10.20.193.28:0/14001273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6ff8a0 unknown :-1 s=CLOSED pgs=1530 gs=1 cs=0 l=1 c_cookie=5350915999830572522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 -- 10.20.193.28:0/14001273 >> 10.20.193.28:0/14001273 conn(0x5589cd5fe1c0 msgr2=0x5589cd6ddda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:32.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 -- 10.20.193.28:0/14001273 shutdown_connections 2026-02-20T13:32:32.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.647+0000 7fd227e0de00 1 -- 10.20.193.28:0/14001273 wait complete. 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd227e0de00 1 -- start start 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd227e0de00 1 Processor -- start 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6f8b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd6f91a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd6f9c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd227e0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589cd6fa260 con 0x5589cd6df4c0 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd227e0de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5589cd6fa3d0 con 0x5589cd720700 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd227e0de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5589cd6fa590 con 0x5589cd6ffde0 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21e7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd6f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21e7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd6f91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36480/0 (socket says 10.20.193.28:36480) 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21e7fc640 1 -- 10.20.193.28:0/3427078372 learned_addr learned my addr 10.20.193.28:0/3427078372 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21f7fe640 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd6f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21effd640 1 -- 10.20.193.28:0/3427078372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 msgr2=0x5589cd6f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21effd640 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd6f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21effd640 1 -- 10.20.193.28:0/3427078372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 msgr2=0x5589cd6f9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.649+0000 7fd21effd640 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd6f9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd21effd640 1 -- 10.20.193.28:0/3427078372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cd596400 con 0x5589cd6df4c0 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd21effd640 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6f8b50 secure :-1 s=READY pgs=1531 gs=1 cs=0 l=1 c_cookie=3170422251687296693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140acee0 tx=0x7fd2140026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bff9a3d83d0beb5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:32.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd1e8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/3427078372 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2140b2b70 con 0x5589cd6df4c0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/3427078372 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd2140b7f90 con 0x5589cd6df4c0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/3427078372 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2140aaee0 con 0x5589cd6df4c0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22015eb70 con 0x5589cd6df4c0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/3427078372 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd2140b7050 con 0x5589cd6df4c0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd1e8ff9640 10 client.20835 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd227e0de00 10 client.20835 _ll_register_callbacks cb 0x5589cd575a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5589cd28a520 con 0x5589cd6df4c0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/3427078372 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd2140092b0 con 0x5589cd6df4c0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd227e0de00 10 client.20835 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.650+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5589cd56eda0 con 0x5589cd6df4c0 2026-02-20T13:32:32.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.651+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/3427078372 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd2140bb020 con 0x5589cd6df4c0 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.651+0000 7fd227e0de00 10 client.20835 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.651+0000 7fd227e0de00 10 client.20835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.651+0000 7fd227e0de00 20 client.20835 populate_metadata read hostname 'trial028' 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.651+0000 7fd227e0de00 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cd6fcf70 0x5589cd6fd410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.651+0000 7fd227e0de00 4 client.20835 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.651+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589cd61c630 con 0x5589cd6fcf70 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.651+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cd6fcf70 0x5589cd6fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.652+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cd6fcf70 0x5589cd6fd410 crc :-1 s=READY pgs=427 gs=4 cs=0 l=0 c_cookie=13106804702467862234 s_cookie=5447510031189814531 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5e4b96f1f042eda server_cookie=4b997182df722d03 in_seq=0 out_seq=0 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.652+0000 7fd1e8ff9640 10 client.20835 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:32.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.652+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/3427078372 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5589cd61c630 con 0x5589cd6fcf70 2026-02-20T13:32:32.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.652+0000 7fd1e8ff9640 10 client.20835 handle_command_reply: tid=0 2026-02-20T13:32:32.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.652+0000 7fd227e0de00 1 client.20835 shutdown 2026-02-20T13:32:32.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.652+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 msgr2=0x5589cd6f8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.652+0000 7fd227e0de00 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6f8b50 secure :-1 s=READY pgs=1531 gs=1 cs=0 l=1 c_cookie=3170422251687296693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140acee0 tx=0x7fd2140026a0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 shutdown_connections 2026-02-20T13:32:32.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cd6fcf70 0x5589cd6fd410 crc :-1 s=READY pgs=427 gs=4 cs=0 l=0 c_cookie=13106804702467862234 s_cookie=5447510031189814531 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd720700 0x5589cd6f9c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd6ffde0 0x5589cd6f91a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 1 --2- 10.20.193.28:0/3427078372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd6f8b50 unknown :-1 s=CLOSED pgs=1531 gs=1 cs=0 l=1 c_cookie=3170422251687296693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd1e8ff9640 0 client.20835 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:32.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 >> 10.20.193.28:0/3427078372 conn(0x5589cd5fe1c0 msgr2=0x5589cd6e0790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:32.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 shutdown_connections 2026-02-20T13:32:32.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 1 -- 10.20.193.28:0/3427078372 wait complete. 2026-02-20T13:32:32.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.653+0000 7fd227e0de00 20 client.20835 trim_cache size 0 max 16384 2026-02-20T13:32:32.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd227e0de00 1 Processor -- start 2026-02-20T13:32:32.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd227e0de00 1 -- start start 2026-02-20T13:32:32.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6df4c0 0x5589cd6f89c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6ffde0 0x5589cd6ea9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd71e5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd227e0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589cd5e88d0 con 0x5589cd6ffde0 2026-02-20T13:32:32.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd227e0de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5589cd329f10 con 0x5589cd6df4c0 2026-02-20T13:32:32.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd227e0de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5589cd6f0880 con 0x5589cd720700 2026-02-20T13:32:32.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.660+0000 7fd21effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6df4c0 0x5589cd6f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6df4c0 0x5589cd6f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39880/0 (socket says 10.20.193.28:39880) 2026-02-20T13:32:32.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21effd640 1 -- 10.20.193.28:0/2948505324 learned_addr learned my addr 10.20.193.28:0/2948505324 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:32.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6ffde0 0x5589cd6ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21f7fe640 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd71e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21effd640 1 -- 10.20.193.28:0/2948505324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 msgr2=0x5589cd71e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:32.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21effd640 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd71e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21effd640 1 -- 10.20.193.28:0/2948505324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6ffde0 msgr2=0x5589cd6ea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:32.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21effd640 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6ffde0 0x5589cd6ea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21effd640 1 -- 10.20.193.28:0/2948505324 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cd6eb1b0 con 0x5589cd6df4c0 2026-02-20T13:32:32.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd21effd640 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6df4c0 0x5589cd6f89c0 secure :-1 s=READY pgs=528 gs=1 cs=0 l=1 c_cookie=442195816950164759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140ae790 tx=0x7fd2140cb000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=622fec0ae7a6d17 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:32.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd1eaffd640 1 -- 10.20.193.28:0/2948505324 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2140aaee0 con 0x5589cd6df4c0 2026-02-20T13:32:32.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd1eaffd640 1 -- 10.20.193.28:0/2948505324 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5589cd28a520 con 0x5589cd6df4c0 2026-02-20T13:32:32.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd1eaffd640 1 -- 10.20.193.28:0/2948505324 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2140b2b70 con 0x5589cd6df4c0 2026-02-20T13:32:32.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 -- 10.20.193.28:0/2948505324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6df4c0 msgr2=0x5589cd6f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6df4c0 0x5589cd6f89c0 secure :-1 s=READY pgs=528 gs=1 cs=0 l=1 c_cookie=442195816950164759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140ae790 tx=0x7fd2140cb000 comp rx=0 tx=0).stop 2026-02-20T13:32:32.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 -- 10.20.193.28:0/2948505324 shutdown_connections 2026-02-20T13:32:32.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6ffde0 0x5589cd6ea9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd71e5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 --2- 10.20.193.28:0/2948505324 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6df4c0 0x5589cd6f89c0 unknown :-1 s=CLOSED pgs=528 gs=1 cs=0 l=1 c_cookie=442195816950164759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 -- 10.20.193.28:0/2948505324 >> 10.20.193.28:0/2948505324 conn(0x5589cd5fe1c0 msgr2=0x5589cd6f4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:32.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 -- 10.20.193.28:0/2948505324 shutdown_connections 2026-02-20T13:32:32.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.661+0000 7fd227e0de00 1 -- 10.20.193.28:0/2948505324 wait complete. 2026-02-20T13:32:32.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.662+0000 7fd227e0de00 1 -- start start 2026-02-20T13:32:32.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.662+0000 7fd227e0de00 1 Processor -- start 2026-02-20T13:32:32.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.662+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd705900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.662+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6ffde0 0x5589cd705e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.662+0000 7fd227e0de00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd704660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.662+0000 7fd227e0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589cd329f10 con 0x5589cd6df4c0 2026-02-20T13:32:32.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.662+0000 7fd227e0de00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5589cd5e88d0 con 0x5589cd6ffde0 2026-02-20T13:32:32.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.662+0000 7fd227e0de00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5589cd704de0 con 0x5589cd720700 2026-02-20T13:32:32.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21e7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6ffde0 0x5589cd705e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd705900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd705900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56446/0 (socket says 10.20.193.28:56446) 2026-02-20T13:32:32.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 -- 10.20.193.28:0/670808498 learned_addr learned my addr 10.20.193.28:0/670808498 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:32.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21f7fe640 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd704660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 -- 10.20.193.28:0/670808498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 msgr2=0x5589cd704660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:32.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd704660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 -- 10.20.193.28:0/670808498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6ffde0 msgr2=0x5589cd705e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:32.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6ffde0 0x5589cd705e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 -- 10.20.193.28:0/670808498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cd580670 con 0x5589cd6df4c0 2026-02-20T13:32:32.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21f7fe640 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd704660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:32.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd21effd640 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd705900 secure :-1 s=READY pgs=1532 gs=1 cs=0 l=1 c_cookie=5655688508218827726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140af0e0 tx=0x7fd214002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7d0abbaca463ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:32.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd1e8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:32.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/670808498 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2140b5150 con 0x5589cd6df4c0 2026-02-20T13:32:32.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/670808498 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd214072ca0 con 0x5589cd6df4c0 2026-02-20T13:32:32.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/670808498 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2140b3d20 con 0x5589cd6df4c0 2026-02-20T13:32:32.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589cd56eda0 con 0x5589cd6df4c0 2026-02-20T13:32:32.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd227e0de00 10 client.20841 _ll_register_callbacks cb 0x5589cd575a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:32.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.663+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5589cd69aca0 con 0x5589cd6df4c0 2026-02-20T13:32:32.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/670808498 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd2140b7f90 con 0x5589cd6df4c0 2026-02-20T13:32:32.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/670808498 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd2140092b0 con 0x5589cd6df4c0 2026-02-20T13:32:32.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd227e0de00 10 client.20841 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:32.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5589cd57b0f0 con 0x5589cd6df4c0 2026-02-20T13:32:32.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/670808498 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd21409e050 con 0x5589cd6df4c0 2026-02-20T13:32:32.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd227e0de00 10 client.20841 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:32.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd227e0de00 10 client.20841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:32.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd227e0de00 20 client.20841 populate_metadata read hostname 'trial028' 2026-02-20T13:32:32.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd227e0de00 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cd7cd180 0x5589cd7ed560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:32.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd227e0de00 4 client.20841 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5589cd2ce640 con 0x5589cd7cd180 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.664+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cd7cd180 0x5589cd7ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.665+0000 7fd21e7fc640 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cd7cd180 0x5589cd7ed560 crc :-1 s=READY pgs=428 gs=4 cs=0 l=0 c_cookie=4512859795639696904 s_cookie=17044196392186415496 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea0e612f03efe08 server_cookie=ec8926508e440988 in_seq=0 out_seq=0 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.665+0000 7fd1e8ff9640 10 client.20841 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.668+0000 7fd1e8ff9640 1 -- 10.20.193.28:0/670808498 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5589cd2ce640 con 0x5589cd7cd180 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.668+0000 7fd1e8ff9640 10 client.20841 handle_command_reply: tid=0 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.668+0000 7fd227e0de00 1 client.20841 shutdown 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 msgr2=0x5589cd705900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd705900 secure :-1 s=READY pgs=1532 gs=1 cs=0 l=1 c_cookie=5655688508218827726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140af0e0 tx=0x7fd214002390 comp rx=0 tx=0).stop 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 shutdown_connections 2026-02-20T13:32:32.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cd7cd180 0x5589cd7ed560 crc :-1 s=READY pgs=428 gs=4 cs=0 l=0 c_cookie=4512859795639696904 s_cookie=17044196392186415496 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cd720700 0x5589cd704660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cd6ffde0 0x5589cd705e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 --2- 10.20.193.28:0/670808498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cd6df4c0 0x5589cd705900 unknown :-1 s=CLOSED pgs=1532 gs=1 cs=0 l=1 c_cookie=5655688508218827726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd1e8ff9640 0 client.20841 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 >> 10.20.193.28:0/670808498 conn(0x5589cd5fe1c0 msgr2=0x5589cd6f4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 shutdown_connections 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 1 -- 10.20.193.28:0/670808498 wait complete. 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd227e0de00 20 client.20841 trim_cache size 0 max 16384 2026-02-20T13:32:32.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:32:32.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:32:32.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:32:32.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:32:32.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 -- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1f40b5760 msgr2=0x7fd1f40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1f40b5760 0x7fd1f40d5c10 secure :-1 s=READY pgs=634 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd208002d80 tx=0x7fd20803a040 comp rx=0 tx=0).stop 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 -- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 msgr2=0x7fd22015c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 0x7fd22015c6b0 secure :-1 s=READY pgs=1529 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2140072a0 tx=0x7fd21400ddf0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 -- 10.20.193.28:0/934799939 shutdown_connections 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd1f40b5760 0x7fd1f40d5c10 unknown :-1 s=CLOSED pgs=634 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd220150e50 0x7fd22015d900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd220062a40 0x7fd22015cd00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 --2- 10.20.193.28:0/934799939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd220061510 0x7fd22015c6b0 unknown :-1 s=CLOSED pgs=1529 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 -- 10.20.193.28:0/934799939 >> 10.20.193.28:0/934799939 conn(0x7fd2200ea4c0 msgr2=0x7fd22010a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 -- 10.20.193.28:0/934799939 shutdown_connections 2026-02-20T13:32:32.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:32.669+0000 7fd21ffff640 1 -- 10.20.193.28:0/934799939 wait complete. 2026-02-20T13:32:32.695 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:32:32.881 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:32.926 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:32 trial028 ceph-mon[37442]: pgmap v637: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:32:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:32 trial127 ceph-mon[43817]: pgmap v637: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:32:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:32 trial034 ceph-mon[43332]: pgmap v637: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-20T13:32:33.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 -- 10.20.193.28:0/4269094375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 msgr2=0x7ff62817a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/4269094375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 0x7ff62817a570 secure :-1 s=READY pgs=1533 gs=1 cs=0 l=1 c_cookie=10937378022747311903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62400aa30 tx=0x7ff624030270 comp rx=0 tx=0).stop 2026-02-20T13:32:33.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 -- 10.20.193.28:0/4269094375 shutdown_connections 2026-02-20T13:32:33.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/4269094375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 0x7ff62817a570 unknown :-1 s=CLOSED pgs=1533 gs=1 cs=0 l=1 c_cookie=10937378022747311903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/4269094375 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff628114990 0x7ff6281193f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/4269094375 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff628113fa0 0x7ff628114370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 -- 10.20.193.28:0/4269094375 >> 10.20.193.28:0/4269094375 conn(0x7ff628064a90 msgr2=0x7ff628064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 -- 10.20.193.28:0/4269094375 shutdown_connections 2026-02-20T13:32:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.074+0000 7ff62ec6f640 1 -- 10.20.193.28:0/4269094375 wait complete. 2026-02-20T13:32:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62ec6f640 1 Processor -- start 2026-02-20T13:32:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62ec6f640 1 -- start start 2026-02-20T13:32:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62ec6f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff628113fa0 0x7ff628122200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62ec6f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff628114990 0x7ff628122740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62ec6f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 0x7ff628127b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62ec6f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff628128130 con 0x7ff628119ba0 2026-02-20T13:32:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62ec6f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281282a0 con 0x7ff628113fa0 2026-02-20T13:32:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62ec6f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff628128460 con 0x7ff628114990 2026-02-20T13:32:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62dc6d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff628113fa0 0x7ff628122200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62e46e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 0x7ff628127b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62d46c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff628114990 0x7ff628122740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62dc6d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff628113fa0 0x7ff628122200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39908/0 (socket says 10.20.193.28:39908) 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.075+0000 7ff62dc6d640 1 -- 10.20.193.28:0/791990197 learned_addr learned my addr 10.20.193.28:0/791990197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff62e46e640 1 -- 10.20.193.28:0/791990197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff628114990 msgr2=0x7ff628122740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff62e46e640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff628114990 0x7ff628122740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff62e46e640 1 -- 10.20.193.28:0/791990197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff628113fa0 msgr2=0x7ff628122200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff62e46e640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff628113fa0 0x7ff628122200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff62e46e640 1 -- 10.20.193.28:0/791990197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62400a650 con 0x7ff628119ba0 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff62e46e640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 0x7ff628127b10 secure :-1 s=READY pgs=1534 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62400a230 tx=0x7ff624030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff616ffd640 1 -- 10.20.193.28:0/791990197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff62403e070 con 0x7ff628119ba0 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff616ffd640 1 -- 10.20.193.28:0/791990197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6240055a0 con 0x7ff628119ba0 2026-02-20T13:32:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff616ffd640 1 -- 10.20.193.28:0/791990197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff624042d10 con 0x7ff628119ba0 2026-02-20T13:32:33.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff62ec6f640 1 -- 10.20.193.28:0/791990197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6281286e0 con 0x7ff628119ba0 2026-02-20T13:32:33.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.076+0000 7ff62ec6f640 1 -- 10.20.193.28:0/791990197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff628168ca0 con 0x7ff628119ba0 2026-02-20T13:32:33.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.080+0000 7ff616ffd640 1 -- 10.20.193.28:0/791990197 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff624042410 con 0x7ff628119ba0 2026-02-20T13:32:33.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.081+0000 7ff616ffd640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff6040b5760 0x7ff6040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.081+0000 7ff616ffd640 1 -- 10.20.193.28:0/791990197 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff62410c4d0 con 0x7ff628119ba0 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.081+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff6040b5760 0x7ff6040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff631ef2e00 1 Processor -- start 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff631ef2e00 1 -- start start 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff6040b5760 0x7ff6040d5c10 secure :-1 s=READY pgs=635 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6180095b0 tx=0x7ff618005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1f2550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc1f2a90 0x5555dc237400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc237940 0x5555dc257d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555dc1087d0 con 0x5555dc1f2a90 2026-02-20T13:32:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555dc104500 con 0x5555dc237940 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555dc0fe4a0 con 0x5555dc1f2180 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff62dc6d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff62d46c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc1f2a90 0x5555dc237400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff62dc6d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36524/0 (socket says 10.20.193.28:36524) 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff62dc6d640 1 -- 10.20.193.28:0/3984302861 learned_addr learned my addr 10.20.193.28:0/3984302861 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.082+0000 7ff62e46e640 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc237940 0x5555dc257d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff62dc6d640 1 -- 10.20.193.28:0/3984302861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc237940 msgr2=0x5555dc257d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc237940 0x5555dc257d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff62dc6d640 1 -- 10.20.193.28:0/3984302861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc1f2a90 msgr2=0x5555dc237400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc1f2a90 0x5555dc237400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff62dc6d640 1 -- 10.20.193.28:0/3984302861 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555dc0a9d80 con 0x5555dc1f2180 2026-02-20T13:32:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff62d46c640 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc1f2a90 0x5555dc237400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1f2550 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=5482071501899929376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff618005970 tx=0x7ff618014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c143afc58099720 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff5f64e6640 1 -- 10.20.193.28:0/3984302861 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff618011a80 con 0x5555dc1f2180 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff5f64e6640 1 -- 10.20.193.28:0/3984302861 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff618011be0 con 0x5555dc1f2180 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff5f64e6640 1 -- 10.20.193.28:0/3984302861 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff61801b690 con 0x5555dc1f2180 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff631ef2e00 1 -- 10.20.193.28:0/3984302861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 msgr2=0x5555dc1f2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1f2550 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=5482071501899929376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff618005970 tx=0x7ff618014000 comp rx=0 tx=0).stop 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff631ef2e00 1 -- 10.20.193.28:0/3984302861 shutdown_connections 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc1f2a90 0x5555dc237400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc237940 0x5555dc257d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/3984302861 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1f2550 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=5482071501899929376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff631ef2e00 1 -- 10.20.193.28:0/3984302861 >> 10.20.193.28:0/3984302861 conn(0x5555dc1d0680 msgr2=0x5555dc1f0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.083+0000 7ff631ef2e00 1 -- 10.20.193.28:0/3984302861 shutdown_connections 2026-02-20T13:32:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.084+0000 7ff631ef2e00 1 -- 10.20.193.28:0/3984302861 wait complete. 2026-02-20T13:32:33.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff631ef2e00 1 -- start start 2026-02-20T13:32:33.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff631ef2e00 1 Processor -- start 2026-02-20T13:32:33.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc24f030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc24f570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc254560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555dc254aa0 con 0x5555dc237940 2026-02-20T13:32:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555dc254c10 con 0x5555dc1f2a90 2026-02-20T13:32:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555dc254dd0 con 0x5555dc1f2180 2026-02-20T13:32:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff62d46c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc24f570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff62d46c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc24f570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39926/0 (socket says 10.20.193.28:39926) 2026-02-20T13:32:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.085+0000 7ff62d46c640 1 -- 10.20.193.28:0/13387776 learned_addr learned my addr 10.20.193.28:0/13387776 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc24f030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62e46e640 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc254560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62d46c640 1 -- 10.20.193.28:0/13387776 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 msgr2=0x5555dc24f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62d46c640 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc24f030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62d46c640 1 -- 10.20.193.28:0/13387776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 msgr2=0x5555dc254560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62d46c640 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc254560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62d46c640 1 -- 10.20.193.28:0/13387776 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff618003de0 con 0x5555dc1f2a90 2026-02-20T13:32:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62e46e640 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc254560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff62d46c640 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc24f570 secure :-1 s=READY pgs=529 gs=1 cs=0 l=1 c_cookie=2919044260402996798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff61c0116c0 tx=0x7ff61c011b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2882874a00f6a63e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff5e37fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:33.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff5e37fe640 1 -- 10.20.193.28:0/13387776 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff61c016070 con 0x5555dc1f2a90 2026-02-20T13:32:33.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c0077e0 con 0x5555dc1f2a90 2026-02-20T13:32:33.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff631ef2e00 10 client.30773 _ll_register_callbacks cb 0x5555dc07f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:33.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.086+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555dbd946f0 con 0x5555dc1f2a90 2026-02-20T13:32:33.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff5e37fe640 1 -- 10.20.193.28:0/13387776 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff61c010d90 con 0x5555dc1f2a90 2026-02-20T13:32:33.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff5e37fe640 1 -- 10.20.193.28:0/13387776 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff61c01b6a0 con 0x5555dc1f2a90 2026-02-20T13:32:33.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff5e37fe640 1 -- 10.20.193.28:0/13387776 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff61c01b830 con 0x5555dc1f2a90 2026-02-20T13:32:33.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff5e37fe640 1 -- 10.20.193.28:0/13387776 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff61c01ba50 con 0x5555dc1f2a90 2026-02-20T13:32:33.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff631ef2e00 10 client.30773 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5555dc082350 con 0x5555dc1f2a90 2026-02-20T13:32:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff5e37fe640 1 -- 10.20.193.28:0/13387776 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff61c01bbf0 con 0x5555dc1f2a90 2026-02-20T13:32:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff631ef2e00 10 client.30773 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff631ef2e00 10 client.30773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff631ef2e00 20 client.30773 populate_metadata read hostname 'trial028' 2026-02-20T13:32:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555dc234a30 0x5555dc234ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff631ef2e00 4 client.30773 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:33.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.087+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555dc10bd60 con 0x5555dc234a30 2026-02-20T13:32:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.088+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555dc234a30 0x5555dc234ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.088+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555dc234a30 0x5555dc234ea0 crc :-1 s=READY pgs=429 gs=4 cs=0 l=0 c_cookie=3058987338621568350 s_cookie=15638517062292278 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a73b4c6faf4c55e server_cookie=378f25fe4fd336 in_seq=0 out_seq=0 2026-02-20T13:32:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.088+0000 7ff5e37fe640 10 client.30773 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff5e37fe640 1 -- 10.20.193.28:0/13387776 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5555dc10bd60 con 0x5555dc234a30 2026-02-20T13:32:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff5e37fe640 10 client.30773 handle_command_reply: tid=0 2026-02-20T13:32:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 client.30773 shutdown 2026-02-20T13:32:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 msgr2=0x5555dc24f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc24f570 secure :-1 s=READY pgs=529 gs=1 cs=0 l=1 c_cookie=2919044260402996798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff61c0116c0 tx=0x7ff61c011b90 comp rx=0 tx=0).stop 2026-02-20T13:32:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 shutdown_connections 2026-02-20T13:32:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555dc234a30 0x5555dc234ea0 crc :-1 s=READY pgs=429 gs=4 cs=0 l=0 c_cookie=3058987338621568350 s_cookie=15638517062292278 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc254560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc24f570 unknown :-1 s=CLOSED pgs=529 gs=1 cs=0 l=1 c_cookie=2919044260402996798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/13387776 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc24f030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 >> 10.20.193.28:0/13387776 conn(0x5555dc1d0680 msgr2=0x5555dc1f0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff5e37fe640 0 client.30773 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:33.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 shutdown_connections 2026-02-20T13:32:33.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 1 -- 10.20.193.28:0/13387776 wait complete. 2026-02-20T13:32:33.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.089+0000 7ff631ef2e00 20 client.30773 trim_cache size 0 max 16384 2026-02-20T13:32:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.098+0000 7ff631ef2e00 1 Processor -- start 2026-02-20T13:32:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.098+0000 7ff631ef2e00 1 -- start start 2026-02-20T13:32:33.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.098+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2180 0x5555dc241030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.098+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2a90 0x5555dc24c320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.098+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc24c860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.098+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555dc0fc0d0 con 0x5555dc237940 2026-02-20T13:32:33.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.098+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555dbdbc700 con 0x5555dc1f2180 2026-02-20T13:32:33.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.098+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555dc255590 con 0x5555dc1f2a90 2026-02-20T13:32:33.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62d46c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2a90 0x5555dc24c320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62e46e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc24c860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62d46c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2a90 0x5555dc24c320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36544/0 (socket says 10.20.193.28:36544) 2026-02-20T13:32:33.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62d46c640 1 -- 10.20.193.28:0/2095668354 learned_addr learned my addr 10.20.193.28:0/2095668354 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:33.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62dc6d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2180 0x5555dc241030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62e46e640 1 -- 10.20.193.28:0/2095668354 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2a90 msgr2=0x5555dc24c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:33.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62e46e640 1 --2- 10.20.193.28:0/2095668354 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2a90 0x5555dc24c320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62e46e640 1 -- 10.20.193.28:0/2095668354 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2180 msgr2=0x5555dc241030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:33.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62e46e640 1 --2- 10.20.193.28:0/2095668354 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2180 0x5555dc241030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62e46e640 1 -- 10.20.193.28:0/2095668354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555dc241800 con 0x5555dc237940 2026-02-20T13:32:33.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff62e46e640 1 --2- 10.20.193.28:0/2095668354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc24c860 secure :-1 s=READY pgs=1535 gs=3 cs=0 l=1 c_cookie=6424147577119395399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62410a090 tx=0x7ff62403b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5927282f4ee34e47 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:33.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff5f5ce5640 1 -- 10.20.193.28:0/2095668354 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6240d2300 con 0x5555dc237940 2026-02-20T13:32:33.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff5f5ce5640 1 -- 10.20.193.28:0/2095668354 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6240d2120 con 0x5555dc237940 2026-02-20T13:32:33.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff5f5ce5640 1 -- 10.20.193.28:0/2095668354 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff624039de0 con 0x5555dc237940 2026-02-20T13:32:33.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff631ef2e00 1 -- 10.20.193.28:0/2095668354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 msgr2=0x5555dc24c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/2095668354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc24c860 secure :-1 s=READY pgs=1535 gs=3 cs=0 l=1 c_cookie=6424147577119395399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62410a090 tx=0x7ff62403b040 comp rx=0 tx=0).stop 2026-02-20T13:32:33.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff631ef2e00 1 -- 10.20.193.28:0/2095668354 shutdown_connections 2026-02-20T13:32:33.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/2095668354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc24c860 unknown :-1 s=CLOSED pgs=1535 gs=3 cs=0 l=1 c_cookie=6424147577119395399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/2095668354 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2a90 0x5555dc24c320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/2095668354 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2180 0x5555dc241030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.099+0000 7ff631ef2e00 1 -- 10.20.193.28:0/2095668354 >> 10.20.193.28:0/2095668354 conn(0x5555dc1d0680 msgr2=0x5555dc24bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 -- 10.20.193.28:0/2095668354 shutdown_connections 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 -- 10.20.193.28:0/2095668354 wait complete. 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 -- start start 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 Processor -- start 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1d62a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc1d6800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc1d1fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5555dc0fc0d0 con 0x5555dc237940 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5555dc1d2700 con 0x5555dc1f2a90 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.100+0000 7ff631ef2e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5555dc1d28c0 con 0x5555dc1f2180 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc1d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62dc6d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1d62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc1d6800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39936/0 (socket says 10.20.193.28:39936) 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 -- 10.20.193.28:0/557552125 learned_addr learned my addr 10.20.193.28:0/557552125 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:33.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62dc6d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1d62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36548/0 (socket says 10.20.193.28:36548) 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62e46e640 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc1d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 -- 10.20.193.28:0/557552125 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 msgr2=0x5555dc1d62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1d62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 -- 10.20.193.28:0/557552125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 msgr2=0x5555dc1d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc1d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 -- 10.20.193.28:0/557552125 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555dc094150 con 0x5555dc1f2a90 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62e46e640 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc1d1fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff62d46c640 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc1d6800 secure :-1 s=READY pgs=530 gs=2 cs=0 l=1 c_cookie=9995131640004403909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff61c01a530 tx=0x7ff61c011670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab5d74525bae2c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:33.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff5e37fe640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.101+0000 7ff5e37fe640 1 -- 10.20.193.28:0/557552125 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff61c016070 con 0x5555dc1f2a90 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff628168ca0 con 0x5555dc1f2a90 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 10 client.30779 _ll_register_callbacks cb 0x5555dc07f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555dbe564a0 con 0x5555dc1f2a90 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff5e37fe640 1 -- 10.20.193.28:0/557552125 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5555dbd946f0 con 0x5555dc1f2a90 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff5e37fe640 1 -- 10.20.193.28:0/557552125 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff61c00e520 con 0x5555dc1f2a90 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff5e37fe640 1 -- 10.20.193.28:0/557552125 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff61c00e680 con 0x5555dc1f2a90 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff5e37fe640 1 -- 10.20.193.28:0/557552125 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff61c00e840 con 0x5555dc1f2a90 2026-02-20T13:32:33.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 10 client.30779 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5555dc08ebd0 con 0x5555dc1f2a90 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff5e37fe640 1 -- 10.20.193.28:0/557552125 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff61c01ab50 con 0x5555dc1f2a90 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 10 client.30779 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 10 client.30779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 20 client.30779 populate_metadata read hostname 'trial028' 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555dc2e5020 0x5555dc3054d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 4 client.30779 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff618011be0 con 0x5555dc2e5020 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.102+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555dc2e5020 0x5555dc3054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff62dc6d640 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555dc2e5020 0x5555dc3054d0 crc :-1 s=READY pgs=430 gs=4 cs=0 l=0 c_cookie=685075403758765477 s_cookie=6312316362172536371 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=981e073356605a5 server_cookie=5799da498d2e1633 in_seq=0 out_seq=0 2026-02-20T13:32:33.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff5e37fe640 10 client.30779 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff5e37fe640 1 -- 10.20.193.28:0/557552125 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7190 (crc 0 0 0) 0x7ff618011be0 con 0x5555dc2e5020 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff5e37fe640 10 client.30779 handle_command_reply: tid=0 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff631ef2e00 1 client.30779 shutdown 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 msgr2=0x5555dc1d6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc1d6800 secure :-1 s=READY pgs=530 gs=2 cs=0 l=1 c_cookie=9995131640004403909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff61c01a530 tx=0x7ff61c011670 comp rx=0 tx=0).stop 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 shutdown_connections 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5555dc2e5020 0x5555dc3054d0 crc :-1 s=READY pgs=430 gs=4 cs=0 l=0 c_cookie=685075403758765477 s_cookie=6312316362172536371 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.103+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5555dc237940 0x5555dc1d1fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff5e37fe640 0 client.30779 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5555dc1f2a90 0x5555dc1d6800 unknown :-1 s=CLOSED pgs=530 gs=2 cs=0 l=1 c_cookie=9995131640004403909 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff631ef2e00 1 --2- 10.20.193.28:0/557552125 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5555dc1f2180 0x5555dc1d62a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 >> 10.20.193.28:0/557552125 conn(0x5555dc1d0680 msgr2=0x5555dc24c320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 shutdown_connections 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff631ef2e00 1 -- 10.20.193.28:0/557552125 wait complete. 2026-02-20T13:32:33.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff631ef2e00 20 client.30779 trim_cache size 0 max 16384 2026-02-20T13:32:33.119 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:32:33.119 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:32:33.119 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:32:33.119 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:32:33.119 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:32:33.119 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:32:33.119 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.119 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:32:33.120 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:32:33.121 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.122 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.123 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:32:33.124 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:55.786578+0000", 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.125 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.126 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.127 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "1c8316bb-7809-4c1a-a95f-688a16f4b82a": { 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:32:02.067864+0000", 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.128 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.129 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:33.130 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 -- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff6040b5760 msgr2=0x7ff6040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff6040b5760 0x7ff6040d5c10 secure :-1 s=READY pgs=635 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6180095b0 tx=0x7ff618005f90 comp rx=0 tx=0).stop 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 -- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 msgr2=0x7ff628127b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 0x7ff628127b10 secure :-1 s=READY pgs=1534 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62400a230 tx=0x7ff624030d00 comp rx=0 tx=0).stop 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 -- 10.20.193.28:0/791990197 shutdown_connections 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff6040b5760 0x7ff6040d5c10 unknown :-1 s=CLOSED pgs=635 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff628119ba0 0x7ff628127b10 unknown :-1 s=CLOSED pgs=1534 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff628114990 0x7ff628122740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 --2- 10.20.193.28:0/791990197 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff628113fa0 0x7ff628122200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.104+0000 7ff62ec6f640 1 -- 10.20.193.28:0/791990197 >> 10.20.193.28:0/791990197 conn(0x7ff628064a90 msgr2=0x7ff6280659c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:33.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.106+0000 7ff62ec6f640 1 -- 10.20.193.28:0/791990197 shutdown_connections 2026-02-20T13:32:33.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.106+0000 7ff62ec6f640 1 -- 10.20.193.28:0/791990197 wait complete. 2026-02-20T13:32:33.247 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:32:33.247 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:32:33.431 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:33.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 -- 10.20.193.28:0/3247765994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec10fc20 msgr2=0x7fefec114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 --2- 10.20.193.28:0/3247765994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec10fc20 0x7fefec114c70 secure :-1 s=READY pgs=1536 gs=1 cs=0 l=1 c_cookie=4385405364571290030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe0009950 tx=0x7fefe002f190 comp rx=0 tx=0).stop 2026-02-20T13:32:33.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 -- 10.20.193.28:0/3247765994 shutdown_connections 2026-02-20T13:32:33.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 --2- 10.20.193.28:0/3247765994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec10fc20 0x7fefec114c70 unknown :-1 s=CLOSED pgs=1536 gs=1 cs=0 l=1 c_cookie=4385405364571290030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 --2- 10.20.193.28:0/3247765994 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefec115420 0x7fefec175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 --2- 10.20.193.28:0/3247765994 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefec10f230 0x7fefec10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 -- 10.20.193.28:0/3247765994 >> 10.20.193.28:0/3247765994 conn(0x7fefec05f830 msgr2=0x7fefec10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 -- 10.20.193.28:0/3247765994 shutdown_connections 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.601+0000 7feff389f640 1 -- 10.20.193.28:0/3247765994 wait complete. 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff389f640 1 Processor -- start 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff389f640 1 -- start start 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff389f640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefec10f230 0x7fefec0f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff389f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefec10fc20 0x7fefec175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff389f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec115420 0x7fefec0f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff389f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fefec0fae90 con 0x7fefec115420 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff389f640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fefec0fb000 con 0x7fefec10fc20 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff389f640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fefec0fb1c0 con 0x7fefec10f230 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff1614640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefec10f230 0x7fefec0f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff1614640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefec10f230 0x7fefec0f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36558/0 (socket says 10.20.193.28:36558) 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff1614640 1 -- 10.20.193.28:0/3863820677 learned_addr learned my addr 10.20.193.28:0/3863820677 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff0e13640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefec10fc20 0x7fefec175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff1e15640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec115420 0x7fefec0f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff1614640 1 -- 10.20.193.28:0/3863820677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefec10fc20 msgr2=0x7fefec175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.602+0000 7feff1614640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefec10fc20 0x7fefec175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7feff1614640 1 -- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec115420 msgr2=0x7fefec0f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7feff1614640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec115420 0x7fefec0f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7feff1614640 1 -- 10.20.193.28:0/3863820677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe0009570 con 0x7fefec10f230 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7feff1e15640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec115420 0x7fefec0f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7feff1614640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefec10f230 0x7fefec0f5580 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefdc009480 tx=0x7fefdc00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7fefda7fc640 1 -- 10.20.193.28:0/3863820677 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefdc00cd40 con 0x7fefec10f230 2026-02-20T13:32:33.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7fefda7fc640 1 -- 10.20.193.28:0/3863820677 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefdc004d30 con 0x7fefec10f230 2026-02-20T13:32:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7fefda7fc640 1 -- 10.20.193.28:0/3863820677 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefdc0106b0 con 0x7fefec10f230 2026-02-20T13:32:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7feff389f640 1 -- 10.20.193.28:0/3863820677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefec0fb4a0 con 0x7fefec10f230 2026-02-20T13:32:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.603+0000 7feff389f640 1 -- 10.20.193.28:0/3863820677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec0fb920 con 0x7fefec10f230 2026-02-20T13:32:33.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.604+0000 7fefbbfff640 1 -- 10.20.193.28:0/3863820677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefec110510 con 0x7fefec10f230 2026-02-20T13:32:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.606+0000 7fefda7fc640 1 -- 10.20.193.28:0/3863820677 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fefdc01f060 con 0x7fefec10f230 2026-02-20T13:32:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.608+0000 7fefda7fc640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefc80b5750 0x7fefc80d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:33.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.608+0000 7fefda7fc640 1 -- 10.20.193.28:0/3863820677 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fefdc014070 con 0x7fefec10f230 2026-02-20T13:32:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.608+0000 7feff0e13640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefc80b5750 0x7fefc80d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.608+0000 7fefda7fc640 1 -- 10.20.193.28:0/3863820677 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fefdc120690 con 0x7fefec10f230 2026-02-20T13:32:33.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.608+0000 7feff0e13640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefc80b5750 0x7fefc80d5c00 secure :-1 s=READY pgs=636 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe00023d0 tx=0x7fefe0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.750+0000 7fefbbfff640 1 -- 10.20.193.28:0/3863820677 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefec10f600 con 0x7fefec10f230 2026-02-20T13:32:33.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.751+0000 7fefda7fc640 1 -- 10.20.193.28:0/3863820677 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7fefdc0a9900 con 0x7fefec10f230 2026-02-20T13:32:33.753 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:32:33.753 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:32:33.753 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 -- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefc80b5750 msgr2=0x7fefc80d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefc80b5750 0x7fefc80d5c00 secure :-1 s=READY pgs=636 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe00023d0 tx=0x7fefe0031040 comp rx=0 tx=0).stop 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 -- 10.20.193.28:0/3863820677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefec10f230 msgr2=0x7fefec0f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefec10f230 0x7fefec0f5580 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefdc009480 tx=0x7fefdc00ee60 comp rx=0 tx=0).stop 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 -- 10.20.193.28:0/3863820677 shutdown_connections 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fefc80b5750 0x7fefc80d5c00 unknown :-1 s=CLOSED pgs=636 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefec115420 0x7fefec0f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fefec10fc20 0x7fefec175cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 --2- 10.20.193.28:0/3863820677 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefec10f230 0x7fefec0f5580 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 -- 10.20.193.28:0/3863820677 >> 10.20.193.28:0/3863820677 conn(0x7fefec05f830 msgr2=0x7fefec10d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 -- 10.20.193.28:0/3863820677 shutdown_connections 2026-02-20T13:32:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:33.752+0000 7fefbbfff640 1 -- 10.20.193.28:0/3863820677 wait complete. 2026-02-20T13:32:33.856 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:32:34.042 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 -- 10.20.193.28:0/4145021207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe344062ae0 msgr2=0x7fe344060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 --2- 10.20.193.28:0/4145021207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe344062ae0 0x7fe344060fb0 secure :-1 s=READY pgs=1537 gs=2 cs=0 l=1 c_cookie=9029021315243587555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe330009890 tx=0x7fe33002f120 comp rx=0 tx=0).stop 2026-02-20T13:32:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 -- 10.20.193.28:0/4145021207 shutdown_connections 2026-02-20T13:32:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 --2- 10.20.193.28:0/4145021207 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe344159ed0 0x7fe34417a2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 --2- 10.20.193.28:0/4145021207 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3440614f0 0x7fe344061920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 --2- 10.20.193.28:0/4145021207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe344062ae0 0x7fe344060fb0 unknown :-1 s=CLOSED pgs=1537 gs=2 cs=0 l=1 c_cookie=9029021315243587555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 -- 10.20.193.28:0/4145021207 >> 10.20.193.28:0/4145021207 conn(0x7fe3440eac10 msgr2=0x7fe34410b020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 -- 10.20.193.28:0/4145021207 shutdown_connections 2026-02-20T13:32:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.210+0000 7fe34a01b640 1 -- 10.20.193.28:0/4145021207 wait complete. 2026-02-20T13:32:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe34a01b640 1 Processor -- start 2026-02-20T13:32:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe34a01b640 1 -- start start 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe34a01b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3440614f0 0x7fe3440f2680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe34a01b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe344062ae0 0x7fe3440f2bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe34a01b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe344159ed0 0x7fe3440f7f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe34a01b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440f85b0 con 0x7fe3440614f0 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe34a01b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440f8720 con 0x7fe344159ed0 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe34a01b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440f88e0 con 0x7fe344062ae0 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe3437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3440614f0 0x7fe3440f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe3437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3440614f0 0x7fe3440f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56524/0 (socket says 10.20.193.28:56524) 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe3437fe640 1 -- 10.20.193.28:0/663190142 learned_addr learned my addr 10.20.193.28:0/663190142 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe342ffd640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe344062ae0 0x7fe3440f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.211+0000 7fe343fff640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe344159ed0 0x7fe3440f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe3437fe640 1 -- 10.20.193.28:0/663190142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe344062ae0 msgr2=0x7fe3440f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe3437fe640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe344062ae0 0x7fe3440f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe3437fe640 1 -- 10.20.193.28:0/663190142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe344159ed0 msgr2=0x7fe3440f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe3437fe640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe344159ed0 0x7fe3440f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe3437fe640 1 -- 10.20.193.28:0/663190142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe334009570 con 0x7fe3440614f0 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe3437fe640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3440614f0 0x7fe3440f2680 secure :-1 s=READY pgs=1538 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3300023b0 tx=0x7fe3300028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe340ff9640 1 -- 10.20.193.28:0/663190142 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe33003d070 con 0x7fe3440614f0 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe340ff9640 1 -- 10.20.193.28:0/663190142 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3300044f0 con 0x7fe3440614f0 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe340ff9640 1 -- 10.20.193.28:0/663190142 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe330041a00 con 0x7fe3440614f0 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe34a01b640 1 -- 10.20.193.28:0/663190142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3300094b0 con 0x7fe3440614f0 2026-02-20T13:32:34.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.212+0000 7fe34a01b640 1 -- 10.20.193.28:0/663190142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3440f8df0 con 0x7fe3440614f0 2026-02-20T13:32:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.215+0000 7fe340ff9640 1 -- 10.20.193.28:0/663190142 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe330038c20 con 0x7fe3440614f0 2026-02-20T13:32:34.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.217+0000 7fe340ff9640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3180b5760 0x7fe3180d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.217+0000 7fe340ff9640 1 -- 10.20.193.28:0/663190142 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe33010b0b0 con 0x7fe3440614f0 2026-02-20T13:32:34.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.217+0000 7fe342ffd640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3180b5760 0x7fe3180d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.217+0000 7fe34c015e00 1 Processor -- start 2026-02-20T13:32:34.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.217+0000 7fe34c015e00 1 -- start start 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.217+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9412ae730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.217+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c9412f35e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 0x55c941313f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe34c015e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9411c4780 con 0x55c9412ae360 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe34c015e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c9411c04b0 con 0x55c9412aec70 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe34c015e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c9411ba450 con 0x55c9412f3b20 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe342ffd640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3180b5760 0x7fe3180d5c10 secure :-1 s=READY pgs=637 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3440f9020 tx=0x7fe334009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9412ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe343fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 0x55c941313f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe342ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c9412f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9412ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56540/0 (socket says 10.20.193.28:56540) 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 -- 10.20.193.28:0/887871385 learned_addr learned my addr 10.20.193.28:0/887871385 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 -- 10.20.193.28:0/887871385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 msgr2=0x55c941313f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 --2- 10.20.193.28:0/887871385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 0x55c941313f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 -- 10.20.193.28:0/887871385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 msgr2=0x55c9412f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 --2- 10.20.193.28:0/887871385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c9412f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 -- 10.20.193.28:0/887871385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c941165d10 con 0x55c9412ae360 2026-02-20T13:32:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe3437fe640 1 --2- 10.20.193.28:0/887871385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9412ae730 secure :-1 s=READY pgs=1539 gs=1 cs=0 l=1 c_cookie=10993538801757475421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe330108bc0 tx=0x7fe330041410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9890e54b3f3a525d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe307fff640 1 -- 10.20.193.28:0/887871385 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3300d0d00 con 0x55c9412ae360 2026-02-20T13:32:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe307fff640 1 -- 10.20.193.28:0/887871385 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe330005b60 con 0x55c9412ae360 2026-02-20T13:32:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.218+0000 7fe307fff640 1 -- 10.20.193.28:0/887871385 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3300cf4e0 con 0x55c9412ae360 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 -- 10.20.193.28:0/887871385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 msgr2=0x55c9412ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 --2- 10.20.193.28:0/887871385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9412ae730 secure :-1 s=READY pgs=1539 gs=1 cs=0 l=1 c_cookie=10993538801757475421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe330108bc0 tx=0x7fe330041410 comp rx=0 tx=0).stop 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 -- 10.20.193.28:0/887871385 shutdown_connections 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 --2- 10.20.193.28:0/887871385 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 0x55c941313f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 --2- 10.20.193.28:0/887871385 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c9412f35e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 --2- 10.20.193.28:0/887871385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9412ae730 unknown :-1 s=CLOSED pgs=1539 gs=1 cs=0 l=1 c_cookie=10993538801757475421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 -- 10.20.193.28:0/887871385 >> 10.20.193.28:0/887871385 conn(0x55c94128c860 msgr2=0x55c9412acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 -- 10.20.193.28:0/887871385 shutdown_connections 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.219+0000 7fe34c015e00 1 -- 10.20.193.28:0/887871385 wait complete. 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.220+0000 7fe34c015e00 1 -- start start 2026-02-20T13:32:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.220+0000 7fe34c015e00 1 Processor -- start 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.220+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412ae360 0x55c94130b700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.220+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c94130bc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.220+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412f3b20 0x55c941310c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.220+0000 7fe34c015e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c941311170 con 0x55c9412f3b20 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.220+0000 7fe34c015e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c9413112e0 con 0x55c9412aec70 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.220+0000 7fe34c015e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c9413114a0 con 0x55c9412ae360 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412ae360 0x55c94130b700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412ae360 0x55c94130b700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36588/0 (socket says 10.20.193.28:36588) 2026-02-20T13:32:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe343fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412f3b20 0x55c941310c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 -- 10.20.193.28:0/2903829289 learned_addr learned my addr 10.20.193.28:0/2903829289 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe342ffd640 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c94130bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 -- 10.20.193.28:0/2903829289 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 msgr2=0x55c94130bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c94130bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 -- 10.20.193.28:0/2903829289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412f3b20 msgr2=0x55c941310c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412f3b20 0x55c941310c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 -- 10.20.193.28:0/2903829289 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94113e3c0 con 0x55c9412ae360 2026-02-20T13:32:34.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe343fff640 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412f3b20 0x55c941310c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:34.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3437fe640 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412ae360 0x55c94130b700 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=10763718236071872534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe330002b60 tx=0x7fe330049000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=956068b503754816 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.221+0000 7fe3057fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:32:34.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe3057fa640 1 -- 10.20.193.28:0/2903829289 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3300cf4e0 con 0x55c9412ae360 2026-02-20T13:32:34.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe3057fa640 1 -- 10.20.193.28:0/2903829289 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3300d0d00 con 0x55c9412ae360 2026-02-20T13:32:34.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe3057fa640 1 -- 10.20.193.28:0/2903829289 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe330041de0 con 0x55c9412ae360 2026-02-20T13:32:34.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3440f8df0 con 0x55c9412ae360 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe3057fa640 1 -- 10.20.193.28:0/2903829289 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe3300d07f0 con 0x55c9412ae360 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe34c015e00 10 client.30649 _ll_register_callbacks cb 0x55c94113ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe3057fa640 10 client.30649 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c940e506f0 con 0x55c9412ae360 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe3057fa640 1 -- 10.20.193.28:0/2903829289 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3300d2e40 con 0x55c9412ae360 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe34c015e00 10 client.30649 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c9411500e0 con 0x55c9412ae360 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe3057fa640 1 -- 10.20.193.28:0/2903829289 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe3300ea050 con 0x55c9412ae360 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe34c015e00 10 client.30649 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.222+0000 7fe34c015e00 10 client.30649 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.223+0000 7fe34c015e00 20 client.30649 populate_metadata read hostname 'trial028' 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.223+0000 7fe34c015e00 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55c9412f0a40 0x55c9412f0ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.223+0000 7fe34c015e00 4 client.30649 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.223+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c94115cf80 con 0x55c9412f0a40 2026-02-20T13:32:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.223+0000 7fe342ffd640 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55c9412f0a40 0x55c9412f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.223+0000 7fe342ffd640 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55c9412f0a40 0x55c9412f0ee0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=8644380778197830425 s_cookie=7171033505012934204 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=77f7028493b24b19 server_cookie=6384a0faa2b8663c in_seq=0 out_seq=0 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.223+0000 7fe3057fa640 10 client.30649 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe3057fa640 1 -- 10.20.193.28:0/2903829289 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c94115cf80 con 0x55c9412f0a40 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe3057fa640 10 client.30649 handle_command_reply: tid=0 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 client.30649 shutdown 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412ae360 msgr2=0x55c94130b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412ae360 0x55c94130b700 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=10763718236071872534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe330002b60 tx=0x7fe330049000 comp rx=0 tx=0).stop 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 shutdown_connections 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55c9412f0a40 0x55c9412f0ee0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=8644380778197830425 s_cookie=7171033505012934204 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412f3b20 0x55c941310c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c94130bc40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 --2- 10.20.193.28:0/2903829289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412ae360 0x55c94130b700 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=10763718236071872534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe3057fa640 0 client.30649 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 >> 10.20.193.28:0/2903829289 conn(0x55c94128c860 msgr2=0x55c9412acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.224+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 shutdown_connections 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.225+0000 7fe34c015e00 1 -- 10.20.193.28:0/2903829289 wait complete. 2026-02-20T13:32:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.225+0000 7fe34c015e00 20 client.30649 trim_cache size 0 max 16384 2026-02-20T13:32:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe34c015e00 1 Processor -- start 2026-02-20T13:32:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe34c015e00 1 -- start start 2026-02-20T13:32:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9413088f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412aec70 0x55c941308e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412f3b20 0x55c9412ee780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe34c015e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9411b8080 con 0x55c9412ae360 2026-02-20T13:32:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe34c015e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c940e78700 con 0x55c9412f3b20 2026-02-20T13:32:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe34c015e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c9413115e0 con 0x55c9412aec70 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe343fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412f3b20 0x55c9412ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe343fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412f3b20 0x55c9412ee780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:39994/0 (socket says 10.20.193.28:39994) 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe343fff640 1 -- 10.20.193.28:0/4258337580 learned_addr learned my addr 10.20.193.28:0/4258337580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe342ffd640 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412aec70 0x55c941308e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.232+0000 7fe3437fe640 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9413088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe342ffd640 1 -- 10.20.193.28:0/4258337580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412f3b20 msgr2=0x55c9412ee780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe342ffd640 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412f3b20 0x55c9412ee780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe342ffd640 1 -- 10.20.193.28:0/4258337580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 msgr2=0x55c9413088f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe342ffd640 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9413088f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe342ffd640 1 -- 10.20.193.28:0/4258337580 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94114ab60 con 0x55c9412aec70 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe343fff640 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412f3b20 0x55c9412ee780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe342ffd640 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412aec70 0x55c941308e30 secure :-1 s=READY pgs=427 gs=3 cs=0 l=1 c_cookie=9119618419374950537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55c9412f1790 tx=0x7fe334014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e8f64a275f40889 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe3077fe640 1 -- 10.20.193.28:0/4258337580 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe334021070 con 0x55c9412aec70 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe3077fe640 1 -- 10.20.193.28:0/4258337580 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe334022040 con 0x55c9412aec70 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe3077fe640 1 -- 10.20.193.28:0/4258337580 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe33401b8a0 con 0x55c9412aec70 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe34c015e00 1 -- 10.20.193.28:0/4258337580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412aec70 msgr2=0x55c941308e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe34c015e00 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412aec70 0x55c941308e30 secure :-1 s=READY pgs=427 gs=3 cs=0 l=1 c_cookie=9119618419374950537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55c9412f1790 tx=0x7fe334014000 comp rx=0 tx=0).stop 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe34c015e00 1 -- 10.20.193.28:0/4258337580 shutdown_connections 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe34c015e00 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412f3b20 0x55c9412ee780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe34c015e00 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412aec70 0x55c941308e30 unknown :-1 s=CLOSED pgs=427 gs=3 cs=0 l=1 c_cookie=9119618419374950537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe34c015e00 1 --2- 10.20.193.28:0/4258337580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c9413088f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe34c015e00 1 -- 10.20.193.28:0/4258337580 >> 10.20.193.28:0/4258337580 conn(0x55c94128c860 msgr2=0x55c9412f5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.233+0000 7fe34c015e00 1 -- 10.20.193.28:0/4258337580 shutdown_connections 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.234+0000 7fe34c015e00 1 -- 10.20.193.28:0/4258337580 wait complete. 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.234+0000 7fe34c015e00 1 -- start start 2026-02-20T13:32:34.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.234+0000 7fe34c015e00 1 Processor -- start 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c941292430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c941292970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe34c015e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 0x55c9412ee480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe34c015e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c94128c5d0 con 0x55c9412ae360 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe34c015e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55c9412892e0 con 0x55c9412aec70 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe34c015e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55c9412eeaf0 con 0x55c9412f3b20 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c941292430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c941292430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56576/0 (socket says 10.20.193.28:56576) 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 -- 10.20.193.28:0/435690606 learned_addr learned my addr 10.20.193.28:0/435690606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe343fff640 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 0x55c9412ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe342ffd640 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c941292970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 -- 10.20.193.28:0/435690606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 msgr2=0x55c9412ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 0x55c9412ee480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 -- 10.20.193.28:0/435690606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 msgr2=0x55c941292970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c941292970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 -- 10.20.193.28:0/435690606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3340114c0 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe342ffd640 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c941292970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3437fe640 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c941292430 secure :-1 s=READY pgs=1540 gs=1 cs=0 l=1 c_cookie=10342239323780569237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe330002940 tx=0x7fe33002f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8703de94045895 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3057fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3057fa640 1 -- 10.20.193.28:0/435690606 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3300d0d00 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3057fa640 1 -- 10.20.193.28:0/435690606 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c940e506f0 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe338004870 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.235+0000 7fe3057fa640 1 -- 10.20.193.28:0/435690606 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3300cf740 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 10 client.20880 _ll_register_callbacks cb 0x55c94113ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe330005b60 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe3057fa640 1 -- 10.20.193.28:0/435690606 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe3300d1a30 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe3057fa640 1 -- 10.20.193.28:0/435690606 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3300d1bf0 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 10 client.20880 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c94113e6f0 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe3057fa640 1 -- 10.20.193.28:0/435690606 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe3300ea020 con 0x55c9412ae360 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 10 client.20880 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:34.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 10 client.20880 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 20 client.20880 populate_metadata read hostname 'trial028' 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55c9413a0c40 0x55c9413c1020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 4 client.20880 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c940e4df40 con 0x55c9413a0c40 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.236+0000 7fe342ffd640 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55c9413a0c40 0x55c9413c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe342ffd640 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55c9413a0c40 0x55c9413c1020 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=10430146786674420209 s_cookie=17844309750911163945 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=90bf533dbee929f1 server_cookie=f7a3b92cdd195e29 in_seq=0 out_seq=0 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe3057fa640 10 client.20880 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe3057fa640 1 -- 10.20.193.28:0/435690606 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c940e4df40 con 0x55c9413a0c40 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe3057fa640 10 client.20880 handle_command_reply: tid=0 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 client.20880 shutdown 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 msgr2=0x55c941292430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c941292430 secure :-1 s=READY pgs=1540 gs=1 cs=0 l=1 c_cookie=10342239323780569237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe330002940 tx=0x7fe33002f120 comp rx=0 tx=0).stop 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 shutdown_connections 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55c9413a0c40 0x55c9413c1020 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=10430146786674420209 s_cookie=17844309750911163945 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55c9412f3b20 0x55c9412ee480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55c9412aec70 0x55c941292970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 --2- 10.20.193.28:0/435690606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9412ae360 0x55c941292430 unknown :-1 s=CLOSED pgs=1540 gs=1 cs=0 l=1 c_cookie=10342239323780569237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 >> 10.20.193.28:0/435690606 conn(0x55c94128c860 msgr2=0x55c94130fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe3057fa640 0 client.20880 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 shutdown_connections 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.237+0000 7fe34c015e00 1 -- 10.20.193.28:0/435690606 wait complete. 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34c015e00 20 client.20880 trim_cache size 0 max 16384 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 -- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3180b5760 msgr2=0x7fe3180d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3180b5760 0x7fe3180d5c10 secure :-1 s=READY pgs=637 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3440f9020 tx=0x7fe334009310 comp rx=0 tx=0).stop 2026-02-20T13:32:34.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 -- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3440614f0 msgr2=0x7fe3440f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3440614f0 0x7fe3440f2680 secure :-1 s=READY pgs=1538 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3300023b0 tx=0x7fe3300028d0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 -- 10.20.193.28:0/663190142 shutdown_connections 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3180b5760 0x7fe3180d5c10 unknown :-1 s=CLOSED pgs=637 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe344159ed0 0x7fe3440f7f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe344062ae0 0x7fe3440f2bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 --2- 10.20.193.28:0/663190142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3440614f0 0x7fe3440f2680 unknown :-1 s=CLOSED pgs=1538 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 -- 10.20.193.28:0/663190142 >> 10.20.193.28:0/663190142 conn(0x7fe3440eac10 msgr2=0x7fe34410f420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 -- 10.20.193.28:0/663190142 shutdown_connections 2026-02-20T13:32:34.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.238+0000 7fe34a01b640 1 -- 10.20.193.28:0/663190142 wait complete. 2026-02-20T13:32:34.385 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:32:34.570 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:34.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 -- 10.20.193.28:0/3264429959 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 msgr2=0x7fc3dc10bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 --2- 10.20.193.28:0/3264429959 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 0x7fc3dc10bcf0 secure :-1 s=READY pgs=531 gs=2 cs=0 l=1 c_cookie=17144289238658926233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3cc009890 tx=0x7fc3cc02f0e0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 -- 10.20.193.28:0/3264429959 shutdown_connections 2026-02-20T13:32:34.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 --2- 10.20.193.28:0/3264429959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3dc10c230 0x7fc3dc155110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 --2- 10.20.193.28:0/3264429959 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc3dc155650 0x7fc3dc175a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 --2- 10.20.193.28:0/3264429959 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 0x7fc3dc10bcf0 unknown :-1 s=CLOSED pgs=531 gs=2 cs=0 l=1 c_cookie=17144289238658926233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 -- 10.20.193.28:0/3264429959 >> 10.20.193.28:0/3264429959 conn(0x7fc3dc0e95a0 msgr2=0x7fc3dc1099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 -- 10.20.193.28:0/3264429959 shutdown_connections 2026-02-20T13:32:34.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 -- 10.20.193.28:0/3264429959 wait complete. 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.748+0000 7fc3e227d640 1 Processor -- start 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e227d640 1 -- start start 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e227d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 0x7fc3dc160d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e227d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3dc10c230 0x7fc3dc1612c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e227d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc3dc155650 0x7fc3dc166690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e227d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc166cb0 con 0x7fc3dc10c230 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e227d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc166e20 con 0x7fc3dc10b920 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e227d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc166fe0 con 0x7fc3dc155650 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 0x7fc3dc160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 0x7fc3dc160d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40034/0 (socket says 10.20.193.28:40034) 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e127b640 1 -- 10.20.193.28:0/1426094191 learned_addr learned my addr 10.20.193.28:0/1426094191 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3dc10c230 0x7fc3dc1612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e1a7c640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc3dc155650 0x7fc3dc166690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e127b640 1 -- 10.20.193.28:0/1426094191 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc3dc155650 msgr2=0x7fc3dc166690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e127b640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc3dc155650 0x7fc3dc166690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e127b640 1 -- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3dc10c230 msgr2=0x7fc3dc1612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e127b640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3dc10c230 0x7fc3dc1612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e127b640 1 -- 10.20.193.28:0/1426094191 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d0009570 con 0x7fc3dc10b920 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e1a7c640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc3dc155650 0x7fc3dc166690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.749+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3dc10c230 0x7fc3dc1612c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:34.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.750+0000 7fc3e127b640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 0x7fc3dc160d80 secure :-1 s=READY pgs=532 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3cc0023b0 tx=0x7fc3cc0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.750+0000 7fc3ca7fc640 1 -- 10.20.193.28:0/1426094191 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3cc03d070 con 0x7fc3dc10b920 2026-02-20T13:32:34.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.750+0000 7fc3ca7fc640 1 -- 10.20.193.28:0/1426094191 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc3cc02fcb0 con 0x7fc3dc10b920 2026-02-20T13:32:34.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.750+0000 7fc3ca7fc640 1 -- 10.20.193.28:0/1426094191 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3cc041960 con 0x7fc3dc10b920 2026-02-20T13:32:34.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.750+0000 7fc3e227d640 1 -- 10.20.193.28:0/1426094191 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc0094b0 con 0x7fc3dc10b920 2026-02-20T13:32:34.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.750+0000 7fc3e227d640 1 -- 10.20.193.28:0/1426094191 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc1520e0 con 0x7fc3dc10b920 2026-02-20T13:32:34.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.753+0000 7fc3ca7fc640 1 -- 10.20.193.28:0/1426094191 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fc3cc0386b0 con 0x7fc3dc10b920 2026-02-20T13:32:34.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.754+0000 7fc3ca7fc640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3b80b5760 0x7fc3b80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.755+0000 7fc3ca7fc640 1 -- 10.20.193.28:0/1426094191 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc3cc10b3e0 con 0x7fc3dc10b920 2026-02-20T13:32:34.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.755+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3b80b5760 0x7fc3b80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.755+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3b80b5760 0x7fc3b80d5c10 secure :-1 s=READY pgs=638 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3dc167720 tx=0x7fc3d0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e5500e00 1 Processor -- start 2026-02-20T13:32:34.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e5500e00 1 -- start start 2026-02-20T13:32:34.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efe730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f435e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f63f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560460e14780 con 0x560460efec70 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560460e104b0 con 0x560460f43b20 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560460e0a450 con 0x560460efe360 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efe730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e0a7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e1a7c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f63f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e1a7c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f63f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40044/0 (socket says 10.20.193.28:40044) 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.756+0000 7fc3e1a7c640 1 -- 10.20.193.28:0/1690590940 learned_addr learned my addr 10.20.193.28:0/1690590940 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e0a7a640 1 -- 10.20.193.28:0/1690590940 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 msgr2=0x560460efe730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1690590940 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efe730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e0a7a640 1 -- 10.20.193.28:0/1690590940 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 msgr2=0x560460f63f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1690590940 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f63f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e0a7a640 1 -- 10.20.193.28:0/1690590940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560460db5d10 con 0x560460efec70 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1690590940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f435e0 secure :-1 s=READY pgs=1541 gs=1 cs=0 l=1 c_cookie=5659831053772920440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3d0009fd0 tx=0x7fc3d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8bc25b38dc1678 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3a9ce5640 1 -- 10.20.193.28:0/1690590940 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3d001c950 con 0x560460efec70 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3a9ce5640 1 -- 10.20.193.28:0/1690590940 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc3d001a460 con 0x560460efec70 2026-02-20T13:32:34.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3a9ce5640 1 -- 10.20.193.28:0/1690590940 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3d000e640 con 0x560460efec70 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1690590940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 msgr2=0x560460f435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/1690590940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f435e0 secure :-1 s=READY pgs=1541 gs=1 cs=0 l=1 c_cookie=5659831053772920440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3d0009fd0 tx=0x7fc3d0014000 comp rx=0 tx=0).stop 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1690590940 shutdown_connections 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/1690590940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f435e0 unknown :-1 s=CLOSED pgs=1541 gs=1 cs=0 l=1 c_cookie=5659831053772920440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/1690590940 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f63f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/1690590940 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efe730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1690590940 >> 10.20.193.28:0/1690590940 conn(0x560460edc860 msgr2=0x560460efcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1690590940 shutdown_connections 2026-02-20T13:32:34.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.757+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1690590940 wait complete. 2026-02-20T13:32:34.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.759+0000 7fc3e5500e00 1 -- start start 2026-02-20T13:32:34.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.759+0000 7fc3e5500e00 1 Processor -- start 2026-02-20T13:32:34.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460efe360 0x560460f5b750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efec70 0x560460f5bc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460f43b20 0x560460f5da20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560460f5df90 con 0x560460f43b20 2026-02-20T13:32:34.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560460f5e100 con 0x560460efe360 2026-02-20T13:32:34.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560460f5e2c0 con 0x560460efec70 2026-02-20T13:32:34.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460efe360 0x560460f5b750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460efe360 0x560460f5b750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40046/0 (socket says 10.20.193.28:40046) 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e127b640 1 -- 10.20.193.28:0/2401436889 learned_addr learned my addr 10.20.193.28:0/2401436889 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efec70 0x560460f5bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e1a7c640 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460f43b20 0x560460f5da20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e127b640 1 -- 10.20.193.28:0/2401436889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efec70 msgr2=0x560460f5bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e127b640 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efec70 0x560460f5bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e127b640 1 -- 10.20.193.28:0/2401436889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460f43b20 msgr2=0x560460f5da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e127b640 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460f43b20 0x560460f5da20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e127b640 1 -- 10.20.193.28:0/2401436889 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560460d8e3c0 con 0x560460efe360 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.760+0000 7fc3e1a7c640 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460f43b20 0x560460f5da20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc3e127b640 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460efe360 0x560460f5b750 secure :-1 s=READY pgs=533 gs=1 cs=0 l=1 c_cookie=14645268690552684578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3cc0d1720 tx=0x7fc3cc005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb3e7247b48b0022 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc396ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc396ffd640 1 -- 10.20.193.28:0/2401436889 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3cc0d1120 con 0x560460efe360 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc396ffd640 1 -- 10.20.193.28:0/2401436889 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc3cc0d0f40 con 0x560460efe360 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d0011440 con 0x560460efe360 2026-02-20T13:32:34.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc396ffd640 1 -- 10.20.193.28:0/2401436889 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3cc0cf720 con 0x560460efe360 2026-02-20T13:32:34.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc396ffd640 1 -- 10.20.193.28:0/2401436889 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc3cc0cf8b0 con 0x560460efe360 2026-02-20T13:32:34.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc396ffd640 10 client.30815 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:34.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc3e5500e00 10 client.30815 _ll_register_callbacks cb 0x560460d8ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:34.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560460aa06f0 con 0x560460efe360 2026-02-20T13:32:34.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc396ffd640 1 -- 10.20.193.28:0/2401436889 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc3cc005b40 con 0x560460efe360 2026-02-20T13:32:34.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc3e5500e00 10 client.30815 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.761+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x560460da00e0 con 0x560460efe360 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.762+0000 7fc396ffd640 1 -- 10.20.193.28:0/2401436889 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc3cc0d3130 con 0x560460efe360 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.762+0000 7fc3e5500e00 10 client.30815 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.762+0000 7fc3e5500e00 10 client.30815 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.762+0000 7fc3e5500e00 20 client.30815 populate_metadata read hostname 'trial028' 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.762+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560460f29660 0x560460f29b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.762+0000 7fc3e5500e00 4 client.30815 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.762+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560460dacf80 con 0x560460f29660 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.762+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560460f29660 0x560460f29b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.763+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560460f29660 0x560460f29b00 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=12399485048777985413 s_cookie=11672931940792254501 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ac13d1f4e22dcd85 server_cookie=a1fe95c11a3bc025 in_seq=0 out_seq=0 2026-02-20T13:32:34.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.763+0000 7fc396ffd640 10 client.30815 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc396ffd640 1 -- 10.20.193.28:0/2401436889 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560460dacf80 con 0x560460f29660 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc396ffd640 10 client.30815 handle_command_reply: tid=0 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 client.30815 shutdown 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460efe360 msgr2=0x560460f5b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460efe360 0x560460f5b750 secure :-1 s=READY pgs=533 gs=1 cs=0 l=1 c_cookie=14645268690552684578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3cc0d1720 tx=0x7fc3cc005f90 comp rx=0 tx=0).stop 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 shutdown_connections 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560460f29660 0x560460f29b00 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=12399485048777985413 s_cookie=11672931940792254501 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460f43b20 0x560460f5da20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efec70 0x560460f5bc90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2401436889 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460efe360 0x560460f5b750 unknown :-1 s=CLOSED pgs=533 gs=1 cs=0 l=1 c_cookie=14645268690552684578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc396ffd640 0 client.30815 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:32:34.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 >> 10.20.193.28:0/2401436889 conn(0x560460edc860 msgr2=0x560460efcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 shutdown_connections 2026-02-20T13:32:34.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2401436889 wait complete. 2026-02-20T13:32:34.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.764+0000 7fc3e5500e00 20 client.30815 trim_cache size 0 max 16384 2026-02-20T13:32:34.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.771+0000 7fc3e5500e00 1 Processor -- start 2026-02-20T13:32:34.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.771+0000 7fc3e5500e00 1 -- start start 2026-02-20T13:32:34.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.771+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efdd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.771+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f434d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.771+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f5a980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.771+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560460e08080 con 0x560460efec70 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.771+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560460ac8700 con 0x560460f43b20 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.771+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560460edc2a0 con 0x560460efe360 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e1a7c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f5a980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56620/0 (socket says 10.20.193.28:56620) 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 -- 10.20.193.28:0/1532149570 learned_addr learned my addr 10.20.193.28:0/1532149570 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36656/0 (socket says 10.20.193.28:36656) 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 -- 10.20.193.28:0/1532149570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 msgr2=0x560460efdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1532149570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 -- 10.20.193.28:0/1532149570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 msgr2=0x560460f5a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1532149570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f5a980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 -- 10.20.193.28:0/1532149570 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560460d9ab60 con 0x560460efec70 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3e0a7a640 1 --2- 10.20.193.28:0/1532149570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f434d0 secure :-1 s=READY pgs=1542 gs=2 cs=0 l=1 c_cookie=15896105794539524806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3d0009fd0 tx=0x7fc3d001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9a4fffbb8e92c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3a94e4640 1 -- 10.20.193.28:0/1532149570 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3d001a7f0 con 0x560460efec70 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3a94e4640 1 -- 10.20.193.28:0/1532149570 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc3d001ce30 con 0x560460efec70 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.772+0000 7fc3a94e4640 1 -- 10.20.193.28:0/1532149570 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3d0004720 con 0x560460efec70 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1532149570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 msgr2=0x560460f434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/1532149570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f434d0 secure :-1 s=READY pgs=1542 gs=2 cs=0 l=1 c_cookie=15896105794539524806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3d0009fd0 tx=0x7fc3d001ad70 comp rx=0 tx=0).stop 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1532149570 shutdown_connections 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/1532149570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f434d0 unknown :-1 s=CLOSED pgs=1542 gs=2 cs=0 l=1 c_cookie=15896105794539524806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/1532149570 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f5a980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/1532149570 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460efdd40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1532149570 >> 10.20.193.28:0/1532149570 conn(0x560460edc860 msgr2=0x560460f42dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1532149570 shutdown_connections 2026-02-20T13:32:34.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 -- 10.20.193.28:0/1532149570 wait complete. 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 -- start start 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.773+0000 7fc3e5500e00 1 Processor -- start 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460f1e890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f1edd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e5500e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f57dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560460f48f20 con 0x560460efec70 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560460f58430 con 0x560460f43b20 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e5500e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560460f585f0 con 0x560460efe360 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e0a7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f1edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460f1e890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e127b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460f1e890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36668/0 (socket says 10.20.193.28:36668) 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e0a7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f1edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56628/0 (socket says 10.20.193.28:56628) 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e127b640 1 -- 10.20.193.28:0/2628553591 learned_addr learned my addr 10.20.193.28:0/2628553591 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e1a7c640 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f57dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e1a7c640 1 -- 10.20.193.28:0/2628553591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 msgr2=0x560460f1e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e1a7c640 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460f1e890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e1a7c640 1 -- 10.20.193.28:0/2628553591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 msgr2=0x560460f1edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e1a7c640 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f1edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e1a7c640 1 -- 10.20.193.28:0/2628553591 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560460d8e6f0 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc3e1a7c640 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f57dc0 secure :-1 s=READY pgs=534 gs=3 cs=0 l=1 c_cookie=2670022566745875635 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560460ebe870 tx=0x7fc3d800ab30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=250dd360c92a24b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.774+0000 7fc396ffd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc396ffd640 1 -- 10.20.193.28:0/2628553591 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3d8005b50 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560460db5d10 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 10 client.30821 _ll_register_callbacks cb 0x560460d8ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d001a460 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc396ffd640 1 -- 10.20.193.28:0/2628553591 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc3d8019040 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc396ffd640 1 -- 10.20.193.28:0/2628553591 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3d80064d0 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc396ffd640 1 -- 10.20.193.28:0/2628553591 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fc3d8006660 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc396ffd640 1 -- 10.20.193.28:0/2628553591 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc3d8026400 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 10 client.30821 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x560460da0340 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc396ffd640 1 -- 10.20.193.28:0/2628553591 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc3d80138a0 con 0x560460f43b20 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 10 client.30821 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 10 client.30821 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 20 client.30821 populate_metadata read hostname 'trial028' 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560460f3b0b0 0x560460f3b550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 4 client.30821 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.775+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560460a9df40 con 0x560460f3b0b0 2026-02-20T13:32:34.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.776+0000 7fc3e127b640 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560460f3b0b0 0x560460f3b550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.776+0000 7fc3e127b640 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560460f3b0b0 0x560460f3b550 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=15375916686762455228 s_cookie=551608542656709369 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d5623ac2f27a30bc server_cookie=7a7b50c081fc2f9 in_seq=0 out_seq=0 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.776+0000 7fc396ffd640 10 client.30821 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.776+0000 7fc396ffd640 1 -- 10.20.193.28:0/2628553591 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560460a9df40 con 0x560460f3b0b0 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.776+0000 7fc396ffd640 10 client.30821 handle_command_reply: tid=0 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.776+0000 7fc3e5500e00 1 client.30821 shutdown 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 msgr2=0x560460f57dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f57dc0 secure :-1 s=READY pgs=534 gs=3 cs=0 l=1 c_cookie=2670022566745875635 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560460ebe870 tx=0x7fc3d800ab30 comp rx=0 tx=0).stop 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 shutdown_connections 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x560460f3b0b0 0x560460f3b550 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=15375916686762455228 s_cookie=551608542656709369 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560460efec70 0x560460f1edd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560460f43b20 0x560460f57dc0 unknown :-1 s=CLOSED pgs=534 gs=3 cs=0 l=1 c_cookie=2670022566745875635 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 --2- 10.20.193.28:0/2628553591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560460efe360 0x560460f1e890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc396ffd640 0 client.30821 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 >> 10.20.193.28:0/2628553591 conn(0x560460edc860 msgr2=0x560460f5fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 shutdown_connections 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 1 -- 10.20.193.28:0/2628553591 wait complete. 2026-02-20T13:32:34.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.777+0000 7fc3e5500e00 20 client.30821 trim_cache size 0 max 16384 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 -- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3b80b5760 msgr2=0x7fc3b80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3b80b5760 0x7fc3b80d5c10 secure :-1 s=READY pgs=638 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3dc167720 tx=0x7fc3d0009310 comp rx=0 tx=0).stop 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 -- 10.20.193.28:0/1426094191 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 msgr2=0x7fc3dc160d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 0x7fc3dc160d80 secure :-1 s=READY pgs=532 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3cc0023b0 tx=0x7fc3cc0028d0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 -- 10.20.193.28:0/1426094191 shutdown_connections 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fc3b80b5760 0x7fc3b80d5c10 unknown :-1 s=CLOSED pgs=638 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3dc10c230 0x7fc3dc1612c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc3dc155650 0x7fc3dc166690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 --2- 10.20.193.28:0/1426094191 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fc3dc10b920 0x7fc3dc160d80 unknown :-1 s=CLOSED pgs=532 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 -- 10.20.193.28:0/1426094191 >> 10.20.193.28:0/1426094191 conn(0x7fc3dc0e95a0 msgr2=0x7fc3dc109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 -- 10.20.193.28:0/1426094191 shutdown_connections 2026-02-20T13:32:34.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:34.778+0000 7fc3e227d640 1 -- 10.20.193.28:0/1426094191 wait complete. 2026-02-20T13:32:34.873 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:34 trial028 ceph-mon[37442]: pgmap v638: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 17 op/s 2026-02-20T13:32:34.873 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:34 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3863820677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:32:34.874 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:32:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:34 trial127 ceph-mon[43817]: pgmap v638: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 17 op/s 2026-02-20T13:32:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:34 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3863820677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:32:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:34 trial034 ceph-mon[43332]: pgmap v638: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 17 op/s 2026-02-20T13:32:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:34 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3863820677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:32:35.058 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:35.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 -- 10.20.193.28:0/469128316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b4113420 msgr2=0x7f40b4173df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/469128316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b4113420 0x7f40b4173df0 secure :-1 s=READY pgs=535 gs=1 cs=0 l=1 c_cookie=4750148871828699717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40b000aa30 tx=0x7f40b0030270 comp rx=0 tx=0).stop 2026-02-20T13:32:35.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 -- 10.20.193.28:0/469128316 shutdown_connections 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/469128316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f40b410dc20 0x7f40b4112c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/469128316 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b4113420 0x7f40b4173df0 unknown :-1 s=CLOSED pgs=535 gs=1 cs=0 l=1 c_cookie=4750148871828699717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/469128316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40b410d230 0x7f40b410d600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 -- 10.20.193.28:0/469128316 >> 10.20.193.28:0/469128316 conn(0x7f40b40eab00 msgr2=0x7f40b410af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 -- 10.20.193.28:0/469128316 shutdown_connections 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.246+0000 7f40ba0ab640 1 -- 10.20.193.28:0/469128316 wait complete. 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.247+0000 7f40ba0ab640 1 Processor -- start 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.247+0000 7f40ba0ab640 1 -- start start 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.247+0000 7f40ba0ab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f40b410d230 0x7f40b40f5770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.247+0000 7f40ba0ab640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b410dc20 0x7f40b4173cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40ba0ab640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40b4113420 0x7f40b40f5e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40ba0ab640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f40b40fb030 con 0x7f40b410d230 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40ba0ab640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f40b40fb1a0 con 0x7f40b410dc20 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40ba0ab640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f40b40fb360 con 0x7f40b4113420 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b90a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f40b410d230 0x7f40b40f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b88a8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b410dc20 0x7f40b4173cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b90a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f40b410d230 0x7f40b40f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56638/0 (socket says 10.20.193.28:56638) 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b90a9640 1 -- 10.20.193.28:0/1254059050 learned_addr learned my addr 10.20.193.28:0/1254059050 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b98aa640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40b4113420 0x7f40b40f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b88a8640 1 -- 10.20.193.28:0/1254059050 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40b4113420 msgr2=0x7f40b40f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b88a8640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40b4113420 0x7f40b40f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b88a8640 1 -- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f40b410d230 msgr2=0x7f40b40f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b88a8640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f40b410d230 0x7f40b40f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b88a8640 1 -- 10.20.193.28:0/1254059050 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a80094b0 con 0x7f40b410dc20 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b90a9640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f40b410d230 0x7f40b40f5770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40b88a8640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b410dc20 0x7f40b4173cf0 secure :-1 s=READY pgs=536 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40a8004680 tx=0x7f40a8002b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40a27fc640 1 -- 10.20.193.28:0/1254059050 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40a800eaa0 con 0x7f40b410dc20 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40a27fc640 1 -- 10.20.193.28:0/1254059050 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40a800ec00 con 0x7f40b410dc20 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40ba0ab640 1 -- 10.20.193.28:0/1254059050 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b000a650 con 0x7f40b410dc20 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40a27fc640 1 -- 10.20.193.28:0/1254059050 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40a800f760 con 0x7f40b410dc20 2026-02-20T13:32:35.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.248+0000 7f40ba0ab640 1 -- 10.20.193.28:0/1254059050 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b40fb980 con 0x7f40b410dc20 2026-02-20T13:32:35.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.251+0000 7f40a27fc640 1 -- 10.20.193.28:0/1254059050 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f40a801f060 con 0x7f40b410dc20 2026-02-20T13:32:35.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.253+0000 7f40a27fc640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40900b56d0 0x7f40900d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.253+0000 7f40a27fc640 1 -- 10.20.193.28:0/1254059050 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f40a80e6de0 con 0x7f40b410dc20 2026-02-20T13:32:35.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.253+0000 7f40b90a9640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40900b56d0 0x7f40900d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40b90a9640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40900b56d0 0x7f40900d5b80 secure :-1 s=READY pgs=639 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40a400b2c0 tx=0x7f40a400b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40bd32ee00 1 Processor -- start 2026-02-20T13:32:35.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40bd32ee00 1 -- start start 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d78730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78c70 0x55cb13dbd5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13dddf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cb13c8e780 con 0x55cb13d78c70 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cb13c8a4b0 con 0x55cb13dbdb20 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cb13c84450 con 0x55cb13d78360 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.254+0000 7f40b98aa640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13dddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b98aa640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13dddf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40084/0 (socket says 10.20.193.28:40084) 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b98aa640 1 -- 10.20.193.28:0/2010156470 learned_addr learned my addr 10.20.193.28:0/2010156470 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b90a9640 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d78730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b88a8640 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78c70 0x55cb13dbd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b98aa640 1 -- 10.20.193.28:0/2010156470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 msgr2=0x55cb13d78730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b98aa640 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d78730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b98aa640 1 -- 10.20.193.28:0/2010156470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78c70 msgr2=0x55cb13dbd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b98aa640 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78c70 0x55cb13dbd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b98aa640 1 -- 10.20.193.28:0/2010156470 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb13c2fd10 con 0x55cb13dbdb20 2026-02-20T13:32:35.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b88a8640 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78c70 0x55cb13dbd5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:35.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f40b98aa640 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13dddf00 secure :-1 s=READY pgs=537 gs=2 cs=0 l=1 c_cookie=8450397105216467643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40b0006c10 tx=0x7f40b0006d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7545d765236ab2bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f4081ce5640 1 -- 10.20.193.28:0/2010156470 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40b003e050 con 0x55cb13dbdb20 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.255+0000 7f4081ce5640 1 -- 10.20.193.28:0/2010156470 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40b003f040 con 0x55cb13dbdb20 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f4081ce5640 1 -- 10.20.193.28:0/2010156470 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40b0039e70 con 0x55cb13dbdb20 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 -- 10.20.193.28:0/2010156470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 msgr2=0x55cb13dddf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13dddf00 secure :-1 s=READY pgs=537 gs=2 cs=0 l=1 c_cookie=8450397105216467643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40b0006c10 tx=0x7f40b0006d90 comp rx=0 tx=0).stop 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 -- 10.20.193.28:0/2010156470 shutdown_connections 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78c70 0x55cb13dbd5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13dddf00 unknown :-1 s=CLOSED pgs=537 gs=2 cs=0 l=1 c_cookie=8450397105216467643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/2010156470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d78730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 -- 10.20.193.28:0/2010156470 >> 10.20.193.28:0/2010156470 conn(0x55cb13d56860 msgr2=0x55cb13d76c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 -- 10.20.193.28:0/2010156470 shutdown_connections 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.256+0000 7f40bd32ee00 1 -- 10.20.193.28:0/2010156470 wait complete. 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.257+0000 7f40bd32ee00 1 -- start start 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.257+0000 7f40bd32ee00 1 Processor -- start 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78360 0x55cb13dd5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13dd5ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13ddaab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cb13ddaff0 con 0x55cb13dbdb20 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cb13ddb160 con 0x55cb13d78360 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cb13ddb320 con 0x55cb13d78c70 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b88a8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13dd5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b98aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13ddaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b88a8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13dd5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36706/0 (socket says 10.20.193.28:36706) 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b88a8640 1 -- 10.20.193.28:0/3528634992 learned_addr learned my addr 10.20.193.28:0/3528634992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b90a9640 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78360 0x55cb13dd5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b88a8640 1 -- 10.20.193.28:0/3528634992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78360 msgr2=0x55cb13dd5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b88a8640 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78360 0x55cb13dd5580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b88a8640 1 -- 10.20.193.28:0/3528634992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 msgr2=0x55cb13ddaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b88a8640 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13ddaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b88a8640 1 -- 10.20.193.28:0/3528634992 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb13c083c0 con 0x55cb13d78c70 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.258+0000 7f40b98aa640 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13ddaab0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f40b88a8640 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13dd5ac0 secure :-1 s=READY pgs=428 gs=2 cs=0 l=1 c_cookie=1004792531010406439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40a80aa3b0 tx=0x7f40a80acb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df1bd7bbbd74827 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f406effd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f406effd640 1 -- 10.20.193.28:0/3528634992 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40a80acf00 con 0x55cb13d78c70 2026-02-20T13:32:35.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f406effd640 1 -- 10.20.193.28:0/3528634992 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40a80b2e60 con 0x55cb13d78c70 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f406effd640 1 -- 10.20.193.28:0/3528634992 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40a80ae050 con 0x55cb13d78c70 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b4174660 con 0x55cb13d78c70 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f40bd32ee00 10 client.30682 _ll_register_callbacks cb 0x55cb13c05a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb1391a6f0 con 0x55cb13d78c70 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f406effd640 1 -- 10.20.193.28:0/3528634992 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f40a80ab120 con 0x55cb13d78c70 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f406effd640 1 -- 10.20.193.28:0/3528634992 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f40a80ab320 con 0x55cb13d78c70 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f40bd32ee00 10 client.30682 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.259+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55cb13c1a0e0 con 0x55cb13d78c70 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f406effd640 1 -- 10.20.193.28:0/3528634992 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f40a8016070 con 0x55cb13d78c70 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f40bd32ee00 10 client.30682 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f40bd32ee00 10 client.30682 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f40bd32ee00 20 client.30682 populate_metadata read hostname 'trial028' 2026-02-20T13:32:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55cb13ddd8f0 0x55cb13dddd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f40bd32ee00 4 client.30682 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb13c26f80 con 0x55cb13ddd8f0 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f40b90a9640 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55cb13ddd8f0 0x55cb13dddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f40b90a9640 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55cb13ddd8f0 0x55cb13dddd90 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=1233809680268983907 s_cookie=12793026614421889231 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=111f5f5e00defe63 server_cookie=b189f5eceabc20cf in_seq=0 out_seq=0 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.260+0000 7f406effd640 10 client.30682 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f406effd640 1 -- 10.20.193.28:0/3528634992 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cb13c26f80 con 0x55cb13ddd8f0 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f406effd640 10 client.30682 handle_command_reply: tid=0 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 client.30682 shutdown 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 msgr2=0x55cb13dd5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13dd5ac0 secure :-1 s=READY pgs=428 gs=2 cs=0 l=1 c_cookie=1004792531010406439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40a80aa3b0 tx=0x7f40a80acb20 comp rx=0 tx=0).stop 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 shutdown_connections 2026-02-20T13:32:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55cb13ddd8f0 0x55cb13dddd90 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=1233809680268983907 s_cookie=12793026614421889231 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13ddaab0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13dd5ac0 unknown :-1 s=CLOSED pgs=428 gs=2 cs=0 l=1 c_cookie=1004792531010406439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/3528634992 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78360 0x55cb13dd5580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f406effd640 0 client.30682 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:32:35.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 >> 10.20.193.28:0/3528634992 conn(0x55cb13d56860 msgr2=0x55cb13d76c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 shutdown_connections 2026-02-20T13:32:35.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 1 -- 10.20.193.28:0/3528634992 wait complete. 2026-02-20T13:32:35.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.261+0000 7f40bd32ee00 20 client.30682 trim_cache size 0 max 16384 2026-02-20T13:32:35.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.268+0000 7f40bd32ee00 1 Processor -- start 2026-02-20T13:32:35.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.268+0000 7f40bd32ee00 1 -- start start 2026-02-20T13:32:35.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.268+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78360 0x55cb13dd2e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.268+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13db7770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.268+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13db7cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.268+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cb13c82080 con 0x55cb13d78360 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.268+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cb13942700 con 0x55cb13dbdb20 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.268+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cb13dce410 con 0x55cb13d78c70 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13db7770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13db7770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36722/0 (socket says 10.20.193.28:36722) 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 -- 10.20.193.28:0/1609734942 learned_addr learned my addr 10.20.193.28:0/1609734942 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b90a9640 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78360 0x55cb13dd2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b98aa640 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13db7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 -- 10.20.193.28:0/1609734942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 msgr2=0x55cb13db7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13db7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 -- 10.20.193.28:0/1609734942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78360 msgr2=0x55cb13dd2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78360 0x55cb13dd2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 -- 10.20.193.28:0/1609734942 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb13c14b60 con 0x55cb13d78c70 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b90a9640 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78360 0x55cb13dd2e40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40b88a8640 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13db7770 secure :-1 s=READY pgs=429 gs=2 cs=0 l=1 c_cookie=9524340776475568921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40a80a9710 tx=0x7f40a8076000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=842d41795d982b19 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40814e4640 1 -- 10.20.193.28:0/1609734942 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40a80b7df0 con 0x55cb13d78c70 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40814e4640 1 -- 10.20.193.28:0/1609734942 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55cb1391a6f0 con 0x55cb13d78c70 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.269+0000 7f40814e4640 1 -- 10.20.193.28:0/1609734942 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40a80b2ed0 con 0x55cb13d78c70 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 -- 10.20.193.28:0/1609734942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 msgr2=0x55cb13db7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13db7770 secure :-1 s=READY pgs=429 gs=2 cs=0 l=1 c_cookie=9524340776475568921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40a80a9710 tx=0x7f40a8076000 comp rx=0 tx=0).stop 2026-02-20T13:32:35.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 -- 10.20.193.28:0/1609734942 shutdown_connections 2026-02-20T13:32:35.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13dbdb20 0x55cb13db7cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78c70 0x55cb13db7770 unknown :-1 s=CLOSED pgs=429 gs=2 cs=0 l=1 c_cookie=9524340776475568921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/1609734942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13d78360 0x55cb13dd2e40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 -- 10.20.193.28:0/1609734942 >> 10.20.193.28:0/1609734942 conn(0x55cb13d56860 msgr2=0x55cb13dd1720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 -- 10.20.193.28:0/1609734942 shutdown_connections 2026-02-20T13:32:35.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 -- 10.20.193.28:0/1609734942 wait complete. 2026-02-20T13:32:35.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.270+0000 7f40bd32ee00 1 -- start start 2026-02-20T13:32:35.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40bd32ee00 1 Processor -- start 2026-02-20T13:32:35.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d5c5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78c70 0x55cb13d57f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40bd32ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13d584a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cb13d562a0 con 0x55cb13dbdb20 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55cb13ce6ae0 con 0x55cb13d78c70 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40bd32ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55cb13d58a60 con 0x55cb13d78360 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40b88a8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78c70 0x55cb13d57f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40b98aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13d584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40b88a8640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78c70 0x55cb13d57f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40124/0 (socket says 10.20.193.28:40124) 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40b88a8640 1 -- 10.20.193.28:0/353117816 learned_addr learned my addr 10.20.193.28:0/353117816 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.271+0000 7f40b90a9640 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d5c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40b98aa640 1 -- 10.20.193.28:0/353117816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 msgr2=0x55cb13d5c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40b98aa640 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d5c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40b98aa640 1 -- 10.20.193.28:0/353117816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78c70 msgr2=0x55cb13d57f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40b98aa640 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78c70 0x55cb13d57f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40b98aa640 1 -- 10.20.193.28:0/353117816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb13c086f0 con 0x55cb13dbdb20 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40b90a9640 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d5c5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40b98aa640 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13d584a0 secure :-1 s=READY pgs=1543 gs=1 cs=0 l=1 c_cookie=5816571936370911742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40b000a230 tx=0x7f40b000a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b89d5bcde4e9fe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f406effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f406effd640 1 -- 10.20.193.28:0/353117816 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40b003e040 con 0x55cb13dbdb20 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f406effd640 1 -- 10.20.193.28:0/353117816 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40b0003e90 con 0x55cb13dbdb20 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a8078020 con 0x55cb13dbdb20 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f406effd640 1 -- 10.20.193.28:0/353117816 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40b0043dc0 con 0x55cb13dbdb20 2026-02-20T13:32:35.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40bd32ee00 10 client.20916 _ll_register_callbacks cb 0x55cb13c05a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.272+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb139dc4a0 con 0x55cb13dbdb20 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f406effd640 1 -- 10.20.193.28:0/353117816 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f40b0043490 con 0x55cb13dbdb20 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f406effd640 1 -- 10.20.193.28:0/353117816 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f40b0043690 con 0x55cb13dbdb20 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40bd32ee00 10 client.20916 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55cb13c1a340 con 0x55cb13dbdb20 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f406effd640 1 -- 10.20.193.28:0/353117816 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f40b00052d0 con 0x55cb13dbdb20 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40bd32ee00 10 client.20916 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40bd32ee00 10 client.20916 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40bd32ee00 20 client.20916 populate_metadata read hostname 'trial028' 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55cb13e6b2d0 0x55cb13e8b780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40bd32ee00 4 client.20916 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f40b003f040 con 0x55cb13e6b2d0 2026-02-20T13:32:35.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.273+0000 7f40b90a9640 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55cb13e6b2d0 0x55cb13e8b780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40b90a9640 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55cb13e6b2d0 0x55cb13e8b780 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=3292063622369126753 s_cookie=11861532220982692609 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2dafc26c254c2961 server_cookie=a49ca0b5bb860b01 in_seq=0 out_seq=0 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f406effd640 10 client.20916 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f406effd640 1 -- 10.20.193.28:0/353117816 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f40b003f040 con 0x55cb13e6b2d0 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f406effd640 10 client.20916 handle_command_reply: tid=0 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 client.20916 shutdown 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 msgr2=0x55cb13d584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13d584a0 secure :-1 s=READY pgs=1543 gs=1 cs=0 l=1 c_cookie=5816571936370911742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40b000a230 tx=0x7f40b000a390 comp rx=0 tx=0).stop 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 shutdown_connections 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55cb13e6b2d0 0x55cb13e8b780 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=3292063622369126753 s_cookie=11861532220982692609 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cb13dbdb20 0x55cb13d584a0 unknown :-1 s=CLOSED pgs=1543 gs=1 cs=0 l=1 c_cookie=5816571936370911742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55cb13d78c70 0x55cb13d57f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 --2- 10.20.193.28:0/353117816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55cb13d78360 0x55cb13d5c5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f406effd640 0 client.20916 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:32:35.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 >> 10.20.193.28:0/353117816 conn(0x55cb13d56860 msgr2=0x55cb13dd1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 shutdown_connections 2026-02-20T13:32:35.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.274+0000 7f40bd32ee00 1 -- 10.20.193.28:0/353117816 wait complete. 2026-02-20T13:32:35.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40bd32ee00 20 client.20916 trim_cache size 0 max 16384 2026-02-20T13:32:35.284 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:32:35.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 -- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40900b56d0 msgr2=0x7f40900d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40900b56d0 0x7f40900d5b80 secure :-1 s=READY pgs=639 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40a400b2c0 tx=0x7f40a400b4a0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 -- 10.20.193.28:0/1254059050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b410dc20 msgr2=0x7f40b4173cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b410dc20 0x7f40b4173cf0 secure :-1 s=READY pgs=536 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40a8004680 tx=0x7f40a8002b40 comp rx=0 tx=0).stop 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 -- 10.20.193.28:0/1254059050 shutdown_connections 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f40900b56d0 0x7f40900d5b80 unknown :-1 s=CLOSED pgs=639 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f40b4113420 0x7f40b40f5e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f40b410dc20 0x7f40b4173cf0 unknown :-1 s=CLOSED pgs=536 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 --2- 10.20.193.28:0/1254059050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f40b410d230 0x7f40b40f5770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 -- 10.20.193.28:0/1254059050 >> 10.20.193.28:0/1254059050 conn(0x7f40b40eab00 msgr2=0x7f40b41102e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 -- 10.20.193.28:0/1254059050 shutdown_connections 2026-02-20T13:32:35.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.275+0000 7f40ba0ab640 1 -- 10.20.193.28:0/1254059050 wait complete. 2026-02-20T13:32:35.416 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:32:35.600 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 -- 10.20.193.28:0/4241566946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 msgr2=0x7f980810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 --2- 10.20.193.28:0/4241566946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 0x7f980810f880 secure :-1 s=READY pgs=538 gs=1 cs=0 l=1 c_cookie=8218533957359878882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc009950 tx=0x7f97fc02f190 comp rx=0 tx=0).stop 2026-02-20T13:32:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 -- 10.20.193.28:0/4241566946 shutdown_connections 2026-02-20T13:32:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 --2- 10.20.193.28:0/4241566946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f980810fea0 0x7f9808114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 --2- 10.20.193.28:0/4241566946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98081156a0 0x7f9808176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 --2- 10.20.193.28:0/4241566946 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 0x7f980810f880 unknown :-1 s=CLOSED pgs=538 gs=1 cs=0 l=1 c_cookie=8218533957359878882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 -- 10.20.193.28:0/4241566946 >> 10.20.193.28:0/4241566946 conn(0x7f98080ecda0 msgr2=0x7f980810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 -- 10.20.193.28:0/4241566946 shutdown_connections 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.783+0000 7f9807fff640 1 -- 10.20.193.28:0/4241566946 wait complete. 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9807fff640 1 Processor -- start 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9807fff640 1 -- start start 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9807fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 0x7f980811dda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9807fff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810fea0 0x7f980811e2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9807fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081156a0 0x7f98081236b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9807fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9808123cd0 con 0x7f98081156a0 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9807fff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9808123e40 con 0x7f980810f4b0 2026-02-20T13:32:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9807fff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9808124000 con 0x7f980810fea0 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 0x7f980811dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f98077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081156a0 0x7f98081236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810fea0 0x7f980811e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 0x7f980811dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40134/0 (socket says 10.20.193.28:40134) 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.784+0000 7f9806ffd640 1 -- 10.20.193.28:0/1191629761 learned_addr learned my addr 10.20.193.28:0/1191629761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f98077fe640 1 -- 10.20.193.28:0/1191629761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810fea0 msgr2=0x7f980811e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f98077fe640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810fea0 0x7f980811e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f98077fe640 1 -- 10.20.193.28:0/1191629761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 msgr2=0x7f980811dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f98077fe640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 0x7f980811dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f98077fe640 1 -- 10.20.193.28:0/1191629761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc009570 con 0x7f98081156a0 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f98077fe640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081156a0 0x7f98081236b0 secure :-1 s=READY pgs=1544 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f800f940 tx=0x7f97f800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f980c893640 1 -- 10.20.193.28:0/1191629761 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f800dce0 con 0x7f98081156a0 2026-02-20T13:32:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f9807fff640 1 -- 10.20.193.28:0/1191629761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98081242e0 con 0x7f98081156a0 2026-02-20T13:32:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f9807fff640 1 -- 10.20.193.28:0/1191629761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98081649e0 con 0x7f98081156a0 2026-02-20T13:32:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f980c893640 1 -- 10.20.193.28:0/1191629761 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97f800de40 con 0x7f98081156a0 2026-02-20T13:32:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.785+0000 7f980c893640 1 -- 10.20.193.28:0/1191629761 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f8011a00 con 0x7f98081156a0 2026-02-20T13:32:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.788+0000 7f980c893640 1 -- 10.20.193.28:0/1191629761 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f97f8020060 con 0x7f98081156a0 2026-02-20T13:32:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.790+0000 7f980c893640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.790+0000 7f980c893640 1 -- 10.20.193.28:0/1191629761 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97f8015070 con 0x7f98081156a0 2026-02-20T13:32:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.790+0000 7f9806ffd640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.790+0000 7f980f88fe00 1 Processor -- start 2026-02-20T13:32:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f980f88fe00 1 -- start start 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459e7730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a2c5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x561045a4cf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f980f88fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5610458fd780 con 0x561045a2cb20 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f980f88fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5610458f94b0 con 0x5610459e7360 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f980f88fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5610458f3450 con 0x5610459e7c70 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f9806ffd640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 secure :-1 s=READY pgs=640 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc005b30 tx=0x7f97fc03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x561045a4cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a2c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x561045a4cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56692/0 (socket says 10.20.193.28:56692) 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 -- 10.20.193.28:0/3658913346 learned_addr learned my addr 10.20.193.28:0/3658913346 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459e7730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40142/0 (socket says 10.20.193.28:40142) 2026-02-20T13:32:35.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 -- 10.20.193.28:0/3658913346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 msgr2=0x561045a2c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 --2- 10.20.193.28:0/3658913346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a2c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 -- 10.20.193.28:0/3658913346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 msgr2=0x5610459e7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 --2- 10.20.193.28:0/3658913346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459e7730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 -- 10.20.193.28:0/3658913346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104589ed10 con 0x561045a2cb20 2026-02-20T13:32:35.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.791+0000 7f98077fe640 1 --2- 10.20.193.28:0/3658913346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x561045a4cf00 secure :-1 s=READY pgs=1545 gs=2 cs=0 l=1 c_cookie=681661195868360849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f800ffd0 tx=0x7f97f80ad9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975bf3efce6d091 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f97cbfff640 1 -- 10.20.193.28:0/3658913346 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f80b3c40 con 0x561045a2cb20 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f97cbfff640 1 -- 10.20.193.28:0/3658913346 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97f80b6220 con 0x561045a2cb20 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f97cbfff640 1 -- 10.20.193.28:0/3658913346 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f80d1be0 con 0x561045a2cb20 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 -- 10.20.193.28:0/3658913346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 msgr2=0x561045a4cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 --2- 10.20.193.28:0/3658913346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x561045a4cf00 secure :-1 s=READY pgs=1545 gs=2 cs=0 l=1 c_cookie=681661195868360849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f800ffd0 tx=0x7f97f80ad9d0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 -- 10.20.193.28:0/3658913346 shutdown_connections 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 --2- 10.20.193.28:0/3658913346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x561045a4cf00 unknown :-1 s=CLOSED pgs=1545 gs=2 cs=0 l=1 c_cookie=681661195868360849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 --2- 10.20.193.28:0/3658913346 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a2c5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 --2- 10.20.193.28:0/3658913346 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459e7730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 -- 10.20.193.28:0/3658913346 >> 10.20.193.28:0/3658913346 conn(0x5610459c5860 msgr2=0x5610459e5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 -- 10.20.193.28:0/3658913346 shutdown_connections 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.792+0000 7f980f88fe00 1 -- 10.20.193.28:0/3658913346 wait complete. 2026-02-20T13:32:35.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.793+0000 7f980f88fe00 1 -- start start 2026-02-20T13:32:35.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.793+0000 7f980f88fe00 1 Processor -- start 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7360 0x561045a446e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a44c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561045a2cb20 0x561045a49c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f980f88fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561045a4a150 con 0x5610459e7360 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f980f88fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x561045a4a2c0 con 0x561045a2cb20 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f980f88fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561045a4a480 con 0x5610459e7c70 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a44c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a44c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36756/0 (socket says 10.20.193.28:36756) 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98067fc640 1 -- 10.20.193.28:0/2382767505 learned_addr learned my addr 10.20.193.28:0/2382767505 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7360 0x561045a446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98077fe640 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561045a2cb20 0x561045a49c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98067fc640 1 -- 10.20.193.28:0/2382767505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561045a2cb20 msgr2=0x561045a49c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98067fc640 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561045a2cb20 0x561045a49c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98067fc640 1 -- 10.20.193.28:0/2382767505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7360 msgr2=0x561045a446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98067fc640 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7360 0x561045a446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.794+0000 7f98067fc640 1 -- 10.20.193.28:0/2382767505 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610458773c0 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f98067fc640 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a44c20 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=14981389852205648692 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0005940 tx=0x7f97f0002a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe896b21e5c0b34 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f97c97fa640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f97c97fa640 1 -- 10.20.193.28:0/2382767505 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f0016070 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f97c97fa640 1 -- 10.20.193.28:0/2382767505 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97f0010d40 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f97c97fa640 1 -- 10.20.193.28:0/2382767505 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f000f3c0 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98081649e0 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f980f88fe00 10 client.30700 _ll_register_callbacks cb 0x561045874a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5610455896f0 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.795+0000 7f97c97fa640 1 -- 10.20.193.28:0/2382767505 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97f0010860 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f97c97fa640 1 -- 10.20.193.28:0/2382767505 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f97f0010a20 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f980f88fe00 10 client.30700 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5610458890e0 con 0x5610459e7c70 2026-02-20T13:32:35.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f97c97fa640 1 -- 10.20.193.28:0/2382767505 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f97f001b420 con 0x5610459e7c70 2026-02-20T13:32:35.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f980f88fe00 10 client.30700 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:35.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f980f88fe00 10 client.30700 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:32:35.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f980f88fe00 20 client.30700 populate_metadata read hostname 'trial028' 2026-02-20T13:32:35.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561045a4cc70 0x561045a2a8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f980f88fe00 4 client.30700 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:35.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561045895f80 con 0x561045a4cc70 2026-02-20T13:32:35.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.796+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561045a4cc70 0x561045a2a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.797+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561045a4cc70 0x561045a2a8a0 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=13879647204195869697 s_cookie=15786129783759125590 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c09e69983dd6a401 server_cookie=db1399665b2d3c56 in_seq=0 out_seq=0 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.797+0000 7f97c97fa640 10 client.30700 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.797+0000 7f97c97fa640 1 -- 10.20.193.28:0/2382767505 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561045895f80 con 0x561045a4cc70 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.797+0000 7f97c97fa640 10 client.30700 handle_command_reply: tid=0 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.797+0000 7f980f88fe00 1 client.30700 shutdown 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 msgr2=0x561045a44c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a44c20 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=14981389852205648692 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0005940 tx=0x7f97f0002a70 comp rx=0 tx=0).stop 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 shutdown_connections 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561045a4cc70 0x561045a2a8a0 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=13879647204195869697 s_cookie=15786129783759125590 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x561045a2cb20 0x561045a49c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x561045a44c20 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=14981389852205648692 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2382767505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7360 0x561045a446e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 >> 10.20.193.28:0/2382767505 conn(0x5610459c5860 msgr2=0x5610459e5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f97c97fa640 0 client.30700 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:32:35.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 shutdown_connections 2026-02-20T13:32:35.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 1 -- 10.20.193.28:0/2382767505 wait complete. 2026-02-20T13:32:35.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.798+0000 7f980f88fe00 20 client.30700 trim_cache size 0 max 16384 2026-02-20T13:32:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f980f88fe00 1 Processor -- start 2026-02-20T13:32:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f980f88fe00 1 -- start start 2026-02-20T13:32:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x561045a2be80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7c70 0x561045a2c3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561045a2cb20 0x561045a27780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f980f88fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5610458f1080 con 0x5610459e7c70 2026-02-20T13:32:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f980f88fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5610455b1700 con 0x5610459e7360 2026-02-20T13:32:35.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f980f88fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x561045a45200 con 0x561045a2cb20 2026-02-20T13:32:35.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x561045a2be80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f98067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7c70 0x561045a2c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x561045a2be80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40150/0 (socket says 10.20.193.28:40150) 2026-02-20T13:32:35.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f98067fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7c70 0x561045a2c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56712/0 (socket says 10.20.193.28:56712) 2026-02-20T13:32:35.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.805+0000 7f9806ffd640 1 -- 10.20.193.28:0/2189836115 learned_addr learned my addr 10.20.193.28:0/2189836115 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f98077fe640 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561045a2cb20 0x561045a27780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f9806ffd640 1 -- 10.20.193.28:0/2189836115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561045a2cb20 msgr2=0x561045a27780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561045a2cb20 0x561045a27780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f9806ffd640 1 -- 10.20.193.28:0/2189836115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7c70 msgr2=0x561045a2c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7c70 0x561045a2c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f9806ffd640 1 -- 10.20.193.28:0/2189836115 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561045883b60 con 0x5610459e7360 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f98067fc640 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7c70 0x561045a2c3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f9806ffd640 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x561045a2be80 secure :-1 s=READY pgs=539 gs=1 cs=0 l=1 c_cookie=12793930929010198402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc0098a0 tx=0x7f97fc043000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b18d2c6510894782 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f97cb7fe640 1 -- 10.20.193.28:0/2189836115 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97fc057070 con 0x5610459e7360 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f97cb7fe640 1 -- 10.20.193.28:0/2189836115 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97fc03e040 con 0x5610459e7360 2026-02-20T13:32:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.806+0000 7f97cb7fe640 1 -- 10.20.193.28:0/2189836115 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97fc05b430 con 0x5610459e7360 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 -- 10.20.193.28:0/2189836115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 msgr2=0x561045a2be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x561045a2be80 secure :-1 s=READY pgs=539 gs=1 cs=0 l=1 c_cookie=12793930929010198402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc0098a0 tx=0x7f97fc043000 comp rx=0 tx=0).stop 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 -- 10.20.193.28:0/2189836115 shutdown_connections 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5610459e7c70 0x561045a2c3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x561045a2cb20 0x561045a27780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 --2- 10.20.193.28:0/2189836115 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x561045a2be80 unknown :-1 s=CLOSED pgs=539 gs=1 cs=0 l=1 c_cookie=12793930929010198402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 -- 10.20.193.28:0/2189836115 >> 10.20.193.28:0/2189836115 conn(0x5610459c5860 msgr2=0x561045a2ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 -- 10.20.193.28:0/2189836115 shutdown_connections 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 -- 10.20.193.28:0/2189836115 wait complete. 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.807+0000 7f980f88fe00 1 -- start start 2026-02-20T13:32:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f980f88fe00 1 Processor -- start 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459cb6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x5610459c6f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f980f88fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x5610459c74a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f980f88fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561045a39080 con 0x561045a2cb20 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f980f88fe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5610459c7ab0 con 0x5610459e7360 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f980f88fe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5610459c7c70 con 0x5610459e7c70 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f98067fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x5610459c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f9806ffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40156/0 (socket says 10.20.193.28:40156) 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f9806ffd640 1 -- 10.20.193.28:0/1493065718 learned_addr learned my addr 10.20.193.28:0/1493065718 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f98077fe640 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x5610459c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f9806ffd640 1 -- 10.20.193.28:0/1493065718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 msgr2=0x5610459c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f9806ffd640 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x5610459c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f9806ffd640 1 -- 10.20.193.28:0/1493065718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 msgr2=0x5610459c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f9806ffd640 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x5610459c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.808+0000 7f9806ffd640 1 -- 10.20.193.28:0/1493065718 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98081768e0 con 0x5610459e7360 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f9806ffd640 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459cb6e0 secure :-1 s=READY pgs=540 gs=1 cs=0 l=1 c_cookie=6589469755563054419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc005970 tx=0x7f97fc05b4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b727fd486841553 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f97c97fa640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f97c97fa640 1 -- 10.20.193.28:0/1493065718 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97fc057030 con 0x5610459e7360 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610458890e0 con 0x5610459e7360 2026-02-20T13:32:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f97c97fa640 1 -- 10.20.193.28:0/1493065718 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97fc05b5c0 con 0x5610459e7360 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 10 client.30857 _ll_register_callbacks cb 0x561045874a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f97c97fa640 1 -- 10.20.193.28:0/1493065718 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97fc052690 con 0x5610459e7360 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97f80b6220 con 0x5610459e7360 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f97c97fa640 1 -- 10.20.193.28:0/1493065718 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f97fc0527f0 con 0x5610459e7360 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f97c97fa640 1 -- 10.20.193.28:0/1493065718 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f97fc0529b0 con 0x5610459e7360 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 10 client.30857 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5610458776f0 con 0x5610459e7360 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f97c97fa640 1 -- 10.20.193.28:0/1493065718 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f97fc06a020 con 0x5610459e7360 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 10 client.30857 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 10 client.30857 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 20 client.30857 populate_metadata read hostname 'trial028' 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.809+0000 7f980f88fe00 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561045ada410 0x561045afa890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f980f88fe00 4 client.30857 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561045586f40 con 0x561045ada410 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f98067fc640 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561045ada410 0x561045afa890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f98067fc640 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561045ada410 0x561045afa890 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=11229144918348835386 s_cookie=5302996816465714 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9bd5efcf0590aa3a server_cookie=12d70c297d8f32 in_seq=0 out_seq=0 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f97c97fa640 10 client.30857 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f97c97fa640 1 -- 10.20.193.28:0/1493065718 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561045586f40 con 0x561045ada410 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f97c97fa640 10 client.30857 handle_command_reply: tid=0 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f980f88fe00 1 client.30857 shutdown 2026-02-20T13:32:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 msgr2=0x5610459cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.810+0000 7f980f88fe00 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459cb6e0 secure :-1 s=READY pgs=540 gs=1 cs=0 l=1 c_cookie=6589469755563054419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc005970 tx=0x7f97fc05b4b0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 shutdown_connections 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x561045ada410 0x561045afa890 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=11229144918348835386 s_cookie=5302996816465714 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561045a2cb20 0x5610459c74a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5610459e7c70 0x5610459c6f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 1 --2- 10.20.193.28:0/1493065718 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5610459e7360 0x5610459cb6e0 unknown :-1 s=CLOSED pgs=540 gs=1 cs=0 l=1 c_cookie=6589469755563054419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 >> 10.20.193.28:0/1493065718 conn(0x5610459c5860 msgr2=0x561045a2ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f97c97fa640 0 client.30857 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 shutdown_connections 2026-02-20T13:32:35.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 1 -- 10.20.193.28:0/1493065718 wait complete. 2026-02-20T13:32:35.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f980f88fe00 20 client.30857 trim_cache size 0 max 16384 2026-02-20T13:32:35.821 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:32:35.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f9807fff640 1 -- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 msgr2=0x7f97dc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f9807fff640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 secure :-1 s=READY pgs=640 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97fc005b30 tx=0x7f97fc03a040 comp rx=0 tx=0).stop 2026-02-20T13:32:35.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f9807fff640 1 -- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081156a0 msgr2=0x7f98081236b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:35.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.811+0000 7f9807fff640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081156a0 0x7f98081236b0 secure :-1 s=READY pgs=1544 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f800f940 tx=0x7f97f800fe10 comp rx=0 tx=0).stop 2026-02-20T13:32:35.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.812+0000 7f9807fff640 1 -- 10.20.193.28:0/1191629761 shutdown_connections 2026-02-20T13:32:35.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.812+0000 7f9807fff640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f97dc0b5760 0x7f97dc0d5c10 unknown :-1 s=CLOSED pgs=640 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.812+0000 7f9807fff640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98081156a0 0x7f98081236b0 unknown :-1 s=CLOSED pgs=1544 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.812+0000 7f9807fff640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f980810fea0 0x7f980811e2e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.812+0000 7f9807fff640 1 --2- 10.20.193.28:0/1191629761 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f980810f4b0 0x7f980811dda0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:35.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.812+0000 7f9807fff640 1 -- 10.20.193.28:0/1191629761 >> 10.20.193.28:0/1191629761 conn(0x7f98080ecda0 msgr2=0x7f980810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:35.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.812+0000 7f9807fff640 1 -- 10.20.193.28:0/1191629761 shutdown_connections 2026-02-20T13:32:35.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:35.812+0000 7f9807fff640 1 -- 10.20.193.28:0/1191629761 wait complete. 2026-02-20T13:32:35.911 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:32:36.094 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 -- 10.20.193.28:0/303013057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10bb40 msgr2=0x7fdfec1109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 --2- 10.20.193.28:0/303013057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10bb40 0x7fdfec1109d0 secure :-1 s=READY pgs=1546 gs=1 cs=0 l=1 c_cookie=10695226610392364843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc009950 tx=0x7fdfdc02f190 comp rx=0 tx=0).stop 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 -- 10.20.193.28:0/303013057 shutdown_connections 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 --2- 10.20.193.28:0/303013057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10bb40 0x7fdfec1109d0 unknown :-1 s=CLOSED pgs=1546 gs=1 cs=0 l=1 c_cookie=10695226610392364843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 --2- 10.20.193.28:0/303013057 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfec111160 0x7fdfec111b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 --2- 10.20.193.28:0/303013057 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdfec10b150 0x7fdfec10b520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 -- 10.20.193.28:0/303013057 >> 10.20.193.28:0/303013057 conn(0x7fdfec0e8ce0 msgr2=0x7fdfec1090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 -- 10.20.193.28:0/303013057 shutdown_connections 2026-02-20T13:32:36.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 -- 10.20.193.28:0/303013057 wait complete. 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.269+0000 7fdff1169640 1 Processor -- start 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff1169640 1 -- start start 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff1169640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10b150 0x7fdfec0f1130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff1169640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdfec10bb40 0x7fdfec0f1670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff1169640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfec111160 0x7fdfec0f6a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff1169640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec0f7060 con 0x7fdfec10b150 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff1169640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec0f71d0 con 0x7fdfec10bb40 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff1169640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec0f7390 con 0x7fdfec111160 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdfebfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10b150 0x7fdfec0f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff0968640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfec111160 0x7fdfec0f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff0968640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfec111160 0x7fdfec0f6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36798/0 (socket says 10.20.193.28:36798) 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdff0968640 1 -- 10.20.193.28:0/174166821 learned_addr learned my addr 10.20.193.28:0/174166821 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:36.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.270+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdfec10bb40 0x7fdfec0f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfeb7fe640 1 -- 10.20.193.28:0/174166821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfec111160 msgr2=0x7fdfec0f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfec111160 0x7fdfec0f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfeb7fe640 1 -- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10b150 msgr2=0x7fdfec0f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10b150 0x7fdfec0f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfeb7fe640 1 -- 10.20.193.28:0/174166821 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc009570 con 0x7fdfec10bb40 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfebfff640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10b150 0x7fdfec0f1130 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdff0968640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfec111160 0x7fdfec0f6a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdfec10bb40 0x7fdfec0f1670 secure :-1 s=READY pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc02f6a0 tx=0x7fdfdc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfe97fa640 1 -- 10.20.193.28:0/174166821 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfdc03d070 con 0x7fdfec10bb40 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdff1169640 1 -- 10.20.193.28:0/174166821 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec0f7610 con 0x7fdfec10bb40 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfe97fa640 1 -- 10.20.193.28:0/174166821 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfdc002ad0 con 0x7fdfec10bb40 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdfe97fa640 1 -- 10.20.193.28:0/174166821 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfdc0418c0 con 0x7fdfec10bb40 2026-02-20T13:32:36.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.271+0000 7fdff1169640 1 -- 10.20.193.28:0/174166821 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec0f7d50 con 0x7fdfec10bb40 2026-02-20T13:32:36.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.274+0000 7fdfe97fa640 1 -- 10.20.193.28:0/174166821 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fdfdc038b40 con 0x7fdfec10bb40 2026-02-20T13:32:36.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.275+0000 7fdfe97fa640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc00b5760 0x7fdfc00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.276+0000 7fdfe97fa640 1 -- 10.20.193.28:0/174166821 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdfdc10af90 con 0x7fdfec10bb40 2026-02-20T13:32:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.276+0000 7fdfebfff640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc00b5760 0x7fdfc00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.276+0000 7fdfebfff640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc00b5760 0x7fdfc00d5c10 secure :-1 s=READY pgs=641 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfd8005970 tx=0x7fdfd8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff43ece00 1 Processor -- start 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff43ece00 1 -- start start 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9360 0x5589cdcc9730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9c70 0x5589cdd0e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd2ef00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff43ece00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589cdbdf780 con 0x5589cdcc9c70 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff43ece00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5589cdbdb4b0 con 0x5589cdd0eb20 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff43ece00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5589cdbd5450 con 0x5589cdcc9360 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff0968640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd2ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdfebfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9360 0x5589cdcc9730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff0968640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd2ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40178/0 (socket says 10.20.193.28:40178) 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdff0968640 1 -- 10.20.193.28:0/2293355251 learned_addr learned my addr 10.20.193.28:0/2293355251 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.277+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9c70 0x5589cdd0e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdff0968640 1 -- 10.20.193.28:0/2293355251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9360 msgr2=0x5589cdcc9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdff0968640 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9360 0x5589cdcc9730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdff0968640 1 -- 10.20.193.28:0/2293355251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9c70 msgr2=0x5589cdd0e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdff0968640 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9c70 0x5589cdd0e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdff0968640 1 -- 10.20.193.28:0/2293355251 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cdb80d10 con 0x5589cdd0eb20 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9c70 0x5589cdd0e5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdff0968640 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd2ef00 secure :-1 s=READY pgs=542 gs=2 cs=0 l=1 c_cookie=12488453628153221804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe00053b0 tx=0x7fdfe0003b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4fe6687c02d2ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdfbcce3640 1 -- 10.20.193.28:0/2293355251 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe0005570 con 0x5589cdd0eb20 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdfbcce3640 1 -- 10.20.193.28:0/2293355251 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfe0003c90 con 0x5589cdd0eb20 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdfbcce3640 1 -- 10.20.193.28:0/2293355251 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe001acd0 con 0x5589cdd0eb20 2026-02-20T13:32:36.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdff43ece00 1 -- 10.20.193.28:0/2293355251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 msgr2=0x5589cdd2ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.278+0000 7fdff43ece00 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd2ef00 secure :-1 s=READY pgs=542 gs=2 cs=0 l=1 c_cookie=12488453628153221804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe00053b0 tx=0x7fdfe0003b50 comp rx=0 tx=0).stop 2026-02-20T13:32:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.279+0000 7fdff43ece00 1 -- 10.20.193.28:0/2293355251 shutdown_connections 2026-02-20T13:32:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.279+0000 7fdff43ece00 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9c70 0x5589cdd0e5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.279+0000 7fdff43ece00 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd2ef00 unknown :-1 s=CLOSED pgs=542 gs=2 cs=0 l=1 c_cookie=12488453628153221804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.279+0000 7fdff43ece00 1 --2- 10.20.193.28:0/2293355251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9360 0x5589cdcc9730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.279+0000 7fdff43ece00 1 -- 10.20.193.28:0/2293355251 >> 10.20.193.28:0/2293355251 conn(0x5589cdca7860 msgr2=0x5589cdcc7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.279+0000 7fdff43ece00 1 -- 10.20.193.28:0/2293355251 shutdown_connections 2026-02-20T13:32:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.279+0000 7fdff43ece00 1 -- 10.20.193.28:0/2293355251 wait complete. 2026-02-20T13:32:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.280+0000 7fdff43ece00 1 -- start start 2026-02-20T13:32:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.280+0000 7fdff43ece00 1 Processor -- start 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd26660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdd26ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd2bc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdff43ece00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589cdd2c140 con 0x5589cdcc9360 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdff43ece00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5589cdd2c2b0 con 0x5589cdcc9c70 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdff43ece00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5589cdd2c470 con 0x5589cdd0eb20 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdd26ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdd26ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40194/0 (socket says 10.20.193.28:40194) 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 -- 10.20.193.28:0/3781829925 learned_addr learned my addr 10.20.193.28:0/3781829925 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdff0968640 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd2bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd26660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 -- 10.20.193.28:0/3781829925 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 msgr2=0x5589cdd2bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd2bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 -- 10.20.193.28:0/3781829925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 msgr2=0x5589cdd26660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd26660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 -- 10.20.193.28:0/3781829925 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cdb593c0 con 0x5589cdcc9c70 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd26660 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdd26ba0 secure :-1 s=READY pgs=543 gs=2 cs=0 l=1 c_cookie=9307731517612621066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc0098a0 tx=0x7fdfdc0d3530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=812bb4803401fd0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.281+0000 7fdfadffb640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdfadffb640 1 -- 10.20.193.28:0/3781829925 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfdc0d1cf0 con 0x5589cdcc9c70 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdfadffb640 1 -- 10.20.193.28:0/3781829925 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfdc0d7010 con 0x5589cdcc9c70 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdfadffb640 1 -- 10.20.193.28:0/3781829925 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfdc0d2f60 con 0x5589cdcc9c70 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe0005050 con 0x5589cdcc9c70 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdfadffb640 1 -- 10.20.193.28:0/3781829925 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdfdc0cf520 con 0x5589cdcc9c70 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdfadffb640 10 client.30869 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 10 client.30869 _ll_register_callbacks cb 0x5589cdb56a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5589cd86b6f0 con 0x5589cdcc9c70 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdfadffb640 1 -- 10.20.193.28:0/3781829925 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdfdc0d95f0 con 0x5589cdcc9c70 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 10 client.30869 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:36.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5589cdb6b0e0 con 0x5589cdcc9c70 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdfadffb640 1 -- 10.20.193.28:0/3781829925 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fdfdc02f9f0 con 0x5589cdcc9c70 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 10 client.30869 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 10 client.30869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 20 client.30869 populate_metadata read hostname 'trial028' 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cdd0bd50 0x5589cdd0c1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 4 client.30869 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.282+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589cdb77f80 con 0x5589cdd0bd50 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.283+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cdd0bd50 0x5589cdd0c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.283+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cdd0bd50 0x5589cdd0c1f0 crc :-1 s=READY pgs=431 gs=4 cs=0 l=0 c_cookie=17388986809156135367 s_cookie=9096809411184657022 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f152175f43b469c7 server_cookie=7e3e5bf66717827e in_seq=0 out_seq=0 2026-02-20T13:32:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.283+0000 7fdfadffb640 10 client.30869 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdfadffb640 1 -- 10.20.193.28:0/3781829925 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5589cdb77f80 con 0x5589cdd0bd50 2026-02-20T13:32:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdfadffb640 10 client.30869 handle_command_reply: tid=0 2026-02-20T13:32:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 client.30869 shutdown 2026-02-20T13:32:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 msgr2=0x5589cdd26ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdd26ba0 secure :-1 s=READY pgs=543 gs=2 cs=0 l=1 c_cookie=9307731517612621066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc0098a0 tx=0x7fdfdc0d3530 comp rx=0 tx=0).stop 2026-02-20T13:32:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 shutdown_connections 2026-02-20T13:32:36.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cdd0bd50 0x5589cdd0c1f0 crc :-1 s=READY pgs=431 gs=4 cs=0 l=0 c_cookie=17388986809156135367 s_cookie=9096809411184657022 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd2bc00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdd26ba0 unknown :-1 s=CLOSED pgs=543 gs=2 cs=0 l=1 c_cookie=9307731517612621066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3781829925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd26660 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 >> 10.20.193.28:0/3781829925 conn(0x5589cdca7860 msgr2=0x5589cdcc7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdfadffb640 0 client.30869 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 shutdown_connections 2026-02-20T13:32:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.284+0000 7fdff43ece00 1 -- 10.20.193.28:0/3781829925 wait complete. 2026-02-20T13:32:36.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.285+0000 7fdff43ece00 20 client.30869 trim_cache size 0 max 16384 2026-02-20T13:32:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.292+0000 7fdff43ece00 1 Processor -- start 2026-02-20T13:32:36.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.292+0000 7fdff43ece00 1 -- start start 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.292+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd23870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.292+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9c70 0x5589cdd23db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.292+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd08770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.292+0000 7fdff43ece00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589cdbd3080 con 0x5589cdcc9360 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.292+0000 7fdff43ece00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5589cd893700 con 0x5589cdd0eb20 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.292+0000 7fdff43ece00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5589cdd1f570 con 0x5589cdcc9c70 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfebfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd23870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfeb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9c70 0x5589cdd23db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfeb7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9c70 0x5589cdd23db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36828/0 (socket says 10.20.193.28:36828) 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfeb7fe640 1 -- 10.20.193.28:0/3553623301 learned_addr learned my addr 10.20.193.28:0/3553623301 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfebfff640 1 -- 10.20.193.28:0/3553623301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9c70 msgr2=0x5589cdd23db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:36.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3553623301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9c70 0x5589cdd23db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfebfff640 1 -- 10.20.193.28:0/3553623301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 msgr2=0x5589cdd08770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T13:32:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3553623301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd08770 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfebfff640 1 -- 10.20.193.28:0/3553623301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cdb65b60 con 0x5589cdcc9360 2026-02-20T13:32:36.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3553623301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd23870 secure :-1 s=READY pgs=1547 gs=1 cs=0 l=1 c_cookie=4414418611093210186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfd8004360 tx=0x7fdfd8009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d432a569415844a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:36.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfaffff640 1 -- 10.20.193.28:0/3553623301 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfd8024040 con 0x5589cdcc9360 2026-02-20T13:32:36.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfaffff640 1 -- 10.20.193.28:0/3553623301 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfd8011ca0 con 0x5589cdcc9360 2026-02-20T13:32:36.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.293+0000 7fdfaffff640 1 -- 10.20.193.28:0/3553623301 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfd8028660 con 0x5589cdcc9360 2026-02-20T13:32:36.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 -- 10.20.193.28:0/3553623301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 msgr2=0x5589cdd23870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3553623301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd23870 secure :-1 s=READY pgs=1547 gs=1 cs=0 l=1 c_cookie=4414418611093210186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfd8004360 tx=0x7fdfd8009000 comp rx=0 tx=0).stop 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 -- 10.20.193.28:0/3553623301 shutdown_connections 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3553623301 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdd0eb20 0x5589cdd08770 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3553623301 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdcc9c70 0x5589cdd23db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3553623301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdd23870 unknown :-1 s=CLOSED pgs=1547 gs=1 cs=0 l=1 c_cookie=4414418611093210186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 -- 10.20.193.28:0/3553623301 >> 10.20.193.28:0/3553623301 conn(0x5589cdca7860 msgr2=0x5589cdd10f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 -- 10.20.193.28:0/3553623301 shutdown_connections 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 -- 10.20.193.28:0/3553623301 wait complete. 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 -- start start 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.294+0000 7fdff43ece00 1 Processor -- start 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdca9440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdca9980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff43ece00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd74950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff43ece00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589cdcaa100 con 0x5589cdcc9360 2026-02-20T13:32:36.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff43ece00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5589cdcaa270 con 0x5589cdcc9c70 2026-02-20T13:32:36.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff43ece00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5589cdd74e90 con 0x5589cdd0eb20 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff0968640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd74950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff0968640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd74950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36830/0 (socket says 10.20.193.28:36830) 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff0968640 1 -- 10.20.193.28:0/3866913467 learned_addr learned my addr 10.20.193.28:0/3866913467 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdfeb7fe640 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdca9980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdca9440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff0968640 1 -- 10.20.193.28:0/3866913467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 msgr2=0x5589cdca9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff0968640 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdca9980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff0968640 1 -- 10.20.193.28:0/3866913467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 msgr2=0x5589cdca9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff0968640 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdca9440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.295+0000 7fdff0968640 1 -- 10.20.193.28:0/3866913467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cdb6b340 con 0x5589cdd0eb20 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdff0968640 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd74950 secure :-1 s=READY pgs=431 gs=2 cs=0 l=1 c_cookie=3680411612787180179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe00053b0 tx=0x7fdfe000afc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=331372dcb7670293 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdfadffb640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdfadffb640 1 -- 10.20.193.28:0/3866913467 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe0012c30 con 0x5589cdd0eb20 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdfadffb640 1 -- 10.20.193.28:0/3866913467 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfe0012d90 con 0x5589cdd0eb20 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589cdb596f0 con 0x5589cdd0eb20 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdfadffb640 1 -- 10.20.193.28:0/3866913467 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfe0006040 con 0x5589cdd0eb20 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdff43ece00 10 client.30724 _ll_register_callbacks cb 0x5589cdb56a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfe0003c90 con 0x5589cdd0eb20 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdfadffb640 1 -- 10.20.193.28:0/3866913467 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fdfe0005850 con 0x5589cdd0eb20 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdfadffb640 1 -- 10.20.193.28:0/3866913467 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdfe001a890 con 0x5589cdd0eb20 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdff43ece00 10 client.30724 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.296+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5589cddbc9e0 con 0x5589cdd0eb20 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdfadffb640 1 -- 10.20.193.28:0/3866913467 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fdfe001aa30 con 0x5589cdd0eb20 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdff43ece00 10 client.30724 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdff43ece00 10 client.30724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdff43ece00 20 client.30724 populate_metadata read hostname 'trial028' 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cddbcfb0 0x5589cdddd460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdff43ece00 4 client.30724 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589cd868f40 con 0x5589cddbcfb0 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cddbcfb0 0x5589cdddd460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdfebfff640 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cddbcfb0 0x5589cdddd460 crc :-1 s=READY pgs=432 gs=4 cs=0 l=0 c_cookie=9182798621446248555 s_cookie=8166395188998382094 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6fdab19340186b server_cookie=7154dd282fb5220e in_seq=0 out_seq=0 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdfadffb640 10 client.30724 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdfadffb640 1 -- 10.20.193.28:0/3866913467 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589cd868f40 con 0x5589cddbcfb0 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdfadffb640 10 client.30724 handle_command_reply: tid=0 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.297+0000 7fdff43ece00 1 client.30724 shutdown 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 msgr2=0x5589cdd74950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd74950 secure :-1 s=READY pgs=431 gs=2 cs=0 l=1 c_cookie=3680411612787180179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfe00053b0 tx=0x7fdfe000afc0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 shutdown_connections 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x5589cddbcfb0 0x5589cdddd460 crc :-1 s=READY pgs=432 gs=4 cs=0 l=0 c_cookie=9182798621446248555 s_cookie=8166395188998382094 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5589cdd0eb20 0x5589cdd74950 unknown :-1 s=CLOSED pgs=431 gs=2 cs=0 l=1 c_cookie=3680411612787180179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5589cdcc9c70 0x5589cdca9980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 --2- 10.20.193.28:0/3866913467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589cdcc9360 0x5589cdca9440 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdfadffb640 0 client.30724 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 >> 10.20.193.28:0/3866913467 conn(0x5589cdca7860 msgr2=0x5589cdd22860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 shutdown_connections 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 1 -- 10.20.193.28:0/3866913467 wait complete. 2026-02-20T13:32:36.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.298+0000 7fdff43ece00 20 client.30724 trim_cache size 0 max 16384 2026-02-20T13:32:36.305 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:32:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 -- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc00b5760 msgr2=0x7fdfc00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc00b5760 0x7fdfc00d5c10 secure :-1 s=READY pgs=641 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfd8005970 tx=0x7fdfd8005900 comp rx=0 tx=0).stop 2026-02-20T13:32:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 -- 10.20.193.28:0/174166821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdfec10bb40 msgr2=0x7fdfec0f1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:36.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdfec10bb40 0x7fdfec0f1670 secure :-1 s=READY pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfdc02f6a0 tx=0x7fdfdc004270 comp rx=0 tx=0).stop 2026-02-20T13:32:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 -- 10.20.193.28:0/174166821 shutdown_connections 2026-02-20T13:32:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fdfc00b5760 0x7fdfc00d5c10 unknown :-1 s=CLOSED pgs=641 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfec111160 0x7fdfec0f6a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fdfec10bb40 0x7fdfec0f1670 unknown :-1 s=CLOSED pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 --2- 10.20.193.28:0/174166821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfec10b150 0x7fdfec0f1130 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 -- 10.20.193.28:0/174166821 >> 10.20.193.28:0/174166821 conn(0x7fdfec0e8ce0 msgr2=0x7fdfec10efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 -- 10.20.193.28:0/174166821 shutdown_connections 2026-02-20T13:32:36.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:36.299+0000 7fdff1169640 1 -- 10.20.193.28:0/174166821 wait complete. 2026-02-20T13:32:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:36 trial127 ceph-mon[43817]: pgmap v639: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:32:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:36 trial034 ceph-mon[43332]: pgmap v639: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:32:37.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:36 trial028 ceph-mon[37442]: pgmap v639: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:32:37.401 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T13:32:37.401 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T13:32:37.588 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 -- 10.20.193.28:0/3780140611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 msgr2=0x7f3a20061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3780140611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 0x7f3a20061300 secure :-1 s=READY pgs=1548 gs=1 cs=0 l=1 c_cookie=15834219725633799037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a10009890 tx=0x7f3a1002f120 comp rx=0 tx=0).stop 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 -- 10.20.193.28:0/3780140611 shutdown_connections 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3780140611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a201556e0 0x7f3a20175ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3780140611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a20061840 0x7f3a201551a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3780140611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 0x7f3a20061300 unknown :-1 s=CLOSED pgs=1548 gs=1 cs=0 l=1 c_cookie=15834219725633799037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 -- 10.20.193.28:0/3780140611 >> 10.20.193.28:0/3780140611 conn(0x7f3a2005f830 msgr2=0x7f3a2010ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 -- 10.20.193.28:0/3780140611 shutdown_connections 2026-02-20T13:32:37.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.767+0000 7f3a2834e640 1 -- 10.20.193.28:0/3780140611 wait complete. 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a2834e640 1 Processor -- start 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a2834e640 1 -- start start 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a2834e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 0x7f3a20161ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a2834e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a20061840 0x7f3a20162420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a2834e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a201556e0 0x7f3a201677f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a2834e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20167e10 con 0x7f3a20060f30 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a2834e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20167f80 con 0x7f3a20061840 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a2834e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20168140 con 0x7f3a201556e0 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.768+0000 7f3a260c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 0x7f3a20161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a268c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a201556e0 0x7f3a201677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a260c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 0x7f3a20161ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56774/0 (socket says 10.20.193.28:56774) 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a260c3640 1 -- 10.20.193.28:0/3878299906 learned_addr learned my addr 10.20.193.28:0/3878299906 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a258c2640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a20061840 0x7f3a20162420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a268c4640 1 -- 10.20.193.28:0/3878299906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a20061840 msgr2=0x7f3a20162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a268c4640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a20061840 0x7f3a20162420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a268c4640 1 -- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 msgr2=0x7f3a20161ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a268c4640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 0x7f3a20161ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a268c4640 1 -- 10.20.193.28:0/3878299906 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a14009570 con 0x7f3a201556e0 2026-02-20T13:32:37.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a260c3640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 0x7f3a20161ee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:37.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a268c4640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a201556e0 0x7f3a201677f0 secure :-1 s=READY pgs=432 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1c00f940 tx=0x7f3a1c00fe10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:37.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a077fe640 1 -- 10.20.193.28:0/3878299906 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1c00dce0 con 0x7f3a201556e0 2026-02-20T13:32:37.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a077fe640 1 -- 10.20.193.28:0/3878299906 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a1c00de40 con 0x7f3a201556e0 2026-02-20T13:32:37.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a077fe640 1 -- 10.20.193.28:0/3878299906 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1c0116b0 con 0x7f3a201556e0 2026-02-20T13:32:37.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.769+0000 7f3a2834e640 1 -- 10.20.193.28:0/3878299906 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a100094b0 con 0x7f3a201556e0 2026-02-20T13:32:37.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.770+0000 7f3a2834e640 1 -- 10.20.193.28:0/3878299906 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a20151160 con 0x7f3a201556e0 2026-02-20T13:32:37.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.772+0000 7f3a077fe640 1 -- 10.20.193.28:0/3878299906 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f3a1c020060 con 0x7f3a201556e0 2026-02-20T13:32:37.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.774+0000 7f3a077fe640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39fc0b5760 0x7f39fc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.774+0000 7f3a077fe640 1 -- 10.20.193.28:0/3878299906 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a1c015070 con 0x7f3a201556e0 2026-02-20T13:32:37.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.774+0000 7f3a260c3640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39fc0b5760 0x7f39fc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a2a348e00 1 Processor -- start 2026-02-20T13:32:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a260c3640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39fc0b5760 0x7f39fc0d5c10 secure :-1 s=READY pgs=642 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a100097e0 tx=0x7f3a1003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a2a348e00 1 -- start start 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6410 0x55df069b67e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069fb480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069fb9c0 0x55df06a1bda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55df068cca20 con 0x55df069b6410 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55df068c8750 con 0x55df069fb9c0 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55df068c26f0 con 0x55df069b6d20 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.775+0000 7f3a260c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6410 0x55df069b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a260c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6410 0x55df069b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56776/0 (socket says 10.20.193.28:56776) 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a260c3640 1 -- 10.20.193.28:0/728601680 learned_addr learned my addr 10.20.193.28:0/728601680 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a258c2640 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a268c4640 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069fb9c0 0x55df06a1bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a260c3640 1 -- 10.20.193.28:0/728601680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 msgr2=0x55df069fb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a260c3640 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069fb480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a260c3640 1 -- 10.20.193.28:0/728601680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069fb9c0 msgr2=0x55df06a1bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a260c3640 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069fb9c0 0x55df06a1bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a260c3640 1 -- 10.20.193.28:0/728601680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df0686e120 con 0x55df069b6410 2026-02-20T13:32:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a260c3640 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6410 0x55df069b67e0 secure :-1 s=READY pgs=1549 gs=1 cs=0 l=1 c_cookie=414126409762408045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a10005c50 tx=0x7f3a10040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf45c689ff066d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a04884640 1 -- 10.20.193.28:0/728601680 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a10004640 con 0x55df069b6410 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a04884640 1 -- 10.20.193.28:0/728601680 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a1003e040 con 0x55df069b6410 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a04884640 1 -- 10.20.193.28:0/728601680 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1004ebf0 con 0x55df069b6410 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a2a348e00 1 -- 10.20.193.28:0/728601680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6410 msgr2=0x55df069b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.776+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6410 0x55df069b67e0 secure :-1 s=READY pgs=1549 gs=1 cs=0 l=1 c_cookie=414126409762408045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a10005c50 tx=0x7f3a10040000 comp rx=0 tx=0).stop 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.777+0000 7f3a2a348e00 1 -- 10.20.193.28:0/728601680 shutdown_connections 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.777+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069fb9c0 0x55df06a1bda0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.777+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069fb480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.777+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/728601680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6410 0x55df069b67e0 unknown :-1 s=CLOSED pgs=1549 gs=1 cs=0 l=1 c_cookie=414126409762408045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.777+0000 7f3a2a348e00 1 -- 10.20.193.28:0/728601680 >> 10.20.193.28:0/728601680 conn(0x55df06994910 msgr2=0x55df069b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.777+0000 7f3a2a348e00 1 -- 10.20.193.28:0/728601680 shutdown_connections 2026-02-20T13:32:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.777+0000 7f3a2a348e00 1 -- 10.20.193.28:0/728601680 wait complete. 2026-02-20T13:32:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.778+0000 7f3a2a348e00 1 -- start start 2026-02-20T13:32:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.778+0000 7f3a2a348e00 1 Processor -- start 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.778+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069cec20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.778+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6d20 0x55df069cf160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.778+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069fb9c0 0x55df069d4150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.778+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55df069d4690 con 0x55df069b6d20 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.778+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55df069d4800 con 0x55df069b6410 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.778+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55df069d49c0 con 0x55df069fb9c0 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069fb9c0 0x55df069d4150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069fb9c0 0x55df069d4150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36864/0 (socket says 10.20.193.28:36864) 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 -- 10.20.193.28:0/2985465893 learned_addr learned my addr 10.20.193.28:0/2985465893 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a260c3640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a258c2640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6d20 0x55df069cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 -- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 msgr2=0x55df069cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 -- 10.20.193.28:0/2985465893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6d20 msgr2=0x55df069cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6d20 0x55df069cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 -- 10.20.193.28:0/2985465893 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df06846810 con 0x55df069fb9c0 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a260c3640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069cec20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a258c2640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6d20 0x55df069cf160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a268c4640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069fb9c0 0x55df069d4150 secure :-1 s=READY pgs=433 gs=2 cs=0 l=1 c_cookie=12866624291798801652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1c0adef0 tx=0x7f3a1c0ae090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b28f6e9f83145cf4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f39d3fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f39d3fff640 1 -- 10.20.193.28:0/2985465893 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1c0d3290 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f39d3fff640 1 -- 10.20.193.28:0/2985465893 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a1c0b3c30 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f39d3fff640 1 -- 10.20.193.28:0/2985465893 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1c0b8e40 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.779+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a20176650 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f39d3fff640 1 -- 10.20.193.28:0/2985465893 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a1c0732c0 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 10 client.30736 _ll_register_callbacks cb 0x55df06879b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55df065589d0 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f39d3fff640 1 -- 10.20.193.28:0/2985465893 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a1c0b6210 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 10 client.30736 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55df068584f0 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f39d3fff640 1 -- 10.20.193.28:0/2985465893 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3a1c0d1bd0 con 0x55df069fb9c0 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 10 client.30736 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 10 client.30736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 20 client.30736 populate_metadata read hostname 'trial028' 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55df069f9490 0x55df069f9930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 4 client.30736 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:37.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df068cfdf0 con 0x55df069f9490 2026-02-20T13:32:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.780+0000 7f3a260c3640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55df069f9490 0x55df069f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.781+0000 7f3a260c3640 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55df069f9490 0x55df069f9930 crc :-1 s=READY pgs=433 gs=4 cs=0 l=0 c_cookie=2854311550796624289 s_cookie=3786345602509691611 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=279c8d3b8f86f1a1 server_cookie=348bcd43ba73dadb in_seq=0 out_seq=0 2026-02-20T13:32:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.781+0000 7f39d3fff640 10 client.30736 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.781+0000 7f39d3fff640 1 -- 10.20.193.28:0/2985465893 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55df068cfdf0 con 0x55df069f9490 2026-02-20T13:32:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.781+0000 7f39d3fff640 10 client.30736 handle_command_reply: tid=0 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 client.30736 shutdown 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069fb9c0 msgr2=0x55df069d4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069fb9c0 0x55df069d4150 secure :-1 s=READY pgs=433 gs=2 cs=0 l=1 c_cookie=12866624291798801652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1c0adef0 tx=0x7f3a1c0ae090 comp rx=0 tx=0).stop 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 shutdown_connections 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55df069f9490 0x55df069f9930 crc :-1 s=READY pgs=433 gs=4 cs=0 l=0 c_cookie=2854311550796624289 s_cookie=3786345602509691611 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069b6d20 0x55df069cf160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069fb9c0 0x55df069d4150 unknown :-1 s=CLOSED pgs=433 gs=2 cs=0 l=1 c_cookie=12866624291798801652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2985465893 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069cec20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f39d3fff640 0 client.30736 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 >> 10.20.193.28:0/2985465893 conn(0x55df06994910 msgr2=0x55df069b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 shutdown_connections 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2985465893 wait complete. 2026-02-20T13:32:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.782+0000 7f3a2a348e00 20 client.30736 trim_cache size 0 max 16384 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.791+0000 7f3a2a348e00 1 Processor -- start 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a2a348e00 1 -- start start 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6410 0x55df069f4630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6d20 0x55df069f4b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069ce060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55df068c0320 con 0x55df069fb9c0 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55df06580790 con 0x55df069b6d20 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55df06991390 con 0x55df069b6410 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a260c3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6410 0x55df069f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a260c3640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6410 0x55df069f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36880/0 (socket says 10.20.193.28:36880) 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a260c3640 1 -- 10.20.193.28:0/3884063362 learned_addr learned my addr 10.20.193.28:0/3884063362 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a258c2640 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6d20 0x55df069f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a268c4640 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a260c3640 1 -- 10.20.193.28:0/3884063362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6d20 msgr2=0x55df069f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a260c3640 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6d20 0x55df069f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.792+0000 7f3a260c3640 1 -- 10.20.193.28:0/3884063362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 msgr2=0x55df069ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.793+0000 7f3a260c3640 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.793+0000 7f3a260c3640 1 -- 10.20.193.28:0/3884063362 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df06852f70 con 0x55df069b6410 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.793+0000 7f3a268c4640 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069ce060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.793+0000 7f3a260c3640 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6410 0x55df069f4630 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=15226057437154032587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a10002b60 tx=0x7f3a10002390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d34dd2916742bbcb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.793+0000 7f39ee4e6640 1 -- 10.20.193.28:0/3884063362 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1005f040 con 0x55df069b6410 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.793+0000 7f39ee4e6640 1 -- 10.20.193.28:0/3884063362 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a100046c0 con 0x55df069b6410 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.793+0000 7f39ee4e6640 1 -- 10.20.193.28:0/3884063362 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a10064690 con 0x55df069b6410 2026-02-20T13:32:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 -- 10.20.193.28:0/3884063362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6410 msgr2=0x55df069f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6410 0x55df069f4630 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=15226057437154032587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a10002b60 tx=0x7f3a10002390 comp rx=0 tx=0).stop 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 -- 10.20.193.28:0/3884063362 shutdown_connections 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069ce060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6d20 0x55df069f4b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/3884063362 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6410 0x55df069f4630 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=15226057437154032587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 -- 10.20.193.28:0/3884063362 >> 10.20.193.28:0/3884063362 conn(0x55df06994910 msgr2=0x55df069fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 -- 10.20.193.28:0/3884063362 shutdown_connections 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 -- 10.20.193.28:0/3884063362 wait complete. 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 -- start start 2026-02-20T13:32:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.794+0000 7f3a2a348e00 1 Processor -- start 2026-02-20T13:32:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069d53c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069d5900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a2a348e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069d72a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55df069d7810 con 0x55df069fb9c0 2026-02-20T13:32:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55df069d7980 con 0x55df069b6410 2026-02-20T13:32:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a2a348e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55df069d7b40 con 0x55df069b6d20 2026-02-20T13:32:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a258c2640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069d5900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a260c3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069d53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a260c3640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069d53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40286/0 (socket says 10.20.193.28:40286) 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a260c3640 1 -- 10.20.193.28:0/2201367026 learned_addr learned my addr 10.20.193.28:0/2201367026 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a268c4640 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069d72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a260c3640 1 -- 10.20.193.28:0/2201367026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 msgr2=0x55df069d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a260c3640 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069d5900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a260c3640 1 -- 10.20.193.28:0/2201367026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 msgr2=0x55df069d72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a260c3640 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069d72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a260c3640 1 -- 10.20.193.28:0/2201367026 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df06846b40 con 0x55df069b6410 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a268c4640 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069d72a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.795+0000 7f3a258c2640 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069d5900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f3a260c3640 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069d53c0 secure :-1 s=READY pgs=544 gs=1 cs=0 l=1 c_cookie=17144083853863084960 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a10005e80 tx=0x7f3a1002fc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edec056e8d04e3a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f39d3fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f39d3fff640 1 -- 10.20.193.28:0/2201367026 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1005f040 con 0x55df069b6410 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f39d3fff640 1 -- 10.20.193.28:0/2201367026 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a1004eb60 con 0x55df069b6410 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f39d3fff640 1 -- 10.20.193.28:0/2201367026 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a10064b30 con 0x55df069b6410 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df0686e120 con 0x55df069b6410 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f39d3fff640 1 -- 10.20.193.28:0/2201367026 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f3a10064cc0 con 0x55df069b6410 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f39d3fff640 10 client.30890 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f3a2a348e00 10 client.30890 _ll_register_callbacks cb 0x55df06879b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a1003e040 con 0x55df069b6410 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f39d3fff640 1 -- 10.20.193.28:0/2201367026 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a100644a0 con 0x55df069b6410 2026-02-20T13:32:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f3a2a348e00 10 client.30890 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.796+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55df06858750 con 0x55df069b6410 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.797+0000 7f39d3fff640 1 -- 10.20.193.28:0/2201367026 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3a1004e680 con 0x55df069b6410 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.797+0000 7f3a2a348e00 10 client.30890 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.797+0000 7f3a2a348e00 10 client.30890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.797+0000 7f3a2a348e00 20 client.30890 populate_metadata read hostname 'trial028' 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.797+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55df06a23040 0x55df06a234b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.797+0000 7f3a2a348e00 4 client.30890 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.797+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55df06556220 con 0x55df06a23040 2026-02-20T13:32:37.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.797+0000 7f3a258c2640 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55df06a23040 0x55df06a234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:37.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.798+0000 7f3a258c2640 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55df06a23040 0x55df06a234b0 crc :-1 s=READY pgs=434 gs=4 cs=0 l=0 c_cookie=10024871216277088596 s_cookie=8967401613704083706 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1f7f41d53be954 server_cookie=7c729c419f18b8fa in_seq=0 out_seq=0 2026-02-20T13:32:37.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.798+0000 7f39d3fff640 10 client.30890 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f39d3fff640 1 -- 10.20.193.28:0/2201367026 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55df06556220 con 0x55df06a23040 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f39d3fff640 10 client.30890 handle_command_reply: tid=0 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 client.30890 shutdown 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 msgr2=0x55df069d53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069d53c0 secure :-1 s=READY pgs=544 gs=1 cs=0 l=1 c_cookie=17144083853863084960 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a10005e80 tx=0x7f3a1002fc30 comp rx=0 tx=0).stop 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 shutdown_connections 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55df06a23040 0x55df06a234b0 crc :-1 s=READY pgs=434 gs=4 cs=0 l=0 c_cookie=10024871216277088596 s_cookie=8967401613704083706 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55df069fb9c0 0x55df069d72a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55df069b6d20 0x55df069d5900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f39d3fff640 0 client.30890 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 --2- 10.20.193.28:0/2201367026 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55df069b6410 0x55df069d53c0 unknown :-1 s=CLOSED pgs=544 gs=1 cs=0 l=1 c_cookie=17144083853863084960 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 >> 10.20.193.28:0/2201367026 conn(0x55df06994910 msgr2=0x55df069fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 shutdown_connections 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 1 -- 10.20.193.28:0/2201367026 wait complete. 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.799+0000 7f3a2a348e00 20 client.30890 trim_cache size 0 max 16384 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "4435b8fc-2007-407a-981e-3d0dc011583c", 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 -- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39fc0b5760 msgr2=0x7f39fc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39fc0b5760 0x7f39fc0d5c10 secure :-1 s=READY pgs=642 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a100097e0 tx=0x7f3a1003a040 comp rx=0 tx=0).stop 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 -- 10.20.193.28:0/3878299906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a201556e0 msgr2=0x7f3a201677f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a201556e0 0x7f3a201677f0 secure :-1 s=READY pgs=432 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1c00f940 tx=0x7f3a1c00fe10 comp rx=0 tx=0).stop 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 -- 10.20.193.28:0/3878299906 shutdown_connections 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f39fc0b5760 0x7f39fc0d5c10 unknown :-1 s=CLOSED pgs=642 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3a201556e0 0x7f3a201677f0 unknown :-1 s=CLOSED pgs=432 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f3a20061840 0x7f3a20162420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 --2- 10.20.193.28:0/3878299906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a20060f30 0x7f3a20161ee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:37.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 -- 10.20.193.28:0/3878299906 >> 10.20.193.28:0/3878299906 conn(0x7f3a2005f830 msgr2=0x7f3a2010acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:37.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.800+0000 7f3a2834e640 1 -- 10.20.193.28:0/3878299906 shutdown_connections 2026-02-20T13:32:37.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:37.801+0000 7f3a2834e640 1 -- 10.20.193.28:0/3878299906 wait complete. 2026-02-20T13:32:37.936 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:32:38.122 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 -- 10.20.193.28:0/479272631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 msgr2=0x7fbc08114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 --2- 10.20.193.28:0/479272631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 0x7fbc08114ef0 secure :-1 s=READY pgs=435 gs=2 cs=0 l=1 c_cookie=18258027871444912658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbfc009890 tx=0x7fbbfc02f140 comp rx=0 tx=0).stop 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 -- 10.20.193.28:0/479272631 shutdown_connections 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 --2- 10.20.193.28:0/479272631 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc081156a0 0x7fbc08176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 --2- 10.20.193.28:0/479272631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 0x7fbc08114ef0 unknown :-1 s=CLOSED pgs=435 gs=2 cs=0 l=1 c_cookie=18258027871444912658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 --2- 10.20.193.28:0/479272631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc0810f4b0 0x7fbc0810f880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 -- 10.20.193.28:0/479272631 >> 10.20.193.28:0/479272631 conn(0x7fbc080ecda0 msgr2=0x7fbc0810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 -- 10.20.193.28:0/479272631 shutdown_connections 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.295+0000 7fbc0e713640 1 -- 10.20.193.28:0/479272631 wait complete. 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.296+0000 7fbc0e713640 1 Processor -- start 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.296+0000 7fbc0e713640 1 -- start start 2026-02-20T13:32:38.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.296+0000 7fbc0e713640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc0810f4b0 0x7fbc080f57a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.296+0000 7fbc0e713640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 0x7fbc08175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.296+0000 7fbc0e713640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc081156a0 0x7fbc080f5ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0e713640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc080fb0b0 con 0x7fbc081156a0 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0e713640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fbc080fb220 con 0x7fbc0810f4b0 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0e713640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbc080fb3e0 con 0x7fbc0810fea0 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 0x7fbc08175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 0x7fbc08175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:36906/0 (socket says 10.20.193.28:36906) 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 -- 10.20.193.28:0/22357350 learned_addr learned my addr 10.20.193.28:0/22357350 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0d711640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc0810f4b0 0x7fbc080f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0df12640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc081156a0 0x7fbc080f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 -- 10.20.193.28:0/22357350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc0810f4b0 msgr2=0x7fbc080f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc0810f4b0 0x7fbc080f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 -- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc081156a0 msgr2=0x7fbc080f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc081156a0 0x7fbc080f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 -- 10.20.193.28:0/22357350 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf8009570 con 0x7fbc0810fea0 2026-02-20T13:32:38.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.297+0000 7fbc0cf10640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 0x7fbc08175f70 secure :-1 s=READY pgs=436 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbfc0097e0 tx=0x7fbbfc0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:38.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.298+0000 7fbbf67fc640 1 -- 10.20.193.28:0/22357350 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbbfc03d070 con 0x7fbc0810fea0 2026-02-20T13:32:38.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.298+0000 7fbbf67fc640 1 -- 10.20.193.28:0/22357350 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbbfc02fd90 con 0x7fbc0810fea0 2026-02-20T13:32:38.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.298+0000 7fbc0e713640 1 -- 10.20.193.28:0/22357350 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc0094b0 con 0x7fbc0810fea0 2026-02-20T13:32:38.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.298+0000 7fbbf67fc640 1 -- 10.20.193.28:0/22357350 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbbfc0386b0 con 0x7fbc0810fea0 2026-02-20T13:32:38.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.298+0000 7fbc0e713640 1 -- 10.20.193.28:0/22357350 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc080fb990 con 0x7fbc0810fea0 2026-02-20T13:32:38.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.300+0000 7fbbf67fc640 1 -- 10.20.193.28:0/22357350 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fbbfc049060 con 0x7fbc0810fea0 2026-02-20T13:32:38.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.302+0000 7fbbf67fc640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbbe40b5750 0x7fbbe40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.302+0000 7fbbf67fc640 1 -- 10.20.193.28:0/22357350 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbbfc10b360 con 0x7fbc0810fea0 2026-02-20T13:32:38.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.302+0000 7fbc0d711640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbbe40b5750 0x7fbbe40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.303+0000 7fbc0d711640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbbe40b5750 0x7fbbe40d5c00 secure :-1 s=READY pgs=643 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbf8005b30 tx=0x7fbbf8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:38.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.303+0000 7fbc11996e00 1 Processor -- start 2026-02-20T13:32:38.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.303+0000 7fbc11996e00 1 -- start start 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f26550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f6b400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f8bd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc11996e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557827e3c7d0 con 0x557827f26180 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc11996e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557827e38500 con 0x557827f6b940 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc11996e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557827e324a0 con 0x557827f26a90 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0df12640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f8bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0df12640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f8bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:40312/0 (socket says 10.20.193.28:40312) 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0cf10640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f6b400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0df12640 1 -- 10.20.193.28:0/1930523788 learned_addr learned my addr 10.20.193.28:0/1930523788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0d711640 1 --2- 10.20.193.28:0/1930523788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f26550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0df12640 1 -- 10.20.193.28:0/1930523788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 msgr2=0x557827f6b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0df12640 1 --2- 10.20.193.28:0/1930523788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f6b400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0df12640 1 -- 10.20.193.28:0/1930523788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 msgr2=0x557827f26550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:38.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0df12640 1 --2- 10.20.193.28:0/1930523788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f26550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.304+0000 7fbc0df12640 1 -- 10.20.193.28:0/1930523788 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557827dddd80 con 0x557827f6b940 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc0df12640 1 --2- 10.20.193.28:0/1930523788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f8bd20 secure :-1 s=READY pgs=545 gs=2 cs=0 l=1 c_cookie=6128574372257222671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc04005630 tx=0x7fbc04003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=550d11ebc5f4500f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbbd5ce5640 1 -- 10.20.193.28:0/1930523788 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc04003e30 con 0x557827f6b940 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbbd5ce5640 1 -- 10.20.193.28:0/1930523788 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbc04011910 con 0x557827f6b940 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbbd5ce5640 1 -- 10.20.193.28:0/1930523788 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc0401baa0 con 0x557827f6b940 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 -- 10.20.193.28:0/1930523788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 msgr2=0x557827f8bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 --2- 10.20.193.28:0/1930523788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f8bd20 secure :-1 s=READY pgs=545 gs=2 cs=0 l=1 c_cookie=6128574372257222671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc04005630 tx=0x7fbc04003c30 comp rx=0 tx=0).stop 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 -- 10.20.193.28:0/1930523788 shutdown_connections 2026-02-20T13:32:38.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 --2- 10.20.193.28:0/1930523788 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f8bd20 unknown :-1 s=CLOSED pgs=545 gs=2 cs=0 l=1 c_cookie=6128574372257222671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 --2- 10.20.193.28:0/1930523788 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f6b400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 --2- 10.20.193.28:0/1930523788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f26550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 -- 10.20.193.28:0/1930523788 >> 10.20.193.28:0/1930523788 conn(0x557827f04680 msgr2=0x557827f24a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:38.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 -- 10.20.193.28:0/1930523788 shutdown_connections 2026-02-20T13:32:38.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.305+0000 7fbc11996e00 1 -- 10.20.193.28:0/1930523788 wait complete. 2026-02-20T13:32:38.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.306+0000 7fbc11996e00 1 -- start start 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc11996e00 1 Processor -- start 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f26180 0x557827f273a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f278e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f6b940 0x557827f4c400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc11996e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557827f28200 con 0x557827f6b940 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc11996e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557827f4c940 con 0x557827f26180 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc11996e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557827f4cb00 con 0x557827f26a90 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc0df12640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f6b940 0x557827f4c400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc0df12640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f6b940 0x557827f4c400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56852/0 (socket says 10.20.193.28:56852) 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc0df12640 1 -- 10.20.193.28:0/3275465502 learned_addr learned my addr 10.20.193.28:0/3275465502 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:38.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc0cf10640 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.307+0000 7fbc0d711640 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f26180 0x557827f273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc0df12640 1 -- 10.20.193.28:0/3275465502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 msgr2=0x557827f278e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc0df12640 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f278e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc0df12640 1 -- 10.20.193.28:0/3275465502 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f26180 msgr2=0x557827f273a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc0df12640 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f26180 0x557827f273a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc0df12640 1 -- 10.20.193.28:0/3275465502 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557827db6350 con 0x557827f6b940 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc0df12640 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f6b940 0x557827f4c400 secure :-1 s=READY pgs=1550 gs=2 cs=0 l=1 c_cookie=11073814730946021073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc0400a530 tx=0x7fbc04006f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ae17d3828686d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbbc2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/3275465502 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc04021070 con 0x557827f6b940 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc040052d0 con 0x557827f6b940 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/3275465502 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbc04011a80 con 0x557827f6b940 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/3275465502 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc04025ac0 con 0x557827f6b940 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc11996e00 10 client.20976 _ll_register_callbacks cb 0x557827db39a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557827ac86f0 con 0x557827f6b940 2026-02-20T13:32:38.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/3275465502 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbc0402f440 con 0x557827f6b940 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/3275465502 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbc0401b690 con 0x557827f6b940 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc11996e00 10 client.20976 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.308+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557827dc8150 con 0x557827f6b940 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.309+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/3275465502 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbc0401a030 con 0x557827f6b940 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.309+0000 7fbc11996e00 10 client.20976 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.309+0000 7fbc11996e00 10 client.20976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.309+0000 7fbc11996e00 20 client.20976 populate_metadata read hostname 'trial028' 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.309+0000 7fbc11996e00 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557827f51300 0x557827f517a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.309+0000 7fbc11996e00 4 client.20976 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.309+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557827e3fd60 con 0x557827f51300 2026-02-20T13:32:38.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.309+0000 7fbc0d711640 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557827f51300 0x557827f517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc0d711640 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557827f51300 0x557827f517a0 crc :-1 s=READY pgs=435 gs=4 cs=0 l=0 c_cookie=14385191260832762011 s_cookie=4694023129288443700 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7a2773c57fd889b server_cookie=4124852a84b48734 in_seq=0 out_seq=0 2026-02-20T13:32:38.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbbc2ffd640 10 client.20976 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:38.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/3275465502 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557827e3fd60 con 0x557827f51300 2026-02-20T13:32:38.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbbc2ffd640 10 client.20976 handle_command_reply: tid=0 2026-02-20T13:32:38.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 client.20976 shutdown 2026-02-20T13:32:38.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f6b940 msgr2=0x557827f4c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f6b940 0x557827f4c400 secure :-1 s=READY pgs=1550 gs=2 cs=0 l=1 c_cookie=11073814730946021073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc0400a530 tx=0x7fbc04006f60 comp rx=0 tx=0).stop 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 shutdown_connections 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557827f51300 0x557827f517a0 crc :-1 s=READY pgs=435 gs=4 cs=0 l=0 c_cookie=14385191260832762011 s_cookie=4694023129288443700 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f6b940 0x557827f4c400 unknown :-1 s=CLOSED pgs=1550 gs=2 cs=0 l=1 c_cookie=11073814730946021073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f278e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 --2- 10.20.193.28:0/3275465502 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f26180 0x557827f273a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbbc2ffd640 0 client.20976 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 >> 10.20.193.28:0/3275465502 conn(0x557827f04680 msgr2=0x557827f24a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.310+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 shutdown_connections 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.311+0000 7fbc11996e00 1 -- 10.20.193.28:0/3275465502 wait complete. 2026-02-20T13:32:38.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.311+0000 7fbc11996e00 20 client.20976 trim_cache size 0 max 16384 2026-02-20T13:32:38.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.320+0000 7fbc11996e00 1 Processor -- start 2026-02-20T13:32:38.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.320+0000 7fbc11996e00 1 -- start start 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f88dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f89300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f6aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc11996e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557827e300d0 con 0x557827f26180 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc11996e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557827af0700 con 0x557827f6b940 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc11996e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557827e9a060 con 0x557827f26a90 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f88dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0cf10640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f89300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f88dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56854/0 (socket says 10.20.193.28:56854) 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 -- 10.20.193.28:0/856742349 learned_addr learned my addr 10.20.193.28:0/856742349 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0df12640 1 --2- 10.20.193.28:0/856742349 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f6aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 -- 10.20.193.28:0/856742349 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 msgr2=0x557827f89300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 --2- 10.20.193.28:0/856742349 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f89300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 -- 10.20.193.28:0/856742349 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 msgr2=0x557827f6aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:38.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 --2- 10.20.193.28:0/856742349 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f6aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 -- 10.20.193.28:0/856742349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557827dc2bd0 con 0x557827f26180 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbc0d711640 1 --2- 10.20.193.28:0/856742349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f88dc0 secure :-1 s=READY pgs=1551 gs=1 cs=0 l=1 c_cookie=2573455016214719569 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbf8004740 tx=0x7fbbf8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b6bfb3d6ecec51 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbbd54e4640 1 -- 10.20.193.28:0/856742349 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbbf801a470 con 0x557827f26180 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbbd54e4640 1 -- 10.20.193.28:0/856742349 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbbf8022040 con 0x557827f26180 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.321+0000 7fbbd54e4640 1 -- 10.20.193.28:0/856742349 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbbf8028c50 con 0x557827f26180 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 -- 10.20.193.28:0/856742349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 msgr2=0x557827f88dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 --2- 10.20.193.28:0/856742349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f88dc0 secure :-1 s=READY pgs=1551 gs=1 cs=0 l=1 c_cookie=2573455016214719569 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbf8004740 tx=0x7fbbf8014000 comp rx=0 tx=0).stop 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 -- 10.20.193.28:0/856742349 shutdown_connections 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 --2- 10.20.193.28:0/856742349 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f6aa60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 --2- 10.20.193.28:0/856742349 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26a90 0x557827f89300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 --2- 10.20.193.28:0/856742349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26180 0x557827f88dc0 unknown :-1 s=CLOSED pgs=1551 gs=1 cs=0 l=1 c_cookie=2573455016214719569 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 -- 10.20.193.28:0/856742349 >> 10.20.193.28:0/856742349 conn(0x557827f04680 msgr2=0x557827f273a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 -- 10.20.193.28:0/856742349 shutdown_connections 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 -- 10.20.193.28:0/856742349 wait complete. 2026-02-20T13:32:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.322+0000 7fbc11996e00 1 -- start start 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc11996e00 1 Processor -- start 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26180 0x557827f60a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26a90 0x557827f60fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc11996e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f614f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc11996e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557827f01100 con 0x557827f26a90 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc11996e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557827f51930 con 0x557827f6b940 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc11996e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557828020500 con 0x557827f26180 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0cf10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26a90 0x557827f60fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0cf10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26a90 0x557827f60fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56856/0 (socket says 10.20.193.28:56856) 2026-02-20T13:32:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0cf10640 1 -- 10.20.193.28:0/210928824 learned_addr learned my addr 10.20.193.28:0/210928824 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0d711640 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26180 0x557827f60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0df12640 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0cf10640 1 -- 10.20.193.28:0/210928824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26180 msgr2=0x557827f60a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0cf10640 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26180 0x557827f60a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0cf10640 1 -- 10.20.193.28:0/210928824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 msgr2=0x557827f614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0cf10640 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f614f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.323+0000 7fbc0cf10640 1 -- 10.20.193.28:0/210928824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557827db6680 con 0x557827f26a90 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc0cf10640 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26a90 0x557827f60fb0 secure :-1 s=READY pgs=1552 gs=1 cs=0 l=1 c_cookie=8920515887003498139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbfc0d16a0 tx=0x7fbbfc0049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcc09efb212769b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbbc2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/210928824 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbbfc0d1480 con 0x557827f26a90 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/210928824 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbbfc0d1770 con 0x557827f26a90 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf8003e20 con 0x557827f26a90 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/210928824 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbbfc0dc890 con 0x557827f26a90 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 10 client.20982 _ll_register_callbacks cb 0x557827db39a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc04011910 con 0x557827f26a90 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/210928824 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fbbfc0d2350 con 0x557827f26a90 2026-02-20T13:32:38.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/210928824 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbbfc0d2510 con 0x557827f26a90 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 10 client.20982 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557827dc83b0 con 0x557827f26a90 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/210928824 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbbfc0cf6a0 con 0x557827f26a90 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 10 client.20982 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 10 client.20982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 20 client.20982 populate_metadata read hostname 'trial028' 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557828021dc0 0x557828042270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 4 client.20982 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.324+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557827ac5f40 con 0x557828021dc0 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.325+0000 7fbc0d711640 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557828021dc0 0x557828042270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.325+0000 7fbc0d711640 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557828021dc0 0x557828042270 crc :-1 s=READY pgs=436 gs=4 cs=0 l=0 c_cookie=7185938805290509179 s_cookie=2447605478807454474 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b995454b09237b server_cookie=21f7a4370a9e430a in_seq=0 out_seq=0 2026-02-20T13:32:38.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.325+0000 7fbbc2ffd640 10 client.20982 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:38.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbbc2ffd640 1 -- 10.20.193.28:0/210928824 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7670 (crc 0 0 0) 0x557827ac5f40 con 0x557828021dc0 2026-02-20T13:32:38.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbbc2ffd640 10 client.20982 handle_command_reply: tid=0 2026-02-20T13:32:38.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 client.20982 shutdown 2026-02-20T13:32:38.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26a90 msgr2=0x557827f60fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26a90 0x557827f60fb0 secure :-1 s=READY pgs=1552 gs=1 cs=0 l=1 c_cookie=8920515887003498139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbfc0d16a0 tx=0x7fbbfc0049f0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 shutdown_connections 2026-02-20T13:32:38.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x557828021dc0 0x557828042270 crc :-1 s=READY pgs=436 gs=4 cs=0 l=0 c_cookie=7185938805290509179 s_cookie=2447605478807454474 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557827f26a90 0x557827f60fb0 unknown :-1 s=CLOSED pgs=1552 gs=1 cs=0 l=1 c_cookie=8920515887003498139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557827f6b940 0x557827f614f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 --2- 10.20.193.28:0/210928824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557827f26180 0x557827f60a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbbc2ffd640 0 client.20982 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:38.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 >> 10.20.193.28:0/210928824 conn(0x557827f04680 msgr2=0x557827f6aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:38.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.326+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 shutdown_connections 2026-02-20T13:32:38.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc11996e00 1 -- 10.20.193.28:0/210928824 wait complete. 2026-02-20T13:32:38.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc11996e00 20 client.20982 trim_cache size 0 max 16384 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "4435b8fc-2007-407a-981e-3d0dc011583c": { 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "4435b8fc-2007-407a-981e-3d0dc011583c", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.334 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.335 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "4435b8fc-2007-407a-981e-3d0dc011583c": { 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:32:37.798945+0000", 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:55.786578+0000", 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:32:38.337 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.338 INFO:teuthology.orchestra.run.trial028.stdout: "1c8316bb-7809-4c1a-a95f-688a16f4b82a": { 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:32:02.067864+0000", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:32:38.339 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 -- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbbe40b5750 msgr2=0x7fbbe40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbbe40b5750 0x7fbbe40d5c00 secure :-1 s=READY pgs=643 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbf8005b30 tx=0x7fbbf8009310 comp rx=0 tx=0).stop 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 -- 10.20.193.28:0/22357350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 msgr2=0x7fbc08175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 0x7fbc08175f70 secure :-1 s=READY pgs=436 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbbfc0097e0 tx=0x7fbbfc0028d0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 -- 10.20.193.28:0/22357350 shutdown_connections 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fbbe40b5750 0x7fbbe40d5c00 unknown :-1 s=CLOSED pgs=643 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc081156a0 0x7fbc080f5ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbc0810fea0 0x7fbc08175f70 unknown :-1 s=CLOSED pgs=436 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 --2- 10.20.193.28:0/22357350 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fbc0810f4b0 0x7fbc080f57a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 -- 10.20.193.28:0/22357350 >> 10.20.193.28:0/22357350 conn(0x7fbc080ecda0 msgr2=0x7fbc08111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 -- 10.20.193.28:0/22357350 shutdown_connections 2026-02-20T13:32:38.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:32:38.327+0000 7fbc0e713640 1 -- 10.20.193.28:0/22357350 wait complete. 2026-02-20T13:32:38.427 INFO:tasks.cephfs.filesystem:scrub status for tag:4435b8fc-2007-407a-981e-3d0dc011583c - {'path': '/', 'tag': '4435b8fc-2007-407a-981e-3d0dc011583c', 'options': 'recursive,force'} 2026-02-20T13:32:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: pgmap v640: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:32:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: scrub queued for path: / 2026-02-20T13:32:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:32:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:32:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: scrub summary: active paths [/] 2026-02-20T13:32:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:38.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:38 trial127 ceph-mon[43817]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: pgmap v640: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:32:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: scrub queued for path: / 2026-02-20T13:32:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:32:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:32:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: scrub summary: active paths [/] 2026-02-20T13:32:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:38.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:38 trial034 ceph-mon[43332]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: pgmap v640: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T13:32:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: scrub queued for path: / 2026-02-20T13:32:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:32:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:32:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: scrub summary: active paths [/] 2026-02-20T13:32:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:39.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:38 trial028 ceph-mon[37442]: scrub summary: idle+waiting paths [/] 2026-02-20T13:32:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:40 trial127 ceph-mon[43817]: pgmap v641: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 16 op/s 2026-02-20T13:32:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:40 trial034 ceph-mon[43332]: pgmap v641: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 16 op/s 2026-02-20T13:32:41.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:40 trial028 ceph-mon[37442]: pgmap v641: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 16 op/s 2026-02-20T13:32:42.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:42 trial127 ceph-mon[43817]: pgmap v642: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 17 op/s 2026-02-20T13:32:42.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:42 trial034 ceph-mon[43332]: pgmap v642: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 17 op/s 2026-02-20T13:32:43.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:42 trial028 ceph-mon[37442]: pgmap v642: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.0 KiB/s wr, 17 op/s 2026-02-20T13:32:43.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:43 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:32:43.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:43 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:32:43.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:43 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:32:43.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:43 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:32:44.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:43 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:32:44.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:43 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:32:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:44 trial127 ceph-mon[43817]: scrub summary: idle 2026-02-20T13:32:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:44 trial127 ceph-mon[43817]: pgmap v643: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:32:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:44 trial034 ceph-mon[43332]: scrub summary: idle 2026-02-20T13:32:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:44 trial034 ceph-mon[43332]: pgmap v643: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:32:45.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:44 trial028 ceph-mon[37442]: scrub summary: idle 2026-02-20T13:32:45.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:44 trial028 ceph-mon[37442]: pgmap v643: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 19 op/s 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.737+0000 7f78bbfff640 1 -- 10.20.193.28:0/1119509379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 msgr2=0x7f78bc1104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.737+0000 7f78bbfff640 1 --2- 10.20.193.28:0/1119509379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 0x7f78bc1104a0 secure :-1 s=READY pgs=1553 gs=1 cs=0 l=1 c_cookie=17417465267935195421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78b00098c0 tx=0x7f78b002f0e0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 -- 10.20.193.28:0/1119509379 shutdown_connections 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 --2- 10.20.193.28:0/1119509379 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78bc10f2f0 0x7f78bc171080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 --2- 10.20.193.28:0/1119509379 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78bc10e940 0x7f78bc10edb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 --2- 10.20.193.28:0/1119509379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 0x7f78bc1104a0 unknown :-1 s=CLOSED pgs=1553 gs=1 cs=0 l=1 c_cookie=17417465267935195421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 -- 10.20.193.28:0/1119509379 >> 10.20.193.28:0/1119509379 conn(0x7f78bc0ec320 msgr2=0x7f78bc10c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 -- 10.20.193.28:0/1119509379 shutdown_connections 2026-02-20T13:32:45.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 -- 10.20.193.28:0/1119509379 wait complete. 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 Processor -- start 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.738+0000 7f78bbfff640 1 -- start start 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78bbfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78bc10e940 0x7f78bc0f8250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78bbfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78bc10f2f0 0x7f78bc171080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 0x7f78bc0f8ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78bbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc0f96a0 con 0x7f78bc1100b0 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78bbfff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc0f9810 con 0x7f78bc10f2f0 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78bbfff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc0f99d0 con 0x7f78bc10e940 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78baffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78bc10e940 0x7f78bc0f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78baffd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78bc10e940 0x7f78bc0f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:50662/0 (socket says 10.20.193.28:50662) 2026-02-20T13:32:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78baffd640 1 -- 10.20.193.28:0/2676631183 learned_addr learned my addr 10.20.193.28:0/2676631183 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78ba7fc640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78bc10f2f0 0x7f78bc171080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 0x7f78bc0f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78baffd640 1 -- 10.20.193.28:0/2676631183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78bc10f2f0 msgr2=0x7f78bc171080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78baffd640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78bc10f2f0 0x7f78bc171080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78baffd640 1 -- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 msgr2=0x7f78bc0f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78baffd640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 0x7f78bc0f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78baffd640 1 -- 10.20.193.28:0/2676631183 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b00094b0 con 0x7f78bc10e940 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.739+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 0x7f78bc0f8ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.740+0000 7f78baffd640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78bc10e940 0x7f78bc0f8250 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78b00023b0 tx=0x7f78b002fb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.740+0000 7f789bfff640 1 -- 10.20.193.28:0/2676631183 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78b003d070 con 0x7f78bc10e940 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.740+0000 7f789bfff640 1 -- 10.20.193.28:0/2676631183 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78b00044f0 con 0x7f78bc10e940 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.740+0000 7f78bbfff640 1 -- 10.20.193.28:0/2676631183 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78bc0f9c50 con 0x7f78bc10e940 2026-02-20T13:32:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.740+0000 7f78bbfff640 1 -- 10.20.193.28:0/2676631183 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78bc0fa0c0 con 0x7f78bc10e940 2026-02-20T13:32:45.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.740+0000 7f789bfff640 1 -- 10.20.193.28:0/2676631183 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78b00388c0 con 0x7f78bc10e940 2026-02-20T13:32:45.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.743+0000 7f789bfff640 1 -- 10.20.193.28:0/2676631183 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f78b0038a20 con 0x7f78bc10e940 2026-02-20T13:32:45.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f789bfff640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78900b56e0 0x7f78900d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f789bfff640 1 -- 10.20.193.28:0/2676631183 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f78b010b460 con 0x7f78bc10e940 2026-02-20T13:32:45.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78ba7fc640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78900b56e0 0x7f78900d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78ba7fc640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78900b56e0 0x7f78900d5b90 secure :-1 s=READY pgs=644 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78a4004740 tx=0x7f78a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:45.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78c3a47e00 1 Processor -- start 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78c3a47e00 1 -- start start 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3764c0 0x55d46b3968a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b3b71c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3b7700 0x55d46b3d7ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d46b28bfd0 con 0x55d46b3764c0 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d46b287d00 con 0x55d46b396de0 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d46b281ca0 con 0x55d46b3b7700 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3764c0 0x55d46b3968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3764c0 0x55d46b3968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53964/0 (socket says 10.20.193.28:53964) 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78baffd640 1 -- 10.20.193.28:0/1916534106 learned_addr learned my addr 10.20.193.28:0/1916534106 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78ba7fc640 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b3b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3b7700 0x55d46b3d7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78baffd640 1 -- 10.20.193.28:0/1916534106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3b7700 msgr2=0x55d46b3d7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78baffd640 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3b7700 0x55d46b3d7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78baffd640 1 -- 10.20.193.28:0/1916534106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 msgr2=0x55d46b3b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78baffd640 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b3b71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.746+0000 7f78baffd640 1 -- 10.20.193.28:0/1916534106 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b2248b0 con 0x55d46b3764c0 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78baffd640 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3764c0 0x55d46b3968a0 secure :-1 s=READY pgs=1554 gs=1 cs=0 l=1 c_cookie=2955370106747895014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78b0108f30 tx=0x7f78b002f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2903957430843ce6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78993fe640 1 -- 10.20.193.28:0/1916534106 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78b00d74e0 con 0x55d46b3764c0 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78993fe640 1 -- 10.20.193.28:0/1916534106 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78b00d9ac0 con 0x55d46b3764c0 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78993fe640 1 -- 10.20.193.28:0/1916534106 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78b00cdbc0 con 0x55d46b3764c0 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1916534106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3764c0 msgr2=0x55d46b3968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3764c0 0x55d46b3968a0 secure :-1 s=READY pgs=1554 gs=1 cs=0 l=1 c_cookie=2955370106747895014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78b0108f30 tx=0x7f78b002f0e0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1916534106 shutdown_connections 2026-02-20T13:32:45.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3b7700 0x55d46b3d7ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b3b71c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1916534106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3764c0 0x55d46b3968a0 unknown :-1 s=CLOSED pgs=1554 gs=1 cs=0 l=1 c_cookie=2955370106747895014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1916534106 >> 10.20.193.28:0/1916534106 conn(0x55d46b2951c0 msgr2=0x55d46b374da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:45.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1916534106 shutdown_connections 2026-02-20T13:32:45.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.747+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1916534106 wait complete. 2026-02-20T13:32:45.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.748+0000 7f78c3a47e00 1 -- start start 2026-02-20T13:32:45.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78c3a47e00 1 Processor -- start 2026-02-20T13:32:45.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b38f930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b38ff80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3909e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d46b391040 con 0x55d46b3b7700 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d46b3911b0 con 0x55d46b3764c0 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d46b391370 con 0x55d46b396de0 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78bb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3909e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78ba7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b38ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78bb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3909e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53966/0 (socket says 10.20.193.28:53966) 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78bb7fe640 1 -- 10.20.193.28:0/179154810 learned_addr learned my addr 10.20.193.28:0/179154810 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.749+0000 7f78baffd640 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b38f930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78bb7fe640 1 -- 10.20.193.28:0/179154810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 msgr2=0x55d46b38ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:45.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b38ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78bb7fe640 1 -- 10.20.193.28:0/179154810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 msgr2=0x55d46b38f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:45.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b38f930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78bb7fe640 1 -- 10.20.193.28:0/179154810 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b22d400 con 0x55d46b3b7700 2026-02-20T13:32:45.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78ba7fc640 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b38ff80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:45.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3909e0 secure :-1 s=READY pgs=1555 gs=3 cs=0 l=1 c_cookie=5357780362621481351 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78ac005410 tx=0x7f78ac00aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5aa8da629df187 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:45.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f7884bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:45.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f7884bfc640 1 -- 10.20.193.28:0/179154810 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78ac005930 con 0x55d46b3b7700 2026-02-20T13:32:45.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f7884bfc640 1 -- 10.20.193.28:0/179154810 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78ac006020 con 0x55d46b3b7700 2026-02-20T13:32:45.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f7884bfc640 1 -- 10.20.193.28:0/179154810 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78ac011a80 con 0x55d46b3b7700 2026-02-20T13:32:45.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78bc0fa0c0 con 0x55d46b3b7700 2026-02-20T13:32:45.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f7884bfc640 1 -- 10.20.193.28:0/179154810 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f78ac011c10 con 0x55d46b3b7700 2026-02-20T13:32:45.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78c3a47e00 10 client.20994 _ll_register_callbacks cb 0x55d46b20ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.750+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d46af21520 con 0x55d46b3b7700 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f7884bfc640 1 -- 10.20.193.28:0/179154810 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f78ac011e10 con 0x55d46b3b7700 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78c3a47e00 10 client.20994 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d46b205da0 con 0x55d46b3b7700 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f7884bfc640 1 -- 10.20.193.28:0/179154810 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f78ac005a90 con 0x55d46b3b7700 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78c3a47e00 10 client.20994 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78c3a47e00 10 client.20994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78c3a47e00 20 client.20994 populate_metadata read hostname 'trial028' 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d46b394090 0x55d46b394530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78c3a47e00 4 client.20994 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:45.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d46b2b3630 con 0x55d46b394090 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.751+0000 7f78baffd640 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d46b394090 0x55d46b394530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.752+0000 7f78baffd640 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d46b394090 0x55d46b394530 crc :-1 s=READY pgs=437 gs=4 cs=0 l=0 c_cookie=17134895135366735321 s_cookie=12317992077395129306 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edcb60574f1a65d9 server_cookie=aaf24c87e73673da in_seq=0 out_seq=0 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.752+0000 7f7884bfc640 10 client.20994 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f7884bfc640 1 -- 10.20.193.28:0/179154810 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d46b2b3630 con 0x55d46b394090 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f7884bfc640 10 client.20994 handle_command_reply: tid=0 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 client.20994 shutdown 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 msgr2=0x55d46b3909e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3909e0 secure :-1 s=READY pgs=1555 gs=3 cs=0 l=1 c_cookie=5357780362621481351 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78ac005410 tx=0x7f78ac00aac0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 shutdown_connections 2026-02-20T13:32:45.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d46b394090 0x55d46b394530 crc :-1 s=READY pgs=437 gs=4 cs=0 l=0 c_cookie=17134895135366735321 s_cookie=12317992077395129306 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3909e0 unknown :-1 s=CLOSED pgs=1555 gs=3 cs=0 l=1 c_cookie=5357780362621481351 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b38ff80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/179154810 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b38f930 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f7884bfc640 0 client.20994 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:45.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 >> 10.20.193.28:0/179154810 conn(0x55d46b2951c0 msgr2=0x55d46b377790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:45.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 shutdown_connections 2026-02-20T13:32:45.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 1 -- 10.20.193.28:0/179154810 wait complete. 2026-02-20T13:32:45.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.753+0000 7f78c3a47e00 20 client.20994 trim_cache size 0 max 16384 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.762+0000 7f78c3a47e00 1 Processor -- start 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.762+0000 7f78c3a47e00 1 -- start start 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.762+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b3817f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.762+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b3b55c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.762+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3b5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.762+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d46b27f8d0 con 0x55d46b3b7700 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.762+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d46afc0f10 con 0x55d46b3764c0 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.762+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d46b2e5490 con 0x55d46b396de0 2026-02-20T13:32:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b3817f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b3817f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:49300/0 (socket says 10.20.193.28:49300) 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78ba7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b3b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 -- 10.20.193.28:0/760994015 learned_addr learned my addr 10.20.193.28:0/760994015 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 -- 10.20.193.28:0/760994015 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 msgr2=0x55d46b3b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b3b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 -- 10.20.193.28:0/760994015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 msgr2=0x55d46b3b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 -- 10.20.193.28:0/760994015 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b381fc0 con 0x55d46b3764c0 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3b5b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:32:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.763+0000 7f78baffd640 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b3817f0 secure :-1 s=READY pgs=546 gs=1 cs=0 l=1 c_cookie=1815429720000737728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78b00d1a30 tx=0x7f78b003a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1931b3b63754b1c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:45.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f7898bfd640 1 -- 10.20.193.28:0/760994015 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78b00cda30 con 0x55d46b3764c0 2026-02-20T13:32:45.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f7898bfd640 1 -- 10.20.193.28:0/760994015 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78b00cda30 con 0x55d46b3764c0 2026-02-20T13:32:45.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 -- 10.20.193.28:0/760994015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 msgr2=0x55d46b3817f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b3817f0 secure :-1 s=READY pgs=546 gs=1 cs=0 l=1 c_cookie=1815429720000737728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78b00d1a30 tx=0x7f78b003a040 comp rx=0 tx=0).stop 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 -- 10.20.193.28:0/760994015 shutdown_connections 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b3b5b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b396de0 0x55d46b3b55c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/760994015 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b3764c0 0x55d46b3817f0 unknown :-1 s=CLOSED pgs=546 gs=1 cs=0 l=1 c_cookie=1815429720000737728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 -- 10.20.193.28:0/760994015 >> 10.20.193.28:0/760994015 conn(0x55d46b2951c0 msgr2=0x55d46b38bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 -- 10.20.193.28:0/760994015 shutdown_connections 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.764+0000 7f78c3a47e00 1 -- 10.20.193.28:0/760994015 wait complete. 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.765+0000 7f78c3a47e00 1 -- start start 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.765+0000 7f78c3a47e00 1 Processor -- start 2026-02-20T13:32:45.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3764c0 0x55d46b41d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b41d7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78c3a47e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b41bf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d46b287d00 con 0x55d46b3b7700 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d46b41c680 con 0x55d46b396de0 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78c3a47e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d46b41c840 con 0x55d46b3764c0 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78ba7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b41d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78ba7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b41d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:49312/0 (socket says 10.20.193.28:49312) 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78ba7fc640 1 -- 10.20.193.28:0/1851434660 learned_addr learned my addr 10.20.193.28:0/1851434660 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b41bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78baffd640 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3764c0 0x55d46b41d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78bb7fe640 1 -- 10.20.193.28:0/1851434660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3764c0 msgr2=0x55d46b41d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3764c0 0x55d46b41d150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78bb7fe640 1 -- 10.20.193.28:0/1851434660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 msgr2=0x55d46b41d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b41d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.766+0000 7f78bb7fe640 1 -- 10.20.193.28:0/1851434660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b2248b0 con 0x55d46b3b7700 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f78bb7fe640 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b41bf80 secure :-1 s=READY pgs=1556 gs=1 cs=0 l=1 c_cookie=2993304106659622663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78ac005f50 tx=0x7f78ac004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298a5a39ce2a2f07 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f7884bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f7884bfc640 1 -- 10.20.193.28:0/1851434660 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78ac02c070 con 0x55d46b3b7700 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f7884bfc640 1 -- 10.20.193.28:0/1851434660 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78ac02d040 con 0x55d46b3b7700 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f7884bfc640 1 -- 10.20.193.28:0/1851434660 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78ac011670 con 0x55d46b3b7700 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac019040 con 0x55d46b3b7700 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f78c3a47e00 10 client.21000 _ll_register_callbacks cb 0x55d46b20ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:45.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d46b331ca0 con 0x55d46b3b7700 2026-02-20T13:32:45.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f7884bfc640 1 -- 10.20.193.28:0/1851434660 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f78ac01c3e0 con 0x55d46b3b7700 2026-02-20T13:32:45.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f7884bfc640 1 -- 10.20.193.28:0/1851434660 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f78ac01c5a0 con 0x55d46b3b7700 2026-02-20T13:32:45.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f78c3a47e00 10 client.21000 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:45.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.767+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d46b217670 con 0x55d46b3b7700 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.768+0000 7f7884bfc640 1 -- 10.20.193.28:0/1851434660 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f78ac0117d0 con 0x55d46b3b7700 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.768+0000 7f78c3a47e00 10 client.21000 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.768+0000 7f78c3a47e00 10 client.21000 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.768+0000 7f78c3a47e00 20 client.21000 populate_metadata read hostname 'trial028' 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.768+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d46b397a40 0x55d46b397ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.768+0000 7f78c3a47e00 4 client.21000 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.768+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d46af65640 con 0x55d46b397a40 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.768+0000 7f78baffd640 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d46b397a40 0x55d46b397ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.769+0000 7f78baffd640 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d46b397a40 0x55d46b397ee0 crc :-1 s=READY pgs=438 gs=4 cs=0 l=0 c_cookie=9343972692309658398 s_cookie=17010088437064500162 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81ac75a83c114b1e server_cookie=ec0ff94f693583c2 in_seq=0 out_seq=0 2026-02-20T13:32:45.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.769+0000 7f7884bfc640 10 client.21000 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:45.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.773+0000 7f7884bfc640 1 -- 10.20.193.28:0/1851434660 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d46af65640 con 0x55d46b397a40 2026-02-20T13:32:45.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.773+0000 7f7884bfc640 10 client.21000 handle_command_reply: tid=0 2026-02-20T13:32:45.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.773+0000 7f78c3a47e00 1 client.21000 shutdown 2026-02-20T13:32:45.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 msgr2=0x55d46b41bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b41bf80 secure :-1 s=READY pgs=1556 gs=1 cs=0 l=1 c_cookie=2993304106659622663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78ac005f50 tx=0x7f78ac004ee0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 shutdown_connections 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d46b397a40 0x55d46b397ee0 crc :-1 s=READY pgs=438 gs=4 cs=0 l=0 c_cookie=9343972692309658398 s_cookie=17010088437064500162 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46b3b7700 0x55d46b41bf80 unknown :-1 s=CLOSED pgs=1556 gs=1 cs=0 l=1 c_cookie=2993304106659622663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d46b396de0 0x55d46b41d7f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 --2- 10.20.193.28:0/1851434660 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d46b3764c0 0x55d46b41d150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 >> 10.20.193.28:0/1851434660 conn(0x55d46b2951c0 msgr2=0x55d46b38c460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f7884bfc640 0 client.21000 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 shutdown_connections 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 1 -- 10.20.193.28:0/1851434660 wait complete. 2026-02-20T13:32:45.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.774+0000 7f78c3a47e00 20 client.21000 trim_cache size 0 max 16384 2026-02-20T13:32:45.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:32:45.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:32:45.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:32:45.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:32:45.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 -- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78900b56e0 msgr2=0x7f78900d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78900b56e0 0x7f78900d5b90 secure :-1 s=READY pgs=644 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78a4004740 tx=0x7f78a4005f90 comp rx=0 tx=0).stop 2026-02-20T13:32:45.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 -- 10.20.193.28:0/2676631183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78bc10e940 msgr2=0x7f78bc0f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:45.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78bc10e940 0x7f78bc0f8250 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78b00023b0 tx=0x7f78b002fb70 comp rx=0 tx=0).stop 2026-02-20T13:32:45.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 -- 10.20.193.28:0/2676631183 shutdown_connections 2026-02-20T13:32:45.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f78900b56e0 0x7f78900d5b90 unknown :-1 s=CLOSED pgs=644 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78bc1100b0 0x7f78bc0f8ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f78bc10f2f0 0x7f78bc171080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 --2- 10.20.193.28:0/2676631183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78bc10e940 0x7f78bc0f8250 unknown :-1 s=CLOSED pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:45.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 -- 10.20.193.28:0/2676631183 >> 10.20.193.28:0/2676631183 conn(0x7f78bc0ec320 msgr2=0x7f78bc0ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:45.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 -- 10.20.193.28:0/2676631183 shutdown_connections 2026-02-20T13:32:45.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:45.775+0000 7f78bbfff640 1 -- 10.20.193.28:0/2676631183 wait complete. 2026-02-20T13:32:45.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:45 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:32:45.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:45 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:32:46.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:45 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:32:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:46 trial127 ceph-mon[43817]: pgmap v644: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2026-02-20T13:32:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:32:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:32:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:32:46.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:32:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:46 trial034 ceph-mon[43332]: pgmap v644: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2026-02-20T13:32:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:32:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:32:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:32:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:32:47.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:46 trial028 ceph-mon[37442]: pgmap v644: 97 pgs: 97 active+clean; 2.8 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2026-02-20T13:32:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:32:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:32:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:32:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:32:48.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:47 trial028 ceph-mon[37442]: pgmap v645: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:32:48.227 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:47 trial127 ceph-mon[43817]: pgmap v645: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:32:48.241 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:47 trial034 ceph-mon[43332]: pgmap v645: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 19 op/s 2026-02-20T13:32:50.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:50 trial028 ceph-mon[37442]: pgmap v646: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2026-02-20T13:32:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:50 trial127 ceph-mon[43817]: pgmap v646: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2026-02-20T13:32:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:50 trial034 ceph-mon[43332]: pgmap v646: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2026-02-20T13:32:52.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:52 trial028 ceph-mon[37442]: pgmap v647: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:32:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:52 trial127 ceph-mon[43817]: pgmap v647: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:32:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:52 trial034 ceph-mon[43332]: pgmap v647: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2026-02-20T13:32:54.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:54 trial028 ceph-mon[37442]: pgmap v648: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:32:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:54 trial127 ceph-mon[43817]: pgmap v648: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:32:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:54 trial034 ceph-mon[43332]: pgmap v648: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:32:56.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:56 trial028 ceph-mon[37442]: pgmap v649: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 6.9 KiB/s wr, 16 op/s 2026-02-20T13:32:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:56 trial127 ceph-mon[43817]: pgmap v649: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 6.9 KiB/s wr, 16 op/s 2026-02-20T13:32:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:56 trial034 ceph-mon[43332]: pgmap v649: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 6.9 KiB/s wr, 16 op/s 2026-02-20T13:32:58.849 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:32:58 trial028 ceph-mon[37442]: pgmap v650: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.850+0000 7fb00bfff640 1 -- 10.20.193.28:0/2884335100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 msgr2=0x7fb00c10b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.850+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2884335100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 0x7fb00c10b2e0 secure :-1 s=READY pgs=1557 gs=2 cs=0 l=1 c_cookie=4084505093707574365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000009950 tx=0x7fb00002f190 comp rx=0 tx=0).stop 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 -- 10.20.193.28:0/2884335100 shutdown_connections 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2884335100 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb00c10c490 0x7fb00c10c910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2884335100 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb00c10b900 0x7fb00c10bd70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2884335100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 0x7fb00c10b2e0 unknown :-1 s=CLOSED pgs=1557 gs=2 cs=0 l=1 c_cookie=4084505093707574365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 -- 10.20.193.28:0/2884335100 >> 10.20.193.28:0/2884335100 conn(0x7fb00c0e8f40 msgr2=0x7fb00c109350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 -- 10.20.193.28:0/2884335100 shutdown_connections 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 -- 10.20.193.28:0/2884335100 wait complete. 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 Processor -- start 2026-02-20T13:32:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.851+0000 7fb00bfff640 1 -- start start 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 0x7fb00c0f4780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00bfff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb00c10b900 0x7fb00c0f4dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00bfff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb00c10c490 0x7fb00c0f59d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c0f6110 con 0x7fb00c0609a0 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00bfff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c0f6280 con 0x7fb00c10b900 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00bfff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c0f6440 con 0x7fb00c10c490 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 0x7fb00c0f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 0x7fb00c0f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49682/0 (socket says 10.20.193.28:49682) 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 -- 10.20.193.28:0/2667786383 learned_addr learned my addr 10.20.193.28:0/2667786383 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00b7fe640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb00c10c490 0x7fb00c0f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb00c10b900 0x7fb00c0f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 -- 10.20.193.28:0/2667786383 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb00c10c490 msgr2=0x7fb00c0f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb00c10c490 0x7fb00c0f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 -- 10.20.193.28:0/2667786383 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb00c10b900 msgr2=0x7fb00c0f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb00c10b900 0x7fb00c0f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 -- 10.20.193.28:0/2667786383 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb000009570 con 0x7fb00c0609a0 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00affd640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 0x7fb00c0f4780 secure :-1 s=READY pgs=1558 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000002d80 tx=0x7fb0000028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb0108c1640 1 -- 10.20.193.28:0/2667786383 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb00003d070 con 0x7fb00c0609a0 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb0108c1640 1 -- 10.20.193.28:0/2667786383 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb000002a40 con 0x7fb00c0609a0 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00bfff640 1 -- 10.20.193.28:0/2667786383 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00c0f66c0 con 0x7fb00c0609a0 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb0108c1640 1 -- 10.20.193.28:0/2667786383 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb000041cf0 con 0x7fb00c0609a0 2026-02-20T13:32:58.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.852+0000 7fb00bfff640 1 -- 10.20.193.28:0/2667786383 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00c0f6be0 con 0x7fb00c0609a0 2026-02-20T13:32:58.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.855+0000 7fb0108c1640 1 -- 10.20.193.28:0/2667786383 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb000038920 con 0x7fb00c0609a0 2026-02-20T13:32:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.857+0000 7fb0108c1640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fafe00b5760 0x7fafe00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.857+0000 7fb0108c1640 1 -- 10.20.193.28:0/2667786383 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb00010b550 con 0x7fb00c0609a0 2026-02-20T13:32:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.857+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fafe00b5760 0x7fafe00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.857+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fafe00b5760 0x7fafe00d5c10 secure :-1 s=READY pgs=645 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faff4004740 tx=0x7faff4005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb013eb0e00 1 Processor -- start 2026-02-20T13:32:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb013eb0e00 1 -- start start 2026-02-20T13:32:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d484c0 0x555dc4d688a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d68de0 0x555dc4d891c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4da9ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555dc4c5dfd0 con 0x555dc4d68de0 2026-02-20T13:32:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555dc4c59d00 con 0x555dc4d484c0 2026-02-20T13:32:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555dc4c53ca0 con 0x555dc4d89700 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d68de0 0x555dc4d891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4da9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d68de0 0x555dc4d891c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49694/0 (socket says 10.20.193.28:49694) 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00a7fc640 1 -- 10.20.193.28:0/4200287947 learned_addr learned my addr 10.20.193.28:0/4200287947 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00affd640 1 --2- 10.20.193.28:0/4200287947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d484c0 0x555dc4d688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00a7fc640 1 -- 10.20.193.28:0/4200287947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 msgr2=0x555dc4da9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/4200287947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4da9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00a7fc640 1 -- 10.20.193.28:0/4200287947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d484c0 msgr2=0x555dc4d688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/4200287947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d484c0 0x555dc4d688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.858+0000 7fb00a7fc640 1 -- 10.20.193.28:0/4200287947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc4bf68b0 con 0x555dc4d68de0 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/4200287947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d68de0 0x555dc4d891c0 secure :-1 s=READY pgs=1559 gs=1 cs=0 l=1 c_cookie=10527557450178475399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faff40046f0 tx=0x7faff4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921965b93a67b587 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fafd77fe640 1 -- 10.20.193.28:0/4200287947 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faff401e460 con 0x555dc4d68de0 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fafd77fe640 1 -- 10.20.193.28:0/4200287947 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faff401eaa0 con 0x555dc4d68de0 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fafd77fe640 1 -- 10.20.193.28:0/4200287947 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faff4010bd0 con 0x555dc4d68de0 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 -- 10.20.193.28:0/4200287947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d68de0 msgr2=0x555dc4d891c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/4200287947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d68de0 0x555dc4d891c0 secure :-1 s=READY pgs=1559 gs=1 cs=0 l=1 c_cookie=10527557450178475399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faff40046f0 tx=0x7faff4012000 comp rx=0 tx=0).stop 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 -- 10.20.193.28:0/4200287947 shutdown_connections 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/4200287947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d68de0 0x555dc4d891c0 unknown :-1 s=CLOSED pgs=1559 gs=1 cs=0 l=1 c_cookie=10527557450178475399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/4200287947 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4da9ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/4200287947 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d484c0 0x555dc4d688a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 -- 10.20.193.28:0/4200287947 >> 10.20.193.28:0/4200287947 conn(0x555dc4c671c0 msgr2=0x555dc4d46da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:58.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 -- 10.20.193.28:0/4200287947 shutdown_connections 2026-02-20T13:32:58.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.859+0000 7fb013eb0e00 1 -- 10.20.193.28:0/4200287947 wait complete. 2026-02-20T13:32:58.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.860+0000 7fb013eb0e00 1 -- start start 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb013eb0e00 1 Processor -- start 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d68de0 0x555dc4d62140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d89700 0x555dc4d62ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555dc4d63200 con 0x555dc4d484c0 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555dc4d63370 con 0x555dc4d89700 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555dc4d63530 con 0x555dc4d68de0 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb00a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d68de0 0x555dc4d62140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb00affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb00a7fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d68de0 0x555dc4d62140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:43366/0 (socket says 10.20.193.28:43366) 2026-02-20T13:32:58.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb00affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49708/0 (socket says 10.20.193.28:49708) 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb00a7fc640 1 -- 10.20.193.28:0/3183490669 learned_addr learned my addr 10.20.193.28:0/3183490669 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.861+0000 7fb00b7fe640 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d89700 0x555dc4d62ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb00affd640 1 -- 10.20.193.28:0/3183490669 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d68de0 msgr2=0x555dc4d62140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb00affd640 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d68de0 0x555dc4d62140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb00affd640 1 -- 10.20.193.28:0/3183490669 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d89700 msgr2=0x555dc4d62ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb00affd640 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d89700 0x555dc4d62ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb00affd640 1 -- 10.20.193.28:0/3183490669 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc4bff400 con 0x555dc4d484c0 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb00affd640 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61af0 secure :-1 s=READY pgs=1560 gs=1 cs=0 l=1 c_cookie=14319086051474303183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000032040 tx=0x7fb0000417a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b79ce5e66068cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fafd4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fafd4ff9640 1 -- 10.20.193.28:0/3183490669 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0000d10b0 con 0x555dc4d484c0 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fafd4ff9640 1 -- 10.20.193.28:0/3183490669 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb000041410 con 0x555dc4d484c0 2026-02-20T13:32:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff400f9b0 con 0x555dc4d484c0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fafd4ff9640 1 -- 10.20.193.28:0/3183490669 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0000d16d0 con 0x555dc4d484c0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb013eb0e00 10 client.21012 _ll_register_callbacks cb 0x555dc4bdea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555dc48f3520 con 0x555dc4d484c0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fafd4ff9640 1 -- 10.20.193.28:0/3183490669 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb00010b2f0 con 0x555dc4d484c0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fafd4ff9640 1 -- 10.20.193.28:0/3183490669 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb0000d2540 con 0x555dc4d484c0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb013eb0e00 10 client.21012 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.862+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x555dc4bd7da0 con 0x555dc4d484c0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fafd4ff9640 1 -- 10.20.193.28:0/3183490669 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb0000dc560 con 0x555dc4d484c0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fb013eb0e00 10 client.21012 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fb013eb0e00 10 client.21012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fb013eb0e00 20 client.21012 populate_metadata read hostname 'trial028' 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555dc4d65f10 0x555dc4d663b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fb013eb0e00 4 client.21012 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dc4c85630 con 0x555dc4d65f10 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555dc4d65f10 0x555dc4d663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555dc4d65f10 0x555dc4d663b0 crc :-1 s=READY pgs=439 gs=4 cs=0 l=0 c_cookie=9008909775929974041 s_cookie=15447783388579129787 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d0613b5bfd99d19 server_cookie=d6618d25637069bb in_seq=0 out_seq=0 2026-02-20T13:32:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.863+0000 7fafd4ff9640 10 client.21012 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fafd4ff9640 1 -- 10.20.193.28:0/3183490669 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555dc4c85630 con 0x555dc4d65f10 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fafd4ff9640 10 client.21012 handle_command_reply: tid=0 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 client.21012 shutdown 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 msgr2=0x555dc4d61af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61af0 secure :-1 s=READY pgs=1560 gs=1 cs=0 l=1 c_cookie=14319086051474303183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000032040 tx=0x7fb0000417a0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 shutdown_connections 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555dc4d65f10 0x555dc4d663b0 crc :-1 s=READY pgs=439 gs=4 cs=0 l=0 c_cookie=9008909775929974041 s_cookie=15447783388579129787 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d89700 0x555dc4d62ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d68de0 0x555dc4d62140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/3183490669 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61af0 unknown :-1 s=CLOSED pgs=1560 gs=1 cs=0 l=1 c_cookie=14319086051474303183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fafd4ff9640 0 client.21012 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 >> 10.20.193.28:0/3183490669 conn(0x555dc4c671c0 msgr2=0x555dc4d49790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 shutdown_connections 2026-02-20T13:32:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 1 -- 10.20.193.28:0/3183490669 wait complete. 2026-02-20T13:32:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.864+0000 7fb013eb0e00 20 client.21012 trim_cache size 0 max 16384 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb013eb0e00 1 Processor -- start 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb013eb0e00 1 -- start start 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 0x555dc4d539b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4d875c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555dc4c518d0 con 0x555dc4d484c0 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555dc4992f10 con 0x555dc4d68de0 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555dc4d66540 con 0x555dc4d89700 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4d875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49724/0 (socket says 10.20.193.28:49724) 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00affd640 1 -- 10.20.193.28:0/2555739214 learned_addr learned my addr 10.20.193.28:0/2555739214 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 0x555dc4d539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00affd640 1 -- 10.20.193.28:0/2555739214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 msgr2=0x555dc4d875c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:58.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00affd640 1 --2- 10.20.193.28:0/2555739214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4d875c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00affd640 1 -- 10.20.193.28:0/2555739214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 msgr2=0x555dc4d539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00affd640 1 --2- 10.20.193.28:0/2555739214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 0x555dc4d539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.872+0000 7fb00affd640 1 -- 10.20.193.28:0/2555739214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc4d54180 con 0x555dc4d484c0 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb00affd640 1 --2- 10.20.193.28:0/2555739214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61960 secure :-1 s=READY pgs=1561 gs=2 cs=0 l=1 c_cookie=2888923015317284974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0000ceb20 tx=0x7fb0000ec000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2817842d1f6fe86e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fafd6ffd640 1 -- 10.20.193.28:0/2555739214 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0000d10b0 con 0x555dc4d484c0 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fafd6ffd640 1 -- 10.20.193.28:0/2555739214 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555dc48f3520 con 0x555dc4d484c0 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fafd6ffd640 1 -- 10.20.193.28:0/2555739214 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0000d9bb0 con 0x555dc4d484c0 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 -- 10.20.193.28:0/2555739214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 msgr2=0x555dc4d61960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/2555739214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61960 secure :-1 s=READY pgs=1561 gs=2 cs=0 l=1 c_cookie=2888923015317284974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0000ceb20 tx=0x7fb0000ec000 comp rx=0 tx=0).stop 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 -- 10.20.193.28:0/2555739214 shutdown_connections 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/2555739214 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4d875c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/2555739214 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 0x555dc4d539b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/2555739214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d61960 unknown :-1 s=CLOSED pgs=1561 gs=2 cs=0 l=1 c_cookie=2888923015317284974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 -- 10.20.193.28:0/2555739214 >> 10.20.193.28:0/2555739214 conn(0x555dc4c671c0 msgr2=0x555dc4d5de30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 -- 10.20.193.28:0/2555739214 shutdown_connections 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 -- 10.20.193.28:0/2555739214 wait complete. 2026-02-20T13:32:58.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.873+0000 7fb013eb0e00 1 -- start start 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb013eb0e00 1 Processor -- start 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d6a710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 0x555dc4d6adb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb013eb0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4d6b8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555dc4d633f0 con 0x555dc4d484c0 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555dc4c518d0 con 0x555dc4d68de0 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb013eb0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555dc4992f10 con 0x555dc4d89700 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d6a710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00a7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 0x555dc4d6adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d6a710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49730/0 (socket says 10.20.193.28:49730) 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00b7fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4d6b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 -- 10.20.193.28:0/421139578 learned_addr learned my addr 10.20.193.28:0/421139578 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 -- 10.20.193.28:0/421139578 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 msgr2=0x555dc4d6b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4d6b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 -- 10.20.193.28:0/421139578 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 msgr2=0x555dc4d6adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 0x555dc4d6adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 -- 10.20.193.28:0/421139578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc4be9670 con 0x555dc4d484c0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fb00affd640 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d6a710 secure :-1 s=READY pgs=1562 gs=1 cs=0 l=1 c_cookie=2835101338898189823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000038820 tx=0x7fb0000417a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27584da58f42cdff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.874+0000 7fafd4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fafd4ff9640 1 -- 10.20.193.28:0/421139578 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0000d10b0 con 0x555dc4d484c0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fafd4ff9640 1 -- 10.20.193.28:0/421139578 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb000041410 con 0x555dc4d484c0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fafd4ff9640 1 -- 10.20.193.28:0/421139578 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb000038c00 con 0x555dc4d484c0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff400f9b0 con 0x555dc4d484c0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fafd4ff9640 1 -- 10.20.193.28:0/421139578 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb000035320 con 0x555dc4d484c0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fafd4ff9640 10 client.21018 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 10 client.21018 _ll_register_callbacks cb 0x555dc4bdea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555dc4d03ca0 con 0x555dc4d484c0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fafd4ff9640 1 -- 10.20.193.28:0/421139578 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb000038d80 con 0x555dc4d484c0 2026-02-20T13:32:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 10 client.21018 fetch_fsmap learned FSMap version 30 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x555dc4be40f0 con 0x555dc4d484c0 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fafd4ff9640 1 -- 10.20.193.28:0/421139578 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb0000d8950 con 0x555dc4d484c0 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 10 client.21018 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 10 client.21018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 20 client.21018 populate_metadata read hostname 'trial028' 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555dc4d6d620 0x555dc4d6dac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 4 client.21018 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555dc4937640 con 0x555dc4d6d620 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.875+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555dc4d6d620 0x555dc4d6dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.876+0000 7fafd4ff9640 10 client.21018 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.876+0000 7fb00a7fc640 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555dc4d6d620 0x555dc4d6dac0 crc :-1 s=READY pgs=440 gs=4 cs=0 l=0 c_cookie=11042135150009005316 s_cookie=18367792362020676380 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=993d8b6a4a243504 server_cookie=fee781d62660231c in_seq=0 out_seq=0 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fafd4ff9640 1 -- 10.20.193.28:0/421139578 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555dc4937640 con 0x555dc4d6d620 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fafd4ff9640 10 client.21018 handle_command_reply: tid=0 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 client.21018 shutdown 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 msgr2=0x555dc4d6a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d6a710 secure :-1 s=READY pgs=1562 gs=1 cs=0 l=1 c_cookie=2835101338898189823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000038820 tx=0x7fb0000417a0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 shutdown_connections 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555dc4d6d620 0x555dc4d6dac0 crc :-1 s=READY pgs=440 gs=4 cs=0 l=0 c_cookie=11042135150009005316 s_cookie=18367792362020676380 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555dc4d89700 0x555dc4d6b8b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555dc4d68de0 0x555dc4d6adb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 --2- 10.20.193.28:0/421139578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dc4d484c0 0x555dc4d6a710 unknown :-1 s=CLOSED pgs=1562 gs=1 cs=0 l=1 c_cookie=2835101338898189823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 >> 10.20.193.28:0/421139578 conn(0x555dc4c671c0 msgr2=0x555dc4d5de30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fafd4ff9640 0 client.21018 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:32:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 shutdown_connections 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 1 -- 10.20.193.28:0/421139578 wait complete. 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb013eb0e00 20 client.21018 trim_cache size 0 max 16384 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb00bfff640 1 -- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fafe00b5760 msgr2=0x7fafe00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fafe00b5760 0x7fafe00d5c10 secure :-1 s=READY pgs=645 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faff4004740 tx=0x7faff4005d00 comp rx=0 tx=0).stop 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb00bfff640 1 -- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 msgr2=0x7fb00c0f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.880+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 0x7fb00c0f4780 secure :-1 s=READY pgs=1558 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000002d80 tx=0x7fb0000028d0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.881+0000 7fb00bfff640 1 -- 10.20.193.28:0/2667786383 shutdown_connections 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.881+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fafe00b5760 0x7fafe00d5c10 unknown :-1 s=CLOSED pgs=645 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.881+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb00c10c490 0x7fb00c0f59d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.881+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb00c10b900 0x7fb00c0f4dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.881+0000 7fb00bfff640 1 --2- 10.20.193.28:0/2667786383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb00c0609a0 0x7fb00c0f4780 unknown :-1 s=CLOSED pgs=1558 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.881+0000 7fb00bfff640 1 -- 10.20.193.28:0/2667786383 >> 10.20.193.28:0/2667786383 conn(0x7fb00c0e8f40 msgr2=0x7fb00c0eabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.881+0000 7fb00bfff640 1 -- 10.20.193.28:0/2667786383 shutdown_connections 2026-02-20T13:32:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T13:32:58.881+0000 7fb00bfff640 1 -- 10.20.193.28:0/2667786383 wait complete. 2026-02-20T13:32:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:32:58 trial127 ceph-mon[43817]: pgmap v650: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:32:58.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:32:58 trial034 ceph-mon[43332]: pgmap v650: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s 2026-02-20T13:33:00.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:00 trial028 ceph-mon[37442]: pgmap v651: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:33:00.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:00 trial127 ceph-mon[43817]: pgmap v651: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:33:00.740 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:00 trial034 ceph-mon[43332]: pgmap v651: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:33:02.024 INFO:tasks.workunit.client.0.trial028.stdout:561/600: open fd = 3 2026-02-20T13:33:02.024 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:562/600: open fd = 3 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:563/600: open fd = 3 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:564/600: open fd = 3 2026-02-20T13:33:02.025 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:565/600: open fd = 3 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:566/600: open fd = 3 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:567/600: open fd = 3 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.026 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:568/600: open fd = 3 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:569/600: open fd = 3 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:570/600: open fd = 3 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.027 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:571/600: open fd = 3 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:572/600: open fd = 3 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:573/600: open fd = 3 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.028 INFO:tasks.workunit.client.0.trial028.stdout:574/600: open fd = 3 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:575/600: open fd = 3 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:576/600: open fd = 3 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:577/600: open fd = 3 2026-02-20T13:33:02.029 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:578/600: open fd = 3 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:579/600: open fd = 3 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:580/600: open fd = 3 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.030 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:581/600: open fd = 3 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:582/600: open fd = 3 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:583/600: open fd = 3 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.031 INFO:tasks.workunit.client.0.trial028.stdout:584/600: open fd = 3 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:585/600: open fd = 3 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:586/600: open fd = 3 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.032 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:587/600: open fd = 3 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:588/600: open fd = 3 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:589/600: open fd = 3 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:590/600: open fd = 3 2026-02-20T13:33:02.033 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:591/600: open fd = 3 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:592/600: open fd = 3 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:593/600: open fd = 3 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.034 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:594/600: open fd = 3 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:595/600: open fd = 3 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:596/600: open fd = 3 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.035 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:597/600: open fd = 3 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:598/600: open fd = 3 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:599/600: open fd = 3 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.036 INFO:tasks.workunit.client.0.trial028.stdout:600/600: open fd = 3 2026-02-20T13:33:02.037 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.037 INFO:tasks.workunit.client.0.trial028.stdout:write ret = 32 2026-02-20T13:33:02.037 INFO:tasks.workunit.client.0.trial028.stdout:pread ret = 64 2026-02-20T13:33:02.037 INFO:tasks.workunit.client.0.trial028.stderr:+ echo OK 2026-02-20T13:33:02.038 INFO:tasks.workunit.client.0.trial028.stdout:OK 2026-02-20T13:33:02.039 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-20T13:33:02.039 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-20T13:33:02.110 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2026-02-20T13:33:02.110 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-20T13:33:02.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:02 trial028 ceph-mon[37442]: pgmap v652: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 16 op/s 2026-02-20T13:33:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:02 trial127 ceph-mon[43817]: pgmap v652: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 16 op/s 2026-02-20T13:33:02.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:02 trial034 ceph-mon[43332]: pgmap v652: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 16 op/s 2026-02-20T13:33:03.197 DEBUG:teuthology.parallel:result is None 2026-02-20T13:33:03.198 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T13:33:03.261 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T13:33:03.261 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2026-02-20T13:33:03.281 INFO:tasks.quiescer:joining Quiescers 2026-02-20T13:33:03.282 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2026-02-20T13:33:03.282 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:33:03.467 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:03.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 -- 10.20.193.28:0/757822529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f423c115420 msgr2=0x7f423c175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:03.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 --2- 10.20.193.28:0/757822529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f423c115420 0x7f423c175df0 secure :-1 s=READY pgs=1563 gs=1 cs=0 l=1 c_cookie=16653852776842281494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f423800aa30 tx=0x7f4238030270 comp rx=0 tx=0).stop 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 -- 10.20.193.28:0/757822529 shutdown_connections 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 --2- 10.20.193.28:0/757822529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f423c115420 0x7f423c175df0 unknown :-1 s=CLOSED pgs=1563 gs=1 cs=0 l=1 c_cookie=16653852776842281494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 --2- 10.20.193.28:0/757822529 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f423c10fc20 0x7f423c114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 --2- 10.20.193.28:0/757822529 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f423c10f230 0x7f423c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 -- 10.20.193.28:0/757822529 >> 10.20.193.28:0/757822529 conn(0x7f423c05f830 msgr2=0x7f423c10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 -- 10.20.193.28:0/757822529 shutdown_connections 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 -- 10.20.193.28:0/757822529 wait complete. 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 Processor -- start 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.645+0000 7f424368d640 1 -- start start 2026-02-20T13:33:03.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f424368d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f423c10f230 0x7f423c11db50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:03.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f424368d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f423c10fc20 0x7f423c11e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:03.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f424368d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f423c115420 0x7f423c123460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:03.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f424368d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f423c123a80 con 0x7f423c10fc20 2026-02-20T13:33:03.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f424368d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f423c123bf0 con 0x7f423c115420 2026-02-20T13:33:03.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f424368d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f423c123db0 con 0x7f423c10f230 2026-02-20T13:33:03.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241402640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f423c10f230 0x7f423c11db50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241402640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f423c10f230 0x7f423c11db50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35258/0 (socket says 10.20.193.28:35258) 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241402640 1 -- 10.20.193.28:0/1316891525 learned_addr learned my addr 10.20.193.28:0/1316891525 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241c03640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f423c115420 0x7f423c123460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4240c01640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f423c10fc20 0x7f423c11e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241402640 1 -- 10.20.193.28:0/1316891525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f423c115420 msgr2=0x7f423c123460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241402640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f423c115420 0x7f423c123460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241402640 1 -- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f423c10fc20 msgr2=0x7f423c11e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241402640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f423c10fc20 0x7f423c11e090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.646+0000 7f4241402640 1 -- 10.20.193.28:0/1316891525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423800a650 con 0x7f423c10f230 2026-02-20T13:33:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.647+0000 7f4241402640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f423c10f230 0x7f423c11db50 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f422c005db0 tx=0x7f422c00ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.647+0000 7f422a7fc640 1 -- 10.20.193.28:0/1316891525 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f422c004500 con 0x7f423c10f230 2026-02-20T13:33:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.647+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423c124090 con 0x7f423c10f230 2026-02-20T13:33:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.647+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423c164790 con 0x7f423c10f230 2026-02-20T13:33:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.647+0000 7f422a7fc640 1 -- 10.20.193.28:0/1316891525 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f422c004d30 con 0x7f423c10f230 2026-02-20T13:33:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.647+0000 7f422a7fc640 1 -- 10.20.193.28:0/1316891525 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f422c005330 con 0x7f423c10f230 2026-02-20T13:33:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.647+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423c110510 con 0x7f423c10f230 2026-02-20T13:33:03.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.649+0000 7f422a7fc640 1 -- 10.20.193.28:0/1316891525 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f422c0098c0 con 0x7f423c10f230 2026-02-20T13:33:03.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.651+0000 7f422a7fc640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42180b5760 0x7f42180d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:03.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.651+0000 7f422a7fc640 1 -- 10.20.193.28:0/1316891525 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f422c0e6bf0 con 0x7f423c10f230 2026-02-20T13:33:03.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.651+0000 7f422a7fc640 1 -- 10.20.193.28:0/1316891525 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f422c11f730 con 0x7f423c10f230 2026-02-20T13:33:03.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.651+0000 7f4240c01640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42180b5760 0x7f42180d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:03.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.652+0000 7f4240c01640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42180b5760 0x7f42180d5c10 secure :-1 s=READY pgs=646 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f423c1244f0 tx=0x7f423000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:03.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.793+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f423c10f600 con 0x7f423c10f230 2026-02-20T13:33:03.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.793+0000 7f422a7fc640 1 -- 10.20.193.28:0/1316891525 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f422c0a95a0 con 0x7f423c10f230 2026-02-20T13:33:03.796 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:03.796 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T13:30:03:634696+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:30:03.347707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24622,24655,24659,24677,24692]},"id":1}]} 2026-02-20T13:33:03.796 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42180b5760 msgr2=0x7f42180d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42180b5760 0x7f42180d5c10 secure :-1 s=READY pgs=646 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f423c1244f0 tx=0x7f423000b410 comp rx=0 tx=0).stop 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f423c10f230 msgr2=0x7f423c11db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f423c10f230 0x7f423c11db50 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f422c005db0 tx=0x7f422c00ddf0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 shutdown_connections 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f42180b5760 0x7f42180d5c10 unknown :-1 s=CLOSED pgs=646 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f423c10fc20 0x7f423c11e090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f423c115420 0x7f423c123460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 --2- 10.20.193.28:0/1316891525 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f423c10f230 0x7f423c11db50 unknown :-1 s=CLOSED pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 >> 10.20.193.28:0/1316891525 conn(0x7f423c05f830 msgr2=0x7f423c10cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 shutdown_connections 2026-02-20T13:33:03.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:03.795+0000 7f424368d640 1 -- 10.20.193.28:0/1316891525 wait complete. 2026-02-20T13:33:03.897 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24692 quiesce db --cancel --all' 2026-02-20T13:33:03.897 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- timeout 105 ceph tell mds.24692 quiesce db --cancel --all 2026-02-20T13:33:04.084 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:04.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1350378359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f281188a0 msgr2=0x7f8f2811d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1350378359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f281188a0 0x7f8f2811d8f0 secure :-1 s=READY pgs=1564 gs=1 cs=0 l=1 c_cookie=8896464803206113548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f10009950 tx=0x7f8f1002f190 comp rx=0 tx=0).stop 2026-02-20T13:33:04.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1350378359 shutdown_connections 2026-02-20T13:33:04.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1350378359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f281188a0 0x7f8f2811d8f0 unknown :-1 s=CLOSED pgs=1564 gs=1 cs=0 l=1 c_cookie=8896464803206113548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1350378359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f2811e0a0 0x7f8f2817ea70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1350378359 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f28117eb0 0x7f8f28118280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1350378359 >> 10.20.193.28:0/1350378359 conn(0x7f8f280f5780 msgr2=0x7f8f28115b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:04.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1350378359 shutdown_connections 2026-02-20T13:33:04.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.265+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1350378359 wait complete. 2026-02-20T13:33:04.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f2c8c4640 1 Processor -- start 2026-02-20T13:33:04.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f2c8c4640 1 -- start start 2026-02-20T13:33:04.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f2c8c4640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f28117eb0 0x7f8f280fe1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f2c8c4640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f281188a0 0x7f8f2817e970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f2c8c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2811e0a0 0x7f8f280fe8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f2c8c4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f28103ab0 con 0x7f8f2811e0a0 2026-02-20T13:33:04.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f2c8c4640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8f28103c20 con 0x7f8f28117eb0 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f2c8c4640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8f28103de0 con 0x7f8f281188a0 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f26d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f28117eb0 0x7f8f280fe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f26d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f28117eb0 0x7f8f280fe1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52710/0 (socket says 10.20.193.28:52710) 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f26d76640 1 -- 10.20.193.28:0/1033674130 learned_addr learned my addr 10.20.193.28:0/1033674130 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.266+0000 7f8f26575640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f281188a0 0x7f8f2817e970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f27577640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2811e0a0 0x7f8f280fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f26d76640 1 -- 10.20.193.28:0/1033674130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f281188a0 msgr2=0x7f8f2817e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f26d76640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f281188a0 0x7f8f2817e970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f26d76640 1 -- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2811e0a0 msgr2=0x7f8f280fe8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f26d76640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2811e0a0 0x7f8f280fe8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f26d76640 1 -- 10.20.193.28:0/1033674130 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f10009570 con 0x7f8f28117eb0 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f27577640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2811e0a0 0x7f8f280fe8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f26d76640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f28117eb0 0x7f8f280fe1a0 secure :-1 s=READY pgs=547 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f1c009480 tx=0x7f8f1c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f07fff640 1 -- 10.20.193.28:0/1033674130 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f1c00cd40 con 0x7f8f28117eb0 2026-02-20T13:33:04.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f07fff640 1 -- 10.20.193.28:0/1033674130 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f1c004d30 con 0x7f8f28117eb0 2026-02-20T13:33:04.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f07fff640 1 -- 10.20.193.28:0/1033674130 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f1c0106b0 con 0x7f8f28117eb0 2026-02-20T13:33:04.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1033674130 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f281040c0 con 0x7f8f28117eb0 2026-02-20T13:33:04.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.267+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1033674130 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f28104540 con 0x7f8f28117eb0 2026-02-20T13:33:04.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.271+0000 7f8f07fff640 1 -- 10.20.193.28:0/1033674130 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8f1c01f060 con 0x7f8f28117eb0 2026-02-20T13:33:04.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.272+0000 7f8f07fff640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8efc0b57d0 0x7f8efc0d5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.272+0000 7f8f07fff640 1 -- 10.20.193.28:0/1033674130 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8f1c014070 con 0x7f8f28117eb0 2026-02-20T13:33:04.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.272+0000 7f8f26575640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8efc0b57d0 0x7f8efc0d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f2f0bfe00 1 Processor -- start 2026-02-20T13:33:04.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f2f0bfe00 1 -- start start 2026-02-20T13:33:04.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6dc140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b720de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b721320 0x55a52b741700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a52b666c00 con 0x55a52b721320 2026-02-20T13:33:04.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a52b5f2090 con 0x55a52b6dc680 2026-02-20T13:33:04.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a52b5eddc0 con 0x55a52b6dbd70 2026-02-20T13:33:04.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f26575640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8efc0b57d0 0x7f8efc0d5c80 secure :-1 s=READY pgs=647 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f28104b40 tx=0x7f8f1003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:04.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f27577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b721320 0x55a52b741700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f27577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b721320 0x55a52b741700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44878/0 (socket says 10.20.193.28:44878) 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f27577640 1 -- 10.20.193.28:0/3309635163 learned_addr learned my addr 10.20.193.28:0/3309635163 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f26d76640 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6dc140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f26575640 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b720de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f27577640 1 -- 10.20.193.28:0/3309635163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 msgr2=0x55a52b6dc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f27577640 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6dc140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f27577640 1 -- 10.20.193.28:0/3309635163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 msgr2=0x55a52b720de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f27577640 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b720de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f27577640 1 -- 10.20.193.28:0/3309635163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52b593140 con 0x55a52b721320 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.273+0000 7f8f26d76640 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6dc140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:04.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f27577640 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b721320 0x55a52b741700 secure :-1 s=READY pgs=1565 gs=1 cs=0 l=1 c_cookie=9980837355145751918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f180051b0 tx=0x7f8f18011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a830eb19a696d6e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:04.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8ef37fe640 1 -- 10.20.193.28:0/3309635163 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f18011e60 con 0x55a52b721320 2026-02-20T13:33:04.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8ef37fe640 1 -- 10.20.193.28:0/3309635163 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f18005e10 con 0x55a52b721320 2026-02-20T13:33:04.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8ef37fe640 1 -- 10.20.193.28:0/3309635163 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f180136d0 con 0x55a52b721320 2026-02-20T13:33:04.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3309635163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b721320 msgr2=0x55a52b741700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b721320 0x55a52b741700 secure :-1 s=READY pgs=1565 gs=1 cs=0 l=1 c_cookie=9980837355145751918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f180051b0 tx=0x7f8f18011740 comp rx=0 tx=0).stop 2026-02-20T13:33:04.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3309635163 shutdown_connections 2026-02-20T13:33:04.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b721320 0x55a52b741700 unknown :-1 s=CLOSED pgs=1565 gs=1 cs=0 l=1 c_cookie=9980837355145751918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b720de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/3309635163 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6dc140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3309635163 >> 10.20.193.28:0/3309635163 conn(0x55a52b6b6740 msgr2=0x55a52b6da650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:04.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3309635163 shutdown_connections 2026-02-20T13:33:04.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.274+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3309635163 wait complete. 2026-02-20T13:33:04.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f2f0bfe00 1 -- start start 2026-02-20T13:33:04.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f2f0bfe00 1 Processor -- start 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6f3d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b6f42c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b721320 0x55a52b6f6050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a52b2a5700 con 0x55a52b6dbd70 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a52b6f65f0 con 0x55a52b6dc680 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a52b6f67b0 con 0x55a52b721320 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f26575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b6f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f27577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b721320 0x55a52b6f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f26575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b6f42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52734/0 (socket says 10.20.193.28:52734) 2026-02-20T13:33:04.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.276+0000 7f8f26575640 1 -- 10.20.193.28:0/1330070727 learned_addr learned my addr 10.20.193.28:0/1330070727 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f26d76640 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f27577640 1 -- 10.20.193.28:0/1330070727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 msgr2=0x55a52b6f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f27577640 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b6f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f27577640 1 -- 10.20.193.28:0/1330070727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 msgr2=0x55a52b6f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f27577640 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f27577640 1 -- 10.20.193.28:0/1330070727 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52b56b750 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f26d76640 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6f3d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f27577640 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b721320 0x55a52b6f6050 secure :-1 s=READY pgs=439 gs=3 cs=0 l=1 c_cookie=11348468236239054191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f180066d0 tx=0x7f8f18011ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d7ddbbbedd5256f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8ef0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/1330070727 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f18005a40 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/1330070727 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f18013660 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/1330070727 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f18027b40 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f18003860 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.277+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/1330070727 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8f18027cd0 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 10 client.30814 _ll_register_callbacks cb 0x55a52b568da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a52b33f4a0 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/1330070727 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8f18027e90 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 10 client.30814 fetch_fsmap learned FSMap version 30 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55a52b57d510 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/1330070727 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8f18019030 con 0x55a52b721320 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 10 client.30814 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 10 client.30814 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 20 client.30814 populate_metadata read hostname 'trial028' 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a52b71e280 0x55a52b71e720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 4 client.30814 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:04.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a52b5dd960 con 0x55a52b71e280 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.278+0000 7f8f26d76640 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a52b71e280 0x55a52b71e720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.279+0000 7f8f26d76640 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a52b71e280 0x55a52b71e720 crc :-1 s=READY pgs=441 gs=4 cs=0 l=0 c_cookie=5524000204844546601 s_cookie=12852231067299279045 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ca930eb3cf1ba29 server_cookie=b25c4c0fc99cf0c5 in_seq=0 out_seq=0 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.279+0000 7f8ef0ff9640 10 client.30814 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.279+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/1330070727 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a52b5dd960 con 0x55a52b71e280 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.279+0000 7f8ef0ff9640 10 client.30814 handle_command_reply: tid=0 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.279+0000 7f8f2f0bfe00 1 client.30814 shutdown 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b721320 msgr2=0x55a52b6f6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b721320 0x55a52b6f6050 secure :-1 s=READY pgs=439 gs=3 cs=0 l=1 c_cookie=11348468236239054191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f180066d0 tx=0x7f8f18011ef0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 shutdown_connections 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a52b71e280 0x55a52b71e720 crc :-1 s=READY pgs=441 gs=4 cs=0 l=0 c_cookie=5524000204844546601 s_cookie=12852231067299279045 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b721320 0x55a52b6f6050 unknown :-1 s=CLOSED pgs=439 gs=3 cs=0 l=1 c_cookie=11348468236239054191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b6dc680 0x55a52b6f42c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/1330070727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6f3d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 >> 10.20.193.28:0/1330070727 conn(0x55a52b6b6740 msgr2=0x55a52b6dad60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8ef0ff9640 0 client.30814 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 shutdown_connections 2026-02-20T13:33:04.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/1330070727 wait complete. 2026-02-20T13:33:04.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.280+0000 7f8f2f0bfe00 20 client.30814 trim_cache size 0 max 16384 2026-02-20T13:33:04.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.289+0000 7f8f2f0bfe00 1 Processor -- start 2026-02-20T13:33:04.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.289+0000 7f8f2f0bfe00 1 -- start start 2026-02-20T13:33:04.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.289+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6f5fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.289+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dc680 0x55a52b6daf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.289+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 0x55a52b6db4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.289+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a52b5e7f20 con 0x55a52b6dc680 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.289+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a52b5e5b50 con 0x55a52b721320 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.289+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a52b64af50 con 0x55a52b6dbd70 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dc680 0x55a52b6daf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35308/0 (socket says 10.20.193.28:35308) 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26d76640 1 -- 10.20.193.28:0/3663191434 learned_addr learned my addr 10.20.193.28:0/3663191434 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f27577640 1 --2- 10.20.193.28:0/3663191434 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 0x55a52b6db4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26575640 1 -- 10.20.193.28:0/3663191434 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 msgr2=0x55a52b6f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26575640 1 --2- 10.20.193.28:0/3663191434 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26575640 1 -- 10.20.193.28:0/3663191434 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 msgr2=0x55a52b6db4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26575640 1 --2- 10.20.193.28:0/3663191434 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 0x55a52b6db4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26575640 1 -- 10.20.193.28:0/3663191434 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52b6e6050 con 0x55a52b6dc680 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8f26575640 1 --2- 10.20.193.28:0/3663191434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dc680 0x55a52b6daf60 secure :-1 s=READY pgs=1566 gs=2 cs=0 l=1 c_cookie=6982229216574445196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a52b6e61e0 tx=0x7f8f10040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e5dc7aa246168c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8ef2ffd640 1 -- 10.20.193.28:0/3663191434 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f10002b00 con 0x55a52b6dc680 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8ef2ffd640 1 -- 10.20.193.28:0/3663191434 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f1003e040 con 0x55a52b6dc680 2026-02-20T13:33:04.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.290+0000 7f8ef2ffd640 1 -- 10.20.193.28:0/3663191434 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f10052880 con 0x55a52b6dc680 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3663191434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dc680 msgr2=0x55a52b6daf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/3663191434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dc680 0x55a52b6daf60 secure :-1 s=READY pgs=1566 gs=2 cs=0 l=1 c_cookie=6982229216574445196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a52b6e61e0 tx=0x7f8f10040000 comp rx=0 tx=0).stop 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3663191434 shutdown_connections 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/3663191434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dc680 0x55a52b6daf60 unknown :-1 s=CLOSED pgs=1566 gs=2 cs=0 l=1 c_cookie=6982229216574445196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/3663191434 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 0x55a52b6db4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/3663191434 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dbd70 0x55a52b6f5fe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3663191434 >> 10.20.193.28:0/3663191434 conn(0x55a52b6b6740 msgr2=0x55a52b6f1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3663191434 shutdown_connections 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/3663191434 wait complete. 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.291+0000 7f8f2f0bfe00 1 -- start start 2026-02-20T13:33:04.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f2f0bfe00 1 Processor -- start 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6eff80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dc680 0x55a52b6f04c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f2f0bfe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 0x55a52b6f0a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a52b6f0f70 con 0x55a52b6dbd70 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55a52b6f10e0 con 0x55a52b721320 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f2f0bfe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55a52b6f12a0 con 0x55a52b6dc680 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dc680 0x55a52b6f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6eff80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44914/0 (socket says 10.20.193.28:44914) 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26d76640 1 -- 10.20.193.28:0/2452350566 learned_addr learned my addr 10.20.193.28:0/2452350566 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:04.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f27577640 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 0x55a52b6f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26d76640 1 -- 10.20.193.28:0/2452350566 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dc680 msgr2=0x55a52b6f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26d76640 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dc680 0x55a52b6f04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26d76640 1 -- 10.20.193.28:0/2452350566 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 msgr2=0x55a52b6f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26d76640 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 0x55a52b6f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.292+0000 7f8f26d76640 1 -- 10.20.193.28:0/2452350566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52b577f90 con 0x55a52b6dbd70 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8f26d76640 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6eff80 secure :-1 s=READY pgs=1567 gs=2 cs=0 l=1 c_cookie=7155555036864403111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f1c0a9690 tx=0x7f8f1c0a8fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634da364ef0f56a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8ef0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/2452350566 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f1c0b2de0 con 0x55a52b6dbd70 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/2452350566 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f1c0b53c0 con 0x55a52b6dbd70 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/2452350566 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f1c0adfd0 con 0x55a52b6dbd70 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1004c040 con 0x55a52b6dbd70 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8f2f0bfe00 10 client.21039 _ll_register_callbacks cb 0x55a52b568da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a52b27b190 con 0x55a52b6dbd70 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/2452350566 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8f1c0a9330 con 0x55a52b6dbd70 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/2452350566 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8f1c0b8200 con 0x55a52b6dbd70 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8f2f0bfe00 10 client.21039 fetch_fsmap learned FSMap version 30 2026-02-20T13:33:04.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.293+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55a52b56ba80 con 0x55a52b6dbd70 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/2452350566 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8f1c0b7d70 con 0x55a52b6dbd70 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8f2f0bfe00 10 client.21039 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8f2f0bfe00 10 client.21039 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8f2f0bfe00 20 client.21039 populate_metadata read hostname 'trial028' 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a52b726660 0x55a52b726b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8f2f0bfe00 4 client.21039 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x7f8f18005e10 con 0x55a52b726660 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8f26575640 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a52b726660 0x55a52b726b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8f26575640 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a52b726660 0x55a52b726b00 crc :-1 s=READY pgs=442 gs=4 cs=0 l=0 c_cookie=3776826796013678636 s_cookie=2047755548977442598 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3469fbf5e292702c server_cookie=1c6b16d283a2af26 in_seq=0 out_seq=0 2026-02-20T13:33:04.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.294+0000 7f8ef0ff9640 10 client.21039 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8ef0ff9640 1 -- 10.20.193.28:0/2452350566 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x7f8f18005e10 con 0x55a52b726660 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8ef0ff9640 10 client.21039 handle_command_reply: tid=0 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 client.21039 shutdown 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 msgr2=0x55a52b6eff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6eff80 secure :-1 s=READY pgs=1567 gs=2 cs=0 l=1 c_cookie=7155555036864403111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f1c0a9690 tx=0x7f8f1c0a8fe0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 shutdown_connections 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55a52b726660 0x55a52b726b00 crc :-1 s=READY pgs=442 gs=4 cs=0 l=0 c_cookie=3776826796013678636 s_cookie=2047755548977442598 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55a52b721320 0x55a52b6f0a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55a52b6dc680 0x55a52b6f04c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 --2- 10.20.193.28:0/2452350566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a52b6dbd70 0x55a52b6eff80 unknown :-1 s=CLOSED pgs=1567 gs=2 cs=0 l=1 c_cookie=7155555036864403111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8ef0ff9640 0 client.21039 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 >> 10.20.193.28:0/2452350566 conn(0x55a52b6b6740 msgr2=0x55a52b6f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 shutdown_connections 2026-02-20T13:33:04.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 1 -- 10.20.193.28:0/2452350566 wait complete. 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.295+0000 7f8f2f0bfe00 20 client.21039 trim_cache size 0 max 16384 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24692, 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 56, 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stdout: "sets": {} 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8efc0b57d0 msgr2=0x7f8efc0d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8efc0b57d0 0x7f8efc0d5c80 secure :-1 s=READY pgs=647 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f28104b40 tx=0x7f8f1003a040 comp rx=0 tx=0).stop 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1033674130 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f28117eb0 msgr2=0x7f8f280fe1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f28117eb0 0x7f8f280fe1a0 secure :-1 s=READY pgs=547 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f1c009480 tx=0x7f8f1c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1033674130 shutdown_connections 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8efc0b57d0 0x7f8efc0d5c80 unknown :-1 s=CLOSED pgs=647 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2811e0a0 0x7f8f280fe8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8f281188a0 0x7f8f2817e970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 --2- 10.20.193.28:0/1033674130 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8f28117eb0 0x7f8f280fe1a0 unknown :-1 s=CLOSED pgs=547 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1033674130 >> 10.20.193.28:0/1033674130 conn(0x7f8f280f5780 msgr2=0x7f8f28116340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1033674130 shutdown_connections 2026-02-20T13:33:04.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:04.296+0000 7f8f2c8c4640 1 -- 10.20.193.28:0/1033674130 wait complete. 2026-02-20T13:33:04.396 INFO:tasks.quiescer:done joining Quiescers 2026-02-20T13:33:04.396 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2026-02-20T13:33:04.409 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@trial028.front.sepia.ceph.com 2026-02-20T13:33:04.418 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2026-02-20T13:33:04.433 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2026-02-20T13:33:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:04 trial028 ceph-mon[37442]: pgmap v653: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.9 KiB/s wr, 17 op/s 2026-02-20T13:33:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:04 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1316891525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:04 trial127 ceph-mon[43817]: pgmap v653: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.9 KiB/s wr, 17 op/s 2026-02-20T13:33:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:04 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1316891525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:04 trial034 ceph-mon[43332]: pgmap v653: 97 pgs: 97 active+clean; 2.9 MiB data, 334 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.9 KiB/s wr, 17 op/s 2026-02-20T13:33:04.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:04 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1316891525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:06 trial028 ceph-mon[37442]: pgmap v654: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T13:33:06.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:06 trial028 ceph-mon[37442]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:33:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:06 trial127 ceph-mon[43817]: pgmap v654: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T13:33:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:06 trial127 ceph-mon[43817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:33:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:06 trial034 ceph-mon[43332]: pgmap v654: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T13:33:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:06 trial034 ceph-mon[43332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-20T13:33:08.428 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T13:33:08.615 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:08.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:08 trial028 ceph-mon[37442]: pgmap v655: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 19 op/s 2026-02-20T13:33:08.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 -- 10.20.193.28:0/2300778654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0114990 msgr2=0x7fd6e01193f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 --2- 10.20.193.28:0/2300778654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0114990 0x7fd6e01193f0 secure :-1 s=READY pgs=1568 gs=1 cs=0 l=1 c_cookie=17236407007188663428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d4009950 tx=0x7fd6d402f190 comp rx=0 tx=0).stop 2026-02-20T13:33:08.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 -- 10.20.193.28:0/2300778654 shutdown_connections 2026-02-20T13:33:08.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 --2- 10.20.193.28:0/2300778654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0114990 0x7fd6e01193f0 unknown :-1 s=CLOSED pgs=1568 gs=1 cs=0 l=1 c_cookie=17236407007188663428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 --2- 10.20.193.28:0/2300778654 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6e0119ba0 0x7fd6e017a570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 --2- 10.20.193.28:0/2300778654 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6e0113fa0 0x7fd6e0114370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 -- 10.20.193.28:0/2300778654 >> 10.20.193.28:0/2300778654 conn(0x7fd6e0064a90 msgr2=0x7fd6e0064e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:08.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 -- 10.20.193.28:0/2300778654 shutdown_connections 2026-02-20T13:33:08.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 -- 10.20.193.28:0/2300778654 wait complete. 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.802+0000 7fd6e664d640 1 Processor -- start 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e664d640 1 -- start start 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e664d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6e0113fa0 0x7fd6e00fbbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e664d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6e0114990 0x7fd6e017a470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e664d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0119ba0 0x7fd6e00fc2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e664d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0101500 con 0x7fd6e0119ba0 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e664d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0101670 con 0x7fd6e0113fa0 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e664d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0101830 con 0x7fd6e0114990 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0119ba0 0x7fd6e00fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0119ba0 0x7fd6e00fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44936/0 (socket says 10.20.193.28:44936) 2026-02-20T13:33:08.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/1811330164 learned_addr learned my addr 10.20.193.28:0/1811330164 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e564b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6e0113fa0 0x7fd6e00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6e0114990 0x7fd6e017a470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/1811330164 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6e0114990 msgr2=0x7fd6e017a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6e0114990 0x7fd6e017a470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/1811330164 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6e0113fa0 msgr2=0x7fd6e00fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6e0113fa0 0x7fd6e00fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/1811330164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d4009570 con 0x7fd6e0119ba0 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e564b640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6e0113fa0 0x7fd6e00fbbf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.803+0000 7fd6e5e4c640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0119ba0 0x7fd6e00fc2f0 secure :-1 s=READY pgs=1569 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6dc006e90 tx=0x7fd6dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.804+0000 7fd6ce7fc640 1 -- 10.20.193.28:0/1811330164 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6dc005500 con 0x7fd6e0119ba0 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.804+0000 7fd6e664d640 1 -- 10.20.193.28:0/1811330164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e0101b10 con 0x7fd6e0119ba0 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.804+0000 7fd6ce7fc640 1 -- 10.20.193.28:0/1811330164 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6dc005e10 con 0x7fd6e0119ba0 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.804+0000 7fd6ce7fc640 1 -- 10.20.193.28:0/1811330164 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6dc003a90 con 0x7fd6e0119ba0 2026-02-20T13:33:08.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.804+0000 7fd6e664d640 1 -- 10.20.193.28:0/1811330164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e0101fe0 con 0x7fd6e0119ba0 2026-02-20T13:33:08.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.806+0000 7fd6ce7fc640 1 -- 10.20.193.28:0/1811330164 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd6dc003c20 con 0x7fd6e0119ba0 2026-02-20T13:33:08.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.808+0000 7fd6ce7fc640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6bc0b5750 0x7fd6bc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.808+0000 7fd6ce7fc640 1 -- 10.20.193.28:0/1811330164 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6dc0e7970 con 0x7fd6e0119ba0 2026-02-20T13:33:08.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.808+0000 7fd6e564b640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6bc0b5750 0x7fd6bc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.808+0000 7fd6e564b640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6bc0b5750 0x7fd6bc0d5c00 secure :-1 s=READY pgs=648 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d0005e30 tx=0x7fd6d0005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:08.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e98d0e00 1 Processor -- start 2026-02-20T13:33:08.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e98d0e00 1 -- start start 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 0x555e5f743550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743a90 0x555e5f788400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f788940 0x555e5f7a8d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555e5f6597d0 con 0x555e5f788940 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555e5f655500 con 0x555e5f743a90 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555e5f64f4a0 con 0x555e5f743180 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e5e4c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f788940 0x555e5f7a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e5e4c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f788940 0x555e5f7a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44938/0 (socket says 10.20.193.28:44938) 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/4146572710 learned_addr learned my addr 10.20.193.28:0/4146572710 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743a90 0x555e5f788400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e564b640 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 0x555e5f743550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/4146572710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 msgr2=0x555e5f743550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e5e4c640 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 0x555e5f743550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/4146572710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743a90 msgr2=0x555e5f788400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:08.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e5e4c640 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743a90 0x555e5f788400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.810+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/4146572710 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e5f5fad80 con 0x555e5f788940 2026-02-20T13:33:08.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e5e4c640 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f788940 0x555e5f7a8d20 secure :-1 s=READY pgs=1570 gs=1 cs=0 l=1 c_cookie=15867851747410302799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6dc0ab360 tx=0x7fd6dc005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc35ef17c0f3d74f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:08.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6adce5640 1 -- 10.20.193.28:0/4146572710 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6dc0ae590 con 0x555e5f788940 2026-02-20T13:33:08.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6adce5640 1 -- 10.20.193.28:0/4146572710 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6dc0d40e0 con 0x555e5f788940 2026-02-20T13:33:08.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6adce5640 1 -- 10.20.193.28:0/4146572710 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6dc0ae930 con 0x555e5f788940 2026-02-20T13:33:08.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/4146572710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f788940 msgr2=0x555e5f7a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f788940 0x555e5f7a8d20 secure :-1 s=READY pgs=1570 gs=1 cs=0 l=1 c_cookie=15867851747410302799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6dc0ab360 tx=0x7fd6dc005730 comp rx=0 tx=0).stop 2026-02-20T13:33:08.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/4146572710 shutdown_connections 2026-02-20T13:33:08.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f788940 0x555e5f7a8d20 unknown :-1 s=CLOSED pgs=1570 gs=1 cs=0 l=1 c_cookie=15867851747410302799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743a90 0x555e5f788400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/4146572710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 0x555e5f743550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/4146572710 >> 10.20.193.28:0/4146572710 conn(0x555e5f721680 msgr2=0x555e5f741a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:08.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/4146572710 shutdown_connections 2026-02-20T13:33:08.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.811+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/4146572710 wait complete. 2026-02-20T13:33:08.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.812+0000 7fd6e98d0e00 1 -- start start 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e98d0e00 1 Processor -- start 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743180 0x555e5f75b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f75bc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f788940 0x555e5f760c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555e5f7611a0 con 0x555e5f743a90 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555e5f761310 con 0x555e5f743180 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555e5f7614d0 con 0x555e5f788940 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e4e4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f75bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e5e4c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f788940 0x555e5f760c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e564b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743180 0x555e5f75b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e5e4c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f788940 0x555e5f760c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35342/0 (socket says 10.20.193.28:35342) 2026-02-20T13:33:08.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e5e4c640 1 -- 10.20.193.28:0/596712943 learned_addr learned my addr 10.20.193.28:0/596712943 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:08.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/596712943 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f788940 msgr2=0x555e5f760c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:08.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f788940 0x555e5f760c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/596712943 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743180 msgr2=0x555e5f75b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:08.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.813+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743180 0x555e5f75b730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/596712943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e5f5d3350 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f75bc70 secure :-1 s=READY pgs=1571 gs=1 cs=0 l=1 c_cookie=9014282592281150884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d4004820 tx=0x7fd6d40386a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d192a4209e7c5a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd69affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd69affd640 1 -- 10.20.193.28:0/596712943 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6d40026a0 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e0101fe0 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd6e98d0e00 10 client.21051 _ll_register_callbacks cb 0x555e5f5d09a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e5f2e56f0 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd69affd640 1 -- 10.20.193.28:0/596712943 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6d4002800 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd69affd640 1 -- 10.20.193.28:0/596712943 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6d40026a0 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd69affd640 1 -- 10.20.193.28:0/596712943 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6d404e450 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd69affd640 1 -- 10.20.193.28:0/596712943 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd6d404e610 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd6e98d0e00 10 client.21051 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.814+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x555e5f5e5150 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd69affd640 1 -- 10.20.193.28:0/596712943 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fd6d4002970 con 0x555e5f743a90 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd6e98d0e00 10 client.21051 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd6e98d0e00 10 client.21051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd6e98d0e00 20 client.21051 populate_metadata read hostname 'trial028' 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e5f785f00 0x555e5f7863a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd6e98d0e00 4 client.21051 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:08.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e5f65cd60 con 0x555e5f785f00 2026-02-20T13:33:08.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd6e564b640 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e5f785f00 0x555e5f7863a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd6e564b640 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e5f785f00 0x555e5f7863a0 crc :-1 s=READY pgs=444 gs=4 cs=0 l=0 c_cookie=15187196372034179879 s_cookie=1182816622726733920 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c3c2a29932d327 server_cookie=106a3573980de060 in_seq=0 out_seq=0 2026-02-20T13:33:08.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.815+0000 7fd69affd640 10 client.21051 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd69affd640 1 -- 10.20.193.28:0/596712943 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555e5f65cd60 con 0x555e5f785f00 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd69affd640 10 client.21051 handle_command_reply: tid=0 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 client.21051 shutdown 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 msgr2=0x555e5f75bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f75bc70 secure :-1 s=READY pgs=1571 gs=1 cs=0 l=1 c_cookie=9014282592281150884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d4004820 tx=0x7fd6d40386a0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 shutdown_connections 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e5f785f00 0x555e5f7863a0 crc :-1 s=READY pgs=444 gs=4 cs=0 l=0 c_cookie=15187196372034179879 s_cookie=1182816622726733920 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f75bc70 unknown :-1 s=CLOSED pgs=1571 gs=1 cs=0 l=1 c_cookie=9014282592281150884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f788940 0x555e5f760c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/596712943 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f743180 0x555e5f75b730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd69affd640 0 client.21051 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 >> 10.20.193.28:0/596712943 conn(0x555e5f721680 msgr2=0x555e5f742250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.816+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 shutdown_connections 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.817+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/596712943 wait complete. 2026-02-20T13:33:08.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.817+0000 7fd6e98d0e00 20 client.21051 trim_cache size 0 max 16384 2026-02-20T13:33:08.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e98d0e00 1 Processor -- start 2026-02-20T13:33:08.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e98d0e00 1 -- start start 2026-02-20T13:33:08.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 0x555e5f786c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f7871c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f787700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555e5f64d0d0 con 0x555e5f743a90 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555e5f30d700 con 0x555e5f788940 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555e5f761610 con 0x555e5f743180 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e4e4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f7871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e564b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 0x555e5f786c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e4e4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f7871c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44952/0 (socket says 10.20.193.28:44952) 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/3725941929 learned_addr learned my addr 10.20.193.28:0/3725941929 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e5e4c640 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f787700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/3725941929 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 msgr2=0x555e5f786c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 0x555e5f786c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/3725941929 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 msgr2=0x555e5f787700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:08.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f787700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/3725941929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e5f5dfbd0 con 0x555e5f743a90 2026-02-20T13:33:08.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.826+0000 7fd6e5e4c640 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f787700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:33:08.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f7871c0 secure :-1 s=READY pgs=1572 gs=1 cs=0 l=1 c_cookie=4658567825939713971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d40098a0 tx=0x7fd6d404b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a68ec16b334fb3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:08.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6ad4e4640 1 -- 10.20.193.28:0/3725941929 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6d404d3b0 con 0x555e5f743a90 2026-02-20T13:33:08.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6ad4e4640 1 -- 10.20.193.28:0/3725941929 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555e5f2e56f0 con 0x555e5f743a90 2026-02-20T13:33:08.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6ad4e4640 1 -- 10.20.193.28:0/3725941929 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6d404df00 con 0x555e5f743a90 2026-02-20T13:33:08.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/3725941929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 msgr2=0x555e5f7871c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f7871c0 secure :-1 s=READY pgs=1572 gs=1 cs=0 l=1 c_cookie=4658567825939713971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d40098a0 tx=0x7fd6d404b000 comp rx=0 tx=0).stop 2026-02-20T13:33:08.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/3725941929 shutdown_connections 2026-02-20T13:33:08.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743a90 0x555e5f7871c0 unknown :-1 s=CLOSED pgs=1572 gs=1 cs=0 l=1 c_cookie=4658567825939713971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f787700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/3725941929 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743180 0x555e5f786c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/3725941929 >> 10.20.193.28:0/3725941929 conn(0x555e5f721680 msgr2=0x555e5f757a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/3725941929 shutdown_connections 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.827+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/3725941929 wait complete. 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.828+0000 7fd6e98d0e00 1 -- start start 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.828+0000 7fd6e98d0e00 1 Processor -- start 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.828+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743180 0x555e5f765520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.828+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743a90 0x555e5f765a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.828+0000 7fd6e98d0e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f7ede70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.828+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555e5f782820 con 0x555e5f743180 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.828+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x555e5f784670 con 0x555e5f788940 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.828+0000 7fd6e98d0e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x555e5f7ee3b0 con 0x555e5f743a90 2026-02-20T13:33:08.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743a90 0x555e5f765a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e5e4c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f7ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743a90 0x555e5f765a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35366/0 (socket says 10.20.193.28:35366) 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/1400896927 learned_addr learned my addr 10.20.193.28:0/1400896927 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e564b640 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743180 0x555e5f765520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/1400896927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 msgr2=0x555e5f7ede70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f7ede70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/1400896927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743180 msgr2=0x555e5f765520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743180 0x555e5f765520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 -- 10.20.193.28:0/1400896927 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e5f5d3680 con 0x555e5f743a90 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e564b640 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743180 0x555e5f765520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e4e4a640 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743a90 0x555e5f765a60 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=15162348752401238087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d4009950 tx=0x7fd6d4004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d26b7bdb53768847 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:08.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd69affd640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd69affd640 1 -- 10.20.193.28:0/1400896927 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6d4005e80 con 0x555e5f743a90 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd69affd640 1 -- 10.20.193.28:0/1400896927 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6d4036860 con 0x555e5f743a90 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.829+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e5f5e5150 con 0x555e5f743a90 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd69affd640 1 -- 10.20.193.28:0/1400896927 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6d4037bf0 con 0x555e5f743a90 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 10 client.30838 _ll_register_callbacks cb 0x555e5f5d09a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6dc0d40e0 con 0x555e5f743a90 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd69affd640 1 -- 10.20.193.28:0/1400896927 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd6d404e450 con 0x555e5f743a90 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd69affd640 1 -- 10.20.193.28:0/1400896927 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd6d4038a50 con 0x555e5f743a90 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 10 client.30838 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=31}) -- 0x555e5f5e53b0 con 0x555e5f743a90 2026-02-20T13:33:08.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd69affd640 1 -- 10.20.193.28:0/1400896927 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fd6d4036370 con 0x555e5f743a90 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 10 client.30838 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 10 client.30838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 20 client.30838 populate_metadata read hostname 'trial028' 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e5f835dc0 0x555e5f856270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 4 client.30838 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555e5f2e2f40 con 0x555e5f835dc0 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.830+0000 7fd6e564b640 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e5f835dc0 0x555e5f856270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e564b640 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e5f835dc0 0x555e5f856270 crc :-1 s=READY pgs=445 gs=4 cs=0 l=0 c_cookie=17061273478999747896 s_cookie=1591984526957861052 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecc5d1d5ab92ad38 server_cookie=1617dd7e193dd8bc in_seq=0 out_seq=0 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd69affd640 10 client.30838 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd69affd640 1 -- 10.20.193.28:0/1400896927 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7474 (crc 0 0 0) 0x555e5f2e2f40 con 0x555e5f835dc0 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd69affd640 10 client.30838 handle_command_reply: tid=0 2026-02-20T13:33:08.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 client.30838 shutdown 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743a90 msgr2=0x555e5f765a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743a90 0x555e5f765a60 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=15162348752401238087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d4009950 tx=0x7fd6d4004320 comp rx=0 tx=0).stop 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 shutdown_connections 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x555e5f835dc0 0x555e5f856270 crc :-1 s=READY pgs=445 gs=4 cs=0 l=0 c_cookie=17061273478999747896 s_cookie=1591984526957861052 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x555e5f788940 0x555e5f7ede70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x555e5f743a90 0x555e5f765a60 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=15162348752401238087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd69affd640 0 client.30838 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 --2- 10.20.193.28:0/1400896927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555e5f743180 0x555e5f765520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 >> 10.20.193.28:0/1400896927 conn(0x555e5f721680 msgr2=0x555e5f758260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 shutdown_connections 2026-02-20T13:33:08.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.831+0000 7fd6e98d0e00 1 -- 10.20.193.28:0/1400896927 wait complete. 2026-02-20T13:33:08.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.832+0000 7fd6e98d0e00 20 client.30838 trim_cache size 0 max 16384 2026-02-20T13:33:08.840 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:33:08.840 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T13:33:08.840 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {}, 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_stats": { 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: "28b37070-4232-44fb-98df-3259633ee060": { 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:08.686349+0000", 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.841 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: "e217eec4-719c-444b-96c3-95c9c672b821": { 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:57.426192+0000", 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.842 INFO:teuthology.orchestra.run.trial028.stdout: "fd00bfa9-8409-4d07-98ec-91f808c4c54a": { 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:27:21.841115+0000", 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "10702b3a-12b5-4963-8b9c-fc9255732ea8": { 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:28:33.081270+0000", 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.843 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "4e1ec8ab-682b-4e53-85ff-f339a10e3aa6": { 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:10.634961+0000", 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.844 INFO:teuthology.orchestra.run.trial028.stdout: "0c437939-f452-4571-ad83-7ea1c854387d": { 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:25:34.944882+0000", 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "74e9be25-8d05-45c2-8488-6b7ae52cd775": { 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:59.197806+0000", 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.845 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "ba90d8e2-ded8-4dc6-9406-a5fe3b1ceda5": { 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:15.614765+0000", 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.846 INFO:teuthology.orchestra.run.trial028.stdout: "a2152168-91c4-42bf-a9fa-9c45db8a05d3": { 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:02.810017+0000", 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "bc028937-4d0d-43c2-ab15-dc51bb66bd30": { 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:17:51.562853+0000", 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.847 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "4435b8fc-2007-407a-981e-3d0dc011583c": { 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:32:37.798945+0000", 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "07bb91cb-dd88-47e7-8303-84c9b1588bc6": { 2026-02-20T13:33:08.848 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:55.786578+0000", 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "f0a289d9-6e3e-4203-a096-2c93fa2928ba": { 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:26:46.263039+0000", 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "7491cd79-13ba-483a-af06-a396aac7fb2a": { 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:21:25.314333+0000", 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "9dc67d71-e707-4884-aa48-2368952af421": { 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:18:27.207936+0000", 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.850 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "7c48936c-1512-47fd-8543-212e62d9a87e": { 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:14.172178+0000", 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "c4589a3f-bba1-4bc2-9899-286bfc82b52c": { 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:19:38.433100+0000", 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.851 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "21f44a7f-24c2-4406-8a6e-28b3985a89fb": { 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:24:23.670724+0000", 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "6ae96310-7779-4ab4-a7a8-f3ef99f8d4e7": { 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:20:49.733256+0000", 2026-02-20T13:33:08.852 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "1c8316bb-7809-4c1a-a95f-688a16f4b82a": { 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:32:02.067864+0000", 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "1131643e-ece2-4683-8f9e-ca44912d2c8c": { 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:00.977409+0000", 2026-02-20T13:33:08.853 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "ff70215d-9f90-4c31-8b7a-465fc8887428": { 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:22:36.587488+0000", 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "48221fde-7a9b-4975-8c4e-b3d11867b75c": { 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:12.286566+0000", 2026-02-20T13:33:08.854 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "cd6edbbf-4ed4-428f-a6b8-f9eee80308d1": { 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:30:20.064502+0000", 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "83957d65-b14a-4c38-b410-12bc5129367e": { 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:29:44.325427+0000", 2026-02-20T13:33:08.855 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "3c6ee257-65e6-4778-8f07-47859e3b574b": { 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "start_time": "2026-02-20T13:23:47.911647+0000", 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_passed": 0, 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_failed": 0, 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_skipped": 0 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:08.856 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:33:08.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.832+0000 7fd6e664d640 1 -- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6bc0b5750 msgr2=0x7fd6bc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.832+0000 7fd6e664d640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6bc0b5750 0x7fd6bc0d5c00 secure :-1 s=READY pgs=648 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d0005e30 tx=0x7fd6d0005dc0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.832+0000 7fd6e664d640 1 -- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0119ba0 msgr2=0x7fd6e00fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:08.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.832+0000 7fd6e664d640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0119ba0 0x7fd6e00fc2f0 secure :-1 s=READY pgs=1569 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6dc006e90 tx=0x7fd6dc00edf0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.834+0000 7fd6e664d640 1 -- 10.20.193.28:0/1811330164 shutdown_connections 2026-02-20T13:33:08.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.834+0000 7fd6e664d640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd6bc0b5750 0x7fd6bc0d5c00 unknown :-1 s=CLOSED pgs=648 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.834+0000 7fd6e664d640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6e0119ba0 0x7fd6e00fc2f0 unknown :-1 s=CLOSED pgs=1569 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.834+0000 7fd6e664d640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd6e0114990 0x7fd6e017a470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.834+0000 7fd6e664d640 1 --2- 10.20.193.28:0/1811330164 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd6e0113fa0 0x7fd6e00fbbf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:08.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.834+0000 7fd6e664d640 1 -- 10.20.193.28:0/1811330164 >> 10.20.193.28:0/1811330164 conn(0x7fd6e0064a90 msgr2=0x7fd6e01185b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:08.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.834+0000 7fd6e664d640 1 -- 10.20.193.28:0/1811330164 shutdown_connections 2026-02-20T13:33:08.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:08.834+0000 7fd6e664d640 1 -- 10.20.193.28:0/1811330164 wait complete. 2026-02-20T13:33:08.933 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T13:33:08.933 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:33:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:08 trial127 ceph-mon[43817]: pgmap v655: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 19 op/s 2026-02-20T13:33:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:08 trial034 ceph-mon[43332]: pgmap v655: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 19 op/s 2026-02-20T13:33:09.120 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 -- 10.20.193.28:0/616809589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 msgr2=0x7f237c152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 --2- 10.20.193.28:0/616809589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 0x7f237c152c40 secure :-1 s=READY pgs=1573 gs=1 cs=0 l=1 c_cookie=4135837411223905645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2368009950 tx=0x7f236802f190 comp rx=0 tx=0).stop 2026-02-20T13:33:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 -- 10.20.193.28:0/616809589 shutdown_connections 2026-02-20T13:33:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 --2- 10.20.193.28:0/616809589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 0x7f237c152c40 unknown :-1 s=CLOSED pgs=1573 gs=1 cs=0 l=1 c_cookie=4135837411223905645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 --2- 10.20.193.28:0/616809589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f237c153180 0x7f237c1735a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 --2- 10.20.193.28:0/616809589 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f237c10dbd0 0x7f237c10dfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 -- 10.20.193.28:0/616809589 >> 10.20.193.28:0/616809589 conn(0x7f237c0e95a0 msgr2=0x7f237c1099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 -- 10.20.193.28:0/616809589 shutdown_connections 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.296+0000 7f23835ab640 1 -- 10.20.193.28:0/616809589 wait complete. 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.297+0000 7f23835ab640 1 Processor -- start 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.297+0000 7f23835ab640 1 -- start start 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.297+0000 7f23835ab640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f237c10dbd0 0x7f237c10d3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.297+0000 7f23835ab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 0x7f237c10b940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.297+0000 7f23835ab640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f237c153180 0x7f237c10be80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.297+0000 7f23835ab640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f237c10c520 con 0x7f237c10e5c0 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.297+0000 7f23835ab640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f237c10c690 con 0x7f237c153180 2026-02-20T13:33:09.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.297+0000 7f23835ab640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f237c14ec00 con 0x7f237c10dbd0 2026-02-20T13:33:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f237c10dbd0 0x7f237c10d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f2381da8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 0x7f237c10b940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f237c10dbd0 0x7f237c10d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35382/0 (socket says 10.20.193.28:35382) 2026-02-20T13:33:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f2381da8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 0x7f237c10b940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44972/0 (socket says 10.20.193.28:44972) 2026-02-20T13:33:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 -- 10.20.193.28:0/1542151782 learned_addr learned my addr 10.20.193.28:0/1542151782 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:09.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f2382daa640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f237c153180 0x7f237c10be80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 -- 10.20.193.28:0/1542151782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f237c153180 msgr2=0x7f237c10be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f237c153180 0x7f237c10be80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 -- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 msgr2=0x7f237c10b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 0x7f237c10b940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 -- 10.20.193.28:0/1542151782 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2368009570 con 0x7f237c10dbd0 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.298+0000 7f23825a9640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f237c10dbd0 0x7f237c10d3c0 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2374009480 tx=0x7f237400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.299+0000 7f23677fe640 1 -- 10.20.193.28:0/1542151782 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f237400cd40 con 0x7f237c10dbd0 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.299+0000 7f23677fe640 1 -- 10.20.193.28:0/1542151782 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2374004d30 con 0x7f237c10dbd0 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.299+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c14eee0 con 0x7f237c10dbd0 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.299+0000 7f23677fe640 1 -- 10.20.193.28:0/1542151782 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f23740106b0 con 0x7f237c10dbd0 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.299+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c14f400 con 0x7f237c10dbd0 2026-02-20T13:33:09.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.299+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c060300 con 0x7f237c10dbd0 2026-02-20T13:33:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.302+0000 7f23677fe640 1 -- 10.20.193.28:0/1542151782 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f237401f060 con 0x7f237c10dbd0 2026-02-20T13:33:09.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.303+0000 7f23677fe640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23580b5760 0x7f23580d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.303+0000 7f23677fe640 1 -- 10.20.193.28:0/1542151782 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2374014070 con 0x7f237c10dbd0 2026-02-20T13:33:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.304+0000 7f2381da8640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23580b5760 0x7f23580d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.304+0000 7f23677fe640 1 -- 10.20.193.28:0/1542151782 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f237411f730 con 0x7f237c10dbd0 2026-02-20T13:33:09.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.304+0000 7f2381da8640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23580b5760 0x7f23580d5c10 secure :-1 s=READY pgs=649 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237c163890 tx=0x7f236803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:09.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.446+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f237c10cc40 con 0x7f237c10dbd0 2026-02-20T13:33:09.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.446+0000 7f23677fe640 1 -- 10.20.193.28:0/1542151782 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11997 (secure 0 0 0) 0x7f23740a9740 con 0x7f237c10dbd0 2026-02-20T13:33:09.449 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:09.449 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":31,"btime":"2026-02-20T13:33:05:585962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:33:05.040895+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[0],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:33:09.449 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 31 2026-02-20T13:33:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23580b5760 msgr2=0x7f23580d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23580b5760 0x7f23580d5c10 secure :-1 s=READY pgs=649 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237c163890 tx=0x7f236803a040 comp rx=0 tx=0).stop 2026-02-20T13:33:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f237c10dbd0 msgr2=0x7f237c10d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f237c10dbd0 0x7f237c10d3c0 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2374009480 tx=0x7f237400ee60 comp rx=0 tx=0).stop 2026-02-20T13:33:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 shutdown_connections 2026-02-20T13:33:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23580b5760 0x7f23580d5c10 unknown :-1 s=CLOSED pgs=649 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f237c10e5c0 0x7f237c10b940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f237c153180 0x7f237c10be80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 --2- 10.20.193.28:0/1542151782 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f237c10dbd0 0x7f237c10d3c0 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 >> 10.20.193.28:0/1542151782 conn(0x7f237c0e95a0 msgr2=0x7f237c109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:09.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 shutdown_connections 2026-02-20T13:33:09.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.448+0000 7f23835ab640 1 -- 10.20.193.28:0/1542151782 wait complete. 2026-02-20T13:33:09.549 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:4 damage ls 2026-02-20T13:33:09.735 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:09 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1542151782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:09.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 -- 10.20.193.28:0/1807203727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 msgr2=0x7fb6f4112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/1807203727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 0x7fb6f4112c80 secure :-1 s=READY pgs=1574 gs=1 cs=0 l=1 c_cookie=15048449090787937253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e8009890 tx=0x7fb6e802f0e0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 -- 10.20.193.28:0/1807203727 shutdown_connections 2026-02-20T13:33:09.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/1807203727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 0x7fb6f4112c80 unknown :-1 s=CLOSED pgs=1574 gs=1 cs=0 l=1 c_cookie=15048449090787937253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/1807203727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f4113430 0x7fb6f4173e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/1807203727 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f410d240 0x7fb6f410d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 -- 10.20.193.28:0/1807203727 >> 10.20.193.28:0/1807203727 conn(0x7fb6f40eaad0 msgr2=0x7fb6f410aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:09.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 -- 10.20.193.28:0/1807203727 shutdown_connections 2026-02-20T13:33:09.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.908+0000 7fb6fb01b640 1 -- 10.20.193.28:0/1807203727 wait complete. 2026-02-20T13:33:09.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fb01b640 1 Processor -- start 2026-02-20T13:33:09.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fb01b640 1 -- start start 2026-02-20T13:33:09.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fb01b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f410d240 0x7fb6f40f5770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fb01b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 0x7fb6f4173d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fb01b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f4113430 0x7fb6f40f5e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fb01b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f40fb080 con 0x7fb6f410dc30 2026-02-20T13:33:09.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fb01b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f40fb1f0 con 0x7fb6f410d240 2026-02-20T13:33:09.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fb01b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f40fb3b0 con 0x7fb6f4113430 2026-02-20T13:33:09.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 0x7fb6f4173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 0x7fb6f4173d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44990/0 (socket says 10.20.193.28:44990) 2026-02-20T13:33:09.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6f9818640 1 -- 10.20.193.28:0/311565313 learned_addr learned my addr 10.20.193.28:0/311565313 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:09.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fa81a640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f4113430 0x7fb6f40f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6fa019640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f410d240 0x7fb6f40f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6f9818640 1 -- 10.20.193.28:0/311565313 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f4113430 msgr2=0x7fb6f40f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6f9818640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f4113430 0x7fb6f40f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6f9818640 1 -- 10.20.193.28:0/311565313 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f410d240 msgr2=0x7fb6f40f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6f9818640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f410d240 0x7fb6f40f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.909+0000 7fb6f9818640 1 -- 10.20.193.28:0/311565313 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e80094b0 con 0x7fb6f410dc30 2026-02-20T13:33:09.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.910+0000 7fb6f9818640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 0x7fb6f4173d00 secure :-1 s=READY pgs=1575 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e80023b0 tx=0x7fb6e80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:09.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.910+0000 7fb6db7fe640 1 -- 10.20.193.28:0/311565313 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e803d070 con 0x7fb6f410dc30 2026-02-20T13:33:09.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.910+0000 7fb6db7fe640 1 -- 10.20.193.28:0/311565313 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6e80044f0 con 0x7fb6f410dc30 2026-02-20T13:33:09.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.910+0000 7fb6db7fe640 1 -- 10.20.193.28:0/311565313 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e8041a00 con 0x7fb6f410dc30 2026-02-20T13:33:09.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.910+0000 7fb6fb01b640 1 -- 10.20.193.28:0/311565313 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f40fb630 con 0x7fb6f410dc30 2026-02-20T13:33:09.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.910+0000 7fb6fb01b640 1 -- 10.20.193.28:0/311565313 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f40fba50 con 0x7fb6f410dc30 2026-02-20T13:33:09.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.913+0000 7fb6db7fe640 1 -- 10.20.193.28:0/311565313 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb6e8048020 con 0x7fb6f410dc30 2026-02-20T13:33:09.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.914+0000 7fb6db7fe640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6d00b5750 0x7fb6d00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.915+0000 7fb6db7fe640 1 -- 10.20.193.28:0/311565313 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6e810ae20 con 0x7fb6f410dc30 2026-02-20T13:33:09.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.915+0000 7fb6fa019640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6d00b5750 0x7fb6d00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.915+0000 7fb6fa019640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6d00b5750 0x7fb6d00d5c00 secure :-1 s=READY pgs=650 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e4005b30 tx=0x7fb6e4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:09.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fe29ee00 1 Processor -- start 2026-02-20T13:33:09.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fe29ee00 1 -- start start 2026-02-20T13:33:09.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4c4d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c925e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4cb2f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560ed4b63780 con 0x560ed4c4d360 2026-02-20T13:33:09.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560ed4b5f4b0 con 0x560ed4c4dc70 2026-02-20T13:33:09.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560ed4b59450 con 0x560ed4c92b20 2026-02-20T13:33:09.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fa019640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4c4d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c925e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52820/0 (socket says 10.20.193.28:52820) 2026-02-20T13:33:09.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6f9818640 1 -- 10.20.193.28:0/2587087105 learned_addr learned my addr 10.20.193.28:0/2587087105 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:09.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fa019640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4c4d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44992/0 (socket says 10.20.193.28:44992) 2026-02-20T13:33:09.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fa81a640 1 --2- 10.20.193.28:0/2587087105 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4cb2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fa019640 1 -- 10.20.193.28:0/2587087105 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 msgr2=0x560ed4cb2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fa019640 1 --2- 10.20.193.28:0/2587087105 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4cb2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fa019640 1 -- 10.20.193.28:0/2587087105 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 msgr2=0x560ed4c925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fa019640 1 --2- 10.20.193.28:0/2587087105 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c925e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.916+0000 7fb6fa019640 1 -- 10.20.193.28:0/2587087105 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed4b04d10 con 0x560ed4c4d360 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fa019640 1 --2- 10.20.193.28:0/2587087105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4c4d730 secure :-1 s=READY pgs=1576 gs=1 cs=0 l=1 c_cookie=12972991823207799242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e4004740 tx=0x7fb6e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4095354505919ca server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6d8884640 1 -- 10.20.193.28:0/2587087105 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e4011d70 con 0x560ed4c4d360 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6d8884640 1 -- 10.20.193.28:0/2587087105 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6e401d940 con 0x560ed4c4d360 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6d8884640 1 -- 10.20.193.28:0/2587087105 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e401a9a0 con 0x560ed4c4d360 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2587087105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 msgr2=0x560ed4c4d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2587087105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4c4d730 secure :-1 s=READY pgs=1576 gs=1 cs=0 l=1 c_cookie=12972991823207799242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e4004740 tx=0x7fb6e4013000 comp rx=0 tx=0).stop 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2587087105 shutdown_connections 2026-02-20T13:33:09.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2587087105 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4cb2f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2587087105 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c925e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2587087105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4c4d730 unknown :-1 s=CLOSED pgs=1576 gs=1 cs=0 l=1 c_cookie=12972991823207799242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2587087105 >> 10.20.193.28:0/2587087105 conn(0x560ed4c2b860 msgr2=0x560ed4c4bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2587087105 shutdown_connections 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.917+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2587087105 wait complete. 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.918+0000 7fb6fe29ee00 1 -- start start 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fe29ee00 1 Processor -- start 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4caa740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c4dc70 0x560ed4caac80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c92b20 0x560ed4cafc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fa019640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4caa740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c4dc70 0x560ed4caac80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fa019640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4caa740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52836/0 (socket says 10.20.193.28:52836) 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c4dc70 0x560ed4caac80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:35414/0 (socket says 10.20.193.28:35414) 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560ed4cb01b0 con 0x560ed4c92b20 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fa019640 1 -- 10.20.193.28:0/2070362223 learned_addr learned my addr 10.20.193.28:0/2070362223 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560ed4cb0320 con 0x560ed4c4d360 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.919+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560ed4cb04e0 con 0x560ed4c4dc70 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6fa81a640 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c92b20 0x560ed4cafc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6f9818640 1 -- 10.20.193.28:0/2070362223 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 msgr2=0x560ed4caa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6f9818640 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4caa740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6f9818640 1 -- 10.20.193.28:0/2070362223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c92b20 msgr2=0x560ed4cafc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6f9818640 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c92b20 0x560ed4cafc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6f9818640 1 -- 10.20.193.28:0/2070362223 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed4add3c0 con 0x560ed4c4dc70 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6f9818640 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c4dc70 0x560ed4caac80 secure :-1 s=READY pgs=442 gs=2 cs=0 l=1 c_cookie=6071381184551712632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e80ce3f0 tx=0x7fb6e802fd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5441e1051131f778 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6a7fff640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:33:09.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6a7fff640 1 -- 10.20.193.28:0/2070362223 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e8005d40 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6a7fff640 1 -- 10.20.193.28:0/2070362223 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6e8005b60 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e4009890 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6a7fff640 1 -- 10.20.193.28:0/2070362223 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e80dc0b0 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6a7fff640 1 -- 10.20.193.28:0/2070362223 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6e80f4e40 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6fe29ee00 10 client.30856 _ll_register_callbacks cb 0x560ed4adaa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.920+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560ed47ef6f0 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6a7fff640 1 -- 10.20.193.28:0/2070362223 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb6e80dc2c0 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fe29ee00 10 client.30856 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=31}) -- 0x560ed4aef0e0 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6a7fff640 1 -- 10.20.193.28:0/2070362223 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fb6e80ba040 con 0x560ed4c4dc70 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fe29ee00 10 client.30856 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fe29ee00 10 client.30856 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fe29ee00 20 client.30856 populate_metadata read hostname 'trial028' 2026-02-20T13:33:09.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560ed4c8fc70 0x560ed4c900e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fe29ee00 4 client.30856 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:09.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ed4afbf80 con 0x560ed4c8fc70 2026-02-20T13:33:09.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.921+0000 7fb6fa019640 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560ed4c8fc70 0x560ed4c900e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fa019640 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560ed4c8fc70 0x560ed4c900e0 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=16267327866131428259 s_cookie=8677749479911271880 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e1c128819993b3a3 server_cookie=786d8f2cdff12dc8 in_seq=0 out_seq=0 2026-02-20T13:33:09.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6a7fff640 10 client.30856 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:33:09.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6a7fff640 1 -- 10.20.193.28:0/2070362223 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560ed4afbf80 con 0x560ed4c8fc70 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6a7fff640 10 client.30856 handle_command_reply: tid=0 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 client.30856 shutdown 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c4dc70 msgr2=0x560ed4caac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c4dc70 0x560ed4caac80 secure :-1 s=READY pgs=442 gs=2 cs=0 l=1 c_cookie=6071381184551712632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e80ce3f0 tx=0x7fb6e802fd70 comp rx=0 tx=0).stop 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 shutdown_connections 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560ed4c8fc70 0x560ed4c900e0 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=16267327866131428259 s_cookie=8677749479911271880 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c92b20 0x560ed4cafc70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c4dc70 0x560ed4caac80 unknown :-1 s=CLOSED pgs=442 gs=2 cs=0 l=1 c_cookie=6071381184551712632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/2070362223 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4caa740 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6a7fff640 0 client.30856 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.922+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 >> 10.20.193.28:0/2070362223 conn(0x560ed4c2b860 msgr2=0x560ed4c4bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.923+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 shutdown_connections 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.923+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/2070362223 wait complete. 2026-02-20T13:33:09.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.923+0000 7fb6fe29ee00 20 client.30856 trim_cache size 0 max 16384 2026-02-20T13:33:09.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fe29ee00 1 Processor -- start 2026-02-20T13:33:09.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fe29ee00 1 -- start start 2026-02-20T13:33:09.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4ca8020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c8c770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4c8ccb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560ed4c9ca70 con 0x560ed4c4d360 2026-02-20T13:33:09.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560ed4b57080 con 0x560ed4c4dc70 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560ed4817700 con 0x560ed4c92b20 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.930+0000 7fb6fa019640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4ca8020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c8c770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c8c770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52838/0 (socket says 10.20.193.28:52838) 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6f9818640 1 -- 10.20.193.28:0/603664047 learned_addr learned my addr 10.20.193.28:0/603664047 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6fa019640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4ca8020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45008/0 (socket says 10.20.193.28:45008) 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6fa81a640 1 --2- 10.20.193.28:0/603664047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4c8ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6fa019640 1 -- 10.20.193.28:0/603664047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 msgr2=0x560ed4c8ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6fa019640 1 --2- 10.20.193.28:0/603664047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4c8ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6fa019640 1 -- 10.20.193.28:0/603664047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 msgr2=0x560ed4c8c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6fa019640 1 --2- 10.20.193.28:0/603664047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c8c770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6fa019640 1 -- 10.20.193.28:0/603664047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed4ae9b60 con 0x560ed4c4d360 2026-02-20T13:33:09.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6fa019640 1 --2- 10.20.193.28:0/603664047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4ca8020 secure :-1 s=READY pgs=1577 gs=1 cs=0 l=1 c_cookie=11477651508252265451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560ed4c906e0 tx=0x7fb6e4031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f48cf3c4d1a4beb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6c24e6640 1 -- 10.20.193.28:0/603664047 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e4034030 con 0x560ed4c4d360 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6c24e6640 1 -- 10.20.193.28:0/603664047 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6e4035040 con 0x560ed4c4d360 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.931+0000 7fb6c24e6640 1 -- 10.20.193.28:0/603664047 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e401de50 con 0x560ed4c4d360 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/603664047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 msgr2=0x560ed4ca8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/603664047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4ca8020 secure :-1 s=READY pgs=1577 gs=1 cs=0 l=1 c_cookie=11477651508252265451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x560ed4c906e0 tx=0x7fb6e4031040 comp rx=0 tx=0).stop 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/603664047 shutdown_connections 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/603664047 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4c8ccb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/603664047 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4dc70 0x560ed4c8c770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/603664047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4d360 0x560ed4ca8020 unknown :-1 s=CLOSED pgs=1577 gs=1 cs=0 l=1 c_cookie=11477651508252265451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/603664047 >> 10.20.193.28:0/603664047 conn(0x560ed4c2b860 msgr2=0x560ed4ca6900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/603664047 shutdown_connections 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/603664047 wait complete. 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 -- start start 2026-02-20T13:33:09.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.932+0000 7fb6fe29ee00 1 Processor -- start 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4c2db10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4dc70 0x560ed4c2e050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fe29ee00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4c2fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560ed4c97fc0 con 0x560ed4c4dc70 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x560ed4c2b2a0 con 0x560ed4c4d360 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fe29ee00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x560ed4c303f0 con 0x560ed4c92b20 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fa019640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4c2db10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6f9818640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4dc70 0x560ed4c2e050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fa019640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4c2db10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:52842/0 (socket says 10.20.193.28:52842) 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fa019640 1 -- 10.20.193.28:0/471978339 learned_addr learned my addr 10.20.193.28:0/471978339 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fa81a640 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4c2fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6f9818640 1 -- 10.20.193.28:0/471978339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 msgr2=0x560ed4c2fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6f9818640 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4c2fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6f9818640 1 -- 10.20.193.28:0/471978339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 msgr2=0x560ed4c2db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6f9818640 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4c2db10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6f9818640 1 -- 10.20.193.28:0/471978339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed4add6f0 con 0x560ed4c4dc70 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6fa019640 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4c2db10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6f9818640 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4dc70 0x560ed4c2e050 secure :-1 s=READY pgs=1578 gs=1 cs=0 l=1 c_cookie=11630651848790980633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e8002940 tx=0x7fb6e809a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a168603c116d3819 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.933+0000 7fb6a7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6a7fff640 1 -- 10.20.193.28:0/471978339 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e80ec070 con 0x560ed4c4dc70 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6a7fff640 1 -- 10.20.193.28:0/471978339 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560ed47ef6f0 con 0x560ed4c4dc70 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6a7fff640 1 -- 10.20.193.28:0/471978339 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e80d6ea0 con 0x560ed4c4dc70 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed4b04d10 con 0x560ed4c4dc70 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6a7fff640 1 -- 10.20.193.28:0/471978339 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb6e80f4e40 con 0x560ed4c4dc70 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6fe29ee00 10 client.21081 _ll_register_callbacks cb 0x560ed4adaa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6e401d940 con 0x560ed4c4dc70 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6a7fff640 1 -- 10.20.193.28:0/471978339 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb6e8005d40 con 0x560ed4c4dc70 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6fe29ee00 10 client.21081 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:09.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x560ed4aef340 con 0x560ed4c4dc70 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.934+0000 7fb6a7fff640 1 -- 10.20.193.28:0/471978339 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fb6e8096c00 con 0x560ed4c4dc70 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 10 client.21081 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 10 client.21081 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 20 client.21081 populate_metadata read hostname 'trial028' 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560ed4d40ae0 0x560ed4d60f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 4 client.21081 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560ed47ecf40 con 0x560ed4d40ae0 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fa019640 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560ed4d40ae0 0x560ed4d60f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fa019640 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560ed4d40ae0 0x560ed4d60f90 crc :-1 s=READY pgs=87 gs=4 cs=0 l=0 c_cookie=17275490383702911149 s_cookie=17799848479207151230 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=efbedef97949e8ad server_cookie=f705c3e25aeb567e in_seq=0 out_seq=0 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6a7fff640 10 client.21081 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6a7fff640 1 -- 10.20.193.28:0/471978339 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560ed47ecf40 con 0x560ed4d40ae0 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6a7fff640 10 client.21081 handle_command_reply: tid=0 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 1 client.21081 shutdown 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4dc70 msgr2=0x560ed4c2e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.935+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4dc70 0x560ed4c2e050 secure :-1 s=READY pgs=1578 gs=1 cs=0 l=1 c_cookie=11630651848790980633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e8002940 tx=0x7fb6e809a000 comp rx=0 tx=0).stop 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 shutdown_connections 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x560ed4d40ae0 0x560ed4d60f90 crc :-1 s=READY pgs=87 gs=4 cs=0 l=0 c_cookie=17275490383702911149 s_cookie=17799848479207151230 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560ed4c4dc70 0x560ed4c2e050 unknown :-1 s=CLOSED pgs=1578 gs=1 cs=0 l=1 c_cookie=11630651848790980633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x560ed4c92b20 0x560ed4c2fe80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 1 --2- 10.20.193.28:0/471978339 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x560ed4c4d360 0x560ed4c2db10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6a7fff640 0 client.21081 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 >> 10.20.193.28:0/471978339 conn(0x560ed4c2b860 msgr2=0x560ed4ca70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 shutdown_connections 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 1 -- 10.20.193.28:0/471978339 wait complete. 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fe29ee00 20 client.21081 trim_cache size 0 max 16384 2026-02-20T13:33:09.951 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:33:09.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 -- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6d00b5750 msgr2=0x7fb6d00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6d00b5750 0x7fb6d00d5c00 secure :-1 s=READY pgs=650 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e4005b30 tx=0x7fb6e4009310 comp rx=0 tx=0).stop 2026-02-20T13:33:09.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 -- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 msgr2=0x7fb6f4173d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:09.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 0x7fb6f4173d00 secure :-1 s=READY pgs=1575 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e80023b0 tx=0x7fb6e80028d0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 -- 10.20.193.28:0/311565313 shutdown_connections 2026-02-20T13:33:09.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb6d00b5750 0x7fb6d00d5c00 unknown :-1 s=CLOSED pgs=650 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6f410dc30 0x7fb6f4173d00 unknown :-1 s=CLOSED pgs=1575 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6f4113430 0x7fb6f40f5e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 --2- 10.20.193.28:0/311565313 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb6f410d240 0x7fb6f40f5770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:09.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.936+0000 7fb6fb01b640 1 -- 10.20.193.28:0/311565313 >> 10.20.193.28:0/311565313 conn(0x7fb6f40eaad0 msgr2=0x7fb6f4111320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:09.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.937+0000 7fb6fb01b640 1 -- 10.20.193.28:0/311565313 shutdown_connections 2026-02-20T13:33:09.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:09.937+0000 7fb6fb01b640 1 -- 10.20.193.28:0/311565313 wait complete. 2026-02-20T13:33:09.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:09 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1542151782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:09.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:09 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1542151782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:10.039 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:3 damage ls 2026-02-20T13:33:10.224 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 -- 10.20.193.28:0/1819126779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 msgr2=0x7fb8641761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/1819126779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 0x7fb8641761b0 secure :-1 s=READY pgs=1579 gs=1 cs=0 l=1 c_cookie=16460293220167916653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85800aa30 tx=0x7fb858030270 comp rx=0 tx=0).stop 2026-02-20T13:33:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 -- 10.20.193.28:0/1819126779 shutdown_connections 2026-02-20T13:33:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/1819126779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 0x7fb8641761b0 unknown :-1 s=CLOSED pgs=1579 gs=1 cs=0 l=1 c_cookie=16460293220167916653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/1819126779 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb86410ffe0 0x7fb864115030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/1819126779 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb86410f5f0 0x7fb86410f9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 -- 10.20.193.28:0/1819126779 >> 10.20.193.28:0/1819126779 conn(0x7fb8640ecea0 msgr2=0x7fb86410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 -- 10.20.193.28:0/1819126779 shutdown_connections 2026-02-20T13:33:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.406+0000 7fb86a6b1640 1 -- 10.20.193.28:0/1819126779 wait complete. 2026-02-20T13:33:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb86a6b1640 1 Processor -- start 2026-02-20T13:33:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb86a6b1640 1 -- start start 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb86a6b1640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb86410f5f0 0x7fb86411d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb86a6b1640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb86410ffe0 0x7fb86411da10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb86a6b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 0x7fb864122de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb86a6b1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb864123400 con 0x7fb8641157e0 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb86a6b1640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb864123570 con 0x7fb86410f5f0 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb86a6b1640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb864123730 con 0x7fb86410ffe0 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb863fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb86410f5f0 0x7fb86411d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb868c27640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 0x7fb864122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb863fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb86410f5f0 0x7fb86411d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57190/0 (socket says 10.20.193.28:57190) 2026-02-20T13:33:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb863fff640 1 -- 10.20.193.28:0/819122199 learned_addr learned my addr 10.20.193.28:0/819122199 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb8637fe640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb86410ffe0 0x7fb86411da10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb863fff640 1 -- 10.20.193.28:0/819122199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb86410ffe0 msgr2=0x7fb86411da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb863fff640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb86410ffe0 0x7fb86411da10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb863fff640 1 -- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 msgr2=0x7fb864122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb863fff640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 0x7fb864122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb863fff640 1 -- 10.20.193.28:0/819122199 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85800a650 con 0x7fb86410f5f0 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb868c27640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 0x7fb864122de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.407+0000 7fb8637fe640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb86410ffe0 0x7fb86411da10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.408+0000 7fb863fff640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb86410f5f0 0x7fb86411d4d0 secure :-1 s=READY pgs=548 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85000d950 tx=0x7fb85000de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.408+0000 7fb8617fa640 1 -- 10.20.193.28:0/819122199 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb850004540 con 0x7fb86410f5f0 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.408+0000 7fb8617fa640 1 -- 10.20.193.28:0/819122199 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb850009d00 con 0x7fb86410f5f0 2026-02-20T13:33:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.408+0000 7fb86a6b1640 1 -- 10.20.193.28:0/819122199 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb864123a10 con 0x7fb86410f5f0 2026-02-20T13:33:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.408+0000 7fb8617fa640 1 -- 10.20.193.28:0/819122199 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8500106e0 con 0x7fb86410f5f0 2026-02-20T13:33:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.408+0000 7fb86a6b1640 1 -- 10.20.193.28:0/819122199 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb864164110 con 0x7fb86410f5f0 2026-02-20T13:33:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.411+0000 7fb8617fa640 1 -- 10.20.193.28:0/819122199 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb8500097c0 con 0x7fb86410f5f0 2026-02-20T13:33:10.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.412+0000 7fb8617fa640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8380b5760 0x7fb8380d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.413+0000 7fb8617fa640 1 -- 10.20.193.28:0/819122199 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb8500e6d20 con 0x7fb86410f5f0 2026-02-20T13:33:10.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.413+0000 7fb8637fe640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8380b5760 0x7fb8380d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.413+0000 7fb8637fe640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8380b5760 0x7fb8380d5c10 secure :-1 s=READY pgs=651 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb854005970 tx=0x7fb854005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.413+0000 7fb86c6abe00 1 Processor -- start 2026-02-20T13:33:10.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb86c6abe00 1 -- start start 2026-02-20T13:33:10.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f624730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f6695e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f669b20 0x557f1f689f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557f1f53a780 con 0x557f1f624360 2026-02-20T13:33:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557f1f5364b0 con 0x557f1f669b20 2026-02-20T13:33:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557f1f530450 con 0x557f1f624c70 2026-02-20T13:33:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f6695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f6695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60354/0 (socket says 10.20.193.28:60354) 2026-02-20T13:33:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb8637fe640 1 -- 10.20.193.28:0/2933677343 learned_addr learned my addr 10.20.193.28:0/2933677343 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb863fff640 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f624730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb868c27640 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f669b20 0x557f1f689f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb8637fe640 1 -- 10.20.193.28:0/2933677343 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f669b20 msgr2=0x557f1f689f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb8637fe640 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f669b20 0x557f1f689f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb8637fe640 1 -- 10.20.193.28:0/2933677343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 msgr2=0x557f1f624730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb8637fe640 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f624730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.414+0000 7fb8637fe640 1 -- 10.20.193.28:0/2933677343 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f4dbd10 con 0x557f1f624c70 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb8637fe640 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f6695e0 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=10417206694126492712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85400fd30 tx=0x7fb854012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90915a4bab3b1c28 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb834ce3640 1 -- 10.20.193.28:0/2933677343 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85401d630 con 0x557f1f624c70 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb834ce3640 1 -- 10.20.193.28:0/2933677343 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb85400fe30 con 0x557f1f624c70 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb834ce3640 1 -- 10.20.193.28:0/2933677343 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb854010b50 con 0x557f1f624c70 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2933677343 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 msgr2=0x557f1f6695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f6695e0 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=10417206694126492712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85400fd30 tx=0x7fb854012000 comp rx=0 tx=0).stop 2026-02-20T13:33:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2933677343 shutdown_connections 2026-02-20T13:33:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f669b20 0x557f1f689f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f6695e0 unknown :-1 s=CLOSED pgs=443 gs=1 cs=0 l=1 c_cookie=10417206694126492712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2933677343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f624730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2933677343 >> 10.20.193.28:0/2933677343 conn(0x557f1f602860 msgr2=0x557f1f622c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2933677343 shutdown_connections 2026-02-20T13:33:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.415+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2933677343 wait complete. 2026-02-20T13:33:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.416+0000 7fb86c6abe00 1 -- start start 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.416+0000 7fb86c6abe00 1 Processor -- start 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f6816e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624c70 0x557f1f681c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f6839b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557f1f683f20 con 0x557f1f624c70 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557f1f684090 con 0x557f1f624360 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557f1f684250 con 0x557f1f669b20 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb863fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f6816e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624c70 0x557f1f681c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb868c27640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f6839b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624c70 0x557f1f681c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44556/0 (socket says 10.20.193.28:44556) 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb8637fe640 1 -- 10.20.193.28:0/1470052958 learned_addr learned my addr 10.20.193.28:0/1470052958 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb8637fe640 1 -- 10.20.193.28:0/1470052958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 msgr2=0x557f1f6839b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb8637fe640 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f6839b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb8637fe640 1 -- 10.20.193.28:0/1470052958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 msgr2=0x557f1f6816e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb8637fe640 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f6816e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb8637fe640 1 -- 10.20.193.28:0/1470052958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f4b43c0 con 0x557f1f624c70 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.417+0000 7fb863fff640 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f6816e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb8637fe640 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624c70 0x557f1f681c20 secure :-1 s=READY pgs=1580 gs=2 cs=0 l=1 c_cookie=11094438867880297034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb854005870 tx=0x7fb854010600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f75d5e964ac24a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb825ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb825ffb640 1 -- 10.20.193.28:0/1470052958 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb854026450 con 0x557f1f624c70 2026-02-20T13:33:10.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb825ffb640 1 -- 10.20.193.28:0/1470052958 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb854026a90 con 0x557f1f624c70 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb825ffb640 1 -- 10.20.193.28:0/1470052958 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85401db50 con 0x557f1f624c70 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85400f9d0 con 0x557f1f624c70 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb86c6abe00 10 client.21093 _ll_register_callbacks cb 0x557f1f4b1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f1f1c66f0 con 0x557f1f624c70 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb825ffb640 1 -- 10.20.193.28:0/1470052958 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb85401dce0 con 0x557f1f624c70 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb825ffb640 1 -- 10.20.193.28:0/1470052958 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb85401dea0 con 0x557f1f624c70 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb86c6abe00 10 client.21093 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.418+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x557f1f4c60e0 con 0x557f1f624c70 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.419+0000 7fb825ffb640 1 -- 10.20.193.28:0/1470052958 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fb85401a040 con 0x557f1f624c70 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.419+0000 7fb86c6abe00 10 client.21093 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.419+0000 7fb86c6abe00 10 client.21093 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:33:10.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.419+0000 7fb86c6abe00 20 client.21093 populate_metadata read hostname 'trial028' 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.419+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557f1f666ed0 0x557f1f667370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.419+0000 7fb86c6abe00 4 client.21093 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.419+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f1f4d2f80 con 0x557f1f666ed0 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.419+0000 7fb863fff640 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557f1f666ed0 0x557f1f667370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb863fff640 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557f1f666ed0 0x557f1f667370 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=16281821383197123678 s_cookie=5513850129852838399 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e1f4a64881d2e45e server_cookie=4c85217abe9eb1ff in_seq=0 out_seq=0 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb825ffb640 10 client.21093 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb825ffb640 1 -- 10.20.193.28:0/1470052958 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557f1f4d2f80 con 0x557f1f666ed0 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb825ffb640 10 client.21093 handle_command_reply: tid=0 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 client.21093 shutdown 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624c70 msgr2=0x557f1f681c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624c70 0x557f1f681c20 secure :-1 s=READY pgs=1580 gs=2 cs=0 l=1 c_cookie=11094438867880297034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb854005870 tx=0x7fb854010600 comp rx=0 tx=0).stop 2026-02-20T13:33:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 shutdown_connections 2026-02-20T13:33:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557f1f666ed0 0x557f1f667370 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=16281821383197123678 s_cookie=5513850129852838399 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624c70 0x557f1f681c20 unknown :-1 s=CLOSED pgs=1580 gs=2 cs=0 l=1 c_cookie=11094438867880297034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f6839b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/1470052958 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f6816e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb825ffb640 0 client.21093 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:33:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 >> 10.20.193.28:0/1470052958 conn(0x557f1f602860 msgr2=0x557f1f622c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.420+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 shutdown_connections 2026-02-20T13:33:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.421+0000 7fb86c6abe00 1 -- 10.20.193.28:0/1470052958 wait complete. 2026-02-20T13:33:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.421+0000 7fb86c6abe00 20 client.21093 trim_cache size 0 max 16384 2026-02-20T13:33:10.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb86c6abe00 1 Processor -- start 2026-02-20T13:33:10.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb86c6abe00 1 -- start start 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f686520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f683940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f669b20 0x557f1f67e8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557f1f52e080 con 0x557f1f669b20 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557f1f1ee700 con 0x557f1f624360 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557f1f602700 con 0x557f1f624c70 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb863fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f686520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb868c27640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f669b20 0x557f1f67e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f683940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb868c27640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f669b20 0x557f1f67e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44570/0 (socket says 10.20.193.28:44570) 2026-02-20T13:33:10.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb868c27640 1 -- 10.20.193.28:0/3091774551 learned_addr learned my addr 10.20.193.28:0/3091774551 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.428+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f683940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60370/0 (socket says 10.20.193.28:60370) 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb868c27640 1 -- 10.20.193.28:0/3091774551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 msgr2=0x557f1f683940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb868c27640 1 --2- 10.20.193.28:0/3091774551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f683940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb868c27640 1 -- 10.20.193.28:0/3091774551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 msgr2=0x557f1f686520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb868c27640 1 --2- 10.20.193.28:0/3091774551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f686520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb868c27640 1 -- 10.20.193.28:0/3091774551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f4c0b60 con 0x557f1f669b20 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb863fff640 1 --2- 10.20.193.28:0/3091774551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f686520 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb868c27640 1 --2- 10.20.193.28:0/3091774551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f669b20 0x557f1f67e8f0 secure :-1 s=READY pgs=1581 gs=3 cs=0 l=1 c_cookie=3582430955417838405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858030780 tx=0x7fb858003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b759f9320b2345 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb827fff640 1 -- 10.20.193.28:0/3091774551 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb858003780 con 0x557f1f669b20 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb827fff640 1 -- 10.20.193.28:0/3091774551 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb85803f040 con 0x557f1f669b20 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb827fff640 1 -- 10.20.193.28:0/3091774551 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8580057b0 con 0x557f1f669b20 2026-02-20T13:33:10.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 -- 10.20.193.28:0/3091774551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f669b20 msgr2=0x557f1f67e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/3091774551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f669b20 0x557f1f67e8f0 secure :-1 s=READY pgs=1581 gs=3 cs=0 l=1 c_cookie=3582430955417838405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858030780 tx=0x7fb858003e80 comp rx=0 tx=0).stop 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 -- 10.20.193.28:0/3091774551 shutdown_connections 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/3091774551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f669b20 0x557f1f67e8f0 unknown :-1 s=CLOSED pgs=1581 gs=3 cs=0 l=1 c_cookie=3582430955417838405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/3091774551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f624c70 0x557f1f683940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/3091774551 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624360 0x557f1f686520 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 -- 10.20.193.28:0/3091774551 >> 10.20.193.28:0/3091774551 conn(0x557f1f602860 msgr2=0x557f1f623840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 -- 10.20.193.28:0/3091774551 shutdown_connections 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.429+0000 7fb86c6abe00 1 -- 10.20.193.28:0/3091774551 wait complete. 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.430+0000 7fb86c6abe00 1 -- start start 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.430+0000 7fb86c6abe00 1 Processor -- start 2026-02-20T13:33:10.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.430+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f67fab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.430+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624c70 0x557f1f680030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.430+0000 7fb86c6abe00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f605c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.430+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557f1f6061a0 con 0x557f1f624360 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.430+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557f1f6062e0 con 0x557f1f624c70 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.430+0000 7fb86c6abe00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557f1f6064a0 con 0x557f1f669b20 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb868c27640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f605c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb863fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f67fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624c70 0x557f1f680030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb868c27640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f605c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60372/0 (socket says 10.20.193.28:60372) 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb868c27640 1 -- 10.20.193.28:0/2235351103 learned_addr learned my addr 10.20.193.28:0/2235351103 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb863fff640 1 -- 10.20.193.28:0/2235351103 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 msgr2=0x557f1f605c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb863fff640 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f605c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb863fff640 1 -- 10.20.193.28:0/2235351103 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624c70 msgr2=0x557f1f680030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb863fff640 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624c70 0x557f1f680030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb863fff640 1 -- 10.20.193.28:0/2235351103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f4b46f0 con 0x557f1f624360 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb863fff640 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f67fab0 secure :-1 s=READY pgs=1582 gs=1 cs=0 l=1 c_cookie=18162444415143894713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8500a9650 tx=0x7fb8500e4750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0df6f7816ddeb9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb825ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb825ffb640 1 -- 10.20.193.28:0/2235351103 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8500b2da0 con 0x557f1f624360 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb864176a20 con 0x557f1f624360 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb86c6abe00 10 client.21099 _ll_register_callbacks cb 0x557f1f4b1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb85400fe30 con 0x557f1f624360 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb825ffb640 1 -- 10.20.193.28:0/2235351103 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8500b5380 con 0x557f1f624360 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb825ffb640 1 -- 10.20.193.28:0/2235351103 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8500b7d30 con 0x557f1f624360 2026-02-20T13:33:10.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb825ffb640 1 -- 10.20.193.28:0/2235351103 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb8500b7e90 con 0x557f1f624360 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb825ffb640 1 -- 10.20.193.28:0/2235351103 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb850072210 con 0x557f1f624360 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb86c6abe00 10 client.21099 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.431+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x557f1f4c6340 con 0x557f1f624360 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb825ffb640 1 -- 10.20.193.28:0/2235351103 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fb8500acc20 con 0x557f1f624360 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb86c6abe00 10 client.21099 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb86c6abe00 10 client.21099 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.i 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb86c6abe00 20 client.21099 populate_metadata read hostname 'trial028' 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557f1f6082a0 0x557f1f608740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb86c6abe00 4 client.21099 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557f1f1c3f40 con 0x557f1f6082a0 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb8637fe640 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557f1f6082a0 0x557f1f608740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb825ffb640 10 client.21099 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.432+0000 7fb8637fe640 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557f1f6082a0 0x557f1f608740 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=10216840149430821843 s_cookie=2966235323013007617 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8dc981fc19c5e3d3 server_cookie=292a2f4f7c680901 in_seq=0 out_seq=0 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb825ffb640 1 -- 10.20.193.28:0/2235351103 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557f1f1c3f40 con 0x557f1f6082a0 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb825ffb640 10 client.21099 handle_command_reply: tid=0 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 client.21099 shutdown 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 msgr2=0x557f1f67fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f67fab0 secure :-1 s=READY pgs=1582 gs=1 cs=0 l=1 c_cookie=18162444415143894713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8500a9650 tx=0x7fb8500e4750 comp rx=0 tx=0).stop 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 shutdown_connections 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x557f1f6082a0 0x557f1f608740 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=10216840149430821843 s_cookie=2966235323013007617 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557f1f669b20 0x557f1f605c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557f1f624c70 0x557f1f680030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 --2- 10.20.193.28:0/2235351103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557f1f624360 0x557f1f67fab0 unknown :-1 s=CLOSED pgs=1582 gs=1 cs=0 l=1 c_cookie=18162444415143894713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 >> 10.20.193.28:0/2235351103 conn(0x557f1f602860 msgr2=0x557f1f6828c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb825ffb640 0 client.21099 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:33:10.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 shutdown_connections 2026-02-20T13:33:10.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 1 -- 10.20.193.28:0/2235351103 wait complete. 2026-02-20T13:33:10.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.433+0000 7fb86c6abe00 20 client.21099 trim_cache size 0 max 16384 2026-02-20T13:33:10.444 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:33:10.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 -- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8380b5760 msgr2=0x7fb8380d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8380b5760 0x7fb8380d5c10 secure :-1 s=READY pgs=651 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb854005970 tx=0x7fb854005900 comp rx=0 tx=0).stop 2026-02-20T13:33:10.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 -- 10.20.193.28:0/819122199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb86410f5f0 msgr2=0x7fb86411d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb86410f5f0 0x7fb86411d4d0 secure :-1 s=READY pgs=548 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85000d950 tx=0x7fb85000de20 comp rx=0 tx=0).stop 2026-02-20T13:33:10.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 -- 10.20.193.28:0/819122199 shutdown_connections 2026-02-20T13:33:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb8380b5760 0x7fb8380d5c10 unknown :-1 s=CLOSED pgs=651 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb8641157e0 0x7fb864122de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb86410ffe0 0x7fb86411da10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 --2- 10.20.193.28:0/819122199 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb86410f5f0 0x7fb86411d4d0 unknown :-1 s=CLOSED pgs=548 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 -- 10.20.193.28:0/819122199 >> 10.20.193.28:0/819122199 conn(0x7fb8640ecea0 msgr2=0x7fb86410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 -- 10.20.193.28:0/819122199 shutdown_connections 2026-02-20T13:33:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.434+0000 7fb86a6b1640 1 -- 10.20.193.28:0/819122199 wait complete. 2026-02-20T13:33:10.532 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T13:33:10.716 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:10.837 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:10 trial028 ceph-mon[37442]: pgmap v656: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.5 KiB/s wr, 15 op/s 2026-02-20T13:33:10.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.902+0000 7fef4c111640 1 -- 10.20.193.28:0/2190354897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef441157e0 msgr2=0x7fef441761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.902+0000 7fef4c111640 1 --2- 10.20.193.28:0/2190354897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef441157e0 0x7fef441761b0 secure :-1 s=READY pgs=1583 gs=1 cs=0 l=1 c_cookie=17750428373404305100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef4000aa30 tx=0x7fef40030270 comp rx=0 tx=0).stop 2026-02-20T13:33:10.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.903+0000 7fef4c111640 1 -- 10.20.193.28:0/2190354897 shutdown_connections 2026-02-20T13:33:10.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.903+0000 7fef4c111640 1 --2- 10.20.193.28:0/2190354897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef441157e0 0x7fef441761b0 unknown :-1 s=CLOSED pgs=1583 gs=1 cs=0 l=1 c_cookie=17750428373404305100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.903+0000 7fef4c111640 1 --2- 10.20.193.28:0/2190354897 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef4410ffe0 0x7fef44115030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.903+0000 7fef4c111640 1 --2- 10.20.193.28:0/2190354897 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef4410f5f0 0x7fef4410f9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.903+0000 7fef4c111640 1 -- 10.20.193.28:0/2190354897 >> 10.20.193.28:0/2190354897 conn(0x7fef440ecea0 msgr2=0x7fef4410d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.903+0000 7fef4c111640 1 -- 10.20.193.28:0/2190354897 shutdown_connections 2026-02-20T13:33:10.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.903+0000 7fef4c111640 1 -- 10.20.193.28:0/2190354897 wait complete. 2026-02-20T13:33:10.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.903+0000 7fef4c111640 1 Processor -- start 2026-02-20T13:33:10.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef4c111640 1 -- start start 2026-02-20T13:33:10.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef4c111640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4410f5f0 0x7fef4411d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef4c111640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef4410ffe0 0x7fef4411da30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef4c111640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef441157e0 0x7fef44122e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef4c111640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef44123420 con 0x7fef4410f5f0 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef4c111640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fef44123590 con 0x7fef4410ffe0 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef4c111640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fef44123750 con 0x7fef441157e0 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49685640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef4410ffe0 0x7fef4411da30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4410f5f0 0x7fef4411d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4410f5f0 0x7fef4411d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44614/0 (socket says 10.20.193.28:44614) 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 -- 10.20.193.28:0/2438514690 learned_addr learned my addr 10.20.193.28:0/2438514690 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef4a687640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef441157e0 0x7fef44122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 -- 10.20.193.28:0/2438514690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef441157e0 msgr2=0x7fef44122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef441157e0 0x7fef44122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 -- 10.20.193.28:0/2438514690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef4410ffe0 msgr2=0x7fef4411da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef4410ffe0 0x7fef4411da30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 -- 10.20.193.28:0/2438514690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4000a650 con 0x7fef4410f5f0 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.904+0000 7fef49e86640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4410f5f0 0x7fef4411d4f0 secure :-1 s=READY pgs=1584 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3400d950 tx=0x7fef3400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.905+0000 7fef32ffd640 1 -- 10.20.193.28:0/2438514690 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef34004540 con 0x7fef4410f5f0 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.905+0000 7fef32ffd640 1 -- 10.20.193.28:0/2438514690 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef34009d00 con 0x7fef4410f5f0 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.905+0000 7fef32ffd640 1 -- 10.20.193.28:0/2438514690 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef340106e0 con 0x7fef4410f5f0 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.905+0000 7fef4c111640 1 -- 10.20.193.28:0/2438514690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef44123a30 con 0x7fef4410f5f0 2026-02-20T13:33:10.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.905+0000 7fef4c111640 1 -- 10.20.193.28:0/2438514690 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef44164130 con 0x7fef4410f5f0 2026-02-20T13:33:10.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.908+0000 7fef32ffd640 1 -- 10.20.193.28:0/2438514690 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fef340097c0 con 0x7fef4410f5f0 2026-02-20T13:33:10.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.909+0000 7fef32ffd640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef200b5760 0x7fef200d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.909+0000 7fef32ffd640 1 -- 10.20.193.28:0/2438514690 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fef340e6dd0 con 0x7fef4410f5f0 2026-02-20T13:33:10.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.910+0000 7fef49685640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef200b5760 0x7fef200d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.910+0000 7fef49685640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef200b5760 0x7fef200d5c10 secure :-1 s=READY pgs=652 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef44123e90 tx=0x7fef38004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.911+0000 7fef4e10be00 1 Processor -- start 2026-02-20T13:33:10.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.911+0000 7fef4e10be00 1 -- start start 2026-02-20T13:33:10.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.911+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55b360 0x55b3aa55b730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.911+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55bc70 0x55b3aa5a05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.911+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5c0f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.911+0000 7fef4e10be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa471780 con 0x55b3aa55bc70 2026-02-20T13:33:10.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.911+0000 7fef4e10be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa46d4b0 con 0x55b3aa55b360 2026-02-20T13:33:10.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.911+0000 7fef4e10be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa467450 con 0x55b3aa5a0b20 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49e86640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55b360 0x55b3aa55b730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55bc70 0x55b3aa5a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55bc70 0x55b3aa5a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44618/0 (socket says 10.20.193.28:44618) 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 -- 10.20.193.28:0/2989280901 learned_addr learned my addr 10.20.193.28:0/2989280901 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef4a687640 1 --2- 10.20.193.28:0/2989280901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 -- 10.20.193.28:0/2989280901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 msgr2=0x55b3aa5c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 --2- 10.20.193.28:0/2989280901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 -- 10.20.193.28:0/2989280901 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55b360 msgr2=0x55b3aa55b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 --2- 10.20.193.28:0/2989280901 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55b360 0x55b3aa55b730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 -- 10.20.193.28:0/2989280901 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3aa412d10 con 0x55b3aa55bc70 2026-02-20T13:33:10.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef49685640 1 --2- 10.20.193.28:0/2989280901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55bc70 0x55b3aa5a05e0 secure :-1 s=READY pgs=1585 gs=1 cs=0 l=1 c_cookie=13256438204681165062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3800fd90 tx=0x7fef38012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f8544fc0f01906 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef124e6640 1 -- 10.20.193.28:0/2989280901 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef3801e680 con 0x55b3aa55bc70 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef124e6640 1 -- 10.20.193.28:0/2989280901 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef38011e60 con 0x55b3aa55bc70 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.912+0000 7fef124e6640 1 -- 10.20.193.28:0/2989280901 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef38010bd0 con 0x55b3aa55bc70 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 -- 10.20.193.28:0/2989280901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55bc70 msgr2=0x55b3aa5a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 --2- 10.20.193.28:0/2989280901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55bc70 0x55b3aa5a05e0 secure :-1 s=READY pgs=1585 gs=1 cs=0 l=1 c_cookie=13256438204681165062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3800fd90 tx=0x7fef38012000 comp rx=0 tx=0).stop 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 -- 10.20.193.28:0/2989280901 shutdown_connections 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 --2- 10.20.193.28:0/2989280901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55bc70 0x55b3aa5a05e0 unknown :-1 s=CLOSED pgs=1585 gs=1 cs=0 l=1 c_cookie=13256438204681165062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 --2- 10.20.193.28:0/2989280901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5c0f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 --2- 10.20.193.28:0/2989280901 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55b360 0x55b3aa55b730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 -- 10.20.193.28:0/2989280901 >> 10.20.193.28:0/2989280901 conn(0x55b3aa539860 msgr2=0x55b3aa559c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 -- 10.20.193.28:0/2989280901 shutdown_connections 2026-02-20T13:33:10.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.913+0000 7fef4e10be00 1 -- 10.20.193.28:0/2989280901 wait complete. 2026-02-20T13:33:10.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.914+0000 7fef4e10be00 1 -- start start 2026-02-20T13:33:10.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.914+0000 7fef4e10be00 1 Processor -- start 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55b360 0x55b3aa5b8740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b8c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5baa10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef4e10be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa5baf80 con 0x55b3aa5a0b20 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef4e10be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa5bb0f0 con 0x55b3aa55bc70 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef4e10be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa5bb2b0 con 0x55b3aa55b360 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55b360 0x55b3aa5b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55b360 0x55b3aa5b8740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60420/0 (socket says 10.20.193.28:60420) 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef4a687640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 -- 10.20.193.28:0/42747129 learned_addr learned my addr 10.20.193.28:0/42747129 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49685640 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 -- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 msgr2=0x55b3aa5b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 -- 10.20.193.28:0/42747129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa5a0b20 msgr2=0x55b3aa5baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 -- 10.20.193.28:0/42747129 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3aa3eb3c0 con 0x55b3aa55b360 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef4a687640 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5baa10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49685640 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b8c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7fef49e86640 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55b360 0x55b3aa5b8740 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=13679986641684137571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef340aa3a0 tx=0x7fef34002cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdd9135ef5ac0663 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7feeff7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.915+0000 7feeff7fe640 1 -- 10.20.193.28:0/42747129 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef340ac930 con 0x55b3aa55b360 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7feeff7fe640 1 -- 10.20.193.28:0/42747129 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef340adb30 con 0x55b3aa55b360 2026-02-20T13:33:10.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3800fa30 con 0x55b3aa55b360 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7feeff7fe640 1 -- 10.20.193.28:0/42747129 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef34072540 con 0x55b3aa55b360 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7feeff7fe640 1 -- 10.20.193.28:0/42747129 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fef340addc0 con 0x55b3aa55b360 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7feeff7fe640 10 client.30892 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 10 client.30892 _ll_register_callbacks cb 0x55b3aa3e8a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3aa0fd6f0 con 0x55b3aa55b360 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7feeff7fe640 1 -- 10.20.193.28:0/42747129 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fef340b2e50 con 0x55b3aa55b360 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 10 client.30892 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55b3aa3fd0e0 con 0x55b3aa55b360 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7feeff7fe640 1 -- 10.20.193.28:0/42747129 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fef340b7de0 con 0x55b3aa55b360 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 10 client.30892 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 10 client.30892 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 20 client.30892 populate_metadata read hostname 'trial028' 2026-02-20T13:33:10.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55b3aa5c0c70 0x55b3aa59e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 4 client.30892 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.916+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3aa409f80 con 0x55b3aa5c0c70 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.917+0000 7fef49685640 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55b3aa5c0c70 0x55b3aa59e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.917+0000 7fef49685640 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55b3aa5c0c70 0x55b3aa59e8a0 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=2104913758195574173 s_cookie=8044236008712290156 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d3627e92814659d server_cookie=6fa2de079cb3bf6c in_seq=0 out_seq=0 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.917+0000 7feeff7fe640 10 client.30892 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7feeff7fe640 1 -- 10.20.193.28:0/42747129 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b3aa409f80 con 0x55b3aa5c0c70 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7feeff7fe640 10 client.30892 handle_command_reply: tid=0 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 client.30892 shutdown 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55b360 msgr2=0x55b3aa5b8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55b360 0x55b3aa5b8740 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=13679986641684137571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef340aa3a0 tx=0x7fef34002cc0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 shutdown_connections 2026-02-20T13:33:10.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55b3aa5c0c70 0x55b3aa59e8a0 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=2104913758195574173 s_cookie=8044236008712290156 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5baa10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b8c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 --2- 10.20.193.28:0/42747129 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55b360 0x55b3aa5b8740 unknown :-1 s=CLOSED pgs=444 gs=1 cs=0 l=1 c_cookie=13679986641684137571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7feeff7fe640 0 client.30892 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:33:10.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 >> 10.20.193.28:0/42747129 conn(0x55b3aa539860 msgr2=0x55b3aa559c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 shutdown_connections 2026-02-20T13:33:10.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 1 -- 10.20.193.28:0/42747129 wait complete. 2026-02-20T13:33:10.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.918+0000 7fef4e10be00 20 client.30892 trim_cache size 0 max 16384 2026-02-20T13:33:10.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.925+0000 7fef4e10be00 1 Processor -- start 2026-02-20T13:33:10.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.925+0000 7fef4e10be00 1 -- start start 2026-02-20T13:33:10.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.925+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa5ba9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.925+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b58d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.925+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5b5e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.925+0000 7fef4e10be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa465080 con 0x55b3aa55b360 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.925+0000 7fef4e10be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa125700 con 0x55b3aa55bc70 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.925+0000 7fef4e10be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa5beca0 con 0x55b3aa5a0b20 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57270/0 (socket says 10.20.193.28:57270) 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 -- 10.20.193.28:0/2964622113 learned_addr learned my addr 10.20.193.28:0/2964622113 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49e86640 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa5ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef4a687640 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 -- 10.20.193.28:0/2964622113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 msgr2=0x55b3aa5b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 -- 10.20.193.28:0/2964622113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 msgr2=0x55b3aa5ba9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa5ba9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 -- 10.20.193.28:0/2964622113 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3aa3f7b60 con 0x55b3aa55bc70 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef49685640 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b58d0 secure :-1 s=READY pgs=549 gs=1 cs=0 l=1 c_cookie=18315537132562096143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef380106f0 tx=0x7fef38010720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe2ddbfb70d7200f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef11ce5640 1 -- 10.20.193.28:0/2964622113 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef38030070 con 0x55b3aa55bc70 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef11ce5640 1 -- 10.20.193.28:0/2964622113 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef38031040 con 0x55b3aa55bc70 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.926+0000 7fef11ce5640 1 -- 10.20.193.28:0/2964622113 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef38036320 con 0x55b3aa55bc70 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 -- 10.20.193.28:0/2964622113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 msgr2=0x55b3aa5b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b58d0 secure :-1 s=READY pgs=549 gs=1 cs=0 l=1 c_cookie=18315537132562096143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef380106f0 tx=0x7fef38010720 comp rx=0 tx=0).stop 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 -- 10.20.193.28:0/2964622113 shutdown_connections 2026-02-20T13:33:10.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5b5e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa55bc70 0x55b3aa5b58d0 unknown :-1 s=CLOSED pgs=549 gs=1 cs=0 l=1 c_cookie=18315537132562096143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 --2- 10.20.193.28:0/2964622113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa5ba9a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 -- 10.20.193.28:0/2964622113 >> 10.20.193.28:0/2964622113 conn(0x55b3aa539860 msgr2=0x55b3aa5bd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 -- 10.20.193.28:0/2964622113 shutdown_connections 2026-02-20T13:33:10.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 -- 10.20.193.28:0/2964622113 wait complete. 2026-02-20T13:33:10.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 -- start start 2026-02-20T13:33:10.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.927+0000 7fef4e10be00 1 Processor -- start 2026-02-20T13:33:10.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa53bf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55bc70 0x55b3aa53c4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef4e10be00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5bca50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef4e10be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa5bd150 con 0x55b3aa55b360 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef4e10be00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa5bd2c0 con 0x55b3aa5a0b20 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef4e10be00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55b3aa5bd480 con 0x55b3aa55bc70 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49e86640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa53bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55bc70 0x55b3aa53c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef4a687640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5bca50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55bc70 0x55b3aa53c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60434/0 (socket says 10.20.193.28:60434) 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 -- 10.20.193.28:0/3464039812 learned_addr learned my addr 10.20.193.28:0/3464039812 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef4a687640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5bca50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57286/0 (socket says 10.20.193.28:57286) 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 -- 10.20.193.28:0/3464039812 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa5a0b20 msgr2=0x55b3aa5bca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5bca50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 -- 10.20.193.28:0/3464039812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 msgr2=0x55b3aa53bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:10.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa53bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 -- 10.20.193.28:0/3464039812 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3aa3eb6f0 con 0x55b3aa55bc70 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49e86640 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa53bf60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7fef49685640 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55bc70 0x55b3aa53c4a0 secure :-1 s=READY pgs=445 gs=2 cs=0 l=1 c_cookie=2079079186009374511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef380023d0 tx=0x7fef38010f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cda5f8115ff3f2f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.928+0000 7feeff7fe640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7feeff7fe640 1 -- 10.20.193.28:0/3464039812 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef38030040 con 0x55b3aa55bc70 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7feeff7fe640 1 -- 10.20.193.28:0/3464039812 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef38010790 con 0x55b3aa55bc70 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7feeff7fe640 1 -- 10.20.193.28:0/3464039812 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef380366b0 con 0x55b3aa55bc70 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3aa412d10 con 0x55b3aa55bc70 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 10 client.30898 _ll_register_callbacks cb 0x55b3aa3e8a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef38011e60 con 0x55b3aa55bc70 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7feeff7fe640 1 -- 10.20.193.28:0/3464039812 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fef38036840 con 0x55b3aa55bc70 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7feeff7fe640 1 -- 10.20.193.28:0/3464039812 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fef38036a20 con 0x55b3aa55bc70 2026-02-20T13:33:10.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 10 client.30898 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55b3aa3fd340 con 0x55b3aa55bc70 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7feeff7fe640 1 -- 10.20.193.28:0/3464039812 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fef3801e460 con 0x55b3aa55bc70 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 10 client.30898 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 10 client.30898 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 20 client.30898 populate_metadata read hostname 'trial028' 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55b3aa53f0a0 0x55b3aa53f540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 4 client.30898 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.929+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3aa0faf40 con 0x55b3aa53f0a0 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef49e86640 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55b3aa53f0a0 0x55b3aa53f540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef49e86640 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55b3aa53f0a0 0x55b3aa53f540 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=9418970563604515832 s_cookie=1998831440616757225 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82b6e7d2e1820bf8 server_cookie=1bbd469adfd817e9 in_seq=0 out_seq=0 2026-02-20T13:33:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7feeff7fe640 10 client.30898 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7feeff7fe640 1 -- 10.20.193.28:0/3464039812 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3aa0faf40 con 0x55b3aa53f0a0 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7feeff7fe640 10 client.30898 handle_command_reply: tid=0 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 client.30898 shutdown 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55bc70 msgr2=0x55b3aa53c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55bc70 0x55b3aa53c4a0 secure :-1 s=READY pgs=445 gs=2 cs=0 l=1 c_cookie=2079079186009374511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef380023d0 tx=0x7fef38010f20 comp rx=0 tx=0).stop 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 shutdown_connections 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55b3aa53f0a0 0x55b3aa53f540 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=9418970563604515832 s_cookie=1998831440616757225 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55b3aa5a0b20 0x55b3aa5bca50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55b3aa55bc70 0x55b3aa53c4a0 unknown :-1 s=CLOSED pgs=445 gs=2 cs=0 l=1 c_cookie=2079079186009374511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 --2- 10.20.193.28:0/3464039812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b3aa55b360 0x55b3aa53bf60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.930+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 >> 10.20.193.28:0/3464039812 conn(0x55b3aa539860 msgr2=0x55b3aa5b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7feeff7fe640 0 client.30898 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:33:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 shutdown_connections 2026-02-20T13:33:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4e10be00 1 -- 10.20.193.28:0/3464039812 wait complete. 2026-02-20T13:33:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4e10be00 20 client.30898 trim_cache size 0 max 16384 2026-02-20T13:33:10.940 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 -- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef200b5760 msgr2=0x7fef200d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef200b5760 0x7fef200d5c10 secure :-1 s=READY pgs=652 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef44123e90 tx=0x7fef38004420 comp rx=0 tx=0).stop 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 -- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4410f5f0 msgr2=0x7fef4411d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4410f5f0 0x7fef4411d4f0 secure :-1 s=READY pgs=1584 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3400d950 tx=0x7fef3400de20 comp rx=0 tx=0).stop 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 -- 10.20.193.28:0/2438514690 shutdown_connections 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fef200b5760 0x7fef200d5c10 unknown :-1 s=CLOSED pgs=652 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef441157e0 0x7fef44122e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fef4410ffe0 0x7fef4411da30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 --2- 10.20.193.28:0/2438514690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4410f5f0 0x7fef4411d4f0 unknown :-1 s=CLOSED pgs=1584 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 -- 10.20.193.28:0/2438514690 >> 10.20.193.28:0/2438514690 conn(0x7fef440ecea0 msgr2=0x7fef4410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 -- 10.20.193.28:0/2438514690 shutdown_connections 2026-02-20T13:33:10.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:10.931+0000 7fef4c111640 1 -- 10.20.193.28:0/2438514690 wait complete. 2026-02-20T13:33:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:10 trial127 ceph-mon[43817]: pgmap v656: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.5 KiB/s wr, 15 op/s 2026-02-20T13:33:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:10 trial034 ceph-mon[43332]: pgmap v656: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 6.5 KiB/s wr, 15 op/s 2026-02-20T13:33:11.032 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T13:33:11.214 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:11.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 -- 10.20.193.28:0/359797870 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438411e200 msgr2=0x7f438417ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 --2- 10.20.193.28:0/359797870 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438411e200 0x7f438417ebd0 secure :-1 s=READY pgs=446 gs=3 cs=0 l=1 c_cookie=6054696712361216310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f437400a970 tx=0x7f43740301b0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 -- 10.20.193.28:0/359797870 shutdown_connections 2026-02-20T13:33:11.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 --2- 10.20.193.28:0/359797870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4384118a00 0x7f438411da50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 --2- 10.20.193.28:0/359797870 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f438411e200 0x7f438417ebd0 unknown :-1 s=CLOSED pgs=446 gs=3 cs=0 l=1 c_cookie=6054696712361216310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 --2- 10.20.193.28:0/359797870 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4384118010 0x7f43841183e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 -- 10.20.193.28:0/359797870 >> 10.20.193.28:0/359797870 conn(0x7f43840f58a0 msgr2=0x7f4384115cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 -- 10.20.193.28:0/359797870 shutdown_connections 2026-02-20T13:33:11.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.396+0000 7f4388dae640 1 -- 10.20.193.28:0/359797870 wait complete. 2026-02-20T13:33:11.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.397+0000 7f4388dae640 1 Processor -- start 2026-02-20T13:33:11.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.397+0000 7f4388dae640 1 -- start start 2026-02-20T13:33:11.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.397+0000 7f4388dae640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4384118010 0x7f4384125ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.397+0000 7f4388dae640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4384118a00 0x7f43841263e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4388dae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438411e200 0x7f438412b7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4388dae640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f438412bdd0 con 0x7f438411e200 2026-02-20T13:33:11.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4388dae640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f438412bf40 con 0x7f4384118010 2026-02-20T13:33:11.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4388dae640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f438412c100 con 0x7f4384118a00 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4384118010 0x7f4384125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438411e200 0x7f438412b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4384118010 0x7f4384125ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57314/0 (socket says 10.20.193.28:57314) 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382575640 1 -- 10.20.193.28:0/423482545 learned_addr learned my addr 10.20.193.28:0/423482545 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4381d74640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4384118a00 0x7f43841263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382d76640 1 -- 10.20.193.28:0/423482545 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4384118a00 msgr2=0x7f43841263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382d76640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4384118a00 0x7f43841263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382d76640 1 -- 10.20.193.28:0/423482545 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4384118010 msgr2=0x7f4384125ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382d76640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4384118010 0x7f4384125ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382d76640 1 -- 10.20.193.28:0/423482545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436c0094b0 con 0x7f438411e200 2026-02-20T13:33:11.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.398+0000 7f4382d76640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438411e200 0x7f438412b7b0 secure :-1 s=READY pgs=1586 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43740306c0 tx=0x7f4374030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.399+0000 7f436b7fe640 1 -- 10.20.193.28:0/423482545 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f437403e070 con 0x7f438411e200 2026-02-20T13:33:11.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.399+0000 7f436b7fe640 1 -- 10.20.193.28:0/423482545 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4374003ad0 con 0x7f438411e200 2026-02-20T13:33:11.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.399+0000 7f436b7fe640 1 -- 10.20.193.28:0/423482545 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4374042870 con 0x7f438411e200 2026-02-20T13:33:11.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.399+0000 7f4388dae640 1 -- 10.20.193.28:0/423482545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437400a590 con 0x7f438411e200 2026-02-20T13:33:11.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.399+0000 7f4388dae640 1 -- 10.20.193.28:0/423482545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f438416c940 con 0x7f438411e200 2026-02-20T13:33:11.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.402+0000 7f436b7fe640 1 -- 10.20.193.28:0/423482545 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f437404a060 con 0x7f438411e200 2026-02-20T13:33:11.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f436b7fe640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5760 0x7f435c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f436b7fe640 1 -- 10.20.193.28:0/423482545 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f437410c260 con 0x7f438411e200 2026-02-20T13:33:11.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f438ada8e00 1 Processor -- start 2026-02-20T13:33:11.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f438ada8e00 1 -- start start 2026-02-20T13:33:11.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f4382575640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5760 0x7f435c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 0x557719998730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199dd5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199fdf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f438ada8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577198ae780 con 0x5577199ddb20 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f438ada8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5577198aa4b0 con 0x557719998360 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.404+0000 7f438ada8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5577198a4450 con 0x557719998c70 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199dd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4382d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199fdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199dd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60450/0 (socket says 10.20.193.28:60450) 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 -- 10.20.193.28:0/4077900410 learned_addr learned my addr 10.20.193.28:0/4077900410 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4382575640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5760 0x7f435c0d5c10 secure :-1 s=READY pgs=653 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43780097c0 tx=0x7f4378009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 -- 10.20.193.28:0/4077900410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 msgr2=0x557719998730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 --2- 10.20.193.28:0/4077900410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 0x557719998730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 -- 10.20.193.28:0/4077900410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 msgr2=0x5577199fdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 --2- 10.20.193.28:0/4077900410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199fdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 -- 10.20.193.28:0/4077900410 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55771984fd10 con 0x557719998c70 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4382d76640 1 --2- 10.20.193.28:0/4077900410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199fdf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.405+0000 7f4381d74640 1 --2- 10.20.193.28:0/4077900410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199dd5e0 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=2487859588816227352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f436c009880 tx=0x7f436c009d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2286a71d6270cc18 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f4368ff9640 1 -- 10.20.193.28:0/4077900410 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f436c002c20 con 0x557719998c70 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f4368ff9640 1 -- 10.20.193.28:0/4077900410 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f436c002d80 con 0x557719998c70 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f4368ff9640 1 -- 10.20.193.28:0/4077900410 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f436c010a20 con 0x557719998c70 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 -- 10.20.193.28:0/4077900410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 msgr2=0x5577199dd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4077900410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199dd5e0 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=2487859588816227352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f436c009880 tx=0x7f436c009d50 comp rx=0 tx=0).stop 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 -- 10.20.193.28:0/4077900410 shutdown_connections 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4077900410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199fdf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4077900410 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199dd5e0 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=2487859588816227352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4077900410 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 0x557719998730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 -- 10.20.193.28:0/4077900410 >> 10.20.193.28:0/4077900410 conn(0x557719976860 msgr2=0x557719996c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 -- 10.20.193.28:0/4077900410 shutdown_connections 2026-02-20T13:33:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.406+0000 7f438ada8e00 1 -- 10.20.193.28:0/4077900410 wait complete. 2026-02-20T13:33:11.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f438ada8e00 1 -- start start 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f438ada8e00 1 Processor -- start 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 0x5577199f5710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199f5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199face0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f438ada8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577199fb220 con 0x5577199ddb20 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f438ada8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5577199fb390 con 0x557719998360 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f438ada8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5577199fb550 con 0x557719998c70 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f4382d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199face0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f4381d74640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f4382d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199face0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44696/0 (socket says 10.20.193.28:44696) 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.408+0000 7f4382d76640 1 -- 10.20.193.28:0/4102750611 learned_addr learned my addr 10.20.193.28:0/4102750611 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4382575640 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 0x5577199f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4382d76640 1 -- 10.20.193.28:0/4102750611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 msgr2=0x5577199f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4382d76640 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4382d76640 1 -- 10.20.193.28:0/4102750611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 msgr2=0x5577199f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4382d76640 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 0x5577199f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4382d76640 1 -- 10.20.193.28:0/4102750611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436c004480 con 0x5577199ddb20 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4382d76640 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199face0 secure :-1 s=READY pgs=1587 gs=1 cs=0 l=1 c_cookie=862315833904734686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4374006cf0 tx=0x7f43740d2740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf78faea41621de server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4333fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4333fff640 1 -- 10.20.193.28:0/4102750611 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4374095070 con 0x5577199ddb20 2026-02-20T13:33:11.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4333fff640 1 -- 10.20.193.28:0/4102750611 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f43740d2fc0 con 0x5577199ddb20 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4333fff640 1 -- 10.20.193.28:0/4102750611 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43740d34d0 con 0x5577199ddb20 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f438416c940 con 0x5577199ddb20 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f438ada8e00 10 client.21129 _ll_register_callbacks cb 0x557719825a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55771953a6f0 con 0x5577199ddb20 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4333fff640 1 -- 10.20.193.28:0/4102750611 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f43740dd700 con 0x5577199ddb20 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f4333fff640 1 -- 10.20.193.28:0/4102750611 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f43740dd500 con 0x5577199ddb20 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f438ada8e00 10 client.21129 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.409+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5577198283c0 con 0x5577199ddb20 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f4333fff640 1 -- 10.20.193.28:0/4102750611 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f43740d05a0 con 0x5577199ddb20 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f438ada8e00 10 client.21129 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f438ada8e00 10 client.21129 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f438ada8e00 20 client.21129 populate_metadata read hostname 'trial028' 2026-02-20T13:33:11.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5577199daea0 0x5577199db340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f438ada8e00 4 client.21129 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557719846f80 con 0x5577199daea0 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f4382575640 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5577199daea0 0x5577199db340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f4333fff640 10 client.21129 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.410+0000 7f4382575640 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5577199daea0 0x5577199db340 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=15065937224220493830 s_cookie=11705537014967063721 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d114f61529ff4806 server_cookie=a2726be5824c54a9 in_seq=0 out_seq=0 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f4333fff640 1 -- 10.20.193.28:0/4102750611 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557719846f80 con 0x5577199daea0 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f4333fff640 10 client.21129 handle_command_reply: tid=0 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 client.21129 shutdown 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 msgr2=0x5577199face0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199face0 secure :-1 s=READY pgs=1587 gs=1 cs=0 l=1 c_cookie=862315833904734686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4374006cf0 tx=0x7f43740d2740 comp rx=0 tx=0).stop 2026-02-20T13:33:11.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 shutdown_connections 2026-02-20T13:33:11.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x5577199daea0 0x5577199db340 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=15065937224220493830 s_cookie=11705537014967063721 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577199ddb20 0x5577199face0 unknown :-1 s=CLOSED pgs=1587 gs=1 cs=0 l=1 c_cookie=862315833904734686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998c70 0x5577199f5c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 --2- 10.20.193.28:0/4102750611 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998360 0x5577199f5710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f4333fff640 0 client.21129 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:33:11.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 >> 10.20.193.28:0/4102750611 conn(0x557719976860 msgr2=0x557719996c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 shutdown_connections 2026-02-20T13:33:11.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.411+0000 7f438ada8e00 1 -- 10.20.193.28:0/4102750611 wait complete. 2026-02-20T13:33:11.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.412+0000 7f438ada8e00 20 client.21129 trim_cache size 0 max 16384 2026-02-20T13:33:11.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f438ada8e00 1 Processor -- start 2026-02-20T13:33:11.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f438ada8e00 1 -- start start 2026-02-20T13:33:11.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998360 0x5577199f2ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998c70 0x5577199dcc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5577199ddb20 0x5577199dd170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f438ada8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577198a2080 con 0x557719998c70 2026-02-20T13:33:11.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f438ada8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x557719562700 con 0x5577199ddb20 2026-02-20T13:33:11.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f438ada8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x5577199ea040 con 0x557719998360 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f4382575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998360 0x5577199f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f4382575640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998360 0x5577199f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60464/0 (socket says 10.20.193.28:60464) 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f4382575640 1 -- 10.20.193.28:0/93863221 learned_addr learned my addr 10.20.193.28:0/93863221 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.419+0000 7f4382d76640 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5577199ddb20 0x5577199dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f4382575640 1 -- 10.20.193.28:0/93863221 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5577199ddb20 msgr2=0x5577199dd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f4382575640 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5577199ddb20 0x5577199dd170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f4381d74640 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998c70 0x5577199dcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f4382575640 1 -- 10.20.193.28:0/93863221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998c70 msgr2=0x5577199dcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f4382575640 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998c70 0x5577199dcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f4382575640 1 -- 10.20.193.28:0/93863221 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577199e3140 con 0x557719998360 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f4381d74640 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998c70 0x5577199dcc30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f4382575640 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998360 0x5577199f2ff0 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=13571087830016033097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4378011510 tx=0x7f4378014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc56307a8bbb8149 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f434e4e6640 1 -- 10.20.193.28:0/93863221 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4378022040 con 0x557719998360 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f434e4e6640 1 -- 10.20.193.28:0/93863221 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4378011cf0 con 0x557719998360 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f434e4e6640 1 -- 10.20.193.28:0/93863221 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f437801c410 con 0x557719998360 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 -- 10.20.193.28:0/93863221 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998360 msgr2=0x5577199f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998360 0x5577199f2ff0 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=13571087830016033097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4378011510 tx=0x7f4378014000 comp rx=0 tx=0).stop 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 -- 10.20.193.28:0/93863221 shutdown_connections 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998c70 0x5577199dcc30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x5577199ddb20 0x5577199dd170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 --2- 10.20.193.28:0/93863221 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x557719998360 0x5577199f2ff0 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=13571087830016033097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 -- 10.20.193.28:0/93863221 >> 10.20.193.28:0/93863221 conn(0x557719976860 msgr2=0x5577199f18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 -- 10.20.193.28:0/93863221 shutdown_connections 2026-02-20T13:33:11.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.420+0000 7f438ada8e00 1 -- 10.20.193.28:0/93863221 wait complete. 2026-02-20T13:33:11.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.421+0000 7f438ada8e00 1 -- start start 2026-02-20T13:33:11.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.421+0000 7f438ada8e00 1 Processor -- start 2026-02-20T13:33:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.421+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998360 0x557719978790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998c70 0x557719978cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f438ada8e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5577199ddb20 0x557719a437a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f438ada8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577199e3000 con 0x557719998360 2026-02-20T13:33:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f438ada8e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x5577199764d0 con 0x557719998c70 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f438ada8e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x557719a43dc0 con 0x5577199ddb20 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998c70 0x557719978cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998c70 0x557719978cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57352/0 (socket says 10.20.193.28:57352) 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 -- 10.20.193.28:0/1792629085 learned_addr learned my addr 10.20.193.28:0/1792629085 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4382d76640 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5577199ddb20 0x557719a437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 -- 10.20.193.28:0/1792629085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5577199ddb20 msgr2=0x557719a437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5577199ddb20 0x557719a437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4382575640 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998360 0x557719978790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 -- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998360 msgr2=0x557719978790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998360 0x557719978790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 -- 10.20.193.28:0/1792629085 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55771983a0e0 con 0x557719998c70 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4382575640 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998360 0x557719978790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4381d74640 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998c70 0x557719978cd0 secure :-1 s=READY pgs=550 gs=1 cs=0 l=1 c_cookie=6756922602351314079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f436c009fd0 tx=0x7f436c01ab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc5694e9ff5449f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.422+0000 7f4333fff640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f4333fff640 1 -- 10.20.193.28:0/1792629085 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f436c002c20 con 0x557719998c70 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f4333fff640 1 -- 10.20.193.28:0/1792629085 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f436c021040 con 0x557719998c70 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4378009d60 con 0x557719998c70 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f4333fff640 1 -- 10.20.193.28:0/1792629085 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f436c004df0 con 0x557719998c70 2026-02-20T13:33:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 10 client.31049 _ll_register_callbacks cb 0x557719825a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f436c002d80 con 0x557719998c70 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f4333fff640 1 -- 10.20.193.28:0/1792629085 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f436c02f440 con 0x557719998c70 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f4333fff640 1 -- 10.20.193.28:0/1792629085 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f436c02f660 con 0x557719998c70 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 10 client.31049 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=31}) -- 0x557719834b60 con 0x557719998c70 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f4333fff640 1 -- 10.20.193.28:0/1792629085 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f436c02d060 con 0x557719998c70 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 10 client.31049 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 10 client.31049 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 20 client.31049 populate_metadata read hostname 'trial028' 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x557719a8bd20 0x557719aac1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 4 client.31049 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:33:11.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.423+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557719537f40 con 0x557719a8bd20 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.424+0000 7f4382575640 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x557719a8bd20 0x557719aac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.424+0000 7f4382575640 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x557719a8bd20 0x557719aac1a0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=13141643494943992946 s_cookie=971679214345870262 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b6607f2198f5ac72 server_cookie=d7c1918e6b75bb6 in_seq=0 out_seq=0 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.424+0000 7f4333fff640 10 client.31049 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.424+0000 7f4333fff640 1 -- 10.20.193.28:0/1792629085 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557719537f40 con 0x557719a8bd20 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.424+0000 7f4333fff640 10 client.31049 handle_command_reply: tid=0 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.424+0000 7f438ada8e00 1 client.31049 shutdown 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.424+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998c70 msgr2=0x557719978cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.424+0000 7f438ada8e00 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998c70 0x557719978cd0 secure :-1 s=READY pgs=550 gs=1 cs=0 l=1 c_cookie=6756922602351314079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f436c009fd0 tx=0x7f436c01ab90 comp rx=0 tx=0).stop 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 shutdown_connections 2026-02-20T13:33:11.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x557719a8bd20 0x557719aac1a0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=13141643494943992946 s_cookie=971679214345870262 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x5577199ddb20 0x557719a437a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x557719998c70 0x557719978cd0 unknown :-1 s=CLOSED pgs=550 gs=1 cs=0 l=1 c_cookie=6756922602351314079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 1 --2- 10.20.193.28:0/1792629085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557719998360 0x557719978790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4333fff640 0 client.31049 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:33:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 >> 10.20.193.28:0/1792629085 conn(0x557719976860 msgr2=0x5577199f20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 shutdown_connections 2026-02-20T13:33:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 1 -- 10.20.193.28:0/1792629085 wait complete. 2026-02-20T13:33:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f438ada8e00 20 client.31049 trim_cache size 0 max 16384 2026-02-20T13:33:11.436 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:33:11.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 -- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5760 msgr2=0x7f435c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5760 0x7f435c0d5c10 secure :-1 s=READY pgs=653 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43780097c0 tx=0x7f4378009310 comp rx=0 tx=0).stop 2026-02-20T13:33:11.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 -- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438411e200 msgr2=0x7f438412b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438411e200 0x7f438412b7b0 secure :-1 s=READY pgs=1586 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43740306c0 tx=0x7f4374030d70 comp rx=0 tx=0).stop 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 -- 10.20.193.28:0/423482545 shutdown_connections 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f435c0b5760 0x7f435c0d5c10 unknown :-1 s=CLOSED pgs=653 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f438411e200 0x7f438412b7b0 unknown :-1 s=CLOSED pgs=1586 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4384118a00 0x7f43841263e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 --2- 10.20.193.28:0/423482545 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f4384118010 0x7f4384125ea0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 -- 10.20.193.28:0/423482545 >> 10.20.193.28:0/423482545 conn(0x7f43840f58a0 msgr2=0x7f4384115c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 -- 10.20.193.28:0/423482545 shutdown_connections 2026-02-20T13:33:11.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.425+0000 7f4388dae640 1 -- 10.20.193.28:0/423482545 wait complete. 2026-02-20T13:33:11.528 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T13:33:11.713 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:11.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 -- 10.20.193.28:0/1832280699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9bc810f4b0 msgr2=0x7f9bc810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 --2- 10.20.193.28:0/1832280699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9bc810f4b0 0x7f9bc810f880 secure :-1 s=READY pgs=1588 gs=1 cs=0 l=1 c_cookie=12472358309827036926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bb8009950 tx=0x7f9bb802f190 comp rx=0 tx=0).stop 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 -- 10.20.193.28:0/1832280699 shutdown_connections 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 --2- 10.20.193.28:0/1832280699 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9bc81156a0 0x7f9bc8176070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 --2- 10.20.193.28:0/1832280699 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9bc810fea0 0x7f9bc8114ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 --2- 10.20.193.28:0/1832280699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9bc810f4b0 0x7f9bc810f880 unknown :-1 s=CLOSED pgs=1588 gs=1 cs=0 l=1 c_cookie=12472358309827036926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 -- 10.20.193.28:0/1832280699 >> 10.20.193.28:0/1832280699 conn(0x7f9bc80ecda0 msgr2=0x7f9bc810d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 -- 10.20.193.28:0/1832280699 shutdown_connections 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.887+0000 7f9bced3a640 1 -- 10.20.193.28:0/1832280699 wait complete. 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bced3a640 1 Processor -- start 2026-02-20T13:33:11.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bced3a640 1 -- start start 2026-02-20T13:33:11.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bced3a640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9bc810f4b0 0x7f9bc8066f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bced3a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9bc810fea0 0x7f9bc80631a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bced3a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9bc81156a0 0x7f9bc8063850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bced3a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc8063fe0 con 0x7f9bc81156a0 2026-02-20T13:33:11.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bced3a640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc8168560 con 0x7f9bc810f4b0 2026-02-20T13:33:11.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bced3a640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc8168720 con 0x7f9bc810fea0 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bcdd38640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9bc810f4b0 0x7f9bc8066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bcdd38640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9bc810f4b0 0x7f9bc8066f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57362/0 (socket says 10.20.193.28:57362) 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bcdd38640 1 -- 10.20.193.28:0/2451586844 learned_addr learned my addr 10.20.193.28:0/2451586844 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.888+0000 7f9bcd537640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9bc810fea0 0x7f9bc80631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.889+0000 7f9bce539640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9bc81156a0 0x7f9bc8063850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.889+0000 7f9bcd537640 1 -- 10.20.193.28:0/2451586844 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9bc810f4b0 msgr2=0x7f9bc8066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.889+0000 7f9bcd537640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9bc810f4b0 0x7f9bc8066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.889+0000 7f9bcd537640 1 -- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9bc81156a0 msgr2=0x7f9bc8063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.889+0000 7f9bcd537640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9bc81156a0 0x7f9bc8063850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.889+0000 7f9bcd537640 1 -- 10.20.193.28:0/2451586844 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb8009570 con 0x7f9bc810fea0 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.889+0000 7f9bcd537640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9bc810fea0 0x7f9bc80631a0 secure :-1 s=READY pgs=449 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bbc00e9c0 tx=0x7f9bbc00ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.890+0000 7f9bb6ffd640 1 -- 10.20.193.28:0/2451586844 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bbc00ccb0 con 0x7f9bc810fea0 2026-02-20T13:33:11.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.890+0000 7f9bb6ffd640 1 -- 10.20.193.28:0/2451586844 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9bbc00ce10 con 0x7f9bc810fea0 2026-02-20T13:33:11.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.890+0000 7f9bb6ffd640 1 -- 10.20.193.28:0/2451586844 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bbc0106b0 con 0x7f9bc810fea0 2026-02-20T13:33:11.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.890+0000 7f9bced3a640 1 -- 10.20.193.28:0/2451586844 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc81689a0 con 0x7f9bc810fea0 2026-02-20T13:33:11.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.890+0000 7f9bced3a640 1 -- 10.20.193.28:0/2451586844 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc8168e20 con 0x7f9bc810fea0 2026-02-20T13:33:11.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.892+0000 7f9bb6ffd640 1 -- 10.20.193.28:0/2451586844 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f9bbc01f060 con 0x7f9bc810fea0 2026-02-20T13:33:11.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.894+0000 7f9bb6ffd640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ba40b56e0 0x7f9ba40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.894+0000 7f9bb6ffd640 1 -- 10.20.193.28:0/2451586844 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9bbc014070 con 0x7f9bc810fea0 2026-02-20T13:33:11.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.894+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ba40b56e0 0x7f9ba40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ba40b56e0 0x7f9ba40d5b90 secure :-1 s=READY pgs=654 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bb8004820 tx=0x7f9bb803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bd1fbde00 1 Processor -- start 2026-02-20T13:33:11.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bd1fbde00 1 -- start start 2026-02-20T13:33:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 0x559a80124730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124c70 0x559a801695e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80169b20 0x559a80189f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559a8003a780 con 0x559a80169b20 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559a800364b0 con 0x559a80124360 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.895+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559a80030450 con 0x559a80124c70 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80169b20 0x559a80189f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bcd537640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124c70 0x559a801695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80169b20 0x559a80189f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44736/0 (socket says 10.20.193.28:44736) 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 -- 10.20.193.28:0/3584259004 learned_addr learned my addr 10.20.193.28:0/3584259004 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 0x559a80124730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 -- 10.20.193.28:0/3584259004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124c70 msgr2=0x559a801695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124c70 0x559a801695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 -- 10.20.193.28:0/3584259004 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 msgr2=0x559a80124730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 0x559a80124730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 -- 10.20.193.28:0/3584259004 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a7ffdbd10 con 0x559a80169b20 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bcd537640 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124c70 0x559a801695e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9bce539640 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80169b20 0x559a80189f00 secure :-1 s=READY pgs=1589 gs=2 cs=0 l=1 c_cookie=7263049043931089981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bc4006a50 tx=0x7f9bc4003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cb889fc9c0cc3d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9b964e6640 1 -- 10.20.193.28:0/3584259004 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bc400ae30 con 0x559a80169b20 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9b964e6640 1 -- 10.20.193.28:0/3584259004 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9bc4003e90 con 0x559a80169b20 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.896+0000 7f9b964e6640 1 -- 10.20.193.28:0/3584259004 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bc4012a30 con 0x559a80169b20 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/3584259004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80169b20 msgr2=0x559a80189f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80169b20 0x559a80189f00 secure :-1 s=READY pgs=1589 gs=2 cs=0 l=1 c_cookie=7263049043931089981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bc4006a50 tx=0x7f9bc4003c30 comp rx=0 tx=0).stop 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/3584259004 shutdown_connections 2026-02-20T13:33:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80169b20 0x559a80189f00 unknown :-1 s=CLOSED pgs=1589 gs=2 cs=0 l=1 c_cookie=7263049043931089981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124c70 0x559a801695e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/3584259004 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 0x559a80124730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/3584259004 >> 10.20.193.28:0/3584259004 conn(0x559a80102860 msgr2=0x559a80122c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/3584259004 shutdown_connections 2026-02-20T13:33:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.897+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/3584259004 wait complete. 2026-02-20T13:33:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.898+0000 7f9bd1fbde00 1 -- start start 2026-02-20T13:33:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.898+0000 7f9bd1fbde00 1 Processor -- start 2026-02-20T13:33:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80181720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a80181c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 0x559a80186c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559a80187190 con 0x559a80124c70 2026-02-20T13:33:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559a80187300 con 0x559a80169b20 2026-02-20T13:33:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559a801874c0 con 0x559a80124360 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bcdd38640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80181720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bcdd38640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80181720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60518/0 (socket says 10.20.193.28:60518) 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bcdd38640 1 -- 10.20.193.28:0/4277391580 learned_addr learned my addr 10.20.193.28:0/4277391580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bcd537640 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a80181c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.899+0000 7f9bce539640 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 0x559a80186c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9bcd537640 1 -- 10.20.193.28:0/4277391580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 msgr2=0x559a80181720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9bcd537640 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80181720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9bcd537640 1 -- 10.20.193.28:0/4277391580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 msgr2=0x559a80186c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9bcd537640 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 0x559a80186c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9bcd537640 1 -- 10.20.193.28:0/4277391580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc4005350 con 0x559a80124c70 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9bcd537640 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a80181c60 secure :-1 s=READY pgs=1590 gs=3 cs=0 l=1 c_cookie=14781145120178173342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bbc0a9570 tx=0x7f9bbc005930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd212d2c45b7f59e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9b837fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9b837fe640 1 -- 10.20.193.28:0/4277391580 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bbc0b52a0 con 0x559a80124c70 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9b837fe640 1 -- 10.20.193.28:0/4277391580 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9bbc0b80e0 con 0x559a80124c70 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9b837fe640 1 -- 10.20.193.28:0/4277391580 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bbc072130 con 0x559a80124c70 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc8168e20 con 0x559a80124c70 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.900+0000 7f9b837fe640 1 -- 10.20.193.28:0/4277391580 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9bbc0722c0 con 0x559a80124c70 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9b837fe640 10 client.21141 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 10 client.21141 _ll_register_callbacks cb 0x559a7ffb1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:11.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559a7fcc66f0 con 0x559a80124c70 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9b837fe640 1 -- 10.20.193.28:0/4277391580 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9bbc0adc30 con 0x559a80124c70 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 10 client.21141 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x559a7ffb43c0 con 0x559a80124c70 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9b837fe640 1 -- 10.20.193.28:0/4277391580 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f9bbc0d20a0 con 0x559a80124c70 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 10 client.21141 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 10 client.21141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 20 client.21141 populate_metadata read hostname 'trial028' 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559a80189c70 0x559a801678a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 4 client.21141 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:11.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a7ffd2f80 con 0x559a80189c70 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.901+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559a80189c70 0x559a801678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.902+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559a80189c70 0x559a801678a0 crc :-1 s=READY pgs=446 gs=4 cs=0 l=0 c_cookie=5819700488046042410 s_cookie=1813499623903479994 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c3bac28126dd2a server_cookie=192ad84cb31248ba in_seq=0 out_seq=0 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.902+0000 7f9b837fe640 10 client.21141 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.902+0000 7f9b837fe640 1 -- 10.20.193.28:0/4277391580 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559a7ffd2f80 con 0x559a80189c70 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9b837fe640 10 client.21141 handle_command_reply: tid=0 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 client.21141 shutdown 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 msgr2=0x559a80181c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a80181c60 secure :-1 s=READY pgs=1590 gs=3 cs=0 l=1 c_cookie=14781145120178173342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bbc0a9570 tx=0x7f9bbc005930 comp rx=0 tx=0).stop 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 shutdown_connections 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559a80189c70 0x559a801678a0 crc :-1 s=READY pgs=446 gs=4 cs=0 l=0 c_cookie=5819700488046042410 s_cookie=1813499623903479994 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a80181c60 unknown :-1 s=CLOSED pgs=1590 gs=3 cs=0 l=1 c_cookie=14781145120178173342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 0x559a80186c50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4277391580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80181720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9b837fe640 0 client.21141 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:11.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 >> 10.20.193.28:0/4277391580 conn(0x559a80102860 msgr2=0x559a80122c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 shutdown_connections 2026-02-20T13:33:11.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4277391580 wait complete. 2026-02-20T13:33:11.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.903+0000 7f9bd1fbde00 20 client.21141 trim_cache size 0 max 16384 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.910+0000 7f9bd1fbde00 1 Processor -- start 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.910+0000 7f9bd1fbde00 1 -- start start 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.910+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80169590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.910+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a80164780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.910+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 0x559a80164cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.910+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559a80173a50 con 0x559a80124c70 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.910+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559a8002e080 con 0x559a80169b20 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.910+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559a7fcee700 con 0x559a80124360 2026-02-20T13:33:11.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80169590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80169590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60534/0 (socket says 10.20.193.28:60534) 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 -- 10.20.193.28:0/4113246519 learned_addr learned my addr 10.20.193.28:0/4113246519 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bce539640 1 --2- 10.20.193.28:0/4113246519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 0x559a80164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 -- 10.20.193.28:0/4113246519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 msgr2=0x559a80164cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/4113246519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 0x559a80164cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 -- 10.20.193.28:0/4113246519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 msgr2=0x559a80164780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/4113246519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a80164780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 -- 10.20.193.28:0/4113246519 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a7ffc60e0 con 0x559a80124360 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/4113246519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80169590 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=3908951398465010765 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bb8038700 tx=0x7f9bb8043000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=363f62961dc5fc4d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.911+0000 7f9b95ce5640 1 -- 10.20.193.28:0/4113246519 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bb8057070 con 0x559a80124360 2026-02-20T13:33:11.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9b95ce5640 1 -- 10.20.193.28:0/4113246519 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9bb803e040 con 0x559a80124360 2026-02-20T13:33:11.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9b95ce5640 1 -- 10.20.193.28:0/4113246519 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bb8038d30 con 0x559a80124360 2026-02-20T13:33:11.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4113246519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 msgr2=0x559a80169590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4113246519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80169590 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=3908951398465010765 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bb8038700 tx=0x7f9bb8043000 comp rx=0 tx=0).stop 2026-02-20T13:33:11.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4113246519 shutdown_connections 2026-02-20T13:33:11.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4113246519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a80164780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4113246519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80169b20 0x559a80164cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/4113246519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80124360 0x559a80169590 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=3908951398465010765 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4113246519 >> 10.20.193.28:0/4113246519 conn(0x559a80102860 msgr2=0x559a80167e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4113246519 shutdown_connections 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/4113246519 wait complete. 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.912+0000 7f9bd1fbde00 1 -- start start 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bd1fbde00 1 Processor -- start 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 0x559a801044b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a801049f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bd1fbde00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80169b20 0x559a801cf950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559a801022a0 con 0x559a80124c70 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x559a80105370 con 0x559a80124360 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bd1fbde00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x559a801cff10 con 0x559a80169b20 2026-02-20T13:33:11.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcdd38640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 0x559a801044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcd537640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a801049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcd537640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a801049f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44762/0 (socket says 10.20.193.28:44762) 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcd537640 1 -- 10.20.193.28:0/2602216072 learned_addr learned my addr 10.20.193.28:0/2602216072 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bce539640 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80169b20 0x559a801cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcd537640 1 -- 10.20.193.28:0/2602216072 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80169b20 msgr2=0x559a801cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcd537640 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80169b20 0x559a801cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcd537640 1 -- 10.20.193.28:0/2602216072 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 msgr2=0x559a801044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcd537640 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 0x559a801044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.913+0000 7f9bcd537640 1 -- 10.20.193.28:0/2602216072 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a7ffc0b60 con 0x559a80124c70 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9bcd537640 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a801049f0 secure :-1 s=READY pgs=1591 gs=1 cs=0 l=1 c_cookie=2276542507662446190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bbc0ad210 tx=0x7f9bbc0ad180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f97e7595d4c0e6e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9b837fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9b837fe640 1 -- 10.20.193.28:0/2602216072 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bbc0ae7a0 con 0x559a80124c70 2026-02-20T13:33:11.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9b837fe640 1 -- 10.20.193.28:0/2602216072 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559a7fcc66f0 con 0x559a80124c70 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9b837fe640 1 -- 10.20.193.28:0/2602216072 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bbc0e4370 con 0x559a80124c70 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc81768e0 con 0x559a80124c70 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9bd1fbde00 10 client.21144 _ll_register_callbacks cb 0x559a7ffb1a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9b837fe640 1 -- 10.20.193.28:0/2602216072 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f9bbc0b80e0 con 0x559a80124c70 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bc4003e90 con 0x559a80124c70 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9b837fe640 1 -- 10.20.193.28:0/2602216072 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9bbc009290 con 0x559a80124c70 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9bd1fbde00 10 client.21144 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x559a7ffb46f0 con 0x559a80124c70 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9b837fe640 1 -- 10.20.193.28:0/2602216072 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f9bbc093020 con 0x559a80124c70 2026-02-20T13:33:11.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.914+0000 7f9bd1fbde00 10 client.21144 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.915+0000 7f9bd1fbde00 10 client.21144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.915+0000 7f9bd1fbde00 20 client.21144 populate_metadata read hostname 'trial028' 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.915+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559a80217ce0 0x559a80238190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.915+0000 7f9bd1fbde00 4 client.21144 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.915+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a7fcc3f40 con 0x559a80217ce0 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.915+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559a80217ce0 0x559a80238190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.915+0000 7f9bcdd38640 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559a80217ce0 0x559a80238190 crc :-1 s=READY pgs=447 gs=4 cs=0 l=0 c_cookie=15943244793148553093 s_cookie=6994137664937170634 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd41c8ab1eb73785 server_cookie=61102b2654c296ca in_seq=0 out_seq=0 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.915+0000 7f9b837fe640 10 client.21144 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9b837fe640 1 -- 10.20.193.28:0/2602216072 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a7fcc3f40 con 0x559a80217ce0 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9b837fe640 10 client.21144 handle_command_reply: tid=0 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 client.21144 shutdown 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 msgr2=0x559a801049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a801049f0 secure :-1 s=READY pgs=1591 gs=1 cs=0 l=1 c_cookie=2276542507662446190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bbc0ad210 tx=0x7f9bbc0ad180 comp rx=0 tx=0).stop 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 shutdown_connections 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x559a80217ce0 0x559a80238190 crc :-1 s=READY pgs=447 gs=4 cs=0 l=0 c_cookie=15943244793148553093 s_cookie=6994137664937170634 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559a80124c70 0x559a801049f0 unknown :-1 s=CLOSED pgs=1591 gs=1 cs=0 l=1 c_cookie=2276542507662446190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x559a80169b20 0x559a801cf950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 --2- 10.20.193.28:0/2602216072 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x559a80124360 0x559a801044b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 >> 10.20.193.28:0/2602216072 conn(0x559a80102860 msgr2=0x559a80168660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9b837fe640 0 client.21144 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 shutdown_connections 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 1 -- 10.20.193.28:0/2602216072 wait complete. 2026-02-20T13:33:11.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.916+0000 7f9bd1fbde00 20 client.21144 trim_cache size 0 max 16384 2026-02-20T13:33:11.925 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T13:33:11.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 -- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ba40b56e0 msgr2=0x7f9ba40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ba40b56e0 0x7f9ba40d5b90 secure :-1 s=READY pgs=654 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bb8004820 tx=0x7f9bb803a040 comp rx=0 tx=0).stop 2026-02-20T13:33:11.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 -- 10.20.193.28:0/2451586844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9bc810fea0 msgr2=0x7f9bc80631a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9bc810fea0 0x7f9bc80631a0 secure :-1 s=READY pgs=449 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bbc00e9c0 tx=0x7f9bbc00ee90 comp rx=0 tx=0).stop 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 -- 10.20.193.28:0/2451586844 shutdown_connections 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f9ba40b56e0 0x7f9ba40d5b90 unknown :-1 s=CLOSED pgs=654 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9bc81156a0 0x7f9bc8063850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9bc810fea0 0x7f9bc80631a0 unknown :-1 s=CLOSED pgs=449 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 --2- 10.20.193.28:0/2451586844 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f9bc810f4b0 0x7f9bc8066f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 -- 10.20.193.28:0/2451586844 >> 10.20.193.28:0/2451586844 conn(0x7f9bc80ecda0 msgr2=0x7f9bc810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 -- 10.20.193.28:0/2451586844 shutdown_connections 2026-02-20T13:33:11.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:11.917+0000 7f9bced3a640 1 -- 10.20.193.28:0/2451586844 wait complete. 2026-02-20T13:33:12.021 INFO:tasks.fwd_scrub:done joining 2026-02-20T13:33:12.021 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2026-02-20T13:33:12.032 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T13:33:12.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3737126243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d010fd50 msgr2=0x7f30d01101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3737126243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d010fd50 0x7f30d01101c0 secure :-1 s=READY pgs=551 gs=2 cs=0 l=1 c_cookie=7672332885269190030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c4009950 tx=0x7f30c402f190 comp rx=0 tx=0).stop 2026-02-20T13:33:12.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3737126243 shutdown_connections 2026-02-20T13:33:12.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3737126243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30d0110700 0x7f30d0171090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3737126243 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d010fd50 0x7f30d01101c0 unknown :-1 s=CLOSED pgs=551 gs=2 cs=0 l=1 c_cookie=7672332885269190030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3737126243 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30d010ebc0 0x7f30d010efb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3737126243 >> 10.20.193.28:0/3737126243 conn(0x7f30d00ec310 msgr2=0x7f30d010c720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3737126243 shutdown_connections 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.149+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3737126243 wait complete. 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d6b1c640 1 Processor -- start 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d6b1c640 1 -- start start 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d6b1c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30d010ebc0 0x7f30d00f81a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d6b1c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30d010fd50 0x7f30d0171070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d6b1c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d0110700 0x7f30d00f93f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d6b1c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f30d00f8cc0 con 0x7f30d010fd50 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d6b1c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f30d00f8e30 con 0x7f30d0110700 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d6b1c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f30d00f99b0 con 0x7f30d010ebc0 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d5b1a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30d010ebc0 0x7f30d00f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d5b1a640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30d010ebc0 0x7f30d00f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60560/0 (socket says 10.20.193.28:60560) 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d5b1a640 1 -- 10.20.193.28:0/3513909851 learned_addr learned my addr 10.20.193.28:0/3513909851 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d5319640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30d010fd50 0x7f30d0171070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.150+0000 7f30d631b640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d0110700 0x7f30d00f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d5b1a640 1 -- 10.20.193.28:0/3513909851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d0110700 msgr2=0x7f30d00f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d5b1a640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d0110700 0x7f30d00f93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d5b1a640 1 -- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30d010fd50 msgr2=0x7f30d0171070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d5b1a640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30d010fd50 0x7f30d0171070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d5b1a640 1 -- 10.20.193.28:0/3513909851 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c4009570 con 0x7f30d010ebc0 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d5319640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30d010fd50 0x7f30d0171070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d631b640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d0110700 0x7f30d00f93f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:12.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d5b1a640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30d010ebc0 0x7f30d00f81a0 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c0009480 tx=0x7f30c000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:12.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30beffd640 1 -- 10.20.193.28:0/3513909851 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30c000cd40 con 0x7f30d010ebc0 2026-02-20T13:33:12.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30beffd640 1 -- 10.20.193.28:0/3513909851 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f30c0004d30 con 0x7f30d010ebc0 2026-02-20T13:33:12.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d00f9c90 con 0x7f30d010ebc0 2026-02-20T13:33:12.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30beffd640 1 -- 10.20.193.28:0/3513909851 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30c00106e0 con 0x7f30d010ebc0 2026-02-20T13:33:12.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.151+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d00fa110 con 0x7f30d010ebc0 2026-02-20T13:33:12.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.152+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d0175100 con 0x7f30d010ebc0 2026-02-20T13:33:12.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.153+0000 7f30beffd640 1 -- 10.20.193.28:0/3513909851 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f30c001f060 con 0x7f30d010ebc0 2026-02-20T13:33:12.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.155+0000 7f30beffd640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30ac0b56e0 0x7f30ac0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.155+0000 7f30beffd640 1 -- 10.20.193.28:0/3513909851 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f30c0014070 con 0x7f30d010ebc0 2026-02-20T13:33:12.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.155+0000 7f30d5319640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30ac0b56e0 0x7f30ac0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.155+0000 7f30d5319640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30ac0b56e0 0x7f30ac0d5b90 secure :-1 s=READY pgs=655 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c4038820 tx=0x7f30c403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:12.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.156+0000 7f30beffd640 1 -- 10.20.193.28:0/3513909851 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f30c00a98f0 con 0x7f30d010ebc0 2026-02-20T13:33:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.269+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30d010ef90 con 0x7f30d010ebc0 2026-02-20T13:33:12.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.270+0000 7f30beffd640 1 -- 10.20.193.28:0/3513909851 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22778 (secure 0 0 0) 0x7f30c00acaa0 con 0x7f30d010ebc0 2026-02-20T13:33:12.272 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:12.272 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":80,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:17:38.460074+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:33:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30ac0b56e0 msgr2=0x7f30ac0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30ac0b56e0 0x7f30ac0d5b90 secure :-1 s=READY pgs=655 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c4038820 tx=0x7f30c403a040 comp rx=0 tx=0).stop 2026-02-20T13:33:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30d010ebc0 msgr2=0x7f30d00f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30d010ebc0 0x7f30d00f81a0 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c0009480 tx=0x7f30c000ee60 comp rx=0 tx=0).stop 2026-02-20T13:33:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 shutdown_connections 2026-02-20T13:33:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f30ac0b56e0 0x7f30ac0d5b90 unknown :-1 s=CLOSED pgs=655 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30d010fd50 0x7f30d0171070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f30d0110700 0x7f30d00f93f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 --2- 10.20.193.28:0/3513909851 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f30d010ebc0 0x7f30d00f81a0 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 >> 10.20.193.28:0/3513909851 conn(0x7f30d00ec310 msgr2=0x7f30d00ee850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 shutdown_connections 2026-02-20T13:33:12.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.271+0000 7f30d6b1c640 1 -- 10.20.193.28:0/3513909851 wait complete. 2026-02-20T13:33:12.285 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-20T13:14:47.526378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2026-02-20T13:16:31.670509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2026-02-20T13:16:32.355776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-20T13:33:12.286 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-20T13:33:12.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 -- 10.20.193.28:0/1650597492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 msgr2=0x7f8cc410c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/1650597492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 0x7f8cc410c0d0 secure :-1 s=READY pgs=552 gs=2 cs=0 l=1 c_cookie=1498720860776337645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cac009950 tx=0x7f8cac02f190 comp rx=0 tx=0).stop 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 -- 10.20.193.28:0/1650597492 shutdown_connections 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/1650597492 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8cc410c610 0x7f8cc410cf70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/1650597492 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 0x7f8cc410c0d0 unknown :-1 s=CLOSED pgs=552 gs=2 cs=0 l=1 c_cookie=1498720860776337645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/1650597492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cc410ac30 0x7f8cc410b020 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 -- 10.20.193.28:0/1650597492 >> 10.20.193.28:0/1650597492 conn(0x7f8cc40e8610 msgr2=0x7f8cc4108a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 -- 10.20.193.28:0/1650597492 shutdown_connections 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.404+0000 7f8cc88cb640 1 -- 10.20.193.28:0/1650597492 wait complete. 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.405+0000 7f8cc88cb640 1 Processor -- start 2026-02-20T13:33:12.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.405+0000 7f8cc88cb640 1 -- start start 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.405+0000 7f8cc88cb640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8cc410ac30 0x7f8cc40f3190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.405+0000 7f8cc88cb640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 0x7f8cc40f37e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.405+0000 7f8cc88cb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cc410c610 0x7f8cc40f43e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.405+0000 7f8cc88cb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc40f4b20 con 0x7f8cc410c610 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.405+0000 7f8cc88cb640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc40f4c90 con 0x7f8cc410bc60 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.405+0000 7f8cc88cb640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc40f4e50 con 0x7f8cc410ac30 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cc410c610 0x7f8cc40f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc2d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8cc410ac30 0x7f8cc40f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc2575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 0x7f8cc40f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cc410c610 0x7f8cc40f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44784/0 (socket says 10.20.193.28:44784) 2026-02-20T13:33:12.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 -- 10.20.193.28:0/479622972 learned_addr learned my addr 10.20.193.28:0/479622972 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 -- 10.20.193.28:0/479622972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8cc410ac30 msgr2=0x7f8cc40f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8cc410ac30 0x7f8cc40f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 -- 10.20.193.28:0/479622972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 msgr2=0x7f8cc40f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 0x7f8cc40f37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 -- 10.20.193.28:0/479622972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac009570 con 0x7f8cc410c610 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc2575640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 0x7f8cc40f37e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc3577640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cc410c610 0x7f8cc40f43e0 secure :-1 s=READY pgs=1592 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cb400f8d0 tx=0x7f8cb400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8ca3fff640 1 -- 10.20.193.28:0/479622972 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8cb400dce0 con 0x7f8cc410c610 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8ca3fff640 1 -- 10.20.193.28:0/479622972 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8cb400de40 con 0x7f8cc410c610 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc40f5130 con 0x7f8cc410c610 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8ca3fff640 1 -- 10.20.193.28:0/479622972 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8cb40116b0 con 0x7f8cc410c610 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.406+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc40f56a0 con 0x7f8cc410c610 2026-02-20T13:33:12.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.407+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc4110f60 con 0x7f8cc410c610 2026-02-20T13:33:12.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.409+0000 7f8ca3fff640 1 -- 10.20.193.28:0/479622972 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f8cb4020060 con 0x7f8cc410c610 2026-02-20T13:33:12.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.411+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c980b56e0 0x7f8c980d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.411+0000 7f8ca3fff640 1 -- 10.20.193.28:0/479622972 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f8cb4015070 con 0x7f8cc410c610 2026-02-20T13:33:12.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.411+0000 7f8ca3fff640 1 -- 10.20.193.28:0/479622972 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f8cb4120730 con 0x7f8cc410c610 2026-02-20T13:33:12.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.411+0000 7f8cc2d76640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c980b56e0 0x7f8c980d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.412+0000 7f8cc2d76640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c980b56e0 0x7f8c980d5b90 secure :-1 s=READY pgs=656 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cb8004740 tx=0x7f8cb8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:12.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.524+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8cc4060010 con 0x7f8cc410c610 2026-02-20T13:33:12.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.525+0000 7f8ca3fff640 1 -- 10.20.193.28:0/479622972 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f8cb40aa620 con 0x7f8cc410c610 2026-02-20T13:33:12.527 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c980b56e0 msgr2=0x7f8c980d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c980b56e0 0x7f8c980d5b90 secure :-1 s=READY pgs=656 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cb8004740 tx=0x7f8cb8005f90 comp rx=0 tx=0).stop 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cc410c610 msgr2=0x7f8cc40f43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cc410c610 0x7f8cc40f43e0 secure :-1 s=READY pgs=1592 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cb400f8d0 tx=0x7f8cb400fda0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 shutdown_connections 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f8c980b56e0 0x7f8c980d5b90 unknown :-1 s=CLOSED pgs=656 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cc410c610 0x7f8cc40f43e0 unknown :-1 s=CLOSED pgs=1592 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f8cc410bc60 0x7f8cc40f37e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 --2- 10.20.193.28:0/479622972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8cc410ac30 0x7f8cc40f3190 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 >> 10.20.193.28:0/479622972 conn(0x7f8cc40e8610 msgr2=0x7f8cc4109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 shutdown_connections 2026-02-20T13:33:12.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.526+0000 7f8cc88cb640 1 -- 10.20.193.28:0/479622972 wait complete. 2026-02-20T13:33:12.541 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2026-02-20T13:33:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 -- 10.20.193.28:0/2230330110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faaa8110320 msgr2=0x7faaa8110790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 --2- 10.20.193.28:0/2230330110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faaa8110320 0x7faaa8110790 secure :-1 s=READY pgs=553 gs=1 cs=0 l=1 c_cookie=4903346520414035633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa90009950 tx=0x7faa9002f190 comp rx=0 tx=0).stop 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 -- 10.20.193.28:0/2230330110 shutdown_connections 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 --2- 10.20.193.28:0/2230330110 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faaa8110cd0 0x7faaa8171660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 --2- 10.20.193.28:0/2230330110 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faaa8110320 0x7faaa8110790 unknown :-1 s=CLOSED pgs=553 gs=1 cs=0 l=1 c_cookie=4903346520414035633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 --2- 10.20.193.28:0/2230330110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaa810f190 0x7faaa810f580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 -- 10.20.193.28:0/2230330110 >> 10.20.193.28:0/2230330110 conn(0x7faaa80ec8e0 msgr2=0x7faaa810ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 -- 10.20.193.28:0/2230330110 shutdown_connections 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 -- 10.20.193.28:0/2230330110 wait complete. 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 Processor -- start 2026-02-20T13:33:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.660+0000 7faaad90c640 1 -- start start 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaad90c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaa810f190 0x7faaa80f8820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaad90c640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faaa8110320 0x7faaa8171660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaad90c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faaa8110cd0 0x7faaa80f9080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaad90c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faaa80f9c70 con 0x7faaa810f190 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaad90c640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7faaa80f9de0 con 0x7faaa8110cd0 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaad90c640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7faaa80f9fa0 con 0x7faaa8110320 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faaa8110320 0x7faaa8171660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaa810f190 0x7faaa80f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faaa8110320 0x7faaa8171660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60596/0 (socket says 10.20.193.28:60596) 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa77fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faaa8110cd0 0x7faaa80f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 -- 10.20.193.28:0/216934368 learned_addr learned my addr 10.20.193.28:0/216934368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 -- 10.20.193.28:0/216934368 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faaa8110cd0 msgr2=0x7faaa80f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faaa8110cd0 0x7faaa80f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 -- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaa810f190 msgr2=0x7faaa80f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaa810f190 0x7faaa80f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 -- 10.20.193.28:0/216934368 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa90009570 con 0x7faaa8110320 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.661+0000 7faaa67fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faaa8110320 0x7faaa8171660 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa90005b30 tx=0x7faa900028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.662+0000 7faaac90a640 1 -- 10.20.193.28:0/216934368 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa9003d070 con 0x7faaa8110320 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.662+0000 7faaac90a640 1 -- 10.20.193.28:0/216934368 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faa90002a40 con 0x7faaa8110320 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.662+0000 7faaad90c640 1 -- 10.20.193.28:0/216934368 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa80fa220 con 0x7faaa8110320 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.662+0000 7faaad90c640 1 -- 10.20.193.28:0/216934368 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa80fa690 con 0x7faaa8110320 2026-02-20T13:33:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.662+0000 7faaac90a640 1 -- 10.20.193.28:0/216934368 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa90041a70 con 0x7faaa8110320 2026-02-20T13:33:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.662+0000 7faa867fc640 1 -- 10.20.193.28:0/216934368 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa70005300 con 0x7faaa8110320 2026-02-20T13:33:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.664+0000 7faaac90a640 1 -- 10.20.193.28:0/216934368 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7faa90038920 con 0x7faaa8110320 2026-02-20T13:33:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.666+0000 7faaac90a640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa7c0b56e0 0x7faa7c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.666+0000 7faaac90a640 1 -- 10.20.193.28:0/216934368 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7faa9010b580 con 0x7faaa8110320 2026-02-20T13:33:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.666+0000 7faaa6ffd640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa7c0b56e0 0x7faa7c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.666+0000 7faaa6ffd640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa7c0b56e0 0x7faa7c0d5b90 secure :-1 s=READY pgs=657 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa9c004740 tx=0x7faa9c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:12.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.667+0000 7faaac90a640 1 -- 10.20.193.28:0/216934368 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7faa900ce020 con 0x7faaa8110320 2026-02-20T13:33:12.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.781+0000 7faa867fc640 1 -- 10.20.193.28:0/216934368 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faa70005b30 con 0x7faaa8110320 2026-02-20T13:33:12.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.781+0000 7faaac90a640 1 -- 10.20.193.28:0/216934368 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7faa900d11d0 con 0x7faaa8110320 2026-02-20T13:33:12.783 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 32 2026-02-20T13:33:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 -- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa7c0b56e0 msgr2=0x7faa7c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa7c0b56e0 0x7faa7c0d5b90 secure :-1 s=READY pgs=657 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa9c004740 tx=0x7faa9c00b410 comp rx=0 tx=0).stop 2026-02-20T13:33:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 -- 10.20.193.28:0/216934368 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faaa8110320 msgr2=0x7faaa8171660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faaa8110320 0x7faaa8171660 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa90005b30 tx=0x7faa900028d0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 -- 10.20.193.28:0/216934368 shutdown_connections 2026-02-20T13:33:12.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7faa7c0b56e0 0x7faa7c0d5b90 unknown :-1 s=CLOSED pgs=657 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7faaa8110cd0 0x7faaa80f9080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7faaa8110320 0x7faaa8171660 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 --2- 10.20.193.28:0/216934368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaa810f190 0x7faaa80f8820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 -- 10.20.193.28:0/216934368 >> 10.20.193.28:0/216934368 conn(0x7faaa80ec8e0 msgr2=0x7faaa80eee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 -- 10.20.193.28:0/216934368 shutdown_connections 2026-02-20T13:33:12.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.782+0000 7faa867fc640 1 -- 10.20.193.28:0/216934368 wait complete. 2026-02-20T13:33:12.797 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2026-02-20T13:33:12.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:12 trial028 ceph-mon[37442]: pgmap v657: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:33:12.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:12 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/3513909851' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:33:12.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:12 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/479622972' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:33:12.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 -- 10.20.193.28:0/868708710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23841137b0 msgr2=0x7f2384133b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 --2- 10.20.193.28:0/868708710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23841137b0 0x7f2384133b90 secure :-1 s=READY pgs=1593 gs=1 cs=0 l=1 c_cookie=15850449859743422349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2374009950 tx=0x7f237402f190 comp rx=0 tx=0).stop 2026-02-20T13:33:12.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 -- 10.20.193.28:0/868708710 shutdown_connections 2026-02-20T13:33:12.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 --2- 10.20.193.28:0/868708710 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f2384154d90 0x7f2384175240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 --2- 10.20.193.28:0/868708710 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f23841341d0 0x7f2384154650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 --2- 10.20.193.28:0/868708710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23841137b0 0x7f2384133b90 unknown :-1 s=CLOSED pgs=1593 gs=1 cs=0 l=1 c_cookie=15850449859743422349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 -- 10.20.193.28:0/868708710 >> 10.20.193.28:0/868708710 conn(0x7f2384064000 msgr2=0x7f2384064420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 -- 10.20.193.28:0/868708710 shutdown_connections 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 -- 10.20.193.28:0/868708710 wait complete. 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 Processor -- start 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.914+0000 7f238b283640 1 -- start start 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238b283640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f23841137b0 0x7f2384154650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238b283640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f23841341d0 0x7f2384175240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238b283640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2384154d90 0x7f23840ff1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238b283640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f23840ff960 con 0x7f2384154d90 2026-02-20T13:33:12.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238b283640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f23840ffad0 con 0x7f23841137b0 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238b283640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2384100100 con 0x7f23841341d0 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f23841137b0 0x7f2384154650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f23841137b0 0x7f2384154650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57458/0 (socket says 10.20.193.28:57458) 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 -- 10.20.193.28:0/385580159 learned_addr learned my addr 10.20.193.28:0/385580159 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f2389a80640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f23841341d0 0x7f2384175240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238aa82640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2384154d90 0x7f23840ff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 -- 10.20.193.28:0/385580159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f23841341d0 msgr2=0x7f2384175240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f23841341d0 0x7f2384175240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 -- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2384154d90 msgr2=0x7f23840ff1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2384154d90 0x7f23840ff1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 -- 10.20.193.28:0/385580159 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2374009570 con 0x7f23841137b0 2026-02-20T13:33:12.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.915+0000 7f238a281640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f23841137b0 0x7f2384154650 secure :-1 s=READY pgs=554 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2374038820 tx=0x7f23740043d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:12.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.916+0000 7f236b7fe640 1 -- 10.20.193.28:0/385580159 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f237403d070 con 0x7f23841137b0 2026-02-20T13:33:12.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.916+0000 7f236b7fe640 1 -- 10.20.193.28:0/385580159 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2374038920 con 0x7f23841137b0 2026-02-20T13:33:12.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.916+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2384100380 con 0x7f23841137b0 2026-02-20T13:33:12.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.916+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23841007f0 con 0x7f23841137b0 2026-02-20T13:33:12.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.916+0000 7f236b7fe640 1 -- 10.20.193.28:0/385580159 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f23740419d0 con 0x7f23841137b0 2026-02-20T13:33:12.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.916+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23841795e0 con 0x7f23841137b0 2026-02-20T13:33:12.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.918+0000 7f236b7fe640 1 -- 10.20.193.28:0/385580159 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f2374038a90 con 0x7f23841137b0 2026-02-20T13:33:12.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.920+0000 7f236b7fe640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23600b56e0 0x7f23600d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:12.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.920+0000 7f236b7fe640 1 -- 10.20.193.28:0/385580159 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f237410b190 con 0x7f23841137b0 2026-02-20T13:33:12.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.920+0000 7f2389a80640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23600b56e0 0x7f23600d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:12.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.920+0000 7f236b7fe640 1 -- 10.20.193.28:0/385580159 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f237410b610 con 0x7f23841137b0 2026-02-20T13:33:12.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:12.921+0000 7f2389a80640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23600b56e0 0x7f23600d5b90 secure :-1 s=READY pgs=658 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2378004740 tx=0x7f2378005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:12 trial127 ceph-mon[43817]: pgmap v657: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:33:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:12 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/3513909851' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:33:12.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:12 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/479622972' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:33:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:12 trial034 ceph-mon[43332]: pgmap v657: 97 pgs: 97 active+clean; 2.9 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2026-02-20T13:33:12.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:12 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/3513909851' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:33:12.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:12 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/479622972' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-20T13:33:13.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.033+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2384100ad0 con 0x7f23841137b0 2026-02-20T13:33:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.033+0000 7f236b7fe640 1 -- 10.20.193.28:0/385580159 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7f23740cdc80 con 0x7f23841137b0 2026-02-20T13:33:13.036 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 64 2026-02-20T13:33:13.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23600b56e0 msgr2=0x7f23600d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:13.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23600b56e0 0x7f23600d5b90 secure :-1 s=READY pgs=658 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2378004740 tx=0x7f2378005f90 comp rx=0 tx=0).stop 2026-02-20T13:33:13.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f23841137b0 msgr2=0x7f2384154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:13.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f23841137b0 0x7f2384154650 secure :-1 s=READY pgs=554 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2374038820 tx=0x7f23740043d0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 shutdown_connections 2026-02-20T13:33:13.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f23600b56e0 0x7f23600d5b90 unknown :-1 s=CLOSED pgs=658 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2384154d90 0x7f23840ff1d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f23841341d0 0x7f2384175240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 --2- 10.20.193.28:0/385580159 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f23841137b0 0x7f2384154650 unknown :-1 s=CLOSED pgs=554 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 >> 10.20.193.28:0/385580159 conn(0x7f2384064000 msgr2=0x7f23840f5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:13.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 shutdown_connections 2026-02-20T13:33:13.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.034+0000 7f238b283640 1 -- 10.20.193.28:0/385580159 wait complete. 2026-02-20T13:33:13.050 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 -- 10.20.193.28:0/4023227769 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4900600b0 msgr2=0x7fe49010b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 --2- 10.20.193.28:0/4023227769 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4900600b0 0x7fe49010b8a0 secure :-1 s=READY pgs=555 gs=1 cs=0 l=1 c_cookie=13537318205000502907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe480009950 tx=0x7fe48002f190 comp rx=0 tx=0).stop 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 -- 10.20.193.28:0/4023227769 shutdown_connections 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 --2- 10.20.193.28:0/4023227769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe49010c940 0x7fe49010cde0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 --2- 10.20.193.28:0/4023227769 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe49010bde0 0x7fe49010c250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 --2- 10.20.193.28:0/4023227769 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe4900600b0 0x7fe49010b8a0 unknown :-1 s=CLOSED pgs=555 gs=1 cs=0 l=1 c_cookie=13537318205000502907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 -- 10.20.193.28:0/4023227769 >> 10.20.193.28:0/4023227769 conn(0x7fe4900e94c0 msgr2=0x7fe490109910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 -- 10.20.193.28:0/4023227769 shutdown_connections 2026-02-20T13:33:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.167+0000 7fe496c12640 1 -- 10.20.193.28:0/4023227769 wait complete. 2026-02-20T13:33:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe496c12640 1 Processor -- start 2026-02-20T13:33:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe496c12640 1 -- start start 2026-02-20T13:33:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe496c12640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4900600b0 0x7fe4900f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe496c12640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe49010bde0 0x7fe4900f5320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe496c12640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe49010c940 0x7fe4900f5f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe496c12640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4900f6660 con 0x7fe4900600b0 2026-02-20T13:33:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe496c12640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe4900f67d0 con 0x7fe49010bde0 2026-02-20T13:33:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe496c12640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe4900f6990 con 0x7fe49010c940 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe487fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe49010bde0 0x7fe4900f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe494987640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4900600b0 0x7fe4900f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe487fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe49010bde0 0x7fe4900f5320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57478/0 (socket says 10.20.193.28:57478) 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe487fff640 1 -- 10.20.193.28:0/516865486 learned_addr learned my addr 10.20.193.28:0/516865486 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.168+0000 7fe495188640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe49010c940 0x7fe4900f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe494987640 1 -- 10.20.193.28:0/516865486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe49010c940 msgr2=0x7fe4900f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe494987640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe49010c940 0x7fe4900f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe494987640 1 -- 10.20.193.28:0/516865486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe49010bde0 msgr2=0x7fe4900f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe494987640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe49010bde0 0x7fe4900f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe494987640 1 -- 10.20.193.28:0/516865486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe480009570 con 0x7fe4900600b0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe487fff640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe49010bde0 0x7fe4900f5320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe494987640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4900600b0 0x7fe4900f4cd0 secure :-1 s=READY pgs=1594 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe48002f6a0 tx=0x7fe480004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe485ffb640 1 -- 10.20.193.28:0/516865486 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe48003d070 con 0x7fe4900600b0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe485ffb640 1 -- 10.20.193.28:0/516865486 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe480038920 con 0x7fe4900600b0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4900f6c10 con 0x7fe4900600b0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe485ffb640 1 -- 10.20.193.28:0/516865486 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe480041910 con 0x7fe4900600b0 2026-02-20T13:33:13.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.169+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4900f7130 con 0x7fe4900600b0 2026-02-20T13:33:13.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.170+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe490060600 con 0x7fe4900600b0 2026-02-20T13:33:13.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.172+0000 7fe485ffb640 1 -- 10.20.193.28:0/516865486 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe480038a90 con 0x7fe4900600b0 2026-02-20T13:33:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.174+0000 7fe485ffb640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe46c0b56e0 0x7fe46c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.174+0000 7fe485ffb640 1 -- 10.20.193.28:0/516865486 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe48010b550 con 0x7fe4900600b0 2026-02-20T13:33:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.174+0000 7fe485ffb640 1 -- 10.20.193.28:0/516865486 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fe48010b9d0 con 0x7fe4900600b0 2026-02-20T13:33:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.174+0000 7fe487fff640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe46c0b56e0 0x7fe46c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:13.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.174+0000 7fe487fff640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe46c0b56e0 0x7fe46c0d5b90 secure :-1 s=READY pgs=659 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4780095b0 tx=0x7fe478005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:13.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.316+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fe490111180 con 0x7fe4900600b0 2026-02-20T13:33:13.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.323+0000 7fe485ffb640 1 -- 10.20.193.28:0/516865486 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v16) ==== 81+0+827131 (secure 0 0 0) 0x7fe4800cdf00 con 0x7fe4900600b0 2026-02-20T13:33:13.329 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 16, 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "active_gid": 14152, 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "active_name": "x", 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "active_addrs": { 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:6800", 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 1124954776 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v1", 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:6801", 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 1124954776 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.330 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "active_addr": "10.20.193.28:6801/1124954776", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "active_change": "2026-02-20T13:13:37.304927+0000", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "active_mgr_features": 4544132024016699391, 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "available": true, 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "standbys": [ 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "gid": 14235, 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "name": "z", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_features": 4544132024016699391, 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.331 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.332 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.333 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.334 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.335 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.336 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-20T13:33:13.337 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.338 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.339 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-20T13:33:13.340 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.341 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.342 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-20T13:33:13.343 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.344 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.345 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.346 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.347 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.348 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.349 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-20T13:33:13.350 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.351 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-20T13:33:13.352 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.353 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.354 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-20T13:33:13.355 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.356 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.357 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_automated_rotation_enabled": { 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.358 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_debug_mode": { 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_debug_mode", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_period": { 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_period", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.359 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "max": "30", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_duration_days": { 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_duration_days", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1095", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "min": "90", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "max": "3650", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.360 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_renewal_threshold_days": { 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_renewal_threshold_days", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "max": "90", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.361 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.362 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alertmanager container image", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alloy": { 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alloy", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alloy container image", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.364 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Elasticsearch container image", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.365 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Grafana container image", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.366 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Haproxy container image", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.367 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.368 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.369 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nginx": { 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nginx", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nginx container image", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.370 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Node exporter container image", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvmeof container image", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_oauth2_proxy": { 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_oauth2_proxy", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-20T13:33:13.371 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Oauth2 proxy container image", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-20T13:33:13.372 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.373 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba container image", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba_metrics": { 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba_metrics", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba metrics container image", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.374 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Snmp gateway container image", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.375 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-20T13:33:13.376 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.377 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.378 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.379 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to perform a host check", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.380 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.381 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.382 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.383 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "max_parallel_osd_upgrades": { 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_parallel_osd_upgrades", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "16", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.384 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Internal - do not modify", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.385 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-20T13:33:13.386 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Cephadm service discovery port", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.387 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T13:33:13.388 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "stray_daemon_check_interval": { 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stray_daemon_check_interval", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.389 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.390 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.391 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.392 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.393 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.394 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.395 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-20T13:33:13.396 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.397 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.398 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-20T13:33:13.399 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "[]", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "MULTICLUSTER_CONFIG": { 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "{}", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.400 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.401 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-20T13:33:13.402 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.403 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.404 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-20T13:33:13.405 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "UNSAFE_TLS_v1_2": { 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.406 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "crypto_caller": { 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crypto_caller", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.408 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.409 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.410 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.411 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.412 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "sso_oauth2": { 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sso_oauth2", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.413 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.414 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.416 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.417 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.418 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.419 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.420 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.421 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.422 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.423 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-20T13:33:13.424 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.425 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.426 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.427 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.428 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.429 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.430 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.431 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.432 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.433 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.434 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.435 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.436 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.437 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-20T13:33:13.438 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.439 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.440 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.441 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-20T13:33:13.442 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.443 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.444 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.445 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.446 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.447 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.448 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.449 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.450 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.451 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.452 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.453 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.454 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "healthcheck_history_max_entries": { 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "name": "healthcheck_history_max_entries", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1000", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.455 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.456 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.457 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.458 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-20T13:33:13.459 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.460 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.461 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-20T13:33:13.462 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.463 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.464 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.465 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.466 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_tls_secret_name": { 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_tls_secret_name", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.467 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.468 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-20T13:33:13.469 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.470 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.471 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-20T13:33:13.472 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smb", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.473 INFO:teuthology.orchestra.run.trial028.stdout: "internal_store_backend": { 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "name": "internal_store_backend", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.474 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.475 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "update_orchestration": { 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_orchestration", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.476 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.477 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.478 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.479 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.480 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.481 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.483 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.484 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.485 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.486 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T13:33:13.487 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.488 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.489 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.490 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.491 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.492 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.493 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.494 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.495 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "pause_cloning": { 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_cloning", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "pause_purging": { 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_purging", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.496 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "gid": 24116, 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "name": "y", 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_features": 4544132024016699391, 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-20T13:33:13.497 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.498 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.499 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.500 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.501 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.502 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-20T13:33:13.503 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.504 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.505 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T13:33:13.506 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.507 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.508 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.509 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-20T13:33:13.510 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_automated_rotation_enabled": { 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_debug_mode": { 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_debug_mode", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.511 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_period": { 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_period", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "max": "30", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_duration_days": { 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_duration_days", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1095", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "min": "90", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "max": "3650", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_renewal_threshold_days": { 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_renewal_threshold_days", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "max": "90", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.512 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-20T13:33:13.513 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alertmanager container image", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alloy": { 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alloy", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alloy container image", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-20T13:33:13.514 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Elasticsearch container image", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Grafana container image", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Haproxy container image", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.515 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.516 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nginx": { 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nginx", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nginx container image", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Node exporter container image", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.517 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvmeof container image", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_oauth2_proxy": { 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_oauth2_proxy", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Oauth2 proxy container image", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.518 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba container image", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba_metrics": { 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba_metrics", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba metrics container image", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Snmp gateway container image", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.519 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-20T13:33:13.520 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.521 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to perform a host check", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.522 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.523 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.524 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.525 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "max_parallel_osd_upgrades": { 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_parallel_osd_upgrades", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "16", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Internal - do not modify", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.526 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.527 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T13:33:13.528 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Cephadm service discovery port", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.529 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "stray_daemon_check_interval": { 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stray_daemon_check_interval", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.530 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.531 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.532 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.533 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.534 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.535 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-20T13:33:13.536 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.537 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.538 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.539 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.540 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "[]", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "MULTICLUSTER_CONFIG": { 2026-02-20T13:33:13.541 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "{}", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.542 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.543 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-20T13:33:13.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.545 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.546 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.547 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "UNSAFE_TLS_v1_2": { 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.548 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.549 INFO:teuthology.orchestra.run.trial028.stdout: "crypto_caller": { 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crypto_caller", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.550 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.551 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-20T13:33:13.552 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.553 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "sso_oauth2": { 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sso_oauth2", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.554 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.555 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.556 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.557 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.558 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.559 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.560 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.561 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.562 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.563 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.564 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.565 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.566 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.567 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.568 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.569 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.570 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.571 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.572 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.573 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-20T13:33:13.574 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.575 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.576 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.577 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.578 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.579 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.581 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.582 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.583 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.584 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.585 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-20T13:33:13.586 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.587 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.588 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.589 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.590 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.591 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-20T13:33:13.592 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.593 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.594 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.595 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.596 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "healthcheck_history_max_entries": { 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "name": "healthcheck_history_max_entries", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1000", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.597 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.598 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.599 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.600 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.601 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.602 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.603 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.604 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.605 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.606 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.607 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_tls_secret_name": { 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_tls_secret_name", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.608 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.609 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.610 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.611 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.612 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.613 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.614 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smb", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "internal_store_backend": { 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "name": "internal_store_backend", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.615 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.616 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "update_orchestration": { 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_orchestration", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.617 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.618 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.619 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.620 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.621 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.622 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.623 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.624 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.625 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-20T13:33:13.626 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.627 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.628 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-20T13:33:13.629 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.630 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.631 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-20T13:33:13.632 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.633 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.634 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.635 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.636 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "pause_cloning": { 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_cloning", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "pause_purging": { 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_purging", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.637 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.638 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "modules": [ 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "dashboard", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "iostat", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "nfs" 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.639 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.640 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.641 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-20T13:33:13.642 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.643 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-20T13:33:13.644 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.645 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.646 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.647 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.648 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-20T13:33:13.649 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.650 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.651 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.652 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-20T13:33:13.653 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_automated_rotation_enabled": { 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.654 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_debug_mode": { 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_debug_mode", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_period": { 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_period", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "max": "30", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_duration_days": { 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_duration_days", 2026-02-20T13:33:13.655 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1095", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "min": "90", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "max": "3650", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_renewal_threshold_days": { 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_renewal_threshold_days", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "max": "90", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.656 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-20T13:33:13.657 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alertmanager container image", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alloy": { 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alloy", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alloy container image", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.658 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Elasticsearch container image", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Grafana container image", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Haproxy container image", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.659 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.660 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nginx": { 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nginx", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nginx container image", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Node exporter container image", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.661 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvmeof container image", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_oauth2_proxy": { 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_oauth2_proxy", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Oauth2 proxy container image", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.662 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba container image", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba_metrics": { 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba_metrics", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba metrics container image", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.663 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Snmp gateway container image", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.665 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to perform a host check", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.666 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.667 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.668 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.669 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "max_parallel_osd_upgrades": { 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_parallel_osd_upgrades", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "16", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Internal - do not modify", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.670 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-20T13:33:13.671 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.672 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Cephadm service discovery port", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "stray_daemon_check_interval": { 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stray_daemon_check_interval", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.674 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.675 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.676 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.677 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-20T13:33:13.678 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.679 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.680 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.681 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-20T13:33:13.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.683 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.684 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.685 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "[]", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "MULTICLUSTER_CONFIG": { 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "{}", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.686 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.688 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.689 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.690 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "UNSAFE_TLS_v1_2": { 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.692 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.693 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "crypto_caller": { 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crypto_caller", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.694 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.695 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.698 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "sso_oauth2": { 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sso_oauth2", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.699 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.700 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.701 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.702 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.703 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.704 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.705 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.706 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-20T13:33:13.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.708 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.709 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.712 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.713 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.714 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.715 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.716 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.717 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.718 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.719 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.720 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-20T13:33:13.722 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.723 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.724 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.725 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.727 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.731 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.732 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.734 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.735 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.737 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "healthcheck_history_max_entries": { 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "healthcheck_history_max_entries", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1000", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-20T13:33:13.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-20T13:33:13.745 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.751 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_tls_secret_name": { 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_tls_secret_name", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.759 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smb", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "internal_store_backend": { 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "internal_store_backend", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.761 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "update_orchestration": { 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_orchestration", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.762 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.766 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.769 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.779 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.780 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-20T13:33:13.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "pause_cloning": { 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_cloning", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "pause_purging": { 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_purging", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T13:33:13.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T13:33:13.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "services": { 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "dashboard": "https://10.20.193.28:8443/" 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "always_on_modules": { 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "octopus": [ 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "pacific": [ 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "quincy": [ 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "reef": [ 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T13:33:13.784 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "squid": [ 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "tentacle": [ 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "force_disabled_modules": {}, 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "last_failure_osd_epoch": 3, 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "active_clients": [ 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 4267729573 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "libcephsqlite", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 2351717990 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 803030585 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 2788676170 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T13:33:13.786 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe46c0b56e0 msgr2=0x7fe46c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe46c0b56e0 0x7fe46c0d5b90 secure :-1 s=READY pgs=659 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4780095b0 tx=0x7fe478005f90 comp rx=0 tx=0).stop 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4900600b0 msgr2=0x7fe4900f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4900600b0 0x7fe4900f4cd0 secure :-1 s=READY pgs=1594 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe48002f6a0 tx=0x7fe480004290 comp rx=0 tx=0).stop 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 shutdown_connections 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe46c0b56e0 0x7fe46c0d5b90 unknown :-1 s=CLOSED pgs=659 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe49010c940 0x7fe4900f5f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe49010bde0 0x7fe4900f5320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 --2- 10.20.193.28:0/516865486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4900600b0 0x7fe4900f4cd0 unknown :-1 s=CLOSED pgs=1594 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 >> 10.20.193.28:0/516865486 conn(0x7fe4900e94c0 msgr2=0x7fe4900eb170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 shutdown_connections 2026-02-20T13:33:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:13.328+0000 7fe496c12640 1 -- 10.20.193.28:0/516865486 wait complete. 2026-02-20T13:33:13.791 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:33:13.976 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:13.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:13 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/216934368' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-20T13:33:13.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:13 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/385580159' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-20T13:33:13.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:13 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/516865486' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-20T13:33:13.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:13 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/216934368' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-20T13:33:13.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:13 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/385580159' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-20T13:33:13.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:13 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/516865486' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-20T13:33:14.020 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:13 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/216934368' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-20T13:33:14.020 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:13 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/385580159' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-20T13:33:14.021 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:13 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/516865486' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-20T13:33:14.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 -- 10.20.193.28:0/2328357325 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410b8a0 msgr2=0x7f121410bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 --2- 10.20.193.28:0/2328357325 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410b8a0 0x7f121410bc70 secure :-1 s=READY pgs=556 gs=1 cs=0 l=1 c_cookie=3474343896773534702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1200009950 tx=0x7f120002f190 comp rx=0 tx=0).stop 2026-02-20T13:33:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 -- 10.20.193.28:0/2328357325 shutdown_connections 2026-02-20T13:33:14.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 --2- 10.20.193.28:0/2328357325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12141555d0 0x7f12141759b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 --2- 10.20.193.28:0/2328357325 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f121410c1b0 0x7f1214155090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 --2- 10.20.193.28:0/2328357325 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410b8a0 0x7f121410bc70 unknown :-1 s=CLOSED pgs=556 gs=1 cs=0 l=1 c_cookie=3474343896773534702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 -- 10.20.193.28:0/2328357325 >> 10.20.193.28:0/2328357325 conn(0x7f12140e95c0 msgr2=0x7f12141099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 -- 10.20.193.28:0/2328357325 shutdown_connections 2026-02-20T13:33:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.163+0000 7f121951b640 1 -- 10.20.193.28:0/2328357325 wait complete. 2026-02-20T13:33:14.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f121951b640 1 Processor -- start 2026-02-20T13:33:14.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f121951b640 1 -- start start 2026-02-20T13:33:14.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f121951b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f121410b8a0 0x7f1214160d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f121951b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410c1b0 0x7f1214161270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f121951b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12141555d0 0x7f1214166640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f121951b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1214166c60 con 0x7f121410b8a0 2026-02-20T13:33:14.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f121951b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f1214166dd0 con 0x7f121410c1b0 2026-02-20T13:33:14.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f121951b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1214166f90 con 0x7f12141555d0 2026-02-20T13:33:14.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.164+0000 7f12137fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410c1b0 0x7f1214161270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12137fe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410c1b0 0x7f1214161270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57502/0 (socket says 10.20.193.28:57502) 2026-02-20T13:33:14.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12137fe640 1 -- 10.20.193.28:0/447017535 learned_addr learned my addr 10.20.193.28:0/447017535 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f1213fff640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f121410b8a0 0x7f1214160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f1218d1a640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12141555d0 0x7f1214166640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12137fe640 1 -- 10.20.193.28:0/447017535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12141555d0 msgr2=0x7f1214166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12137fe640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12141555d0 0x7f1214166640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12137fe640 1 -- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f121410b8a0 msgr2=0x7f1214160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12137fe640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f121410b8a0 0x7f1214160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12137fe640 1 -- 10.20.193.28:0/447017535 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1200009570 con 0x7f121410c1b0 2026-02-20T13:33:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f1218d1a640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12141555d0 0x7f1214166640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12137fe640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410c1b0 0x7f1214161270 secure :-1 s=READY pgs=557 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1204009480 tx=0x7f120400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12117fa640 1 -- 10.20.193.28:0/447017535 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f120400cd40 con 0x7f121410c1b0 2026-02-20T13:33:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12117fa640 1 -- 10.20.193.28:0/447017535 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1204004d30 con 0x7f121410c1b0 2026-02-20T13:33:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f121951b640 1 -- 10.20.193.28:0/447017535 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1214167270 con 0x7f121410c1b0 2026-02-20T13:33:14.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f121951b640 1 -- 10.20.193.28:0/447017535 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1214152200 con 0x7f121410c1b0 2026-02-20T13:33:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.165+0000 7f12117fa640 1 -- 10.20.193.28:0/447017535 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12040106b0 con 0x7f121410c1b0 2026-02-20T13:33:14.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.166+0000 7f11e6ffd640 1 -- 10.20.193.28:0/447017535 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12140603a0 con 0x7f121410c1b0 2026-02-20T13:33:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.168+0000 7f12117fa640 1 -- 10.20.193.28:0/447017535 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f120401f060 con 0x7f121410c1b0 2026-02-20T13:33:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.169+0000 7f12117fa640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11e80b56e0 0x7f11e80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.169+0000 7f12117fa640 1 -- 10.20.193.28:0/447017535 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f1204014070 con 0x7f121410c1b0 2026-02-20T13:33:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.169+0000 7f1213fff640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11e80b56e0 0x7f11e80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.170+0000 7f1213fff640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11e80b56e0 0x7f11e80d5b90 secure :-1 s=READY pgs=660 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1200005b30 tx=0x7f120003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.170+0000 7f12117fa640 1 -- 10.20.193.28:0/447017535 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f12040a9700 con 0x7f121410c1b0 2026-02-20T13:33:14.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.311+0000 7f11e6ffd640 1 -- 10.20.193.28:0/447017535 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f121410bc70 con 0x7f121410c1b0 2026-02-20T13:33:14.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.312+0000 7f12117fa640 1 -- 10.20.193.28:0/447017535 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11997 (secure 0 0 0) 0x7f12040ac8b0 con 0x7f121410c1b0 2026-02-20T13:33:14.315 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:14.315 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":31,"btime":"2026-02-20T13:33:05:585962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:33:05.040895+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[0],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:33:14.316 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 31 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 -- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11e80b56e0 msgr2=0x7f11e80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11e80b56e0 0x7f11e80d5b90 secure :-1 s=READY pgs=660 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1200005b30 tx=0x7f120003a040 comp rx=0 tx=0).stop 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 -- 10.20.193.28:0/447017535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410c1b0 msgr2=0x7f1214161270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410c1b0 0x7f1214161270 secure :-1 s=READY pgs=557 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1204009480 tx=0x7f120400ee60 comp rx=0 tx=0).stop 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 -- 10.20.193.28:0/447017535 shutdown_connections 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f11e80b56e0 0x7f11e80d5b90 unknown :-1 s=CLOSED pgs=660 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12141555d0 0x7f1214166640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f121410c1b0 0x7f1214161270 unknown :-1 s=CLOSED pgs=557 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 --2- 10.20.193.28:0/447017535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f121410b8a0 0x7f1214160d30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 -- 10.20.193.28:0/447017535 >> 10.20.193.28:0/447017535 conn(0x7f12140e95c0 msgr2=0x7f12141099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 -- 10.20.193.28:0/447017535 shutdown_connections 2026-02-20T13:33:14.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.313+0000 7f11e6ffd640 1 -- 10.20.193.28:0/447017535 wait complete. 2026-02-20T13:33:14.415 DEBUG:tasks.check_counter:Getting stats from a 2026-02-20T13:33:14.415 DEBUG:tasks.check_counter:skipping mds.14688 2026-02-20T13:33:14.415 DEBUG:tasks.check_counter:Getting stats from d 2026-02-20T13:33:14.416 DEBUG:tasks.check_counter:skipping mds.24628 2026-02-20T13:33:14.416 DEBUG:tasks.check_counter:Getting stats from g 2026-02-20T13:33:14.416 DEBUG:tasks.check_counter:Getting stats from mds.24677 2026-02-20T13:33:14.416 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24677 perf dump --format=json-pretty 2026-02-20T13:33:14.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 -- 10.20.193.28:0/1735728846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3e4110700 msgr2=0x7fe3e4171090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 --2- 10.20.193.28:0/1735728846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3e4110700 0x7fe3e4171090 secure :-1 s=READY pgs=453 gs=2 cs=0 l=1 c_cookie=955099044104875697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e000a970 tx=0x7fe3e00301b0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 -- 10.20.193.28:0/1735728846 shutdown_connections 2026-02-20T13:33:14.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 --2- 10.20.193.28:0/1735728846 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3e410fd50 0x7fe3e41101c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 --2- 10.20.193.28:0/1735728846 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3e4110700 0x7fe3e4171090 unknown :-1 s=CLOSED pgs=453 gs=2 cs=0 l=1 c_cookie=955099044104875697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 --2- 10.20.193.28:0/1735728846 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3e410ebc0 0x7fe3e410efb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 -- 10.20.193.28:0/1735728846 >> 10.20.193.28:0/1735728846 conn(0x7fe3e40ec310 msgr2=0x7fe3e410c720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 -- 10.20.193.28:0/1735728846 shutdown_connections 2026-02-20T13:33:14.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.535+0000 7fe3ea992640 1 -- 10.20.193.28:0/1735728846 wait complete. 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea992640 1 Processor -- start 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea992640 1 -- start start 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea992640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3e410ebc0 0x7fe3e40f8240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea992640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3e410fd50 0x7fe3e4171070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea992640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3e4110700 0x7fe3e40f8a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea992640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e40f96e0 con 0x7fe3e410ebc0 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea992640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e40f9850 con 0x7fe3e4110700 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea992640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e40f9a10 con 0x7fe3e410fd50 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3e9990640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3e410ebc0 0x7fe3e40f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3e9990640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3e410ebc0 0x7fe3e40f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44902/0 (socket says 10.20.193.28:44902) 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3e9990640 1 -- 10.20.193.28:0/3696444681 learned_addr learned my addr 10.20.193.28:0/3696444681 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3ea191640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3e4110700 0x7fe3e40f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.536+0000 7fe3e918f640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3e410fd50 0x7fe3e4171070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3e9990640 1 -- 10.20.193.28:0/3696444681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3e410fd50 msgr2=0x7fe3e4171070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3e9990640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3e410fd50 0x7fe3e4171070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3e9990640 1 -- 10.20.193.28:0/3696444681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3e4110700 msgr2=0x7fe3e40f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3e9990640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3e4110700 0x7fe3e40f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3e9990640 1 -- 10.20.193.28:0/3696444681 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e000a590 con 0x7fe3e410ebc0 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3e9990640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3e410ebc0 0x7fe3e40f8240 secure :-1 s=READY pgs=1595 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d4009480 tx=0x7fe3d400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3d2ffd640 1 -- 10.20.193.28:0/3696444681 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3d400cd40 con 0x7fe3e410ebc0 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3ea992640 1 -- 10.20.193.28:0/3696444681 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e40f9cf0 con 0x7fe3e410ebc0 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3d2ffd640 1 -- 10.20.193.28:0/3696444681 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3d4004d30 con 0x7fe3e410ebc0 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3d2ffd640 1 -- 10.20.193.28:0/3696444681 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3d4010740 con 0x7fe3e410ebc0 2026-02-20T13:33:14.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.537+0000 7fe3ea992640 1 -- 10.20.193.28:0/3696444681 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e40fa1c0 con 0x7fe3e410ebc0 2026-02-20T13:33:14.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.540+0000 7fe3d2ffd640 1 -- 10.20.193.28:0/3696444681 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fe3d401f060 con 0x7fe3e410ebc0 2026-02-20T13:33:14.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.541+0000 7fe3d2ffd640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3c00b5760 0x7fe3c00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.541+0000 7fe3d2ffd640 1 -- 10.20.193.28:0/3696444681 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe3d4014070 con 0x7fe3e410ebc0 2026-02-20T13:33:14.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3e918f640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3c00b5760 0x7fe3c00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ee216e00 1 Processor -- start 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ee216e00 1 -- start start 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3e918f640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3c00b5760 0x7fe3c00d5c10 secure :-1 s=READY pgs=661 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d8005b30 tx=0x7fe3d8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c29b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 0x55699a3e32d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 0x55699a403bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55699a2b8d90 con 0x55699a3c2ef0 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55699a2b4ac0 con 0x55699a3a25d0 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55699a2aea60 con 0x55699a3e3810 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3e9990640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3e9990640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57526/0 (socket says 10.20.193.28:57526) 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3e9990640 1 -- 10.20.193.28:0/2190648773 learned_addr learned my addr 10.20.193.28:0/2190648773 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3ea191640 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 0x55699a403bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.542+0000 7fe3e918f640 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 0x55699a3e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3e9990640 1 -- 10.20.193.28:0/2190648773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 msgr2=0x55699a403bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3e9990640 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 0x55699a403bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3e9990640 1 -- 10.20.193.28:0/2190648773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 msgr2=0x55699a3e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3e9990640 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 0x55699a3e32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3e9990640 1 -- 10.20.193.28:0/2190648773 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a25a300 con 0x55699a3a25d0 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3e9990640 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c29b0 secure :-1 s=READY pgs=558 gs=1 cs=0 l=1 c_cookie=9566581470433532051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d40a9680 tx=0x7fe3d40a9700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84c3532954065893 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3b1bfe640 1 -- 10.20.193.28:0/2190648773 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3d40ac8b0 con 0x55699a3a25d0 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3b1bfe640 1 -- 10.20.193.28:0/2190648773 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3d40adab0 con 0x55699a3a25d0 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3b1bfe640 1 -- 10.20.193.28:0/2190648773 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3d40b7050 con 0x55699a3a25d0 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2190648773 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 msgr2=0x55699a3c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c29b0 secure :-1 s=READY pgs=558 gs=1 cs=0 l=1 c_cookie=9566581470433532051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d40a9680 tx=0x7fe3d40a9700 comp rx=0 tx=0).stop 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2190648773 shutdown_connections 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 0x55699a3e32d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 0x55699a403bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2190648773 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c29b0 unknown :-1 s=CLOSED pgs=558 gs=1 cs=0 l=1 c_cookie=9566581470433532051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2190648773 >> 10.20.193.28:0/2190648773 conn(0x55699a2c1c90 msgr2=0x55699a3a0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2190648773 shutdown_connections 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.543+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2190648773 wait complete. 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ee216e00 1 -- start start 2026-02-20T13:33:14.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ee216e00 1 Processor -- start 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 0x55699a3bd6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3bdd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3bc100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55699a3bc800 con 0x55699a3e3810 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55699a3bc970 con 0x55699a3c2ef0 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55699a3bcb30 con 0x55699a3a25d0 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3e9990640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 0x55699a3bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3ea191640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3e918f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3bdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3e918f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3bdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57538/0 (socket says 10.20.193.28:57538) 2026-02-20T13:33:14.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.545+0000 7fe3e918f640 1 -- 10.20.193.28:0/2969467340 learned_addr learned my addr 10.20.193.28:0/2969467340 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ea191640 1 -- 10.20.193.28:0/2969467340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 msgr2=0x55699a3bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ea191640 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 0x55699a3bd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ea191640 1 -- 10.20.193.28:0/2969467340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 msgr2=0x55699a3bdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ea191640 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3bdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ea191640 1 -- 10.20.193.28:0/2969467340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a2326c0 con 0x55699a3e3810 2026-02-20T13:33:14.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3e918f640 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3bdd00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:14.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ea191640 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3bc100 secure :-1 s=READY pgs=1596 gs=2 cs=0 l=1 c_cookie=12948477474170158520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e0005900 tx=0x7fe3e00396a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b23ba8a60f3db8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe39effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe39effd640 1 -- 10.20.193.28:0/2969467340 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e003e040 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe39effd640 1 -- 10.20.193.28:0/2969467340 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e003f040 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe39effd640 1 -- 10.20.193.28:0/2969467340 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e0045450 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e40fa1c0 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ee216e00 10 client.21192 _ll_register_callbacks cb 0x55699a2396b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556999f919e0 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe39effd640 1 -- 10.20.193.28:0/2969467340 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe3e00455e0 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe39effd640 1 -- 10.20.193.28:0/2969467340 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe3e00457a0 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ee216e00 10 client.21192 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.546+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55699a244810 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe39effd640 1 -- 10.20.193.28:0/2969467340 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fe3e0005050 con 0x55699a3e3810 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe3ee216e00 10 client.21192 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe3ee216e00 10 client.21192 resolve_mds: validated gid 24677 aka daemon mds.g 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe3ee216e00 20 client.21192 populate_metadata read hostname 'trial028' 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55699a3c0b20 0x55699a3c0fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe3ee216e00 4 client.21192 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55699a2815b0 con 0x55699a3c0b20 2026-02-20T13:33:14.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe3e9990640 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55699a3c0b20 0x55699a3c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe3e9990640 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55699a3c0b20 0x55699a3c0fc0 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=8901846276131633240 s_cookie=11131021469379389542 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b89b6062df5b858 server_cookie=9a79550d3d9ae866 in_seq=0 out_seq=0 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.547+0000 7fe39effd640 10 client.21192 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe39effd640 1 -- 10.20.193.28:0/2969467340 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55699a2815b0 con 0x55699a3c0b20 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe39effd640 10 client.21192 handle_command_reply: tid=0 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 client.21192 shutdown 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 msgr2=0x55699a3bc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3bc100 secure :-1 s=READY pgs=1596 gs=2 cs=0 l=1 c_cookie=12948477474170158520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e0005900 tx=0x7fe3e00396a0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 shutdown_connections 2026-02-20T13:33:14.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55699a3c0b20 0x55699a3c0fc0 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=8901846276131633240 s_cookie=11131021469379389542 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3bc100 unknown :-1 s=CLOSED pgs=1596 gs=2 cs=0 l=1 c_cookie=12948477474170158520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3bdd00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2969467340 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 0x55699a3bd6b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 >> 10.20.193.28:0/2969467340 conn(0x55699a2c1c90 msgr2=0x55699a3a38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe39effd640 0 client.21192 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:33:14.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 shutdown_connections 2026-02-20T13:33:14.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2969467340 wait complete. 2026-02-20T13:33:14.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.548+0000 7fe3ee216e00 20 client.21192 trim_cache size 0 max 16384 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.556+0000 7fe3ee216e00 1 Processor -- start 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.556+0000 7fe3ee216e00 1 -- start start 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 0x55699a3e16d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3e1c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3e2150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55699a2ac690 con 0x55699a3e3810 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x556999f4c690 con 0x55699a3c2ef0 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55699a3bcc70 con 0x55699a3a25d0 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3e2150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3e9990640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 0x55699a3e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3e918f640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3e2150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44932/0 (socket says 10.20.193.28:44932) 2026-02-20T13:33:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 -- 10.20.193.28:0/2688495232 learned_addr learned my addr 10.20.193.28:0/2688495232 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 -- 10.20.193.28:0/2688495232 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 msgr2=0x55699a3e16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 --2- 10.20.193.28:0/2688495232 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 0x55699a3e16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 -- 10.20.193.28:0/2688495232 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 msgr2=0x55699a3e1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 --2- 10.20.193.28:0/2688495232 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3e1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 -- 10.20.193.28:0/2688495232 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a3ae450 con 0x55699a3e3810 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3e918f640 1 --2- 10.20.193.28:0/2688495232 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3e1c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3ea191640 1 --2- 10.20.193.28:0/2688495232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3e2150 secure :-1 s=READY pgs=1597 gs=2 cs=0 l=1 c_cookie=1545614627718619244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e0006c20 tx=0x7fe3e0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157320509cd0e06c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3b13fd640 1 -- 10.20.193.28:0/2688495232 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e003e040 con 0x55699a3e3810 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3b13fd640 1 -- 10.20.193.28:0/2688495232 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x556999f919e0 con 0x55699a3e3810 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.557+0000 7fe3b13fd640 1 -- 10.20.193.28:0/2688495232 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e0005780 con 0x55699a3e3810 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2688495232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 msgr2=0x55699a3e2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2688495232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3e2150 secure :-1 s=READY pgs=1597 gs=2 cs=0 l=1 c_cookie=1545614627718619244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e0006c20 tx=0x7fe3e0050000 comp rx=0 tx=0).stop 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2688495232 shutdown_connections 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2688495232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3e3810 0x55699a3e2150 unknown :-1 s=CLOSED pgs=1597 gs=2 cs=0 l=1 c_cookie=1545614627718619244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2688495232 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3c2ef0 0x55699a3e1c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/2688495232 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3a25d0 0x55699a3e16d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2688495232 >> 10.20.193.28:0/2688495232 conn(0x55699a2c1c90 msgr2=0x55699a3c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2688495232 shutdown_connections 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 -- 10.20.193.28:0/2688495232 wait complete. 2026-02-20T13:33:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 -- start start 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.558+0000 7fe3ee216e00 1 Processor -- start 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c32c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 0x55699a3c3800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3ee216e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 0x55699a3c3e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55699a3121d0 con 0x55699a3c2ef0 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55699a3c45b0 con 0x55699a3a25d0 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3ee216e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55699a3c4770 con 0x55699a3e3810 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57562/0 (socket says 10.20.193.28:57562) 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 -- 10.20.193.28:0/1419681633 learned_addr learned my addr 10.20.193.28:0/1419681633 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3ea191640 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 0x55699a3c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e918f640 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 0x55699a3c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 -- 10.20.193.28:0/1419681633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 msgr2=0x55699a3c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 0x55699a3c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 -- 10.20.193.28:0/1419681633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 msgr2=0x55699a3c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 0x55699a3c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 -- 10.20.193.28:0/1419681633 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a23f0b0 con 0x55699a3a25d0 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe3e9990640 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c32c0 secure :-1 s=READY pgs=559 gs=1 cs=0 l=1 c_cookie=9362005824849729092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d40ad040 tx=0x7fe3d40050b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81ec86b2174e5644 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.559+0000 7fe39effd640 10 client.0 ms_handle_connect on v2:10.20.193.34:3300/0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe39effd640 1 -- 10.20.193.28:0/1419681633 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3d40ac8b0 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55699a244810 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe39effd640 1 -- 10.20.193.28:0/1419681633 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3d40e4900 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe39effd640 1 -- 10.20.193.28:0/1419681633 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3d40b7fe0 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 10 client.31121 _ll_register_callbacks cb 0x55699a2396b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55699a2e0100 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe39effd640 1 -- 10.20.193.28:0/1419681633 <== mon.2 v2:10.20.193.34:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fe3d4072070 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe39effd640 1 -- 10.20.193.28:0/1419681633 <== mon.2 v2:10.20.193.34:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe3d40add40 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 10 client.31121 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55699a2329f0 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe39effd640 1 -- 10.20.193.28:0/1419681633 <== mon.2 v2:10.20.193.34:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fe3d4072230 con 0x55699a3a25d0 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 10 client.31121 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 10 client.31121 resolve_mds: validated gid 24677 aka daemon mds.g 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 20 client.31121 populate_metadata read hostname 'trial028' 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55699a3c6160 0x55699a3c6600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 4 client.31121 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 --> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x556999fdf740 con 0x55699a3c6160 2026-02-20T13:33:14.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.560+0000 7fe3e918f640 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55699a3c6160 0x55699a3c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3e918f640 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55699a3c6160 0x55699a3c6600 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=12800382810651580450 s_cookie=15699602452834004511 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b1a41858d1e75822 server_cookie=d9e031403405ae1f in_seq=0 out_seq=0 2026-02-20T13:33:14.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe39effd640 10 client.31121 ms_handle_connect on v2:10.20.193.28:6838/1527574900 2026-02-20T13:33:14.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe39effd640 1 -- 10.20.193.28:0/1419681633 <== mds.1 v2:10.20.193.28:6838/1527574900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18314 (crc 0 0 0) 0x556999fdf740 con 0x55699a3c6160 2026-02-20T13:33:14.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe39effd640 10 client.31121 handle_command_reply: tid=0 2026-02-20T13:33:14.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 client.31121 shutdown 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 msgr2=0x55699a3c32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c32c0 secure :-1 s=READY pgs=559 gs=1 cs=0 l=1 c_cookie=9362005824849729092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d40ad040 tx=0x7fe3d40050b0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 shutdown_connections 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.28:6838/1527574900,v1:10.20.193.28:6839/1527574900] conn(0x55699a3c6160 0x55699a3c6600 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=12800382810651580450 s_cookie=15699602452834004511 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55699a3c2ef0 0x55699a3c3800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55699a3e3810 0x55699a3c3e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 --2- 10.20.193.28:0/1419681633 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55699a3a25d0 0x55699a3c32c0 unknown :-1 s=CLOSED pgs=559 gs=1 cs=0 l=1 c_cookie=9362005824849729092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 >> 10.20.193.28:0/1419681633 conn(0x55699a2c1c90 msgr2=0x55699a3c1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe39effd640 0 client.31121 ms_handle_reset on v2:10.20.193.28:6838/1527574900 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.561+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 shutdown_connections 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ee216e00 1 -- 10.20.193.28:0/1419681633 wait complete. 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ee216e00 20 client.31121 trim_cache size 0 max 16384 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-20T13:33:14.566 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 2122, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 1749, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 1139723, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 1420358, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 58, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 5, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.180918284, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.083198934, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.108429107, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.001801134, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1749, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.070148928, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000040108 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2875, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000427950, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000148 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 656992, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 331952 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.567 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 110, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 289, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 75742, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 561798, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 16, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.043899988, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.030584483, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.013050472, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000043370, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 288, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.024501616, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000085075 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 174, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000087635, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000503 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 160, 2026-02-20T13:33:14.568 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 439984 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 215, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 211, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 149340, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 248461, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 16, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 8, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.025306130, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.012180994, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.013300591, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000748902, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 210, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.035525871, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000169170 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 312, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000096233, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000308 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.569 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 97, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.004638020, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000047814 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000013455, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000006727 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-20T13:33:14.570 INFO:teuthology.orchestra.run.trial028.stdout: "request": 1, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 1, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 11, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 19, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 19, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 17, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 4, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 0, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 4, 2026-02-20T13:33:14.571 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 41, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 35, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 1, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 5, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 1, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 3, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 50, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 5, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 50, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-20T13:33:14.572 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 25, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 25, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 25, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 1, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 1, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 0 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 17, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 11, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 13, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-20T13:33:14.573 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 14, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 112, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_succeeded": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_write_failed": 0 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-20T13:33:14.574 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 6, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 6, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 2, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 2, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 2, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 4194304, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 4200523, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 5, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.005677411, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001135482 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-20T13:33:14.575 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 22, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 24, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 2, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 20, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 23, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 3, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 19, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 23, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 4, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 0, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 2, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 2, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 50348, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 261853184 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 1, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 1, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 1, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 16, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 2, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.576 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-20T13:33:14.577 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.578 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-20T13:33:14.580 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.581 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.582 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "cache_trim_throttle": 0, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle": 0, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle2o": 0, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "global_recall_throttle": 0, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 1, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 2, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 1, 2026-02-20T13:33:14.583 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 1, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 969, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-20T13:33:14.584 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 286901, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 99, 2026-02-20T13:33:14.585 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 7600, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 155, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 92440, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 549, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_items": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-20T13:33:14.586 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 94, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 17579, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 27, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 94, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 94, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.149996253, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001595704 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 119, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 94 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op": 94, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 50, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 44, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 0, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 10, 2026-02-20T13:33:14.587 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 5, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 7, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 6, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 50, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 20, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-20T13:33:14.588 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 80, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 2, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 9, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 14, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 5, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 18, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 3, 2026-02-20T13:33:14.589 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_sent": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_bounced": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_completed": 0 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:14.590 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get": 2447, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 1128364, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 2447, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "put": 2447, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 1128364, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "take": 94, 2026-02-20T13:33:14.591 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 17579, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "put": 94, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 17579, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "take": 94, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 94, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "put": 94, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 94, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.592 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "put": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x1a302640": { 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "get": 6, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 6219, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 6, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "put": 5, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 6219, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "trackedop": { 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 132 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.594 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 -- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3c00b5760 msgr2=0x7fe3c00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3c00b5760 0x7fe3c00d5c10 secure :-1 s=READY pgs=661 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d8005b30 tx=0x7fe3d8009310 comp rx=0 tx=0).stop 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 -- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3e410ebc0 msgr2=0x7fe3e40f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3e410ebc0 0x7fe3e40f8240 secure :-1 s=READY pgs=1595 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d4009480 tx=0x7fe3d400ee60 comp rx=0 tx=0).stop 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 -- 10.20.193.28:0/3696444681 shutdown_connections 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fe3c00b5760 0x7fe3c00d5c10 unknown :-1 s=CLOSED pgs=661 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fe3e4110700 0x7fe3e40f8a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe3e410fd50 0x7fe3e4171070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 --2- 10.20.193.28:0/3696444681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3e410ebc0 0x7fe3e40f8240 unknown :-1 s=CLOSED pgs=1595 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 -- 10.20.193.28:0/3696444681 >> 10.20.193.28:0/3696444681 conn(0x7fe3e40ec310 msgr2=0x7fe3e40ee8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 -- 10.20.193.28:0/3696444681 shutdown_connections 2026-02-20T13:33:14.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.562+0000 7fe3ea992640 1 -- 10.20.193.28:0/3696444681 wait complete. 2026-02-20T13:33:14.596 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2026-02-20T13:33:14.596 INFO:tasks.check_counter:Daemon mds.g mds.imported=1 2026-02-20T13:33:14.596 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2026-02-20T13:33:14.596 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=17 2026-02-20T13:33:14.596 DEBUG:tasks.check_counter:Getting stats from j 2026-02-20T13:33:14.596 DEBUG:tasks.check_counter:Getting stats from mds.24622 2026-02-20T13:33:14.596 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24622 perf dump --format=json-pretty 2026-02-20T13:33:14.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 -- 10.20.193.28:0/1879942299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 msgr2=0x7fa138133b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 --2- 10.20.193.28:0/1879942299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 0x7fa138133b90 secure :-1 s=READY pgs=560 gs=1 cs=0 l=1 c_cookie=9926606809672875126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c009950 tx=0x7fa12c02f190 comp rx=0 tx=0).stop 2026-02-20T13:33:14.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 -- 10.20.193.28:0/1879942299 shutdown_connections 2026-02-20T13:33:14.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 --2- 10.20.193.28:0/1879942299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa138154d90 0x7fa138175240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 --2- 10.20.193.28:0/1879942299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1381341d0 0x7fa138154650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 --2- 10.20.193.28:0/1879942299 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 0x7fa138133b90 unknown :-1 s=CLOSED pgs=560 gs=1 cs=0 l=1 c_cookie=9926606809672875126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 -- 10.20.193.28:0/1879942299 >> 10.20.193.28:0/1879942299 conn(0x7fa138064000 msgr2=0x7fa138064420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 -- 10.20.193.28:0/1879942299 shutdown_connections 2026-02-20T13:33:14.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.714+0000 7fa13c846640 1 -- 10.20.193.28:0/1879942299 wait complete. 2026-02-20T13:33:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa13c846640 1 Processor -- start 2026-02-20T13:33:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa13c846640 1 -- start start 2026-02-20T13:33:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa13c846640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 0x7fa138154650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa13c846640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1381341d0 0x7fa138175240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa13c846640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa138154d90 0x7fa1380ff1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa13c846640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa1380ff980 con 0x7fa1381341d0 2026-02-20T13:33:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa13c846640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa1380ffaf0 con 0x7fa1381137b0 2026-02-20T13:33:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa13c846640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa138100120 con 0x7fa138154d90 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa136d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 0x7fa138154650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa136d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 0x7fa138154650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57584/0 (socket says 10.20.193.28:57584) 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa136d76640 1 -- 10.20.193.28:0/3435426183 learned_addr learned my addr 10.20.193.28:0/3435426183 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa136575640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1381341d0 0x7fa138175240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.715+0000 7fa137577640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa138154d90 0x7fa1380ff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa136d76640 1 -- 10.20.193.28:0/3435426183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa138154d90 msgr2=0x7fa1380ff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa136d76640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa138154d90 0x7fa1380ff1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa136d76640 1 -- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1381341d0 msgr2=0x7fa138175240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa136d76640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1381341d0 0x7fa138175240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa136d76640 1 -- 10.20.193.28:0/3435426183 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c009570 con 0x7fa1381137b0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa136d76640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 0x7fa138154650 secure :-1 s=READY pgs=561 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c038820 tx=0x7fa12c0043d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa117fff640 1 -- 10.20.193.28:0/3435426183 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12c03d070 con 0x7fa1381137b0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa117fff640 1 -- 10.20.193.28:0/3435426183 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa12c038920 con 0x7fa1381137b0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa117fff640 1 -- 10.20.193.28:0/3435426183 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12c0419d0 con 0x7fa1381137b0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa13c846640 1 -- 10.20.193.28:0/3435426183 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1381003a0 con 0x7fa1381137b0 2026-02-20T13:33:14.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.716+0000 7fa13c846640 1 -- 10.20.193.28:0/3435426183 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1381007c0 con 0x7fa1381137b0 2026-02-20T13:33:14.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.719+0000 7fa117fff640 1 -- 10.20.193.28:0/3435426183 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa12c038a90 con 0x7fa1381137b0 2026-02-20T13:33:14.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.720+0000 7fa117fff640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa10c0b56e0 0x7fa10c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.721+0000 7fa117fff640 1 -- 10.20.193.28:0/3435426183 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa12c10b220 con 0x7fa1381137b0 2026-02-20T13:33:14.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.721+0000 7fa13f637e00 1 Processor -- start 2026-02-20T13:33:14.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.721+0000 7fa136575640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa10c0b56e0 0x7fa10c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.721+0000 7fa13f637e00 1 -- start start 2026-02-20T13:33:14.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.721+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2349b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e2552d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e275bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa13f637e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d13e12ad90 con 0x55d13e234ef0 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa13f637e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d13e126ac0 con 0x55d13e255810 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa13f637e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d13e120a60 con 0x55d13e2145d0 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136d76640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2349b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60750/0 (socket says 10.20.193.28:60750) 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136d76640 1 -- 10.20.193.28:0/1590481891 learned_addr learned my addr 10.20.193.28:0/1590481891 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136575640 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e2552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa137577640 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e275bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136575640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa10c0b56e0 0x7fa10c0d5b90 secure :-1 s=READY pgs=662 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa120004740 tx=0x7fa120005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136575640 1 -- 10.20.193.28:0/1590481891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 msgr2=0x55d13e2349b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136575640 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2349b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136575640 1 -- 10.20.193.28:0/1590481891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 msgr2=0x55d13e275bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136575640 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e275bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136575640 1 -- 10.20.193.28:0/1590481891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d13e0cc300 con 0x55d13e234ef0 2026-02-20T13:33:14.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa136575640 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e2552d0 secure :-1 s=READY pgs=1598 gs=3 cs=0 l=1 c_cookie=2072016606779136523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa120004200 tx=0x7fa120014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc1482037c7da0b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa1153fe640 1 -- 10.20.193.28:0/1590481891 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa120011e30 con 0x55d13e234ef0 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa1153fe640 1 -- 10.20.193.28:0/1590481891 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa120009d50 con 0x55d13e234ef0 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.722+0000 7fa1153fe640 1 -- 10.20.193.28:0/1590481891 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12001b9e0 con 0x55d13e234ef0 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 -- 10.20.193.28:0/1590481891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 msgr2=0x55d13e2552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e2552d0 secure :-1 s=READY pgs=1598 gs=3 cs=0 l=1 c_cookie=2072016606779136523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa120004200 tx=0x7fa120014000 comp rx=0 tx=0).stop 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 -- 10.20.193.28:0/1590481891 shutdown_connections 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e2552d0 unknown :-1 s=CLOSED pgs=1598 gs=3 cs=0 l=1 c_cookie=2072016606779136523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e275bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1590481891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2349b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 -- 10.20.193.28:0/1590481891 >> 10.20.193.28:0/1590481891 conn(0x55d13e133c90 msgr2=0x55d13e212eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 -- 10.20.193.28:0/1590481891 shutdown_connections 2026-02-20T13:33:14.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.723+0000 7fa13f637e00 1 -- 10.20.193.28:0/1590481891 wait complete. 2026-02-20T13:33:14.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.724+0000 7fa13f637e00 1 -- start start 2026-02-20T13:33:14.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.724+0000 7fa13f637e00 1 Processor -- start 2026-02-20T13:33:14.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e22f6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e22fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e22e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa13f637e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d13e22e7f0 con 0x55d13e234ef0 2026-02-20T13:33:14.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa13f637e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d13e22e960 con 0x55d13e255810 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa13f637e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d13e22eb20 con 0x55d13e2145d0 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa137577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e22e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa136575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e22fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa137577640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e22e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57592/0 (socket says 10.20.193.28:57592) 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa137577640 1 -- 10.20.193.28:0/1339710119 learned_addr learned my addr 10.20.193.28:0/1339710119 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa136d76640 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e22f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa136575640 1 -- 10.20.193.28:0/1339710119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 msgr2=0x55d13e22f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa136575640 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e22f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa136575640 1 -- 10.20.193.28:0/1339710119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 msgr2=0x55d13e22e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa136575640 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e22e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa136575640 1 -- 10.20.193.28:0/1339710119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d13e0a46c0 con 0x55d13e234ef0 2026-02-20T13:33:14.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa136575640 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e22fcf0 secure :-1 s=READY pgs=1599 gs=2 cs=0 l=1 c_cookie=14004235750812070498 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1200046a0 tx=0x7fa120005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2590a37bdfab262 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa100bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:14.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.725+0000 7fa100bfc640 1 -- 10.20.193.28:0/1339710119 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12001aeb0 con 0x55d13e234ef0 2026-02-20T13:33:14.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa100bfc640 1 -- 10.20.193.28:0/1339710119 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa12001ab70 con 0x55d13e234ef0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa120009900 con 0x55d13e234ef0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 10 client.21210 _ll_register_callbacks cb 0x55d13e0ab6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d13de039e0 con 0x55d13e234ef0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa100bfc640 1 -- 10.20.193.28:0/1339710119 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12002d3f0 con 0x55d13e234ef0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa100bfc640 1 -- 10.20.193.28:0/1339710119 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa12002d580 con 0x55d13e234ef0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa100bfc640 1 -- 10.20.193.28:0/1339710119 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa12001a690 con 0x55d13e234ef0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 10 client.21210 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55d13e0b6810 con 0x55d13e234ef0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa100bfc640 1 -- 10.20.193.28:0/1339710119 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fa12001a7f0 con 0x55d13e234ef0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 10 client.21210 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 10 client.21210 resolve_mds: validated gid 24622 aka daemon mds.j 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 20 client.21210 populate_metadata read hostname 'trial028' 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55d13e232ad0 0x55d13e232f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 4 client.21210 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d13e0f35b0 con 0x55d13e232ad0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.726+0000 7fa136d76640 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55d13e232ad0 0x55d13e232f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.727+0000 7fa136d76640 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55d13e232ad0 0x55d13e232f70 crc :-1 s=READY pgs=88 gs=4 cs=0 l=0 c_cookie=15758037387579019511 s_cookie=8285310750240070718 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=daafcb83abf8d0f7 server_cookie=72fb563ad9c8dc3e in_seq=0 out_seq=0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.727+0000 7fa100bfc640 10 client.21210 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.727+0000 7fa100bfc640 1 -- 10.20.193.28:0/1339710119 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d13e0f35b0 con 0x55d13e232ad0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.727+0000 7fa100bfc640 10 client.21210 handle_command_reply: tid=0 2026-02-20T13:33:14.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.727+0000 7fa13f637e00 1 client.21210 shutdown 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.727+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 msgr2=0x55d13e22fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.727+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e22fcf0 secure :-1 s=READY pgs=1599 gs=2 cs=0 l=1 c_cookie=14004235750812070498 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1200046a0 tx=0x7fa120005c60 comp rx=0 tx=0).stop 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 shutdown_connections 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55d13e232ad0 0x55d13e232f70 crc :-1 s=READY pgs=88 gs=4 cs=0 l=0 c_cookie=15758037387579019511 s_cookie=8285310750240070718 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e22fcf0 unknown :-1 s=CLOSED pgs=1599 gs=2 cs=0 l=1 c_cookie=14004235750812070498 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e255810 0x55d13e22e0f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1339710119 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e22f6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 >> 10.20.193.28:0/1339710119 conn(0x55d13e133c90 msgr2=0x55d13e2158a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa100bfc640 0 client.21210 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:33:14.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 shutdown_connections 2026-02-20T13:33:14.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 1 -- 10.20.193.28:0/1339710119 wait complete. 2026-02-20T13:33:14.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.728+0000 7fa13f637e00 20 client.21210 trim_cache size 0 max 16384 2026-02-20T13:33:14.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.736+0000 7fa13f637e00 1 Processor -- start 2026-02-20T13:33:14.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.736+0000 7fa13f637e00 1 -- start start 2026-02-20T13:33:14.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.736+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2189c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.736+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e234ef0 0x55d13e22a3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.736+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e255810 0x55d13e22a920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.736+0000 7fa13f637e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d13e11e690 con 0x55d13e255810 2026-02-20T13:33:14.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.736+0000 7fa13f637e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d13ddbe690 con 0x55d13e234ef0 2026-02-20T13:33:14.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.736+0000 7fa13f637e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d13e22ec60 con 0x55d13e2145d0 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e234ef0 0x55d13e22a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e234ef0 0x55d13e22a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57594/0 (socket says 10.20.193.28:57594) 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 -- 10.20.193.28:0/1248352378 learned_addr learned my addr 10.20.193.28:0/1248352378 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa137577640 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e255810 0x55d13e22a920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136d76640 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2189c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 -- 10.20.193.28:0/1248352378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 msgr2=0x55d13e2189c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2189c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 -- 10.20.193.28:0/1248352378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e255810 msgr2=0x55d13e22a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e255810 0x55d13e22a920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 -- 10.20.193.28:0/1248352378 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d13e220440 con 0x55d13e234ef0 2026-02-20T13:33:14.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136d76640 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2189c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa137577640 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e255810 0x55d13e22a920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa136575640 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e234ef0 0x55d13e22a3e0 secure :-1 s=READY pgs=562 gs=1 cs=0 l=1 c_cookie=3332776818582291030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12001b500 tx=0x7fa12001d020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e4066dbd3410256 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa114bfd640 1 -- 10.20.193.28:0/1248352378 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12000fec0 con 0x55d13e234ef0 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa114bfd640 1 -- 10.20.193.28:0/1248352378 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa12003a020 con 0x55d13e234ef0 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.737+0000 7fa114bfd640 1 -- 10.20.193.28:0/1248352378 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa120025440 con 0x55d13e234ef0 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 -- 10.20.193.28:0/1248352378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e234ef0 msgr2=0x55d13e22a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e234ef0 0x55d13e22a3e0 secure :-1 s=READY pgs=562 gs=1 cs=0 l=1 c_cookie=3332776818582291030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12001b500 tx=0x7fa12001d020 comp rx=0 tx=0).stop 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 -- 10.20.193.28:0/1248352378 shutdown_connections 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e255810 0x55d13e22a920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e234ef0 0x55d13e22a3e0 unknown :-1 s=CLOSED pgs=562 gs=1 cs=0 l=1 c_cookie=3332776818582291030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 --2- 10.20.193.28:0/1248352378 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e2145d0 0x55d13e2189c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 -- 10.20.193.28:0/1248352378 >> 10.20.193.28:0/1248352378 conn(0x55d13e133c90 msgr2=0x55d13e2536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 -- 10.20.193.28:0/1248352378 shutdown_connections 2026-02-20T13:33:14.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 -- 10.20.193.28:0/1248352378 wait complete. 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 -- start start 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.738+0000 7fa13f637e00 1 Processor -- start 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e2145d0 0x55d13e236d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e237420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa13f637e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e255810 0x55d13e238030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa13f637e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d13e1841d0 con 0x55d13e234ef0 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa13f637e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d13e2386a0 con 0x55d13e2145d0 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa13f637e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d13e238860 con 0x55d13e255810 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e2145d0 0x55d13e236d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e237420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136d76640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e2145d0 0x55d13e236d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57602/0 (socket says 10.20.193.28:57602) 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136d76640 1 -- 10.20.193.28:0/554037850 learned_addr learned my addr 10.20.193.28:0/554037850 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa137577640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e255810 0x55d13e238030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136575640 1 -- 10.20.193.28:0/554037850 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e255810 msgr2=0x55d13e238030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136575640 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e255810 0x55d13e238030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136575640 1 -- 10.20.193.28:0/554037850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e2145d0 msgr2=0x55d13e236d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136575640 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e2145d0 0x55d13e236d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136575640 1 -- 10.20.193.28:0/554037850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d13e0b6810 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136d76640 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e2145d0 0x55d13e236d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa136575640 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e237420 secure :-1 s=READY pgs=1600 gs=3 cs=0 l=1 c_cookie=17782894295992244473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa120019d90 tx=0x7fa12001b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c98824f6f018f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa100bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa100bfc640 1 -- 10.20.193.28:0/554037850 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1200255d0 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa100bfc640 1 -- 10.20.193.28:0/554037850 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d13de039e0 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa100bfc640 1 -- 10.20.193.28:0/554037850 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa12002c990 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.739+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa128005510 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa100bfc640 1 -- 10.20.193.28:0/554037850 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fa12003b030 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa100bfc640 10 client.21216 inactive, discarding osd_map(80..80 src has 1..80) 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 10 client.21216 _ll_register_callbacks cb 0x55d13e0ab6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d13e152100 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa100bfc640 1 -- 10.20.193.28:0/554037850 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa12001ba50 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 10 client.21216 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55d13e0b10b0 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa100bfc640 1 -- 10.20.193.28:0/554037850 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fa120009d50 con 0x55d13e234ef0 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 10 client.21216 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 10 client.21216 resolve_mds: validated gid 24622 aka daemon mds.j 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 20 client.21216 populate_metadata read hostname 'trial028' 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55d13e23a030 0x55d13e23a4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 4 client.21216 mds_command: new command op to 24622 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-20T13:33:14.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 --> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55d13de51740 con 0x55d13e23a030 2026-02-20T13:33:14.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.740+0000 7fa136d76640 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55d13e23a030 0x55d13e23a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa100bfc640 10 client.21216 ms_handle_connect on v2:10.20.193.28:6834/2839011553 2026-02-20T13:33:14.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa136d76640 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55d13e23a030 0x55d13e23a4d0 crc :-1 s=READY pgs=89 gs=4 cs=0 l=0 c_cookie=4450074933369343433 s_cookie=16273030901479796071 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3dc1d7930b598dc9 server_cookie=e1d56b62fda86d67 in_seq=0 out_seq=0 2026-02-20T13:33:14.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa100bfc640 1 -- 10.20.193.28:0/554037850 <== mds.4 v2:10.20.193.28:6834/2839011553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18296 (crc 0 0 0) 0x55d13de51740 con 0x55d13e23a030 2026-02-20T13:33:14.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa100bfc640 10 client.21216 handle_command_reply: tid=0 2026-02-20T13:33:14.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 client.21216 shutdown 2026-02-20T13:33:14.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 msgr2=0x55d13e237420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e237420 secure :-1 s=READY pgs=1600 gs=3 cs=0 l=1 c_cookie=17782894295992244473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa120019d90 tx=0x7fa12001b690 comp rx=0 tx=0).stop 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 shutdown_connections 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.28:6834/2839011553,v1:10.20.193.28:6835/2839011553] conn(0x55d13e23a030 0x55d13e23a4d0 crc :-1 s=READY pgs=89 gs=4 cs=0 l=0 c_cookie=4450074933369343433 s_cookie=16273030901479796071 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d13e234ef0 0x55d13e237420 unknown :-1 s=CLOSED pgs=1600 gs=3 cs=0 l=1 c_cookie=17782894295992244473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d13e255810 0x55d13e238030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 --2- 10.20.193.28:0/554037850 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d13e2145d0 0x55d13e236d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa100bfc640 0 client.21216 ms_handle_reset on v2:10.20.193.28:6834/2839011553 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 >> 10.20.193.28:0/554037850 conn(0x55d13e133c90 msgr2=0x55d13e2536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 shutdown_connections 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 1 -- 10.20.193.28:0/554037850 wait complete. 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.741+0000 7fa13f637e00 20 client.21216 trim_cache size 0 max 16384 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 142, 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 143, 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 71633, 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 734850, 2026-02-20T13:33:14.746 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 63, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 5, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.042447163, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.007190138, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.025762859, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000442229, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 142, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.023018103, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000162099 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 204, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000034815, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000170 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 100, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 303, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 65998, 2026-02-20T13:33:14.747 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 746623, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 18, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.034143637, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.021315800, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.011797762, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000311667, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 302, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.030567113, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000101215 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 164, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000027401, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000167 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 320, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 573056 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 2079, 2026-02-20T13:33:14.748 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 1642, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 1161171, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 520407, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 8, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 5, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.146603207, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.080265942, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.087418559, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000114254, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1642, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.078884345, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000048041 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2920, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000474455, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000162 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 638016, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 171952 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.749 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 30, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001072684, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000035756 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000010289, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000005144 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "request": 0, 2026-02-20T13:33:14.750 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 11, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 16, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 16, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 13, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 4, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 0, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 3, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 39, 2026-02-20T13:33:14.751 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 34, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 5, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 5, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-20T13:33:14.752 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 0 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 15, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 10, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 12, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 0, 2026-02-20T13:33:14.753 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 14, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 84, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_succeeded": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_write_failed": 0 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 2, 2026-02-20T13:33:14.754 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 2, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 2, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 2, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 2, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 4194304, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 4194892, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000703696, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000703696 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-20T13:33:14.755 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 20, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 22, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 2, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 18, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 21, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 3, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 16, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 20, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 4, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 0, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 0, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 0, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 49508, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 261853184 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 0, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 1, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 0, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 0, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 2, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.756 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.757 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.759 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.761 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-20T13:33:14.762 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "cache_trim_throttle": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle2o": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "global_recall_throttle": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-20T13:33:14.763 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-20T13:33:14.764 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-20T13:33:14.765 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 238407, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 81, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 7600, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 155, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 82276, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 380, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-20T13:33:14.766 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 35, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 10952, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 27, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 35, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 35, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.121996950, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003485627 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 57, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 35 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op": 35, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 0, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 35, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-20T13:33:14.767 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 10, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 1, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 5, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 6, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 20, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-20T13:33:14.768 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 80, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 2, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 9, 2026-02-20T13:33:14.769 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 15, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 6, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 14, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 1, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_sent": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_bounced": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_completed": 0 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 0, 2026-02-20T13:33:14.770 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "get": 2321, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 1073862, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 2321, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "put": 2321, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 1073862, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:14.771 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "take": 35, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 10952, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "put": 35, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 10952, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "take": 35, 2026-02-20T13:33:14.772 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 35, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "put": 35, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 35, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "put": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.773 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x3cb5c640": { 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "get": 2, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 588, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 2, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "put": 1, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 588, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "trackedop": { 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 98 2026-02-20T13:33:14.774 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.775 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:33:14.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 -- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa10c0b56e0 msgr2=0x7fa10c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa10c0b56e0 0x7fa10c0d5b90 secure :-1 s=READY pgs=662 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa120004740 tx=0x7fa120005f90 comp rx=0 tx=0).stop 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 -- 10.20.193.28:0/3435426183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 msgr2=0x7fa138154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 0x7fa138154650 secure :-1 s=READY pgs=561 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa12c038820 tx=0x7fa12c0043d0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 -- 10.20.193.28:0/3435426183 shutdown_connections 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa10c0b56e0 0x7fa10c0d5b90 unknown :-1 s=CLOSED pgs=662 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa1381341d0 0x7fa138175240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa138154d90 0x7fa1380ff1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 --2- 10.20.193.28:0/3435426183 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa1381137b0 0x7fa138154650 unknown :-1 s=CLOSED pgs=561 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 -- 10.20.193.28:0/3435426183 >> 10.20.193.28:0/3435426183 conn(0x7fa138064000 msgr2=0x7fa1380f5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 -- 10.20.193.28:0/3435426183 shutdown_connections 2026-02-20T13:33:14.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.742+0000 7fa13c846640 1 -- 10.20.193.28:0/3435426183 wait complete. 2026-02-20T13:33:14.776 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2026-02-20T13:33:14.777 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2026-02-20T13:33:14.777 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update=0 2026-02-20T13:33:14.777 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update_receipt=15 2026-02-20T13:33:14.777 DEBUG:tasks.check_counter:Getting stats from b 2026-02-20T13:33:14.777 DEBUG:tasks.check_counter:Getting stats from mds.24692 2026-02-20T13:33:14.777 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24692 perf dump --format=json-pretty 2026-02-20T13:33:14.825 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:14 trial028 ceph-mon[37442]: pgmap v658: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 7.1 KiB/s wr, 15 op/s 2026-02-20T13:33:14.825 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:14 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/447017535' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:14.878 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:14 trial127 ceph-mon[43817]: pgmap v658: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 7.1 KiB/s wr, 15 op/s 2026-02-20T13:33:14.878 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:14 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/447017535' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:14.891 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:14 trial034 ceph-mon[43332]: pgmap v658: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 7.1 KiB/s wr, 15 op/s 2026-02-20T13:33:14.891 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:14 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/447017535' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 -- 10.20.193.28:0/3168867777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5ac1341d0 msgr2=0x7fb5ac154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 --2- 10.20.193.28:0/3168867777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5ac1341d0 0x7fb5ac154650 secure :-1 s=READY pgs=454 gs=2 cs=0 l=1 c_cookie=17460983396095208272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a0009950 tx=0x7fb5a002f190 comp rx=0 tx=0).stop 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 -- 10.20.193.28:0/3168867777 shutdown_connections 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 --2- 10.20.193.28:0/3168867777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5ac154d90 0x7fb5ac175240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 --2- 10.20.193.28:0/3168867777 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5ac1341d0 0x7fb5ac154650 unknown :-1 s=CLOSED pgs=454 gs=2 cs=0 l=1 c_cookie=17460983396095208272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 --2- 10.20.193.28:0/3168867777 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5ac1137b0 0x7fb5ac133b90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 -- 10.20.193.28:0/3168867777 >> 10.20.193.28:0/3168867777 conn(0x7fb5ac064000 msgr2=0x7fb5ac064420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 -- 10.20.193.28:0/3168867777 shutdown_connections 2026-02-20T13:33:14.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 -- 10.20.193.28:0/3168867777 wait complete. 2026-02-20T13:33:14.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 Processor -- start 2026-02-20T13:33:14.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.894+0000 7fb5b2883640 1 -- start start 2026-02-20T13:33:14.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2883640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5ac1137b0 0x7fb5ac175240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2883640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5ac1341d0 0x7fb5ac1545f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2883640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5ac154d90 0x7fb5ac0ff210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2883640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac0ff9a0 con 0x7fb5ac1341d0 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2883640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac0ffb10 con 0x7fb5ac1137b0 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2883640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac100160 con 0x7fb5ac154d90 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1080640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5ac1341d0 0x7fb5ac1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5ac1137b0 0x7fb5ac175240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5ac1137b0 0x7fb5ac175240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57622/0 (socket says 10.20.193.28:57622) 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1881640 1 -- 10.20.193.28:0/2790577422 learned_addr learned my addr 10.20.193.28:0/2790577422 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2082640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5ac154d90 0x7fb5ac0ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1080640 1 -- 10.20.193.28:0/2790577422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5ac154d90 msgr2=0x7fb5ac0ff210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1080640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5ac154d90 0x7fb5ac0ff210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1080640 1 -- 10.20.193.28:0/2790577422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5ac1137b0 msgr2=0x7fb5ac175240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1080640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5ac1137b0 0x7fb5ac175240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1080640 1 -- 10.20.193.28:0/2790577422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a0009570 con 0x7fb5ac1341d0 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b1080640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5ac1341d0 0x7fb5ac1545f0 secure :-1 s=READY pgs=1601 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a002f6a0 tx=0x7fb5a0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb59affd640 1 -- 10.20.193.28:0/2790577422 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a003d070 con 0x7fb5ac1341d0 2026-02-20T13:33:14.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2883640 1 -- 10.20.193.28:0/2790577422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ac1003b0 con 0x7fb5ac1341d0 2026-02-20T13:33:14.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb59affd640 1 -- 10.20.193.28:0/2790577422 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5a0038920 con 0x7fb5ac1341d0 2026-02-20T13:33:14.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb59affd640 1 -- 10.20.193.28:0/2790577422 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a0041910 con 0x7fb5ac1341d0 2026-02-20T13:33:14.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.895+0000 7fb5b2883640 1 -- 10.20.193.28:0/2790577422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ac100870 con 0x7fb5ac1341d0 2026-02-20T13:33:14.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.898+0000 7fb59affd640 1 -- 10.20.193.28:0/2790577422 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fb5a0038a90 con 0x7fb5ac1341d0 2026-02-20T13:33:14.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.900+0000 7fb59affd640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5880b5760 0x7fb5880d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.900+0000 7fb59affd640 1 -- 10.20.193.28:0/2790577422 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5a010b130 con 0x7fb5ac1341d0 2026-02-20T13:33:14.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.900+0000 7fb5b1881640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5880b5760 0x7fb5880d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.900+0000 7fb5b1881640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5880b5760 0x7fb5880d5c10 secure :-1 s=READY pgs=663 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c0095d0 tx=0x7fb59c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.901+0000 7fb5b6206e00 1 Processor -- start 2026-02-20T13:33:14.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b6206e00 1 -- start start 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3f99b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3f9ef0 0x55d48d41a2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d43abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d48d2efd90 con 0x55d48d41a810 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d48d2ebac0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d48d2e5a60 con 0x55d48d3d95d0 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b1881640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b2082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d43abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b1080640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3f9ef0 0x55d48d41a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b1881640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60800/0 (socket says 10.20.193.28:60800) 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b1881640 1 -- 10.20.193.28:0/257053438 learned_addr learned my addr 10.20.193.28:0/257053438 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b2082640 1 -- 10.20.193.28:0/257053438 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 msgr2=0x55d48d3f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b2082640 1 --2- 10.20.193.28:0/257053438 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b2082640 1 -- 10.20.193.28:0/257053438 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3f9ef0 msgr2=0x55d48d41a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b2082640 1 --2- 10.20.193.28:0/257053438 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3f9ef0 0x55d48d41a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b2082640 1 -- 10.20.193.28:0/257053438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48d291300 con 0x55d48d41a810 2026-02-20T13:33:14.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.902+0000 7fb5b2082640 1 --2- 10.20.193.28:0/257053438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d43abf0 secure :-1 s=READY pgs=1602 gs=2 cs=0 l=1 c_cookie=11292853721214171607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a80055c0 tx=0x7fb5a8003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb846a0996b39d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb579bfe640 1 -- 10.20.193.28:0/257053438 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a800ac10 con 0x55d48d41a810 2026-02-20T13:33:14.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb579bfe640 1 -- 10.20.193.28:0/257053438 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5a800ad70 con 0x55d48d41a810 2026-02-20T13:33:14.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb579bfe640 1 -- 10.20.193.28:0/257053438 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a8012970 con 0x55d48d41a810 2026-02-20T13:33:14.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 -- 10.20.193.28:0/257053438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 msgr2=0x55d48d43abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/257053438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d43abf0 secure :-1 s=READY pgs=1602 gs=2 cs=0 l=1 c_cookie=11292853721214171607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a80055c0 tx=0x7fb5a8003c30 comp rx=0 tx=0).stop 2026-02-20T13:33:14.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 -- 10.20.193.28:0/257053438 shutdown_connections 2026-02-20T13:33:14.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/257053438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d43abf0 unknown :-1 s=CLOSED pgs=1602 gs=2 cs=0 l=1 c_cookie=11292853721214171607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/257053438 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3f9ef0 0x55d48d41a2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/257053438 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3f99b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 -- 10.20.193.28:0/257053438 >> 10.20.193.28:0/257053438 conn(0x55d48d2f8c90 msgr2=0x55d48d3d7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 -- 10.20.193.28:0/257053438 shutdown_connections 2026-02-20T13:33:14.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.903+0000 7fb5b6206e00 1 -- 10.20.193.28:0/257053438 wait complete. 2026-02-20T13:33:14.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.904+0000 7fb5b6206e00 1 -- start start 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b6206e00 1 Processor -- start 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f45e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3f4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d41a810 0x55d48d3f3030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d48d3f3730 con 0x55d48d3f9ef0 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d48d3f38a0 con 0x55d48d3d95d0 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d48d3f3a60 con 0x55d48d41a810 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1881640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57640/0 (socket says 10.20.193.28:57640) 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1881640 1 -- 10.20.193.28:0/2235279445 learned_addr learned my addr 10.20.193.28:0/2235279445 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1080640 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b2082640 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d41a810 0x55d48d3f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1080640 1 -- 10.20.193.28:0/2235279445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d41a810 msgr2=0x55d48d3f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1080640 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d41a810 0x55d48d3f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1080640 1 -- 10.20.193.28:0/2235279445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 msgr2=0x55d48d3f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1080640 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.905+0000 7fb5b1080640 1 -- 10.20.193.28:0/2235279445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48d2696c0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b1080640 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3f4c30 secure :-1 s=READY pgs=1603 gs=2 cs=0 l=1 c_cookie=866225285464641068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a0032040 tx=0x7fb5a0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05734ec394ce2c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb566ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb566ffd640 1 -- 10.20.193.28:0/2235279445 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a00d0eb0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a8005260 con 0x55d48d3f9ef0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 10 client.21228 _ll_register_callbacks cb 0x55d48d2706b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d48cfc89e0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb566ffd640 1 -- 10.20.193.28:0/2235279445 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5a00d0cd0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb566ffd640 1 -- 10.20.193.28:0/2235279445 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a00d2ec0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb566ffd640 1 -- 10.20.193.28:0/2235279445 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5a00f6040 con 0x55d48d3f9ef0 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb566ffd640 1 -- 10.20.193.28:0/2235279445 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb5a00d71f0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 10 client.21228 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55d48d27b810 con 0x55d48d3f9ef0 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb566ffd640 1 -- 10.20.193.28:0/2235279445 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fb5a00d3020 con 0x55d48d3f9ef0 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 10 client.21228 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 10 client.21228 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 20 client.21228 populate_metadata read hostname 'trial028' 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d48d3f7760 0x55d48d3f7c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 4 client.21228 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.906+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d48d2b85b0 con 0x55d48d3f7760 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.907+0000 7fb5b1881640 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d48d3f7760 0x55d48d3f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b1881640 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d48d3f7760 0x55d48d3f7c00 crc :-1 s=READY pgs=448 gs=4 cs=0 l=0 c_cookie=12339805830795413653 s_cookie=17797860533742690582 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab3fcc0625dac895 server_cookie=f6feb3dbbbad6116 in_seq=0 out_seq=0 2026-02-20T13:33:14.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb566ffd640 10 client.21228 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:14.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb566ffd640 1 -- 10.20.193.28:0/2235279445 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d48d2b85b0 con 0x55d48d3f7760 2026-02-20T13:33:14.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb566ffd640 10 client.21228 handle_command_reply: tid=0 2026-02-20T13:33:14.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 client.21228 shutdown 2026-02-20T13:33:14.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 msgr2=0x55d48d3f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3f4c30 secure :-1 s=READY pgs=1603 gs=2 cs=0 l=1 c_cookie=866225285464641068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a0032040 tx=0x7fb5a0009310 comp rx=0 tx=0).stop 2026-02-20T13:33:14.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 shutdown_connections 2026-02-20T13:33:14.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d48d3f7760 0x55d48d3f7c00 crc :-1 s=READY pgs=448 gs=4 cs=0 l=0 c_cookie=12339805830795413653 s_cookie=17797860533742690582 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3f4c30 unknown :-1 s=CLOSED pgs=1603 gs=2 cs=0 l=1 c_cookie=866225285464641068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d41a810 0x55d48d3f3030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/2235279445 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f45e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 >> 10.20.193.28:0/2235279445 conn(0x55d48d2f8c90 msgr2=0x55d48d3da8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.908+0000 7fb566ffd640 0 client.21228 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:14.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.909+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 shutdown_connections 2026-02-20T13:33:14.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.909+0000 7fb5b6206e00 1 -- 10.20.193.28:0/2235279445 wait complete. 2026-02-20T13:33:14.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.909+0000 7fb5b6206e00 20 client.21228 trim_cache size 0 max 16384 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.917+0000 7fb5b6206e00 1 Processor -- start 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.917+0000 7fb5b6206e00 1 -- start start 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.917+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.917+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3f9ef0 0x55d48d4186d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.917+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d418c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.917+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d48d2e3690 con 0x55d48d41a810 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.917+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d48cf83690 con 0x55d48d3d95d0 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.917+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d48d3e0870 con 0x55d48d3f9ef0 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d418c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d418c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45032/0 (socket says 10.20.193.28:45032) 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 -- 10.20.193.28:0/1410221475 learned_addr learned my addr 10.20.193.28:0/1410221475 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b1881640 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b1080640 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3f9ef0 0x55d48d4186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 -- 10.20.193.28:0/1410221475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3f9ef0 msgr2=0x55d48d4186d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3f9ef0 0x55d48d4186d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 -- 10.20.193.28:0/1410221475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 msgr2=0x55d48d3f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 -- 10.20.193.28:0/1410221475 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48d2760b0 con 0x55d48d41a810 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b2082640 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d418c10 secure :-1 s=READY pgs=1604 gs=1 cs=0 l=1 c_cookie=5757276547586839643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a8003780 tx=0x7fb5a80037b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe5f4844499d45b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5793fd640 1 -- 10.20.193.28:0/1410221475 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a80057e0 con 0x55d48d41a810 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5793fd640 1 -- 10.20.193.28:0/1410221475 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5a8005e20 con 0x55d48d41a810 2026-02-20T13:33:14.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5793fd640 1 -- 10.20.193.28:0/1410221475 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a801b470 con 0x55d48d41a810 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b6206e00 1 -- 10.20.193.28:0/1410221475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 msgr2=0x55d48d418c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.918+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d418c10 secure :-1 s=READY pgs=1604 gs=1 cs=0 l=1 c_cookie=5757276547586839643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a8003780 tx=0x7fb5a80037b0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 -- 10.20.193.28:0/1410221475 shutdown_connections 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d41a810 0x55d48d418c10 unknown :-1 s=CLOSED pgs=1604 gs=1 cs=0 l=1 c_cookie=5757276547586839643 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3f9ef0 0x55d48d4186d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/1410221475 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d3d95d0 0x55d48d3f4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 -- 10.20.193.28:0/1410221475 >> 10.20.193.28:0/1410221475 conn(0x55d48d2f8c90 msgr2=0x55d48d3f84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 -- 10.20.193.28:0/1410221475 shutdown_connections 2026-02-20T13:33:14.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 -- 10.20.193.28:0/1410221475 wait complete. 2026-02-20T13:33:14.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 -- start start 2026-02-20T13:33:14.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.919+0000 7fb5b6206e00 1 Processor -- start 2026-02-20T13:33:14.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3fa470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3faa10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d41a810 0x55d48d3fb100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d48d3f3ba0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d48d3fb830 con 0x55d48d41a810 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d48d3fb9f0 con 0x55d48d3d95d0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3faa10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45038/0 (socket says 10.20.193.28:45038) 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 -- 10.20.193.28:0/3065912527 learned_addr learned my addr 10.20.193.28:0/3065912527 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1881640 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b2082640 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d41a810 0x55d48d3fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 -- 10.20.193.28:0/3065912527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 msgr2=0x55d48d3fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 -- 10.20.193.28:0/3065912527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d41a810 msgr2=0x55d48d3fb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d41a810 0x55d48d3fb100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 -- 10.20.193.28:0/3065912527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48d2699f0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1881640 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3fa470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b1080640 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3faa10 secure :-1 s=READY pgs=1605 gs=1 cs=0 l=1 c_cookie=7764257348693134077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a00ce740 tx=0x7fb5a0097340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc02eebfd920afd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb566ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb566ffd640 1 -- 10.20.193.28:0/3065912527 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a00cf6d0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a8023040 con 0x55d48d3f9ef0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 10 client.21234 _ll_register_callbacks cb 0x55d48d2706b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d48d317100 con 0x55d48d3f9ef0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb566ffd640 1 -- 10.20.193.28:0/3065912527 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d48cfc89e0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.920+0000 7fb566ffd640 1 -- 10.20.193.28:0/3065912527 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5a00d3100 con 0x55d48d3f9ef0 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb566ffd640 1 -- 10.20.193.28:0/3065912527 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fb5a00f6040 con 0x55d48d3f9ef0 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb566ffd640 1 -- 10.20.193.28:0/3065912527 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb5a00d71f0 con 0x55d48d3f9ef0 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b6206e00 10 client.21234 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55d48d27ba70 con 0x55d48d3f9ef0 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb566ffd640 1 -- 10.20.193.28:0/3065912527 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fb5a00cfd50 con 0x55d48d3f9ef0 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b6206e00 10 client.21234 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b6206e00 10 client.21234 resolve_mds: validated gid 24692 aka daemon mds.b 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b6206e00 20 client.21234 populate_metadata read hostname 'trial028' 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d48d3fd360 0x55d48d3fd800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b6206e00 4 client.21234 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 --> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55d48d016740 con 0x55d48d3fd360 2026-02-20T13:33:14.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.921+0000 7fb5b1881640 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d48d3fd360 0x55d48d3fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.922+0000 7fb566ffd640 10 client.21234 ms_handle_connect on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.922+0000 7fb5b1881640 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d48d3fd360 0x55d48d3fd800 crc :-1 s=READY pgs=449 gs=4 cs=0 l=0 c_cookie=16336317202958458201 s_cookie=6887675892618293592 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b641f14c711d59 server_cookie=5f95f0bb5b88f158 in_seq=0 out_seq=0 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.922+0000 7fb566ffd640 1 -- 10.20.193.28:0/3065912527 <== mds.0 v2:10.20.193.34:6838/1838974969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18464 (crc 0 0 0) 0x55d48d016740 con 0x55d48d3fd360 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.922+0000 7fb566ffd640 10 client.21234 handle_command_reply: tid=0 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.922+0000 7fb5b6206e00 1 client.21234 shutdown 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 msgr2=0x55d48d3faa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3faa10 secure :-1 s=READY pgs=1605 gs=1 cs=0 l=1 c_cookie=7764257348693134077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a00ce740 tx=0x7fb5a0097340 comp rx=0 tx=0).stop 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 shutdown_connections 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.34:6838/1838974969,v1:10.20.193.34:6839/1838974969] conn(0x55d48d3fd360 0x55d48d3fd800 crc :-1 s=READY pgs=449 gs=4 cs=0 l=0 c_cookie=16336317202958458201 s_cookie=6887675892618293592 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d48d3f9ef0 0x55d48d3faa10 unknown :-1 s=CLOSED pgs=1605 gs=1 cs=0 l=1 c_cookie=7764257348693134077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d48d41a810 0x55d48d3fb100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb566ffd640 0 client.21234 ms_handle_reset on v2:10.20.193.34:6838/1838974969 2026-02-20T13:33:14.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 --2- 10.20.193.28:0/3065912527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d48d3d95d0 0x55d48d3fa470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 >> 10.20.193.28:0/3065912527 conn(0x55d48d2f8c90 msgr2=0x55d48d3f4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 shutdown_connections 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 1 -- 10.20.193.28:0/3065912527 wait complete. 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b6206e00 20 client.21234 trim_cache size 0 max 16384 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 4777, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 5625, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 1321166, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 7680726, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 8, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 4, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.191695574, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.096796797, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.066747692, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.022356256, 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.927 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 5630, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.070689607, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000012555 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 5451, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000449491, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000082 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 4469, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 5655, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 1932251, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 2132000, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 11, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.187878155, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.106556988, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.094228627, 2026-02-20T13:33:14.928 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.008356216, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 5659, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.324490136, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000057340 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 5182, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000571939, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000110 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 663392, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 203904 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 2476, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 3092, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 647128, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 7133440, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 430, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 11, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.152637780, 2026-02-20T13:33:14.929 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.052068833, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.096592243, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.005457775, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3081, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.179027971, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000058107 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3709, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000334923, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000090 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 66912, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 708112 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:14.930 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 4868, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.523210451, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000107479 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 23, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000262558, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000011415 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "request": 536, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 535, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 535, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 14.604834550, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.027298756 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.931 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 1, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 433, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 20, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 2, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 3, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 15, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 16, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 5, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 3, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 3, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 3, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 685, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 671, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 1, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 0, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 1877, 2026-02-20T13:33:14.932 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 2, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 4, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 1, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 0, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 302, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 4, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 302, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 206, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 26, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 180, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 96, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 4, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 493, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 470, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 403, 2026-02-20T13:33:14.933 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 517, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 439, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 2, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 431 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 17, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 44, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 2, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 2, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-20T13:33:14.934 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 14, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 161, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 26, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 2, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_succeeded": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_write_failed": 0 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 1702, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 1691, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 1691, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 11, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 2, 2026-02-20T13:33:14.935 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 75, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 74, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 74, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 1, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 1, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 1, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 10088484, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 10120748, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1686, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 1.531433153, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000908323 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 21, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 52, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 31, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 17, 2026-02-20T13:33:14.936 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 20, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 3, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 20, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 28, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 8, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 3, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 18, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 15, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 58264, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 276537344 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 1374, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 2, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 536, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 21, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 12, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 13, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.002898654, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000222973 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 88, 2026-02-20T13:33:14.937 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.008360681, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000095007 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000703485, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000234495 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.938 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000135732, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000067866 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.939 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 8, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 13.635011345, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 1.704376418 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000048410, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000048410 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-20T13:33:14.940 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000328751, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000328751 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000780888, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000390444 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.010246525, 2026-02-20T13:33:14.941 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.005123262 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 404, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.935429882, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002315420 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.942 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 11, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.010890197, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000990017 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "cache_trim_throttle": 0, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle": 0, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle2o": 0, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "global_recall_throttle": 0, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 1, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 2, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 1, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 1, 2026-02-20T13:33:14.944 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 6, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 6, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 963, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-20T13:33:14.945 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 286389, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 95, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 0, 2026-02-20T13:33:14.946 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 7600, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 155, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 91732, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 676, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_bytes": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_items": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-20T13:33:14.947 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 3710, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 6375105, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 36, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 3710, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3710, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 9.038766204, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002436325 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 4610, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3710 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op": 3710, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 356, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 3354, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 415, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 23, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 28, 2026-02-20T13:33:14.948 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 1688, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 154, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 516, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 328, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 46, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 403, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-20T13:33:14.949 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 80, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 3, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 12, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 13, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 1, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 999, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-20T13:33:14.950 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 10, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_sent": 0, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_bounced": 0, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_completed": 0 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 1, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 1, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 2, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 2, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.951 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get": 11722, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 2852880, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 11722, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "put": 11722, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 2852880, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.952 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "take": 3710, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 6375307, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "put": 3710, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 6375307, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "take": 3710, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 3710, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "put": 3710, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 3710, 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.953 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "get": 2, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 202, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 2, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "put": 2, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 202, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.954 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x37ac640": { 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "get": 1702, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 5926444, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 1702, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "put": 1686, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 5926444, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "trackedop": { 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 198 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:14.955 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:33:14.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 -- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5880b5760 msgr2=0x7fb5880d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5880b5760 0x7fb5880d5c10 secure :-1 s=READY pgs=663 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c0095d0 tx=0x7fb59c005f90 comp rx=0 tx=0).stop 2026-02-20T13:33:14.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 -- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5ac1341d0 msgr2=0x7fb5ac1545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:14.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5ac1341d0 0x7fb5ac1545f0 secure :-1 s=READY pgs=1601 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a002f6a0 tx=0x7fb5a0004290 comp rx=0 tx=0).stop 2026-02-20T13:33:14.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 -- 10.20.193.28:0/2790577422 shutdown_connections 2026-02-20T13:33:14.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fb5880b5760 0x7fb5880d5c10 unknown :-1 s=CLOSED pgs=663 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5ac1341d0 0x7fb5ac1545f0 unknown :-1 s=CLOSED pgs=1601 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb5ac154d90 0x7fb5ac0ff210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 --2- 10.20.193.28:0/2790577422 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fb5ac1137b0 0x7fb5ac175240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:14.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.923+0000 7fb5b2883640 1 -- 10.20.193.28:0/2790577422 >> 10.20.193.28:0/2790577422 conn(0x7fb5ac064000 msgr2=0x7fb5ac0f5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:14.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.924+0000 7fb5b2883640 1 -- 10.20.193.28:0/2790577422 shutdown_connections 2026-02-20T13:33:14.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:14.924+0000 7fb5b2883640 1 -- 10.20.193.28:0/2790577422 wait complete. 2026-02-20T13:33:14.957 INFO:tasks.check_counter:Daemon mds.b mds.exported=2 2026-02-20T13:33:14.957 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2026-02-20T13:33:14.957 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=17 2026-02-20T13:33:14.957 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2026-02-20T13:33:14.957 DEBUG:tasks.check_counter:Getting stats from e 2026-02-20T13:33:14.958 DEBUG:tasks.check_counter:skipping mds.24641 2026-02-20T13:33:14.958 DEBUG:tasks.check_counter:Getting stats from h 2026-02-20T13:33:14.958 DEBUG:tasks.check_counter:Getting stats from mds.24659 2026-02-20T13:33:14.958 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24659 perf dump --format=json-pretty 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.075+0000 7f2786f75640 1 -- 10.20.193.28:0/3063697598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 msgr2=0x7f278010ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.075+0000 7f2786f75640 1 --2- 10.20.193.28:0/3063697598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 0x7f278010ef90 secure :-1 s=READY pgs=563 gs=2 cs=0 l=1 c_cookie=12516961900681087663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2770009950 tx=0x7f277002f190 comp rx=0 tx=0).stop 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.075+0000 7f2786f75640 1 -- 10.20.193.28:0/3063697598 shutdown_connections 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.075+0000 7f2786f75640 1 --2- 10.20.193.28:0/3063697598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f278010fd30 0x7f27801101a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.075+0000 7f2786f75640 1 --2- 10.20.193.28:0/3063697598 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f27801106e0 0x7f2780171070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.075+0000 7f2786f75640 1 --2- 10.20.193.28:0/3063697598 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 0x7f278010ef90 unknown :-1 s=CLOSED pgs=563 gs=2 cs=0 l=1 c_cookie=12516961900681087663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.075+0000 7f2786f75640 1 -- 10.20.193.28:0/3063697598 >> 10.20.193.28:0/3063697598 conn(0x7f27800ec2d0 msgr2=0x7f278010c700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.075+0000 7f2786f75640 1 -- 10.20.193.28:0/3063697598 shutdown_connections 2026-02-20T13:33:15.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 -- 10.20.193.28:0/3063697598 wait complete. 2026-02-20T13:33:15.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 Processor -- start 2026-02-20T13:33:15.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 -- start start 2026-02-20T13:33:15.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 0x7f27800f81c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f278010fd30 0x7f2780171070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27801106e0 0x7f27800f8a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27800f9610 con 0x7f27801106e0 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f27800f9780 con 0x7f278010eba0 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.076+0000 7f2786f75640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f27800f9940 con 0x7f278010fd30 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2785f73640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 0x7f27800f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2785f73640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 0x7f27800f81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57670/0 (socket says 10.20.193.28:57670) 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2785f73640 1 -- 10.20.193.28:0/2815049467 learned_addr learned my addr 10.20.193.28:0/2815049467 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2785772640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f278010fd30 0x7f2780171070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786774640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27801106e0 0x7f27800f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786774640 1 -- 10.20.193.28:0/2815049467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f278010fd30 msgr2=0x7f2780171070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786774640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f278010fd30 0x7f2780171070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786774640 1 -- 10.20.193.28:0/2815049467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 msgr2=0x7f27800f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786774640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 0x7f27800f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786774640 1 -- 10.20.193.28:0/2815049467 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2770009570 con 0x7f27801106e0 2026-02-20T13:33:15.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786774640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27801106e0 0x7f27800f8a20 secure :-1 s=READY pgs=1606 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f277c00f940 tx=0x7f277c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f276effd640 1 -- 10.20.193.28:0/2815049467 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f277c00dce0 con 0x7f27801106e0 2026-02-20T13:33:15.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786f75640 1 -- 10.20.193.28:0/2815049467 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27800f9c20 con 0x7f27801106e0 2026-02-20T13:33:15.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f276effd640 1 -- 10.20.193.28:0/2815049467 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f277c00de40 con 0x7f27801106e0 2026-02-20T13:33:15.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f276effd640 1 -- 10.20.193.28:0/2815049467 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f277c0116b0 con 0x7f27801106e0 2026-02-20T13:33:15.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.077+0000 7f2786f75640 1 -- 10.20.193.28:0/2815049467 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27800fa0f0 con 0x7f27801106e0 2026-02-20T13:33:15.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.080+0000 7f276effd640 1 -- 10.20.193.28:0/2815049467 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f277c020060 con 0x7f27801106e0 2026-02-20T13:33:15.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f276effd640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f275c0b56e0 0x7f275c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f276effd640 1 -- 10.20.193.28:0/2815049467 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f277c015070 con 0x7f27801106e0 2026-02-20T13:33:15.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f278a7e9e00 1 Processor -- start 2026-02-20T13:33:15.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f2785f73640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f275c0b56e0 0x7f275c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f278a7e9e00 1 -- start start 2026-02-20T13:33:15.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d659b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d862d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505da6bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d505c5bd90 con 0x55d505d86810 2026-02-20T13:33:15.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d505c57ac0 con 0x55d505d65ef0 2026-02-20T13:33:15.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.082+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d505c51a60 con 0x55d505d455d0 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785f73640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d862d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57680/0 (socket says 10.20.193.28:57680) 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 -- 10.20.193.28:0/4243399588 learned_addr learned my addr 10.20.193.28:0/4243399588 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2786774640 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505da6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785f73640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f275c0b56e0 0x7f275c0d5b90 secure :-1 s=READY pgs=664 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2770005b30 tx=0x7f277003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 -- 10.20.193.28:0/4243399588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 msgr2=0x55d505d659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 -- 10.20.193.28:0/4243399588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 msgr2=0x55d505da6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505da6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 -- 10.20.193.28:0/4243399588 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d505bfd300 con 0x55d505d65ef0 2026-02-20T13:33:15.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2786774640 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505da6bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.083+0000 7f2785772640 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d862d0 secure :-1 s=READY pgs=564 gs=1 cs=0 l=1 c_cookie=17800520964679040886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2774002800 tx=0x7f27740046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f708278194967f76 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f274e3ff640 1 -- 10.20.193.28:0/4243399588 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2774009d50 con 0x55d505d65ef0 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f274e3ff640 1 -- 10.20.193.28:0/4243399588 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f277401a950 con 0x55d505d65ef0 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 -- 10.20.193.28:0/4243399588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 msgr2=0x55d505d862d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d862d0 secure :-1 s=READY pgs=564 gs=1 cs=0 l=1 c_cookie=17800520964679040886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2774002800 tx=0x7f27740046d0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 -- 10.20.193.28:0/4243399588 shutdown_connections 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505da6bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d862d0 unknown :-1 s=CLOSED pgs=564 gs=1 cs=0 l=1 c_cookie=17800520964679040886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/4243399588 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d659b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 -- 10.20.193.28:0/4243399588 >> 10.20.193.28:0/4243399588 conn(0x55d505c64c90 msgr2=0x55d505d43eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 -- 10.20.193.28:0/4243399588 shutdown_connections 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.084+0000 7f278a7e9e00 1 -- 10.20.193.28:0/4243399588 wait complete. 2026-02-20T13:33:15.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.085+0000 7f278a7e9e00 1 -- start start 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.085+0000 7f278a7e9e00 1 Processor -- start 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d605a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d60bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505d5eff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d505d5f6f0 con 0x55d505d86810 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d505d5f860 con 0x55d505d65ef0 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d505d5fa20 con 0x55d505d455d0 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2785f73640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2785772640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d60bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2785f73640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60866/0 (socket says 10.20.193.28:60866) 2026-02-20T13:33:15.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2785f73640 1 -- 10.20.193.28:0/3968912008 learned_addr learned my addr 10.20.193.28:0/3968912008 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2785772640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d60bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57694/0 (socket says 10.20.193.28:57694) 2026-02-20T13:33:15.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2786774640 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505d5eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2786774640 1 -- 10.20.193.28:0/3968912008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 msgr2=0x55d505d605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2786774640 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2786774640 1 -- 10.20.193.28:0/3968912008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 msgr2=0x55d505d60bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2786774640 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d60bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.086+0000 7f2786774640 1 -- 10.20.193.28:0/3968912008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d505bd56c0 con 0x55d505d86810 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f2786774640 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505d5eff0 secure :-1 s=READY pgs=1607 gs=3 cs=0 l=1 c_cookie=1714682004002553294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f277c0aa6b0 tx=0x7f277c0ad8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cbc632a753bdce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f273b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f273b7fe640 1 -- 10.20.193.28:0/3968912008 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f277c0b63e0 con 0x55d505d86810 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f273b7fe640 1 -- 10.20.193.28:0/3968912008 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f277c0b9220 con 0x55d505d86810 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f273b7fe640 1 -- 10.20.193.28:0/3968912008 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f277c0b9010 con 0x55d505d86810 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2774004370 con 0x55d505d86810 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f278a7e9e00 10 client.21246 _ll_register_callbacks cb 0x55d505bdc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d5059349e0 con 0x55d505d86810 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f273b7fe640 1 -- 10.20.193.28:0/3968912008 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f277c0aa350 con 0x55d505d86810 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f273b7fe640 1 -- 10.20.193.28:0/3968912008 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f277c0aed70 con 0x55d505d86810 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f278a7e9e00 10 client.21246 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:15.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.087+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55d505be7810 con 0x55d505d86810 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.088+0000 7f273b7fe640 1 -- 10.20.193.28:0/3968912008 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f277c073270 con 0x55d505d86810 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.088+0000 7f278a7e9e00 10 client.21246 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.088+0000 7f278a7e9e00 10 client.21246 resolve_mds: validated gid 24659 aka daemon mds.h 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.088+0000 7f278a7e9e00 20 client.21246 populate_metadata read hostname 'trial028' 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.088+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d505d63850 0x55d505d63cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.088+0000 7f278a7e9e00 4 client.21246 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.088+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d505c245b0 con 0x55d505d63850 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.088+0000 7f2785f73640 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d505d63850 0x55d505d63cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.089+0000 7f2785f73640 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d505d63850 0x55d505d63cc0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=2457639253764613202 s_cookie=936633084995986500 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=221b49e152b22452 server_cookie=cff96d40c106444 in_seq=0 out_seq=0 2026-02-20T13:33:15.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.089+0000 7f273b7fe640 10 client.21246 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.089+0000 7f273b7fe640 1 -- 10.20.193.28:0/3968912008 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d505c245b0 con 0x55d505d63850 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.089+0000 7f273b7fe640 10 client.21246 handle_command_reply: tid=0 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.089+0000 7f278a7e9e00 1 client.21246 shutdown 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 msgr2=0x55d505d5eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505d5eff0 secure :-1 s=READY pgs=1607 gs=3 cs=0 l=1 c_cookie=1714682004002553294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f277c0aa6b0 tx=0x7f277c0ad8e0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 shutdown_connections 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d505d63850 0x55d505d63cc0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=2457639253764613202 s_cookie=936633084995986500 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d86810 0x55d505d5eff0 unknown :-1 s=CLOSED pgs=1607 gs=3 cs=0 l=1 c_cookie=1714682004002553294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d65ef0 0x55d505d60bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3968912008 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d455d0 0x55d505d605a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 >> 10.20.193.28:0/3968912008 conn(0x55d505c64c90 msgr2=0x55d505d468a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f273b7fe640 0 client.21246 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:33:15.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 shutdown_connections 2026-02-20T13:33:15.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3968912008 wait complete. 2026-02-20T13:33:15.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.090+0000 7f278a7e9e00 20 client.21246 trim_cache size 0 max 16384 2026-02-20T13:33:15.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f278a7e9e00 1 Processor -- start 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f278a7e9e00 1 -- start start 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505c64c90 0x55d505d60b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d455d0 0x55d505d846d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d65ef0 0x55d505d84c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d505c4f690 con 0x55d505d65ef0 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d5058ef690 con 0x55d505d455d0 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d505d510a0 con 0x55d505c64c90 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f2786774640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d65ef0 0x55d505d84c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f2786774640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d65ef0 0x55d505d84c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45084/0 (socket says 10.20.193.28:45084) 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f2786774640 1 -- 10.20.193.28:0/3083450563 learned_addr learned my addr 10.20.193.28:0/3083450563 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.098+0000 7f2785f73640 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505c64c90 0x55d505d60b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f2785772640 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d455d0 0x55d505d846d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f2786774640 1 -- 10.20.193.28:0/3083450563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505c64c90 msgr2=0x55d505d60b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f2786774640 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505c64c90 0x55d505d60b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f2786774640 1 -- 10.20.193.28:0/3083450563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d455d0 msgr2=0x55d505d846d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f2786774640 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d455d0 0x55d505d846d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f2786774640 1 -- 10.20.193.28:0/3083450563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d505d43e30 con 0x55d505d65ef0 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f2786774640 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d65ef0 0x55d505d84c10 secure :-1 s=READY pgs=1608 gs=1 cs=0 l=1 c_cookie=17248632815315850465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f277c0ae350 tx=0x7f277c06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5f74288a0c14e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f274dbfe640 1 -- 10.20.193.28:0/3083450563 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f277c0ac0c0 con 0x55d505d65ef0 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f274dbfe640 1 -- 10.20.193.28:0/3083450563 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f277c0cb060 con 0x55d505d65ef0 2026-02-20T13:33:15.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f274dbfe640 1 -- 10.20.193.28:0/3083450563 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f277c0061d0 con 0x55d505d65ef0 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3083450563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d65ef0 msgr2=0x55d505d84c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d65ef0 0x55d505d84c10 secure :-1 s=READY pgs=1608 gs=1 cs=0 l=1 c_cookie=17248632815315850465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f277c0ae350 tx=0x7f277c06f000 comp rx=0 tx=0).stop 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3083450563 shutdown_connections 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d65ef0 0x55d505d84c10 unknown :-1 s=CLOSED pgs=1608 gs=1 cs=0 l=1 c_cookie=17248632815315850465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505d455d0 0x55d505d846d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/3083450563 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505c64c90 0x55d505d60b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3083450563 >> 10.20.193.28:0/3083450563 conn(0x55d505d511e0 msgr2=0x55d505d64570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3083450563 shutdown_connections 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.099+0000 7f278a7e9e00 1 -- 10.20.193.28:0/3083450563 wait complete. 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f278a7e9e00 1 -- start start 2026-02-20T13:33:15.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f278a7e9e00 1 Processor -- start 2026-02-20T13:33:15.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505c64c90 0x55d505d662c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d455d0 0x55d505d66800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f278a7e9e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d65ef0 0x55d505d66d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d505d45040 con 0x55d505d455d0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55d505c4f690 con 0x55d505c64c90 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f278a7e9e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55d505d674d0 con 0x55d505d65ef0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f2785772640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d455d0 0x55d505d66800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.100+0000 7f2785772640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d455d0 0x55d505d66800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45098/0 (socket says 10.20.193.28:45098) 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2785772640 1 -- 10.20.193.28:0/1180250771 learned_addr learned my addr 10.20.193.28:0/1180250771 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2785f73640 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505c64c90 0x55d505d662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2786774640 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d65ef0 0x55d505d66d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2785772640 1 -- 10.20.193.28:0/1180250771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d65ef0 msgr2=0x55d505d66d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2785772640 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d65ef0 0x55d505d66d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2785772640 1 -- 10.20.193.28:0/1180250771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505c64c90 msgr2=0x55d505d662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2785772640 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505c64c90 0x55d505d662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2785772640 1 -- 10.20.193.28:0/1180250771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d505be20b0 con 0x55d505d455d0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f2785772640 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d455d0 0x55d505d66800 secure :-1 s=READY pgs=1609 gs=1 cs=0 l=1 c_cookie=16115668549430676581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2774002800 tx=0x7f277401a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa65b2946c00c65 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f273b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f273b7fe640 1 -- 10.20.193.28:0/1180250771 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f277401ac40 con 0x55d505d455d0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f273b7fe640 1 -- 10.20.193.28:0/1180250771 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f277401ada0 con 0x55d505d455d0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2774004370 con 0x55d505d455d0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f273b7fe640 1 -- 10.20.193.28:0/1180250771 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27740277c0 con 0x55d505d455d0 2026-02-20T13:33:15.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f278a7e9e00 10 client.21252 _ll_register_callbacks cb 0x55d505bdc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d505c83100 con 0x55d505d455d0 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f273b7fe640 1 -- 10.20.193.28:0/1180250771 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f2774027950 con 0x55d505d455d0 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.101+0000 7f273b7fe640 1 -- 10.20.193.28:0/1180250771 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2774027b30 con 0x55d505d455d0 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f278a7e9e00 10 client.21252 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55d505bd59f0 con 0x55d505d455d0 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f273b7fe640 1 -- 10.20.193.28:0/1180250771 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f2774027cd0 con 0x55d505d455d0 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f278a7e9e00 10 client.21252 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f278a7e9e00 10 client.21252 resolve_mds: validated gid 24659 aka daemon mds.h 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f278a7e9e00 20 client.21252 populate_metadata read hostname 'trial028' 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d505d86810 0x55d505d69490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f278a7e9e00 4 client.21252 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 --> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55d505982740 con 0x55d505d86810 2026-02-20T13:33:15.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.102+0000 7f2785f73640 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d505d86810 0x55d505d69490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.103+0000 7f2785f73640 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d505d86810 0x55d505d69490 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=16796422228787536029 s_cookie=700160443381771999 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e918e1069c5b209d server_cookie=9b77836b18ceedf in_seq=0 out_seq=0 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.103+0000 7f273b7fe640 10 client.21252 ms_handle_connect on v2:10.20.193.34:6836/3360165301 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f273b7fe640 1 -- 10.20.193.28:0/1180250771 <== mds.2 v2:10.20.193.34:6836/3360165301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18297 (crc 0 0 0) 0x55d505982740 con 0x55d505d86810 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f273b7fe640 10 client.21252 handle_command_reply: tid=0 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 client.21252 shutdown 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d455d0 msgr2=0x55d505d66800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d455d0 0x55d505d66800 secure :-1 s=READY pgs=1609 gs=1 cs=0 l=1 c_cookie=16115668549430676581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2774002800 tx=0x7f277401a6a0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 shutdown_connections 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.34:6836/3360165301,v1:10.20.193.34:6837/3360165301] conn(0x55d505d86810 0x55d505d69490 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=16796422228787536029 s_cookie=700160443381771999 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d505d455d0 0x55d505d66800 unknown :-1 s=CLOSED pgs=1609 gs=1 cs=0 l=1 c_cookie=16115668549430676581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55d505d65ef0 0x55d505d66d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 --2- 10.20.193.28:0/1180250771 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55d505c64c90 0x55d505d662c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f273b7fe640 0 client.21252 ms_handle_reset on v2:10.20.193.34:6836/3360165301 2026-02-20T13:33:15.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 >> 10.20.193.28:0/1180250771 conn(0x55d505d511e0 msgr2=0x55d505d64570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 shutdown_connections 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 1 -- 10.20.193.28:0/1180250771 wait complete. 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f278a7e9e00 20 client.21252 trim_cache size 0 max 16384 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 424, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 405, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 719357, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 343408, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 16, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 7, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.029509196, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.012597015, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.017566985, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000109083, 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:15.108 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 405, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.016201559, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000040003 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 157, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000013534, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000086 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 653552, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 173424 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 68, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 274, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 11615, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 1255243, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 64, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.019099024, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.008309517, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.009288190, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000126823, 2026-02-20T13:33:15.109 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 271, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.012989169, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000047930 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 52, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000001342, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000025 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 320, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 574752 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 1853, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 1426, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 582804, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 426374, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 8, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 4, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.065713167, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.037027898, 2026-02-20T13:33:15.110 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.036089520, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000115565, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1427, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.029107381, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000020397 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3137, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000250646, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000079 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:15.111 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 53, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000454680, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000008578 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000007283, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000003641 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "request": 2, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 1, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000147614, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000147614 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 1, 2026-02-20T13:33:15.112 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 11, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 16, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 16, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 13, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 4, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 3, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 43, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 36, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 6, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 0, 2026-02-20T13:33:15.113 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 5, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 0, 2026-02-20T13:33:15.114 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 1 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 15, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 10, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 13, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-20T13:33:15.115 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 14, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 84, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_succeeded": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_write_failed": 0 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 4, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 4, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 2, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 0, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 2, 2026-02-20T13:33:15.116 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 2, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 0, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 4194304, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 4195443, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.002568425, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000856141 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 20, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 22, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 2, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 18, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 22, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 4, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 16, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 20, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 4, 2026-02-20T13:33:15.117 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 0, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 1, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 1, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 53044, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 260800512 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 3, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 1, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 2, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 4, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 2, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000147614, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000147614 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.118 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.119 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.120 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-20T13:33:15.121 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-20T13:33:15.122 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.123 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "cache_trim_throttle": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle2o": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "global_recall_throttle": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.124 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 1, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 1, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 1, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 1, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 84, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-20T13:33:15.125 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 254007, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 79, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 0, 2026-02-20T13:33:15.126 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 7600, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 155, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 82308, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 384, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_bytes": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_items": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 38, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 11593, 2026-02-20T13:33:15.127 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 27, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 38, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 38, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.140996336, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003710429 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 60, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 38 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "op": 38, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 38, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 10, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 3, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 6, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 6, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-20T13:33:15.128 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 20, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-20T13:33:15.129 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 80, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 2, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 8, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 13, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 5, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 14, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 1, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_sent": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_bounced": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_completed": 0 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 0, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-20T13:33:15.130 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get": 2345, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 1086240, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 2345, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "put": 2345, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 1086240, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "take": 38, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 11593, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "put": 38, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 11593, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.131 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "take": 38, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 38, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "put": 38, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 38, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "put": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.132 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x3876640": { 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "get": 4, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 1139, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 4, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "put": 3, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 1139, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "trackedop": { 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 98 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.133 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 -- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f275c0b56e0 msgr2=0x7f275c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f275c0b56e0 0x7f275c0d5b90 secure :-1 s=READY pgs=664 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2770005b30 tx=0x7f277003a040 comp rx=0 tx=0).stop 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 -- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27801106e0 msgr2=0x7f27800f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27801106e0 0x7f27800f8a20 secure :-1 s=READY pgs=1606 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f277c00f940 tx=0x7f277c00fe10 comp rx=0 tx=0).stop 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 -- 10.20.193.28:0/2815049467 shutdown_connections 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f275c0b56e0 0x7f275c0d5b90 unknown :-1 s=CLOSED pgs=664 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27801106e0 0x7f27800f8a20 unknown :-1 s=CLOSED pgs=1606 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f278010fd30 0x7f2780171070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 --2- 10.20.193.28:0/2815049467 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f278010eba0 0x7f27800f81c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.104+0000 7f2786f75640 1 -- 10.20.193.28:0/2815049467 >> 10.20.193.28:0/2815049467 conn(0x7f27800ec2d0 msgr2=0x7f27800ee810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.105+0000 7f2786f75640 1 -- 10.20.193.28:0/2815049467 shutdown_connections 2026-02-20T13:33:15.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.105+0000 7f2786f75640 1 -- 10.20.193.28:0/2815049467 wait complete. 2026-02-20T13:33:15.135 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2026-02-20T13:33:15.135 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2026-02-20T13:33:15.135 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2026-02-20T13:33:15.135 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=15 2026-02-20T13:33:15.135 DEBUG:tasks.check_counter:Getting stats from k 2026-02-20T13:33:15.135 DEBUG:tasks.check_counter:skipping mds.24617 2026-02-20T13:33:15.135 DEBUG:tasks.check_counter:Getting stats from c 2026-02-20T13:33:15.135 DEBUG:tasks.check_counter:skipping mds.24643 2026-02-20T13:33:15.135 DEBUG:tasks.check_counter:Getting stats from f 2026-02-20T13:33:15.135 DEBUG:tasks.check_counter:skipping mds.24637 2026-02-20T13:33:15.135 DEBUG:tasks.check_counter:Getting stats from i 2026-02-20T13:33:15.135 DEBUG:tasks.check_counter:Getting stats from mds.24655 2026-02-20T13:33:15.135 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24655 perf dump --format=json-pretty 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 -- 10.20.193.28:0/935729867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f801179d0 msgr2=0x7f0f80117dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/935729867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f801179d0 0x7f0f80117dc0 secure :-1 s=READY pgs=1610 gs=1 cs=0 l=1 c_cookie=4033177240844684872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f74009950 tx=0x7f0f7402f190 comp rx=0 tx=0).stop 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 -- 10.20.193.28:0/935729867 shutdown_connections 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/935729867 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f80119510 0x7f0f80179ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/935729867 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f80118b60 0x7f0f80118fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/935729867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f801179d0 0x7f0f80117dc0 unknown :-1 s=CLOSED pgs=1610 gs=1 cs=0 l=1 c_cookie=4033177240844684872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 -- 10.20.193.28:0/935729867 >> 10.20.193.28:0/935729867 conn(0x7f0f800f5100 msgr2=0x7f0f80115530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 -- 10.20.193.28:0/935729867 shutdown_connections 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 -- 10.20.193.28:0/935729867 wait complete. 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.254+0000 7f0f7ffff640 1 Processor -- start 2026-02-20T13:33:15.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7ffff640 1 -- start start 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7ffff640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f801179d0 0x7f0f80101010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f80118b60 0x7f0f80179ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7ffff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f80119510 0x7f0f80101870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0f80102460 con 0x7f0f80118b60 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7ffff640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0f801025d0 con 0x7f0f80119510 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7ffff640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0f80102790 con 0x7f0f801179d0 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f80118b60 0x7f0f80179ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f80118b60 0x7f0f80179ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45116/0 (socket says 10.20.193.28:45116) 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7e7fc640 1 -- 10.20.193.28:0/2332161602 learned_addr learned my addr 10.20.193.28:0/2332161602 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7effd640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f801179d0 0x7f0f80101010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7f7fe640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f80119510 0x7f0f80101870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7e7fc640 1 -- 10.20.193.28:0/2332161602 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f801179d0 msgr2=0x7f0f80101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f801179d0 0x7f0f80101010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7e7fc640 1 -- 10.20.193.28:0/2332161602 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f80119510 msgr2=0x7f0f80101870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f80119510 0x7f0f80101870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.255+0000 7f0f7e7fc640 1 -- 10.20.193.28:0/2332161602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f74009570 con 0x7f0f80118b60 2026-02-20T13:33:15.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.256+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f80118b60 0x7f0f80179ea0 secure :-1 s=READY pgs=1611 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f6800d950 tx=0x7f0f6800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.256+0000 7f0f5ffff640 1 -- 10.20.193.28:0/2332161602 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f68004540 con 0x7f0f80118b60 2026-02-20T13:33:15.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.256+0000 7f0f5ffff640 1 -- 10.20.193.28:0/2332161602 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0f68009d00 con 0x7f0f80118b60 2026-02-20T13:33:15.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.256+0000 7f0f5ffff640 1 -- 10.20.193.28:0/2332161602 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f680106e0 con 0x7f0f80118b60 2026-02-20T13:33:15.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.256+0000 7f0f7ffff640 1 -- 10.20.193.28:0/2332161602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f80102a70 con 0x7f0f80118b60 2026-02-20T13:33:15.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.256+0000 7f0f7ffff640 1 -- 10.20.193.28:0/2332161602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f80102ef0 con 0x7f0f80118b60 2026-02-20T13:33:15.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.259+0000 7f0f5ffff640 1 -- 10.20.193.28:0/2332161602 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0f680097c0 con 0x7f0f80118b60 2026-02-20T13:33:15.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.260+0000 7f0f5ffff640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0f540b5760 0x7f0f540d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.260+0000 7f0f5ffff640 1 -- 10.20.193.28:0/2332161602 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0f680e69f0 con 0x7f0f80118b60 2026-02-20T13:33:15.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f7effd640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0f540b5760 0x7f0f540d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f87e19e00 1 Processor -- start 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f87e19e00 1 -- start start 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f7effd640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0f540b5760 0x7f0f540d5c10 secure :-1 s=READY pgs=665 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f740023d0 tx=0x7f0f74031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc7419b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc741ef0 0x55ecbc7622d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc762810 0x55ecbc782bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc637d90 con 0x55ecbc741ef0 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc633ac0 con 0x55ecbc762810 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc62da60 con 0x55ecbc7215d0 2026-02-20T13:33:15.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f7e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc741ef0 0x55ecbc7622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f7effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc7419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f7e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc741ef0 0x55ecbc7622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45132/0 (socket says 10.20.193.28:45132) 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f7e7fc640 1 -- 10.20.193.28:0/3841733612 learned_addr learned my addr 10.20.193.28:0/3841733612 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f7f7fe640 1 --2- 10.20.193.28:0/3841733612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc762810 0x55ecbc782bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.261+0000 7f0f7e7fc640 1 -- 10.20.193.28:0/3841733612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 msgr2=0x55ecbc7419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/3841733612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc7419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f7e7fc640 1 -- 10.20.193.28:0/3841733612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc762810 msgr2=0x55ecbc782bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/3841733612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc762810 0x55ecbc782bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f7e7fc640 1 -- 10.20.193.28:0/3841733612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbc5d9300 con 0x55ecbc741ef0 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/3841733612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc741ef0 0x55ecbc7622d0 secure :-1 s=READY pgs=1612 gs=1 cs=0 l=1 c_cookie=13179771465686654173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f680e4500 tx=0x7f0f68002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e7f45191151cdd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f4b7fe640 1 -- 10.20.193.28:0/3841733612 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f680ac770 con 0x55ecbc741ef0 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f4b7fe640 1 -- 10.20.193.28:0/3841733612 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0f680ac590 con 0x55ecbc741ef0 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f4b7fe640 1 -- 10.20.193.28:0/3841733612 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f680e4110 con 0x55ecbc741ef0 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 -- 10.20.193.28:0/3841733612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc741ef0 msgr2=0x55ecbc7622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/3841733612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc741ef0 0x55ecbc7622d0 secure :-1 s=READY pgs=1612 gs=1 cs=0 l=1 c_cookie=13179771465686654173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f680e4500 tx=0x7f0f68002cc0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 -- 10.20.193.28:0/3841733612 shutdown_connections 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/3841733612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc741ef0 0x55ecbc7622d0 unknown :-1 s=CLOSED pgs=1612 gs=1 cs=0 l=1 c_cookie=13179771465686654173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/3841733612 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc762810 0x55ecbc782bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/3841733612 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc7419b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 -- 10.20.193.28:0/3841733612 >> 10.20.193.28:0/3841733612 conn(0x55ecbc640c90 msgr2=0x55ecbc71feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 -- 10.20.193.28:0/3841733612 shutdown_connections 2026-02-20T13:33:15.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.262+0000 7f0f87e19e00 1 -- 10.20.193.28:0/3841733612 wait complete. 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f87e19e00 1 -- start start 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f87e19e00 1 Processor -- start 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc7215d0 0x55ecbc73c660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc73ccb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc762810 0x55ecbc73b0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc73b7b0 con 0x55ecbc7215d0 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc73b920 con 0x55ecbc741ef0 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc73bae0 con 0x55ecbc762810 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f7effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc7215d0 0x55ecbc73c660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f7effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc7215d0 0x55ecbc73c660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45140/0 (socket says 10.20.193.28:45140) 2026-02-20T13:33:15.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.264+0000 7f0f7effd640 1 -- 10.20.193.28:0/2144207924 learned_addr learned my addr 10.20.193.28:0/2144207924 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f7effd640 1 -- 10.20.193.28:0/2144207924 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc762810 msgr2=0x55ecbc73b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f7effd640 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc762810 0x55ecbc73b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f7effd640 1 -- 10.20.193.28:0/2144207924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 msgr2=0x55ecbc73ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc73ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f7effd640 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc73ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f7effd640 1 -- 10.20.193.28:0/2144207924 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbc5b16c0 con 0x55ecbc7215d0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc73ccb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f7effd640 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc7215d0 0x55ecbc73c660 secure :-1 s=READY pgs=1613 gs=1 cs=0 l=1 c_cookie=9711659507853106166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f74009950 tx=0x7f0f74009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c6bede29211bf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f48ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f48ff9640 1 -- 10.20.193.28:0/2144207924 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f74038e10 con 0x55ecbc7215d0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f48ff9640 1 -- 10.20.193.28:0/2144207924 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0f740438e0 con 0x55ecbc7215d0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f48ff9640 1 -- 10.20.193.28:0/2144207924 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f740506a0 con 0x55ecbc7215d0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f80102ef0 con 0x55ecbc7215d0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f48ff9640 1 -- 10.20.193.28:0/2144207924 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0f74050880 con 0x55ecbc7215d0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f87e19e00 10 client.21264 _ll_register_callbacks cb 0x55ecbc5b86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ecbc3109e0 con 0x55ecbc7215d0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f48ff9640 1 -- 10.20.193.28:0/2144207924 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0f74043400 con 0x55ecbc7215d0 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f87e19e00 10 client.21264 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:15.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.265+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55ecbc5c3810 con 0x55ecbc7215d0 2026-02-20T13:33:15.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.266+0000 7f0f48ff9640 1 -- 10.20.193.28:0/2144207924 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f0f7404f070 con 0x55ecbc7215d0 2026-02-20T13:33:15.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.266+0000 7f0f87e19e00 10 client.21264 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:15.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.266+0000 7f0f87e19e00 10 client.21264 resolve_mds: validated gid 24655 aka daemon mds.i 2026-02-20T13:33:15.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.266+0000 7f0f87e19e00 20 client.21264 populate_metadata read hostname 'trial028' 2026-02-20T13:33:15.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.266+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55ecbc73fb40 0x55ecbc73ffe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.266+0000 7f0f87e19e00 4 client.21264 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T13:33:15.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.266+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecbc6005b0 con 0x55ecbc73fb40 2026-02-20T13:33:15.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.266+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55ecbc73fb40 0x55ecbc73ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.267+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55ecbc73fb40 0x55ecbc73ffe0 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=16580701663594602223 s_cookie=16010972430509352445 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e61a7c509148deef server_cookie=de326698851525fd in_seq=0 out_seq=0 2026-02-20T13:33:15.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.267+0000 7f0f48ff9640 10 client.21264 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:33:15.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.267+0000 7f0f48ff9640 1 -- 10.20.193.28:0/2144207924 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ecbc6005b0 con 0x55ecbc73fb40 2026-02-20T13:33:15.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.267+0000 7f0f48ff9640 10 client.21264 handle_command_reply: tid=0 2026-02-20T13:33:15.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.267+0000 7f0f87e19e00 1 client.21264 shutdown 2026-02-20T13:33:15.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.267+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc7215d0 msgr2=0x55ecbc73c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.267+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc7215d0 0x55ecbc73c660 secure :-1 s=READY pgs=1613 gs=1 cs=0 l=1 c_cookie=9711659507853106166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f74009950 tx=0x7f0f74009310 comp rx=0 tx=0).stop 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 shutdown_connections 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55ecbc73fb40 0x55ecbc73ffe0 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=16580701663594602223 s_cookie=16010972430509352445 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc762810 0x55ecbc73b0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc73ccb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/2144207924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc7215d0 0x55ecbc73c660 unknown :-1 s=CLOSED pgs=1613 gs=1 cs=0 l=1 c_cookie=9711659507853106166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f48ff9640 0 client.21264 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 >> 10.20.193.28:0/2144207924 conn(0x55ecbc640c90 msgr2=0x55ecbc7228a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 shutdown_connections 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 1 -- 10.20.193.28:0/2144207924 wait complete. 2026-02-20T13:33:15.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.268+0000 7f0f87e19e00 20 client.21264 trim_cache size 0 max 16384 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f87e19e00 1 Processor -- start 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f87e19e00 1 -- start start 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc7215d0 0x55ecbc7606d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc741ef0 0x55ecbc760c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc761150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc62b690 con 0x55ecbc762810 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc2cb690 con 0x55ecbc7215d0 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc73c660 con 0x55ecbc741ef0 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f7effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc7215d0 0x55ecbc7606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f7f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc761150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f7effd640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc7215d0 0x55ecbc7606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57764/0 (socket says 10.20.193.28:57764) 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f7effd640 1 -- 10.20.193.28:0/1623396010 learned_addr learned my addr 10.20.193.28:0/1623396010 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.276+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/1623396010 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc741ef0 0x55ecbc760c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f7f7fe640 1 -- 10.20.193.28:0/1623396010 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc741ef0 msgr2=0x55ecbc760c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f7f7fe640 1 --2- 10.20.193.28:0/1623396010 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc741ef0 0x55ecbc760c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f7f7fe640 1 -- 10.20.193.28:0/1623396010 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc7215d0 msgr2=0x55ecbc7606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f7f7fe640 1 --2- 10.20.193.28:0/1623396010 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc7215d0 0x55ecbc7606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f7f7fe640 1 -- 10.20.193.28:0/1623396010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbc5be0b0 con 0x55ecbc762810 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f7f7fe640 1 --2- 10.20.193.28:0/1623396010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc761150 secure :-1 s=READY pgs=1614 gs=2 cs=0 l=1 c_cookie=644185444635814317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55ecbc6f6610 tx=0x7f0f70003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f09b3fb4fea9ad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f4affd640 1 -- 10.20.193.28:0/1623396010 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f70012bb0 con 0x55ecbc762810 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f4affd640 1 -- 10.20.193.28:0/1623396010 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0f70012d10 con 0x55ecbc762810 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f4affd640 1 -- 10.20.193.28:0/1623396010 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f70013a40 con 0x55ecbc762810 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 -- 10.20.193.28:0/1623396010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 msgr2=0x55ecbc761150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/1623396010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc761150 secure :-1 s=READY pgs=1614 gs=2 cs=0 l=1 c_cookie=644185444635814317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55ecbc6f6610 tx=0x7f0f70003d50 comp rx=0 tx=0).stop 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 -- 10.20.193.28:0/1623396010 shutdown_connections 2026-02-20T13:33:15.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/1623396010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc761150 unknown :-1 s=CLOSED pgs=1614 gs=2 cs=0 l=1 c_cookie=644185444635814317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/1623396010 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc741ef0 0x55ecbc760c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/1623396010 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc7215d0 0x55ecbc7606d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 -- 10.20.193.28:0/1623396010 >> 10.20.193.28:0/1623396010 conn(0x55ecbc640c90 msgr2=0x55ecbc7406a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 -- 10.20.193.28:0/1623396010 shutdown_connections 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.277+0000 7f0f87e19e00 1 -- 10.20.193.28:0/1623396010 wait complete. 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f87e19e00 1 -- start start 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f87e19e00 1 Processor -- start 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc742850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc742ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f87e19e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc743810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc743e20 con 0x55ecbc762810 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc743f90 con 0x55ecbc741ef0 2026-02-20T13:33:15.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f87e19e00 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc744150 con 0x55ecbc7215d0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f7e7fc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc742ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f7effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc742850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f7f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc743810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f7effd640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc742850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:60924/0 (socket says 10.20.193.28:60924) 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.278+0000 7f0f7effd640 1 -- 10.20.193.28:0/4121805860 learned_addr learned my addr 10.20.193.28:0/4121805860 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f7effd640 1 -- 10.20.193.28:0/4121805860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 msgr2=0x55ecbc742ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f7effd640 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc742ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f7effd640 1 -- 10.20.193.28:0/4121805860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 msgr2=0x55ecbc743810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f7effd640 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc743810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f7effd640 1 -- 10.20.193.28:0/4121805860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbc5b19f0 con 0x55ecbc7215d0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f7effd640 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc742850 secure :-1 s=READY pgs=455 gs=3 cs=0 l=1 c_cookie=15350049068839284802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f740357f0 tx=0x7f0f74040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d506544cd0fb3042 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f48ff9640 10 client.0 ms_handle_connect on v2:10.20.193.127:3300/0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f48ff9640 1 -- 10.20.193.28:0/4121805860 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f74035ea0 con 0x55ecbc7215d0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f70005460 con 0x55ecbc7215d0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f87e19e00 10 client.31048 _ll_register_callbacks cb 0x55ecbc5b86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ecbc65f100 con 0x55ecbc7215d0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f48ff9640 1 -- 10.20.193.28:0/4121805860 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ecbc65f100 con 0x55ecbc7215d0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f48ff9640 1 -- 10.20.193.28:0/4121805860 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f74035320 con 0x55ecbc7215d0 2026-02-20T13:33:15.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f48ff9640 1 -- 10.20.193.28:0/4121805860 <== mon.1 v2:10.20.193.127:3300/0 4 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0f740354b0 con 0x55ecbc7215d0 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f48ff9640 1 -- 10.20.193.28:0/4121805860 <== mon.1 v2:10.20.193.127:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0f74036370 con 0x55ecbc7215d0 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f87e19e00 10 client.31048 fetch_fsmap learned FSMap version 31 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.279+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55ecbc5c3a70 con 0x55ecbc7215d0 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f48ff9640 1 -- 10.20.193.28:0/4121805860 <== mon.1 v2:10.20.193.127:3300/0 6 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f0f7406d060 con 0x55ecbc7215d0 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f87e19e00 10 client.31048 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f87e19e00 10 client.31048 resolve_mds: validated gid 24655 aka daemon mds.i 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f87e19e00 20 client.31048 populate_metadata read hostname 'trial028' 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55ecbc745ca0 0x55ecbc746140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f87e19e00 4 client.31048 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 --> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55ecbc35e740 con 0x55ecbc745ca0 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55ecbc745ca0 0x55ecbc746140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f7e7fc640 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55ecbc745ca0 0x55ecbc746140 crc :-1 s=READY pgs=87 gs=4 cs=0 l=0 c_cookie=6282421996214699897 s_cookie=5198828052776870697 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=572fa585157a4779 server_cookie=4825f291c619e329 in_seq=0 out_seq=0 2026-02-20T13:33:15.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.280+0000 7f0f48ff9640 10 client.31048 ms_handle_connect on v2:10.20.193.127:6838/3644236506 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f48ff9640 1 -- 10.20.193.28:0/4121805860 <== mds.3 v2:10.20.193.127:6838/3644236506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18375 (crc 0 0 0) 0x55ecbc35e740 con 0x55ecbc745ca0 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f48ff9640 10 client.31048 handle_command_reply: tid=0 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 client.31048 shutdown 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 msgr2=0x55ecbc742850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc742850 secure :-1 s=READY pgs=455 gs=3 cs=0 l=1 c_cookie=15350049068839284802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f740357f0 tx=0x7f0f74040000 comp rx=0 tx=0).stop 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 shutdown_connections 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.127:6838/3644236506,v1:10.20.193.127:6839/3644236506] conn(0x55ecbc745ca0 0x55ecbc746140 crc :-1 s=READY pgs=87 gs=4 cs=0 l=0 c_cookie=6282421996214699897 s_cookie=5198828052776870697 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecbc762810 0x55ecbc743810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x55ecbc741ef0 0x55ecbc742ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f48ff9640 0 client.31048 ms_handle_reset on v2:10.20.193.127:6838/3644236506 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 --2- 10.20.193.28:0/4121805860 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x55ecbc7215d0 0x55ecbc742850 unknown :-1 s=CLOSED pgs=455 gs=3 cs=0 l=1 c_cookie=15350049068839284802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 >> 10.20.193.28:0/4121805860 conn(0x55ecbc640c90 msgr2=0x55ecbc740e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 shutdown_connections 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 1 -- 10.20.193.28:0/4121805860 wait complete. 2026-02-20T13:33:15.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f87e19e00 20 client.31048 trim_cache size 0 max 16384 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 1223, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 2040, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 376568, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 2013181, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 52, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 5, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.069099926, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.034223526, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.025684749, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.006386189, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2039, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.039385269, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000019315 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1232, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000179322, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000145 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 316, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 520, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 121775, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 944124, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 29, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.025933729, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.013978554, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.008931735, 2026-02-20T13:33:15.284 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.001962211, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 519, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.018426786, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000035504 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 162, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000015607, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000096 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 320, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 573504 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 2229, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 1756, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 1207084, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 604721, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 7, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 5, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.077212152, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.041283942, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.045684284, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000081721, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1756, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.026848792, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000015289 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3245, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000214263, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000066 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 647552, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 178752 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-20T13:33:15.285 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1508, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.114093125, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000075658 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000012724, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000006362 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "request": 201, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 201, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 201, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.352990495, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001756171 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 11, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 17, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 17, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 0, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 14, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 4, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 1, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 1, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 3, 2026-02-20T13:33:15.286 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 241, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 234, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 4, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 100, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 1, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 1, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 1, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 7, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 5, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 7, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 7, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 219, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 216, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 196, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 227, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 214, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 1, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 200 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 3, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 11, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 7, 2026-02-20T13:33:15.287 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 9, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 3, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 1, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 1, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 14, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 99, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 1, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_succeeded": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_write_failed": 0 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 643, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 643, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 2, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 2, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 2, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 0, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 4194304, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 4960292, 2026-02-20T13:33:15.288 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 618, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.504676416, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000816628 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 21, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 23, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 2, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 18, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 22, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 4, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 17, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 22, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 5, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 1, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 2, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 1, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 52112, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 261849088 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 596, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 1, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 201, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 5, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 4, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000730489, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000243496 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.289 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-20T13:33:15.290 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000241349, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000241349 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.291 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 196, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.350920453, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001790410 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.292 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001098204, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001098204 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "cache_trim_throttle": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle2o": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "global_recall_throttle": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 1, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 1, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 1, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 63, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 63, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 1748, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-20T13:33:15.293 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 262762, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 90, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 7600, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 155, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-20T13:33:15.294 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 86050, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 521, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_bytes": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_items": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 877, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 779206, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 32, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 877, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 877, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.817986916, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000932710 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 904, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 877 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op": 877, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 7, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 870, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 10, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 618, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 23, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 6, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-20T13:33:15.295 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 7, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 20, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 196, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 80, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 2, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 8, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 13, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 5, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 21, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 3, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_sent": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_bounced": 0, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_completed": 0 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-20T13:33:15.296 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get": 3768, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 1357049, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 3768, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "put": 3768, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 1357049, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "take": 877, 2026-02-20T13:33:15.297 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 779206, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "put": 877, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 779206, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "take": 877, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 877, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "put": 877, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 877, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "put": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.298 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x2370640": { 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "get": 643, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 765988, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 643, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "put": 618, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 765988, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "trackedop": { 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 114 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T13:33:15.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f7ffff640 1 -- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0f540b5760 msgr2=0x7f0f540d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0f540b5760 0x7f0f540d5c10 secure :-1 s=READY pgs=665 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f740023d0 tx=0x7f0f74031040 comp rx=0 tx=0).stop 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f7ffff640 1 -- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f80118b60 msgr2=0x7f0f80179ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.281+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f80118b60 0x7f0f80179ea0 secure :-1 s=READY pgs=1611 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f6800d950 tx=0x7f0f6800de20 comp rx=0 tx=0).stop 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.282+0000 7f0f7ffff640 1 -- 10.20.193.28:0/2332161602 shutdown_connections 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.282+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0f540b5760 0x7f0f540d5c10 unknown :-1 s=CLOSED pgs=665 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.282+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f80118b60 0x7f0f80179ea0 unknown :-1 s=CLOSED pgs=1611 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.282+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0f80119510 0x7f0f80101870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.282+0000 7f0f7ffff640 1 --2- 10.20.193.28:0/2332161602 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0f801179d0 0x7f0f80101010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.282+0000 7f0f7ffff640 1 -- 10.20.193.28:0/2332161602 >> 10.20.193.28:0/2332161602 conn(0x7f0f800f5100 msgr2=0x7f0f800f76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.282+0000 7f0f7ffff640 1 -- 10.20.193.28:0/2332161602 shutdown_connections 2026-02-20T13:33:15.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.282+0000 7f0f7ffff640 1 -- 10.20.193.28:0/2332161602 wait complete. 2026-02-20T13:33:15.300 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2026-02-20T13:33:15.300 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2026-02-20T13:33:15.300 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=3 2026-02-20T13:33:15.300 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=11 2026-02-20T13:33:15.300 DEBUG:tasks.check_counter:Getting stats from l 2026-02-20T13:33:15.300 DEBUG:tasks.check_counter:skipping mds.24604 2026-02-20T13:33:15.300 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2026-02-20T13:33:15.311 INFO:tasks.kclient:Unmounting kernel clients... 2026-02-20T13:33:15.311 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:33:15.311 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T13:33:15.350 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T13:33:15.350 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T13:33:15.428 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd blocklist ls 2026-02-20T13:33:15.651 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:33:15.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.827+0000 7f354186d640 1 -- 10.20.193.28:0/3905911534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f353c10bb60 msgr2=0x7f353c1109f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.827+0000 7f354186d640 1 --2- 10.20.193.28:0/3905911534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f353c10bb60 0x7f353c1109f0 secure :-1 s=READY pgs=1615 gs=1 cs=0 l=1 c_cookie=646805285666119274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3524009890 tx=0x7f352402f120 comp rx=0 tx=0).stop 2026-02-20T13:33:15.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.828+0000 7f354186d640 1 -- 10.20.193.28:0/3905911534 shutdown_connections 2026-02-20T13:33:15.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.828+0000 7f354186d640 1 --2- 10.20.193.28:0/3905911534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f353c10bb60 0x7f353c1109f0 unknown :-1 s=CLOSED pgs=1615 gs=1 cs=0 l=1 c_cookie=646805285666119274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.828+0000 7f354186d640 1 --2- 10.20.193.28:0/3905911534 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f353c111180 0x7f353c111b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.828+0000 7f354186d640 1 --2- 10.20.193.28:0/3905911534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f353c10b170 0x7f353c10b540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.828+0000 7f354186d640 1 -- 10.20.193.28:0/3905911534 >> 10.20.193.28:0/3905911534 conn(0x7f353c0e8ce0 msgr2=0x7f353c1090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.828+0000 7f354186d640 1 -- 10.20.193.28:0/3905911534 shutdown_connections 2026-02-20T13:33:15.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.828+0000 7f354186d640 1 -- 10.20.193.28:0/3905911534 wait complete. 2026-02-20T13:33:15.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.828+0000 7f354186d640 1 Processor -- start 2026-02-20T13:33:15.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354186d640 1 -- start start 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354186d640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f353c10b170 0x7f353c0f1110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354186d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f353c10bb60 0x7f353c0f1650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354186d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f353c111180 0x7f353c0f6a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354186d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0f7040 con 0x7f353c10bb60 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354186d640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0f71b0 con 0x7f353c10b170 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354186d640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0f7370 con 0x7f353c111180 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354086b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f353c10b170 0x7f353c0f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354086b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f353c10b170 0x7f353c0f1110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.34:3300/0 says I am v2:10.20.193.28:57790/0 (socket says 10.20.193.28:57790) 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354086b640 1 -- 10.20.193.28:0/2342786964 learned_addr learned my addr 10.20.193.28:0/2342786964 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f3533fff640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f353c10bb60 0x7f353c0f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354106c640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f353c111180 0x7f353c0f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354086b640 1 -- 10.20.193.28:0/2342786964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f353c111180 msgr2=0x7f353c0f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354086b640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f353c111180 0x7f353c0f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354086b640 1 -- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f353c10bb60 msgr2=0x7f353c0f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354086b640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f353c10bb60 0x7f353c0f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.829+0000 7f354086b640 1 -- 10.20.193.28:0/2342786964 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35240094b0 con 0x7f353c10b170 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.830+0000 7f354086b640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f353c10b170 0x7f353c0f1110 secure :-1 s=READY pgs=565 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f352c005940 tx=0x7f352c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.830+0000 7f3531ffb640 1 -- 10.20.193.28:0/2342786964 <== mon.2 v2:10.20.193.34:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f352c00cd10 con 0x7f353c10b170 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.830+0000 7f3531ffb640 1 -- 10.20.193.28:0/2342786964 <== mon.2 v2:10.20.193.34:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f352c00ce70 con 0x7f353c10b170 2026-02-20T13:33:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.830+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c0f7650 con 0x7f353c10b170 2026-02-20T13:33:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.830+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c0f7d30 con 0x7f353c10b170 2026-02-20T13:33:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.830+0000 7f3531ffb640 1 -- 10.20.193.28:0/2342786964 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f352c0053c0 con 0x7f353c10b170 2026-02-20T13:33:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.830+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c0f7870 con 0x7f353c10b170 2026-02-20T13:33:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.833+0000 7f3531ffb640 1 -- 10.20.193.28:0/2342786964 <== mon.2 v2:10.20.193.34:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f352c005550 con 0x7f353c10b170 2026-02-20T13:33:15.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.834+0000 7f3531ffb640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f35180b56e0 0x7f35180d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:33:15.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.834+0000 7f3531ffb640 1 -- 10.20.193.28:0/2342786964 <== mon.2 v2:10.20.193.34:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f352c014070 con 0x7f353c10b170 2026-02-20T13:33:15.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.835+0000 7f3533fff640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f35180b56e0 0x7f35180d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:33:15.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.835+0000 7f3531ffb640 1 -- 10.20.193.28:0/2342786964 <== mon.2 v2:10.20.193.34:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f352c11f730 con 0x7f353c10b170 2026-02-20T13:33:15.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.835+0000 7f3533fff640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f35180b56e0 0x7f35180d5b90 secure :-1 s=READY pgs=666 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f353c0f7ab0 tx=0x7f352403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:33:15.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.956+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f353c0f2270 con 0x7f353c10b170 2026-02-20T13:33:15.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.956+0000 7f3531ffb640 1 -- 10.20.193.28:0/2342786964 <== mon.2 v2:10.20.193.34:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+588 (secure 0 0 0) 0x7f352c0a94c0 con 0x7f353c10b170 2026-02-20T13:33:15.959 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/3613875849 2026-02-21T13:13:37.304833+0000 2026-02-20T13:33:15.959 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/701608793 2026-02-21T13:13:37.304833+0000 2026-02-20T13:33:15.960 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1283600451 2026-02-21T13:13:37.304833+0000 2026-02-20T13:33:15.960 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2163750178 2026-02-21T13:13:37.304833+0000 2026-02-20T13:33:15.960 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/2570534842 2026-02-21T13:13:24.612016+0000 2026-02-20T13:33:15.960 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/3613875849 2026-02-21T13:13:37.304833+0000 2026-02-20T13:33:15.960 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2935390412 2026-02-21T13:13:24.612016+0000 2026-02-20T13:33:15.960 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/2570534842 2026-02-21T13:13:24.612016+0000 2026-02-20T13:33:15.960 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/404382129 2026-02-21T13:13:24.612016+0000 2026-02-20T13:33:15.960 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/91657074 2026-02-21T13:13:24.612016+0000 2026-02-20T13:33:15.961 INFO:teuthology.orchestra.run.trial028.stderr:listed 10 entries 2026-02-20T13:33:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.957+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f35180b56e0 msgr2=0x7f35180d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.957+0000 7f354186d640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f35180b56e0 0x7f35180d5b90 secure :-1 s=READY pgs=666 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f353c0f7ab0 tx=0x7f352403a040 comp rx=0 tx=0).stop 2026-02-20T13:33:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.957+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f353c10b170 msgr2=0x7f353c0f1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:33:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.957+0000 7f354186d640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f353c10b170 0x7f353c0f1110 secure :-1 s=READY pgs=565 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f352c005940 tx=0x7f352c00ee60 comp rx=0 tx=0).stop 2026-02-20T13:33:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.958+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 shutdown_connections 2026-02-20T13:33:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.958+0000 7f354186d640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f35180b56e0 0x7f35180d5b90 unknown :-1 s=CLOSED pgs=666 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.958+0000 7f354186d640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f353c10bb60 0x7f353c0f1650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.958+0000 7f354186d640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f353c111180 0x7f353c0f6a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.958+0000 7f354186d640 1 --2- 10.20.193.28:0/2342786964 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f353c10b170 0x7f353c0f1110 unknown :-1 s=CLOSED pgs=565 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:33:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.958+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 >> 10.20.193.28:0/2342786964 conn(0x7f353c0e8ce0 msgr2=0x7f353c10dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:33:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.958+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 shutdown_connections 2026-02-20T13:33:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:33:15.958+0000 7f354186d640 1 -- 10.20.193.28:0/2342786964 wait complete. 2026-02-20T13:33:16.057 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2026-02-20T13:33:16.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:33:16.057 DEBUG:teuthology.orchestra.run.trial028:> sudo umount /home/ubuntu/cephtest/mnt.0 2026-02-20T13:33:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:16 trial127 ceph-mon[43817]: pgmap v659: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:33:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:16 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2342786964' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-20T13:33:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:16 trial034 ceph-mon[43332]: pgmap v659: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:33:16.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:16 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2342786964' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-20T13:33:17.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:16 trial028 ceph-mon[37442]: pgmap v659: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2026-02-20T13:33:17.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:16 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2342786964' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-20T13:33:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:18 trial127 ceph-mon[43817]: pgmap v660: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2026-02-20T13:33:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:18 trial034 ceph-mon[43332]: pgmap v660: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2026-02-20T13:33:19.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:18 trial028 ceph-mon[37442]: pgmap v660: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2026-02-20T13:33:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:20 trial127 ceph-mon[43817]: pgmap v661: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:33:20.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:20 trial034 ceph-mon[43332]: pgmap v661: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:33:21.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:20 trial028 ceph-mon[37442]: pgmap v661: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2026-02-20T13:33:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:22 trial127 ceph-mon[43817]: pgmap v662: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:33:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:22 trial034 ceph-mon[43332]: pgmap v662: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:33:23.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:22 trial028 ceph-mon[37442]: pgmap v662: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2026-02-20T13:33:24.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:24 trial127 ceph-mon[43817]: pgmap v663: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2026-02-20T13:33:24.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:24 trial034 ceph-mon[43332]: pgmap v663: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2026-02-20T13:33:25.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:24 trial028 ceph-mon[37442]: pgmap v663: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2026-02-20T13:33:26.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:26 trial127 ceph-mon[43817]: pgmap v664: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2026-02-20T13:33:26.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:26 trial034 ceph-mon[43332]: pgmap v664: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2026-02-20T13:33:27.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:26 trial028 ceph-mon[37442]: pgmap v664: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2026-02-20T13:33:28.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:28 trial127 ceph-mon[43817]: pgmap v665: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-20T13:33:28.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:28 trial034 ceph-mon[43332]: pgmap v665: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-20T13:33:29.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:28 trial028 ceph-mon[37442]: pgmap v665: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-20T13:33:30.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:30 trial127 ceph-mon[43817]: pgmap v666: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-20T13:33:30.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:30 trial034 ceph-mon[43332]: pgmap v666: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-20T13:33:31.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:30 trial028 ceph-mon[37442]: pgmap v666: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-20T13:33:32.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:32 trial127 ceph-mon[43817]: pgmap v667: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 10 op/s 2026-02-20T13:33:32.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:32 trial034 ceph-mon[43332]: pgmap v667: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 10 op/s 2026-02-20T13:33:33.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:32 trial028 ceph-mon[37442]: pgmap v667: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 10 op/s 2026-02-20T13:33:34.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:34 trial127 ceph-mon[43817]: pgmap v668: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-20T13:33:34.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:34 trial034 ceph-mon[43332]: pgmap v668: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-20T13:33:35.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:34 trial028 ceph-mon[37442]: pgmap v668: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-20T13:33:36.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:36 trial127 ceph-mon[43817]: pgmap v669: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-20T13:33:36.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:36 trial034 ceph-mon[43332]: pgmap v669: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-20T13:33:37.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:36 trial028 ceph-mon[37442]: pgmap v669: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-20T13:33:38.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:38 trial127 ceph-mon[43817]: pgmap v670: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-20T13:33:38.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:38 trial034 ceph-mon[43332]: pgmap v670: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-20T13:33:39.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:38 trial028 ceph-mon[37442]: pgmap v670: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-20T13:33:40.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:40 trial127 ceph-mon[43817]: pgmap v671: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:33:40.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:40 trial034 ceph-mon[43332]: pgmap v671: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:33:41.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:40 trial028 ceph-mon[37442]: pgmap v671: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:33:42.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:42 trial127 ceph-mon[43817]: pgmap v672: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:33:42.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:42 trial034 ceph-mon[43332]: pgmap v672: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:33:43.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:42 trial028 ceph-mon[37442]: pgmap v672: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:33:44.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:44 trial127 ceph-mon[43817]: pgmap v673: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:33:44.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:44 trial034 ceph-mon[43332]: pgmap v673: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:33:45.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:44 trial028 ceph-mon[37442]: pgmap v673: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:33:46.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:46 trial127 ceph-mon[43817]: pgmap v674: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:33:46.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:46 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:33:46.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:46 trial034 ceph-mon[43332]: pgmap v674: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:33:46.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:46 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:33:47.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:46 trial028 ceph-mon[37442]: pgmap v674: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:33:47.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:46 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-20T13:33:47.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:47 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:33:47.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:47 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:33:47.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:47 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:33:47.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:47 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:33:47.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:47 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:33:47.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:47 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:33:47.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:47 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:33:47.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:47 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:33:48.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:47 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-20T13:33:48.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:47 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-20T13:33:48.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:47 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' 2026-02-20T13:33:48.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:47 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-20T13:33:48.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:48 trial127 ceph-mon[43817]: pgmap v675: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:33:48.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:48 trial034 ceph-mon[43332]: pgmap v675: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:33:49.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:48 trial028 ceph-mon[37442]: pgmap v675: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:33:50.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:50 trial127 ceph-mon[43817]: pgmap v676: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:33:50.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:50 trial034 ceph-mon[43332]: pgmap v676: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:33:51.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:50 trial028 ceph-mon[37442]: pgmap v676: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:33:52.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:52 trial127 ceph-mon[43817]: pgmap v677: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:33:52.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:52 trial034 ceph-mon[43332]: pgmap v677: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:33:53.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:52 trial028 ceph-mon[37442]: pgmap v677: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:33:54.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:54 trial127 ceph-mon[43817]: pgmap v678: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:33:54.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:54 trial034 ceph-mon[43332]: pgmap v678: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:33:55.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:54 trial028 ceph-mon[37442]: pgmap v678: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:33:56.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:56 trial127 ceph-mon[43817]: pgmap v679: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:33:56.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:56 trial034 ceph-mon[43332]: pgmap v679: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:33:57.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:56 trial028 ceph-mon[37442]: pgmap v679: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:33:58.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:33:58 trial127 ceph-mon[43817]: pgmap v680: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:33:58.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:33:58 trial034 ceph-mon[43332]: pgmap v680: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:33:59.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:33:58 trial028 ceph-mon[37442]: pgmap v680: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:34:00.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:00 trial127 ceph-mon[43817]: pgmap v681: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:34:00.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:00 trial034 ceph-mon[43332]: pgmap v681: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:34:01.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:00 trial028 ceph-mon[37442]: pgmap v681: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-20T13:34:02.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:02 trial127 ceph-mon[43817]: pgmap v682: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:34:02.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:02 trial034 ceph-mon[43332]: pgmap v682: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:34:03.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:02 trial028 ceph-mon[37442]: pgmap v682: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-20T13:34:04.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:04 trial127 ceph-mon[43817]: pgmap v683: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:34:04.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:04 trial034 ceph-mon[43332]: pgmap v683: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:34:05.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:04 trial028 ceph-mon[37442]: pgmap v683: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-20T13:34:06.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:06 trial127 ceph-mon[43817]: pgmap v684: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:34:06.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:06 trial034 ceph-mon[43332]: pgmap v684: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:34:07.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:06 trial028 ceph-mon[37442]: pgmap v684: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-20T13:34:08.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:08 trial127 ceph-mon[43817]: pgmap v685: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:34:08.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:08 trial034 ceph-mon[43332]: pgmap v685: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:34:09.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:08 trial028 ceph-mon[37442]: pgmap v685: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-20T13:34:10.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:10 trial127 ceph-mon[43817]: pgmap v686: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-20T13:34:10.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:10 trial034 ceph-mon[43332]: pgmap v686: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-20T13:34:11.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:10 trial028 ceph-mon[37442]: pgmap v686: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-20T13:34:12.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:12 trial127 ceph-mon[43817]: pgmap v687: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-20T13:34:12.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:12 trial034 ceph-mon[43332]: pgmap v687: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-20T13:34:13.099 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:12 trial028 ceph-mon[37442]: pgmap v687: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-20T13:34:14.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:14 trial127 ceph-mon[43817]: pgmap v688: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-20T13:34:14.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:14 trial034 ceph-mon[43332]: pgmap v688: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-20T13:34:15.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:14 trial028 ceph-mon[37442]: pgmap v688: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-20T13:34:16.687 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial028.front.sepia.ceph.com 2026-02-20T13:34:16.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:34:16.688 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2026-02-20T13:34:16.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:34:16.729 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-20T13:34:16.807 INFO:teuthology.orchestra.run.trial028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2026-02-20T13:34:16.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:34:16.808 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T13:34:16.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T13:34:16.906 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link delete ceph-brx 2026-02-20T13:34:16.936 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:16 trial028 ceph-mon[37442]: pgmap v689: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-20T13:34:16.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:16 trial127 ceph-mon[43817]: pgmap v689: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-20T13:34:16.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:16 trial034 ceph-mon[43332]: pgmap v689: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-20T13:34:17.007 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-20T13:34:17.020 INFO:tasks.cephadm:Teardown begin 2026-02-20T13:34:17.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2026-02-20T13:34:17.021 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:34:17.236 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:34:17.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 -- 10.20.193.28:0/3608016303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0558062ae0 msgr2=0x7f0558060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:17.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 --2- 10.20.193.28:0/3608016303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0558062ae0 0x7f0558060fb0 secure :-1 s=READY pgs=1616 gs=1 cs=0 l=1 c_cookie=1598858888510879049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f054c009950 tx=0x7f054c02f190 comp rx=0 tx=0).stop 2026-02-20T13:34:17.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 -- 10.20.193.28:0/3608016303 shutdown_connections 2026-02-20T13:34:17.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 --2- 10.20.193.28:0/3608016303 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0558159d40 0x7f055817a120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 --2- 10.20.193.28:0/3608016303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f05580614f0 0x7f0558061920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 --2- 10.20.193.28:0/3608016303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0558062ae0 0x7f0558060fb0 unknown :-1 s=CLOSED pgs=1616 gs=1 cs=0 l=1 c_cookie=1598858888510879049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 -- 10.20.193.28:0/3608016303 >> 10.20.193.28:0/3608016303 conn(0x7f05580eab00 msgr2=0x7f055810af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:17.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 -- 10.20.193.28:0/3608016303 shutdown_connections 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.423+0000 7f055d6aa640 1 -- 10.20.193.28:0/3608016303 wait complete. 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f055d6aa640 1 Processor -- start 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f055d6aa640 1 -- start start 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f055d6aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f05580614f0 0x7f05580f24a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f055d6aa640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0558062ae0 0x7f05580f29e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f055d6aa640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0558159d40 0x7f05580f7db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f055d6aa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f05580f83d0 con 0x7f05580614f0 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f055d6aa640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f05580f8540 con 0x7f0558062ae0 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f055d6aa640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f05580f8700 con 0x7f0558159d40 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f0556ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f05580614f0 0x7f05580f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f0556ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f05580614f0 0x7f05580f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56892/0 (socket says 10.20.193.28:56892) 2026-02-20T13:34:17.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f0556ffd640 1 -- 10.20.193.28:0/2342531739 learned_addr learned my addr 10.20.193.28:0/2342531739 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.424+0000 7f05567fc640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0558062ae0 0x7f05580f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f05577fe640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0558159d40 0x7f05580f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0556ffd640 1 -- 10.20.193.28:0/2342531739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0558159d40 msgr2=0x7f05580f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0556ffd640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0558159d40 0x7f05580f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0556ffd640 1 -- 10.20.193.28:0/2342531739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0558062ae0 msgr2=0x7f05580f29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0556ffd640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0558062ae0 0x7f05580f29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0556ffd640 1 -- 10.20.193.28:0/2342531739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c009570 con 0x7f05580614f0 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0556ffd640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f05580614f0 0x7f05580f24a0 secure :-1 s=READY pgs=1617 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f054c005b30 tx=0x7f054c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0537fff640 1 -- 10.20.193.28:0/2342531739 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f054c03d070 con 0x7f05580614f0 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0537fff640 1 -- 10.20.193.28:0/2342531739 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f054c038920 con 0x7f05580614f0 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f0537fff640 1 -- 10.20.193.28:0/2342531739 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f054c041870 con 0x7f05580614f0 2026-02-20T13:34:17.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05580f8980 con 0x7f05580614f0 2026-02-20T13:34:17.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.425+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05580f8f20 con 0x7f05580614f0 2026-02-20T13:34:17.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.426+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05580624c0 con 0x7f05580614f0 2026-02-20T13:34:17.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.428+0000 7f0537fff640 1 -- 10.20.193.28:0/2342531739 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f054c048020 con 0x7f05580614f0 2026-02-20T13:34:17.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.430+0000 7f0537fff640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f052c0b5760 0x7f052c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:17.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.430+0000 7f0537fff640 1 -- 10.20.193.28:0/2342531739 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f054c10b220 con 0x7f05580614f0 2026-02-20T13:34:17.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.430+0000 7f05567fc640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f052c0b5760 0x7f052c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:17.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.430+0000 7f0537fff640 1 -- 10.20.193.28:0/2342531739 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f054c10b6a0 con 0x7f05580614f0 2026-02-20T13:34:17.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.430+0000 7f05567fc640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f052c0b5760 0x7f052c0d5c10 secure :-1 s=READY pgs=667 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0540005970 tx=0x7f0540005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:17.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.571+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0558061920 con 0x7f05580614f0 2026-02-20T13:34:17.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.571+0000 7f0537fff640 1 -- 10.20.193.28:0/2342531739 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11997 (secure 0 0 0) 0x7f054c0cdbd0 con 0x7f05580614f0 2026-02-20T13:34:17.575 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:34:17.575 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":31,"btime":"2026-02-20T13:33:05:585962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:33:05.040895+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[0],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:34:17.576 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 31 2026-02-20T13:34:17.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f052c0b5760 msgr2=0x7f052c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:17.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f052c0b5760 0x7f052c0d5c10 secure :-1 s=READY pgs=667 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0540005970 tx=0x7f0540005900 comp rx=0 tx=0).stop 2026-02-20T13:34:17.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f05580614f0 msgr2=0x7f05580f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:17.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f05580614f0 0x7f05580f24a0 secure :-1 s=READY pgs=1617 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f054c005b30 tx=0x7f054c004340 comp rx=0 tx=0).stop 2026-02-20T13:34:17.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 shutdown_connections 2026-02-20T13:34:17.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f052c0b5760 0x7f052c0d5c10 unknown :-1 s=CLOSED pgs=667 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0558159d40 0x7f05580f7db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0558062ae0 0x7f05580f29e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 --2- 10.20.193.28:0/2342531739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f05580614f0 0x7f05580f24a0 unknown :-1 s=CLOSED pgs=1617 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:17.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 >> 10.20.193.28:0/2342531739 conn(0x7f05580eab00 msgr2=0x7f055810f230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:17.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 shutdown_connections 2026-02-20T13:34:17.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:17.572+0000 7f055d6aa640 1 -- 10.20.193.28:0/2342531739 wait complete. 2026-02-20T13:34:17.677 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T13:34:17.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:17 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2342531739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:34:17.864 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:34:17.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:17 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2342531739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:34:17.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:17 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2342531739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:34:18.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 -- 10.20.193.28:0/1886128453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc1135c0 msgr2=0x7ff2bc173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/1886128453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc1135c0 0x7ff2bc173f90 secure :-1 s=READY pgs=1618 gs=2 cs=0 l=1 c_cookie=13323201665878527868 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b800aa30 tx=0x7ff2b8030270 comp rx=0 tx=0).stop 2026-02-20T13:34:18.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 -- 10.20.193.28:0/1886128453 shutdown_connections 2026-02-20T13:34:18.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/1886128453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc1135c0 0x7ff2bc173f90 unknown :-1 s=CLOSED pgs=1618 gs=2 cs=0 l=1 c_cookie=13323201665878527868 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/1886128453 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2bc10ddc0 0x7ff2bc112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/1886128453 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2bc10d3d0 0x7ff2bc10d7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 -- 10.20.193.28:0/1886128453 >> 10.20.193.28:0/1886128453 conn(0x7ff2bc0eacc0 msgr2=0x7ff2bc10b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 -- 10.20.193.28:0/1886128453 shutdown_connections 2026-02-20T13:34:18.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.047+0000 7ff2c31dc640 1 -- 10.20.193.28:0/1886128453 wait complete. 2026-02-20T13:34:18.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c31dc640 1 Processor -- start 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c31dc640 1 -- start start 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c31dc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc10d3d0 0x7ff2bc11aac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c31dc640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2bc10ddc0 0x7ff2bc11b000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c31dc640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2bc1135c0 0x7ff2bc1203d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c31dc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1209f0 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c31dc640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc120b60 con 0x7ff2bc10ddc0 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c31dc640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc120d20 con 0x7ff2bc1135c0 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c0f51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc10d3d0 0x7ff2bc11aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c0f51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc10d3d0 0x7ff2bc11aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56908/0 (socket says 10.20.193.28:56908) 2026-02-20T13:34:18.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2b3fff640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2bc10ddc0 0x7ff2bc11b000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c0f51640 1 -- 10.20.193.28:0/2498529847 learned_addr learned my addr 10.20.193.28:0/2498529847 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.048+0000 7ff2c1752640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2bc1135c0 0x7ff2bc1203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c0f51640 1 -- 10.20.193.28:0/2498529847 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2bc1135c0 msgr2=0x7ff2bc1203d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c0f51640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2bc1135c0 0x7ff2bc1203d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c0f51640 1 -- 10.20.193.28:0/2498529847 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2bc10ddc0 msgr2=0x7ff2bc11b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c0f51640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2bc10ddc0 0x7ff2bc11b000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c0f51640 1 -- 10.20.193.28:0/2498529847 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b800a650 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2b3fff640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2bc10ddc0 0x7ff2bc11b000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c0f51640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc10d3d0 0x7ff2bc11aac0 secure :-1 s=READY pgs=1619 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2ac009480 tx=0x7ff2ac00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2b1ffb640 1 -- 10.20.193.28:0/2498529847 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2ac00ccc0 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2b1ffb640 1 -- 10.20.193.28:0/2498529847 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2ac00ce20 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2b1ffb640 1 -- 10.20.193.28:0/2498529847 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2ac0106b0 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc121000 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc161700 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.049+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc121220 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.052+0000 7ff2b1ffb640 1 -- 10.20.193.28:0/2498529847 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7ff2ac01f060 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.053+0000 7ff2b1ffb640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2980b5760 0x7ff2980d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.053+0000 7ff2b1ffb640 1 -- 10.20.193.28:0/2498529847 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7ff2ac014070 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.054+0000 7ff2b3fff640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2980b5760 0x7ff2980d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.054+0000 7ff2b1ffb640 1 -- 10.20.193.28:0/2498529847 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7ff2ac0a9640 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.054+0000 7ff2b3fff640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2980b5760 0x7ff2980d5c10 secure :-1 s=READY pgs=668 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2bc121460 tx=0x7ff2a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:18.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.195+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2bc11bc20 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.196+0000 7ff2b1ffb640 1 -- 10.20.193.28:0/2498529847 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11997 (secure 0 0 0) 0x7ff2ac0ac7f0 con 0x7ff2bc10d3d0 2026-02-20T13:34:18.198 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:34:18.198 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":31,"btime":"2026-02-20T13:33:05:585962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/12920569","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":12920569},{"type":"v1","addr":"10.20.193.28:6841","nonce":12920569}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/3591480373","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":3591480373},{"type":"v1","addr":"10.20.193.127:6833","nonce":3591480373}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T13:16:33.380729+0000","modified":"2026-02-20T13:33:05.040895+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24677,"mds_2":24659,"mds_3":24655,"mds_4":24622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24617":{"gid":24617,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6833/4255317184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6832","nonce":4255317184},{"type":"v1","addr":"10.20.193.34:6833","nonce":4255317184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"j","rank":4,"incarnation":21,"state":"up:active","state_seq":6,"addr":"10.20.193.28:6835/2839011553","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":2839011553},{"type":"v1","addr":"10.20.193.28:6835","nonce":2839011553}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"d","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6837/3921516269","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3921516269},{"type":"v1","addr":"10.20.193.28:6837","nonce":3921516269}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6835/519312474","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":519312474},{"type":"v1","addr":"10.20.193.127:6835","nonce":519312474}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.34:6835/1117780356","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6834","nonce":1117780356},{"type":"v1","addr":"10.20.193.34:6835","nonce":1117780356}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.127:6837/2801639412","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":2801639412},{"type":"v1","addr":"10.20.193.127:6837","nonce":2801639412}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.127:6839/3644236506","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":3644236506},{"type":"v1","addr":"10.20.193.127:6839","nonce":3644236506}]},"join_fscid":-1,"export_targets":[0],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":2,"incarnation":17,"state":"up:active","state_seq":5,"addr":"10.20.193.34:6837/3360165301","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6836","nonce":3360165301},{"type":"v1","addr":"10.20.193.34:6837","nonce":3360165301}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"g","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.28:6839/1527574900","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1527574900},{"type":"v1","addr":"10.20.193.28:6839","nonce":1527574900}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.34:6839/1838974969","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6838","nonce":1838974969},{"type":"v1","addr":"10.20.193.34:6839","nonce":1838974969}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24677,24659,24655,24622]},"id":1}]} 2026-02-20T13:34:18.198 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 31 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2980b5760 msgr2=0x7ff2980d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2980b5760 0x7ff2980d5c10 secure :-1 s=READY pgs=668 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2bc121460 tx=0x7ff2a4005f90 comp rx=0 tx=0).stop 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc10d3d0 msgr2=0x7ff2bc11aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc10d3d0 0x7ff2bc11aac0 secure :-1 s=READY pgs=1619 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2ac009480 tx=0x7ff2ac00ee60 comp rx=0 tx=0).stop 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 shutdown_connections 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7ff2980b5760 0x7ff2980d5c10 unknown :-1 s=CLOSED pgs=668 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff2bc1135c0 0x7ff2bc1203d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7ff2bc10ddc0 0x7ff2bc11b000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 --2- 10.20.193.28:0/2498529847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2bc10d3d0 0x7ff2bc11aac0 unknown :-1 s=CLOSED pgs=1619 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.197+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 >> 10.20.193.28:0/2498529847 conn(0x7ff2bc0eacc0 msgr2=0x7ff2bc10c170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:18.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.198+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 shutdown_connections 2026-02-20T13:34:18.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.198+0000 7ff2c31dc640 1 -- 10.20.193.28:0/2498529847 wait complete. 2026-02-20T13:34:18.299 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T13:34:18.484 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:34:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 -- 10.20.193.28:0/118647843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010b230 msgr2=0x7f0a2010b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/118647843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010b230 0x7f0a2010b600 secure :-1 s=READY pgs=1620 gs=1 cs=0 l=1 c_cookie=14309765667577662855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a10009950 tx=0x7f0a1002f190 comp rx=0 tx=0).stop 2026-02-20T13:34:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 -- 10.20.193.28:0/118647843 shutdown_connections 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/118647843 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a20155850 0x7f0a20175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/118647843 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a2010bb40 0x7f0a201551e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/118647843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010b230 0x7f0a2010b600 unknown :-1 s=CLOSED pgs=1620 gs=1 cs=0 l=1 c_cookie=14309765667577662855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 -- 10.20.193.28:0/118647843 >> 10.20.193.28:0/118647843 conn(0x7f0a200e8ce0 msgr2=0x7f0a201090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 -- 10.20.193.28:0/118647843 shutdown_connections 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 -- 10.20.193.28:0/118647843 wait complete. 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.663+0000 7f0a25e0e640 1 Processor -- start 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a25e0e640 1 -- start start 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a25e0e640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a2010b230 0x7f0a20160100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a25e0e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010bb40 0x7f0a20160640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a25e0e640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a20155850 0x7f0a20165a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a25e0e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20166030 con 0x7f0a2010bb40 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a25e0e640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201661a0 con 0x7f0a2010b230 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a25e0e640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20166360 con 0x7f0a20155850 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010bb40 0x7f0a20160640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a24e0c640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a2010b230 0x7f0a20160100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010bb40 0x7f0a20160640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56914/0 (socket says 10.20.193.28:56914) 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a17fff640 1 -- 10.20.193.28:0/175465513 learned_addr learned my addr 10.20.193.28:0/175465513 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a2560d640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a20155850 0x7f0a20165a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a17fff640 1 -- 10.20.193.28:0/175465513 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a20155850 msgr2=0x7f0a20165a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a17fff640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a20155850 0x7f0a20165a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a17fff640 1 -- 10.20.193.28:0/175465513 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a2010b230 msgr2=0x7f0a20160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a17fff640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a2010b230 0x7f0a20160100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.664+0000 7f0a17fff640 1 -- 10.20.193.28:0/175465513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a10009570 con 0x7f0a2010bb40 2026-02-20T13:34:18.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.665+0000 7f0a17fff640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010bb40 0x7f0a20160640 secure :-1 s=READY pgs=1621 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a08009480 tx=0x7f0a0800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:18.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.665+0000 7f0a15ffb640 1 -- 10.20.193.28:0/175465513 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a0800cd40 con 0x7f0a2010bb40 2026-02-20T13:34:18.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.665+0000 7f0a15ffb640 1 -- 10.20.193.28:0/175465513 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0a08004500 con 0x7f0a2010bb40 2026-02-20T13:34:18.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.665+0000 7f0a15ffb640 1 -- 10.20.193.28:0/175465513 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a08010690 con 0x7f0a2010bb40 2026-02-20T13:34:18.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.665+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a20166640 con 0x7f0a2010bb40 2026-02-20T13:34:18.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.665+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a20153360 con 0x7f0a2010bb40 2026-02-20T13:34:18.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.665+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a20166860 con 0x7f0a2010bb40 2026-02-20T13:34:18.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.668+0000 7f0a15ffb640 1 -- 10.20.193.28:0/175465513 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0a0801f060 con 0x7f0a2010bb40 2026-02-20T13:34:18.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.670+0000 7f0a15ffb640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09fc0b5760 0x7f09fc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:18.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.670+0000 7f0a15ffb640 1 -- 10.20.193.28:0/175465513 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7f0a08014070 con 0x7f0a2010bb40 2026-02-20T13:34:18.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.670+0000 7f0a24e0c640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09fc0b5760 0x7f09fc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:18.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.670+0000 7f0a15ffb640 1 -- 10.20.193.28:0/175465513 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f0a0811f730 con 0x7f0a2010bb40 2026-02-20T13:34:18.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.670+0000 7f0a24e0c640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09fc0b5760 0x7f09fc0d5c10 secure :-1 s=READY pgs=669 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a100098a0 tx=0x7f0a1003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:18.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.785+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a20161260 con 0x7f0a2010bb40 2026-02-20T13:34:18.788 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:18 trial028 ceph-mon[37442]: pgmap v690: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2026-02-20T13:34:18.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:18 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2498529847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:34:18.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.786+0000 7f0a15ffb640 1 -- 10.20.193.28:0/175465513 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22778 (secure 0 0 0) 0x7f0a080a97a0 con 0x7f0a2010bb40 2026-02-20T13:34:18.790 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T13:34:18.790 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":80,"fsid":"dd845518-0e5d-11f1-9909-d404e6e7d460","created":"2026-02-20T13:13:12.477975+0000","modified":"2026-02-20T13:17:38.460074+0000","last_up_change":"2026-02-20T13:16:13.827689+0000","last_in_change":"2026-02-20T13:16:04.607101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T13:14:47.526378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T13:16:31.670509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T13:16:32.355776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d65e9bc-8b4a-480c-b540-72a21130e6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6803","nonce":3440519886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6805","nonce":3440519886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6809","nonce":3440519886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3440519886},{"type":"v1","addr":"10.20.193.28:6807","nonce":3440519886}]},"public_addr":"10.20.193.28:6803/3440519886","cluster_addr":"10.20.193.28:6805/3440519886","heartbeat_back_addr":"10.20.193.28:6809/3440519886","heartbeat_front_addr":"10.20.193.28:6807/3440519886","state":["exists","up"]},{"osd":1,"uuid":"21efdc9a-53aa-4a76-b2a0-90918eaf0262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6801","nonce":1497190611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6803","nonce":1497190611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6807","nonce":1497190611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1497190611},{"type":"v1","addr":"10.20.193.34:6805","nonce":1497190611}]},"public_addr":"10.20.193.34:6801/1497190611","cluster_addr":"10.20.193.34:6803/1497190611","heartbeat_back_addr":"10.20.193.34:6807/1497190611","heartbeat_front_addr":"10.20.193.34:6805/1497190611","state":["exists","up"]},{"osd":2,"uuid":"04252b73-4bf2-46c0-b9fb-9b4187606781","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6801","nonce":3179400175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6803","nonce":3179400175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6807","nonce":3179400175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3179400175},{"type":"v1","addr":"10.20.193.127:6805","nonce":3179400175}]},"public_addr":"10.20.193.127:6801/3179400175","cluster_addr":"10.20.193.127:6803/3179400175","heartbeat_back_addr":"10.20.193.127:6807/3179400175","heartbeat_front_addr":"10.20.193.127:6805/3179400175","state":["exists","up"]},{"osd":3,"uuid":"75c4c4b5-3018-42f7-a5ac-645bf321af19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6811","nonce":3411989985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6813","nonce":3411989985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6817","nonce":3411989985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3411989985},{"type":"v1","addr":"10.20.193.28:6815","nonce":3411989985}]},"public_addr":"10.20.193.28:6811/3411989985","cluster_addr":"10.20.193.28:6813/3411989985","heartbeat_back_addr":"10.20.193.28:6817/3411989985","heartbeat_front_addr":"10.20.193.28:6815/3411989985","state":["exists","up"]},{"osd":4,"uuid":"ccc69aa4-4352-4e39-aec0-41289a3d0d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6809","nonce":3346390712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6811","nonce":3346390712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6815","nonce":3346390712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":3346390712},{"type":"v1","addr":"10.20.193.34:6813","nonce":3346390712}]},"public_addr":"10.20.193.34:6809/3346390712","cluster_addr":"10.20.193.34:6811/3346390712","heartbeat_back_addr":"10.20.193.34:6815/3346390712","heartbeat_front_addr":"10.20.193.34:6813/3346390712","state":["exists","up"]},{"osd":5,"uuid":"772d85ad-8132-408c-bded-4c43600e0648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6809","nonce":460724236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6811","nonce":460724236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6815","nonce":460724236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":460724236},{"type":"v1","addr":"10.20.193.127:6813","nonce":460724236}]},"public_addr":"10.20.193.127:6809/460724236","cluster_addr":"10.20.193.127:6811/460724236","heartbeat_back_addr":"10.20.193.127:6815/460724236","heartbeat_front_addr":"10.20.193.127:6813/460724236","state":["exists","up"]},{"osd":6,"uuid":"48076158-4886-4ca9-8eb0-d9f1adeb4b9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6819","nonce":3124866379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6821","nonce":3124866379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6825","nonce":3124866379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":3124866379},{"type":"v1","addr":"10.20.193.28:6823","nonce":3124866379}]},"public_addr":"10.20.193.28:6819/3124866379","cluster_addr":"10.20.193.28:6821/3124866379","heartbeat_back_addr":"10.20.193.28:6825/3124866379","heartbeat_front_addr":"10.20.193.28:6823/3124866379","state":["exists","up"]},{"osd":7,"uuid":"f995ac5e-8e5e-43ac-b394-5bae7a4bf16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6817","nonce":646042575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6818","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6819","nonce":646042575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6822","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6823","nonce":646042575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6820","nonce":646042575},{"type":"v1","addr":"10.20.193.34:6821","nonce":646042575}]},"public_addr":"10.20.193.34:6817/646042575","cluster_addr":"10.20.193.34:6819/646042575","heartbeat_back_addr":"10.20.193.34:6823/646042575","heartbeat_front_addr":"10.20.193.34:6821/646042575","state":["exists","up"]},{"osd":8,"uuid":"6d2e30d1-5c22-405d-9d9c-b3a986a18c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6817","nonce":2418786729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6819","nonce":2418786729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6823","nonce":2418786729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":2418786729},{"type":"v1","addr":"10.20.193.127:6821","nonce":2418786729}]},"public_addr":"10.20.193.127:6817/2418786729","cluster_addr":"10.20.193.127:6819/2418786729","heartbeat_back_addr":"10.20.193.127:6823/2418786729","heartbeat_front_addr":"10.20.193.127:6821/2418786729","state":["exists","up"]},{"osd":9,"uuid":"b57f8393-ae99-42fe-9e7a-74462092b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6827","nonce":1755797163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6829","nonce":1755797163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6833","nonce":1755797163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1755797163},{"type":"v1","addr":"10.20.193.28:6831","nonce":1755797163}]},"public_addr":"10.20.193.28:6827/1755797163","cluster_addr":"10.20.193.28:6829/1755797163","heartbeat_back_addr":"10.20.193.28:6833/1755797163","heartbeat_front_addr":"10.20.193.28:6831/1755797163","state":["exists","up"]},{"osd":10,"uuid":"3cc473cd-99f0-483e-b827-c925c4627fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6824","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6825","nonce":3326939746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6826","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6827","nonce":3326939746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6830","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6831","nonce":3326939746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6828","nonce":3326939746},{"type":"v1","addr":"10.20.193.34:6829","nonce":3326939746}]},"public_addr":"10.20.193.34:6825/3326939746","cluster_addr":"10.20.193.34:6827/3326939746","heartbeat_back_addr":"10.20.193.34:6831/3326939746","heartbeat_front_addr":"10.20.193.34:6829/3326939746","state":["exists","up"]},{"osd":11,"uuid":"872a1e80-e6c9-4bf0-be98-a2b4cdc0cbea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6825","nonce":2910856149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6827","nonce":2910856149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6831","nonce":2910856149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":2910856149},{"type":"v1","addr":"10.20.193.127:6829","nonce":2910856149}]},"public_addr":"10.20.193.127:6825/2910856149","cluster_addr":"10.20.193.127:6827/2910856149","heartbeat_back_addr":"10.20.193.127:6831/2910856149","heartbeat_front_addr":"10.20.193.127:6829/2910856149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:29.075032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:37.259075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:45.351486+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:14:58.988310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:07.095576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:15.226974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:28.582699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:36.512460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:44.558506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:15:57.903957+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:04.141931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T13:16:12.245258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/701608793":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/1283600451":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2163750178":"2026-02-21T13:13:37.304833+0000","10.20.193.28:6801/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/3613875849":"2026-02-21T13:13:37.304833+0000","10.20.193.28:0/2935390412":"2026-02-21T13:13:24.612016+0000","10.20.193.28:6800/2570534842":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/404382129":"2026-02-21T13:13:24.612016+0000","10.20.193.28:0/91657074":"2026-02-21T13:13:24.612016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:34:18.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09fc0b5760 msgr2=0x7f09fc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09fc0b5760 0x7f09fc0d5c10 secure :-1 s=READY pgs=669 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a100098a0 tx=0x7f0a1003a040 comp rx=0 tx=0).stop 2026-02-20T13:34:18.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010bb40 msgr2=0x7f0a20160640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:18.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010bb40 0x7f0a20160640 secure :-1 s=READY pgs=1621 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a08009480 tx=0x7f0a0800ee60 comp rx=0 tx=0).stop 2026-02-20T13:34:18.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 shutdown_connections 2026-02-20T13:34:18.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f09fc0b5760 0x7f09fc0d5c10 unknown :-1 s=CLOSED pgs=669 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a2010bb40 0x7f0a20160640 unknown :-1 s=CLOSED pgs=1621 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0a20155850 0x7f0a20165a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 --2- 10.20.193.28:0/175465513 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0a2010b230 0x7f0a20160100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:18.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 >> 10.20.193.28:0/175465513 conn(0x7f0a200e8ce0 msgr2=0x7f0a201090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:18.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 shutdown_connections 2026-02-20T13:34:18.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:18.788+0000 7f0a25e0e640 1 -- 10.20.193.28:0/175465513 wait complete. 2026-02-20T13:34:18.898 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs fail cephfs 2026-02-20T13:34:18.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:18 trial127 ceph-mon[43817]: pgmap v690: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2026-02-20T13:34:18.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:18 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2498529847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:34:18.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:18 trial034 ceph-mon[43332]: pgmap v690: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2026-02-20T13:34:18.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:18 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2498529847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-20T13:34:19.085 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd73d441640 1 -- 10.20.193.28:0/1637117519 <== mon.2 v2:10.20.193.34:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7280386f0 con 0x7fd73810f230 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 -- 10.20.193.28:0/1637117519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd73810f230 msgr2=0x7fd73810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 --2- 10.20.193.28:0/1637117519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd73810f230 0x7fd73810f600 secure :-1 s=READY pgs=566 gs=1 cs=0 l=1 c_cookie=6555010484399514650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd728009950 tx=0x7fd72802f190 comp rx=0 tx=0).stop 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 -- 10.20.193.28:0/1637117519 shutdown_connections 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 --2- 10.20.193.28:0/1637117519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd738115420 0x7fd738175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 --2- 10.20.193.28:0/1637117519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd73810fc20 0x7fd738114c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 --2- 10.20.193.28:0/1637117519 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd73810f230 0x7fd73810f600 unknown :-1 s=CLOSED pgs=566 gs=1 cs=0 l=1 c_cookie=6555010484399514650 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 -- 10.20.193.28:0/1637117519 >> 10.20.193.28:0/1637117519 conn(0x7fd73805f830 msgr2=0x7fd73810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 -- 10.20.193.28:0/1637117519 shutdown_connections 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.264+0000 7fd7406ce640 1 -- 10.20.193.28:0/1637117519 wait complete. 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.265+0000 7fd7406ce640 1 Processor -- start 2026-02-20T13:34:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.265+0000 7fd7406ce640 1 -- start start 2026-02-20T13:34:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd7406ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd73810f230 0x7fd7380f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd7406ce640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd73810fc20 0x7fd738175cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd7406ce640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd738115420 0x7fd7380f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd7406ce640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380fae90 con 0x7fd73810f230 2026-02-20T13:34:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd7406ce640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380fb000 con 0x7fd738115420 2026-02-20T13:34:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd7406ce640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380fb1c0 con 0x7fd73810fc20 2026-02-20T13:34:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73dc42640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd73810fc20 0x7fd738175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73e443640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd73810f230 0x7fd7380f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73dc42640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd73810fc20 0x7fd738175cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37702/0 (socket says 10.20.193.28:37702) 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73dc42640 1 -- 10.20.193.28:0/222199900 learned_addr learned my addr 10.20.193.28:0/222199900 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73ec44640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd738115420 0x7fd7380f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73e443640 1 -- 10.20.193.28:0/222199900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd73810fc20 msgr2=0x7fd738175cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73e443640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd73810fc20 0x7fd738175cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73e443640 1 -- 10.20.193.28:0/222199900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd738115420 msgr2=0x7fd7380f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73e443640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd738115420 0x7fd7380f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.266+0000 7fd73e443640 1 -- 10.20.193.28:0/222199900 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73400a590 con 0x7fd73810f230 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.267+0000 7fd73e443640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd73810f230 0x7fd7380f5580 secure :-1 s=READY pgs=1622 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd72802f6a0 tx=0x7fd728004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.267+0000 7fd71f7fe640 1 -- 10.20.193.28:0/222199900 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd72803d070 con 0x7fd73810f230 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.267+0000 7fd71f7fe640 1 -- 10.20.193.28:0/222199900 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd728002ad0 con 0x7fd73810f230 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.267+0000 7fd71f7fe640 1 -- 10.20.193.28:0/222199900 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd728041820 con 0x7fd73810f230 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.267+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd728009570 con 0x7fd73810f230 2026-02-20T13:34:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.267+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7380fb6a0 con 0x7fd73810f230 2026-02-20T13:34:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.268+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd738110510 con 0x7fd73810f230 2026-02-20T13:34:19.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.270+0000 7fd71f7fe640 1 -- 10.20.193.28:0/222199900 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fd72802f9f0 con 0x7fd73810f230 2026-02-20T13:34:19.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.272+0000 7fd71f7fe640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7140b5750 0x7fd7140d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:19.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.272+0000 7fd71f7fe640 1 -- 10.20.193.28:0/222199900 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8217+0+0 (secure 0 0 0) 0x7fd72810b150 con 0x7fd73810f230 2026-02-20T13:34:19.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.272+0000 7fd73dc42640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7140b5750 0x7fd7140d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:19.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.272+0000 7fd73dc42640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7140b5750 0x7fd7140d5c00 secure :-1 s=READY pgs=670 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7380fbf20 tx=0x7fd72c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:19.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.273+0000 7fd71f7fe640 1 -- 10.20.193.28:0/222199900 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fd7280cdbb0 con 0x7fd73810f230 2026-02-20T13:34:19.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.415+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd738179110 con 0x7fd73810f230 2026-02-20T13:34:19.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.418+0000 7fd71f7fe640 1 -- 10.20.193.28:0/222199900 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7fd7280f6020 con 0x7fd73810f230 2026-02-20T13:34:19.421 INFO:teuthology.orchestra.run.trial028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2026-02-20T13:34:19.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.420+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7140b5750 msgr2=0x7fd7140d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:19.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.420+0000 7fd7406ce640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7140b5750 0x7fd7140d5c00 secure :-1 s=READY pgs=670 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7380fbf20 tx=0x7fd72c005f90 comp rx=0 tx=0).stop 2026-02-20T13:34:19.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.420+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd73810f230 msgr2=0x7fd7380f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:19.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.420+0000 7fd7406ce640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd73810f230 0x7fd7380f5580 secure :-1 s=READY pgs=1622 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd72802f6a0 tx=0x7fd728004290 comp rx=0 tx=0).stop 2026-02-20T13:34:19.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.421+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 shutdown_connections 2026-02-20T13:34:19.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.421+0000 7fd7406ce640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fd7140b5750 0x7fd7140d5c00 unknown :-1 s=CLOSED pgs=670 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.421+0000 7fd7406ce640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fd738115420 0x7fd7380f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.421+0000 7fd7406ce640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd73810fc20 0x7fd738175cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.421+0000 7fd7406ce640 1 --2- 10.20.193.28:0/222199900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd73810f230 0x7fd7380f5580 unknown :-1 s=CLOSED pgs=1622 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.421+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 >> 10.20.193.28:0/222199900 conn(0x7fd73805f830 msgr2=0x7fd738111770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:19.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.421+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 shutdown_connections 2026-02-20T13:34:19.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.421+0000 7fd7406ce640 1 -- 10.20.193.28:0/222199900 wait complete. 2026-02-20T13:34:19.526 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph fs rm cephfs --yes-i-really-mean-it 2026-02-20T13:34:19.673 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a[37438]: 2026-02-20T13:34:19.416+0000 7fc3c3254640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g[100855]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g[100855]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mds[100859]: -- 10.20.193.28:0/1129634399 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x2c82ea0 con 0x2dc4400 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g[100855]: starting mds.g at 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d[100378]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mds[100382]: -- 10.20.193.28:0/3980293135 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x239eeea0 con 0x23a23c00 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d[100378]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d[100378]: starting mds.d at 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-j[100080]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-j[100080]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mds[100084]: -- 10.20.193.28:0/1527772837 <== mon.0 v2:10.20.193.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x186fcea0 con 0x18731c00 2026-02-20T13:34:19.674 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:34:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-j[100080]: starting mds.j at 2026-02-20T13:34:19.709 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:34:19.727 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/175465513' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:34:19.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/222199900' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-20T13:34:19.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mon[43817]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-20T13:34:19.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mon[43817]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T13:34:19.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/222199900' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-20T13:34:19.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mon[43817]: osdmap e81: 12 total, 12 up, 12 in 2026-02-20T13:34:19.728 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mon[43817]: fsmap cephfs:0/5 2 up:standby, 5 failed 2026-02-20T13:34:19.728 INFO:journalctl@ceph.mds.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-c[96963]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.729 INFO:journalctl@ceph.mds.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-c[96963]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.729 INFO:journalctl@ceph.mds.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mds[96968]: -- 10.20.193.127:0/3971682298 <== mon.1 v2:10.20.193.127:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x2cdaea0 con 0x2caf400 2026-02-20T13:34:19.729 INFO:journalctl@ceph.mds.c.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-c[96963]: starting mds.c at 2026-02-20T13:34:19.729 INFO:journalctl@ceph.mds.f.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-f[96630]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.729 INFO:journalctl@ceph.mds.f.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-f[96630]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.730 INFO:journalctl@ceph.mds.f.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mds[96634]: -- 10.20.193.127:0/4125450222 <== mon.1 v2:10.20.193.127:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x23c6ea0 con 0x239b800 2026-02-20T13:34:19.730 INFO:journalctl@ceph.mds.f.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-f[96630]: starting mds.f at 2026-02-20T13:34:19.730 INFO:journalctl@ceph.mds.i.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-i[97304]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.730 INFO:journalctl@ceph.mds.i.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-i[97304]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.730 INFO:journalctl@ceph.mds.i.trial127.stdout:Feb 20 13:34:19 trial127 ceph-mds[97308]: -- 10.20.193.127:0/2601586388 <== mon.1 v2:10.20.193.127:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x328cea0 con 0x3261800 2026-02-20T13:34:19.730 INFO:journalctl@ceph.mds.i.trial127.stdout:Feb 20 13:34:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-i[97304]: starting mds.i at 2026-02-20T13:34:19.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/175465513' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:34:19.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/222199900' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-20T13:34:19.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mon[43332]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-20T13:34:19.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mon[43332]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T13:34:19.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/222199900' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-20T13:34:19.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mon[43332]: osdmap e81: 12 total, 12 up, 12 in 2026-02-20T13:34:19.741 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mon[43332]: fsmap cephfs:0/5 2 up:standby, 5 failed 2026-02-20T13:34:19.742 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-k[91699]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.742 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-k[91699]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.742 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mds[91706]: -- 10.20.193.34:0/1159964596 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1c34ea0 con 0x1c09400 2026-02-20T13:34:19.742 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-k[91699]: starting mds.k at 2026-02-20T13:34:19.742 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.742 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.743 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mds[92714]: -- 10.20.193.34:0/705908228 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x3086ea0 con 0x305bc00 2026-02-20T13:34:19.743 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: starting mds.b at 2026-02-20T13:34:19.743 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e[92037]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.743 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e[92037]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.743 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mds[92041]: -- 10.20.193.34:0/1204954940 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x26e0ea0 con 0x26b5c00 2026-02-20T13:34:19.743 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e[92037]: starting mds.e at 2026-02-20T13:34:19.744 INFO:journalctl@ceph.mds.h.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-h[92374]: ignoring --setuser ceph since I am not root 2026-02-20T13:34:19.744 INFO:journalctl@ceph.mds.h.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-h[92374]: ignoring --setgroup ceph since I am not root 2026-02-20T13:34:19.744 INFO:journalctl@ceph.mds.h.trial034.stdout:Feb 20 13:34:19 trial034 ceph-mds[92381]: -- 10.20.193.34:0/856101984 <== mon.2 v2:10.20.193.34:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1916ea0 con 0x18eb800 2026-02-20T13:34:19.744 INFO:journalctl@ceph.mds.h.trial034.stdout:Feb 20 13:34:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-h[92374]: starting mds.h at 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 -- 10.20.193.28:0/457407871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc10fea0 msgr2=0x7fccfc114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 --2- 10.20.193.28:0/457407871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc10fea0 0x7fccfc114ef0 secure :-1 s=READY pgs=1625 gs=1 cs=0 l=1 c_cookie=2883431736398602486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccf0009890 tx=0x7fccf002f0e0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 -- 10.20.193.28:0/457407871 shutdown_connections 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 --2- 10.20.193.28:0/457407871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc10fea0 0x7fccfc114ef0 unknown :-1 s=CLOSED pgs=1625 gs=1 cs=0 l=1 c_cookie=2883431736398602486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 --2- 10.20.193.28:0/457407871 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccfc1156a0 0x7fccfc176070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 --2- 10.20.193.28:0/457407871 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccfc10f4b0 0x7fccfc10f880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 -- 10.20.193.28:0/457407871 >> 10.20.193.28:0/457407871 conn(0x7fccfc0ecda0 msgr2=0x7fccfc10d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 -- 10.20.193.28:0/457407871 shutdown_connections 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.884+0000 7fcd0328b640 1 -- 10.20.193.28:0/457407871 wait complete. 2026-02-20T13:34:19.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd0328b640 1 Processor -- start 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd0328b640 1 -- start start 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd0328b640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccfc10f4b0 0x7fccfc0f5880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd0328b640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccfc10fea0 0x7fccfc175f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd0328b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc1156a0 0x7fccfc0f5f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd0328b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc0fb190 con 0x7fccfc1156a0 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd0328b640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc0fb300 con 0x7fccfc10f4b0 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd0328b640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc0fb4c0 con 0x7fccfc10fea0 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd02a8a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc1156a0 0x7fccfc0f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.885+0000 7fcd01a88640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccfc10fea0 0x7fccfc175f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd01a88640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccfc10fea0 0x7fccfc175f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.28:37762/0 (socket says 10.20.193.28:37762) 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd02a8a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc1156a0 0x7fccfc0f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57000/0 (socket says 10.20.193.28:57000) 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd01a88640 1 -- 10.20.193.28:0/4120226579 learned_addr learned my addr 10.20.193.28:0/4120226579 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:34:19.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd02289640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccfc10f4b0 0x7fccfc0f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd01a88640 1 -- 10.20.193.28:0/4120226579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccfc10f4b0 msgr2=0x7fccfc0f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd01a88640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccfc10f4b0 0x7fccfc0f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd01a88640 1 -- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc1156a0 msgr2=0x7fccfc0f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd01a88640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc1156a0 0x7fccfc0f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd01a88640 1 -- 10.20.193.28:0/4120226579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf00094b0 con 0x7fccfc10fea0 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd01a88640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccfc10fea0 0x7fccfc175f70 secure :-1 s=READY pgs=462 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccf00023b0 tx=0x7fccf00028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcce37fe640 1 -- 10.20.193.28:0/4120226579 <== mon.1 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fccf003d070 con 0x7fccfc10fea0 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcce37fe640 1 -- 10.20.193.28:0/4120226579 <== mon.1 v2:10.20.193.127:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fccf00044f0 con 0x7fccfc10fea0 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.886+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccfc0fb740 con 0x7fccfc10fea0 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.887+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccfc0fbbb0 con 0x7fccfc10fea0 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.887+0000 7fcce37fe640 1 -- 10.20.193.28:0/4120226579 <== mon.1 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fccf00419a0 con 0x7fccfc10fea0 2026-02-20T13:34:19.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.887+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccfc110790 con 0x7fccfc10fea0 2026-02-20T13:34:19.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.889+0000 7fcce37fe640 1 -- 10.20.193.28:0/4120226579 <== mon.1 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fccf0038c20 con 0x7fccfc10fea0 2026-02-20T13:34:19.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.891+0000 7fcce37fe640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fccd40b56d0 0x7fccd40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:19.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.891+0000 7fcce37fe640 1 -- 10.20.193.28:0/4120226579 <== mon.1 v2:10.20.193.127:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8647+0+0 (secure 0 0 0) 0x7fccf010ba00 con 0x7fccfc10fea0 2026-02-20T13:34:19.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.891+0000 7fcd02289640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fccd40b56d0 0x7fccd40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:19.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.891+0000 7fcce37fe640 1 -- 10.20.193.28:0/4120226579 <== mon.1 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fccf00ce2b0 con 0x7fccfc10fea0 2026-02-20T13:34:19.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:19.892+0000 7fcd02289640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fccd40b56d0 0x7fccd40d5b80 secure :-1 s=READY pgs=671 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccec004740 tx=0x7fccec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:20.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.031+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fccfc10f880 con 0x7fccfc10fea0 2026-02-20T13:34:20.034 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/175465513' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-20T13:34:20.034 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/222199900' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-20T13:34:20.034 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mon[37442]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-20T13:34:20.034 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mon[37442]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T13:34:20.034 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/222199900' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-20T13:34:20.034 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mon[37442]: osdmap e81: 12 total, 12 up, 12 in 2026-02-20T13:34:20.035 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:19 trial028 ceph-mon[37442]: fsmap cephfs:0/5 2 up:standby, 5 failed 2026-02-20T13:34:20.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.425+0000 7fcce37fe640 1 -- 10.20.193.28:0/4120226579 <== mon.1 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 If there are active snapshot schedules associated with this file-system, you might see EIO errors in the mgr logs or at the snap-schedule command-line due to the missing file-system. However, these errors are transient and will get auto-resolved. v33) ==== 350+0+0 (secure 0 0 0) 0x7fccf0005d40 con 0x7fccfc10fea0 2026-02-20T13:34:20.427 INFO:teuthology.orchestra.run.trial028.stderr:If there are active snapshot schedules associated with this file-system, you might see EIO errors in the mgr logs or at the snap-schedule command-line due to the missing file-system. However, these errors are transient and will get auto-resolved. 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.427+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fccd40b56d0 msgr2=0x7fccd40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.427+0000 7fcd0328b640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fccd40b56d0 0x7fccd40d5b80 secure :-1 s=READY pgs=671 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccec004740 tx=0x7fccec005f90 comp rx=0 tx=0).stop 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.427+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccfc10fea0 msgr2=0x7fccfc175f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.427+0000 7fcd0328b640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccfc10fea0 0x7fccfc175f70 secure :-1 s=READY pgs=462 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccf00023b0 tx=0x7fccf00028d0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.428+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 shutdown_connections 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.428+0000 7fcd0328b640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fccd40b56d0 0x7fccd40d5b80 unknown :-1 s=CLOSED pgs=671 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.428+0000 7fcd0328b640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fccfc1156a0 0x7fccfc0f5f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.428+0000 7fcd0328b640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fccfc10fea0 0x7fccfc175f70 unknown :-1 s=CLOSED pgs=462 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.428+0000 7fcd0328b640 1 --2- 10.20.193.28:0/4120226579 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fccfc10f4b0 0x7fccfc0f5880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.428+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 >> 10.20.193.28:0/4120226579 conn(0x7fccfc0ecda0 msgr2=0x7fccfc111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.429+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 shutdown_connections 2026-02-20T13:34:20.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.429+0000 7fcd0328b640 1 -- 10.20.193.28:0/4120226579 wait complete. 2026-02-20T13:34:20.533 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2026-02-20T13:34:20.718 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: pgmap v692: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 10 op/s 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/4120226579' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: Cluster is now healthy 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6832/2129540157,v1:10.20.193.34:6836/2129540157] up:boot 2026-02-20T13:34:20.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6834/4250236469,v1:10.20.193.34:6837/4250236469] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6833/3498804899,v1:10.20.193.34:6839/3498804899] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.34:6835/1554746257,v1:10.20.193.34:6838/1554746257] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.127:6835/3556526618,v1:10.20.193.127:6838/3556526618] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.127:6836/4042042708,v1:10.20.193.127:6839/4042042708] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.127:6834/220160332,v1:10.20.193.127:6837/220160332] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6834/3034644856,v1:10.20.193.28:6835/3034644856] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6836/447907218,v1:10.20.193.28:6837/447907218] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: mds.? [v2:10.20.193.28:6838/1090442968,v1:10.20.193.28:6839/1090442968] up:boot 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: fsmap 12 up:standby 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-20T13:34:20.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-20T13:34:20.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-20T13:34:20.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-20T13:34:20.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-20T13:34:20.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:20 trial028 ceph-mon[37442]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-20T13:34:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 -- 10.20.193.28:0/492466515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 msgr2=0x7fa7900631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 --2- 10.20.193.28:0/492466515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 0x7fa7900631c0 secure :-1 s=READY pgs=1626 gs=1 cs=0 l=1 c_cookie=2747301661199592180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa77c009950 tx=0x7fa77c02f190 comp rx=0 tx=0).stop 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 -- 10.20.193.28:0/492466515 shutdown_connections 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 --2- 10.20.193.28:0/492466515 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa790159cc0 0x7fa79017a150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 --2- 10.20.193.28:0/492466515 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa7900637e0 0x7fa790063bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 --2- 10.20.193.28:0/492466515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 0x7fa7900631c0 unknown :-1 s=CLOSED pgs=1626 gs=1 cs=0 l=1 c_cookie=2747301661199592180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 -- 10.20.193.28:0/492466515 >> 10.20.193.28:0/492466515 conn(0x7fa7900ecda0 msgr2=0x7fa79010d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 -- 10.20.193.28:0/492466515 shutdown_connections 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.891+0000 7fa794a91640 1 -- 10.20.193.28:0/492466515 wait complete. 2026-02-20T13:34:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.892+0000 7fa794a91640 1 Processor -- start 2026-02-20T13:34:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.892+0000 7fa794a91640 1 -- start start 2026-02-20T13:34:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.892+0000 7fa794a91640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7900637e0 0x7fa790163f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.892+0000 7fa794a91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 0x7fa7901644d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.892+0000 7fa794a91640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa790159cc0 0x7fa7901698a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.892+0000 7fa794a91640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa790169ec0 con 0x7fa7900671a0 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.892+0000 7fa794a91640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7fa79016a030 con 0x7fa790159cc0 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.892+0000 7fa794a91640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa79016a1f0 con 0x7fa7900637e0 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 0x7fa7901644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 0x7fa7901644d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37890/0 (socket says 10.20.193.28:37890) 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 -- 10.20.193.28:0/2632019357 learned_addr learned my addr 10.20.193.28:0/2632019357 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 -- 10.20.193.28:0/2632019357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7900637e0 msgr2=0x7fa790163f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78f7fe640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7900637e0 0x7fa790163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7900637e0 0x7fa790163f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 -- 10.20.193.28:0/2632019357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa790159cc0 msgr2=0x7fa7901698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa790159cc0 0x7fa7901698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 -- 10.20.193.28:0/2632019357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77c009570 con 0x7fa7900671a0 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78f7fe640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7900637e0 0x7fa790163f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78effd640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 0x7fa7901644d0 secure :-1 s=READY pgs=1627 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa780005db0 tx=0x7fa78000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78cff9640 1 -- 10.20.193.28:0/2632019357 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa780004540 con 0x7fa7900671a0 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78cff9640 1 -- 10.20.193.28:0/2632019357 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa780009d00 con 0x7fa7900671a0 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa78cff9640 1 -- 10.20.193.28:0/2632019357 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7800106e0 con 0x7fa7900671a0 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.893+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79016a4d0 con 0x7fa7900671a0 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.894+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa790157d10 con 0x7fa7900671a0 2026-02-20T13:34:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.894+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79016a6f0 con 0x7fa7900671a0 2026-02-20T13:34:20.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.896+0000 7fa78cff9640 1 -- 10.20.193.28:0/2632019357 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7fa7800027c0 con 0x7fa7900671a0 2026-02-20T13:34:20.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.898+0000 7fa78cff9640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7640b57e0 0x7fa7640d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:20.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.898+0000 7fa78cff9640 1 -- 10.20.193.28:0/2632019357 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8647+0+0 (secure 0 0 0) 0x7fa7800e7470 con 0x7fa7900671a0 2026-02-20T13:34:20.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.898+0000 7fa78cff9640 1 -- 10.20.193.28:0/2632019357 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7fa7800e7870 con 0x7fa7900671a0 2026-02-20T13:34:20.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.898+0000 7fa78f7fe640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7640b57e0 0x7fa7640d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:20.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:20.899+0000 7fa78f7fe640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7640b57e0 0x7fa7640d5c90 secure :-1 s=READY pgs=682 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa77c0098a0 tx=0x7fa77c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:20.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: pgmap v692: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 10 op/s 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/4120226579' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: Cluster is now healthy 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6832/2129540157,v1:10.20.193.34:6836/2129540157] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6834/4250236469,v1:10.20.193.34:6837/4250236469] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6833/3498804899,v1:10.20.193.34:6839/3498804899] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.34:6835/1554746257,v1:10.20.193.34:6838/1554746257] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.127:6835/3556526618,v1:10.20.193.127:6838/3556526618] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.127:6836/4042042708,v1:10.20.193.127:6839/4042042708] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.127:6834/220160332,v1:10.20.193.127:6837/220160332] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6834/3034644856,v1:10.20.193.28:6835/3034644856] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6836/447907218,v1:10.20.193.28:6837/447907218] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: mds.? [v2:10.20.193.28:6838/1090442968,v1:10.20.193.28:6839/1090442968] up:boot 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: fsmap 12 up:standby 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-20T13:34:20.978 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-20T13:34:20.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-20T13:34:20.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-20T13:34:20.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-20T13:34:20.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-20T13:34:20.979 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:20 trial127 ceph-mon[43817]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: pgmap v692: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 10 op/s 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/4120226579' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: Cluster is now healthy 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6832/2129540157,v1:10.20.193.34:6836/2129540157] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6834/4250236469,v1:10.20.193.34:6837/4250236469] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6833/3498804899,v1:10.20.193.34:6839/3498804899] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.34:6835/1554746257,v1:10.20.193.34:6838/1554746257] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.127:6835/3556526618,v1:10.20.193.127:6838/3556526618] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.127:6836/4042042708,v1:10.20.193.127:6839/4042042708] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.127:6834/220160332,v1:10.20.193.127:6837/220160332] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6834/3034644856,v1:10.20.193.28:6835/3034644856] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6836/447907218,v1:10.20.193.28:6837/447907218] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: mds.? [v2:10.20.193.28:6838/1090442968,v1:10.20.193.28:6839/1090442968] up:boot 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: fsmap 12 up:standby 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-20T13:34:20.991 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:20 trial034 ceph-mon[43332]: from='mgr.14152 10.20.193.28:0/3607039306' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-20T13:34:21.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.012+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa7901650f0 con 0x7fa7900671a0 2026-02-20T13:34:21.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.677+0000 7fa78cff9640 1 -- 10.20.193.28:0/2632019357 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) ==== 181+0+0 (secure 0 0 0) 0x7fa7800a9c70 con 0x7fa7900671a0 2026-02-20T13:34:21.680 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_metadata' removed 2026-02-20T13:34:21.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.679+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7640b57e0 msgr2=0x7fa7640d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:21.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.679+0000 7fa794a91640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7640b57e0 0x7fa7640d5c90 secure :-1 s=READY pgs=682 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa77c0098a0 tx=0x7fa77c031040 comp rx=0 tx=0).stop 2026-02-20T13:34:21.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.679+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 msgr2=0x7fa7901644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.679+0000 7fa794a91640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 0x7fa7901644d0 secure :-1 s=READY pgs=1627 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa780005db0 tx=0x7fa78000ddf0 comp rx=0 tx=0).stop 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.680+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 shutdown_connections 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.680+0000 7fa794a91640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7fa7640b57e0 0x7fa7640d5c90 unknown :-1 s=CLOSED pgs=682 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.680+0000 7fa794a91640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7900671a0 0x7fa7901644d0 unknown :-1 s=CLOSED pgs=1627 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.680+0000 7fa794a91640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7fa790159cc0 0x7fa7901698a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.680+0000 7fa794a91640 1 --2- 10.20.193.28:0/2632019357 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7900637e0 0x7fa790163f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.680+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 >> 10.20.193.28:0/2632019357 conn(0x7fa7900ecda0 msgr2=0x7fa79010d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.680+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 shutdown_connections 2026-02-20T13:34:21.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:21.680+0000 7fa794a91640 1 -- 10.20.193.28:0/2632019357 wait complete. 2026-02-20T13:34:21.786 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2026-02-20T13:34:21.971 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:34:21.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:21 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2632019357' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-20T13:34:21.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:21 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2632019357' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-20T13:34:22.017 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:21 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2632019357' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-20T13:34:22.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 -- 10.20.193.28:0/2979692133 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae8062ae0 msgr2=0x7f0ae8060fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 --2- 10.20.193.28:0/2979692133 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae8062ae0 0x7f0ae8060fb0 secure :-1 s=READY pgs=1628 gs=2 cs=0 l=1 c_cookie=12260918724509914379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ad8009950 tx=0x7f0ad802f190 comp rx=0 tx=0).stop 2026-02-20T13:34:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 -- 10.20.193.28:0/2979692133 shutdown_connections 2026-02-20T13:34:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 --2- 10.20.193.28:0/2979692133 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ae8159af0 0x7f0ae8179ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 --2- 10.20.193.28:0/2979692133 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ae80614f0 0x7f0ae8061920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 --2- 10.20.193.28:0/2979692133 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae8062ae0 0x7f0ae8060fb0 unknown :-1 s=CLOSED pgs=1628 gs=2 cs=0 l=1 c_cookie=12260918724509914379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 -- 10.20.193.28:0/2979692133 >> 10.20.193.28:0/2979692133 conn(0x7f0ae805f830 msgr2=0x7f0ae810ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 -- 10.20.193.28:0/2979692133 shutdown_connections 2026-02-20T13:34:22.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.147+0000 7f0aefffe640 1 -- 10.20.193.28:0/2979692133 wait complete. 2026-02-20T13:34:22.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.148+0000 7f0aefffe640 1 Processor -- start 2026-02-20T13:34:22.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.148+0000 7f0aefffe640 1 -- start start 2026-02-20T13:34:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.148+0000 7f0aefffe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae80614f0 0x7f0ae80f2c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.148+0000 7f0aefffe640 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ae8062ae0 0x7f0ae80f3160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:22.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.148+0000 7f0aefffe640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ae8159af0 0x7f0ae80f8530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.148+0000 7f0aefffe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80f8b50 con 0x7f0ae80614f0 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.148+0000 7f0aefffe640 1 -- --> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80f8cc0 con 0x7f0ae8159af0 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.148+0000 7f0aefffe640 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80f8e80 con 0x7f0ae8062ae0 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae80614f0 0x7f0ae80f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aee574640 1 --2- >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ae8159af0 0x7f0ae80f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae80614f0 0x7f0ae80f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37922/0 (socket says 10.20.193.28:37922) 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 -- 10.20.193.28:0/1329284409 learned_addr learned my addr 10.20.193.28:0/1329284409 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aed572640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ae8062ae0 0x7f0ae80f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 -- 10.20.193.28:0/1329284409 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ae8062ae0 msgr2=0x7f0ae80f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ae8062ae0 0x7f0ae80f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 -- 10.20.193.28:0/1329284409 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ae8159af0 msgr2=0x7f0ae80f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ae8159af0 0x7f0ae80f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 -- 10.20.193.28:0/1329284409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad8009570 con 0x7f0ae80614f0 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aedd73640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae80614f0 0x7f0ae80f2c20 secure :-1 s=READY pgs=1629 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ad8038820 tx=0x7f0ad8004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0ad6ffd640 1 -- 10.20.193.28:0/1329284409 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ad803d070 con 0x7f0ae80614f0 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0ad6ffd640 1 -- 10.20.193.28:0/1329284409 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ad8002ad0 con 0x7f0ae80614f0 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0ad6ffd640 1 -- 10.20.193.28:0/1329284409 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ad8041930 con 0x7f0ae80614f0 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae80f9100 con 0x7f0ae80614f0 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.149+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae80f96a0 con 0x7f0ae80614f0 2026-02-20T13:34:22.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.150+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae80624c0 con 0x7f0ae80614f0 2026-02-20T13:34:22.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.152+0000 7f0ad6ffd640 1 -- 10.20.193.28:0/1329284409 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 157122+0+0 (secure 0 0 0) 0x7f0ad802f9f0 con 0x7f0ae80614f0 2026-02-20T13:34:22.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.153+0000 7f0ad6ffd640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ac40b5760 0x7f0ac40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T13:34:22.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.154+0000 7f0ad6ffd640 1 -- 10.20.193.28:0/1329284409 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8119+0+0 (secure 0 0 0) 0x7f0ad810afc0 con 0x7f0ae80614f0 2026-02-20T13:34:22.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.154+0000 7f0aed572640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ac40b5760 0x7f0ac40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T13:34:22.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.154+0000 7f0aed572640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ac40b5760 0x7f0ac40d5c10 secure :-1 s=READY pgs=683 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ae80f95c0 tx=0x7f0adc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T13:34:22.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.155+0000 7f0ad6ffd640 1 -- 10.20.193.28:0/1329284409 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231025 (secure 0 0 0) 0x7f0ad80cda90 con 0x7f0ae80614f0 2026-02-20T13:34:22.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.269+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0ae817d650 con 0x7f0ae80614f0 2026-02-20T13:34:22.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.684+0000 7f0ad6ffd640 1 -- 10.20.193.28:0/1329284409 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) ==== 169+0+0 (secure 0 0 0) 0x7f0ad80d0c40 con 0x7f0ae80614f0 2026-02-20T13:34:22.686 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data' removed 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ac40b5760 msgr2=0x7f0ac40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ac40b5760 0x7f0ac40d5c10 secure :-1 s=READY pgs=683 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ae80f95c0 tx=0x7f0adc005f90 comp rx=0 tx=0).stop 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae80614f0 msgr2=0x7f0ae80f2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae80614f0 0x7f0ae80f2c20 secure :-1 s=READY pgs=1629 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ad8038820 tx=0x7f0ad8004300 comp rx=0 tx=0).stop 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 shutdown_connections 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:6800/1124954776,v1:10.20.193.28:6801/1124954776] conn(0x7f0ac40b5760 0x7f0ac40d5c10 unknown :-1 s=CLOSED pgs=683 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] conn(0x7f0ae8159af0 0x7f0ae80f8530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ae8062ae0 0x7f0ae80f3160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 --2- 10.20.193.28:0/1329284409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ae80614f0 0x7f0ae80f2c20 unknown :-1 s=CLOSED pgs=1629 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 >> 10.20.193.28:0/1329284409 conn(0x7f0ae805f830 msgr2=0x7f0ae810f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 shutdown_connections 2026-02-20T13:34:22.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T13:34:22.686+0000 7f0aefffe640 1 -- 10.20.193.28:0/1329284409 wait complete. 2026-02-20T13:34:22.793 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:34:22.852 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:34:22.883 DEBUG:teuthology.orchestra.run.trial127:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:34:22.913 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-20T13:34:22.914 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-20T13:34:22.963 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:22 trial028 ceph-mon[37442]: pgmap v693: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 716 B/s wr, 10 op/s 2026-02-20T13:34:22.963 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:22 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/2632019357' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T13:34:22.963 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:22 trial028 ceph-mon[37442]: osdmap e82: 12 total, 12 up, 12 in 2026-02-20T13:34:22.963 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:22 trial028 ceph-mon[37442]: from='client.? 10.20.193.28:0/1329284409' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-20T13:34:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:22 trial127 ceph-mon[43817]: pgmap v693: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 716 B/s wr, 10 op/s 2026-02-20T13:34:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:22 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/2632019357' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T13:34:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:22 trial127 ceph-mon[43817]: osdmap e82: 12 total, 12 up, 12 in 2026-02-20T13:34:22.977 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:22 trial127 ceph-mon[43817]: from='client.? 10.20.193.28:0/1329284409' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-20T13:34:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:22 trial034 ceph-mon[43332]: pgmap v693: 97 pgs: 97 active+clean; 3.0 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 716 B/s wr, 10 op/s 2026-02-20T13:34:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:22 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/2632019357' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T13:34:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:22 trial034 ceph-mon[43332]: osdmap e82: 12 total, 12 up, 12 in 2026-02-20T13:34:22.990 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:22 trial034 ceph-mon[43332]: from='client.? 10.20.193.28:0/1329284409' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-20T13:34:23.097 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/mon.a/config 2026-02-20T13:34:23.134 INFO:teuthology.orchestra.run.trial028.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-20T13:34:23.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-20T13:34:23.157 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-20T13:34:23.157 DEBUG:teuthology.orchestra.run.trial028:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-20T13:34:23.196 DEBUG:teuthology.orchestra.run.trial034:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-20T13:34:23.215 DEBUG:teuthology.orchestra.run.trial127:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-20T13:34:23.232 INFO:tasks.cephadm:Stopping all daemons... 2026-02-20T13:34:23.232 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-20T13:34:23.232 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.a 2026-02-20T13:34:23.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:23 trial028 systemd[1]: Stopping Ceph mon.a for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:23.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:23 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a[37438]: 2026-02-20T13:34:23.426+0000 7fc3c8a5f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:34:23.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 13:34:23 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-a[37438]: 2026-02-20T13:34:23.426+0000 7fc3c8a5f640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-20T13:34:23.846 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.a.service' 2026-02-20T13:34:23.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:23.920 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-20T13:34:23.920 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-20T13:34:23.920 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.b 2026-02-20T13:34:24.199 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:23 trial034 systemd[1]: Stopping Ceph mon.b for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:24.199 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-b[43328]: 2026-02-20T13:34:24.015+0000 7feb9f8c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:34:24.199 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-b[43328]: 2026-02-20T13:34:24.015+0000 7feb9f8c0640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-20T13:34:24.199 INFO:journalctl@ceph.mon.b.trial034.stdout:Feb 20 13:34:24 trial034 podman[96904]: 2026-02-20 13:34:24.198442576 +0000 UTC m=+0.195244445 container died efdac399e00ca9d5c7469a939387abf47f0a498601b2bbf26f9aa5d6e7627e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-b, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default) 2026-02-20T13:34:24.292 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.b.service' 2026-02-20T13:34:24.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:24.331 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-20T13:34:24.331 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-20T13:34:24.331 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.c 2026-02-20T13:34:24.697 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:24 trial127 systemd[1]: Stopping Ceph mon.c for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:24.697 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:24 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-c[43813]: 2026-02-20T13:34:24.431+0000 7f24c64d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:34:24.697 INFO:journalctl@ceph.mon.c.trial127.stdout:Feb 20 13:34:24 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mon-c[43813]: 2026-02-20T13:34:24.431+0000 7f24c64d6640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-20T13:34:24.782 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mon.c.service' 2026-02-20T13:34:24.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:24.819 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-20T13:34:24.819 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-20T13:34:24.819 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.x 2026-02-20T13:34:25.149 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:34:24 trial028 systemd[1]: Stopping Ceph mgr.x for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:25.150 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:34:25 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: 2026-02-20T13:34:25.008+0000 7f28c2e19640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:34:25.150 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:34:25 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x[37680]: 2026-02-20T13:34:25.008+0000 7f28c2e19640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-20T13:34:25.150 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 13:34:25 trial028 podman[152995]: 2026-02-20 13:34:25.100748202 +0000 UTC m=+0.116257375 container died 99dbc4c627044bfb78112880a56b37d6e72953657ce30705709976310f6c0790 (image=quay.ceph.io/ceph-ci/ceph:0917c15888a16c5bbbd9de28990cc81230360c9e, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, org.label-schema.build-date=20260216, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e) 2026-02-20T13:34:25.304 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.x.service' 2026-02-20T13:34:25.375 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:25.375 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-20T13:34:25.375 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-20T13:34:25.375 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.y 2026-02-20T13:34:25.598 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.y.service' 2026-02-20T13:34:25.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:25.632 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-20T13:34:25.632 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-20T13:34:25.632 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.z 2026-02-20T13:34:25.853 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mgr.z.service' 2026-02-20T13:34:25.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:25.887 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-20T13:34:25.887 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-20T13:34:25.887 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.0 2026-02-20T13:34:26.350 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:25 trial028 systemd[1]: Stopping Ceph osd.0 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:26.350 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:26 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0[52709]: 2026-02-20T13:34:26.069+0000 7f53ca80f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:34:26.350 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:26 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0[52709]: 2026-02-20T13:34:26.069+0000 7f53ca80f640 -1 osd.0 83 *** Got signal Terminated *** 2026-02-20T13:34:26.350 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:26 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0[52709]: 2026-02-20T13:34:26.069+0000 7f53ca80f640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:34:31.508 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 podman[153127]: 2026-02-20 13:34:31.196313191 +0000 UTC m=+5.150195601 container died 47134796bee0e3f5f9995482c70fd6984c1419eefebd2d69833adfb98f44b5ad (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0) 2026-02-20T13:34:31.508 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 podman[153127]: 2026-02-20 13:34:31.253786196 +0000 UTC m=+5.207668607 container remove 47134796bee0e3f5f9995482c70fd6984c1419eefebd2d69833adfb98f44b5ad (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS) 2026-02-20T13:34:31.509 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 bash[153127]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0 2026-02-20T13:34:31.767 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 podman[153228]: 2026-02-20 13:34:31.506411989 +0000 UTC m=+0.029230776 container create bb83ba22f8b0e464a9596938b81445ca0c4885333ac070ad3496a98ca3caa3c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T13:34:31.767 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 podman[153228]: 2026-02-20 13:34:31.559994926 +0000 UTC m=+0.082813643 container init bb83ba22f8b0e464a9596938b81445ca0c4885333ac070ad3496a98ca3caa3c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0-deactivate, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260219.125903) 2026-02-20T13:34:31.767 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 podman[153228]: 2026-02-20 13:34:31.565500571 +0000 UTC m=+0.088319298 container start bb83ba22f8b0e464a9596938b81445ca0c4885333ac070ad3496a98ca3caa3c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0-deactivate, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T13:34:31.767 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 podman[153228]: 2026-02-20 13:34:31.56642115 +0000 UTC m=+0.089239867 container attach bb83ba22f8b0e464a9596938b81445ca0c4885333ac070ad3496a98ca3caa3c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default) 2026-02-20T13:34:31.768 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 podman[153228]: 2026-02-20 13:34:31.496498956 +0000 UTC m=+0.019317693 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:34:31.768 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 13:34:31 trial028 podman[153228]: 2026-02-20 13:34:31.751293812 +0000 UTC m=+0.274112539 container died bb83ba22f8b0e464a9596938b81445ca0c4885333ac070ad3496a98ca3caa3c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216) 2026-02-20T13:34:31.837 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.0.service' 2026-02-20T13:34:31.907 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:31.907 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-20T13:34:31.907 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-20T13:34:31.908 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.1 2026-02-20T13:34:32.241 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:31 trial034 systemd[1]: Stopping Ceph osd.1 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:32.241 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:32 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1[49081]: 2026-02-20T13:34:32.005+0000 7f1955bdc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:34:32.241 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:32 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1[49081]: 2026-02-20T13:34:32.005+0000 7f1955bdc640 -1 osd.1 83 *** Got signal Terminated *** 2026-02-20T13:34:32.241 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:32 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1[49081]: 2026-02-20T13:34:32.005+0000 7f1955bdc640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 podman[97224]: 2026-02-20 13:34:37.064326765 +0000 UTC m=+5.071289312 container died 47d363fb2554739dab0d13d73984beebefe41bf2af92283d3c20b9d4affaeb48 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.build-date=20260216, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e) 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 podman[97224]: 2026-02-20 13:34:37.073108171 +0000 UTC m=+5.080070709 container remove 47d363fb2554739dab0d13d73984beebefe41bf2af92283d3c20b9d4affaeb48 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260219.125903, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 bash[97224]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 podman[97358]: 2026-02-20 13:34:37.195176386 +0000 UTC m=+0.016548712 container create d85e11092c8b6b118908e1d311c7e3b09589a1fdd24c82ea3fd3f3833473b66c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1-deactivate, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True, io.buildah.version=1.41.3, OSD_FLAVOR=default) 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 podman[97358]: 2026-02-20 13:34:37.227455359 +0000 UTC m=+0.048827645 container init d85e11092c8b6b118908e1d311c7e3b09589a1fdd24c82ea3fd3f3833473b66c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260219.125903, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 podman[97358]: 2026-02-20 13:34:37.230149218 +0000 UTC m=+0.051521484 container start d85e11092c8b6b118908e1d311c7e3b09589a1fdd24c82ea3fd3f3833473b66c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1-deactivate, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.build-date=20260216) 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 podman[97358]: 2026-02-20 13:34:37.230573676 +0000 UTC m=+0.051945962 container attach d85e11092c8b6b118908e1d311c7e3b09589a1fdd24c82ea3fd3f3833473b66c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 podman[97358]: 2026-02-20 13:34:37.188597777 +0000 UTC m=+0.009970043 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:34:37.361 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 20 13:34:37 trial034 podman[97358]: 2026-02-20 13:34:37.359588682 +0000 UTC m=+0.180960958 container died d85e11092c8b6b118908e1d311c7e3b09589a1fdd24c82ea3fd3f3833473b66c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-20T13:34:37.395 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.1.service' 2026-02-20T13:34:37.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:37.433 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-20T13:34:37.433 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-20T13:34:37.433 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.2 2026-02-20T13:34:37.728 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:37 trial127 systemd[1]: Stopping Ceph osd.2 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:37.728 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:37 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2[49802]: 2026-02-20T13:34:37.530+0000 7f7b68d0e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:34:37.728 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:37 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2[49802]: 2026-02-20T13:34:37.530+0000 7f7b68d0e640 -1 osd.2 83 *** Got signal Terminated *** 2026-02-20T13:34:37.728 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:37 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2[49802]: 2026-02-20T13:34:37.530+0000 7f7b68d0e640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:34:42.891 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:42 trial127 podman[102273]: 2026-02-20 13:34:42.600645809 +0000 UTC m=+5.082354454 container died e8b120713daf54587d57d8e385a72480274ce47f2fa05e1ed3be8eec41c1e602 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-02-20T13:34:42.891 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:42 trial127 podman[102273]: 2026-02-20 13:34:42.609615882 +0000 UTC m=+5.091324527 container remove e8b120713daf54587d57d8e385a72480274ce47f2fa05e1ed3be8eec41c1e602 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260219.125903, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True, org.label-schema.schema-version=1.0) 2026-02-20T13:34:42.891 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:42 trial127 bash[102273]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2 2026-02-20T13:34:42.891 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:42 trial127 podman[102406]: 2026-02-20 13:34:42.736406407 +0000 UTC m=+0.014518489 container create d9b2ce7b95e42261ef26c417e33ec1aeb203798ba5c7ec9999c799c055772168 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, ceph=True, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS) 2026-02-20T13:34:42.891 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:42 trial127 podman[102406]: 2026-02-20 13:34:42.765569517 +0000 UTC m=+0.043681609 container init d9b2ce7b95e42261ef26c417e33ec1aeb203798ba5c7ec9999c799c055772168 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:34:42.891 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:42 trial127 podman[102406]: 2026-02-20 13:34:42.7680648 +0000 UTC m=+0.046176882 container start d9b2ce7b95e42261ef26c417e33ec1aeb203798ba5c7ec9999c799c055772168 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2-deactivate, io.buildah.version=1.41.3, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T13:34:42.891 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:42 trial127 podman[102406]: 2026-02-20 13:34:42.768763981 +0000 UTC m=+0.046876063 container attach d9b2ce7b95e42261ef26c417e33ec1aeb203798ba5c7ec9999c799c055772168 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3) 2026-02-20T13:34:42.891 INFO:journalctl@ceph.osd.2.trial127.stdout:Feb 20 13:34:42 trial127 podman[102406]: 2026-02-20 13:34:42.730618496 +0000 UTC m=+0.008730578 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:34:42.928 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.2.service' 2026-02-20T13:34:42.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:42.965 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-20T13:34:42.965 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-20T13:34:42.966 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.3 2026-02-20T13:34:43.350 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:43 trial028 systemd[1]: Stopping Ceph osd.3 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:43.351 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:43 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3[65019]: 2026-02-20T13:34:43.150+0000 7f2b21dba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:34:43.351 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:43 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3[65019]: 2026-02-20T13:34:43.150+0000 7f2b21dba640 -1 osd.3 83 *** Got signal Terminated *** 2026-02-20T13:34:43.351 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:43 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3[65019]: 2026-02-20T13:34:43.150+0000 7f2b21dba640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:34:48.561 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 podman[153345]: 2026-02-20 13:34:48.246553622 +0000 UTC m=+5.119877350 container died 6d6e7ac638b30b5ec5bf3c8643d18aa14b955fb2d69c4e6eca827a18b10f8b40 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3, CEPH_REF=wip-vshankar-testing-20260219.125903, ceph=True, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T13:34:48.561 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 podman[153345]: 2026-02-20 13:34:48.306182608 +0000 UTC m=+5.179506346 container remove 6d6e7ac638b30b5ec5bf3c8643d18aa14b955fb2d69c4e6eca827a18b10f8b40 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T13:34:48.561 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 bash[153345]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3 2026-02-20T13:34:48.827 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 podman[153445]: 2026-02-20 13:34:48.559252794 +0000 UTC m=+0.028458262 container create 0b2700b1da32fbb7392ca495935ec80f53bf2ad36ee36a579fd4b6fad42ed997 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3-deactivate, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.build-date=20260216, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T13:34:48.827 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 podman[153445]: 2026-02-20 13:34:48.603660618 +0000 UTC m=+0.072866096 container init 0b2700b1da32fbb7392ca495935ec80f53bf2ad36ee36a579fd4b6fad42ed997 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, org.label-schema.license=GPLv2) 2026-02-20T13:34:48.827 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 podman[153445]: 2026-02-20 13:34:48.609425635 +0000 UTC m=+0.078631103 container start 0b2700b1da32fbb7392ca495935ec80f53bf2ad36ee36a579fd4b6fad42ed997 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:34:48.828 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 podman[153445]: 2026-02-20 13:34:48.610388962 +0000 UTC m=+0.079594430 container attach 0b2700b1da32fbb7392ca495935ec80f53bf2ad36ee36a579fd4b6fad42ed997 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3-deactivate, io.buildah.version=1.41.3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260219.125903, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T13:34:48.828 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 podman[153445]: 2026-02-20 13:34:48.54958713 +0000 UTC m=+0.018792608 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:34:48.828 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 13:34:48 trial028 podman[153445]: 2026-02-20 13:34:48.809463605 +0000 UTC m=+0.278669073 container died 0b2700b1da32fbb7392ca495935ec80f53bf2ad36ee36a579fd4b6fad42ed997 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, ceph=True, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3) 2026-02-20T13:34:48.902 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.3.service' 2026-02-20T13:34:48.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:48.973 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-20T13:34:48.973 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-20T13:34:48.973 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.4 2026-02-20T13:34:49.453 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:49 trial034 systemd[1]: Stopping Ceph osd.4 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:49.453 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:49 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4[61750]: 2026-02-20T13:34:49.068+0000 7f8887cdc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:34:49.453 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:49 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4[61750]: 2026-02-20T13:34:49.068+0000 7f8887cdc640 -1 osd.4 83 *** Got signal Terminated *** 2026-02-20T13:34:49.453 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:49 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4[61750]: 2026-02-20T13:34:49.068+0000 7f8887cdc640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:34:52.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:51 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:51.818+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:52.228 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:51 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:51.934+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:28.432176+0000 front 2026-02-20T13:34:28.432240+0000 (oldest deadline 2026-02-20T13:34:51.932185+0000) 2026-02-20T13:34:53.227 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:52 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:52.898+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:28.432176+0000 front 2026-02-20T13:34:28.432240+0000 (oldest deadline 2026-02-20T13:34:51.932185+0000) 2026-02-20T13:34:53.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:52 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:52.819+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:54.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:53 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:53.818+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:54.228 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:53 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:53.851+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:28.432176+0000 front 2026-02-20T13:34:28.432240+0000 (oldest deadline 2026-02-20T13:34:51.932185+0000) 2026-02-20T13:34:54.420 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:54 trial034 podman[97495]: 2026-02-20 13:34:54.127675424 +0000 UTC m=+5.071351809 container died e40c3937632753d319e3d5578a352d2a8cbe8c547069081753d477cb230223e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default) 2026-02-20T13:34:54.420 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:54 trial034 podman[97495]: 2026-02-20 13:34:54.135348645 +0000 UTC m=+5.079025019 container remove e40c3937632753d319e3d5578a352d2a8cbe8c547069081753d477cb230223e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T13:34:54.421 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:54 trial034 bash[97495]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4 2026-02-20T13:34:54.421 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:54 trial034 podman[97625]: 2026-02-20 13:34:54.266525332 +0000 UTC m=+0.016539014 container create 13440e598e174a3ef0ebdec6ba9391d78e2558607e3fb6595a7b52c6b490f849 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4-deactivate, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2) 2026-02-20T13:34:54.421 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:54 trial034 podman[97625]: 2026-02-20 13:34:54.295343192 +0000 UTC m=+0.045356874 container init 13440e598e174a3ef0ebdec6ba9391d78e2558607e3fb6595a7b52c6b490f849 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_REF=wip-vshankar-testing-20260219.125903, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:34:54.421 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:54 trial034 podman[97625]: 2026-02-20 13:34:54.297856176 +0000 UTC m=+0.047869868 container start 13440e598e174a3ef0ebdec6ba9391d78e2558607e3fb6595a7b52c6b490f849 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4-deactivate, CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T13:34:54.421 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:54 trial034 podman[97625]: 2026-02-20 13:34:54.298388824 +0000 UTC m=+0.048402506 container attach 13440e598e174a3ef0ebdec6ba9391d78e2558607e3fb6595a7b52c6b490f849 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-4-deactivate, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e) 2026-02-20T13:34:54.421 INFO:journalctl@ceph.osd.4.trial034.stdout:Feb 20 13:34:54 trial034 podman[97625]: 2026-02-20 13:34:54.260304357 +0000 UTC m=+0.010318049 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:34:54.459 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.4.service' 2026-02-20T13:34:54.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:34:54.497 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-20T13:34:54.497 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-20T13:34:54.497 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.5 2026-02-20T13:34:54.843 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:54 trial127 systemd[1]: Stopping Ceph osd.5 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:34:54.843 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:54 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:54.595+0000 7f5b06176640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:34:54.843 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:54 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:54.595+0000 7f5b06176640 -1 osd.5 83 *** Got signal Terminated *** 2026-02-20T13:34:54.843 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:54 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:54.595+0000 7f5b06176640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:34:55.227 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:54 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:54.866+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:28.432176+0000 front 2026-02-20T13:34:28.432240+0000 (oldest deadline 2026-02-20T13:34:51.932185+0000) 2026-02-20T13:34:55.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:54 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:54.842+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:55.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:34:54 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:34:54.842+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:34:55.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:34:55 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:34:55.239+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:34:56.227 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:55 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:55.897+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:28.432176+0000 front 2026-02-20T13:34:28.432240+0000 (oldest deadline 2026-02-20T13:34:51.932185+0000) 2026-02-20T13:34:56.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:55 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:55.881+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:56.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:34:55 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:34:55.822+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:34:56.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:34:56 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:34:56.213+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:34:57.227 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:56 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:56.908+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:28.432176+0000 front 2026-02-20T13:34:28.432240+0000 (oldest deadline 2026-02-20T13:34:51.932185+0000) 2026-02-20T13:34:57.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:56 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:56.851+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:57.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:34:56 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:34:56.839+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:34:57.253 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:34:56 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:34:56.914+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:34:57.599 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:34:57 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:34:57.251+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:34:57.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:34:57 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:34:57.251+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.877949+0000 front 2026-02-20T13:34:34.878063+0000 (oldest deadline 2026-02-20T13:34:57.178015+0000) 2026-02-20T13:34:58.202 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:57 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:57.915+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:28.432176+0000 front 2026-02-20T13:34:28.432240+0000 (oldest deadline 2026-02-20T13:34:51.932185+0000) 2026-02-20T13:34:58.202 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:57 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:57.915+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.932407+0000 front 2026-02-20T13:34:31.932474+0000 (oldest deadline 2026-02-20T13:34:57.832406+0000) 2026-02-20T13:34:58.203 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:57 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:57.818+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:58.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:34:57 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:34:57.790+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:34:58.290 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:34:57 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:34:57.926+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:34:58.290 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:34:57 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:34:57.926+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:34:58.477 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:34:58 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:34:58.201+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:34:58.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:34:58 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:34:58.288+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:34:58.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:34:58 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:34:58.288+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.877949+0000 front 2026-02-20T13:34:34.878063+0000 (oldest deadline 2026-02-20T13:34:57.178015+0000) 2026-02-20T13:34:58.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:34:58 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:34:58.390+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:34:59.165 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:58 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:58.942+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:28.432176+0000 front 2026-02-20T13:34:28.432240+0000 (oldest deadline 2026-02-20T13:34:51.932185+0000) 2026-02-20T13:34:59.165 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:58 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5[61910]: 2026-02-20T13:34:58.942+0000 7f5b0283e640 -1 osd.5 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.932407+0000 front 2026-02-20T13:34:31.932474+0000 (oldest deadline 2026-02-20T13:34:57.832406+0000) 2026-02-20T13:34:59.165 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:58 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:58.841+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:59.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:34:58 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:34:58.779+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:34:59.314 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:34:58 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:34:58.911+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:34:59.314 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:34:58 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:34:58.911+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:34:59.477 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:34:59 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:34:59.164+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:34:59.599 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:34:59 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:34:59.312+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:34:59.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:34:59 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:34:59.312+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.877949+0000 front 2026-02-20T13:34:34.878063+0000 (oldest deadline 2026-02-20T13:34:57.178015+0000) 2026-02-20T13:34:59.741 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:34:59 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:34:59.374+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:34:59.964 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:59 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:59.859+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:34:59.964 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:34:59 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:34:59.859+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:34:59.965 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 podman[102542]: 2026-02-20 13:34:59.665103559 +0000 UTC m=+5.082123284 container died f1e1ddc5bb4e9ef8b0c24af14bec7e2f59fe8bdcc5996e73ea06746d4fc049c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, ceph=True) 2026-02-20T13:34:59.965 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 podman[102542]: 2026-02-20 13:34:59.673736684 +0000 UTC m=+5.090756409 container remove f1e1ddc5bb4e9ef8b0c24af14bec7e2f59fe8bdcc5996e73ea06746d4fc049c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.build-date=20260216, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:34:59.965 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 bash[102542]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5 2026-02-20T13:34:59.965 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 podman[102679]: 2026-02-20 13:34:59.80502013 +0000 UTC m=+0.017343426 container create f9bb06b54c8b2d2b227649c60b4463676f76a78e07245c7bd0c706e61d2a464c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, ceph=True, org.label-schema.build-date=20260216, io.buildah.version=1.41.3) 2026-02-20T13:34:59.965 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 podman[102679]: 2026-02-20 13:34:59.835674966 +0000 UTC m=+0.047998211 container init f9bb06b54c8b2d2b227649c60b4463676f76a78e07245c7bd0c706e61d2a464c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260219.125903, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.build-date=20260216, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS) 2026-02-20T13:34:59.965 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 podman[102679]: 2026-02-20 13:34:59.83818095 +0000 UTC m=+0.050504195 container start f9bb06b54c8b2d2b227649c60b4463676f76a78e07245c7bd0c706e61d2a464c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.license=GPLv2) 2026-02-20T13:34:59.965 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 podman[102679]: 2026-02-20 13:34:59.838725162 +0000 UTC m=+0.051048397 container attach f9bb06b54c8b2d2b227649c60b4463676f76a78e07245c7bd0c706e61d2a464c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903) 2026-02-20T13:34:59.966 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 podman[102679]: 2026-02-20 13:34:59.798134908 +0000 UTC m=+0.010458153 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:34:59.966 INFO:journalctl@ceph.osd.5.trial127.stdout:Feb 20 13:34:59 trial127 podman[102679]: 2026-02-20 13:34:59.96279231 +0000 UTC m=+0.175115555 container died f9bb06b54c8b2d2b227649c60b4463676f76a78e07245c7bd0c706e61d2a464c (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-5-deactivate, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260219.125903, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS) 2026-02-20T13:35:00.004 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.5.service' 2026-02-20T13:35:00.039 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:00.040 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-20T13:35:00.040 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-20T13:35:00.040 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.6 2026-02-20T13:35:00.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:00 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:00.181+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:00.234 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:34:59 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:34:59.899+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:00.235 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:34:59 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:34:59.899+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:00.235 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:00 trial028 systemd[1]: Stopping Ceph osd.6 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:00.235 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:00 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:00.231+0000 7fc3753c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:35:00.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:34:59 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:34:59.797+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:00.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:34:59 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:34:59.797+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:00.599 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:00 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:00.231+0000 7fc3753c5640 -1 osd.6 83 *** Got signal Terminated *** 2026-02-20T13:35:00.599 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:00 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:00.231+0000 7fc3753c5640 -1 osd.6 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:35:00.599 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:00 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:00.321+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:35:00.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:00 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:00.321+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.877949+0000 front 2026-02-20T13:34:34.878063+0000 (oldest deadline 2026-02-20T13:34:57.178015+0000) 2026-02-20T13:35:00.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:00 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:00.355+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:01.167 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:00 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:00.899+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:01.167 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:00 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:00.899+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:01.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:00 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:00.818+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:01.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:00 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:00.818+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:01.301 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:00 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:00.873+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:01.301 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:00 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:00.873+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:01.477 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:01 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:01.166+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:01.599 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:01 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:01.299+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:35:01.599 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:01 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:01.299+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.877949+0000 front 2026-02-20T13:34:34.878063+0000 (oldest deadline 2026-02-20T13:34:57.178015+0000) 2026-02-20T13:35:01.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:01 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:01.402+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:02.148 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:01 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:01.877+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:02.148 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:01 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:01.877+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:02.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:01 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:01.802+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:02.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:01 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:01.802+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:02.343 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:01 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:01.916+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:02.343 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:01 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:01.916+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:02.477 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:02 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:02.147+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:02.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:02 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:02.342+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:35:02.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:02 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:02.342+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.877949+0000 front 2026-02-20T13:34:34.878063+0000 (oldest deadline 2026-02-20T13:34:57.178015+0000) 2026-02-20T13:35:02.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:02 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:02.400+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:03.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:02 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:02.875+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:03.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:02 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:02.875+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:03.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:03 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:03.099+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:03.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:02 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:02.804+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:03.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:02 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:02.804+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:03.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:02 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:02.965+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:03.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:02 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:02.965+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:03.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:03 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:03.354+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:03.850 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:03 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:03.374+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:35:03.850 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:03 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:03.374+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.877949+0000 front 2026-02-20T13:34:34.878063+0000 (oldest deadline 2026-02-20T13:34:57.178015+0000) 2026-02-20T13:35:04.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:04 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:04.081+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:04.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:03 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:03.901+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:04.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:03 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:03.901+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:04.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:03 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:03.853+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:04.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:03 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:03.853+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:04.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:03 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:03.853+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:04.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:03 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:03.980+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:04.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:03 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:03.980+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:04.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:03 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:03.980+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:04.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:04 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:04.316+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:04.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:04 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:04.316+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:40.700340+0000 front 2026-02-20T13:34:40.700281+0000 (oldest deadline 2026-02-20T13:35:04.200292+0000) 2026-02-20T13:35:04.849 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:04 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:04.422+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.177761+0000 front 2026-02-20T13:34:30.177691+0000 (oldest deadline 2026-02-20T13:34:54.877715+0000) 2026-02-20T13:35:04.849 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:04 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6[78054]: 2026-02-20T13:35:04.422+0000 7fc371a8d640 -1 osd.6 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.877949+0000 front 2026-02-20T13:34:34.878063+0000 (oldest deadline 2026-02-20T13:34:57.178015+0000) 2026-02-20T13:35:05.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:05 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:05.052+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:05.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:05 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:05.052+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:05.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:04 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:04.903+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:05.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:04 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:04.903+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:05.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:04 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:04.903+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:05.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:04 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:04.807+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:05.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:04 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:04.807+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:05.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:04 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:04.807+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:05.340 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:05 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:05.024+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:05.340 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:05 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:05.024+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:05.340 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:05 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:05.024+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:05.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 podman[153569]: 2026-02-20 13:35:05.338435558 +0000 UTC m=+5.130982025 container died e73e63df19992123475d33ad41b5c5dc6f73e8e8dcb5568f4b7d1edf5cf7abde (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216) 2026-02-20T13:35:05.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 podman[153569]: 2026-02-20 13:35:05.396302254 +0000 UTC m=+5.188848711 container remove e73e63df19992123475d33ad41b5c5dc6f73e8e8dcb5568f4b7d1edf5cf7abde (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T13:35:05.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 bash[153569]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6 2026-02-20T13:35:05.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:05 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:05.333+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:05.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:05 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:05.333+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:40.700340+0000 front 2026-02-20T13:34:40.700281+0000 (oldest deadline 2026-02-20T13:35:04.200292+0000) 2026-02-20T13:35:05.921 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 podman[153671]: 2026-02-20 13:35:05.66013018 +0000 UTC m=+0.028519295 container create 828282149c8d194622bb536696d9a77e80b33e5d9cd785986635168bfa6bc8ca (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, OSD_FLAVOR=default, org.label-schema.vendor=CentOS) 2026-02-20T13:35:05.922 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 podman[153671]: 2026-02-20 13:35:05.710579634 +0000 UTC m=+0.078968699 container init 828282149c8d194622bb536696d9a77e80b33e5d9cd785986635168bfa6bc8ca (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True, CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T13:35:05.922 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 podman[153671]: 2026-02-20 13:35:05.716277116 +0000 UTC m=+0.084666171 container start 828282149c8d194622bb536696d9a77e80b33e5d9cd785986635168bfa6bc8ca (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6-deactivate, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T13:35:05.922 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 podman[153671]: 2026-02-20 13:35:05.717033008 +0000 UTC m=+0.085422063 container attach 828282149c8d194622bb536696d9a77e80b33e5d9cd785986635168bfa6bc8ca (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6-deactivate, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True, CEPH_REF=wip-vshankar-testing-20260219.125903) 2026-02-20T13:35:05.922 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 podman[153671]: 2026-02-20 13:35:05.650866292 +0000 UTC m=+0.019255347 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:35:05.922 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 13:35:05 trial028 podman[153671]: 2026-02-20 13:35:05.904856836 +0000 UTC m=+0.273245891 container died 828282149c8d194622bb536696d9a77e80b33e5d9cd785986635168bfa6bc8ca (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T13:35:05.993 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.6.service' 2026-02-20T13:35:06.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:06.065 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-20T13:35:06.065 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-20T13:35:06.065 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.7 2026-02-20T13:35:06.089 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:05 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:05.774+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:06.089 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:05 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:05.774+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:06.089 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:05 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:05.774+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:06.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:06 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:06.018+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:06.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:06 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:06.018+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:06.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:05 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:05.912+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:06.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:05 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:05.912+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:06.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:05 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:05.912+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:06.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:06 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:06.002+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:06.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:06 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:06.002+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:06.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:06 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:06.002+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:06.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:06 trial034 systemd[1]: Stopping Ceph osd.7 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:06.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:06.169+0000 7f2cb005b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:35:06.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:06.169+0000 7f2cb005b640 -1 osd.7 83 *** Got signal Terminated *** 2026-02-20T13:35:06.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:06.169+0000 7f2cb005b640 -1 osd.7 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:35:06.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:06.294+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:06.492 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:06.294+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:40.700340+0000 front 2026-02-20T13:34:40.700281+0000 (oldest deadline 2026-02-20T13:35:04.200292+0000) 2026-02-20T13:35:07.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:07 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:07.026+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:07.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:07 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:07.026+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:07.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:06 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:06.953+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:07.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:06 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:06.953+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:07.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:06 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:06.953+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:07.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:06.771+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:07.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:06.771+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:07.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:06 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:06.771+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:07.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:07 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:07.027+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:07.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:07 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:07.027+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:07.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:07 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:07.027+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:07.741 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:07 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:07.309+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:07.741 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:07 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:07.309+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:40.700340+0000 front 2026-02-20T13:34:40.700281+0000 (oldest deadline 2026-02-20T13:35:04.200292+0000) 2026-02-20T13:35:08.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:08 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:08.073+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:08.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:08 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:08.073+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:08.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:07 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:07.949+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:08.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:07 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:07.949+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:08.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:07 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:07.949+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:08.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:07 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:07.765+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:08.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:07 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:07.765+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:08.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:07 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:07.765+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:08.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:07 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:07.985+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:08.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:07 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:07.985+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:08.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:07 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:07.985+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:08.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:08 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:08.286+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:08.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:08 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:08.286+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:40.700340+0000 front 2026-02-20T13:34:40.700281+0000 (oldest deadline 2026-02-20T13:35:04.200292+0000) 2026-02-20T13:35:09.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:09 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:09.040+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:09.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:09 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:09.040+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:09.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:08 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:08.907+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:09.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:08 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:08.907+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:09.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:08 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:08.907+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:09.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:08 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:08.751+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:09.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:08 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:08.751+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:09.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:08 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:08.751+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:09.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:09 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:09.012+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:09.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:09 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:09.012+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:09.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:09 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:09.012+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:09.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:09 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:09.311+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:09.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:09 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:09.311+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:40.700340+0000 front 2026-02-20T13:34:40.700281+0000 (oldest deadline 2026-02-20T13:35:04.200292+0000) 2026-02-20T13:35:10.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:09 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:09.995+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:10.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:09 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:09.995+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:10.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:09 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:09.885+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:10.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:09 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:09.885+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:10.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:09 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:09.885+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:10.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:09 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:09.775+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:10.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:09 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:09.775+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:10.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:09 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:09.775+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:10.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:09 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:09.775+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:10.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:10 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:10.039+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:10.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:10 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:10.039+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:10.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:10 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:10.039+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:10.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:10 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:10.039+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:10.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:10.315+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.299328+0000 front 2026-02-20T13:34:36.299339+0000 (oldest deadline 2026-02-20T13:34:57.399474+0000) 2026-02-20T13:35:10.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:10.315+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:40.700340+0000 front 2026-02-20T13:34:40.700281+0000 (oldest deadline 2026-02-20T13:35:04.200292+0000) 2026-02-20T13:35:10.740 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7[74396]: 2026-02-20T13:35:10.315+0000 7f2ca871b640 -1 osd.7 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.200534+0000 front 2026-02-20T13:34:44.200671+0000 (oldest deadline 2026-02-20T13:35:09.500511+0000) 2026-02-20T13:35:11.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:10.987+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:11.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:10.987+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:11.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:10.925+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:11.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:10.925+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:11.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:10.925+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:11.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:10 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:10.925+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:11.239 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:10.762+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:11.239 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:10.762+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:11.239 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:10.762+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:11.239 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:10 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:10.762+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:11.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:11 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:11.021+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:11.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:11 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:11.021+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:11.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:11 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:11.021+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:11.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:11 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:11.021+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:11.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:11 trial034 podman[97757]: 2026-02-20 13:35:11.238057988 +0000 UTC m=+5.082117161 container died a39135f3ff4eca9b9fd97d2b46be57ab282c1faa7e296f6290fd0d8547b46f98 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:35:11.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:11 trial034 podman[97757]: 2026-02-20 13:35:11.24673487 +0000 UTC m=+5.090794043 container remove a39135f3ff4eca9b9fd97d2b46be57ab282c1faa7e296f6290fd0d8547b46f98 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7, CEPH_REF=wip-vshankar-testing-20260219.125903, io.buildah.version=1.41.3, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:35:11.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:11 trial034 bash[97757]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7 2026-02-20T13:35:11.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:11 trial034 podman[97887]: 2026-02-20 13:35:11.372699756 +0000 UTC m=+0.016455379 container create d8de9bd52fb334a63a4b2d083560d261ed6eef1cb285c8d61f57811dfc2fc140 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7-deactivate, io.buildah.version=1.41.3, org.label-schema.build-date=20260216, ceph=True, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2) 2026-02-20T13:35:11.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:11 trial034 podman[97887]: 2026-02-20 13:35:11.408452075 +0000 UTC m=+0.052207698 container init d8de9bd52fb334a63a4b2d083560d261ed6eef1cb285c8d61f57811dfc2fc140 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7-deactivate, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True) 2026-02-20T13:35:11.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:11 trial034 podman[97887]: 2026-02-20 13:35:11.410856978 +0000 UTC m=+0.054612601 container start d8de9bd52fb334a63a4b2d083560d261ed6eef1cb285c8d61f57811dfc2fc140 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T13:35:11.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:11 trial034 podman[97887]: 2026-02-20 13:35:11.411365772 +0000 UTC m=+0.055121395 container attach d8de9bd52fb334a63a4b2d083560d261ed6eef1cb285c8d61f57811dfc2fc140 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-7-deactivate, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2026-02-20T13:35:11.491 INFO:journalctl@ceph.osd.7.trial034.stdout:Feb 20 13:35:11 trial034 podman[97887]: 2026-02-20 13:35:11.366498257 +0000 UTC m=+0.010253880 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:35:11.578 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.7.service' 2026-02-20T13:35:11.654 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:11.654 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-20T13:35:11.654 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-20T13:35:11.654 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.8 2026-02-20T13:35:11.976 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:11.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:11.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:11.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:11.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:11 trial127 systemd[1]: Stopping Ceph osd.8 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:11.750+0000 7f36f30d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:11.750+0000 7f36f30d4640 -1 osd.8 83 *** Got signal Terminated *** 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:11.750+0000 7f36f30d4640 -1 osd.8 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:11.975+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:11.977 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:11 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:11.975+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:11.990 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:11 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:11.737+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:11.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:11 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:11.737+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:11.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:11 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:11.737+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:11.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:11 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:11.737+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:12.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:12 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:12.032+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:12.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:12 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:12.032+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:12.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:12 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:12.032+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:12.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:12 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:12.032+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:12.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:12 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:12.735+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:12.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:12 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:12.735+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:12.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:12 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:12.735+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:12.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:12 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:12.735+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:13.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:12 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:12.993+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:13.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:12 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:12.993+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:13.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:12 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:12.914+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:13.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:12 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:12.914+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:13.229 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:12 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:12.914+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:13.229 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:12 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:12.914+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:13.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:13 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:13.070+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:13.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:13 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:13.070+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:13.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:13 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:13.070+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:13.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:13 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:13.070+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:13.990 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:13 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:13.731+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:13.990 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:13 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:13.731+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:13.990 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:13 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:13.731+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:13.990 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:13 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:13.731+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:14.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:14 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:14.038+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:14.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:14 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:14.038+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:14.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:14 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:14.038+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.380833+0000 front 2026-02-20T13:34:47.380801+0000 (oldest deadline 2026-02-20T13:35:13.280790+0000) 2026-02-20T13:35:14.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:13 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:13.893+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:14.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:13 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:13.893+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:14.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:13 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:13.893+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:14.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:13 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:13.893+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:14.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:14 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:14.073+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:14.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:14 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:14.073+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:14.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:14 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:14.073+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:14.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:14 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:14.073+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:15.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:15.011+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:15.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:15.011+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:15.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:15.011+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.380833+0000 front 2026-02-20T13:34:47.380801+0000 (oldest deadline 2026-02-20T13:35:13.280790+0000) 2026-02-20T13:35:15.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:14 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:14.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:15.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:14 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:14.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:15.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:14 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:14.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:15.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:14 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:14.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:15.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:14 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:14.765+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:15.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:14 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:14.765+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:15.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:14 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:14.765+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:15.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:14 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:14.765+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:15.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:15 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:15.119+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:15.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:15 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:15.119+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:15.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:15 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:15.119+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:15.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:15 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:15.119+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:16.227 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:15.985+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:31.679734+0000 front 2026-02-20T13:34:31.679632+0000 (oldest deadline 2026-02-20T13:34:57.579695+0000) 2026-02-20T13:35:16.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:15.985+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.879994+0000 front 2026-02-20T13:34:39.880016+0000 (oldest deadline 2026-02-20T13:35:04.580096+0000) 2026-02-20T13:35:16.228 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8[74571]: 2026-02-20T13:35:15.985+0000 7f36eb794640 -1 osd.8 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.380833+0000 front 2026-02-20T13:34:47.380801+0000 (oldest deadline 2026-02-20T13:35:13.280790+0000) 2026-02-20T13:35:16.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:15.855+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:16.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:15.855+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:16.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:15.855+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:16.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:15.855+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:16.229 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:15 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:15.855+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:16.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:15 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:15.745+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:16.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:15 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:15.745+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:16.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:15 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:15.745+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:16.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:15 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:15.745+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:16.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:16 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:16.095+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:16.349 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:16 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:16.095+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:16.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:16 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:16.095+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:16.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:16 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:16.095+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:16.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:16 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:16.095+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.402336+0000 front 2026-02-20T13:34:53.402459+0000 (oldest deadline 2026-02-20T13:35:15.702387+0000) 2026-02-20T13:35:16.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:16 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:16.717+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:16.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:16 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:16.717+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:16.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:16 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:16.717+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:16.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:16 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:16.717+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:17.137 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:16 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:16.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:17.137 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:16 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:16.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:17.137 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:16 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:16.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:17.137 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:16 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:16.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:17.137 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:16 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:16.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:17.138 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:16 trial127 podman[102810]: 2026-02-20 13:35:16.819518392 +0000 UTC m=+5.081885638 container died 34da12ac25a8a457fd5ffa13dea420486545a245897281b946f0ea70f29370a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, OSD_FLAVOR=default, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_REF=wip-vshankar-testing-20260219.125903) 2026-02-20T13:35:17.138 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:16 trial127 podman[102810]: 2026-02-20 13:35:16.829781952 +0000 UTC m=+5.092149198 container remove 34da12ac25a8a457fd5ffa13dea420486545a245897281b946f0ea70f29370a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_REF=wip-vshankar-testing-20260219.125903) 2026-02-20T13:35:17.138 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:16 trial127 bash[102810]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8 2026-02-20T13:35:17.138 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:16 trial127 podman[102941]: 2026-02-20 13:35:16.972700319 +0000 UTC m=+0.016117644 container create 7517be0c2cbcde33ed3cb7644308a2cc408091ad48c58880f6f79a05710e9fee (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8-deactivate, OSD_FLAVOR=default, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216) 2026-02-20T13:35:17.138 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:17 trial127 podman[102941]: 2026-02-20 13:35:17.002450792 +0000 UTC m=+0.045868127 container init 7517be0c2cbcde33ed3cb7644308a2cc408091ad48c58880f6f79a05710e9fee (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T13:35:17.138 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:17 trial127 podman[102941]: 2026-02-20 13:35:17.004725986 +0000 UTC m=+0.048143311 container start 7517be0c2cbcde33ed3cb7644308a2cc408091ad48c58880f6f79a05710e9fee (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8-deactivate, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216) 2026-02-20T13:35:17.138 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:17 trial127 podman[102941]: 2026-02-20 13:35:17.005450604 +0000 UTC m=+0.048867939 container attach 7517be0c2cbcde33ed3cb7644308a2cc408091ad48c58880f6f79a05710e9fee (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-8-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2) 2026-02-20T13:35:17.138 INFO:journalctl@ceph.osd.8.trial127.stdout:Feb 20 13:35:17 trial127 podman[102941]: 2026-02-20 13:35:16.966638188 +0000 UTC m=+0.010055533 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:35:17.168 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.8.service' 2026-02-20T13:35:17.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:17.203 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-20T13:35:17.203 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-20T13:35:17.203 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.9 2026-02-20T13:35:17.401 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:17.136+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:17.401 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:17.136+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:17.401 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:17.136+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:17.401 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:17.136+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:17.401 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:17.136+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.402336+0000 front 2026-02-20T13:34:53.402459+0000 (oldest deadline 2026-02-20T13:35:15.702387+0000) 2026-02-20T13:35:17.401 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 systemd[1]: Stopping Ceph osd.9 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:17.401 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:17.396+0000 7faaf1264640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:35:17.402 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:17.396+0000 7faaf1264640 -1 osd.9 83 *** Got signal Terminated *** 2026-02-20T13:35:17.402 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:17 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:17.396+0000 7faaf1264640 -1 osd.9 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:35:17.990 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:17 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:17.685+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:17.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:17 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:17.685+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:17.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:17 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:17.685+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:17.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:17 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:17.685+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:17.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:17 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:17.685+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:18.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:17 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:17.888+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:18.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:17 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:17.888+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:18.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:17 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:17.888+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:18.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:17 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:17.888+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:18.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:17 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:17.888+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:18.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:18 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:18.139+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:18.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:18 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:18.139+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:18.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:18 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:18.139+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:18.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:18 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:18.139+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:18.600 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:18 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:18.139+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.402336+0000 front 2026-02-20T13:34:53.402459+0000 (oldest deadline 2026-02-20T13:35:15.702387+0000) 2026-02-20T13:35:18.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:18 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:18.718+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:18.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:18 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:18.718+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:18.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:18 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:18.718+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:18.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:18 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:18.718+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:18.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:18 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:18.718+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:19.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:18 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:18.883+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:19.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:18 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:18.883+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:19.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:18 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:18.883+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:19.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:18 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:18.883+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:19.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:18 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:18.883+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:19.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:19.096+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:19.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:19.096+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:19.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:19.096+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:19.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:19.096+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:19.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:19 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:19.096+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.402336+0000 front 2026-02-20T13:34:53.402459+0000 (oldest deadline 2026-02-20T13:35:15.702387+0000) 2026-02-20T13:35:19.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:19.721+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:19.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:19.721+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:19.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:19.721+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:19.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:19.721+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:19.991 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:19 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:19.721+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:20.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:19.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:20.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:19.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:20.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:19.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:20.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:19.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:20.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:19 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:19.919+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:20.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:20.092+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:20.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:20.092+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:20.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:20.092+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:20.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:20.092+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:20.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:20.092+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.402336+0000 front 2026-02-20T13:34:53.402459+0000 (oldest deadline 2026-02-20T13:35:15.702387+0000) 2026-02-20T13:35:20.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:20 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:20.092+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.702621+0000 front 2026-02-20T13:34:55.702627+0000 (oldest deadline 2026-02-20T13:35:19.802584+0000) 2026-02-20T13:35:21.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:20 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:20.941+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:21.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:20 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:20.941+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:21.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:20 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:20.941+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:21.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:20 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:20.941+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:21.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:20 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:20.941+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:21.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:20 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:20.770+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:21.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:20 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:20.770+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:21.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:20 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:20.770+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:21.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:20 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:20.770+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:21.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:20 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:20.770+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:21.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:21 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:21.094+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:21.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:21 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:21.094+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:21.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:21 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:21.094+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:21.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:21 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:21.094+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:21.351 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:21 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:21.094+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.402336+0000 front 2026-02-20T13:34:53.402459+0000 (oldest deadline 2026-02-20T13:35:15.702387+0000) 2026-02-20T13:35:21.351 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:21 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:21.094+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.702621+0000 front 2026-02-20T13:34:55.702627+0000 (oldest deadline 2026-02-20T13:35:19.802584+0000) 2026-02-20T13:35:22.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:21 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:21.970+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:22.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:21 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:21.970+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:22.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:21 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:21.970+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:22.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:21 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:21.970+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:22.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:21 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:21.970+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:22.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:21 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:21.782+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:22.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:21 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:21.782+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:22.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:21 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:21.782+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:22.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:21 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:21.782+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:22.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:21 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:21.782+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:22.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:22.083+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.700520+0000 front 2026-02-20T13:34:30.700711+0000 (oldest deadline 2026-02-20T13:34:56.600510+0000) 2026-02-20T13:35:22.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:22.083+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:36.600901+0000 front 2026-02-20T13:34:36.600749+0000 (oldest deadline 2026-02-20T13:34:57.100783+0000) 2026-02-20T13:35:22.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:22.083+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:37.601324+0000 front 2026-02-20T13:34:37.601264+0000 (oldest deadline 2026-02-20T13:35:03.501286+0000) 2026-02-20T13:35:22.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:22.083+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:44.601710+0000 front 2026-02-20T13:34:44.601804+0000 (oldest deadline 2026-02-20T13:35:09.301787+0000) 2026-02-20T13:35:22.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:22.083+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.402336+0000 front 2026-02-20T13:34:53.402459+0000 (oldest deadline 2026-02-20T13:35:15.702387+0000) 2026-02-20T13:35:22.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9[90560]: 2026-02-20T13:35:22.083+0000 7faae9924640 -1 osd.9 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.702621+0000 front 2026-02-20T13:34:55.702627+0000 (oldest deadline 2026-02-20T13:35:19.802584+0000) 2026-02-20T13:35:22.810 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 podman[153785]: 2026-02-20 13:35:22.493903215 +0000 UTC m=+5.119230675 container died 8ca80ac3359631bcdcadc4a60fed79dc012f3529b9850bf10a11314a10e2c08f (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-02-20T13:35:22.811 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 podman[153785]: 2026-02-20 13:35:22.552525433 +0000 UTC m=+5.177852893 container remove 8ca80ac3359631bcdcadc4a60fed79dc012f3529b9850bf10a11314a10e2c08f (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_REF=wip-vshankar-testing-20260219.125903, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T13:35:22.811 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 bash[153785]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9 2026-02-20T13:35:23.068 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 podman[153886]: 2026-02-20 13:35:22.808976342 +0000 UTC m=+0.028469113 container create 025aa8ce3dd7733c60e946b55669ccdeb921318f750ca9ee9838865b94192c33 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9-deactivate, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, ceph=True, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.license=GPLv2) 2026-02-20T13:35:23.068 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 podman[153886]: 2026-02-20 13:35:22.863007531 +0000 UTC m=+0.082500292 container init 025aa8ce3dd7733c60e946b55669ccdeb921318f750ca9ee9838865b94192c33 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.build-date=20260216) 2026-02-20T13:35:23.068 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 podman[153886]: 2026-02-20 13:35:22.86836418 +0000 UTC m=+0.087856951 container start 025aa8ce3dd7733c60e946b55669ccdeb921318f750ca9ee9838865b94192c33 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9-deactivate, ceph=True, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T13:35:23.068 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 podman[153886]: 2026-02-20 13:35:22.869243161 +0000 UTC m=+0.088735932 container attach 025aa8ce3dd7733c60e946b55669ccdeb921318f750ca9ee9838865b94192c33 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-9-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e) 2026-02-20T13:35:23.069 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 13:35:22 trial028 podman[153886]: 2026-02-20 13:35:22.79944654 +0000 UTC m=+0.018939311 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:35:23.152 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.9.service' 2026-02-20T13:35:23.222 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:23.222 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-20T13:35:23.222 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-20T13:35:23.222 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.10 2026-02-20T13:35:23.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:22 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:22.938+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:23.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:22 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:22.938+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:23.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:22 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:22.938+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:23.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:22 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:22.938+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:23.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:22 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:22.938+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:23.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:22 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:22.819+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:23.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:22 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:22.819+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:23.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:22 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:22.819+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:23.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:22 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:22.819+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:23.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:22 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:22.819+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:23.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:22 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:22.819+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:57.200577+0000 front 2026-02-20T13:34:57.200541+0000 (oldest deadline 2026-02-20T13:35:21.900545+0000) 2026-02-20T13:35:23.740 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 systemd[1]: Stopping Ceph osd.10 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:23.740 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.319+0000 7f92c6bb8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:35:23.740 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.319+0000 7f92c6bb8640 -1 osd.10 83 *** Got signal Terminated *** 2026-02-20T13:35:23.740 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.319+0000 7f92c6bb8640 -1 osd.10 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:35:24.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:23 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:23.911+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:24.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:23 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:23.911+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:24.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:23 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:23.911+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:24.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:23 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:23.911+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:24.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:23 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:23.911+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:24.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:23 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:23.911+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:24.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.773+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:24.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.773+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:24.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.773+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:24.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.773+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:24.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.773+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:24.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:23 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:23.773+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:57.200577+0000 front 2026-02-20T13:34:57.200541+0000 (oldest deadline 2026-02-20T13:35:21.900545+0000) 2026-02-20T13:35:25.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:24 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:24.905+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:25.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:24 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:24.905+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:25.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:24 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:24.905+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:25.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:24 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:24.905+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:25.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:24 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:24.905+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:25.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:24 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:24.905+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:25.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:24.786+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:25.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:24.786+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:25.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:24.786+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:25.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:24.786+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:25.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:24.786+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:25.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:24 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:24.786+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:57.200577+0000 front 2026-02-20T13:34:57.200541+0000 (oldest deadline 2026-02-20T13:35:21.900545+0000) 2026-02-20T13:35:26.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:25 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:25.926+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:26.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:25 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:25.926+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:26.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:25 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:25.926+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:26.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:25 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:25.926+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:26.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:25 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:25.926+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:26.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:25 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:25.926+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:26.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:25 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:25.830+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:26.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:25 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:25.830+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:26.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:25 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:25.830+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:26.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:25 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:25.830+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:26.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:25 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:25.830+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:26.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:25 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:25.830+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:57.200577+0000 front 2026-02-20T13:34:57.200541+0000 (oldest deadline 2026-02-20T13:35:21.900545+0000) 2026-02-20T13:35:27.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:26 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:26.915+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:27.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:26 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:26.915+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:27.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:26 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:26.915+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:27.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:26 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:26.915+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:27.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:26 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:26.915+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:27.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:26 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:26.915+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:27.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:26 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:26.869+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:27.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:26 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:26.869+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:27.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:26 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:26.869+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:27.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:26 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:26.869+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:27.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:26 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:26.869+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:27.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:26 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:26.869+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:57.200577+0000 front 2026-02-20T13:34:57.200541+0000 (oldest deadline 2026-02-20T13:35:21.900545+0000) 2026-02-20T13:35:28.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:27 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:27.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:28.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:27 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:27.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:28.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:27 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:27.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:28.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:27 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:27.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:28.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:27 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:27.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:28.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:27 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:27.884+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:28.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:27 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:27.868+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:30.999022+0000 front 2026-02-20T13:34:30.998993+0000 (oldest deadline 2026-02-20T13:34:54.498972+0000) 2026-02-20T13:35:28.240 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:27 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:27.868+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:34.499131+0000 front 2026-02-20T13:34:34.499112+0000 (oldest deadline 2026-02-20T13:34:59.199190+0000) 2026-02-20T13:35:28.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:27 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:27.868+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:42.099680+0000 front 2026-02-20T13:34:42.099625+0000 (oldest deadline 2026-02-20T13:35:03.799633+0000) 2026-02-20T13:35:28.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:27 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:27.868+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:43.799833+0000 front 2026-02-20T13:34:43.799830+0000 (oldest deadline 2026-02-20T13:35:09.699792+0000) 2026-02-20T13:35:28.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:27 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:27.868+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:53.700265+0000 front 2026-02-20T13:34:53.700251+0000 (oldest deadline 2026-02-20T13:35:17.200334+0000) 2026-02-20T13:35:28.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:27 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:27.868+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:57.200577+0000 front 2026-02-20T13:34:57.200541+0000 (oldest deadline 2026-02-20T13:35:21.900545+0000) 2026-02-20T13:35:28.241 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:27 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10[86093]: 2026-02-20T13:35:27.868+0000 7f92bf278640 -1 osd.10 83 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T13:35:04.601396+0000 front 2026-02-20T13:35:04.601331+0000 (oldest deadline 2026-02-20T13:35:26.901268+0000) 2026-02-20T13:35:28.675 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 podman[98021]: 2026-02-20 13:35:28.388426243 +0000 UTC m=+5.080799950 container died 1b73ea671a2f549b346308264f93a8dcb770e70919d6cc4d8762471c6bba0deb (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260219.125903, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T13:35:28.675 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 podman[98021]: 2026-02-20 13:35:28.397327402 +0000 UTC m=+5.089701109 container remove 1b73ea671a2f549b346308264f93a8dcb770e70919d6cc4d8762471c6bba0deb (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260219.125903, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2026-02-20T13:35:28.675 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 bash[98021]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10 2026-02-20T13:35:28.676 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 podman[98151]: 2026-02-20 13:35:28.524006322 +0000 UTC m=+0.015715125 container create a9debee5f00c09bd81444441814949fdbf71b667739f61fc604b46afe6b4fb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True) 2026-02-20T13:35:28.676 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 podman[98151]: 2026-02-20 13:35:28.550156411 +0000 UTC m=+0.041865134 container init a9debee5f00c09bd81444441814949fdbf71b667739f61fc604b46afe6b4fb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10-deactivate, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, ceph=True) 2026-02-20T13:35:28.676 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 podman[98151]: 2026-02-20 13:35:28.552851002 +0000 UTC m=+0.044559735 container start a9debee5f00c09bd81444441814949fdbf71b667739f61fc604b46afe6b4fb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10-deactivate, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260219.125903, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2) 2026-02-20T13:35:28.676 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 podman[98151]: 2026-02-20 13:35:28.553457758 +0000 UTC m=+0.045166491 container attach a9debee5f00c09bd81444441814949fdbf71b667739f61fc604b46afe6b4fb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260219.125903, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e) 2026-02-20T13:35:28.676 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 podman[98151]: 2026-02-20 13:35:28.51720514 +0000 UTC m=+0.008913873 image pull 8ba129fe2622710ee6e72fc30a86d438f7bb54f8677eedfe7464f6d66fe8dfdb quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6 2026-02-20T13:35:28.676 INFO:journalctl@ceph.osd.10.trial034.stdout:Feb 20 13:35:28 trial034 podman[98151]: 2026-02-20 13:35:28.673820117 +0000 UTC m=+0.165528850 container died a9debee5f00c09bd81444441814949fdbf71b667739f61fc604b46afe6b4fb31 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-10-deactivate, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.license=GPLv2) 2026-02-20T13:35:28.708 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.10.service' 2026-02-20T13:35:28.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:28.786 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-20T13:35:28.786 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-20T13:35:28.786 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.11 2026-02-20T13:35:29.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 systemd[1]: Stopping Ceph osd.11 for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:29.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.881+0000 7f9cbb265640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-20T13:35:29.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.881+0000 7f9cbb265640 -1 osd.11 83 *** Got signal Terminated *** 2026-02-20T13:35:29.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.881+0000 7f9cbb265640 -1 osd.11 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T13:35:29.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.928+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:29.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.928+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:29.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.928+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:29.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.928+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:29.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.928+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:29.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:28 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:28.928+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:30.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:29 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:29.958+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:30.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:29 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:29.958+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:30.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:29 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:29.958+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:30.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:29 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:29.958+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:30.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:29 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:29.958+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:30.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:29 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:29.958+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:31.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:30 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:30.921+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:31.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:30 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:30.921+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:31.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:30 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:30.921+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:31.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:30 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:30.921+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:31.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:30 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:30.921+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:31.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:30 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:30.921+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:32.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:31 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:31.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:32.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:31 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:31.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:32.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:31 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:31.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:32.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:31 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:31.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:32.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:31 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:31.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:32.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:31 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:31.880+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:33.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:32 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:32.849+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:33.227 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:32 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:32.849+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:33.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:32 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:32.849+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:33.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:32 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:32.849+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:33.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:32 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:32.849+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:33.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:32 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:32.849+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:33.228 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:32 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:32.849+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6820 osd.7 since back 2026-02-20T13:35:07.058457+0000 front 2026-02-20T13:35:07.058501+0000 (oldest deadline 2026-02-20T13:35:32.358460+0000) 2026-02-20T13:35:34.093 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:33.835+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T13:34:29.855746+0000 front 2026-02-20T13:34:29.855945+0000 (oldest deadline 2026-02-20T13:34:51.555742+0000) 2026-02-20T13:35:34.093 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:33.835+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6804 osd.1 since back 2026-02-20T13:34:35.056216+0000 front 2026-02-20T13:34:35.056084+0000 (oldest deadline 2026-02-20T13:34:59.156145+0000) 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:33.835+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6804 osd.2 since back 2026-02-20T13:34:39.156299+0000 front 2026-02-20T13:34:39.156279+0000 (oldest deadline 2026-02-20T13:35:04.456414+0000) 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:33.835+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T13:34:47.956930+0000 front 2026-02-20T13:34:47.956936+0000 (oldest deadline 2026-02-20T13:35:10.256934+0000) 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:33.835+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6812 osd.4 since back 2026-02-20T13:34:50.257176+0000 front 2026-02-20T13:34:50.257162+0000 (oldest deadline 2026-02-20T13:35:15.557217+0000) 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:33.835+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.127:6812 osd.5 since back 2026-02-20T13:34:55.557379+0000 front 2026-02-20T13:34:55.557390+0000 (oldest deadline 2026-02-20T13:35:23.757751+0000) 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11[86993]: 2026-02-20T13:35:33.835+0000 7f9cb3925640 -1 osd.11 83 heartbeat_check: no reply from 10.20.193.34:6820 osd.7 since back 2026-02-20T13:35:07.058457+0000 front 2026-02-20T13:35:07.058501+0000 (oldest deadline 2026-02-20T13:35:32.358460+0000) 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 podman[103081]: 2026-02-20 13:35:33.951954602 +0000 UTC m=+5.082032871 container died 01f55771a6ba6d6a8d2b113f3d26b67d078cb3f5d4c852694db73229076eb5b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260219.125903, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e) 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 podman[103081]: 2026-02-20 13:35:33.960334516 +0000 UTC m=+5.090412785 container remove 01f55771a6ba6d6a8d2b113f3d26b67d078cb3f5d4c852694db73229076eb5b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260219.125903, OSD_FLAVOR=default, org.label-schema.license=GPLv2) 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:33 trial127 bash[103081]: ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11 2026-02-20T13:35:34.094 INFO:journalctl@ceph.osd.11.trial127.stdout:Feb 20 13:35:34 trial127 podman[103209]: 2026-02-20 13:35:34.091983232 +0000 UTC m=+0.017105502 container create fe1a86239c7c8d786be229b2dac7dc64fdcbbcb12601d9ef50a039f55a09c126 (image=quay.ceph.io/ceph-ci/ceph@sha256:15a46c4844de5b5a76d5df85efb22863f21869977c73bd4cd83e6af9709e44e6, name=ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-osd-11-deactivate, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260219.125903, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_SHA1=0917c15888a16c5bbbd9de28990cc81230360c9e, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T13:35:34.281 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@osd.11.service' 2026-02-20T13:35:34.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:34.319 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-20T13:35:34.319 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-20T13:35:34.319 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.a 2026-02-20T13:35:34.851 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 13:35:34 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-a[101200]: 2026-02-20T13:35:34.510+0000 7fd8555de640 -1 mds.a *** got signal Terminated *** 2026-02-20T13:35:35.645 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.a.service' 2026-02-20T13:35:35.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:35.713 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-20T13:35:35.713 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-20T13:35:35.713 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.d 2026-02-20T13:35:36.100 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:35:35 trial028 systemd[1]: Stopping Ceph mds.d for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:36.100 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:35:35 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d[100378]: 2026-02-20T13:35:35.937+0000 7f300d568640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:36.100 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 13:35:35 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-d[100378]: 2026-02-20T13:35:35.937+0000 7f300d568640 -1 mds.d *** got signal Terminated *** 2026-02-20T13:35:37.064 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.d.service' 2026-02-20T13:35:37.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:37.133 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-20T13:35:37.134 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-20T13:35:37.134 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.g 2026-02-20T13:35:37.600 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:35:37 trial028 systemd[1]: Stopping Ceph mds.g for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:37.600 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:35:37 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g[100855]: 2026-02-20T13:35:37.317+0000 7f83e0c22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:37.600 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 13:35:37 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-g[100855]: 2026-02-20T13:35:37.317+0000 7f83e0c22640 -1 mds.g *** got signal Terminated *** 2026-02-20T13:35:38.441 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.g.service' 2026-02-20T13:35:38.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:38.506 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-20T13:35:38.506 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-20T13:35:38.506 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.j 2026-02-20T13:35:38.850 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:35:38 trial028 systemd[1]: Stopping Ceph mds.j for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:38.850 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:35:38 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-j[100080]: 2026-02-20T13:35:38.694+0000 7f39df709640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:38.850 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 13:35:38 trial028 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-j[100080]: 2026-02-20T13:35:38.694+0000 7f39df709640 -1 mds.j *** got signal Terminated *** 2026-02-20T13:35:39.819 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.j.service' 2026-02-20T13:35:39.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:39.883 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-20T13:35:39.884 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-20T13:35:39.884 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.b 2026-02-20T13:35:40.240 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:35:39 trial034 systemd[1]: Stopping Ceph mds.b for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:40.240 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:35:39 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: 2026-02-20T13:35:39.978+0000 7f043dbe2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:40.240 INFO:journalctl@ceph.mds.b.trial034.stdout:Feb 20 13:35:39 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-b[92710]: 2026-02-20T13:35:39.978+0000 7f043dbe2640 -1 mds.b *** got signal Terminated *** 2026-02-20T13:35:41.009 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.b.service' 2026-02-20T13:35:41.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:41.043 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-20T13:35:41.043 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-20T13:35:41.044 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.e 2026-02-20T13:35:41.240 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:35:41 trial034 systemd[1]: Stopping Ceph mds.e for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:41.240 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:35:41 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e[92037]: 2026-02-20T13:35:41.170+0000 7fe117690640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:41.240 INFO:journalctl@ceph.mds.e.trial034.stdout:Feb 20 13:35:41 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-e[92037]: 2026-02-20T13:35:41.170+0000 7fe117690640 -1 mds.e *** got signal Terminated *** 2026-02-20T13:35:42.211 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.e.service' 2026-02-20T13:35:42.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:42.244 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-20T13:35:42.244 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-20T13:35:42.244 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.h 2026-02-20T13:35:42.490 INFO:journalctl@ceph.mds.h.trial034.stdout:Feb 20 13:35:42 trial034 systemd[1]: Stopping Ceph mds.h for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:42.491 INFO:journalctl@ceph.mds.h.trial034.stdout:Feb 20 13:35:42 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-h[92374]: 2026-02-20T13:35:42.375+0000 7f83ee2d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:42.491 INFO:journalctl@ceph.mds.h.trial034.stdout:Feb 20 13:35:42 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-h[92374]: 2026-02-20T13:35:42.375+0000 7f83ee2d1640 -1 mds.h *** got signal Terminated *** 2026-02-20T13:35:43.409 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.h.service' 2026-02-20T13:35:43.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:43.440 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-20T13:35:43.441 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-20T13:35:43.441 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.k 2026-02-20T13:35:43.741 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:35:43 trial034 systemd[1]: Stopping Ceph mds.k for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:43.741 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:35:43 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-k[91699]: 2026-02-20T13:35:43.573+0000 7f4a53884640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:43.741 INFO:journalctl@ceph.mds.k.trial034.stdout:Feb 20 13:35:43 trial034 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-k[91699]: 2026-02-20T13:35:43.573+0000 7f4a53884640 -1 mds.k *** got signal Terminated *** 2026-02-20T13:35:44.614 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.k.service' 2026-02-20T13:35:44.646 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:44.647 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-20T13:35:44.647 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-20T13:35:44.647 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.c 2026-02-20T13:35:44.977 INFO:journalctl@ceph.mds.c.trial127.stdout:Feb 20 13:35:44 trial127 systemd[1]: Stopping Ceph mds.c for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:44.977 INFO:journalctl@ceph.mds.c.trial127.stdout:Feb 20 13:35:44 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-c[96963]: 2026-02-20T13:35:44.748+0000 7f5ec1eed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:44.977 INFO:journalctl@ceph.mds.c.trial127.stdout:Feb 20 13:35:44 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-c[96963]: 2026-02-20T13:35:44.748+0000 7f5ec1eed640 -1 mds.c *** got signal Terminated *** 2026-02-20T13:35:45.798 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.c.service' 2026-02-20T13:35:45.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:45.832 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-20T13:35:45.832 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-20T13:35:45.832 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.f 2026-02-20T13:35:45.968 INFO:journalctl@ceph.mds.f.trial127.stdout:Feb 20 13:35:45 trial127 systemd[1]: Stopping Ceph mds.f for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:46.227 INFO:journalctl@ceph.mds.f.trial127.stdout:Feb 20 13:35:45 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-f[96630]: 2026-02-20T13:35:45.966+0000 7f4fe0daf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:46.227 INFO:journalctl@ceph.mds.f.trial127.stdout:Feb 20 13:35:45 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-f[96630]: 2026-02-20T13:35:45.966+0000 7f4fe0daf640 -1 mds.f *** got signal Terminated *** 2026-02-20T13:35:47.006 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.f.service' 2026-02-20T13:35:47.040 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:47.040 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-20T13:35:47.040 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-20T13:35:47.040 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.i 2026-02-20T13:35:47.227 INFO:journalctl@ceph.mds.i.trial127.stdout:Feb 20 13:35:47 trial127 systemd[1]: Stopping Ceph mds.i for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:47.228 INFO:journalctl@ceph.mds.i.trial127.stdout:Feb 20 13:35:47 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-i[97304]: 2026-02-20T13:35:47.170+0000 7f8b69450640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:47.228 INFO:journalctl@ceph.mds.i.trial127.stdout:Feb 20 13:35:47 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-i[97304]: 2026-02-20T13:35:47.170+0000 7f8b69450640 -1 mds.i *** got signal Terminated *** 2026-02-20T13:35:48.216 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.i.service' 2026-02-20T13:35:48.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:48.249 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-20T13:35:48.249 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-20T13:35:48.249 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.l 2026-02-20T13:35:48.389 INFO:journalctl@ceph.mds.l.trial127.stdout:Feb 20 13:35:48 trial127 systemd[1]: Stopping Ceph mds.l for dd845518-0e5d-11f1-9909-d404e6e7d460... 2026-02-20T13:35:48.727 INFO:journalctl@ceph.mds.l.trial127.stdout:Feb 20 13:35:48 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-l[96287]: 2026-02-20T13:35:48.386+0000 7f4c3fe9a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T13:35:48.727 INFO:journalctl@ceph.mds.l.trial127.stdout:Feb 20 13:35:48 trial127 ceph-dd845518-0e5d-11f1-9909-d404e6e7d460-mds-l[96287]: 2026-02-20T13:35:48.386+0000 7f4c3fe9a640 -1 mds.l *** got signal Terminated *** 2026-02-20T13:35:49.427 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd845518-0e5d-11f1-9909-d404e6e7d460@mds.l.service' 2026-02-20T13:35:49.460 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T13:35:49.460 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-20T13:35:49.460 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 --force --keep-logs 2026-02-20T13:35:49.649 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:35:52.886 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 --force --keep-logs 2026-02-20T13:35:53.006 INFO:teuthology.orchestra.run.trial034.stdout:Deleting cluster with fsid: dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:35:54.817 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 --force --keep-logs 2026-02-20T13:35:54.939 INFO:teuthology.orchestra.run.trial127.stdout:Deleting cluster with fsid: dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:35:56.772 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:35:56.834 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:35:56.861 DEBUG:teuthology.orchestra.run.trial127:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T13:35:56.889 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-20T13:35:56.892 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial028/crash 2026-02-20T13:35:56.893 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash -- . 2026-02-20T13:35:56.949 INFO:teuthology.orchestra.run.trial028.stderr:tar: /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-20T13:35:56.949 INFO:teuthology.orchestra.run.trial028.stderr:tar: Error is not recoverable: exiting now 2026-02-20T13:35:56.952 DEBUG:teuthology.misc:Transferring archived files from trial034:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial034/crash 2026-02-20T13:35:56.954 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash -- . 2026-02-20T13:35:56.980 INFO:teuthology.orchestra.run.trial034.stderr:tar: /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-20T13:35:56.980 INFO:teuthology.orchestra.run.trial034.stderr:tar: Error is not recoverable: exiting now 2026-02-20T13:35:56.984 DEBUG:teuthology.misc:Transferring archived files from trial127:/var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial127/crash 2026-02-20T13:35:56.985 DEBUG:teuthology.orchestra.run.trial127:> sudo tar c -f - -C /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash -- . 2026-02-20T13:35:57.012 INFO:teuthology.orchestra.run.trial127.stderr:tar: /var/lib/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-20T13:35:57.012 INFO:teuthology.orchestra.run.trial127.stderr:tar: Error is not recoverable: exiting now 2026-02-20T13:35:57.013 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-20T13:35:57.014 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-20T13:35:57.075 INFO:tasks.cephadm:Compressing logs... 2026-02-20T13:35:57.076 DEBUG:teuthology.orchestra.run.trial028:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:35:57.079 DEBUG:teuthology.orchestra.run.trial034:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:35:57.082 DEBUG:teuthology.orchestra.run.trial127:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:35:57.105 INFO:teuthology.orchestra.run.trial034.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory 2026-02-20T13:35:57.105 INFO:teuthology.orchestra.run.trial034.stderr: /var/log/ceph/cephadm.log 2026-02-20T13:35:57.105 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.y.log 2026-02-20T13:35:57.105 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.b.log 2026-02-20T13:35:57.105 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.h.log 2026-02-20T13:35:57.109 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.7.log 2026-02-20T13:35:57.109 INFO:teuthology.orchestra.run.trial034.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-20T13:35:57.109 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log 2026-02-20T13:35:57.109 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.10.log 2026-02-20T13:35:57.109 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.4.log 2026-02-20T13:35:57.109 INFO:teuthology.orchestra.run.trial034.stderr: 85.2% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log.gz 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.b.log 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.1.log 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.k.log 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr: 90.8% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log.gz 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.e.log 2026-02-20T13:35:57.110 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.k.log: 92.3% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-20T13:35:57.111 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.e.log: 87.6% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log.gz 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.2.log 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.i.log 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.c.log 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.i.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.f.log 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.5.log 2026-02-20T13:35:57.115 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.11.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log: /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr: 85.1% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log.gz 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.z.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr:gzip/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log: -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.l.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.c.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr:gzip/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.c.log: -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.8.log 2026-02-20T13:35:57.116 INFO:teuthology.orchestra.run.trial127.stderr: 90.8% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log.gz 2026-02-20T13:35:57.117 INFO:teuthology.orchestra.run.trial034.stderr: 93.7% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log.gz 2026-02-20T13:35:57.117 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log: /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.8.log: 87.6% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log.gz 2026-02-20T13:35:57.118 INFO:teuthology.orchestra.run.trial127.stderr: 95.1% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.l.log.gz 2026-02-20T13:35:57.118 INFO:teuthology.orchestra.run.trial127.stderr: 92.3% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-20T13:35:57.119 INFO:teuthology.orchestra.run.trial127.stderr: 93.8% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log.gz 2026-02-20T13:35:57.131 INFO:teuthology.orchestra.run.trial028.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2026-02-20T13:35:57.131 INFO:teuthology.orchestra.run.trial028.stderr: -- /var/log/ceph/cephadm.log 2026-02-20T13:35:57.132 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.a.log 2026-02-20T13:35:57.132 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.d.log 2026-02-20T13:35:57.133 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.j.log 2026-02-20T13:35:57.133 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.0.log 2026-02-20T13:35:57.134 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.d.log: /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.3.log 2026-02-20T13:35:57.135 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log 2026-02-20T13:35:57.136 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.a.log 2026-02-20T13:35:57.137 INFO:teuthology.orchestra.run.trial028.stderr:gzip/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log: -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.g.log 2026-02-20T13:35:57.137 INFO:teuthology.orchestra.run.trial028.stderr: 94.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-20T13:35:57.137 INFO:teuthology.orchestra.run.trial028.stderr: 84.1% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.cephadm.log.gz 2026-02-20T13:35:57.140 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.g.log: /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log 2026-02-20T13:35:57.140 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log 2026-02-20T13:35:57.140 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.6.log 2026-02-20T13:35:57.142 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log: 90.6% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.audit.log.gz 2026-02-20T13:35:57.143 INFO:teuthology.orchestra.run.trial034.stderr: 94.8% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.k.log.gz 2026-02-20T13:35:57.144 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.6.log: 95.0% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.a.log.gz 2026-02-20T13:35:57.146 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.x.log 2026-02-20T13:35:57.146 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log 2026-02-20T13:35:57.149 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.x.log: /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.9.log 2026-02-20T13:35:57.150 INFO:teuthology.orchestra.run.trial028.stderr: 93.8% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-volume.log.gz 2026-02-20T13:35:57.151 INFO:teuthology.orchestra.run.trial034.stderr: 94.6% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.e.log.gz 2026-02-20T13:35:57.153 INFO:teuthology.orchestra.run.trial127.stderr: 94.4% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.f.log.gz 2026-02-20T13:35:57.156 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.9.log: 87.6% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph.log.gz 2026-02-20T13:35:57.160 INFO:teuthology.orchestra.run.trial034.stderr: 92.7% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.h.log.gz 2026-02-20T13:35:57.190 INFO:teuthology.orchestra.run.trial028.stderr: 94.6% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.d.log.gz 2026-02-20T13:35:57.193 INFO:teuthology.orchestra.run.trial028.stderr: 92.7% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.j.log.gz 2026-02-20T13:35:57.224 INFO:teuthology.orchestra.run.trial127.stderr: 93.8% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.c.log.gz 2026-02-20T13:35:57.243 INFO:teuthology.orchestra.run.trial028.stderr: 92.5% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.g.log.gz 2026-02-20T13:35:57.312 INFO:teuthology.orchestra.run.trial028.stderr: 90.3% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-20T13:35:57.339 INFO:teuthology.orchestra.run.trial127.stderr: 92.7% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.i.log.gz 2026-02-20T13:35:57.341 INFO:teuthology.orchestra.run.trial127.stderr: 92.0% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.c.log.gz 2026-02-20T13:35:57.355 INFO:teuthology.orchestra.run.trial034.stderr: 91.7% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.b.log.gz 2026-02-20T13:35:57.511 INFO:teuthology.orchestra.run.trial034.stderr: 92.3% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.4.log.gz 2026-02-20T13:35:57.523 INFO:teuthology.orchestra.run.trial127.stderr: 92.3% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.8.log.gz 2026-02-20T13:35:57.574 INFO:teuthology.orchestra.run.trial127.stderr: 92.2% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.11.log.gz 2026-02-20T13:35:57.609 INFO:teuthology.orchestra.run.trial028.stderr: 92.3% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.3.log.gz 2026-02-20T13:35:57.622 INFO:teuthology.orchestra.run.trial034.stderr: 92.2% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.7.log.gz 2026-02-20T13:35:57.638 INFO:teuthology.orchestra.run.trial028.stderr: 92.2% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.0.log.gz 2026-02-20T13:35:57.700 INFO:teuthology.orchestra.run.trial034.stderr: 91.9% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.1.log.gz 2026-02-20T13:35:57.710 INFO:teuthology.orchestra.run.trial028.stderr: 91.1% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.9.log.gz 2026-02-20T13:35:57.758 INFO:teuthology.orchestra.run.trial028.stderr: 91.3% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.6.log.gz 2026-02-20T13:35:57.777 INFO:teuthology.orchestra.run.trial028.stderr: 90.3% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mon.a.log.gz 2026-02-20T13:35:57.780 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-20T13:35:57.780 INFO:teuthology.orchestra.run.trial028.stderr:real 0m0.668s 2026-02-20T13:35:57.780 INFO:teuthology.orchestra.run.trial028.stderr:user 0m2.805s 2026-02-20T13:35:57.780 INFO:teuthology.orchestra.run.trial028.stderr:sys 0m0.392s 2026-02-20T13:35:57.809 INFO:teuthology.orchestra.run.trial127.stderr: 91.9% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.5.log.gz 2026-02-20T13:35:58.050 INFO:teuthology.orchestra.run.trial034.stderr: 92.8% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-mds.b.log.gz 2026-02-20T13:35:58.079 INFO:teuthology.orchestra.run.trial127.stderr: 91.2% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.2.log.gz 2026-02-20T13:35:58.081 INFO:teuthology.orchestra.run.trial127.stderr: 2026-02-20T13:35:58.081 INFO:teuthology.orchestra.run.trial127.stderr:real 0m0.981s 2026-02-20T13:35:58.081 INFO:teuthology.orchestra.run.trial127.stderr:user 0m3.003s 2026-02-20T13:35:58.081 INFO:teuthology.orchestra.run.trial127.stderr:sys 0m0.173s 2026-02-20T13:35:58.094 INFO:teuthology.orchestra.run.trial034.stderr: 91.7% -- replaced with /var/log/ceph/dd845518-0e5d-11f1-9909-d404e6e7d460/ceph-osd.10.log.gz 2026-02-20T13:35:58.096 INFO:teuthology.orchestra.run.trial034.stderr: 2026-02-20T13:35:58.096 INFO:teuthology.orchestra.run.trial034.stderr:real 0m1.000s 2026-02-20T13:35:58.096 INFO:teuthology.orchestra.run.trial034.stderr:user 0m3.670s 2026-02-20T13:35:58.096 INFO:teuthology.orchestra.run.trial034.stderr:sys 0m0.188s 2026-02-20T13:35:58.097 INFO:tasks.cephadm:Archiving logs... 2026-02-20T13:35:58.097 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial028/log 2026-02-20T13:35:58.098 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T13:35:58.435 DEBUG:teuthology.misc:Transferring archived files from trial034:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial034/log 2026-02-20T13:35:58.436 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T13:35:58.806 DEBUG:teuthology.misc:Transferring archived files from trial127:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial127/log 2026-02-20T13:35:58.807 DEBUG:teuthology.orchestra.run.trial127:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T13:35:59.140 INFO:tasks.cephadm:Removing cluster... 2026-02-20T13:35:59.140 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 --force 2026-02-20T13:35:59.328 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:35:59.613 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 --force 2026-02-20T13:35:59.732 INFO:teuthology.orchestra.run.trial034.stdout:Deleting cluster with fsid: dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:35:59.895 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dd845518-0e5d-11f1-9909-d404e6e7d460 --force 2026-02-20T13:36:00.014 INFO:teuthology.orchestra.run.trial127.stdout:Deleting cluster with fsid: dd845518-0e5d-11f1-9909-d404e6e7d460 2026-02-20T13:36:00.191 INFO:tasks.cephadm:Removing cephadm ... 2026-02-20T13:36:00.192 DEBUG:teuthology.orchestra.run.trial028:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-20T13:36:00.233 DEBUG:teuthology.orchestra.run.trial034:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-20T13:36:00.252 DEBUG:teuthology.orchestra.run.trial127:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-20T13:36:00.269 INFO:tasks.cephadm:Teardown complete 2026-02-20T13:36:00.270 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T13:36:00.277 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T13:36:00.277 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T13:36:00.280 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T13:36:00.294 DEBUG:teuthology.orchestra.run.trial127:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T13:36:00.553 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T13:36:00.564 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T13:36:00.564 DEBUG:teuthology.orchestra.run.trial028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:36:00.567 DEBUG:teuthology.orchestra.run.trial034:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:36:00.569 DEBUG:teuthology.orchestra.run.trial127:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:36:00.583 INFO:teuthology.orchestra.run.trial034.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:36:00.585 INFO:teuthology.orchestra.run.trial127.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:36:00.601 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:36:01.003 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:36:01.003 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-20T13:36:01.003 INFO:teuthology.orchestra.run.trial028.stdout:^+ 69.9.131.124 2 7 377 114 +6006us[+5993us] +/- 90ms 2026-02-20T13:36:01.003 INFO:teuthology.orchestra.run.trial028.stdout:^* sensei.ruselabs.com 2 7 377 110 -1569us[-1582us] +/- 37ms 2026-02-20T13:36:01.003 INFO:teuthology.orchestra.run.trial028.stdout:^+ 72-14-182-49.ip.linodeus> 2 6 377 46 -856us[ -856us] +/- 82ms 2026-02-20T13:36:01.003 INFO:teuthology.orchestra.run.trial028.stdout:^+ 23.157.160.168 2 6 377 49 -751us[ -751us] +/- 57ms 2026-02-20T13:36:05.998 INFO:teuthology.orchestra.run.trial034.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:36:05.998 INFO:teuthology.orchestra.run.trial034.stdout:=============================================================================== 2026-02-20T13:36:05.998 INFO:teuthology.orchestra.run.trial034.stdout:^- 144.202.41.38.vultruserc> 2 7 377 111 +1163us[+1163us] +/- 38ms 2026-02-20T13:36:05.998 INFO:teuthology.orchestra.run.trial034.stdout:^- usmoi.meezy.link 2 6 377 48 -850us[ -850us] +/- 23ms 2026-02-20T13:36:05.999 INFO:teuthology.orchestra.run.trial034.stdout:^* ntp.netlinkify.com 2 7 377 112 -34us[ -49us] +/- 7381us 2026-02-20T13:36:05.999 INFO:teuthology.orchestra.run.trial034.stdout:^- t2.time.gq1.yahoo.com 2 7 377 45 -36ms[ -36ms] +/- 69ms 2026-02-20T13:36:06.001 INFO:teuthology.orchestra.run.trial127.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:36:06.001 INFO:teuthology.orchestra.run.trial127.stdout:=============================================================================== 2026-02-20T13:36:06.001 INFO:teuthology.orchestra.run.trial127.stdout:^- 172-232-15-202.ip.linode> 2 6 377 46 -6192us[-6192us] +/- 76ms 2026-02-20T13:36:06.001 INFO:teuthology.orchestra.run.trial127.stdout:^* 99-28-14-242.lightspeed.> 1 7 377 109 +1109us[+1081us] +/- 14ms 2026-02-20T13:36:06.001 INFO:teuthology.orchestra.run.trial127.stdout:^+ time.trtnw.net 2 6 377 46 -269us[ -269us] +/- 37ms 2026-02-20T13:36:06.001 INFO:teuthology.orchestra.run.trial127.stdout:^+ jane.qotw.net 2 7 377 110 -863us[ -891us] +/- 23ms 2026-02-20T13:36:06.001 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T13:36:06.020 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T13:36:06.021 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T13:36:06.039 DEBUG:teuthology.orchestra.run.trial028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T13:36:06.163 DEBUG:teuthology.orchestra.run.trial034:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T13:36:06.222 DEBUG:teuthology.orchestra.run.trial127:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T13:36:06.282 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-20T13:36:06.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:36:06.344 DEBUG:teuthology.orchestra.run.trial034:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-20T13:36:06.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:36:06.371 DEBUG:teuthology.orchestra.run.trial127:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-20T13:36:06.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:36:06.400 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T13:36:06.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T13:36:06.433 INFO:teuthology.task.internal:Duration was 1712.279552 seconds 2026-02-20T13:36:06.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T13:36:06.449 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T13:36:06.449 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T13:36:06.454 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T13:36:06.456 DEBUG:teuthology.orchestra.run.trial127:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T13:36:06.492 INFO:teuthology.orchestra.run.trial034.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:36:06.493 INFO:teuthology.orchestra.run.trial127.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:36:06.532 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:36:06.779 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T13:36:06.780 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial028.front.sepia.ceph.com 2026-02-20T13:36:06.780 DEBUG:teuthology.orchestra.run.trial028:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T13:36:06.827 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial034.front.sepia.ceph.com 2026-02-20T13:36:06.827 DEBUG:teuthology.orchestra.run.trial034:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T13:36:06.845 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial127.front.sepia.ceph.com 2026-02-20T13:36:06.845 DEBUG:teuthology.orchestra.run.trial127:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T13:36:06.865 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T13:36:06.865 DEBUG:teuthology.orchestra.run.trial028:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:36:06.868 DEBUG:teuthology.orchestra.run.trial034:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:36:06.888 DEBUG:teuthology.orchestra.run.trial127:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:36:07.909 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T13:36:07.909 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:36:07.913 DEBUG:teuthology.orchestra.run.trial034:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:36:07.916 DEBUG:teuthology.orchestra.run.trial127:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:36:07.938 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:36:07.939 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:36:07.939 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T13:36:07.939 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:36:07.939 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T13:36:07.941 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:36:07.943 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:36:07.943 INFO:teuthology.orchestra.run.trial127.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:36:07.943 INFO:teuthology.orchestra.run.trial127.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T13:36:07.943 INFO:teuthology.orchestra.run.trial127.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T13:36:07.959 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T13:36:07.963 INFO:teuthology.orchestra.run.trial127.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T13:36:07.965 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:36:07.966 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:36:07.966 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:36:07.967 INFO:teuthology.orchestra.run.trial028.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T13:36:07.967 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T13:36:08.143 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 91.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T13:36:08.146 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T13:36:08.158 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T13:36:08.158 DEBUG:teuthology.orchestra.run.trial028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T13:36:08.215 DEBUG:teuthology.orchestra.run.trial034:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T13:36:08.240 DEBUG:teuthology.orchestra.run.trial127:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T13:36:08.267 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T13:36:08.278 DEBUG:teuthology.orchestra.run.trial028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:36:08.281 DEBUG:teuthology.orchestra.run.trial034:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:36:08.283 DEBUG:teuthology.orchestra.run.trial127:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:36:08.305 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern = core 2026-02-20T13:36:08.331 INFO:teuthology.orchestra.run.trial127.stdout:kernel.core_pattern = core 2026-02-20T13:36:08.352 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = core 2026-02-20T13:36:08.379 DEBUG:teuthology.orchestra.run.trial028:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:36:08.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:36:08.415 DEBUG:teuthology.orchestra.run.trial034:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:36:08.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:36:08.433 DEBUG:teuthology.orchestra.run.trial127:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:36:08.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:36:08.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T13:36:08.462 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T13:36:08.463 DEBUG:teuthology.misc:Transferring archived files from trial028:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial028 2026-02-20T13:36:08.463 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T13:36:08.541 DEBUG:teuthology.misc:Transferring archived files from trial034:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial034 2026-02-20T13:36:08.541 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T13:36:08.577 DEBUG:teuthology.misc:Transferring archived files from trial127:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/remote/trial127 2026-02-20T13:36:08.577 DEBUG:teuthology.orchestra.run.trial127:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T13:36:08.616 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T13:36:08.616 DEBUG:teuthology.orchestra.run.trial028:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T13:36:08.620 DEBUG:teuthology.orchestra.run.trial034:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T13:36:08.623 DEBUG:teuthology.orchestra.run.trial127:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T13:36:08.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T13:36:08.677 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T13:36:08.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T13:36:08.692 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T13:36:08.692 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T13:36:08.699 DEBUG:teuthology.orchestra.run.trial034:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T13:36:08.703 DEBUG:teuthology.orchestra.run.trial127:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T13:36:08.716 INFO:teuthology.orchestra.run.trial034.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 13:36 /home/ubuntu/cephtest 2026-02-20T13:36:08.720 INFO:teuthology.orchestra.run.trial127.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 13:36 /home/ubuntu/cephtest 2026-02-20T13:36:08.734 INFO:teuthology.orchestra.run.trial028.stdout: 1048605 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 13:36 /home/ubuntu/cephtest 2026-02-20T13:36:08.736 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T13:36:08.758 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T13:36:08.788 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} duration: 1712.2795519828796 flavor: default owner: scheduled_vshankar@soko04.front.sepia.ceph.com success: true 2026-02-20T13:36:08.788 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T13:36:08.888 INFO:teuthology.run:pass